2024-09-16T01:05:57.885 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T01:05:57.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T01:05:58.017 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-limits} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906453' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - responding to mclientcaps\(revoke\) - not advance its oldest_client_tid - failing to advance its oldest client/flush tid - Too many inodes in cache - failing to respond to cache pressure - slow requests are blocked - failing to respond to capability release - MDS cache is too large - \(MDS_CLIENT_OLDEST_TID\) - \(MDS_CACHE_OVERSIZED\) sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOicZ89XDrF4UAJOcgvRW6aqAZMATxJD+N2WFlRBaRbnbPSbDy6ZvmbXu+EyupAECXgUTyDC8AGgGhmtUxZqMsI= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOw7E5jUOd17ArgLa7T4gmHNnqfmQ1oTl+/OVZMU4YzUTgranmKW/sbA2d+O5seKTkc3MPDJ7AVsuQ4dbSu4jHE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_client_limits teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-16T01:05:58.017 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-16T01:05:58.018 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-16T01:05:58.018 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T01:05:58.020 INFO:teuthology.task.internal:Checking packages... 2024-09-16T01:05:58.044 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-16T01:05:58.044 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T01:05:58.044 INFO:teuthology.packaging:ref: None 2024-09-16T01:05:58.044 INFO:teuthology.packaging:tag: None 2024-09-16T01:05:58.044 INFO:teuthology.packaging:branch: squid 2024-09-16T01:05:58.044 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:05:58.044 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-16T01:05:58.293 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-16T01:05:58.295 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T01:05:58.301 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T01:05:58.301 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T01:05:58.308 INFO:teuthology.task.internal:Saving configuration 2024-09-16T01:05:58.328 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T01:05:58.335 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T01:05:58.358 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 01:01:08.814650', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOicZ89XDrF4UAJOcgvRW6aqAZMATxJD+N2WFlRBaRbnbPSbDy6ZvmbXu+EyupAECXgUTyDC8AGgGhmtUxZqMsI='} 2024-09-16T01:05:58.380 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 01:01:08.815928', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOw7E5jUOd17ArgLa7T4gmHNnqfmQ1oTl+/OVZMU4YzUTgranmKW/sbA2d+O5seKTkc3MPDJ7AVsuQ4dbSu4jHE='} 2024-09-16T01:05:58.380 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T01:05:58.386 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-16T01:05:58.386 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-16T01:05:58.386 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T01:05:58.445 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb525433be0>, signals=[15]) 2024-09-16T01:05:58.445 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T01:05:58.452 INFO:teuthology.task.internal:Opening connections... 2024-09-16T01:05:58.453 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:05:58.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:05:58.533 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:05:58.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:05:58.615 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T01:05:58.622 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-16T01:05:58.641 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-16T01:05:58.641 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-16T01:05:58.699 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-09-16T01:05:58.699 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-09-16T01:05:58.699 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-09-16T01:05:58.699 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-09-16T01:05:58.699 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-09-16T01:05:58.700 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-09-16T01:05:58.700 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T01:05:58.700 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-09-16T01:05:58.700 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-09-16T01:05:58.700 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T01:05:58.700 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-09-16T01:05:58.700 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T01:05:58.700 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T01:05:58.700 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T01:05:58.701 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-16T01:05:58.730 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-16T01:05:58.748 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-16T01:05:58.748 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-16T01:05:58.806 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-09-16T01:05:58.806 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-09-16T01:05:58.806 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-09-16T01:05:58.807 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-09-16T01:05:58.807 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-09-16T01:05:58.807 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-09-16T01:05:58.807 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T01:05:58.807 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-09-16T01:05:58.807 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-09-16T01:05:58.807 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T01:05:58.807 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-09-16T01:05:58.807 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T01:05:58.807 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T01:05:58.807 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T01:05:58.808 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-16T01:05:58.838 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T01:05:58.847 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T01:05:58.852 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T01:05:58.852 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-16T01:05:58.855 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-16T01:05:58.872 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T01:05:58.880 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T01:05:58.880 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-16T01:05:58.914 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-16T01:05:59.033 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T01:05:59.084 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T01:05:59.098 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-16T01:05:59.098 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-16T01:05:59.098 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-16T01:05:59.098 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T01:05:59.099 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T01:05:59.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:05:59.116 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-16T01:05:59.117 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:05:59.117 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-16T01:05:59.178 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-503.el9.x86_64 2024-09-16T01:05:59.178 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.14.0-503.el9.x86_64 2024-09-16T01:05:59.178 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2024-09-16T01:05:59.179 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-503.el9.x86_64 2024-09-16T01:05:59.179 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.14.0-503.el9.x86_64 2024-09-16T01:05:59.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2024-09-16T01:06:01.571 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-16T01:06:03.364 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-16T01:06:03.510 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.2 MB 00:02 2024-09-16T01:06:06.620 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:02 2024-09-16T01:06:07.723 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-16T01:06:09.782 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 19 kB 00:00 2024-09-16T01:06:10.561 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-16T01:06:11.220 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 8.3 MB/s | 6.5 MB 00:00 2024-09-16T01:06:12.696 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-16T01:06:13.625 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-16T01:06:15.925 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-16T01:06:17.948 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T01:06:17.948 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T01:06:18.047 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-16T01:06:18.059 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-16T01:06:18.059 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-16T01:06:18.059 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-16T01:06:18.059 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-16T01:06:18.059 INFO:teuthology.orchestra.run.smithi081.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T01:06:18.059 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-16T01:06:18.059 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T01:06:18.059 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T01:06:18.059 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T01:06:18.059 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:06:18.059 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-16T01:06:18.059 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-16T01:06:18.060 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-09-16T01:06:18.060 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:06:18.060 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 79 M 2024-09-16T01:06:18.060 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 126 M 2024-09-16T01:06:18.060 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-16T01:06:18.619 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2024-09-16T01:06:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-16T01:06:19.494 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-16T01:06:20.178 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 16 MB/s | 35 MB 00:02 2024-09-16T01:06:20.903 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-16T01:06:20.903 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:06:20.903 INFO:teuthology.orchestra.run.smithi081.stdout:Total 28 MB/s | 79 MB 00:02 2024-09-16T01:06:21.121 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T01:06:21.121 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T01:06:21.217 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-16T01:06:21.224 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-16T01:06:21.224 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-16T01:06:21.224 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-16T01:06:21.224 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-16T01:06:21.224 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T01:06:21.224 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-16T01:06:21.224 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T01:06:21.225 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T01:06:21.225 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T01:06:21.225 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:06:21.225 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-16T01:06:21.225 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-16T01:06:21.225 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-09-16T01:06:21.225 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:06:21.226 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 79 M 2024-09-16T01:06:21.226 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 126 M 2024-09-16T01:06:21.226 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-16T01:06:21.425 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 319 kB/s | 23 kB 00:00 2024-09-16T01:06:21.586 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-16T01:06:21.833 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-16T01:06:21.952 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-16T01:06:21.953 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-16T01:06:22.642 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-16T01:06:22.918 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-16T01:06:22.919 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-16T01:06:22.934 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 19 MB/s | 29 MB 00:01 2024-09-16T01:06:22.934 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:06:22.934 INFO:teuthology.orchestra.run.smithi102.stdout:Total 46 MB/s | 79 MB 00:01 2024-09-16T01:06:23.620 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-16T01:06:23.985 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-16T01:06:23.985 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-16T01:06:24.926 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-16T01:06:24.926 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-16T01:06:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-16T01:06:26.041 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:06:26.131 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:06:27.371 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-16T01:06:28.085 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:06:28.176 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:06:28.944 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:06:29.084 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:06:30.973 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:06:31.106 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:06:33.890 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:06:33.926 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:06:35.902 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:06:35.940 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:06:38.800 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:06:40.770 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:07:16.830 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:07:16.869 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:07:17.329 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:07:17.329 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:07:17.329 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:07:17.329 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:07:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:07:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:07:18.187 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-16T01:07:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T01:07:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T01:07:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T01:07:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T01:07:18.187 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:07:18.187 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-16T01:07:18.555 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:07:18.631 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:07:18.632 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:07:18.632 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T01:07:18.632 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T01:07:18.633 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T01:07:18.633 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-16T01:07:18.633 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T01:07:18.633 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:07:18.691 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:07:18.692 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:07:18.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-09-16T01:07:18.723 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-09-16T01:07:18.724 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-09-16T01:07:18.724 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-09-16T01:07:18.724 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 82.el9 2024-09-16T01:07:18.724 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-09-16T01:07:18.724 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T01:07:18.724 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-09-16T01:07:18.724 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8274670 2024-09-16T01:07:18.724 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-09-16T01:07:18.724 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T01:07:18.724 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T01:07:18.724 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T01:07:18.725 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T01:07:18.725 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-09-16T01:07:18.725 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-09-16T01:07:18.725 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T01:07:18.725 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-09-16T01:07:18.725 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-09-16T01:07:18.725 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:07:18.725 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T01:07:18.725 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T01:07:18.725 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T01:07:18.725 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-09-16T01:07:18.726 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:07:18.726 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T01:07:18.727 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T01:07:18.727 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 5.14.0-505.el9.x86_64 2024-09-16T01:07:18.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T01:07:18.860 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:07:18.901 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:07:19.186 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:07:19.186 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T01:07:19.186 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T01:07:19.186 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T01:07:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-16T01:07:20.048 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T01:07:20.048 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:07:20.048 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-16T01:07:20.048 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T01:07:20.048 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T01:07:20.048 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T01:07:20.048 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T01:07:20.049 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:07:20.049 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-16T01:07:20.379 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:07:20.456 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:07:20.456 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:07:20.456 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T01:07:20.456 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T01:07:20.456 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T01:07:20.457 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-16T01:07:20.457 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T01:07:20.457 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T01:07:20.515 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T01:07:20.515 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T01:07:20.516 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2024-09-16T01:07:20.557 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2024-09-16T01:07:20.557 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2024-09-16T01:07:20.557 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2024-09-16T01:07:20.557 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 82.el9 2024-09-16T01:07:20.557 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2024-09-16T01:07:20.557 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T01:07:20.557 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2024-09-16T01:07:20.557 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8274670 2024-09-16T01:07:20.557 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2024-09-16T01:07:20.558 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T01:07:20.558 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T01:07:20.558 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T01:07:20.558 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T01:07:20.558 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2024-09-16T01:07:20.558 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2024-09-16T01:07:20.558 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T01:07:20.558 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2024-09-16T01:07:20.558 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2024-09-16T01:07:20.558 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:07:20.558 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T01:07:20.558 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T01:07:20.559 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T01:07:20.559 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2024-09-16T01:07:20.559 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:07:20.559 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T01:07:20.560 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T01:07:20.560 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 5.14.0-505.el9.x86_64 2024-09-16T01:07:20.560 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T01:07:20.805 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T01:07:20.848 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-16T01:07:20.850 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-16T01:07:20.906 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.BXaBDL8jr0 2024-09-16T01:07:20.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BXaBDL8jr0 2024-09-16T01:07:20.972 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.BXaBDL8jr0 2024-09-16T01:07:21.116 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.BXaBDL8jr0 is 6KB 2024-09-16T01:07:21.164 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.BXaBDL8jr0 2024-09-16T01:07:21.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T01:07:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T01:07:21.242 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T01:07:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T01:07:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T01:07:21.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T01:07:21.315 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-09-16T01:07:21.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-16T01:07:22.601 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T01:07:22.637 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-09-16T01:07:22.640 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-16T01:07:22.655 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.sxt1301wTN 2024-09-16T01:07:22.655 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sxt1301wTN 2024-09-16T01:07:22.732 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.sxt1301wTN 2024-09-16T01:07:22.867 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.sxt1301wTN is 6KB 2024-09-16T01:07:22.915 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.sxt1301wTN 2024-09-16T01:07:22.930 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T01:07:22.992 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T01:07:22.992 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T01:07:22.993 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T01:07:22.993 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T01:07:22.994 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T01:07:23.141 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-09-16T01:07:51.419 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-16T01:07:51.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-16T01:07:51.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:07:53.145 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-16T01:07:53.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-16T01:07:53.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:08:51.481 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T01:08:53.149 DEBUG:teuthology.orchestra.remote:timed out 2024-09-16T01:09:00.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-16T01:09:00.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:09:00.836 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-16T01:09:01.236 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-16T01:09:01.236 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-16T01:09:01.236 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-16T01:09:01.251 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-505.el9.x86_64 2024-09-16T01:09:01.251 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T01:09:01.251 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T01:09:01.251 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T01:09:02.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-16T01:09:02.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:09:02.267 DEBUG:teuthology.parallel:result is None 2024-09-16T01:09:02.509 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-16T01:09:02.959 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-16T01:09:02.959 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-16T01:09:02.959 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-16T01:09:02.975 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-505.el9.x86_64 2024-09-16T01:09:02.975 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T01:09:02.975 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T01:09:02.975 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T01:09:03.976 DEBUG:teuthology.parallel:result is None 2024-09-16T01:09:03.976 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T01:09:03.983 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T01:09:03.983 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T01:09:03.986 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T01:09:04.001 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T01:09:04.008 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T01:09:04.014 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T01:09:04.015 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T01:09:04.040 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T01:09:04.066 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T01:09:04.073 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T01:09:04.073 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T01:09:04.093 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T01:09:04.192 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:09:04.201 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:09:04.215 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:09:04.217 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T01:09:04.218 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T01:09:04.225 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T01:09:04.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T01:09:04.228 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T01:09:04.253 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T01:09:04.271 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T01:09:04.271 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T01:09:04.291 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T01:09:04.312 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:09:04.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:09:04.428 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:09:04.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:09:04.546 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:09:04.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T01:09:04.609 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:09:04.651 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T01:09:04.693 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:09:04.779 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T01:09:04.825 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:09:04.826 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T01:09:04.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-16T01:09:04.896 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-16T01:09:04.945 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:09:05.005 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:09:05.391 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T01:09:05.401 INFO:teuthology.task.internal:Starting timer... 2024-09-16T01:09:05.402 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T01:09:05.417 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T01:09:05.431 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-16T01:09:05.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-09-16T01:09:05.501 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-09-16T01:09:05.502 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-09-16T01:09:05.563 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-09-16T01:09:05.565 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T01:09:05.565 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-09-16T01:09:05.588 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-09-16T01:09:05.589 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-09-16T01:09:05.614 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-09-16T01:09:05.615 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi102.front.sepia.ceph.com': 'permissive'} 2024-09-16T01:09:05.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:09:05.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:09:05.654 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:09:05.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:09:05.699 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T01:09:05.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-09-16T01:09:05.920 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-09-16T01:09:05.955 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T01:09:05.964 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T01:09:05.975 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T01:09:05.976 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T01:12:51.950 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2024-09-16T01:12:51.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-16T01:12:51.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:12:52.028 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-16T01:12:52.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-16T01:12:52.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-16T01:12:52.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T01:12:52.183 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-16T01:12:52.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-16T01:12:52.221 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T01:12:52.230 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T01:12:52.230 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T01:12:52.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:12:52.233 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T01:12:52.233 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:12:52.259 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T01:12:52.274 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T01:12:52.290 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T01:12:52.298 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-09-16T01:12:52.305 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T01:12:52.309 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-09-16T01:12:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T01:12:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-09-16T01:12:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T01:12:52.341 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-09-16T01:12:52.355 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T01:12:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T01:12:52.392 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:12:52.395 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:12:52.395 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-16T01:12:52.395 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:12:52.396 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:12:52.396 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:12:52.396 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:12:52.425 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:12:52.429 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:12:52.429 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-16T01:12:52.429 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:12:52.429 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:12:52.429 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:12:52.429 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:12:52.430 INFO:teuthology.run_tasks:Running task install... 2024-09-16T01:12:52.438 DEBUG:teuthology.task.install:project ceph 2024-09-16T01:12:52.439 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-16T01:12:52.439 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-16T01:12:52.439 INFO:teuthology.task.install:Using flavor: default 2024-09-16T01:12:52.444 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T01:12:52.444 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-16T01:12:52.445 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T01:12:52.445 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:12:52.447 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-16T01:12:52.447 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:12:52.587 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T01:12:52.587 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T01:12:52.596 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-16T01:12:52.597 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-16T01:12:52.696 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T01:12:52.697 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:12:52.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T01:12:52.705 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T01:12:52.705 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:12:52.705 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T01:12:52.723 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T01:12:52.724 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T01:12:52.732 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-16T01:12:52.732 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T01:12:52.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T01:12:52.797 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T01:12:52.864 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T01:12:52.872 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T01:12:52.928 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-09-16T01:12:52.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-09-16T01:12:52.937 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-09-16T01:12:52.938 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-09-16T01:12:53.157 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-09-16T01:12:53.175 INFO:teuthology.orchestra.run.smithi102.stdout:45 files removed 2024-09-16T01:12:53.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T01:12:53.202 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-16T01:12:53.742 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 308 kB/s | 83 kB 00:00 2024-09-16T01:12:53.754 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 317 kB/s | 83 kB 00:00 2024-09-16T01:12:54.025 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-16T01:12:54.038 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-16T01:12:54.301 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-16T01:12:54.305 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-16T01:12:54.914 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-16T01:12:55.001 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-16T01:12:58.285 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 20 MB 00:02 2024-09-16T01:12:58.432 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 20 MB 00:02 2024-09-16T01:13:02.544 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-16T01:13:03.241 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 6.8 MB/s | 6.5 MB 00:00 2024-09-16T01:13:04.012 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-16T01:13:04.886 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-16T01:13:05.909 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 19 kB 00:01 2024-09-16T01:13:06.788 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-16T01:13:10.306 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-16T01:13:12.285 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-16T01:13:12.659 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:13:12.660 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:13:12.673 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T01:13:12.674 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T01:13:12.675 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T01:13:12.676 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T01:13:12.678 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T01:13:12.681 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T01:13:12.682 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T01:13:12.745 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-16T01:13:12.758 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-16T01:13:12.758 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-16T01:13:12.758 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-16T01:13:12.758 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-16T01:13:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T01:13:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T01:13:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T01:13:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T01:13:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T01:13:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T01:13:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T01:13:12.759 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T01:13:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T01:13:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T01:13:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T01:13:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T01:13:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T01:13:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T01:13:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T01:13:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T01:13:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T01:13:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T01:13:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T01:13:12.760 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T01:13:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T01:13:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T01:13:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T01:13:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T01:13:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T01:13:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T01:13:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T01:13:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T01:13:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T01:13:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T01:13:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T01:13:12.761 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T01:13:12.762 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T01:13:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T01:13:12.763 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-16T01:13:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T01:13:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T01:13:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T01:13:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T01:13:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T01:13:12.763 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T01:13:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T01:13:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T01:13:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T01:13:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T01:13:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T01:13:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T01:13:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T01:13:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T01:13:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T01:13:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T01:13:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T01:13:12.764 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T01:13:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T01:13:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T01:13:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T01:13:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T01:13:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T01:13:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T01:13:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T01:13:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T01:13:12.765 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T01:13:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T01:13:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T01:13:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T01:13:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T01:13:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T01:13:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T01:13:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T01:13:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T01:13:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T01:13:12.766 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T01:13:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T01:13:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T01:13:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T01:13:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T01:13:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T01:13:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T01:13:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T01:13:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T01:13:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T01:13:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T01:13:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T01:13:12.767 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T01:13:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T01:13:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T01:13:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T01:13:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T01:13:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T01:13:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T01:13:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T01:13:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T01:13:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T01:13:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T01:13:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T01:13:12.768 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T01:13:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T01:13:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T01:13:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T01:13:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T01:13:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T01:13:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T01:13:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T01:13:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T01:13:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T01:13:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T01:13:12.769 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T01:13:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T01:13:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T01:13:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T01:13:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T01:13:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T01:13:12.770 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T01:13:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T01:13:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T01:13:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T01:13:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T01:13:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T01:13:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T01:13:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T01:13:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T01:13:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T01:13:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T01:13:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T01:13:12.771 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T01:13:12.772 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout:====================================================================================== 2024-09-16T01:13:12.773 INFO:teuthology.orchestra.run.smithi081.stdout:Install 148 Packages 2024-09-16T01:13:12.774 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 8 Packages 2024-09-16T01:13:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:13:12.774 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 226 M 2024-09-16T01:13:12.774 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-16T01:13:13.774 INFO:teuthology.orchestra.run.smithi081.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 48 kB/s | 6.5 kB 00:00 2024-09-16T01:13:14.007 INFO:teuthology.orchestra.run.smithi081.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 3.8 MB/s | 896 kB 00:00 2024-09-16T01:13:14.083 INFO:teuthology.orchestra.run.smithi081.stdout:(3/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-16T01:13:14.108 INFO:teuthology.orchestra.run.smithi081.stdout:(4/156): ceph-immutable-object-cache-19.1.1-326 1.4 MB/s | 145 kB 00:00 2024-09-16T01:13:14.192 INFO:teuthology.orchestra.run.smithi081.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 22 MB/s | 2.4 MB 00:00 2024-09-16T01:13:14.408 INFO:teuthology.orchestra.run.smithi081.stdout:(6/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 22 MB/s | 4.7 MB 00:00 2024-09-16T01:13:14.442 INFO:teuthology.orchestra.run.smithi081.stdout:(7/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 4.6 MB/s | 1.5 MB 00:00 2024-09-16T01:13:14.623 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:13:14.623 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-16T01:13:14.636 INFO:teuthology.orchestra.run.smithi102.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-16T01:13:14.637 INFO:teuthology.orchestra.run.smithi102.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-16T01:13:14.638 INFO:teuthology.orchestra.run.smithi102.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-16T01:13:14.639 INFO:teuthology.orchestra.run.smithi102.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-16T01:13:14.640 INFO:teuthology.orchestra.run.smithi102.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-16T01:13:14.643 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-16T01:13:14.644 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-16T01:13:14.707 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-16T01:13:14.723 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-16T01:13:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-16T01:13:14.723 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-16T01:13:14.723 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-16T01:13:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-16T01:13:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-16T01:13:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-16T01:13:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-16T01:13:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-16T01:13:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-16T01:13:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-16T01:13:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-16T01:13:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-16T01:13:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-16T01:13:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-16T01:13:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-16T01:13:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-16T01:13:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-16T01:13:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-16T01:13:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-16T01:13:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-16T01:13:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-16T01:13:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-16T01:13:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-16T01:13:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-16T01:13:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-16T01:13:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-16T01:13:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-16T01:13:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-16T01:13:14.726 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T01:13:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-16T01:13:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-16T01:13:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-16T01:13:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-16T01:13:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-16T01:13:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-16T01:13:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-16T01:13:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-16T01:13:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T01:13:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T01:13:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T01:13:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T01:13:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T01:13:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T01:13:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T01:13:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T01:13:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-16T01:13:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T01:13:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T01:13:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T01:13:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T01:13:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T01:13:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-16T01:13:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T01:13:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-16T01:13:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T01:13:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-16T01:13:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T01:13:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T01:13:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T01:13:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T01:13:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T01:13:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T01:13:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T01:13:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T01:13:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T01:13:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T01:13:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T01:13:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T01:13:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T01:13:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T01:13:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T01:13:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T01:13:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T01:13:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T01:13:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T01:13:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-16T01:13:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T01:13:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T01:13:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:13:14.737 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-16T01:13:14.737 INFO:teuthology.orchestra.run.smithi102.stdout:====================================================================================== 2024-09-16T01:13:14.737 INFO:teuthology.orchestra.run.smithi102.stdout:Install 148 Packages 2024-09-16T01:13:14.737 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 8 Packages 2024-09-16T01:13:14.737 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:13:14.737 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 226 M 2024-09-16T01:13:14.737 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-16T01:13:15.059 INFO:teuthology.orchestra.run.smithi081.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 15 MB/s | 21 MB 00:01 2024-09-16T01:13:15.109 INFO:teuthology.orchestra.run.smithi081.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 505 kB/s | 25 kB 00:00 2024-09-16T01:13:15.303 INFO:teuthology.orchestra.run.smithi081.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 19 MB/s | 17 MB 00:00 2024-09-16T01:13:15.403 INFO:teuthology.orchestra.run.smithi102.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-16T01:13:15.426 INFO:teuthology.orchestra.run.smithi081.stdout:(11/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 11 MB/s | 11 MB 00:00 2024-09-16T01:13:15.452 INFO:teuthology.orchestra.run.smithi081.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 1.5 MB/s | 228 kB 00:00 2024-09-16T01:13:15.477 INFO:teuthology.orchestra.run.smithi081.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 541 kB/s | 27 kB 00:00 2024-09-16T01:13:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 634 kB/s | 32 kB 00:00 2024-09-16T01:13:15.545 INFO:teuthology.orchestra.run.smithi081.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 751 kB 00:00 2024-09-16T01:13:15.570 INFO:teuthology.orchestra.run.smithi081.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.4 MB/s | 163 kB 00:00 2024-09-16T01:13:15.578 INFO:teuthology.orchestra.run.smithi102.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 5.0 MB/s | 896 kB 00:00 2024-09-16T01:13:15.595 INFO:teuthology.orchestra.run.smithi081.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-16T01:13:15.629 INFO:teuthology.orchestra.run.smithi081.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 8.4 MB/s | 506 kB 00:00 2024-09-16T01:13:15.662 INFO:teuthology.orchestra.run.smithi102.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.7 MB/s | 145 kB 00:00 2024-09-16T01:13:15.729 INFO:teuthology.orchestra.run.smithi081.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 451 kB/s | 45 kB 00:00 2024-09-16T01:13:15.829 INFO:teuthology.orchestra.run.smithi081.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.3 MB/s | 136 kB 00:00 2024-09-16T01:13:15.913 INFO:teuthology.orchestra.run.smithi081.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.9 MB/s | 161 kB 00:00 2024-09-16T01:13:15.962 INFO:teuthology.orchestra.run.smithi102.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 7.9 MB/s | 5.4 MB 00:00 2024-09-16T01:13:15.980 INFO:teuthology.orchestra.run.smithi081.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 4.7 MB/s | 320 kB 00:00 2024-09-16T01:13:16.122 INFO:teuthology.orchestra.run.smithi081.stdout:(23/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 10 MB/s | 5.3 MB 00:00 2024-09-16T01:13:16.147 INFO:teuthology.orchestra.run.smithi081.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 1.8 MB/s | 300 kB 00:00 2024-09-16T01:13:16.171 INFO:teuthology.orchestra.run.smithi102.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 7.3 MB/s | 1.5 MB 00:00 2024-09-16T01:13:16.206 INFO:teuthology.orchestra.run.smithi081.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.2 MB/s | 99 kB 00:00 2024-09-16T01:13:16.231 INFO:teuthology.orchestra.run.smithi081.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.0 MB/s | 85 kB 00:00 2024-09-16T01:13:16.331 INFO:teuthology.orchestra.run.smithi081.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 1.7 MB/s | 170 kB 00:00 2024-09-16T01:13:16.338 INFO:teuthology.orchestra.run.smithi102.stdout:(6/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 3.5 MB/s | 2.4 MB 00:00 2024-09-16T01:13:16.415 INFO:teuthology.orchestra.run.smithi081.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 381 kB/s | 32 kB 00:00 2024-09-16T01:13:16.515 INFO:teuthology.orchestra.run.smithi081.stdout:(29/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.4 MB/s | 146 kB 00:00 2024-09-16T01:13:16.616 INFO:teuthology.orchestra.run.smithi081.stdout:(30/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 7.6 MB/s | 3.1 MB 00:00 2024-09-16T01:13:16.749 INFO:teuthology.orchestra.run.smithi081.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 15 MB/s | 3.6 MB 00:00 2024-09-16T01:13:16.763 INFO:teuthology.orchestra.run.smithi102.stdout:(7/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 14 MB/s | 21 MB 00:01 2024-09-16T01:13:16.817 INFO:teuthology.orchestra.run.smithi081.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 3.7 MB/s | 249 kB 00:00 2024-09-16T01:13:16.830 INFO:teuthology.orchestra.run.smithi102.stdout:(8/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 7.1 MB/s | 4.7 MB 00:00 2024-09-16T01:13:16.875 INFO:teuthology.orchestra.run.smithi081.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 846 kB/s | 49 kB 00:00 2024-09-16T01:13:16.913 INFO:teuthology.orchestra.run.smithi102.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 303 kB/s | 25 kB 00:00 2024-09-16T01:13:16.959 INFO:teuthology.orchestra.run.smithi081.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 198 kB/s | 16 kB 00:00 2024-09-16T01:13:17.059 INFO:teuthology.orchestra.run.smithi081.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 2.8 MB/s | 285 kB 00:00 2024-09-16T01:13:17.326 INFO:teuthology.orchestra.run.smithi081.stdout:(36/156): ceph-mgr-diskprediction-local-19.1.1- 10 MB/s | 7.4 MB 00:00 2024-09-16T01:13:17.376 INFO:teuthology.orchestra.run.smithi081.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 366 kB/s | 18 kB 00:00 2024-09-16T01:13:17.405 INFO:teuthology.orchestra.run.smithi102.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 17 MB/s | 11 MB 00:00 2024-09-16T01:13:17.464 INFO:teuthology.orchestra.run.smithi102.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.8 MB/s | 228 kB 00:00 2024-09-16T01:13:17.510 INFO:teuthology.orchestra.run.smithi081.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 599 kB/s | 80 kB 00:00 2024-09-16T01:13:17.522 INFO:teuthology.orchestra.run.smithi102.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 464 kB/s | 27 kB 00:00 2024-09-16T01:13:17.573 INFO:teuthology.orchestra.run.smithi102.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 635 kB/s | 32 kB 00:00 2024-09-16T01:13:17.618 INFO:teuthology.orchestra.run.smithi081.stdout:(39/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 1.3 MB/s | 765 kB 00:00 2024-09-16T01:13:17.640 INFO:teuthology.orchestra.run.smithi102.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 751 kB 00:00 2024-09-16T01:13:17.699 INFO:teuthology.orchestra.run.smithi102.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.7 MB/s | 163 kB 00:00 2024-09-16T01:13:17.702 INFO:teuthology.orchestra.run.smithi081.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-16T01:13:17.749 INFO:teuthology.orchestra.run.smithi102.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-16T01:13:17.761 INFO:teuthology.orchestra.run.smithi081.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-16T01:13:17.807 INFO:teuthology.orchestra.run.smithi102.stdout:(17/156): libradosstriper1-19.1.1-326.g8921c8ef 8.5 MB/s | 506 kB 00:00 2024-09-16T01:13:17.811 INFO:teuthology.orchestra.run.smithi081.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 994 kB/s | 191 kB 00:00 2024-09-16T01:13:17.870 INFO:teuthology.orchestra.run.smithi081.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-16T01:13:17.937 INFO:teuthology.orchestra.run.smithi081.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-09-16T01:13:17.962 INFO:teuthology.orchestra.run.smithi081.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-16T01:13:17.987 INFO:teuthology.orchestra.run.smithi081.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-16T01:13:18.021 INFO:teuthology.orchestra.run.smithi081.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-16T01:13:18.108 INFO:teuthology.orchestra.run.smithi102.stdout:(18/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 18 MB/s | 5.3 MB 00:00 2024-09-16T01:13:18.158 INFO:teuthology.orchestra.run.smithi102.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 908 kB/s | 45 kB 00:00 2024-09-16T01:13:18.217 INFO:teuthology.orchestra.run.smithi102.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.3 MB/s | 136 kB 00:00 2024-09-16T01:13:18.267 INFO:teuthology.orchestra.run.smithi102.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 3.2 MB/s | 161 kB 00:00 2024-09-16T01:13:18.326 INFO:teuthology.orchestra.run.smithi102.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 5.4 MB/s | 320 kB 00:00 2024-09-16T01:13:18.384 INFO:teuthology.orchestra.run.smithi102.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.0 MB/s | 300 kB 00:00 2024-09-16T01:13:18.443 INFO:teuthology.orchestra.run.smithi102.stdout:(24/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.7 MB/s | 99 kB 00:00 2024-09-16T01:13:18.501 INFO:teuthology.orchestra.run.smithi102.stdout:(25/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-16T01:13:18.580 INFO:teuthology.orchestra.run.smithi081.stdout:(48/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 14 MB/s | 49 MB 00:03 2024-09-16T01:13:18.668 INFO:teuthology.orchestra.run.smithi102.stdout:(26/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 7.2 MB/s | 17 MB 00:02 2024-09-16T01:13:18.735 INFO:teuthology.orchestra.run.smithi102.stdout:(27/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-16T01:13:18.760 INFO:teuthology.orchestra.run.smithi102.stdout:(28/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 1.8 MB/s | 170 kB 00:00 2024-09-16T01:13:18.786 INFO:teuthology.orchestra.run.smithi102.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 635 kB/s | 32 kB 00:00 2024-09-16T01:13:18.803 INFO:teuthology.orchestra.run.smithi102.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 3.4 MB/s | 146 kB 00:00 2024-09-16T01:13:18.970 INFO:teuthology.orchestra.run.smithi102.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 19 MB/s | 3.6 MB 00:00 2024-09-16T01:13:19.020 INFO:teuthology.orchestra.run.smithi102.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 4.9 MB/s | 249 kB 00:00 2024-09-16T01:13:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 847 kB/s | 49 kB 00:00 2024-09-16T01:13:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 281 kB/s | 16 kB 00:00 2024-09-16T01:13:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.8 MB/s | 285 kB 00:00 2024-09-16T01:13:19.247 INFO:teuthology.orchestra.run.smithi081.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 160 kB/s | 107 kB 00:00 2024-09-16T01:13:19.271 INFO:teuthology.orchestra.run.smithi102.stdout:(36/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 10 MB/s | 765 kB 00:00 2024-09-16T01:13:19.305 INFO:teuthology.orchestra.run.smithi081.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 523 kB/s | 689 kB 00:01 2024-09-16T01:13:19.330 INFO:teuthology.orchestra.run.smithi102.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 313 kB/s | 18 kB 00:00 2024-09-16T01:13:19.447 INFO:teuthology.orchestra.run.smithi081.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 661 kB/s | 943 kB 00:01 2024-09-16T01:13:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 38 kB/s | 22 kB 00:00 2024-09-16T01:13:19.827 INFO:teuthology.orchestra.run.smithi102.stdout:(38/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 17 MB/s | 49 MB 00:02 2024-09-16T01:13:20.006 INFO:teuthology.orchestra.run.smithi081.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-16T01:13:20.014 INFO:teuthology.orchestra.run.smithi102.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 6.1 MB/s | 7.4 MB 00:01 2024-09-16T01:13:20.039 INFO:teuthology.orchestra.run.smithi102.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 113 kB/s | 80 kB 00:00 2024-09-16T01:13:20.173 INFO:teuthology.orchestra.run.smithi081.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 362 kB/s | 313 kB 00:00 2024-09-16T01:13:20.181 INFO:teuthology.orchestra.run.smithi102.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-16T01:13:20.206 INFO:teuthology.orchestra.run.smithi102.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 997 kB/s | 191 kB 00:00 2024-09-16T01:13:20.265 INFO:teuthology.orchestra.run.smithi102.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-16T01:13:20.298 INFO:teuthology.orchestra.run.smithi102.stdout:(44/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 801 kB 00:00 2024-09-16T01:13:20.424 INFO:teuthology.orchestra.run.smithi102.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 5.1 MB/s | 1.2 MB 00:00 2024-09-16T01:13:20.466 INFO:teuthology.orchestra.run.smithi102.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 674 kB/s | 135 kB 00:00 2024-09-16T01:13:20.507 INFO:teuthology.orchestra.run.smithi081.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-16T01:13:20.533 INFO:teuthology.orchestra.run.smithi102.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 533 kB/s | 125 kB 00:00 2024-09-16T01:13:20.583 INFO:teuthology.orchestra.run.smithi102.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-09-16T01:13:20.617 INFO:teuthology.orchestra.run.smithi102.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 4.5 MB/s | 689 kB 00:00 2024-09-16T01:13:20.650 INFO:teuthology.orchestra.run.smithi102.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 655 kB/s | 22 kB 00:00 2024-09-16T01:13:20.657 INFO:teuthology.orchestra.run.smithi081.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-16T01:13:20.692 INFO:teuthology.orchestra.run.smithi102.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-09-16T01:13:20.717 INFO:teuthology.orchestra.run.smithi102.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 797 kB/s | 107 kB 00:00 2024-09-16T01:13:20.743 INFO:teuthology.orchestra.run.smithi102.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-16T01:13:20.776 INFO:teuthology.orchestra.run.smithi102.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-16T01:13:20.801 INFO:teuthology.orchestra.run.smithi102.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-16T01:13:20.827 INFO:teuthology.orchestra.run.smithi102.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-16T01:13:20.849 INFO:teuthology.orchestra.run.smithi081.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-09-16T01:13:20.852 INFO:teuthology.orchestra.run.smithi102.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-16T01:13:20.869 INFO:teuthology.orchestra.run.smithi102.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-16T01:13:20.911 INFO:teuthology.orchestra.run.smithi102.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-16T01:13:20.944 INFO:teuthology.orchestra.run.smithi102.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-16T01:13:20.961 INFO:teuthology.orchestra.run.smithi102.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 488 kB/s | 24 kB 00:00 2024-09-16T01:13:20.978 INFO:teuthology.orchestra.run.smithi102.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-16T01:13:21.003 INFO:teuthology.orchestra.run.smithi102.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-09-16T01:13:21.029 INFO:teuthology.orchestra.run.smithi102.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-16T01:13:21.054 INFO:teuthology.orchestra.run.smithi102.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-16T01:13:21.104 INFO:teuthology.orchestra.run.smithi102.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.7 MB/s | 3.0 MB 00:00 2024-09-16T01:13:21.205 INFO:teuthology.orchestra.run.smithi102.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 28 MB/s | 4.9 MB 00:00 2024-09-16T01:13:21.247 INFO:teuthology.orchestra.run.smithi102.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-16T01:13:21.282 INFO:teuthology.orchestra.run.smithi081.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-09-16T01:13:21.289 INFO:teuthology.orchestra.run.smithi102.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-16T01:13:21.307 INFO:teuthology.orchestra.run.smithi081.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 200 kB/s | 160 kB 00:00 2024-09-16T01:13:21.314 INFO:teuthology.orchestra.run.smithi102.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-16T01:13:21.372 INFO:teuthology.orchestra.run.smithi102.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-16T01:13:21.406 INFO:teuthology.orchestra.run.smithi102.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-16T01:13:21.441 INFO:teuthology.orchestra.run.smithi102.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-16T01:13:21.482 INFO:teuthology.orchestra.run.smithi102.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-16T01:13:21.557 INFO:teuthology.orchestra.run.smithi102.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-16T01:13:21.582 INFO:teuthology.orchestra.run.smithi102.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-16T01:13:21.608 INFO:teuthology.orchestra.run.smithi102.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-16T01:13:21.633 INFO:teuthology.orchestra.run.smithi102.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-16T01:13:21.658 INFO:teuthology.orchestra.run.smithi102.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-16T01:13:21.683 INFO:teuthology.orchestra.run.smithi102.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-16T01:13:21.709 INFO:teuthology.orchestra.run.smithi102.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-16T01:13:21.749 INFO:teuthology.orchestra.run.smithi081.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 736 kB/s | 662 kB 00:00 2024-09-16T01:13:21.792 INFO:teuthology.orchestra.run.smithi102.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-16T01:13:21.818 INFO:teuthology.orchestra.run.smithi102.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-16T01:13:21.841 INFO:teuthology.orchestra.run.smithi081.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 46 kB/s | 24 kB 00:00 2024-09-16T01:13:21.843 INFO:teuthology.orchestra.run.smithi102.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-16T01:13:21.860 INFO:teuthology.orchestra.run.smithi102.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-16T01:13:21.885 INFO:teuthology.orchestra.run.smithi102.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-16T01:13:21.910 INFO:teuthology.orchestra.run.smithi102.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-16T01:13:21.936 INFO:teuthology.orchestra.run.smithi102.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-16T01:13:21.969 INFO:teuthology.orchestra.run.smithi102.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-16T01:13:21.994 INFO:teuthology.orchestra.run.smithi102.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 874 kB/s | 51 kB 00:00 2024-09-16T01:13:22.020 INFO:teuthology.orchestra.run.smithi102.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-16T01:13:22.095 INFO:teuthology.orchestra.run.smithi102.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-16T01:13:22.120 INFO:teuthology.orchestra.run.smithi102.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-16T01:13:22.145 INFO:teuthology.orchestra.run.smithi102.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 881 kB/s | 44 kB 00:00 2024-09-16T01:13:22.167 INFO:teuthology.orchestra.run.smithi081.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 657 kB/s | 581 kB 00:00 2024-09-16T01:13:22.171 INFO:teuthology.orchestra.run.smithi102.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-16T01:13:22.196 INFO:teuthology.orchestra.run.smithi102.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-16T01:13:22.221 INFO:teuthology.orchestra.run.smithi102.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-16T01:13:22.247 INFO:teuthology.orchestra.run.smithi102.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-16T01:13:22.272 INFO:teuthology.orchestra.run.smithi102.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-16T01:13:22.289 INFO:teuthology.orchestra.run.smithi102.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-16T01:13:22.306 INFO:teuthology.orchestra.run.smithi102.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-09-16T01:13:22.323 INFO:teuthology.orchestra.run.smithi102.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-16T01:13:22.392 INFO:teuthology.orchestra.run.smithi081.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 74 kB/s | 47 kB 00:00 2024-09-16T01:13:22.431 INFO:teuthology.orchestra.run.smithi102.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-16T01:13:22.615 INFO:teuthology.orchestra.run.smithi102.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-16T01:13:22.657 INFO:teuthology.orchestra.run.smithi102.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.4 MB/s | 548 kB 00:00 2024-09-16T01:13:22.682 INFO:teuthology.orchestra.run.smithi102.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 844 kB/s | 19 kB 00:00 2024-09-16T01:13:22.700 INFO:teuthology.orchestra.run.smithi081.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 341 kB/s | 292 kB 00:00 2024-09-16T01:13:22.716 INFO:teuthology.orchestra.run.smithi102.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.1 MB/s | 308 kB 00:00 2024-09-16T01:13:22.741 INFO:teuthology.orchestra.run.smithi102.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-16T01:13:22.775 INFO:teuthology.orchestra.run.smithi102.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-09-16T01:13:22.800 INFO:teuthology.orchestra.run.smithi102.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-09-16T01:13:22.825 INFO:teuthology.orchestra.run.smithi102.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 580 kB/s | 49 kB 00:00 2024-09-16T01:13:22.851 INFO:teuthology.orchestra.run.smithi102.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-16T01:13:22.901 INFO:teuthology.orchestra.run.smithi102.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-16T01:13:22.909 INFO:teuthology.orchestra.run.smithi081.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 254 kB/s | 188 kB 00:00 2024-09-16T01:13:22.926 INFO:teuthology.orchestra.run.smithi102.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-16T01:13:22.952 INFO:teuthology.orchestra.run.smithi102.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-16T01:13:22.969 INFO:teuthology.orchestra.run.smithi081.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 67 kB/s | 38 kB 00:00 2024-09-16T01:13:22.977 INFO:teuthology.orchestra.run.smithi102.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 571 kB/s | 14 kB 00:00 2024-09-16T01:13:23.002 INFO:teuthology.orchestra.run.smithi102.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.6 MB/s | 839 kB 00:00 2024-09-16T01:13:23.027 INFO:teuthology.orchestra.run.smithi102.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-16T01:13:23.069 INFO:teuthology.orchestra.run.smithi102.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.1 MB/s | 303 kB 00:00 2024-09-16T01:13:23.095 INFO:teuthology.orchestra.run.smithi102.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-16T01:13:23.120 INFO:teuthology.orchestra.run.smithi102.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-16T01:13:23.187 INFO:teuthology.orchestra.run.smithi102.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-09-16T01:13:23.212 INFO:teuthology.orchestra.run.smithi102.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-16T01:13:23.237 INFO:teuthology.orchestra.run.smithi102.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-16T01:13:23.263 INFO:teuthology.orchestra.run.smithi102.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-16T01:13:23.288 INFO:teuthology.orchestra.run.smithi102.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-16T01:13:23.313 INFO:teuthology.orchestra.run.smithi102.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-16T01:13:23.339 INFO:teuthology.orchestra.run.smithi102.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-16T01:13:23.364 INFO:teuthology.orchestra.run.smithi102.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-16T01:13:23.389 INFO:teuthology.orchestra.run.smithi102.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-16T01:13:23.415 INFO:teuthology.orchestra.run.smithi102.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-16T01:13:23.448 INFO:teuthology.orchestra.run.smithi102.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-16T01:13:23.474 INFO:teuthology.orchestra.run.smithi102.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-16T01:13:23.499 INFO:teuthology.orchestra.run.smithi102.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-16T01:13:23.524 INFO:teuthology.orchestra.run.smithi102.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-16T01:13:23.549 INFO:teuthology.orchestra.run.smithi102.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-16T01:13:23.575 INFO:teuthology.orchestra.run.smithi102.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-16T01:13:23.600 INFO:teuthology.orchestra.run.smithi102.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-16T01:13:23.625 INFO:teuthology.orchestra.run.smithi102.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-16T01:13:23.650 INFO:teuthology.orchestra.run.smithi102.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-16T01:13:23.676 INFO:teuthology.orchestra.run.smithi102.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-16T01:13:23.726 INFO:teuthology.orchestra.run.smithi102.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-16T01:13:23.752 INFO:teuthology.orchestra.run.smithi102.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-16T01:13:23.777 INFO:teuthology.orchestra.run.smithi102.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-16T01:13:23.802 INFO:teuthology.orchestra.run.smithi102.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-16T01:13:23.809 INFO:teuthology.orchestra.run.smithi081.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.5 MB/s | 4.9 MB 00:01 2024-09-16T01:13:23.819 INFO:teuthology.orchestra.run.smithi102.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-16T01:13:23.853 INFO:teuthology.orchestra.run.smithi102.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-16T01:13:23.903 INFO:teuthology.orchestra.run.smithi102.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-16T01:13:23.951 INFO:teuthology.orchestra.run.smithi081.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:00 2024-09-16T01:13:24.027 INFO:teuthology.orchestra.run.smithi081.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2024-09-16T01:13:24.162 INFO:teuthology.orchestra.run.smithi102.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 10 MB/s | 3.4 MB 00:00 2024-09-16T01:13:24.262 INFO:teuthology.orchestra.run.smithi102.stdout:(150/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 7.7 MB/s | 3.2 MB 00:00 2024-09-16T01:13:24.370 INFO:teuthology.orchestra.run.smithi102.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 376 kB/s | 41 kB 00:00 2024-09-16T01:13:24.420 INFO:teuthology.orchestra.run.smithi102.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 4.5 MB/s | 2.3 MB 00:00 2024-09-16T01:13:24.463 INFO:teuthology.orchestra.run.smithi102.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 6.0 MB/s | 1.8 MB 00:00 2024-09-16T01:13:24.546 INFO:teuthology.orchestra.run.smithi102.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 1.4 MB/s | 249 kB 00:00 2024-09-16T01:13:24.727 INFO:teuthology.orchestra.run.smithi081.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 992 kB/s | 910 kB 00:00 2024-09-16T01:13:24.738 INFO:teuthology.orchestra.run.smithi102.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.7 MB/s | 2.4 MB 00:00 2024-09-16T01:13:24.753 INFO:teuthology.orchestra.run.smithi081.stdout:(71/156): postgresql-private-libs-13.16-1.el9.x 172 kB/s | 137 kB 00:00 2024-09-16T01:13:24.971 INFO:teuthology.orchestra.run.smithi102.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 2.5 MB/s | 1.4 MB 00:00 2024-09-16T01:13:24.977 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:13:24.977 INFO:teuthology.orchestra.run.smithi102.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-16T01:13:25.153 INFO:teuthology.orchestra.run.smithi081.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 5.1 MB/s | 5.8 MB 00:01 2024-09-16T01:13:25.436 INFO:teuthology.orchestra.run.smithi081.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 128 kB/s | 87 kB 00:00 2024-09-16T01:13:25.703 INFO:teuthology.orchestra.run.smithi081.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-09-16T01:13:26.062 INFO:teuthology.orchestra.run.smithi081.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 98 kB/s | 61 kB 00:00 2024-09-16T01:13:26.215 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-16T01:13:26.321 INFO:teuthology.orchestra.run.smithi081.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-16T01:13:26.370 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-16T01:13:26.381 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-16T01:13:26.455 INFO:teuthology.orchestra.run.smithi081.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 326 kB/s | 245 kB 00:00 2024-09-16T01:13:26.871 INFO:teuthology.orchestra.run.smithi081.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 47 kB/s | 26 kB 00:00 2024-09-16T01:13:26.921 INFO:teuthology.orchestra.run.smithi081.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 289 kB/s | 248 kB 00:00 2024-09-16T01:13:26.955 INFO:teuthology.orchestra.run.smithi081.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 38 kB/s | 19 kB 00:00 2024-09-16T01:13:27.472 INFO:teuthology.orchestra.run.smithi081.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-09-16T01:13:27.605 INFO:teuthology.orchestra.run.smithi081.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 235 kB/s | 172 kB 00:00 2024-09-16T01:13:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.5 MB/s | 5.1 MB 00:01 2024-09-16T01:13:28.239 INFO:teuthology.orchestra.run.smithi081.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 327 kB/s | 250 kB 00:00 2024-09-16T01:13:28.389 INFO:teuthology.orchestra.run.smithi081.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 284 kB/s | 222 kB 00:00 2024-09-16T01:13:28.587 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-16T01:13:28.588 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-16T01:13:28.760 INFO:teuthology.orchestra.run.smithi081.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 114 kB/s | 77 kB 00:00 2024-09-16T01:13:28.815 INFO:teuthology.orchestra.run.smithi081.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 73 kB/s | 42 kB 00:00 2024-09-16T01:13:29.224 INFO:teuthology.orchestra.run.smithi081.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 323 kB/s | 269 kB 00:00 2024-09-16T01:13:29.482 INFO:teuthology.orchestra.run.smithi081.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 220 kB/s | 159 kB 00:00 2024-09-16T01:13:29.599 INFO:teuthology.orchestra.run.smithi081.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 356 kB/s | 279 kB 00:00 2024-09-16T01:13:29.833 INFO:teuthology.orchestra.run.smithi081.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 84 kB/s | 51 kB 00:00 2024-09-16T01:13:30.074 INFO:teuthology.orchestra.run.smithi081.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 91 kB/s | 54 kB 00:00 2024-09-16T01:13:30.391 INFO:teuthology.orchestra.run.smithi081.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 75 kB/s | 42 kB 00:00 2024-09-16T01:13:30.667 INFO:teuthology.orchestra.run.smithi081.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 75 kB/s | 44 kB 00:00 2024-09-16T01:13:31.059 INFO:teuthology.orchestra.run.smithi081.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-16T01:13:31.284 INFO:teuthology.orchestra.run.smithi081.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 248 kB/s | 221 kB 00:00 2024-09-16T01:13:31.493 INFO:teuthology.orchestra.run.smithi081.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 43 kB/s | 36 kB 00:00 2024-09-16T01:13:31.659 INFO:teuthology.orchestra.run.smithi081.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 80 kB/s | 47 kB 00:00 2024-09-16T01:13:32.085 INFO:teuthology.orchestra.run.smithi081.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 380 kB/s | 304 kB 00:00 2024-09-16T01:13:32.177 INFO:teuthology.orchestra.run.smithi081.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 84 kB/s | 58 kB 00:00 2024-09-16T01:13:32.311 INFO:teuthology.orchestra.run.smithi081.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 147 kB/s | 96 kB 00:00 2024-09-16T01:13:32.619 INFO:teuthology.orchestra.run.smithi081.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-09-16T01:13:32.728 INFO:teuthology.orchestra.run.smithi081.stdout:(103/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 99 kB/s | 64 kB 00:00 2024-09-16T01:13:32.761 INFO:teuthology.orchestra.run.smithi081.stdout:(104/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2024-09-16T01:13:32.803 INFO:teuthology.orchestra.run.smithi081.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-16T01:13:32.828 INFO:teuthology.orchestra.run.smithi081.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 838 kB/s | 19 kB 00:00 2024-09-16T01:13:32.862 INFO:teuthology.orchestra.run.smithi081.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-16T01:13:32.887 INFO:teuthology.orchestra.run.smithi081.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-16T01:13:32.912 INFO:teuthology.orchestra.run.smithi081.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-16T01:13:32.946 INFO:teuthology.orchestra.run.smithi081.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-16T01:13:32.980 INFO:teuthology.orchestra.run.smithi081.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-16T01:13:33.063 INFO:teuthology.orchestra.run.smithi081.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-09-16T01:13:33.097 INFO:teuthology.orchestra.run.smithi081.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-16T01:13:33.131 INFO:teuthology.orchestra.run.smithi081.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-09-16T01:13:33.156 INFO:teuthology.orchestra.run.smithi081.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 744 kB/s | 43 kB 00:00 2024-09-16T01:13:33.181 INFO:teuthology.orchestra.run.smithi081.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-16T01:13:33.206 INFO:teuthology.orchestra.run.smithi081.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-16T01:13:33.232 INFO:teuthology.orchestra.run.smithi081.stdout:(118/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.4 MB/s | 863 kB 00:00 2024-09-16T01:13:33.274 INFO:teuthology.orchestra.run.smithi081.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-09-16T01:13:33.307 INFO:teuthology.orchestra.run.smithi081.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-09-16T01:13:33.333 INFO:teuthology.orchestra.run.smithi081.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.8 MB/s | 220 kB 00:00 2024-09-16T01:13:33.366 INFO:teuthology.orchestra.run.smithi081.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-16T01:13:33.391 INFO:teuthology.orchestra.run.smithi081.stdout:(123/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.9 MB/s | 303 kB 00:00 2024-09-16T01:13:33.417 INFO:teuthology.orchestra.run.smithi081.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-16T01:13:33.434 INFO:teuthology.orchestra.run.smithi081.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 423 kB/s | 18 kB 00:00 2024-09-16T01:13:33.450 INFO:teuthology.orchestra.run.smithi081.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 694 kB/s | 23 kB 00:00 2024-09-16T01:13:33.468 INFO:teuthology.orchestra.run.smithi081.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 579 kB/s | 19 kB 00:00 2024-09-16T01:13:33.485 INFO:teuthology.orchestra.run.smithi081.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 584 kB/s | 20 kB 00:00 2024-09-16T01:13:33.502 INFO:teuthology.orchestra.run.smithi081.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-16T01:13:33.527 INFO:teuthology.orchestra.run.smithi081.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-16T01:13:33.552 INFO:teuthology.orchestra.run.smithi081.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-16T01:13:33.586 INFO:teuthology.orchestra.run.smithi081.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-16T01:13:33.611 INFO:teuthology.orchestra.run.smithi081.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-16T01:13:33.645 INFO:teuthology.orchestra.run.smithi081.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-16T01:13:33.670 INFO:teuthology.orchestra.run.smithi081.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-16T01:13:33.696 INFO:teuthology.orchestra.run.smithi081.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-16T01:13:33.747 INFO:teuthology.orchestra.run.smithi081.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 403 kB/s | 31 kB 00:00 2024-09-16T01:13:34.105 INFO:teuthology.orchestra.run.smithi081.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 2.6 MB/s | 2.0 MB 00:00 2024-09-16T01:13:34.180 INFO:teuthology.orchestra.run.smithi081.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 137 kB/s | 59 kB 00:00 2024-09-16T01:13:34.205 INFO:teuthology.orchestra.run.smithi081.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-09-16T01:13:34.230 INFO:teuthology.orchestra.run.smithi081.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 353 kB/s | 188 kB 00:00 2024-09-16T01:13:34.256 INFO:teuthology.orchestra.run.smithi081.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-16T01:13:34.281 INFO:teuthology.orchestra.run.smithi081.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-16T01:13:34.306 INFO:teuthology.orchestra.run.smithi081.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-16T01:13:34.332 INFO:teuthology.orchestra.run.smithi081.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-16T01:13:34.357 INFO:teuthology.orchestra.run.smithi081.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-16T01:13:34.382 INFO:teuthology.orchestra.run.smithi081.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-16T01:13:34.457 INFO:teuthology.orchestra.run.smithi081.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-16T01:13:34.674 INFO:teuthology.orchestra.run.smithi081.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-16T01:13:34.733 INFO:teuthology.orchestra.run.smithi081.stdout:(150/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 9.0 MB/s | 3.2 MB 00:00 2024-09-16T01:13:34.900 INFO:teuthology.orchestra.run.smithi081.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 5.2 MB/s | 2.3 MB 00:00 2024-09-16T01:13:34.925 INFO:teuthology.orchestra.run.smithi081.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 212 kB/s | 41 kB 00:00 2024-09-16T01:13:34.959 INFO:teuthology.orchestra.run.smithi081.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 4.2 MB/s | 249 kB 00:00 2024-09-16T01:13:35.052 INFO:teuthology.orchestra.run.smithi081.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 4.8 MB/s | 1.8 MB 00:00 2024-09-16T01:13:35.148 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-16T01:13:35.178 INFO:teuthology.orchestra.run.smithi081.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-09-16T01:13:35.219 INFO:teuthology.orchestra.run.smithi081.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.2 MB/s | 2.4 MB 00:00 2024-09-16T01:13:35.226 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-16T01:13:35.226 INFO:teuthology.orchestra.run.smithi081.stdout:Total 10 MB/s | 226 MB 00:22 2024-09-16T01:13:35.259 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T01:13:35.305 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T01:13:35.359 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T01:13:35.402 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T01:13:35.428 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T01:13:35.481 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T01:13:35.821 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T01:13:35.945 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:13:36.067 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:13:36.096 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:13:36.188 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:13:36.218 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:13:36.386 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T01:13:36.417 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-16T01:13:36.453 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T01:13:36.484 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:13:36.570 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-16T01:13:36.570 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-16T01:13:36.587 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:13:36.610 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:13:36.673 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:13:36.703 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:13:36.726 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:13:36.937 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:13:37.111 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:13:37.243 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T01:13:37.361 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:13:37.419 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:13:37.648 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:13:37.763 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T01:13:37.862 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T01:13:37.891 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T01:13:37.926 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T01:13:37.990 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T01:13:38.043 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T01:13:38.075 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T01:13:38.119 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T01:13:38.151 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T01:13:38.179 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T01:13:38.249 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T01:13:38.302 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T01:13:38.333 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T01:13:38.375 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T01:13:38.443 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T01:13:38.478 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T01:13:38.521 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T01:13:38.549 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T01:13:38.619 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T01:13:38.664 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T01:13:38.739 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T01:13:38.785 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-16T01:13:38.785 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-16T01:13:38.890 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T01:13:38.950 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T01:13:39.467 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T01:13:39.546 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T01:13:39.583 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T01:13:39.618 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T01:13:39.656 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T01:13:39.697 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T01:13:39.851 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T01:13:39.909 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T01:13:39.964 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T01:13:40.036 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T01:13:40.076 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T01:13:40.113 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T01:13:40.160 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T01:13:40.195 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T01:13:40.238 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T01:13:40.280 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T01:13:40.414 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T01:13:40.457 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T01:13:40.498 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T01:13:40.601 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T01:13:40.656 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T01:13:40.920 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T01:13:40.964 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T01:13:40.989 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T01:13:41.087 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T01:13:41.216 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T01:13:41.246 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T01:13:41.274 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T01:13:41.315 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T01:13:41.355 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T01:13:41.387 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T01:13:41.417 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T01:13:41.451 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T01:13:41.488 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T01:13:41.530 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T01:13:41.565 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T01:13:41.652 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T01:13:41.694 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T01:13:41.726 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T01:13:41.830 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T01:13:41.885 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T01:13:42.603 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T01:13:42.649 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T01:13:42.683 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T01:13:42.782 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T01:13:42.838 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T01:13:42.883 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T01:13:42.972 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T01:13:43.002 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T01:13:43.188 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T01:13:43.358 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T01:13:43.555 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T01:13:44.288 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T01:13:44.408 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T01:13:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-16T01:13:45.399 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-16T01:13:45.512 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-16T01:13:45.608 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-16T01:13:45.641 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-16T01:13:45.652 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T01:13:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-16T01:13:45.746 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-16T01:13:45.747 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T01:13:45.775 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T01:13:45.808 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T01:13:46.074 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-16T01:13:46.119 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T01:13:46.155 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:13:46.176 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:13:46.246 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:13:46.281 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:13:46.310 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:13:46.368 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T01:13:46.393 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:13:46.421 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T01:13:46.423 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:13:46.606 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-16T01:13:46.661 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-16T01:13:46.689 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:13:46.793 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:13:46.815 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:13:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-16T01:13:46.900 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:13:46.904 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T01:13:46.926 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-16T01:13:46.941 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:13:46.996 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:13:47.026 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T01:13:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:13:47.243 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-16T01:13:47.365 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-16T01:13:47.496 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:13:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:13:47.807 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-16T01:13:47.927 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-16T01:13:48.017 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-16T01:13:48.055 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-16T01:13:48.098 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-16T01:13:48.162 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-16T01:13:48.207 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-16T01:13:48.239 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-16T01:13:48.282 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-16T01:13:48.315 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-16T01:13:48.343 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-16T01:13:48.411 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-16T01:13:48.474 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-16T01:13:48.514 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-16T01:13:48.556 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-16T01:13:48.631 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-16T01:13:48.667 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-16T01:13:48.710 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-16T01:13:48.739 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-16T01:13:48.808 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-16T01:13:48.854 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-16T01:13:48.936 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-16T01:13:49.077 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-16T01:13:49.139 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-16T01:13:49.305 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:13:49.339 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:13:49.658 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-16T01:13:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:13:49.934 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:13:49.952 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-16T01:13:49.980 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-16T01:13:50.012 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:13:50.012 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T01:13:50.012 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T01:13:50.012 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:13:50.024 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-16T01:13:50.061 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:13:50.061 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-16T01:13:50.106 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-16T01:13:50.267 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-16T01:13:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-16T01:13:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-16T01:13:50.467 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-16T01:13:50.499 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-16T01:13:50.535 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-16T01:13:50.581 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-16T01:13:50.618 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-16T01:13:50.661 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-16T01:13:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-16T01:13:50.855 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-16T01:13:50.905 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-16T01:13:50.946 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-16T01:13:51.048 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-16T01:13:51.080 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-16T01:13:51.120 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-16T01:13:51.153 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-16T01:13:51.178 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-16T01:13:51.280 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-16T01:13:51.407 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-16T01:13:51.447 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-16T01:13:51.483 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-16T01:13:51.533 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-16T01:13:51.583 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-16T01:13:51.630 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-16T01:13:51.668 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-16T01:13:51.703 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-16T01:13:51.736 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-16T01:13:51.778 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-16T01:13:51.812 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-16T01:13:51.899 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-16T01:13:51.951 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-16T01:13:51.982 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-16T01:13:52.085 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-16T01:13:52.133 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-16T01:13:52.872 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-16T01:13:52.914 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-16T01:13:52.947 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-16T01:13:53.046 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-16T01:13:53.094 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-16T01:13:53.147 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-16T01:13:53.242 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-16T01:13:53.293 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-16T01:13:53.478 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-16T01:13:53.516 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-16T01:13:53.605 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-16T01:13:54.254 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-16T01:13:54.372 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-16T01:13:55.622 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-16T01:13:55.722 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-16T01:13:55.750 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-16T01:13:55.782 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-16T01:13:56.094 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-16T01:13:56.145 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:13:56.236 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-16T01:13:56.275 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-16T01:13:56.311 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-16T01:13:56.791 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-16T01:13:56.824 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:13:56.895 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-16T01:13:56.917 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-16T01:13:59.210 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:13:59.246 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:13:59.799 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-16T01:13:59.834 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:13:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-16T01:13:59.906 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T01:13:59.906 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T01:13:59.906 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:13:59.943 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:14:01.709 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:14:01.709 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-09-16T01:14:01.709 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-09-16T01:14:01.709 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-09-16T01:14:01.709 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-09-16T01:14:01.709 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-09-16T01:14:01.709 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-09-16T01:14:01.709 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-09-16T01:14:01.709 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:01.883 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:14:01.900 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:14:01.900 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:01.900 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T01:14:01.900 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:03.370 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:14:03.397 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:14:03.397 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:03.397 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T01:14:03.397 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:14:03.397 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:14:03.398 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:03.629 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:14:03.652 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:14:03.652 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:03.652 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T01:14:03.652 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:14:03.652 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:14:03.652 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:04.104 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:14:04.128 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:14:04.128 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:04.128 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T01:14:04.128 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:14:04.128 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:14:04.128 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:04.234 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T01:14:04.291 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T01:14:04.347 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T01:14:04.532 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T01:14:04.580 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T01:14:04.659 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T01:14:04.748 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T01:14:04.887 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T01:14:04.934 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T01:14:04.962 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T01:14:04.989 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T01:14:05.460 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:14:05.488 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:14:05.528 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T01:14:05.591 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T01:14:05.619 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:14:06.663 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:14:06.705 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:14:07.670 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:14:07.697 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:14:07.800 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:14:07.969 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T01:14:08.016 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:14:08.040 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:14:08.040 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:08.040 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T01:14:08.040 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:14:08.041 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:14:08.041 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:08.091 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:14:08.104 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:14:08.202 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T01:14:08.252 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T01:14:09.172 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T01:14:09.210 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:14:09.234 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:14:09.234 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:09.235 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T01:14:09.235 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:14:09.235 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:14:09.235 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:09.278 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:14:09.301 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:14:09.302 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:09.302 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T01:14:09.302 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:09.354 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:14:09.377 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:14:09.377 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:09.377 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T01:14:09.377 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:14:09.377 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:14:09.378 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:09.679 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:14:09.703 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:14:09.703 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:09.703 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T01:14:09.703 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:14:09.704 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:14:09.704 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:11.720 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-16T01:14:11.720 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-09-16T01:14:11.720 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-09-16T01:14:11.720 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-09-16T01:14:11.720 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-09-16T01:14:11.721 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-09-16T01:14:11.721 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-09-16T01:14:11.721 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-09-16T01:14:11.721 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:11.888 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:14:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-16T01:14:11.904 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:11.904 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-16T01:14:11.904 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:13.383 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:14:13.410 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-16T01:14:13.410 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:13.410 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T01:14:13.410 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:14:13.410 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T01:14:13.410 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:13.634 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:14:13.657 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-16T01:14:13.657 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:13.657 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T01:14:13.657 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:14:13.657 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T01:14:13.657 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:14.085 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:14:14.108 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-16T01:14:14.108 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:14.108 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T01:14:14.108 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:14:14.108 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T01:14:14.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:14.214 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-16T01:14:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-16T01:14:14.300 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T01:14:14.326 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-16T01:14:14.341 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T01:14:14.389 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T01:14:14.422 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T01:14:14.449 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T01:14:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-16T01:14:14.568 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-16T01:14:14.641 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T01:14:14.646 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-16T01:14:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T01:14:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T01:14:14.734 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-16T01:14:14.748 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T01:14:14.794 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T01:14:14.875 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-16T01:14:14.935 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-16T01:14:14.967 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-16T01:14:14.995 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-16T01:14:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:14:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:14:15.457 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:14:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:14:15.494 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-16T01:14:15.525 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-16T01:14:15.588 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-16T01:14:15.617 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:14:16.310 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T01:14:16.388 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T01:14:16.438 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T01:14:16.521 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T01:14:16.550 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T01:14:16.575 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T01:14:16.601 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T01:14:16.601 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:14:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-16T01:14:16.694 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:14:16.694 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:14:16.694 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:14:16.778 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:14:16.803 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T01:14:16.808 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:14:16.808 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:14:16.996 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:14:16.996 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:14:17.089 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:14:17.163 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:14:17.650 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-16T01:14:17.678 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:14:17.779 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-16T01:14:17.948 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-16T01:14:17.988 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:14:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-16T01:14:18.012 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:18.012 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T01:14:18.012 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:14:18.012 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T01:14:18.012 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:18.063 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:14:18.075 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-16T01:14:18.173 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-16T01:14:18.226 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-16T01:14:19.153 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-16T01:14:19.183 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:14:19.206 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-16T01:14:19.206 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:19.206 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T01:14:19.206 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:14:19.207 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T01:14:19.207 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:19.251 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:14:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-16T01:14:19.273 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:19.273 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T01:14:19.273 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:19.318 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:14:19.341 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-16T01:14:19.341 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:19.341 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-16T01:14:19.341 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:14:19.342 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-16T01:14:19.342 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:19.652 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:14:19.675 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-16T01:14:19.675 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T01:14:19.675 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T01:14:19.676 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:14:19.676 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T01:14:19.676 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:22.994 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:14:22.995 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T01:14:22.995 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T01:14:22.995 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T01:14:22.995 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T01:14:22.995 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T01:14:22.995 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T01:14:22.995 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T01:14:22.995 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:14:22.995 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:14:22.995 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:14:22.995 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T01:14:22.995 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T01:14:22.996 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T01:14:22.997 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T01:14:22.997 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T01:14:22.997 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T01:14:22.997 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T01:14:23.008 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T01:14:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T01:14:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T01:14:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T01:14:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T01:14:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T01:14:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T01:14:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T01:14:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T01:14:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T01:14:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T01:14:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T01:14:23.009 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T01:14:23.010 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T01:14:23.011 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T01:14:23.012 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T01:14:23.013 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T01:14:23.014 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T01:14:23.015 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T01:14:23.016 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T01:14:23.017 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T01:14:23.018 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T01:14:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-16T01:14:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-16T01:14:24.338 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-16T01:14:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-16T01:14:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-16T01:14:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-16T01:14:24.645 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-16T01:14:24.675 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-16T01:14:24.704 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-16T01:14:24.759 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-16T01:14:25.283 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:14:25.324 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:14:25.344 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-16T01:14:25.517 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:14:25.517 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:25.517 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-09-16T01:14:25.517 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T01:14:25.518 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.519 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.519 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.519 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.519 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:25.519 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.519 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.519 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.519 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:25.519 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:25.520 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:25.520 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:25.520 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:25.520 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.520 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.520 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:25.520 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.520 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.520 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.520 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:25.520 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:25.520 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T01:14:25.521 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.522 INFO:teuthology.orchestra.run.smithi102.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T01:14:25.523 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T01:14:25.523 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T01:14:25.523 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T01:14:25.523 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T01:14:25.523 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T01:14:25.523 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T01:14:25.523 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T01:14:25.523 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T01:14:25.523 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T01:14:25.523 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.524 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.525 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.525 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T01:14:25.525 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T01:14:25.525 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T01:14:25.525 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T01:14:25.525 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T01:14:25.525 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T01:14:25.525 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T01:14:25.525 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T01:14:25.525 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T01:14:25.525 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T01:14:25.525 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T01:14:25.526 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T01:14:25.527 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T01:14:25.528 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T01:14:25.529 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T01:14:25.529 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T01:14:25.529 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T01:14:25.529 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T01:14:25.529 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T01:14:25.529 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T01:14:25.529 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T01:14:25.529 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T01:14:25.529 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T01:14:25.529 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.530 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.530 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:25.530 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T01:14:25.530 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T01:14:25.530 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T01:14:25.530 INFO:teuthology.orchestra.run.smithi102.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T01:14:25.530 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T01:14:25.530 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T01:14:25.530 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T01:14:25.531 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:25.531 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-16T01:14:25.915 DEBUG:teuthology.parallel:result is None 2024-09-16T01:14:26.174 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-16T01:14:26.262 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-16T01:14:26.309 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-16T01:14:26.402 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-16T01:14:26.432 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-16T01:14:26.472 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-16T01:14:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-16T01:14:26.508 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:14:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-16T01:14:26.593 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:14:26.676 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-16T01:14:26.701 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-16T01:14:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:14:26.707 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:14:26.895 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-16T01:14:26.895 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:14:26.971 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-16T01:14:27.036 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:14:32.885 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:14:32.885 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-16T01:14:32.885 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-16T01:14:32.885 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-16T01:14:32.885 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-16T01:14:32.886 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-16T01:14:32.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-16T01:14:32.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-16T01:14:32.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-16T01:14:32.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-16T01:14:32.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-16T01:14:32.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-16T01:14:32.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-16T01:14:32.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-16T01:14:32.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-16T01:14:32.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-16T01:14:32.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-16T01:14:32.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-16T01:14:32.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-16T01:14:32.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-16T01:14:32.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-16T01:14:32.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-16T01:14:32.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-16T01:14:32.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-16T01:14:32.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-16T01:14:32.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-16T01:14:32.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-16T01:14:32.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-16T01:14:32.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-16T01:14:32.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-16T01:14:32.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-16T01:14:32.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-16T01:14:32.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-16T01:14:32.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-16T01:14:32.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-16T01:14:32.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-16T01:14:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-16T01:14:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-16T01:14:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-16T01:14:32.931 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-16T01:14:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-16T01:14:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-16T01:14:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-16T01:14:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-16T01:14:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-16T01:14:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-16T01:14:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-16T01:14:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-16T01:14:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-16T01:14:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-16T01:14:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-16T01:14:32.932 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-16T01:14:32.933 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-16T01:14:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-16T01:14:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-16T01:14:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-16T01:14:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-16T01:14:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-16T01:14:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-16T01:14:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-16T01:14:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-16T01:14:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-16T01:14:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-16T01:14:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-16T01:14:32.934 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-16T01:14:32.935 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-16T01:14:32.936 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-16T01:14:35.612 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-16T01:14:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:35.613 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-09-16T01:14:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-16T01:14:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-16T01:14:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-16T01:14:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-16T01:14:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-16T01:14:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-16T01:14:35.613 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.614 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.615 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-16T01:14:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-16T01:14:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-09-16T01:14:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T01:14:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T01:14:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T01:14:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-16T01:14:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T01:14:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T01:14:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-16T01:14:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T01:14:35.616 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T01:14:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T01:14:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T01:14:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T01:14:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T01:14:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T01:14:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T01:14:35.617 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T01:14:35.618 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.16-1.el9.x86_64 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.619 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T01:14:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T01:14:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T01:14:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T01:14:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-16T01:14:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-16T01:14:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T01:14:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T01:14:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T01:14:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T01:14:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T01:14:35.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T01:14:35.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T01:14:35.622 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T01:14:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-16T01:14:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T01:14:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T01:14:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T01:14:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T01:14:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T01:14:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T01:14:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T01:14:35.623 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.624 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-16T01:14:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T01:14:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T01:14:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T01:14:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-16T01:14:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-16T01:14:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T01:14:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-16T01:14:35.625 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:35.626 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-16T01:14:36.056 DEBUG:teuthology.parallel:result is None 2024-09-16T01:14:36.057 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:14:36.198 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T01:14:36.221 INFO:teuthology.orchestra.run.smithi081.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T01:14:36.221 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T01:14:36.221 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T01:14:36.223 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-16T01:14:36.363 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T01:14:36.389 INFO:teuthology.orchestra.run.smithi102.stdout:19.1.1-326.g8921c8ef.el9 2024-09-16T01:14:36.389 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-16T01:14:36.389 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-16T01:14:36.391 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T01:14:36.391 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:14:36.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T01:14:36.419 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:14:36.419 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T01:14:36.459 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T01:14:36.459 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:14:36.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T01:14:36.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T01:14:36.549 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:14:36.549 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T01:14:36.576 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T01:14:36.642 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T01:14:36.643 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:14:36.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T01:14:36.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T01:14:36.732 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:14:36.732 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T01:14:36.758 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T01:14:36.823 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T01:14:36.824 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:14:36.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T01:14:36.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T01:14:36.913 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:14:36.913 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T01:14:36.938 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T01:14:37.003 INFO:teuthology.run_tasks:Running task ceph... 2024-09-16T01:14:37.080 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-16T01:14:37.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-09-16T01:14:37.086 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2024-09-16T01:14:37.110 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-16T01:14:37.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T01:14:37.151 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-16T01:14:37.175 INFO:tasks.ceph:Creating extra log directories... 2024-09-16T01:14:37.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T01:14:37.215 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-16T01:14:37.245 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-16T01:14:37.245 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-16T01:14:37.245 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-16T01:14:37.246 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:14:37.246 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-16T01:14:37.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-16T01:14:37.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-16T01:14:37.442 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:14:37.442 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-16T01:14:37.458 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-16T01:14:37.570 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-16T01:14:37.600 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-16T01:14:37.600 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-16T01:14:37.600 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-limits}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906453', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3393, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'sleep_before_teardown': 0, 'subset': '294/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOicZ89XDrF4UAJOcgvRW6aqAZMATxJD+N2WFlRBaRbnbPSbDy6ZvmbXu+EyupAECXgUTyDC8AGgGhmtUxZqMsI=', 'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOw7E5jUOd17ArgLa7T4gmHNnqfmQ1oTl+/OVZMU4YzUTgranmKW/sbA2d+O5seKTkc3MPDJ7AVsuQ4dbSu4jHE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_client_limits']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-16T01:14:37.601 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T01:14:37.603 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-16T01:14:37.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T01:14:37.658 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2024-09-16T01:14:37.714 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:14:37.715 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T01:14:37.736 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T01:14:37.736 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-16T01:14:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T01:14:37.790 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:14:37.791 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-16T01:14:37.791 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:14:37.791 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:14:37.791 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-16 01:14:27.406352761 +0000 2024-09-16T01:14:37.791 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-16 01:12:31.453973366 +0000 2024-09-16T01:14:37.791 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-16 01:12:31.453973366 +0000 2024-09-16T01:14:37.791 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-16 01:12:31.453973366 +0000 2024-09-16T01:14:37.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T01:14:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-16T01:14:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-16T01:14:37.854 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000201785 s, 2.5 MB/s 2024-09-16T01:14:37.855 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T01:14:37.911 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-16T01:14:37.966 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T01:14:37.966 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:14:37.966 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-16T01:14:37.967 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:14:37.967 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:14:37.967 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-16 01:14:27.406352761 +0000 2024-09-16T01:14:37.967 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-16 01:12:31.776966932 +0000 2024-09-16T01:14:37.967 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-16 01:12:31.776966932 +0000 2024-09-16T01:14:37.967 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-16 01:12:31.776966932 +0000 2024-09-16T01:14:37.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T01:14:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-16T01:14:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-16T01:14:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00019201 s, 2.7 MB/s 2024-09-16T01:14:38.031 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T01:14:38.087 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-16T01:14:38.142 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T01:14:38.142 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:14:38.143 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-16T01:14:38.143 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:14:38.143 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:14:38.143 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-16 01:14:27.407352741 +0000 2024-09-16T01:14:38.143 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-16 01:12:32.107960338 +0000 2024-09-16T01:14:38.143 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-16 01:12:32.107960338 +0000 2024-09-16T01:14:38.143 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-16 01:12:32.107960338 +0000 2024-09-16T01:14:38.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T01:14:38.205 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-16T01:14:38.205 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-16T01:14:38.206 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000216057 s, 2.4 MB/s 2024-09-16T01:14:38.207 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T01:14:38.264 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-16T01:14:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T01:14:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:14:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T01:14:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:14:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:14:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-16 01:14:27.407352741 +0000 2024-09-16T01:14:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-16 01:12:32.438953744 +0000 2024-09-16T01:14:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-16 01:12:32.438953744 +0000 2024-09-16T01:14:38.319 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-16 01:12:32.438953744 +0000 2024-09-16T01:14:38.320 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T01:14:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-16T01:14:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-16T01:14:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000178387 s, 2.9 MB/s 2024-09-16T01:14:38.384 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T01:14:38.439 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T01:14:38.439 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:14:38.439 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T01:14:38.457 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T01:14:38.457 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-16T01:14:38.516 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T01:14:38.517 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:14:38.517 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-16T01:14:38.517 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:14:38.517 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:14:38.517 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-16 01:14:17.529077615 +0000 2024-09-16T01:14:38.517 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-16 01:12:31.468195632 +0000 2024-09-16T01:14:38.517 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-16 01:12:31.468195632 +0000 2024-09-16T01:14:38.518 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-16 01:12:31.468195632 +0000 2024-09-16T01:14:38.518 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T01:14:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-16T01:14:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-16T01:14:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000216756 s, 2.4 MB/s 2024-09-16T01:14:38.583 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T01:14:38.641 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-16T01:14:38.697 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T01:14:38.697 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:14:38.697 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-16T01:14:38.697 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:14:38.697 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:14:38.698 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-16 01:14:17.530077594 +0000 2024-09-16T01:14:38.698 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-16 01:12:31.815188344 +0000 2024-09-16T01:14:38.698 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-16 01:12:31.815188344 +0000 2024-09-16T01:14:38.698 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-16 01:12:31.815188344 +0000 2024-09-16T01:14:38.698 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T01:14:38.762 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-16T01:14:38.762 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-16T01:14:38.762 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000185394 s, 2.8 MB/s 2024-09-16T01:14:38.764 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T01:14:38.821 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-16T01:14:38.878 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T01:14:38.878 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:14:38.878 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-16T01:14:38.878 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:14:38.878 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:14:38.879 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-16 01:14:17.530077594 +0000 2024-09-16T01:14:38.879 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-16 01:12:32.131181707 +0000 2024-09-16T01:14:38.879 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-16 01:12:32.131181707 +0000 2024-09-16T01:14:38.879 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-16 01:12:32.131181707 +0000 2024-09-16T01:14:38.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T01:14:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-16T01:14:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-16T01:14:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000170879 s, 3.0 MB/s 2024-09-16T01:14:38.944 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T01:14:39.000 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-16T01:14:39.055 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T01:14:39.056 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T01:14:39.056 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-16T01:14:39.056 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T01:14:39.056 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T01:14:39.056 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-16 01:14:17.530077594 +0000 2024-09-16T01:14:39.056 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-16 01:12:32.460174798 +0000 2024-09-16T01:14:39.056 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-16 01:12:32.460174798 +0000 2024-09-16T01:14:39.056 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-16 01:12:32.460174798 +0000 2024-09-16T01:14:39.056 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T01:14:39.120 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-16T01:14:39.120 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-16T01:14:39.120 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000193827 s, 2.6 MB/s 2024-09-16T01:14:39.121 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T01:14:39.178 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T01:14:39.178 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-16T01:14:39.178 INFO:tasks.ceph:Generating config... 2024-09-16T01:14:39.180 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-16T01:14:39.180 INFO:tasks.ceph:[client] debug client = 20 2024-09-16T01:14:39.180 INFO:tasks.ceph:[client] debug ms = 1 2024-09-16T01:14:39.180 INFO:tasks.ceph:[client] pid file = 2024-09-16T01:14:39.180 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-16T01:14:39.180 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-16T01:14:39.180 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-16T01:14:39.180 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-16T01:14:39.180 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-16T01:14:39.180 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-16T01:14:39.180 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-16T01:14:39.180 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-16T01:14:39.181 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-16T01:14:39.182 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-16T01:14:39.183 INFO:tasks.ceph:Setting up mon.a... 2024-09-16T01:14:39.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-16T01:14:39.234 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2024-09-16T01:14:39.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-16T01:14:39.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T01:14:39.345 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.102'), ('mon.c', '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]')] 2024-09-16T01:14:39.346 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-16T01:14:39.347 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:14:39.347 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T01:14:39.401 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.102 --addv c '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:14:39.487 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:14:39.487 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973 2024-09-16T01:14:39.487 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-09-16T01:14:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2024-09-16T01:14:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:fsid a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973 2024-09-16T01:14:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2024-09-16T01:14:39.487548+0000 2024-09-16T01:14:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-16T01:14:39.487548+0000 2024-09-16T01:14:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 17 (quincy) 2024-09-16T01:14:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2024-09-16T01:14:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-16T01:14:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-09-16T01:14:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-16T01:14:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-16T01:14:39.489 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-16T01:14:39.504 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973... 2024-09-16T01:14:39.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T01:14:39.547 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-16T01:14:39.587 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-16T01:14:39.587 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-16T01:14:39.587 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T01:14:39.587 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-16T01:14:39.587 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.587 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-16T01:14:39.587 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.588 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.589 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on skipped message = False 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-16T01:14:39.590 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.591 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-16T01:14:39.592 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2024-09-16T01:14:39.593 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-16T01:14:39.594 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T01:14:39.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: mon down mkfs grace = 300 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on pool no app = False 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T01:14:39.596 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-16T01:14:39.597 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2024-09-16T01:14:39.598 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2024-09-16T01:14:39.598 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds balancer = 20 2024-09-16T01:14:39.598 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-16T01:14:39.598 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2024-09-16T01:14:39.598 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2024-09-16T01:14:39.598 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2024-09-16T01:14:39.598 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2024-09-16T01:14:39.598 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2024-09-16T01:14:39.598 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2024-09-16T01:14:39.598 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2024-09-16T01:14:39.599 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-16T01:14:39.599 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-09-16T01:14:39.599 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-16T01:14:39.599 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-09-16T01:14:39.600 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.600 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-09-16T01:14:39.600 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.600 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-09-16T01:14:39.600 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.600 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-09-16T01:14:39.600 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-09-16T01:14:39.600 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.600 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-09-16T01:14:39.600 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-09-16T01:14:39.600 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.600 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-09-16T01:14:39.601 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-09-16T01:14:39.602 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.81,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on skipped message = False 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-09-16T01:14:39.603 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-09-16T01:14:39.604 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.605 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-09-16T01:14:39.605 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-09-16T01:14:39.605 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.605 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-09-16T01:14:39.605 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-09-16T01:14:39.605 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-09-16T01:14:39.605 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-09-16T01:14:39.605 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2024-09-16T01:14:39.605 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2024-09-16T01:14:39.605 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-16T01:14:39.605 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-09-16T01:14:39.605 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-16T01:14:39.606 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-09-16T01:14:39.607 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-09-16T01:14:39.608 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.609 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-09-16T01:14:39.609 INFO:teuthology.orchestra.run.smithi102.stdout: mon down mkfs grace = 300 2024-09-16T01:14:39.609 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2024-09-16T01:14:39.609 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on pool no app = False 2024-09-16T01:14:39.609 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-16T01:14:39.609 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-09-16T01:14:39.609 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-09-16T01:14:39.609 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-09-16T01:14:39.609 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-09-16T01:14:39.609 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-16T01:14:39.609 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-16T01:14:39.609 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = "" 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2024-09-16T01:14:39.610 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2024-09-16T01:14:39.611 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2024-09-16T01:14:39.611 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-16T01:14:39.611 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2024-09-16T01:14:39.611 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2024-09-16T01:14:39.611 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2024-09-16T01:14:39.611 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2024-09-16T01:14:39.611 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-09-16T01:14:39.611 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-09-16T01:14:39.611 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-09-16T01:14:39.612 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-16T01:14:39.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-16T01:14:39.706 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-16T01:14:39.706 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:14:39.707 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-16T01:14:39.722 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:14:39.722 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-16T01:14:39.776 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:14:39.777 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:14:39.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T01:14:39.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T01:14:39.850 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:14:39.850 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:14:39.905 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:14:39.906 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:14:39.906 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-16T01:14:39.906 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-16T01:14:39.941 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:14:39.941 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:14:39.996 INFO:tasks.ceph:Setting up mon nodes... 2024-09-16T01:14:39.996 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-16T01:14:39.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T01:14:40.046 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-16T01:14:40.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T01:14:40.108 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-16T01:14:40.110 INFO:tasks.ceph:Setting up mds nodes... 2024-09-16T01:14:40.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-16T01:14:40.161 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-16T01:14:40.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-16T01:14:40.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-16T01:14:40.279 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-16T01:14:40.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-16T01:14:40.306 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-16T01:14:40.357 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-16T01:14:40.360 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-16T01:14:40.384 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-16T01:14:40.475 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-16T01:14:40.478 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-16T01:14:40.502 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-16T01:14:40.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T01:14:40.543 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-16T01:14:40.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-16T01:14:40.637 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-16T01:14:40.649 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T01:14:40.689 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-16T01:14:40.702 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-16T01:14:40.783 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-16T01:14:40.796 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-16T01:14:40.796 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-16T01:14:40.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-16T01:14:40.821 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T01:14:40.821 INFO:tasks.ceph:role: osd.0 2024-09-16T01:14:40.821 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:14:40.821 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T01:14:40.893 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:14:40.893 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:14:40.893 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:14:40.893 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:14:40.893 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:14:40.893 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:14:40.893 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:14:40.893 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:14:40.894 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:14:40.894 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:14:41.394 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-16T01:14:41.396 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-16T01:14:41.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-16T01:14:41.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-16T01:14:41.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-16T01:14:41.618 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T01:14:41.618 INFO:tasks.ceph:role: osd.1 2024-09-16T01:14:41.618 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:14:41.618 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T01:14:41.691 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:14:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:14:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:14:41.691 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:14:41.692 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:14:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:14:41.692 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:14:41.692 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:14:41.692 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:14:41.692 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:14:42.152 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-16T01:14:42.154 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-16T01:14:42.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-16T01:14:42.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-16T01:14:42.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-16T01:14:42.344 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T01:14:42.344 INFO:tasks.ceph:role: osd.2 2024-09-16T01:14:42.344 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:14:42.344 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T01:14:42.417 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:14:42.417 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:14:42.417 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:14:42.417 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:14:42.418 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:14:42.418 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:14:42.418 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:14:42.418 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:14:42.418 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:14:42.419 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:14:42.899 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-16T01:14:42.901 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-16T01:14:42.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-16T01:14:43.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-16T01:14:43.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-16T01:14:43.104 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-16T01:14:43.104 INFO:tasks.ceph:role: osd.3 2024-09-16T01:14:43.104 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:14:43.105 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T01:14:43.176 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:14:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:14:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:14:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:14:43.177 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:14:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:14:43.177 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:14:43.177 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:14:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:14:43.177 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:14:43.700 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-16T01:14:43.702 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-16T01:14:43.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-16T01:14:43.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-16T01:14:43.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:14:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:43.971+0000 7f514a358640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-16T01:14:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:43.971+0000 7f514a358640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-16T01:14:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:43.971+0000 7f514a358640 -1 bdev(0x55b9deb2f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-16T01:14:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:43.971+0000 7f514a358640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-16T01:14:46.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T01:14:46.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:14:47.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:47.004+0000 7effbc14d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-16T01:14:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:47.005+0000 7effbc14d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-16T01:14:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:47.005+0000 7effbc14d640 -1 bdev(0x5651f8857800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-16T01:14:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:47.005+0000 7effbc14d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-16T01:14:50.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T01:14:50.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:14:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:50.528+0000 7f000360c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-16T01:14:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:50.528+0000 7f000360c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-16T01:14:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:50.528+0000 7f000360c640 -1 bdev(0x55854d55f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-16T01:14:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:50.528+0000 7f000360c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-16T01:14:53.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T01:14:53.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:14:53.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:53.555+0000 7f854460e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-16T01:14:53.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:53.555+0000 7f854460e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-16T01:14:53.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:53.555+0000 7f854460e640 -1 bdev(0x5580cebd3800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-16T01:14:53.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:14:53.555+0000 7f854460e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-16T01:14:56.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T01:14:56.534 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-16T01:14:56.563 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T01:14:56.563 INFO:tasks.ceph:role: osd.4 2024-09-16T01:14:56.563 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:14:56.564 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-16T01:14:56.639 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:14:56.639 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:14:56.639 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:14:56.639 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:14:56.639 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:14:56.639 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:14:56.639 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:14:56.639 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:14:56.639 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:14:56.639 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:14:57.143 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-16T01:14:57.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-16T01:14:57.146 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-16T01:14:57.256 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-16T01:14:57.292 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-16T01:14:57.363 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T01:14:57.363 INFO:tasks.ceph:role: osd.5 2024-09-16T01:14:57.363 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:14:57.363 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-16T01:14:57.438 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:14:57.439 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:14:57.439 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:14:57.439 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:14:57.439 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:14:57.439 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:14:57.439 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:14:57.439 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:14:57.439 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:14:57.439 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:14:57.903 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-16T01:14:57.906 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-16T01:14:57.906 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-16T01:14:58.008 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-16T01:14:58.042 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-16T01:14:58.111 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T01:14:58.111 INFO:tasks.ceph:role: osd.6 2024-09-16T01:14:58.111 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:14:58.111 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-16T01:14:58.186 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:14:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:14:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:14:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:14:58.186 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:14:58.186 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:14:58.186 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:14:58.187 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:14:58.187 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:14:58.187 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:14:58.667 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-16T01:14:58.670 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-16T01:14:58.670 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-16T01:14:58.825 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-16T01:14:58.860 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-16T01:14:58.931 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-16T01:14:58.931 INFO:tasks.ceph:role: osd.7 2024-09-16T01:14:58.931 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:14:58.931 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-16T01:14:59.008 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-16T01:14:59.008 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-16T01:14:59.008 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-16T01:14:59.008 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-16T01:14:59.008 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-16T01:14:59.008 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-16T01:14:59.008 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-16T01:14:59.008 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-16T01:14:59.008 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-16T01:14:59.008 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-16T01:14:59.515 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-16T01:14:59.517 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-16T01:14:59.518 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-16T01:14:59.648 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-16T01:14:59.681 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:14:59.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:14:59.787+0000 7fc4a77cc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-16T01:14:59.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:14:59.788+0000 7fc4a77cc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-16T01:14:59.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:14:59.788+0000 7fc4a77cc640 -1 bdev(0x55b225d67800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-16T01:14:59.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:14:59.789+0000 7fc4a77cc640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-16T01:15:03.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T01:15:03.488 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:15:03.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:03.580+0000 7fafb642c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-16T01:15:03.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:03.580+0000 7fafb642c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-16T01:15:03.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:03.580+0000 7fafb642c640 -1 bdev(0x555ce5647800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-16T01:15:03.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:03.580+0000 7fafb642c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-16T01:15:06.496 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T01:15:06.526 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:15:06.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:06.619+0000 7fb95c345640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-16T01:15:06.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:06.619+0000 7fb95c345640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-16T01:15:06.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:06.619+0000 7fb95c345640 -1 bdev(0x556736121800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-16T01:15:06.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:06.620+0000 7fb95c345640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-16T01:15:07.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:15:07.605 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:15:09.794 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-16T01:15:09.821 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:15:09.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:09.907+0000 7f87f7c0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-16T01:15:09.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:09.907+0000 7f87f7c0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-16T01:15:09.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:09.907+0000 7f87f7c0d640 -1 bdev(0x563564cd1800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-16T01:15:09.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:09.908+0000 7f87f7c0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-16T01:15:13.069 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-16T01:15:13.099 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-16T01:15:13.100 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:13.100 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-16T01:15:13.129 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:13.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-16T01:15:13.198 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:13.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-16T01:15:13.266 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:13.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-16T01:15:13.333 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:13.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-16T01:15:13.400 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:13.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-16T01:15:13.467 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:13.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-16T01:15:13.531 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:13.532 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-16T01:15:13.561 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:13.561 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-16T01:15:13.630 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:13.630 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-16T01:15:13.698 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:13.698 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-16T01:15:13.764 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:13.764 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-16T01:15:13.831 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:13.831 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-16T01:15:13.896 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:13.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-16T01:15:13.962 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:13.962 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-16T01:15:13.979 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:13.979 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-16T01:15:14.037 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:14.037 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-16T01:15:14.054 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:14.054 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-16T01:15:14.109 INFO:tasks.ceph:Adding keys to all mons... 2024-09-16T01:15:14.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T01:15:14.112 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-16T01:15:14.155 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2024-09-16T01:15:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmqULCAhAAMbYmGXWGiINwif20O1JG3g== 2024-09-16T01:15:14.155 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-16T01:15:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmx4OgCRAAkmpWDpuwqbDuz0taNg8bag== 2024-09-16T01:15:14.156 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-16T01:15:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmcCavEBAA0CuddD0zPcjqrMSOD5c6OA== 2024-09-16T01:15:14.156 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-09-16T01:15:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCDhudmUtTqORAAkZKChid+qoa+0nIgpuun7g== 2024-09-16T01:15:14.156 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-09-16T01:15:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCHhudmUhtiABAA2vDoACv8RJ2KD9p1cdKClA== 2024-09-16T01:15:14.156 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-09-16T01:15:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCKhudmhOmRHxAAbGjJkUZLras/b6omekdz7A== 2024-09-16T01:15:14.156 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-09-16T01:15:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCNhudmA+csIRAAW1kenpimaWIak/qgG+UeXw== 2024-09-16T01:15:14.156 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-09-16T01:15:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmRdtyBhAAMQngXCuTHg6AjACCw/SmCg== 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmSNpLFRAAzc9Sr8b65zH9VZFYvqsYpA== 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmVeRcHBAANIL7HFYSc43qv7Zg0llkYQ== 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCThudmvgQBLxAAWLto5pG0iyiQPSnxldWYwg== 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCXhudmKfyiIhAALbJHvDeQtVgSCKjD1X3OYg== 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCahudmPG/9JBAA6d/gK0K/5c9Gp4uKOLCCOw== 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCdhudmVdY3NhAAXlOaeE0XidHVCaeQrirBAg== 2024-09-16T01:15:14.157 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-16T01:15:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg== 2024-09-16T01:15:14.158 INFO:teuthology.orchestra.run.smithi081.stdout:[client.2] 2024-09-16T01:15:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmwfD5JRAAPhdVLFZD07Uy75g3zStblg== 2024-09-16T01:15:14.158 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2024-09-16T01:15:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmMgEhKRAAUD2kJ9eOFJscZ6ATlO5PmQ== 2024-09-16T01:15:14.158 INFO:teuthology.orchestra.run.smithi081.stdout:[client.3] 2024-09-16T01:15:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudm8/qzLhAAVFRbGhXH00h2LS9ZC9rraA== 2024-09-16T01:15:14.175 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2024-09-16T01:15:14.175 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCAhudmqULCAhAAMbYmGXWGiINwif20O1JG3g== 2024-09-16T01:15:14.175 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-09-16T01:15:14.176 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCAhudmx4OgCRAAkmpWDpuwqbDuz0taNg8bag== 2024-09-16T01:15:14.176 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-09-16T01:15:14.176 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCAhudmcCavEBAA0CuddD0zPcjqrMSOD5c6OA== 2024-09-16T01:15:14.176 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2024-09-16T01:15:14.176 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCDhudmUtTqORAAkZKChid+qoa+0nIgpuun7g== 2024-09-16T01:15:14.176 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2024-09-16T01:15:14.176 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCHhudmUhtiABAA2vDoACv8RJ2KD9p1cdKClA== 2024-09-16T01:15:14.176 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2024-09-16T01:15:14.176 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCKhudmhOmRHxAAbGjJkUZLras/b6omekdz7A== 2024-09-16T01:15:14.176 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2024-09-16T01:15:14.176 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCNhudmA+csIRAAW1kenpimaWIak/qgG+UeXw== 2024-09-16T01:15:14.176 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCAhudmRdtyBhAAMQngXCuTHg6AjACCw/SmCg== 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCAhudmSNpLFRAAzc9Sr8b65zH9VZFYvqsYpA== 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCAhudmVeRcHBAANIL7HFYSc43qv7Zg0llkYQ== 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.4] 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCThudmvgQBLxAAWLto5pG0iyiQPSnxldWYwg== 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.5] 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCXhudmKfyiIhAALbJHvDeQtVgSCKjD1X3OYg== 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.6] 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCahudmPG/9JBAA6d/gK0K/5c9Gp4uKOLCCOw== 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.7] 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCdhudmVdY3NhAAXlOaeE0XidHVCaeQrirBAg== 2024-09-16T01:15:14.177 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2024-09-16T01:15:14.178 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg== 2024-09-16T01:15:14.178 INFO:teuthology.orchestra.run.smithi102.stdout:[client.2] 2024-09-16T01:15:14.178 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCAhudmwfD5JRAAPhdVLFZD07Uy75g3zStblg== 2024-09-16T01:15:14.178 INFO:teuthology.orchestra.run.smithi102.stdout:[client.1] 2024-09-16T01:15:14.178 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCAhudmMgEhKRAAUD2kJ9eOFJscZ6ATlO5PmQ== 2024-09-16T01:15:14.178 INFO:teuthology.orchestra.run.smithi102.stdout:[client.3] 2024-09-16T01:15:14.178 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCAhudm8/qzLhAAVFRbGhXH00h2LS9ZC9rraA== 2024-09-16T01:15:14.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T01:15:14.202 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T01:15:14.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:15:14.272 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:15:14.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:15:14.329 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:15:14.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.385 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.490 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.542 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T01:15:14.595 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-16T01:15:14.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:15:14.648 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:15:14.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:15:14.704 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-16T01:15:14.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.759 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.812 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.865 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.919 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-16T01:15:14.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:15:14.972 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:15:15.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:15:15.028 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:15:15.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:15:15.085 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:15:15.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:15:15.142 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-16T01:15:15.195 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-16T01:15:15.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-16T01:15:15.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T01:15:15.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-16T01:15:15.340 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-16T01:15:15.365 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T01:15:15.459 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-16T01:15:15.484 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-16T01:15:15.549 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-16T01:15:15.644 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-16T01:15:15.668 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:15:15.671 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-16T01:15:15.724 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-16T01:15:15.724 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-16T01:15:15.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-16T01:15:15.726 INFO:tasks.ceph.mon.a:Started 2024-09-16T01:15:15.726 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-16T01:15:15.726 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-16T01:15:15.766 INFO:tasks.ceph.mon.b:Started 2024-09-16T01:15:15.766 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-16T01:15:15.766 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-16T01:15:15.768 INFO:tasks.ceph.mon.c:Started 2024-09-16T01:15:15.768 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-16T01:15:15.768 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-16T01:15:15.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-16T01:15:15.770 INFO:tasks.ceph.mgr.y:Started 2024-09-16T01:15:15.771 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-16T01:15:15.771 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-16T01:15:15.773 INFO:tasks.ceph.mgr.x:Started 2024-09-16T01:15:15.773 INFO:tasks.ceph:Setting crush tunables to default 2024-09-16T01:15:15.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2024-09-16T01:15:15.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.872+0000 7efda8ae6640 1 Processor -- start 2024-09-16T01:15:15.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.872+0000 7efda8ae6640 1 -- start start 2024-09-16T01:15:15.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.873+0000 7efda8ae6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efda40b48e0 0x7efda4165f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.873+0000 7efda8ae6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda40b5770 con 0x7efda415b1b0 2024-09-16T01:15:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.873+0000 7efda8ae6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda40b09f0 con 0x7efda409ab10 2024-09-16T01:15:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.873+0000 7efda8ae6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efda40b5510 con 0x7efda40b48e0 2024-09-16T01:15:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.874+0000 7efda259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efda415b1b0 0x7efda40b4e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33592/0 (socket says 172.21.15.81:33592) 2024-09-16T01:15:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.874+0000 7efda259c640 1 -- 172.21.15.81:0/362999630 learned_addr learned my addr 172.21.15.81:0/362999630 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.874+0000 7efda2d9d640 1 --2- 172.21.15.81:0/362999630 >> v2:172.21.15.102:3300/0 conn(0x7efda40b48e0 0x7efda4165f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.874+0000 7efda2d9d640 1 -- 172.21.15.81:0/362999630 >> v2:172.21.15.102:3300/0 conn(0x7efda40b48e0 msgr2=0x7efda4165f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-16T01:15:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.874+0000 7efda2d9d640 1 -- 172.21.15.81:0/362999630 >> v2:172.21.15.102:3300/0 conn(0x7efda40b48e0 msgr2=0x7efda4165f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-16T01:15:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.874+0000 7efda2d9d640 1 --2- 172.21.15.81:0/362999630 >> v2:172.21.15.102:3300/0 conn(0x7efda40b48e0 0x7efda4165f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-16T01:15:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:15.874+0000 7efda2d9d640 1 --2- 172.21.15.81:0/362999630 >> v2:172.21.15.102:3300/0 conn(0x7efda40b48e0 0x7efda4165f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-16T01:15:16.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.039+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1904978882 0 0) 0x7efda40b5770 con 0x7efda415b1b0 2024-09-16T01:15:16.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.039+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd8c003520 con 0x7efda415b1b0 2024-09-16T01:15:16.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2009479436 0 0) 0x7efd8c003520 con 0x7efda415b1b0 2024-09-16T01:15:16.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 >> v2:172.21.15.102:3300/0 conn(0x7efda40b48e0 msgr2=0x7efda4165f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:15:16.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 --2- 172.21.15.81:0/362999630 >> v2:172.21.15.102:3300/0 conn(0x7efda40b48e0 0x7efda4165f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 >> v1:172.21.15.102:6789/0 conn(0x7efda409ab10 legacy=0x7efda40b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda40b0cd0 con 0x7efda415b1b0 2024-09-16T01:15:16.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7efd94001670 con 0x7efda415b1b0 2024-09-16T01:15:16.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 >> v1:172.21.15.81:6789/0 conn(0x7efda415b1b0 legacy=0x7efda40b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 --2- 172.21.15.81:0/362999630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0039b0 0x7efd8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 --2- 172.21.15.81:0/362999630 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd8c004800 0x7efd8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 --2- 172.21.15.81:0/362999630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c0051c0 0x7efd8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efda40b5510 con 0x7efd8c0051c0 2024-09-16T01:15:16.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c00c110 con 0x7efd8c0039b0 2024-09-16T01:15:16.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efd8c00c310 con 0x7efd8c004800 2024-09-16T01:15:16.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda2d9d640 1 --2- 172.21.15.81:0/362999630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c0051c0 0x7efd8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda259c640 1 --2- 172.21.15.81:0/362999630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0039b0 0x7efd8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda1d9b640 1 --2- 172.21.15.81:0/362999630 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd8c004800 0x7efd8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda259c640 1 -- 172.21.15.81:0/362999630 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd8c004800 msgr2=0x7efd8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:16.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda259c640 1 --2- 172.21.15.81:0/362999630 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd8c004800 0x7efd8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda259c640 1 -- 172.21.15.81:0/362999630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c0051c0 msgr2=0x7efd8c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:16.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda259c640 1 --2- 172.21.15.81:0/362999630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c0051c0 0x7efd8c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda259c640 1 -- 172.21.15.81:0/362999630 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c003520 con 0x7efd8c0039b0 2024-09-16T01:15:16.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda2d9d640 1 --2- 172.21.15.81:0/362999630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c0051c0 0x7efd8c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:16.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.040+0000 7efda2d9d640 1 -- 172.21.15.81:0/362999630 reap_dead start 2024-09-16T01:15:16.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.041+0000 7efda259c640 1 --2- 172.21.15.81:0/362999630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0039b0 0x7efd8c003dd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd9400c240 tx=0x7efd8c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ec4c4dc35d0f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.043+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94007cf0 con 0x7efd8c0039b0 2024-09-16T01:15:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.043+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd94005af0 con 0x7efd8c0039b0 2024-09-16T01:15:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.043+0000 7efda159a640 1 -- 172.21.15.81:0/362999630 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd94007070 con 0x7efd8c0039b0 2024-09-16T01:15:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.044+0000 7efda8ae6640 1 -- 172.21.15.81:0/362999630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0039b0 msgr2=0x7efd8c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.044+0000 7efda8ae6640 1 --2- 172.21.15.81:0/362999630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0039b0 0x7efd8c003dd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd9400c240 tx=0x7efd8c005830 comp rx=0 tx=0).stop 2024-09-16T01:15:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.044+0000 7efda8ae6640 1 -- 172.21.15.81:0/362999630 shutdown_connections 2024-09-16T01:15:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.044+0000 7efda8ae6640 1 --2- 172.21.15.81:0/362999630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0039b0 0x7efd8c003dd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.044+0000 7efda8ae6640 1 -- 172.21.15.81:0/362999630 >> 172.21.15.81:0/362999630 conn(0x7efda40734b0 msgr2=0x7efda40b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.044+0000 7efda8ae6640 1 -- 172.21.15.81:0/362999630 shutdown_connections 2024-09-16T01:15:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.045+0000 7efda8ae6640 1 -- 172.21.15.81:0/362999630 wait complete. 2024-09-16T01:15:16.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.046+0000 7efda8ae6640 1 Processor -- start 2024-09-16T01:15:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.046+0000 7efda8ae6640 1 -- start start 2024-09-16T01:15:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda8ae6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0039b0 0x7efda409e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda8ae6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda41e4350 0x7efda4157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda8ae6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda41f1f50 0x7efda41e5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda8ae6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efda40b5bd0 con 0x7efda41e4350 2024-09-16T01:15:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda8ae6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efda40b5a50 con 0x7efd8c0039b0 2024-09-16T01:15:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda8ae6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efda415b590 con 0x7efda41f1f50 2024-09-16T01:15:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda41e4350 0x7efda4157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda41e4350 0x7efda4157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39732/0 (socket says 172.21.15.81:39732) 2024-09-16T01:15:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda1d9b640 1 -- 172.21.15.81:0/1298800770 learned_addr learned my addr 172.21.15.81:0/1298800770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:16.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda259c640 1 --2- 172.21.15.81:0/1298800770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0039b0 0x7efda409e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda2d9d640 1 --2- 172.21.15.81:0/1298800770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda41f1f50 0x7efda41e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda1d9b640 1 -- 172.21.15.81:0/1298800770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda41f1f50 msgr2=0x7efda41e5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda1d9b640 1 --2- 172.21.15.81:0/1298800770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda41f1f50 0x7efda41e5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda1d9b640 1 -- 172.21.15.81:0/1298800770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0039b0 msgr2=0x7efda409e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda1d9b640 1 --2- 172.21.15.81:0/1298800770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0039b0 0x7efda409e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda1d9b640 1 -- 172.21.15.81:0/1298800770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda41e47d0 con 0x7efda41e4350 2024-09-16T01:15:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.047+0000 7efda1d9b640 1 --2- 172.21.15.81:0/1298800770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda41e4350 0x7efda4157910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efd9800f620 tx=0x7efd9800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.048+0000 7efd92ffd640 1 -- 172.21.15.81:0/1298800770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd980052e0 con 0x7efda41e4350 2024-09-16T01:15:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.048+0000 7efd92ffd640 1 -- 172.21.15.81:0/1298800770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98018070 con 0x7efda41e4350 2024-09-16T01:15:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.048+0000 7efda8ae6640 1 -- 172.21.15.81:0/1298800770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda409c520 con 0x7efda41e4350 2024-09-16T01:15:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.048+0000 7efd92ffd640 1 -- 172.21.15.81:0/1298800770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98003810 con 0x7efda41e4350 2024-09-16T01:15:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.048+0000 7efda8ae6640 1 -- 172.21.15.81:0/1298800770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda409cae0 con 0x7efda41e4350 2024-09-16T01:15:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.048+0000 7efd92ffd640 1 -- 172.21.15.81:0/1298800770 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efd9801c410 con 0x7efda41e4350 2024-09-16T01:15:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.048+0000 7efd92ffd640 1 -- 172.21.15.81:0/1298800770 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efd9800d530 con 0x7efda41e4350 2024-09-16T01:15:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.049+0000 7efda8ae6640 1 -- 172.21.15.81:0/1298800770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda40b2b40 con 0x7efda41e4350 2024-09-16T01:15:16.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.051+0000 7efd92ffd640 1 -- 172.21.15.81:0/1298800770 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efda40b2b40 con 0x7efda41e4350 2024-09-16T01:15:16.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.114+0000 7efda8ae6640 1 -- 172.21.15.81:0/1298800770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7efda4070010 con 0x7efda41e4350 2024-09-16T01:15:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.116+0000 7efd92ffd640 1 -- 172.21.15.81:0/1298800770 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7efda41e47d0 con 0x7efda41e4350 2024-09-16T01:15:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-16T01:15:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.117+0000 7efda8ae6640 1 -- 172.21.15.81:0/1298800770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda41e4350 msgr2=0x7efda4157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.117+0000 7efda8ae6640 1 --2- 172.21.15.81:0/1298800770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda41e4350 0x7efda4157910 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efd9800f620 tx=0x7efd9800fae0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.117+0000 7efda8ae6640 1 -- 172.21.15.81:0/1298800770 shutdown_connections 2024-09-16T01:15:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.117+0000 7efda8ae6640 1 --2- 172.21.15.81:0/1298800770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda41f1f50 0x7efda41e5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.117+0000 7efda8ae6640 1 --2- 172.21.15.81:0/1298800770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda41e4350 0x7efda4157910 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.117+0000 7efda8ae6640 1 --2- 172.21.15.81:0/1298800770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0039b0 0x7efda409e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.117+0000 7efda8ae6640 1 -- 172.21.15.81:0/1298800770 >> 172.21.15.81:0/1298800770 conn(0x7efda40734b0 msgr2=0x7efda4070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.117+0000 7efda8ae6640 1 -- 172.21.15.81:0/1298800770 shutdown_connections 2024-09-16T01:15:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:16.117+0000 7efda8ae6640 1 -- 172.21.15.81:0/1298800770 wait complete. 2024-09-16T01:15:16.129 INFO:tasks.ceph:check_enable_crimson: False 2024-09-16T01:15:16.129 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-16T01:15:16.129 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:16.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-16T01:15:16.140 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:16.139+0000 7f7c909d4040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T01:15:16.146 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:16.145+0000 7fcd30769040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-16T01:15:16.153 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:16.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-16T01:15:16.180 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:16.179+0000 7f7c909d4040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T01:15:16.188 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:16.187+0000 7fcd30769040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-16T01:15:16.212 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:16.212 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-16T01:15:16.277 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:16.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-16T01:15:16.327 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:16.326+0000 7f7c909d4040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T01:15:16.330 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:16.330+0000 7fcd30769040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-16T01:15:16.341 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:16.341 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-16T01:15:16.366 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:16.366 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-16T01:15:16.380 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:16.378+0000 7f7c909d4040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T01:15:16.382 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:16.382+0000 7fcd30769040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-16T01:15:16.403 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:16.404 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-16T01:15:16.469 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:15:16.469 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-16T01:15:16.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 79091d3d-fd64-4212-82b8-8a55acc7aa49 0 2024-09-16T01:15:16.552 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:16.552+0000 7fcd30769040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:15:16.594 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:16.593+0000 7f7c909d4040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:15:16.661 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:16.660+0000 7fcd30769040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T01:15:16.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.671+0000 7f6937e8d640 1 Processor -- start 2024-09-16T01:15:16.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.671+0000 7f6937e8d640 1 -- start start 2024-09-16T01:15:16.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.672+0000 7f6937e8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 0x7f69300b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.672+0000 7f6937e8d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f693006c970 con 0x7f69300b5f40 2024-09-16T01:15:16.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.672+0000 7f6937e8d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69300b6420 con 0x7f6930161dc0 2024-09-16T01:15:16.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.672+0000 7f6937e8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f69300b6700 con 0x7f693006be80 2024-09-16T01:15:16.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.672+0000 7f693642a640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6930161dc0 0x7f693015e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57766/0 (socket says 172.21.15.102:57766) 2024-09-16T01:15:16.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.672+0000 7f693642a640 1 -- 172.21.15.102:0/3777135049 learned_addr learned my addr 172.21.15.102:0/3777135049 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-16T01:15:16.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.672+0000 7f6935c29640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 0x7f69300b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.673+0000 7f6935c29640 1 -- 172.21.15.102:0/3777135049 >> v1:172.21.15.102:6789/0 conn(0x7f6930161dc0 legacy=0x7f693015e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.673+0000 7f6934c27640 1 -- 172.21.15.102:0/3777135049 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1140244728 0 0) 0x7f69300b6420 con 0x7f6930161dc0 2024-09-16T01:15:16.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.673+0000 7f6935c29640 1 -- 172.21.15.102:0/3777135049 >> v1:172.21.15.81:6789/0 conn(0x7f69300b5f40 legacy=0x7f693006c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.673+0000 7f6935c29640 1 -- 172.21.15.102:0/3777135049 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69301602d0 con 0x7f693006be80 2024-09-16T01:15:16.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.673+0000 7f6935c29640 1 --2- 172.21.15.102:0/3777135049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 0x7f69300b0750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f69240097d0 tx=0x7f692402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b5d6c25175a8c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:16.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.674+0000 7f6934c27640 1 -- 172.21.15.102:0/3777135049 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924037070 con 0x7f693006be80 2024-09-16T01:15:16.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.674+0000 7f6934c27640 1 -- 172.21.15.102:0/3777135049 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6924032440 con 0x7f693006be80 2024-09-16T01:15:16.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.674+0000 7f6934c27640 1 -- 172.21.15.102:0/3777135049 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924032810 con 0x7f693006be80 2024-09-16T01:15:16.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.674+0000 7f6937e8d640 1 -- 172.21.15.102:0/3777135049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 msgr2=0x7f69300b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.674+0000 7f6937e8d640 1 --2- 172.21.15.102:0/3777135049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 0x7f69300b0750 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f69240097d0 tx=0x7f692402a180 comp rx=0 tx=0).stop 2024-09-16T01:15:16.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.674+0000 7f6937e8d640 1 -- 172.21.15.102:0/3777135049 shutdown_connections 2024-09-16T01:15:16.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.674+0000 7f6937e8d640 1 --2- 172.21.15.102:0/3777135049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 0x7f69300b0750 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.674+0000 7f6937e8d640 1 -- 172.21.15.102:0/3777135049 >> 172.21.15.102:0/3777135049 conn(0x7f69300734b0 msgr2=0x7f69300b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:16.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.674+0000 7f6937e8d640 1 -- 172.21.15.102:0/3777135049 shutdown_connections 2024-09-16T01:15:16.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.674+0000 7f6937e8d640 1 -- 172.21.15.102:0/3777135049 wait complete. 2024-09-16T01:15:16.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f6937e8d640 1 Processor -- start 2024-09-16T01:15:16.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f6937e8d640 1 -- start start 2024-09-16T01:15:16.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f6937e8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 0x7f6930158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f6937e8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69300b5f40 0x7f6930151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f6937e8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6930161dc0 0x7f69301f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f6937e8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f693015ed90 con 0x7f6930161dc0 2024-09-16T01:15:16.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f6937e8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6930160890 con 0x7f69300b5f40 2024-09-16T01:15:16.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f6937e8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f693015ef10 con 0x7f693006be80 2024-09-16T01:15:16.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f6935c29640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 0x7f6930158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f6935c29640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 0x7f6930158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:41714/0 (socket says 172.21.15.102:41714) 2024-09-16T01:15:16.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f6935c29640 1 -- 172.21.15.102:0/693366536 learned_addr learned my addr 172.21.15.102:0/693366536 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-16T01:15:16.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f6935428640 1 --2- 172.21.15.102:0/693366536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69300b5f40 0x7f6930151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.676+0000 7f693642a640 1 --2- 172.21.15.102:0/693366536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6930161dc0 0x7f69301f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f6935c29640 1 -- 172.21.15.102:0/693366536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69300b5f40 msgr2=0x7f6930151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f6935c29640 1 --2- 172.21.15.102:0/693366536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69300b5f40 0x7f6930151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f6935c29640 1 -- 172.21.15.102:0/693366536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6930161dc0 msgr2=0x7f69301f40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f6935c29640 1 --2- 172.21.15.102:0/693366536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6930161dc0 0x7f69301f40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f6935c29640 1 -- 172.21.15.102:0/693366536 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6930154c80 con 0x7f693006be80 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f6935428640 1 --2- 172.21.15.102:0/693366536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69300b5f40 0x7f6930151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f6935c29640 1 --2- 172.21.15.102:0/693366536 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 0x7f6930158140 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f69240097d0 tx=0x7f69240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f69227fc640 1 -- 172.21.15.102:0/693366536 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924041070 con 0x7f693006be80 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f69227fc640 1 -- 172.21.15.102:0/693366536 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692403c870 con 0x7f693006be80 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f6937e8d640 1 -- 172.21.15.102:0/693366536 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69301543e0 con 0x7f693006be80 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f69227fc640 1 -- 172.21.15.102:0/693366536 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6924037040 con 0x7f693006be80 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f6937e8d640 1 -- 172.21.15.102:0/693366536 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f69301549a0 con 0x7f693006be80 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f69227fc640 1 -- 172.21.15.102:0/693366536 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6924044070 con 0x7f693006be80 2024-09-16T01:15:16.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.677+0000 7f69227fc640 1 -- 172.21.15.102:0/693366536 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f692403d3f0 con 0x7f693006be80 2024-09-16T01:15:16.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.678+0000 7f6937e8d640 1 -- 172.21.15.102:0/693366536 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69300b0750 con 0x7f693006be80 2024-09-16T01:15:16.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.680+0000 7f69227fc640 1 -- 172.21.15.102:0/693366536 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f692403cc60 con 0x7f693006be80 2024-09-16T01:15:16.711 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:16.710+0000 7f7c909d4040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-16T01:15:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.750+0000 7f6937e8d640 1 -- 172.21.15.102:0/693366536 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd new", "uuid": "79091d3d-fd64-4212-82b8-8a55acc7aa49", "id": 0} v 0) -- 0x7f6930152460 con 0x7f693006be80 2024-09-16T01:15:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.755+0000 7f69227fc640 1 -- 172.21.15.102:0/693366536 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "79091d3d-fd64-4212-82b8-8a55acc7aa49", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f6924046450 con 0x7f693006be80 2024-09-16T01:15:16.756 INFO:teuthology.orchestra.run.smithi102.stdout:0 2024-09-16T01:15:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.756+0000 7f6937e8d640 1 -- 172.21.15.102:0/693366536 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 msgr2=0x7f6930158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.756+0000 7f6937e8d640 1 --2- 172.21.15.102:0/693366536 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 0x7f6930158140 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f69240097d0 tx=0x7f69240046c0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.756+0000 7f6937e8d640 1 -- 172.21.15.102:0/693366536 shutdown_connections 2024-09-16T01:15:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.756+0000 7f6937e8d640 1 --2- 172.21.15.102:0/693366536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6930161dc0 0x7f69301f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.756+0000 7f6937e8d640 1 --2- 172.21.15.102:0/693366536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69300b5f40 0x7f6930151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.756+0000 7f6937e8d640 1 --2- 172.21.15.102:0/693366536 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f693006be80 0x7f6930158140 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.756+0000 7f6937e8d640 1 -- 172.21.15.102:0/693366536 >> 172.21.15.102:0/693366536 conn(0x7f69300734b0 msgr2=0x7f69300b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.756+0000 7f6937e8d640 1 -- 172.21.15.102:0/693366536 shutdown_connections 2024-09-16T01:15:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.756+0000 7f6937e8d640 1 -- 172.21.15.102:0/693366536 wait complete. 2024-09-16T01:15:16.768 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 75c9bff1-ab46-4ce0-b3c2-75302021affc 1 2024-09-16T01:15:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.906+0000 7f3dae36d640 1 Processor -- start 2024-09-16T01:15:16.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.906+0000 7f3dae36d640 1 -- start start 2024-09-16T01:15:16.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.907+0000 7f3dae36d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 0x7f3da815de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.907+0000 7f3dae36d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da80b3dc0 con 0x7f3da8145cd0 2024-09-16T01:15:16.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.907+0000 7f3dae36d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da80b3ae0 con 0x7f3da806c320 2024-09-16T01:15:16.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.907+0000 7f3dae36d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3da80b3890 con 0x7f3da80b64e0 2024-09-16T01:15:16.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.907+0000 7f3da77fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 0x7f3da815de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.907+0000 7f3dac90a640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3da806c320 0x7f3da815e340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57778/0 (socket says 172.21.15.102:57778) 2024-09-16T01:15:16.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.907+0000 7f3dac90a640 1 -- 172.21.15.102:0/1412198635 learned_addr learned my addr 172.21.15.102:0/1412198635 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-16T01:15:16.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.907+0000 7f3da6ffd640 1 -- 172.21.15.102:0/1412198635 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204583744 0 0) 0x7f3da80b3ae0 con 0x7f3da806c320 2024-09-16T01:15:16.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.907+0000 7f3da77fe640 1 -- 172.21.15.102:0/1412198635 >> v1:172.21.15.102:6789/0 conn(0x7f3da806c320 legacy=0x7f3da815e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.907+0000 7f3da77fe640 1 -- 172.21.15.102:0/1412198635 >> v1:172.21.15.81:6789/0 conn(0x7f3da8145cd0 legacy=0x7f3da806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.907+0000 7f3da77fe640 1 -- 172.21.15.102:0/1412198635 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da815d600 con 0x7f3da80b64e0 2024-09-16T01:15:16.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.908+0000 7f3da77fe640 1 --2- 172.21.15.102:0/1412198635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 0x7f3da815de00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0097d0 tx=0x7f3d9c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e942b9e49276a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:16.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.908+0000 7f3da6ffd640 1 -- 172.21.15.102:0/1412198635 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c037070 con 0x7f3da80b64e0 2024-09-16T01:15:16.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.908+0000 7f3da6ffd640 1 -- 172.21.15.102:0/1412198635 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9c032440 con 0x7f3da80b64e0 2024-09-16T01:15:16.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.908+0000 7f3da6ffd640 1 -- 172.21.15.102:0/1412198635 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c032810 con 0x7f3da80b64e0 2024-09-16T01:15:16.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.909+0000 7f3dae36d640 1 -- 172.21.15.102:0/1412198635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 msgr2=0x7f3da815de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.909+0000 7f3dae36d640 1 --2- 172.21.15.102:0/1412198635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 0x7f3da815de00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0097d0 tx=0x7f3d9c02a180 comp rx=0 tx=0).stop 2024-09-16T01:15:16.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.909+0000 7f3dae36d640 1 -- 172.21.15.102:0/1412198635 shutdown_connections 2024-09-16T01:15:16.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.909+0000 7f3dae36d640 1 --2- 172.21.15.102:0/1412198635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 0x7f3da815de00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.909+0000 7f3dae36d640 1 -- 172.21.15.102:0/1412198635 >> 172.21.15.102:0/1412198635 conn(0x7f3da80734b0 msgr2=0x7f3da80b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:16.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.909+0000 7f3dae36d640 1 -- 172.21.15.102:0/1412198635 shutdown_connections 2024-09-16T01:15:16.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.909+0000 7f3dae36d640 1 -- 172.21.15.102:0/1412198635 wait complete. 2024-09-16T01:15:16.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.910+0000 7f3dae36d640 1 Processor -- start 2024-09-16T01:15:16.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.910+0000 7f3dae36d640 1 -- start start 2024-09-16T01:15:16.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3dae36d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da806c320 0x7f3da815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3dae36d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 0x7f3da815b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3dae36d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da8145cd0 0x7f3da80cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3dae36d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3da809aa30 con 0x7f3da806c320 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3dae36d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3da81460b0 con 0x7f3da8145cd0 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3dae36d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3da809abb0 con 0x7f3da80b64e0 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3dac90a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da8145cd0 0x7f3da80cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3da77fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 0x7f3da815b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3dac90a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da8145cd0 0x7f3da80cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39108/0 (socket says 172.21.15.102:39108) 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3da77fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 0x7f3da815b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:41728/0 (socket says 172.21.15.102:41728) 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3dac90a640 1 -- 172.21.15.102:0/2868490900 learned_addr learned my addr 172.21.15.102:0/2868490900 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3da7fff640 1 --2- 172.21.15.102:0/2868490900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da806c320 0x7f3da815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3da77fe640 1 -- 172.21.15.102:0/2868490900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da8145cd0 msgr2=0x7f3da80cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3da77fe640 1 --2- 172.21.15.102:0/2868490900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da8145cd0 0x7f3da80cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3da77fe640 1 -- 172.21.15.102:0/2868490900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da806c320 msgr2=0x7f3da815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3da77fe640 1 --2- 172.21.15.102:0/2868490900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da806c320 0x7f3da815ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3da77fe640 1 -- 172.21.15.102:0/2868490900 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da813e2d0 con 0x7f3da80b64e0 2024-09-16T01:15:16.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3da77fe640 1 --2- 172.21.15.102:0/2868490900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 0x7f3da815b220 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c031000 tx=0x7f3d9c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:16.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.911+0000 7f3da4ff9640 1 -- 172.21.15.102:0/2868490900 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c032e60 con 0x7f3da80b64e0 2024-09-16T01:15:16.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.912+0000 7f3da4ff9640 1 -- 172.21.15.102:0/2868490900 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9c042070 con 0x7f3da80b64e0 2024-09-16T01:15:16.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.912+0000 7f3dae36d640 1 -- 172.21.15.102:0/2868490900 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da813e5b0 con 0x7f3da80b64e0 2024-09-16T01:15:16.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.912+0000 7f3da4ff9640 1 -- 172.21.15.102:0/2868490900 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c037040 con 0x7f3da80b64e0 2024-09-16T01:15:16.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.912+0000 7f3dae36d640 1 -- 172.21.15.102:0/2868490900 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da813eb70 con 0x7f3da80b64e0 2024-09-16T01:15:16.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.912+0000 7f3da4ff9640 1 -- 172.21.15.102:0/2868490900 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3d9c030b70 con 0x7f3da80b64e0 2024-09-16T01:15:16.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.912+0000 7f3da4ff9640 1 -- 172.21.15.102:0/2868490900 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f3d9c03d7f0 con 0x7f3da80b64e0 2024-09-16T01:15:16.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.912+0000 7f3dae36d640 1 -- 172.21.15.102:0/2868490900 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da80ae1b0 con 0x7f3da80b64e0 2024-09-16T01:15:16.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.916+0000 7f3da4ff9640 1 -- 172.21.15.102:0/2868490900 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3d9c047d20 con 0x7f3da80b64e0 2024-09-16T01:15:16.985 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:16.985+0000 7fcd30769040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T01:15:16.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.985+0000 7f3dae36d640 1 -- 172.21.15.102:0/2868490900 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd new", "uuid": "75c9bff1-ab46-4ce0-b3c2-75302021affc", "id": 1} v 0) -- 0x7f3da815cfd0 con 0x7f3da80b64e0 2024-09-16T01:15:16.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.990+0000 7f3da4ff9640 1 -- 172.21.15.102:0/2868490900 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "75c9bff1-ab46-4ce0-b3c2-75302021affc", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f3d9c03da40 con 0x7f3da80b64e0 2024-09-16T01:15:16.991 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:15:16.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.991+0000 7f3dae36d640 1 -- 172.21.15.102:0/2868490900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 msgr2=0x7f3da815b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:16.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.991+0000 7f3dae36d640 1 --2- 172.21.15.102:0/2868490900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 0x7f3da815b220 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c031000 tx=0x7f3d9c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.991+0000 7f3dae36d640 1 -- 172.21.15.102:0/2868490900 shutdown_connections 2024-09-16T01:15:16.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.991+0000 7f3dae36d640 1 --2- 172.21.15.102:0/2868490900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da8145cd0 0x7f3da80cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.991+0000 7f3dae36d640 1 --2- 172.21.15.102:0/2868490900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da80b64e0 0x7f3da815b220 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.991+0000 7f3dae36d640 1 --2- 172.21.15.102:0/2868490900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da806c320 0x7f3da815ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:16.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.991+0000 7f3dae36d640 1 -- 172.21.15.102:0/2868490900 >> 172.21.15.102:0/2868490900 conn(0x7f3da80734b0 msgr2=0x7f3da815dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:16.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.991+0000 7f3dae36d640 1 -- 172.21.15.102:0/2868490900 shutdown_connections 2024-09-16T01:15:16.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:16.991+0000 7f3dae36d640 1 -- 172.21.15.102:0/2868490900 wait complete. 2024-09-16T01:15:17.002 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 292f046c-3cd5-4df5-976c-1e6d40d4ca60 2 2024-09-16T01:15:17.035 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:17.035+0000 7fcd30769040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T01:15:17.048 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:17.047+0000 7f7c909d4040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-16T01:15:17.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.099+0000 7f11d18c9640 1 Processor -- start 2024-09-16T01:15:17.100 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:17.099+0000 7f7c909d4040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-16T01:15:17.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.099+0000 7f11d18c9640 1 -- start start 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11d18c9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11cc162e30 0x7f11cc06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11d18c9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f11cc0cf280 0x7f11cc0d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11d18c9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11cc15ff70 con 0x7f11cc162340 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11d18c9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f11cc06de90 con 0x7f11cc162e30 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11d18c9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f11cc163270 con 0x7f11cc0cf280 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11cb7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f11cc0cf280 0x7f11cc0d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11cb7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f11cc0cf280 0x7f11cc0d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39116/0 (socket says 172.21.15.102:39116) 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11cb7fe640 1 -- 172.21.15.102:0/2386990563 learned_addr learned my addr 172.21.15.102:0/2386990563 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11c3fff640 1 --2- 172.21.15.102:0/2386990563 >> v2:172.21.15.81:3300/0 conn(0x7f11cc162e30 0x7f11cc06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11cb7fe640 1 -- 172.21.15.102:0/2386990563 >> v2:172.21.15.81:3300/0 conn(0x7f11cc162e30 msgr2=0x7f11cc06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11cb7fe640 1 --2- 172.21.15.102:0/2386990563 >> v2:172.21.15.81:3300/0 conn(0x7f11cc162e30 0x7f11cc06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11cb7fe640 1 -- 172.21.15.102:0/2386990563 >> v1:172.21.15.81:6789/0 conn(0x7f11cc162340 legacy=0x7f11cc162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.100+0000 7f11cb7fe640 1 -- 172.21.15.102:0/2386990563 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11cc0d4d10 con 0x7f11cc0cf280 2024-09-16T01:15:17.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.101+0000 7f11cb7fe640 1 --2- 172.21.15.102:0/2386990563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11cc0cf280 0x7f11cc0d2990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11cc06c3d0 tx=0x7f11c402a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c3fef0301ca508e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:17.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.101+0000 7f11ca7fc640 1 -- 172.21.15.102:0/2386990563 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4036070 con 0x7f11cc0cf280 2024-09-16T01:15:17.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.101+0000 7f11ca7fc640 1 -- 172.21.15.102:0/2386990563 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c4031600 con 0x7f11cc0cf280 2024-09-16T01:15:17.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.101+0000 7f11ca7fc640 1 -- 172.21.15.102:0/2386990563 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c40319d0 con 0x7f11cc0cf280 2024-09-16T01:15:17.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.102+0000 7f11d18c9640 1 -- 172.21.15.102:0/2386990563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11cc0cf280 msgr2=0x7f11cc0d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.102+0000 7f11d18c9640 1 --2- 172.21.15.102:0/2386990563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11cc0cf280 0x7f11cc0d2990 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f11cc06c3d0 tx=0x7f11c402a6a0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.102+0000 7f11d18c9640 1 -- 172.21.15.102:0/2386990563 shutdown_connections 2024-09-16T01:15:17.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.102+0000 7f11d18c9640 1 --2- 172.21.15.102:0/2386990563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11cc0cf280 0x7f11cc0d2990 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.102+0000 7f11d18c9640 1 --2- 172.21.15.102:0/2386990563 >> v2:172.21.15.81:3300/0 conn(0x7f11cc162e30 0x7f11cc06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.102+0000 7f11d18c9640 1 -- 172.21.15.102:0/2386990563 >> 172.21.15.102:0/2386990563 conn(0x7f11cc08bfc0 msgr2=0x7f11cc0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:17.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.102+0000 7f11d18c9640 1 -- 172.21.15.102:0/2386990563 shutdown_connections 2024-09-16T01:15:17.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.102+0000 7f11d18c9640 1 -- 172.21.15.102:0/2386990563 wait complete. 2024-09-16T01:15:17.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.103+0000 7f11d18c9640 1 Processor -- start 2024-09-16T01:15:17.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.103+0000 7f11d18c9640 1 -- start start 2024-09-16T01:15:17.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11d18c9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11cc0cf280 0x7f11cc15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11d18c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11cc162340 0x7f11cc0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11d18c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11cc162e30 0x7f11cc0b95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11d18c9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc0cf6f0 con 0x7f11cc162340 2024-09-16T01:15:17.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11d18c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f11cc0d2470 con 0x7f11cc162e30 2024-09-16T01:15:17.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11d18c9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f11cc0d52d0 con 0x7f11cc0cf280 2024-09-16T01:15:17.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11cb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11cc162e30 0x7f11cc0b95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11caffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11cc0cf280 0x7f11cc15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11cb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11cc162e30 0x7f11cc0b95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39124/0 (socket says 172.21.15.102:39124) 2024-09-16T01:15:17.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11cb7fe640 1 -- 172.21.15.102:0/4125118775 learned_addr learned my addr 172.21.15.102:0/4125118775 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11c3fff640 1 --2- 172.21.15.102:0/4125118775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11cc162340 0x7f11cc0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11cb7fe640 1 -- 172.21.15.102:0/4125118775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11cc0cf280 msgr2=0x7f11cc15b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11cb7fe640 1 --2- 172.21.15.102:0/4125118775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11cc0cf280 0x7f11cc15b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11cb7fe640 1 -- 172.21.15.102:0/4125118775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11cc162340 msgr2=0x7f11cc0b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11cb7fe640 1 --2- 172.21.15.102:0/4125118775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11cc162340 0x7f11cc0b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11cb7fe640 1 -- 172.21.15.102:0/4125118775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11cc0b1a40 con 0x7f11cc162e30 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11caffd640 1 --2- 172.21.15.102:0/4125118775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11cc0cf280 0x7f11cc15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11cb7fe640 1 --2- 172.21.15.102:0/4125118775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11cc162e30 0x7f11cc0b95e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f11c4034040 tx=0x7f11c4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11c8ff9640 1 -- 172.21.15.102:0/4125118775 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4036050 con 0x7f11cc162e30 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11c8ff9640 1 -- 172.21.15.102:0/4125118775 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11c4042070 con 0x7f11cc162e30 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11d18c9640 1 -- 172.21.15.102:0/4125118775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11cc0b1d20 con 0x7f11cc162e30 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11c8ff9640 1 -- 172.21.15.102:0/4125118775 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11c4009510 con 0x7f11cc162e30 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.104+0000 7f11d18c9640 1 -- 172.21.15.102:0/4125118775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11cc158a20 con 0x7f11cc162e30 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.105+0000 7f11c8ff9640 1 -- 172.21.15.102:0/4125118775 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f11c4007bf0 con 0x7f11cc162e30 2024-09-16T01:15:17.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.105+0000 7f11c8ff9640 1 -- 172.21.15.102:0/4125118775 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f11c403d450 con 0x7f11cc162e30 2024-09-16T01:15:17.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.105+0000 7f11d18c9640 1 -- 172.21.15.102:0/4125118775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11cc06d740 con 0x7f11cc162e30 2024-09-16T01:15:17.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.108+0000 7f11c8ff9640 1 -- 172.21.15.102:0/4125118775 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f11c4047460 con 0x7f11cc162e30 2024-09-16T01:15:17.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.177+0000 7f11d18c9640 1 -- 172.21.15.102:0/4125118775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "292f046c-3cd5-4df5-976c-1e6d40d4ca60", "id": 2} v 0) -- 0x7f11cc0ba450 con 0x7f11cc162e30 2024-09-16T01:15:17.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.182+0000 7f11c8ff9640 1 -- 172.21.15.102:0/4125118775 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "292f046c-3cd5-4df5-976c-1e6d40d4ca60", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f11c4047b40 con 0x7f11cc162e30 2024-09-16T01:15:17.183 INFO:teuthology.orchestra.run.smithi102.stdout:2 2024-09-16T01:15:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.182+0000 7f11d18c9640 1 -- 172.21.15.102:0/4125118775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11cc162e30 msgr2=0x7f11cc0b95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.182+0000 7f11d18c9640 1 --2- 172.21.15.102:0/4125118775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11cc162e30 0x7f11cc0b95e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f11c4034040 tx=0x7f11c4004a40 comp rx=0 tx=0).stop 2024-09-16T01:15:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.182+0000 7f11d18c9640 1 -- 172.21.15.102:0/4125118775 shutdown_connections 2024-09-16T01:15:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.182+0000 7f11d18c9640 1 --2- 172.21.15.102:0/4125118775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11cc162e30 0x7f11cc0b95e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.182+0000 7f11d18c9640 1 --2- 172.21.15.102:0/4125118775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11cc162340 0x7f11cc0b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.182+0000 7f11d18c9640 1 --2- 172.21.15.102:0/4125118775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11cc0cf280 0x7f11cc15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.182+0000 7f11d18c9640 1 -- 172.21.15.102:0/4125118775 >> 172.21.15.102:0/4125118775 conn(0x7f11cc08bfc0 msgr2=0x7f11cc160990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.183+0000 7f11d18c9640 1 -- 172.21.15.102:0/4125118775 shutdown_connections 2024-09-16T01:15:17.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.183+0000 7f11d18c9640 1 -- 172.21.15.102:0/4125118775 wait complete. 2024-09-16T01:15:17.185 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:17.185+0000 7fcd30769040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T01:15:17.194 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new d8bf03f0-5d58-45cf-a445-f4d5f465544e 3 2024-09-16T01:15:17.260 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:17.258+0000 7f7c909d4040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-16T01:15:17.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.291+0000 7f66b008c640 1 Processor -- start 2024-09-16T01:15:17.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.291+0000 7f66b008c640 1 -- start start 2024-09-16T01:15:17.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66b008c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f66a806be80 0x7f66a80b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66b008c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 0x7f66a806c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66b008c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a80b6420 con 0x7f66a806c7a0 2024-09-16T01:15:17.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66b008c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f66a80b6700 con 0x7f66a806be80 2024-09-16T01:15:17.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66b008c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f66a81602d0 con 0x7f66a80b5f40 2024-09-16T01:15:17.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66ad627640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 0x7f66a806c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66ad627640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 0x7f66a806c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:41750/0 (socket says 172.21.15.102:41750) 2024-09-16T01:15:17.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66ad627640 1 -- 172.21.15.102:0/2893548140 learned_addr learned my addr 172.21.15.102:0/2893548140 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-16T01:15:17.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66ade28640 1 --2- 172.21.15.102:0/2893548140 >> v2:172.21.15.81:3300/0 conn(0x7f66a806be80 0x7f66a80b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66ad627640 1 -- 172.21.15.102:0/2893548140 >> v2:172.21.15.81:3300/0 conn(0x7f66a806be80 msgr2=0x7f66a80b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:17.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66ad627640 1 --2- 172.21.15.102:0/2893548140 >> v2:172.21.15.81:3300/0 conn(0x7f66a806be80 0x7f66a80b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66ad627640 1 -- 172.21.15.102:0/2893548140 >> v1:172.21.15.81:6789/0 conn(0x7f66a806c7a0 legacy=0x7f66a8160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.292+0000 7f66ad627640 1 -- 172.21.15.102:0/2893548140 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a81605b0 con 0x7f66a80b5f40 2024-09-16T01:15:17.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.293+0000 7f66ad627640 1 --2- 172.21.15.102:0/2893548140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 0x7f66a806c260 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009870 tx=0x7f66a402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1649058f4ef4627e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:17.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.293+0000 7f66ace26640 1 -- 172.21.15.102:0/2893548140 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4037070 con 0x7f66a80b5f40 2024-09-16T01:15:17.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.293+0000 7f66ace26640 1 -- 172.21.15.102:0/2893548140 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a4032440 con 0x7f66a80b5f40 2024-09-16T01:15:17.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.293+0000 7f66ace26640 1 -- 172.21.15.102:0/2893548140 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4032810 con 0x7f66a80b5f40 2024-09-16T01:15:17.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.294+0000 7f66b008c640 1 -- 172.21.15.102:0/2893548140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 msgr2=0x7f66a806c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.294+0000 7f66b008c640 1 --2- 172.21.15.102:0/2893548140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 0x7f66a806c260 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f66a4009870 tx=0x7f66a402a1c0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.294+0000 7f66b008c640 1 -- 172.21.15.102:0/2893548140 shutdown_connections 2024-09-16T01:15:17.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.294+0000 7f66b008c640 1 --2- 172.21.15.102:0/2893548140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 0x7f66a806c260 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.294+0000 7f66b008c640 1 --2- 172.21.15.102:0/2893548140 >> v2:172.21.15.81:3300/0 conn(0x7f66a806be80 0x7f66a80b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.294+0000 7f66b008c640 1 -- 172.21.15.102:0/2893548140 >> 172.21.15.102:0/2893548140 conn(0x7f66a80734b0 msgr2=0x7f66a80b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:17.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.294+0000 7f66b008c640 1 -- 172.21.15.102:0/2893548140 shutdown_connections 2024-09-16T01:15:17.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.294+0000 7f66b008c640 1 -- 172.21.15.102:0/2893548140 wait complete. 2024-09-16T01:15:17.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.295+0000 7f66b008c640 1 Processor -- start 2024-09-16T01:15:17.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.295+0000 7f66b008c640 1 -- start start 2024-09-16T01:15:17.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66b008c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66a806be80 0x7f66a814bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66b008c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 0x7f66a809ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66b008c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a80b3600 0x7f66a809cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66b008c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66a815f810 con 0x7f66a80b3600 2024-09-16T01:15:17.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66b008c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f66a815f690 con 0x7f66a806be80 2024-09-16T01:15:17.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66b008c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f66a815f990 con 0x7f66a80b5f40 2024-09-16T01:15:17.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66ad627640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 0x7f66a809ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66ade28640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66a806be80 0x7f66a814bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66ad627640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 0x7f66a809ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:41766/0 (socket says 172.21.15.102:41766) 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66ad627640 1 -- 172.21.15.102:0/3364455190 learned_addr learned my addr 172.21.15.102:0/3364455190 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66ae629640 1 --2- 172.21.15.102:0/3364455190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a80b3600 0x7f66a809cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66ad627640 1 -- 172.21.15.102:0/3364455190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66a806be80 msgr2=0x7f66a814bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66ad627640 1 --2- 172.21.15.102:0/3364455190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66a806be80 0x7f66a814bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66ad627640 1 -- 172.21.15.102:0/3364455190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a80b3600 msgr2=0x7f66a809cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66ad627640 1 --2- 172.21.15.102:0/3364455190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a80b3600 0x7f66a809cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66ad627640 1 -- 172.21.15.102:0/3364455190 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a814c1e0 con 0x7f66a80b5f40 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66ade28640 1 --2- 172.21.15.102:0/3364455190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66a806be80 0x7f66a814bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f66ad627640 1 --2- 172.21.15.102:0/3364455190 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 0x7f66a809ed30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f66a402a200 tx=0x7f66a40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.296+0000 7f669e7fc640 1 -- 172.21.15.102:0/3364455190 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4041020 con 0x7f66a80b5f40 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.297+0000 7f669e7fc640 1 -- 172.21.15.102:0/3364455190 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66a40306c0 con 0x7f66a80b5f40 2024-09-16T01:15:17.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.297+0000 7f66b008c640 1 -- 172.21.15.102:0/3364455190 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a809b4d0 con 0x7f66a80b5f40 2024-09-16T01:15:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.297+0000 7f669e7fc640 1 -- 172.21.15.102:0/3364455190 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4037040 con 0x7f66a80b5f40 2024-09-16T01:15:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.297+0000 7f66b008c640 1 -- 172.21.15.102:0/3364455190 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a809b770 con 0x7f66a80b5f40 2024-09-16T01:15:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.297+0000 7f669e7fc640 1 -- 172.21.15.102:0/3364455190 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f66a4044020 con 0x7f66a80b5f40 2024-09-16T01:15:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.297+0000 7f669e7fc640 1 -- 172.21.15.102:0/3364455190 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f66a403dc90 con 0x7f66a80b5f40 2024-09-16T01:15:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.297+0000 7f66b008c640 1 -- 172.21.15.102:0/3364455190 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a806c260 con 0x7f66a80b5f40 2024-09-16T01:15:17.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.300+0000 7f669e7fc640 1 -- 172.21.15.102:0/3364455190 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f66a404b030 con 0x7f66a80b5f40 2024-09-16T01:15:17.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.369+0000 7f66b008c640 1 -- 172.21.15.102:0/3364455190 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d8bf03f0-5d58-45cf-a445-f4d5f465544e", "id": 3} v 0) -- 0x7f66a80700e0 con 0x7f66a80b5f40 2024-09-16T01:15:17.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.374+0000 7f669e7fc640 1 -- 172.21.15.102:0/3364455190 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8bf03f0-5d58-45cf-a445-f4d5f465544e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f66a814c1e0 con 0x7f66a80b5f40 2024-09-16T01:15:17.375 INFO:teuthology.orchestra.run.smithi102.stdout:3 2024-09-16T01:15:17.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.375+0000 7f66b008c640 1 -- 172.21.15.102:0/3364455190 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 msgr2=0x7f66a809ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.375+0000 7f66b008c640 1 --2- 172.21.15.102:0/3364455190 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 0x7f66a809ed30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f66a402a200 tx=0x7f66a40046c0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.375+0000 7f66b008c640 1 -- 172.21.15.102:0/3364455190 shutdown_connections 2024-09-16T01:15:17.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.375+0000 7f66b008c640 1 --2- 172.21.15.102:0/3364455190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a80b3600 0x7f66a809cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.375+0000 7f66b008c640 1 --2- 172.21.15.102:0/3364455190 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66a80b5f40 0x7f66a809ed30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.375+0000 7f66b008c640 1 --2- 172.21.15.102:0/3364455190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66a806be80 0x7f66a814bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.375+0000 7f66b008c640 1 -- 172.21.15.102:0/3364455190 >> 172.21.15.102:0/3364455190 conn(0x7f66a80734b0 msgr2=0x7f66a80703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:17.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.375+0000 7f66b008c640 1 -- 172.21.15.102:0/3364455190 shutdown_connections 2024-09-16T01:15:17.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.375+0000 7f66b008c640 1 -- 172.21.15.102:0/3364455190 wait complete. 2024-09-16T01:15:17.386 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 974c34ea-d019-439a-8625-9f4036107649 4 2024-09-16T01:15:17.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.483+0000 7f88b001e640 1 Processor -- start 2024-09-16T01:15:17.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.483+0000 7f88b001e640 1 -- start start 2024-09-16T01:15:17.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88b001e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88a8145cd0 0x7f88a806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88b001e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a8160de0 con 0x7f88a80b64e0 2024-09-16T01:15:17.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88b001e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a80b3dc0 con 0x7f88a815ee10 2024-09-16T01:15:17.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88b001e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f88a80b3890 con 0x7f88a8145cd0 2024-09-16T01:15:17.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88ae5bb640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f88a815ee10 0x7f88a81606d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57786/0 (socket says 172.21.15.102:57786) 2024-09-16T01:15:17.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88ae5bb640 1 -- 172.21.15.102:0/4250707882 learned_addr learned my addr 172.21.15.102:0/4250707882 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-16T01:15:17.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88addba640 1 --2- 172.21.15.102:0/4250707882 >> v2:172.21.15.81:3300/0 conn(0x7f88a8145cd0 0x7f88a806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88acdb8640 1 -- 172.21.15.102:0/4250707882 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615686701 0 0) 0x7f88a80b3dc0 con 0x7f88a815ee10 2024-09-16T01:15:17.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88acdb8640 1 -- 172.21.15.102:0/4250707882 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8894003520 con 0x7f88a815ee10 2024-09-16T01:15:17.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88acdb8640 1 -- 172.21.15.102:0/4250707882 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264611722 0 0) 0x7f88a8160de0 con 0x7f88a80b64e0 2024-09-16T01:15:17.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88acdb8640 1 -- 172.21.15.102:0/4250707882 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88a80b3dc0 con 0x7f88a80b64e0 2024-09-16T01:15:17.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88addba640 1 -- 172.21.15.102:0/4250707882 >> v1:172.21.15.102:6789/0 conn(0x7f88a815ee10 legacy=0x7f88a81606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88acdb8640 1 -- 172.21.15.102:0/4250707882 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2325956504 0 0) 0x7f8894003520 con 0x7f88a815ee10 2024-09-16T01:15:17.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88addba640 1 -- 172.21.15.102:0/4250707882 >> v1:172.21.15.81:6789/0 conn(0x7f88a80b64e0 legacy=0x7f88a815ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.484+0000 7f88addba640 1 -- 172.21.15.102:0/4250707882 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a80b3ae0 con 0x7f88a8145cd0 2024-09-16T01:15:17.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.485+0000 7f88addba640 1 --2- 172.21.15.102:0/4250707882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a8145cd0 0x7f88a806bc10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009720 tx=0x7f88a402a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7931e9d7931bb73 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:17.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.485+0000 7f88acdb8640 1 -- 172.21.15.102:0/4250707882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4037070 con 0x7f88a8145cd0 2024-09-16T01:15:17.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.485+0000 7f88acdb8640 1 -- 172.21.15.102:0/4250707882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a402abe0 con 0x7f88a8145cd0 2024-09-16T01:15:17.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.485+0000 7f88acdb8640 1 -- 172.21.15.102:0/4250707882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a00019f0 con 0x7f88a8145cd0 2024-09-16T01:15:17.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.486+0000 7f88b001e640 1 -- 172.21.15.102:0/4250707882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a8145cd0 msgr2=0x7f88a806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.486+0000 7f88b001e640 1 --2- 172.21.15.102:0/4250707882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a8145cd0 0x7f88a806bc10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009720 tx=0x7f88a402a0d0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.486+0000 7f88b001e640 1 -- 172.21.15.102:0/4250707882 shutdown_connections 2024-09-16T01:15:17.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.486+0000 7f88b001e640 1 --2- 172.21.15.102:0/4250707882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a8145cd0 0x7f88a806bc10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.486+0000 7f88b001e640 1 -- 172.21.15.102:0/4250707882 >> 172.21.15.102:0/4250707882 conn(0x7f88a80734b0 msgr2=0x7f88a80b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:17.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.486+0000 7f88b001e640 1 -- 172.21.15.102:0/4250707882 shutdown_connections 2024-09-16T01:15:17.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.486+0000 7f88b001e640 1 -- 172.21.15.102:0/4250707882 wait complete. 2024-09-16T01:15:17.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.487+0000 7f88b001e640 1 Processor -- start 2024-09-16T01:15:17.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.487+0000 7f88b001e640 1 -- start start 2024-09-16T01:15:17.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88b001e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88a80b64e0 0x7f88a813fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88b001e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f88a8145cd0 0x7f88a8151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88b001e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a815ee10 0x7f88a80d0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88b001e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f88a81460b0 con 0x7f88a815ee10 2024-09-16T01:15:17.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88b001e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f88a815d8e0 con 0x7f88a80b64e0 2024-09-16T01:15:17.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88b001e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f88a809aa30 con 0x7f88a8145cd0 2024-09-16T01:15:17.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88addba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88a80b64e0 0x7f88a813fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88addba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88a80b64e0 0x7f88a813fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39132/0 (socket says 172.21.15.102:39132) 2024-09-16T01:15:17.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88addba640 1 -- 172.21.15.102:0/1329869770 learned_addr learned my addr 172.21.15.102:0/1329869770 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-16T01:15:17.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88ad5b9640 1 --2- 172.21.15.102:0/1329869770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f88a8145cd0 0x7f88a8151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88ae5bb640 1 --2- 172.21.15.102:0/1329869770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a815ee10 0x7f88a80d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88addba640 1 -- 172.21.15.102:0/1329869770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f88a8145cd0 msgr2=0x7f88a8151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88addba640 1 --2- 172.21.15.102:0/1329869770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f88a8145cd0 0x7f88a8151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88addba640 1 -- 172.21.15.102:0/1329869770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a815ee10 msgr2=0x7f88a80d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88addba640 1 --2- 172.21.15.102:0/1329869770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a815ee10 0x7f88a80d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.488+0000 7f88addba640 1 -- 172.21.15.102:0/1329869770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a8152060 con 0x7f88a80b64e0 2024-09-16T01:15:17.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.489+0000 7f88addba640 1 --2- 172.21.15.102:0/1329869770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88a80b64e0 0x7f88a813fa40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f88a4035040 tx=0x7f88a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:17.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.489+0000 7f889e7fc640 1 -- 172.21.15.102:0/1329869770 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4041020 con 0x7f88a80b64e0 2024-09-16T01:15:17.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.489+0000 7f889e7fc640 1 -- 172.21.15.102:0/1329869770 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a403d620 con 0x7f88a80b64e0 2024-09-16T01:15:17.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.489+0000 7f88b001e640 1 -- 172.21.15.102:0/1329869770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a80d06c0 con 0x7f88a80b64e0 2024-09-16T01:15:17.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.489+0000 7f889e7fc640 1 -- 172.21.15.102:0/1329869770 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4037040 con 0x7f88a80b64e0 2024-09-16T01:15:17.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.489+0000 7f88b001e640 1 -- 172.21.15.102:0/1329869770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a80cf6a0 con 0x7f88a80b64e0 2024-09-16T01:15:17.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.489+0000 7f889e7fc640 1 -- 172.21.15.102:0/1329869770 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f88a4044020 con 0x7f88a80b64e0 2024-09-16T01:15:17.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.489+0000 7f889e7fc640 1 -- 172.21.15.102:0/1329869770 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f88a403b3f0 con 0x7f88a80b64e0 2024-09-16T01:15:17.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.490+0000 7f88b001e640 1 -- 172.21.15.102:0/1329869770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a80ae1b0 con 0x7f88a80b64e0 2024-09-16T01:15:17.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.492+0000 7f889e7fc640 1 -- 172.21.15.102:0/1329869770 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f88a404b030 con 0x7f88a80b64e0 2024-09-16T01:15:17.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.561+0000 7f88b001e640 1 -- 172.21.15.102:0/1329869770 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "974c34ea-d019-439a-8625-9f4036107649", "id": 4} v 0) -- 0x7f88a80b3670 con 0x7f88a80b64e0 2024-09-16T01:15:17.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.566+0000 7f889e7fc640 1 -- 172.21.15.102:0/1329869770 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "974c34ea-d019-439a-8625-9f4036107649", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f88a4046400 con 0x7f88a80b64e0 2024-09-16T01:15:17.567 INFO:teuthology.orchestra.run.smithi102.stdout:4 2024-09-16T01:15:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.567+0000 7f88b001e640 1 -- 172.21.15.102:0/1329869770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88a80b64e0 msgr2=0x7f88a813fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.567+0000 7f88b001e640 1 --2- 172.21.15.102:0/1329869770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88a80b64e0 0x7f88a813fa40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f88a4035040 tx=0x7f88a40046c0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.567+0000 7f88b001e640 1 -- 172.21.15.102:0/1329869770 shutdown_connections 2024-09-16T01:15:17.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.567+0000 7f88b001e640 1 --2- 172.21.15.102:0/1329869770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a815ee10 0x7f88a80d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.567+0000 7f88b001e640 1 --2- 172.21.15.102:0/1329869770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f88a8145cd0 0x7f88a8151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.567+0000 7f88b001e640 1 --2- 172.21.15.102:0/1329869770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88a80b64e0 0x7f88a813fa40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.567+0000 7f88b001e640 1 -- 172.21.15.102:0/1329869770 >> 172.21.15.102:0/1329869770 conn(0x7f88a80734b0 msgr2=0x7f88a8143fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.567+0000 7f88b001e640 1 -- 172.21.15.102:0/1329869770 shutdown_connections 2024-09-16T01:15:17.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.567+0000 7f88b001e640 1 -- 172.21.15.102:0/1329869770 wait complete. 2024-09-16T01:15:17.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 1942eaca-07bb-490a-b314-9804f2c3932f 5 2024-09-16T01:15:17.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.676+0000 7f3e7d72a640 1 Processor -- start 2024-09-16T01:15:17.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.676+0000 7f3e7d72a640 1 -- start start 2024-09-16T01:15:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.677+0000 7f3e7d72a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e7815e6c0 0x7f3e780cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.677+0000 7f3e7d72a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e780d34f0 con 0x7f3e780cfcb0 2024-09-16T01:15:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.677+0000 7f3e7d72a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e780d3790 con 0x7f3e780d5090 2024-09-16T01:15:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.677+0000 7f3e7d72a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3e780cf400 con 0x7f3e7815e6c0 2024-09-16T01:15:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.677+0000 7f3e767fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3e780d5090 0x7f3e780cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:57802/0 (socket says 172.21.15.102:57802) 2024-09-16T01:15:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.677+0000 7f3e767fc640 1 -- 172.21.15.102:0/2249491644 learned_addr learned my addr 172.21.15.102:0/2249491644 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-16T01:15:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.677+0000 7f3e76ffd640 1 --2- 172.21.15.102:0/2249491644 >> v2:172.21.15.81:3300/0 conn(0x7f3e7815e6c0 0x7f3e780cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.677+0000 7f3e75ffb640 1 -- 172.21.15.102:0/2249491644 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2323663914 0 0) 0x7f3e780d3790 con 0x7f3e780d5090 2024-09-16T01:15:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.677+0000 7f3e75ffb640 1 -- 172.21.15.102:0/2249491644 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e64003520 con 0x7f3e780d5090 2024-09-16T01:15:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.677+0000 7f3e76ffd640 1 -- 172.21.15.102:0/2249491644 >> v1:172.21.15.102:6789/0 conn(0x7f3e780d5090 legacy=0x7f3e780cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.677+0000 7f3e76ffd640 1 -- 172.21.15.102:0/2249491644 >> v1:172.21.15.81:6789/0 conn(0x7f3e780cfcb0 legacy=0x7f3e780b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.677+0000 7f3e76ffd640 1 -- 172.21.15.102:0/2249491644 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e780d3a70 con 0x7f3e7815e6c0 2024-09-16T01:15:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.678+0000 7f3e76ffd640 1 --2- 172.21.15.102:0/2249491644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e6c0 0x7f3e780cebb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3e680097a0 tx=0x7f3e6802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6496f8c2552a0d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.678+0000 7f3e75ffb640 1 -- 172.21.15.102:0/2249491644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68037070 con 0x7f3e7815e6c0 2024-09-16T01:15:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.678+0000 7f3e75ffb640 1 -- 172.21.15.102:0/2249491644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e68032440 con 0x7f3e7815e6c0 2024-09-16T01:15:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.678+0000 7f3e75ffb640 1 -- 172.21.15.102:0/2249491644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e68032810 con 0x7f3e7815e6c0 2024-09-16T01:15:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.679+0000 7f3e7d72a640 1 -- 172.21.15.102:0/2249491644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e6c0 msgr2=0x7f3e780cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.679+0000 7f3e7d72a640 1 --2- 172.21.15.102:0/2249491644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e6c0 0x7f3e780cebb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3e680097a0 tx=0x7f3e6802a1a0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.679+0000 7f3e7d72a640 1 -- 172.21.15.102:0/2249491644 shutdown_connections 2024-09-16T01:15:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.679+0000 7f3e7d72a640 1 --2- 172.21.15.102:0/2249491644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e6c0 0x7f3e780cebb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.679+0000 7f3e7d72a640 1 -- 172.21.15.102:0/2249491644 >> 172.21.15.102:0/2249491644 conn(0x7f3e7808bfc0 msgr2=0x7f3e780d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.679+0000 7f3e7d72a640 1 -- 172.21.15.102:0/2249491644 shutdown_connections 2024-09-16T01:15:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.679+0000 7f3e7d72a640 1 -- 172.21.15.102:0/2249491644 wait complete. 2024-09-16T01:15:17.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.680+0000 7f3e7d72a640 1 Processor -- start 2024-09-16T01:15:17.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.680+0000 7f3e7d72a640 1 -- start start 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e7d72a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e780cfcb0 0x7f3e780cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e7d72a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e780d5090 0x7f3e78152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e7d72a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e6c0 0x7f3e780b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e7d72a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7815eaa0 con 0x7f3e7815e6c0 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e7d72a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3e780b10d0 con 0x7f3e780d5090 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e7d72a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7815ec20 con 0x7f3e780cfcb0 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e76ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e780cfcb0 0x7f3e780cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e767fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e780d5090 0x7f3e78152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e76ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e780cfcb0 0x7f3e780cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:41794/0 (socket says 172.21.15.102:41794) 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e76ffd640 1 -- 172.21.15.102:0/4045003994 learned_addr learned my addr 172.21.15.102:0/4045003994 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e777fe640 1 --2- 172.21.15.102:0/4045003994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e6c0 0x7f3e780b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e767fc640 1 -- 172.21.15.102:0/4045003994 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e780cfcb0 msgr2=0x7f3e780cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e767fc640 1 --2- 172.21.15.102:0/4045003994 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e780cfcb0 0x7f3e780cad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e767fc640 1 -- 172.21.15.102:0/4045003994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e6c0 msgr2=0x7f3e780b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e767fc640 1 --2- 172.21.15.102:0/4045003994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e6c0 0x7f3e780b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e767fc640 1 -- 172.21.15.102:0/4045003994 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e78159960 con 0x7f3e780d5090 2024-09-16T01:15:17.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.681+0000 7f3e76ffd640 1 --2- 172.21.15.102:0/4045003994 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e780cfcb0 0x7f3e780cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:17.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.682+0000 7f3e767fc640 1 --2- 172.21.15.102:0/4045003994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e780d5090 0x7f3e78152b30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000c3c0 tx=0x7f3e60001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:17.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.682+0000 7f3e6f7fe640 1 -- 172.21.15.102:0/4045003994 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60017070 con 0x7f3e780d5090 2024-09-16T01:15:17.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.682+0000 7f3e6f7fe640 1 -- 172.21.15.102:0/4045003994 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e60005ce0 con 0x7f3e780d5090 2024-09-16T01:15:17.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.682+0000 7f3e7d72a640 1 -- 172.21.15.102:0/4045003994 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e78159c40 con 0x7f3e780d5090 2024-09-16T01:15:17.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.682+0000 7f3e6f7fe640 1 -- 172.21.15.102:0/4045003994 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e600072d0 con 0x7f3e780d5090 2024-09-16T01:15:17.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.682+0000 7f3e7d72a640 1 -- 172.21.15.102:0/4045003994 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e7815a200 con 0x7f3e780d5090 2024-09-16T01:15:17.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.682+0000 7f3e6f7fe640 1 -- 172.21.15.102:0/4045003994 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3e6001a070 con 0x7f3e780d5090 2024-09-16T01:15:17.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.682+0000 7f3e6f7fe640 1 -- 172.21.15.102:0/4045003994 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f3e6001cc10 con 0x7f3e780d5090 2024-09-16T01:15:17.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.683+0000 7f3e7d72a640 1 -- 172.21.15.102:0/4045003994 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e780cebb0 con 0x7f3e780d5090 2024-09-16T01:15:17.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.685+0000 7f3e6f7fe640 1 -- 172.21.15.102:0/4045003994 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3e600074d0 con 0x7f3e780d5090 2024-09-16T01:15:17.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.754+0000 7f3e7d72a640 1 -- 172.21.15.102:0/4045003994 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1942eaca-07bb-490a-b314-9804f2c3932f", "id": 5} v 0) -- 0x7f3e780b1770 con 0x7f3e780d5090 2024-09-16T01:15:17.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.759+0000 7f3e6f7fe640 1 -- 172.21.15.102:0/4045003994 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1942eaca-07bb-490a-b314-9804f2c3932f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f3e6001c440 con 0x7f3e780d5090 2024-09-16T01:15:17.760 INFO:teuthology.orchestra.run.smithi102.stdout:5 2024-09-16T01:15:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.760+0000 7f3e7d72a640 1 -- 172.21.15.102:0/4045003994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e780d5090 msgr2=0x7f3e78152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.760+0000 7f3e7d72a640 1 --2- 172.21.15.102:0/4045003994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e780d5090 0x7f3e78152b30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000c3c0 tx=0x7f3e60001e70 comp rx=0 tx=0).stop 2024-09-16T01:15:17.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.760+0000 7f3e7d72a640 1 -- 172.21.15.102:0/4045003994 shutdown_connections 2024-09-16T01:15:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.760+0000 7f3e7d72a640 1 --2- 172.21.15.102:0/4045003994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e6c0 0x7f3e780b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.760+0000 7f3e7d72a640 1 --2- 172.21.15.102:0/4045003994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3e780d5090 0x7f3e78152b30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.760+0000 7f3e7d72a640 1 --2- 172.21.15.102:0/4045003994 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3e780cfcb0 0x7f3e780cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.760+0000 7f3e7d72a640 1 -- 172.21.15.102:0/4045003994 >> 172.21.15.102:0/4045003994 conn(0x7f3e7808bfc0 msgr2=0x7f3e780b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.760+0000 7f3e7d72a640 1 -- 172.21.15.102:0/4045003994 shutdown_connections 2024-09-16T01:15:17.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.760+0000 7f3e7d72a640 1 -- 172.21.15.102:0/4045003994 wait complete. 2024-09-16T01:15:17.771 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new a6b65b9d-4b55-407e-9736-9f88c76f2325 6 2024-09-16T01:15:17.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.868+0000 7f311c711640 1 Processor -- start 2024-09-16T01:15:17.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.868+0000 7f311c711640 1 -- start start 2024-09-16T01:15:17.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.869+0000 7f311c711640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3114145cd0 0x7f311406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.869+0000 7f311c711640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f311415ee10 0x7f311406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.869+0000 7f311c711640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31140b3dc0 con 0x7f31140b64e0 2024-09-16T01:15:17.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.869+0000 7f311c711640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f31140b3890 con 0x7f3114145cd0 2024-09-16T01:15:17.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.869+0000 7f311c711640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f31140b3ae0 con 0x7f311415ee10 2024-09-16T01:15:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.870+0000 7f311acae640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f311415ee10 0x7f311406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.870+0000 7f311acae640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f311415ee10 0x7f311406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39146/0 (socket says 172.21.15.102:39146) 2024-09-16T01:15:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.870+0000 7f311acae640 1 -- 172.21.15.102:0/1558645780 learned_addr learned my addr 172.21.15.102:0/1558645780 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-16T01:15:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.870+0000 7f311a4ad640 1 --2- 172.21.15.102:0/1558645780 >> v2:172.21.15.81:3300/0 conn(0x7f3114145cd0 0x7f311406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.870+0000 7f311acae640 1 -- 172.21.15.102:0/1558645780 >> v2:172.21.15.81:3300/0 conn(0x7f3114145cd0 msgr2=0x7f311406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.870+0000 7f311acae640 1 --2- 172.21.15.102:0/1558645780 >> v2:172.21.15.81:3300/0 conn(0x7f3114145cd0 0x7f311406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.870+0000 7f311acae640 1 -- 172.21.15.102:0/1558645780 >> v1:172.21.15.81:6789/0 conn(0x7f31140b64e0 legacy=0x7f311415ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.870+0000 7f311acae640 1 -- 172.21.15.102:0/1558645780 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311415d600 con 0x7f311415ee10 2024-09-16T01:15:17.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.871+0000 7f311acae640 1 --2- 172.21.15.102:0/1558645780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311415ee10 0x7f311406c150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f31140d1100 tx=0x7f310c02a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=306bd89faf06f192 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.871+0000 7f31194ab640 1 -- 172.21.15.102:0/1558645780 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c036070 con 0x7f311415ee10 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.871+0000 7f31194ab640 1 -- 172.21.15.102:0/1558645780 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310c031600 con 0x7f311415ee10 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.871+0000 7f31194ab640 1 -- 172.21.15.102:0/1558645780 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0319d0 con 0x7f311415ee10 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.871+0000 7f311c711640 1 -- 172.21.15.102:0/1558645780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311415ee10 msgr2=0x7f311406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.871+0000 7f311c711640 1 --2- 172.21.15.102:0/1558645780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311415ee10 0x7f311406c150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f31140d1100 tx=0x7f310c02a6a0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.871+0000 7f311c711640 1 -- 172.21.15.102:0/1558645780 shutdown_connections 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.871+0000 7f311c711640 1 --2- 172.21.15.102:0/1558645780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311415ee10 0x7f311406c150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.871+0000 7f311c711640 1 --2- 172.21.15.102:0/1558645780 >> v2:172.21.15.81:3300/0 conn(0x7f3114145cd0 0x7f311406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.871+0000 7f311c711640 1 -- 172.21.15.102:0/1558645780 >> 172.21.15.102:0/1558645780 conn(0x7f31140734b0 msgr2=0x7f31140b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.871+0000 7f311c711640 1 -- 172.21.15.102:0/1558645780 shutdown_connections 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.871+0000 7f311c711640 1 -- 172.21.15.102:0/1558645780 wait complete. 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f311c711640 1 Processor -- start 2024-09-16T01:15:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f311c711640 1 -- start start 2024-09-16T01:15:17.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f311c711640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31140b64e0 0x7f311413ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f311c711640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3114145cd0 0x7f311413c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f311c711640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311415ee10 0x7f311413d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f311c711640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f311409aa30 con 0x7f3114145cd0 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f311c711640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f31141460b0 con 0x7f311415ee10 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f311c711640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f311409abb0 con 0x7f31140b64e0 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f311a4ad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31140b64e0 0x7f311413ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f311a4ad640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31140b64e0 0x7f311413ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:41806/0 (socket says 172.21.15.102:41806) 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f311acae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311415ee10 0x7f311413d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f311a4ad640 1 -- 172.21.15.102:0/2735074338 learned_addr learned my addr 172.21.15.102:0/2735074338 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.873+0000 7f3119cac640 1 --2- 172.21.15.102:0/2735074338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3114145cd0 0x7f311413c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f311a4ad640 1 -- 172.21.15.102:0/2735074338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311415ee10 msgr2=0x7f311413d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f311a4ad640 1 --2- 172.21.15.102:0/2735074338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311415ee10 0x7f311413d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f311a4ad640 1 -- 172.21.15.102:0/2735074338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3114145cd0 msgr2=0x7f311413c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f311a4ad640 1 --2- 172.21.15.102:0/2735074338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3114145cd0 0x7f311413c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f311a4ad640 1 -- 172.21.15.102:0/2735074338 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311413dd60 con 0x7f31140b64e0 2024-09-16T01:15:17.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f311acae640 1 --2- 172.21.15.102:0/2735074338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311415ee10 0x7f311413d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:17.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f311a4ad640 1 --2- 172.21.15.102:0/2735074338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31140b64e0 0x7f311413ee00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f310400e9b0 tx=0x7f310400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:17.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f310affd640 1 -- 172.21.15.102:0/2735074338 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104017070 con 0x7f31140b64e0 2024-09-16T01:15:17.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f310affd640 1 -- 172.21.15.102:0/2735074338 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310400c9a0 con 0x7f31140b64e0 2024-09-16T01:15:17.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f311c711640 1 -- 172.21.15.102:0/2735074338 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311413e040 con 0x7f31140b64e0 2024-09-16T01:15:17.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f310affd640 1 -- 172.21.15.102:0/2735074338 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310400cd90 con 0x7f31140b64e0 2024-09-16T01:15:17.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f311c711640 1 -- 172.21.15.102:0/2735074338 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f311413e600 con 0x7f31140b64e0 2024-09-16T01:15:17.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f310affd640 1 -- 172.21.15.102:0/2735074338 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f310401a070 con 0x7f31140b64e0 2024-09-16T01:15:17.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.874+0000 7f310affd640 1 -- 172.21.15.102:0/2735074338 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f310401cb30 con 0x7f31140b64e0 2024-09-16T01:15:17.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.875+0000 7f311c711640 1 -- 172.21.15.102:0/2735074338 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f311406c9b0 con 0x7f31140b64e0 2024-09-16T01:15:17.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.877+0000 7f310affd640 1 -- 172.21.15.102:0/2735074338 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f311406c9b0 con 0x7f31140b64e0 2024-09-16T01:15:17.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.947+0000 7f311c711640 1 -- 172.21.15.102:0/2735074338 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a6b65b9d-4b55-407e-9736-9f88c76f2325", "id": 6} v 0) -- 0x7f31140b3670 con 0x7f31140b64e0 2024-09-16T01:15:17.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.952+0000 7f310affd640 1 -- 172.21.15.102:0/2735074338 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6b65b9d-4b55-407e-9736-9f88c76f2325", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f310401c6d0 con 0x7f31140b64e0 2024-09-16T01:15:17.953 INFO:teuthology.orchestra.run.smithi102.stdout:6 2024-09-16T01:15:17.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.953+0000 7f311c711640 1 -- 172.21.15.102:0/2735074338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31140b64e0 msgr2=0x7f311413ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:17.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.953+0000 7f311c711640 1 --2- 172.21.15.102:0/2735074338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31140b64e0 0x7f311413ee00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f310400e9b0 tx=0x7f310400ee70 comp rx=0 tx=0).stop 2024-09-16T01:15:17.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.953+0000 7f311c711640 1 -- 172.21.15.102:0/2735074338 shutdown_connections 2024-09-16T01:15:17.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.953+0000 7f311c711640 1 --2- 172.21.15.102:0/2735074338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311415ee10 0x7f311413d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.953+0000 7f311c711640 1 --2- 172.21.15.102:0/2735074338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3114145cd0 0x7f311413c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.953+0000 7f311c711640 1 --2- 172.21.15.102:0/2735074338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31140b64e0 0x7f311413ee00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:17.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.953+0000 7f311c711640 1 -- 172.21.15.102:0/2735074338 >> 172.21.15.102:0/2735074338 conn(0x7f31140734b0 msgr2=0x7f31140b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:17.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.953+0000 7f311c711640 1 -- 172.21.15.102:0/2735074338 shutdown_connections 2024-09-16T01:15:17.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:17.953+0000 7f311c711640 1 -- 172.21.15.102:0/2735074338 wait complete. 2024-09-16T01:15:17.964 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 83bb35ce-e93a-444c-a66b-9d414122d8af 7 2024-09-16T01:15:18.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.061+0000 7fea8c0d7640 1 Processor -- start 2024-09-16T01:15:18.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.062+0000 7fea8c0d7640 1 -- start start 2024-09-16T01:15:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.062+0000 7fea8c0d7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 0x7fea840b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.062+0000 7fea8c0d7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea840b5f40 0x7fea8406c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.062+0000 7fea8c0d7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea840b6420 con 0x7fea8406c7a0 2024-09-16T01:15:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.062+0000 7fea8c0d7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fea840b6700 con 0x7fea840b5f40 2024-09-16T01:15:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.062+0000 7fea8c0d7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fea841602d0 con 0x7fea8406be80 2024-09-16T01:15:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.063+0000 7fea89e73640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 0x7fea840b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.063+0000 7fea89e73640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 0x7fea840b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:41814/0 (socket says 172.21.15.102:41814) 2024-09-16T01:15:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.063+0000 7fea89e73640 1 -- 172.21.15.102:0/552249632 learned_addr learned my addr 172.21.15.102:0/552249632 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-16T01:15:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.063+0000 7fea89672640 1 --2- 172.21.15.102:0/552249632 >> v2:172.21.15.81:3300/0 conn(0x7fea840b5f40 0x7fea8406c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.063+0000 7fea89e73640 1 -- 172.21.15.102:0/552249632 >> v2:172.21.15.81:3300/0 conn(0x7fea840b5f40 msgr2=0x7fea8406c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.063+0000 7fea89e73640 1 --2- 172.21.15.102:0/552249632 >> v2:172.21.15.81:3300/0 conn(0x7fea840b5f40 0x7fea8406c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.063+0000 7fea89e73640 1 -- 172.21.15.102:0/552249632 >> v1:172.21.15.81:6789/0 conn(0x7fea8406c7a0 legacy=0x7fea84160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.063+0000 7fea89e73640 1 -- 172.21.15.102:0/552249632 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea841605b0 con 0x7fea8406be80 2024-09-16T01:15:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.063+0000 7fea89672640 1 --2- 172.21.15.102:0/552249632 >> v2:172.21.15.81:3300/0 conn(0x7fea840b5f40 0x7fea8406c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:15:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.064+0000 7fea89e73640 1 --2- 172.21.15.102:0/552249632 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 0x7fea840b0750 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fea74009870 tx=0x7fea7402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d76f5fb84458c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.064+0000 7fea88e71640 1 -- 172.21.15.102:0/552249632 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74037070 con 0x7fea8406be80 2024-09-16T01:15:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.064+0000 7fea88e71640 1 -- 172.21.15.102:0/552249632 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea74032440 con 0x7fea8406be80 2024-09-16T01:15:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.064+0000 7fea88e71640 1 -- 172.21.15.102:0/552249632 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74032810 con 0x7fea8406be80 2024-09-16T01:15:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.064+0000 7fea8c0d7640 1 -- 172.21.15.102:0/552249632 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 msgr2=0x7fea840b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.064+0000 7fea8c0d7640 1 --2- 172.21.15.102:0/552249632 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 0x7fea840b0750 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fea74009870 tx=0x7fea7402a1c0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.064+0000 7fea8c0d7640 1 -- 172.21.15.102:0/552249632 shutdown_connections 2024-09-16T01:15:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.064+0000 7fea8c0d7640 1 --2- 172.21.15.102:0/552249632 >> v2:172.21.15.81:3300/0 conn(0x7fea840b5f40 0x7fea8406c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.064+0000 7fea8c0d7640 1 --2- 172.21.15.102:0/552249632 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 0x7fea840b0750 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.064+0000 7fea8c0d7640 1 -- 172.21.15.102:0/552249632 >> 172.21.15.102:0/552249632 conn(0x7fea840734b0 msgr2=0x7fea840b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.065+0000 7fea8c0d7640 1 -- 172.21.15.102:0/552249632 shutdown_connections 2024-09-16T01:15:18.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.065+0000 7fea8c0d7640 1 -- 172.21.15.102:0/552249632 wait complete. 2024-09-16T01:15:18.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.066+0000 7fea8c0d7640 1 Processor -- start 2024-09-16T01:15:18.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.066+0000 7fea8c0d7640 1 -- start start 2024-09-16T01:15:18.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.066+0000 7fea8c0d7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 0x7fea841f8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.066+0000 7fea8c0d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea840b5f40 0x7fea84152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.066+0000 7fea8c0d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea8415ce60 0x7fea8415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.066+0000 7fea8c0d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea8415f810 con 0x7fea840b5f40 2024-09-16T01:15:18.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.066+0000 7fea8c0d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fea8415f690 con 0x7fea8415ce60 2024-09-16T01:15:18.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.066+0000 7fea8c0d7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fea8415f990 con 0x7fea8406be80 2024-09-16T01:15:18.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.066+0000 7fea89e73640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 0x7fea841f8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea89e73640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 0x7fea841f8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:41828/0 (socket says 172.21.15.102:41828) 2024-09-16T01:15:18.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea89e73640 1 -- 172.21.15.102:0/2880681642 learned_addr learned my addr 172.21.15.102:0/2880681642 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-16T01:15:18.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea8a674640 1 --2- 172.21.15.102:0/2880681642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea8415ce60 0x7fea8415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea89672640 1 --2- 172.21.15.102:0/2880681642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea840b5f40 0x7fea84152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea89e73640 1 -- 172.21.15.102:0/2880681642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea8415ce60 msgr2=0x7fea8415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:18.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea89e73640 1 --2- 172.21.15.102:0/2880681642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea8415ce60 0x7fea8415d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea89e73640 1 -- 172.21.15.102:0/2880681642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea840b5f40 msgr2=0x7fea84152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:18.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea89e73640 1 --2- 172.21.15.102:0/2880681642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea840b5f40 0x7fea84152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea89e73640 1 -- 172.21.15.102:0/2880681642 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea841f7bc0 con 0x7fea8406be80 2024-09-16T01:15:18.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea89e73640 1 --2- 172.21.15.102:0/2880681642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 0x7fea841f8660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fea74000c00 tx=0x7fea740046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:18.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea7a7fc640 1 -- 172.21.15.102:0/2880681642 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74041020 con 0x7fea8406be80 2024-09-16T01:15:18.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea7a7fc640 1 -- 172.21.15.102:0/2880681642 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea740306c0 con 0x7fea8406be80 2024-09-16T01:15:18.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea8c0d7640 1 -- 172.21.15.102:0/2880681642 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea841533e0 con 0x7fea8406be80 2024-09-16T01:15:18.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea7a7fc640 1 -- 172.21.15.102:0/2880681642 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74037040 con 0x7fea8406be80 2024-09-16T01:15:18.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea8c0d7640 1 -- 172.21.15.102:0/2880681642 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fea841f7e60 con 0x7fea8406be80 2024-09-16T01:15:18.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea7a7fc640 1 -- 172.21.15.102:0/2880681642 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fea74044020 con 0x7fea8406be80 2024-09-16T01:15:18.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.067+0000 7fea7a7fc640 1 -- 172.21.15.102:0/2880681642 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fea7403d420 con 0x7fea8406be80 2024-09-16T01:15:18.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.068+0000 7fea8c0d7640 1 -- 172.21.15.102:0/2880681642 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8406c260 con 0x7fea8406be80 2024-09-16T01:15:18.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.070+0000 7fea7a7fc640 1 -- 172.21.15.102:0/2880681642 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fea7404b070 con 0x7fea8406be80 2024-09-16T01:15:18.108 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:18.108+0000 7fcd30769040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T01:15:18.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.140+0000 7fea8c0d7640 1 -- 172.21.15.102:0/2880681642 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd new", "uuid": "83bb35ce-e93a-444c-a66b-9d414122d8af", "id": 7} v 0) -- 0x7fea840b0120 con 0x7fea8406be80 2024-09-16T01:15:18.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.147+0000 7fea7a7fc640 1 -- 172.21.15.102:0/2880681642 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83bb35ce-e93a-444c-a66b-9d414122d8af", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fea74005990 con 0x7fea8406be80 2024-09-16T01:15:18.148 INFO:teuthology.orchestra.run.smithi102.stdout:7 2024-09-16T01:15:18.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.147+0000 7fea8c0d7640 1 -- 172.21.15.102:0/2880681642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 msgr2=0x7fea841f8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:18.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.147+0000 7fea8c0d7640 1 --2- 172.21.15.102:0/2880681642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 0x7fea841f8660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fea74000c00 tx=0x7fea740046c0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.147+0000 7fea8c0d7640 1 -- 172.21.15.102:0/2880681642 shutdown_connections 2024-09-16T01:15:18.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.147+0000 7fea8c0d7640 1 --2- 172.21.15.102:0/2880681642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea8415ce60 0x7fea8415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.147+0000 7fea8c0d7640 1 --2- 172.21.15.102:0/2880681642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea840b5f40 0x7fea84152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.147+0000 7fea8c0d7640 1 --2- 172.21.15.102:0/2880681642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea8406be80 0x7fea841f8660 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.148+0000 7fea8c0d7640 1 -- 172.21.15.102:0/2880681642 >> 172.21.15.102:0/2880681642 conn(0x7fea840734b0 msgr2=0x7fea840aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:18.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.148+0000 7fea8c0d7640 1 -- 172.21.15.102:0/2880681642 shutdown_connections 2024-09-16T01:15:18.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:15:18.148+0000 7fea8c0d7640 1 -- 172.21.15.102:0/2880681642 wait complete. 2024-09-16T01:15:18.159 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-16T01:15:18.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-16T01:15:18.161 INFO:tasks.ceph.osd.0:Started 2024-09-16T01:15:18.161 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-16T01:15:18.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-16T01:15:18.163 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:18.161+0000 7fcd30769040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T01:15:18.164 INFO:tasks.ceph.osd.1:Started 2024-09-16T01:15:18.164 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-16T01:15:18.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-16T01:15:18.167 INFO:tasks.ceph.osd.2:Started 2024-09-16T01:15:18.167 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-16T01:15:18.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-16T01:15:18.169 INFO:tasks.ceph.osd.3:Started 2024-09-16T01:15:18.169 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-16T01:15:18.169 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-16T01:15:18.171 INFO:tasks.ceph.osd.4:Started 2024-09-16T01:15:18.171 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-16T01:15:18.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-16T01:15:18.173 INFO:tasks.ceph.osd.5:Started 2024-09-16T01:15:18.174 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-16T01:15:18.174 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-16T01:15:18.176 INFO:tasks.ceph.osd.6:Started 2024-09-16T01:15:18.176 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-16T01:15:18.176 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-16T01:15:18.178 INFO:tasks.ceph.osd.7:Started 2024-09-16T01:15:18.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:15:18.267 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:18.266+0000 7f7c909d4040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-16T01:15:18.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.293+0000 7fe81863c640 1 Processor -- start 2024-09-16T01:15:18.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.293+0000 7fe81863c640 1 -- start start 2024-09-16T01:15:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.293+0000 7fe81863c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe81015c520 0x7fe81009b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.293+0000 7fe81863c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8100b1620 0x7fe8100b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe81863c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8100cec00 con 0x7fe8100d0980 2024-09-16T01:15:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe81863c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe81009bd90 con 0x7fe8100b1620 2024-09-16T01:15:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe81863c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe8100d0010 con 0x7fe81015c520 2024-09-16T01:15:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe816bd9640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe8100d0980 0x7fe8100cd570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33612/0 (socket says 172.21.15.81:33612) 2024-09-16T01:15:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe816bd9640 1 -- 172.21.15.81:0/121445890 learned_addr learned my addr 172.21.15.81:0/121445890 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe815bd7640 1 --2- 172.21.15.81:0/121445890 >> v2:172.21.15.81:3300/0 conn(0x7fe8100b1620 0x7fe8100b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe8163d8640 1 --2- 172.21.15.81:0/121445890 >> v2:172.21.15.102:3300/0 conn(0x7fe81015c520 0x7fe81009b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe8153d6640 1 -- 172.21.15.81:0/121445890 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1851090680 0 0) 0x7fe8100cec00 con 0x7fe8100d0980 2024-09-16T01:15:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe8153d6640 1 -- 172.21.15.81:0/121445890 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7fc003520 con 0x7fe8100d0980 2024-09-16T01:15:18.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe815bd7640 1 -- 172.21.15.81:0/121445890 >> v2:172.21.15.102:3300/0 conn(0x7fe81015c520 msgr2=0x7fe81009b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe815bd7640 1 --2- 172.21.15.81:0/121445890 >> v2:172.21.15.102:3300/0 conn(0x7fe81015c520 0x7fe81009b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe815bd7640 1 -- 172.21.15.81:0/121445890 >> v1:172.21.15.81:6789/0 conn(0x7fe8100d0980 legacy=0x7fe8100cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe815bd7640 1 -- 172.21.15.81:0/121445890 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8100d02f0 con 0x7fe8100b1620 2024-09-16T01:15:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.294+0000 7fe8163d8640 1 --2- 172.21.15.81:0/121445890 >> v2:172.21.15.102:3300/0 conn(0x7fe81015c520 0x7fe81009b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.295+0000 7fe815bd7640 1 --2- 172.21.15.81:0/121445890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8100b1620 0x7fe8100b1d40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe810073340 tx=0x7fe80002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363dcba34d1242b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.295+0000 7fe8153d6640 1 -- 172.21.15.81:0/121445890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800037070 con 0x7fe8100b1620 2024-09-16T01:15:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.295+0000 7fe8153d6640 1 -- 172.21.15.81:0/121445890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe800032440 con 0x7fe8100b1620 2024-09-16T01:15:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.295+0000 7fe8153d6640 1 -- 172.21.15.81:0/121445890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8000327f0 con 0x7fe8100b1620 2024-09-16T01:15:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.296+0000 7fe81863c640 1 -- 172.21.15.81:0/121445890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8100b1620 msgr2=0x7fe8100b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.296+0000 7fe81863c640 1 --2- 172.21.15.81:0/121445890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8100b1620 0x7fe8100b1d40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe810073340 tx=0x7fe80002a1a0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.296+0000 7fe81863c640 1 -- 172.21.15.81:0/121445890 shutdown_connections 2024-09-16T01:15:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.296+0000 7fe81863c640 1 --2- 172.21.15.81:0/121445890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8100b1620 0x7fe8100b1d40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.296+0000 7fe81863c640 1 --2- 172.21.15.81:0/121445890 >> v2:172.21.15.102:3300/0 conn(0x7fe81015c520 0x7fe81009b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.296+0000 7fe81863c640 1 -- 172.21.15.81:0/121445890 >> 172.21.15.81:0/121445890 conn(0x7fe8100d23a0 msgr2=0x7fe8100d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.296+0000 7fe81863c640 1 -- 172.21.15.81:0/121445890 shutdown_connections 2024-09-16T01:15:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.296+0000 7fe81863c640 1 -- 172.21.15.81:0/121445890 wait complete. 2024-09-16T01:15:18.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.297+0000 7fe81863c640 1 Processor -- start 2024-09-16T01:15:18.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.297+0000 7fe81863c640 1 -- start start 2024-09-16T01:15:18.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe81863c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8100b1620 0x7fe8100b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe81863c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8100d0980 0x7fe81015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe81863c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe81015c520 0x7fe81015a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:18.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe8163d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8100b1620 0x7fe8100b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe81863c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe81015c900 con 0x7fe8100b1620 2024-09-16T01:15:18.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe81863c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe8100d05d0 con 0x7fe8100d0980 2024-09-16T01:15:18.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe8163d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8100b1620 0x7fe8100b7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39778/0 (socket says 172.21.15.81:39778) 2024-09-16T01:15:18.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe8163d8640 1 -- 172.21.15.81:0/90762688 learned_addr learned my addr 172.21.15.81:0/90762688 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:18.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe81863c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe8100b8090 con 0x7fe81015c520 2024-09-16T01:15:18.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe815bd7640 1 --2- 172.21.15.81:0/90762688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8100d0980 0x7fe81015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe816bd9640 1 --2- 172.21.15.81:0/90762688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe81015c520 0x7fe81015a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe815bd7640 1 -- 172.21.15.81:0/90762688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe81015c520 msgr2=0x7fe81015a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe815bd7640 1 --2- 172.21.15.81:0/90762688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe81015c520 0x7fe81015a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe815bd7640 1 -- 172.21.15.81:0/90762688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8100b1620 msgr2=0x7fe8100b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe815bd7640 1 --2- 172.21.15.81:0/90762688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8100b1620 0x7fe8100b7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe815bd7640 1 -- 172.21.15.81:0/90762688 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8100b7db0 con 0x7fe8100d0980 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe8163d8640 1 --2- 172.21.15.81:0/90762688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8100b1620 0x7fe8100b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.298+0000 7fe815bd7640 1 --2- 172.21.15.81:0/90762688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8100d0980 0x7fe81015a100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe800031000 tx=0x7fe8000046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.299+0000 7fe806ffd640 1 -- 172.21.15.81:0/90762688 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800037040 con 0x7fe8100d0980 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.299+0000 7fe806ffd640 1 -- 172.21.15.81:0/90762688 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe800003c90 con 0x7fe8100d0980 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.299+0000 7fe81863c640 1 -- 172.21.15.81:0/90762688 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8100c6000 con 0x7fe8100d0980 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.299+0000 7fe806ffd640 1 -- 172.21.15.81:0/90762688 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800006e10 con 0x7fe8100d0980 2024-09-16T01:15:18.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.299+0000 7fe81863c640 1 -- 172.21.15.81:0/90762688 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8100c65c0 con 0x7fe8100d0980 2024-09-16T01:15:18.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.299+0000 7fe806ffd640 1 -- 172.21.15.81:0/90762688 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe800044020 con 0x7fe8100d0980 2024-09-16T01:15:18.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.299+0000 7fe806ffd640 1 -- 172.21.15.81:0/90762688 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fe800032b80 con 0x7fe8100d0980 2024-09-16T01:15:18.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.300+0000 7fe81863c640 1 -- 172.21.15.81:0/90762688 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8100b1d40 con 0x7fe8100d0980 2024-09-16T01:15:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.304+0000 7fe806ffd640 1 -- 172.21.15.81:0/90762688 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe80003d760 con 0x7fe8100d0980 2024-09-16T01:15:18.324 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:18.323+0000 7f7c909d4040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-16T01:15:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.362+0000 7fe81863c640 1 -- 172.21.15.81:0/90762688 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8100b8320 con 0x7fe8100d0980 2024-09-16T01:15:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.363+0000 7fe806ffd640 1 -- 172.21.15.81:0/90762688 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fe80003d940 con 0x7fe8100d0980 2024-09-16T01:15:18.364 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:18.364 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:18.141792+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:15:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.364+0000 7fe81863c640 1 -- 172.21.15.81:0/90762688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8100d0980 msgr2=0x7fe81015a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.364+0000 7fe81863c640 1 --2- 172.21.15.81:0/90762688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8100d0980 0x7fe81015a100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe800031000 tx=0x7fe8000046c0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.364+0000 7fe81863c640 1 -- 172.21.15.81:0/90762688 shutdown_connections 2024-09-16T01:15:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.364+0000 7fe81863c640 1 --2- 172.21.15.81:0/90762688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe81015c520 0x7fe81015a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.364+0000 7fe81863c640 1 --2- 172.21.15.81:0/90762688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8100d0980 0x7fe81015a100 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.364+0000 7fe81863c640 1 --2- 172.21.15.81:0/90762688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8100b1620 0x7fe8100b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.364+0000 7fe81863c640 1 -- 172.21.15.81:0/90762688 >> 172.21.15.81:0/90762688 conn(0x7fe8100d23a0 msgr2=0x7fe8100d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.364+0000 7fe81863c640 1 -- 172.21.15.81:0/90762688 shutdown_connections 2024-09-16T01:15:18.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:18.364+0000 7fe81863c640 1 -- 172.21.15.81:0/90762688 wait complete. 2024-09-16T01:15:18.375 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-16T01:15:18.375 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-16T01:15:18.570 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:18.570+0000 7fcd30769040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T01:15:18.656 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:18.654+0000 7fcd30769040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T01:15:18.690 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:18.689+0000 7f7c909d4040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-16T01:15:18.761 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:18.761+0000 7fcd30769040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:15:18.776 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:18.774+0000 7f7c909d4040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-16T01:15:18.807 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:18.807+0000 7fcd30769040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T01:15:18.885 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:18.884+0000 7f7c909d4040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-16T01:15:18.921 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:18.920+0000 7fcd30769040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T01:15:18.931 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:18.930+0000 7f7c909d4040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-16T01:15:18.973 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:18.972+0000 7fcd30769040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T01:15:19.016 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:19.016+0000 7fcd30769040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T01:15:19.099 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:19.044+0000 7f7c909d4040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-16T01:15:19.099 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:19.098+0000 7f7c909d4040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-16T01:15:19.131 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:19.130+0000 7fcd30769040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T01:15:19.146 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:19.145+0000 7f7c909d4040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-16T01:15:19.180 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:19.179+0000 7fcd30769040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T01:15:19.199 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T01:15:19.232 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:19.231+0000 7fcd30769040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T01:15:19.260 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:19.258+0000 7f7c909d4040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-16T01:15:19.291 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.290+0000 7fb454065640 1 Processor -- start 2024-09-16T01:15:19.291 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.291+0000 7fb454065640 1 -- start start 2024-09-16T01:15:19.292 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.291+0000 7fb454065640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb44c1601f0 0x7fb44c09aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:19.293 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.291+0000 7fb454065640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb44c1605d0 0x7fb44c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:19.293 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.291+0000 7fb454065640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44c15d410 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.293 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.291+0000 7fb454065640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb44c15d6f0 con 0x7fb44c1601f0 2024-09-16T01:15:19.293 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.291+0000 7fb454065640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb44c0b37c0 con 0x7fb44c1605d0 2024-09-16T01:15:19.293 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.292+0000 7fb451600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb44c1605d0 0x7fb44c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:19.293 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.292+0000 7fb451e01640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb44c1601f0 0x7fb44c09aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:19.293 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.292+0000 7fb451600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb44c1605d0 0x7fb44c15db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:55784/0 (socket says 172.21.15.81:55784) 2024-09-16T01:15:19.293 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.292+0000 7fb451600640 1 -- 172.21.15.81:0/4268696902 learned_addr learned my addr 172.21.15.81:0/4268696902 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:19.293 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.292+0000 7fb451600640 1 -- 172.21.15.81:0/4268696902 >> v2:172.21.15.81:3300/0 conn(0x7fb44c1601f0 msgr2=0x7fb44c09aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:19.293 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.292+0000 7fb451600640 1 --2- 172.21.15.81:0/4268696902 >> v2:172.21.15.81:3300/0 conn(0x7fb44c1601f0 0x7fb44c09aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:19.293 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.292+0000 7fb451600640 1 -- 172.21.15.81:0/4268696902 >> v1:172.21.15.102:6789/0 conn(0x7fb44c0ae2d0 legacy=0x7fb44c15bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:19.293 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.292+0000 7fb451600640 1 -- 172.21.15.81:0/4268696902 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44c0b3aa0 con 0x7fb44c1605d0 2024-09-16T01:15:19.294 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.293+0000 7fb451600640 1 --2- 172.21.15.81:0/4268696902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb44c1605d0 0x7fb44c15db30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb44c073ce0 tx=0x7fb44002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6568b3b0e438f2c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:19.295 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.293+0000 7fb450dff640 1 -- 172.21.15.81:0/4268696902 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb440037070 con 0x7fb44c1605d0 2024-09-16T01:15:19.295 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.293+0000 7fb450dff640 1 -- 172.21.15.81:0/4268696902 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb440032440 con 0x7fb44c1605d0 2024-09-16T01:15:19.295 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.293+0000 7fb450dff640 1 -- 172.21.15.81:0/4268696902 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb440032810 con 0x7fb44c1605d0 2024-09-16T01:15:19.295 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.294+0000 7fb454065640 1 -- 172.21.15.81:0/4268696902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb44c1605d0 msgr2=0x7fb44c15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:19.295 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.294+0000 7fb454065640 1 --2- 172.21.15.81:0/4268696902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb44c1605d0 0x7fb44c15db30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb44c073ce0 tx=0x7fb44002a270 comp rx=0 tx=0).stop 2024-09-16T01:15:19.295 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.294+0000 7fb454065640 1 -- 172.21.15.81:0/4268696902 shutdown_connections 2024-09-16T01:15:19.295 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.294+0000 7fb454065640 1 --2- 172.21.15.81:0/4268696902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb44c1605d0 0x7fb44c15db30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:19.295 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.294+0000 7fb454065640 1 --2- 172.21.15.81:0/4268696902 >> v2:172.21.15.81:3300/0 conn(0x7fb44c1601f0 0x7fb44c09aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:19.295 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.294+0000 7fb454065640 1 -- 172.21.15.81:0/4268696902 >> 172.21.15.81:0/4268696902 conn(0x7fb44c073420 msgr2=0x7fb44c0b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:19.295 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.294+0000 7fb454065640 1 -- 172.21.15.81:0/4268696902 shutdown_connections 2024-09-16T01:15:19.295 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.294+0000 7fb454065640 1 -- 172.21.15.81:0/4268696902 wait complete. 2024-09-16T01:15:19.296 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.295+0000 7fb454065640 1 Processor -- start 2024-09-16T01:15:19.296 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.295+0000 7fb454065640 1 -- start start 2024-09-16T01:15:19.298 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb454065640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44c0ae2d0 0x7fb44c143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:19.298 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb454065640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb44c1601f0 0x7fb44c156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:19.298 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb454065640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb44c1605d0 0x7fb44c1444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:19.298 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb454065640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c15c640 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.298 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb454065640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c15c4c0 con 0x7fb44c1601f0 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb454065640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb44c15c7c0 con 0x7fb44c1605d0 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb451e01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44c0ae2d0 0x7fb44c143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb451e01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44c0ae2d0 0x7fb44c143da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39802/0 (socket says 172.21.15.81:39802) 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb451e01640 1 -- 172.21.15.81:0/653155984 learned_addr learned my addr 172.21.15.81:0/653155984 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb451600640 1 --2- 172.21.15.81:0/653155984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb44c1601f0 0x7fb44c156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb452602640 1 --2- 172.21.15.81:0/653155984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb44c1605d0 0x7fb44c1444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb451e01640 1 -- 172.21.15.81:0/653155984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb44c1605d0 msgr2=0x7fb44c1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb451e01640 1 --2- 172.21.15.81:0/653155984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb44c1605d0 0x7fb44c1444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb451e01640 1 -- 172.21.15.81:0/653155984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb44c1601f0 msgr2=0x7fb44c156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb451e01640 1 --2- 172.21.15.81:0/653155984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb44c1601f0 0x7fb44c156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb451e01640 1 -- 172.21.15.81:0/653155984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44c154f60 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb451600640 1 --2- 172.21.15.81:0/653155984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb44c1601f0 0x7fb44c156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:19.299 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb451e01640 1 --2- 172.21.15.81:0/653155984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44c0ae2d0 0x7fb44c143da0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb44800e9b0 tx=0x7fb44800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:19.300 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb43e7fc640 1 -- 172.21.15.81:0/653155984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb448017070 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.300 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb43e7fc640 1 -- 172.21.15.81:0/653155984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb44800c9a0 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.300 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb454065640 1 -- 172.21.15.81:0/653155984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44c155240 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.300 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.296+0000 7fb43e7fc640 1 -- 172.21.15.81:0/653155984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb44800cd90 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.300 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.297+0000 7fb454065640 1 -- 172.21.15.81:0/653155984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44c155800 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.300 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.297+0000 7fb43e7fc640 1 -- 172.21.15.81:0/653155984 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb44801a070 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.300 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.297+0000 7fb43e7fc640 1 -- 172.21.15.81:0/653155984 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb44801cc10 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.300 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.297+0000 7fb454065640 1 -- 172.21.15.81:0/653155984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb44c0754a0 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.301 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.300+0000 7fb43e7fc640 1 -- 172.21.15.81:0/653155984 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb44c0754a0 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.304 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:19.303+0000 7fcd30769040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T01:15:19.310 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:19.309+0000 7f7c909d4040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-16T01:15:19.350 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:19.349+0000 7fcd30769040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T01:15:19.359 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.358+0000 7fb454065640 1 -- 172.21.15.81:0/653155984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb44c09aa70 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.359 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.359+0000 7fb43e7fc640 1 -- 172.21.15.81:0/653155984 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb44801c540 con 0x7fb44c0ae2d0 2024-09-16T01:15:19.359 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-16T01:15:19.360 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:18.141792+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:15:19.360 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.360+0000 7fb454065640 1 -- 172.21.15.81:0/653155984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44c0ae2d0 msgr2=0x7fb44c143da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:19.361 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.360+0000 7fb454065640 1 --2- 172.21.15.81:0/653155984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44c0ae2d0 0x7fb44c143da0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb44800e9b0 tx=0x7fb44800ee70 comp rx=0 tx=0).stop 2024-09-16T01:15:19.361 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.360+0000 7fb454065640 1 -- 172.21.15.81:0/653155984 shutdown_connections 2024-09-16T01:15:19.361 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.360+0000 7fb454065640 1 --2- 172.21.15.81:0/653155984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb44c1605d0 0x7fb44c1444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:19.361 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.360+0000 7fb454065640 1 --2- 172.21.15.81:0/653155984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb44c1601f0 0x7fb44c156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:19.361 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.360+0000 7fb454065640 1 --2- 172.21.15.81:0/653155984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44c0ae2d0 0x7fb44c143da0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:19.361 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.360+0000 7fb454065640 1 -- 172.21.15.81:0/653155984 >> 172.21.15.81:0/653155984 conn(0x7fb44c073420 msgr2=0x7fb44c15ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:19.361 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.360+0000 7fb454065640 1 -- 172.21.15.81:0/653155984 shutdown_connections 2024-09-16T01:15:19.361 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:19.360+0000 7fb454065640 1 -- 172.21.15.81:0/653155984 wait complete. 2024-09-16T01:15:19.361 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:19.360+0000 7f7c909d4040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-16T01:15:19.370 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-16T01:15:19.396 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:19.396+0000 7fcd30769040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T01:15:19.431 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:19.430+0000 7f7c909d4040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-16T01:15:19.475 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:19.474+0000 7f7c909d4040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-16T01:15:19.518 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:19.517+0000 7f7c909d4040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-16T01:15:19.635 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-09-16T01:15:19.634+0000 7f906220b640 -1 Falling back to public interface 2024-09-16T01:15:19.645 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-16T01:15:19.643+0000 7ff593c24640 -1 Falling back to public interface 2024-09-16T01:15:19.645 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-09-16T01:15:19.643+0000 7fa4f3616640 -1 Falling back to public interface 2024-09-16T01:15:19.645 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-16T01:15:19.643+0000 7ff592bcc640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2024-09-16T01:15:19.657 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-09-16T01:15:19.655+0000 7f36b92e4640 -1 Falling back to public interface 2024-09-16T01:15:19.914 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-16T01:15:19.913+0000 7fa8f1622640 -1 Falling back to public interface 2024-09-16T01:15:19.921 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-16T01:15:19.920+0000 7f02ca087640 -1 Falling back to public interface 2024-09-16T01:15:19.926 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-16T01:15:19.925+0000 7fb19501d640 -1 Falling back to public interface 2024-09-16T01:15:20.048 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:20.048+0000 7fcd30769040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T01:15:20.150 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-16T01:15:20.149+0000 7fd3e34b2640 -1 Falling back to public interface 2024-09-16T01:15:20.181 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-16T01:15:20.180+0000 7f7c909d4040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-16T01:15:21.061 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:21.061+0000 7fccd1027640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-16T01:15:21.062 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-16T01:15:21.062+0000 7fccd1027640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-16T01:15:23.444 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-09-16T01:15:23.443+0000 7f906220b640 -1 osd.7 0 log_to_monitors true 2024-09-16T01:15:23.508 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-16T01:15:23.507+0000 7fb19501d640 -1 osd.0 0 log_to_monitors true 2024-09-16T01:15:23.712 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-16T01:15:23.711+0000 7fa8f1622640 -1 osd.1 0 log_to_monitors true 2024-09-16T01:15:23.717 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-16T01:15:23.717+0000 7f02ca087640 -1 osd.3 0 log_to_monitors true 2024-09-16T01:15:23.738 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-09-16T01:15:23.737+0000 7fa4f3616640 -1 osd.5 0 log_to_monitors true 2024-09-16T01:15:23.738 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-16T01:15:23.737+0000 7ff593c24640 -1 osd.4 0 log_to_monitors true 2024-09-16T01:15:23.739 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-09-16T01:15:23.737+0000 7f36b92e4640 -1 osd.6 0 log_to_monitors true 2024-09-16T01:15:23.909 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-16T01:15:23.908+0000 7fd3e34b2640 -1 osd.2 0 log_to_monitors true 2024-09-16T01:15:26.177 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T01:15:26.274 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.273+0000 7f4567623640 1 Processor -- start 2024-09-16T01:15:26.274 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.274+0000 7f4567623640 1 -- start start 2024-09-16T01:15:26.275 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.274+0000 7f4567623640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45600d0d30 0x7f45600d1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:26.276 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.274+0000 7f4567623640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45600d2ee0 con 0x7f456015fed0 2024-09-16T01:15:26.276 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.274+0000 7f4567623640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45600d31a0 con 0x7f456015faf0 2024-09-16T01:15:26.276 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.274+0000 7f4567623640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f45600cdbc0 con 0x7f45600d0d30 2024-09-16T01:15:26.276 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.275+0000 7f4565bc0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f45600d0d30 0x7f45600d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:26.276 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.275+0000 7f4564bbe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f456015fed0 0x7f45600d0620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42860/0 (socket says 172.21.15.81:42860) 2024-09-16T01:15:26.276 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.275+0000 7f4564bbe640 1 -- 172.21.15.81:0/1687321247 learned_addr learned my addr 172.21.15.81:0/1687321247 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:26.276 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.275+0000 7f4565bc0640 1 -- 172.21.15.81:0/1687321247 >> v1:172.21.15.102:6789/0 conn(0x7f456015faf0 legacy=0x7f45600b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:26.276 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.275+0000 7f4565bc0640 1 -- 172.21.15.81:0/1687321247 >> v1:172.21.15.81:6789/0 conn(0x7f456015fed0 legacy=0x7f45600d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:26.276 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.275+0000 7f4557fff640 1 -- 172.21.15.81:0/1687321247 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 617562472 0 0) 0x7f45600d2ee0 con 0x7f456015fed0 2024-09-16T01:15:26.276 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.275+0000 7f4565bc0640 1 -- 172.21.15.81:0/1687321247 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45600cde10 con 0x7f45600d0d30 2024-09-16T01:15:26.278 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.276+0000 7f4565bc0640 1 --2- 172.21.15.81:0/1687321247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45600d0d30 0x7f45600d1140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4558009d90 tx=0x7f455802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de0cde7ac599d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:26.278 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.276+0000 7f4557fff640 1 -- 172.21.15.81:0/1687321247 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558007740 con 0x7f45600d0d30 2024-09-16T01:15:26.278 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.276+0000 7f4557fff640 1 -- 172.21.15.81:0/1687321247 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45580078e0 con 0x7f45600d0d30 2024-09-16T01:15:26.278 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.276+0000 7f4557fff640 1 -- 172.21.15.81:0/1687321247 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4558007cb0 con 0x7f45600d0d30 2024-09-16T01:15:26.278 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.276+0000 7f4567623640 1 -- 172.21.15.81:0/1687321247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45600d0d30 msgr2=0x7f45600d1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:26.278 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.276+0000 7f4567623640 1 --2- 172.21.15.81:0/1687321247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45600d0d30 0x7f45600d1140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4558009d90 tx=0x7f455802a660 comp rx=0 tx=0).stop 2024-09-16T01:15:26.278 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.276+0000 7f4567623640 1 -- 172.21.15.81:0/1687321247 shutdown_connections 2024-09-16T01:15:26.278 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.276+0000 7f4567623640 1 --2- 172.21.15.81:0/1687321247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45600d0d30 0x7f45600d1140 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.278 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.276+0000 7f4567623640 1 -- 172.21.15.81:0/1687321247 >> 172.21.15.81:0/1687321247 conn(0x7f45600d23f0 msgr2=0x7f45600d27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:26.278 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.276+0000 7f4567623640 1 -- 172.21.15.81:0/1687321247 shutdown_connections 2024-09-16T01:15:26.278 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.276+0000 7f4567623640 1 -- 172.21.15.81:0/1687321247 wait complete. 2024-09-16T01:15:26.280 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.278+0000 7f4567623640 1 Processor -- start 2024-09-16T01:15:26.280 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.278+0000 7f4567623640 1 -- start start 2024-09-16T01:15:26.281 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.278+0000 7f4567623640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45600d0d30 0x7f45600cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:26.281 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.278+0000 7f4567623640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f456015faf0 0x7f45600c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:26.281 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.278+0000 7f4567623640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f456015fed0 0x7f4560154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:26.281 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.278+0000 7f4567623640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f456009bcf0 con 0x7f45600d0d30 2024-09-16T01:15:26.281 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.278+0000 7f4567623640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f45600ce460 con 0x7f456015fed0 2024-09-16T01:15:26.281 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.278+0000 7f4567623640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f45601676a0 con 0x7f456015faf0 2024-09-16T01:15:26.281 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.278+0000 7f45653bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45600d0d30 0x7f45600cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:26.281 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.278+0000 7f45653bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45600d0d30 0x7f45600cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59430/0 (socket says 172.21.15.81:59430) 2024-09-16T01:15:26.281 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.278+0000 7f45653bf640 1 -- 172.21.15.81:0/4096294430 learned_addr learned my addr 172.21.15.81:0/4096294430 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:26.282 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f4565bc0640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f456015fed0 0x7f4560154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:26.282 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f4564bbe640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f456015faf0 0x7f45600c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:26.282 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f45653bf640 1 -- 172.21.15.81:0/4096294430 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f456015faf0 msgr2=0x7f45600c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:26.282 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f45653bf640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f456015faf0 0x7f45600c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.282 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f45653bf640 1 -- 172.21.15.81:0/4096294430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f456015fed0 msgr2=0x7f4560154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:26.282 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f45653bf640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f456015fed0 0x7f4560154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.282 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f45653bf640 1 -- 172.21.15.81:0/4096294430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4560155cd0 con 0x7f45600d0d30 2024-09-16T01:15:26.282 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f45653bf640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45600d0d30 0x7f45600cbf60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f455c00c450 tx=0x7f455c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:26.282 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f4555ffb640 1 -- 172.21.15.81:0/4096294430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c0052d0 con 0x7f45600d0d30 2024-09-16T01:15:26.282 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f4555ffb640 1 -- 172.21.15.81:0/4096294430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455c005470 con 0x7f45600d0d30 2024-09-16T01:15:26.283 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f4567623640 1 -- 172.21.15.81:0/4096294430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f456015edb0 con 0x7f45600d0d30 2024-09-16T01:15:26.283 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f4555ffb640 1 -- 172.21.15.81:0/4096294430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455c012870 con 0x7f45600d0d30 2024-09-16T01:15:26.283 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.279+0000 7f4567623640 1 -- 172.21.15.81:0/4096294430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45600cba40 con 0x7f45600d0d30 2024-09-16T01:15:26.283 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.281+0000 7f4567623640 1 -- 172.21.15.81:0/4096294430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45600d1140 con 0x7f45600d0d30 2024-09-16T01:15:26.284 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.281+0000 7f4555ffb640 1 -- 172.21.15.81:0/4096294430 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7f455c012a10 con 0x7f45600d0d30 2024-09-16T01:15:26.284 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.281+0000 7f4555ffb640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f454406c220 0x7f454406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:26.284 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.281+0000 7f4555ffb640 1 -- 172.21.15.81:0/4096294430 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f455c089fb0 con 0x7f45600d0d30 2024-09-16T01:15:26.284 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.281+0000 7f4564bbe640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f454406c220 0x7f454406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:26.284 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.282+0000 7f4564bbe640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f454406c220 0x7f454406e6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4550007f70 tx=0x7f4550007f00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:26.286 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.286+0000 7f4555ffb640 1 -- 172.21.15.81:0/4096294430 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f455c058fd0 con 0x7f45600d0d30 2024-09-16T01:15:26.482 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.481+0000 7f4567623640 1 -- 172.21.15.81:0/4096294430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45600b8370 con 0x7f45600d0d30 2024-09-16T01:15:26.483 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.482+0000 7f4555ffb640 1 -- 172.21.15.81:0/4096294430 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f455c05d2d0 con 0x7f45600d0d30 2024-09-16T01:15:26.483 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-16T01:15:26.483 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":12,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:25.065173+0000","last_up_change":"0.000000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:15:26.485 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.484+0000 7f4567623640 1 -- 172.21.15.81:0/4096294430 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f454406c220 msgr2=0x7f454406e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:26.485 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.484+0000 7f4567623640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f454406c220 0x7f454406e6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4550007f70 tx=0x7f4550007f00 comp rx=0 tx=0).stop 2024-09-16T01:15:26.485 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.484+0000 7f4567623640 1 -- 172.21.15.81:0/4096294430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45600d0d30 msgr2=0x7f45600cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:26.485 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.484+0000 7f4567623640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45600d0d30 0x7f45600cbf60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f455c00c450 tx=0x7f455c00c910 comp rx=0 tx=0).stop 2024-09-16T01:15:26.485 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.484+0000 7f4567623640 1 -- 172.21.15.81:0/4096294430 shutdown_connections 2024-09-16T01:15:26.485 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.484+0000 7f4567623640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f454406c220 0x7f454406e6e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.486 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.484+0000 7f4567623640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f456015fed0 0x7f4560154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.486 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.484+0000 7f4567623640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f456015faf0 0x7f45600c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.486 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.484+0000 7f4567623640 1 --2- 172.21.15.81:0/4096294430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45600d0d30 0x7f45600cbf60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:26.486 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.484+0000 7f4567623640 1 -- 172.21.15.81:0/4096294430 >> 172.21.15.81:0/4096294430 conn(0x7f45600d23f0 msgr2=0x7f45600d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:26.486 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.484+0000 7f4567623640 1 -- 172.21.15.81:0/4096294430 shutdown_connections 2024-09-16T01:15:26.486 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:26.484+0000 7f4567623640 1 -- 172.21.15.81:0/4096294430 wait complete. 2024-09-16T01:15:26.498 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-16T01:15:27.010 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-16T01:15:27.010+0000 7fd3df441640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T01:15:27.026 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-16T01:15:27.025+0000 7fd3d7261640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:15:27.202 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-16T01:15:27.201+0000 7fb190a08640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T01:15:27.203 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-09-16T01:15:27.199+0000 7f905da97640 -1 osd.7 0 waiting for initial osdmap 2024-09-16T01:15:27.213 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-16T01:15:27.213+0000 7fb188828640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:15:27.219 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-09-16T01:15:27.218+0000 7f90558b7640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:15:27.220 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-16T01:15:27.218+0000 7ff58fbb3640 -1 osd.4 0 waiting for initial osdmap 2024-09-16T01:15:27.221 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-16T01:15:27.220+0000 7fa8ed823640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T01:15:27.231 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-16T01:15:27.231+0000 7fa8e4e2f640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:15:27.232 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-16T01:15:27.231+0000 7ff5879d3640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:15:27.232 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-16T01:15:27.232+0000 7f02c6016640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T01:15:27.236 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-09-16T01:15:27.235+0000 7fa4ef053640 -1 osd.5 0 waiting for initial osdmap 2024-09-16T01:15:27.246 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-16T01:15:27.246+0000 7f02bde36640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:15:27.248 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-09-16T01:15:27.247+0000 7fa4e6e73640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:15:27.273 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-09-16T01:15:27.271+0000 7f36b5273640 -1 osd.6 0 waiting for initial osdmap 2024-09-16T01:15:27.285 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-09-16T01:15:27.284+0000 7f36ad093640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T01:15:33.304 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-16T01:15:33.405 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.404+0000 7f74ff9cf640 1 Processor -- start 2024-09-16T01:15:33.405 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.404+0000 7f74ff9cf640 1 -- start start 2024-09-16T01:15:33.406 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.405+0000 7f74ff9cf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74f815e6d0 0x7f74f806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:33.406 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.405+0000 7f74ff9cf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74f809b890 0x7f74f809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:33.406 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.405+0000 7f74ff9cf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f80d0880 con 0x7f74f809afb0 2024-09-16T01:15:33.406 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.405+0000 7f74ff9cf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f74f80cda70 con 0x7f74f815e6d0 2024-09-16T01:15:33.406 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.405+0000 7f74ff9cf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f74f80d0b60 con 0x7f74f809b890 2024-09-16T01:15:33.407 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.405+0000 7f74fd76b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74f815e6d0 0x7f74f806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:33.407 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.405+0000 7f74fdf6c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f74f809afb0 0x7f74f8162230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54396/0 (socket says 172.21.15.81:54396) 2024-09-16T01:15:33.407 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.405+0000 7f74fdf6c640 1 -- 172.21.15.81:0/1417655289 learned_addr learned my addr 172.21.15.81:0/1417655289 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:33.407 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.405+0000 7f74fcf6a640 1 --2- 172.21.15.81:0/1417655289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74f809b890 0x7f74f809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:33.407 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.405+0000 7f74fd76b640 1 -- 172.21.15.81:0/1417655289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74f809b890 msgr2=0x7f74f809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:33.407 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.405+0000 7f74fd76b640 1 --2- 172.21.15.81:0/1417655289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74f809b890 0x7f74f809aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.407 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.406+0000 7f74fd76b640 1 -- 172.21.15.81:0/1417655289 >> v1:172.21.15.81:6789/0 conn(0x7f74f809afb0 legacy=0x7f74f8162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.407 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.406+0000 7f74fd76b640 1 -- 172.21.15.81:0/1417655289 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f80d0e40 con 0x7f74f815e6d0 2024-09-16T01:15:33.407 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.406+0000 7f74effff640 1 -- 172.21.15.81:0/1417655289 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4143065294 0 0) 0x7f74f80d0880 con 0x7f74f809afb0 2024-09-16T01:15:33.408 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.406+0000 7f74fd76b640 1 --2- 172.21.15.81:0/1417655289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f815e6d0 0x7f74f806d700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009d90 tx=0x7f74f402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11af4e98d1e55705 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:33.408 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.406+0000 7f74effff640 1 -- 172.21.15.81:0/1417655289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4007740 con 0x7f74f815e6d0 2024-09-16T01:15:33.408 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.406+0000 7f74effff640 1 -- 172.21.15.81:0/1417655289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f40078e0 con 0x7f74f815e6d0 2024-09-16T01:15:33.408 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.406+0000 7f74effff640 1 -- 172.21.15.81:0/1417655289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4007cb0 con 0x7f74f815e6d0 2024-09-16T01:15:33.409 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.407+0000 7f74ff9cf640 1 -- 172.21.15.81:0/1417655289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f815e6d0 msgr2=0x7f74f806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.409 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.407+0000 7f74ff9cf640 1 --2- 172.21.15.81:0/1417655289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f815e6d0 0x7f74f806d700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009d90 tx=0x7f74f402a6f0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.409 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.407+0000 7f74ff9cf640 1 -- 172.21.15.81:0/1417655289 shutdown_connections 2024-09-16T01:15:33.409 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.407+0000 7f74ff9cf640 1 --2- 172.21.15.81:0/1417655289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74f809b890 0x7f74f809aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.409 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.407+0000 7f74ff9cf640 1 --2- 172.21.15.81:0/1417655289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f815e6d0 0x7f74f806d700 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.409 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.407+0000 7f74ff9cf640 1 -- 172.21.15.81:0/1417655289 >> 172.21.15.81:0/1417655289 conn(0x7f74f80d2410 msgr2=0x7f74f80d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:33.409 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.407+0000 7f74ff9cf640 1 -- 172.21.15.81:0/1417655289 shutdown_connections 2024-09-16T01:15:33.409 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.407+0000 7f74ff9cf640 1 -- 172.21.15.81:0/1417655289 wait complete. 2024-09-16T01:15:33.411 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.408+0000 7f74ff9cf640 1 Processor -- start 2024-09-16T01:15:33.411 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.408+0000 7f74ff9cf640 1 -- start start 2024-09-16T01:15:33.411 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74ff9cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f809afb0 0x7f74f80cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74ff9cf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74f809b890 0x7f74f81e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74ff9cf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74f815e6d0 0x7f74f8157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74ff9cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f74f815eab0 con 0x7f74f809afb0 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74ff9cf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f74f80d1400 con 0x7f74f815e6d0 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74ff9cf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f74f80d1920 con 0x7f74f809b890 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74fd76b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f809afb0 0x7f74f80cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74fd76b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f809afb0 0x7f74f80cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40984/0 (socket says 172.21.15.81:40984) 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74fd76b640 1 -- 172.21.15.81:0/2350806113 learned_addr learned my addr 172.21.15.81:0/2350806113 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74fdf6c640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74f815e6d0 0x7f74f8157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74fcf6a640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74f809b890 0x7f74f81e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74fd76b640 1 -- 172.21.15.81:0/2350806113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74f809b890 msgr2=0x7f74f81e8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74fd76b640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74f809b890 0x7f74f81e8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.412 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74fd76b640 1 -- 172.21.15.81:0/2350806113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74f815e6d0 msgr2=0x7f74f8157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.413 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74fd76b640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74f815e6d0 0x7f74f8157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.413 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74fd76b640 1 -- 172.21.15.81:0/2350806113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f81e9180 con 0x7f74f809afb0 2024-09-16T01:15:33.413 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74fcf6a640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74f809b890 0x7f74f81e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:15:33.413 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.409+0000 7f74fdf6c640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74f815e6d0 0x7f74f8157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:15:33.413 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.410+0000 7f74fd76b640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f809afb0 0x7f74f80cb4f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009d90 tx=0x7f74f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:33.413 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.410+0000 7f74edffb640 1 -- 172.21.15.81:0/2350806113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f403f070 con 0x7f74f809afb0 2024-09-16T01:15:33.413 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.410+0000 7f74edffb640 1 -- 172.21.15.81:0/2350806113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f4031c40 con 0x7f74f809afb0 2024-09-16T01:15:33.413 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.410+0000 7f74ff9cf640 1 -- 172.21.15.81:0/2350806113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f81e9460 con 0x7f74f809afb0 2024-09-16T01:15:33.413 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.410+0000 7f74edffb640 1 -- 172.21.15.81:0/2350806113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4043410 con 0x7f74f809afb0 2024-09-16T01:15:33.413 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.410+0000 7f74ff9cf640 1 -- 172.21.15.81:0/2350806113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f81e9a20 con 0x7f74f809afb0 2024-09-16T01:15:33.414 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.411+0000 7f74ff9cf640 1 -- 172.21.15.81:0/2350806113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f809aa70 con 0x7f74f809afb0 2024-09-16T01:15:33.414 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.411+0000 7f74edffb640 1 -- 172.21.15.81:0/2350806113 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f74f40435b0 con 0x7f74f809afb0 2024-09-16T01:15:33.414 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.412+0000 7f74edffb640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74dc06c2b0 0x7f74dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:33.414 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.412+0000 7f74edffb640 1 -- 172.21.15.81:0/2350806113 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f74f40ac620 con 0x7f74f809afb0 2024-09-16T01:15:33.414 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.412+0000 7f74fcf6a640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74dc06c2b0 0x7f74dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:33.414 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.412+0000 7f74fcf6a640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74dc06c2b0 0x7f74dc06e770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f74f81f7b60 tx=0x7f74e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:33.417 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.416+0000 7f74edffb640 1 -- 172.21.15.81:0/2350806113 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74f407b0e0 con 0x7f74f809afb0 2024-09-16T01:15:33.583 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.582+0000 7f74ff9cf640 1 -- 172.21.15.81:0/2350806113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74f80b8390 con 0x7f74f809afb0 2024-09-16T01:15:33.584 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.583+0000 7f74edffb640 1 -- 172.21.15.81:0/2350806113 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12896 (secure 0 0 0) 0x7f74f407a9e0 con 0x7f74f809afb0 2024-09-16T01:15:33.584 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-16T01:15:33.584 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":16,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:31.041775+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:15:33.586 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.585+0000 7f74ff9cf640 1 -- 172.21.15.81:0/2350806113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74dc06c2b0 msgr2=0x7f74dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.586 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.585+0000 7f74ff9cf640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74dc06c2b0 0x7f74dc06e770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f74f81f7b60 tx=0x7f74e8008040 comp rx=0 tx=0).stop 2024-09-16T01:15:33.587 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.585+0000 7f74ff9cf640 1 -- 172.21.15.81:0/2350806113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f809afb0 msgr2=0x7f74f80cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.587 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.585+0000 7f74ff9cf640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f809afb0 0x7f74f80cb4f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009d90 tx=0x7f74f4004a40 comp rx=0 tx=0).stop 2024-09-16T01:15:33.587 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.585+0000 7f74ff9cf640 1 -- 172.21.15.81:0/2350806113 shutdown_connections 2024-09-16T01:15:33.587 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.585+0000 7f74ff9cf640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74dc06c2b0 0x7f74dc06e770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.587 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.585+0000 7f74ff9cf640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74f815e6d0 0x7f74f8157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.587 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.585+0000 7f74ff9cf640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74f809b890 0x7f74f81e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.587 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.585+0000 7f74ff9cf640 1 --2- 172.21.15.81:0/2350806113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f809afb0 0x7f74f80cb4f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.587 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.585+0000 7f74ff9cf640 1 -- 172.21.15.81:0/2350806113 >> 172.21.15.81:0/2350806113 conn(0x7f74f80d2410 msgr2=0x7f74f8070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:33.587 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.586+0000 7f74ff9cf640 1 -- 172.21.15.81:0/2350806113 shutdown_connections 2024-09-16T01:15:33.587 INFO:teuthology.misc.health.smithi081.stderr:2024-09-16T01:15:33.586+0000 7f74ff9cf640 1 -- 172.21.15.81:0/2350806113 wait complete. 2024-09-16T01:15:33.596 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-16T01:15:33.596 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-16T01:15:33.596 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:15:33.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:15:33.598 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:15:33.598 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:15:33.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:15:33.601 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:15:33.601 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:15:33.601 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:15:33.603 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:15:33.604 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:15:33.604 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:15:33.606 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:15:33.606 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-16T01:15:33.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:15:33.672 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:15:33.672 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:15:33.690 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:15:33.690 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-16T01:15:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.707+0000 7efcebad7640 1 Processor -- start 2024-09-16T01:15:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.708+0000 7efcebad7640 1 -- start start 2024-09-16T01:15:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.708+0000 7efcebad7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efce4162060 0x7efce40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.708+0000 7efcebad7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce406d9f0 con 0x7efce4161c80 2024-09-16T01:15:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.708+0000 7efcebad7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce406dcd0 con 0x7efce40b64b0 2024-09-16T01:15:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.708+0000 7efcebad7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7efce406dfb0 con 0x7efce4162060 2024-09-16T01:15:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.708+0000 7efce9072640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efce4162060 0x7efce40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.708+0000 7efce9873640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efce4161c80 0x7efce406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54412/0 (socket says 172.21.15.81:54412) 2024-09-16T01:15:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.708+0000 7efce9873640 1 -- 172.21.15.81:0/443518850 learned_addr learned my addr 172.21.15.81:0/443518850 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.709+0000 7efce9072640 1 -- 172.21.15.81:0/443518850 >> v1:172.21.15.102:6789/0 conn(0x7efce40b64b0 legacy=0x7efce40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.709+0000 7efce9072640 1 -- 172.21.15.81:0/443518850 >> v1:172.21.15.81:6789/0 conn(0x7efce4161c80 legacy=0x7efce406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.709+0000 7efce9072640 1 -- 172.21.15.81:0/443518850 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce40d2890 con 0x7efce4162060 2024-09-16T01:15:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.709+0000 7efce8871640 1 -- 172.21.15.81:0/443518850 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1845613434 0 0) 0x7efce406d9f0 con 0x7efce4161c80 2024-09-16T01:15:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.709+0000 7efce9072640 1 --2- 172.21.15.81:0/443518850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce4162060 0x7efce40b5f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efcd80097a0 tx=0x7efcd802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b5595081225256 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.710+0000 7efce8871640 1 -- 172.21.15.81:0/443518850 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd8037070 con 0x7efce4162060 2024-09-16T01:15:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.710+0000 7efce8871640 1 -- 172.21.15.81:0/443518850 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd8032440 con 0x7efce4162060 2024-09-16T01:15:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.710+0000 7efce8871640 1 -- 172.21.15.81:0/443518850 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd8032810 con 0x7efce4162060 2024-09-16T01:15:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.710+0000 7efcebad7640 1 -- 172.21.15.81:0/443518850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce4162060 msgr2=0x7efce40b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.710+0000 7efcebad7640 1 --2- 172.21.15.81:0/443518850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce4162060 0x7efce40b5f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efcd80097a0 tx=0x7efcd802a230 comp rx=0 tx=0).stop 2024-09-16T01:15:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.710+0000 7efcebad7640 1 -- 172.21.15.81:0/443518850 shutdown_connections 2024-09-16T01:15:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.710+0000 7efcebad7640 1 --2- 172.21.15.81:0/443518850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce4162060 0x7efce40b5f70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.710+0000 7efcebad7640 1 -- 172.21.15.81:0/443518850 >> 172.21.15.81:0/443518850 conn(0x7efce40d44f0 msgr2=0x7efce40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.710+0000 7efcebad7640 1 -- 172.21.15.81:0/443518850 shutdown_connections 2024-09-16T01:15:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.710+0000 7efcebad7640 1 -- 172.21.15.81:0/443518850 wait complete. 2024-09-16T01:15:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.711+0000 7efcebad7640 1 Processor -- start 2024-09-16T01:15:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.711+0000 7efcebad7640 1 -- start start 2024-09-16T01:15:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efcebad7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce40b64b0 0x7efce41f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efcebad7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce4161c80 0x7efce40b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efcebad7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efce4162060 0x7efce40b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efcebad7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efce40b6d30 con 0x7efce40b64b0 2024-09-16T01:15:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efcebad7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efce40b6bb0 con 0x7efce4161c80 2024-09-16T01:15:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efcebad7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efce40cf8f0 con 0x7efce4162060 2024-09-16T01:15:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efce9873640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce40b64b0 0x7efce41f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efce9873640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce40b64b0 0x7efce41f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41028/0 (socket says 172.21.15.81:41028) 2024-09-16T01:15:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efce9873640 1 -- 172.21.15.81:0/2238987872 learned_addr learned my addr 172.21.15.81:0/2238987872 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efce9072640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce4161c80 0x7efce40b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efcea074640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efce4162060 0x7efce40b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efce9873640 1 -- 172.21.15.81:0/2238987872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efce4162060 msgr2=0x7efce40b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.712+0000 7efce9873640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efce4162060 0x7efce40b7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.713+0000 7efce9873640 1 -- 172.21.15.81:0/2238987872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce4161c80 msgr2=0x7efce40b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.713+0000 7efce9873640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce4161c80 0x7efce40b4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.713+0000 7efce9873640 1 -- 172.21.15.81:0/2238987872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce40b9550 con 0x7efce40b64b0 2024-09-16T01:15:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.713+0000 7efce9873640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce40b64b0 0x7efce41f52c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efce000c4d0 tx=0x7efce000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.713+0000 7efcd67fc640 1 -- 172.21.15.81:0/2238987872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0018070 con 0x7efce40b64b0 2024-09-16T01:15:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.713+0000 7efcd67fc640 1 -- 172.21.15.81:0/2238987872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce00074e0 con 0x7efce40b64b0 2024-09-16T01:15:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.713+0000 7efcebad7640 1 -- 172.21.15.81:0/2238987872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce40b9830 con 0x7efce40b64b0 2024-09-16T01:15:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.713+0000 7efcd67fc640 1 -- 172.21.15.81:0/2238987872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0004a20 con 0x7efce40b64b0 2024-09-16T01:15:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.713+0000 7efcebad7640 1 -- 172.21.15.81:0/2238987872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce40b9df0 con 0x7efce40b64b0 2024-09-16T01:15:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.714+0000 7efcebad7640 1 -- 172.21.15.81:0/2238987872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce406d9f0 con 0x7efce40b64b0 2024-09-16T01:15:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.714+0000 7efcd67fc640 1 -- 172.21.15.81:0/2238987872 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efce001b070 con 0x7efce40b64b0 2024-09-16T01:15:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.715+0000 7efcd67fc640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efcc806c2b0 0x7efcc806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.715+0000 7efce9072640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efcc806c2b0 0x7efcc806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.715+0000 7efcd67fc640 1 -- 172.21.15.81:0/2238987872 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7efce008a340 con 0x7efce40b64b0 2024-09-16T01:15:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.715+0000 7efce9072640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efcc806c2b0 0x7efcc806e770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcd8034000 tx=0x7efcd802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:33.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.719+0000 7efcd67fc640 1 -- 172.21.15.81:0/2238987872 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efce0058840 con 0x7efce40b64b0 2024-09-16T01:15:33.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.919+0000 7efcebad7640 1 -- 172.21.15.81:0/2238987872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efce40ba470 con 0x7efce40b64b0 2024-09-16T01:15:33.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.919+0000 7efcd67fc640 1 -- 172.21.15.81:0/2238987872 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7efce005cb40 con 0x7efce40b64b0 2024-09-16T01:15:33.920 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:33.921 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"btime":"2024-09-16T01:15:33:676284+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4105201682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4105201682},{"type":"v1","addr":"172.21.15.81:6835","nonce":4105201682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-16T01:15:33.921 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2024-09-16T01:15:33.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.921+0000 7efcebad7640 1 -- 172.21.15.81:0/2238987872 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efcc806c2b0 msgr2=0x7efcc806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.921+0000 7efcebad7640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efcc806c2b0 0x7efcc806e770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcd8034000 tx=0x7efcd802e000 comp rx=0 tx=0).stop 2024-09-16T01:15:33.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.921+0000 7efcebad7640 1 -- 172.21.15.81:0/2238987872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce40b64b0 msgr2=0x7efce41f52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:33.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.921+0000 7efcebad7640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce40b64b0 0x7efce41f52c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efce000c4d0 tx=0x7efce000c990 comp rx=0 tx=0).stop 2024-09-16T01:15:33.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.921+0000 7efcebad7640 1 -- 172.21.15.81:0/2238987872 shutdown_connections 2024-09-16T01:15:33.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.921+0000 7efcebad7640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efcc806c2b0 0x7efcc806e770 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.921+0000 7efcebad7640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efce4162060 0x7efce40b7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.921+0000 7efcebad7640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce4161c80 0x7efce40b4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.921+0000 7efcebad7640 1 --2- 172.21.15.81:0/2238987872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce40b64b0 0x7efce41f52c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:33.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.921+0000 7efcebad7640 1 -- 172.21.15.81:0/2238987872 >> 172.21.15.81:0/2238987872 conn(0x7efce40d44f0 msgr2=0x7efce40b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:33.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.922+0000 7efcebad7640 1 -- 172.21.15.81:0/2238987872 shutdown_connections 2024-09-16T01:15:33.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:33.922+0000 7efcebad7640 1 -- 172.21.15.81:0/2238987872 wait complete. 2024-09-16T01:15:35.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:15:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.043+0000 7f6f59331640 1 Processor -- start 2024-09-16T01:15:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.043+0000 7f6f59331640 1 -- start start 2024-09-16T01:15:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.043+0000 7f6f59331640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6f5415e5f0 0x7f6f540d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.043+0000 7f6f59331640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f540b6690 0x7f6f5406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.043+0000 7f6f59331640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f540d3690 con 0x7f6f540d30f0 2024-09-16T01:15:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.043+0000 7f6f59331640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6f5406d530 con 0x7f6f5415e5f0 2024-09-16T01:15:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.043+0000 7f6f59331640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6f540d3970 con 0x7f6f540b6690 2024-09-16T01:15:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.043+0000 7f6f527fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6f540d30f0 0x7f6f540b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54418/0 (socket says 172.21.15.81:54418) 2024-09-16T01:15:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.044+0000 7f6f527fc640 1 -- 172.21.15.81:0/813710654 learned_addr learned my addr 172.21.15.81:0/813710654 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.044+0000 7f6f537fe640 1 --2- 172.21.15.81:0/813710654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f540b6690 0x7f6f5406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.044+0000 7f6f52ffd640 1 --2- 172.21.15.81:0/813710654 >> v2:172.21.15.102:3300/0 conn(0x7f6f5415e5f0 0x7f6f540d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.044+0000 7f6f51ffb640 1 -- 172.21.15.81:0/813710654 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 217507856 0 0) 0x7f6f540d3690 con 0x7f6f540d30f0 2024-09-16T01:15:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.044+0000 7f6f51ffb640 1 -- 172.21.15.81:0/813710654 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f3c003520 con 0x7f6f540d30f0 2024-09-16T01:15:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.044+0000 7f6f537fe640 1 -- 172.21.15.81:0/813710654 >> v2:172.21.15.102:3300/0 conn(0x7f6f5415e5f0 msgr2=0x7f6f540d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.044+0000 7f6f537fe640 1 --2- 172.21.15.81:0/813710654 >> v2:172.21.15.102:3300/0 conn(0x7f6f5415e5f0 0x7f6f540d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.044+0000 7f6f537fe640 1 -- 172.21.15.81:0/813710654 >> v1:172.21.15.81:6789/0 conn(0x7f6f540d30f0 legacy=0x7f6f540b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.044+0000 7f6f51ffb640 1 -- 172.21.15.81:0/813710654 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1615876437 0 0) 0x7f6f3c003520 con 0x7f6f540d30f0 2024-09-16T01:15:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.044+0000 7f6f537fe640 1 -- 172.21.15.81:0/813710654 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5406cee0 con 0x7f6f540b6690 2024-09-16T01:15:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.044+0000 7f6f52ffd640 1 --2- 172.21.15.81:0/813710654 >> v2:172.21.15.102:3300/0 conn(0x7f6f5415e5f0 0x7f6f540d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.045+0000 7f6f537fe640 1 --2- 172.21.15.81:0/813710654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f540b6690 0x7f6f5406d9c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009d90 tx=0x7f6f4c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e9e0a53b8f85957 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.045+0000 7f6f51ffb640 1 -- 172.21.15.81:0/813710654 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48001690 con 0x7f6f540b6690 2024-09-16T01:15:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.045+0000 7f6f51ffb640 1 -- 172.21.15.81:0/813710654 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c007540 con 0x7f6f540b6690 2024-09-16T01:15:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.045+0000 7f6f51ffb640 1 -- 172.21.15.81:0/813710654 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0078f0 con 0x7f6f540b6690 2024-09-16T01:15:36.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.046+0000 7f6f59331640 1 -- 172.21.15.81:0/813710654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f540b6690 msgr2=0x7f6f5406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.046+0000 7f6f59331640 1 --2- 172.21.15.81:0/813710654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f540b6690 0x7f6f5406d9c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009d90 tx=0x7f6f4c02a5f0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.046+0000 7f6f59331640 1 -- 172.21.15.81:0/813710654 shutdown_connections 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.046+0000 7f6f59331640 1 --2- 172.21.15.81:0/813710654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f540b6690 0x7f6f5406d9c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.046+0000 7f6f59331640 1 --2- 172.21.15.81:0/813710654 >> v2:172.21.15.102:3300/0 conn(0x7f6f5415e5f0 0x7f6f540d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.046+0000 7f6f59331640 1 -- 172.21.15.81:0/813710654 >> 172.21.15.81:0/813710654 conn(0x7f6f5408bfc0 msgr2=0x7f6f540d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.046+0000 7f6f59331640 1 -- 172.21.15.81:0/813710654 shutdown_connections 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.046+0000 7f6f59331640 1 -- 172.21.15.81:0/813710654 wait complete. 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.047+0000 7f6f59331640 1 Processor -- start 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.047+0000 7f6f59331640 1 -- start start 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f59331640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f540b6690 0x7f6f540c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f59331640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f540d30f0 0x7f6f540c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f59331640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f5415e5f0 0x7f6f54159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f59331640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6f540d5310 con 0x7f6f540b6690 2024-09-16T01:15:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f59331640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5415e9d0 con 0x7f6f5415e5f0 2024-09-16T01:15:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f59331640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5406df00 con 0x7f6f540d30f0 2024-09-16T01:15:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f52ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f540b6690 0x7f6f540c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f52ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f540b6690 0x7f6f540c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41034/0 (socket says 172.21.15.81:41034) 2024-09-16T01:15:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f52ffd640 1 -- 172.21.15.81:0/715429843 learned_addr learned my addr 172.21.15.81:0/715429843 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f527fc640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f540d30f0 0x7f6f540c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f537fe640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f5415e5f0 0x7f6f54159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f52ffd640 1 -- 172.21.15.81:0/715429843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f540d30f0 msgr2=0x7f6f540c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f52ffd640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f540d30f0 0x7f6f540c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f52ffd640 1 -- 172.21.15.81:0/715429843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f5415e5f0 msgr2=0x7f6f54159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f52ffd640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f5415e5f0 0x7f6f54159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f52ffd640 1 -- 172.21.15.81:0/715429843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f540c87a0 con 0x7f6f540b6690 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f527fc640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f540d30f0 0x7f6f540c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.048+0000 7f6f52ffd640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f540b6690 0x7f6f540c8030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400e960 tx=0x7f6f4400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.049+0000 7f6f3b7fe640 1 -- 172.21.15.81:0/715429843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44017070 con 0x7f6f540b6690 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.049+0000 7f6f3b7fe640 1 -- 172.21.15.81:0/715429843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4400ca00 con 0x7f6f540b6690 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.049+0000 7f6f59331640 1 -- 172.21.15.81:0/715429843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f540c8a80 con 0x7f6f540b6690 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.049+0000 7f6f3b7fe640 1 -- 172.21.15.81:0/715429843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4400cdd0 con 0x7f6f540b6690 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.049+0000 7f6f59331640 1 -- 172.21.15.81:0/715429843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f540c9040 con 0x7f6f540b6690 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.050+0000 7f6f59331640 1 -- 172.21.15.81:0/715429843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f5406d9c0 con 0x7f6f540b6690 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.050+0000 7f6f3b7fe640 1 -- 172.21.15.81:0/715429843 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f4401a070 con 0x7f6f540b6690 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.051+0000 7f6f3b7fe640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6f4006c2e0 0x7f6f4006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.051+0000 7f6f3b7fe640 1 -- 172.21.15.81:0/715429843 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f6f4408b2c0 con 0x7f6f540b6690 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.051+0000 7f6f527fc640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6f4006c2e0 0x7f6f4006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.051+0000 7f6f527fc640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6f4006c2e0 0x7f6f4006e7a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f540ba4e0 tx=0x7f6f48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:36.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.055+0000 7f6f3b7fe640 1 -- 172.21.15.81:0/715429843 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f44059e10 con 0x7f6f540b6690 2024-09-16T01:15:36.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.255+0000 7f6f59331640 1 -- 172.21.15.81:0/715429843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f540cb390 con 0x7f6f540b6690 2024-09-16T01:15:36.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.255+0000 7f6f3b7fe640 1 -- 172.21.15.81:0/715429843 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7f6f44059710 con 0x7f6f540b6690 2024-09-16T01:15:36.257 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:36.257 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"btime":"2024-09-16T01:15:34:677297+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1441310273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1441310273},{"type":"v1","addr":"172.21.15.102:6834","nonce":1441310273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1086586307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1086586307},{"type":"v1","addr":"172.21.15.102:6835","nonce":1086586307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4105201682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4105201682},{"type":"v1","addr":"172.21.15.81:6835","nonce":4105201682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2354333316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2354333316},{"type":"v1","addr":"172.21.15.81:6837","nonce":2354333316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-16T01:15:36.258 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2024-09-16T01:15:36.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.257+0000 7f6f59331640 1 -- 172.21.15.81:0/715429843 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6f4006c2e0 msgr2=0x7f6f4006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.257+0000 7f6f59331640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6f4006c2e0 0x7f6f4006e7a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f540ba4e0 tx=0x7f6f48009040 comp rx=0 tx=0).stop 2024-09-16T01:15:36.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.257+0000 7f6f59331640 1 -- 172.21.15.81:0/715429843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f540b6690 msgr2=0x7f6f540c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.257+0000 7f6f59331640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f540b6690 0x7f6f540c8030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400e960 tx=0x7f6f4400ee20 comp rx=0 tx=0).stop 2024-09-16T01:15:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.257+0000 7f6f59331640 1 -- 172.21.15.81:0/715429843 shutdown_connections 2024-09-16T01:15:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.257+0000 7f6f59331640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6f4006c2e0 0x7f6f4006e7a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.257+0000 7f6f59331640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f5415e5f0 0x7f6f54159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.257+0000 7f6f59331640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f540d30f0 0x7f6f540c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.257+0000 7f6f59331640 1 --2- 172.21.15.81:0/715429843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f540b6690 0x7f6f540c8030 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.257+0000 7f6f59331640 1 -- 172.21.15.81:0/715429843 >> 172.21.15.81:0/715429843 conn(0x7f6f5408bfc0 msgr2=0x7f6f540b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.257+0000 7f6f59331640 1 -- 172.21.15.81:0/715429843 shutdown_connections 2024-09-16T01:15:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.257+0000 7f6f59331640 1 -- 172.21.15.81:0/715429843 wait complete. 2024-09-16T01:15:36.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:15:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.365+0000 7ff03a4b7640 1 Processor -- start 2024-09-16T01:15:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.365+0000 7ff03a4b7640 1 -- start start 2024-09-16T01:15:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff03a4b7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff03415ba30 0x7ff03406f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff03a4b7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff034073050 0x7ff0340b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff03a4b7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0340b3570 con 0x7ff03406fd50 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff03a4b7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff0340b4180 con 0x7ff03415ba30 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff03a4b7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff0340b3850 con 0x7ff034073050 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff033fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff03415ba30 0x7ff03406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff0337fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff03406fd50 0x7ff034072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54424/0 (socket says 172.21.15.81:54424) 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff0337fe640 1 -- 172.21.15.81:0/2120458899 learned_addr learned my addr 172.21.15.81:0/2120458899 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff033fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff03415ba30 0x7ff03406f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41042/0 (socket says 172.21.15.81:41042) 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff038a54640 1 --2- 172.21.15.81:0/2120458899 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff034073050 0x7ff0340b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff033fff640 1 -- 172.21.15.81:0/2120458899 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff034073050 msgr2=0x7ff0340b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff033fff640 1 --2- 172.21.15.81:0/2120458899 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff034073050 0x7ff0340b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff033fff640 1 -- 172.21.15.81:0/2120458899 >> v1:172.21.15.81:6789/0 conn(0x7ff03406fd50 legacy=0x7ff034072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff033fff640 1 -- 172.21.15.81:0/2120458899 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0340b3b30 con 0x7ff03415ba30 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff032ffd640 1 -- 172.21.15.81:0/2120458899 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965772403 0 0) 0x7ff0340b3570 con 0x7ff03406fd50 2024-09-16T01:15:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.366+0000 7ff038a54640 1 --2- 172.21.15.81:0/2120458899 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff034073050 0x7ff0340b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:15:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.367+0000 7ff033fff640 1 --2- 172.21.15.81:0/2120458899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03415ba30 0x7ff03406f810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0240097a0 tx=0x7ff02402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e492e1f73c33d63 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.367+0000 7ff032ffd640 1 -- 172.21.15.81:0/2120458899 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024037070 con 0x7ff03415ba30 2024-09-16T01:15:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.367+0000 7ff032ffd640 1 -- 172.21.15.81:0/2120458899 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff024032440 con 0x7ff03415ba30 2024-09-16T01:15:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.367+0000 7ff032ffd640 1 -- 172.21.15.81:0/2120458899 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024032810 con 0x7ff03415ba30 2024-09-16T01:15:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.368+0000 7ff03a4b7640 1 -- 172.21.15.81:0/2120458899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03415ba30 msgr2=0x7ff03406f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.368+0000 7ff03a4b7640 1 --2- 172.21.15.81:0/2120458899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03415ba30 0x7ff03406f810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0240097a0 tx=0x7ff02402a180 comp rx=0 tx=0).stop 2024-09-16T01:15:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.368+0000 7ff03a4b7640 1 -- 172.21.15.81:0/2120458899 shutdown_connections 2024-09-16T01:15:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.368+0000 7ff03a4b7640 1 --2- 172.21.15.81:0/2120458899 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff034073050 0x7ff0340b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.368+0000 7ff03a4b7640 1 --2- 172.21.15.81:0/2120458899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03415ba30 0x7ff03406f810 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.368+0000 7ff03a4b7640 1 -- 172.21.15.81:0/2120458899 >> 172.21.15.81:0/2120458899 conn(0x7ff034067d70 msgr2=0x7ff03406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:36.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.368+0000 7ff03a4b7640 1 -- 172.21.15.81:0/2120458899 shutdown_connections 2024-09-16T01:15:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.368+0000 7ff03a4b7640 1 -- 172.21.15.81:0/2120458899 wait complete. 2024-09-16T01:15:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.369+0000 7ff03a4b7640 1 Processor -- start 2024-09-16T01:15:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.369+0000 7ff03a4b7640 1 -- start start 2024-09-16T01:15:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff03a4b7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff03406fd50 0x7ff03414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff03a4b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff034073050 0x7ff03414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff03a4b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff03415ba30 0x7ff0341567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff03a4b7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0340ccfe0 con 0x7ff034073050 2024-09-16T01:15:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff03a4b7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff0340ce810 con 0x7ff03415ba30 2024-09-16T01:15:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff03a4b7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff0340cd160 con 0x7ff03406fd50 2024-09-16T01:15:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff0337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff034073050 0x7ff03414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff0337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff034073050 0x7ff03414ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41046/0 (socket says 172.21.15.81:41046) 2024-09-16T01:15:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff0337fe640 1 -- 172.21.15.81:0/145982166 learned_addr learned my addr 172.21.15.81:0/145982166 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff033fff640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff03406fd50 0x7ff03414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff038a54640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff03415ba30 0x7ff0341567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff0337fe640 1 -- 172.21.15.81:0/145982166 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff03406fd50 msgr2=0x7ff03414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff0337fe640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff03406fd50 0x7ff03414f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff0337fe640 1 -- 172.21.15.81:0/145982166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff03415ba30 msgr2=0x7ff0341567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff0337fe640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff03415ba30 0x7ff0341567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff0337fe640 1 -- 172.21.15.81:0/145982166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0341586e0 con 0x7ff034073050 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff033fff640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff03406fd50 0x7ff03414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff038a54640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff03415ba30 0x7ff0341567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff0337fe640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff034073050 0x7ff03414ec30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff02800c4a0 tx=0x7ff02800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff030ff9640 1 -- 172.21.15.81:0/145982166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028018070 con 0x7ff034073050 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff030ff9640 1 -- 172.21.15.81:0/145982166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0280074e0 con 0x7ff034073050 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff03a4b7640 1 -- 172.21.15.81:0/145982166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03414f460 con 0x7ff034073050 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff030ff9640 1 -- 172.21.15.81:0/145982166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff028004a20 con 0x7ff034073050 2024-09-16T01:15:36.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.370+0000 7ff03a4b7640 1 -- 172.21.15.81:0/145982166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff034156290 con 0x7ff034073050 2024-09-16T01:15:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.371+0000 7ff03a4b7640 1 -- 172.21.15.81:0/145982166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff03406f810 con 0x7ff034073050 2024-09-16T01:15:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.372+0000 7ff030ff9640 1 -- 172.21.15.81:0/145982166 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff02801b070 con 0x7ff034073050 2024-09-16T01:15:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.372+0000 7ff030ff9640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff02006c2b0 0x7ff02006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.372+0000 7ff030ff9640 1 -- 172.21.15.81:0/145982166 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff02808a3e0 con 0x7ff034073050 2024-09-16T01:15:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.372+0000 7ff033fff640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff02006c2b0 0x7ff02006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.373+0000 7ff033fff640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff02006c2b0 0x7ff02006e770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff024034000 tx=0x7ff02402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.377+0000 7ff030ff9640 1 -- 172.21.15.81:0/145982166 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff028058ea0 con 0x7ff034073050 2024-09-16T01:15:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.544+0000 7ff03a4b7640 1 -- 172.21.15.81:0/145982166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff034159a30 con 0x7ff034073050 2024-09-16T01:15:36.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.544+0000 7ff030ff9640 1 -- 172.21.15.81:0/145982166 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7ff0280587a0 con 0x7ff034073050 2024-09-16T01:15:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:36.546 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-16T01:15:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:15:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-16T01:15:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-16T01:15:36.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:15:36.546 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-16T01:15:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.546+0000 7ff03a4b7640 1 -- 172.21.15.81:0/145982166 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff02006c2b0 msgr2=0x7ff02006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.546+0000 7ff03a4b7640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff02006c2b0 0x7ff02006e770 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff024034000 tx=0x7ff02402e000 comp rx=0 tx=0).stop 2024-09-16T01:15:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.546+0000 7ff03a4b7640 1 -- 172.21.15.81:0/145982166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff034073050 msgr2=0x7ff03414ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.546+0000 7ff03a4b7640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff034073050 0x7ff03414ec30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff02800c4a0 tx=0x7ff02800c960 comp rx=0 tx=0).stop 2024-09-16T01:15:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.546+0000 7ff03a4b7640 1 -- 172.21.15.81:0/145982166 shutdown_connections 2024-09-16T01:15:36.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.546+0000 7ff03a4b7640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff02006c2b0 0x7ff02006e770 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.546+0000 7ff03a4b7640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff03415ba30 0x7ff0341567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.546+0000 7ff03a4b7640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff034073050 0x7ff03414ec30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.546+0000 7ff03a4b7640 1 --2- 172.21.15.81:0/145982166 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff03406fd50 0x7ff03414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.546+0000 7ff03a4b7640 1 -- 172.21.15.81:0/145982166 >> 172.21.15.81:0/145982166 conn(0x7ff034067d70 msgr2=0x7ff03415a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:36.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.546+0000 7ff03a4b7640 1 -- 172.21.15.81:0/145982166 shutdown_connections 2024-09-16T01:15:36.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.546+0000 7ff03a4b7640 1 -- 172.21.15.81:0/145982166 wait complete. 2024-09-16T01:15:36.558 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:15:36.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:15:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.659+0000 7f039e511640 1 Processor -- start 2024-09-16T01:15:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.659+0000 7f039e511640 1 -- start start 2024-09-16T01:15:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.659+0000 7f039e511640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f03980cf540 0x7f03981621b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.659+0000 7f039e511640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03980b11f0 con 0x7f03981626f0 2024-09-16T01:15:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.659+0000 7f039e511640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03980d0100 con 0x7f039815e5d0 2024-09-16T01:15:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.659+0000 7f039e511640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0398162b60 con 0x7f03980cf540 2024-09-16T01:15:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f039caae640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f03981626f0 0x7f03980b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54432/0 (socket says 172.21.15.81:54432) 2024-09-16T01:15:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f039caae640 1 -- 172.21.15.81:0/3984667352 learned_addr learned my addr 172.21.15.81:0/3984667352 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f038ffff640 1 --2- 172.21.15.81:0/3984667352 >> v2:172.21.15.102:3300/0 conn(0x7f03980cf540 0x7f03981621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4201665753 0 0) 0x7f03980b11f0 con 0x7f03981626f0 2024-09-16T01:15:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0384003520 con 0x7f03981626f0 2024-09-16T01:15:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2418433597 0 0) 0x7f0384003520 con 0x7f03981626f0 2024-09-16T01:15:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 >> v2:172.21.15.102:3300/0 conn(0x7f03980cf540 msgr2=0x7f03981621b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 --2- 172.21.15.81:0/3984667352 >> v2:172.21.15.102:3300/0 conn(0x7f03980cf540 0x7f03981621b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 >> v1:172.21.15.102:6789/0 conn(0x7f039815e5d0 legacy=0x7f03980d4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03980cfb40 con 0x7f03981626f0 2024-09-16T01:15:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f0390001a10 con 0x7f03981626f0 2024-09-16T01:15:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 >> v1:172.21.15.81:6789/0 conn(0x7f03981626f0 legacy=0x7f03980b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 --2- 172.21.15.81:0/3984667352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03840039b0 0x7f0384003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 --2- 172.21.15.81:0/3984667352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0384004800 0x7f0384004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 --2- 172.21.15.81:0/3984667352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03840051c0 0x7f038400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0398162b60 con 0x7f03840051c0 2024-09-16T01:15:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f038400c060 con 0x7f03840039b0 2024-09-16T01:15:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f038400c260 con 0x7f0384004800 2024-09-16T01:15:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f039caae640 1 --2- 172.21.15.81:0/3984667352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03840051c0 0x7f038400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f038ffff640 1 --2- 172.21.15.81:0/3984667352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0384004800 0x7f0384004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f0397fff640 1 --2- 172.21.15.81:0/3984667352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03840039b0 0x7f0384003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f039caae640 1 -- 172.21.15.81:0/3984667352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0384004800 msgr2=0x7f0384004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f039caae640 1 --2- 172.21.15.81:0/3984667352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0384004800 0x7f0384004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f039caae640 1 -- 172.21.15.81:0/3984667352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03840039b0 msgr2=0x7f0384003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.660+0000 7f039caae640 1 --2- 172.21.15.81:0/3984667352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03840039b0 0x7f0384003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.661+0000 7f039caae640 1 -- 172.21.15.81:0/3984667352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0384003520 con 0x7f03840051c0 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.661+0000 7f039caae640 1 -- 172.21.15.81:0/3984667352 reap_dead start 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.661+0000 7f039caae640 1 --2- 172.21.15.81:0/3984667352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03840051c0 0x7f038400b9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f039000a8f0 tx=0x7f0384005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722a108e86a3720a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.661+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039000a4c0 con 0x7f03840051c0 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.661+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f039002f070 con 0x7f03840051c0 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.661+0000 7f03977fe640 1 -- 172.21.15.81:0/3984667352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039002bcb0 con 0x7f03840051c0 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.662+0000 7f039e511640 1 -- 172.21.15.81:0/3984667352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03840051c0 msgr2=0x7f038400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.662+0000 7f039e511640 1 --2- 172.21.15.81:0/3984667352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03840051c0 0x7f038400b9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f039000a8f0 tx=0x7f0384005830 comp rx=0 tx=0).stop 2024-09-16T01:15:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.662+0000 7f039e511640 1 -- 172.21.15.81:0/3984667352 shutdown_connections 2024-09-16T01:15:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.662+0000 7f039e511640 1 --2- 172.21.15.81:0/3984667352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03840051c0 0x7f038400b9c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.662+0000 7f039e511640 1 -- 172.21.15.81:0/3984667352 >> 172.21.15.81:0/3984667352 conn(0x7f039808bfc0 msgr2=0x7f03980d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.662+0000 7f039e511640 1 -- 172.21.15.81:0/3984667352 shutdown_connections 2024-09-16T01:15:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.662+0000 7f039e511640 1 -- 172.21.15.81:0/3984667352 wait complete. 2024-09-16T01:15:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.663+0000 7f039e511640 1 Processor -- start 2024-09-16T01:15:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.663+0000 7f039e511640 1 -- start start 2024-09-16T01:15:36.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f039e511640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03840051c0 0x7f039815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f039e511640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03980b3ba0 0x7f03981f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f039e511640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03980b62e0 0x7f03980b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f039e511640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f039815e9b0 con 0x7f03980b3ba0 2024-09-16T01:15:36.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f039e511640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03980b1490 con 0x7f03980b62e0 2024-09-16T01:15:36.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f039e511640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f039815eb30 con 0x7f03840051c0 2024-09-16T01:15:36.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f038ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03980b3ba0 0x7f03981f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f038ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03980b3ba0 0x7f03981f4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41062/0 (socket says 172.21.15.81:41062) 2024-09-16T01:15:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f038ffff640 1 -- 172.21.15.81:0/2702188815 learned_addr learned my addr 172.21.15.81:0/2702188815 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f0397fff640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03840051c0 0x7f039815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f039caae640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03980b62e0 0x7f03980b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f038ffff640 1 -- 172.21.15.81:0/2702188815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03840051c0 msgr2=0x7f039815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f038ffff640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03840051c0 0x7f039815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f038ffff640 1 -- 172.21.15.81:0/2702188815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03980b62e0 msgr2=0x7f03980b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f038ffff640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03980b62e0 0x7f03980b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f038ffff640 1 -- 172.21.15.81:0/2702188815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03980b4020 con 0x7f03980b3ba0 2024-09-16T01:15:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f038ffff640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03980b3ba0 0x7f03981f4b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f03800118e0 tx=0x7f0380011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f03957fa640 1 -- 172.21.15.81:0/2702188815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038000faf0 con 0x7f03980b3ba0 2024-09-16T01:15:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f03957fa640 1 -- 172.21.15.81:0/2702188815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f038000fc90 con 0x7f03980b3ba0 2024-09-16T01:15:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f039e511640 1 -- 172.21.15.81:0/2702188815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03981f5060 con 0x7f03980b3ba0 2024-09-16T01:15:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.664+0000 7f03957fa640 1 -- 172.21.15.81:0/2702188815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380014440 con 0x7f03980b3ba0 2024-09-16T01:15:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.665+0000 7f039e511640 1 -- 172.21.15.81:0/2702188815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03980cd4e0 con 0x7f03980b3ba0 2024-09-16T01:15:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.665+0000 7f039e511640 1 -- 172.21.15.81:0/2702188815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03981621b0 con 0x7f03980b3ba0 2024-09-16T01:15:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.666+0000 7f03957fa640 1 -- 172.21.15.81:0/2702188815 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0380012040 con 0x7f03980b3ba0 2024-09-16T01:15:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.666+0000 7f03957fa640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f037806c2e0 0x7f037806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.666+0000 7f03957fa640 1 -- 172.21.15.81:0/2702188815 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f038008b810 con 0x7f03980b3ba0 2024-09-16T01:15:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.666+0000 7f0397fff640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f037806c2e0 0x7f037806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.667+0000 7f0397fff640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f037806c2e0 0x7f037806e7a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0388000c00 tx=0x7f0388009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.671+0000 7f03957fa640 1 -- 172.21.15.81:0/2702188815 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03981f5060 con 0x7f03980b3ba0 2024-09-16T01:15:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:36.838+0000 7f039e511640 1 -- 172.21.15.81:0/2702188815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f03980ba460 con 0x7f03980b3ba0 2024-09-16T01:15:37.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:15:37.681 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:15:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.689+0000 7f03957fa640 1 -- 172.21.15.81:0/2702188815 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f03980b4020 con 0x7f03980b3ba0 2024-09-16T01:15:37.691 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-16T01:15:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.693+0000 7f039e511640 1 -- 172.21.15.81:0/2702188815 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f037806c2e0 msgr2=0x7f037806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.693+0000 7f039e511640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f037806c2e0 0x7f037806e7a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0388000c00 tx=0x7f0388009040 comp rx=0 tx=0).stop 2024-09-16T01:15:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.694+0000 7f039e511640 1 -- 172.21.15.81:0/2702188815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03980b3ba0 msgr2=0x7f03981f4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.694+0000 7f039e511640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03980b3ba0 0x7f03981f4b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f03800118e0 tx=0x7f0380011da0 comp rx=0 tx=0).stop 2024-09-16T01:15:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.694+0000 7f039e511640 1 -- 172.21.15.81:0/2702188815 shutdown_connections 2024-09-16T01:15:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.694+0000 7f039e511640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f037806c2e0 0x7f037806e7a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.694+0000 7f039e511640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03980b62e0 0x7f03980b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:37.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.694+0000 7f039e511640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03980b3ba0 0x7f03981f4b20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.694+0000 7f039e511640 1 --2- 172.21.15.81:0/2702188815 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03840051c0 0x7f039815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.694+0000 7f039e511640 1 -- 172.21.15.81:0/2702188815 >> 172.21.15.81:0/2702188815 conn(0x7f039808bfc0 msgr2=0x7f039806daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.695+0000 7f039e511640 1 -- 172.21.15.81:0/2702188815 shutdown_connections 2024-09-16T01:15:37.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.696+0000 7f039e511640 1 -- 172.21.15.81:0/2702188815 wait complete. 2024-09-16T01:15:37.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-16T01:15:37.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.864+0000 7f61dd4d0640 1 Processor -- start 2024-09-16T01:15:37.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.864+0000 7f61dd4d0640 1 -- start start 2024-09-16T01:15:37.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.865+0000 7f61dd4d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f61d8162e30 0x7f61d806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:37.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.865+0000 7f61dd4d0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61d80cf280 0x7f61d80d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:37.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.865+0000 7f61dd4d0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d815ff70 con 0x7f61d8162340 2024-09-16T01:15:37.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.865+0000 7f61dd4d0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f61d806de90 con 0x7f61d8162e30 2024-09-16T01:15:37.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.865+0000 7f61dd4d0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f61d8163270 con 0x7f61d80cf280 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.865+0000 7f61d6ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f61d8162340 0x7f61d8162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54434/0 (socket says 172.21.15.81:54434) 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.865+0000 7f61d6ffd640 1 -- 172.21.15.81:0/3900771603 learned_addr learned my addr 172.21.15.81:0/3900771603 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.865+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1144572201 0 0) 0x7f61d815ff70 con 0x7f61d8162340 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.865+0000 7f61ce7fc640 1 --2- 172.21.15.81:0/3900771603 >> v2:172.21.15.102:3300/0 conn(0x7f61d8162e30 0x7f61d806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.865+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61c4003520 con 0x7f61d8162340 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.865+0000 7f61d77fe640 1 --2- 172.21.15.81:0/3900771603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61d80cf280 0x7f61d80d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1398840479 0 0) 0x7f61c4003520 con 0x7f61d8162340 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61d80cf280 msgr2=0x7f61d80d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 --2- 172.21.15.81:0/3900771603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61d80cf280 0x7f61d80d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 >> v2:172.21.15.102:3300/0 conn(0x7f61d8162e30 msgr2=0x7f61d806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 --2- 172.21.15.81:0/3900771603 >> v2:172.21.15.102:3300/0 conn(0x7f61d8162e30 0x7f61d806d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d80d4d10 con 0x7f61d8162340 2024-09-16T01:15:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f61c8001670 con 0x7f61d8162340 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 >> v1:172.21.15.81:6789/0 conn(0x7f61d8162340 legacy=0x7f61d8162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 --2- 172.21.15.81:0/3900771603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61d80cf280 0x7f61c40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 --2- 172.21.15.81:0/3900771603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c4003f30 0x7f61c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 --2- 172.21.15.81:0/3900771603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61c4004d40 0x7f61c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61d806de90 con 0x7f61c4003f30 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f61d8163270 con 0x7f61c4004d40 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f61c400ba10 con 0x7f61d80cf280 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61ce7fc640 1 --2- 172.21.15.81:0/3900771603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c4003f30 0x7f61c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d6ffd640 1 --2- 172.21.15.81:0/3900771603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61d80cf280 0x7f61c40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61d77fe640 1 --2- 172.21.15.81:0/3900771603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61c4004d40 0x7f61c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61ce7fc640 1 -- 172.21.15.81:0/3900771603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61d80cf280 msgr2=0x7f61c40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61ce7fc640 1 --2- 172.21.15.81:0/3900771603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61d80cf280 0x7f61c40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:37.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61ce7fc640 1 -- 172.21.15.81:0/3900771603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61c4004d40 msgr2=0x7f61c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61ce7fc640 1 --2- 172.21.15.81:0/3900771603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61c4004d40 0x7f61c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.866+0000 7f61ce7fc640 1 -- 172.21.15.81:0/3900771603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c4003520 con 0x7f61c4003f30 2024-09-16T01:15:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.867+0000 7f61ce7fc640 1 --2- 172.21.15.81:0/3900771603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c4003f30 0x7f61c4004800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009ae0 tx=0x7f61c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c089dc9e34648b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.867+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0036070 con 0x7f61c4003f30 2024-09-16T01:15:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.867+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c0005990 con 0x7f61c4003f30 2024-09-16T01:15:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.867+0000 7f61d67fc640 1 -- 172.21.15.81:0/3900771603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0009680 con 0x7f61c4003f30 2024-09-16T01:15:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.867+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3900771603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c4003f30 msgr2=0x7f61c4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.867+0000 7f61dd4d0640 1 --2- 172.21.15.81:0/3900771603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c4003f30 0x7f61c4004800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009ae0 tx=0x7f61c4005830 comp rx=0 tx=0).stop 2024-09-16T01:15:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.867+0000 7f61d77fe640 1 -- 172.21.15.81:0/3900771603 reap_dead start 2024-09-16T01:15:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.867+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3900771603 shutdown_connections 2024-09-16T01:15:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.867+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3900771603 >> 172.21.15.81:0/3900771603 conn(0x7f61d808bfc0 msgr2=0x7f61d80d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:37.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.867+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3900771603 shutdown_connections 2024-09-16T01:15:37.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.868+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3900771603 wait complete. 2024-09-16T01:15:37.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.869+0000 7f61dd4d0640 1 Processor -- start 2024-09-16T01:15:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.869+0000 7f61dd4d0640 1 -- start start 2024-09-16T01:15:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61dd4d0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61c4003f30 0x7f61d815a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61dd4d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d81f5410 0x7f61d80ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61dd4d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d81f5890 0x7f61d815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61dd4d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61d80cf710 con 0x7f61d81f5890 2024-09-16T01:15:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61dd4d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f61d80d2470 con 0x7f61d81f5410 2024-09-16T01:15:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61dd4d0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f61d80d52d0 con 0x7f61c4003f30 2024-09-16T01:15:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61d77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d81f5890 0x7f61d815e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61d77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d81f5890 0x7f61d815e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41080/0 (socket says 172.21.15.81:41080) 2024-09-16T01:15:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61d77fe640 1 -- 172.21.15.81:0/3494461148 learned_addr learned my addr 172.21.15.81:0/3494461148 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61d6ffd640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61c4003f30 0x7f61d815a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:37.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61ce7fc640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d81f5410 0x7f61d80ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61d77fe640 1 -- 172.21.15.81:0/3494461148 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61c4003f30 msgr2=0x7f61d815a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61d77fe640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61c4003f30 0x7f61d815a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61d77fe640 1 -- 172.21.15.81:0/3494461148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d81f5410 msgr2=0x7f61d80ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61d77fe640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d81f5410 0x7f61d80ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61d77fe640 1 -- 172.21.15.81:0/3494461148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d80b7300 con 0x7f61d81f5890 2024-09-16T01:15:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61ce7fc640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d81f5410 0x7f61d80ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61d6ffd640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61c4003f30 0x7f61d815a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61d77fe640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d81f5890 0x7f61d815e570 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f61d808e190 tx=0x7f61d000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61cffff640 1 -- 172.21.15.81:0/3494461148 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d000fd80 con 0x7f61d81f5890 2024-09-16T01:15:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61cffff640 1 -- 172.21.15.81:0/3494461148 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d001d070 con 0x7f61d81f5890 2024-09-16T01:15:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3494461148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d80b75e0 con 0x7f61d81f5890 2024-09-16T01:15:37.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61cffff640 1 -- 172.21.15.81:0/3494461148 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d0015670 con 0x7f61d81f5890 2024-09-16T01:15:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.870+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3494461148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d80b7ba0 con 0x7f61d81f5890 2024-09-16T01:15:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.871+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3494461148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d80cedf0 con 0x7f61d81f5890 2024-09-16T01:15:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.872+0000 7f61cffff640 1 -- 172.21.15.81:0/3494461148 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f61d0015810 con 0x7f61d81f5890 2024-09-16T01:15:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.872+0000 7f61cffff640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61b806c2e0 0x7f61b806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.872+0000 7f61d6ffd640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61b806c2e0 0x7f61b806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.872+0000 7f61cffff640 1 -- 172.21.15.81:0/3494461148 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f61d008ba80 con 0x7f61d81f5890 2024-09-16T01:15:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.873+0000 7f61d6ffd640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61b806c2e0 0x7f61b806e7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f61d815f130 tx=0x7f61c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:37.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:37.877+0000 7f61cffff640 1 -- 172.21.15.81:0/3494461148 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61d80cedf0 con 0x7f61d81f5890 2024-09-16T01:15:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.047+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3494461148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f61d806dc10 con 0x7f61d81f5890 2024-09-16T01:15:38.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.696+0000 7f61cffff640 1 -- 172.21.15.81:0/3494461148 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f61d806dc10 con 0x7f61d81f5890 2024-09-16T01:15:38.698 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-16T01:15:38.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.698+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3494461148 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61b806c2e0 msgr2=0x7f61b806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:38.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.698+0000 7f61dd4d0640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61b806c2e0 0x7f61b806e7a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f61d815f130 tx=0x7f61c8009040 comp rx=0 tx=0).stop 2024-09-16T01:15:38.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.698+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3494461148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d81f5890 msgr2=0x7f61d815e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:38.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.698+0000 7f61dd4d0640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d81f5890 0x7f61d815e570 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f61d808e190 tx=0x7f61d000f580 comp rx=0 tx=0).stop 2024-09-16T01:15:38.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.698+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3494461148 shutdown_connections 2024-09-16T01:15:38.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.698+0000 7f61dd4d0640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61b806c2e0 0x7f61b806e7a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:38.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.698+0000 7f61dd4d0640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d81f5890 0x7f61d815e570 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:38.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.698+0000 7f61dd4d0640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d81f5410 0x7f61d80ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:38.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.698+0000 7f61dd4d0640 1 --2- 172.21.15.81:0/3494461148 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61c4003f30 0x7f61d815a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:38.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.698+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3494461148 >> 172.21.15.81:0/3494461148 conn(0x7f61d808bfc0 msgr2=0x7f61d8162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:38.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.699+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3494461148 shutdown_connections 2024-09-16T01:15:38.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.699+0000 7f61dd4d0640 1 -- 172.21.15.81:0/3494461148 wait complete. 2024-09-16T01:15:38.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:15:38.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.821+0000 7f5feb874640 1 Processor -- start 2024-09-16T01:15:38.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.822+0000 7f5feb874640 1 -- start start 2024-09-16T01:15:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.822+0000 7f5feb874640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe415fff0 0x7f5fe40d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.822+0000 7f5feb874640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe4160430 con 0x7f5fe40d09c0 2024-09-16T01:15:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.822+0000 7f5feb874640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fe40d1040 con 0x7f5fe41621f0 2024-09-16T01:15:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5feb874640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe40702f0 con 0x7f5fe415fff0 2024-09-16T01:15:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe9e11640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5fe40d09c0 0x7f5fe4070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54448/0 (socket says 172.21.15.81:54448) 2024-09-16T01:15:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe9e11640 1 -- 172.21.15.81:0/3165593278 learned_addr learned my addr 172.21.15.81:0/3165593278 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe8e0f640 1 --2- 172.21.15.81:0/3165593278 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe415fff0 0x7f5fe40d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3311434214 0 0) 0x7f5fe4160430 con 0x7f5fe40d09c0 2024-09-16T01:15:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fcc003520 con 0x7f5fe40d09c0 2024-09-16T01:15:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 977371394 0 0) 0x7f5fcc003520 con 0x7f5fe40d09c0 2024-09-16T01:15:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe415fff0 msgr2=0x7f5fe40d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:38.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 --2- 172.21.15.81:0/3165593278 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe415fff0 0x7f5fe40d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 >> v1:172.21.15.102:6789/0 conn(0x7f5fe41621f0 legacy=0x7f5fe41625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe40d1320 con 0x7f5fe40d09c0 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f5fdc0019f0 con 0x7f5fe40d09c0 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 >> v1:172.21.15.81:6789/0 conn(0x7f5fe40d09c0 legacy=0x7f5fe4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 --2- 172.21.15.81:0/3165593278 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe415fff0 0x7f5fcc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 --2- 172.21.15.81:0/3165593278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fcc003f20 0x7f5fcc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 --2- 172.21.15.81:0/3165593278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fcc004d40 0x7f5fcc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe40702f0 con 0x7f5fcc004d40 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5fcc00ba20 con 0x7f5fcc003f20 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5fcc00bc20 con 0x7f5fe415fff0 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe9e11640 1 --2- 172.21.15.81:0/3165593278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fcc004d40 0x7f5fcc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe9610640 1 --2- 172.21.15.81:0/3165593278 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe415fff0 0x7f5fcc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:38.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.823+0000 7f5fe8e0f640 1 --2- 172.21.15.81:0/3165593278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fcc003f20 0x7f5fcc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.824+0000 7f5fe9e11640 1 -- 172.21.15.81:0/3165593278 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe415fff0 msgr2=0x7f5fcc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.824+0000 7f5fe9e11640 1 --2- 172.21.15.81:0/3165593278 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe415fff0 0x7f5fcc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.824+0000 7f5fe9e11640 1 -- 172.21.15.81:0/3165593278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fcc003f20 msgr2=0x7f5fcc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.824+0000 7f5fe9e11640 1 --2- 172.21.15.81:0/3165593278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fcc003f20 0x7f5fcc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.824+0000 7f5fe9e11640 1 -- 172.21.15.81:0/3165593278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fcc003520 con 0x7f5fcc004d40 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.824+0000 7f5fe9e11640 1 --2- 172.21.15.81:0/3165593278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fcc004d40 0x7f5fcc0051c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00a810 tx=0x7f5fcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d95a93342db02b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.824+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc00a430 con 0x7f5fcc004d40 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.824+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc02f070 con 0x7f5fcc004d40 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.824+0000 7f5fe3fff640 1 -- 172.21.15.81:0/3165593278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc02bc90 con 0x7f5fcc004d40 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.825+0000 7f5feb874640 1 -- 172.21.15.81:0/3165593278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fcc004d40 msgr2=0x7f5fcc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.825+0000 7f5feb874640 1 --2- 172.21.15.81:0/3165593278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fcc004d40 0x7f5fcc0051c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00a810 tx=0x7f5fcc005830 comp rx=0 tx=0).stop 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.825+0000 7f5fe9e11640 1 -- 172.21.15.81:0/3165593278 reap_dead start 2024-09-16T01:15:38.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.825+0000 7f5feb874640 1 -- 172.21.15.81:0/3165593278 shutdown_connections 2024-09-16T01:15:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.825+0000 7f5feb874640 1 -- 172.21.15.81:0/3165593278 >> 172.21.15.81:0/3165593278 conn(0x7f5fe40b3de0 msgr2=0x7f5fe40b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.825+0000 7f5feb874640 1 -- 172.21.15.81:0/3165593278 shutdown_connections 2024-09-16T01:15:38.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.825+0000 7f5feb874640 1 -- 172.21.15.81:0/3165593278 wait complete. 2024-09-16T01:15:38.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.826+0000 7f5feb874640 1 Processor -- start 2024-09-16T01:15:38.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.826+0000 7f5feb874640 1 -- start start 2024-09-16T01:15:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5feb874640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fcc004d40 0x7f5fe40b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5feb874640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe40b6790 0x7f5fe40c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5feb874640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fe406dcf0 0x7f5fe406e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5feb874640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe4163050 con 0x7f5fe406dcf0 2024-09-16T01:15:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5feb874640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe4162ed0 con 0x7f5fcc004d40 2024-09-16T01:15:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5feb874640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe415f960 con 0x7f5fe40b6790 2024-09-16T01:15:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5fe9e11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fe406dcf0 0x7f5fe406e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5fe9e11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fe406dcf0 0x7f5fe406e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41098/0 (socket says 172.21.15.81:41098) 2024-09-16T01:15:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5fe9e11640 1 -- 172.21.15.81:0/918138514 learned_addr learned my addr 172.21.15.81:0/918138514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5fe8e0f640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe40b6790 0x7f5fe40c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5fe9610640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fcc004d40 0x7f5fe40b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:38.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5fe9e11640 1 -- 172.21.15.81:0/918138514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe40b6790 msgr2=0x7f5fe40c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5fe9e11640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe40b6790 0x7f5fe40c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5fe9e11640 1 -- 172.21.15.81:0/918138514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fcc004d40 msgr2=0x7f5fe40b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5fe9e11640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fcc004d40 0x7f5fe40b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5fe9e11640 1 -- 172.21.15.81:0/918138514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe40b6ee0 con 0x7f5fe406dcf0 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.827+0000 7f5fe8e0f640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe40b6790 0x7f5fe40c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.828+0000 7f5fe9e11640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fe406dcf0 0x7f5fe406e170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00a930 tx=0x7f5fdc001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.828+0000 7f5fe1ffb640 1 -- 172.21.15.81:0/918138514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc044070 con 0x7f5fe406dcf0 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.828+0000 7f5fe1ffb640 1 -- 172.21.15.81:0/918138514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fdc034470 con 0x7f5fe406dcf0 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.828+0000 7f5feb874640 1 -- 172.21.15.81:0/918138514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe40af1d0 con 0x7f5fe406dcf0 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.828+0000 7f5fe1ffb640 1 -- 172.21.15.81:0/918138514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc00a430 con 0x7f5fe406dcf0 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.828+0000 7f5feb874640 1 -- 172.21.15.81:0/918138514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe40af790 con 0x7f5fe406dcf0 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.829+0000 7f5feb874640 1 -- 172.21.15.81:0/918138514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe40d1040 con 0x7f5fe406dcf0 2024-09-16T01:15:38.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.829+0000 7f5fe1ffb640 1 -- 172.21.15.81:0/918138514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5fdc047070 con 0x7f5fe406dcf0 2024-09-16T01:15:38.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.830+0000 7f5fe1ffb640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5fd006c2b0 0x7f5fd006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:38.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.830+0000 7f5fe1ffb640 1 -- 172.21.15.81:0/918138514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f5fdc0ab110 con 0x7f5fe406dcf0 2024-09-16T01:15:38.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.830+0000 7f5fe9610640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5fd006c2b0 0x7f5fd006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:38.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.830+0000 7f5fe9610640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5fd006c2b0 0x7f5fd006e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4001940 tx=0x7f5fd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:38.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:38.834+0000 7f5fe1ffb640 1 -- 172.21.15.81:0/918138514 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5fe40b6ee0 con 0x7f5fe406dcf0 2024-09-16T01:15:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.035+0000 7f5feb874640 1 -- 172.21.15.81:0/918138514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5fe40c9130 con 0x7f5fe406dcf0 2024-09-16T01:15:39.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.698+0000 7f5fe1ffb640 1 -- 172.21.15.81:0/918138514 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f5fdc079350 con 0x7f5fe406dcf0 2024-09-16T01:15:39.700 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-09-16T01:15:39.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.700+0000 7f5feb874640 1 -- 172.21.15.81:0/918138514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5fd006c2b0 msgr2=0x7f5fd006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:39.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.700+0000 7f5feb874640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5fd006c2b0 0x7f5fd006e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4001940 tx=0x7f5fd4009040 comp rx=0 tx=0).stop 2024-09-16T01:15:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.700+0000 7f5feb874640 1 -- 172.21.15.81:0/918138514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fe406dcf0 msgr2=0x7f5fe406e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.700+0000 7f5feb874640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fe406dcf0 0x7f5fe406e170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc00a930 tx=0x7f5fdc001d40 comp rx=0 tx=0).stop 2024-09-16T01:15:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.700+0000 7f5feb874640 1 -- 172.21.15.81:0/918138514 shutdown_connections 2024-09-16T01:15:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.700+0000 7f5feb874640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5fd006c2b0 0x7f5fd006e770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.700+0000 7f5feb874640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fe406dcf0 0x7f5fe406e170 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.700+0000 7f5feb874640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5fe40b6790 0x7f5fe40c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.700+0000 7f5feb874640 1 --2- 172.21.15.81:0/918138514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fcc004d40 0x7f5fe40b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.700+0000 7f5feb874640 1 -- 172.21.15.81:0/918138514 >> 172.21.15.81:0/918138514 conn(0x7f5fe40b3de0 msgr2=0x7f5fe415e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.701+0000 7f5feb874640 1 -- 172.21.15.81:0/918138514 shutdown_connections 2024-09-16T01:15:39.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.701+0000 7f5feb874640 1 -- 172.21.15.81:0/918138514 wait complete. 2024-09-16T01:15:39.721 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-16T01:15:39.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-16T01:15:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.828+0000 7facffde4640 1 Processor -- start 2024-09-16T01:15:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.828+0000 7facffde4640 1 -- start start 2024-09-16T01:15:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.829+0000 7facffde4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facf8156940 0x7facf815d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.829+0000 7facffde4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf815d7d0 con 0x7facf806fa90 2024-09-16T01:15:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.829+0000 7facffde4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf806e9f0 con 0x7facf80b6620 2024-09-16T01:15:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.829+0000 7facffde4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7facf8156d20 con 0x7facf8156940 2024-09-16T01:15:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.829+0000 7facfdb80640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facf8156940 0x7facf815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.829+0000 7facfd37f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7facf806fa90 0x7facf80b5f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54454/0 (socket says 172.21.15.81:54454) 2024-09-16T01:15:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.829+0000 7facfdb80640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facf8156940 0x7facf815d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41102/0 (socket says 172.21.15.81:41102) 2024-09-16T01:15:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.829+0000 7facfd37f640 1 -- 172.21.15.81:0/4211351606 learned_addr learned my addr 172.21.15.81:0/4211351606 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.830+0000 7facfdb80640 1 -- 172.21.15.81:0/4211351606 >> v1:172.21.15.102:6789/0 conn(0x7facf80b6620 legacy=0x7facf815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.830+0000 7facfdb80640 1 -- 172.21.15.81:0/4211351606 >> v1:172.21.15.81:6789/0 conn(0x7facf806fa90 legacy=0x7facf80b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.830+0000 7facfdb80640 1 -- 172.21.15.81:0/4211351606 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf806ecd0 con 0x7facf8156940 2024-09-16T01:15:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.830+0000 7facfcb7e640 1 -- 172.21.15.81:0/4211351606 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4061783758 0 0) 0x7facec001110 con 0x7facf806fa90 2024-09-16T01:15:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.830+0000 7facfdb80640 1 --2- 172.21.15.81:0/4211351606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf8156940 0x7facf815d290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7face8009d90 tx=0x7face802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c16399abdeacc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.830+0000 7facfcb7e640 1 -- 172.21.15.81:0/4211351606 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8007740 con 0x7facf8156940 2024-09-16T01:15:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.831+0000 7facfcb7e640 1 -- 172.21.15.81:0/4211351606 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face80078e0 con 0x7facf8156940 2024-09-16T01:15:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.831+0000 7facfcb7e640 1 -- 172.21.15.81:0/4211351606 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8007cb0 con 0x7facf8156940 2024-09-16T01:15:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.831+0000 7facffde4640 1 -- 172.21.15.81:0/4211351606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf8156940 msgr2=0x7facf815d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.831+0000 7facffde4640 1 --2- 172.21.15.81:0/4211351606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf8156940 0x7facf815d290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7face8009d90 tx=0x7face802a6a0 comp rx=0 tx=0).stop 2024-09-16T01:15:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.831+0000 7facffde4640 1 -- 172.21.15.81:0/4211351606 shutdown_connections 2024-09-16T01:15:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.831+0000 7facffde4640 1 --2- 172.21.15.81:0/4211351606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf8156940 0x7facf815d290 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.831+0000 7facffde4640 1 -- 172.21.15.81:0/4211351606 >> 172.21.15.81:0/4211351606 conn(0x7facf8073590 msgr2=0x7facf806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.831+0000 7facffde4640 1 -- 172.21.15.81:0/4211351606 shutdown_connections 2024-09-16T01:15:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.831+0000 7facffde4640 1 -- 172.21.15.81:0/4211351606 wait complete. 2024-09-16T01:15:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.832+0000 7facffde4640 1 Processor -- start 2024-09-16T01:15:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.832+0000 7facffde4640 1 -- start start 2024-09-16T01:15:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facffde4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7facf806fa90 0x7facf8153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facffde4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf80b6620 0x7facf814c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facffde4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facf8156940 0x7facf814c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facffde4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7facf806f570 con 0x7facf80b6620 2024-09-16T01:15:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facffde4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7facf806f290 con 0x7facf8156940 2024-09-16T01:15:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facffde4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7facf806e6c0 con 0x7facf806fa90 2024-09-16T01:15:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facfd37f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf80b6620 0x7facf814c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facfd37f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf80b6620 0x7facf814c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41104/0 (socket says 172.21.15.81:41104) 2024-09-16T01:15:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facfd37f640 1 -- 172.21.15.81:0/130860709 learned_addr learned my addr 172.21.15.81:0/130860709 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facfe381640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facf8156940 0x7facf814c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facfdb80640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7facf806fa90 0x7facf8153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facfd37f640 1 -- 172.21.15.81:0/130860709 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7facf806fa90 msgr2=0x7facf8153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facfd37f640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7facf806fa90 0x7facf8153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facfd37f640 1 -- 172.21.15.81:0/130860709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facf8156940 msgr2=0x7facf814c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facfd37f640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facf8156940 0x7facf814c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facfd37f640 1 -- 172.21.15.81:0/130860709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf81561b0 con 0x7facf80b6620 2024-09-16T01:15:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facfe381640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facf8156940 0x7facf814c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.833+0000 7facfd37f640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf80b6620 0x7facf814c150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7facec00c780 tx=0x7facec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.834+0000 7facf67fc640 1 -- 172.21.15.81:0/130860709 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec018070 con 0x7facf80b6620 2024-09-16T01:15:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.834+0000 7facf67fc640 1 -- 172.21.15.81:0/130860709 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facec0072d0 con 0x7facf80b6620 2024-09-16T01:15:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.834+0000 7facffde4640 1 -- 172.21.15.81:0/130860709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf8159800 con 0x7facf80b6620 2024-09-16T01:15:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.834+0000 7facf67fc640 1 -- 172.21.15.81:0/130860709 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec0047e0 con 0x7facf80b6620 2024-09-16T01:15:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.834+0000 7facffde4640 1 -- 172.21.15.81:0/130860709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf8158d20 con 0x7facf80b6620 2024-09-16T01:15:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.835+0000 7facffde4640 1 -- 172.21.15.81:0/130860709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf8067ca0 con 0x7facf80b6620 2024-09-16T01:15:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.835+0000 7facf67fc640 1 -- 172.21.15.81:0/130860709 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7facec01b070 con 0x7facf80b6620 2024-09-16T01:15:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.836+0000 7facf67fc640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7face406c2b0 0x7face406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.836+0000 7facf67fc640 1 -- 172.21.15.81:0/130860709 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7facec08a7d0 con 0x7facf80b6620 2024-09-16T01:15:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.836+0000 7facfdb80640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7face406c2b0 0x7face406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.836+0000 7facfdb80640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7face406c2b0 0x7face406e770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7face8034000 tx=0x7face802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:39.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:39.840+0000 7facf67fc640 1 -- 172.21.15.81:0/130860709 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facf815d7d0 con 0x7facf80b6620 2024-09-16T01:15:40.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.014+0000 7facffde4640 1 -- 172.21.15.81:0/130860709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7facf815fb20 con 0x7facf80b6620 2024-09-16T01:15:40.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.700+0000 7facf67fc640 1 -- 172.21.15.81:0/130860709 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7facec058f40 con 0x7facf80b6620 2024-09-16T01:15:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.703+0000 7facffde4640 1 -- 172.21.15.81:0/130860709 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7face406c2b0 msgr2=0x7face406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.703+0000 7facffde4640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7face406c2b0 0x7face406e770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7face8034000 tx=0x7face802f000 comp rx=0 tx=0).stop 2024-09-16T01:15:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.703+0000 7facffde4640 1 -- 172.21.15.81:0/130860709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf80b6620 msgr2=0x7facf814c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.703+0000 7facffde4640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf80b6620 0x7facf814c150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7facec00c780 tx=0x7facec00cc40 comp rx=0 tx=0).stop 2024-09-16T01:15:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.703+0000 7facffde4640 1 -- 172.21.15.81:0/130860709 shutdown_connections 2024-09-16T01:15:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.703+0000 7facffde4640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7face406c2b0 0x7face406e770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.703+0000 7facffde4640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facf8156940 0x7facf814c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.703+0000 7facffde4640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf80b6620 0x7facf814c150 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.703+0000 7facffde4640 1 --2- 172.21.15.81:0/130860709 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7facf806fa90 0x7facf8153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.703+0000 7facffde4640 1 -- 172.21.15.81:0/130860709 >> 172.21.15.81:0/130860709 conn(0x7facf8073590 msgr2=0x7facf80b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.703+0000 7facffde4640 1 -- 172.21.15.81:0/130860709 shutdown_connections 2024-09-16T01:15:40.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.703+0000 7facffde4640 1 -- 172.21.15.81:0/130860709 wait complete. 2024-09-16T01:15:40.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:15:40.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.829+0000 7f34f1a23640 1 Processor -- start 2024-09-16T01:15:40.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.829+0000 7f34f1a23640 1 -- start start 2024-09-16T01:15:40.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34f1a23640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34ec162340 0x7f34ec06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34f1a23640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34ec0cf280 0x7f34ec162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34f1a23640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f34ec162c60 0x7f34ec0d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34f1a23640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f34ec06de90 con 0x7f34ec0cf280 2024-09-16T01:15:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34f1a23640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f34ec15ff70 con 0x7f34ec162c60 2024-09-16T01:15:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34f1a23640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f34ec0d4d10 con 0x7f34ec162340 2024-09-16T01:15:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34e3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34ec0cf280 0x7f34ec162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34e3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34ec0cf280 0x7f34ec162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41108/0 (socket says 172.21.15.81:41108) 2024-09-16T01:15:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34e3fff640 1 -- 172.21.15.81:0/531154289 learned_addr learned my addr 172.21.15.81:0/531154289 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34eaffd640 1 --2- 172.21.15.81:0/531154289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34ec162340 0x7f34ec06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34eb7fe640 1 --2- 172.21.15.81:0/531154289 >> v2:172.21.15.102:3300/0 conn(0x7f34ec162c60 0x7f34ec0d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34e3fff640 1 -- 172.21.15.81:0/531154289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34ec162340 msgr2=0x7f34ec06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34e3fff640 1 --2- 172.21.15.81:0/531154289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34ec162340 0x7f34ec06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34e3fff640 1 -- 172.21.15.81:0/531154289 >> v2:172.21.15.102:3300/0 conn(0x7f34ec162c60 msgr2=0x7f34ec0d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34e3fff640 1 --2- 172.21.15.81:0/531154289 >> v2:172.21.15.102:3300/0 conn(0x7f34ec162c60 0x7f34ec0d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34e3fff640 1 -- 172.21.15.81:0/531154289 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec0d4ff0 con 0x7f34ec0cf280 2024-09-16T01:15:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34eaffd640 1 --2- 172.21.15.81:0/531154289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34ec162340 0x7f34ec06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:15:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.830+0000 7f34eb7fe640 1 --2- 172.21.15.81:0/531154289 >> v2:172.21.15.102:3300/0 conn(0x7f34ec162c60 0x7f34ec0d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:15:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.831+0000 7f34e3fff640 1 --2- 172.21.15.81:0/531154289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec0cf280 0x7f34ec162720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0c7f30 tx=0x7f34d402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966167685014c381 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.831+0000 7f34ea7fc640 1 -- 172.21.15.81:0/531154289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4004030 con 0x7f34ec0cf280 2024-09-16T01:15:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.831+0000 7f34ea7fc640 1 -- 172.21.15.81:0/531154289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d40041d0 con 0x7f34ec0cf280 2024-09-16T01:15:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.831+0000 7f34ea7fc640 1 -- 172.21.15.81:0/531154289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4003610 con 0x7f34ec0cf280 2024-09-16T01:15:40.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.832+0000 7f34f1a23640 1 -- 172.21.15.81:0/531154289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec0cf280 msgr2=0x7f34ec162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:40.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.832+0000 7f34f1a23640 1 --2- 172.21.15.81:0/531154289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec0cf280 0x7f34ec162720 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0c7f30 tx=0x7f34d402a130 comp rx=0 tx=0).stop 2024-09-16T01:15:40.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.832+0000 7f34f1a23640 1 -- 172.21.15.81:0/531154289 shutdown_connections 2024-09-16T01:15:40.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.832+0000 7f34f1a23640 1 --2- 172.21.15.81:0/531154289 >> v2:172.21.15.102:3300/0 conn(0x7f34ec162c60 0x7f34ec0d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.832+0000 7f34f1a23640 1 --2- 172.21.15.81:0/531154289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec0cf280 0x7f34ec162720 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.832+0000 7f34f1a23640 1 --2- 172.21.15.81:0/531154289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34ec162340 0x7f34ec06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.832+0000 7f34f1a23640 1 -- 172.21.15.81:0/531154289 >> 172.21.15.81:0/531154289 conn(0x7f34ec08bfc0 msgr2=0x7f34ec0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.832+0000 7f34f1a23640 1 -- 172.21.15.81:0/531154289 shutdown_connections 2024-09-16T01:15:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.832+0000 7f34f1a23640 1 -- 172.21.15.81:0/531154289 wait complete. 2024-09-16T01:15:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.833+0000 7f34f1a23640 1 Processor -- start 2024-09-16T01:15:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.833+0000 7f34f1a23640 1 -- start start 2024-09-16T01:15:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34f1a23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec0cf280 0x7f34ec15c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34f1a23640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34ec162340 0x7f34ec1567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34f1a23640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34ec162c60 0x7f34ec1e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34f1a23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec0cf6c0 con 0x7f34ec0cf280 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34f1a23640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec0d52d0 con 0x7f34ec162c60 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34f1a23640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f34ec163110 con 0x7f34ec162340 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34eaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec0cf280 0x7f34ec15c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34eaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec0cf280 0x7f34ec15c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41122/0 (socket says 172.21.15.81:41122) 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34eaffd640 1 -- 172.21.15.81:0/351990083 learned_addr learned my addr 172.21.15.81:0/351990083 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34e3fff640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34ec162340 0x7f34ec1567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34eb7fe640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34ec162c60 0x7f34ec1e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34eaffd640 1 -- 172.21.15.81:0/351990083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34ec162340 msgr2=0x7f34ec1567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34eaffd640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34ec162340 0x7f34ec1567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34eaffd640 1 -- 172.21.15.81:0/351990083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34ec162c60 msgr2=0x7f34ec1e90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34eaffd640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34ec162c60 0x7f34ec1e90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34eaffd640 1 -- 172.21.15.81:0/351990083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec0b8580 con 0x7f34ec0cf280 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34eaffd640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec0cf280 0x7f34ec15c6f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00d800 tx=0x7f34dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34e8ff9640 1 -- 172.21.15.81:0/351990083 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc018070 con 0x7f34ec0cf280 2024-09-16T01:15:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34e8ff9640 1 -- 172.21.15.81:0/351990083 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34dc004030 con 0x7f34ec0cf280 2024-09-16T01:15:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34e8ff9640 1 -- 172.21.15.81:0/351990083 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc004400 con 0x7f34ec0cf280 2024-09-16T01:15:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34f1a23640 1 -- 172.21.15.81:0/351990083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34ec15cc30 con 0x7f34ec0cf280 2024-09-16T01:15:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.834+0000 7f34f1a23640 1 -- 172.21.15.81:0/351990083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34ec0b8b00 con 0x7f34ec0cf280 2024-09-16T01:15:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.835+0000 7f34f1a23640 1 -- 172.21.15.81:0/351990083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34ec162720 con 0x7f34ec0cf280 2024-09-16T01:15:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.836+0000 7f34e8ff9640 1 -- 172.21.15.81:0/351990083 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f34dc0096a0 con 0x7f34ec0cf280 2024-09-16T01:15:40.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.836+0000 7f34e8ff9640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f34cc06c2b0 0x7f34cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:40.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.836+0000 7f34e8ff9640 1 -- 172.21.15.81:0/351990083 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f34dc08b780 con 0x7f34ec0cf280 2024-09-16T01:15:40.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.836+0000 7f34e3fff640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f34cc06c2b0 0x7f34cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:40.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.837+0000 7f34e3fff640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f34cc06c2b0 0x7f34cc06e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34d4033000 tx=0x7f34d402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:40.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:40.841+0000 7f34e8ff9640 1 -- 172.21.15.81:0/351990083 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34dc059800 con 0x7f34ec0cf280 2024-09-16T01:15:41.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:41.008+0000 7f34f1a23640 1 -- 172.21.15.81:0/351990083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f34ec1e87b0 con 0x7f34ec0cf280 2024-09-16T01:15:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.734+0000 7f34e8ff9640 1 -- 172.21.15.81:0/351990083 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f34dc05db00 con 0x7f34ec0cf280 2024-09-16T01:15:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' created 2024-09-16T01:15:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.737+0000 7f34f1a23640 1 -- 172.21.15.81:0/351990083 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f34cc06c2b0 msgr2=0x7f34cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.737+0000 7f34f1a23640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f34cc06c2b0 0x7f34cc06e770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34d4033000 tx=0x7f34d402e000 comp rx=0 tx=0).stop 2024-09-16T01:15:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.737+0000 7f34f1a23640 1 -- 172.21.15.81:0/351990083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec0cf280 msgr2=0x7f34ec15c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.737+0000 7f34f1a23640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec0cf280 0x7f34ec15c6f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00d800 tx=0x7f34dc00dcc0 comp rx=0 tx=0).stop 2024-09-16T01:15:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.737+0000 7f34f1a23640 1 -- 172.21.15.81:0/351990083 shutdown_connections 2024-09-16T01:15:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.737+0000 7f34f1a23640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f34cc06c2b0 0x7f34cc06e770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.737+0000 7f34f1a23640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34ec162c60 0x7f34ec1e90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.737+0000 7f34f1a23640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34ec162340 0x7f34ec1567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.737+0000 7f34f1a23640 1 --2- 172.21.15.81:0/351990083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34ec0cf280 0x7f34ec15c6f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.737+0000 7f34f1a23640 1 -- 172.21.15.81:0/351990083 >> 172.21.15.81:0/351990083 conn(0x7f34ec08bfc0 msgr2=0x7f34ec161980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.738+0000 7f34f1a23640 1 -- 172.21.15.81:0/351990083 shutdown_connections 2024-09-16T01:15:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.738+0000 7f34f1a23640 1 -- 172.21.15.81:0/351990083 wait complete. 2024-09-16T01:15:42.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-16T01:15:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.864+0000 7f97fb62e640 1 Processor -- start 2024-09-16T01:15:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.864+0000 7f97fb62e640 1 -- start start 2024-09-16T01:15:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97fb62e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97f40d15f0 0x7f97f40cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97fb62e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97f40cf160 0x7f97f406d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97fb62e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97f40cf980 con 0x7f97f4161a20 2024-09-16T01:15:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97fb62e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f97f4161e00 con 0x7f97f40d15f0 2024-09-16T01:15:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97fb62e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f97f406d050 con 0x7f97f40cf160 2024-09-16T01:15:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97f8bc9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97f40d15f0 0x7f97f40cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97f8bc9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97f40d15f0 0x7f97f40cec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33524/0 (socket says 172.21.15.81:33524) 2024-09-16T01:15:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97f8bc9640 1 -- 172.21.15.81:0/4094568348 learned_addr learned my addr 172.21.15.81:0/4094568348 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97f9bcb640 1 --2- 172.21.15.81:0/4094568348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97f40cf160 0x7f97f406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97f8bc9640 1 -- 172.21.15.81:0/4094568348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97f40cf160 msgr2=0x7f97f406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97f8bc9640 1 --2- 172.21.15.81:0/4094568348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97f40cf160 0x7f97f406d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97f8bc9640 1 -- 172.21.15.81:0/4094568348 >> v1:172.21.15.102:6789/0 conn(0x7f97f4161a20 legacy=0x7f97f40d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.865+0000 7f97f8bc9640 1 -- 172.21.15.81:0/4094568348 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f40cfc20 con 0x7f97f40d15f0 2024-09-16T01:15:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.866+0000 7f97f8bc9640 1 --2- 172.21.15.81:0/4094568348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f40d15f0 0x7f97f40cec20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97f406c7d0 tx=0x7f97e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3817f9867bd5506 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.866+0000 7f97ebfff640 1 -- 172.21.15.81:0/4094568348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4037070 con 0x7f97f40d15f0 2024-09-16T01:15:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.866+0000 7f97ebfff640 1 -- 172.21.15.81:0/4094568348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e4032440 con 0x7f97f40d15f0 2024-09-16T01:15:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.866+0000 7f97ebfff640 1 -- 172.21.15.81:0/4094568348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4032810 con 0x7f97f40d15f0 2024-09-16T01:15:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.866+0000 7f97fb62e640 1 -- 172.21.15.81:0/4094568348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f40d15f0 msgr2=0x7f97f40cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.866+0000 7f97fb62e640 1 --2- 172.21.15.81:0/4094568348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f40d15f0 0x7f97f40cec20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f97f406c7d0 tx=0x7f97e402a1e0 comp rx=0 tx=0).stop 2024-09-16T01:15:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.866+0000 7f97fb62e640 1 -- 172.21.15.81:0/4094568348 shutdown_connections 2024-09-16T01:15:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.866+0000 7f97fb62e640 1 --2- 172.21.15.81:0/4094568348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97f40cf160 0x7f97f406d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.866+0000 7f97fb62e640 1 --2- 172.21.15.81:0/4094568348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f40d15f0 0x7f97f40cec20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.866+0000 7f97fb62e640 1 -- 172.21.15.81:0/4094568348 >> 172.21.15.81:0/4094568348 conn(0x7f97f409d850 msgr2=0x7f97f408bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.867+0000 7f97fb62e640 1 -- 172.21.15.81:0/4094568348 shutdown_connections 2024-09-16T01:15:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.867+0000 7f97fb62e640 1 -- 172.21.15.81:0/4094568348 wait complete. 2024-09-16T01:15:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.868+0000 7f97fb62e640 1 Processor -- start 2024-09-16T01:15:42.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.868+0000 7f97fb62e640 1 -- start start 2024-09-16T01:15:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.868+0000 7f97fb62e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97f40cf160 0x7f97f40b6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.868+0000 7f97fb62e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f40d15f0 0x7f97f415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.868+0000 7f97fb62e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97f4161a20 0x7f97f415d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.868+0000 7f97fb62e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97f40b1040 con 0x7f97f40d15f0 2024-09-16T01:15:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.868+0000 7f97fb62e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97f406d2f0 con 0x7f97f4161a20 2024-09-16T01:15:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.868+0000 7f97fb62e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f97f40cf590 con 0x7f97f40cf160 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.868+0000 7f97f8bc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f40d15f0 0x7f97f415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97f8bc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f40d15f0 0x7f97f415cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33538/0 (socket says 172.21.15.81:33538) 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97f8bc9640 1 -- 172.21.15.81:0/3234207235 learned_addr learned my addr 172.21.15.81:0/3234207235 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97f8bc9640 1 -- 172.21.15.81:0/3234207235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97f40cf160 msgr2=0x7f97f40b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97f93ca640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97f40cf160 0x7f97f40b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97f9bcb640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97f4161a20 0x7f97f415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97f8bc9640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97f40cf160 0x7f97f40b6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97f8bc9640 1 -- 172.21.15.81:0/3234207235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97f4161a20 msgr2=0x7f97f415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97f8bc9640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97f4161a20 0x7f97f415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97f8bc9640 1 -- 172.21.15.81:0/3234207235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f40b6a50 con 0x7f97f40d15f0 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97f93ca640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97f40cf160 0x7f97f40b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97f8bc9640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f40d15f0 0x7f97f415cf20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f97e402a220 tx=0x7f97e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97e9ffb640 1 -- 172.21.15.81:0/3234207235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4037040 con 0x7f97f40d15f0 2024-09-16T01:15:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97e9ffb640 1 -- 172.21.15.81:0/3234207235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97e4042070 con 0x7f97f40d15f0 2024-09-16T01:15:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97fb62e640 1 -- 172.21.15.81:0/3234207235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f41f8000 con 0x7f97f40d15f0 2024-09-16T01:15:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97e9ffb640 1 -- 172.21.15.81:0/3234207235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4030bb0 con 0x7f97f40d15f0 2024-09-16T01:15:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.869+0000 7f97fb62e640 1 -- 172.21.15.81:0/3234207235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f41f85c0 con 0x7f97f40d15f0 2024-09-16T01:15:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.870+0000 7f97fb62e640 1 -- 172.21.15.81:0/3234207235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f40cec20 con 0x7f97f40d15f0 2024-09-16T01:15:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.871+0000 7f97e9ffb640 1 -- 172.21.15.81:0/3234207235 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f97e4047460 con 0x7f97f40d15f0 2024-09-16T01:15:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.871+0000 7f97e9ffb640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f97d806c2b0 0x7f97d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.871+0000 7f97f93ca640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f97d806c2b0 0x7f97d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.871+0000 7f97e9ffb640 1 -- 172.21.15.81:0/3234207235 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f97e40ac430 con 0x7f97f40d15f0 2024-09-16T01:15:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.872+0000 7f97f93ca640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f97d806c2b0 0x7f97d806e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97f000a830 tx=0x7f97f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:42.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:42.876+0000 7f97e9ffb640 1 -- 172.21.15.81:0/3234207235 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f97e4045360 con 0x7f97f40d15f0 2024-09-16T01:15:43.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.040+0000 7f97fb62e640 1 -- 172.21.15.81:0/3234207235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f97f4161080 con 0x7f97f40d15f0 2024-09-16T01:15:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.739+0000 7f97e9ffb640 1 -- 172.21.15.81:0/3234207235 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f97e407a880 con 0x7f97f40d15f0 2024-09-16T01:15:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:set pool 4 allow_ec_overwrites to true 2024-09-16T01:15:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.742+0000 7f97fb62e640 1 -- 172.21.15.81:0/3234207235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f97d806c2b0 msgr2=0x7f97d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.742+0000 7f97fb62e640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f97d806c2b0 0x7f97d806e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97f000a830 tx=0x7f97f0008040 comp rx=0 tx=0).stop 2024-09-16T01:15:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.742+0000 7f97fb62e640 1 -- 172.21.15.81:0/3234207235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f40d15f0 msgr2=0x7f97f415cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.742+0000 7f97fb62e640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f40d15f0 0x7f97f415cf20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f97e402a220 tx=0x7f97e40046c0 comp rx=0 tx=0).stop 2024-09-16T01:15:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.742+0000 7f97fb62e640 1 -- 172.21.15.81:0/3234207235 shutdown_connections 2024-09-16T01:15:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.742+0000 7f97fb62e640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f97d806c2b0 0x7f97d806e770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.742+0000 7f97fb62e640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97f4161a20 0x7f97f415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.742+0000 7f97fb62e640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f40d15f0 0x7f97f415cf20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.742+0000 7f97fb62e640 1 --2- 172.21.15.81:0/3234207235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97f40cf160 0x7f97f40b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.742+0000 7f97fb62e640 1 -- 172.21.15.81:0/3234207235 >> 172.21.15.81:0/3234207235 conn(0x7f97f409d850 msgr2=0x7f97f40746d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.742+0000 7f97fb62e640 1 -- 172.21.15.81:0/3234207235 shutdown_connections 2024-09-16T01:15:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.742+0000 7f97fb62e640 1 -- 172.21.15.81:0/3234207235 wait complete. 2024-09-16T01:15:43.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-16T01:15:43.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.870+0000 7fc16979f640 1 Processor -- start 2024-09-16T01:15:43.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.870+0000 7fc16979f640 1 -- start start 2024-09-16T01:15:43.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.871+0000 7fc16979f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc16415e550 0x7fc16406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.871+0000 7fc16979f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1640b3400 0x7fc1640d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.871+0000 7fc16979f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc16406d270 con 0x7fc1640d2920 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.871+0000 7fc16979f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc1640d4a50 con 0x7fc1640b3400 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.871+0000 7fc16979f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc1640cf180 con 0x7fc16415e550 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.871+0000 7fc1637fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1640b3400 0x7fc1640d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.871+0000 7fc163fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc16415e550 0x7fc16406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.871+0000 7fc163fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc16415e550 0x7fc16406cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:34306/0 (socket says 172.21.15.81:34306) 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.871+0000 7fc1637fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1640b3400 0x7fc1640d1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:39196/0 (socket says 172.21.15.81:39196) 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.871+0000 7fc163fff640 1 -- 172.21.15.81:0/2758642584 learned_addr learned my addr 172.21.15.81:0/2758642584 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.871+0000 7fc168f9e640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc1640d2920 0x7fc1640cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:38508/0 (socket says 172.21.15.81:38508) 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.872+0000 7fc1637fe640 1 -- 172.21.15.81:0/2758642584 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc16415e550 msgr2=0x7fc16406cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.872+0000 7fc1637fe640 1 --2- 172.21.15.81:0/2758642584 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc16415e550 0x7fc16406cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.872+0000 7fc1637fe640 1 -- 172.21.15.81:0/2758642584 >> v1:172.21.15.102:6789/0 conn(0x7fc1640d2920 legacy=0x7fc1640cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.872+0000 7fc1637fe640 1 -- 172.21.15.81:0/2758642584 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1640cee50 con 0x7fc1640b3400 2024-09-16T01:15:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.872+0000 7fc162ffd640 1 -- 172.21.15.81:0/2758642584 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155835339 0 0) 0x7fc16406d270 con 0x7fc1640d2920 2024-09-16T01:15:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.872+0000 7fc163fff640 1 --2- 172.21.15.81:0/2758642584 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc16415e550 0x7fc16406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.873+0000 7fc1637fe640 1 --2- 172.21.15.81:0/2758642584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1640b3400 0x7fc1640d1f10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc1580097a0 tx=0x7fc15802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6893a401c7cf2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.873+0000 7fc162ffd640 1 -- 172.21.15.81:0/2758642584 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158037070 con 0x7fc1640b3400 2024-09-16T01:15:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.873+0000 7fc162ffd640 1 -- 172.21.15.81:0/2758642584 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15802adb0 con 0x7fc1640b3400 2024-09-16T01:15:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.873+0000 7fc162ffd640 1 -- 172.21.15.81:0/2758642584 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158032660 con 0x7fc1640b3400 2024-09-16T01:15:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.873+0000 7fc16979f640 1 -- 172.21.15.81:0/2758642584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1640b3400 msgr2=0x7fc1640d1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.873+0000 7fc16979f640 1 --2- 172.21.15.81:0/2758642584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1640b3400 0x7fc1640d1f10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc1580097a0 tx=0x7fc15802a060 comp rx=0 tx=0).stop 2024-09-16T01:15:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.873+0000 7fc16979f640 1 -- 172.21.15.81:0/2758642584 shutdown_connections 2024-09-16T01:15:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.873+0000 7fc16979f640 1 --2- 172.21.15.81:0/2758642584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1640b3400 0x7fc1640d1f10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.873+0000 7fc16979f640 1 --2- 172.21.15.81:0/2758642584 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc16415e550 0x7fc16406cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.873+0000 7fc16979f640 1 -- 172.21.15.81:0/2758642584 >> 172.21.15.81:0/2758642584 conn(0x7fc16408bfc0 msgr2=0x7fc1640d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.873+0000 7fc16979f640 1 -- 172.21.15.81:0/2758642584 shutdown_connections 2024-09-16T01:15:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.873+0000 7fc16979f640 1 -- 172.21.15.81:0/2758642584 wait complete. 2024-09-16T01:15:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.874+0000 7fc16979f640 1 Processor -- start 2024-09-16T01:15:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.875+0000 7fc16979f640 1 -- start start 2024-09-16T01:15:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.875+0000 7fc16979f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1640b3400 0x7fc16414b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.875+0000 7fc16979f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1640d2920 0x7fc1640c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.875+0000 7fc16979f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16415e550 0x7fc1640c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.875+0000 7fc16979f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc1640d2450 con 0x7fc16415e550 2024-09-16T01:15:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.875+0000 7fc16979f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc1640d4f80 con 0x7fc1640b3400 2024-09-16T01:15:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.875+0000 7fc16979f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc1640d2db0 con 0x7fc1640d2920 2024-09-16T01:15:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.875+0000 7fc168f9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16415e550 0x7fc1640c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc168f9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16415e550 0x7fc1640c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33544/0 (socket says 172.21.15.81:33544) 2024-09-16T01:15:43.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc168f9e640 1 -- 172.21.15.81:0/1034738645 learned_addr learned my addr 172.21.15.81:0/1034738645 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc163fff640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1640b3400 0x7fc16414b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc1637fe640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1640d2920 0x7fc1640c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc168f9e640 1 -- 172.21.15.81:0/1034738645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1640d2920 msgr2=0x7fc1640c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc168f9e640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1640d2920 0x7fc1640c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc168f9e640 1 -- 172.21.15.81:0/1034738645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1640b3400 msgr2=0x7fc16414b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc168f9e640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1640b3400 0x7fc16414b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc168f9e640 1 -- 172.21.15.81:0/1034738645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1641f40d0 con 0x7fc16415e550 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc168f9e640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16415e550 0x7fc1640c7f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00c7e0 tx=0x7fc15c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc160ff9640 1 -- 172.21.15.81:0/1034738645 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c018070 con 0x7fc16415e550 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc16979f640 1 -- 172.21.15.81:0/1034738645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1640caaf0 con 0x7fc16415e550 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc160ff9640 1 -- 172.21.15.81:0/1034738645 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c00a640 con 0x7fc16415e550 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc160ff9640 1 -- 172.21.15.81:0/1034738645 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00aa30 con 0x7fc16415e550 2024-09-16T01:15:43.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.876+0000 7fc16979f640 1 -- 172.21.15.81:0/1034738645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16415fa20 con 0x7fc16415e550 2024-09-16T01:15:43.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.877+0000 7fc16979f640 1 -- 172.21.15.81:0/1034738645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1640d3100 con 0x7fc16415e550 2024-09-16T01:15:43.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.878+0000 7fc160ff9640 1 -- 172.21.15.81:0/1034738645 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc15c00abd0 con 0x7fc16415e550 2024-09-16T01:15:43.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.878+0000 7fc160ff9640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc15006c2b0 0x7fc15006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:43.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.878+0000 7fc160ff9640 1 -- 172.21.15.81:0/1034738645 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fc15c08ae00 con 0x7fc16415e550 2024-09-16T01:15:43.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.878+0000 7fc163fff640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc15006c2b0 0x7fc15006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:43.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.878+0000 7fc163fff640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc15006c2b0 0x7fc15006e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc154006ca0 tx=0x7fc154009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:43.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:43.882+0000 7fc160ff9640 1 -- 172.21.15.81:0/1034738645 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc15c058b80 con 0x7fc16415e550 2024-09-16T01:15:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.090+0000 7fc16979f640 1 -- 172.21.15.81:0/1034738645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fc1640d18f0 con 0x7fc16415e550 2024-09-16T01:15:44.686 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-16T01:15:44.684+0000 7f709ecfb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:15:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.750+0000 7fc160ff9640 1 -- 172.21.15.81:0/1034738645 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7fc15c05ce80 con 0x7fc16415e550 2024-09-16T01:15:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:added data pool 4 to fsmap 2024-09-16T01:15:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.752+0000 7fc16979f640 1 -- 172.21.15.81:0/1034738645 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc15006c2b0 msgr2=0x7fc15006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.752+0000 7fc16979f640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc15006c2b0 0x7fc15006e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc154006ca0 tx=0x7fc154009240 comp rx=0 tx=0).stop 2024-09-16T01:15:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.752+0000 7fc16979f640 1 -- 172.21.15.81:0/1034738645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16415e550 msgr2=0x7fc1640c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:44.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.752+0000 7fc16979f640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16415e550 0x7fc1640c7f30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc15c00c7e0 tx=0x7fc15c00cca0 comp rx=0 tx=0).stop 2024-09-16T01:15:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.752+0000 7fc16979f640 1 -- 172.21.15.81:0/1034738645 shutdown_connections 2024-09-16T01:15:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.752+0000 7fc16979f640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc15006c2b0 0x7fc15006e770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.752+0000 7fc16979f640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc16415e550 0x7fc1640c7f30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.752+0000 7fc16979f640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1640d2920 0x7fc1640c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.752+0000 7fc16979f640 1 --2- 172.21.15.81:0/1034738645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1640b3400 0x7fc16414b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.752+0000 7fc16979f640 1 -- 172.21.15.81:0/1034738645 >> 172.21.15.81:0/1034738645 conn(0x7fc16408bfc0 msgr2=0x7fc1640b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.752+0000 7fc16979f640 1 -- 172.21.15.81:0/1034738645 shutdown_connections 2024-09-16T01:15:44.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.752+0000 7fc16979f640 1 -- 172.21.15.81:0/1034738645 wait complete. 2024-09-16T01:15:44.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:15:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.871+0000 7f09165b7640 1 Processor -- start 2024-09-16T01:15:44.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.871+0000 7f09165b7640 1 -- start start 2024-09-16T01:15:44.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f09165b7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015e5f0 0x7f09100d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:44.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f09165b7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f09100d30f0 0x7f09100b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:44.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f09165b7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09100d3690 con 0x7f09100b64c0 2024-09-16T01:15:44.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f09165b7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f091006d530 con 0x7f09100d30f0 2024-09-16T01:15:44.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f09165b7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f09100d3970 con 0x7f091015e5f0 2024-09-16T01:15:44.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f0914b54640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f09100b64c0 0x7f09100cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34818/0 (socket says 172.21.15.81:34818) 2024-09-16T01:15:44.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f0914b54640 1 -- 172.21.15.81:0/2515340401 learned_addr learned my addr 172.21.15.81:0/2515340401 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:44.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f090f7fe640 1 --2- 172.21.15.81:0/2515340401 >> v2:172.21.15.102:3300/0 conn(0x7f09100d30f0 0x7f09100b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:44.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f090ffff640 1 --2- 172.21.15.81:0/2515340401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015e5f0 0x7f09100d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:44.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 191986457 0 0) 0x7f09100d3690 con 0x7f09100b64c0 2024-09-16T01:15:44.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08f8003520 con 0x7f09100b64c0 2024-09-16T01:15:44.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1274466535 0 0) 0x7f08f8003520 con 0x7f09100b64c0 2024-09-16T01:15:44.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.872+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015e5f0 msgr2=0x7f09100d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:44.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090effd640 1 --2- 172.21.15.81:0/2515340401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015e5f0 0x7f09100d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:44.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 >> v2:172.21.15.102:3300/0 conn(0x7f09100d30f0 msgr2=0x7f09100b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:44.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090effd640 1 --2- 172.21.15.81:0/2515340401 >> v2:172.21.15.102:3300/0 conn(0x7f09100d30f0 0x7f09100b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:44.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f091006cee0 con 0x7f09100b64c0 2024-09-16T01:15:44.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f09080019f0 con 0x7f09100b64c0 2024-09-16T01:15:44.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 >> v1:172.21.15.81:6789/0 conn(0x7f09100b64c0 legacy=0x7f09100cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090effd640 1 --2- 172.21.15.81:0/2515340401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f80039b0 0x7f08f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090effd640 1 --2- 172.21.15.81:0/2515340401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015e5f0 0x7f08f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090effd640 1 --2- 172.21.15.81:0/2515340401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f8004d40 0x7f08f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f091006d530 con 0x7f08f80039b0 2024-09-16T01:15:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f09100d3970 con 0x7f08f8004d40 2024-09-16T01:15:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f08f800b9c0 con 0x7f091015e5f0 2024-09-16T01:15:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090ffff640 1 --2- 172.21.15.81:0/2515340401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f80039b0 0x7f08f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090f7fe640 1 --2- 172.21.15.81:0/2515340401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015e5f0 0x7f08f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f0914b54640 1 --2- 172.21.15.81:0/2515340401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f8004d40 0x7f08f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090ffff640 1 -- 172.21.15.81:0/2515340401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015e5f0 msgr2=0x7f08f8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090ffff640 1 --2- 172.21.15.81:0/2515340401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015e5f0 0x7f08f8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090ffff640 1 -- 172.21.15.81:0/2515340401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f8004d40 msgr2=0x7f08f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090ffff640 1 --2- 172.21.15.81:0/2515340401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f8004d40 0x7f08f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.873+0000 7f090ffff640 1 -- 172.21.15.81:0/2515340401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f8003520 con 0x7f08f80039b0 2024-09-16T01:15:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.874+0000 7f090ffff640 1 --2- 172.21.15.81:0/2515340401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f80039b0 0x7f08f8003dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0900009ac0 tx=0x7f08f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fc5736d993bcc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.874+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900036070 con 0x7f08f80039b0 2024-09-16T01:15:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.874+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0900031400 con 0x7f08f80039b0 2024-09-16T01:15:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.874+0000 7f090effd640 1 -- 172.21.15.81:0/2515340401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900009690 con 0x7f08f80039b0 2024-09-16T01:15:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.874+0000 7f09165b7640 1 -- 172.21.15.81:0/2515340401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f80039b0 msgr2=0x7f08f8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.874+0000 7f09165b7640 1 --2- 172.21.15.81:0/2515340401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f80039b0 0x7f08f8003dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0900009ac0 tx=0x7f08f8005830 comp rx=0 tx=0).stop 2024-09-16T01:15:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.874+0000 7f0914b54640 1 -- 172.21.15.81:0/2515340401 reap_dead start 2024-09-16T01:15:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.874+0000 7f09165b7640 1 -- 172.21.15.81:0/2515340401 shutdown_connections 2024-09-16T01:15:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.874+0000 7f09165b7640 1 -- 172.21.15.81:0/2515340401 >> 172.21.15.81:0/2515340401 conn(0x7f091008bfc0 msgr2=0x7f09100d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:44.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.874+0000 7f09165b7640 1 -- 172.21.15.81:0/2515340401 shutdown_connections 2024-09-16T01:15:44.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.874+0000 7f09165b7640 1 -- 172.21.15.81:0/2515340401 wait complete. 2024-09-16T01:15:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.875+0000 7f09165b7640 1 Processor -- start 2024-09-16T01:15:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.876+0000 7f09165b7640 1 -- start start 2024-09-16T01:15:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.876+0000 7f09165b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f80039b0 0x7f09100ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.876+0000 7f09165b7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015d550 0x7f091015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.876+0000 7f09165b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f091015f090 0x7f09100cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.876+0000 7f09165b7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f091006e9d0 con 0x7f091015f090 2024-09-16T01:15:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.876+0000 7f09165b7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f091015e9d0 con 0x7f08f80039b0 2024-09-16T01:15:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.876+0000 7f09165b7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f091006eb50 con 0x7f091015d550 2024-09-16T01:15:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f0914b54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f091015f090 0x7f09100cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f0914b54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f091015f090 0x7f09100cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33556/0 (socket says 172.21.15.81:33556) 2024-09-16T01:15:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f0914b54640 1 -- 172.21.15.81:0/129976908 learned_addr learned my addr 172.21.15.81:0/129976908 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f0914b54640 1 -- 172.21.15.81:0/129976908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015d550 msgr2=0x7f091015eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f090ffff640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f80039b0 0x7f09100ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f090f7fe640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015d550 0x7f091015eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f0914b54640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015d550 0x7f091015eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f0914b54640 1 -- 172.21.15.81:0/129976908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f80039b0 msgr2=0x7f09100ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f0914b54640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f80039b0 0x7f09100ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f0914b54640 1 -- 172.21.15.81:0/129976908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09100cc3c0 con 0x7f091015f090 2024-09-16T01:15:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f0914b54640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f091015f090 0x7f09100cce60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09100d1f90 tx=0x7f0908007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f090cff9640 1 -- 172.21.15.81:0/129976908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090800ac40 con 0x7f091015f090 2024-09-16T01:15:44.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f090cff9640 1 -- 172.21.15.81:0/129976908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0908019070 con 0x7f091015f090 2024-09-16T01:15:44.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f09165b7640 1 -- 172.21.15.81:0/129976908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09101615d0 con 0x7f091015f090 2024-09-16T01:15:44.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f090cff9640 1 -- 172.21.15.81:0/129976908 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09080133f0 con 0x7f091015f090 2024-09-16T01:15:44.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.877+0000 7f09165b7640 1 -- 172.21.15.81:0/129976908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09100cc660 con 0x7f091015f090 2024-09-16T01:15:44.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.878+0000 7f09165b7640 1 -- 172.21.15.81:0/129976908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09100d3690 con 0x7f091015f090 2024-09-16T01:15:44.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.879+0000 7f090cff9640 1 -- 172.21.15.81:0/129976908 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0908013590 con 0x7f091015f090 2024-09-16T01:15:44.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.879+0000 7f090cff9640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08fc06c2e0 0x7f08fc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:44.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.879+0000 7f090cff9640 1 -- 172.21.15.81:0/129976908 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f090808bd40 con 0x7f091015f090 2024-09-16T01:15:44.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.879+0000 7f090ffff640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08fc06c2e0 0x7f08fc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:44.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.880+0000 7f090ffff640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08fc06c2e0 0x7f08fc06e7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0900033000 tx=0x7f0900008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:44.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:44.883+0000 7f090cff9640 1 -- 172.21.15.81:0/129976908 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f090805a170 con 0x7f091015f090 2024-09-16T01:15:45.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.084+0000 7f09165b7640 1 -- 172.21.15.81:0/129976908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0910161af0 con 0x7f091015f090 2024-09-16T01:15:45.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.085+0000 7f090cff9640 1 -- 172.21.15.81:0/129976908 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5225 (secure 0 0 0) 0x7f0908059a70 con 0x7f091015f090 2024-09-16T01:15:45.087 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:45.087 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-16T01:15:44:741152+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1441310273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1441310273},{"type":"v1","addr":"172.21.15.102:6834","nonce":1441310273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1086586307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1086586307},{"type":"v1","addr":"172.21.15.102:6835","nonce":1086586307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4105201682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4105201682},{"type":"v1","addr":"172.21.15.81:6835","nonce":4105201682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:15:39.037094+0000","modified":"2024-09-16T01:15:44.092560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2354333316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2354333316},{"type":"v1","addr":"172.21.15.81:6837","nonce":2354333316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-16T01:15:45.087 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-16T01:15:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.086+0000 7f09165b7640 1 -- 172.21.15.81:0/129976908 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08fc06c2e0 msgr2=0x7f08fc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.086+0000 7f09165b7640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08fc06c2e0 0x7f08fc06e7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0900033000 tx=0x7f0900008030 comp rx=0 tx=0).stop 2024-09-16T01:15:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.086+0000 7f09165b7640 1 -- 172.21.15.81:0/129976908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f091015f090 msgr2=0x7f09100cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.086+0000 7f09165b7640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f091015f090 0x7f09100cce60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f09100d1f90 tx=0x7f0908007b20 comp rx=0 tx=0).stop 2024-09-16T01:15:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.087+0000 7f09165b7640 1 -- 172.21.15.81:0/129976908 shutdown_connections 2024-09-16T01:15:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.087+0000 7f09165b7640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08fc06c2e0 0x7f08fc06e7a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.087+0000 7f09165b7640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f091015f090 0x7f09100cce60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.087+0000 7f09165b7640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f091015d550 0x7f091015eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.087+0000 7f09165b7640 1 --2- 172.21.15.81:0/129976908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f80039b0 0x7f09100ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.087+0000 7f09165b7640 1 -- 172.21.15.81:0/129976908 >> 172.21.15.81:0/129976908 conn(0x7f091008bfc0 msgr2=0x7f09100d13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.087+0000 7f09165b7640 1 -- 172.21.15.81:0/129976908 shutdown_connections 2024-09-16T01:15:45.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.087+0000 7f09165b7640 1 -- 172.21.15.81:0/129976908 wait complete. 2024-09-16T01:15:45.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:15:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.195+0000 7fe5e4578640 1 Processor -- start 2024-09-16T01:15:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.195+0000 7fe5e4578640 1 -- start start 2024-09-16T01:15:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.195+0000 7fe5e4578640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe5dc15c870 0x7fe5dc15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.196+0000 7fe5e4578640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5dc0ccf90 0x7fe5dc0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.196+0000 7fe5e4578640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5dc0d01c0 con 0x7fe5dc15c490 2024-09-16T01:15:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.196+0000 7fe5e4578640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe5dc0cff70 con 0x7fe5dc0ccf90 2024-09-16T01:15:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.196+0000 7fe5e4578640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe5dc0d0dd0 con 0x7fe5dc15c870 2024-09-16T01:15:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.196+0000 7fe5e2314640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe5dc15c490 0x7fe5dc09b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34824/0 (socket says 172.21.15.81:34824) 2024-09-16T01:15:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.196+0000 7fe5e2b15640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe5dc0ccf90 0x7fe5dc0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.196+0000 7fe5e2314640 1 -- 172.21.15.81:0/1221695255 learned_addr learned my addr 172.21.15.81:0/1221695255 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.196+0000 7fe5e1b13640 1 --2- 172.21.15.81:0/1221695255 >> v2:172.21.15.102:3300/0 conn(0x7fe5dc15c870 0x7fe5dc15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.196+0000 7fe5e2b15640 1 -- 172.21.15.81:0/1221695255 >> v2:172.21.15.102:3300/0 conn(0x7fe5dc15c870 msgr2=0x7fe5dc15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.196+0000 7fe5e2b15640 1 --2- 172.21.15.81:0/1221695255 >> v2:172.21.15.102:3300/0 conn(0x7fe5dc15c870 0x7fe5dc15cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.196+0000 7fe5e2b15640 1 -- 172.21.15.81:0/1221695255 >> v1:172.21.15.81:6789/0 conn(0x7fe5dc15c490 legacy=0x7fe5dc09b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.196+0000 7fe5e2b15640 1 -- 172.21.15.81:0/1221695255 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc0d04a0 con 0x7fe5dc0ccf90 2024-09-16T01:15:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.197+0000 7fe5e2b15640 1 --2- 172.21.15.81:0/1221695255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5dc0ccf90 0x7fe5dc0cd3e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc074070 tx=0x7fe5d802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58de26315dc3c090 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.197+0000 7fe5e1312640 1 -- 172.21.15.81:0/1221695255 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8037070 con 0x7fe5dc0ccf90 2024-09-16T01:15:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.197+0000 7fe5e1312640 1 -- 172.21.15.81:0/1221695255 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d8032440 con 0x7fe5dc0ccf90 2024-09-16T01:15:45.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.197+0000 7fe5e1312640 1 -- 172.21.15.81:0/1221695255 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8032810 con 0x7fe5dc0ccf90 2024-09-16T01:15:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.197+0000 7fe5e4578640 1 -- 172.21.15.81:0/1221695255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5dc0ccf90 msgr2=0x7fe5dc0cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.197+0000 7fe5e4578640 1 --2- 172.21.15.81:0/1221695255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5dc0ccf90 0x7fe5dc0cd3e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc074070 tx=0x7fe5d802a230 comp rx=0 tx=0).stop 2024-09-16T01:15:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.197+0000 7fe5e4578640 1 -- 172.21.15.81:0/1221695255 shutdown_connections 2024-09-16T01:15:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.197+0000 7fe5e4578640 1 --2- 172.21.15.81:0/1221695255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5dc0ccf90 0x7fe5dc0cd3e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.197+0000 7fe5e4578640 1 --2- 172.21.15.81:0/1221695255 >> v2:172.21.15.102:3300/0 conn(0x7fe5dc15c870 0x7fe5dc15cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.197+0000 7fe5e4578640 1 -- 172.21.15.81:0/1221695255 >> 172.21.15.81:0/1221695255 conn(0x7fe5dc0d23a0 msgr2=0x7fe5dc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.197+0000 7fe5e4578640 1 -- 172.21.15.81:0/1221695255 shutdown_connections 2024-09-16T01:15:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.197+0000 7fe5e4578640 1 -- 172.21.15.81:0/1221695255 wait complete. 2024-09-16T01:15:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.199+0000 7fe5e4578640 1 Processor -- start 2024-09-16T01:15:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.199+0000 7fe5e4578640 1 -- start start 2024-09-16T01:15:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.199+0000 7fe5e4578640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5dc0ccf90 0x7fe5dc0c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.199+0000 7fe5e4578640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5dc15c490 0x7fe5dc0c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.199+0000 7fe5e4578640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5dc15c870 0x7fe5dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.199+0000 7fe5e4578640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0d1260 con 0x7fe5dc15c490 2024-09-16T01:15:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.199+0000 7fe5e4578640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0d0a60 con 0x7fe5dc15c870 2024-09-16T01:15:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.199+0000 7fe5e4578640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe5dc14ced0 con 0x7fe5dc0ccf90 2024-09-16T01:15:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.199+0000 7fe5e1b13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5dc15c490 0x7fe5dc0c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.199+0000 7fe5e1b13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5dc15c490 0x7fe5dc0c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33582/0 (socket says 172.21.15.81:33582) 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.199+0000 7fe5e1b13640 1 -- 172.21.15.81:0/573824029 learned_addr learned my addr 172.21.15.81:0/573824029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5e2b15640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5dc15c870 0x7fe5dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5e2314640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5dc0ccf90 0x7fe5dc0c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5e1b13640 1 -- 172.21.15.81:0/573824029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5dc0ccf90 msgr2=0x7fe5dc0c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5e1b13640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5dc0ccf90 0x7fe5dc0c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5e1b13640 1 -- 172.21.15.81:0/573824029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5dc15c870 msgr2=0x7fe5dc06e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5e1b13640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5dc15c870 0x7fe5dc06e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5e1b13640 1 -- 172.21.15.81:0/573824029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc0cbb10 con 0x7fe5dc15c490 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5e1b13640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5dc15c490 0x7fe5dc0c9470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000cd00 tx=0x7fe5d000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5ceffd640 1 -- 172.21.15.81:0/573824029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0003990 con 0x7fe5dc15c490 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5ceffd640 1 -- 172.21.15.81:0/573824029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d0003b30 con 0x7fe5dc15c490 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5ceffd640 1 -- 172.21.15.81:0/573824029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0004020 con 0x7fe5dc15c490 2024-09-16T01:15:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5e4578640 1 -- 172.21.15.81:0/573824029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5dc0cbdd0 con 0x7fe5dc15c490 2024-09-16T01:15:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.200+0000 7fe5e4578640 1 -- 172.21.15.81:0/573824029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5dc06e830 con 0x7fe5dc15c490 2024-09-16T01:15:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.201+0000 7fe5e4578640 1 -- 172.21.15.81:0/573824029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5dc15cce0 con 0x7fe5dc15c490 2024-09-16T01:15:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.202+0000 7fe5ceffd640 1 -- 172.21.15.81:0/573824029 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe5d00041c0 con 0x7fe5dc15c490 2024-09-16T01:15:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.202+0000 7fe5ceffd640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe5c006c2e0 0x7fe5c006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.202+0000 7fe5ceffd640 1 -- 172.21.15.81:0/573824029 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe5d008bb60 con 0x7fe5dc15c490 2024-09-16T01:15:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.202+0000 7fe5e2314640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe5c006c2e0 0x7fe5c006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.202+0000 7fe5e2314640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe5c006c2e0 0x7fe5c006e7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4007fd0 tx=0x7fe5d4007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.206+0000 7fe5ceffd640 1 -- 172.21.15.81:0/573824029 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5d0014030 con 0x7fe5dc15c490 2024-09-16T01:15:45.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.374+0000 7fe5e4578640 1 -- 172.21.15.81:0/573824029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5dc15a870 con 0x7fe5dc15c490 2024-09-16T01:15:45.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.375+0000 7fe5ceffd640 1 -- 172.21.15.81:0/573824029 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18598 (secure 0 0 0) 0x7fe5d00598b0 con 0x7fe5dc15c490 2024-09-16T01:15:45.378 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:45.378 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:44.092404+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:15:36.856888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:15:38.066938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:15:41.748133+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:15:45.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.377+0000 7fe5e4578640 1 -- 172.21.15.81:0/573824029 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe5c006c2e0 msgr2=0x7fe5c006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.377+0000 7fe5e4578640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe5c006c2e0 0x7fe5c006e7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4007fd0 tx=0x7fe5d4007e80 comp rx=0 tx=0).stop 2024-09-16T01:15:45.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.377+0000 7fe5e4578640 1 -- 172.21.15.81:0/573824029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5dc15c490 msgr2=0x7fe5dc0c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.377+0000 7fe5e4578640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5dc15c490 0x7fe5dc0c9470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000cd00 tx=0x7fe5d000a5c0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.377+0000 7fe5e4578640 1 -- 172.21.15.81:0/573824029 shutdown_connections 2024-09-16T01:15:45.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.377+0000 7fe5e4578640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe5c006c2e0 0x7fe5c006e7a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.377+0000 7fe5e4578640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5dc15c870 0x7fe5dc06e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.377+0000 7fe5e4578640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5dc15c490 0x7fe5dc0c9470 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.377+0000 7fe5e4578640 1 --2- 172.21.15.81:0/573824029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5dc0ccf90 0x7fe5dc0c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.377+0000 7fe5e4578640 1 -- 172.21.15.81:0/573824029 >> 172.21.15.81:0/573824029 conn(0x7fe5dc0d23a0 msgr2=0x7fe5dc15ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:45.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.377+0000 7fe5e4578640 1 -- 172.21.15.81:0/573824029 shutdown_connections 2024-09-16T01:15:45.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.377+0000 7fe5e4578640 1 -- 172.21.15.81:0/573824029 wait complete. 2024-09-16T01:15:45.390 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:15:45.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.486+0000 7fa21f38d640 1 Processor -- start 2024-09-16T01:15:45.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.486+0000 7fa21f38d640 1 -- start start 2024-09-16T01:15:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.487+0000 7fa21f38d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa218161c80 0x7fa21806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.487+0000 7fa21f38d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa218162060 0x7fa2180b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.487+0000 7fa21f38d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2180b64b0 0x7fa2180b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.487+0000 7fa21f38d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa21806e870 con 0x7fa218161c80 2024-09-16T01:15:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.487+0000 7fa21f38d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa21806d9f0 con 0x7fa218162060 2024-09-16T01:15:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.487+0000 7fa21f38d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa21806dcd0 con 0x7fa2180b64b0 2024-09-16T01:15:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.487+0000 7fa21d129640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa218161c80 0x7fa21806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.487+0000 7fa21d129640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa218161c80 0x7fa21806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33590/0 (socket says 172.21.15.81:33590) 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.487+0000 7fa21d129640 1 -- 172.21.15.81:0/1874188896 learned_addr learned my addr 172.21.15.81:0/1874188896 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.487+0000 7fa21d92a640 1 --2- 172.21.15.81:0/1874188896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2180b64b0 0x7fa2180b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.487+0000 7fa21c928640 1 --2- 172.21.15.81:0/1874188896 >> v2:172.21.15.102:3300/0 conn(0x7fa218162060 0x7fa2180b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.488+0000 7fa21d129640 1 -- 172.21.15.81:0/1874188896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2180b64b0 msgr2=0x7fa2180b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.488+0000 7fa21d129640 1 --2- 172.21.15.81:0/1874188896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2180b64b0 0x7fa2180b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.488+0000 7fa21d129640 1 -- 172.21.15.81:0/1874188896 >> v2:172.21.15.102:3300/0 conn(0x7fa218162060 msgr2=0x7fa2180b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.488+0000 7fa21d129640 1 --2- 172.21.15.81:0/1874188896 >> v2:172.21.15.102:3300/0 conn(0x7fa218162060 0x7fa2180b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.488+0000 7fa21d129640 1 -- 172.21.15.81:0/1874188896 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21806dfb0 con 0x7fa218161c80 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.488+0000 7fa21c928640 1 --2- 172.21.15.81:0/1874188896 >> v2:172.21.15.102:3300/0 conn(0x7fa218162060 0x7fa2180b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.488+0000 7fa21d92a640 1 --2- 172.21.15.81:0/1874188896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2180b64b0 0x7fa2180b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.488+0000 7fa21d129640 1 --2- 172.21.15.81:0/1874188896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa218161c80 0x7fa21806e330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa21808e830 tx=0x7fa21402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d3270f0807b663 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.488+0000 7fa20ffff640 1 -- 172.21.15.81:0/1874188896 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214037070 con 0x7fa218161c80 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.488+0000 7fa20ffff640 1 -- 172.21.15.81:0/1874188896 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa214032440 con 0x7fa218161c80 2024-09-16T01:15:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.488+0000 7fa20ffff640 1 -- 172.21.15.81:0/1874188896 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214032810 con 0x7fa218161c80 2024-09-16T01:15:45.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.489+0000 7fa21f38d640 1 -- 172.21.15.81:0/1874188896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa218161c80 msgr2=0x7fa21806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.489+0000 7fa21f38d640 1 --2- 172.21.15.81:0/1874188896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa218161c80 0x7fa21806e330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa21808e830 tx=0x7fa21402a1e0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.489+0000 7fa21f38d640 1 -- 172.21.15.81:0/1874188896 shutdown_connections 2024-09-16T01:15:45.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.489+0000 7fa21f38d640 1 --2- 172.21.15.81:0/1874188896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2180b64b0 0x7fa2180b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.489+0000 7fa21f38d640 1 --2- 172.21.15.81:0/1874188896 >> v2:172.21.15.102:3300/0 conn(0x7fa218162060 0x7fa2180b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.489+0000 7fa21f38d640 1 --2- 172.21.15.81:0/1874188896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa218161c80 0x7fa21806e330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.489+0000 7fa21f38d640 1 -- 172.21.15.81:0/1874188896 >> 172.21.15.81:0/1874188896 conn(0x7fa2180d44f0 msgr2=0x7fa2180d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:45.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.489+0000 7fa21f38d640 1 -- 172.21.15.81:0/1874188896 shutdown_connections 2024-09-16T01:15:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.489+0000 7fa21f38d640 1 -- 172.21.15.81:0/1874188896 wait complete. 2024-09-16T01:15:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.490+0000 7fa21f38d640 1 Processor -- start 2024-09-16T01:15:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.490+0000 7fa21f38d640 1 -- start start 2024-09-16T01:15:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21f38d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2180b64b0 0x7fa2181565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21f38d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa218161c80 0x7fa2180cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21f38d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa218162060 0x7fa2180b9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21f38d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa218162500 con 0x7fa218162060 2024-09-16T01:15:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21f38d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa2180d2aa0 con 0x7fa218161c80 2024-09-16T01:15:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21f38d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa218162680 con 0x7fa2180b64b0 2024-09-16T01:15:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21d92a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa218162060 0x7fa2180b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21d92a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa218162060 0x7fa2180b9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33606/0 (socket says 172.21.15.81:33606) 2024-09-16T01:15:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21d92a640 1 -- 172.21.15.81:0/2898281857 learned_addr learned my addr 172.21.15.81:0/2898281857 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21c928640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa218161c80 0x7fa2180cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21d129640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2180b64b0 0x7fa2181565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21d92a640 1 -- 172.21.15.81:0/2898281857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2180b64b0 msgr2=0x7fa2181565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21d92a640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2180b64b0 0x7fa2181565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21d92a640 1 -- 172.21.15.81:0/2898281857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa218161c80 msgr2=0x7fa2180cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21d92a640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa218161c80 0x7fa2180cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21d92a640 1 -- 172.21.15.81:0/2898281857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa218157610 con 0x7fa218162060 2024-09-16T01:15:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.491+0000 7fa21d92a640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa218162060 0x7fa2180b9510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa21000cef0 tx=0x7fa21000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.492+0000 7fa20dffb640 1 -- 172.21.15.81:0/2898281857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21001a070 con 0x7fa218162060 2024-09-16T01:15:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.492+0000 7fa20dffb640 1 -- 172.21.15.81:0/2898281857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21000d840 con 0x7fa218162060 2024-09-16T01:15:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.492+0000 7fa20dffb640 1 -- 172.21.15.81:0/2898281857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa21000dc30 con 0x7fa218162060 2024-09-16T01:15:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.492+0000 7fa21f38d640 1 -- 172.21.15.81:0/2898281857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2181578f0 con 0x7fa218162060 2024-09-16T01:15:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.492+0000 7fa21f38d640 1 -- 172.21.15.81:0/2898281857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa218157eb0 con 0x7fa218162060 2024-09-16T01:15:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.493+0000 7fa21f38d640 1 -- 172.21.15.81:0/2898281857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa21806e330 con 0x7fa218162060 2024-09-16T01:15:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.493+0000 7fa20dffb640 1 -- 172.21.15.81:0/2898281857 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa21001d070 con 0x7fa218162060 2024-09-16T01:15:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.493+0000 7fa20dffb640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa1fc06c2b0 0x7fa1fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.493+0000 7fa20dffb640 1 -- 172.21.15.81:0/2898281857 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa21008bfc0 con 0x7fa218162060 2024-09-16T01:15:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.493+0000 7fa21d129640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa1fc06c2b0 0x7fa1fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.494+0000 7fa21d129640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa1fc06c2b0 0x7fa1fc06e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa214034000 tx=0x7fa21402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:45.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.498+0000 7fa20dffb640 1 -- 172.21.15.81:0/2898281857 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa21005a3f0 con 0x7fa218162060 2024-09-16T01:15:45.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.662+0000 7fa21f38d640 1 -- 172.21.15.81:0/2898281857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2180ba470 con 0x7fa218162060 2024-09-16T01:15:45.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.663+0000 7fa20dffb640 1 -- 172.21.15.81:0/2898281857 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18598 (secure 0 0 0) 0x7fa210059cf0 con 0x7fa218162060 2024-09-16T01:15:45.665 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:45.665 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:44.092404+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:15:36.856888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:15:38.066938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:15:41.748133+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:15:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.665+0000 7fa21f38d640 1 -- 172.21.15.81:0/2898281857 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa1fc06c2b0 msgr2=0x7fa1fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.665+0000 7fa21f38d640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa1fc06c2b0 0x7fa1fc06e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa214034000 tx=0x7fa21402e000 comp rx=0 tx=0).stop 2024-09-16T01:15:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.665+0000 7fa21f38d640 1 -- 172.21.15.81:0/2898281857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa218162060 msgr2=0x7fa2180b9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.665+0000 7fa21f38d640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa218162060 0x7fa2180b9510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa21000cef0 tx=0x7fa21000a710 comp rx=0 tx=0).stop 2024-09-16T01:15:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.665+0000 7fa21f38d640 1 -- 172.21.15.81:0/2898281857 shutdown_connections 2024-09-16T01:15:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.665+0000 7fa21f38d640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa1fc06c2b0 0x7fa1fc06e770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.665+0000 7fa21f38d640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa218162060 0x7fa2180b9510 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.665+0000 7fa21f38d640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa218161c80 0x7fa2180cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.665+0000 7fa21f38d640 1 --2- 172.21.15.81:0/2898281857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2180b64b0 0x7fa2181565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.665+0000 7fa21f38d640 1 -- 172.21.15.81:0/2898281857 >> 172.21.15.81:0/2898281857 conn(0x7fa2180d44f0 msgr2=0x7fa2180b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.665+0000 7fa21f38d640 1 -- 172.21.15.81:0/2898281857 shutdown_connections 2024-09-16T01:15:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.665+0000 7fa21f38d640 1 -- 172.21.15.81:0/2898281857 wait complete. 2024-09-16T01:15:45.693 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:15:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.789+0000 7ff207ae4640 1 Processor -- start 2024-09-16T01:15:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.789+0000 7ff207ae4640 1 -- start start 2024-09-16T01:15:45.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff207ae4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff20015b300 0x7ff2000cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff207ae4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2000cdbe0 con 0x7ff20006f8d0 2024-09-16T01:15:45.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff207ae4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2000cd900 con 0x7ff2000cd3f0 2024-09-16T01:15:45.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff207ae4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff2000728a0 con 0x7ff20015b300 2024-09-16T01:15:45.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff206081640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff20006f8d0 0x7ff20015b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34828/0 (socket says 172.21.15.81:34828) 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff206081640 1 -- 172.21.15.81:0/2466441984 learned_addr learned my addr 172.21.15.81:0/2466441984 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439474252 0 0) 0x7ff2000cdbe0 con 0x7ff20006f8d0 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff205880640 1 --2- 172.21.15.81:0/2466441984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff20015b300 0x7ff2000cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1ec003520 con 0x7ff20006f8d0 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3916397410 0 0) 0x7ff1ec003520 con 0x7ff20006f8d0 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff20015b300 msgr2=0x7ff2000cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff20487e640 1 --2- 172.21.15.81:0/2466441984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff20015b300 0x7ff2000cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 >> v1:172.21.15.102:6789/0 conn(0x7ff2000cd3f0 legacy=0x7ff20006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff200072250 con 0x7ff20006f8d0 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7ff1f80019f0 con 0x7ff20006f8d0 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.790+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 >> v1:172.21.15.81:6789/0 conn(0x7ff20006f8d0 legacy=0x7ff20015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff20487e640 1 --2- 172.21.15.81:0/2466441984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1ec0039e0 0x7ff1ec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff20487e640 1 --2- 172.21.15.81:0/2466441984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1ec004800 0x7ff1ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff20487e640 1 --2- 172.21.15.81:0/2466441984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff20015b300 0x7ff1ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2000728a0 con 0x7ff1ec004800 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ec00ba70 con 0x7ff1ec0039e0 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff1ec00bc70 con 0x7ff20015b300 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff20507f640 1 --2- 172.21.15.81:0/2466441984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1ec004800 0x7ff1ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff205880640 1 --2- 172.21.15.81:0/2466441984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1ec0039e0 0x7ff1ec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff206081640 1 --2- 172.21.15.81:0/2466441984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff20015b300 0x7ff1ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff20507f640 1 -- 172.21.15.81:0/2466441984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff20015b300 msgr2=0x7ff1ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff20507f640 1 --2- 172.21.15.81:0/2466441984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff20015b300 0x7ff1ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff20507f640 1 -- 172.21.15.81:0/2466441984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1ec0039e0 msgr2=0x7ff1ec003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff20507f640 1 --2- 172.21.15.81:0/2466441984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1ec0039e0 0x7ff1ec003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.791+0000 7ff20507f640 1 -- 172.21.15.81:0/2466441984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ec003520 con 0x7ff1ec004800 2024-09-16T01:15:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.792+0000 7ff20507f640 1 --2- 172.21.15.81:0/2466441984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1ec004800 0x7ff1ec004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff2000cd830 tx=0x7ff1ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3b19c433461165 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:45.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.792+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0001370 con 0x7ff1ec004800 2024-09-16T01:15:45.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.792+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f00052d0 con 0x7ff1ec004800 2024-09-16T01:15:45.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.792+0000 7ff20487e640 1 -- 172.21.15.81:0/2466441984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f002ab70 con 0x7ff1ec004800 2024-09-16T01:15:45.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.792+0000 7ff207ae4640 1 -- 172.21.15.81:0/2466441984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1ec004800 msgr2=0x7ff1ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.792+0000 7ff207ae4640 1 --2- 172.21.15.81:0/2466441984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1ec004800 0x7ff1ec004c80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff2000cd830 tx=0x7ff1ec005830 comp rx=0 tx=0).stop 2024-09-16T01:15:45.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.792+0000 7ff206081640 1 -- 172.21.15.81:0/2466441984 reap_dead start 2024-09-16T01:15:45.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.792+0000 7ff207ae4640 1 -- 172.21.15.81:0/2466441984 shutdown_connections 2024-09-16T01:15:45.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.792+0000 7ff207ae4640 1 -- 172.21.15.81:0/2466441984 >> 172.21.15.81:0/2466441984 conn(0x7ff200067d70 msgr2=0x7ff20006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:45.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.792+0000 7ff207ae4640 1 -- 172.21.15.81:0/2466441984 shutdown_connections 2024-09-16T01:15:45.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.792+0000 7ff207ae4640 1 -- 172.21.15.81:0/2466441984 wait complete. 2024-09-16T01:15:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.793+0000 7ff207ae4640 1 Processor -- start 2024-09-16T01:15:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.794+0000 7ff207ae4640 1 -- start start 2024-09-16T01:15:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.794+0000 7ff207ae4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1ec004800 0x7ff2001f4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.794+0000 7ff207ae4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff200152930 0x7ff2000ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.794+0000 7ff207ae4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff200152db0 0x7ff2000caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.794+0000 7ff207ae4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2000d0160 con 0x7ff200152db0 2024-09-16T01:15:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.794+0000 7ff207ae4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff2000cffe0 con 0x7ff200152930 2024-09-16T01:15:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.794+0000 7ff207ae4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff200072d30 con 0x7ff1ec004800 2024-09-16T01:15:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.794+0000 7ff206081640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff200152db0 0x7ff2000caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.794+0000 7ff206081640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff200152db0 0x7ff2000caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33628/0 (socket says 172.21.15.81:33628) 2024-09-16T01:15:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.794+0000 7ff206081640 1 -- 172.21.15.81:0/3568252733 learned_addr learned my addr 172.21.15.81:0/3568252733 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.794+0000 7ff20507f640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff200152930 0x7ff2000ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.794+0000 7ff205880640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1ec004800 0x7ff2001f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.795+0000 7ff206081640 1 -- 172.21.15.81:0/3568252733 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1ec004800 msgr2=0x7ff2001f4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.795+0000 7ff206081640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1ec004800 0x7ff2001f4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.795+0000 7ff206081640 1 -- 172.21.15.81:0/3568252733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff200152930 msgr2=0x7ff2000ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.795+0000 7ff206081640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff200152930 0x7ff2000ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.795+0000 7ff206081640 1 -- 172.21.15.81:0/3568252733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff200158540 con 0x7ff200152db0 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.795+0000 7ff206081640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff200152db0 0x7ff2000caef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff2000b3920 tx=0x7ff1f8007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.795+0000 7ff1f67fc640 1 -- 172.21.15.81:0/3568252733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f800ac20 con 0x7ff200152db0 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.795+0000 7ff1f67fc640 1 -- 172.21.15.81:0/3568252733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f8018070 con 0x7ff200152db0 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.795+0000 7ff207ae4640 1 -- 172.21.15.81:0/3568252733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff200157f80 con 0x7ff200152db0 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.795+0000 7ff1f67fc640 1 -- 172.21.15.81:0/3568252733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80133f0 con 0x7ff200152db0 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.795+0000 7ff207ae4640 1 -- 172.21.15.81:0/3568252733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff20014ffc0 con 0x7ff200152db0 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.796+0000 7ff207ae4640 1 -- 172.21.15.81:0/3568252733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2000b4aa0 con 0x7ff200152db0 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.796+0000 7ff1f67fc640 1 -- 172.21.15.81:0/3568252733 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff1f8013590 con 0x7ff200152db0 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.797+0000 7ff1f67fc640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1e406c2b0 0x7ff1e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.797+0000 7ff1f67fc640 1 -- 172.21.15.81:0/3568252733 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff1f808bc50 con 0x7ff200152db0 2024-09-16T01:15:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.797+0000 7ff205880640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1e406c2b0 0x7ff1e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.797+0000 7ff205880640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1e406c2b0 0x7ff1e406e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009b40 tx=0x7ff1fc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:45.801+0000 7ff1f67fc640 1 -- 172.21.15.81:0/3568252733 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1f8091020 con 0x7ff200152db0 2024-09-16T01:15:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.001+0000 7ff207ae4640 1 -- 172.21.15.81:0/3568252733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff20015baf0 con 0x7ff200152db0 2024-09-16T01:15:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.001+0000 7ff1f67fc640 1 -- 172.21.15.81:0/3568252733 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5225 (secure 0 0 0) 0x7ff1f805a110 con 0x7ff200152db0 2024-09-16T01:15:46.004 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:46.004 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-16T01:15:44:741152+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1441310273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1441310273},{"type":"v1","addr":"172.21.15.102:6834","nonce":1441310273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1086586307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1086586307},{"type":"v1","addr":"172.21.15.102:6835","nonce":1086586307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4105201682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4105201682},{"type":"v1","addr":"172.21.15.81:6835","nonce":4105201682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:15:39.037094+0000","modified":"2024-09-16T01:15:44.092560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2354333316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2354333316},{"type":"v1","addr":"172.21.15.81:6837","nonce":2354333316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-16T01:15:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-16T01:15:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.003+0000 7ff207ae4640 1 -- 172.21.15.81:0/3568252733 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1e406c2b0 msgr2=0x7ff1e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.003+0000 7ff207ae4640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1e406c2b0 0x7ff1e406e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009b40 tx=0x7ff1fc009190 comp rx=0 tx=0).stop 2024-09-16T01:15:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.003+0000 7ff207ae4640 1 -- 172.21.15.81:0/3568252733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff200152db0 msgr2=0x7ff2000caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.003+0000 7ff207ae4640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff200152db0 0x7ff2000caef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff2000b3920 tx=0x7ff1f8007b10 comp rx=0 tx=0).stop 2024-09-16T01:15:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.003+0000 7ff207ae4640 1 -- 172.21.15.81:0/3568252733 shutdown_connections 2024-09-16T01:15:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.003+0000 7ff207ae4640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1e406c2b0 0x7ff1e406e770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.003+0000 7ff207ae4640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff200152db0 0x7ff2000caef0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.003+0000 7ff207ae4640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff200152930 0x7ff2000ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.003+0000 7ff207ae4640 1 --2- 172.21.15.81:0/3568252733 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1ec004800 0x7ff2001f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.003+0000 7ff207ae4640 1 -- 172.21.15.81:0/3568252733 >> 172.21.15.81:0/3568252733 conn(0x7ff200067d70 msgr2=0x7ff20006f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.004+0000 7ff207ae4640 1 -- 172.21.15.81:0/3568252733 shutdown_connections 2024-09-16T01:15:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.004+0000 7ff207ae4640 1 -- 172.21.15.81:0/3568252733 wait complete. 2024-09-16T01:15:46.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:15:46.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.112+0000 7ff34110a640 1 Processor -- start 2024-09-16T01:15:46.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.112+0000 7ff34110a640 1 -- start start 2024-09-16T01:15:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff34110a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff33c0cfcc0 0x7ff33c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff34110a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff33c0d4fd0 0x7ff33c0d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff34110a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33c0d2700 con 0x7ff33c15e760 2024-09-16T01:15:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff34110a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff33c0cedb0 con 0x7ff33c0cfcc0 2024-09-16T01:15:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff34110a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff33c0cf090 con 0x7ff33c0d4fd0 2024-09-16T01:15:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff33a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff33c0cfcc0 0x7ff33c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff33ad9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff33c15e760 0x7ff33c0cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34844/0 (socket says 172.21.15.81:34844) 2024-09-16T01:15:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff33a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff33c0cfcc0 0x7ff33c06cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33644/0 (socket says 172.21.15.81:33644) 2024-09-16T01:15:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff33ad9d640 1 -- 172.21.15.81:0/4184675613 learned_addr learned my addr 172.21.15.81:0/4184675613 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff33a59c640 1 -- 172.21.15.81:0/4184675613 >> v2:172.21.15.102:3300/0 conn(0x7ff33c0d4fd0 msgr2=0x7ff33c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff33a59c640 1 --2- 172.21.15.81:0/4184675613 >> v2:172.21.15.102:3300/0 conn(0x7ff33c0d4fd0 0x7ff33c0d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff33a59c640 1 -- 172.21.15.81:0/4184675613 >> v1:172.21.15.81:6789/0 conn(0x7ff33c15e760 legacy=0x7ff33c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff33a59c640 1 -- 172.21.15.81:0/4184675613 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c0b3c80 con 0x7ff33c0cfcc0 2024-09-16T01:15:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.113+0000 7ff339d9b640 1 -- 172.21.15.81:0/4184675613 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3794896214 0 0) 0x7ff32c001110 con 0x7ff33c15e760 2024-09-16T01:15:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.114+0000 7ff33a59c640 1 --2- 172.21.15.81:0/4184675613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c0cfcc0 0x7ff33c06cdd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06ee50 tx=0x7ff33002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be89a08b00f259d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.114+0000 7ff339d9b640 1 -- 172.21.15.81:0/4184675613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330037070 con 0x7ff33c0cfcc0 2024-09-16T01:15:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.114+0000 7ff339d9b640 1 -- 172.21.15.81:0/4184675613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff330032440 con 0x7ff33c0cfcc0 2024-09-16T01:15:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.114+0000 7ff339d9b640 1 -- 172.21.15.81:0/4184675613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330032810 con 0x7ff33c0cfcc0 2024-09-16T01:15:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.115+0000 7ff34110a640 1 -- 172.21.15.81:0/4184675613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c0cfcc0 msgr2=0x7ff33c06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.115+0000 7ff34110a640 1 --2- 172.21.15.81:0/4184675613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c0cfcc0 0x7ff33c06cdd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff33c06ee50 tx=0x7ff33002a1a0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.115+0000 7ff34110a640 1 -- 172.21.15.81:0/4184675613 shutdown_connections 2024-09-16T01:15:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.115+0000 7ff34110a640 1 --2- 172.21.15.81:0/4184675613 >> v2:172.21.15.102:3300/0 conn(0x7ff33c0d4fd0 0x7ff33c0d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.115+0000 7ff34110a640 1 --2- 172.21.15.81:0/4184675613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c0cfcc0 0x7ff33c06cdd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.115+0000 7ff34110a640 1 -- 172.21.15.81:0/4184675613 >> 172.21.15.81:0/4184675613 conn(0x7ff33c08bfc0 msgr2=0x7ff33c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.115+0000 7ff34110a640 1 -- 172.21.15.81:0/4184675613 shutdown_connections 2024-09-16T01:15:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.115+0000 7ff34110a640 1 -- 172.21.15.81:0/4184675613 wait complete. 2024-09-16T01:15:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.116+0000 7ff34110a640 1 Processor -- start 2024-09-16T01:15:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.116+0000 7ff34110a640 1 -- start start 2024-09-16T01:15:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff34110a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff33c0cfcc0 0x7ff33c0b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff34110a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33c0d4fd0 0x7ff33c0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff34110a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c15e760 0x7ff33c1f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff34110a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c0d33e0 con 0x7ff33c15e760 2024-09-16T01:15:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff34110a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c0b38e0 con 0x7ff33c0cfcc0 2024-09-16T01:15:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff34110a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff33c0d3560 con 0x7ff33c0d4fd0 2024-09-16T01:15:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff33b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c15e760 0x7ff33c1f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff33b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c15e760 0x7ff33c1f8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33648/0 (socket says 172.21.15.81:33648) 2024-09-16T01:15:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff33b59e640 1 -- 172.21.15.81:0/1664942591 learned_addr learned my addr 172.21.15.81:0/1664942591 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff33ad9d640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff33c0cfcc0 0x7ff33c0b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff33a59c640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33c0d4fd0 0x7ff33c0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff33b59e640 1 -- 172.21.15.81:0/1664942591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33c0d4fd0 msgr2=0x7ff33c0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff33b59e640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33c0d4fd0 0x7ff33c0cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff33b59e640 1 -- 172.21.15.81:0/1664942591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff33c0cfcc0 msgr2=0x7ff33c0b99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff33b59e640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff33c0cfcc0 0x7ff33c0b99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.117+0000 7ff33b59e640 1 -- 172.21.15.81:0/1664942591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c0b8910 con 0x7ff33c15e760 2024-09-16T01:15:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.118+0000 7ff33b59e640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c15e760 0x7ff33c1f8080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff33400b9e0 tx=0x7ff33400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.118+0000 7ff3237fe640 1 -- 172.21.15.81:0/1664942591 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff334019070 con 0x7ff33c15e760 2024-09-16T01:15:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.118+0000 7ff3237fe640 1 -- 172.21.15.81:0/1664942591 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff33400cac0 con 0x7ff33c15e760 2024-09-16T01:15:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.118+0000 7ff34110a640 1 -- 172.21.15.81:0/1664942591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c0b8bf0 con 0x7ff33c15e760 2024-09-16T01:15:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.118+0000 7ff3237fe640 1 -- 172.21.15.81:0/1664942591 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff334014440 con 0x7ff33c15e760 2024-09-16T01:15:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.118+0000 7ff34110a640 1 -- 172.21.15.81:0/1664942591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c0b91b0 con 0x7ff33c15e760 2024-09-16T01:15:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.119+0000 7ff34110a640 1 -- 172.21.15.81:0/1664942591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33c0b9690 con 0x7ff33c15e760 2024-09-16T01:15:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.119+0000 7ff3237fe640 1 -- 172.21.15.81:0/1664942591 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff33401c070 con 0x7ff33c15e760 2024-09-16T01:15:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.120+0000 7ff3237fe640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff32806c2b0 0x7ff32806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.120+0000 7ff3237fe640 1 -- 172.21.15.81:0/1664942591 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff33408b3c0 con 0x7ff33c15e760 2024-09-16T01:15:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.120+0000 7ff33ad9d640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff32806c2b0 0x7ff32806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.120+0000 7ff33ad9d640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff32806c2b0 0x7ff32806e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff32c007fd0 tx=0x7ff32c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.124+0000 7ff3237fe640 1 -- 172.21.15.81:0/1664942591 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff33c0b9690 con 0x7ff33c15e760 2024-09-16T01:15:46.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.291+0000 7ff34110a640 1 -- 172.21.15.81:0/1664942591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff33c0d3890 con 0x7ff33c15e760 2024-09-16T01:15:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.293+0000 7ff3237fe640 1 -- 172.21.15.81:0/1664942591 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18598 (secure 0 0 0) 0x7ff3340591a0 con 0x7ff33c15e760 2024-09-16T01:15:46.295 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:46.295 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:44.092404+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:15:36.856888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:15:38.066938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:15:41.748133+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:15:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.295+0000 7ff34110a640 1 -- 172.21.15.81:0/1664942591 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff32806c2b0 msgr2=0x7ff32806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.295+0000 7ff34110a640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff32806c2b0 0x7ff32806e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff32c007fd0 tx=0x7ff32c007de0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.295+0000 7ff34110a640 1 -- 172.21.15.81:0/1664942591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c15e760 msgr2=0x7ff33c1f8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.295+0000 7ff34110a640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c15e760 0x7ff33c1f8080 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff33400b9e0 tx=0x7ff33400bea0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.295+0000 7ff34110a640 1 -- 172.21.15.81:0/1664942591 shutdown_connections 2024-09-16T01:15:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.295+0000 7ff34110a640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff32806c2b0 0x7ff32806e770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.295+0000 7ff34110a640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c15e760 0x7ff33c1f8080 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.295+0000 7ff34110a640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33c0d4fd0 0x7ff33c0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.295+0000 7ff34110a640 1 --2- 172.21.15.81:0/1664942591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff33c0cfcc0 0x7ff33c0b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.295+0000 7ff34110a640 1 -- 172.21.15.81:0/1664942591 >> 172.21.15.81:0/1664942591 conn(0x7ff33c08bfc0 msgr2=0x7ff33c15c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:46.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.295+0000 7ff34110a640 1 -- 172.21.15.81:0/1664942591 shutdown_connections 2024-09-16T01:15:46.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.295+0000 7ff34110a640 1 -- 172.21.15.81:0/1664942591 wait complete. 2024-09-16T01:15:46.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:15:39.037094+0000', 'modified': '2024-09-16T01:15:44.092560+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2354333316', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 2354333316}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2354333316}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-09-16T01:15:46.710 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:15:46.710 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-16T01:15:46.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.810+0000 7f06957c0640 1 Processor -- start 2024-09-16T01:15:46.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.810+0000 7f06957c0640 1 -- start start 2024-09-16T01:15:46.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.810+0000 7f06957c0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06900b6680 0x7f0690169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f06957c0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f069006d9f0 con 0x7f0690162060 2024-09-16T01:15:46.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f06957c0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f069006dcd0 con 0x7f0690161c80 2024-09-16T01:15:46.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f06957c0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f069006dfb0 con 0x7f06900b6680 2024-09-16T01:15:46.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068e7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0690162060 0x7f06900b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34854/0 (socket says 172.21.15.81:34854) 2024-09-16T01:15:46.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068e7fc640 1 -- 172.21.15.81:0/74957274 learned_addr learned my addr 172.21.15.81:0/74957274 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:46.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068f7fe640 1 --2- 172.21.15.81:0/74957274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06900b6680 0x7f0690169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2629760214 0 0) 0x7f069006d9f0 con 0x7f0690162060 2024-09-16T01:15:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0678003520 con 0x7f0690162060 2024-09-16T01:15:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 294590979 0 0) 0x7f0678003520 con 0x7f0690162060 2024-09-16T01:15:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06900b6680 msgr2=0x7f0690169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 --2- 172.21.15.81:0/74957274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06900b6680 0x7f0690169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 >> v1:172.21.15.102:6789/0 conn(0x7f0690161c80 legacy=0x7f069006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06900d01f0 con 0x7f0690162060 2024-09-16T01:15:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f0684001670 con 0x7f0690162060 2024-09-16T01:15:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 >> v1:172.21.15.81:6789/0 conn(0x7f0690162060 legacy=0x7f06900b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 --2- 172.21.15.81:0/74957274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06780039e0 0x7f0678003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 --2- 172.21.15.81:0/74957274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0678004800 0x7f0678004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 --2- 172.21.15.81:0/74957274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06900b6680 0x7f06780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f069006dfb0 con 0x7f0678004800 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f067800baa0 con 0x7f06780039e0 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f067800bca0 con 0x7f06900b6680 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068e7fc640 1 --2- 172.21.15.81:0/74957274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0678004800 0x7f0678004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068effd640 1 --2- 172.21.15.81:0/74957274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06780039e0 0x7f0678003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.811+0000 7f068f7fe640 1 --2- 172.21.15.81:0/74957274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06900b6680 0x7f06780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.812+0000 7f068e7fc640 1 -- 172.21.15.81:0/74957274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06900b6680 msgr2=0x7f06780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.812+0000 7f068e7fc640 1 --2- 172.21.15.81:0/74957274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06900b6680 0x7f06780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.812+0000 7f068e7fc640 1 -- 172.21.15.81:0/74957274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06780039e0 msgr2=0x7f0678003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.812+0000 7f068e7fc640 1 --2- 172.21.15.81:0/74957274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06780039e0 0x7f0678003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.812+0000 7f068e7fc640 1 -- 172.21.15.81:0/74957274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0678003520 con 0x7f0678004800 2024-09-16T01:15:46.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.812+0000 7f068e7fc640 1 --2- 172.21.15.81:0/74957274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0678004800 0x7f0678004c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0684001eb0 tx=0x7f0678005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f3baae66febd47 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.812+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684007d30 con 0x7f0678004800 2024-09-16T01:15:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.812+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0684005af0 con 0x7f0678004800 2024-09-16T01:15:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.812+0000 7f068dffb640 1 -- 172.21.15.81:0/74957274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684007070 con 0x7f0678004800 2024-09-16T01:15:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.813+0000 7f06957c0640 1 -- 172.21.15.81:0/74957274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0678004800 msgr2=0x7f0678004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.813+0000 7f06957c0640 1 --2- 172.21.15.81:0/74957274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0678004800 0x7f0678004c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0684001eb0 tx=0x7f0678005830 comp rx=0 tx=0).stop 2024-09-16T01:15:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.813+0000 7f068f7fe640 1 -- 172.21.15.81:0/74957274 reap_dead start 2024-09-16T01:15:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.813+0000 7f06957c0640 1 -- 172.21.15.81:0/74957274 shutdown_connections 2024-09-16T01:15:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.813+0000 7f06957c0640 1 -- 172.21.15.81:0/74957274 >> 172.21.15.81:0/74957274 conn(0x7f06900d44f0 msgr2=0x7f06900d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.813+0000 7f06957c0640 1 -- 172.21.15.81:0/74957274 shutdown_connections 2024-09-16T01:15:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.813+0000 7f06957c0640 1 -- 172.21.15.81:0/74957274 wait complete. 2024-09-16T01:15:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.814+0000 7f06957c0640 1 Processor -- start 2024-09-16T01:15:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.814+0000 7f06957c0640 1 -- start start 2024-09-16T01:15:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f06957c0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0678004800 0x7f069015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f06957c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0690158470 0x7f0690157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f06957c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06900b1a70 0x7f069015b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f06957c0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06900b6cb0 con 0x7f06900b1a70 2024-09-16T01:15:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f06957c0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f06900b6b30 con 0x7f0690158470 2024-09-16T01:15:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f06957c0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0690167820 con 0x7f0678004800 2024-09-16T01:15:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f068f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06900b1a70 0x7f069015b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f068f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06900b1a70 0x7f069015b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33656/0 (socket says 172.21.15.81:33656) 2024-09-16T01:15:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f068f7fe640 1 -- 172.21.15.81:0/3994261280 learned_addr learned my addr 172.21.15.81:0/3994261280 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f068effd640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0678004800 0x7f069015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f068e7fc640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0690158470 0x7f0690157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f068f7fe640 1 -- 172.21.15.81:0/3994261280 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0678004800 msgr2=0x7f069015a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f068f7fe640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0678004800 0x7f069015a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f068f7fe640 1 -- 172.21.15.81:0/3994261280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0690158470 msgr2=0x7f0690157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f068f7fe640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0690158470 0x7f0690157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f068f7fe640 1 -- 172.21.15.81:0/3994261280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069015aca0 con 0x7f06900b1a70 2024-09-16T01:15:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.815+0000 7f068e7fc640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0690158470 0x7f0690157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:15:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.816+0000 7f068f7fe640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06900b1a70 0x7f069015b7b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0688011c80 tx=0x7f068800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.816+0000 7f06777fe640 1 -- 172.21.15.81:0/3994261280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0688015430 con 0x7f06900b1a70 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.816+0000 7f06777fe640 1 -- 172.21.15.81:0/3994261280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06880155f0 con 0x7f06900b1a70 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.816+0000 7f06957c0640 1 -- 172.21.15.81:0/3994261280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06900b30e0 con 0x7f06900b1a70 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.816+0000 7f06777fe640 1 -- 172.21.15.81:0/3994261280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06880159e0 con 0x7f06900b1a70 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.816+0000 7f06957c0640 1 -- 172.21.15.81:0/3994261280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06900b2e00 con 0x7f06900b1a70 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.817+0000 7f06777fe640 1 -- 172.21.15.81:0/3994261280 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0688015b80 con 0x7f06900b1a70 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.818+0000 7f06777fe640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f067c06c2b0 0x7f067c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.818+0000 7f068effd640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f067c06c2b0 0x7f067c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.818+0000 7f06777fe640 1 -- 172.21.15.81:0/3994261280 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f068808c4f0 con 0x7f06900b1a70 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.818+0000 7f068effd640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f067c06c2b0 0x7f067c06e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0680001760 tx=0x7f0680009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.818+0000 7f069862e740 1 Processor -- start 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.819+0000 7f069862e740 1 -- start start 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.819+0000 7f069862e740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc72c0 0x558e27c0ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.819+0000 7f069862e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc4a80 0x558e27bc76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.819+0000 7f069862e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27bc8a50 0x558e27bc18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.819+0000 7f069862e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e27b29520 con 0x558e27bc4a80 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.819+0000 7f069862e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558e27ad13e0 con 0x558e27bc8a50 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.819+0000 7f069862e740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x558e27b254e0 con 0x558e27bc72c0 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.819+0000 7f068e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc4a80 0x558e27bc76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.819+0000 7f068e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc4a80 0x558e27bc76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33672/0 (socket says 172.21.15.81:33672) 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.820+0000 7f068e7fc640 1 -- 172.21.15.81:0/3295441813 learned_addr learned my addr 172.21.15.81:0/3295441813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.820+0000 7f068f7fe640 1 --2- 172.21.15.81:0/3295441813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27bc8a50 0x558e27bc18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.820+0000 7f068effd640 1 --2- 172.21.15.81:0/3295441813 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc72c0 0x558e27c0ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.820+0000 7f068e7fc640 1 -- 172.21.15.81:0/3295441813 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc72c0 msgr2=0x558e27c0ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.820+0000 7f068e7fc640 1 --2- 172.21.15.81:0/3295441813 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc72c0 0x558e27c0ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.820+0000 7f068e7fc640 1 -- 172.21.15.81:0/3295441813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27bc8a50 msgr2=0x558e27bc18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.820+0000 7f068e7fc640 1 --2- 172.21.15.81:0/3295441813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27bc8a50 0x558e27bc18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.820+0000 7f068e7fc640 1 -- 172.21.15.81:0/3295441813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e27aec2f0 con 0x558e27bc4a80 2024-09-16T01:15:46.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.820+0000 7f068e7fc640 1 --2- 172.21.15.81:0/3295441813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc4a80 0x558e27bc76a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0684000fe0 tx=0x7f0684009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbd4ad00a02c12b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.820+0000 7f0674ff9640 1 -- 172.21.15.81:0/3295441813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684042070 con 0x558e27bc4a80 2024-09-16T01:15:46.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.820+0000 7f0674ff9640 1 -- 172.21.15.81:0/3295441813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0684038040 con 0x558e27bc4a80 2024-09-16T01:15:46.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.820+0000 7f0674ff9640 1 -- 172.21.15.81:0/3295441813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684001630 con 0x558e27bc4a80 2024-09-16T01:15:46.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.821+0000 7f069862e740 1 -- 172.21.15.81:0/3295441813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc4a80 msgr2=0x558e27bc76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.821+0000 7f069862e740 1 --2- 172.21.15.81:0/3295441813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc4a80 0x558e27bc76a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0684000fe0 tx=0x7f0684009030 comp rx=0 tx=0).stop 2024-09-16T01:15:46.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.821+0000 7f069862e740 1 -- 172.21.15.81:0/3295441813 shutdown_connections 2024-09-16T01:15:46.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.821+0000 7f069862e740 1 --2- 172.21.15.81:0/3295441813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27bc8a50 0x558e27bc18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.821+0000 7f069862e740 1 --2- 172.21.15.81:0/3295441813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc4a80 0x558e27bc76a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.821+0000 7f069862e740 1 --2- 172.21.15.81:0/3295441813 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc72c0 0x558e27c0ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.821+0000 7f069862e740 1 -- 172.21.15.81:0/3295441813 >> 172.21.15.81:0/3295441813 conn(0x558e27bc3a80 msgr2=0x558e27c0bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.821+0000 7f069862e740 1 -- 172.21.15.81:0/3295441813 shutdown_connections 2024-09-16T01:15:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.821+0000 7f069862e740 1 -- 172.21.15.81:0/3295441813 wait complete. 2024-09-16T01:15:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.821+0000 7f069862e740 1 -- start start 2024-09-16T01:15:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.821+0000 7f069862e740 1 Processor -- start 2024-09-16T01:15:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f069862e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27bc72c0 0x558e27bf22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f069862e740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 0x558e27bf29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f069862e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27c09530 0x558e27bdcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f069862e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e27bc2f20 con 0x558e27c09530 2024-09-16T01:15:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f069862e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558e27ab2450 con 0x558e27bc72c0 2024-09-16T01:15:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f069862e740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x558e27c0d290 con 0x558e27bc8a50 2024-09-16T01:15:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f069862e740 10 client.0 _ll_register_callbacks cb 0x558e2783bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:15:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f068f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27c09530 0x558e27bdcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f068f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27c09530 0x558e27bdcec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33688/0 (socket says 172.21.15.81:33688) 2024-09-16T01:15:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f068f7fe640 1 -- 172.21.15.81:0/3955679620 learned_addr learned my addr 172.21.15.81:0/3955679620 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f068effd640 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27bc72c0 0x558e27bf22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f068e7fc640 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 0x558e27bf29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f068f7fe640 1 -- 172.21.15.81:0/3955679620 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 msgr2=0x558e27bf29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f068f7fe640 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 0x558e27bf29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f068f7fe640 1 -- 172.21.15.81:0/3955679620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27bc72c0 msgr2=0x558e27bf22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f068f7fe640 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27bc72c0 0x558e27bf22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.822+0000 7f068f7fe640 1 -- 172.21.15.81:0/3955679620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e2783c2d0 con 0x558e27c09530 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f068f7fe640 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27c09530 0x558e27bdcec0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f068808a770 tx=0x7f068805aa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c014e389367c361e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f066dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f066dffb640 1 -- 172.21.15.81:0/3955679620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0688062e90 con 0x558e27c09530 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f066dffb640 1 -- 172.21.15.81:0/3955679620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f068808c070 con 0x558e27c09530 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f069862e740 1 -- 172.21.15.81:0/3955679620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0684038040 con 0x558e27c09530 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f066dffb640 1 -- 172.21.15.81:0/3955679620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f068808c290 con 0x558e27c09530 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f069862e740 10 client.4416 fetch_fsmap learned FSMap version 7 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f069862e740 1 -- 172.21.15.81:0/3955679620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x558e279066b0 con 0x558e27c09530 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f066dffb640 1 -- 172.21.15.81:0/3955679620 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0684038040 con 0x558e27c09530 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f066dffb640 1 -- 172.21.15.81:0/3955679620 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f0688025030 con 0x558e27c09530 2024-09-16T01:15:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f069862e740 10 client.4416 fetch_fsmap finished waiting for FSMap version 7 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f069862e740 10 client.4416 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f069862e740 20 client.4416 populate_metadata read hostname 'smithi081' 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f069862e740 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x558e27beef90 0x558e27bef370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f069862e740 4 client.4416 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f069862e740 1 -- 172.21.15.81:0/3955679620 --> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e27b36c50 con 0x558e27beef90 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.823+0000 7f068effd640 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x558e27beef90 0x558e27bef370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f066dffb640 10 client.4416 ms_handle_connect on v2:172.21.15.81:6836/2354333316 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f068effd640 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x558e27beef90 0x558e27bef370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=332f182864fa6d02 server_cookie=d6deefc8b12897ff in_seq=0 out_seq=0 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f066dffb640 1 -- 172.21.15.81:0/3955679620 <== mds.0 v2:172.21.15.81:6836/2354333316 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e27b36c50 con 0x558e27beef90 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f066dffb640 10 client.4416 handle_command_reply: tid=0 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f069862e740 1 client.4416 shutdown 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f069862e740 1 -- 172.21.15.81:0/3955679620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27c09530 msgr2=0x558e27bdcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f069862e740 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27c09530 0x558e27bdcec0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f068808a770 tx=0x7f068805aa30 comp rx=0 tx=0).stop 2024-09-16T01:15:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f069862e740 1 -- 172.21.15.81:0/3955679620 shutdown_connections 2024-09-16T01:15:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f069862e740 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x558e27beef90 0x558e27bef370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f069862e740 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27c09530 0x558e27bdcec0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f069862e740 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 0x558e27bf29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f066dffb640 0 client.4416 ms_handle_reset on v2:172.21.15.81:6836/2354333316 2024-09-16T01:15:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f069862e740 1 --2- 172.21.15.81:0/3955679620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27bc72c0 0x558e27bf22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f069862e740 1 -- 172.21.15.81:0/3955679620 >> 172.21.15.81:0/3955679620 conn(0x558e27bc4a80 msgr2=0x558e27c0da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f069862e740 1 -- 172.21.15.81:0/3955679620 shutdown_connections 2024-09-16T01:15:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.824+0000 7f069862e740 1 -- 172.21.15.81:0/3955679620 wait complete. 2024-09-16T01:15:46.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.825+0000 7f069862e740 20 client.4416 trim_cache size 0 max 16384 2024-09-16T01:15:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.842+0000 7f069862e740 1 Processor -- start 2024-09-16T01:15:46.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.842+0000 7f069862e740 1 -- start start 2024-09-16T01:15:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f069862e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 0x558e27befad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f069862e740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 0x558e27c09fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f069862e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27c09530 0x558e27c0a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f069862e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0690201930 con 0x558e27bc72c0 2024-09-16T01:15:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f069862e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0690200cc0 con 0x558e27c09530 2024-09-16T01:15:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f069862e740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f06902012e0 con 0x558e27bc8a50 2024-09-16T01:15:46.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f068effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 0x558e27befad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f068effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 0x558e27befad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33698/0 (socket says 172.21.15.81:33698) 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f068effd640 1 -- 172.21.15.81:0/460363337 learned_addr learned my addr 172.21.15.81:0/460363337 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f068f7fe640 1 --2- 172.21.15.81:0/460363337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27c09530 0x558e27c0a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f068e7fc640 1 --2- 172.21.15.81:0/460363337 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 0x558e27c09fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f068effd640 1 -- 172.21.15.81:0/460363337 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 msgr2=0x558e27c09fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f068effd640 1 --2- 172.21.15.81:0/460363337 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 0x558e27c09fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f068effd640 1 -- 172.21.15.81:0/460363337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27c09530 msgr2=0x558e27c0a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f068effd640 1 --2- 172.21.15.81:0/460363337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27c09530 0x558e27c0a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f068effd640 1 -- 172.21.15.81:0/460363337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e27c0d390 con 0x558e27bc72c0 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f068effd640 1 --2- 172.21.15.81:0/460363337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 0x558e27befad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0680012f20 tx=0x7f0680015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8c425e9085a2ad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f066ffff640 1 -- 172.21.15.81:0/460363337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0680019040 con 0x558e27bc72c0 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f066ffff640 1 -- 172.21.15.81:0/460363337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f068001a040 con 0x558e27bc72c0 2024-09-16T01:15:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.843+0000 7f066ffff640 1 -- 172.21.15.81:0/460363337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0680005220 con 0x558e27bc72c0 2024-09-16T01:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.844+0000 7f069862e740 1 -- 172.21.15.81:0/460363337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 msgr2=0x558e27befad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.844+0000 7f069862e740 1 --2- 172.21.15.81:0/460363337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 0x558e27befad0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0680012f20 tx=0x7f0680015000 comp rx=0 tx=0).stop 2024-09-16T01:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.844+0000 7f069862e740 1 -- 172.21.15.81:0/460363337 shutdown_connections 2024-09-16T01:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.844+0000 7f069862e740 1 --2- 172.21.15.81:0/460363337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27c09530 0x558e27c0a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.844+0000 7f069862e740 1 --2- 172.21.15.81:0/460363337 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 0x558e27c09fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.844+0000 7f069862e740 1 --2- 172.21.15.81:0/460363337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 0x558e27befad0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.844+0000 7f069862e740 1 -- 172.21.15.81:0/460363337 >> 172.21.15.81:0/460363337 conn(0x558e27bc4a80 msgr2=0x558e27bdb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.844+0000 7f069862e740 1 -- 172.21.15.81:0/460363337 shutdown_connections 2024-09-16T01:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.844+0000 7f069862e740 1 -- 172.21.15.81:0/460363337 wait complete. 2024-09-16T01:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.844+0000 7f069862e740 1 -- start start 2024-09-16T01:15:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.844+0000 7f069862e740 1 Processor -- start 2024-09-16T01:15:46.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f069862e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 0x558e27c08c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f069862e740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 0x558e27c702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f069862e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27c09530 0x558e27bf00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f069862e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558e27bf3100 con 0x558e27bc72c0 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f069862e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558e27bdc720 con 0x558e27c09530 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f069862e740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x558e27c09ad0 con 0x558e27bc8a50 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f069862e740 10 client.0 _ll_register_callbacks cb 0x7f0688011f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f068effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 0x558e27c08c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f068effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 0x558e27c08c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33708/0 (socket says 172.21.15.81:33708) 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f068effd640 1 -- 172.21.15.81:0/3144844488 learned_addr learned my addr 172.21.15.81:0/3144844488 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f068e7fc640 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 0x558e27c702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f068f7fe640 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27c09530 0x558e27bf00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f068effd640 1 -- 172.21.15.81:0/3144844488 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 msgr2=0x558e27c702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f068effd640 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 0x558e27c702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f068effd640 1 -- 172.21.15.81:0/3144844488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27c09530 msgr2=0x558e27bf00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f068effd640 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27c09530 0x558e27bf00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.845+0000 7f068effd640 1 -- 172.21.15.81:0/3144844488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e27c8aa00 con 0x558e27bc72c0 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f068effd640 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 0x558e27c08c90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0680024040 tx=0x7f0680001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fcb5f6342cdac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f066dffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f066dffb640 1 -- 172.21.15.81:0/3144844488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068003b060 con 0x558e27bc72c0 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f066dffb640 1 -- 172.21.15.81:0/3144844488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f068002b2e0 con 0x558e27bc72c0 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f069862e740 1 -- 172.21.15.81:0/3144844488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f068001a040 con 0x558e27bc72c0 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f066dffb640 1 -- 172.21.15.81:0/3144844488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f0680041050 con 0x558e27bc72c0 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f069862e740 10 client.4422 fetch_fsmap learned FSMap version 7 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f069862e740 1 -- 172.21.15.81:0/3144844488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x558e27c8b2a0 con 0x558e27bc72c0 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f066dffb640 1 -- 172.21.15.81:0/3144844488 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f068001a040 con 0x558e27bc72c0 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f066dffb640 1 -- 172.21.15.81:0/3144844488 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f0680044020 con 0x558e27bc72c0 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f069862e740 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2024-09-16T01:15:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f069862e740 10 client.4422 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f069862e740 20 client.4422 populate_metadata read hostname 'smithi081' 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f069862e740 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x558e27c8e150 0x558e27c8e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f069862e740 4 client.4422 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f069862e740 1 -- 172.21.15.81:0/3144844488 --> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] -- command(tid 0: {"prefix": "status"}) -- 0x558e27b30fa0 con 0x558e27c8e150 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.846+0000 7f068e7fc640 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x558e27c8e150 0x558e27c8e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f066dffb640 10 client.4422 ms_handle_connect on v2:172.21.15.81:6836/2354333316 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f068e7fc640 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x558e27c8e150 0x558e27c8e530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c4cf77950e47d5e server_cookie=4b89ed646a5a60a2 in_seq=0 out_seq=0 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f066dffb640 1 -- 172.21.15.81:0/3144844488 <== mds.0 v2:172.21.15.81:6836/2354333316 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x558e27b30fa0 con 0x558e27c8e150 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f066dffb640 10 client.4422 handle_command_reply: tid=0 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f069862e740 1 client.4422 shutdown 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f069862e740 1 -- 172.21.15.81:0/3144844488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 msgr2=0x558e27c08c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f069862e740 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 0x558e27c08c90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0680024040 tx=0x7f0680001120 comp rx=0 tx=0).stop 2024-09-16T01:15:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f069862e740 1 -- 172.21.15.81:0/3144844488 shutdown_connections 2024-09-16T01:15:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f069862e740 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x558e27c8e150 0x558e27c8e530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f069862e740 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558e27c09530 0x558e27bf00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f066dffb640 0 client.4422 ms_handle_reset on v2:172.21.15.81:6836/2354333316 2024-09-16T01:15:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f069862e740 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558e27bc8a50 0x558e27c702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f069862e740 1 --2- 172.21.15.81:0/3144844488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558e27bc72c0 0x558e27c08c90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f069862e740 1 -- 172.21.15.81:0/3144844488 >> 172.21.15.81:0/3144844488 conn(0x558e27bc4a80 msgr2=0x558e27c09fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f069862e740 1 -- 172.21.15.81:0/3144844488 shutdown_connections 2024-09-16T01:15:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f069862e740 1 -- 172.21.15.81:0/3144844488 wait complete. 2024-09-16T01:15:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f069862e740 20 client.4422 trim_cache size 0 max 16384 2024-09-16T01:15:46.856 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:15:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973", 2024-09-16T01:15:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-16T01:15:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4290, 2024-09-16T01:15:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-16T01:15:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-16T01:15:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-16T01:15:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 7.1485216960000004, 2024-09-16T01:15:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 7, 2024-09-16T01:15:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 24, 2024-09-16T01:15:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 24, 2024-09-16T01:15:46.857 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.173490661000001 2024-09-16T01:15:46.857 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:15:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f06957c0640 1 -- 172.21.15.81:0/3994261280 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f067c06c2b0 msgr2=0x7f067c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f06957c0640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f067c06c2b0 0x7f067c06e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0680001760 tx=0x7f0680009040 comp rx=0 tx=0).stop 2024-09-16T01:15:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f06957c0640 1 -- 172.21.15.81:0/3994261280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06900b1a70 msgr2=0x7f069015b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f06957c0640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06900b1a70 0x7f069015b7b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0688011c80 tx=0x7f068800f580 comp rx=0 tx=0).stop 2024-09-16T01:15:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f06957c0640 1 -- 172.21.15.81:0/3994261280 shutdown_connections 2024-09-16T01:15:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f06957c0640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f067c06c2b0 0x7f067c06e770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f06957c0640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06900b1a70 0x7f069015b7b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f06957c0640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0690158470 0x7f0690157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.847+0000 7f06957c0640 1 --2- 172.21.15.81:0/3994261280 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0678004800 0x7f069015a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.848+0000 7f06957c0640 1 -- 172.21.15.81:0/3994261280 >> 172.21.15.81:0/3994261280 conn(0x7f06900d44f0 msgr2=0x7f0690074760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.848+0000 7f06957c0640 1 -- 172.21.15.81:0/3994261280 shutdown_connections 2024-09-16T01:15:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.848+0000 7f06957c0640 1 -- 172.21.15.81:0/3994261280 wait complete. 2024-09-16T01:15:46.860 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:15:46.860 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:15:46.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:15:46.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.956+0000 7f4e315d6640 1 Processor -- start 2024-09-16T01:15:46.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.956+0000 7f4e315d6640 1 -- start start 2024-09-16T01:15:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e315d6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e2c161c80 0x7f4e2c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e315d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e2c162060 0x7f4e2c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e315d6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e2c06e870 con 0x7f4e2c0b64b0 2024-09-16T01:15:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e315d6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4e2c06d9f0 con 0x7f4e2c161c80 2024-09-16T01:15:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e315d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2c06dcd0 con 0x7f4e2c162060 2024-09-16T01:15:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e2affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e2c161c80 0x7f4e2c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e2affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e2c161c80 0x7f4e2c06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33718/0 (socket says 172.21.15.81:33718) 2024-09-16T01:15:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e2affd640 1 -- 172.21.15.81:0/1682497575 learned_addr learned my addr 172.21.15.81:0/1682497575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:46.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e23fff640 1 --2- 172.21.15.81:0/1682497575 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e2c162060 0x7f4e2c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e2affd640 1 -- 172.21.15.81:0/1682497575 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e2c162060 msgr2=0x7f4e2c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e2affd640 1 --2- 172.21.15.81:0/1682497575 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e2c162060 0x7f4e2c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e2affd640 1 -- 172.21.15.81:0/1682497575 >> v1:172.21.15.102:6789/0 conn(0x7f4e2c0b64b0 legacy=0x7f4e2c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.957+0000 7f4e2affd640 1 -- 172.21.15.81:0/1682497575 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c06dfb0 con 0x7f4e2c161c80 2024-09-16T01:15:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.958+0000 7f4e2affd640 1 --2- 172.21.15.81:0/1682497575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e2c161c80 0x7f4e2c06e330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009870 tx=0x7f4e1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261a1baadfb4e92a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.958+0000 7f4e2a7fc640 1 -- 172.21.15.81:0/1682497575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c037070 con 0x7f4e2c161c80 2024-09-16T01:15:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.958+0000 7f4e2a7fc640 1 -- 172.21.15.81:0/1682497575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e1c032440 con 0x7f4e2c161c80 2024-09-16T01:15:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.958+0000 7f4e2a7fc640 1 -- 172.21.15.81:0/1682497575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c032810 con 0x7f4e2c161c80 2024-09-16T01:15:46.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.958+0000 7f4e315d6640 1 -- 172.21.15.81:0/1682497575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e2c161c80 msgr2=0x7f4e2c06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.958+0000 7f4e315d6640 1 --2- 172.21.15.81:0/1682497575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e2c161c80 0x7f4e2c06e330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009870 tx=0x7f4e1c02a270 comp rx=0 tx=0).stop 2024-09-16T01:15:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.959+0000 7f4e315d6640 1 -- 172.21.15.81:0/1682497575 shutdown_connections 2024-09-16T01:15:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.959+0000 7f4e315d6640 1 --2- 172.21.15.81:0/1682497575 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e2c162060 0x7f4e2c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.959+0000 7f4e315d6640 1 --2- 172.21.15.81:0/1682497575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e2c161c80 0x7f4e2c06e330 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.959+0000 7f4e315d6640 1 -- 172.21.15.81:0/1682497575 >> 172.21.15.81:0/1682497575 conn(0x7f4e2c0d44f0 msgr2=0x7f4e2c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.959+0000 7f4e315d6640 1 -- 172.21.15.81:0/1682497575 shutdown_connections 2024-09-16T01:15:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.959+0000 7f4e315d6640 1 -- 172.21.15.81:0/1682497575 wait complete. 2024-09-16T01:15:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.960+0000 7f4e315d6640 1 Processor -- start 2024-09-16T01:15:46.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.960+0000 7f4e315d6640 1 -- start start 2024-09-16T01:15:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.960+0000 7f4e315d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e2c0b64b0 0x7f4e2c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.960+0000 7f4e315d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e2c161c80 0x7f4e2c0b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.960+0000 7f4e315d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e2c162060 0x7f4e2c15e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.960+0000 7f4e315d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c0d2a10 con 0x7f4e2c0b64b0 2024-09-16T01:15:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.960+0000 7f4e315d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c0d2890 con 0x7f4e2c162060 2024-09-16T01:15:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.960+0000 7f4e315d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2c0b6960 con 0x7f4e2c161c80 2024-09-16T01:15:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e2affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e2c0b64b0 0x7f4e2c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e2affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e2c0b64b0 0x7f4e2c155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33730/0 (socket says 172.21.15.81:33730) 2024-09-16T01:15:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e2affd640 1 -- 172.21.15.81:0/3119556634 learned_addr learned my addr 172.21.15.81:0/3119556634 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e23fff640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e2c161c80 0x7f4e2c0b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e2b7fe640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e2c162060 0x7f4e2c15e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e2affd640 1 -- 172.21.15.81:0/3119556634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e2c161c80 msgr2=0x7f4e2c0b8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e2affd640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e2c161c80 0x7f4e2c0b8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e2affd640 1 -- 172.21.15.81:0/3119556634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e2c162060 msgr2=0x7f4e2c15e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e2affd640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e2c162060 0x7f4e2c15e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e2affd640 1 -- 172.21.15.81:0/3119556634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c0c87e0 con 0x7f4e2c0b64b0 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e23fff640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e2c161c80 0x7f4e2c0b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e2affd640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e2c0b64b0 0x7f4e2c155ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c02a2b0 tx=0x7f4e1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e237fe640 1 -- 172.21.15.81:0/3119556634 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c041020 con 0x7f4e2c0b64b0 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e237fe640 1 -- 172.21.15.81:0/3119556634 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e1c0306c0 con 0x7f4e2c0b64b0 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e315d6640 1 -- 172.21.15.81:0/3119556634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2c0c8a80 con 0x7f4e2c0b64b0 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e237fe640 1 -- 172.21.15.81:0/3119556634 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c037040 con 0x7f4e2c0b64b0 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.961+0000 7f4e315d6640 1 -- 172.21.15.81:0/3119556634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2c0c9040 con 0x7f4e2c0b64b0 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.962+0000 7f4e315d6640 1 -- 172.21.15.81:0/3119556634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2c06e330 con 0x7f4e2c0b64b0 2024-09-16T01:15:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.963+0000 7f4e237fe640 1 -- 172.21.15.81:0/3119556634 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4e1c044020 con 0x7f4e2c0b64b0 2024-09-16T01:15:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.963+0000 7f4e237fe640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e0c06c2b0 0x7f4e0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.963+0000 7f4e23fff640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e0c06c2b0 0x7f4e0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.963+0000 7f4e237fe640 1 -- 172.21.15.81:0/3119556634 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4e1c0abe60 con 0x7f4e2c0b64b0 2024-09-16T01:15:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.964+0000 7f4e23fff640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e0c06c2b0 0x7f4e0c06e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4e14006fd0 tx=0x7f4e14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:46.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:46.968+0000 7f4e237fe640 1 -- 172.21.15.81:0/3119556634 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e1c04b030 con 0x7f4e2c0b64b0 2024-09-16T01:15:47.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.169+0000 7f4e315d6640 1 -- 172.21.15.81:0/3119556634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4e2c0ba470 con 0x7f4e2c0b64b0 2024-09-16T01:15:47.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.169+0000 7f4e237fe640 1 -- 172.21.15.81:0/3119556634 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f4e1c07a320 con 0x7f4e2c0b64b0 2024-09-16T01:15:47.171 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-16T01:15:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.171+0000 7f4e315d6640 1 -- 172.21.15.81:0/3119556634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e0c06c2b0 msgr2=0x7f4e0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.171+0000 7f4e315d6640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e0c06c2b0 0x7f4e0c06e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4e14006fd0 tx=0x7f4e14008040 comp rx=0 tx=0).stop 2024-09-16T01:15:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.171+0000 7f4e315d6640 1 -- 172.21.15.81:0/3119556634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e2c0b64b0 msgr2=0x7f4e2c155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.171+0000 7f4e315d6640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e2c0b64b0 0x7f4e2c155ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c02a2b0 tx=0x7f4e1c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:15:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.171+0000 7f4e315d6640 1 -- 172.21.15.81:0/3119556634 shutdown_connections 2024-09-16T01:15:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.171+0000 7f4e315d6640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e0c06c2b0 0x7f4e0c06e770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.171+0000 7f4e315d6640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e2c162060 0x7f4e2c15e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.171+0000 7f4e315d6640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e2c161c80 0x7f4e2c0b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.171+0000 7f4e315d6640 1 --2- 172.21.15.81:0/3119556634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e2c0b64b0 0x7f4e2c155ef0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.171+0000 7f4e315d6640 1 -- 172.21.15.81:0/3119556634 >> 172.21.15.81:0/3119556634 conn(0x7f4e2c0d44f0 msgr2=0x7f4e2c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.171+0000 7f4e315d6640 1 -- 172.21.15.81:0/3119556634 shutdown_connections 2024-09-16T01:15:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47.171+0000 7f4e315d6640 1 -- 172.21.15.81:0/3119556634 wait complete. 2024-09-16T01:15:47.183 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:15:47.183 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:15:47.183 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:15:47.183 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-16T01:15:47.183 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:15:47.184 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:15:47.184 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:15:47.184 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:15:47.184 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-16T01:15:47.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:15:47.184 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:15:47.199 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:15:47.199 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:15:47.199 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:15:47.199 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:15:47.199 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:15:47.200 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42791sec preferred_lft 42791sec 2024-09-16T01:15:47.201 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:15:47.201 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:15:47.201 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T01:15:47.201 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:15:47.201 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:15:47.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-16T01:15:47.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-16T01:15:47.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-16T01:15:47.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T01:15:47.202 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:15:47.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:15:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:15:47.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:15:47.393 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:15:47.417 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:15:47.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:15:47.419 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:15:47.490 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:15:47.490 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:15:47.490 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:15:47.490 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:15:47.490 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:15:47.491 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:15:47.491 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:15:47.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:15:47.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:15:47.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:15:47.491 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:15:47.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:15:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:15:47.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:15:47.792 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:15:47.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:15:47.807 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-16T01:15:47.863 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:15:47.863 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:15:47.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:15:47.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-16T01:15:47.864 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:15:47.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:15:47.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:15:47.982 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-16T01:15:47.983 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:15:47.983 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:15:47.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-16T01:15:47.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T01:15:47.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-16T01:15:47.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-16T01:15:47.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-16T01:15:47.983 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:15:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:15:48.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:15:48.128 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:15:48.128 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:15:48.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-16T01:15:48.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T01:15:48.128 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:15:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:15:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:15:48.205 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-16T01:15:48.206 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:15:48.206 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:15:48.235 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-16T01:15:48.235 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:15:48.235 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:15:48.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-16T01:15:48.356 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T01:15:48.411 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-16T01:15:48.411 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-16T01:15:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-16T01:15:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-16T01:15:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-16T01:15:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-16T01:15:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-16T01:15:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-16T01:15:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-16T01:15:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-16T01:15:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-16T01:15:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-16T01:15:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T01:15:48.412 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-16T01:15:48.413 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-16T01:15:48.414 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-16T01:15:48.414 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-16T01:15:48.414 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-16T01:15:48.414 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:15:48.414 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:15:48.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:15:48.414 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-16T01:15:48.466 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-16T01:15:48.466 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-16T01:15:48.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-16T01:15:48.532 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-16T01:15:48.588 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-16T01:15:48.588 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-16T01:15:48.588 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-16T01:15:48.588 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-16T01:15:48.588 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-16T01:15:48.588 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-16T01:15:48.588 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-16T01:15:48.589 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-16T01:15:48.590 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-16T01:15:48.590 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-16T01:15:48.590 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-16T01:15:48.590 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-16T01:15:48.590 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-16T01:15:48.590 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-16T01:15:48.590 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-16T01:15:48.590 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-16T01:15:48.590 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-16T01:15:48.590 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:15:48.590 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:15:48.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:15:48.591 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-16T01:15:48.626 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:2024-09-16T01:15:48.624+0000 7f801ae15480 -1 init, newargv = 0x563fc5516a40 newargc=15 2024-09-16T01:15:48.626 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[43272]: starting ceph client 2024-09-16T01:15:48.633 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[43272]: starting fuse 2024-09-16T01:15:48.642 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-16T01:15:48.642 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-16T01:15:48.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-16T01:15:48.642 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-16T01:15:48.643 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:15:48.644 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-16T01:15:48.644 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-16T01:15:48.644 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-16T01:15:48.644 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-16T01:15:48.644 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-16T01:15:48.644 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-16T01:15:48.644 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-16T01:15:48.644 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-16T01:15:48.644 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:15:48.644 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.admin")) 2024-09-16T01:15:48.644 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-16T01:15:48.761 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.admin.43272.asok 2024-09-16T01:15:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:15:48.771 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43272.asok 2024-09-16T01:15:48.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:15:48.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43272.asok status 2024-09-16T01:15:48.904 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:15:48.905 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-16T01:15:48.905 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-16T01:15:48.905 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-16T01:15:48.905 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "admin", 2024-09-16T01:15:48.905 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-16T01:15:48.905 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-16T01:15:48.906 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "43272", 2024-09-16T01:15:48.906 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-16T01:15:48.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:15:48.906 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-16T01:15:48.906 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-16T01:15:48.906 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4437, 2024-09-16T01:15:48.907 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-16T01:15:48.907 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-16T01:15:48.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:15:48.907 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4437 2024-09-16T01:15:48.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:15:48.907 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-16T01:15:48.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-16T01:15:48.908 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-16T01:15:48.908 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2401732904 2024-09-16T01:15:48.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:15:48.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:15:48.908 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-16T01:15:48.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-16T01:15:48.909 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-16T01:15:48.909 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2401732904 2024-09-16T01:15:48.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:15:48.909 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4437 192.168.0.1:0/2401732904", 2024-09-16T01:15:48.909 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2401732904", 2024-09-16T01:15:48.909 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-16T01:15:48.909 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 7, 2024-09-16T01:15:48.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 24, 2024-09-16T01:15:48.910 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-16T01:15:48.910 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-16T01:15:48.910 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-16T01:15:48.910 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:15:48.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:15:48.913 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-16T01:15:48.913 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:15:48.929 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-16T01:15:48.929 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:15:48.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:15:48.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:15:48.995 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-16T01:15:49.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:15:49.108 INFO:teuthology.orchestra.run.smithi081.stdout:# file: . 2024-09-16T01:15:49.108 INFO:teuthology.orchestra.run.smithi081.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-16T01:15:49.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:49.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:15:49.114 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:49.114 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:15:49.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:15:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.266+0000 7f7510a96640 1 Processor -- start 2024-09-16T01:15:49.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.266+0000 7f7510a96640 1 -- start start 2024-09-16T01:15:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.267+0000 7f7510a96640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f750c15b300 0x7f750c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.267+0000 7f7510a96640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f750c06f8d0 0x7f750c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.267+0000 7f7510a96640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f750c0cdbe0 con 0x7f750c0cd3f0 2024-09-16T01:15:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.267+0000 7f7510a96640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f750c0728a0 con 0x7f750c06f8d0 2024-09-16T01:15:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.267+0000 7f7510a96640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f750c0cd900 con 0x7f750c15b300 2024-09-16T01:15:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.268+0000 7f750ad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f750c06f8d0 0x7f750c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.268+0000 7f7509d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f750c0cd3f0 0x7f750c06f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34870/0 (socket says 172.21.15.81:34870) 2024-09-16T01:15:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.268+0000 7f7509d9b640 1 -- 172.21.15.81:0/1123512863 learned_addr learned my addr 172.21.15.81:0/1123512863 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.268+0000 7f750a59c640 1 --2- 172.21.15.81:0/1123512863 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f750c15b300 0x7f750c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.268+0000 7f750ad9d640 1 -- 172.21.15.81:0/1123512863 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f750c15b300 msgr2=0x7f750c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.268+0000 7f750ad9d640 1 --2- 172.21.15.81:0/1123512863 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f750c15b300 0x7f750c0cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.268+0000 7f750ad9d640 1 -- 172.21.15.81:0/1123512863 >> v1:172.21.15.81:6789/0 conn(0x7f750c0cd3f0 legacy=0x7f750c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.268+0000 7f750959a640 1 -- 172.21.15.81:0/1123512863 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025357085 0 0) 0x7f750c0cdbe0 con 0x7f750c0cd3f0 2024-09-16T01:15:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.268+0000 7f750ad9d640 1 -- 172.21.15.81:0/1123512863 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750c072250 con 0x7f750c06f8d0 2024-09-16T01:15:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.269+0000 7f750ad9d640 1 --2- 172.21.15.81:0/1123512863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c06f8d0 0x7f750c15b6e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0097a0 tx=0x7f74fc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1f6619bc56a74b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.269+0000 7f750959a640 1 -- 172.21.15.81:0/1123512863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc037070 con 0x7f750c06f8d0 2024-09-16T01:15:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.269+0000 7f750959a640 1 -- 172.21.15.81:0/1123512863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74fc032440 con 0x7f750c06f8d0 2024-09-16T01:15:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.269+0000 7f750959a640 1 -- 172.21.15.81:0/1123512863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74fc032810 con 0x7f750c06f8d0 2024-09-16T01:15:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.269+0000 7f7510a96640 1 -- 172.21.15.81:0/1123512863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c06f8d0 msgr2=0x7f750c15b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.269+0000 7f7510a96640 1 --2- 172.21.15.81:0/1123512863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c06f8d0 0x7f750c15b6e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0097a0 tx=0x7f74fc02a180 comp rx=0 tx=0).stop 2024-09-16T01:15:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.269+0000 7f7510a96640 1 -- 172.21.15.81:0/1123512863 shutdown_connections 2024-09-16T01:15:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.269+0000 7f7510a96640 1 --2- 172.21.15.81:0/1123512863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c06f8d0 0x7f750c15b6e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.269+0000 7f7510a96640 1 --2- 172.21.15.81:0/1123512863 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f750c15b300 0x7f750c0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.269+0000 7f7510a96640 1 -- 172.21.15.81:0/1123512863 >> 172.21.15.81:0/1123512863 conn(0x7f750c067d70 msgr2=0x7f750c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.269+0000 7f7510a96640 1 -- 172.21.15.81:0/1123512863 shutdown_connections 2024-09-16T01:15:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.269+0000 7f7510a96640 1 -- 172.21.15.81:0/1123512863 wait complete. 2024-09-16T01:15:49.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.271+0000 7f7510a96640 1 Processor -- start 2024-09-16T01:15:49.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.271+0000 7f7510a96640 1 -- start start 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.271+0000 7f7510a96640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c06f8d0 0x7f750c0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.271+0000 7f7510a96640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f750c0cd3f0 0x7f750c1f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.271+0000 7f7510a96640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f750c15b300 0x7f750c1f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.271+0000 7f7510a96640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f750c0d0160 con 0x7f750c06f8d0 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.271+0000 7f7510a96640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f750c0cffe0 con 0x7f750c0cd3f0 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.271+0000 7f7510a96640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f750c072d30 con 0x7f750c15b300 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.271+0000 7f750a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c06f8d0 0x7f750c0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.271+0000 7f750a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c06f8d0 0x7f750c0c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33748/0 (socket says 172.21.15.81:33748) 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f750a59c640 1 -- 172.21.15.81:0/604142994 learned_addr learned my addr 172.21.15.81:0/604142994 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f750ad9d640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f750c15b300 0x7f750c1f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f750a59c640 1 -- 172.21.15.81:0/604142994 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f750c15b300 msgr2=0x7f750c1f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f750a59c640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f750c15b300 0x7f750c1f4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f750a59c640 1 -- 172.21.15.81:0/604142994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f750c0cd3f0 msgr2=0x7f750c1f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f7509d9b640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f750c0cd3f0 0x7f750c1f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f750a59c640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f750c0cd3f0 0x7f750c1f46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f750a59c640 1 -- 172.21.15.81:0/604142994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750c0c8700 con 0x7f750c06f8d0 2024-09-16T01:15:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f750a59c640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c06f8d0 0x7f750c0c7e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f750400efc0 tx=0x7f750400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f7502ffd640 1 -- 172.21.15.81:0/604142994 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504018020 con 0x7f750c06f8d0 2024-09-16T01:15:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f7502ffd640 1 -- 172.21.15.81:0/604142994 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7504014480 con 0x7f750c06f8d0 2024-09-16T01:15:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f7502ffd640 1 -- 172.21.15.81:0/604142994 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504014850 con 0x7f750c06f8d0 2024-09-16T01:15:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f7510a96640 1 -- 172.21.15.81:0/604142994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f750c0c89e0 con 0x7f750c06f8d0 2024-09-16T01:15:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.272+0000 7f7510a96640 1 -- 172.21.15.81:0/604142994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f750c0c8fa0 con 0x7f750c06f8d0 2024-09-16T01:15:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.273+0000 7f7510a96640 1 -- 172.21.15.81:0/604142994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f750c0cb910 con 0x7f750c06f8d0 2024-09-16T01:15:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.274+0000 7f7502ffd640 1 -- 172.21.15.81:0/604142994 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7504005d10 con 0x7f750c06f8d0 2024-09-16T01:15:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.274+0000 7f7502ffd640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74ec06c2b0 0x7f74ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.274+0000 7f7502ffd640 1 -- 172.21.15.81:0/604142994 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f750408c250 con 0x7f750c06f8d0 2024-09-16T01:15:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.274+0000 7f7509d9b640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74ec06c2b0 0x7f74ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.274+0000 7f7509d9b640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74ec06c2b0 0x7f74ec06e770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74f4007fd0 tx=0x7f74f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:49.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.278+0000 7f7502ffd640 1 -- 172.21.15.81:0/604142994 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7504022070 con 0x7f750c06f8d0 2024-09-16T01:15:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.453+0000 7f7510a96640 1 -- 172.21.15.81:0/604142994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f750c0c93a0 con 0x7f750c06f8d0 2024-09-16T01:15:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.454+0000 7f7502ffd640 1 -- 172.21.15.81:0/604142994 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f7504010040 con 0x7f750c06f8d0 2024-09-16T01:15:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:15:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.455+0000 7f7510a96640 1 -- 172.21.15.81:0/604142994 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74ec06c2b0 msgr2=0x7f74ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.455+0000 7f7510a96640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74ec06c2b0 0x7f74ec06e770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74f4007fd0 tx=0x7f74f4009040 comp rx=0 tx=0).stop 2024-09-16T01:15:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.455+0000 7f7510a96640 1 -- 172.21.15.81:0/604142994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c06f8d0 msgr2=0x7f750c0c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.455+0000 7f7510a96640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c06f8d0 0x7f750c0c7e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f750400efc0 tx=0x7f750400c490 comp rx=0 tx=0).stop 2024-09-16T01:15:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.455+0000 7f7510a96640 1 -- 172.21.15.81:0/604142994 shutdown_connections 2024-09-16T01:15:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.456+0000 7f7510a96640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74ec06c2b0 0x7f74ec06e770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.456+0000 7f7510a96640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f750c15b300 0x7f750c1f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.456+0000 7f7510a96640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f750c0cd3f0 0x7f750c1f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.456+0000 7f7510a96640 1 --2- 172.21.15.81:0/604142994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f750c06f8d0 0x7f750c0c7e00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.456+0000 7f7510a96640 1 -- 172.21.15.81:0/604142994 >> 172.21.15.81:0/604142994 conn(0x7f750c067d70 msgr2=0x7f750c0c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.456+0000 7f7510a96640 1 -- 172.21.15.81:0/604142994 shutdown_connections 2024-09-16T01:15:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.456+0000 7f7510a96640 1 -- 172.21.15.81:0/604142994 wait complete. 2024-09-16T01:15:49.468 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:15:49.468 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:15:49.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:15:49.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.621+0000 7f27dc68d640 1 Processor -- start 2024-09-16T01:15:49.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.621+0000 7f27dc68d640 1 -- start start 2024-09-16T01:15:49.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27dc68d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f27d40d06e0 0x7f27d40ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:49.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27dc68d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27d415d3e0 0x7f27d40d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27dc68d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27d40d1000 con 0x7f27d409b510 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27dc68d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f27d409b080 con 0x7f27d415d3e0 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27dc68d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f27d40d00a0 con 0x7f27d40d06e0 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27d9c28640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27d415d3e0 0x7f27d40d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27dac2a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f27d409b510 0x7f27d40ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34884/0 (socket says 172.21.15.81:34884) 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27dac2a640 1 -- 172.21.15.81:0/107048663 learned_addr learned my addr 172.21.15.81:0/107048663 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27da429640 1 --2- 172.21.15.81:0/107048663 >> v2:172.21.15.102:3300/0 conn(0x7f27d40d06e0 0x7f27d40ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27d9c28640 1 -- 172.21.15.81:0/107048663 >> v2:172.21.15.102:3300/0 conn(0x7f27d40d06e0 msgr2=0x7f27d40ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27d9c28640 1 --2- 172.21.15.81:0/107048663 >> v2:172.21.15.102:3300/0 conn(0x7f27d40d06e0 0x7f27d40ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27d9c28640 1 -- 172.21.15.81:0/107048663 >> v1:172.21.15.81:6789/0 conn(0x7f27d409b510 legacy=0x7f27d40ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27d9427640 1 -- 172.21.15.81:0/107048663 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3456953363 0 0) 0x7f27d40d1000 con 0x7f27d409b510 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.622+0000 7f27d9c28640 1 -- 172.21.15.81:0/107048663 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d40d0380 con 0x7f27d415d3e0 2024-09-16T01:15:49.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.623+0000 7f27d9c28640 1 --2- 172.21.15.81:0/107048663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d415d3e0 0x7f27d40d0ac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f27d40734a0 tx=0x7f27c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7498a90ed2a54b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.623+0000 7f27d9427640 1 -- 172.21.15.81:0/107048663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4037070 con 0x7f27d415d3e0 2024-09-16T01:15:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.623+0000 7f27d9427640 1 -- 172.21.15.81:0/107048663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27c4032440 con 0x7f27d415d3e0 2024-09-16T01:15:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.623+0000 7f27d9427640 1 -- 172.21.15.81:0/107048663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c4032810 con 0x7f27d415d3e0 2024-09-16T01:15:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.623+0000 7f27dc68d640 1 -- 172.21.15.81:0/107048663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d415d3e0 msgr2=0x7f27d40d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.623+0000 7f27dc68d640 1 --2- 172.21.15.81:0/107048663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d415d3e0 0x7f27d40d0ac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f27d40734a0 tx=0x7f27c402a1a0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.624+0000 7f27dc68d640 1 -- 172.21.15.81:0/107048663 shutdown_connections 2024-09-16T01:15:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.624+0000 7f27dc68d640 1 --2- 172.21.15.81:0/107048663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d415d3e0 0x7f27d40d0ac0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.624+0000 7f27dc68d640 1 --2- 172.21.15.81:0/107048663 >> v2:172.21.15.102:3300/0 conn(0x7f27d40d06e0 0x7f27d40ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.624+0000 7f27dc68d640 1 -- 172.21.15.81:0/107048663 >> 172.21.15.81:0/107048663 conn(0x7f27d40d23a0 msgr2=0x7f27d40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:49.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.624+0000 7f27dc68d640 1 -- 172.21.15.81:0/107048663 shutdown_connections 2024-09-16T01:15:49.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.624+0000 7f27dc68d640 1 -- 172.21.15.81:0/107048663 wait complete. 2024-09-16T01:15:49.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.625+0000 7f27dc68d640 1 Processor -- start 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.625+0000 7f27dc68d640 1 -- start start 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.625+0000 7f27dc68d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d409b510 0x7f27d41575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.625+0000 7f27dc68d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27d40d06e0 0x7f27d4155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.625+0000 7f27dc68d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d415d3e0 0x7f27d40c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.625+0000 7f27dc68d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27d415d800 con 0x7f27d409b510 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.625+0000 7f27dc68d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f27d409ad10 con 0x7f27d415d3e0 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.625+0000 7f27dc68d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f27d415c740 con 0x7f27d40d06e0 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27da429640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d409b510 0x7f27d41575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27da429640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d409b510 0x7f27d41575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33770/0 (socket says 172.21.15.81:33770) 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27da429640 1 -- 172.21.15.81:0/1811847677 learned_addr learned my addr 172.21.15.81:0/1811847677 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27dac2a640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d415d3e0 0x7f27d40c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27d9c28640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27d40d06e0 0x7f27d4155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:49.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27da429640 1 -- 172.21.15.81:0/1811847677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27d40d06e0 msgr2=0x7f27d4155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27da429640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27d40d06e0 0x7f27d4155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27da429640 1 -- 172.21.15.81:0/1811847677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d415d3e0 msgr2=0x7f27d40c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27da429640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d415d3e0 0x7f27d40c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27da429640 1 -- 172.21.15.81:0/1811847677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d4156550 con 0x7f27d409b510 2024-09-16T01:15:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27da429640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d409b510 0x7f27d41575f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f27d000e930 tx=0x7f27d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27caffd640 1 -- 172.21.15.81:0/1811847677 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0017070 con 0x7f27d409b510 2024-09-16T01:15:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27caffd640 1 -- 172.21.15.81:0/1811847677 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d000ca00 con 0x7f27d409b510 2024-09-16T01:15:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27dc68d640 1 -- 172.21.15.81:0/1811847677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d4156830 con 0x7f27d409b510 2024-09-16T01:15:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27caffd640 1 -- 172.21.15.81:0/1811847677 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d000cdf0 con 0x7f27d409b510 2024-09-16T01:15:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.626+0000 7f27dc68d640 1 -- 172.21.15.81:0/1811847677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d4156df0 con 0x7f27d409b510 2024-09-16T01:15:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.627+0000 7f27dc68d640 1 -- 172.21.15.81:0/1811847677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d415bed0 con 0x7f27d409b510 2024-09-16T01:15:49.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.628+0000 7f27caffd640 1 -- 172.21.15.81:0/1811847677 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f27d001a070 con 0x7f27d409b510 2024-09-16T01:15:49.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.628+0000 7f27caffd640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f27b806c2b0 0x7f27b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:49.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.628+0000 7f27caffd640 1 -- 172.21.15.81:0/1811847677 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f27d008baf0 con 0x7f27d409b510 2024-09-16T01:15:49.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.628+0000 7f27d9c28640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f27b806c2b0 0x7f27b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:49.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.629+0000 7f27d9c28640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f27b806c2b0 0x7f27b806e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27c4034000 tx=0x7f27c402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:49.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.632+0000 7f27caffd640 1 -- 172.21.15.81:0/1811847677 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27d005a070 con 0x7f27d409b510 2024-09-16T01:15:49.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.813+0000 7f27dc68d640 1 -- 172.21.15.81:0/1811847677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f27d40d31d0 con 0x7f27d409b510 2024-09-16T01:15:49.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.813+0000 7f27caffd640 1 -- 172.21.15.81:0/1811847677 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f27d0059970 con 0x7f27d409b510 2024-09-16T01:15:49.815 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:15:49.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.815+0000 7f27dc68d640 1 -- 172.21.15.81:0/1811847677 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f27b806c2b0 msgr2=0x7f27b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:49.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.815+0000 7f27dc68d640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f27b806c2b0 0x7f27b806e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f27c4034000 tx=0x7f27c402e000 comp rx=0 tx=0).stop 2024-09-16T01:15:49.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.815+0000 7f27dc68d640 1 -- 172.21.15.81:0/1811847677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d409b510 msgr2=0x7f27d41575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:49.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.815+0000 7f27dc68d640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d409b510 0x7f27d41575f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f27d000e930 tx=0x7f27d000edf0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.815+0000 7f27dc68d640 1 -- 172.21.15.81:0/1811847677 shutdown_connections 2024-09-16T01:15:49.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.815+0000 7f27dc68d640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f27b806c2b0 0x7f27b806e770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.815+0000 7f27dc68d640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d415d3e0 0x7f27d40c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.815+0000 7f27dc68d640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27d40d06e0 0x7f27d4155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.815+0000 7f27dc68d640 1 --2- 172.21.15.81:0/1811847677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d409b510 0x7f27d41575f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:49.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.815+0000 7f27dc68d640 1 -- 172.21.15.81:0/1811847677 >> 172.21.15.81:0/1811847677 conn(0x7f27d40d23a0 msgr2=0x7f27d40b2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:49.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.815+0000 7f27dc68d640 1 -- 172.21.15.81:0/1811847677 shutdown_connections 2024-09-16T01:15:49.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:49.815+0000 7f27dc68d640 1 -- 172.21.15.81:0/1811847677 wait complete. 2024-09-16T01:15:49.827 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-16T01:15:49.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:15:49.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-16T01:15:49.850 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[43272]: fuse finished with error 0 and tester_r 0 2024-09-16T01:15:49.852 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:15:55.953 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:15:55.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:15:55.953 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-16T01:15:55.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:15:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.134+0000 7fbe24b9f640 1 Processor -- start 2024-09-16T01:15:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.134+0000 7fbe24b9f640 1 -- start start 2024-09-16T01:15:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.135+0000 7fbe24b9f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe2009aca0 0x7fbe2009b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.135+0000 7fbe24b9f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe200d12c0 con 0x7fbe2009b5c0 2024-09-16T01:15:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.135+0000 7fbe24b9f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe200d15a0 con 0x7fbe20071750 2024-09-16T01:15:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.135+0000 7fbe24b9f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fbe2006d040 con 0x7fbe2009aca0 2024-09-16T01:15:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.135+0000 7fbe1e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe2009aca0 0x7fbe2009b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.135+0000 7fbe15d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbe2009b5c0 0x7fbe200d05e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38380/0 (socket says 172.21.15.81:38380) 2024-09-16T01:15:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.135+0000 7fbe15d9b640 1 -- 172.21.15.81:0/442564933 learned_addr learned my addr 172.21.15.81:0/442564933 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.136+0000 7fbe1e59c640 1 -- 172.21.15.81:0/442564933 >> v1:172.21.15.102:6789/0 conn(0x7fbe20071750 legacy=0x7fbe201680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.136+0000 7fbe1e59c640 1 -- 172.21.15.81:0/442564933 >> v1:172.21.15.81:6789/0 conn(0x7fbe2009b5c0 legacy=0x7fbe200d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.136+0000 7fbe1e59c640 1 -- 172.21.15.81:0/442564933 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe200d1880 con 0x7fbe2009aca0 2024-09-16T01:15:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.136+0000 7fbe1dd9b640 1 -- 172.21.15.81:0/442564933 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3804549750 0 0) 0x7fbe200d12c0 con 0x7fbe2009b5c0 2024-09-16T01:15:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.136+0000 7fbe1e59c640 1 --2- 172.21.15.81:0/442564933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe2009aca0 0x7fbe2009b080 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbe100097a0 tx=0x7fbe1002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecd8a28b51e631b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.136+0000 7fbe1dd9b640 1 -- 172.21.15.81:0/442564933 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10037070 con 0x7fbe2009aca0 2024-09-16T01:15:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.137+0000 7fbe1dd9b640 1 -- 172.21.15.81:0/442564933 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe10032440 con 0x7fbe2009aca0 2024-09-16T01:15:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.137+0000 7fbe1dd9b640 1 -- 172.21.15.81:0/442564933 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10032810 con 0x7fbe2009aca0 2024-09-16T01:15:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.137+0000 7fbe24b9f640 1 -- 172.21.15.81:0/442564933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe2009aca0 msgr2=0x7fbe2009b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.137+0000 7fbe24b9f640 1 --2- 172.21.15.81:0/442564933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe2009aca0 0x7fbe2009b080 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbe100097a0 tx=0x7fbe1002a1e0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.137+0000 7fbe24b9f640 1 -- 172.21.15.81:0/442564933 shutdown_connections 2024-09-16T01:15:56.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.137+0000 7fbe24b9f640 1 --2- 172.21.15.81:0/442564933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe2009aca0 0x7fbe2009b080 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.137+0000 7fbe24b9f640 1 -- 172.21.15.81:0/442564933 >> 172.21.15.81:0/442564933 conn(0x7fbe200d23a0 msgr2=0x7fbe200d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:56.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.137+0000 7fbe24b9f640 1 -- 172.21.15.81:0/442564933 shutdown_connections 2024-09-16T01:15:56.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.137+0000 7fbe24b9f640 1 -- 172.21.15.81:0/442564933 wait complete. 2024-09-16T01:15:56.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.139+0000 7fbe24b9f640 1 Processor -- start 2024-09-16T01:15:56.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.139+0000 7fbe24b9f640 1 -- start start 2024-09-16T01:15:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.139+0000 7fbe24b9f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe20071750 0x7fbe2015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.139+0000 7fbe24b9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe2009aca0 0x7fbe200b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.139+0000 7fbe24b9f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe2009b5c0 0x7fbe201524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe24b9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe200d0cf0 con 0x7fbe2009aca0 2024-09-16T01:15:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe24b9f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbe20070220 con 0x7fbe2009b5c0 2024-09-16T01:15:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe24b9f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbe200d0e70 con 0x7fbe20071750 2024-09-16T01:15:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe15d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe2009aca0 0x7fbe200b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe15d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe2009aca0 0x7fbe200b5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60336/0 (socket says 172.21.15.81:60336) 2024-09-16T01:15:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe15d9b640 1 -- 172.21.15.81:0/4228006835 learned_addr learned my addr 172.21.15.81:0/4228006835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe1e59c640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe20071750 0x7fbe2015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe1ed9d640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe2009b5c0 0x7fbe201524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe15d9b640 1 -- 172.21.15.81:0/4228006835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe20071750 msgr2=0x7fbe2015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe15d9b640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe20071750 0x7fbe2015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe15d9b640 1 -- 172.21.15.81:0/4228006835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe2009b5c0 msgr2=0x7fbe201524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe15d9b640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe2009b5c0 0x7fbe201524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe15d9b640 1 -- 172.21.15.81:0/4228006835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe200b73d0 con 0x7fbe2009aca0 2024-09-16T01:15:56.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe15d9b640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe2009aca0 0x7fbe200b5240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800c4a0 tx=0x7fbe0800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:56.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe177fe640 1 -- 172.21.15.81:0/4228006835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08018070 con 0x7fbe2009aca0 2024-09-16T01:15:56.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe177fe640 1 -- 172.21.15.81:0/4228006835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe080074e0 con 0x7fbe2009aca0 2024-09-16T01:15:56.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe24b9f640 1 -- 172.21.15.81:0/4228006835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe200b7990 con 0x7fbe2009aca0 2024-09-16T01:15:56.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe177fe640 1 -- 172.21.15.81:0/4228006835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe08004a20 con 0x7fbe2009aca0 2024-09-16T01:15:56.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.140+0000 7fbe24b9f640 1 -- 172.21.15.81:0/4228006835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe200b7f50 con 0x7fbe2009aca0 2024-09-16T01:15:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.141+0000 7fbe24b9f640 1 -- 172.21.15.81:0/4228006835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe2009b080 con 0x7fbe2009aca0 2024-09-16T01:15:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.142+0000 7fbe177fe640 1 -- 172.21.15.81:0/4228006835 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbe0801b070 con 0x7fbe2009aca0 2024-09-16T01:15:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.142+0000 7fbe177fe640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbe0006c2b0 0x7fbe0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.142+0000 7fbe177fe640 1 -- 172.21.15.81:0/4228006835 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbe0808aa40 con 0x7fbe2009aca0 2024-09-16T01:15:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.142+0000 7fbe1e59c640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbe0006c2b0 0x7fbe0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.143+0000 7fbe1e59c640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbe0006c2b0 0x7fbe0006e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe10034000 tx=0x7fbe1002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:56.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.147+0000 7fbe177fe640 1 -- 172.21.15.81:0/4228006835 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe08058820 con 0x7fbe2009aca0 2024-09-16T01:15:56.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.312+0000 7fbe24b9f640 1 -- 172.21.15.81:0/4228006835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe2009bce0 con 0x7fbe2009aca0 2024-09-16T01:15:56.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.313+0000 7fbe177fe640 1 -- 172.21.15.81:0/4228006835 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18598 (secure 0 0 0) 0x7fbe0805cb20 con 0x7fbe2009aca0 2024-09-16T01:15:56.315 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:56.315 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:44.092404+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:15:36.856888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:15:38.066938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:15:41.748133+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:15:56.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.315+0000 7fbe24b9f640 1 -- 172.21.15.81:0/4228006835 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbe0006c2b0 msgr2=0x7fbe0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.315+0000 7fbe24b9f640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbe0006c2b0 0x7fbe0006e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe10034000 tx=0x7fbe1002e000 comp rx=0 tx=0).stop 2024-09-16T01:15:56.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.315+0000 7fbe24b9f640 1 -- 172.21.15.81:0/4228006835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe2009aca0 msgr2=0x7fbe200b5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.315+0000 7fbe24b9f640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe2009aca0 0x7fbe200b5240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbe0800c4a0 tx=0x7fbe0800c960 comp rx=0 tx=0).stop 2024-09-16T01:15:56.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.315+0000 7fbe24b9f640 1 -- 172.21.15.81:0/4228006835 shutdown_connections 2024-09-16T01:15:56.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.315+0000 7fbe24b9f640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbe0006c2b0 0x7fbe0006e770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.315+0000 7fbe24b9f640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe2009b5c0 0x7fbe201524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.315+0000 7fbe24b9f640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe2009aca0 0x7fbe200b5240 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.315+0000 7fbe24b9f640 1 --2- 172.21.15.81:0/4228006835 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbe20071750 0x7fbe2015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.315+0000 7fbe24b9f640 1 -- 172.21.15.81:0/4228006835 >> 172.21.15.81:0/4228006835 conn(0x7fbe200d23a0 msgr2=0x7fbe200b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:56.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.315+0000 7fbe24b9f640 1 -- 172.21.15.81:0/4228006835 shutdown_connections 2024-09-16T01:15:56.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.315+0000 7fbe24b9f640 1 -- 172.21.15.81:0/4228006835 wait complete. 2024-09-16T01:15:56.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:15:56.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.424+0000 7fd5edd52640 1 Processor -- start 2024-09-16T01:15:56.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.424+0000 7fd5edd52640 1 -- start start 2024-09-16T01:15:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.425+0000 7fd5edd52640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd5e8072d30 0x7fd5e806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.425+0000 7fd5edd52640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5e806f700 0x7fd5e815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.425+0000 7fd5edd52640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e80cdbe0 con 0x7fd5e815b300 2024-09-16T01:15:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.425+0000 7fd5edd52640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e80728a0 con 0x7fd5e8072d30 2024-09-16T01:15:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.425+0000 7fd5edd52640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e806fb30 con 0x7fd5e806f700 2024-09-16T01:15:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.425+0000 7fd5e7fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5e806f700 0x7fd5e815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.425+0000 7fd5e6ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd5e8072d30 0x7fd5e806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.425+0000 7fd5e7fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5e806f700 0x7fd5e815b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:57078/0 (socket says 172.21.15.81:57078) 2024-09-16T01:15:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.425+0000 7fd5e7fff640 1 -- 172.21.15.81:0/3571260921 learned_addr learned my addr 172.21.15.81:0/3571260921 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.426+0000 7fd5e6ffd640 1 -- 172.21.15.81:0/3571260921 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5e806f700 msgr2=0x7fd5e815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.426+0000 7fd5e6ffd640 1 --2- 172.21.15.81:0/3571260921 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5e806f700 0x7fd5e815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.426+0000 7fd5e6ffd640 1 -- 172.21.15.81:0/3571260921 >> v1:172.21.15.102:6789/0 conn(0x7fd5e815b300 legacy=0x7fd5e80cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.426+0000 7fd5e6ffd640 1 -- 172.21.15.81:0/3571260921 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e80cd900 con 0x7fd5e8072d30 2024-09-16T01:15:56.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.426+0000 7fd5e6ffd640 1 --2- 172.21.15.81:0/3571260921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e8072d30 0x7fd5e806f1c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00ba40 tx=0x7fd5dc02c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f29284e11873a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:56.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.426+0000 7fd5e67fc640 1 -- 172.21.15.81:0/3571260921 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc031710 con 0x7fd5e8072d30 2024-09-16T01:15:56.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.427+0000 7fd5e67fc640 1 -- 172.21.15.81:0/3571260921 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5dc0318b0 con 0x7fd5e8072d30 2024-09-16T01:15:56.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.427+0000 7fd5e67fc640 1 -- 172.21.15.81:0/3571260921 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc031c80 con 0x7fd5e8072d30 2024-09-16T01:15:56.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.427+0000 7fd5edd52640 1 -- 172.21.15.81:0/3571260921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e8072d30 msgr2=0x7fd5e806f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.427+0000 7fd5edd52640 1 --2- 172.21.15.81:0/3571260921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e8072d30 0x7fd5e806f1c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00ba40 tx=0x7fd5dc02c7b0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.427+0000 7fd5edd52640 1 -- 172.21.15.81:0/3571260921 shutdown_connections 2024-09-16T01:15:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.427+0000 7fd5edd52640 1 --2- 172.21.15.81:0/3571260921 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5e806f700 0x7fd5e815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.427+0000 7fd5edd52640 1 --2- 172.21.15.81:0/3571260921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e8072d30 0x7fd5e806f1c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.427+0000 7fd5edd52640 1 -- 172.21.15.81:0/3571260921 >> 172.21.15.81:0/3571260921 conn(0x7fd5e8067d70 msgr2=0x7fd5e806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.427+0000 7fd5edd52640 1 -- 172.21.15.81:0/3571260921 shutdown_connections 2024-09-16T01:15:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.427+0000 7fd5edd52640 1 -- 172.21.15.81:0/3571260921 wait complete. 2024-09-16T01:15:56.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.428+0000 7fd5edd52640 1 Processor -- start 2024-09-16T01:15:56.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.428+0000 7fd5edd52640 1 -- start start 2024-09-16T01:15:56.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.429+0000 7fd5edd52640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5e806f700 0x7fd5e81562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.429+0000 7fd5edd52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5e8072d30 0x7fd5e814bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.429+0000 7fd5edd52640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e815b300 0x7fd5e806dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.429+0000 7fd5edd52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e80cd5c0 con 0x7fd5e8072d30 2024-09-16T01:15:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.429+0000 7fd5edd52640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e8072530 con 0x7fd5e815b300 2024-09-16T01:15:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.429+0000 7fd5edd52640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e80cffe0 con 0x7fd5e806f700 2024-09-16T01:15:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.429+0000 7fd5e6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5e8072d30 0x7fd5e814bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.429+0000 7fd5e6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5e8072d30 0x7fd5e814bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60340/0 (socket says 172.21.15.81:60340) 2024-09-16T01:15:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.429+0000 7fd5e6ffd640 1 -- 172.21.15.81:0/3410032544 learned_addr learned my addr 172.21.15.81:0/3410032544 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.429+0000 7fd5e7fff640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e815b300 0x7fd5e806dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.429+0000 7fd5e77fe640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5e806f700 0x7fd5e81562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.430+0000 7fd5e6ffd640 1 -- 172.21.15.81:0/3410032544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5e806f700 msgr2=0x7fd5e81562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.430+0000 7fd5e6ffd640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5e806f700 0x7fd5e81562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.430+0000 7fd5e6ffd640 1 -- 172.21.15.81:0/3410032544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e815b300 msgr2=0x7fd5e806dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.430+0000 7fd5e6ffd640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e815b300 0x7fd5e806dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.430+0000 7fd5e6ffd640 1 -- 172.21.15.81:0/3410032544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e8156980 con 0x7fd5e8072d30 2024-09-16T01:15:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.430+0000 7fd5e6ffd640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5e8072d30 0x7fd5e814bfa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00bb60 tx=0x7fd5dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.430+0000 7fd5cffff640 1 -- 172.21.15.81:0/3410032544 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc040070 con 0x7fd5e8072d30 2024-09-16T01:15:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.430+0000 7fd5cffff640 1 -- 172.21.15.81:0/3410032544 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5dc033c40 con 0x7fd5e8072d30 2024-09-16T01:15:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.430+0000 7fd5edd52640 1 -- 172.21.15.81:0/3410032544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e8156c60 con 0x7fd5e8072d30 2024-09-16T01:15:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.430+0000 7fd5cffff640 1 -- 172.21.15.81:0/3410032544 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc03c430 con 0x7fd5e8072d30 2024-09-16T01:15:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.430+0000 7fd5edd52640 1 -- 172.21.15.81:0/3410032544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e8157220 con 0x7fd5e8072d30 2024-09-16T01:15:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.431+0000 7fd5edd52640 1 -- 172.21.15.81:0/3410032544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e815d1e0 con 0x7fd5e8072d30 2024-09-16T01:15:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.431+0000 7fd5cffff640 1 -- 172.21.15.81:0/3410032544 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd5dc043070 con 0x7fd5e8072d30 2024-09-16T01:15:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.432+0000 7fd5cffff640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd5d406c2e0 0x7fd5d406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.432+0000 7fd5cffff640 1 -- 172.21.15.81:0/3410032544 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd5dc0ac260 con 0x7fd5e8072d30 2024-09-16T01:15:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.432+0000 7fd5e77fe640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd5d406c2e0 0x7fd5d406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.432+0000 7fd5e77fe640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd5d406c2e0 0x7fd5d406e7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8000f60 tx=0x7fd5d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.436+0000 7fd5cffff640 1 -- 172.21.15.81:0/3410032544 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5dc07a040 con 0x7fd5e8072d30 2024-09-16T01:15:56.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.605+0000 7fd5edd52640 1 -- 172.21.15.81:0/3410032544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5e815cf00 con 0x7fd5e8072d30 2024-09-16T01:15:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.607+0000 7fd5cffff640 1 -- 172.21.15.81:0/3410032544 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18598 (secure 0 0 0) 0x7fd5dc07e340 con 0x7fd5e8072d30 2024-09-16T01:15:56.609 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:56.609 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:44.092404+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:15:36.856888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:15:38.066938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:15:41.748133+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:15:56.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.609+0000 7fd5edd52640 1 -- 172.21.15.81:0/3410032544 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd5d406c2e0 msgr2=0x7fd5d406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.609+0000 7fd5edd52640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd5d406c2e0 0x7fd5d406e7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8000f60 tx=0x7fd5d8009040 comp rx=0 tx=0).stop 2024-09-16T01:15:56.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.609+0000 7fd5edd52640 1 -- 172.21.15.81:0/3410032544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5e8072d30 msgr2=0x7fd5e814bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.609+0000 7fd5edd52640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5e8072d30 0x7fd5e814bfa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00bb60 tx=0x7fd5dc0046c0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.609+0000 7fd5edd52640 1 -- 172.21.15.81:0/3410032544 shutdown_connections 2024-09-16T01:15:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.609+0000 7fd5edd52640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd5d406c2e0 0x7fd5d406e7a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.609+0000 7fd5edd52640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5e815b300 0x7fd5e806dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.609+0000 7fd5edd52640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5e8072d30 0x7fd5e814bfa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.609+0000 7fd5edd52640 1 --2- 172.21.15.81:0/3410032544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5e806f700 0x7fd5e81562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.609+0000 7fd5edd52640 1 -- 172.21.15.81:0/3410032544 >> 172.21.15.81:0/3410032544 conn(0x7fd5e8067d70 msgr2=0x7fd5e80cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.609+0000 7fd5edd52640 1 -- 172.21.15.81:0/3410032544 shutdown_connections 2024-09-16T01:15:56.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.609+0000 7fd5edd52640 1 -- 172.21.15.81:0/3410032544 wait complete. 2024-09-16T01:15:56.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:15:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.721+0000 7f43f26e6640 1 Processor -- start 2024-09-16T01:15:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.721+0000 7f43f26e6640 1 -- start start 2024-09-16T01:15:56.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f26e6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f43ec15e7f0 0x7f43ec0b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f26e6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43ec0af210 0x7f43ec070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f26e6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f43ec0b7250 0x7f43ec070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f26e6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f43ec06cdc0 con 0x7f43ec0b7250 2024-09-16T01:15:56.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f26e6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f43ec06d0a0 con 0x7f43ec15e7f0 2024-09-16T01:15:56.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f26e6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f43ec06d380 con 0x7f43ec0af210 2024-09-16T01:15:56.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f0c83640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f43ec0b7250 0x7f43ec070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f0c83640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f43ec0b7250 0x7f43ec070fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60344/0 (socket says 172.21.15.81:60344) 2024-09-16T01:15:56.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f0c83640 1 -- 172.21.15.81:0/563813230 learned_addr learned my addr 172.21.15.81:0/563813230 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:56.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43eb7fe640 1 --2- 172.21.15.81:0/563813230 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43ec0af210 0x7f43ec070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43ebfff640 1 --2- 172.21.15.81:0/563813230 >> v2:172.21.15.102:3300/0 conn(0x7f43ec15e7f0 0x7f43ec0b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f0c83640 1 -- 172.21.15.81:0/563813230 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43ec0af210 msgr2=0x7f43ec070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:56.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f0c83640 1 --2- 172.21.15.81:0/563813230 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43ec0af210 0x7f43ec070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f0c83640 1 -- 172.21.15.81:0/563813230 >> v2:172.21.15.102:3300/0 conn(0x7f43ec15e7f0 msgr2=0x7f43ec0b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:56.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f0c83640 1 --2- 172.21.15.81:0/563813230 >> v2:172.21.15.102:3300/0 conn(0x7f43ec15e7f0 0x7f43ec0b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.722+0000 7f43f0c83640 1 -- 172.21.15.81:0/563813230 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ec06d660 con 0x7f43ec0b7250 2024-09-16T01:15:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.723+0000 7f43f0c83640 1 --2- 172.21.15.81:0/563813230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43ec0b7250 0x7f43ec070fb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f43ec073080 tx=0x7f43e402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530f0685b2af8ee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.723+0000 7f43eaffd640 1 -- 172.21.15.81:0/563813230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e4036070 con 0x7f43ec0b7250 2024-09-16T01:15:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.723+0000 7f43eaffd640 1 -- 172.21.15.81:0/563813230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43e4031600 con 0x7f43ec0b7250 2024-09-16T01:15:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.723+0000 7f43eaffd640 1 -- 172.21.15.81:0/563813230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43e40319d0 con 0x7f43ec0b7250 2024-09-16T01:15:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.724+0000 7f43f26e6640 1 -- 172.21.15.81:0/563813230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43ec0b7250 msgr2=0x7f43ec070fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.724+0000 7f43f26e6640 1 --2- 172.21.15.81:0/563813230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43ec0b7250 0x7f43ec070fb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f43ec073080 tx=0x7f43e402a6a0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.724+0000 7f43f26e6640 1 -- 172.21.15.81:0/563813230 shutdown_connections 2024-09-16T01:15:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.724+0000 7f43f26e6640 1 --2- 172.21.15.81:0/563813230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43ec0b7250 0x7f43ec070fb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.724+0000 7f43f26e6640 1 --2- 172.21.15.81:0/563813230 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43ec0af210 0x7f43ec070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.724+0000 7f43f26e6640 1 --2- 172.21.15.81:0/563813230 >> v2:172.21.15.102:3300/0 conn(0x7f43ec15e7f0 0x7f43ec0b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.724+0000 7f43f26e6640 1 -- 172.21.15.81:0/563813230 >> 172.21.15.81:0/563813230 conn(0x7f43ec0b3f30 msgr2=0x7f43ec0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:56.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.724+0000 7f43f26e6640 1 -- 172.21.15.81:0/563813230 shutdown_connections 2024-09-16T01:15:56.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.724+0000 7f43f26e6640 1 -- 172.21.15.81:0/563813230 wait complete. 2024-09-16T01:15:56.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.725+0000 7f43f26e6640 1 Processor -- start 2024-09-16T01:15:56.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.725+0000 7f43f26e6640 1 -- start start 2024-09-16T01:15:56.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43f26e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43ec0af210 0x7f43ec151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43f26e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0b7250 0x7f43ec160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43f26e6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43ec15e7f0 0x7f43ec156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43f26e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec09aa30 con 0x7f43ec0af210 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43f26e6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec0b6150 con 0x7f43ec0b7250 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43f26e6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f43ec09abb0 con 0x7f43ec15e7f0 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43ebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43ec0af210 0x7f43ec151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43ebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43ec0af210 0x7f43ec151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60358/0 (socket says 172.21.15.81:60358) 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43eb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0b7250 0x7f43ec160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43ebfff640 1 -- 172.21.15.81:0/2148157605 learned_addr learned my addr 172.21.15.81:0/2148157605 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43f0c83640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43ec15e7f0 0x7f43ec156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43ebfff640 1 -- 172.21.15.81:0/2148157605 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43ec15e7f0 msgr2=0x7f43ec156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43ebfff640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43ec15e7f0 0x7f43ec156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43ebfff640 1 -- 172.21.15.81:0/2148157605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0b7250 msgr2=0x7f43ec160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43ebfff640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0b7250 0x7f43ec160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43ebfff640 1 -- 172.21.15.81:0/2148157605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ec152040 con 0x7f43ec0af210 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43ebfff640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43ec0af210 0x7f43ec151b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00d620 tx=0x7f43dc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.726+0000 7f43e8ff9640 1 -- 172.21.15.81:0/2148157605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00b620 con 0x7f43ec0af210 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.727+0000 7f43e8ff9640 1 -- 172.21.15.81:0/2148157605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43dc019070 con 0x7f43ec0af210 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.727+0000 7f43f26e6640 1 -- 172.21.15.81:0/2148157605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ec15f060 con 0x7f43ec0af210 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.727+0000 7f43e8ff9640 1 -- 172.21.15.81:0/2148157605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00ba00 con 0x7f43ec0af210 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.727+0000 7f43f26e6640 1 -- 172.21.15.81:0/2148157605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ec15f900 con 0x7f43ec0af210 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.727+0000 7f43f26e6640 1 -- 172.21.15.81:0/2148157605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ec15f450 con 0x7f43ec0af210 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.728+0000 7f43e8ff9640 1 -- 172.21.15.81:0/2148157605 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f43dc00bba0 con 0x7f43ec0af210 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.728+0000 7f43e8ff9640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f43d806c2e0 0x7f43d806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.729+0000 7f43e8ff9640 1 -- 172.21.15.81:0/2148157605 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f43dc08ba70 con 0x7f43ec0af210 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.729+0000 7f43eb7fe640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f43d806c2e0 0x7f43d806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.729+0000 7f43eb7fe640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f43d806c2e0 0x7f43d806e7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0b3620 tx=0x7f43e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:56.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.733+0000 7f43e8ff9640 1 -- 172.21.15.81:0/2148157605 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43dc0597c0 con 0x7f43ec0af210 2024-09-16T01:15:56.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:56.933+0000 7f43f26e6640 1 -- 172.21.15.81:0/2148157605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f43ec0b6d10 con 0x7f43ec0af210 2024-09-16T01:15:57.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.776+0000 7f43e8ff9640 1 -- 172.21.15.81:0/2148157605 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f43dc05dac0 con 0x7f43ec0af210 2024-09-16T01:15:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.779+0000 7f43f26e6640 1 -- 172.21.15.81:0/2148157605 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f43d806c2e0 msgr2=0x7f43d806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.779+0000 7f43f26e6640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f43d806c2e0 0x7f43d806e7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0b3620 tx=0x7f43e0008040 comp rx=0 tx=0).stop 2024-09-16T01:15:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.779+0000 7f43f26e6640 1 -- 172.21.15.81:0/2148157605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43ec0af210 msgr2=0x7f43ec151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.779+0000 7f43f26e6640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43ec0af210 0x7f43ec151b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00d620 tx=0x7f43dc00dae0 comp rx=0 tx=0).stop 2024-09-16T01:15:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.779+0000 7f43f26e6640 1 -- 172.21.15.81:0/2148157605 shutdown_connections 2024-09-16T01:15:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.779+0000 7f43f26e6640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f43d806c2e0 0x7f43d806e7a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.779+0000 7f43f26e6640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43ec15e7f0 0x7f43ec156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.779+0000 7f43f26e6640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec0b7250 0x7f43ec160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.779+0000 7f43f26e6640 1 --2- 172.21.15.81:0/2148157605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43ec0af210 0x7f43ec151b00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.779+0000 7f43f26e6640 1 -- 172.21.15.81:0/2148157605 >> 172.21.15.81:0/2148157605 conn(0x7f43ec0b3f30 msgr2=0x7f43ec0af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.779+0000 7f43f26e6640 1 -- 172.21.15.81:0/2148157605 shutdown_connections 2024-09-16T01:15:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.779+0000 7f43f26e6640 1 -- 172.21.15.81:0/2148157605 wait complete. 2024-09-16T01:15:57.795 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-16T01:15:57.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:15:57.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.899+0000 7f602516d640 1 Processor -- start 2024-09-16T01:15:57.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.899+0000 7f602516d640 1 -- start start 2024-09-16T01:15:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.900+0000 7f602516d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6020162e30 0x7f602006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.900+0000 7f602516d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f602015ff70 con 0x7f6020162340 2024-09-16T01:15:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.900+0000 7f602516d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60200d4d10 con 0x7f60200cf280 2024-09-16T01:15:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.900+0000 7f602516d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f602006de90 con 0x7f6020162e30 2024-09-16T01:15:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.900+0000 7f601ed9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6020162340 0x7f6020162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38384/0 (socket says 172.21.15.81:38384) 2024-09-16T01:15:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.900+0000 7f601ed9d640 1 -- 172.21.15.81:0/2414198288 learned_addr learned my addr 172.21.15.81:0/2414198288 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.900+0000 7f601e59c640 1 --2- 172.21.15.81:0/2414198288 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6020162e30 0x7f602006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 757879578 0 0) 0x7f602015ff70 con 0x7f6020162340 2024-09-16T01:15:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6008003520 con 0x7f6020162340 2024-09-16T01:15:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 241364088 0 0) 0x7f60200d4d10 con 0x7f60200cf280 2024-09-16T01:15:57.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f602015ff70 con 0x7f60200cf280 2024-09-16T01:15:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3758760024 0 0) 0x7f6008003520 con 0x7f6020162340 2024-09-16T01:15:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6020162e30 msgr2=0x7f602006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 --2- 172.21.15.81:0/2414198288 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6020162e30 0x7f602006d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 >> v1:172.21.15.102:6789/0 conn(0x7f60200cf280 legacy=0x7f60200d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60200d4ff0 con 0x7f6020162340 2024-09-16T01:15:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f60100019f0 con 0x7f6020162340 2024-09-16T01:15:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 >> v1:172.21.15.81:6789/0 conn(0x7f6020162340 legacy=0x7f6020162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 --2- 172.21.15.81:0/2414198288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6008003b70 0x7f6008003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 --2- 172.21.15.81:0/2414198288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6008004800 0x7f6008004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 --2- 172.21.15.81:0/2414198288 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6020162e30 0x7f60080051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f602006de90 con 0x7f6008003b70 2024-09-16T01:15:57.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f600800bad0 con 0x7f6008004800 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f600800bcd0 con 0x7f6020162e30 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601ed9d640 1 --2- 172.21.15.81:0/2414198288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6008003b70 0x7f6008003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601e59c640 1 --2- 172.21.15.81:0/2414198288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6008004800 0x7f6008004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601f59e640 1 --2- 172.21.15.81:0/2414198288 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6020162e30 0x7f60080051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601ed9d640 1 -- 172.21.15.81:0/2414198288 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6020162e30 msgr2=0x7f60080051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601ed9d640 1 --2- 172.21.15.81:0/2414198288 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6020162e30 0x7f60080051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601ed9d640 1 -- 172.21.15.81:0/2414198288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6008004800 msgr2=0x7f6008004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601ed9d640 1 --2- 172.21.15.81:0/2414198288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6008004800 0x7f6008004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.901+0000 7f601ed9d640 1 -- 172.21.15.81:0/2414198288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6008003520 con 0x7f6008003b70 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.902+0000 7f601ed9d640 1 --2- 172.21.15.81:0/2414198288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6008003b70 0x7f6008003f70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f601000a820 tx=0x7f6008005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20e76459eb7288b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.902+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601000a450 con 0x7f6008003b70 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.902+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601002f070 con 0x7f6008003b70 2024-09-16T01:15:57.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.902+0000 7f601dd9b640 1 -- 172.21.15.81:0/2414198288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601002bc90 con 0x7f6008003b70 2024-09-16T01:15:57.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.903+0000 7f602516d640 1 -- 172.21.15.81:0/2414198288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6008003b70 msgr2=0x7f6008003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:57.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.903+0000 7f602516d640 1 --2- 172.21.15.81:0/2414198288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6008003b70 0x7f6008003f70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f601000a820 tx=0x7f6008005830 comp rx=0 tx=0).stop 2024-09-16T01:15:57.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.903+0000 7f601f59e640 1 -- 172.21.15.81:0/2414198288 reap_dead start 2024-09-16T01:15:57.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.903+0000 7f602516d640 1 -- 172.21.15.81:0/2414198288 shutdown_connections 2024-09-16T01:15:57.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.903+0000 7f602516d640 1 -- 172.21.15.81:0/2414198288 >> 172.21.15.81:0/2414198288 conn(0x7f602008bfc0 msgr2=0x7f60200d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:57.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.903+0000 7f602516d640 1 -- 172.21.15.81:0/2414198288 shutdown_connections 2024-09-16T01:15:57.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.903+0000 7f602516d640 1 -- 172.21.15.81:0/2414198288 wait complete. 2024-09-16T01:15:57.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.904+0000 7f602516d640 1 Processor -- start 2024-09-16T01:15:57.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.904+0000 7f602516d640 1 -- start start 2024-09-16T01:15:57.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f602516d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6008003b70 0x7f60200cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f602516d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60200b9d70 0x7f60201519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f602516d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6020161350 0x7f60201617d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f602516d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60200cf710 con 0x7f6008003b70 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f602516d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6020163270 con 0x7f6020161350 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f602516d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f60200d52d0 con 0x7f60200b9d70 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f601ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6008003b70 0x7f60200cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f601ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6008003b70 0x7f60200cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60376/0 (socket says 172.21.15.81:60376) 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f601ed9d640 1 -- 172.21.15.81:0/2104795224 learned_addr learned my addr 172.21.15.81:0/2104795224 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f601f59e640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6020161350 0x7f60201617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f601e59c640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60200b9d70 0x7f60201519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f601ed9d640 1 -- 172.21.15.81:0/2104795224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60200b9d70 msgr2=0x7f60201519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f601ed9d640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60200b9d70 0x7f60201519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f601ed9d640 1 -- 172.21.15.81:0/2104795224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6020161350 msgr2=0x7f60201617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f601ed9d640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6020161350 0x7f60201617d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:57.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.905+0000 7f601ed9d640 1 -- 172.21.15.81:0/2104795224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60200ba1f0 con 0x7f6008003b70 2024-09-16T01:15:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.906+0000 7f601ed9d640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6008003b70 0x7f60200cabe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6010007040 tx=0x7f6010001db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.906+0000 7f60077fe640 1 -- 172.21.15.81:0/2104795224 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601002ba10 con 0x7f6008003b70 2024-09-16T01:15:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.906+0000 7f60077fe640 1 -- 172.21.15.81:0/2104795224 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f601002bbb0 con 0x7f6008003b70 2024-09-16T01:15:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.906+0000 7f60077fe640 1 -- 172.21.15.81:0/2104795224 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6010004e30 con 0x7f6008003b70 2024-09-16T01:15:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.906+0000 7f602516d640 1 -- 172.21.15.81:0/2104795224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60200b3f30 con 0x7f6008003b70 2024-09-16T01:15:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.906+0000 7f602516d640 1 -- 172.21.15.81:0/2104795224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60200b6d90 con 0x7f6008003b70 2024-09-16T01:15:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.907+0000 7f602516d640 1 -- 172.21.15.81:0/2104795224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602006d740 con 0x7f6008003b70 2024-09-16T01:15:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.907+0000 7f60077fe640 1 -- 172.21.15.81:0/2104795224 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6010034470 con 0x7f6008003b70 2024-09-16T01:15:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.908+0000 7f60077fe640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f600c06c2b0 0x7f600c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.908+0000 7f60077fe640 1 -- 172.21.15.81:0/2104795224 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f60100abc40 con 0x7f6008003b70 2024-09-16T01:15:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.908+0000 7f601e59c640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f600c06c2b0 0x7f600c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.908+0000 7f601e59c640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f600c06c2b0 0x7f600c06e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6020161f90 tx=0x7f6014008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:57.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:57.912+0000 7f60077fe640 1 -- 172.21.15.81:0/2104795224 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f601007a070 con 0x7f6008003b70 2024-09-16T01:15:58.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.113+0000 7f602516d640 1 -- 172.21.15.81:0/2104795224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f60200b7300 con 0x7f6008003b70 2024-09-16T01:15:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.781+0000 7f60077fe640 1 -- 172.21.15.81:0/2104795224 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f6010079970 con 0x7f6008003b70 2024-09-16T01:15:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.784+0000 7f602516d640 1 -- 172.21.15.81:0/2104795224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f600c06c2b0 msgr2=0x7f600c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.784+0000 7f602516d640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f600c06c2b0 0x7f600c06e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6020161f90 tx=0x7f6014008040 comp rx=0 tx=0).stop 2024-09-16T01:15:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.784+0000 7f602516d640 1 -- 172.21.15.81:0/2104795224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6008003b70 msgr2=0x7f60200cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.784+0000 7f602516d640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6008003b70 0x7f60200cabe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6010007040 tx=0x7f6010001db0 comp rx=0 tx=0).stop 2024-09-16T01:15:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.784+0000 7f602516d640 1 -- 172.21.15.81:0/2104795224 shutdown_connections 2024-09-16T01:15:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.784+0000 7f602516d640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f600c06c2b0 0x7f600c06e770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.784+0000 7f602516d640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6020161350 0x7f60201617d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.784+0000 7f602516d640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f60200b9d70 0x7f60201519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.784+0000 7f602516d640 1 --2- 172.21.15.81:0/2104795224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6008003b70 0x7f60200cabe0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.784+0000 7f602516d640 1 -- 172.21.15.81:0/2104795224 >> 172.21.15.81:0/2104795224 conn(0x7f602008bfc0 msgr2=0x7f60200b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.784+0000 7f602516d640 1 -- 172.21.15.81:0/2104795224 shutdown_connections 2024-09-16T01:15:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.784+0000 7f602516d640 1 -- 172.21.15.81:0/2104795224 wait complete. 2024-09-16T01:15:58.798 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:15:58.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:15:58.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.895+0000 7ff694f11640 1 Processor -- start 2024-09-16T01:15:58.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.895+0000 7ff694f11640 1 -- start start 2024-09-16T01:15:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.895+0000 7ff694f11640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff69015e5f0 0x7ff6900d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff694f11640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6900d3690 con 0x7ff6900d30f0 2024-09-16T01:15:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff694f11640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6900d3970 con 0x7ff6900b6690 2024-09-16T01:15:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff694f11640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff69006d530 con 0x7ff69015e5f0 2024-09-16T01:15:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68dd9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff6900d30f0 0x7ff6900b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38390/0 (socket says 172.21.15.81:38390) 2024-09-16T01:15:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68dd9b640 1 -- 172.21.15.81:0/3952030098 learned_addr learned my addr 172.21.15.81:0/3952030098 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68e59c640 1 --2- 172.21.15.81:0/3952030098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff69015e5f0 0x7ff6900d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1415539450 0 0) 0x7ff6900d3690 con 0x7ff6900d30f0 2024-09-16T01:15:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff67c003520 con 0x7ff6900d30f0 2024-09-16T01:15:58.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 761189835 0 0) 0x7ff67c003520 con 0x7ff6900d30f0 2024-09-16T01:15:58.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff69015e5f0 msgr2=0x7ff6900d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:58.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 --2- 172.21.15.81:0/3952030098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff69015e5f0 0x7ff6900d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:58.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 >> v1:172.21.15.102:6789/0 conn(0x7ff6900b6690 legacy=0x7ff69006d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:58.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff69006cee0 con 0x7ff6900d30f0 2024-09-16T01:15:58.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7ff678001670 con 0x7ff6900d30f0 2024-09-16T01:15:58.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 >> v1:172.21.15.81:6789/0 conn(0x7ff6900d30f0 legacy=0x7ff6900b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:58.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 --2- 172.21.15.81:0/3952030098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff67c0039e0 0x7ff67c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:58.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 --2- 172.21.15.81:0/3952030098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff69015e5f0 0x7ff67c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:58.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 --2- 172.21.15.81:0/3952030098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c004d40 0x7ff67c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:58.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff69006d530 con 0x7ff67c004d40 2024-09-16T01:15:58.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c00b9c0 con 0x7ff67c0039e0 2024-09-16T01:15:58.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff67c00bbc0 con 0x7ff69015e5f0 2024-09-16T01:15:58.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68ed9d640 1 --2- 172.21.15.81:0/3952030098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c004d40 0x7ff67c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:58.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68e59c640 1 --2- 172.21.15.81:0/3952030098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff67c0039e0 0x7ff67c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:58.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.896+0000 7ff68dd9b640 1 --2- 172.21.15.81:0/3952030098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff69015e5f0 0x7ff67c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:58.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.897+0000 7ff68ed9d640 1 -- 172.21.15.81:0/3952030098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff69015e5f0 msgr2=0x7ff67c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:58.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.897+0000 7ff68ed9d640 1 --2- 172.21.15.81:0/3952030098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff69015e5f0 0x7ff67c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:58.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.897+0000 7ff68ed9d640 1 -- 172.21.15.81:0/3952030098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff67c0039e0 msgr2=0x7ff67c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:58.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.897+0000 7ff68ed9d640 1 --2- 172.21.15.81:0/3952030098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff67c0039e0 0x7ff67c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.897+0000 7ff68ed9d640 1 -- 172.21.15.81:0/3952030098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c003520 con 0x7ff67c004d40 2024-09-16T01:15:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.897+0000 7ff68ed9d640 1 --2- 172.21.15.81:0/3952030098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c004d40 0x7ff67c0051c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff680001860 tx=0x7ff67c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419b6a62fe5eb383 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.898+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff680037070 con 0x7ff67c004d40 2024-09-16T01:15:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.898+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff68002abf0 con 0x7ff67c004d40 2024-09-16T01:15:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.898+0000 7ff68d59a640 1 -- 172.21.15.81:0/3952030098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff680001430 con 0x7ff67c004d40 2024-09-16T01:15:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.898+0000 7ff694f11640 1 -- 172.21.15.81:0/3952030098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c004d40 msgr2=0x7ff67c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.898+0000 7ff694f11640 1 --2- 172.21.15.81:0/3952030098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c004d40 0x7ff67c0051c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff680001860 tx=0x7ff67c005830 comp rx=0 tx=0).stop 2024-09-16T01:15:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.898+0000 7ff68ed9d640 1 -- 172.21.15.81:0/3952030098 reap_dead start 2024-09-16T01:15:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.898+0000 7ff694f11640 1 -- 172.21.15.81:0/3952030098 shutdown_connections 2024-09-16T01:15:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.898+0000 7ff694f11640 1 -- 172.21.15.81:0/3952030098 >> 172.21.15.81:0/3952030098 conn(0x7ff69008bfc0 msgr2=0x7ff6900d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.898+0000 7ff694f11640 1 -- 172.21.15.81:0/3952030098 shutdown_connections 2024-09-16T01:15:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.898+0000 7ff694f11640 1 -- 172.21.15.81:0/3952030098 wait complete. 2024-09-16T01:15:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.899+0000 7ff694f11640 1 Processor -- start 2024-09-16T01:15:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.900+0000 7ff694f11640 1 -- start start 2024-09-16T01:15:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.900+0000 7ff694f11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c004d40 0x7ff690161710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.900+0000 7ff694f11640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6900b25d0 0x7ff6900cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.900+0000 7ff694f11640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6900b2a50 0x7ff690150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.900+0000 7ff694f11640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6900d4dd0 con 0x7ff67c004d40 2024-09-16T01:15:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.900+0000 7ff694f11640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff69015e9d0 con 0x7ff6900b2a50 2024-09-16T01:15:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.900+0000 7ff694f11640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff6900d4f50 con 0x7ff6900b25d0 2024-09-16T01:15:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.900+0000 7ff68e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c004d40 0x7ff690161710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.900+0000 7ff68e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c004d40 0x7ff690161710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60390/0 (socket says 172.21.15.81:60390) 2024-09-16T01:15:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.900+0000 7ff68e59c640 1 -- 172.21.15.81:0/551780419 learned_addr learned my addr 172.21.15.81:0/551780419 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.900+0000 7ff68dd9b640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6900b25d0 0x7ff6900cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.900+0000 7ff68ed9d640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6900b2a50 0x7ff690150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.901+0000 7ff68e59c640 1 -- 172.21.15.81:0/551780419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6900b25d0 msgr2=0x7ff6900cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.901+0000 7ff68e59c640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6900b25d0 0x7ff6900cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.901+0000 7ff68e59c640 1 -- 172.21.15.81:0/551780419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6900b2a50 msgr2=0x7ff690150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.901+0000 7ff68e59c640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6900b2a50 0x7ff690150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.901+0000 7ff68e59c640 1 -- 172.21.15.81:0/551780419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6900ccc20 con 0x7ff67c004d40 2024-09-16T01:15:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.901+0000 7ff68e59c640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c004d40 0x7ff690161710 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff688011e60 tx=0x7ff68800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.901+0000 7ff686ffd640 1 -- 172.21.15.81:0/551780419 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688015630 con 0x7ff67c004d40 2024-09-16T01:15:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.901+0000 7ff686ffd640 1 -- 172.21.15.81:0/551780419 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6880157d0 con 0x7ff67c004d40 2024-09-16T01:15:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.901+0000 7ff694f11640 1 -- 172.21.15.81:0/551780419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6900ccf00 con 0x7ff67c004d40 2024-09-16T01:15:58.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.901+0000 7ff686ffd640 1 -- 172.21.15.81:0/551780419 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff688015ba0 con 0x7ff67c004d40 2024-09-16T01:15:58.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.901+0000 7ff694f11640 1 -- 172.21.15.81:0/551780419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6900cd4c0 con 0x7ff67c004d40 2024-09-16T01:15:58.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.902+0000 7ff694f11640 1 -- 172.21.15.81:0/551780419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff69015ee20 con 0x7ff67c004d40 2024-09-16T01:15:58.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.902+0000 7ff686ffd640 1 -- 172.21.15.81:0/551780419 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff68801d400 con 0x7ff67c004d40 2024-09-16T01:15:58.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.903+0000 7ff686ffd640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff67006c2b0 0x7ff67006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:58.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.903+0000 7ff686ffd640 1 -- 172.21.15.81:0/551780419 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff68808c870 con 0x7ff67c004d40 2024-09-16T01:15:58.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.903+0000 7ff68dd9b640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff67006c2b0 0x7ff67006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:58.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.903+0000 7ff68dd9b640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff67006c2b0 0x7ff67006e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff678001050 tx=0x7ff678000f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:58.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:58.907+0000 7ff686ffd640 1 -- 172.21.15.81:0/551780419 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff688019030 con 0x7ff67c004d40 2024-09-16T01:15:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.105+0000 7ff694f11640 1 -- 172.21.15.81:0/551780419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6900b1bc0 con 0x7ff67c004d40 2024-09-16T01:15:59.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.106+0000 7ff686ffd640 1 -- 172.21.15.81:0/551780419 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7ff688010040 con 0x7ff67c004d40 2024-09-16T01:15:59.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:59.108 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-16T01:15:58:778268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1441310273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1441310273},{"type":"v1","addr":"172.21.15.102:6834","nonce":1441310273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1086586307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1086586307},{"type":"v1","addr":"172.21.15.102:6835","nonce":1086586307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4105201682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4105201682},{"type":"v1","addr":"172.21.15.81:6835","nonce":4105201682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:15:39.037094+0000","modified":"2024-09-16T01:15:58.115389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2354333316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2354333316},{"type":"v1","addr":"172.21.15.81:6837","nonce":2354333316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-16T01:15:59.108 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-16T01:15:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.108+0000 7ff694f11640 1 -- 172.21.15.81:0/551780419 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff67006c2b0 msgr2=0x7ff67006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.108+0000 7ff694f11640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff67006c2b0 0x7ff67006e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff678001050 tx=0x7ff678000f80 comp rx=0 tx=0).stop 2024-09-16T01:15:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.108+0000 7ff694f11640 1 -- 172.21.15.81:0/551780419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c004d40 msgr2=0x7ff690161710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.108+0000 7ff694f11640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c004d40 0x7ff690161710 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff688011e60 tx=0x7ff68800f580 comp rx=0 tx=0).stop 2024-09-16T01:15:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.108+0000 7ff694f11640 1 -- 172.21.15.81:0/551780419 shutdown_connections 2024-09-16T01:15:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.108+0000 7ff694f11640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff67006c2b0 0x7ff67006e770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.108+0000 7ff694f11640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6900b2a50 0x7ff690150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.108+0000 7ff694f11640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6900b25d0 0x7ff6900cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.108+0000 7ff694f11640 1 --2- 172.21.15.81:0/551780419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c004d40 0x7ff690161710 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.108+0000 7ff694f11640 1 -- 172.21.15.81:0/551780419 >> 172.21.15.81:0/551780419 conn(0x7ff69008bfc0 msgr2=0x7ff6900ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.108+0000 7ff694f11640 1 -- 172.21.15.81:0/551780419 shutdown_connections 2024-09-16T01:15:59.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.108+0000 7ff694f11640 1 -- 172.21.15.81:0/551780419 wait complete. 2024-09-16T01:15:59.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:15:59.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.216+0000 7fa4e3e80640 1 Processor -- start 2024-09-16T01:15:59.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.217+0000 7fa4e3e80640 1 -- start start 2024-09-16T01:15:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.217+0000 7fa4e3e80640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc15b340 0x7fa4dc09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.217+0000 7fa4e3e80640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc0b3830 con 0x7fa4dc0b5050 2024-09-16T01:15:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.217+0000 7fa4e3e80640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc0b5610 con 0x7fa4dc0b43f0 2024-09-16T01:15:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.217+0000 7fa4e3e80640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa4dc0b5bd0 con 0x7fa4dc15b340 2024-09-16T01:15:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e241d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa4dc0b5050 0x7fa4dc15b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38392/0 (socket says 172.21.15.81:38392) 2024-09-16T01:15:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e241d640 1 -- 172.21.15.81:0/3443032094 learned_addr learned my addr 172.21.15.81:0/3443032094 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:15:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e1c1c640 1 --2- 172.21.15.81:0/3443032094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc15b340 0x7fa4dc09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2045974392 0 0) 0x7fa4dc0b3830 con 0x7fa4dc0b5050 2024-09-16T01:15:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c8003520 con 0x7fa4dc0b5050 2024-09-16T01:15:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2152196160 0 0) 0x7fa4c8003520 con 0x7fa4dc0b5050 2024-09-16T01:15:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc15b340 msgr2=0x7fa4dc09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 --2- 172.21.15.81:0/3443032094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc15b340 0x7fa4dc09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 >> v1:172.21.15.102:6789/0 conn(0x7fa4dc0b43f0 legacy=0x7fa4dc0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc0b58f0 con 0x7fa4dc0b5050 2024-09-16T01:15:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fa4d40019f0 con 0x7fa4dc0b5050 2024-09-16T01:15:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 >> v1:172.21.15.81:6789/0 conn(0x7fa4dc0b5050 legacy=0x7fa4dc15b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 --2- 172.21.15.81:0/3443032094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc15b340 0x7fa4c80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 --2- 172.21.15.81:0/3443032094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c8003f60 0x7fa4c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 --2- 172.21.15.81:0/3443032094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4c8004d40 0x7fa4c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc0b5bd0 con 0x7fa4c8004d40 2024-09-16T01:15:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c800bb30 con 0x7fa4c8003f60 2024-09-16T01:15:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c800bd30 con 0x7fa4dc15b340 2024-09-16T01:15:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e241d640 1 --2- 172.21.15.81:0/3443032094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4c8004d40 0x7fa4c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e1c1c640 1 --2- 172.21.15.81:0/3443032094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc15b340 0x7fa4c80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.218+0000 7fa4e141b640 1 --2- 172.21.15.81:0/3443032094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c8003f60 0x7fa4c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.219+0000 7fa4e241d640 1 -- 172.21.15.81:0/3443032094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc15b340 msgr2=0x7fa4c80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.219+0000 7fa4e241d640 1 --2- 172.21.15.81:0/3443032094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc15b340 0x7fa4c80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.219+0000 7fa4e241d640 1 -- 172.21.15.81:0/3443032094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c8003f60 msgr2=0x7fa4c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.219+0000 7fa4e241d640 1 --2- 172.21.15.81:0/3443032094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c8003f60 0x7fa4c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.219+0000 7fa4e241d640 1 -- 172.21.15.81:0/3443032094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c8003520 con 0x7fa4c8004d40 2024-09-16T01:15:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.219+0000 7fa4e241d640 1 --2- 172.21.15.81:0/3443032094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4c8004d40 0x7fa4c80051c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400a860 tx=0x7fa4c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba44f28d200f51a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.219+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d400a480 con 0x7fa4c8004d40 2024-09-16T01:15:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.219+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d402f070 con 0x7fa4c8004d40 2024-09-16T01:15:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.219+0000 7fa4e0c1a640 1 -- 172.21.15.81:0/3443032094 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d402bd40 con 0x7fa4c8004d40 2024-09-16T01:15:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.220+0000 7fa4e3e80640 1 -- 172.21.15.81:0/3443032094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4c8004d40 msgr2=0x7fa4c80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.220+0000 7fa4e3e80640 1 --2- 172.21.15.81:0/3443032094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4c8004d40 0x7fa4c80051c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400a860 tx=0x7fa4c8005830 comp rx=0 tx=0).stop 2024-09-16T01:15:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.220+0000 7fa4e241d640 1 -- 172.21.15.81:0/3443032094 reap_dead start 2024-09-16T01:15:59.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.220+0000 7fa4e3e80640 1 -- 172.21.15.81:0/3443032094 shutdown_connections 2024-09-16T01:15:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.220+0000 7fa4e3e80640 1 -- 172.21.15.81:0/3443032094 >> 172.21.15.81:0/3443032094 conn(0x7fa4dc073490 msgr2=0x7fa4dc0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.220+0000 7fa4e3e80640 1 -- 172.21.15.81:0/3443032094 shutdown_connections 2024-09-16T01:15:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.220+0000 7fa4e3e80640 1 -- 172.21.15.81:0/3443032094 wait complete. 2024-09-16T01:15:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.221+0000 7fa4e3e80640 1 Processor -- start 2024-09-16T01:15:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.221+0000 7fa4e3e80640 1 -- start start 2024-09-16T01:15:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e3e80640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c8004d40 0x7fa4dc14db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e3e80640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc0d0990 0x7fa4dc150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e3e80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc150580 0x7fa4dc14e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e3e80640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc0cdb30 con 0x7fa4dc150580 2024-09-16T01:15:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e3e80640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc15d8f0 con 0x7fa4c8004d40 2024-09-16T01:15:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e3e80640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa4dc0cdcb0 con 0x7fa4dc0d0990 2024-09-16T01:15:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e241d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc150580 0x7fa4dc14e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e241d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc150580 0x7fa4dc14e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60398/0 (socket says 172.21.15.81:60398) 2024-09-16T01:15:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e241d640 1 -- 172.21.15.81:0/2536345684 learned_addr learned my addr 172.21.15.81:0/2536345684 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e141b640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc0d0990 0x7fa4dc150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e1c1c640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c8004d40 0x7fa4dc14db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e241d640 1 -- 172.21.15.81:0/2536345684 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc0d0990 msgr2=0x7fa4dc150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e241d640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc0d0990 0x7fa4dc150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e241d640 1 -- 172.21.15.81:0/2536345684 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c8004d40 msgr2=0x7fa4dc14db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e241d640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c8004d40 0x7fa4dc14db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e241d640 1 -- 172.21.15.81:0/2536345684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc0ce930 con 0x7fa4dc150580 2024-09-16T01:15:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.222+0000 7fa4e1c1c640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c8004d40 0x7fa4dc14db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:15:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.223+0000 7fa4e241d640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc150580 0x7fa4dc14e1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400a860 tx=0x7fa4dc0ae830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.223+0000 7fa4ce7fc640 1 -- 172.21.15.81:0/2536345684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d400a480 con 0x7fa4dc150580 2024-09-16T01:15:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.223+0000 7fa4ce7fc640 1 -- 172.21.15.81:0/2536345684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d4004b60 con 0x7fa4dc150580 2024-09-16T01:15:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.223+0000 7fa4ce7fc640 1 -- 172.21.15.81:0/2536345684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4034470 con 0x7fa4dc150580 2024-09-16T01:15:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.223+0000 7fa4e3e80640 1 -- 172.21.15.81:0/2536345684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4dc0ceba0 con 0x7fa4dc150580 2024-09-16T01:15:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.223+0000 7fa4e3e80640 1 -- 172.21.15.81:0/2536345684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4dc0cf160 con 0x7fa4dc150580 2024-09-16T01:15:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.224+0000 7fa4e3e80640 1 -- 172.21.15.81:0/2536345684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4dc09aa30 con 0x7fa4dc150580 2024-09-16T01:15:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.224+0000 7fa4ce7fc640 1 -- 172.21.15.81:0/2536345684 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa4d403e070 con 0x7fa4dc150580 2024-09-16T01:15:59.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.224+0000 7fa4ce7fc640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa4c006c250 0x7fa4c006e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.225+0000 7fa4ce7fc640 1 -- 172.21.15.81:0/2536345684 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa4d40ab740 con 0x7fa4dc150580 2024-09-16T01:15:59.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.225+0000 7fa4e1c1c640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa4c006c250 0x7fa4c006e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.225+0000 7fa4e1c1c640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa4c006c250 0x7fa4c006e710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009ab0 tx=0x7fa4d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:59.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.229+0000 7fa4ce7fc640 1 -- 172.21.15.81:0/2536345684 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4d4046060 con 0x7fa4dc150580 2024-09-16T01:15:59.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.395+0000 7fa4e3e80640 1 -- 172.21.15.81:0/2536345684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4dc157890 con 0x7fa4dc150580 2024-09-16T01:15:59.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.397+0000 7fa4ce7fc640 1 -- 172.21.15.81:0/2536345684 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18598 (secure 0 0 0) 0x7fa4d4079c00 con 0x7fa4dc150580 2024-09-16T01:15:59.398 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:59.399 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:44.092404+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:15:36.856888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:15:38.066938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:15:41.748133+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:15:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.398+0000 7fa4e3e80640 1 -- 172.21.15.81:0/2536345684 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa4c006c250 msgr2=0x7fa4c006e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.398+0000 7fa4e3e80640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa4c006c250 0x7fa4c006e710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009ab0 tx=0x7fa4d0008040 comp rx=0 tx=0).stop 2024-09-16T01:15:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.398+0000 7fa4e3e80640 1 -- 172.21.15.81:0/2536345684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc150580 msgr2=0x7fa4dc14e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.398+0000 7fa4e3e80640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc150580 0x7fa4dc14e1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400a860 tx=0x7fa4dc0ae830 comp rx=0 tx=0).stop 2024-09-16T01:15:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.398+0000 7fa4e3e80640 1 -- 172.21.15.81:0/2536345684 shutdown_connections 2024-09-16T01:15:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.398+0000 7fa4e3e80640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa4c006c250 0x7fa4c006e710 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.398+0000 7fa4e3e80640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4dc150580 0x7fa4dc14e1a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.398+0000 7fa4e3e80640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4dc0d0990 0x7fa4dc150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.398+0000 7fa4e3e80640 1 --2- 172.21.15.81:0/2536345684 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4c8004d40 0x7fa4dc14db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.398+0000 7fa4e3e80640 1 -- 172.21.15.81:0/2536345684 >> 172.21.15.81:0/2536345684 conn(0x7fa4dc073490 msgr2=0x7fa4dc06c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.399+0000 7fa4e3e80640 1 -- 172.21.15.81:0/2536345684 shutdown_connections 2024-09-16T01:15:59.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.399+0000 7fa4e3e80640 1 -- 172.21.15.81:0/2536345684 wait complete. 2024-09-16T01:15:59.412 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:15:59.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:15:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.508+0000 7f6080d68640 1 Processor -- start 2024-09-16T01:15:59.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.508+0000 7f6080d68640 1 -- start start 2024-09-16T01:15:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.509+0000 7f6080d68640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f607c15e760 0x7f607c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.509+0000 7f6080d68640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c0d4fd0 0x7f607c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.509+0000 7f6080d68640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f607c0d2700 con 0x7f607c0b3650 2024-09-16T01:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.509+0000 7f6080d68640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f607c0cedb0 con 0x7f607c15e760 2024-09-16T01:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.509+0000 7f6080d68640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f607c0cf090 con 0x7f607c0d4fd0 2024-09-16T01:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.509+0000 7f6071d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c0d4fd0 0x7f607c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.509+0000 7f6071d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c0d4fd0 0x7f607c0cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:57188/0 (socket says 172.21.15.81:57188) 2024-09-16T01:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.509+0000 7f6071d9b640 1 -- 172.21.15.81:0/2273365129 learned_addr learned my addr 172.21.15.81:0/2273365129 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.509+0000 7f607a59c640 1 --2- 172.21.15.81:0/2273365129 >> v2:172.21.15.102:3300/0 conn(0x7f607c15e760 0x7f607c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.510+0000 7f6071d9b640 1 -- 172.21.15.81:0/2273365129 >> v2:172.21.15.102:3300/0 conn(0x7f607c15e760 msgr2=0x7f607c06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.510+0000 7f6071d9b640 1 --2- 172.21.15.81:0/2273365129 >> v2:172.21.15.102:3300/0 conn(0x7f607c15e760 0x7f607c06cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.510+0000 7f6071d9b640 1 -- 172.21.15.81:0/2273365129 >> v1:172.21.15.102:6789/0 conn(0x7f607c0b3650 legacy=0x7f607c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.510+0000 7f6071d9b640 1 -- 172.21.15.81:0/2273365129 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607c0b3c80 con 0x7f607c0d4fd0 2024-09-16T01:15:59.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.510+0000 7f607a59c640 1 --2- 172.21.15.81:0/2273365129 >> v2:172.21.15.102:3300/0 conn(0x7f607c15e760 0x7f607c06cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.510+0000 7f6071d9b640 1 --2- 172.21.15.81:0/2273365129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c0d4fd0 0x7f607c0cf5b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6064009850 tx=0x7f606402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5889c64618769f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.511+0000 7f6079d9b640 1 -- 172.21.15.81:0/2273365129 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064004030 con 0x7f607c0d4fd0 2024-09-16T01:15:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.511+0000 7f6079d9b640 1 -- 172.21.15.81:0/2273365129 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60640041d0 con 0x7f607c0d4fd0 2024-09-16T01:15:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.511+0000 7f6079d9b640 1 -- 172.21.15.81:0/2273365129 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064003610 con 0x7f607c0d4fd0 2024-09-16T01:15:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.511+0000 7f6080d68640 1 -- 172.21.15.81:0/2273365129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c0d4fd0 msgr2=0x7f607c0cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.511+0000 7f6080d68640 1 --2- 172.21.15.81:0/2273365129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c0d4fd0 0x7f607c0cf5b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6064009850 tx=0x7f606402a1a0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.511+0000 7f6080d68640 1 -- 172.21.15.81:0/2273365129 shutdown_connections 2024-09-16T01:15:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.511+0000 7f6080d68640 1 --2- 172.21.15.81:0/2273365129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c0d4fd0 0x7f607c0cf5b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.511+0000 7f6080d68640 1 --2- 172.21.15.81:0/2273365129 >> v2:172.21.15.102:3300/0 conn(0x7f607c15e760 0x7f607c06cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.511+0000 7f6080d68640 1 -- 172.21.15.81:0/2273365129 >> 172.21.15.81:0/2273365129 conn(0x7f607c08bfc0 msgr2=0x7f607c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:59.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.511+0000 7f6080d68640 1 -- 172.21.15.81:0/2273365129 shutdown_connections 2024-09-16T01:15:59.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.511+0000 7f6080d68640 1 -- 172.21.15.81:0/2273365129 wait complete. 2024-09-16T01:15:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.513+0000 7f6080d68640 1 Processor -- start 2024-09-16T01:15:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.513+0000 7f6080d68640 1 -- start start 2024-09-16T01:15:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.513+0000 7f6080d68640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f607c0b3650 0x7f607c0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.513+0000 7f6080d68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f607c0d4fd0 0x7f607c0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.513+0000 7f6080d68640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c15e760 0x7f607c0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.513+0000 7f6080d68640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f607c0cfe80 con 0x7f607c0d4fd0 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.513+0000 7f6080d68640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f607c0cfd00 con 0x7f607c0b3650 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.513+0000 7f6080d68640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f607c0d35b0 con 0x7f607c15e760 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.513+0000 7f6071d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f607c0d4fd0 0x7f607c0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f6071d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f607c0d4fd0 0x7f607c0cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60414/0 (socket says 172.21.15.81:60414) 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f6071d9b640 1 -- 172.21.15.81:0/3217322024 learned_addr learned my addr 172.21.15.81:0/3217322024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f607a59c640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f607c0b3650 0x7f607c0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f607ad9d640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c15e760 0x7f607c0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f6071d9b640 1 -- 172.21.15.81:0/3217322024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c15e760 msgr2=0x7f607c0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f6071d9b640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c15e760 0x7f607c0cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f6071d9b640 1 -- 172.21.15.81:0/3217322024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f607c0b3650 msgr2=0x7f607c0cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f6071d9b640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f607c0b3650 0x7f607c0cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f6071d9b640 1 -- 172.21.15.81:0/3217322024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607c0ce050 con 0x7f607c0d4fd0 2024-09-16T01:15:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f607ad9d640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c15e760 0x7f607c0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f607a59c640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f607c0b3650 0x7f607c0cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:15:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f6071d9b640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f607c0d4fd0 0x7f607c0cd490 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f606402a1e0 tx=0x7f60640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f60737fe640 1 -- 172.21.15.81:0/3217322024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064041020 con 0x7f607c0d4fd0 2024-09-16T01:15:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f60737fe640 1 -- 172.21.15.81:0/3217322024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6064003c50 con 0x7f607c0d4fd0 2024-09-16T01:15:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f6080d68640 1 -- 172.21.15.81:0/3217322024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607c0ce330 con 0x7f607c0d4fd0 2024-09-16T01:15:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f60737fe640 1 -- 172.21.15.81:0/3217322024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064004030 con 0x7f607c0d4fd0 2024-09-16T01:15:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.514+0000 7f6080d68640 1 -- 172.21.15.81:0/3217322024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f607c15eb40 con 0x7f607c0d4fd0 2024-09-16T01:15:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.515+0000 7f6080d68640 1 -- 172.21.15.81:0/3217322024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f607c0d3930 con 0x7f607c0d4fd0 2024-09-16T01:15:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.516+0000 7f60737fe640 1 -- 172.21.15.81:0/3217322024 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6064044020 con 0x7f607c0d4fd0 2024-09-16T01:15:59.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.516+0000 7f60737fe640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f605c06c2b0 0x7f605c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.516+0000 7f60737fe640 1 -- 172.21.15.81:0/3217322024 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f60640ac0e0 con 0x7f607c0d4fd0 2024-09-16T01:15:59.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.516+0000 7f607a59c640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f605c06c2b0 0x7f605c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.517+0000 7f607a59c640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f605c06c2b0 0x7f605c06e770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f606c009560 tx=0x7f606c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.520+0000 7f60737fe640 1 -- 172.21.15.81:0/3217322024 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f606404b030 con 0x7f607c0d4fd0 2024-09-16T01:15:59.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.682+0000 7f6080d68640 1 -- 172.21.15.81:0/3217322024 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f607c15cb10 con 0x7f605c06c2b0 2024-09-16T01:15:59.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.690+0000 7f60737fe640 1 -- 172.21.15.81:0/3217322024 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f607c15cb10 con 0x7f605c06c2b0 2024-09-16T01:15:59.696 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:15:59.697 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:15:59.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.694+0000 7f6080d68640 1 -- 172.21.15.81:0/3217322024 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f605c06c2b0 msgr2=0x7f605c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.694+0000 7f6080d68640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f605c06c2b0 0x7f605c06e770 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f606c009560 tx=0x7f606c009190 comp rx=0 tx=0).stop 2024-09-16T01:15:59.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.694+0000 7f6080d68640 1 -- 172.21.15.81:0/3217322024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f607c0d4fd0 msgr2=0x7f607c0cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.694+0000 7f6080d68640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f607c0d4fd0 0x7f607c0cd490 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f606402a1e0 tx=0x7f60640046c0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.694+0000 7f6080d68640 1 -- 172.21.15.81:0/3217322024 shutdown_connections 2024-09-16T01:15:59.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.694+0000 7f6080d68640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f605c06c2b0 0x7f605c06e770 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.694+0000 7f6080d68640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f607c15e760 0x7f607c0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.694+0000 7f6080d68640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f607c0d4fd0 0x7f607c0cd490 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.694+0000 7f6080d68640 1 --2- 172.21.15.81:0/3217322024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f607c0b3650 0x7f607c0cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.694+0000 7f6080d68640 1 -- 172.21.15.81:0/3217322024 >> 172.21.15.81:0/3217322024 conn(0x7f607c08bfc0 msgr2=0x7f607c0d4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:59.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.694+0000 7f6080d68640 1 -- 172.21.15.81:0/3217322024 shutdown_connections 2024-09-16T01:15:59.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.694+0000 7f6080d68640 1 -- 172.21.15.81:0/3217322024 wait complete. 2024-09-16T01:15:59.707 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-16T01:15:58.062255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219432,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755288,"statfs":{"total":773094113280,"available":772869414912,"internally_reserved":0,"allocated":3284992,"data_stored":1992068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003163"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747622+0000","last_change":"2024-09-16T01:15:38.721067+0000","last_active":"2024-09-16T01:15:44.747622+0000","last_peered":"2024-09-16T01:15:44.747622+0000","last_clean":"2024-09-16T01:15:44.747622+0000","last_became_active":"2024-09-16T01:15:38.720869+0000","last_became_peered":"2024-09-16T01:15:38.720869+0000","last_unstale":"2024-09-16T01:15:44.747622+0000","last_undegraded":"2024-09-16T01:15:44.747622+0000","last_fullsized":"2024-09-16T01:15:44.747622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:37.356692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922559+0000","last_change":"2024-09-16T01:15:39.720014+0000","last_active":"2024-09-16T01:15:44.922559+0000","last_peered":"2024-09-16T01:15:44.922559+0000","last_clean":"2024-09-16T01:15:44.922559+0000","last_became_active":"2024-09-16T01:15:39.719700+0000","last_became_peered":"2024-09-16T01:15:39.719700+0000","last_unstale":"2024-09-16T01:15:44.922559+0000","last_undegraded":"2024-09-16T01:15:44.922559+0000","last_fullsized":"2024-09-16T01:15:44.922559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:15.851594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921951+0000","last_change":"2024-09-16T01:15:43.919879+0000","last_active":"2024-09-16T01:15:44.921951+0000","last_peered":"2024-09-16T01:15:44.921951+0000","last_clean":"2024-09-16T01:15:44.921951+0000","last_became_active":"2024-09-16T01:15:43.919471+0000","last_became_peered":"2024-09-16T01:15:43.919471+0000","last_unstale":"2024-09-16T01:15:44.921951+0000","last_undegraded":"2024-09-16T01:15:44.921951+0000","last_fullsized":"2024-09-16T01:15:44.921951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:48.711431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922637+0000","last_change":"2024-09-16T01:15:38.718512+0000","last_active":"2024-09-16T01:15:44.922637+0000","last_peered":"2024-09-16T01:15:44.922637+0000","last_clean":"2024-09-16T01:15:44.922637+0000","last_became_active":"2024-09-16T01:15:38.718193+0000","last_became_peered":"2024-09-16T01:15:38.718193+0000","last_unstale":"2024-09-16T01:15:44.922637+0000","last_undegraded":"2024-09-16T01:15:44.922637+0000","last_fullsized":"2024-09-16T01:15:44.922637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:36.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747347+0000","last_change":"2024-09-16T01:15:39.730526+0000","last_active":"2024-09-16T01:15:44.747347+0000","last_peered":"2024-09-16T01:15:44.747347+0000","last_clean":"2024-09-16T01:15:44.747347+0000","last_became_active":"2024-09-16T01:15:39.729904+0000","last_became_peered":"2024-09-16T01:15:39.729904+0000","last_unstale":"2024-09-16T01:15:44.747347+0000","last_undegraded":"2024-09-16T01:15:44.747347+0000","last_fullsized":"2024-09-16T01:15:44.747347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944132+0000","last_change":"2024-09-16T01:15:43.764125+0000","last_active":"2024-09-16T01:15:45.944132+0000","last_peered":"2024-09-16T01:15:45.944132+0000","last_clean":"2024-09-16T01:15:45.944132+0000","last_became_active":"2024-09-16T01:15:43.763689+0000","last_became_peered":"2024-09-16T01:15:43.763689+0000","last_unstale":"2024-09-16T01:15:45.944132+0000","last_undegraded":"2024-09-16T01:15:45.944132+0000","last_fullsized":"2024-09-16T01:15:45.944132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:36.873854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251413+0000","last_change":"2024-09-16T01:15:38.723925+0000","last_active":"2024-09-16T01:15:46.251413+0000","last_peered":"2024-09-16T01:15:46.251413+0000","last_clean":"2024-09-16T01:15:46.251413+0000","last_became_active":"2024-09-16T01:15:38.723660+0000","last_became_peered":"2024-09-16T01:15:38.723660+0000","last_unstale":"2024-09-16T01:15:46.251413+0000","last_undegraded":"2024-09-16T01:15:46.251413+0000","last_fullsized":"2024-09-16T01:15:46.251413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:50.843647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745352+0000","last_change":"2024-09-16T01:15:39.718658+0000","last_active":"2024-09-16T01:15:44.745352+0000","last_peered":"2024-09-16T01:15:44.745352+0000","last_clean":"2024-09-16T01:15:44.745352+0000","last_became_active":"2024-09-16T01:15:39.718360+0000","last_became_peered":"2024-09-16T01:15:39.718360+0000","last_unstale":"2024-09-16T01:15:44.745352+0000","last_undegraded":"2024-09-16T01:15:44.745352+0000","last_fullsized":"2024-09-16T01:15:44.745352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:51.270260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944453+0000","last_change":"2024-09-16T01:15:43.764643+0000","last_active":"2024-09-16T01:15:45.944453+0000","last_peered":"2024-09-16T01:15:45.944453+0000","last_clean":"2024-09-16T01:15:45.944453+0000","last_became_active":"2024-09-16T01:15:43.764229+0000","last_became_peered":"2024-09-16T01:15:43.764229+0000","last_unstale":"2024-09-16T01:15:45.944453+0000","last_undegraded":"2024-09-16T01:15:45.944453+0000","last_fullsized":"2024-09-16T01:15:45.944453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:57.315283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251049+0000","last_change":"2024-09-16T01:15:38.721191+0000","last_active":"2024-09-16T01:15:46.251049+0000","last_peered":"2024-09-16T01:15:46.251049+0000","last_clean":"2024-09-16T01:15:46.251049+0000","last_became_active":"2024-09-16T01:15:38.720832+0000","last_became_peered":"2024-09-16T01:15:38.720832+0000","last_unstale":"2024-09-16T01:15:46.251049+0000","last_undegraded":"2024-09-16T01:15:46.251049+0000","last_fullsized":"2024-09-16T01:15:46.251049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:35.717778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745724+0000","last_change":"2024-09-16T01:15:39.718836+0000","last_active":"2024-09-16T01:15:44.745724+0000","last_peered":"2024-09-16T01:15:44.745724+0000","last_clean":"2024-09-16T01:15:44.745724+0000","last_became_active":"2024-09-16T01:15:39.718367+0000","last_became_peered":"2024-09-16T01:15:39.718367+0000","last_unstale":"2024-09-16T01:15:44.745724+0000","last_undegraded":"2024-09-16T01:15:44.745724+0000","last_fullsized":"2024-09-16T01:15:44.745724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:39.132954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944337+0000","last_change":"2024-09-16T01:15:43.762123+0000","last_active":"2024-09-16T01:15:45.944337+0000","last_peered":"2024-09-16T01:15:45.944337+0000","last_clean":"2024-09-16T01:15:45.944337+0000","last_became_active":"2024-09-16T01:15:43.761634+0000","last_became_peered":"2024-09-16T01:15:43.761634+0000","last_unstale":"2024-09-16T01:15:45.944337+0000","last_undegraded":"2024-09-16T01:15:45.944337+0000","last_fullsized":"2024-09-16T01:15:45.944337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:26.316809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746166+0000","last_change":"2024-09-16T01:15:39.718972+0000","last_active":"2024-09-16T01:15:44.746166+0000","last_peered":"2024-09-16T01:15:44.746166+0000","last_clean":"2024-09-16T01:15:44.746166+0000","last_became_active":"2024-09-16T01:15:39.718666+0000","last_became_peered":"2024-09-16T01:15:39.718666+0000","last_unstale":"2024-09-16T01:15:44.746166+0000","last_undegraded":"2024-09-16T01:15:44.746166+0000","last_fullsized":"2024-09-16T01:15:44.746166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.166842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251231+0000","last_change":"2024-09-16T01:15:38.726840+0000","last_active":"2024-09-16T01:15:46.251231+0000","last_peered":"2024-09-16T01:15:46.251231+0000","last_clean":"2024-09-16T01:15:46.251231+0000","last_became_active":"2024-09-16T01:15:38.726541+0000","last_became_peered":"2024-09-16T01:15:38.726541+0000","last_unstale":"2024-09-16T01:15:46.251231+0000","last_undegraded":"2024-09-16T01:15:46.251231+0000","last_fullsized":"2024-09-16T01:15:46.251231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:54.657992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944947+0000","last_change":"2024-09-16T01:15:43.764429+0000","last_active":"2024-09-16T01:15:45.944947+0000","last_peered":"2024-09-16T01:15:45.944947+0000","last_clean":"2024-09-16T01:15:45.944947+0000","last_became_active":"2024-09-16T01:15:43.763453+0000","last_became_peered":"2024-09-16T01:15:43.763453+0000","last_unstale":"2024-09-16T01:15:45.944947+0000","last_undegraded":"2024-09-16T01:15:45.944947+0000","last_fullsized":"2024-09-16T01:15:45.944947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:54.978121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922348+0000","last_change":"2024-09-16T01:15:39.729023+0000","last_active":"2024-09-16T01:15:44.922348+0000","last_peered":"2024-09-16T01:15:44.922348+0000","last_clean":"2024-09-16T01:15:44.922348+0000","last_became_active":"2024-09-16T01:15:39.728164+0000","last_became_peered":"2024-09-16T01:15:39.728164+0000","last_unstale":"2024-09-16T01:15:44.922348+0000","last_undegraded":"2024-09-16T01:15:44.922348+0000","last_fullsized":"2024-09-16T01:15:44.922348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817115+0000","last_change":"2024-09-16T01:15:38.712201+0000","last_active":"2024-09-16T01:15:44.817115+0000","last_peered":"2024-09-16T01:15:44.817115+0000","last_clean":"2024-09-16T01:15:44.817115+0000","last_became_active":"2024-09-16T01:15:38.711909+0000","last_became_peered":"2024-09-16T01:15:38.711909+0000","last_unstale":"2024-09-16T01:15:44.817115+0000","last_undegraded":"2024-09-16T01:15:44.817115+0000","last_fullsized":"2024-09-16T01:15:44.817115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:46.439923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944544+0000","last_change":"2024-09-16T01:15:43.764651+0000","last_active":"2024-09-16T01:15:45.944544+0000","last_peered":"2024-09-16T01:15:45.944544+0000","last_clean":"2024-09-16T01:15:45.944544+0000","last_became_active":"2024-09-16T01:15:43.764198+0000","last_became_peered":"2024-09-16T01:15:43.764198+0000","last_unstale":"2024-09-16T01:15:45.944544+0000","last_undegraded":"2024-09-16T01:15:45.944544+0000","last_fullsized":"2024-09-16T01:15:45.944544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:55.307076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921967+0000","last_change":"2024-09-16T01:15:39.730357+0000","last_active":"2024-09-16T01:15:44.921967+0000","last_peered":"2024-09-16T01:15:44.921967+0000","last_clean":"2024-09-16T01:15:44.921967+0000","last_became_active":"2024-09-16T01:15:39.728252+0000","last_became_peered":"2024-09-16T01:15:39.728252+0000","last_unstale":"2024-09-16T01:15:44.921967+0000","last_undegraded":"2024-09-16T01:15:44.921967+0000","last_fullsized":"2024-09-16T01:15:44.921967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816830+0000","last_change":"2024-09-16T01:15:38.716181+0000","last_active":"2024-09-16T01:15:44.816830+0000","last_peered":"2024-09-16T01:15:44.816830+0000","last_clean":"2024-09-16T01:15:44.816830+0000","last_became_active":"2024-09-16T01:15:38.715894+0000","last_became_peered":"2024-09-16T01:15:38.715894+0000","last_unstale":"2024-09-16T01:15:44.816830+0000","last_undegraded":"2024-09-16T01:15:44.816830+0000","last_fullsized":"2024-09-16T01:15:44.816830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:58.925739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817629+0000","last_change":"2024-09-16T01:15:43.921354+0000","last_active":"2024-09-16T01:15:44.817629+0000","last_peered":"2024-09-16T01:15:44.817629+0000","last_clean":"2024-09-16T01:15:44.817629+0000","last_became_active":"2024-09-16T01:15:43.919480+0000","last_became_peered":"2024-09-16T01:15:43.919480+0000","last_unstale":"2024-09-16T01:15:44.817629+0000","last_undegraded":"2024-09-16T01:15:44.817629+0000","last_fullsized":"2024-09-16T01:15:44.817629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:34.196444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944562+0000","last_change":"2024-09-16T01:15:39.722840+0000","last_active":"2024-09-16T01:15:45.944562+0000","last_peered":"2024-09-16T01:15:45.944562+0000","last_clean":"2024-09-16T01:15:45.944562+0000","last_became_active":"2024-09-16T01:15:39.722566+0000","last_became_peered":"2024-09-16T01:15:39.722566+0000","last_unstale":"2024-09-16T01:15:45.944562+0000","last_undegraded":"2024-09-16T01:15:45.944562+0000","last_fullsized":"2024-09-16T01:15:45.944562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.000406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250736+0000","last_change":"2024-09-16T01:15:38.722591+0000","last_active":"2024-09-16T01:15:46.250736+0000","last_peered":"2024-09-16T01:15:46.250736+0000","last_clean":"2024-09-16T01:15:46.250736+0000","last_became_active":"2024-09-16T01:15:38.722331+0000","last_became_peered":"2024-09-16T01:15:38.722331+0000","last_unstale":"2024-09-16T01:15:46.250736+0000","last_undegraded":"2024-09-16T01:15:46.250736+0000","last_fullsized":"2024-09-16T01:15:46.250736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:58.925739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944801+0000","last_change":"2024-09-16T01:15:43.763545+0000","last_active":"2024-09-16T01:15:45.944801+0000","last_peered":"2024-09-16T01:15:45.944801+0000","last_clean":"2024-09-16T01:15:45.944801+0000","last_became_active":"2024-09-16T01:15:43.763123+0000","last_became_peered":"2024-09-16T01:15:43.763123+0000","last_unstale":"2024-09-16T01:15:45.944801+0000","last_undegraded":"2024-09-16T01:15:45.944801+0000","last_fullsized":"2024-09-16T01:15:45.944801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:27.078175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747527+0000","last_change":"2024-09-16T01:15:39.721956+0000","last_active":"2024-09-16T01:15:44.747527+0000","last_peered":"2024-09-16T01:15:44.747527+0000","last_clean":"2024-09-16T01:15:44.747527+0000","last_became_active":"2024-09-16T01:15:39.721349+0000","last_became_peered":"2024-09-16T01:15:39.721349+0000","last_unstale":"2024-09-16T01:15:44.747527+0000","last_undegraded":"2024-09-16T01:15:44.747527+0000","last_fullsized":"2024-09-16T01:15:44.747527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.089581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746703+0000","last_change":"2024-09-16T01:15:38.717450+0000","last_active":"2024-09-16T01:15:44.746703+0000","last_peered":"2024-09-16T01:15:44.746703+0000","last_clean":"2024-09-16T01:15:44.746703+0000","last_became_active":"2024-09-16T01:15:38.717143+0000","last_became_peered":"2024-09-16T01:15:38.717143+0000","last_unstale":"2024-09-16T01:15:44.746703+0000","last_undegraded":"2024-09-16T01:15:44.746703+0000","last_fullsized":"2024-09-16T01:15:44.746703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:46.439923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944225+0000","last_change":"2024-09-16T01:15:43.920611+0000","last_active":"2024-09-16T01:15:45.944225+0000","last_peered":"2024-09-16T01:15:45.944225+0000","last_clean":"2024-09-16T01:15:45.944225+0000","last_became_active":"2024-09-16T01:15:43.920154+0000","last_became_peered":"2024-09-16T01:15:43.920154+0000","last_unstale":"2024-09-16T01:15:45.944225+0000","last_undegraded":"2024-09-16T01:15:45.944225+0000","last_fullsized":"2024-09-16T01:15:45.944225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:43.169770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922664+0000","last_change":"2024-09-16T01:15:39.727833+0000","last_active":"2024-09-16T01:15:44.922664+0000","last_peered":"2024-09-16T01:15:44.922664+0000","last_clean":"2024-09-16T01:15:44.922664+0000","last_became_active":"2024-09-16T01:15:39.727573+0000","last_became_peered":"2024-09-16T01:15:39.727573+0000","last_unstale":"2024-09-16T01:15:44.922664+0000","last_undegraded":"2024-09-16T01:15:44.922664+0000","last_fullsized":"2024-09-16T01:15:44.922664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:22.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817625+0000","last_change":"2024-09-16T01:15:38.707107+0000","last_active":"2024-09-16T01:15:44.817625+0000","last_peered":"2024-09-16T01:15:44.817625+0000","last_clean":"2024-09-16T01:15:44.817625+0000","last_became_active":"2024-09-16T01:15:38.706848+0000","last_became_peered":"2024-09-16T01:15:38.706848+0000","last_unstale":"2024-09-16T01:15:44.817625+0000","last_undegraded":"2024-09-16T01:15:44.817625+0000","last_fullsized":"2024-09-16T01:15:44.817625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:08.518045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922236+0000","last_change":"2024-09-16T01:15:43.921496+0000","last_active":"2024-09-16T01:15:44.922236+0000","last_peered":"2024-09-16T01:15:44.922236+0000","last_clean":"2024-09-16T01:15:44.922236+0000","last_became_active":"2024-09-16T01:15:43.920197+0000","last_became_peered":"2024-09-16T01:15:43.920197+0000","last_unstale":"2024-09-16T01:15:44.922236+0000","last_undegraded":"2024-09-16T01:15:44.922236+0000","last_fullsized":"2024-09-16T01:15:44.922236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:09.951543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817435+0000","last_change":"2024-09-16T01:15:39.723117+0000","last_active":"2024-09-16T01:15:44.817435+0000","last_peered":"2024-09-16T01:15:44.817435+0000","last_clean":"2024-09-16T01:15:44.817435+0000","last_became_active":"2024-09-16T01:15:39.722836+0000","last_became_peered":"2024-09-16T01:15:39.722836+0000","last_unstale":"2024-09-16T01:15:44.817435+0000","last_undegraded":"2024-09-16T01:15:44.817435+0000","last_fullsized":"2024-09-16T01:15:44.817435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251484+0000","last_change":"2024-09-16T01:15:38.722596+0000","last_active":"2024-09-16T01:15:46.251484+0000","last_peered":"2024-09-16T01:15:46.251484+0000","last_clean":"2024-09-16T01:15:46.251484+0000","last_became_active":"2024-09-16T01:15:38.722356+0000","last_became_peered":"2024-09-16T01:15:38.722356+0000","last_unstale":"2024-09-16T01:15:46.251484+0000","last_undegraded":"2024-09-16T01:15:46.251484+0000","last_fullsized":"2024-09-16T01:15:46.251484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:31.352796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747052+0000","last_change":"2024-09-16T01:15:43.921163+0000","last_active":"2024-09-16T01:15:44.747052+0000","last_peered":"2024-09-16T01:15:44.747052+0000","last_clean":"2024-09-16T01:15:44.747052+0000","last_became_active":"2024-09-16T01:15:43.920789+0000","last_became_peered":"2024-09-16T01:15:43.920789+0000","last_unstale":"2024-09-16T01:15:44.747052+0000","last_undegraded":"2024-09-16T01:15:44.747052+0000","last_fullsized":"2024-09-16T01:15:44.747052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:24.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745802+0000","last_change":"2024-09-16T01:15:39.721863+0000","last_active":"2024-09-16T01:15:44.745802+0000","last_peered":"2024-09-16T01:15:44.745802+0000","last_clean":"2024-09-16T01:15:44.745802+0000","last_became_active":"2024-09-16T01:15:39.721445+0000","last_became_peered":"2024-09-16T01:15:39.721445+0000","last_unstale":"2024-09-16T01:15:44.745802+0000","last_undegraded":"2024-09-16T01:15:44.745802+0000","last_fullsized":"2024-09-16T01:15:44.745802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:53.278467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817489+0000","last_change":"2024-09-16T01:15:38.718239+0000","last_active":"2024-09-16T01:15:44.817489+0000","last_peered":"2024-09-16T01:15:44.817489+0000","last_clean":"2024-09-16T01:15:44.817489+0000","last_became_active":"2024-09-16T01:15:38.717981+0000","last_became_peered":"2024-09-16T01:15:38.717981+0000","last_unstale":"2024-09-16T01:15:44.817489+0000","last_undegraded":"2024-09-16T01:15:44.817489+0000","last_fullsized":"2024-09-16T01:15:44.817489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:35.717778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816857+0000","last_change":"2024-09-16T01:15:43.759115+0000","last_active":"2024-09-16T01:15:44.816857+0000","last_peered":"2024-09-16T01:15:44.816857+0000","last_clean":"2024-09-16T01:15:44.816857+0000","last_became_active":"2024-09-16T01:15:43.758725+0000","last_became_peered":"2024-09-16T01:15:43.758725+0000","last_unstale":"2024-09-16T01:15:44.816857+0000","last_undegraded":"2024-09-16T01:15:44.816857+0000","last_fullsized":"2024-09-16T01:15:44.816857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:27.078175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944821+0000","last_change":"2024-09-16T01:15:39.723087+0000","last_active":"2024-09-16T01:15:45.944821+0000","last_peered":"2024-09-16T01:15:45.944821+0000","last_clean":"2024-09-16T01:15:45.944821+0000","last_became_active":"2024-09-16T01:15:39.722204+0000","last_became_peered":"2024-09-16T01:15:39.722204+0000","last_unstale":"2024-09-16T01:15:45.944821+0000","last_undegraded":"2024-09-16T01:15:45.944821+0000","last_fullsized":"2024-09-16T01:15:45.944821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:36.723734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746291+0000","last_change":"2024-09-16T01:15:38.717252+0000","last_active":"2024-09-16T01:15:44.746291+0000","last_peered":"2024-09-16T01:15:44.746291+0000","last_clean":"2024-09-16T01:15:44.746291+0000","last_became_active":"2024-09-16T01:15:38.716781+0000","last_became_peered":"2024-09-16T01:15:38.716781+0000","last_unstale":"2024-09-16T01:15:44.746291+0000","last_undegraded":"2024-09-16T01:15:44.746291+0000","last_fullsized":"2024-09-16T01:15:44.746291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:58.925739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817388+0000","last_change":"2024-09-16T01:15:43.760901+0000","last_active":"2024-09-16T01:15:44.817388+0000","last_peered":"2024-09-16T01:15:44.817388+0000","last_clean":"2024-09-16T01:15:44.817388+0000","last_became_active":"2024-09-16T01:15:43.758844+0000","last_became_peered":"2024-09-16T01:15:43.758844+0000","last_unstale":"2024-09-16T01:15:44.817388+0000","last_undegraded":"2024-09-16T01:15:44.817388+0000","last_fullsized":"2024-09-16T01:15:44.817388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:23.908567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816870+0000","last_change":"2024-09-16T01:15:39.723832+0000","last_active":"2024-09-16T01:15:44.816870+0000","last_peered":"2024-09-16T01:15:44.816870+0000","last_clean":"2024-09-16T01:15:44.816870+0000","last_became_active":"2024-09-16T01:15:39.723596+0000","last_became_peered":"2024-09-16T01:15:39.723596+0000","last_unstale":"2024-09-16T01:15:44.816870+0000","last_undegraded":"2024-09-16T01:15:44.816870+0000","last_fullsized":"2024-09-16T01:15:44.816870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644673+0000","last_change":"2024-09-16T01:15:38.713951+0000","last_active":"2024-09-16T01:15:46.644673+0000","last_peered":"2024-09-16T01:15:46.644673+0000","last_clean":"2024-09-16T01:15:46.644673+0000","last_became_active":"2024-09-16T01:15:38.713670+0000","last_became_peered":"2024-09-16T01:15:38.713670+0000","last_unstale":"2024-09-16T01:15:46.644673+0000","last_undegraded":"2024-09-16T01:15:46.644673+0000","last_fullsized":"2024-09-16T01:15:46.644673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:24.701682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817651+0000","last_change":"2024-09-16T01:15:43.760201+0000","last_active":"2024-09-16T01:15:44.817651+0000","last_peered":"2024-09-16T01:15:44.817651+0000","last_clean":"2024-09-16T01:15:44.817651+0000","last_became_active":"2024-09-16T01:15:43.759329+0000","last_became_peered":"2024-09-16T01:15:43.759329+0000","last_unstale":"2024-09-16T01:15:44.817651+0000","last_undegraded":"2024-09-16T01:15:44.817651+0000","last_fullsized":"2024-09-16T01:15:44.817651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:00.235274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746870+0000","last_change":"2024-09-16T01:15:39.719776+0000","last_active":"2024-09-16T01:15:44.746870+0000","last_peered":"2024-09-16T01:15:44.746870+0000","last_clean":"2024-09-16T01:15:44.746870+0000","last_became_active":"2024-09-16T01:15:39.719492+0000","last_became_peered":"2024-09-16T01:15:39.719492+0000","last_unstale":"2024-09-16T01:15:44.746870+0000","last_undegraded":"2024-09-16T01:15:44.746870+0000","last_fullsized":"2024-09-16T01:15:44.746870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:18.272881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250816+0000","last_change":"2024-09-16T01:15:38.722446+0000","last_active":"2024-09-16T01:15:46.250816+0000","last_peered":"2024-09-16T01:15:46.250816+0000","last_clean":"2024-09-16T01:15:46.250816+0000","last_became_active":"2024-09-16T01:15:38.722134+0000","last_became_peered":"2024-09-16T01:15:38.722134+0000","last_unstale":"2024-09-16T01:15:46.250816+0000","last_undegraded":"2024-09-16T01:15:46.250816+0000","last_fullsized":"2024-09-16T01:15:46.250816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:43.994450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747413+0000","last_change":"2024-09-16T01:15:43.921254+0000","last_active":"2024-09-16T01:15:44.747413+0000","last_peered":"2024-09-16T01:15:44.747413+0000","last_clean":"2024-09-16T01:15:44.747413+0000","last_became_active":"2024-09-16T01:15:43.920320+0000","last_became_peered":"2024-09-16T01:15:43.920320+0000","last_unstale":"2024-09-16T01:15:44.747413+0000","last_undegraded":"2024-09-16T01:15:44.747413+0000","last_fullsized":"2024-09-16T01:15:44.747413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:23.908567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921967+0000","last_change":"2024-09-16T01:15:39.729053+0000","last_active":"2024-09-16T01:15:44.921967+0000","last_peered":"2024-09-16T01:15:44.921967+0000","last_clean":"2024-09-16T01:15:44.921967+0000","last_became_active":"2024-09-16T01:15:39.727897+0000","last_became_peered":"2024-09-16T01:15:39.727897+0000","last_unstale":"2024-09-16T01:15:44.921967+0000","last_undegraded":"2024-09-16T01:15:44.921967+0000","last_fullsized":"2024-09-16T01:15:44.921967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745582+0000","last_change":"2024-09-16T01:15:38.712828+0000","last_active":"2024-09-16T01:15:44.745582+0000","last_peered":"2024-09-16T01:15:44.745582+0000","last_clean":"2024-09-16T01:15:44.745582+0000","last_became_active":"2024-09-16T01:15:38.712543+0000","last_became_peered":"2024-09-16T01:15:38.712543+0000","last_unstale":"2024-09-16T01:15:44.745582+0000","last_undegraded":"2024-09-16T01:15:44.745582+0000","last_fullsized":"2024-09-16T01:15:44.745582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:52.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250598+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:15:46.250598+0000","last_peered":"2024-09-16T01:15:46.250598+0000","last_clean":"2024-09-16T01:15:46.250598+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:15:46.250598+0000","last_undegraded":"2024-09-16T01:15:46.250598+0000","last_fullsized":"2024-09-16T01:15:46.250598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745908+0000","last_change":"2024-09-16T01:15:43.920489+0000","last_active":"2024-09-16T01:15:44.745908+0000","last_peered":"2024-09-16T01:15:44.745908+0000","last_clean":"2024-09-16T01:15:44.745908+0000","last_became_active":"2024-09-16T01:15:43.920110+0000","last_became_peered":"2024-09-16T01:15:43.920110+0000","last_unstale":"2024-09-16T01:15:44.745908+0000","last_undegraded":"2024-09-16T01:15:44.745908+0000","last_fullsized":"2024-09-16T01:15:44.745908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:57.315283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251313+0000","last_change":"2024-09-16T01:15:39.728812+0000","last_active":"2024-09-16T01:15:46.251313+0000","last_peered":"2024-09-16T01:15:46.251313+0000","last_clean":"2024-09-16T01:15:46.251313+0000","last_became_active":"2024-09-16T01:15:39.728567+0000","last_became_peered":"2024-09-16T01:15:39.728567+0000","last_unstale":"2024-09-16T01:15:46.251313+0000","last_undegraded":"2024-09-16T01:15:46.251313+0000","last_fullsized":"2024-09-16T01:15:46.251313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:50.941305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644951+0000","last_change":"2024-09-16T01:15:38.714874+0000","last_active":"2024-09-16T01:15:46.644951+0000","last_peered":"2024-09-16T01:15:46.644951+0000","last_clean":"2024-09-16T01:15:46.644951+0000","last_became_active":"2024-09-16T01:15:38.714594+0000","last_became_peered":"2024-09-16T01:15:38.714594+0000","last_unstale":"2024-09-16T01:15:46.644951+0000","last_undegraded":"2024-09-16T01:15:46.644951+0000","last_fullsized":"2024-09-16T01:15:46.644951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:42.942780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746039+0000","last_change":"2024-09-16T01:15:43.917212+0000","last_active":"2024-09-16T01:15:44.746039+0000","last_peered":"2024-09-16T01:15:44.746039+0000","last_clean":"2024-09-16T01:15:44.746039+0000","last_became_active":"2024-09-16T01:15:43.916799+0000","last_became_peered":"2024-09-16T01:15:43.916799+0000","last_unstale":"2024-09-16T01:15:44.746039+0000","last_undegraded":"2024-09-16T01:15:44.746039+0000","last_fullsized":"2024-09-16T01:15:44.746039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:55.307076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745452+0000","last_change":"2024-09-16T01:15:39.716325+0000","last_active":"2024-09-16T01:15:44.745452+0000","last_peered":"2024-09-16T01:15:44.745452+0000","last_clean":"2024-09-16T01:15:44.745452+0000","last_became_active":"2024-09-16T01:15:39.716048+0000","last_became_peered":"2024-09-16T01:15:39.716048+0000","last_unstale":"2024-09-16T01:15:44.745452+0000","last_undegraded":"2024-09-16T01:15:44.745452+0000","last_fullsized":"2024-09-16T01:15:44.745452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:20.730699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817475+0000","last_change":"2024-09-16T01:15:38.710438+0000","last_active":"2024-09-16T01:15:44.817475+0000","last_peered":"2024-09-16T01:15:44.817475+0000","last_clean":"2024-09-16T01:15:44.817475+0000","last_became_active":"2024-09-16T01:15:38.710126+0000","last_became_peered":"2024-09-16T01:15:38.710126+0000","last_unstale":"2024-09-16T01:15:44.817475+0000","last_undegraded":"2024-09-16T01:15:44.817475+0000","last_fullsized":"2024-09-16T01:15:44.817475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:50.843647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747422+0000","last_change":"2024-09-16T01:15:43.755716+0000","last_active":"2024-09-16T01:15:44.747422+0000","last_peered":"2024-09-16T01:15:44.747422+0000","last_clean":"2024-09-16T01:15:44.747422+0000","last_became_active":"2024-09-16T01:15:43.755284+0000","last_became_peered":"2024-09-16T01:15:43.755284+0000","last_unstale":"2024-09-16T01:15:44.747422+0000","last_undegraded":"2024-09-16T01:15:44.747422+0000","last_fullsized":"2024-09-16T01:15:44.747422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:34.196444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251434+0000","last_change":"2024-09-16T01:15:39.721173+0000","last_active":"2024-09-16T01:15:46.251434+0000","last_peered":"2024-09-16T01:15:46.251434+0000","last_clean":"2024-09-16T01:15:46.251434+0000","last_became_active":"2024-09-16T01:15:39.720757+0000","last_became_peered":"2024-09-16T01:15:39.720757+0000","last_unstale":"2024-09-16T01:15:46.251434+0000","last_undegraded":"2024-09-16T01:15:46.251434+0000","last_fullsized":"2024-09-16T01:15:46.251434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:44.674615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644910+0000","last_change":"2024-09-16T01:15:38.713886+0000","last_active":"2024-09-16T01:15:46.644910+0000","last_peered":"2024-09-16T01:15:46.644910+0000","last_clean":"2024-09-16T01:15:46.644910+0000","last_became_active":"2024-09-16T01:15:38.713596+0000","last_became_peered":"2024-09-16T01:15:38.713596+0000","last_unstale":"2024-09-16T01:15:46.644910+0000","last_undegraded":"2024-09-16T01:15:46.644910+0000","last_fullsized":"2024-09-16T01:15:46.644910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:52.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744816+0000","last_change":"2024-09-16T01:15:43.917236+0000","last_active":"2024-09-16T01:15:44.744816+0000","last_peered":"2024-09-16T01:15:44.744816+0000","last_clean":"2024-09-16T01:15:44.744816+0000","last_became_active":"2024-09-16T01:15:43.916784+0000","last_became_peered":"2024-09-16T01:15:43.916784+0000","last_unstale":"2024-09-16T01:15:44.744816+0000","last_undegraded":"2024-09-16T01:15:44.744816+0000","last_fullsized":"2024-09-16T01:15:44.744816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:48.711431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251384+0000","last_change":"2024-09-16T01:15:39.721477+0000","last_active":"2024-09-16T01:15:46.251384+0000","last_peered":"2024-09-16T01:15:46.251384+0000","last_clean":"2024-09-16T01:15:46.251384+0000","last_became_active":"2024-09-16T01:15:39.720755+0000","last_became_peered":"2024-09-16T01:15:39.720755+0000","last_unstale":"2024-09-16T01:15:46.251384+0000","last_undegraded":"2024-09-16T01:15:46.251384+0000","last_fullsized":"2024-09-16T01:15:46.251384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:56.198457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944995+0000","last_change":"2024-09-16T01:15:38.718410+0000","last_active":"2024-09-16T01:15:45.944995+0000","last_peered":"2024-09-16T01:15:45.944995+0000","last_clean":"2024-09-16T01:15:45.944995+0000","last_became_active":"2024-09-16T01:15:38.718113+0000","last_became_peered":"2024-09-16T01:15:38.718113+0000","last_unstale":"2024-09-16T01:15:45.944995+0000","last_undegraded":"2024-09-16T01:15:45.944995+0000","last_fullsized":"2024-09-16T01:15:45.944995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:36.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944193+0000","last_change":"2024-09-16T01:15:43.763443+0000","last_active":"2024-09-16T01:15:45.944193+0000","last_peered":"2024-09-16T01:15:45.944193+0000","last_clean":"2024-09-16T01:15:45.944193+0000","last_became_active":"2024-09-16T01:15:43.763064+0000","last_became_peered":"2024-09-16T01:15:43.763064+0000","last_unstale":"2024-09-16T01:15:45.944193+0000","last_undegraded":"2024-09-16T01:15:45.944193+0000","last_fullsized":"2024-09-16T01:15:45.944193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:19.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251116+0000","last_change":"2024-09-16T01:15:39.721525+0000","last_active":"2024-09-16T01:15:46.251116+0000","last_peered":"2024-09-16T01:15:46.251116+0000","last_clean":"2024-09-16T01:15:46.251116+0000","last_became_active":"2024-09-16T01:15:39.721282+0000","last_became_peered":"2024-09-16T01:15:39.721282+0000","last_unstale":"2024-09-16T01:15:46.251116+0000","last_undegraded":"2024-09-16T01:15:46.251116+0000","last_fullsized":"2024-09-16T01:15:46.251116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:53.278467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644540+0000","last_change":"2024-09-16T01:15:38.716594+0000","last_active":"2024-09-16T01:15:46.644540+0000","last_peered":"2024-09-16T01:15:46.644540+0000","last_clean":"2024-09-16T01:15:46.644540+0000","last_became_active":"2024-09-16T01:15:38.716327+0000","last_became_peered":"2024-09-16T01:15:38.716327+0000","last_unstale":"2024-09-16T01:15:46.644540+0000","last_undegraded":"2024-09-16T01:15:46.644540+0000","last_fullsized":"2024-09-16T01:15:46.644540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:44.803896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747246+0000","last_change":"2024-09-16T01:15:43.763464+0000","last_active":"2024-09-16T01:15:44.747246+0000","last_peered":"2024-09-16T01:15:44.747246+0000","last_clean":"2024-09-16T01:15:44.747246+0000","last_became_active":"2024-09-16T01:15:43.763095+0000","last_became_peered":"2024-09-16T01:15:43.763095+0000","last_unstale":"2024-09-16T01:15:44.747246+0000","last_undegraded":"2024-09-16T01:15:44.747246+0000","last_fullsized":"2024-09-16T01:15:44.747246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:54.978121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745408+0000","last_change":"2024-09-16T01:15:39.726106+0000","last_active":"2024-09-16T01:15:44.745408+0000","last_peered":"2024-09-16T01:15:44.745408+0000","last_clean":"2024-09-16T01:15:44.745408+0000","last_became_active":"2024-09-16T01:15:39.725833+0000","last_became_peered":"2024-09-16T01:15:39.725833+0000","last_unstale":"2024-09-16T01:15:44.745408+0000","last_undegraded":"2024-09-16T01:15:44.745408+0000","last_fullsized":"2024-09-16T01:15:44.745408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745838+0000","last_change":"2024-09-16T01:15:38.710514+0000","last_active":"2024-09-16T01:15:44.745838+0000","last_peered":"2024-09-16T01:15:44.745838+0000","last_clean":"2024-09-16T01:15:44.745838+0000","last_became_active":"2024-09-16T01:15:38.710185+0000","last_became_peered":"2024-09-16T01:15:38.710185+0000","last_unstale":"2024-09-16T01:15:44.745838+0000","last_undegraded":"2024-09-16T01:15:44.745838+0000","last_fullsized":"2024-09-16T01:15:44.745838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:42.942780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922611+0000","last_change":"2024-09-16T01:15:43.919233+0000","last_active":"2024-09-16T01:15:44.922611+0000","last_peered":"2024-09-16T01:15:44.922611+0000","last_clean":"2024-09-16T01:15:44.922611+0000","last_became_active":"2024-09-16T01:15:43.918866+0000","last_became_peered":"2024-09-16T01:15:43.918866+0000","last_unstale":"2024-09-16T01:15:44.922611+0000","last_undegraded":"2024-09-16T01:15:44.922611+0000","last_fullsized":"2024-09-16T01:15:44.922611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:15.298412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251002+0000","last_change":"2024-09-16T01:15:39.722459+0000","last_active":"2024-09-16T01:15:46.251002+0000","last_peered":"2024-09-16T01:15:46.251002+0000","last_clean":"2024-09-16T01:15:46.251002+0000","last_became_active":"2024-09-16T01:15:39.722016+0000","last_became_peered":"2024-09-16T01:15:39.722016+0000","last_unstale":"2024-09-16T01:15:46.251002+0000","last_undegraded":"2024-09-16T01:15:46.251002+0000","last_fullsized":"2024-09-16T01:15:46.251002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:20.730699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746247+0000","last_change":"2024-09-16T01:15:38.715930+0000","last_active":"2024-09-16T01:15:44.746247+0000","last_peered":"2024-09-16T01:15:44.746247+0000","last_clean":"2024-09-16T01:15:44.746247+0000","last_became_active":"2024-09-16T01:15:38.715602+0000","last_became_peered":"2024-09-16T01:15:38.715602+0000","last_unstale":"2024-09-16T01:15:44.746247+0000","last_undegraded":"2024-09-16T01:15:44.746247+0000","last_fullsized":"2024-09-16T01:15:44.746247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:08.518045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922632+0000","last_change":"2024-09-16T01:15:43.917197+0000","last_active":"2024-09-16T01:15:44.922632+0000","last_peered":"2024-09-16T01:15:44.922632+0000","last_clean":"2024-09-16T01:15:44.922632+0000","last_became_active":"2024-09-16T01:15:43.916694+0000","last_became_peered":"2024-09-16T01:15:43.916694+0000","last_unstale":"2024-09-16T01:15:44.922632+0000","last_undegraded":"2024-09-16T01:15:44.922632+0000","last_fullsized":"2024-09-16T01:15:44.922632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:03:54.915059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747227+0000","last_change":"2024-09-16T01:15:39.731508+0000","last_active":"2024-09-16T01:15:44.747227+0000","last_peered":"2024-09-16T01:15:44.747227+0000","last_clean":"2024-09-16T01:15:44.747227+0000","last_became_active":"2024-09-16T01:15:39.730663+0000","last_became_peered":"2024-09-16T01:15:39.730663+0000","last_unstale":"2024-09-16T01:15:44.747227+0000","last_undegraded":"2024-09-16T01:15:44.747227+0000","last_fullsized":"2024-09-16T01:15:44.747227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:52.736329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747663+0000","last_change":"2024-09-16T01:15:38.715147+0000","last_active":"2024-09-16T01:15:44.747663+0000","last_peered":"2024-09-16T01:15:44.747663+0000","last_clean":"2024-09-16T01:15:44.747663+0000","last_became_active":"2024-09-16T01:15:38.714378+0000","last_became_peered":"2024-09-16T01:15:38.714378+0000","last_unstale":"2024-09-16T01:15:44.747663+0000","last_undegraded":"2024-09-16T01:15:44.747663+0000","last_fullsized":"2024-09-16T01:15:44.747663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:36.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745684+0000","last_change":"2024-09-16T01:15:43.917886+0000","last_active":"2024-09-16T01:15:44.745684+0000","last_peered":"2024-09-16T01:15:44.745684+0000","last_clean":"2024-09-16T01:15:44.745684+0000","last_became_active":"2024-09-16T01:15:43.917474+0000","last_became_peered":"2024-09-16T01:15:43.917474+0000","last_unstale":"2024-09-16T01:15:44.745684+0000","last_undegraded":"2024-09-16T01:15:44.745684+0000","last_fullsized":"2024-09-16T01:15:44.745684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:08.989590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251072+0000","last_change":"2024-09-16T01:15:39.727254+0000","last_active":"2024-09-16T01:15:46.251072+0000","last_peered":"2024-09-16T01:15:46.251072+0000","last_clean":"2024-09-16T01:15:46.251072+0000","last_became_active":"2024-09-16T01:15:39.726904+0000","last_became_peered":"2024-09-16T01:15:39.726904+0000","last_unstale":"2024-09-16T01:15:46.251072+0000","last_undegraded":"2024-09-16T01:15:46.251072+0000","last_fullsized":"2024-09-16T01:15:46.251072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:23.041359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:49.106598+0000","last_change":"2024-09-16T01:15:38.716774+0000","last_active":"2024-09-16T01:15:49.106598+0000","last_peered":"2024-09-16T01:15:49.106598+0000","last_clean":"2024-09-16T01:15:49.106598+0000","last_became_active":"2024-09-16T01:15:38.716441+0000","last_became_peered":"2024-09-16T01:15:38.716441+0000","last_unstale":"2024-09-16T01:15:49.106598+0000","last_undegraded":"2024-09-16T01:15:49.106598+0000","last_fullsized":"2024-09-16T01:15:49.106598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:08.518045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816941+0000","last_change":"2024-09-16T01:15:43.760938+0000","last_active":"2024-09-16T01:15:44.816941+0000","last_peered":"2024-09-16T01:15:44.816941+0000","last_clean":"2024-09-16T01:15:44.816941+0000","last_became_active":"2024-09-16T01:15:43.759362+0000","last_became_peered":"2024-09-16T01:15:43.759362+0000","last_unstale":"2024-09-16T01:15:44.816941+0000","last_undegraded":"2024-09-16T01:15:44.816941+0000","last_fullsized":"2024-09-16T01:15:44.816941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:54.978121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944687+0000","last_change":"2024-09-16T01:15:39.724557+0000","last_active":"2024-09-16T01:15:45.944687+0000","last_peered":"2024-09-16T01:15:45.944687+0000","last_clean":"2024-09-16T01:15:45.944687+0000","last_became_active":"2024-09-16T01:15:39.724253+0000","last_became_peered":"2024-09-16T01:15:39.724253+0000","last_unstale":"2024-09-16T01:15:45.944687+0000","last_undegraded":"2024-09-16T01:15:45.944687+0000","last_fullsized":"2024-09-16T01:15:45.944687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:51.849603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817542+0000","last_change":"2024-09-16T01:15:38.712961+0000","last_active":"2024-09-16T01:15:44.817542+0000","last_peered":"2024-09-16T01:15:44.817542+0000","last_clean":"2024-09-16T01:15:44.817542+0000","last_became_active":"2024-09-16T01:15:38.712701+0000","last_became_peered":"2024-09-16T01:15:38.712701+0000","last_unstale":"2024-09-16T01:15:44.817542+0000","last_undegraded":"2024-09-16T01:15:44.817542+0000","last_fullsized":"2024-09-16T01:15:44.817542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:43.994450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944656+0000","last_change":"2024-09-16T01:15:43.765439+0000","last_active":"2024-09-16T01:15:45.944656+0000","last_peered":"2024-09-16T01:15:45.944656+0000","last_clean":"2024-09-16T01:15:45.944656+0000","last_became_active":"2024-09-16T01:15:43.765020+0000","last_became_peered":"2024-09-16T01:15:43.765020+0000","last_unstale":"2024-09-16T01:15:45.944656+0000","last_undegraded":"2024-09-16T01:15:45.944656+0000","last_fullsized":"2024-09-16T01:15:45.944656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:24.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747568+0000","last_change":"2024-09-16T01:15:39.730738+0000","last_active":"2024-09-16T01:15:44.747568+0000","last_peered":"2024-09-16T01:15:44.747568+0000","last_clean":"2024-09-16T01:15:44.747568+0000","last_became_active":"2024-09-16T01:15:39.730255+0000","last_became_peered":"2024-09-16T01:15:39.730255+0000","last_unstale":"2024-09-16T01:15:44.747568+0000","last_undegraded":"2024-09-16T01:15:44.747568+0000","last_fullsized":"2024-09-16T01:15:44.747568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745379+0000","last_change":"2024-09-16T01:15:38.715232+0000","last_active":"2024-09-16T01:15:44.745379+0000","last_peered":"2024-09-16T01:15:44.745379+0000","last_clean":"2024-09-16T01:15:44.745379+0000","last_became_active":"2024-09-16T01:15:38.714944+0000","last_became_peered":"2024-09-16T01:15:38.714944+0000","last_unstale":"2024-09-16T01:15:44.745379+0000","last_undegraded":"2024-09-16T01:15:44.745379+0000","last_fullsized":"2024-09-16T01:15:44.745379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:24.701682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921870+0000","last_change":"2024-09-16T01:15:43.758834+0000","last_active":"2024-09-16T01:15:44.921870+0000","last_peered":"2024-09-16T01:15:44.921870+0000","last_clean":"2024-09-16T01:15:44.921870+0000","last_became_active":"2024-09-16T01:15:43.758362+0000","last_became_peered":"2024-09-16T01:15:43.758362+0000","last_unstale":"2024-09-16T01:15:44.921870+0000","last_undegraded":"2024-09-16T01:15:44.921870+0000","last_fullsized":"2024-09-16T01:15:44.921870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:10.924601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745261+0000","last_change":"2024-09-16T01:15:39.723043+0000","last_active":"2024-09-16T01:15:44.745261+0000","last_peered":"2024-09-16T01:15:44.745261+0000","last_clean":"2024-09-16T01:15:44.745261+0000","last_became_active":"2024-09-16T01:15:39.722068+0000","last_became_peered":"2024-09-16T01:15:39.722068+0000","last_unstale":"2024-09-16T01:15:44.745261+0000","last_undegraded":"2024-09-16T01:15:44.745261+0000","last_fullsized":"2024-09-16T01:15:44.745261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:15.851594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746622+0000","last_change":"2024-09-16T01:15:38.712075+0000","last_active":"2024-09-16T01:15:44.746622+0000","last_peered":"2024-09-16T01:15:44.746622+0000","last_clean":"2024-09-16T01:15:44.746622+0000","last_became_active":"2024-09-16T01:15:38.711796+0000","last_became_peered":"2024-09-16T01:15:38.711796+0000","last_unstale":"2024-09-16T01:15:44.746622+0000","last_undegraded":"2024-09-16T01:15:44.746622+0000","last_fullsized":"2024-09-16T01:15:44.746622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:24.701682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922056+0000","last_change":"2024-09-16T01:15:43.920754+0000","last_active":"2024-09-16T01:15:44.922056+0000","last_peered":"2024-09-16T01:15:44.922056+0000","last_clean":"2024-09-16T01:15:44.922056+0000","last_became_active":"2024-09-16T01:15:43.919569+0000","last_became_peered":"2024-09-16T01:15:43.919569+0000","last_unstale":"2024-09-16T01:15:44.922056+0000","last_undegraded":"2024-09-16T01:15:44.922056+0000","last_fullsized":"2024-09-16T01:15:44.922056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:08.989590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747159+0000","last_change":"2024-09-16T01:15:43.921667+0000","last_active":"2024-09-16T01:15:44.747159+0000","last_peered":"2024-09-16T01:15:44.747159+0000","last_clean":"2024-09-16T01:15:44.747159+0000","last_became_active":"2024-09-16T01:15:43.921261+0000","last_became_peered":"2024-09-16T01:15:43.921261+0000","last_unstale":"2024-09-16T01:15:44.747159+0000","last_undegraded":"2024-09-16T01:15:44.747159+0000","last_fullsized":"2024-09-16T01:15:44.747159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:27.078175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816721+0000","last_change":"2024-09-16T01:15:39.715516+0000","last_active":"2024-09-16T01:15:44.816721+0000","last_peered":"2024-09-16T01:15:44.816721+0000","last_clean":"2024-09-16T01:15:44.816721+0000","last_became_active":"2024-09-16T01:15:39.715303+0000","last_became_peered":"2024-09-16T01:15:39.715303+0000","last_unstale":"2024-09-16T01:15:44.816721+0000","last_undegraded":"2024-09-16T01:15:44.816721+0000","last_fullsized":"2024-09-16T01:15:44.816721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744965+0000","last_change":"2024-09-16T01:15:38.709515+0000","last_active":"2024-09-16T01:15:44.744965+0000","last_peered":"2024-09-16T01:15:44.744965+0000","last_clean":"2024-09-16T01:15:44.744965+0000","last_became_active":"2024-09-16T01:15:38.708945+0000","last_became_peered":"2024-09-16T01:15:38.708945+0000","last_unstale":"2024-09-16T01:15:44.744965+0000","last_undegraded":"2024-09-16T01:15:44.744965+0000","last_fullsized":"2024-09-16T01:15:44.744965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:46.439923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746558+0000","last_change":"2024-09-16T01:15:43.763256+0000","last_active":"2024-09-16T01:15:44.746558+0000","last_peered":"2024-09-16T01:15:44.746558+0000","last_clean":"2024-09-16T01:15:44.746558+0000","last_became_active":"2024-09-16T01:15:43.762837+0000","last_became_peered":"2024-09-16T01:15:43.762837+0000","last_unstale":"2024-09-16T01:15:44.746558+0000","last_undegraded":"2024-09-16T01:15:44.746558+0000","last_fullsized":"2024-09-16T01:15:44.746558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:24.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921881+0000","last_change":"2024-09-16T01:15:39.727402+0000","last_active":"2024-09-16T01:15:44.921881+0000","last_peered":"2024-09-16T01:15:44.921881+0000","last_clean":"2024-09-16T01:15:44.921881+0000","last_became_active":"2024-09-16T01:15:39.726906+0000","last_became_peered":"2024-09-16T01:15:39.726906+0000","last_unstale":"2024-09-16T01:15:44.921881+0000","last_undegraded":"2024-09-16T01:15:44.921881+0000","last_fullsized":"2024-09-16T01:15:44.921881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.166842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922185+0000","last_change":"2024-09-16T01:15:38.707171+0000","last_active":"2024-09-16T01:15:44.922185+0000","last_peered":"2024-09-16T01:15:44.922185+0000","last_clean":"2024-09-16T01:15:44.922185+0000","last_became_active":"2024-09-16T01:15:38.706905+0000","last_became_peered":"2024-09-16T01:15:38.706905+0000","last_unstale":"2024-09-16T01:15:44.922185+0000","last_undegraded":"2024-09-16T01:15:44.922185+0000","last_fullsized":"2024-09-16T01:15:44.922185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:42.942780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746293+0000","last_change":"2024-09-16T01:15:38.709634+0000","last_active":"2024-09-16T01:15:44.746293+0000","last_peered":"2024-09-16T01:15:44.746293+0000","last_clean":"2024-09-16T01:15:44.746293+0000","last_became_active":"2024-09-16T01:15:38.709327+0000","last_became_peered":"2024-09-16T01:15:38.709327+0000","last_unstale":"2024-09-16T01:15:44.746293+0000","last_undegraded":"2024-09-16T01:15:44.746293+0000","last_fullsized":"2024-09-16T01:15:44.746293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:52.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747564+0000","last_change":"2024-09-16T01:15:39.722400+0000","last_active":"2024-09-16T01:15:44.747564+0000","last_peered":"2024-09-16T01:15:44.747564+0000","last_clean":"2024-09-16T01:15:44.747564+0000","last_became_active":"2024-09-16T01:15:39.722125+0000","last_became_peered":"2024-09-16T01:15:39.722125+0000","last_unstale":"2024-09-16T01:15:44.747564+0000","last_undegraded":"2024-09-16T01:15:44.747564+0000","last_fullsized":"2024-09-16T01:15:44.747564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644833+0000","last_change":"2024-09-16T01:15:43.756363+0000","last_active":"2024-09-16T01:15:46.644833+0000","last_peered":"2024-09-16T01:15:46.644833+0000","last_clean":"2024-09-16T01:15:46.644833+0000","last_became_active":"2024-09-16T01:15:43.755986+0000","last_became_peered":"2024-09-16T01:15:43.755986+0000","last_unstale":"2024-09-16T01:15:46.644833+0000","last_undegraded":"2024-09-16T01:15:46.644833+0000","last_fullsized":"2024-09-16T01:15:46.644833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:59.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922374+0000","last_change":"2024-09-16T01:15:38.717144+0000","last_active":"2024-09-16T01:15:44.922374+0000","last_peered":"2024-09-16T01:15:44.922374+0000","last_clean":"2024-09-16T01:15:44.922374+0000","last_became_active":"2024-09-16T01:15:38.716925+0000","last_became_peered":"2024-09-16T01:15:38.716925+0000","last_unstale":"2024-09-16T01:15:44.922374+0000","last_undegraded":"2024-09-16T01:15:44.922374+0000","last_fullsized":"2024-09-16T01:15:44.922374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:44.803896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944458+0000","last_change":"2024-09-16T01:15:39.720645+0000","last_active":"2024-09-16T01:15:45.944458+0000","last_peered":"2024-09-16T01:15:45.944458+0000","last_clean":"2024-09-16T01:15:45.944458+0000","last_became_active":"2024-09-16T01:15:39.720391+0000","last_became_peered":"2024-09-16T01:15:39.720391+0000","last_unstale":"2024-09-16T01:15:45.944458+0000","last_undegraded":"2024-09-16T01:15:45.944458+0000","last_fullsized":"2024-09-16T01:15:45.944458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:09.524001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922230+0000","last_change":"2024-09-16T01:15:43.761796+0000","last_active":"2024-09-16T01:15:44.922230+0000","last_peered":"2024-09-16T01:15:44.922230+0000","last_clean":"2024-09-16T01:15:44.922230+0000","last_became_active":"2024-09-16T01:15:43.761242+0000","last_became_peered":"2024-09-16T01:15:43.761242+0000","last_unstale":"2024-09-16T01:15:44.922230+0000","last_undegraded":"2024-09-16T01:15:44.922230+0000","last_fullsized":"2024-09-16T01:15:44.922230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:41.757039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745300+0000","last_change":"2024-09-16T01:15:39.726420+0000","last_active":"2024-09-16T01:15:44.745300+0000","last_peered":"2024-09-16T01:15:44.745300+0000","last_clean":"2024-09-16T01:15:44.745300+0000","last_became_active":"2024-09-16T01:15:39.726142+0000","last_became_peered":"2024-09-16T01:15:39.726142+0000","last_unstale":"2024-09-16T01:15:44.745300+0000","last_undegraded":"2024-09-16T01:15:44.745300+0000","last_fullsized":"2024-09-16T01:15:44.745300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644670+0000","last_change":"2024-09-16T01:15:39.708234+0000","last_active":"2024-09-16T01:15:46.644670+0000","last_peered":"2024-09-16T01:15:46.644670+0000","last_clean":"2024-09-16T01:15:46.644670+0000","last_became_active":"2024-09-16T01:15:39.707935+0000","last_became_peered":"2024-09-16T01:15:39.707935+0000","last_unstale":"2024-09-16T01:15:46.644670+0000","last_undegraded":"2024-09-16T01:15:46.644670+0000","last_fullsized":"2024-09-16T01:15:46.644670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.000406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746151+0000","last_change":"2024-09-16T01:15:39.716296+0000","last_active":"2024-09-16T01:15:44.746151+0000","last_peered":"2024-09-16T01:15:44.746151+0000","last_clean":"2024-09-16T01:15:44.746151+0000","last_became_active":"2024-09-16T01:15:39.715998+0000","last_became_peered":"2024-09-16T01:15:39.715998+0000","last_unstale":"2024-09-16T01:15:44.746151+0000","last_undegraded":"2024-09-16T01:15:44.746151+0000","last_fullsized":"2024-09-16T01:15:44.746151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:19.871750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747461+0000","last_change":"2024-09-16T01:15:39.732779+0000","last_active":"2024-09-16T01:15:44.747461+0000","last_peered":"2024-09-16T01:15:44.747461+0000","last_clean":"2024-09-16T01:15:44.747461+0000","last_became_active":"2024-09-16T01:15:39.732514+0000","last_became_peered":"2024-09-16T01:15:39.732514+0000","last_unstale":"2024-09-16T01:15:44.747461+0000","last_undegraded":"2024-09-16T01:15:44.747461+0000","last_fullsized":"2024-09-16T01:15:44.747461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922366+0000","last_change":"2024-09-16T01:15:39.732741+0000","last_active":"2024-09-16T01:15:44.922366+0000","last_peered":"2024-09-16T01:15:44.922366+0000","last_clean":"2024-09-16T01:15:44.922366+0000","last_became_active":"2024-09-16T01:15:39.732480+0000","last_became_peered":"2024-09-16T01:15:39.732480+0000","last_unstale":"2024-09-16T01:15:44.922366+0000","last_undegraded":"2024-09-16T01:15:44.922366+0000","last_fullsized":"2024-09-16T01:15:44.922366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:32.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817305+0000","last_change":"2024-09-16T01:15:39.721673+0000","last_active":"2024-09-16T01:15:44.817305+0000","last_peered":"2024-09-16T01:15:44.817305+0000","last_clean":"2024-09-16T01:15:44.817305+0000","last_became_active":"2024-09-16T01:15:39.721038+0000","last_became_peered":"2024-09-16T01:15:39.721038+0000","last_unstale":"2024-09-16T01:15:44.817305+0000","last_undegraded":"2024-09-16T01:15:44.817305+0000","last_fullsized":"2024-09-16T01:15:44.817305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:32.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746704+0000","last_change":"2024-09-16T01:15:39.725684+0000","last_active":"2024-09-16T01:15:44.746704+0000","last_peered":"2024-09-16T01:15:44.746704+0000","last_clean":"2024-09-16T01:15:44.746704+0000","last_became_active":"2024-09-16T01:15:39.725383+0000","last_became_peered":"2024-09-16T01:15:39.725383+0000","last_unstale":"2024-09-16T01:15:44.746704+0000","last_undegraded":"2024-09-16T01:15:44.746704+0000","last_fullsized":"2024-09-16T01:15:44.746704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922579+0000","last_change":"2024-09-16T01:15:39.732120+0000","last_active":"2024-09-16T01:15:44.922579+0000","last_peered":"2024-09-16T01:15:44.922579+0000","last_clean":"2024-09-16T01:15:44.922579+0000","last_became_active":"2024-09-16T01:15:39.731874+0000","last_became_peered":"2024-09-16T01:15:39.731874+0000","last_unstale":"2024-09-16T01:15:44.922579+0000","last_undegraded":"2024-09-16T01:15:44.922579+0000","last_fullsized":"2024-09-16T01:15:44.922579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:39.132954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744949+0000","last_change":"2024-09-16T01:15:39.714218+0000","last_active":"2024-09-16T01:15:44.744949+0000","last_peered":"2024-09-16T01:15:44.744949+0000","last_clean":"2024-09-16T01:15:44.744949+0000","last_became_active":"2024-09-16T01:15:39.713937+0000","last_became_peered":"2024-09-16T01:15:39.713937+0000","last_unstale":"2024-09-16T01:15:44.744949+0000","last_undegraded":"2024-09-16T01:15:44.744949+0000","last_fullsized":"2024-09-16T01:15:44.744949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:32.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922164+0000","last_change":"2024-09-16T01:15:39.733311+0000","last_active":"2024-09-16T01:15:44.922164+0000","last_peered":"2024-09-16T01:15:44.922164+0000","last_clean":"2024-09-16T01:15:44.922164+0000","last_became_active":"2024-09-16T01:15:39.733144+0000","last_became_peered":"2024-09-16T01:15:39.733144+0000","last_unstale":"2024-09-16T01:15:44.922164+0000","last_undegraded":"2024-09-16T01:15:44.922164+0000","last_fullsized":"2024-09-16T01:15:44.922164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746055+0000","last_change":"2024-09-16T01:15:39.724420+0000","last_active":"2024-09-16T01:15:44.746055+0000","last_peered":"2024-09-16T01:15:44.746055+0000","last_clean":"2024-09-16T01:15:44.746055+0000","last_became_active":"2024-09-16T01:15:39.723819+0000","last_became_peered":"2024-09-16T01:15:39.723819+0000","last_unstale":"2024-09-16T01:15:44.746055+0000","last_undegraded":"2024-09-16T01:15:44.746055+0000","last_fullsized":"2024-09-16T01:15:44.746055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:50.941305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747222+0000","last_change":"2024-09-16T01:15:39.723569+0000","last_active":"2024-09-16T01:15:44.747222+0000","last_peered":"2024-09-16T01:15:44.747222+0000","last_clean":"2024-09-16T01:15:44.747222+0000","last_became_active":"2024-09-16T01:15:39.723316+0000","last_became_peered":"2024-09-16T01:15:39.723316+0000","last_unstale":"2024-09-16T01:15:44.747222+0000","last_undegraded":"2024-09-16T01:15:44.747222+0000","last_fullsized":"2024-09-16T01:15:44.747222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746161+0000","last_change":"2024-09-16T01:15:39.719774+0000","last_active":"2024-09-16T01:15:44.746161+0000","last_peered":"2024-09-16T01:15:44.746161+0000","last_clean":"2024-09-16T01:15:44.746161+0000","last_became_active":"2024-09-16T01:15:39.719499+0000","last_became_peered":"2024-09-16T01:15:39.719499+0000","last_unstale":"2024-09-16T01:15:44.746161+0000","last_undegraded":"2024-09-16T01:15:44.746161+0000","last_fullsized":"2024-09-16T01:15:44.746161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251449+0000","last_change":"2024-09-16T01:15:39.724488+0000","last_active":"2024-09-16T01:15:46.251449+0000","last_peered":"2024-09-16T01:15:46.251449+0000","last_clean":"2024-09-16T01:15:46.251449+0000","last_became_active":"2024-09-16T01:15:39.724205+0000","last_became_peered":"2024-09-16T01:15:39.724205+0000","last_unstale":"2024-09-16T01:15:46.251449+0000","last_undegraded":"2024-09-16T01:15:46.251449+0000","last_fullsized":"2024-09-16T01:15:46.251449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:06.887785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644890+0000","last_change":"2024-09-16T01:15:39.712637+0000","last_active":"2024-09-16T01:15:46.644890+0000","last_peered":"2024-09-16T01:15:46.644890+0000","last_clean":"2024-09-16T01:15:46.644890+0000","last_became_active":"2024-09-16T01:15:39.712015+0000","last_became_peered":"2024-09-16T01:15:39.712015+0000","last_unstale":"2024-09-16T01:15:46.644890+0000","last_undegraded":"2024-09-16T01:15:46.644890+0000","last_fullsized":"2024-09-16T01:15:46.644890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:51.849603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745814+0000","last_change":"2024-09-16T01:15:39.722757+0000","last_active":"2024-09-16T01:15:44.745814+0000","last_peered":"2024-09-16T01:15:44.745814+0000","last_clean":"2024-09-16T01:15:44.745814+0000","last_became_active":"2024-09-16T01:15:39.722500+0000","last_became_peered":"2024-09-16T01:15:39.722500+0000","last_unstale":"2024-09-16T01:15:44.745814+0000","last_undegraded":"2024-09-16T01:15:44.745814+0000","last_fullsized":"2024-09-16T01:15:44.745814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:23.041359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744838+0000","last_change":"2024-09-16T01:15:39.725209+0000","last_active":"2024-09-16T01:15:44.744838+0000","last_peered":"2024-09-16T01:15:44.744838+0000","last_clean":"2024-09-16T01:15:44.744838+0000","last_became_active":"2024-09-16T01:15:39.724906+0000","last_became_peered":"2024-09-16T01:15:39.724906+0000","last_unstale":"2024-09-16T01:15:44.744838+0000","last_undegraded":"2024-09-16T01:15:44.744838+0000","last_fullsized":"2024-09-16T01:15:44.744838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816777+0000","last_change":"2024-09-16T01:15:39.724771+0000","last_active":"2024-09-16T01:15:44.816777+0000","last_peered":"2024-09-16T01:15:44.816777+0000","last_clean":"2024-09-16T01:15:44.816777+0000","last_became_active":"2024-09-16T01:15:39.724512+0000","last_became_peered":"2024-09-16T01:15:39.724512+0000","last_unstale":"2024-09-16T01:15:44.816777+0000","last_undegraded":"2024-09-16T01:15:44.816777+0000","last_fullsized":"2024-09-16T01:15:44.816777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747162+0000","last_change":"2024-09-16T01:15:39.717182+0000","last_active":"2024-09-16T01:15:44.747162+0000","last_peered":"2024-09-16T01:15:44.747162+0000","last_clean":"2024-09-16T01:15:44.747162+0000","last_became_active":"2024-09-16T01:15:39.716928+0000","last_became_peered":"2024-09-16T01:15:39.716928+0000","last_unstale":"2024-09-16T01:15:44.747162+0000","last_undegraded":"2024-09-16T01:15:44.747162+0000","last_fullsized":"2024-09-16T01:15:44.747162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:55.663948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922288+0000","last_change":"2024-09-16T01:15:39.729915+0000","last_active":"2024-09-16T01:15:44.922288+0000","last_peered":"2024-09-16T01:15:44.922288+0000","last_clean":"2024-09-16T01:15:44.922288+0000","last_became_active":"2024-09-16T01:15:39.729619+0000","last_became_peered":"2024-09-16T01:15:39.729619+0000","last_unstale":"2024-09-16T01:15:44.922288+0000","last_undegraded":"2024-09-16T01:15:44.922288+0000","last_fullsized":"2024-09-16T01:15:44.922288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944679+0000","last_change":"2024-09-16T01:15:39.728860+0000","last_active":"2024-09-16T01:15:45.944679+0000","last_peered":"2024-09-16T01:15:45.944679+0000","last_clean":"2024-09-16T01:15:45.944679+0000","last_became_active":"2024-09-16T01:15:39.728186+0000","last_became_peered":"2024-09-16T01:15:39.728186+0000","last_unstale":"2024-09-16T01:15:45.944679+0000","last_undegraded":"2024-09-16T01:15:45.944679+0000","last_fullsized":"2024-09-16T01:15:45.944679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:59.931695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746379+0000","last_change":"2024-09-16T01:15:39.721095+0000","last_active":"2024-09-16T01:15:44.746379+0000","last_peered":"2024-09-16T01:15:44.746379+0000","last_clean":"2024-09-16T01:15:44.746379+0000","last_became_active":"2024-09-16T01:15:39.720129+0000","last_became_peered":"2024-09-16T01:15:39.720129+0000","last_unstale":"2024-09-16T01:15:44.746379+0000","last_undegraded":"2024-09-16T01:15:44.746379+0000","last_fullsized":"2024-09-16T01:15:44.746379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.089581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746705+0000","last_change":"2024-09-16T01:15:39.720408+0000","last_active":"2024-09-16T01:15:44.746705+0000","last_peered":"2024-09-16T01:15:44.746705+0000","last_clean":"2024-09-16T01:15:44.746705+0000","last_became_active":"2024-09-16T01:15:39.720126+0000","last_became_peered":"2024-09-16T01:15:39.720126+0000","last_unstale":"2024-09-16T01:15:44.746705+0000","last_undegraded":"2024-09-16T01:15:44.746705+0000","last_fullsized":"2024-09-16T01:15:44.746705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251410+0000","last_change":"2024-09-16T01:15:39.729127+0000","last_active":"2024-09-16T01:15:46.251410+0000","last_peered":"2024-09-16T01:15:46.251410+0000","last_clean":"2024-09-16T01:15:46.251410+0000","last_became_active":"2024-09-16T01:15:39.728867+0000","last_became_peered":"2024-09-16T01:15:39.728867+0000","last_unstale":"2024-09-16T01:15:46.251410+0000","last_undegraded":"2024-09-16T01:15:46.251410+0000","last_fullsized":"2024-09-16T01:15:46.251410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:30.159628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921788+0000","last_change":"2024-09-16T01:15:39.727163+0000","last_active":"2024-09-16T01:15:44.921788+0000","last_peered":"2024-09-16T01:15:44.921788+0000","last_clean":"2024-09-16T01:15:44.921788+0000","last_became_active":"2024-09-16T01:15:39.726499+0000","last_became_peered":"2024-09-16T01:15:39.726499+0000","last_unstale":"2024-09-16T01:15:44.921788+0000","last_undegraded":"2024-09-16T01:15:44.921788+0000","last_fullsized":"2024-09-16T01:15:44.921788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.089581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250973+0000","last_change":"2024-09-16T01:15:39.723869+0000","last_active":"2024-09-16T01:15:46.250973+0000","last_peered":"2024-09-16T01:15:46.250973+0000","last_clean":"2024-09-16T01:15:46.250973+0000","last_became_active":"2024-09-16T01:15:39.723601+0000","last_became_peered":"2024-09-16T01:15:39.723601+0000","last_unstale":"2024-09-16T01:15:46.250973+0000","last_undegraded":"2024-09-16T01:15:46.250973+0000","last_fullsized":"2024-09-16T01:15:46.250973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:22.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745944+0000","last_change":"2024-09-16T01:15:39.724663+0000","last_active":"2024-09-16T01:15:44.745944+0000","last_peered":"2024-09-16T01:15:44.745944+0000","last_clean":"2024-09-16T01:15:44.745944+0000","last_became_active":"2024-09-16T01:15:39.724164+0000","last_became_peered":"2024-09-16T01:15:39.724164+0000","last_unstale":"2024-09-16T01:15:44.745944+0000","last_undegraded":"2024-09-16T01:15:44.745944+0000","last_fullsized":"2024-09-16T01:15:44.745944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250875+0000","last_change":"2024-09-16T01:15:39.723119+0000","last_active":"2024-09-16T01:15:46.250875+0000","last_peered":"2024-09-16T01:15:46.250875+0000","last_clean":"2024-09-16T01:15:46.250875+0000","last_became_active":"2024-09-16T01:15:39.722798+0000","last_became_peered":"2024-09-16T01:15:39.722798+0000","last_unstale":"2024-09-16T01:15:46.250875+0000","last_undegraded":"2024-09-16T01:15:46.250875+0000","last_fullsized":"2024-09-16T01:15:46.250875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:51.270260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745254+0000","last_change":"2024-09-16T01:15:39.716987+0000","last_active":"2024-09-16T01:15:44.745254+0000","last_peered":"2024-09-16T01:15:44.745254+0000","last_clean":"2024-09-16T01:15:44.745254+0000","last_became_active":"2024-09-16T01:15:39.716715+0000","last_became_peered":"2024-09-16T01:15:39.716715+0000","last_unstale":"2024-09-16T01:15:44.745254+0000","last_undegraded":"2024-09-16T01:15:44.745254+0000","last_fullsized":"2024-09-16T01:15:44.745254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:22.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747307+0000","last_change":"2024-09-16T01:15:39.721824+0000","last_active":"2024-09-16T01:15:44.747307+0000","last_peered":"2024-09-16T01:15:44.747307+0000","last_clean":"2024-09-16T01:15:44.747307+0000","last_became_active":"2024-09-16T01:15:39.721566+0000","last_became_peered":"2024-09-16T01:15:39.721566+0000","last_unstale":"2024-09-16T01:15:44.747307+0000","last_undegraded":"2024-09-16T01:15:44.747307+0000","last_fullsized":"2024-09-16T01:15:44.747307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.166842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817619+0000","last_change":"2024-09-16T01:15:39.723439+0000","last_active":"2024-09-16T01:15:44.817619+0000","last_peered":"2024-09-16T01:15:44.817619+0000","last_clean":"2024-09-16T01:15:44.817619+0000","last_became_active":"2024-09-16T01:15:39.722822+0000","last_became_peered":"2024-09-16T01:15:39.722822+0000","last_unstale":"2024-09-16T01:15:44.817619+0000","last_undegraded":"2024-09-16T01:15:44.817619+0000","last_fullsized":"2024-09-16T01:15:44.817619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251286+0000","last_change":"2024-09-16T01:15:39.721668+0000","last_active":"2024-09-16T01:15:46.251286+0000","last_peered":"2024-09-16T01:15:46.251286+0000","last_clean":"2024-09-16T01:15:46.251286+0000","last_became_active":"2024-09-16T01:15:39.720818+0000","last_became_peered":"2024-09-16T01:15:39.720818+0000","last_unstale":"2024-09-16T01:15:46.251286+0000","last_undegraded":"2024-09-16T01:15:46.251286+0000","last_fullsized":"2024-09-16T01:15:46.251286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:19.871750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:15:59.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:15:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.845+0000 7f823976d640 1 Processor -- start 2024-09-16T01:15:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.845+0000 7f823976d640 1 -- start start 2024-09-16T01:15:59.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f823976d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8234161c80 0x7f823406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f823976d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82340b6680 0x7f82340cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f823976d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823406e870 con 0x7f8234162060 2024-09-16T01:15:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f823976d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f823406d9f0 con 0x7f8234161c80 2024-09-16T01:15:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f823976d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f823406dcd0 con 0x7f82340b6680 2024-09-16T01:15:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f82337fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82340b6680 0x7f82340cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f8232ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8234161c80 0x7f823406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f8232ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8234161c80 0x7f823406e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:60302/0 (socket says 172.21.15.81:60302) 2024-09-16T01:15:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f822a7fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8234162060 0x7f82340b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:37264/0 (socket says 172.21.15.81:37264) 2024-09-16T01:15:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f82337fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82340b6680 0x7f82340cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:57214/0 (socket says 172.21.15.81:57214) 2024-09-16T01:15:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f8232ffd640 1 -- 172.21.15.81:0/2384687100 learned_addr learned my addr 172.21.15.81:0/2384687100 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f8232ffd640 1 -- 172.21.15.81:0/2384687100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82340b6680 msgr2=0x7f82340cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:15:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.846+0000 7f8232ffd640 1 --2- 172.21.15.81:0/2384687100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82340b6680 0x7f82340cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.847+0000 7f8232ffd640 1 -- 172.21.15.81:0/2384687100 >> v1:172.21.15.102:6789/0 conn(0x7f8234162060 legacy=0x7f82340b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.847+0000 7f8232ffd640 1 -- 172.21.15.81:0/2384687100 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823406dfb0 con 0x7f8234161c80 2024-09-16T01:15:59.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.847+0000 7f8232ffd640 1 --2- 172.21.15.81:0/2384687100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8234161c80 0x7f823406e330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8224009870 tx=0x7f822402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18ce435b3817a60c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:59.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.847+0000 7f82327fc640 1 -- 172.21.15.81:0/2384687100 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224037070 con 0x7f8234161c80 2024-09-16T01:15:59.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.847+0000 7f82327fc640 1 -- 172.21.15.81:0/2384687100 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8224032440 con 0x7f8234161c80 2024-09-16T01:15:59.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.847+0000 7f82327fc640 1 -- 172.21.15.81:0/2384687100 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224032810 con 0x7f8234161c80 2024-09-16T01:15:59.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.848+0000 7f823976d640 1 -- 172.21.15.81:0/2384687100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8234161c80 msgr2=0x7f823406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.848+0000 7f823976d640 1 --2- 172.21.15.81:0/2384687100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8234161c80 0x7f823406e330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8224009870 tx=0x7f822402a270 comp rx=0 tx=0).stop 2024-09-16T01:15:59.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.848+0000 7f823976d640 1 -- 172.21.15.81:0/2384687100 shutdown_connections 2024-09-16T01:15:59.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.848+0000 7f823976d640 1 --2- 172.21.15.81:0/2384687100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82340b6680 0x7f82340cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.848+0000 7f823976d640 1 --2- 172.21.15.81:0/2384687100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8234161c80 0x7f823406e330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.848+0000 7f823976d640 1 -- 172.21.15.81:0/2384687100 >> 172.21.15.81:0/2384687100 conn(0x7f82340d44f0 msgr2=0x7f82340d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:15:59.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.848+0000 7f823976d640 1 -- 172.21.15.81:0/2384687100 shutdown_connections 2024-09-16T01:15:59.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.848+0000 7f823976d640 1 -- 172.21.15.81:0/2384687100 wait complete. 2024-09-16T01:15:59.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.849+0000 7f823976d640 1 Processor -- start 2024-09-16T01:15:59.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.849+0000 7f823976d640 1 -- start start 2024-09-16T01:15:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.850+0000 7f823976d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340b6680 0x7f82341566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.850+0000 7f823976d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8234161c80 0x7f82341605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.850+0000 7f823976d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8234162060 0x7f82340b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.850+0000 7f823976d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f82340b6cb0 con 0x7f8234162060 2024-09-16T01:15:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.850+0000 7f823976d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f82340b6b30 con 0x7f82340b6680 2024-09-16T01:15:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.850+0000 7f823976d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f82340cf720 con 0x7f8234161c80 2024-09-16T01:15:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.850+0000 7f8232ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340b6680 0x7f82341566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.850+0000 7f8232ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340b6680 0x7f82341566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:60316/0 (socket says 172.21.15.81:60316) 2024-09-16T01:15:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.850+0000 7f8232ffd640 1 -- 172.21.15.81:0/564838568 learned_addr learned my addr 172.21.15.81:0/564838568 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:15:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.850+0000 7f82337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8234162060 0x7f82340b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.850+0000 7f822a7fc640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8234161c80 0x7f82341605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.851+0000 7f8232ffd640 1 -- 172.21.15.81:0/564838568 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8234161c80 msgr2=0x7f82341605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.851+0000 7f8232ffd640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8234161c80 0x7f82341605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.851+0000 7f8232ffd640 1 -- 172.21.15.81:0/564838568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8234162060 msgr2=0x7f82340b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:15:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.851+0000 7f8232ffd640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8234162060 0x7f82340b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:15:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.851+0000 7f8232ffd640 1 -- 172.21.15.81:0/564838568 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8234156c30 con 0x7f82340b6680 2024-09-16T01:15:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.851+0000 7f8232ffd640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340b6680 0x7f82341566f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f822402a2b0 tx=0x7f82240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.851+0000 7f822bfff640 1 -- 172.21.15.81:0/564838568 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224037040 con 0x7f82340b6680 2024-09-16T01:15:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.851+0000 7f822bfff640 1 -- 172.21.15.81:0/564838568 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8224042070 con 0x7f82340b6680 2024-09-16T01:15:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.851+0000 7f823976d640 1 -- 172.21.15.81:0/564838568 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82340cc390 con 0x7f82340b6680 2024-09-16T01:15:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.851+0000 7f822bfff640 1 -- 172.21.15.81:0/564838568 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224030880 con 0x7f82340b6680 2024-09-16T01:15:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.851+0000 7f823976d640 1 -- 172.21.15.81:0/564838568 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82340cc950 con 0x7f82340b6680 2024-09-16T01:15:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.852+0000 7f823976d640 1 -- 172.21.15.81:0/564838568 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82340cf1e0 con 0x7f82340b6680 2024-09-16T01:15:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.853+0000 7f822bfff640 1 -- 172.21.15.81:0/564838568 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8224030a20 con 0x7f82340b6680 2024-09-16T01:15:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.853+0000 7f822bfff640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f821406c2b0 0x7f821406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:15:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.853+0000 7f822bfff640 1 -- 172.21.15.81:0/564838568 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f82240abff0 con 0x7f82340b6680 2024-09-16T01:15:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.853+0000 7f822a7fc640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f821406c2b0 0x7f821406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:15:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.853+0000 7f822a7fc640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f821406c2b0 0x7f821406e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82340a23b0 tx=0x7f821c007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:15:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:15:59.859+0000 7f822bfff640 1 -- 172.21.15.81:0/564838568 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8224079cc0 con 0x7f82340b6680 2024-09-16T01:16:00.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.023+0000 7f823976d640 1 -- 172.21.15.81:0/564838568 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82340d4290 con 0x7f821406c2b0 2024-09-16T01:16:00.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.030+0000 7f822bfff640 1 -- 172.21.15.81:0/564838568 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f82340d4290 con 0x7f821406c2b0 2024-09-16T01:16:00.036 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:00.037 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:16:00.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.034+0000 7f823976d640 1 -- 172.21.15.81:0/564838568 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f821406c2b0 msgr2=0x7f821406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.034+0000 7f823976d640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f821406c2b0 0x7f821406e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82340a23b0 tx=0x7f821c007e80 comp rx=0 tx=0).stop 2024-09-16T01:16:00.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.034+0000 7f823976d640 1 -- 172.21.15.81:0/564838568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340b6680 msgr2=0x7f82341566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.034+0000 7f823976d640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340b6680 0x7f82341566f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f822402a2b0 tx=0x7f82240046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.034+0000 7f823976d640 1 -- 172.21.15.81:0/564838568 shutdown_connections 2024-09-16T01:16:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.034+0000 7f823976d640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f821406c2b0 0x7f821406e770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.034+0000 7f823976d640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8234162060 0x7f82340b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.034+0000 7f823976d640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8234161c80 0x7f82341605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.034+0000 7f823976d640 1 --2- 172.21.15.81:0/564838568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82340b6680 0x7f82341566f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.034+0000 7f823976d640 1 -- 172.21.15.81:0/564838568 >> 172.21.15.81:0/564838568 conn(0x7f82340d44f0 msgr2=0x7f8234162490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.034+0000 7f823976d640 1 -- 172.21.15.81:0/564838568 shutdown_connections 2024-09-16T01:16:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.034+0000 7f823976d640 1 -- 172.21.15.81:0/564838568 wait complete. 2024-09-16T01:16:00.049 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-16T01:15:58.062255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219432,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755288,"statfs":{"total":773094113280,"available":772869414912,"internally_reserved":0,"allocated":3284992,"data_stored":1992068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003163"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747622+0000","last_change":"2024-09-16T01:15:38.721067+0000","last_active":"2024-09-16T01:15:44.747622+0000","last_peered":"2024-09-16T01:15:44.747622+0000","last_clean":"2024-09-16T01:15:44.747622+0000","last_became_active":"2024-09-16T01:15:38.720869+0000","last_became_peered":"2024-09-16T01:15:38.720869+0000","last_unstale":"2024-09-16T01:15:44.747622+0000","last_undegraded":"2024-09-16T01:15:44.747622+0000","last_fullsized":"2024-09-16T01:15:44.747622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:37.356692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922559+0000","last_change":"2024-09-16T01:15:39.720014+0000","last_active":"2024-09-16T01:15:44.922559+0000","last_peered":"2024-09-16T01:15:44.922559+0000","last_clean":"2024-09-16T01:15:44.922559+0000","last_became_active":"2024-09-16T01:15:39.719700+0000","last_became_peered":"2024-09-16T01:15:39.719700+0000","last_unstale":"2024-09-16T01:15:44.922559+0000","last_undegraded":"2024-09-16T01:15:44.922559+0000","last_fullsized":"2024-09-16T01:15:44.922559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:15.851594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921951+0000","last_change":"2024-09-16T01:15:43.919879+0000","last_active":"2024-09-16T01:15:44.921951+0000","last_peered":"2024-09-16T01:15:44.921951+0000","last_clean":"2024-09-16T01:15:44.921951+0000","last_became_active":"2024-09-16T01:15:43.919471+0000","last_became_peered":"2024-09-16T01:15:43.919471+0000","last_unstale":"2024-09-16T01:15:44.921951+0000","last_undegraded":"2024-09-16T01:15:44.921951+0000","last_fullsized":"2024-09-16T01:15:44.921951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:48.711431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922637+0000","last_change":"2024-09-16T01:15:38.718512+0000","last_active":"2024-09-16T01:15:44.922637+0000","last_peered":"2024-09-16T01:15:44.922637+0000","last_clean":"2024-09-16T01:15:44.922637+0000","last_became_active":"2024-09-16T01:15:38.718193+0000","last_became_peered":"2024-09-16T01:15:38.718193+0000","last_unstale":"2024-09-16T01:15:44.922637+0000","last_undegraded":"2024-09-16T01:15:44.922637+0000","last_fullsized":"2024-09-16T01:15:44.922637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:36.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747347+0000","last_change":"2024-09-16T01:15:39.730526+0000","last_active":"2024-09-16T01:15:44.747347+0000","last_peered":"2024-09-16T01:15:44.747347+0000","last_clean":"2024-09-16T01:15:44.747347+0000","last_became_active":"2024-09-16T01:15:39.729904+0000","last_became_peered":"2024-09-16T01:15:39.729904+0000","last_unstale":"2024-09-16T01:15:44.747347+0000","last_undegraded":"2024-09-16T01:15:44.747347+0000","last_fullsized":"2024-09-16T01:15:44.747347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944132+0000","last_change":"2024-09-16T01:15:43.764125+0000","last_active":"2024-09-16T01:15:45.944132+0000","last_peered":"2024-09-16T01:15:45.944132+0000","last_clean":"2024-09-16T01:15:45.944132+0000","last_became_active":"2024-09-16T01:15:43.763689+0000","last_became_peered":"2024-09-16T01:15:43.763689+0000","last_unstale":"2024-09-16T01:15:45.944132+0000","last_undegraded":"2024-09-16T01:15:45.944132+0000","last_fullsized":"2024-09-16T01:15:45.944132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:36.873854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251413+0000","last_change":"2024-09-16T01:15:38.723925+0000","last_active":"2024-09-16T01:15:46.251413+0000","last_peered":"2024-09-16T01:15:46.251413+0000","last_clean":"2024-09-16T01:15:46.251413+0000","last_became_active":"2024-09-16T01:15:38.723660+0000","last_became_peered":"2024-09-16T01:15:38.723660+0000","last_unstale":"2024-09-16T01:15:46.251413+0000","last_undegraded":"2024-09-16T01:15:46.251413+0000","last_fullsized":"2024-09-16T01:15:46.251413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:50.843647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745352+0000","last_change":"2024-09-16T01:15:39.718658+0000","last_active":"2024-09-16T01:15:44.745352+0000","last_peered":"2024-09-16T01:15:44.745352+0000","last_clean":"2024-09-16T01:15:44.745352+0000","last_became_active":"2024-09-16T01:15:39.718360+0000","last_became_peered":"2024-09-16T01:15:39.718360+0000","last_unstale":"2024-09-16T01:15:44.745352+0000","last_undegraded":"2024-09-16T01:15:44.745352+0000","last_fullsized":"2024-09-16T01:15:44.745352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:51.270260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944453+0000","last_change":"2024-09-16T01:15:43.764643+0000","last_active":"2024-09-16T01:15:45.944453+0000","last_peered":"2024-09-16T01:15:45.944453+0000","last_clean":"2024-09-16T01:15:45.944453+0000","last_became_active":"2024-09-16T01:15:43.764229+0000","last_became_peered":"2024-09-16T01:15:43.764229+0000","last_unstale":"2024-09-16T01:15:45.944453+0000","last_undegraded":"2024-09-16T01:15:45.944453+0000","last_fullsized":"2024-09-16T01:15:45.944453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:57.315283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251049+0000","last_change":"2024-09-16T01:15:38.721191+0000","last_active":"2024-09-16T01:15:46.251049+0000","last_peered":"2024-09-16T01:15:46.251049+0000","last_clean":"2024-09-16T01:15:46.251049+0000","last_became_active":"2024-09-16T01:15:38.720832+0000","last_became_peered":"2024-09-16T01:15:38.720832+0000","last_unstale":"2024-09-16T01:15:46.251049+0000","last_undegraded":"2024-09-16T01:15:46.251049+0000","last_fullsized":"2024-09-16T01:15:46.251049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:35.717778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745724+0000","last_change":"2024-09-16T01:15:39.718836+0000","last_active":"2024-09-16T01:15:44.745724+0000","last_peered":"2024-09-16T01:15:44.745724+0000","last_clean":"2024-09-16T01:15:44.745724+0000","last_became_active":"2024-09-16T01:15:39.718367+0000","last_became_peered":"2024-09-16T01:15:39.718367+0000","last_unstale":"2024-09-16T01:15:44.745724+0000","last_undegraded":"2024-09-16T01:15:44.745724+0000","last_fullsized":"2024-09-16T01:15:44.745724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:39.132954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944337+0000","last_change":"2024-09-16T01:15:43.762123+0000","last_active":"2024-09-16T01:15:45.944337+0000","last_peered":"2024-09-16T01:15:45.944337+0000","last_clean":"2024-09-16T01:15:45.944337+0000","last_became_active":"2024-09-16T01:15:43.761634+0000","last_became_peered":"2024-09-16T01:15:43.761634+0000","last_unstale":"2024-09-16T01:15:45.944337+0000","last_undegraded":"2024-09-16T01:15:45.944337+0000","last_fullsized":"2024-09-16T01:15:45.944337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:26.316809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746166+0000","last_change":"2024-09-16T01:15:39.718972+0000","last_active":"2024-09-16T01:15:44.746166+0000","last_peered":"2024-09-16T01:15:44.746166+0000","last_clean":"2024-09-16T01:15:44.746166+0000","last_became_active":"2024-09-16T01:15:39.718666+0000","last_became_peered":"2024-09-16T01:15:39.718666+0000","last_unstale":"2024-09-16T01:15:44.746166+0000","last_undegraded":"2024-09-16T01:15:44.746166+0000","last_fullsized":"2024-09-16T01:15:44.746166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.166842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251231+0000","last_change":"2024-09-16T01:15:38.726840+0000","last_active":"2024-09-16T01:15:46.251231+0000","last_peered":"2024-09-16T01:15:46.251231+0000","last_clean":"2024-09-16T01:15:46.251231+0000","last_became_active":"2024-09-16T01:15:38.726541+0000","last_became_peered":"2024-09-16T01:15:38.726541+0000","last_unstale":"2024-09-16T01:15:46.251231+0000","last_undegraded":"2024-09-16T01:15:46.251231+0000","last_fullsized":"2024-09-16T01:15:46.251231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:54.657992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944947+0000","last_change":"2024-09-16T01:15:43.764429+0000","last_active":"2024-09-16T01:15:45.944947+0000","last_peered":"2024-09-16T01:15:45.944947+0000","last_clean":"2024-09-16T01:15:45.944947+0000","last_became_active":"2024-09-16T01:15:43.763453+0000","last_became_peered":"2024-09-16T01:15:43.763453+0000","last_unstale":"2024-09-16T01:15:45.944947+0000","last_undegraded":"2024-09-16T01:15:45.944947+0000","last_fullsized":"2024-09-16T01:15:45.944947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:54.978121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922348+0000","last_change":"2024-09-16T01:15:39.729023+0000","last_active":"2024-09-16T01:15:44.922348+0000","last_peered":"2024-09-16T01:15:44.922348+0000","last_clean":"2024-09-16T01:15:44.922348+0000","last_became_active":"2024-09-16T01:15:39.728164+0000","last_became_peered":"2024-09-16T01:15:39.728164+0000","last_unstale":"2024-09-16T01:15:44.922348+0000","last_undegraded":"2024-09-16T01:15:44.922348+0000","last_fullsized":"2024-09-16T01:15:44.922348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817115+0000","last_change":"2024-09-16T01:15:38.712201+0000","last_active":"2024-09-16T01:15:44.817115+0000","last_peered":"2024-09-16T01:15:44.817115+0000","last_clean":"2024-09-16T01:15:44.817115+0000","last_became_active":"2024-09-16T01:15:38.711909+0000","last_became_peered":"2024-09-16T01:15:38.711909+0000","last_unstale":"2024-09-16T01:15:44.817115+0000","last_undegraded":"2024-09-16T01:15:44.817115+0000","last_fullsized":"2024-09-16T01:15:44.817115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:46.439923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944544+0000","last_change":"2024-09-16T01:15:43.764651+0000","last_active":"2024-09-16T01:15:45.944544+0000","last_peered":"2024-09-16T01:15:45.944544+0000","last_clean":"2024-09-16T01:15:45.944544+0000","last_became_active":"2024-09-16T01:15:43.764198+0000","last_became_peered":"2024-09-16T01:15:43.764198+0000","last_unstale":"2024-09-16T01:15:45.944544+0000","last_undegraded":"2024-09-16T01:15:45.944544+0000","last_fullsized":"2024-09-16T01:15:45.944544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:55.307076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921967+0000","last_change":"2024-09-16T01:15:39.730357+0000","last_active":"2024-09-16T01:15:44.921967+0000","last_peered":"2024-09-16T01:15:44.921967+0000","last_clean":"2024-09-16T01:15:44.921967+0000","last_became_active":"2024-09-16T01:15:39.728252+0000","last_became_peered":"2024-09-16T01:15:39.728252+0000","last_unstale":"2024-09-16T01:15:44.921967+0000","last_undegraded":"2024-09-16T01:15:44.921967+0000","last_fullsized":"2024-09-16T01:15:44.921967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816830+0000","last_change":"2024-09-16T01:15:38.716181+0000","last_active":"2024-09-16T01:15:44.816830+0000","last_peered":"2024-09-16T01:15:44.816830+0000","last_clean":"2024-09-16T01:15:44.816830+0000","last_became_active":"2024-09-16T01:15:38.715894+0000","last_became_peered":"2024-09-16T01:15:38.715894+0000","last_unstale":"2024-09-16T01:15:44.816830+0000","last_undegraded":"2024-09-16T01:15:44.816830+0000","last_fullsized":"2024-09-16T01:15:44.816830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:58.925739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817629+0000","last_change":"2024-09-16T01:15:43.921354+0000","last_active":"2024-09-16T01:15:44.817629+0000","last_peered":"2024-09-16T01:15:44.817629+0000","last_clean":"2024-09-16T01:15:44.817629+0000","last_became_active":"2024-09-16T01:15:43.919480+0000","last_became_peered":"2024-09-16T01:15:43.919480+0000","last_unstale":"2024-09-16T01:15:44.817629+0000","last_undegraded":"2024-09-16T01:15:44.817629+0000","last_fullsized":"2024-09-16T01:15:44.817629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:34.196444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944562+0000","last_change":"2024-09-16T01:15:39.722840+0000","last_active":"2024-09-16T01:15:45.944562+0000","last_peered":"2024-09-16T01:15:45.944562+0000","last_clean":"2024-09-16T01:15:45.944562+0000","last_became_active":"2024-09-16T01:15:39.722566+0000","last_became_peered":"2024-09-16T01:15:39.722566+0000","last_unstale":"2024-09-16T01:15:45.944562+0000","last_undegraded":"2024-09-16T01:15:45.944562+0000","last_fullsized":"2024-09-16T01:15:45.944562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.000406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250736+0000","last_change":"2024-09-16T01:15:38.722591+0000","last_active":"2024-09-16T01:15:46.250736+0000","last_peered":"2024-09-16T01:15:46.250736+0000","last_clean":"2024-09-16T01:15:46.250736+0000","last_became_active":"2024-09-16T01:15:38.722331+0000","last_became_peered":"2024-09-16T01:15:38.722331+0000","last_unstale":"2024-09-16T01:15:46.250736+0000","last_undegraded":"2024-09-16T01:15:46.250736+0000","last_fullsized":"2024-09-16T01:15:46.250736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:58.925739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944801+0000","last_change":"2024-09-16T01:15:43.763545+0000","last_active":"2024-09-16T01:15:45.944801+0000","last_peered":"2024-09-16T01:15:45.944801+0000","last_clean":"2024-09-16T01:15:45.944801+0000","last_became_active":"2024-09-16T01:15:43.763123+0000","last_became_peered":"2024-09-16T01:15:43.763123+0000","last_unstale":"2024-09-16T01:15:45.944801+0000","last_undegraded":"2024-09-16T01:15:45.944801+0000","last_fullsized":"2024-09-16T01:15:45.944801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:27.078175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747527+0000","last_change":"2024-09-16T01:15:39.721956+0000","last_active":"2024-09-16T01:15:44.747527+0000","last_peered":"2024-09-16T01:15:44.747527+0000","last_clean":"2024-09-16T01:15:44.747527+0000","last_became_active":"2024-09-16T01:15:39.721349+0000","last_became_peered":"2024-09-16T01:15:39.721349+0000","last_unstale":"2024-09-16T01:15:44.747527+0000","last_undegraded":"2024-09-16T01:15:44.747527+0000","last_fullsized":"2024-09-16T01:15:44.747527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.089581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746703+0000","last_change":"2024-09-16T01:15:38.717450+0000","last_active":"2024-09-16T01:15:44.746703+0000","last_peered":"2024-09-16T01:15:44.746703+0000","last_clean":"2024-09-16T01:15:44.746703+0000","last_became_active":"2024-09-16T01:15:38.717143+0000","last_became_peered":"2024-09-16T01:15:38.717143+0000","last_unstale":"2024-09-16T01:15:44.746703+0000","last_undegraded":"2024-09-16T01:15:44.746703+0000","last_fullsized":"2024-09-16T01:15:44.746703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:46.439923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944225+0000","last_change":"2024-09-16T01:15:43.920611+0000","last_active":"2024-09-16T01:15:45.944225+0000","last_peered":"2024-09-16T01:15:45.944225+0000","last_clean":"2024-09-16T01:15:45.944225+0000","last_became_active":"2024-09-16T01:15:43.920154+0000","last_became_peered":"2024-09-16T01:15:43.920154+0000","last_unstale":"2024-09-16T01:15:45.944225+0000","last_undegraded":"2024-09-16T01:15:45.944225+0000","last_fullsized":"2024-09-16T01:15:45.944225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:43.169770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922664+0000","last_change":"2024-09-16T01:15:39.727833+0000","last_active":"2024-09-16T01:15:44.922664+0000","last_peered":"2024-09-16T01:15:44.922664+0000","last_clean":"2024-09-16T01:15:44.922664+0000","last_became_active":"2024-09-16T01:15:39.727573+0000","last_became_peered":"2024-09-16T01:15:39.727573+0000","last_unstale":"2024-09-16T01:15:44.922664+0000","last_undegraded":"2024-09-16T01:15:44.922664+0000","last_fullsized":"2024-09-16T01:15:44.922664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:22.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817625+0000","last_change":"2024-09-16T01:15:38.707107+0000","last_active":"2024-09-16T01:15:44.817625+0000","last_peered":"2024-09-16T01:15:44.817625+0000","last_clean":"2024-09-16T01:15:44.817625+0000","last_became_active":"2024-09-16T01:15:38.706848+0000","last_became_peered":"2024-09-16T01:15:38.706848+0000","last_unstale":"2024-09-16T01:15:44.817625+0000","last_undegraded":"2024-09-16T01:15:44.817625+0000","last_fullsized":"2024-09-16T01:15:44.817625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:08.518045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922236+0000","last_change":"2024-09-16T01:15:43.921496+0000","last_active":"2024-09-16T01:15:44.922236+0000","last_peered":"2024-09-16T01:15:44.922236+0000","last_clean":"2024-09-16T01:15:44.922236+0000","last_became_active":"2024-09-16T01:15:43.920197+0000","last_became_peered":"2024-09-16T01:15:43.920197+0000","last_unstale":"2024-09-16T01:15:44.922236+0000","last_undegraded":"2024-09-16T01:15:44.922236+0000","last_fullsized":"2024-09-16T01:15:44.922236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:09.951543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817435+0000","last_change":"2024-09-16T01:15:39.723117+0000","last_active":"2024-09-16T01:15:44.817435+0000","last_peered":"2024-09-16T01:15:44.817435+0000","last_clean":"2024-09-16T01:15:44.817435+0000","last_became_active":"2024-09-16T01:15:39.722836+0000","last_became_peered":"2024-09-16T01:15:39.722836+0000","last_unstale":"2024-09-16T01:15:44.817435+0000","last_undegraded":"2024-09-16T01:15:44.817435+0000","last_fullsized":"2024-09-16T01:15:44.817435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251484+0000","last_change":"2024-09-16T01:15:38.722596+0000","last_active":"2024-09-16T01:15:46.251484+0000","last_peered":"2024-09-16T01:15:46.251484+0000","last_clean":"2024-09-16T01:15:46.251484+0000","last_became_active":"2024-09-16T01:15:38.722356+0000","last_became_peered":"2024-09-16T01:15:38.722356+0000","last_unstale":"2024-09-16T01:15:46.251484+0000","last_undegraded":"2024-09-16T01:15:46.251484+0000","last_fullsized":"2024-09-16T01:15:46.251484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:31.352796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747052+0000","last_change":"2024-09-16T01:15:43.921163+0000","last_active":"2024-09-16T01:15:44.747052+0000","last_peered":"2024-09-16T01:15:44.747052+0000","last_clean":"2024-09-16T01:15:44.747052+0000","last_became_active":"2024-09-16T01:15:43.920789+0000","last_became_peered":"2024-09-16T01:15:43.920789+0000","last_unstale":"2024-09-16T01:15:44.747052+0000","last_undegraded":"2024-09-16T01:15:44.747052+0000","last_fullsized":"2024-09-16T01:15:44.747052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:24.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745802+0000","last_change":"2024-09-16T01:15:39.721863+0000","last_active":"2024-09-16T01:15:44.745802+0000","last_peered":"2024-09-16T01:15:44.745802+0000","last_clean":"2024-09-16T01:15:44.745802+0000","last_became_active":"2024-09-16T01:15:39.721445+0000","last_became_peered":"2024-09-16T01:15:39.721445+0000","last_unstale":"2024-09-16T01:15:44.745802+0000","last_undegraded":"2024-09-16T01:15:44.745802+0000","last_fullsized":"2024-09-16T01:15:44.745802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:53.278467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817489+0000","last_change":"2024-09-16T01:15:38.718239+0000","last_active":"2024-09-16T01:15:44.817489+0000","last_peered":"2024-09-16T01:15:44.817489+0000","last_clean":"2024-09-16T01:15:44.817489+0000","last_became_active":"2024-09-16T01:15:38.717981+0000","last_became_peered":"2024-09-16T01:15:38.717981+0000","last_unstale":"2024-09-16T01:15:44.817489+0000","last_undegraded":"2024-09-16T01:15:44.817489+0000","last_fullsized":"2024-09-16T01:15:44.817489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:35.717778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816857+0000","last_change":"2024-09-16T01:15:43.759115+0000","last_active":"2024-09-16T01:15:44.816857+0000","last_peered":"2024-09-16T01:15:44.816857+0000","last_clean":"2024-09-16T01:15:44.816857+0000","last_became_active":"2024-09-16T01:15:43.758725+0000","last_became_peered":"2024-09-16T01:15:43.758725+0000","last_unstale":"2024-09-16T01:15:44.816857+0000","last_undegraded":"2024-09-16T01:15:44.816857+0000","last_fullsized":"2024-09-16T01:15:44.816857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:27.078175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944821+0000","last_change":"2024-09-16T01:15:39.723087+0000","last_active":"2024-09-16T01:15:45.944821+0000","last_peered":"2024-09-16T01:15:45.944821+0000","last_clean":"2024-09-16T01:15:45.944821+0000","last_became_active":"2024-09-16T01:15:39.722204+0000","last_became_peered":"2024-09-16T01:15:39.722204+0000","last_unstale":"2024-09-16T01:15:45.944821+0000","last_undegraded":"2024-09-16T01:15:45.944821+0000","last_fullsized":"2024-09-16T01:15:45.944821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:36.723734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746291+0000","last_change":"2024-09-16T01:15:38.717252+0000","last_active":"2024-09-16T01:15:44.746291+0000","last_peered":"2024-09-16T01:15:44.746291+0000","last_clean":"2024-09-16T01:15:44.746291+0000","last_became_active":"2024-09-16T01:15:38.716781+0000","last_became_peered":"2024-09-16T01:15:38.716781+0000","last_unstale":"2024-09-16T01:15:44.746291+0000","last_undegraded":"2024-09-16T01:15:44.746291+0000","last_fullsized":"2024-09-16T01:15:44.746291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:58.925739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817388+0000","last_change":"2024-09-16T01:15:43.760901+0000","last_active":"2024-09-16T01:15:44.817388+0000","last_peered":"2024-09-16T01:15:44.817388+0000","last_clean":"2024-09-16T01:15:44.817388+0000","last_became_active":"2024-09-16T01:15:43.758844+0000","last_became_peered":"2024-09-16T01:15:43.758844+0000","last_unstale":"2024-09-16T01:15:44.817388+0000","last_undegraded":"2024-09-16T01:15:44.817388+0000","last_fullsized":"2024-09-16T01:15:44.817388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:23.908567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816870+0000","last_change":"2024-09-16T01:15:39.723832+0000","last_active":"2024-09-16T01:15:44.816870+0000","last_peered":"2024-09-16T01:15:44.816870+0000","last_clean":"2024-09-16T01:15:44.816870+0000","last_became_active":"2024-09-16T01:15:39.723596+0000","last_became_peered":"2024-09-16T01:15:39.723596+0000","last_unstale":"2024-09-16T01:15:44.816870+0000","last_undegraded":"2024-09-16T01:15:44.816870+0000","last_fullsized":"2024-09-16T01:15:44.816870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644673+0000","last_change":"2024-09-16T01:15:38.713951+0000","last_active":"2024-09-16T01:15:46.644673+0000","last_peered":"2024-09-16T01:15:46.644673+0000","last_clean":"2024-09-16T01:15:46.644673+0000","last_became_active":"2024-09-16T01:15:38.713670+0000","last_became_peered":"2024-09-16T01:15:38.713670+0000","last_unstale":"2024-09-16T01:15:46.644673+0000","last_undegraded":"2024-09-16T01:15:46.644673+0000","last_fullsized":"2024-09-16T01:15:46.644673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:24.701682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817651+0000","last_change":"2024-09-16T01:15:43.760201+0000","last_active":"2024-09-16T01:15:44.817651+0000","last_peered":"2024-09-16T01:15:44.817651+0000","last_clean":"2024-09-16T01:15:44.817651+0000","last_became_active":"2024-09-16T01:15:43.759329+0000","last_became_peered":"2024-09-16T01:15:43.759329+0000","last_unstale":"2024-09-16T01:15:44.817651+0000","last_undegraded":"2024-09-16T01:15:44.817651+0000","last_fullsized":"2024-09-16T01:15:44.817651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:00.235274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746870+0000","last_change":"2024-09-16T01:15:39.719776+0000","last_active":"2024-09-16T01:15:44.746870+0000","last_peered":"2024-09-16T01:15:44.746870+0000","last_clean":"2024-09-16T01:15:44.746870+0000","last_became_active":"2024-09-16T01:15:39.719492+0000","last_became_peered":"2024-09-16T01:15:39.719492+0000","last_unstale":"2024-09-16T01:15:44.746870+0000","last_undegraded":"2024-09-16T01:15:44.746870+0000","last_fullsized":"2024-09-16T01:15:44.746870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:18.272881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250816+0000","last_change":"2024-09-16T01:15:38.722446+0000","last_active":"2024-09-16T01:15:46.250816+0000","last_peered":"2024-09-16T01:15:46.250816+0000","last_clean":"2024-09-16T01:15:46.250816+0000","last_became_active":"2024-09-16T01:15:38.722134+0000","last_became_peered":"2024-09-16T01:15:38.722134+0000","last_unstale":"2024-09-16T01:15:46.250816+0000","last_undegraded":"2024-09-16T01:15:46.250816+0000","last_fullsized":"2024-09-16T01:15:46.250816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:43.994450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747413+0000","last_change":"2024-09-16T01:15:43.921254+0000","last_active":"2024-09-16T01:15:44.747413+0000","last_peered":"2024-09-16T01:15:44.747413+0000","last_clean":"2024-09-16T01:15:44.747413+0000","last_became_active":"2024-09-16T01:15:43.920320+0000","last_became_peered":"2024-09-16T01:15:43.920320+0000","last_unstale":"2024-09-16T01:15:44.747413+0000","last_undegraded":"2024-09-16T01:15:44.747413+0000","last_fullsized":"2024-09-16T01:15:44.747413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:23.908567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921967+0000","last_change":"2024-09-16T01:15:39.729053+0000","last_active":"2024-09-16T01:15:44.921967+0000","last_peered":"2024-09-16T01:15:44.921967+0000","last_clean":"2024-09-16T01:15:44.921967+0000","last_became_active":"2024-09-16T01:15:39.727897+0000","last_became_peered":"2024-09-16T01:15:39.727897+0000","last_unstale":"2024-09-16T01:15:44.921967+0000","last_undegraded":"2024-09-16T01:15:44.921967+0000","last_fullsized":"2024-09-16T01:15:44.921967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745582+0000","last_change":"2024-09-16T01:15:38.712828+0000","last_active":"2024-09-16T01:15:44.745582+0000","last_peered":"2024-09-16T01:15:44.745582+0000","last_clean":"2024-09-16T01:15:44.745582+0000","last_became_active":"2024-09-16T01:15:38.712543+0000","last_became_peered":"2024-09-16T01:15:38.712543+0000","last_unstale":"2024-09-16T01:15:44.745582+0000","last_undegraded":"2024-09-16T01:15:44.745582+0000","last_fullsized":"2024-09-16T01:15:44.745582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:52.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250598+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:15:46.250598+0000","last_peered":"2024-09-16T01:15:46.250598+0000","last_clean":"2024-09-16T01:15:46.250598+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:15:46.250598+0000","last_undegraded":"2024-09-16T01:15:46.250598+0000","last_fullsized":"2024-09-16T01:15:46.250598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745908+0000","last_change":"2024-09-16T01:15:43.920489+0000","last_active":"2024-09-16T01:15:44.745908+0000","last_peered":"2024-09-16T01:15:44.745908+0000","last_clean":"2024-09-16T01:15:44.745908+0000","last_became_active":"2024-09-16T01:15:43.920110+0000","last_became_peered":"2024-09-16T01:15:43.920110+0000","last_unstale":"2024-09-16T01:15:44.745908+0000","last_undegraded":"2024-09-16T01:15:44.745908+0000","last_fullsized":"2024-09-16T01:15:44.745908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:57.315283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251313+0000","last_change":"2024-09-16T01:15:39.728812+0000","last_active":"2024-09-16T01:15:46.251313+0000","last_peered":"2024-09-16T01:15:46.251313+0000","last_clean":"2024-09-16T01:15:46.251313+0000","last_became_active":"2024-09-16T01:15:39.728567+0000","last_became_peered":"2024-09-16T01:15:39.728567+0000","last_unstale":"2024-09-16T01:15:46.251313+0000","last_undegraded":"2024-09-16T01:15:46.251313+0000","last_fullsized":"2024-09-16T01:15:46.251313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:50.941305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644951+0000","last_change":"2024-09-16T01:15:38.714874+0000","last_active":"2024-09-16T01:15:46.644951+0000","last_peered":"2024-09-16T01:15:46.644951+0000","last_clean":"2024-09-16T01:15:46.644951+0000","last_became_active":"2024-09-16T01:15:38.714594+0000","last_became_peered":"2024-09-16T01:15:38.714594+0000","last_unstale":"2024-09-16T01:15:46.644951+0000","last_undegraded":"2024-09-16T01:15:46.644951+0000","last_fullsized":"2024-09-16T01:15:46.644951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:42.942780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746039+0000","last_change":"2024-09-16T01:15:43.917212+0000","last_active":"2024-09-16T01:15:44.746039+0000","last_peered":"2024-09-16T01:15:44.746039+0000","last_clean":"2024-09-16T01:15:44.746039+0000","last_became_active":"2024-09-16T01:15:43.916799+0000","last_became_peered":"2024-09-16T01:15:43.916799+0000","last_unstale":"2024-09-16T01:15:44.746039+0000","last_undegraded":"2024-09-16T01:15:44.746039+0000","last_fullsized":"2024-09-16T01:15:44.746039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:55.307076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745452+0000","last_change":"2024-09-16T01:15:39.716325+0000","last_active":"2024-09-16T01:15:44.745452+0000","last_peered":"2024-09-16T01:15:44.745452+0000","last_clean":"2024-09-16T01:15:44.745452+0000","last_became_active":"2024-09-16T01:15:39.716048+0000","last_became_peered":"2024-09-16T01:15:39.716048+0000","last_unstale":"2024-09-16T01:15:44.745452+0000","last_undegraded":"2024-09-16T01:15:44.745452+0000","last_fullsized":"2024-09-16T01:15:44.745452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:20.730699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817475+0000","last_change":"2024-09-16T01:15:38.710438+0000","last_active":"2024-09-16T01:15:44.817475+0000","last_peered":"2024-09-16T01:15:44.817475+0000","last_clean":"2024-09-16T01:15:44.817475+0000","last_became_active":"2024-09-16T01:15:38.710126+0000","last_became_peered":"2024-09-16T01:15:38.710126+0000","last_unstale":"2024-09-16T01:15:44.817475+0000","last_undegraded":"2024-09-16T01:15:44.817475+0000","last_fullsized":"2024-09-16T01:15:44.817475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:50.843647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747422+0000","last_change":"2024-09-16T01:15:43.755716+0000","last_active":"2024-09-16T01:15:44.747422+0000","last_peered":"2024-09-16T01:15:44.747422+0000","last_clean":"2024-09-16T01:15:44.747422+0000","last_became_active":"2024-09-16T01:15:43.755284+0000","last_became_peered":"2024-09-16T01:15:43.755284+0000","last_unstale":"2024-09-16T01:15:44.747422+0000","last_undegraded":"2024-09-16T01:15:44.747422+0000","last_fullsized":"2024-09-16T01:15:44.747422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:34.196444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251434+0000","last_change":"2024-09-16T01:15:39.721173+0000","last_active":"2024-09-16T01:15:46.251434+0000","last_peered":"2024-09-16T01:15:46.251434+0000","last_clean":"2024-09-16T01:15:46.251434+0000","last_became_active":"2024-09-16T01:15:39.720757+0000","last_became_peered":"2024-09-16T01:15:39.720757+0000","last_unstale":"2024-09-16T01:15:46.251434+0000","last_undegraded":"2024-09-16T01:15:46.251434+0000","last_fullsized":"2024-09-16T01:15:46.251434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:44.674615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644910+0000","last_change":"2024-09-16T01:15:38.713886+0000","last_active":"2024-09-16T01:15:46.644910+0000","last_peered":"2024-09-16T01:15:46.644910+0000","last_clean":"2024-09-16T01:15:46.644910+0000","last_became_active":"2024-09-16T01:15:38.713596+0000","last_became_peered":"2024-09-16T01:15:38.713596+0000","last_unstale":"2024-09-16T01:15:46.644910+0000","last_undegraded":"2024-09-16T01:15:46.644910+0000","last_fullsized":"2024-09-16T01:15:46.644910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:52.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744816+0000","last_change":"2024-09-16T01:15:43.917236+0000","last_active":"2024-09-16T01:15:44.744816+0000","last_peered":"2024-09-16T01:15:44.744816+0000","last_clean":"2024-09-16T01:15:44.744816+0000","last_became_active":"2024-09-16T01:15:43.916784+0000","last_became_peered":"2024-09-16T01:15:43.916784+0000","last_unstale":"2024-09-16T01:15:44.744816+0000","last_undegraded":"2024-09-16T01:15:44.744816+0000","last_fullsized":"2024-09-16T01:15:44.744816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:48.711431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251384+0000","last_change":"2024-09-16T01:15:39.721477+0000","last_active":"2024-09-16T01:15:46.251384+0000","last_peered":"2024-09-16T01:15:46.251384+0000","last_clean":"2024-09-16T01:15:46.251384+0000","last_became_active":"2024-09-16T01:15:39.720755+0000","last_became_peered":"2024-09-16T01:15:39.720755+0000","last_unstale":"2024-09-16T01:15:46.251384+0000","last_undegraded":"2024-09-16T01:15:46.251384+0000","last_fullsized":"2024-09-16T01:15:46.251384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:56.198457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944995+0000","last_change":"2024-09-16T01:15:38.718410+0000","last_active":"2024-09-16T01:15:45.944995+0000","last_peered":"2024-09-16T01:15:45.944995+0000","last_clean":"2024-09-16T01:15:45.944995+0000","last_became_active":"2024-09-16T01:15:38.718113+0000","last_became_peered":"2024-09-16T01:15:38.718113+0000","last_unstale":"2024-09-16T01:15:45.944995+0000","last_undegraded":"2024-09-16T01:15:45.944995+0000","last_fullsized":"2024-09-16T01:15:45.944995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:36.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944193+0000","last_change":"2024-09-16T01:15:43.763443+0000","last_active":"2024-09-16T01:15:45.944193+0000","last_peered":"2024-09-16T01:15:45.944193+0000","last_clean":"2024-09-16T01:15:45.944193+0000","last_became_active":"2024-09-16T01:15:43.763064+0000","last_became_peered":"2024-09-16T01:15:43.763064+0000","last_unstale":"2024-09-16T01:15:45.944193+0000","last_undegraded":"2024-09-16T01:15:45.944193+0000","last_fullsized":"2024-09-16T01:15:45.944193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:19.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251116+0000","last_change":"2024-09-16T01:15:39.721525+0000","last_active":"2024-09-16T01:15:46.251116+0000","last_peered":"2024-09-16T01:15:46.251116+0000","last_clean":"2024-09-16T01:15:46.251116+0000","last_became_active":"2024-09-16T01:15:39.721282+0000","last_became_peered":"2024-09-16T01:15:39.721282+0000","last_unstale":"2024-09-16T01:15:46.251116+0000","last_undegraded":"2024-09-16T01:15:46.251116+0000","last_fullsized":"2024-09-16T01:15:46.251116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:53.278467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644540+0000","last_change":"2024-09-16T01:15:38.716594+0000","last_active":"2024-09-16T01:15:46.644540+0000","last_peered":"2024-09-16T01:15:46.644540+0000","last_clean":"2024-09-16T01:15:46.644540+0000","last_became_active":"2024-09-16T01:15:38.716327+0000","last_became_peered":"2024-09-16T01:15:38.716327+0000","last_unstale":"2024-09-16T01:15:46.644540+0000","last_undegraded":"2024-09-16T01:15:46.644540+0000","last_fullsized":"2024-09-16T01:15:46.644540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:44.803896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747246+0000","last_change":"2024-09-16T01:15:43.763464+0000","last_active":"2024-09-16T01:15:44.747246+0000","last_peered":"2024-09-16T01:15:44.747246+0000","last_clean":"2024-09-16T01:15:44.747246+0000","last_became_active":"2024-09-16T01:15:43.763095+0000","last_became_peered":"2024-09-16T01:15:43.763095+0000","last_unstale":"2024-09-16T01:15:44.747246+0000","last_undegraded":"2024-09-16T01:15:44.747246+0000","last_fullsized":"2024-09-16T01:15:44.747246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:54.978121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745408+0000","last_change":"2024-09-16T01:15:39.726106+0000","last_active":"2024-09-16T01:15:44.745408+0000","last_peered":"2024-09-16T01:15:44.745408+0000","last_clean":"2024-09-16T01:15:44.745408+0000","last_became_active":"2024-09-16T01:15:39.725833+0000","last_became_peered":"2024-09-16T01:15:39.725833+0000","last_unstale":"2024-09-16T01:15:44.745408+0000","last_undegraded":"2024-09-16T01:15:44.745408+0000","last_fullsized":"2024-09-16T01:15:44.745408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745838+0000","last_change":"2024-09-16T01:15:38.710514+0000","last_active":"2024-09-16T01:15:44.745838+0000","last_peered":"2024-09-16T01:15:44.745838+0000","last_clean":"2024-09-16T01:15:44.745838+0000","last_became_active":"2024-09-16T01:15:38.710185+0000","last_became_peered":"2024-09-16T01:15:38.710185+0000","last_unstale":"2024-09-16T01:15:44.745838+0000","last_undegraded":"2024-09-16T01:15:44.745838+0000","last_fullsized":"2024-09-16T01:15:44.745838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:42.942780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922611+0000","last_change":"2024-09-16T01:15:43.919233+0000","last_active":"2024-09-16T01:15:44.922611+0000","last_peered":"2024-09-16T01:15:44.922611+0000","last_clean":"2024-09-16T01:15:44.922611+0000","last_became_active":"2024-09-16T01:15:43.918866+0000","last_became_peered":"2024-09-16T01:15:43.918866+0000","last_unstale":"2024-09-16T01:15:44.922611+0000","last_undegraded":"2024-09-16T01:15:44.922611+0000","last_fullsized":"2024-09-16T01:15:44.922611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:15.298412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251002+0000","last_change":"2024-09-16T01:15:39.722459+0000","last_active":"2024-09-16T01:15:46.251002+0000","last_peered":"2024-09-16T01:15:46.251002+0000","last_clean":"2024-09-16T01:15:46.251002+0000","last_became_active":"2024-09-16T01:15:39.722016+0000","last_became_peered":"2024-09-16T01:15:39.722016+0000","last_unstale":"2024-09-16T01:15:46.251002+0000","last_undegraded":"2024-09-16T01:15:46.251002+0000","last_fullsized":"2024-09-16T01:15:46.251002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:20.730699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746247+0000","last_change":"2024-09-16T01:15:38.715930+0000","last_active":"2024-09-16T01:15:44.746247+0000","last_peered":"2024-09-16T01:15:44.746247+0000","last_clean":"2024-09-16T01:15:44.746247+0000","last_became_active":"2024-09-16T01:15:38.715602+0000","last_became_peered":"2024-09-16T01:15:38.715602+0000","last_unstale":"2024-09-16T01:15:44.746247+0000","last_undegraded":"2024-09-16T01:15:44.746247+0000","last_fullsized":"2024-09-16T01:15:44.746247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:08.518045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922632+0000","last_change":"2024-09-16T01:15:43.917197+0000","last_active":"2024-09-16T01:15:44.922632+0000","last_peered":"2024-09-16T01:15:44.922632+0000","last_clean":"2024-09-16T01:15:44.922632+0000","last_became_active":"2024-09-16T01:15:43.916694+0000","last_became_peered":"2024-09-16T01:15:43.916694+0000","last_unstale":"2024-09-16T01:15:44.922632+0000","last_undegraded":"2024-09-16T01:15:44.922632+0000","last_fullsized":"2024-09-16T01:15:44.922632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:03:54.915059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747227+0000","last_change":"2024-09-16T01:15:39.731508+0000","last_active":"2024-09-16T01:15:44.747227+0000","last_peered":"2024-09-16T01:15:44.747227+0000","last_clean":"2024-09-16T01:15:44.747227+0000","last_became_active":"2024-09-16T01:15:39.730663+0000","last_became_peered":"2024-09-16T01:15:39.730663+0000","last_unstale":"2024-09-16T01:15:44.747227+0000","last_undegraded":"2024-09-16T01:15:44.747227+0000","last_fullsized":"2024-09-16T01:15:44.747227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:52.736329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747663+0000","last_change":"2024-09-16T01:15:38.715147+0000","last_active":"2024-09-16T01:15:44.747663+0000","last_peered":"2024-09-16T01:15:44.747663+0000","last_clean":"2024-09-16T01:15:44.747663+0000","last_became_active":"2024-09-16T01:15:38.714378+0000","last_became_peered":"2024-09-16T01:15:38.714378+0000","last_unstale":"2024-09-16T01:15:44.747663+0000","last_undegraded":"2024-09-16T01:15:44.747663+0000","last_fullsized":"2024-09-16T01:15:44.747663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:36.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745684+0000","last_change":"2024-09-16T01:15:43.917886+0000","last_active":"2024-09-16T01:15:44.745684+0000","last_peered":"2024-09-16T01:15:44.745684+0000","last_clean":"2024-09-16T01:15:44.745684+0000","last_became_active":"2024-09-16T01:15:43.917474+0000","last_became_peered":"2024-09-16T01:15:43.917474+0000","last_unstale":"2024-09-16T01:15:44.745684+0000","last_undegraded":"2024-09-16T01:15:44.745684+0000","last_fullsized":"2024-09-16T01:15:44.745684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:08.989590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251072+0000","last_change":"2024-09-16T01:15:39.727254+0000","last_active":"2024-09-16T01:15:46.251072+0000","last_peered":"2024-09-16T01:15:46.251072+0000","last_clean":"2024-09-16T01:15:46.251072+0000","last_became_active":"2024-09-16T01:15:39.726904+0000","last_became_peered":"2024-09-16T01:15:39.726904+0000","last_unstale":"2024-09-16T01:15:46.251072+0000","last_undegraded":"2024-09-16T01:15:46.251072+0000","last_fullsized":"2024-09-16T01:15:46.251072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:23.041359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:49.106598+0000","last_change":"2024-09-16T01:15:38.716774+0000","last_active":"2024-09-16T01:15:49.106598+0000","last_peered":"2024-09-16T01:15:49.106598+0000","last_clean":"2024-09-16T01:15:49.106598+0000","last_became_active":"2024-09-16T01:15:38.716441+0000","last_became_peered":"2024-09-16T01:15:38.716441+0000","last_unstale":"2024-09-16T01:15:49.106598+0000","last_undegraded":"2024-09-16T01:15:49.106598+0000","last_fullsized":"2024-09-16T01:15:49.106598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:08.518045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816941+0000","last_change":"2024-09-16T01:15:43.760938+0000","last_active":"2024-09-16T01:15:44.816941+0000","last_peered":"2024-09-16T01:15:44.816941+0000","last_clean":"2024-09-16T01:15:44.816941+0000","last_became_active":"2024-09-16T01:15:43.759362+0000","last_became_peered":"2024-09-16T01:15:43.759362+0000","last_unstale":"2024-09-16T01:15:44.816941+0000","last_undegraded":"2024-09-16T01:15:44.816941+0000","last_fullsized":"2024-09-16T01:15:44.816941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:54.978121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944687+0000","last_change":"2024-09-16T01:15:39.724557+0000","last_active":"2024-09-16T01:15:45.944687+0000","last_peered":"2024-09-16T01:15:45.944687+0000","last_clean":"2024-09-16T01:15:45.944687+0000","last_became_active":"2024-09-16T01:15:39.724253+0000","last_became_peered":"2024-09-16T01:15:39.724253+0000","last_unstale":"2024-09-16T01:15:45.944687+0000","last_undegraded":"2024-09-16T01:15:45.944687+0000","last_fullsized":"2024-09-16T01:15:45.944687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:51.849603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817542+0000","last_change":"2024-09-16T01:15:38.712961+0000","last_active":"2024-09-16T01:15:44.817542+0000","last_peered":"2024-09-16T01:15:44.817542+0000","last_clean":"2024-09-16T01:15:44.817542+0000","last_became_active":"2024-09-16T01:15:38.712701+0000","last_became_peered":"2024-09-16T01:15:38.712701+0000","last_unstale":"2024-09-16T01:15:44.817542+0000","last_undegraded":"2024-09-16T01:15:44.817542+0000","last_fullsized":"2024-09-16T01:15:44.817542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:43.994450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944656+0000","last_change":"2024-09-16T01:15:43.765439+0000","last_active":"2024-09-16T01:15:45.944656+0000","last_peered":"2024-09-16T01:15:45.944656+0000","last_clean":"2024-09-16T01:15:45.944656+0000","last_became_active":"2024-09-16T01:15:43.765020+0000","last_became_peered":"2024-09-16T01:15:43.765020+0000","last_unstale":"2024-09-16T01:15:45.944656+0000","last_undegraded":"2024-09-16T01:15:45.944656+0000","last_fullsized":"2024-09-16T01:15:45.944656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:24.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747568+0000","last_change":"2024-09-16T01:15:39.730738+0000","last_active":"2024-09-16T01:15:44.747568+0000","last_peered":"2024-09-16T01:15:44.747568+0000","last_clean":"2024-09-16T01:15:44.747568+0000","last_became_active":"2024-09-16T01:15:39.730255+0000","last_became_peered":"2024-09-16T01:15:39.730255+0000","last_unstale":"2024-09-16T01:15:44.747568+0000","last_undegraded":"2024-09-16T01:15:44.747568+0000","last_fullsized":"2024-09-16T01:15:44.747568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745379+0000","last_change":"2024-09-16T01:15:38.715232+0000","last_active":"2024-09-16T01:15:44.745379+0000","last_peered":"2024-09-16T01:15:44.745379+0000","last_clean":"2024-09-16T01:15:44.745379+0000","last_became_active":"2024-09-16T01:15:38.714944+0000","last_became_peered":"2024-09-16T01:15:38.714944+0000","last_unstale":"2024-09-16T01:15:44.745379+0000","last_undegraded":"2024-09-16T01:15:44.745379+0000","last_fullsized":"2024-09-16T01:15:44.745379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:24.701682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921870+0000","last_change":"2024-09-16T01:15:43.758834+0000","last_active":"2024-09-16T01:15:44.921870+0000","last_peered":"2024-09-16T01:15:44.921870+0000","last_clean":"2024-09-16T01:15:44.921870+0000","last_became_active":"2024-09-16T01:15:43.758362+0000","last_became_peered":"2024-09-16T01:15:43.758362+0000","last_unstale":"2024-09-16T01:15:44.921870+0000","last_undegraded":"2024-09-16T01:15:44.921870+0000","last_fullsized":"2024-09-16T01:15:44.921870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:10.924601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745261+0000","last_change":"2024-09-16T01:15:39.723043+0000","last_active":"2024-09-16T01:15:44.745261+0000","last_peered":"2024-09-16T01:15:44.745261+0000","last_clean":"2024-09-16T01:15:44.745261+0000","last_became_active":"2024-09-16T01:15:39.722068+0000","last_became_peered":"2024-09-16T01:15:39.722068+0000","last_unstale":"2024-09-16T01:15:44.745261+0000","last_undegraded":"2024-09-16T01:15:44.745261+0000","last_fullsized":"2024-09-16T01:15:44.745261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:15.851594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746622+0000","last_change":"2024-09-16T01:15:38.712075+0000","last_active":"2024-09-16T01:15:44.746622+0000","last_peered":"2024-09-16T01:15:44.746622+0000","last_clean":"2024-09-16T01:15:44.746622+0000","last_became_active":"2024-09-16T01:15:38.711796+0000","last_became_peered":"2024-09-16T01:15:38.711796+0000","last_unstale":"2024-09-16T01:15:44.746622+0000","last_undegraded":"2024-09-16T01:15:44.746622+0000","last_fullsized":"2024-09-16T01:15:44.746622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:24.701682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922056+0000","last_change":"2024-09-16T01:15:43.920754+0000","last_active":"2024-09-16T01:15:44.922056+0000","last_peered":"2024-09-16T01:15:44.922056+0000","last_clean":"2024-09-16T01:15:44.922056+0000","last_became_active":"2024-09-16T01:15:43.919569+0000","last_became_peered":"2024-09-16T01:15:43.919569+0000","last_unstale":"2024-09-16T01:15:44.922056+0000","last_undegraded":"2024-09-16T01:15:44.922056+0000","last_fullsized":"2024-09-16T01:15:44.922056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:08.989590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747159+0000","last_change":"2024-09-16T01:15:43.921667+0000","last_active":"2024-09-16T01:15:44.747159+0000","last_peered":"2024-09-16T01:15:44.747159+0000","last_clean":"2024-09-16T01:15:44.747159+0000","last_became_active":"2024-09-16T01:15:43.921261+0000","last_became_peered":"2024-09-16T01:15:43.921261+0000","last_unstale":"2024-09-16T01:15:44.747159+0000","last_undegraded":"2024-09-16T01:15:44.747159+0000","last_fullsized":"2024-09-16T01:15:44.747159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:27.078175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816721+0000","last_change":"2024-09-16T01:15:39.715516+0000","last_active":"2024-09-16T01:15:44.816721+0000","last_peered":"2024-09-16T01:15:44.816721+0000","last_clean":"2024-09-16T01:15:44.816721+0000","last_became_active":"2024-09-16T01:15:39.715303+0000","last_became_peered":"2024-09-16T01:15:39.715303+0000","last_unstale":"2024-09-16T01:15:44.816721+0000","last_undegraded":"2024-09-16T01:15:44.816721+0000","last_fullsized":"2024-09-16T01:15:44.816721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744965+0000","last_change":"2024-09-16T01:15:38.709515+0000","last_active":"2024-09-16T01:15:44.744965+0000","last_peered":"2024-09-16T01:15:44.744965+0000","last_clean":"2024-09-16T01:15:44.744965+0000","last_became_active":"2024-09-16T01:15:38.708945+0000","last_became_peered":"2024-09-16T01:15:38.708945+0000","last_unstale":"2024-09-16T01:15:44.744965+0000","last_undegraded":"2024-09-16T01:15:44.744965+0000","last_fullsized":"2024-09-16T01:15:44.744965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:46.439923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746558+0000","last_change":"2024-09-16T01:15:43.763256+0000","last_active":"2024-09-16T01:15:44.746558+0000","last_peered":"2024-09-16T01:15:44.746558+0000","last_clean":"2024-09-16T01:15:44.746558+0000","last_became_active":"2024-09-16T01:15:43.762837+0000","last_became_peered":"2024-09-16T01:15:43.762837+0000","last_unstale":"2024-09-16T01:15:44.746558+0000","last_undegraded":"2024-09-16T01:15:44.746558+0000","last_fullsized":"2024-09-16T01:15:44.746558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:24.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921881+0000","last_change":"2024-09-16T01:15:39.727402+0000","last_active":"2024-09-16T01:15:44.921881+0000","last_peered":"2024-09-16T01:15:44.921881+0000","last_clean":"2024-09-16T01:15:44.921881+0000","last_became_active":"2024-09-16T01:15:39.726906+0000","last_became_peered":"2024-09-16T01:15:39.726906+0000","last_unstale":"2024-09-16T01:15:44.921881+0000","last_undegraded":"2024-09-16T01:15:44.921881+0000","last_fullsized":"2024-09-16T01:15:44.921881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.166842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922185+0000","last_change":"2024-09-16T01:15:38.707171+0000","last_active":"2024-09-16T01:15:44.922185+0000","last_peered":"2024-09-16T01:15:44.922185+0000","last_clean":"2024-09-16T01:15:44.922185+0000","last_became_active":"2024-09-16T01:15:38.706905+0000","last_became_peered":"2024-09-16T01:15:38.706905+0000","last_unstale":"2024-09-16T01:15:44.922185+0000","last_undegraded":"2024-09-16T01:15:44.922185+0000","last_fullsized":"2024-09-16T01:15:44.922185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:42.942780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746293+0000","last_change":"2024-09-16T01:15:38.709634+0000","last_active":"2024-09-16T01:15:44.746293+0000","last_peered":"2024-09-16T01:15:44.746293+0000","last_clean":"2024-09-16T01:15:44.746293+0000","last_became_active":"2024-09-16T01:15:38.709327+0000","last_became_peered":"2024-09-16T01:15:38.709327+0000","last_unstale":"2024-09-16T01:15:44.746293+0000","last_undegraded":"2024-09-16T01:15:44.746293+0000","last_fullsized":"2024-09-16T01:15:44.746293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:52.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747564+0000","last_change":"2024-09-16T01:15:39.722400+0000","last_active":"2024-09-16T01:15:44.747564+0000","last_peered":"2024-09-16T01:15:44.747564+0000","last_clean":"2024-09-16T01:15:44.747564+0000","last_became_active":"2024-09-16T01:15:39.722125+0000","last_became_peered":"2024-09-16T01:15:39.722125+0000","last_unstale":"2024-09-16T01:15:44.747564+0000","last_undegraded":"2024-09-16T01:15:44.747564+0000","last_fullsized":"2024-09-16T01:15:44.747564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644833+0000","last_change":"2024-09-16T01:15:43.756363+0000","last_active":"2024-09-16T01:15:46.644833+0000","last_peered":"2024-09-16T01:15:46.644833+0000","last_clean":"2024-09-16T01:15:46.644833+0000","last_became_active":"2024-09-16T01:15:43.755986+0000","last_became_peered":"2024-09-16T01:15:43.755986+0000","last_unstale":"2024-09-16T01:15:46.644833+0000","last_undegraded":"2024-09-16T01:15:46.644833+0000","last_fullsized":"2024-09-16T01:15:46.644833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:59.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922374+0000","last_change":"2024-09-16T01:15:38.717144+0000","last_active":"2024-09-16T01:15:44.922374+0000","last_peered":"2024-09-16T01:15:44.922374+0000","last_clean":"2024-09-16T01:15:44.922374+0000","last_became_active":"2024-09-16T01:15:38.716925+0000","last_became_peered":"2024-09-16T01:15:38.716925+0000","last_unstale":"2024-09-16T01:15:44.922374+0000","last_undegraded":"2024-09-16T01:15:44.922374+0000","last_fullsized":"2024-09-16T01:15:44.922374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:44.803896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944458+0000","last_change":"2024-09-16T01:15:39.720645+0000","last_active":"2024-09-16T01:15:45.944458+0000","last_peered":"2024-09-16T01:15:45.944458+0000","last_clean":"2024-09-16T01:15:45.944458+0000","last_became_active":"2024-09-16T01:15:39.720391+0000","last_became_peered":"2024-09-16T01:15:39.720391+0000","last_unstale":"2024-09-16T01:15:45.944458+0000","last_undegraded":"2024-09-16T01:15:45.944458+0000","last_fullsized":"2024-09-16T01:15:45.944458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:09.524001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922230+0000","last_change":"2024-09-16T01:15:43.761796+0000","last_active":"2024-09-16T01:15:44.922230+0000","last_peered":"2024-09-16T01:15:44.922230+0000","last_clean":"2024-09-16T01:15:44.922230+0000","last_became_active":"2024-09-16T01:15:43.761242+0000","last_became_peered":"2024-09-16T01:15:43.761242+0000","last_unstale":"2024-09-16T01:15:44.922230+0000","last_undegraded":"2024-09-16T01:15:44.922230+0000","last_fullsized":"2024-09-16T01:15:44.922230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:41.757039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745300+0000","last_change":"2024-09-16T01:15:39.726420+0000","last_active":"2024-09-16T01:15:44.745300+0000","last_peered":"2024-09-16T01:15:44.745300+0000","last_clean":"2024-09-16T01:15:44.745300+0000","last_became_active":"2024-09-16T01:15:39.726142+0000","last_became_peered":"2024-09-16T01:15:39.726142+0000","last_unstale":"2024-09-16T01:15:44.745300+0000","last_undegraded":"2024-09-16T01:15:44.745300+0000","last_fullsized":"2024-09-16T01:15:44.745300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644670+0000","last_change":"2024-09-16T01:15:39.708234+0000","last_active":"2024-09-16T01:15:46.644670+0000","last_peered":"2024-09-16T01:15:46.644670+0000","last_clean":"2024-09-16T01:15:46.644670+0000","last_became_active":"2024-09-16T01:15:39.707935+0000","last_became_peered":"2024-09-16T01:15:39.707935+0000","last_unstale":"2024-09-16T01:15:46.644670+0000","last_undegraded":"2024-09-16T01:15:46.644670+0000","last_fullsized":"2024-09-16T01:15:46.644670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.000406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746151+0000","last_change":"2024-09-16T01:15:39.716296+0000","last_active":"2024-09-16T01:15:44.746151+0000","last_peered":"2024-09-16T01:15:44.746151+0000","last_clean":"2024-09-16T01:15:44.746151+0000","last_became_active":"2024-09-16T01:15:39.715998+0000","last_became_peered":"2024-09-16T01:15:39.715998+0000","last_unstale":"2024-09-16T01:15:44.746151+0000","last_undegraded":"2024-09-16T01:15:44.746151+0000","last_fullsized":"2024-09-16T01:15:44.746151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:19.871750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747461+0000","last_change":"2024-09-16T01:15:39.732779+0000","last_active":"2024-09-16T01:15:44.747461+0000","last_peered":"2024-09-16T01:15:44.747461+0000","last_clean":"2024-09-16T01:15:44.747461+0000","last_became_active":"2024-09-16T01:15:39.732514+0000","last_became_peered":"2024-09-16T01:15:39.732514+0000","last_unstale":"2024-09-16T01:15:44.747461+0000","last_undegraded":"2024-09-16T01:15:44.747461+0000","last_fullsized":"2024-09-16T01:15:44.747461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922366+0000","last_change":"2024-09-16T01:15:39.732741+0000","last_active":"2024-09-16T01:15:44.922366+0000","last_peered":"2024-09-16T01:15:44.922366+0000","last_clean":"2024-09-16T01:15:44.922366+0000","last_became_active":"2024-09-16T01:15:39.732480+0000","last_became_peered":"2024-09-16T01:15:39.732480+0000","last_unstale":"2024-09-16T01:15:44.922366+0000","last_undegraded":"2024-09-16T01:15:44.922366+0000","last_fullsized":"2024-09-16T01:15:44.922366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:32.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817305+0000","last_change":"2024-09-16T01:15:39.721673+0000","last_active":"2024-09-16T01:15:44.817305+0000","last_peered":"2024-09-16T01:15:44.817305+0000","last_clean":"2024-09-16T01:15:44.817305+0000","last_became_active":"2024-09-16T01:15:39.721038+0000","last_became_peered":"2024-09-16T01:15:39.721038+0000","last_unstale":"2024-09-16T01:15:44.817305+0000","last_undegraded":"2024-09-16T01:15:44.817305+0000","last_fullsized":"2024-09-16T01:15:44.817305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:32.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746704+0000","last_change":"2024-09-16T01:15:39.725684+0000","last_active":"2024-09-16T01:15:44.746704+0000","last_peered":"2024-09-16T01:15:44.746704+0000","last_clean":"2024-09-16T01:15:44.746704+0000","last_became_active":"2024-09-16T01:15:39.725383+0000","last_became_peered":"2024-09-16T01:15:39.725383+0000","last_unstale":"2024-09-16T01:15:44.746704+0000","last_undegraded":"2024-09-16T01:15:44.746704+0000","last_fullsized":"2024-09-16T01:15:44.746704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922579+0000","last_change":"2024-09-16T01:15:39.732120+0000","last_active":"2024-09-16T01:15:44.922579+0000","last_peered":"2024-09-16T01:15:44.922579+0000","last_clean":"2024-09-16T01:15:44.922579+0000","last_became_active":"2024-09-16T01:15:39.731874+0000","last_became_peered":"2024-09-16T01:15:39.731874+0000","last_unstale":"2024-09-16T01:15:44.922579+0000","last_undegraded":"2024-09-16T01:15:44.922579+0000","last_fullsized":"2024-09-16T01:15:44.922579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:39.132954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744949+0000","last_change":"2024-09-16T01:15:39.714218+0000","last_active":"2024-09-16T01:15:44.744949+0000","last_peered":"2024-09-16T01:15:44.744949+0000","last_clean":"2024-09-16T01:15:44.744949+0000","last_became_active":"2024-09-16T01:15:39.713937+0000","last_became_peered":"2024-09-16T01:15:39.713937+0000","last_unstale":"2024-09-16T01:15:44.744949+0000","last_undegraded":"2024-09-16T01:15:44.744949+0000","last_fullsized":"2024-09-16T01:15:44.744949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:32.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922164+0000","last_change":"2024-09-16T01:15:39.733311+0000","last_active":"2024-09-16T01:15:44.922164+0000","last_peered":"2024-09-16T01:15:44.922164+0000","last_clean":"2024-09-16T01:15:44.922164+0000","last_became_active":"2024-09-16T01:15:39.733144+0000","last_became_peered":"2024-09-16T01:15:39.733144+0000","last_unstale":"2024-09-16T01:15:44.922164+0000","last_undegraded":"2024-09-16T01:15:44.922164+0000","last_fullsized":"2024-09-16T01:15:44.922164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746055+0000","last_change":"2024-09-16T01:15:39.724420+0000","last_active":"2024-09-16T01:15:44.746055+0000","last_peered":"2024-09-16T01:15:44.746055+0000","last_clean":"2024-09-16T01:15:44.746055+0000","last_became_active":"2024-09-16T01:15:39.723819+0000","last_became_peered":"2024-09-16T01:15:39.723819+0000","last_unstale":"2024-09-16T01:15:44.746055+0000","last_undegraded":"2024-09-16T01:15:44.746055+0000","last_fullsized":"2024-09-16T01:15:44.746055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:50.941305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747222+0000","last_change":"2024-09-16T01:15:39.723569+0000","last_active":"2024-09-16T01:15:44.747222+0000","last_peered":"2024-09-16T01:15:44.747222+0000","last_clean":"2024-09-16T01:15:44.747222+0000","last_became_active":"2024-09-16T01:15:39.723316+0000","last_became_peered":"2024-09-16T01:15:39.723316+0000","last_unstale":"2024-09-16T01:15:44.747222+0000","last_undegraded":"2024-09-16T01:15:44.747222+0000","last_fullsized":"2024-09-16T01:15:44.747222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746161+0000","last_change":"2024-09-16T01:15:39.719774+0000","last_active":"2024-09-16T01:15:44.746161+0000","last_peered":"2024-09-16T01:15:44.746161+0000","last_clean":"2024-09-16T01:15:44.746161+0000","last_became_active":"2024-09-16T01:15:39.719499+0000","last_became_peered":"2024-09-16T01:15:39.719499+0000","last_unstale":"2024-09-16T01:15:44.746161+0000","last_undegraded":"2024-09-16T01:15:44.746161+0000","last_fullsized":"2024-09-16T01:15:44.746161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251449+0000","last_change":"2024-09-16T01:15:39.724488+0000","last_active":"2024-09-16T01:15:46.251449+0000","last_peered":"2024-09-16T01:15:46.251449+0000","last_clean":"2024-09-16T01:15:46.251449+0000","last_became_active":"2024-09-16T01:15:39.724205+0000","last_became_peered":"2024-09-16T01:15:39.724205+0000","last_unstale":"2024-09-16T01:15:46.251449+0000","last_undegraded":"2024-09-16T01:15:46.251449+0000","last_fullsized":"2024-09-16T01:15:46.251449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:06.887785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644890+0000","last_change":"2024-09-16T01:15:39.712637+0000","last_active":"2024-09-16T01:15:46.644890+0000","last_peered":"2024-09-16T01:15:46.644890+0000","last_clean":"2024-09-16T01:15:46.644890+0000","last_became_active":"2024-09-16T01:15:39.712015+0000","last_became_peered":"2024-09-16T01:15:39.712015+0000","last_unstale":"2024-09-16T01:15:46.644890+0000","last_undegraded":"2024-09-16T01:15:46.644890+0000","last_fullsized":"2024-09-16T01:15:46.644890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:51.849603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745814+0000","last_change":"2024-09-16T01:15:39.722757+0000","last_active":"2024-09-16T01:15:44.745814+0000","last_peered":"2024-09-16T01:15:44.745814+0000","last_clean":"2024-09-16T01:15:44.745814+0000","last_became_active":"2024-09-16T01:15:39.722500+0000","last_became_peered":"2024-09-16T01:15:39.722500+0000","last_unstale":"2024-09-16T01:15:44.745814+0000","last_undegraded":"2024-09-16T01:15:44.745814+0000","last_fullsized":"2024-09-16T01:15:44.745814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:23.041359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744838+0000","last_change":"2024-09-16T01:15:39.725209+0000","last_active":"2024-09-16T01:15:44.744838+0000","last_peered":"2024-09-16T01:15:44.744838+0000","last_clean":"2024-09-16T01:15:44.744838+0000","last_became_active":"2024-09-16T01:15:39.724906+0000","last_became_peered":"2024-09-16T01:15:39.724906+0000","last_unstale":"2024-09-16T01:15:44.744838+0000","last_undegraded":"2024-09-16T01:15:44.744838+0000","last_fullsized":"2024-09-16T01:15:44.744838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816777+0000","last_change":"2024-09-16T01:15:39.724771+0000","last_active":"2024-09-16T01:15:44.816777+0000","last_peered":"2024-09-16T01:15:44.816777+0000","last_clean":"2024-09-16T01:15:44.816777+0000","last_became_active":"2024-09-16T01:15:39.724512+0000","last_became_peered":"2024-09-16T01:15:39.724512+0000","last_unstale":"2024-09-16T01:15:44.816777+0000","last_undegraded":"2024-09-16T01:15:44.816777+0000","last_fullsized":"2024-09-16T01:15:44.816777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747162+0000","last_change":"2024-09-16T01:15:39.717182+0000","last_active":"2024-09-16T01:15:44.747162+0000","last_peered":"2024-09-16T01:15:44.747162+0000","last_clean":"2024-09-16T01:15:44.747162+0000","last_became_active":"2024-09-16T01:15:39.716928+0000","last_became_peered":"2024-09-16T01:15:39.716928+0000","last_unstale":"2024-09-16T01:15:44.747162+0000","last_undegraded":"2024-09-16T01:15:44.747162+0000","last_fullsized":"2024-09-16T01:15:44.747162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:55.663948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922288+0000","last_change":"2024-09-16T01:15:39.729915+0000","last_active":"2024-09-16T01:15:44.922288+0000","last_peered":"2024-09-16T01:15:44.922288+0000","last_clean":"2024-09-16T01:15:44.922288+0000","last_became_active":"2024-09-16T01:15:39.729619+0000","last_became_peered":"2024-09-16T01:15:39.729619+0000","last_unstale":"2024-09-16T01:15:44.922288+0000","last_undegraded":"2024-09-16T01:15:44.922288+0000","last_fullsized":"2024-09-16T01:15:44.922288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944679+0000","last_change":"2024-09-16T01:15:39.728860+0000","last_active":"2024-09-16T01:15:45.944679+0000","last_peered":"2024-09-16T01:15:45.944679+0000","last_clean":"2024-09-16T01:15:45.944679+0000","last_became_active":"2024-09-16T01:15:39.728186+0000","last_became_peered":"2024-09-16T01:15:39.728186+0000","last_unstale":"2024-09-16T01:15:45.944679+0000","last_undegraded":"2024-09-16T01:15:45.944679+0000","last_fullsized":"2024-09-16T01:15:45.944679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:59.931695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746379+0000","last_change":"2024-09-16T01:15:39.721095+0000","last_active":"2024-09-16T01:15:44.746379+0000","last_peered":"2024-09-16T01:15:44.746379+0000","last_clean":"2024-09-16T01:15:44.746379+0000","last_became_active":"2024-09-16T01:15:39.720129+0000","last_became_peered":"2024-09-16T01:15:39.720129+0000","last_unstale":"2024-09-16T01:15:44.746379+0000","last_undegraded":"2024-09-16T01:15:44.746379+0000","last_fullsized":"2024-09-16T01:15:44.746379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.089581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746705+0000","last_change":"2024-09-16T01:15:39.720408+0000","last_active":"2024-09-16T01:15:44.746705+0000","last_peered":"2024-09-16T01:15:44.746705+0000","last_clean":"2024-09-16T01:15:44.746705+0000","last_became_active":"2024-09-16T01:15:39.720126+0000","last_became_peered":"2024-09-16T01:15:39.720126+0000","last_unstale":"2024-09-16T01:15:44.746705+0000","last_undegraded":"2024-09-16T01:15:44.746705+0000","last_fullsized":"2024-09-16T01:15:44.746705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251410+0000","last_change":"2024-09-16T01:15:39.729127+0000","last_active":"2024-09-16T01:15:46.251410+0000","last_peered":"2024-09-16T01:15:46.251410+0000","last_clean":"2024-09-16T01:15:46.251410+0000","last_became_active":"2024-09-16T01:15:39.728867+0000","last_became_peered":"2024-09-16T01:15:39.728867+0000","last_unstale":"2024-09-16T01:15:46.251410+0000","last_undegraded":"2024-09-16T01:15:46.251410+0000","last_fullsized":"2024-09-16T01:15:46.251410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:30.159628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921788+0000","last_change":"2024-09-16T01:15:39.727163+0000","last_active":"2024-09-16T01:15:44.921788+0000","last_peered":"2024-09-16T01:15:44.921788+0000","last_clean":"2024-09-16T01:15:44.921788+0000","last_became_active":"2024-09-16T01:15:39.726499+0000","last_became_peered":"2024-09-16T01:15:39.726499+0000","last_unstale":"2024-09-16T01:15:44.921788+0000","last_undegraded":"2024-09-16T01:15:44.921788+0000","last_fullsized":"2024-09-16T01:15:44.921788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.089581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250973+0000","last_change":"2024-09-16T01:15:39.723869+0000","last_active":"2024-09-16T01:15:46.250973+0000","last_peered":"2024-09-16T01:15:46.250973+0000","last_clean":"2024-09-16T01:15:46.250973+0000","last_became_active":"2024-09-16T01:15:39.723601+0000","last_became_peered":"2024-09-16T01:15:39.723601+0000","last_unstale":"2024-09-16T01:15:46.250973+0000","last_undegraded":"2024-09-16T01:15:46.250973+0000","last_fullsized":"2024-09-16T01:15:46.250973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:22.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745944+0000","last_change":"2024-09-16T01:15:39.724663+0000","last_active":"2024-09-16T01:15:44.745944+0000","last_peered":"2024-09-16T01:15:44.745944+0000","last_clean":"2024-09-16T01:15:44.745944+0000","last_became_active":"2024-09-16T01:15:39.724164+0000","last_became_peered":"2024-09-16T01:15:39.724164+0000","last_unstale":"2024-09-16T01:15:44.745944+0000","last_undegraded":"2024-09-16T01:15:44.745944+0000","last_fullsized":"2024-09-16T01:15:44.745944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250875+0000","last_change":"2024-09-16T01:15:39.723119+0000","last_active":"2024-09-16T01:15:46.250875+0000","last_peered":"2024-09-16T01:15:46.250875+0000","last_clean":"2024-09-16T01:15:46.250875+0000","last_became_active":"2024-09-16T01:15:39.722798+0000","last_became_peered":"2024-09-16T01:15:39.722798+0000","last_unstale":"2024-09-16T01:15:46.250875+0000","last_undegraded":"2024-09-16T01:15:46.250875+0000","last_fullsized":"2024-09-16T01:15:46.250875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:51.270260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745254+0000","last_change":"2024-09-16T01:15:39.716987+0000","last_active":"2024-09-16T01:15:44.745254+0000","last_peered":"2024-09-16T01:15:44.745254+0000","last_clean":"2024-09-16T01:15:44.745254+0000","last_became_active":"2024-09-16T01:15:39.716715+0000","last_became_peered":"2024-09-16T01:15:39.716715+0000","last_unstale":"2024-09-16T01:15:44.745254+0000","last_undegraded":"2024-09-16T01:15:44.745254+0000","last_fullsized":"2024-09-16T01:15:44.745254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:22.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747307+0000","last_change":"2024-09-16T01:15:39.721824+0000","last_active":"2024-09-16T01:15:44.747307+0000","last_peered":"2024-09-16T01:15:44.747307+0000","last_clean":"2024-09-16T01:15:44.747307+0000","last_became_active":"2024-09-16T01:15:39.721566+0000","last_became_peered":"2024-09-16T01:15:39.721566+0000","last_unstale":"2024-09-16T01:15:44.747307+0000","last_undegraded":"2024-09-16T01:15:44.747307+0000","last_fullsized":"2024-09-16T01:15:44.747307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.166842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817619+0000","last_change":"2024-09-16T01:15:39.723439+0000","last_active":"2024-09-16T01:15:44.817619+0000","last_peered":"2024-09-16T01:15:44.817619+0000","last_clean":"2024-09-16T01:15:44.817619+0000","last_became_active":"2024-09-16T01:15:39.722822+0000","last_became_peered":"2024-09-16T01:15:39.722822+0000","last_unstale":"2024-09-16T01:15:44.817619+0000","last_undegraded":"2024-09-16T01:15:44.817619+0000","last_fullsized":"2024-09-16T01:15:44.817619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251286+0000","last_change":"2024-09-16T01:15:39.721668+0000","last_active":"2024-09-16T01:15:46.251286+0000","last_peered":"2024-09-16T01:15:46.251286+0000","last_clean":"2024-09-16T01:15:46.251286+0000","last_became_active":"2024-09-16T01:15:39.720818+0000","last_became_peered":"2024-09-16T01:15:39.720818+0000","last_unstale":"2024-09-16T01:15:46.251286+0000","last_undegraded":"2024-09-16T01:15:46.251286+0000","last_fullsized":"2024-09-16T01:15:46.251286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:19.871750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:16:00.054 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:16:00.055 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T01:16:00.055 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-16T01:16:00.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-16T01:16:00.055 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-16T01:16:00.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.186+0000 7fb34ee0e640 1 Processor -- start 2024-09-16T01:16:00.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.186+0000 7fb34ee0e640 1 -- start start 2024-09-16T01:16:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb34ee0e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb34815ba30 0x7fb34806f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb34ee0e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb348073050 0x7fb3480b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb34ee0e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3480b3570 con 0x7fb34806fd50 2024-09-16T01:16:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb34ee0e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb3480b4180 con 0x7fb34815ba30 2024-09-16T01:16:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb34ee0e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb3480b3850 con 0x7fb348073050 2024-09-16T01:16:00.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb347fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb34806fd50 0x7fb348072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38398/0 (socket says 172.21.15.81:38398) 2024-09-16T01:16:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb347fff640 1 -- 172.21.15.81:0/233279705 learned_addr learned my addr 172.21.15.81:0/233279705 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb34cbaa640 1 --2- 172.21.15.81:0/233279705 >> v2:172.21.15.102:3300/0 conn(0x7fb34815ba30 0x7fb34806f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065336098 0 0) 0x7fb3480b3570 con 0x7fb34806fd50 2024-09-16T01:16:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb34d3ab640 1 --2- 172.21.15.81:0/233279705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb348073050 0x7fb3480b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb338004630 con 0x7fb34806fd50 2024-09-16T01:16:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2655844394 0 0) 0x7fb338004630 con 0x7fb34806fd50 2024-09-16T01:16:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb348073050 msgr2=0x7fb3480b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb3477fe640 1 --2- 172.21.15.81:0/233279705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb348073050 0x7fb3480b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 >> v2:172.21.15.102:3300/0 conn(0x7fb34815ba30 msgr2=0x7fb34806f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb3477fe640 1 --2- 172.21.15.81:0/233279705 >> v2:172.21.15.102:3300/0 conn(0x7fb34815ba30 0x7fb34806f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3480b3b30 con 0x7fb34806fd50 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fb334001670 con 0x7fb34806fd50 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 >> v1:172.21.15.81:6789/0 conn(0x7fb34806fd50 legacy=0x7fb348072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb3477fe640 1 --2- 172.21.15.81:0/233279705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb338004ac0 0x7fb338004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.187+0000 7fb3477fe640 1 --2- 172.21.15.81:0/233279705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb338003440 0x7fb3380038c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.188+0000 7fb3477fe640 1 --2- 172.21.15.81:0/233279705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb348073050 0x7fb338003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.188+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3480b4180 con 0x7fb338003440 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.188+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb3480b3850 con 0x7fb338004ac0 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.188+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb33800b9d0 con 0x7fb348073050 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.188+0000 7fb347fff640 1 --2- 172.21.15.81:0/233279705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb338003440 0x7fb3380038c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.188+0000 7fb34cbaa640 1 --2- 172.21.15.81:0/233279705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb338004ac0 0x7fb338004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.188+0000 7fb34d3ab640 1 --2- 172.21.15.81:0/233279705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb348073050 0x7fb338003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.188+0000 7fb347fff640 1 -- 172.21.15.81:0/233279705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb348073050 msgr2=0x7fb338003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.188+0000 7fb347fff640 1 --2- 172.21.15.81:0/233279705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb348073050 0x7fb338003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.188+0000 7fb347fff640 1 -- 172.21.15.81:0/233279705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb338004ac0 msgr2=0x7fb338004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.188+0000 7fb347fff640 1 --2- 172.21.15.81:0/233279705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb338004ac0 0x7fb338004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.188+0000 7fb347fff640 1 -- 172.21.15.81:0/233279705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb338004630 con 0x7fb338003440 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.189+0000 7fb347fff640 1 --2- 172.21.15.81:0/233279705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb338003440 0x7fb3380038c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c240 tx=0x7fb338004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4b11e00bda21a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.189+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334007d30 con 0x7fb338003440 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.189+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb334005ad0 con 0x7fb338003440 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.189+0000 7fb3477fe640 1 -- 172.21.15.81:0/233279705 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334007070 con 0x7fb338003440 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.189+0000 7fb34ee0e640 1 -- 172.21.15.81:0/233279705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb338003440 msgr2=0x7fb3380038c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.189+0000 7fb34ee0e640 1 --2- 172.21.15.81:0/233279705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb338003440 0x7fb3380038c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c240 tx=0x7fb338004470 comp rx=0 tx=0).stop 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.189+0000 7fb34d3ab640 1 -- 172.21.15.81:0/233279705 reap_dead start 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.189+0000 7fb34ee0e640 1 -- 172.21.15.81:0/233279705 shutdown_connections 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.189+0000 7fb34ee0e640 1 -- 172.21.15.81:0/233279705 >> 172.21.15.81:0/233279705 conn(0x7fb348067d70 msgr2=0x7fb34806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:00.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.189+0000 7fb34ee0e640 1 -- 172.21.15.81:0/233279705 shutdown_connections 2024-09-16T01:16:00.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.189+0000 7fb34ee0e640 1 -- 172.21.15.81:0/233279705 wait complete. 2024-09-16T01:16:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.190+0000 7fb34ee0e640 1 Processor -- start 2024-09-16T01:16:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.191+0000 7fb34ee0e640 1 -- start start 2024-09-16T01:16:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.191+0000 7fb34ee0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb338003440 0x7fb348142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.191+0000 7fb34ee0e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3480b12c0 0x7fb3480b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.191+0000 7fb34ee0e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb3480adff0 0x7fb3480ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.191+0000 7fb34ee0e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3480ccfe0 con 0x7fb338003440 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.191+0000 7fb34ee0e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb3480ce810 con 0x7fb3480b12c0 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.191+0000 7fb34ee0e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb3480cd160 con 0x7fb3480adff0 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.191+0000 7fb34cbaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb338003440 0x7fb348142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb34cbaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb338003440 0x7fb348142400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60446/0 (socket says 172.21.15.81:60446) 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb34cbaa640 1 -- 172.21.15.81:0/2366600171 learned_addr learned my addr 172.21.15.81:0/2366600171 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb347fff640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3480b12c0 0x7fb3480b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb34d3ab640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb3480adff0 0x7fb3480ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb34cbaa640 1 -- 172.21.15.81:0/2366600171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb3480adff0 msgr2=0x7fb3480ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb34cbaa640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb3480adff0 0x7fb3480ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb34cbaa640 1 -- 172.21.15.81:0/2366600171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3480b12c0 msgr2=0x7fb3480b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb34cbaa640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3480b12c0 0x7fb3480b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb34cbaa640 1 -- 172.21.15.81:0/2366600171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3480aed80 con 0x7fb338003440 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb34d3ab640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb3480adff0 0x7fb3480ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb34cbaa640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb338003440 0x7fb348142400 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb33c011990 tx=0x7fb33c011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb3457fa640 1 -- 172.21.15.81:0/2366600171 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00fa70 con 0x7fb338003440 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb3457fa640 1 -- 172.21.15.81:0/2366600171 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c00fc10 con 0x7fb338003440 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb34ee0e640 1 -- 172.21.15.81:0/2366600171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3480af060 con 0x7fb338003440 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb3457fa640 1 -- 172.21.15.81:0/2366600171 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c014440 con 0x7fb338003440 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.192+0000 7fb34ee0e640 1 -- 172.21.15.81:0/2366600171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3480ae9b0 con 0x7fb338003440 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.193+0000 7fb34ee0e640 1 -- 172.21.15.81:0/2366600171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb34806f810 con 0x7fb338003440 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.194+0000 7fb3457fa640 1 -- 172.21.15.81:0/2366600171 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb33c012040 con 0x7fb338003440 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.194+0000 7fb3457fa640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb32c06c2b0 0x7fb32c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.194+0000 7fb3457fa640 1 -- 172.21.15.81:0/2366600171 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb33c08bcc0 con 0x7fb338003440 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.194+0000 7fb347fff640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb32c06c2b0 0x7fb32c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.194+0000 7fb347fff640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb32c06c2b0 0x7fb32c06e770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb334033000 tx=0x7fb334009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.198+0000 7fb3457fa640 1 -- 172.21.15.81:0/2366600171 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb33c019030 con 0x7fb338003440 2024-09-16T01:16:00.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.408+0000 7fb34ee0e640 1 -- 172.21.15.81:0/2366600171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb3480cec30 con 0x7fb338003440 2024-09-16T01:16:00.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.411+0000 7fb3457fa640 1 -- 172.21.15.81:0/2366600171 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173503 (secure 0 0 0) 0x7fb33c05a180 con 0x7fb338003440 2024-09-16T01:16:00.415 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.413+0000 7fb34ee0e640 1 -- 172.21.15.81:0/2366600171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb32c06c2b0 msgr2=0x7fb32c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.413+0000 7fb34ee0e640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb32c06c2b0 0x7fb32c06e770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb334033000 tx=0x7fb334009030 comp rx=0 tx=0).stop 2024-09-16T01:16:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.413+0000 7fb34ee0e640 1 -- 172.21.15.81:0/2366600171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb338003440 msgr2=0x7fb348142400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.413+0000 7fb34ee0e640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb338003440 0x7fb348142400 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb33c011990 tx=0x7fb33c011e50 comp rx=0 tx=0).stop 2024-09-16T01:16:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.414+0000 7fb34ee0e640 1 -- 172.21.15.81:0/2366600171 shutdown_connections 2024-09-16T01:16:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.414+0000 7fb34ee0e640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb32c06c2b0 0x7fb32c06e770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.414+0000 7fb34ee0e640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb3480adff0 0x7fb3480ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.414+0000 7fb34ee0e640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3480b12c0 0x7fb3480b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.414+0000 7fb34ee0e640 1 --2- 172.21.15.81:0/2366600171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb338003440 0x7fb348142400 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.414+0000 7fb34ee0e640 1 -- 172.21.15.81:0/2366600171 >> 172.21.15.81:0/2366600171 conn(0x7fb348067d70 msgr2=0x7fb34814e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.414+0000 7fb34ee0e640 1 -- 172.21.15.81:0/2366600171 shutdown_connections 2024-09-16T01:16:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.414+0000 7fb34ee0e640 1 -- 172.21.15.81:0/2366600171 wait complete. 2024-09-16T01:16:00.426 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":3436185483},{"type":"v1","addr":"172.21.15.81:6825","nonce":3436185483}]},"active_addr":"172.21.15.81:6825/3436185483","active_change":"2024-09-16T01:15:20.049727+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":4131728314}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":547107273}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":677322521}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3526023242}]}]} 2024-09-16T01:16:00.431 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-16T01:16:00.431 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-16T01:16:00.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:16:00.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.527+0000 7f872dc8d640 1 Processor -- start 2024-09-16T01:16:00.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.527+0000 7f872dc8d640 1 -- start start 2024-09-16T01:16:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.528+0000 7f872dc8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87280cfcc0 0x7f872806cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.528+0000 7f872dc8d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87280d2700 con 0x7f87280d4fd0 2024-09-16T01:16:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.528+0000 7f872dc8d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87280cedb0 con 0x7f872815e760 2024-09-16T01:16:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.528+0000 7f872dc8d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f87280cf090 con 0x7f87280cfcc0 2024-09-16T01:16:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.528+0000 7f8726ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87280cfcc0 0x7f872806cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.528+0000 7f8726ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f87280cfcc0 0x7f872806cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60460/0 (socket says 172.21.15.81:60460) 2024-09-16T01:16:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.528+0000 7f8727fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f87280d4fd0 0x7f87280d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38410/0 (socket says 172.21.15.81:38410) 2024-09-16T01:16:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.528+0000 7f8726ffd640 1 -- 172.21.15.81:0/3677614129 learned_addr learned my addr 172.21.15.81:0/3677614129 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.529+0000 7f8726ffd640 1 -- 172.21.15.81:0/3677614129 >> v1:172.21.15.102:6789/0 conn(0x7f872815e760 legacy=0x7f87280cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.529+0000 7f8726ffd640 1 -- 172.21.15.81:0/3677614129 >> v1:172.21.15.81:6789/0 conn(0x7f87280d4fd0 legacy=0x7f87280d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.529+0000 7f8726ffd640 1 -- 172.21.15.81:0/3677614129 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87280b3c80 con 0x7f87280cfcc0 2024-09-16T01:16:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.529+0000 7f87267fc640 1 -- 172.21.15.81:0/3677614129 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24645816 0 0) 0x7f8720001490 con 0x7f87280d4fd0 2024-09-16T01:16:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.529+0000 7f8726ffd640 1 --2- 172.21.15.81:0/3677614129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87280cfcc0 0x7f872806cdd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f871c009850 tx=0x7f871c02a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4225d3d47a564360 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.530+0000 7f87267fc640 1 -- 172.21.15.81:0/3677614129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c004230 con 0x7f87280cfcc0 2024-09-16T01:16:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.530+0000 7f87267fc640 1 -- 172.21.15.81:0/3677614129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f871c0043d0 con 0x7f87280cfcc0 2024-09-16T01:16:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.530+0000 7f87267fc640 1 -- 172.21.15.81:0/3677614129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c003810 con 0x7f87280cfcc0 2024-09-16T01:16:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.530+0000 7f872dc8d640 1 -- 172.21.15.81:0/3677614129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87280cfcc0 msgr2=0x7f872806cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.530+0000 7f872dc8d640 1 --2- 172.21.15.81:0/3677614129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87280cfcc0 0x7f872806cdd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f871c009850 tx=0x7f871c02a2e0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.530+0000 7f872dc8d640 1 -- 172.21.15.81:0/3677614129 shutdown_connections 2024-09-16T01:16:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.530+0000 7f872dc8d640 1 --2- 172.21.15.81:0/3677614129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87280cfcc0 0x7f872806cdd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.530+0000 7f872dc8d640 1 -- 172.21.15.81:0/3677614129 >> 172.21.15.81:0/3677614129 conn(0x7f872808bfc0 msgr2=0x7f87280d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.530+0000 7f872dc8d640 1 -- 172.21.15.81:0/3677614129 shutdown_connections 2024-09-16T01:16:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.530+0000 7f872dc8d640 1 -- 172.21.15.81:0/3677614129 wait complete. 2024-09-16T01:16:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.531+0000 7f872dc8d640 1 Processor -- start 2024-09-16T01:16:00.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.531+0000 7f872dc8d640 1 -- start start 2024-09-16T01:16:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.532+0000 7f872dc8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280cfcc0 0x7f872815c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.532+0000 7f872dc8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280d4fd0 0x7f872815cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.532+0000 7f872dc8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872815e760 0x7f87280cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.532+0000 7f872dc8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87280d35b0 con 0x7f872815e760 2024-09-16T01:16:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.532+0000 7f872dc8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f87280b3920 con 0x7f87280cfcc0 2024-09-16T01:16:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.532+0000 7f872dc8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f87280d3730 con 0x7f87280d4fd0 2024-09-16T01:16:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.532+0000 7f8727fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872815e760 0x7f87280cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.532+0000 7f8727fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872815e760 0x7f87280cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60472/0 (socket says 172.21.15.81:60472) 2024-09-16T01:16:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.532+0000 7f8727fff640 1 -- 172.21.15.81:0/3259819325 learned_addr learned my addr 172.21.15.81:0/3259819325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.532+0000 7f87277fe640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280cfcc0 0x7f872815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.532+0000 7f8726ffd640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280d4fd0 0x7f872815cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.533+0000 7f8727fff640 1 -- 172.21.15.81:0/3259819325 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280d4fd0 msgr2=0x7f872815cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.533+0000 7f8727fff640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280d4fd0 0x7f872815cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.533+0000 7f8727fff640 1 -- 172.21.15.81:0/3259819325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280cfcc0 msgr2=0x7f872815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.533+0000 7f8727fff640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280cfcc0 0x7f872815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.533+0000 7f8727fff640 1 -- 172.21.15.81:0/3259819325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87280ce0e0 con 0x7f872815e760 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.533+0000 7f8727fff640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872815e760 0x7f87280cbcc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f872000c710 tx=0x7f872000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.533+0000 7f870ffff640 1 -- 172.21.15.81:0/3259819325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8720018070 con 0x7f872815e760 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.533+0000 7f870ffff640 1 -- 172.21.15.81:0/3259819325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f872000ce20 con 0x7f872815e760 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.533+0000 7f872dc8d640 1 -- 172.21.15.81:0/3259819325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87280b84b0 con 0x7f872815e760 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.533+0000 7f870ffff640 1 -- 172.21.15.81:0/3259819325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f872000a880 con 0x7f872815e760 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.533+0000 7f872dc8d640 1 -- 172.21.15.81:0/3259819325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87280ce380 con 0x7f872815e760 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.534+0000 7f872dc8d640 1 -- 172.21.15.81:0/3259819325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87280d3a60 con 0x7f872815e760 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.534+0000 7f870ffff640 1 -- 172.21.15.81:0/3259819325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f872001b070 con 0x7f872815e760 2024-09-16T01:16:00.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.535+0000 7f870ffff640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f871406c2b0 0x7f871406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.535+0000 7f870ffff640 1 -- 172.21.15.81:0/3259819325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f872008abd0 con 0x7f872815e760 2024-09-16T01:16:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.535+0000 7f87277fe640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f871406c2b0 0x7f871406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.535+0000 7f87277fe640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f871406c2b0 0x7f871406e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8718000f60 tx=0x7f8718009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:00.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.539+0000 7f870ffff640 1 -- 172.21.15.81:0/3259819325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87280d2700 con 0x7f872815e760 2024-09-16T01:16:00.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.706+0000 7f872dc8d640 1 -- 172.21.15.81:0/3259819325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87280cfaa0 con 0x7f872815e760 2024-09-16T01:16:00.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.708+0000 7f870ffff640 1 -- 172.21.15.81:0/3259819325 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18598 (secure 0 0 0) 0x7f8720058a40 con 0x7f872815e760 2024-09-16T01:16:00.710 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:00.710 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:44.092404+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:15:36.856888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:15:38.066938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:15:41.748133+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:16:00.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.710+0000 7f872dc8d640 1 -- 172.21.15.81:0/3259819325 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f871406c2b0 msgr2=0x7f871406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.710+0000 7f872dc8d640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f871406c2b0 0x7f871406e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8718000f60 tx=0x7f8718009040 comp rx=0 tx=0).stop 2024-09-16T01:16:00.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.710+0000 7f872dc8d640 1 -- 172.21.15.81:0/3259819325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872815e760 msgr2=0x7f87280cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.710+0000 7f872dc8d640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872815e760 0x7f87280cbcc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f872000c710 tx=0x7f872000cbd0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.710+0000 7f872dc8d640 1 -- 172.21.15.81:0/3259819325 shutdown_connections 2024-09-16T01:16:00.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.710+0000 7f872dc8d640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f871406c2b0 0x7f871406e770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.710+0000 7f872dc8d640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f872815e760 0x7f87280cbcc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.710+0000 7f872dc8d640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280d4fd0 0x7f872815cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.710+0000 7f872dc8d640 1 --2- 172.21.15.81:0/3259819325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280cfcc0 0x7f872815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.710+0000 7f872dc8d640 1 -- 172.21.15.81:0/3259819325 >> 172.21.15.81:0/3259819325 conn(0x7f872808bfc0 msgr2=0x7f872806e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:00.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.710+0000 7f872dc8d640 1 -- 172.21.15.81:0/3259819325 shutdown_connections 2024-09-16T01:16:00.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.710+0000 7f872dc8d640 1 -- 172.21.15.81:0/3259819325 wait complete. 2024-09-16T01:16:00.723 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-16T01:16:00.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:16:00.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.820+0000 7f4dc7a1e640 1 Processor -- start 2024-09-16T01:16:00.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.821+0000 7f4dc7a1e640 1 -- start start 2024-09-16T01:16:00.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.821+0000 7f4dc7a1e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4dc015c520 0x7f4dc009b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.821+0000 7f4dc7a1e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dc00b1620 0x7f4dc00b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.821+0000 7f4dc7a1e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc00cec00 con 0x7f4dc00d0980 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.821+0000 7f4dc7a1e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc009bd90 con 0x7f4dc015c520 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.821+0000 7f4dc7a1e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc00d0010 con 0x7f4dc00b1620 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.822+0000 7f4dc5fbb640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4dc00d0980 0x7f4dc00cd570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38420/0 (socket says 172.21.15.81:38420) 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.822+0000 7f4dc5fbb640 1 -- 172.21.15.81:0/1867290579 learned_addr learned my addr 172.21.15.81:0/1867290579 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.822+0000 7f4dc4fb9640 1 --2- 172.21.15.81:0/1867290579 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dc00b1620 0x7f4dc00b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.822+0000 7f4dc57ba640 1 --2- 172.21.15.81:0/1867290579 >> v2:172.21.15.102:3300/0 conn(0x7f4dc015c520 0x7f4dc009b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.822+0000 7f4db7fff640 1 -- 172.21.15.81:0/1867290579 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647259942 0 0) 0x7f4dc00cec00 con 0x7f4dc00d0980 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.822+0000 7f4db7fff640 1 -- 172.21.15.81:0/1867290579 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dac003520 con 0x7f4dc00d0980 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.822+0000 7f4dc57ba640 1 -- 172.21.15.81:0/1867290579 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dc00b1620 msgr2=0x7f4dc00b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.822+0000 7f4dc57ba640 1 --2- 172.21.15.81:0/1867290579 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dc00b1620 0x7f4dc00b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.822+0000 7f4dc57ba640 1 -- 172.21.15.81:0/1867290579 >> v1:172.21.15.81:6789/0 conn(0x7f4dc00d0980 legacy=0x7f4dc00cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.822+0000 7f4dc57ba640 1 -- 172.21.15.81:0/1867290579 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc00d02f0 con 0x7f4dc015c520 2024-09-16T01:16:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.822+0000 7f4dc4fb9640 1 --2- 172.21.15.81:0/1867290579 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dc00b1620 0x7f4dc00b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:16:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.823+0000 7f4dc57ba640 1 --2- 172.21.15.81:0/1867290579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dc015c520 0x7f4dc009b720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0097a0 tx=0x7f4dbc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c878b414b70de98c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.823+0000 7f4db7fff640 1 -- 172.21.15.81:0/1867290579 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc037070 con 0x7f4dc015c520 2024-09-16T01:16:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.823+0000 7f4db7fff640 1 -- 172.21.15.81:0/1867290579 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dbc032440 con 0x7f4dc015c520 2024-09-16T01:16:00.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.823+0000 7f4db7fff640 1 -- 172.21.15.81:0/1867290579 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0327f0 con 0x7f4dc015c520 2024-09-16T01:16:00.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.823+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/1867290579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dc015c520 msgr2=0x7f4dc009b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.823+0000 7f4dc7a1e640 1 --2- 172.21.15.81:0/1867290579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dc015c520 0x7f4dc009b720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc0097a0 tx=0x7f4dbc02a180 comp rx=0 tx=0).stop 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.823+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/1867290579 shutdown_connections 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.823+0000 7f4dc7a1e640 1 --2- 172.21.15.81:0/1867290579 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dc00b1620 0x7f4dc00b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.823+0000 7f4dc7a1e640 1 --2- 172.21.15.81:0/1867290579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dc015c520 0x7f4dc009b720 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.823+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/1867290579 >> 172.21.15.81:0/1867290579 conn(0x7f4dc00d23a0 msgr2=0x7f4dc00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.824+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/1867290579 shutdown_connections 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.824+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/1867290579 wait complete. 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.825+0000 7f4dc7a1e640 1 Processor -- start 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.825+0000 7f4dc7a1e640 1 -- start start 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.825+0000 7f4dc7a1e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc00b1620 0x7f4dc00c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.825+0000 7f4dc7a1e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dc00d0980 0x7f4dc0153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.825+0000 7f4dc7a1e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dc015c520 0x7f4dc006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.825+0000 7f4dc7a1e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc015c900 con 0x7f4dc00b1620 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.825+0000 7f4dc7a1e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc00d05d0 con 0x7f4dc00d0980 2024-09-16T01:16:00.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.825+0000 7f4dc7a1e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc00c64b0 con 0x7f4dc015c520 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc57ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc00b1620 0x7f4dc00c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc57ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc00b1620 0x7f4dc00c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60476/0 (socket says 172.21.15.81:60476) 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc57ba640 1 -- 172.21.15.81:0/569913401 learned_addr learned my addr 172.21.15.81:0/569913401 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc5fbb640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dc015c520 0x7f4dc006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc4fb9640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dc00d0980 0x7f4dc0153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc57ba640 1 -- 172.21.15.81:0/569913401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dc015c520 msgr2=0x7f4dc006e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc57ba640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dc015c520 0x7f4dc006e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc57ba640 1 -- 172.21.15.81:0/569913401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dc00d0980 msgr2=0x7f4dc0153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc57ba640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dc00d0980 0x7f4dc0153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc57ba640 1 -- 172.21.15.81:0/569913401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc00c6790 con 0x7f4dc00b1620 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc57ba640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc00b1620 0x7f4dc00c5ed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc035040 tx=0x7f4dbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4db5ffb640 1 -- 172.21.15.81:0/569913401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc037040 con 0x7f4dc00b1620 2024-09-16T01:16:00.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4db5ffb640 1 -- 172.21.15.81:0/569913401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dbc042070 con 0x7f4dc00b1620 2024-09-16T01:16:00.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/569913401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc00c6a70 con 0x7f4dc00b1620 2024-09-16T01:16:00.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4db5ffb640 1 -- 172.21.15.81:0/569913401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc03b930 con 0x7f4dc00b1620 2024-09-16T01:16:00.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.826+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/569913401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc00b1390 con 0x7f4dc00b1620 2024-09-16T01:16:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.827+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/569913401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc00c6e60 con 0x7f4dc00b1620 2024-09-16T01:16:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.828+0000 7f4db5ffb640 1 -- 172.21.15.81:0/569913401 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4dbc03bad0 con 0x7f4dc00b1620 2024-09-16T01:16:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.828+0000 7f4db5ffb640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4da406c2b0 0x7f4da406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.828+0000 7f4db5ffb640 1 -- 172.21.15.81:0/569913401 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4dbc0ac040 con 0x7f4dc00b1620 2024-09-16T01:16:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.828+0000 7f4dc4fb9640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4da406c2b0 0x7f4da406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:00.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.829+0000 7f4dc4fb9640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4da406c2b0 0x7f4da406e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009560 tx=0x7f4db0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:00.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.832+0000 7f4db5ffb640 1 -- 172.21.15.81:0/569913401 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4dbc07a590 con 0x7f4dc00b1620 2024-09-16T01:16:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.998+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/569913401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4dc00b1d40 con 0x7f4dc00b1620 2024-09-16T01:16:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:00.999+0000 7f4db5ffb640 1 -- 172.21.15.81:0/569913401 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18598 (secure 0 0 0) 0x7f4dbc079e90 con 0x7f4dc00b1620 2024-09-16T01:16:01.001 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:01.001 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:44.092404+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:15:36.856888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:15:38.066938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:15:41.748133+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:16:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.001+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/569913401 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4da406c2b0 msgr2=0x7f4da406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.001+0000 7f4dc7a1e640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4da406c2b0 0x7f4da406e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009560 tx=0x7f4db0008040 comp rx=0 tx=0).stop 2024-09-16T01:16:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.001+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/569913401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc00b1620 msgr2=0x7f4dc00c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.001+0000 7f4dc7a1e640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc00b1620 0x7f4dc00c5ed0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc035040 tx=0x7f4dbc0046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.001+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/569913401 shutdown_connections 2024-09-16T01:16:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.001+0000 7f4dc7a1e640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4da406c2b0 0x7f4da406e770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.001+0000 7f4dc7a1e640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dc015c520 0x7f4dc006e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.001+0000 7f4dc7a1e640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dc00d0980 0x7f4dc0153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.001+0000 7f4dc7a1e640 1 --2- 172.21.15.81:0/569913401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dc00b1620 0x7f4dc00c5ed0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.001+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/569913401 >> 172.21.15.81:0/569913401 conn(0x7f4dc00d23a0 msgr2=0x7f4dc0071600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.001+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/569913401 shutdown_connections 2024-09-16T01:16:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.001+0000 7f4dc7a1e640 1 -- 172.21.15.81:0/569913401 wait complete. 2024-09-16T01:16:01.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-16T01:16:01.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-16T01:16:01.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-16T01:16:01.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-16T01:16:01.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-16T01:16:01.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-16T01:16:01.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-16T01:16:01.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-16T01:16:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.181+0000 7fa44da2b640 1 Processor -- start 2024-09-16T01:16:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.182+0000 7fa44da2b640 1 -- start start 2024-09-16T01:16:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.183+0000 7f6ec691f640 1 Processor -- start 2024-09-16T01:16:01.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.183+0000 7fa44da2b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa4480b2920 0x7fa448073860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.183+0000 7fa44da2b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa448071fd0 con 0x7fa44806f820 2024-09-16T01:16:01.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.183+0000 7fa44da2b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4480722b0 con 0x7fa44815d730 2024-09-16T01:16:01.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.183+0000 7fa44da2b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa448073da0 con 0x7fa4480b2920 2024-09-16T01:16:01.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.183+0000 7f6ec691f640 1 -- start start 2024-09-16T01:16:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.183+0000 7fa44d22a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa44806f820 0x7fa4480b3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42286/0 (socket says 172.21.15.81:42286) 2024-09-16T01:16:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.183+0000 7fa44d22a640 1 -- 172.21.15.81:0/2475889851 learned_addr learned my addr 172.21.15.81:0/2475889851 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.184+0000 7fec35482640 1 Processor -- start 2024-09-16T01:16:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.184+0000 7fec35482640 1 -- start start 2024-09-16T01:16:01.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.184+0000 7fa44ca29640 1 --2- 172.21.15.81:0/2475889851 >> v2:172.21.15.81:3300/0 conn(0x7fa4480b2920 0x7fa448073860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.184+0000 7fa44ca29640 1 -- 172.21.15.81:0/2475889851 >> v1:172.21.15.102:6789/0 conn(0x7fa44815d730 legacy=0x7fa44806f110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:16:01.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.184+0000 7fa44ca29640 1 -- 172.21.15.81:0/2475889851 >> v1:172.21.15.81:6789/0 conn(0x7fa44806f820 legacy=0x7fa4480b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.184+0000 7fa44ca29640 1 -- 172.21.15.81:0/2475889851 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa448072590 con 0x7fa4480b2920 2024-09-16T01:16:01.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7f6ec691f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ec0147450 0x7f6ec00af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7f6ec691f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6ec006eac0 0x7f6ec00720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7f6ec691f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec00aff10 con 0x7f6ec006ef20 2024-09-16T01:16:01.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7f6ec691f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec00ae9e0 con 0x7f6ec006eac0 2024-09-16T01:16:01.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7f6ec691f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec006f4b0 con 0x7f6ec0147450 2024-09-16T01:16:01.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7fec35482640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec28051340 0x7fec2804fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7fec35482640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec28052550 0x7fec28052990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7fec35482640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec2803ab40 con 0x7fec28035980 2024-09-16T01:16:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7fec35482640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fec28051de0 con 0x7fec28051340 2024-09-16T01:16:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7fec35482640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fec2803ae20 con 0x7fec28052550 2024-09-16T01:16:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7fec34c81640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec28052550 0x7fec28052990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7fec34c81640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec28052550 0x7fec28052990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:44880/0 (socket says 172.21.15.81:44880) 2024-09-16T01:16:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7fec34c81640 1 -- 172.21.15.81:0/951544786 learned_addr learned my addr 172.21.15.81:0/951544786 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7f6ebf7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6ec006eac0 0x7f6ec00720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7f6ebf7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6ec006eac0 0x7f6ec00720b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:35544/0 (socket says 172.21.15.81:35544) 2024-09-16T01:16:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7f6ebf7fe640 1 -- 172.21.15.81:0/1478752012 learned_addr learned my addr 172.21.15.81:0/1478752012 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.185+0000 7f09d3124640 1 Processor -- start 2024-09-16T01:16:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7f09d3124640 1 -- start start 2024-09-16T01:16:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7fec2f7fe640 1 --2- 172.21.15.81:0/951544786 >> v2:172.21.15.81:3300/0 conn(0x7fec28051340 0x7fec2804fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7f6ebf7fe640 1 -- 172.21.15.81:0/1478752012 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ec0147450 msgr2=0x7f6ec00af9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:16:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7f6ebf7fe640 1 --2- 172.21.15.81:0/1478752012 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ec0147450 0x7f6ec00af9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7f6ebf7fe640 1 -- 172.21.15.81:0/1478752012 >> v1:172.21.15.81:6789/0 conn(0x7f6ec006ef20 legacy=0x7f6ec00b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7f6ebf7fe640 1 -- 172.21.15.81:0/1478752012 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec00aec10 con 0x7f6ec006eac0 2024-09-16T01:16:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7f722d453640 1 Processor -- start 2024-09-16T01:16:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f722d453640 1 -- start start 2024-09-16T01:16:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7fa44ca29640 1 --2- 172.21.15.81:0/2475889851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4480b2920 0x7fa448073860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa4440097a0 tx=0x7fa44402a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22ef60a697df708 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7fec2f7fe640 1 -- 172.21.15.81:0/951544786 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec28052550 msgr2=0x7fec28052990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7fec2f7fe640 1 --2- 172.21.15.81:0/951544786 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec28052550 0x7fec28052990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7fec2f7fe640 1 -- 172.21.15.81:0/951544786 >> v1:172.21.15.81:6789/0 conn(0x7fec28035980 legacy=0x7fec2803a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7fec2f7fe640 1 -- 172.21.15.81:0/951544786 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2803b100 con 0x7fec28051340 2024-09-16T01:16:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f6ebf7fe640 1 --2- 172.21.15.81:0/1478752012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ec006eac0 0x7f6ec00720b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0068270 tx=0x7f6eb402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=445222d9c796faf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f09d3124640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09c4053780 0x7f09c403b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f09d3124640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c40585a0 con 0x7f09c40e6e00 2024-09-16T01:16:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f09d3124640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c40576e0 con 0x7f09c4037bc0 2024-09-16T01:16:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f09d3124640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f09c40064a0 con 0x7f09c4053780 2024-09-16T01:16:01.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f6ebeffd640 1 -- 172.21.15.81:0/1478752012 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4037070 con 0x7f6ec006eac0 2024-09-16T01:16:01.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7fa43f7fe640 1 -- 172.21.15.81:0/2475889851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444037070 con 0x7fa4480b2920 2024-09-16T01:16:01.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7fa43f7fe640 1 -- 172.21.15.81:0/2475889851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa44402ad60 con 0x7fa4480b2920 2024-09-16T01:16:01.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f09d2122640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f09c40e6e00 0x7f09c4053070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42318/0 (socket says 172.21.15.81:42318) 2024-09-16T01:16:01.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f09d2122640 1 -- 172.21.15.81:0/359428552 learned_addr learned my addr 172.21.15.81:0/359428552 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:01.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f09d2923640 1 --1- 172.21.15.81:0/359428552 >> v1:172.21.15.102:6789/0 conn(0x7f09c4037bc0 0x7f09c4006930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:33760/0 (socket says 172.21.15.81:33760) 2024-09-16T01:16:01.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f09d1921640 1 --2- 172.21.15.81:0/359428552 >> v2:172.21.15.81:3300/0 conn(0x7f09c4053780 0x7f09c403b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f6ebeffd640 1 -- 172.21.15.81:0/1478752012 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb4032440 con 0x7f6ec006eac0 2024-09-16T01:16:01.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.187+0000 7f6ebeffd640 1 -- 172.21.15.81:0/1478752012 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4032810 con 0x7f6ec006eac0 2024-09-16T01:16:01.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7fa43f7fe640 1 -- 172.21.15.81:0/2475889851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444032660 con 0x7fa4480b2920 2024-09-16T01:16:01.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.184+0000 7fd9701d8640 1 Processor -- start 2024-09-16T01:16:01.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.184+0000 7fd9701d8640 1 -- start start 2024-09-16T01:16:01.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7fd9701d8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9680b3b90 0x7fd96806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7fd9701d8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9680b4680 0x7fd9680ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7fd9701d8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd96816b570 con 0x7fd96806e1a0 2024-09-16T01:16:01.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7fd9701d8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd96806e610 con 0x7fd9680b3b90 2024-09-16T01:16:01.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7fd9701d8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd9680b4df0 con 0x7fd9680b4680 2024-09-16T01:16:01.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7fd96df74640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9680b3b90 0x7fd96806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7fd96df74640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd9680b3b90 0x7fd96806dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41274/0 (socket says 172.21.15.81:41274) 2024-09-16T01:16:01.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7fd96df74640 1 -- 172.21.15.81:0/1954944338 learned_addr learned my addr 172.21.15.81:0/1954944338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.186+0000 7fd96e775640 1 --2- 172.21.15.81:0/1954944338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9680b4680 0x7fd9680ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7f722d453640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7228147230 0x7f722806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7f722d453640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7228147e90 0x7f72280720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7f722d453640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7228072a00 con 0x7f72280725f0 2024-09-16T01:16:01.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7f722d453640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f72280b34d0 con 0x7f7228147230 2024-09-16T01:16:01.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7f722d453640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f72280ae9e0 con 0x7f7228147e90 2024-09-16T01:16:01.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7f72277fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f72280725f0 0x7f7228161f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42322/0 (socket says 172.21.15.81:42322) 2024-09-16T01:16:01.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7f72277fe640 1 -- 172.21.15.81:0/1346179461 learned_addr learned my addr 172.21.15.81:0/1346179461 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:01.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7fd96cf72640 1 -- 172.21.15.81:0/1954944338 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368213720 0 0) 0x7fd96816b570 con 0x7fd96806e1a0 2024-09-16T01:16:01.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7fd96cf72640 1 -- 172.21.15.81:0/1954944338 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd954003520 con 0x7fd96806e1a0 2024-09-16T01:16:01.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7fa44da2b640 1 -- 172.21.15.81:0/2475889851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4480b2920 msgr2=0x7fa448073860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7f5035415640 1 Processor -- start 2024-09-16T01:16:01.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7fa44da2b640 1 --2- 172.21.15.81:0/2475889851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4480b2920 0x7fa448073860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa4440097a0 tx=0x7fa44402a0d0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7fa44da2b640 1 -- 172.21.15.81:0/2475889851 shutdown_connections 2024-09-16T01:16:01.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7fa44da2b640 1 --2- 172.21.15.81:0/2475889851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4480b2920 0x7fa448073860 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7fa44da2b640 1 -- 172.21.15.81:0/2475889851 >> 172.21.15.81:0/2475889851 conn(0x7fa4480b1e00 msgr2=0x7fa4480b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7fec2f7fe640 1 --2- 172.21.15.81:0/951544786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec28051340 0x7fec2804fd20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0097a0 tx=0x7fec1c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b78151903ada91 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f6ec691f640 1 -- 172.21.15.81:0/1478752012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ec006eac0 msgr2=0x7f6ec00720b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f6ec691f640 1 --2- 172.21.15.81:0/1478752012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ec006eac0 0x7f6ec00720b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0068270 tx=0x7f6eb402a250 comp rx=0 tx=0).stop 2024-09-16T01:16:01.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f6ec691f640 1 -- 172.21.15.81:0/1478752012 shutdown_connections 2024-09-16T01:16:01.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f6ec691f640 1 --2- 172.21.15.81:0/1478752012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ec006eac0 0x7f6ec00720b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f6ec691f640 1 --2- 172.21.15.81:0/1478752012 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ec0147450 0x7f6ec00af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f6ec691f640 1 -- 172.21.15.81:0/1478752012 >> 172.21.15.81:0/1478752012 conn(0x7f6ec0067b30 msgr2=0x7f6ec006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f6ec691f640 1 -- 172.21.15.81:0/1478752012 shutdown_connections 2024-09-16T01:16:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7fd96e775640 1 -- 172.21.15.81:0/1954944338 >> v2:172.21.15.81:3300/0 conn(0x7fd9680b3b90 msgr2=0x7fd96806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7fd96e775640 1 --2- 172.21.15.81:0/1954944338 >> v2:172.21.15.81:3300/0 conn(0x7fd9680b3b90 0x7fd96806dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7fd96e775640 1 -- 172.21.15.81:0/1954944338 >> v1:172.21.15.81:6789/0 conn(0x7fd96806e1a0 legacy=0x7fd9680b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7fd96e775640 1 -- 172.21.15.81:0/1954944338 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9680b50d0 con 0x7fd9680b4680 2024-09-16T01:16:01.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7fa44da2b640 1 -- 172.21.15.81:0/2475889851 shutdown_connections 2024-09-16T01:16:01.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.188+0000 7f72267fc640 1 --2- 172.21.15.81:0/1346179461 >> v2:172.21.15.102:3300/0 conn(0x7f7228147e90 0x7f72280720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f7226ffd640 1 --2- 172.21.15.81:0/1346179461 >> v2:172.21.15.81:3300/0 conn(0x7f7228147230 0x7f722806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f7225ffb640 1 -- 172.21.15.81:0/1346179461 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3166846549 0 0) 0x7f7220001490 con 0x7f72280725f0 2024-09-16T01:16:01.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f7225ffb640 1 -- 172.21.15.81:0/1346179461 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7210003520 con 0x7f72280725f0 2024-09-16T01:16:01.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f6ec691f640 1 -- 172.21.15.81:0/1478752012 wait complete. 2024-09-16T01:16:01.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7fa44da2b640 1 -- 172.21.15.81:0/2475889851 wait complete. 2024-09-16T01:16:01.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f5035415640 1 -- start start 2024-09-16T01:16:01.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f09d1120640 1 -- 172.21.15.81:0/359428552 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2733771071 0 0) 0x7f09c40576e0 con 0x7f09c4037bc0 2024-09-16T01:16:01.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f09d1120640 1 -- 172.21.15.81:0/359428552 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09b8003520 con 0x7f09c4037bc0 2024-09-16T01:16:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f09d1120640 1 -- 172.21.15.81:0/359428552 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3857037251 0 0) 0x7f09c40585a0 con 0x7f09c40e6e00 2024-09-16T01:16:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f09d1120640 1 -- 172.21.15.81:0/359428552 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09c40576e0 con 0x7f09c40e6e00 2024-09-16T01:16:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f09d1921640 1 -- 172.21.15.81:0/359428552 >> v1:172.21.15.102:6789/0 conn(0x7f09c4037bc0 legacy=0x7f09c4006930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f09d1921640 1 -- 172.21.15.81:0/359428552 >> v1:172.21.15.81:6789/0 conn(0x7f09c40e6e00 legacy=0x7f09c4053070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f09d1921640 1 -- 172.21.15.81:0/359428552 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c4005e50 con 0x7f09c4053780 2024-09-16T01:16:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7fec2effd640 1 -- 172.21.15.81:0/951544786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c037070 con 0x7fec28051340 2024-09-16T01:16:01.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7fec2effd640 1 -- 172.21.15.81:0/951544786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1c032440 con 0x7fec28051340 2024-09-16T01:16:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7fd96e775640 1 --2- 172.21.15.81:0/1954944338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9680b4680 0x7fd9680ce5e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd96000bfa0 tx=0x7fd96002c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=846f3b0b33600591 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7fd96cf72640 1 -- 172.21.15.81:0/1954944338 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960039070 con 0x7fd9680b4680 2024-09-16T01:16:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7fd96cf72640 1 -- 172.21.15.81:0/1954944338 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd960009540 con 0x7fd9680b4680 2024-09-16T01:16:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7fd96cf72640 1 -- 172.21.15.81:0/1954944338 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9600098f0 con 0x7fd9680b4680 2024-09-16T01:16:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f72267fc640 1 -- 172.21.15.81:0/1346179461 >> v2:172.21.15.81:3300/0 conn(0x7f7228147230 msgr2=0x7f722806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f72267fc640 1 --2- 172.21.15.81:0/1346179461 >> v2:172.21.15.81:3300/0 conn(0x7f7228147230 0x7f722806e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.189+0000 7f72267fc640 1 -- 172.21.15.81:0/1346179461 >> v1:172.21.15.81:6789/0 conn(0x7f72280725f0 legacy=0x7f7228161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7f72267fc640 1 -- 172.21.15.81:0/1346179461 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722806f480 con 0x7f7228147e90 2024-09-16T01:16:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7ff2a6b5b640 1 Processor -- start 2024-09-16T01:16:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7ff2a6b5b640 1 -- start start 2024-09-16T01:16:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7f5035415640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f502803bc60 0x7f5028053790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7f5035415640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5028057830 0x7f50280066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7f5035415640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5028057d80 con 0x7f50280e28f0 2024-09-16T01:16:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7f5035415640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5028058060 con 0x7f5028057830 2024-09-16T01:16:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.190+0000 7f5035415640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5028005eb0 con 0x7f502803bc60 2024-09-16T01:16:01.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7f6ec691f640 1 Processor -- start 2024-09-16T01:16:01.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7fec35482640 1 -- 172.21.15.81:0/951544786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec28051340 msgr2=0x7fec2804fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7fec35482640 1 --2- 172.21.15.81:0/951544786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec28051340 0x7fec2804fd20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0097a0 tx=0x7fec1c02a180 comp rx=0 tx=0).stop 2024-09-16T01:16:01.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7f502ffff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f50280e28f0 0x7f5028053080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:33770/0 (socket says 172.21.15.81:33770) 2024-09-16T01:16:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7fec35482640 1 -- 172.21.15.81:0/951544786 shutdown_connections 2024-09-16T01:16:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7fec35482640 1 --2- 172.21.15.81:0/951544786 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec28052550 0x7fec28052990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7fec35482640 1 --2- 172.21.15.81:0/951544786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec28051340 0x7fec2804fd20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7fec35482640 1 -- 172.21.15.81:0/951544786 >> 172.21.15.81:0/951544786 conn(0x7fec2801ea30 msgr2=0x7fec280556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7f09d1921640 1 --2- 172.21.15.81:0/359428552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09c4053780 0x7f09c403b870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09cc06a6a0 tx=0x7f09cc0a6050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142c5d06086d4c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7fa44da2b640 1 Processor -- start 2024-09-16T01:16:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7ff2a6b5b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff298033b90 0x7ff298034630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7f72267fc640 1 --2- 172.21.15.81:0/1346179461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7228147e90 0x7f72280720b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f722806ccb0 tx=0x7f721c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48c2eb3f46ba8e71 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7f6ec691f640 1 -- start start 2024-09-16T01:16:01.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7ff2a6b5b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2980532b0 con 0x7ff298055780 2024-09-16T01:16:01.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7ff2a6b5b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff298053550 con 0x7ff298047e80 2024-09-16T01:16:01.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7ff2a6b5b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff29803ae10 con 0x7ff298033b90 2024-09-16T01:16:01.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7f502ffff640 1 -- 172.21.15.81:0/1234228081 learned_addr learned my addr 172.21.15.81:0/1234228081 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:01.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7ff2a5b59640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff298047e80 0x7ff298048260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:33784/0 (socket says 172.21.15.81:33784) 2024-09-16T01:16:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7ff2a5b59640 1 -- 172.21.15.81:0/1329756457 learned_addr learned my addr 172.21.15.81:0/1329756457 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7f09d1120640 1 -- 172.21.15.81:0/359428552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0b3070 con 0x7f09c4053780 2024-09-16T01:16:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7f09d1120640 1 -- 172.21.15.81:0/359428552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc0ae440 con 0x7f09c4053780 2024-09-16T01:16:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595438412 0 0) 0x7f5028057d80 con 0x7f50280e28f0 2024-09-16T01:16:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5020003520 con 0x7f50280e28f0 2024-09-16T01:16:01.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7f502f7fe640 1 --2- 172.21.15.81:0/1234228081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f502803bc60 0x7f5028053790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7f5034c14640 1 --2- 172.21.15.81:0/1234228081 >> v2:172.21.15.81:3300/0 conn(0x7f5028057830 0x7f50280066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7fa44da2b640 1 -- start start 2024-09-16T01:16:01.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7fd9701d8640 1 -- 172.21.15.81:0/1954944338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9680b4680 msgr2=0x7fd9680ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7fd9701d8640 1 --2- 172.21.15.81:0/1954944338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9680b4680 0x7fd9680ce5e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd96000bfa0 tx=0x7fd96002c890 comp rx=0 tx=0).stop 2024-09-16T01:16:01.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7fd9701d8640 1 -- 172.21.15.81:0/1954944338 shutdown_connections 2024-09-16T01:16:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7fd9701d8640 1 --2- 172.21.15.81:0/1954944338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9680b4680 0x7fd9680ce5e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7fd9701d8640 1 --2- 172.21.15.81:0/1954944338 >> v2:172.21.15.81:3300/0 conn(0x7fd9680b3b90 0x7fd96806dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7fd9701d8640 1 -- 172.21.15.81:0/1954944338 >> 172.21.15.81:0/1954944338 conn(0x7fd968067950 msgr2=0x7fd968067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3689614617 0 0) 0x7f5020003520 con 0x7f50280e28f0 2024-09-16T01:16:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f502803bc60 msgr2=0x7f5028053790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 --2- 172.21.15.81:0/1234228081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f502803bc60 0x7f5028053790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 >> v2:172.21.15.81:3300/0 conn(0x7f5028057830 msgr2=0x7f50280066b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 --2- 172.21.15.81:0/1234228081 >> v2:172.21.15.81:3300/0 conn(0x7f5028057830 0x7f50280066b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5028006190 con 0x7f50280e28f0 2024-09-16T01:16:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 172202525 0 0) 0x7ff298053550 con 0x7ff298047e80 2024-09-16T01:16:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff28c003520 con 0x7ff298047e80 2024-09-16T01:16:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f5024001650 con 0x7f50280e28f0 2024-09-16T01:16:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 >> v1:172.21.15.102:6789/0 conn(0x7f50280e28f0 legacy=0x7f5028053080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 --2- 172.21.15.81:0/1234228081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50200039b0 0x7f5020003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 --2- 172.21.15.81:0/1234228081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f502803bc60 0x7f5020004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f7225ffb640 1 -- 172.21.15.81:0/1346179461 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c037070 con 0x7f7228147e90 2024-09-16T01:16:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 --2- 172.21.15.81:0/1234228081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5020004d40 0x7f50200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5028058060 con 0x7f50200039b0 2024-09-16T01:16:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f7225ffb640 1 -- 172.21.15.81:0/1346179461 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c032440 con 0x7f7228147e90 2024-09-16T01:16:01.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5028005eb0 con 0x7f5020004d40 2024-09-16T01:16:01.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f502000b9c0 con 0x7f502803bc60 2024-09-16T01:16:01.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f7225ffb640 1 -- 172.21.15.81:0/1346179461 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c0327f0 con 0x7f7228147e90 2024-09-16T01:16:01.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480513391 0 0) 0x7ff2980532b0 con 0x7ff298055780 2024-09-16T01:16:01.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff298053550 con 0x7ff298055780 2024-09-16T01:16:01.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f09d1120640 1 -- 172.21.15.81:0/359428552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0a6e60 con 0x7f09c4053780 2024-09-16T01:16:01.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3136017912 0 0) 0x7ff28c003520 con 0x7ff298047e80 2024-09-16T01:16:01.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.191+0000 7fec35482640 1 -- 172.21.15.81:0/951544786 shutdown_connections 2024-09-16T01:16:01.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 >> v2:172.21.15.102:3300/0 conn(0x7ff298033b90 msgr2=0x7ff298034630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 --2- 172.21.15.81:0/1329756457 >> v2:172.21.15.102:3300/0 conn(0x7ff298033b90 0x7ff298034630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 >> v1:172.21.15.81:6789/0 conn(0x7ff298055780 legacy=0x7ff298053a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29803a570 con 0x7ff298047e80 2024-09-16T01:16:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f5034c14640 1 --2- 172.21.15.81:0/1234228081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5020004d40 0x7f50200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7fd9701d8640 1 -- 172.21.15.81:0/1954944338 shutdown_connections 2024-09-16T01:16:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7ff2a004ffb0 con 0x7ff298047e80 2024-09-16T01:16:01.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 >> v1:172.21.15.102:6789/0 conn(0x7ff298047e80 legacy=0x7ff298048260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f502f7fe640 1 --2- 172.21.15.81:0/1234228081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f502803bc60 0x7f5020004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f09d3124640 1 -- 172.21.15.81:0/359428552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09c4053780 msgr2=0x7f09c403b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f09d3124640 1 --2- 172.21.15.81:0/359428552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09c4053780 0x7f09c403b870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f09cc06a6a0 tx=0x7f09cc0a6050 comp rx=0 tx=0).stop 2024-09-16T01:16:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 --2- 172.21.15.81:0/1329756457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff28c003b40 0x7ff28c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 --2- 172.21.15.81:0/1329756457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c004800 0x7ff28c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 --2- 172.21.15.81:0/1329756457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c0051c0 0x7ff28c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff29803ae10 con 0x7ff28c004800 2024-09-16T01:16:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff28c00c0c0 con 0x7ff28c0051c0 2024-09-16T01:16:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff28c00c2c0 con 0x7ff28c003b40 2024-09-16T01:16:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7f6ec691f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ec006eac0 0x7f6ec01608f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ec691f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ec006ef20 0x7f6ec00b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f09d3124640 1 -- 172.21.15.81:0/359428552 shutdown_connections 2024-09-16T01:16:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f09d3124640 1 --2- 172.21.15.81:0/359428552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09c4053780 0x7f09c403b870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f09d3124640 1 -- 172.21.15.81:0/359428552 >> 172.21.15.81:0/359428552 conn(0x7f09c403a510 msgr2=0x7f09c403a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f09d3124640 1 -- 172.21.15.81:0/359428552 shutdown_connections 2024-09-16T01:16:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7ff2a5b59640 1 --2- 172.21.15.81:0/1329756457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff28c003b40 0x7ff28c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f09d3124640 1 -- 172.21.15.81:0/359428552 wait complete. 2024-09-16T01:16:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7ff2a635a640 1 --2- 172.21.15.81:0/1329756457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c0051c0 0x7ff28c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ec691f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec0147450 0x7f6ec01fb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ec691f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec00af4b0 con 0x7f6ec0147450 2024-09-16T01:16:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ec691f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec00af1d0 con 0x7f6ec006eac0 2024-09-16T01:16:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ec691f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec0148050 con 0x7f6ec006ef20 2024-09-16T01:16:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ebffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ec006eac0 0x7f6ec01608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ebffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ec006eac0 0x7f6ec01608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:35608/0 (socket says 172.21.15.81:35608) 2024-09-16T01:16:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ebffff640 1 -- 172.21.15.81:0/2019024858 learned_addr learned my addr 172.21.15.81:0/2019024858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f502f7fe640 1 -- 172.21.15.81:0/1234228081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5020004d40 msgr2=0x7f50200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f502f7fe640 1 --2- 172.21.15.81:0/1234228081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5020004d40 0x7f50200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f502f7fe640 1 -- 172.21.15.81:0/1234228081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50200039b0 msgr2=0x7f5020003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f502f7fe640 1 --2- 172.21.15.81:0/1234228081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50200039b0 0x7f5020003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7fa44da2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa44806f820 0x7fa448154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f502f7fe640 1 -- 172.21.15.81:0/1234228081 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5020003520 con 0x7f502803bc60 2024-09-16T01:16:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7fa44da2b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4480b2920 0x7fa448159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ebf7fe640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ec006ef20 0x7f6ec00b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7fa44ca29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa44806f820 0x7fa448154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7fa44ca29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa44806f820 0x7fa448154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41330/0 (socket says 172.21.15.81:41330) 2024-09-16T01:16:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7fa44da2b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa44815d730 0x7fa44814f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f722d453640 1 -- 172.21.15.81:0/1346179461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7228147e90 msgr2=0x7f72280720b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f722d453640 1 --2- 172.21.15.81:0/1346179461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7228147e90 0x7f72280720b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f722806ccb0 tx=0x7f721c02a1c0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.192+0000 7fd9701d8640 1 -- 172.21.15.81:0/1954944338 wait complete. 2024-09-16T01:16:01.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7fa44ca29640 1 -- 172.21.15.81:0/108739731 learned_addr learned my addr 172.21.15.81:0/108739731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7fa44da2b640 1 -- 172.21.15.81:0/108739731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa4480cfd10 con 0x7fa44806f820 2024-09-16T01:16:01.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7fa44da2b640 1 -- 172.21.15.81:0/108739731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa448072b50 con 0x7fa4480b2920 2024-09-16T01:16:01.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7fa44da2b640 1 -- 172.21.15.81:0/108739731 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa448071c10 con 0x7fa44815d730 2024-09-16T01:16:01.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7fa44d22a640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa44815d730 0x7fa44814f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ebffff640 1 -- 172.21.15.81:0/2019024858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ec006ef20 msgr2=0x7f6ec00b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ebffff640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ec006ef20 0x7f6ec00b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ebffff640 1 -- 172.21.15.81:0/2019024858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec0147450 msgr2=0x7f6ec01fb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ebffff640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ec0147450 0x7f6ec01fb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7f6ebffff640 1 -- 172.21.15.81:0/2019024858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec01e72b0 con 0x7f6ec006eac0 2024-09-16T01:16:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7ff2a5b59640 1 -- 172.21.15.81:0/1329756457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c0051c0 msgr2=0x7ff28c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7ff2a5b59640 1 --2- 172.21.15.81:0/1329756457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c0051c0 0x7ff28c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7ff2a5b59640 1 -- 172.21.15.81:0/1329756457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c004800 msgr2=0x7ff28c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7ff2a5b59640 1 --2- 172.21.15.81:0/1329756457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c004800 0x7ff28c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7ff2a5b59640 1 -- 172.21.15.81:0/1329756457 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28c003520 con 0x7ff28c003b40 2024-09-16T01:16:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.193+0000 7ff2a635a640 1 -- 172.21.15.81:0/1329756457 reap_dead start 2024-09-16T01:16:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7fd9701d8640 1 Processor -- start 2024-09-16T01:16:01.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7f6ebffff640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ec006eac0 0x7f6ec01608f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800ba50 tx=0x7f6eb800bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7fa44d22a640 1 -- 172.21.15.81:0/108739731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4480b2920 msgr2=0x7fa448159c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T01:16:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7fa44d22a640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4480b2920 0x7fa448159c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7fa44d22a640 1 -- 172.21.15.81:0/108739731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa44806f820 msgr2=0x7fa448154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7fa44d22a640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa44806f820 0x7fa448154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7fa44d22a640 1 -- 172.21.15.81:0/108739731 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa448154a70 con 0x7fa44815d730 2024-09-16T01:16:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7fd9701d8640 1 -- start start 2024-09-16T01:16:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7f6ebcff9640 1 -- 172.21.15.81:0/2019024858 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8019070 con 0x7f6ec006eac0 2024-09-16T01:16:01.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7f6ec691f640 1 -- 172.21.15.81:0/2019024858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec00b0840 con 0x7f6ec006eac0 2024-09-16T01:16:01.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7f722d453640 1 -- 172.21.15.81:0/1346179461 shutdown_connections 2024-09-16T01:16:01.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7f722d453640 1 --2- 172.21.15.81:0/1346179461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7228147e90 0x7f72280720b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7f722d453640 1 --2- 172.21.15.81:0/1346179461 >> v2:172.21.15.81:3300/0 conn(0x7f7228147230 0x7f722806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7f722d453640 1 -- 172.21.15.81:0/1346179461 >> 172.21.15.81:0/1346179461 conn(0x7f7228067d70 msgr2=0x7f722806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7f6ebcff9640 1 -- 172.21.15.81:0/2019024858 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb800cc10 con 0x7f6ec006eac0 2024-09-16T01:16:01.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7f6ebcff9640 1 -- 172.21.15.81:0/2019024858 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8014440 con 0x7f6ec006eac0 2024-09-16T01:16:01.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7f502f7fe640 1 --2- 172.21.15.81:0/1234228081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f502803bc60 0x7f5020004800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f501c009a90 tx=0x7f5020005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5c19ad07c3228fc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7fec35482640 1 -- 172.21.15.81:0/951544786 wait complete. 2024-09-16T01:16:01.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7f09d3124640 1 Processor -- start 2024-09-16T01:16:01.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7fa44d22a640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa44815d730 0x7fa44814f120 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa44000c890 tx=0x7fa44000cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7ff2a5b59640 1 --2- 172.21.15.81:0/1329756457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff28c003b40 0x7ff28c003f40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0076eb0 tx=0x7ff28c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77dc39b25730c84a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.194+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c036070 con 0x7f502803bc60 2024-09-16T01:16:01.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501c031400 con 0x7f502803bc60 2024-09-16T01:16:01.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7f09d3124640 1 -- start start 2024-09-16T01:16:01.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fd9701d8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd96806e1a0 0x7fd968203380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fd9701d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9680b3b90 0x7fd9680c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fd9701d8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9680b4680 0x7fd9680c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fd9701d8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd9680b4b10 con 0x7fd9680b3b90 2024-09-16T01:16:01.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fec35482640 1 Processor -- start 2024-09-16T01:16:01.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7f502effd640 1 -- 172.21.15.81:0/1234228081 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c036070 con 0x7f502803bc60 2024-09-16T01:16:01.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fd9701d8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd9680ce0c0 con 0x7fd96806e1a0 2024-09-16T01:16:01.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fd9701d8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd9680cda90 con 0x7fd9680b4680 2024-09-16T01:16:01.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fd96e775640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9680b4680 0x7fd9680c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fd96e775640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9680b4680 0x7fd9680c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:44940/0 (socket says 172.21.15.81:44940) 2024-09-16T01:16:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7f5035415640 1 -- 172.21.15.81:0/1234228081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f502803bc60 msgr2=0x7f5020004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7f5035415640 1 --2- 172.21.15.81:0/1234228081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f502803bc60 0x7f5020004800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f501c009a90 tx=0x7f5020005830 comp rx=0 tx=0).stop 2024-09-16T01:16:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f5034c14640 1 -- 172.21.15.81:0/1234228081 reap_dead start 2024-09-16T01:16:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fa43d7fa640 1 -- 172.21.15.81:0/108739731 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440018070 con 0x7fa44815d730 2024-09-16T01:16:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fa43d7fa640 1 -- 172.21.15.81:0/108739731 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa44000a640 con 0x7fa44815d730 2024-09-16T01:16:01.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fa43d7fa640 1 -- 172.21.15.81:0/108739731 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44000a9f0 con 0x7fa44815d730 2024-09-16T01:16:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7fec35482640 1 -- start start 2024-09-16T01:16:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7f09d3124640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f09c4037bc0 0x7f09c41853e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d3124640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09c4053780 0x7f09c4188250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d3124640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09c40e6e00 0x7f09c400bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d3124640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f09c4057000 con 0x7f09c4053780 2024-09-16T01:16:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d3124640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f09c40e71e0 con 0x7f09c40e6e00 2024-09-16T01:16:01.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d3124640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f09c4057180 con 0x7f09c4037bc0 2024-09-16T01:16:01.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7fd96e775640 1 -- 172.21.15.81:0/2407393541 learned_addr learned my addr 172.21.15.81:0/2407393541 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7fd96df74640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd96806e1a0 0x7fd968203380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f5035415640 1 -- 172.21.15.81:0/1234228081 shutdown_connections 2024-09-16T01:16:01.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f5035415640 1 -- 172.21.15.81:0/1234228081 >> 172.21.15.81:0/1234228081 conn(0x7f502803a520 msgr2=0x7f502803a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0075670 con 0x7ff28c003b40 2024-09-16T01:16:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d1921640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09c4053780 0x7f09c4188250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d2923640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09c40e6e00 0x7f09c400bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f5035415640 1 -- 172.21.15.81:0/1234228081 shutdown_connections 2024-09-16T01:16:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a00aa070 con 0x7ff28c003b40 2024-09-16T01:16:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7ff2a4b57640 1 -- 172.21.15.81:0/1329756457 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a006d330 con 0x7ff28c003b40 2024-09-16T01:16:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f5035415640 1 -- 172.21.15.81:0/1234228081 wait complete. 2024-09-16T01:16:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.195+0000 7f6ec691f640 1 -- 172.21.15.81:0/2019024858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec00b0e00 con 0x7f6ec006eac0 2024-09-16T01:16:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d1921640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09c4053780 0x7f09c4188250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41350/0 (socket says 172.21.15.81:41350) 2024-09-16T01:16:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7fd96df74640 1 -- 172.21.15.81:0/2407393541 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9680b4680 msgr2=0x7fd9680c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7fd96df74640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd9680b4680 0x7fd9680c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7fd96df74640 1 -- 172.21.15.81:0/2407393541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9680b3b90 msgr2=0x7fd9680c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7fd96df74640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9680b3b90 0x7fd9680c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7fd96df74640 1 -- 172.21.15.81:0/2407393541 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9680aeaf0 con 0x7fd96806e1a0 2024-09-16T01:16:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1329756457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff28c003b40 msgr2=0x7ff28c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7ff2a6b5b640 1 --2- 172.21.15.81:0/1329756457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff28c003b40 0x7ff28c003f40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0076eb0 tx=0x7ff28c005830 comp rx=0 tx=0).stop 2024-09-16T01:16:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d1921640 1 -- 172.21.15.81:0/2805520573 learned_addr learned my addr 172.21.15.81:0/2805520573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d2122640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f09c4037bc0 0x7f09c41853e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d1921640 1 -- 172.21.15.81:0/2805520573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f09c4037bc0 msgr2=0x7f09c41853e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d1921640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f09c4037bc0 0x7f09c41853e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d1921640 1 -- 172.21.15.81:0/2805520573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09c40e6e00 msgr2=0x7f09c400bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d1921640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f09c40e6e00 0x7f09c400bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f09d1921640 1 -- 172.21.15.81:0/2805520573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c4188790 con 0x7f09c4053780 2024-09-16T01:16:01.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7f722d453640 1 -- 172.21.15.81:0/1346179461 shutdown_connections 2024-09-16T01:16:01.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.196+0000 7fd96df74640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd96806e1a0 0x7fd968203380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd96400a6f0 tx=0x7fd96400abb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1329756457 shutdown_connections 2024-09-16T01:16:01.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7ff2a6b5b640 1 --2- 172.21.15.81:0/1329756457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff28c003b40 0x7ff28c003f40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1329756457 >> 172.21.15.81:0/1329756457 conn(0x7ff29801e180 msgr2=0x7ff298054eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7fa44da2b640 1 -- 172.21.15.81:0/108739731 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa448154d50 con 0x7fa44815d730 2024-09-16T01:16:01.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7f6ec691f640 1 -- 172.21.15.81:0/2019024858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ec0075670 con 0x7f6ec006eac0 2024-09-16T01:16:01.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7fa44da2b640 1 -- 172.21.15.81:0/108739731 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa448155310 con 0x7fa44815d730 2024-09-16T01:16:01.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7f6ebcff9640 1 -- 172.21.15.81:0/2019024858 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6eb801c070 con 0x7f6ec006eac0 2024-09-16T01:16:01.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7fec35482640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec28035980 0x7fec2804c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7f09d1921640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09c4053780 0x7f09c4188250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09cc076eb0 tx=0x7f09cc0699e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1329756457 shutdown_connections 2024-09-16T01:16:01.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7fec35482640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec28052550 0x7fec2804e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7f09c2ffd640 1 -- 172.21.15.81:0/2805520573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0b3050 con 0x7f09c4053780 2024-09-16T01:16:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7f09d3124640 1 -- 172.21.15.81:0/2805520573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c400ab60 con 0x7f09c4053780 2024-09-16T01:16:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7f6ebcff9640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6eac06c2e0 0x7f6eac06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1329756457 wait complete. 2024-09-16T01:16:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7f5035415640 1 Processor -- start 2024-09-16T01:16:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7fec35482640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec280e1cb0 0x7fec280e0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7fec35482640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec28052ed0 con 0x7fec28035980 2024-09-16T01:16:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7fec35482640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fec28050260 con 0x7fec28052550 2024-09-16T01:16:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7fec35482640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fec28053050 con 0x7fec280e1cb0 2024-09-16T01:16:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7fec2ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec28035980 0x7fec2804c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7fec2ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec28035980 0x7fec2804c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41360/0 (socket says 172.21.15.81:41360) 2024-09-16T01:16:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7fec2ffff640 1 -- 172.21.15.81:0/2260185143 learned_addr learned my addr 172.21.15.81:0/2260185143 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7f6ebf7fe640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6eac06c2e0 0x7f6eac06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7f5035415640 1 -- start start 2024-09-16T01:16:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7fa44da2b640 1 -- 172.21.15.81:0/108739731 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4481547c0 con 0x7fa44815d730 2024-09-16T01:16:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7fec34c81640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec280e1cb0 0x7fec280e0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7f722d453640 1 -- 172.21.15.81:0/1346179461 wait complete. 2024-09-16T01:16:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7fd95e7fc640 1 -- 172.21.15.81:0/2407393541 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96400eb20 con 0x7fd96806e1a0 2024-09-16T01:16:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7fd9701d8640 1 -- 172.21.15.81:0/2407393541 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9680ac020 con 0x7fd96806e1a0 2024-09-16T01:16:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7fd9701d8640 1 -- 172.21.15.81:0/2407393541 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9680ac5a0 con 0x7fd96806e1a0 2024-09-16T01:16:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7fd95e7fc640 1 -- 172.21.15.81:0/2407393541 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96401b070 con 0x7fd96806e1a0 2024-09-16T01:16:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.197+0000 7fd95e7fc640 1 -- 172.21.15.81:0/2407393541 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964016480 con 0x7fd96806e1a0 2024-09-16T01:16:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.198+0000 7fd9701d8640 1 -- 172.21.15.81:0/2407393541 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9680acf40 con 0x7fd96806e1a0 2024-09-16T01:16:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7f722d453640 1 Processor -- start 2024-09-16T01:16:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7ff2a6b5b640 1 Processor -- start 2024-09-16T01:16:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7f722d453640 1 -- start start 2024-09-16T01:16:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7fec2f7fe640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec28052550 0x7fec2804e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7f6ebf7fe640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6eac06c2e0 0x7f6eac06e7a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4034000 tx=0x7f6eb402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7f6ebcff9640 1 -- 172.21.15.81:0/2019024858 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6eb808b220 con 0x7f6ec006eac0 2024-09-16T01:16:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7fd95e7fc640 1 -- 172.21.15.81:0/2407393541 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd964014050 con 0x7fd96806e1a0 2024-09-16T01:16:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7f5035415640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50280e1510 0x7f502800ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7f5035415640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50280517d0 0x7f5028051c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7f5035415640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50280098c0 0x7f5028009d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f502f7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50280517d0 0x7f5028051c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f6ebcff9640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] conn(0x7f6eac075960 0x7f6eac077da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f502f7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50280517d0 0x7f5028051c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:44948/0 (socket says 172.21.15.81:44948) 2024-09-16T01:16:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f502f7fe640 1 -- 172.21.15.81:0/108570868 learned_addr learned my addr 172.21.15.81:0/108570868 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f5034c14640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50280098c0 0x7f5028009d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7f5035415640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f50280e2e50 con 0x7f50280e1510 2024-09-16T01:16:01.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f50280e2cd0 con 0x7f50280098c0 2024-09-16T01:16:01.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f50280e2fd0 con 0x7f50280517d0 2024-09-16T01:16:01.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7fec2ffff640 1 -- 172.21.15.81:0/2260185143 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec280e1cb0 msgr2=0x7fec280e0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7fec2ffff640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec280e1cb0 0x7fec280e0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7fec2ffff640 1 -- 172.21.15.81:0/2260185143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec28052550 msgr2=0x7fec2804e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7fec2ffff640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec28052550 0x7fec2804e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7fec2ffff640 1 -- 172.21.15.81:0/2260185143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2804d7b0 con 0x7fec28035980 2024-09-16T01:16:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fec2ffff640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec28035980 0x7fec2804c7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fec2400c450 tx=0x7fec2400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7fa43d7fa640 1 -- 172.21.15.81:0/108739731 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa44001b070 con 0x7fa44815d730 2024-09-16T01:16:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f6ec4ebc640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] conn(0x7f6eac075960 0x7f6eac077da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fec2cff9640 1 -- 172.21.15.81:0/2260185143 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec240052d0 con 0x7fec28035980 2024-09-16T01:16:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fec2cff9640 1 -- 172.21.15.81:0/2260185143 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec24005470 con 0x7fec28035980 2024-09-16T01:16:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fec2cff9640 1 -- 172.21.15.81:0/2260185143 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec240052d0 con 0x7fec28035980 2024-09-16T01:16:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fec35482640 1 -- 172.21.15.81:0/2260185143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2804cf10 con 0x7fec28035980 2024-09-16T01:16:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f502ffff640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50280e1510 0x7f502800ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f502f7fe640 1 -- 172.21.15.81:0/108570868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50280098c0 msgr2=0x7f5028009d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f502f7fe640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50280098c0 0x7f5028009d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f502f7fe640 1 -- 172.21.15.81:0/108570868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50280e1510 msgr2=0x7f502800ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f502f7fe640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50280e1510 0x7f502800ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f502f7fe640 1 -- 172.21.15.81:0/108570868 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50280e18f0 con 0x7f50280517d0 2024-09-16T01:16:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fa43d7fa640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa43406c380 0x7fa43406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fa43d7fa640 1 -- 172.21.15.81:0/108739731 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa44008ae50 con 0x7fa44815d730 2024-09-16T01:16:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.199+0000 7ff2a6b5b640 1 -- start start 2024-09-16T01:16:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7ff2a6b5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c003b40 0x7ff298182f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fa44ca29640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa43406c380 0x7fa43406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fa43d7fa640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] conn(0x7fa434075b00 0x7fa434077f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fa43d7fa640 1 -- 172.21.15.81:0/108739731 --> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa440021e50 con 0x7fa434075b00 2024-09-16T01:16:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fa43d7fa640 1 -- 172.21.15.81:0/108739731 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa44008d4b0 con 0x7fa44815d730 2024-09-16T01:16:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f722d453640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72280725f0 0x7f72281f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fec35482640 1 -- 172.21.15.81:0/2260185143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2804d4d0 con 0x7fec28035980 2024-09-16T01:16:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fd95e7fc640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd94c074b90 0x7fd94c077050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fd95e7fc640 1 -- 172.21.15.81:0/2407393541 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd96408bf10 con 0x7fd96806e1a0 2024-09-16T01:16:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7fd96d773640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd94c074b90 0x7fd94c077050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7f502f7fe640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50280517d0 0x7f5028051c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f501c009bb0 tx=0x7f501c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7f722d453640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7228147230 0x7f722815de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7fd95e7fc640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] conn(0x7fd94c07e310 0x7fd94c080750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7fd95e7fc640 1 -- 172.21.15.81:0/2407393541 --> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd96400df80 con 0x7fd94c07e310 2024-09-16T01:16:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7fa43ffff640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] conn(0x7fa434075b00 0x7fa434077f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7fd95e7fc640 1 -- 172.21.15.81:0/2407393541 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd96408c300 con 0x7fd96806e1a0 2024-09-16T01:16:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7f502cff9640 1 -- 172.21.15.81:0/108570868 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c03f020 con 0x7f50280517d0 2024-09-16T01:16:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7f722d453640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7228147e90 0x7f7228144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7f72267fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7228147230 0x7f722815de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7f7226ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72280725f0 0x7f72281f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7f7226ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72280725f0 0x7f72281f4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:44958/0 (socket says 172.21.15.81:44958) 2024-09-16T01:16:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7ff2a5b59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c003b40 0x7ff298182f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7ff2a5b59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c003b40 0x7ff298182f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41368/0 (socket says 172.21.15.81:41368) 2024-09-16T01:16:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7ff2a5b59640 1 -- 172.21.15.81:0/1285867929 learned_addr learned my addr 172.21.15.81:0/1285867929 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7ff2a6b5b640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff29804a630 0x7ff2981863a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7ff2a6b5b640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff29800b160 0x7ff29800b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff298055bf0 con 0x7ff28c003b40 2024-09-16T01:16:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff29803ab30 con 0x7ff29800b160 2024-09-16T01:16:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff298055d70 con 0x7ff29804a630 2024-09-16T01:16:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7f6ebcff9640 1 -- 172.21.15.81:0/2019024858 --> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6eac078470 con 0x7f6eac075960 2024-09-16T01:16:01.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7f72267fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7228147230 0x7f722815de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41384/0 (socket says 172.21.15.81:41384) 2024-09-16T01:16:01.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7f722d453640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f722806eec0 con 0x7f7228147230 2024-09-16T01:16:01.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7f722d453640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f722806ebe0 con 0x7f7228147e90 2024-09-16T01:16:01.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7f722d453640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f722806f1a0 con 0x7f72280725f0 2024-09-16T01:16:01.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50280e4680 con 0x7f50280517d0 2024-09-16T01:16:01.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f50280e4c40 con 0x7f50280517d0 2024-09-16T01:16:01.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7ff2a5358640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff29804a630 0x7ff2981863a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7ff2a635a640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff29800b160 0x7ff29800b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7f7226ffd640 1 -- 172.21.15.81:0/202776582 learned_addr learned my addr 172.21.15.81:0/202776582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7fd96d773640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd94c074b90 0x7fd94c077050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9580010e0 tx=0x7fd958007950 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7fd96e775640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] conn(0x7fd94c07e310 0x7fd94c080750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7fa43ffff640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] conn(0x7fa434075b00 0x7fa434077f40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7f72277fe640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7228147e90 0x7f7228144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7f6ec4ebc640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] conn(0x7f6eac075960 0x7f6eac077da0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7f6ebcff9640 1 -- 172.21.15.81:0/2019024858 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6eb8090060 con 0x7f6ec006eac0 2024-09-16T01:16:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7f502cff9640 1 -- 172.21.15.81:0/108570868 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501c00f000 con 0x7f50280517d0 2024-09-16T01:16:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.200+0000 7f09c2ffd640 1 -- 172.21.15.81:0/2805520573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc0b4040 con 0x7f09c4053780 2024-09-16T01:16:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.201+0000 7f09d3124640 1 -- 172.21.15.81:0/2805520573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c4050260 con 0x7f09c4053780 2024-09-16T01:16:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7f09c2ffd640 1 -- 172.21.15.81:0/2805520573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0adae0 con 0x7f09c4053780 2024-09-16T01:16:01.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7f09c0ff9640 1 -- 172.21.15.81:0/2805520573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f09c404fd90 con 0x7f09c4053780 2024-09-16T01:16:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7ff2a5358640 1 -- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff29800b160 msgr2=0x7ff29800b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7ff2a5358640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff29800b160 0x7ff29800b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7ff2a5358640 1 -- 172.21.15.81:0/1285867929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c003b40 msgr2=0x7ff298182f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7ff2a5358640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c003b40 0x7ff298182f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7ff2a5358640 1 -- 172.21.15.81:0/1285867929 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2981868e0 con 0x7ff29804a630 2024-09-16T01:16:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7fec35482640 1 -- 172.21.15.81:0/2260185143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec10001030 con 0x7fec28035980 2024-09-16T01:16:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.202+0000 7fa44ca29640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa43406c380 0x7fa43406e840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa444009560 tx=0x7fa44402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7ff2a5358640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff29804a630 0x7ff2981863a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff29000b390 tx=0x7ff29000b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7ff2967fc640 1 -- 172.21.15.81:0/1285867929 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff290015020 con 0x7ff29804a630 2024-09-16T01:16:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff29804abf0 con 0x7ff29804a630 2024-09-16T01:16:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7f09c2ffd640 1 -- 172.21.15.81:0/2805520573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f09cc0c1020 con 0x7f09c4053780 2024-09-16T01:16:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff29804b1b0 con 0x7ff29804a630 2024-09-16T01:16:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7fd96e775640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] conn(0x7fd94c07e310 0x7fd94c080750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7ff2967fc640 1 -- 172.21.15.81:0/1285867929 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff290011830 con 0x7ff29804a630 2024-09-16T01:16:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7ff2967fc640 1 -- 172.21.15.81:0/1285867929 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff290011c20 con 0x7ff29804a630 2024-09-16T01:16:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7f72267fc640 1 -- 172.21.15.81:0/202776582 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72280725f0 msgr2=0x7f72281f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7f72267fc640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72280725f0 0x7f72281f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7f72267fc640 1 -- 172.21.15.81:0/202776582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7228147e90 msgr2=0x7f7228144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7f72267fc640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7228147e90 0x7f7228144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7f72267fc640 1 -- 172.21.15.81:0/202776582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72281f4330 con 0x7f7228147230 2024-09-16T01:16:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7f502cff9640 1 -- 172.21.15.81:0/108570868 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501c036040 con 0x7f50280517d0 2024-09-16T01:16:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.203+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5010001030 con 0x7f50280517d0 2024-09-16T01:16:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.204+0000 7f09c2ffd640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f09b006c380 0x7f09b006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.204+0000 7fa43d7fa640 1 -- 172.21.15.81:0/108739731 <== osd.5 v2:172.21.15.102:6808/366563181 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa440021e50 con 0x7fa434075b00 2024-09-16T01:16:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.204+0000 7f72267fc640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7228147230 0x7f722815de90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f721c031000 tx=0x7f721c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.204+0000 7fd95e7fc640 1 -- 172.21.15.81:0/2407393541 <== osd.3 v2:172.21.15.81:6808/3410907338 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd96400df80 con 0x7fd94c07e310 2024-09-16T01:16:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.204+0000 7f502cff9640 1 -- 172.21.15.81:0/108570868 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f501c042020 con 0x7f50280517d0 2024-09-16T01:16:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.204+0000 7f720f7fe640 1 -- 172.21.15.81:0/202776582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c037050 con 0x7f7228147230 2024-09-16T01:16:01.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.204+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff288001030 con 0x7ff29804a630 2024-09-16T01:16:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7f502cff9640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f501406c380 0x7f501406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7f502cff9640 1 -- 172.21.15.81:0/108570868 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f501c0ab190 con 0x7f50280517d0 2024-09-16T01:16:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7f502cff9640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] conn(0x7f5014075b00 0x7f5014077f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7f502cff9640 1 -- 172.21.15.81:0/108570868 --> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f501c007e80 con 0x7f5014075b00 2024-09-16T01:16:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.204+0000 7f722d453640 1 -- 172.21.15.81:0/202776582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72281320d0 con 0x7f7228147230 2024-09-16T01:16:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.204+0000 7f722d453640 1 -- 172.21.15.81:0/202776582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72281f48d0 con 0x7f7228147230 2024-09-16T01:16:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7f502cff9640 1 -- 172.21.15.81:0/108570868 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f501c0b2050 con 0x7f50280517d0 2024-09-16T01:16:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7f720f7fe640 1 -- 172.21.15.81:0/202776582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f721c043070 con 0x7f7228147230 2024-09-16T01:16:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7f09c2ffd640 1 -- 172.21.15.81:0/2805520573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f09cc1279c0 con 0x7f09c4053780 2024-09-16T01:16:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7fec2cff9640 1 -- 172.21.15.81:0/2260185143 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fec24012630 con 0x7fec28035980 2024-09-16T01:16:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.206+0000 7f502ffff640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f501406c380 0x7f501406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.206+0000 7ff2967fc640 1 -- 172.21.15.81:0/1285867929 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff290018020 con 0x7ff29804a630 2024-09-16T01:16:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7f09c2ffd640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] conn(0x7f09b0075b00 0x7f09b0077f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7f09c2ffd640 1 -- 172.21.15.81:0/2805520573 --> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f09cc0c1e80 con 0x7f09b0075b00 2024-09-16T01:16:01.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7f09c2ffd640 1 -- 172.21.15.81:0/2805520573 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f09cc12c2a0 con 0x7f09c4053780 2024-09-16T01:16:01.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7f09d2122640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f09b006c380 0x7f09b006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.206+0000 7f09d2923640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] conn(0x7f09b0075b00 0x7f09b0077f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.206+0000 7f5034c14640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] conn(0x7f5014075b00 0x7f5014077f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.206+0000 7fec2cff9640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fec1406c6b0 0x7fec1406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.206+0000 7fec2cff9640 1 -- 172.21.15.81:0/2260185143 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fec240050d0 con 0x7fec28035980 2024-09-16T01:16:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.206+0000 7f6ebcff9640 1 -- 172.21.15.81:0/2019024858 <== osd.2 v2:172.21.15.81:6826/3728781080 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6eac078470 con 0x7f6eac075960 2024-09-16T01:16:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.206+0000 7ff2967fc640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff28406c4e0 0x7ff28406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.206+0000 7f5034c14640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] conn(0x7f5014075b00 0x7f5014077f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7f502ffff640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f501406c380 0x7f501406e840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f50280506e0 tx=0x7f5024001b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.206+0000 7ff2967fc640 1 -- 172.21.15.81:0/1285867929 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff2900119e0 con 0x7ff29804a630 2024-09-16T01:16:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7ff2967fc640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] conn(0x7ff284075b60 0x7ff284077fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7ff2967fc640 1 -- 172.21.15.81:0/1285867929 --> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff29000fe50 con 0x7ff284075b60 2024-09-16T01:16:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7ff2967fc640 1 -- 172.21.15.81:0/1285867929 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff29008b720 con 0x7ff29804a630 2024-09-16T01:16:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7ff2a5b59640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff28406c4e0 0x7ff28406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.206+0000 7fec2cff9640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] conn(0x7fec14076980 0x7fec14078e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.206+0000 7fec2cff9640 1 -- 172.21.15.81:0/2260185143 --> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec140794f0 con 0x7fec14076980 2024-09-16T01:16:01.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7fec34c81640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] conn(0x7fec14076980 0x7fec14078e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.205+0000 7f720f7fe640 1 -- 172.21.15.81:0/202776582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c0325f0 con 0x7f7228147230 2024-09-16T01:16:01.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7f720f7fe640 1 -- 172.21.15.81:0/202776582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f721c032790 con 0x7f7228147230 2024-09-16T01:16:01.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7f722d453640 1 -- 172.21.15.81:0/202776582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7208001030 con 0x7f7228147230 2024-09-16T01:16:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7fec34c81640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] conn(0x7fec14076980 0x7fec14078e20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7fec2cff9640 1 -- 172.21.15.81:0/2260185143 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fec24055f20 con 0x7fec28035980 2024-09-16T01:16:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7ff2a635a640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] conn(0x7ff284075b60 0x7ff284077fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.208+0000 7ff2a635a640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] conn(0x7ff284075b60 0x7ff284077fa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.208+0000 7f720f7fe640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f721406c300 0x7f721406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.208+0000 7f720f7fe640 1 -- 172.21.15.81:0/202776582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f721c0abe80 con 0x7f7228147230 2024-09-16T01:16:01.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.208+0000 7f720f7fe640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] conn(0x7f7214075a80 0x7f7214077ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.208+0000 7f720f7fe640 1 -- 172.21.15.81:0/202776582 --> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f721c007e40 con 0x7f7214075a80 2024-09-16T01:16:01.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.208+0000 7f720f7fe640 1 -- 172.21.15.81:0/202776582 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f721c0ae5d0 con 0x7f7228147230 2024-09-16T01:16:01.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7f502cff9640 1 -- 172.21.15.81:0/108570868 <== osd.4 v2:172.21.15.102:6809/1702667483 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f501c007e80 con 0x7f5014075b00 2024-09-16T01:16:01.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.207+0000 7fec2f7fe640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fec1406c6b0 0x7fec1406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.208+0000 7fec2f7fe640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fec1406c6b0 0x7fec1406eb70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec1c034000 tx=0x7fec1c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.208+0000 7f72277fe640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] conn(0x7f7214075a80 0x7f7214077ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.208+0000 7ff2967fc640 1 -- 172.21.15.81:0/1285867929 <== osd.7 v2:172.21.15.102:6800/1527646643 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff29000fe50 con 0x7ff284075b60 2024-09-16T01:16:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.209+0000 7f7226ffd640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f721406c300 0x7f721406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.209+0000 7ff2a5b59640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff28406c4e0 0x7ff28406e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0075ea0 tx=0x7ff2a006d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.209+0000 7f09d2122640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f09b006c380 0x7f09b006e840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f09c80011e0 tx=0x7f09c8007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.209+0000 7fec2cff9640 1 -- 172.21.15.81:0/2260185143 <== osd.1 v2:172.21.15.81:6800/1559362497 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec140794f0 con 0x7fec14076980 2024-09-16T01:16:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.209+0000 7f72277fe640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] conn(0x7f7214075a80 0x7f7214077ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.210+0000 7f720f7fe640 1 -- 172.21.15.81:0/202776582 <== osd.6 v2:172.21.15.102:6824/136250174 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f721c007e40 con 0x7f7214075a80 2024-09-16T01:16:01.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.210+0000 7f7226ffd640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f721406c300 0x7f721406e7c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7218006fd0 tx=0x7f7218008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.209+0000 7f09d2923640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] conn(0x7f09b0075b00 0x7f09b0077f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.210+0000 7f09c2ffd640 1 -- 172.21.15.81:0/2805520573 <== osd.0 v2:172.21.15.81:6816/2041738643 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f09cc0c1e80 con 0x7f09b0075b00 2024-09-16T01:16:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.233+0000 7fd9701d8640 1 -- 172.21.15.81:0/2407393541 --> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd96806dc60 con 0x7fd94c07e310 2024-09-16T01:16:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.234+0000 7fd95e7fc640 1 -- 172.21.15.81:0/2407393541 <== osd.3 v2:172.21.15.81:6808/3410907338 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd96806dc60 con 0x7fd94c07e310 2024-09-16T01:16:01.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.234+0000 7fa44da2b640 1 -- 172.21.15.81:0/108739731 --> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa448069730 con 0x7fa434075b00 2024-09-16T01:16:01.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.235+0000 7fa43d7fa640 1 -- 172.21.15.81:0/108739731 <== osd.5 v2:172.21.15.102:6808/366563181 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa448069730 con 0x7fa434075b00 2024-09-16T01:16:01.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.235+0000 7fd94bfff640 1 -- 172.21.15.81:0/2407393541 >> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] conn(0x7fd94c07e310 msgr2=0x7fd94c080750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.235+0000 7fd94bfff640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] conn(0x7fd94c07e310 0x7fd94c080750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.235+0000 7fd94bfff640 1 -- 172.21.15.81:0/2407393541 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd94c074b90 msgr2=0x7fd94c077050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.235+0000 7fd94bfff640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd94c074b90 0x7fd94c077050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd9580010e0 tx=0x7fd958007950 comp rx=0 tx=0).stop 2024-09-16T01:16:01.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.235+0000 7fd94bfff640 1 -- 172.21.15.81:0/2407393541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd96806e1a0 msgr2=0x7fd968203380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.235+0000 7fd94bfff640 1 --2- 172.21.15.81:0/2407393541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd96806e1a0 0x7fd968203380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd96400a6f0 tx=0x7fd96400abb0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.235+0000 7fd96e775640 1 -- 172.21.15.81:0/2407393541 reap_dead start 2024-09-16T01:16:01.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fa42effd640 1 -- 172.21.15.81:0/108739731 >> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] conn(0x7fa434075b00 msgr2=0x7fa434077f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fa42effd640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] conn(0x7fa434075b00 0x7fa434077f40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fa42effd640 1 -- 172.21.15.81:0/108739731 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa43406c380 msgr2=0x7fa43406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fa42effd640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa43406c380 0x7fa43406e840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa444009560 tx=0x7fa44402e000 comp rx=0 tx=0).stop 2024-09-16T01:16:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fa42effd640 1 -- 172.21.15.81:0/108739731 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa44815d730 msgr2=0x7fa44814f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fa42effd640 1 --2- 172.21.15.81:0/108739731 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa44815d730 0x7fa44814f120 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa44000c890 tx=0x7fa44000cd50 comp rx=0 tx=0).stop 2024-09-16T01:16:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fa44d22a640 1 -- 172.21.15.81:0/108739731 reap_dead start 2024-09-16T01:16:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fd94bfff640 1 -- 172.21.15.81:0/2407393541 shutdown_connections 2024-09-16T01:16:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fd94bfff640 1 -- 172.21.15.81:0/2407393541 >> 172.21.15.81:0/2407393541 conn(0x7fd968067950 msgr2=0x7fd96816d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fa42effd640 1 -- 172.21.15.81:0/108739731 shutdown_connections 2024-09-16T01:16:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fa42effd640 1 -- 172.21.15.81:0/108739731 >> 172.21.15.81:0/108739731 conn(0x7fa4480b1e00 msgr2=0x7fa4480ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fd94bfff640 1 -- 172.21.15.81:0/2407393541 shutdown_connections 2024-09-16T01:16:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fd94bfff640 1 -- 172.21.15.81:0/2407393541 wait complete. 2024-09-16T01:16:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fa42effd640 1 -- 172.21.15.81:0/108739731 shutdown_connections 2024-09-16T01:16:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7fa42effd640 1 -- 172.21.15.81:0/108739731 wait complete. 2024-09-16T01:16:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.236+0000 7f6ec691f640 1 -- 172.21.15.81:0/2019024858 --> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ec00af9d0 con 0x7f6eac075960 2024-09-16T01:16:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.237+0000 7f6ebcff9640 1 -- 172.21.15.81:0/2019024858 <== osd.2 v2:172.21.15.81:6826/3728781080 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ec00af9d0 con 0x7f6eac075960 2024-09-16T01:16:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.238+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 --> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5010002dd0 con 0x7f5014075b00 2024-09-16T01:16:01.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.238+0000 7f6ea67fc640 1 -- 172.21.15.81:0/2019024858 >> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] conn(0x7f6eac075960 msgr2=0x7f6eac077da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.238+0000 7f6ea67fc640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] conn(0x7f6eac075960 0x7f6eac077da0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.238+0000 7f6ea67fc640 1 -- 172.21.15.81:0/2019024858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6eac06c2e0 msgr2=0x7f6eac06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.238+0000 7f6ea67fc640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6eac06c2e0 0x7f6eac06e7a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4034000 tx=0x7f6eb402e000 comp rx=0 tx=0).stop 2024-09-16T01:16:01.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.238+0000 7f6ea67fc640 1 -- 172.21.15.81:0/2019024858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ec006eac0 msgr2=0x7f6ec01608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.238+0000 7f6ea67fc640 1 --2- 172.21.15.81:0/2019024858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ec006eac0 0x7f6ec01608f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800ba50 tx=0x7f6eb800bf10 comp rx=0 tx=0).stop 2024-09-16T01:16:01.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.238+0000 7f6ec4ebc640 1 -- 172.21.15.81:0/2019024858 reap_dead start 2024-09-16T01:16:01.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.239+0000 7f502cff9640 1 -- 172.21.15.81:0/108570868 <== osd.4 v2:172.21.15.102:6809/1702667483 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5010002dd0 con 0x7f5014075b00 2024-09-16T01:16:01.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.239+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 >> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] conn(0x7f5014075b00 msgr2=0x7f5014077f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.239+0000 7f5035415640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] conn(0x7f5014075b00 0x7f5014077f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.239+0000 7f6ea67fc640 1 -- 172.21.15.81:0/2019024858 shutdown_connections 2024-09-16T01:16:01.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.239+0000 7f6ea67fc640 1 -- 172.21.15.81:0/2019024858 >> 172.21.15.81:0/2019024858 conn(0x7f6ec0067b30 msgr2=0x7f6ec00cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.239+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f501406c380 msgr2=0x7f501406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.239+0000 7f5035415640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f501406c380 0x7f501406e840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f50280506e0 tx=0x7f5024001b80 comp rx=0 tx=0).stop 2024-09-16T01:16:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.239+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50280517d0 msgr2=0x7f5028051c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.239+0000 7f5035415640 1 --2- 172.21.15.81:0/108570868 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50280517d0 0x7f5028051c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f501c009bb0 tx=0x7f501c004730 comp rx=0 tx=0).stop 2024-09-16T01:16:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.239+0000 7f5034c14640 1 -- 172.21.15.81:0/108570868 reap_dead start 2024-09-16T01:16:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.239+0000 7f09c0ff9640 1 -- 172.21.15.81:0/2805520573 --> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f09c403b870 con 0x7f09b0075b00 2024-09-16T01:16:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.240+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 shutdown_connections 2024-09-16T01:16:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.240+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 >> 172.21.15.81:0/108570868 conn(0x7f502803a520 msgr2=0x7f50280e1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.240+0000 7fec35482640 1 -- 172.21.15.81:0/2260185143 --> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec10002dd0 con 0x7fec14076980 2024-09-16T01:16:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.240+0000 7f6ea67fc640 1 -- 172.21.15.81:0/2019024858 shutdown_connections 2024-09-16T01:16:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.240+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 --> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff288002dd0 con 0x7ff284075b60 2024-09-16T01:16:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.240+0000 7f6ea67fc640 1 -- 172.21.15.81:0/2019024858 wait complete. 2024-09-16T01:16:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.240+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 shutdown_connections 2024-09-16T01:16:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.240+0000 7f5035415640 1 -- 172.21.15.81:0/108570868 wait complete. 2024-09-16T01:16:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.240+0000 7ff2967fc640 1 -- 172.21.15.81:0/1285867929 <== osd.7 v2:172.21.15.102:6800/1527646643 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff288002dd0 con 0x7ff284075b60 2024-09-16T01:16:01.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.240+0000 7f09c2ffd640 1 -- 172.21.15.81:0/2805520573 <== osd.0 v2:172.21.15.81:6816/2041738643 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f09c403b870 con 0x7f09b0075b00 2024-09-16T01:16:01.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.240+0000 7f722d453640 1 -- 172.21.15.81:0/202776582 --> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7208002dd0 con 0x7f7214075a80 2024-09-16T01:16:01.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7fec2cff9640 1 -- 172.21.15.81:0/2260185143 <== osd.1 v2:172.21.15.81:6800/1559362497 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fec10002dd0 con 0x7fec14076980 2024-09-16T01:16:01.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] conn(0x7ff284075b60 msgr2=0x7ff284077fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7ff2a6b5b640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] conn(0x7ff284075b60 0x7ff284077fa0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7f09c0ff9640 1 -- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] conn(0x7f09b0075b00 msgr2=0x7f09b0077f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7f09c0ff9640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] conn(0x7f09b0075b00 0x7f09b0077f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff28406c4e0 msgr2=0x7ff28406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7ff2a6b5b640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff28406c4e0 0x7ff28406e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0075ea0 tx=0x7ff2a006d000 comp rx=0 tx=0).stop 2024-09-16T01:16:01.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7f09c0ff9640 1 -- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f09b006c380 msgr2=0x7f09b006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7f09c0ff9640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f09b006c380 0x7f09b006e840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f09c80011e0 tx=0x7f09c8007d30 comp rx=0 tx=0).stop 2024-09-16T01:16:01.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7fec35482640 1 -- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] conn(0x7fec14076980 msgr2=0x7fec14078e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7f720f7fe640 1 -- 172.21.15.81:0/202776582 <== osd.6 v2:172.21.15.102:6824/136250174 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7208002dd0 con 0x7f7214075a80 2024-09-16T01:16:01.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7f09c0ff9640 1 -- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09c4053780 msgr2=0x7f09c4188250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7f09c0ff9640 1 --2- 172.21.15.81:0/2805520573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09c4053780 0x7f09c4188250 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f09cc076eb0 tx=0x7f09cc0699e0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff29804a630 msgr2=0x7ff2981863a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7ff2a6b5b640 1 --2- 172.21.15.81:0/1285867929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff29804a630 0x7ff2981863a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff29000b390 tx=0x7ff29000b850 comp rx=0 tx=0).stop 2024-09-16T01:16:01.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7ff2a635a640 1 -- 172.21.15.81:0/1285867929 reap_dead start 2024-09-16T01:16:01.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 shutdown_connections 2024-09-16T01:16:01.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 >> 172.21.15.81:0/1285867929 conn(0x7ff29801e180 msgr2=0x7ff298006f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f722d453640 1 -- 172.21.15.81:0/202776582 >> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] conn(0x7f7214075a80 msgr2=0x7f7214077ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f722d453640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] conn(0x7f7214075a80 0x7f7214077ec0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f09d2923640 1 -- 172.21.15.81:0/2805520573 reap_dead start 2024-09-16T01:16:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f09c0ff9640 1 -- 172.21.15.81:0/2805520573 shutdown_connections 2024-09-16T01:16:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f09c0ff9640 1 -- 172.21.15.81:0/2805520573 >> 172.21.15.81:0/2805520573 conn(0x7f09c403a510 msgr2=0x7f09c403bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7fec35482640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] conn(0x7fec14076980 0x7fec14078e20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7fec35482640 1 -- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fec1406c6b0 msgr2=0x7fec1406eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7fec35482640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fec1406c6b0 0x7fec1406eb70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fec1c034000 tx=0x7fec1c02e000 comp rx=0 tx=0).stop 2024-09-16T01:16:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7fec35482640 1 -- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec28035980 msgr2=0x7fec2804c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7fec35482640 1 --2- 172.21.15.81:0/2260185143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec28035980 0x7fec2804c7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fec2400c450 tx=0x7fec2400c910 comp rx=0 tx=0).stop 2024-09-16T01:16:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.241+0000 7fec34c81640 1 -- 172.21.15.81:0/2260185143 reap_dead start 2024-09-16T01:16:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7fec35482640 1 -- 172.21.15.81:0/2260185143 shutdown_connections 2024-09-16T01:16:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7fec35482640 1 -- 172.21.15.81:0/2260185143 >> 172.21.15.81:0/2260185143 conn(0x7fec2801ea30 msgr2=0x7fec2803a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f722d453640 1 -- 172.21.15.81:0/202776582 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f721406c300 msgr2=0x7f721406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7fec35482640 1 -- 172.21.15.81:0/2260185143 shutdown_connections 2024-09-16T01:16:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f09c0ff9640 1 -- 172.21.15.81:0/2805520573 shutdown_connections 2024-09-16T01:16:01.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7fec35482640 1 -- 172.21.15.81:0/2260185143 wait complete. 2024-09-16T01:16:01.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f09c0ff9640 1 -- 172.21.15.81:0/2805520573 wait complete. 2024-09-16T01:16:01.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 shutdown_connections 2024-09-16T01:16:01.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f722d453640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f721406c300 0x7f721406e7c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7218006fd0 tx=0x7f7218008040 comp rx=0 tx=0).stop 2024-09-16T01:16:01.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f722d453640 1 -- 172.21.15.81:0/202776582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7228147230 msgr2=0x7f722815de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f722d453640 1 --2- 172.21.15.81:0/202776582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7228147230 0x7f722815de90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f721c031000 tx=0x7f721c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f72277fe640 1 -- 172.21.15.81:0/202776582 reap_dead start 2024-09-16T01:16:01.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f722d453640 1 -- 172.21.15.81:0/202776582 shutdown_connections 2024-09-16T01:16:01.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f722d453640 1 -- 172.21.15.81:0/202776582 >> 172.21.15.81:0/202776582 conn(0x7f7228067d70 msgr2=0x7f72281e7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7ff2a6b5b640 1 -- 172.21.15.81:0/1285867929 wait complete. 2024-09-16T01:16:01.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f722d453640 1 -- 172.21.15.81:0/202776582 shutdown_connections 2024-09-16T01:16:01.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.242+0000 7f722d453640 1 -- 172.21.15.81:0/202776582 wait complete. 2024-09-16T01:16:01.305 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:01.305 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:01.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T01:16:01.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T01:16:01.307 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-16T01:16:01.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T01:16:01.308 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:01.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T01:16:01.309 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:01.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T01:16:01.310 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:01.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T01:16:01.311 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-16T01:16:01.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T01:16:01.312 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:01.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T01:16:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.511+0000 7f76b1a6e640 1 Processor -- start 2024-09-16T01:16:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.511+0000 7f76b1a6e640 1 -- start start 2024-09-16T01:16:01.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7f76b1a6e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f76a4034c40 0x7f76a4035b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7f76b1a6e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a4052090 con 0x7f76a4036090 2024-09-16T01:16:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7f76b1a6e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a4052370 con 0x7f76a4048dc0 2024-09-16T01:16:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7f76b1a6e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f76a4052650 con 0x7f76a4034c40 2024-09-16T01:16:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7f76abfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f76a4036090 0x7f76a40486b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42346/0 (socket says 172.21.15.81:42346) 2024-09-16T01:16:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7f76abfff640 1 -- 172.21.15.81:0/3993457146 learned_addr learned my addr 172.21.15.81:0/3993457146 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.514+0000 7f76b0a6c640 1 --2- 172.21.15.81:0/3993457146 >> v2:172.21.15.102:3300/0 conn(0x7f76a4034c40 0x7f76a4035b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.514+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989973809 0 0) 0x7f76a4052090 con 0x7f76a4036090 2024-09-16T01:16:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.514+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f769c003520 con 0x7f76a4036090 2024-09-16T01:16:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.512+0000 7fa6ce3d6640 1 Processor -- start 2024-09-16T01:16:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.512+0000 7fa6ce3d6640 1 -- start start 2024-09-16T01:16:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7fa6ce3d6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6c00e6f70 0x7fa6c0034d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7fa6cc973640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa6c0049780 0x7fa6c0007790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42352/0 (socket says 172.21.15.81:42352) 2024-09-16T01:16:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7fa6cc973640 1 -- 172.21.15.81:0/2917841924 learned_addr learned my addr 172.21.15.81:0/2917841924 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7fa6c7fff640 1 --2- 172.21.15.81:0/2917841924 >> v2:172.21.15.81:3300/0 conn(0x7fa6c00e6f70 0x7fa6c0034d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2917841924 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c0033c80 con 0x7fa6c0049780 2024-09-16T01:16:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2917841924 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c0033f60 con 0x7fa6c0035d90 2024-09-16T01:16:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.513+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2917841924 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa6c0034240 con 0x7fa6c00e6f70 2024-09-16T01:16:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.514+0000 7fda4628f640 1 Processor -- start 2024-09-16T01:16:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.514+0000 7fda4628f640 1 -- start start 2024-09-16T01:16:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.514+0000 7fa6c6ffd640 1 -- 172.21.15.81:0/2917841924 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2599678392 0 0) 0x7fa6c0033c80 con 0x7fa6c0049780 2024-09-16T01:16:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.514+0000 7fa6c6ffd640 1 -- 172.21.15.81:0/2917841924 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6b8003520 con 0x7fa6c0049780 2024-09-16T01:16:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.514+0000 7fa6c7fff640 1 -- 172.21.15.81:0/2917841924 >> v1:172.21.15.102:6789/0 conn(0x7fa6c0035d90 legacy=0x7fa6c00333a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:16:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.514+0000 7fa6c7fff640 1 -- 172.21.15.81:0/2917841924 >> v1:172.21.15.81:6789/0 conn(0x7fa6c0049780 legacy=0x7fa6c0007790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.514+0000 7fa6c7fff640 1 -- 172.21.15.81:0/2917841924 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c0034520 con 0x7fa6c00e6f70 2024-09-16T01:16:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1377687905 0 0) 0x7f769c003520 con 0x7f76a4036090 2024-09-16T01:16:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 >> v2:172.21.15.102:3300/0 conn(0x7f76a4034c40 msgr2=0x7f76a4035b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 --2- 172.21.15.81:0/3993457146 >> v2:172.21.15.102:3300/0 conn(0x7f76a4034c40 0x7f76a4035b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 >> v1:172.21.15.102:6789/0 conn(0x7f76a4048dc0 legacy=0x7f76a4053a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a4052930 con 0x7f76a4036090 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f7698001670 con 0x7f76a4036090 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 >> v1:172.21.15.81:6789/0 conn(0x7f76a4036090 legacy=0x7f76a40486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f769c0039b0 0x7f769c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f769c004800 0x7f769c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f769c0051c0 0x7f769c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76a4052650 con 0x7f769c004800 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f769c00c0f0 con 0x7f769c0039b0 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f769c00c2f0 con 0x7f769c0051c0 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76b126d640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f769c0051c0 0x7f769c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76b0a6c640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f769c0039b0 0x7f769c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7f76abfff640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f769c004800 0x7f769c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7fda4628f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fda380e2fe0 0x7fda3803a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.515+0000 7fda4628f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda38036a00 0x7fda38007730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f76abfff640 1 -- 172.21.15.81:0/3993457146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f769c0051c0 msgr2=0x7f769c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f76abfff640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f769c0051c0 0x7f769c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f76abfff640 1 -- 172.21.15.81:0/3993457146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f769c0039b0 msgr2=0x7f769c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f76abfff640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f769c0039b0 0x7f769c003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f76abfff640 1 -- 172.21.15.81:0/3993457146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a4052930 con 0x7f769c004800 2024-09-16T01:16:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f76b126d640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f769c0051c0 0x7f769c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:16:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f76b126d640 1 -- 172.21.15.81:0/3993457146 reap_dead start 2024-09-16T01:16:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fda4628f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda380542c0 con 0x7fda380345e0 2024-09-16T01:16:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fda4628f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fda38036f00 con 0x7fda380e2fe0 2024-09-16T01:16:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fda4628f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fda38008ab0 con 0x7fda38036a00 2024-09-16T01:16:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fda44a8c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fda380345e0 0x7fda3803a8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:33810/0 (socket says 172.21.15.81:33810) 2024-09-16T01:16:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fda44a8c640 1 -- 172.21.15.81:0/2408569550 learned_addr learned my addr 172.21.15.81:0/2408569550 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:01.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fda45a8e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda38036a00 0x7fda38007730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f65af931640 1 Processor -- start 2024-09-16T01:16:01.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f6c1b59e640 1 Processor -- start 2024-09-16T01:16:01.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f76b0a6c640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f769c0039b0 0x7f769c003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:16:01.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fda4528d640 1 --2- 172.21.15.81:0/2408569550 >> v2:172.21.15.102:3300/0 conn(0x7fda380e2fe0 0x7fda3803a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fda45a8e640 1 -- 172.21.15.81:0/2408569550 >> v2:172.21.15.102:3300/0 conn(0x7fda380e2fe0 msgr2=0x7fda3803a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f1f7359e640 1 Processor -- start 2024-09-16T01:16:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f1f7359e640 1 -- start start 2024-09-16T01:16:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f6c1b59e640 1 -- start start 2024-09-16T01:16:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fa6c7fff640 1 --2- 172.21.15.81:0/2917841924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c00e6f70 0x7fa6c0034d20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009790 tx=0x7fa6bc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b5a3726325e414 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fa6c6ffd640 1 -- 172.21.15.81:0/2917841924 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc037070 con 0x7fa6c00e6f70 2024-09-16T01:16:01.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fa6c6ffd640 1 -- 172.21.15.81:0/2917841924 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6bc032440 con 0x7fa6c00e6f70 2024-09-16T01:16:01.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fda45a8e640 1 --2- 172.21.15.81:0/2408569550 >> v2:172.21.15.102:3300/0 conn(0x7fda380e2fe0 0x7fda3803a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fa6c6ffd640 1 -- 172.21.15.81:0/2917841924 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc037070 con 0x7fa6c00e6f70 2024-09-16T01:16:01.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fda45a8e640 1 -- 172.21.15.81:0/2408569550 >> v1:172.21.15.102:6789/0 conn(0x7fda380345e0 legacy=0x7fda3803a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7fda45a8e640 1 -- 172.21.15.81:0/2408569550 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda380350b0 con 0x7fda38036a00 2024-09-16T01:16:01.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.517+0000 7fda4528d640 1 --2- 172.21.15.81:0/2408569550 >> v2:172.21.15.102:3300/0 conn(0x7fda380e2fe0 0x7fda3803a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:01.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f7304e65640 1 Processor -- start 2024-09-16T01:16:01.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f7304e65640 1 -- start start 2024-09-16T01:16:01.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.517+0000 7f76abfff640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f769c004800 0x7f769c004c80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f769800c5a0 tx=0x7f769c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f51d62c4e6a078 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.516+0000 7f65af931640 1 -- start start 2024-09-16T01:16:01.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.517+0000 7f65af931640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f65a815e710 0x7f65a80d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.517+0000 7f65af931640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65a80cfb60 0x7f65a80cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.517+0000 7f65acecc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65a80cfb60 0x7f65a80cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.517+0000 7f65acecc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f65a80cfb60 0x7f65a80cff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41398/0 (socket says 172.21.15.81:41398) 2024-09-16T01:16:01.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.517+0000 7f65ad6cd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f65a815e710 0x7f65a80d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f65ad6cd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f65a815e710 0x7f65a80d31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:35728/0 (socket says 172.21.15.81:35728) 2024-09-16T01:16:01.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.517+0000 7f6c1b59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6c1c1627e0 0x7f6c1c0b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f65acecc640 1 -- 172.21.15.81:0/1182453875 learned_addr learned my addr 172.21.15.81:0/1182453875 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f6c1b59e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6c1c0b3e10 0x7f6c1c072580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f65af931640 1 -- 172.21.15.81:0/1182453875 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a80d2170 con 0x7f65a80b6010 2024-09-16T01:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f6c1b59e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1c0b4430 con 0x7f6c1c072130 2024-09-16T01:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f65af931640 1 -- 172.21.15.81:0/1182453875 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f65a80d2d20 con 0x7f65a80cfb60 2024-09-16T01:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f65af931640 1 -- 172.21.15.81:0/1182453875 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f65a80d04b0 con 0x7f65a815e710 2024-09-16T01:16:01.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f6c1b59e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1c072ac0 con 0x7f6c1c1627e0 2024-09-16T01:16:01.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.517+0000 7fda45a8e640 1 --2- 172.21.15.81:0/2408569550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda38036a00 0x7fda38007730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda4006a6a0 tx=0x7fda400a6050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc01b355b745a6e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f6c1b59e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1c0b5090 con 0x7f6c1c0b3e10 2024-09-16T01:16:01.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7fda37fff640 1 -- 172.21.15.81:0/2408569550 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda400b3070 con 0x7fda38036a00 2024-09-16T01:16:01.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7fda37fff640 1 -- 172.21.15.81:0/2408569550 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda400ae440 con 0x7fda38036a00 2024-09-16T01:16:01.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7fda37fff640 1 -- 172.21.15.81:0/2408569550 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda400b3070 con 0x7fda38036a00 2024-09-16T01:16:01.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f1f7359e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1f740d0dd0 0x7f1f740d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f1f7359e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f7415e660 0x7f1f7406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f1f7359e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f740cf000 con 0x7f1f740d1f90 2024-09-16T01:16:01.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f1f7359e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1f740b37d0 con 0x7f1f740d0dd0 2024-09-16T01:16:01.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f1f7359e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1f740cf330 con 0x7f1f7415e660 2024-09-16T01:16:01.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f6c1ad9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6c1c0b3e10 0x7f6c1c072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2917841924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c00e6f70 msgr2=0x7fa6c0034d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7fa6ce3d6640 1 --2- 172.21.15.81:0/2917841924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c00e6f70 0x7fa6c0034d20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009790 tx=0x7fa6bc02a1c0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f1f72d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1f740d1f90 0x7f1f740cf7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42372/0 (socket says 172.21.15.81:42372) 2024-09-16T01:16:01.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f7304e65640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72f800bb70 0x7f72f80dec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f7304e65640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f72f80323c0 0x7f72f8006500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f7304e65640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f801c5c0 con 0x7f72f8052350 2024-09-16T01:16:01.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f7304e65640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f72f801c830 con 0x7f72f800bb70 2024-09-16T01:16:01.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f7304e65640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f72f801cb10 con 0x7f72f80323c0 2024-09-16T01:16:01.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f1f72d9d640 1 -- 172.21.15.81:0/1588728053 learned_addr learned my addr 172.21.15.81:0/1588728053 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:01.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2917841924 shutdown_connections 2024-09-16T01:16:01.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7fa6ce3d6640 1 --2- 172.21.15.81:0/2917841924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c00e6f70 0x7fa6c0034d20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2917841924 >> 172.21.15.81:0/2917841924 conn(0x7fa6c001fb40 msgr2=0x7fa6c00567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932280995 0 0) 0x7f65a80d2170 con 0x7f65a80b6010 2024-09-16T01:16:01.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6594003520 con 0x7f65a80b6010 2024-09-16T01:16:01.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f72fdd9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f72f80323c0 0x7f72f8006500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f1f7259c640 1 --2- 172.21.15.81:0/1588728053 >> v2:172.21.15.102:3300/0 conn(0x7f1f740d0dd0 0x7f1f740d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f72fdd9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f72f80323c0 0x7f72f8006500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:35746/0 (socket says 172.21.15.81:35746) 2024-09-16T01:16:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f6c1ad9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6c1c0b3e10 0x7f6c1c072580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:45002/0 (socket says 172.21.15.81:45002) 2024-09-16T01:16:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f6c1ad9d640 1 -- 172.21.15.81:0/3940583407 learned_addr learned my addr 172.21.15.81:0/3940583407 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f6c1a59c640 1 --2- 172.21.15.81:0/3940583407 >> v2:172.21.15.81:3300/0 conn(0x7f6c1c1627e0 0x7f6c1c0b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f72fed9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f72f8052350 0x7f72f8009af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:33822/0 (socket says 172.21.15.81:33822) 2024-09-16T01:16:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f72fed9d640 1 -- 172.21.15.81:0/4033347884 learned_addr learned my addr 172.21.15.81:0/4033347884 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:01.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f1f71d9b640 1 --2- 172.21.15.81:0/1588728053 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f7415e660 0x7f1f7406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2574233633 0 0) 0x7f6594003520 con 0x7f65a80b6010 2024-09-16T01:16:01.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 >> v2:172.21.15.102:3300/0 conn(0x7f65a815e710 msgr2=0x7f65a80d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f659ffff640 1 --2- 172.21.15.81:0/1182453875 >> v2:172.21.15.102:3300/0 conn(0x7f65a815e710 0x7f65a80d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 >> v2:172.21.15.81:3300/0 conn(0x7f65a80cfb60 msgr2=0x7f65a80cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2917841924 shutdown_connections 2024-09-16T01:16:01.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f659ffff640 1 --2- 172.21.15.81:0/1182453875 >> v2:172.21.15.81:3300/0 conn(0x7f65a80cfb60 0x7f65a80cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a80d2410 con 0x7f65a80b6010 2024-09-16T01:16:01.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.518+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f65a00019f0 con 0x7f65a80b6010 2024-09-16T01:16:01.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 >> v1:172.21.15.102:6789/0 conn(0x7f65a80b6010 legacy=0x7f65a806ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f659ffff640 1 --2- 172.21.15.81:0/1182453875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6594003a00 0x7f6594003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f659ffff640 1 --2- 172.21.15.81:0/1182453875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004800 0x7f6594004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f659ffff640 1 --2- 172.21.15.81:0/1182453875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65940051c0 0x7f659400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65a80d2d20 con 0x7f6594004800 2024-09-16T01:16:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f65a80d04b0 con 0x7f65940051c0 2024-09-16T01:16:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f659400bfb0 con 0x7f6594003a00 2024-09-16T01:16:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f1f7259c640 1 -- 172.21.15.81:0/1588728053 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f7415e660 msgr2=0x7f1f7406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f1f7259c640 1 --2- 172.21.15.81:0/1588728053 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f7415e660 0x7f1f7406ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f1f7259c640 1 -- 172.21.15.81:0/1588728053 >> v1:172.21.15.81:6789/0 conn(0x7f1f740d1f90 legacy=0x7f1f740cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f1f7259c640 1 -- 172.21.15.81:0/1588728053 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f740d16f0 con 0x7f1f740d0dd0 2024-09-16T01:16:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f72fe59c640 1 --2- 172.21.15.81:0/4033347884 >> v2:172.21.15.81:3300/0 conn(0x7f72f800bb70 0x7f72f80dec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f6c1a59c640 1 -- 172.21.15.81:0/3940583407 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6c1c0b3e10 msgr2=0x7f6c1c072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f6c1a59c640 1 --2- 172.21.15.81:0/3940583407 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6c1c0b3e10 0x7f6c1c072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f6c1a59c640 1 -- 172.21.15.81:0/3940583407 >> v1:172.21.15.81:6789/0 conn(0x7f6c1c072130 legacy=0x7f6c1c0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f6c1a59c640 1 -- 172.21.15.81:0/3940583407 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c0b52e0 con 0x7f6c1c1627e0 2024-09-16T01:16:01.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f72fdd9b640 1 -- 172.21.15.81:0/4033347884 >> v2:172.21.15.81:3300/0 conn(0x7f72f800bb70 msgr2=0x7f72f80dec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f72fdd9b640 1 --2- 172.21.15.81:0/4033347884 >> v2:172.21.15.81:3300/0 conn(0x7f72f800bb70 0x7f72f80dec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f72fdd9b640 1 -- 172.21.15.81:0/4033347884 >> v1:172.21.15.102:6789/0 conn(0x7f72f8052350 legacy=0x7f72f8009af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7698032020 con 0x7f769c004800 2024-09-16T01:16:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7698005b10 con 0x7f769c004800 2024-09-16T01:16:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f76ab7fe640 1 -- 172.21.15.81:0/3993457146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7698007d50 con 0x7f769c004800 2024-09-16T01:16:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f72fdd9b640 1 -- 172.21.15.81:0/4033347884 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f801cdf0 con 0x7f72f80323c0 2024-09-16T01:16:01.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f65adece640 1 --2- 172.21.15.81:0/1182453875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65940051c0 0x7f659400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7fda4628f640 1 -- 172.21.15.81:0/2408569550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda38036a00 msgr2=0x7fda38007730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7fda4628f640 1 --2- 172.21.15.81:0/2408569550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda38036a00 0x7fda38007730 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda4006a6a0 tx=0x7fda400a6050 comp rx=0 tx=0).stop 2024-09-16T01:16:01.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f65acecc640 1 --2- 172.21.15.81:0/1182453875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004800 0x7f6594004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7f65ad6cd640 1 --2- 172.21.15.81:0/1182453875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6594003a00 0x7f6594003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.519+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2917841924 wait complete. 2024-09-16T01:16:01.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7fda4628f640 1 -- 172.21.15.81:0/2408569550 shutdown_connections 2024-09-16T01:16:01.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7fda4628f640 1 --2- 172.21.15.81:0/2408569550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda38036a00 0x7fda38007730 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7fda4628f640 1 --2- 172.21.15.81:0/2408569550 >> v2:172.21.15.102:3300/0 conn(0x7fda380e2fe0 0x7fda3803a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7fda4628f640 1 -- 172.21.15.81:0/2408569550 >> 172.21.15.81:0/2408569550 conn(0x7fda3801ea40 msgr2=0x7fda380556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7fda4628f640 1 -- 172.21.15.81:0/2408569550 shutdown_connections 2024-09-16T01:16:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f1f7259c640 1 --2- 172.21.15.81:0/1588728053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f740d0dd0 0x7f1f740d11b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1f640097a0 tx=0x7f1f6402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a81f70442f8bf94c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7fda4628f640 1 -- 172.21.15.81:0/2408569550 wait complete. 2024-09-16T01:16:01.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f65acecc640 1 -- 172.21.15.81:0/1182453875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6594003a00 msgr2=0x7f6594003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f65acecc640 1 --2- 172.21.15.81:0/1182453875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6594003a00 0x7f6594003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f65acecc640 1 -- 172.21.15.81:0/1182453875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65940051c0 msgr2=0x7f659400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f65acecc640 1 --2- 172.21.15.81:0/1182453875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65940051c0 0x7f659400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f65acecc640 1 -- 172.21.15.81:0/1182453875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6594003520 con 0x7f6594004800 2024-09-16T01:16:01.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f76b1a6e640 1 -- 172.21.15.81:0/3993457146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f769c004800 msgr2=0x7f769c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f76b1a6e640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f769c004800 0x7f769c004c80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f769800c5a0 tx=0x7f769c005830 comp rx=0 tx=0).stop 2024-09-16T01:16:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f76b1a6e640 1 -- 172.21.15.81:0/3993457146 shutdown_connections 2024-09-16T01:16:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f76b1a6e640 1 --2- 172.21.15.81:0/3993457146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f769c004800 0x7f769c004c80 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f769800c5a0 tx=0x7f769c005830 comp rx=0 tx=0).stop 2024-09-16T01:16:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f76b1a6e640 1 -- 172.21.15.81:0/3993457146 >> 172.21.15.81:0/3993457146 conn(0x7f76a401ea40 msgr2=0x7f76a40556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f1f7159a640 1 -- 172.21.15.81:0/1588728053 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64037070 con 0x7f1f740d0dd0 2024-09-16T01:16:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f1f7159a640 1 -- 172.21.15.81:0/1588728053 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f64032440 con 0x7f1f740d0dd0 2024-09-16T01:16:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f6c1a59c640 1 --2- 172.21.15.81:0/3940583407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c1627e0 0x7f6c1c0b5dc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c06f820 tx=0x7f6c0c02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7cbf692602b1ec server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f72fdd9b640 1 --2- 172.21.15.81:0/4033347884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72f80323c0 0x7f72f8006500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f72f8008080 tx=0x7f72f002a010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8ccb043e9612e87 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f76b1a6e640 1 -- 172.21.15.81:0/3993457146 shutdown_connections 2024-09-16T01:16:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f1f7159a640 1 -- 172.21.15.81:0/1588728053 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64032810 con 0x7f1f740d0dd0 2024-09-16T01:16:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f04308f1640 1 Processor -- start 2024-09-16T01:16:01.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f6c1959a640 1 -- 172.21.15.81:0/3940583407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c037070 con 0x7f6c1c1627e0 2024-09-16T01:16:01.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f76b1a6e640 1 -- 172.21.15.81:0/3993457146 wait complete. 2024-09-16T01:16:01.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f6c1959a640 1 -- 172.21.15.81:0/3940583407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c02ad90 con 0x7f6c1c1627e0 2024-09-16T01:16:01.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f6c1959a640 1 -- 172.21.15.81:0/3940583407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c032660 con 0x7f6c1c1627e0 2024-09-16T01:16:01.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.520+0000 7f65adece640 1 -- 172.21.15.81:0/1182453875 reap_dead start 2024-09-16T01:16:01.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7fa6ce3d6640 1 Processor -- start 2024-09-16T01:16:01.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f65acecc640 1 --2- 172.21.15.81:0/1182453875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004800 0x7f6594004c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6598009b50 tx=0x7f6594005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253b526d1e5443ff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f04308f1640 1 -- start start 2024-09-16T01:16:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f72fd59a640 1 -- 172.21.15.81:0/4033347884 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0037070 con 0x7f72f80323c0 2024-09-16T01:16:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f1f7359e640 1 -- 172.21.15.81:0/1588728053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f740d0dd0 msgr2=0x7f1f740d11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f72fd59a640 1 -- 172.21.15.81:0/4033347884 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f002aca0 con 0x7f72f80323c0 2024-09-16T01:16:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f72fd59a640 1 -- 172.21.15.81:0/4033347884 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0032660 con 0x7f72f80323c0 2024-09-16T01:16:01.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7f1f7359e640 1 --2- 172.21.15.81:0/1588728053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f740d0dd0 0x7f1f740d11b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1f640097a0 tx=0x7f1f6402a180 comp rx=0 tx=0).stop 2024-09-16T01:16:01.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598036070 con 0x7f6594004800 2024-09-16T01:16:01.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6598005990 con 0x7f6594004800 2024-09-16T01:16:01.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f659ffff640 1 -- 172.21.15.81:0/1182453875 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598009720 con 0x7f6594004800 2024-09-16T01:16:01.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f1f7359e640 1 -- 172.21.15.81:0/1588728053 shutdown_connections 2024-09-16T01:16:01.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f1f7359e640 1 --2- 172.21.15.81:0/1588728053 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f7415e660 0x7f1f7406ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f1f7359e640 1 --2- 172.21.15.81:0/1588728053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f740d0dd0 0x7f1f740d11b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f1f7359e640 1 -- 172.21.15.81:0/1588728053 >> 172.21.15.81:0/1588728053 conn(0x7f1f7408bfc0 msgr2=0x7f1f740d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f6c1b59e640 1 -- 172.21.15.81:0/3940583407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c1627e0 msgr2=0x7f6c1c0b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f1f7359e640 1 -- 172.21.15.81:0/1588728053 shutdown_connections 2024-09-16T01:16:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f6c1b59e640 1 --2- 172.21.15.81:0/3940583407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c1627e0 0x7f6c1c0b5dc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c06f820 tx=0x7f6c0c02a080 comp rx=0 tx=0).stop 2024-09-16T01:16:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7fda4628f640 1 Processor -- start 2024-09-16T01:16:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7fda4628f640 1 -- start start 2024-09-16T01:16:01.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f1f7359e640 1 -- 172.21.15.81:0/1588728053 wait complete. 2024-09-16T01:16:01.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.521+0000 7fa6ce3d6640 1 -- start start 2024-09-16T01:16:01.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7fa6ce3d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c0035d90 0x7fa6c00e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f7304e65640 1 -- 172.21.15.81:0/4033347884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72f80323c0 msgr2=0x7f72f8006500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f04308f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f042c162ad0 0x7f042c0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f04308f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f042c0b49a0 con 0x7f042c06f6f0 2024-09-16T01:16:01.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f04308f1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f042c0afa20 con 0x7f042c0720b0 2024-09-16T01:16:01.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.522+0000 7f04308f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f042c0afce0 con 0x7f042c162ad0 2024-09-16T01:16:01.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f7304e65640 1 --2- 172.21.15.81:0/4033347884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72f80323c0 0x7f72f8006500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f72f8008080 tx=0x7f72f002a010 comp rx=0 tx=0).stop 2024-09-16T01:16:01.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f65af931640 1 -- 172.21.15.81:0/1182453875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004800 msgr2=0x7f6594004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f65af931640 1 --2- 172.21.15.81:0/1182453875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004800 0x7f6594004c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6598009b50 tx=0x7f6594005830 comp rx=0 tx=0).stop 2024-09-16T01:16:01.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f6c1b59e640 1 -- 172.21.15.81:0/3940583407 shutdown_connections 2024-09-16T01:16:01.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f6c1b59e640 1 --2- 172.21.15.81:0/3940583407 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6c1c0b3e10 0x7f6c1c072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f6c1b59e640 1 --2- 172.21.15.81:0/3940583407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c1627e0 0x7f6c1c0b5dc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f76b1a6e640 1 Processor -- start 2024-09-16T01:16:01.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f6c1b59e640 1 -- 172.21.15.81:0/3940583407 >> 172.21.15.81:0/3940583407 conn(0x7f6c1c067d70 msgr2=0x7f6c1c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f042ad9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f042c06f6f0 0x7f042c0b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42384/0 (socket says 172.21.15.81:42384) 2024-09-16T01:16:01.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f042ad9d640 1 -- 172.21.15.81:0/2945890233 learned_addr learned my addr 172.21.15.81:0/2945890233 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f7304e65640 1 -- 172.21.15.81:0/4033347884 shutdown_connections 2024-09-16T01:16:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f7304e65640 1 --2- 172.21.15.81:0/4033347884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72f80323c0 0x7f72f8006500 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f7304e65640 1 --2- 172.21.15.81:0/4033347884 >> v2:172.21.15.81:3300/0 conn(0x7f72f800bb70 0x7f72f80dec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f7304e65640 1 -- 172.21.15.81:0/4033347884 >> 172.21.15.81:0/4033347884 conn(0x7f72f8036090 msgr2=0x7f72f80364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f76b1a6e640 1 -- start start 2024-09-16T01:16:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f65af931640 1 -- 172.21.15.81:0/1182453875 shutdown_connections 2024-09-16T01:16:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f65af931640 1 --2- 172.21.15.81:0/1182453875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004800 0x7f6594004c80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f65af931640 1 -- 172.21.15.81:0/1182453875 >> 172.21.15.81:0/1182453875 conn(0x7f65a808bfc0 msgr2=0x7f65a80d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7fa6c7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c0035d90 0x7fa6c00e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7fa6ce3d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6c0049780 0x7fa6c00e4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7fa6ce3d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6c00e6f70 0x7fa6c00e52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7fa6ce3d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c0049d50 con 0x7fa6c0035d90 2024-09-16T01:16:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7fa6c7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c0035d90 0x7fa6c00e62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41442/0 (socket says 172.21.15.81:41442) 2024-09-16T01:16:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7fa6c7fff640 1 -- 172.21.15.81:0/2213909164 learned_addr learned my addr 172.21.15.81:0/2213909164 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2213909164 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c0049bd0 con 0x7fa6c0049780 2024-09-16T01:16:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2213909164 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c0049ed0 con 0x7fa6c00e6f70 2024-09-16T01:16:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f7304e65640 1 -- 172.21.15.81:0/4033347884 shutdown_connections 2024-09-16T01:16:01.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768649586 0 0) 0x7f042c0b49a0 con 0x7f042c06f6f0 2024-09-16T01:16:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f7304e65640 1 -- 172.21.15.81:0/4033347884 wait complete. 2024-09-16T01:16:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7fa6c77fe640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6c0049780 0x7fa6c00e4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0414003520 con 0x7f042c06f6f0 2024-09-16T01:16:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 105481115 0 0) 0x7f042c0afa20 con 0x7f042c0720b0 2024-09-16T01:16:01.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7fa6cc973640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6c00e6f70 0x7fa6c00e52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7fda4628f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda380345e0 0x7fda38006bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.523+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f042c0b49a0 con 0x7f042c0720b0 2024-09-16T01:16:01.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4628f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda38036a00 0x7fda38049190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4628f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda380e2fe0 0x7fda38051d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fa6cc973640 1 -- 172.21.15.81:0/2213909164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6c0049780 msgr2=0x7fa6c00e4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fa6cc973640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6c0049780 0x7fa6c00e4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fa6cc973640 1 -- 172.21.15.81:0/2213909164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c0035d90 msgr2=0x7fa6c00e62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fa6cc973640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c0035d90 0x7fa6c00e62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fa6cc973640 1 -- 172.21.15.81:0/2213909164 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c004d590 con 0x7fa6c00e6f70 2024-09-16T01:16:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fa6c77fe640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6c0049780 0x7fa6c00e4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:16:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f1f7359e640 1 Processor -- start 2024-09-16T01:16:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2009783790 0 0) 0x7f042c0b49a0 con 0x7f042c0720b0 2024-09-16T01:16:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f042c162ad0 msgr2=0x7f042c0cfca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:16:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 --2- 172.21.15.81:0/2945890233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f042c162ad0 0x7f042c0cfca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 >> v1:172.21.15.81:6789/0 conn(0x7f042c06f6f0 legacy=0x7f042c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042c0b34d0 con 0x7f042c0720b0 2024-09-16T01:16:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f041c001670 con 0x7f042c0720b0 2024-09-16T01:16:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 >> v1:172.21.15.102:6789/0 conn(0x7f042c0720b0 legacy=0x7f042c072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 --2- 172.21.15.81:0/2945890233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0414004ba0 0x7f0414004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 --2- 172.21.15.81:0/2945890233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04140037a0 0x7f0414003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 --2- 172.21.15.81:0/2945890233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04140041b0 0x7f041400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f042c0afce0 con 0x7f04140041b0 2024-09-16T01:16:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f041400c140 con 0x7f0414004ba0 2024-09-16T01:16:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f041400c340 con 0x7f04140037a0 2024-09-16T01:16:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042ad9d640 1 --2- 172.21.15.81:0/2945890233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04140041b0 0x7f041400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4628f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda3803afe0 con 0x7fda38036a00 2024-09-16T01:16:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4628f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fda38008f40 con 0x7fda380e2fe0 2024-09-16T01:16:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4628f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fda3803b160 con 0x7fda380345e0 2024-09-16T01:16:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4528d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda380345e0 0x7fda38006bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4528d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda380345e0 0x7fda38006bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:45028/0 (socket says 172.21.15.81:45028) 2024-09-16T01:16:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4528d640 1 -- 172.21.15.81:0/3886580900 learned_addr learned my addr 172.21.15.81:0/3886580900 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda45a8e640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda380e2fe0 0x7fda38051d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4528d640 1 -- 172.21.15.81:0/3886580900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda380e2fe0 msgr2=0x7fda38051d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4528d640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda380e2fe0 0x7fda38051d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda44a8c640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda38036a00 0x7fda38049190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4528d640 1 -- 172.21.15.81:0/3886580900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda38036a00 msgr2=0x7fda38049190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4528d640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda38036a00 0x7fda38049190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda4528d640 1 -- 172.21.15.81:0/3886580900 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3804cd00 con 0x7fda380345e0 2024-09-16T01:16:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fda44a8c640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda38036a00 0x7fda38049190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7fa6cc973640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6c00e6f70 0x7fa6c00e52e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80504d0 tx=0x7fa6c8069620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042a59c640 1 --2- 172.21.15.81:0/2945890233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0414004ba0 0x7f0414004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042ad9d640 1 -- 172.21.15.81:0/2945890233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04140037a0 msgr2=0x7f0414003c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:16:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7fda4528d640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda380345e0 0x7fda38006bc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00c7f0 tx=0x7fda3c00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f6c1b59e640 1 -- 172.21.15.81:0/3940583407 shutdown_connections 2024-09-16T01:16:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f042ad9d640 1 --2- 172.21.15.81:0/2945890233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04140037a0 0x7f0414003c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f042ad9d640 1 -- 172.21.15.81:0/2945890233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0414004ba0 msgr2=0x7f0414004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f042ad9d640 1 --2- 172.21.15.81:0/2945890233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0414004ba0 0x7f0414004fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f042ad9d640 1 -- 172.21.15.81:0/2945890233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042c0b34d0 con 0x7f04140041b0 2024-09-16T01:16:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f76b1a6e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76a417f8e0 0x7f76a417cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f76b1a6e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a417fcc0 0x7f76a417d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f65af931640 1 -- 172.21.15.81:0/1182453875 shutdown_connections 2024-09-16T01:16:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.524+0000 7f1f7359e640 1 -- start start 2024-09-16T01:16:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7fda35ffb640 1 -- 172.21.15.81:0/3886580900 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3c015070 con 0x7fda380345e0 2024-09-16T01:16:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7fda4628f640 1 -- 172.21.15.81:0/3886580900 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3804cfe0 con 0x7fda380345e0 2024-09-16T01:16:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f76b1a6e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76a417dd70 0x7f76a4051090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7fda4628f640 1 -- 172.21.15.81:0/3886580900 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3804d5a0 con 0x7fda380345e0 2024-09-16T01:16:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7fda35ffb640 1 -- 172.21.15.81:0/3886580900 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3c00aa60 con 0x7fda380345e0 2024-09-16T01:16:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7fda35ffb640 1 -- 172.21.15.81:0/3886580900 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3c015070 con 0x7fda380345e0 2024-09-16T01:16:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f7304e65640 1 Processor -- start 2024-09-16T01:16:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f7304e65640 1 -- start start 2024-09-16T01:16:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f6c1b59e640 1 -- 172.21.15.81:0/3940583407 wait complete. 2024-09-16T01:16:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7fa6c4ff9640 1 -- 172.21.15.81:0/2213909164 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8050ea0 con 0x7fa6c00e6f70 2024-09-16T01:16:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f1f7359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f740d0dd0 0x7f1f740caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7fa6c4ff9640 1 -- 172.21.15.81:0/2213909164 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6c8090020 con 0x7fa6c00e6f70 2024-09-16T01:16:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7fa6c4ff9640 1 -- 172.21.15.81:0/2213909164 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8074c20 con 0x7fa6c00e6f70 2024-09-16T01:16:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2213909164 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c004d2b0 con 0x7fa6c00e6f70 2024-09-16T01:16:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2213909164 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c003aad0 con 0x7fa6c00e6f70 2024-09-16T01:16:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f1f7359e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f740d1f90 0x7f1f740b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f042ad9d640 1 --2- 172.21.15.81:0/2945890233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04140041b0 0x7f041400b9c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f042400c2f0 tx=0x7f0414005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16405d835ea9fb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f1f7359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f7415e660 0x7f1f740b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f1f7259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f740d0dd0 0x7f1f740caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f1f7259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f740d0dd0 0x7f1f740caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41468/0 (socket says 172.21.15.81:41468) 2024-09-16T01:16:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f7304e65640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72f800bb70 0x7f72f80d3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424035070 con 0x7f04140041b0 2024-09-16T01:16:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f1f71d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f740d1f90 0x7f1f740b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f7304e65640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72f80323c0 0x7f72f80d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0424007270 con 0x7f04140041b0 2024-09-16T01:16:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f042959a640 1 -- 172.21.15.81:0/2945890233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0424002090 con 0x7f04140041b0 2024-09-16T01:16:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f72fe59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72f800bb70 0x7f72f80d3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.526+0000 7f1f71d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f740d1f90 0x7f1f740b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:45040/0 (socket says 172.21.15.81:45040) 2024-09-16T01:16:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f72fe59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72f800bb70 0x7f72f80d3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:45056/0 (socket says 172.21.15.81:45056) 2024-09-16T01:16:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f65af931640 1 -- 172.21.15.81:0/1182453875 wait complete. 2024-09-16T01:16:01.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f72fe59c640 1 -- 172.21.15.81:0/745631323 learned_addr learned my addr 172.21.15.81:0/745631323 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f72fdd9b640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72f80323c0 0x7f72f80d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f65af931640 1 Processor -- start 2024-09-16T01:16:01.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f7304e65640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f8052350 0x7f72f804f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f76b1a6e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76a4035b50 con 0x7f76a417fcc0 2024-09-16T01:16:01.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f76b126d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76a417dd70 0x7f76a4051090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f76b126d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76a417dd70 0x7f76a4051090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:45032/0 (socket says 172.21.15.81:45032) 2024-09-16T01:16:01.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f76b126d640 1 -- 172.21.15.81:0/303456650 learned_addr learned my addr 172.21.15.81:0/303456650 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f76abfff640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a417fcc0 0x7f76a417d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.525+0000 7f76b0a6c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76a417f8e0 0x7f76a417cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f76b1a6e640 1 -- 172.21.15.81:0/303456650 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f76a4035570 con 0x7f76a417f8e0 2024-09-16T01:16:01.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f76b1a6e640 1 -- 172.21.15.81:0/303456650 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f76a4035cd0 con 0x7f76a417dd70 2024-09-16T01:16:01.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7fa6b27fc640 1 -- 172.21.15.81:0/2213909164 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c0034d20 con 0x7fa6c00e6f70 2024-09-16T01:16:01.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7fda4628f640 1 -- 172.21.15.81:0/3886580900 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda20005290 con 0x7fda380345e0 2024-09-16T01:16:01.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f72fed9d640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f8052350 0x7f72f804f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72f800a200 con 0x7f72f8052350 2024-09-16T01:16:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72f8032980 con 0x7f72f80323c0 2024-09-16T01:16:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f72f800a380 con 0x7f72f800bb70 2024-09-16T01:16:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f1f7359e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f740d2f40 con 0x7f1f740d0dd0 2024-09-16T01:16:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f1f7359e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f740d2c60 con 0x7f1f7415e660 2024-09-16T01:16:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f1f7359e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1f740d3220 con 0x7f1f740d1f90 2024-09-16T01:16:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f1f7259c640 1 -- 172.21.15.81:0/2363384913 learned_addr learned my addr 172.21.15.81:0/2363384913 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f1f72d9d640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f7415e660 0x7f1f740b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f1f7259c640 1 -- 172.21.15.81:0/2363384913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f740d1f90 msgr2=0x7f1f740b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f1f7259c640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f740d1f90 0x7f1f740b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f1f7259c640 1 -- 172.21.15.81:0/2363384913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f7415e660 msgr2=0x7f1f740b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f1f7259c640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f7415e660 0x7f1f740b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f1f7259c640 1 -- 172.21.15.81:0/2363384913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f740b69f0 con 0x7f1f740d0dd0 2024-09-16T01:16:01.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f6c1b59e640 1 Processor -- start 2024-09-16T01:16:01.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f6c1b59e640 1 -- start start 2024-09-16T01:16:01.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f04308f1640 1 -- 172.21.15.81:0/2945890233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04140041b0 msgr2=0x7f041400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f04308f1640 1 --2- 172.21.15.81:0/2945890233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04140041b0 0x7f041400b9c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f042400c2f0 tx=0x7f0414005830 comp rx=0 tx=0).stop 2024-09-16T01:16:01.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f042ad9d640 1 -- 172.21.15.81:0/2945890233 reap_dead start 2024-09-16T01:16:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f1f72d9d640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f7415e660 0x7f1f740b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f72fdd9b640 1 -- 172.21.15.81:0/745631323 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72f800bb70 msgr2=0x7f72f80d3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f72fdd9b640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72f800bb70 0x7f72f80d3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f72fdd9b640 1 -- 172.21.15.81:0/745631323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f8052350 msgr2=0x7f72f804f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f72fdd9b640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f8052350 0x7f72f804f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f72fdd9b640 1 -- 172.21.15.81:0/745631323 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f804cd80 con 0x7f72f80323c0 2024-09-16T01:16:01.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f04308f1640 1 -- 172.21.15.81:0/2945890233 shutdown_connections 2024-09-16T01:16:01.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f04308f1640 1 -- 172.21.15.81:0/2945890233 >> 172.21.15.81:0/2945890233 conn(0x7f042c067d70 msgr2=0x7f042c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.527+0000 7f65af931640 1 -- start start 2024-09-16T01:16:01.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f72fed9d640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f8052350 0x7f72f804f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:16:01.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f65af931640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004800 0x7f65a815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f65af931640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8161910 0x7f65a8200400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f65af931640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65a8160170 0x7f65a80ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f65af931640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65a80d29b0 con 0x7f6594004800 2024-09-16T01:16:01.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f65af931640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f65a80d26d0 con 0x7f65a8160170 2024-09-16T01:16:01.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f65af931640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f65a80cff70 con 0x7f65a8161910 2024-09-16T01:16:01.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f04308f1640 1 -- 172.21.15.81:0/2945890233 shutdown_connections 2024-09-16T01:16:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f65ad6cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004800 0x7f65a815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f65acecc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8161910 0x7f65a8200400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f65acecc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8161910 0x7f65a8200400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:45070/0 (socket says 172.21.15.81:45070) 2024-09-16T01:16:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f65ad6cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004800 0x7f65a815eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41484/0 (socket says 172.21.15.81:41484) 2024-09-16T01:16:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f65acecc640 1 -- 172.21.15.81:0/1383167005 learned_addr learned my addr 172.21.15.81:0/1383167005 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f65adece640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65a8160170 0x7f65a80ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7fa6c4ff9640 1 -- 172.21.15.81:0/2213909164 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa6c806d110 con 0x7fa6c00e6f70 2024-09-16T01:16:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f72fdd9b640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72f80323c0 0x7f72f80d2cf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f72f0031000 tx=0x7f72f00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f1f7259c640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f740d0dd0 0x7f1f740caae0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f640097a0 tx=0x7f1f640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f04308f1640 1 -- 172.21.15.81:0/2945890233 wait complete. 2024-09-16T01:16:01.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.528+0000 7f6c1b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c1c072130 0x7f6c1c1653f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f6c1b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c0b3e10 0x7f6c1c0abd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f65acecc640 1 -- 172.21.15.81:0/1383167005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65a8160170 msgr2=0x7f65a80ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f65acecc640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65a8160170 0x7f65a80ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f65acecc640 1 -- 172.21.15.81:0/1383167005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004800 msgr2=0x7f65a815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f65acecc640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004800 0x7f65a815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f65acecc640 1 -- 172.21.15.81:0/1383167005 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a8200940 con 0x7f65a8161910 2024-09-16T01:16:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f6c1a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c1c072130 0x7f6c1c1653f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f6c1a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c1c072130 0x7f6c1c1653f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:35848/0 (socket says 172.21.15.81:35848) 2024-09-16T01:16:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f6c1a59c640 1 -- 172.21.15.81:0/2848816446 learned_addr learned my addr 172.21.15.81:0/2848816446 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f1f62ffd640 1 -- 172.21.15.81:0/2363384913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f64041070 con 0x7f1f740d0dd0 2024-09-16T01:16:01.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f6c1b59e640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6c1c1627e0 0x7f6c1c155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7fa6c4ff9640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa6ac06c2b0 0x7fa6ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f1f62ffd640 1 -- 172.21.15.81:0/2363384913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6403c870 con 0x7f1f740d0dd0 2024-09-16T01:16:01.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f1f7359e640 1 -- 172.21.15.81:0/2363384913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7414f120 con 0x7f1f740d0dd0 2024-09-16T01:16:01.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f6c19d9b640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c0b3e10 0x7f6c1c0abd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f6c1ad9d640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6c1c1627e0 0x7f6c1c155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f65acecc640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8161910 0x7f65a8200400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6598009c70 tx=0x7f6598004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f1f7359e640 1 -- 172.21.15.81:0/2363384913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f740b6430 con 0x7f1f740d0dd0 2024-09-16T01:16:01.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7fa6c4ff9640 1 -- 172.21.15.81:0/2213909164 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa6c8106b20 con 0x7fa6c00e6f70 2024-09-16T01:16:01.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c0b58a0 con 0x7f6c1c0b3e10 2024-09-16T01:16:01.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7fa6c7fff640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa6ac06c2b0 0x7fa6ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7fda35ffb640 1 -- 172.21.15.81:0/3886580900 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fda3c018070 con 0x7fda380345e0 2024-09-16T01:16:01.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c162bc0 con 0x7f6c1c072130 2024-09-16T01:16:01.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1c0b6300 con 0x7f6c1c1627e0 2024-09-16T01:16:01.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f76b126d640 1 -- 172.21.15.81:0/303456650 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76a417f8e0 msgr2=0x7f76a417cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f76b126d640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76a417f8e0 0x7f76a417cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f76b126d640 1 -- 172.21.15.81:0/303456650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a417fcc0 msgr2=0x7f76a417d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f76b126d640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a417fcc0 0x7f76a417d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f76b126d640 1 -- 172.21.15.81:0/303456650 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a4034040 con 0x7f76a417dd70 2024-09-16T01:16:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7f6c1a59c640 1 -- 172.21.15.81:0/2848816446 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6c1c1627e0 msgr2=0x7f6c1c155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7f6c1a59c640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6c1c1627e0 0x7f6c1c155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7f6c1a59c640 1 -- 172.21.15.81:0/2848816446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c0b3e10 msgr2=0x7f6c1c0abd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f72eeffd640 1 -- 172.21.15.81:0/745631323 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0037050 con 0x7f72f80323c0 2024-09-16T01:16:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f72eeffd640 1 -- 172.21.15.81:0/745631323 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f0038040 con 0x7f72f80323c0 2024-09-16T01:16:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f72eeffd640 1 -- 172.21.15.81:0/745631323 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f0004470 con 0x7f72f80323c0 2024-09-16T01:16:01.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.529+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f804d060 con 0x7f72f80323c0 2024-09-16T01:16:01.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7f04308f1640 1 Processor -- start 2024-09-16T01:16:01.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f804fcd0 con 0x7f72f80323c0 2024-09-16T01:16:01.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7fa6c7fff640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa6ac06c2b0 0x7fa6ac06e770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc035040 tx=0x7fa6bc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7f04308f1640 1 -- start start 2024-09-16T01:16:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7fda35ffb640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fda2406c6b0 0x7fda2406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7fda35ffb640 1 -- 172.21.15.81:0/3886580900 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fda3c00a860 con 0x7fda380345e0 2024-09-16T01:16:01.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7f6c1a59c640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c0b3e10 0x7f6c1c0abd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7f6c1a59c640 1 -- 172.21.15.81:0/2848816446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c0ac6a0 con 0x7f6c1c072130 2024-09-16T01:16:01.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7f6c19d9b640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c0b3e10 0x7f6c1c0abd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:16:01.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.530+0000 7f76b126d640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76a417dd70 0x7f76a4051090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f76ac06a370 tx=0x7f76ac075960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7fda44a8c640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fda2406c6b0 0x7fda2406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f6c1a59c640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c1c072130 0x7f6c1c1653f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009890 tx=0x7f6c0c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f1f62ffd640 1 -- 172.21.15.81:0/2363384913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6404b060 con 0x7f1f740d0dd0 2024-09-16T01:16:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f6c0affd640 1 -- 172.21.15.81:0/2848816446 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c040020 con 0x7f6c1c072130 2024-09-16T01:16:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f6c0affd640 1 -- 172.21.15.81:0/2848816446 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c038040 con 0x7f6c1c072130 2024-09-16T01:16:01.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1c0ac980 con 0x7f6c1c072130 2024-09-16T01:16:01.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f04308f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f042c15b120 0x7f042c0a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f6c0affd640 1 -- 172.21.15.81:0/2848816446 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c037070 con 0x7f6c1c072130 2024-09-16T01:16:01.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f04308f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f042c15b500 0x7f042c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7fda44a8c640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fda2406c6b0 0x7fda2406eb70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda3800bda0 tx=0x7fda30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f04308f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a99d0 0x7f042c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1c0acf40 con 0x7f6c1c072130 2024-09-16T01:16:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f04308f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f042c0b3d70 con 0x7f042c0a99d0 2024-09-16T01:16:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f04308f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f042c0b3a90 con 0x7f042c15b500 2024-09-16T01:16:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.531+0000 7f04308f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f042c0cfca0 con 0x7f042c15b120 2024-09-16T01:16:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f0429d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f042c15b500 0x7f042c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f042a59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f042c15b120 0x7f042c0a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f042a59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f042c15b120 0x7f042c0a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:45102/0 (socket says 172.21.15.81:45102) 2024-09-16T01:16:01.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f042a59c640 1 -- 172.21.15.81:0/1363104975 learned_addr learned my addr 172.21.15.81:0/1363104975 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:01.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f042ad9d640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a99d0 0x7f042c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f042a59c640 1 -- 172.21.15.81:0/1363104975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f042c15b500 msgr2=0x7f042c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f042a59c640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f042c15b500 0x7f042c15ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f042a59c640 1 -- 172.21.15.81:0/1363104975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a99d0 msgr2=0x7f042c15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f042a59c640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a99d0 0x7f042c15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f042a59c640 1 -- 172.21.15.81:0/1363104975 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042c15aa50 con 0x7f042c15b120 2024-09-16T01:16:01.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f042ad9d640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a99d0 0x7f042c15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:01.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f72eeffd640 1 -- 172.21.15.81:0/745631323 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f72f002ab60 con 0x7f72f80323c0 2024-09-16T01:16:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f804e880 con 0x7f72f80323c0 2024-09-16T01:16:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f1f7359e640 1 -- 172.21.15.81:0/2363384913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f740d2440 con 0x7f1f740d0dd0 2024-09-16T01:16:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f042a59c640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f042c15b120 0x7f042c0a9490 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f041c00e880 tx=0x7f041c00ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f72eeffd640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72e006c380 0x7f72e006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.532+0000 7f1f62ffd640 1 -- 172.21.15.81:0/2363384913 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1f64044070 con 0x7f1f740d0dd0 2024-09-16T01:16:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.533+0000 7f72fe59c640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72e006c380 0x7f72e006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.533+0000 7f72eeffd640 1 -- 172.21.15.81:0/745631323 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f72f00abc50 con 0x7f72f80323c0 2024-09-16T01:16:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.533+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1c06cec0 con 0x7f6c1c072130 2024-09-16T01:16:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.533+0000 7f1f62ffd640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f5406c300 0x7f1f5406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.533+0000 7f72fe59c640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72e006c380 0x7f72e006e840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7300069c30 tx=0x7f730008d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.533+0000 7f1f62ffd640 1 -- 172.21.15.81:0/2363384913 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1f640ac470 con 0x7f1f740d0dd0 2024-09-16T01:16:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.533+0000 7f1f71d9b640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f5406c300 0x7f1f5406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.533+0000 7f6c0affd640 1 -- 172.21.15.81:0/2848816446 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6c0c043020 con 0x7f6c1c072130 2024-09-16T01:16:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.534+0000 7f1f71d9b640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f5406c300 0x7f1f5406e7c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1f740d4f10 tx=0x7f1f68009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.534+0000 7f6c0affd640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6bfc06c300 0x7f6bfc06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.534+0000 7f6c0affd640 1 -- 172.21.15.81:0/2848816446 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6c0c0ab810 con 0x7f6c1c072130 2024-09-16T01:16:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.534+0000 7f6c19d9b640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6bfc06c300 0x7f6bfc06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.534+0000 7f6c19d9b640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6bfc06c300 0x7f6bfc06e7c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c165d40 tx=0x7f6c10007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.535+0000 7f659dffb640 1 -- 172.21.15.81:0/1383167005 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598036070 con 0x7f65a8161910 2024-09-16T01:16:01.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.535+0000 7f041affd640 1 -- 172.21.15.81:0/1363104975 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c0052e0 con 0x7f042c15b120 2024-09-16T01:16:01.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.535+0000 7f65af931640 1 -- 172.21.15.81:0/1383167005 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a815f0d0 con 0x7f65a8161910 2024-09-16T01:16:01.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.535+0000 7f04308f1640 1 -- 172.21.15.81:0/1363104975 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f042c15b9d0 con 0x7f042c15b120 2024-09-16T01:16:01.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.535+0000 7fa6c4ff9640 1 -- 172.21.15.81:0/2213909164 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6c809a030 con 0x7fa6c00e6f70 2024-09-16T01:16:01.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.535+0000 7f65af931640 1 -- 172.21.15.81:0/1383167005 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a815f690 con 0x7f65a8161910 2024-09-16T01:16:01.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.535+0000 7f04308f1640 1 -- 172.21.15.81:0/1363104975 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f042c15bf90 con 0x7f042c15b120 2024-09-16T01:16:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.536+0000 7f04308f1640 1 -- 172.21.15.81:0/1363104975 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f042c072490 con 0x7f042c15b120 2024-09-16T01:16:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.537+0000 7f65af931640 1 -- 172.21.15.81:0/1383167005 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a80d31b0 con 0x7f65a8161910 2024-09-16T01:16:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.538+0000 7f1f62ffd640 1 -- 172.21.15.81:0/2363384913 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f6407a250 con 0x7f1f740d0dd0 2024-09-16T01:16:01.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.543+0000 7f72eeffd640 1 -- 172.21.15.81:0/745631323 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72f804e880 con 0x7f72f80323c0 2024-09-16T01:16:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.545+0000 7f76a97fa640 1 -- 172.21.15.81:0/303456650 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac063640 con 0x7f76a417dd70 2024-09-16T01:16:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.545+0000 7f76a97fa640 1 -- 172.21.15.81:0/303456650 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac074d30 con 0x7f76a417dd70 2024-09-16T01:16:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.545+0000 7f76a97fa640 1 -- 172.21.15.81:0/303456650 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac095680 con 0x7f76a417dd70 2024-09-16T01:16:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.545+0000 7f659dffb640 1 -- 172.21.15.81:0/1383167005 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6598041070 con 0x7f65a8161910 2024-09-16T01:16:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.545+0000 7f041affd640 1 -- 172.21.15.81:0/1363104975 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041c018070 con 0x7f042c15b120 2024-09-16T01:16:01.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.545+0000 7f041affd640 1 -- 172.21.15.81:0/1363104975 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041c00c8e0 con 0x7f042c15b120 2024-09-16T01:16:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.545+0000 7f76b1a6e640 1 -- 172.21.15.81:0/303456650 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a417d790 con 0x7f76a417dd70 2024-09-16T01:16:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.545+0000 7f76b1a6e640 1 -- 172.21.15.81:0/303456650 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a404c7b0 con 0x7f76a417dd70 2024-09-16T01:16:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.545+0000 7fda35ffb640 1 -- 172.21.15.81:0/3886580900 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda3c0595f0 con 0x7fda380345e0 2024-09-16T01:16:01.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.546+0000 7f659dffb640 1 -- 172.21.15.81:0/1383167005 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6598005990 con 0x7f65a8161910 2024-09-16T01:16:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.546+0000 7f76b1a6e640 1 -- 172.21.15.81:0/303456650 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f768c005290 con 0x7f76a417dd70 2024-09-16T01:16:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.547+0000 7f659dffb640 1 -- 172.21.15.81:0/1383167005 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6598046460 con 0x7f65a8161910 2024-09-16T01:16:01.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.547+0000 7f041affd640 1 -- 172.21.15.81:0/1363104975 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f041c00ca80 con 0x7f042c15b120 2024-09-16T01:16:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.547+0000 7f659dffb640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f658c06c450 0x7f658c06e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.547+0000 7f659dffb640 1 -- 172.21.15.81:0/1383167005 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f65980ac580 con 0x7f65a8161910 2024-09-16T01:16:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.548+0000 7f65ad6cd640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f658c06c450 0x7f658c06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.548+0000 7f041affd640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f040c06c2b0 0x7f040c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.548+0000 7f041affd640 1 -- 172.21.15.81:0/1363104975 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f041c08c0d0 con 0x7f042c15b120 2024-09-16T01:16:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.548+0000 7f65ad6cd640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f658c06c450 0x7f658c06e910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009ae0 tx=0x7f65a4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.548+0000 7f0429d9b640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f040c06c2b0 0x7f040c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.549+0000 7f0429d9b640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f040c06c2b0 0x7f040c06e770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f042c15b900 tx=0x7f0420008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.552+0000 7f6c0affd640 1 -- 172.21.15.81:0/2848816446 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c0c04a030 con 0x7f6c1c072130 2024-09-16T01:16:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.554+0000 7f659dffb640 1 -- 172.21.15.81:0/1383167005 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f659807a400 con 0x7f65a8161910 2024-09-16T01:16:01.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.558+0000 7f041affd640 1 -- 172.21.15.81:0/1363104975 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f041c05a670 con 0x7f042c15b120 2024-09-16T01:16:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.560+0000 7f76a97fa640 1 -- 172.21.15.81:0/303456650 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f76ac0958e0 con 0x7f76a417dd70 2024-09-16T01:16:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.560+0000 7f76a97fa640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f769006c2b0 0x7f769006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.561+0000 7f76a97fa640 1 -- 172.21.15.81:0/303456650 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f76ac107040 con 0x7f76a417dd70 2024-09-16T01:16:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.561+0000 7f76b0a6c640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f769006c2b0 0x7f769006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.561+0000 7f76b0a6c640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f769006c2b0 0x7f769006e770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f76a4003e80 tx=0x7f76a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:01.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.563+0000 7f76a97fa640 1 -- 172.21.15.81:0/303456650 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76ac09c030 con 0x7f76a417dd70 2024-09-16T01:16:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.892+0000 7fa6b27fc640 1 -- 172.21.15.81:0/2213909164 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa6c0038b30 con 0x7fa6c00e6f70 2024-09-16T01:16:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.893+0000 7fa6c4ff9640 1 -- 172.21.15.81:0/2213909164 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa6c004d590 con 0x7fa6c00e6f70 2024-09-16T01:16:01.896 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-09-16T01:16:01.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.896+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2213909164 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa6ac06c2b0 msgr2=0x7fa6ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.896+0000 7fa6ce3d6640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa6ac06c2b0 0x7fa6ac06e770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc035040 tx=0x7fa6bc02e000 comp rx=0 tx=0).stop 2024-09-16T01:16:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.897+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2213909164 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6c00e6f70 msgr2=0x7fa6c00e52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.897+0000 7fa6ce3d6640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6c00e6f70 0x7fa6c00e52e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80504d0 tx=0x7fa6c8069620 comp rx=0 tx=0).stop 2024-09-16T01:16:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.897+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2213909164 shutdown_connections 2024-09-16T01:16:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.897+0000 7fa6ce3d6640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa6ac06c2b0 0x7fa6ac06e770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.897+0000 7fa6ce3d6640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6c00e6f70 0x7fa6c00e52e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.897+0000 7fa6ce3d6640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6c0049780 0x7fa6c00e4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.897+0000 7fa6ce3d6640 1 --2- 172.21.15.81:0/2213909164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c0035d90 0x7fa6c00e62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.897+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2213909164 >> 172.21.15.81:0/2213909164 conn(0x7fa6c001fb40 msgr2=0x7fa6c000bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.898+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2213909164 shutdown_connections 2024-09-16T01:16:01.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.898+0000 7fa6ce3d6640 1 -- 172.21.15.81:0/2213909164 wait complete. 2024-09-16T01:16:01.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-09-16T01:16:01.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.915+0000 7f1f7359e640 1 -- 172.21.15.81:0/2363384913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1f740d1b20 con 0x7f1f740d0dd0 2024-09-16T01:16:01.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.916+0000 7f1f62ffd640 1 -- 172.21.15.81:0/2363384913 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1f6407e550 con 0x7f1f740d0dd0 2024-09-16T01:16:01.917 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-09-16T01:16:01.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.919+0000 7f1f7359e640 1 -- 172.21.15.81:0/2363384913 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f5406c300 msgr2=0x7f1f5406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.919+0000 7f1f7359e640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f5406c300 0x7f1f5406e7c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1f740d4f10 tx=0x7f1f68009190 comp rx=0 tx=0).stop 2024-09-16T01:16:01.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.919+0000 7f1f7359e640 1 -- 172.21.15.81:0/2363384913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f740d0dd0 msgr2=0x7f1f740caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.919+0000 7f1f7359e640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f740d0dd0 0x7f1f740caae0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f640097a0 tx=0x7f1f640046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.920+0000 7f1f7359e640 1 -- 172.21.15.81:0/2363384913 shutdown_connections 2024-09-16T01:16:01.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.920+0000 7f1f7359e640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f5406c300 0x7f1f5406e7c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.920+0000 7f1f7359e640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f7415e660 0x7f1f740b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.920+0000 7f1f7359e640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f740d1f90 0x7f1f740b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.920+0000 7f1f7359e640 1 --2- 172.21.15.81:0/2363384913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f740d0dd0 0x7f1f740caae0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.920+0000 7f1f7359e640 1 -- 172.21.15.81:0/2363384913 >> 172.21.15.81:0/2363384913 conn(0x7f1f7408bfc0 msgr2=0x7f1f740b71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.920+0000 7f1f7359e640 1 -- 172.21.15.81:0/2363384913 shutdown_connections 2024-09-16T01:16:01.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.920+0000 7f1f7359e640 1 -- 172.21.15.81:0/2363384913 wait complete. 2024-09-16T01:16:01.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-09-16T01:16:01.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.937+0000 7f76b1a6e640 1 -- 172.21.15.81:0/303456650 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f768c005850 con 0x7f76a417dd70 2024-09-16T01:16:01.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.937+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f72f80321a0 con 0x7f72f80323c0 2024-09-16T01:16:01.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.937+0000 7f76a97fa640 1 -- 172.21.15.81:0/303456650 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f76ac0d4e00 con 0x7f76a417dd70 2024-09-16T01:16:01.939 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:01.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.938+0000 7f72eeffd640 1 -- 172.21.15.81:0/745631323 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f72f0079bc0 con 0x7f72f80323c0 2024-09-16T01:16:01.940 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-09-16T01:16:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f76b1a6e640 1 -- 172.21.15.81:0/303456650 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f769006c2b0 msgr2=0x7f769006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f76b1a6e640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f769006c2b0 0x7f769006e770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f76a4003e80 tx=0x7f76a0008040 comp rx=0 tx=0).stop 2024-09-16T01:16:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f76b1a6e640 1 -- 172.21.15.81:0/303456650 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76a417dd70 msgr2=0x7f76a4051090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f76b1a6e640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76a417dd70 0x7f76a4051090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f76ac06a370 tx=0x7f76ac075960 comp rx=0 tx=0).stop 2024-09-16T01:16:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72e006c380 msgr2=0x7f72e006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f7304e65640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72e006c380 0x7f72e006e840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7300069c30 tx=0x7f730008d040 comp rx=0 tx=0).stop 2024-09-16T01:16:01.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72f80323c0 msgr2=0x7f72f80d2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f7304e65640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72f80323c0 0x7f72f80d2cf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f72f0031000 tx=0x7f72f00046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f76b1a6e640 1 -- 172.21.15.81:0/303456650 shutdown_connections 2024-09-16T01:16:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f76b1a6e640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f769006c2b0 0x7f769006e770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f76b1a6e640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76a417dd70 0x7f76a4051090 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f76b1a6e640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a417fcc0 0x7f76a417d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f76b1a6e640 1 --2- 172.21.15.81:0/303456650 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76a417f8e0 0x7f76a417cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f76b1a6e640 1 -- 172.21.15.81:0/303456650 >> 172.21.15.81:0/303456650 conn(0x7f76a401ea40 msgr2=0x7f76a4055c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 shutdown_connections 2024-09-16T01:16:01.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f7304e65640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72e006c380 0x7f72e006e840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f7304e65640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f8052350 0x7f72f804f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f7304e65640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72f80323c0 0x7f72f80d2cf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f7304e65640 1 --2- 172.21.15.81:0/745631323 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72f800bb70 0x7f72f80d3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 >> 172.21.15.81:0/745631323 conn(0x7f72f8036090 msgr2=0x7f72f80d49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f76b1a6e640 1 -- 172.21.15.81:0/303456650 shutdown_connections 2024-09-16T01:16:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 shutdown_connections 2024-09-16T01:16:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f76b1a6e640 1 -- 172.21.15.81:0/303456650 wait complete. 2024-09-16T01:16:01.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.940+0000 7f7304e65640 1 -- 172.21.15.81:0/745631323 wait complete. 2024-09-16T01:16:01.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.945+0000 7fda4628f640 1 -- 172.21.15.81:0/3886580900 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fda20005580 con 0x7fda380345e0 2024-09-16T01:16:01.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.945+0000 7fda35ffb640 1 -- 172.21.15.81:0/3886580900 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fda3c058ef0 con 0x7fda380345e0 2024-09-16T01:16:01.947 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-09-16T01:16:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.949+0000 7fda4628f640 1 -- 172.21.15.81:0/3886580900 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fda2406c6b0 msgr2=0x7fda2406eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.949+0000 7fda4628f640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fda2406c6b0 0x7fda2406eb70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda3800bda0 tx=0x7fda30009040 comp rx=0 tx=0).stop 2024-09-16T01:16:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.949+0000 7fda4628f640 1 -- 172.21.15.81:0/3886580900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda380345e0 msgr2=0x7fda38006bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.949+0000 7fda4628f640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda380345e0 0x7fda38006bc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00c7f0 tx=0x7fda3c00ccb0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.949+0000 7fda4628f640 1 -- 172.21.15.81:0/3886580900 shutdown_connections 2024-09-16T01:16:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.949+0000 7fda4628f640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fda2406c6b0 0x7fda2406eb70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.949+0000 7fda4628f640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fda380e2fe0 0x7fda38051d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.949+0000 7fda4628f640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda38036a00 0x7fda38049190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.949+0000 7fda4628f640 1 --2- 172.21.15.81:0/3886580900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fda380345e0 0x7fda38006bc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.949+0000 7fda4628f640 1 -- 172.21.15.81:0/3886580900 >> 172.21.15.81:0/3886580900 conn(0x7fda3801ea40 msgr2=0x7fda38004f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.949+0000 7fda4628f640 1 -- 172.21.15.81:0/3886580900 shutdown_connections 2024-09-16T01:16:01.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.949+0000 7fda4628f640 1 -- 172.21.15.81:0/3886580900 wait complete. 2024-09-16T01:16:01.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-09-16T01:16:01.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-09-16T01:16:01.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.957+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6c1c166530 con 0x7f6c1c072130 2024-09-16T01:16:01.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.958+0000 7f6c0affd640 1 -- 172.21.15.81:0/2848816446 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c0c079760 con 0x7f6c1c072130 2024-09-16T01:16:01.960 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:01.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.958+0000 7f04308f1640 1 -- 172.21.15.81:0/1363104975 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f042c072980 con 0x7f042c15b120 2024-09-16T01:16:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.959+0000 7f041affd640 1 -- 172.21.15.81:0/1363104975 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f041c059f70 con 0x7f042c15b120 2024-09-16T01:16:01.961 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-09-16T01:16:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.961+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6bfc06c300 msgr2=0x7f6bfc06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.961+0000 7f6c1b59e640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6bfc06c300 0x7f6bfc06e7c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c165d40 tx=0x7f6c10007e30 comp rx=0 tx=0).stop 2024-09-16T01:16:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.961+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c1c072130 msgr2=0x7f6c1c1653f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.961+0000 7f6c1b59e640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c1c072130 0x7f6c1c1653f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009890 tx=0x7f6c0c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.961+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 shutdown_connections 2024-09-16T01:16:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.961+0000 7f6c1b59e640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6bfc06c300 0x7f6bfc06e7c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.961+0000 7f6c1b59e640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6c1c1627e0 0x7f6c1c155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.961+0000 7f6c1b59e640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c0b3e10 0x7f6c1c0abd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.961+0000 7f6c1b59e640 1 --2- 172.21.15.81:0/2848816446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c1c072130 0x7f6c1c1653f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.961+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 >> 172.21.15.81:0/2848816446 conn(0x7f6c1c067d70 msgr2=0x7f6c1c0cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.961+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 shutdown_connections 2024-09-16T01:16:01.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.961+0000 7f6c1b59e640 1 -- 172.21.15.81:0/2848816446 wait complete. 2024-09-16T01:16:01.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.963+0000 7f04308f1640 1 -- 172.21.15.81:0/1363104975 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f040c06c2b0 msgr2=0x7f040c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.963+0000 7f04308f1640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f040c06c2b0 0x7f040c06e770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f042c15b900 tx=0x7f0420008040 comp rx=0 tx=0).stop 2024-09-16T01:16:01.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.963+0000 7f04308f1640 1 -- 172.21.15.81:0/1363104975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f042c15b120 msgr2=0x7f042c0a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.963+0000 7f04308f1640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f042c15b120 0x7f042c0a9490 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f041c00e880 tx=0x7f041c00ed40 comp rx=0 tx=0).stop 2024-09-16T01:16:01.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.963+0000 7f04308f1640 1 -- 172.21.15.81:0/1363104975 shutdown_connections 2024-09-16T01:16:01.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.963+0000 7f04308f1640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f040c06c2b0 0x7f040c06e770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.963+0000 7f04308f1640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c0a99d0 0x7f042c15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.963+0000 7f04308f1640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f042c15b500 0x7f042c15ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.963+0000 7f04308f1640 1 --2- 172.21.15.81:0/1363104975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f042c15b120 0x7f042c0a9490 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.963+0000 7f04308f1640 1 -- 172.21.15.81:0/1363104975 >> 172.21.15.81:0/1363104975 conn(0x7f042c067d70 msgr2=0x7f042c1618c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.963+0000 7f04308f1640 1 -- 172.21.15.81:0/1363104975 shutdown_connections 2024-09-16T01:16:01.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.963+0000 7f04308f1640 1 -- 172.21.15.81:0/1363104975 wait complete. 2024-09-16T01:16:01.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-09-16T01:16:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.967+0000 7f65af931640 1 -- 172.21.15.81:0/1383167005 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f65a806e890 con 0x7f65a8161910 2024-09-16T01:16:01.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.967+0000 7f659dffb640 1 -- 172.21.15.81:0/1383167005 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f659807e700 con 0x7f65a8161910 2024-09-16T01:16:01.969 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-09-16T01:16:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.970+0000 7f65af931640 1 -- 172.21.15.81:0/1383167005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f658c06c450 msgr2=0x7f658c06e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.970+0000 7f65af931640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f658c06c450 0x7f658c06e910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009ae0 tx=0x7f65a4009190 comp rx=0 tx=0).stop 2024-09-16T01:16:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.970+0000 7f65af931640 1 -- 172.21.15.81:0/1383167005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8161910 msgr2=0x7f65a8200400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.970+0000 7f65af931640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8161910 0x7f65a8200400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6598009c70 tx=0x7f6598004730 comp rx=0 tx=0).stop 2024-09-16T01:16:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.970+0000 7f65af931640 1 -- 172.21.15.81:0/1383167005 shutdown_connections 2024-09-16T01:16:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.970+0000 7f65af931640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f658c06c450 0x7f658c06e910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.970+0000 7f65af931640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65a8160170 0x7f65a80ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.970+0000 7f65af931640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8161910 0x7f65a8200400 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.970+0000 7f65af931640 1 --2- 172.21.15.81:0/1383167005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004800 0x7f65a815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.970+0000 7f65af931640 1 -- 172.21.15.81:0/1383167005 >> 172.21.15.81:0/1383167005 conn(0x7f65a808bfc0 msgr2=0x7f65a8162130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.970+0000 7f65af931640 1 -- 172.21.15.81:0/1383167005 shutdown_connections 2024-09-16T01:16:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:01.970+0000 7f65af931640 1 -- 172.21.15.81:0/1383167005 wait complete. 2024-09-16T01:16:01.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-09-16T01:16:01.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-09-16T01:16:01.983 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-09-16T01:16:02.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-16T01:16:02.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-16T01:16:02.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-16T01:16:02.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-16T01:16:02.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-16T01:16:02.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-16T01:16:02.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-16T01:16:02.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-16T01:16:03.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.062+0000 7fc2d2796640 1 Processor -- start 2024-09-16T01:16:03.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.062+0000 7fc2d2796640 1 -- start start 2024-09-16T01:16:03.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.064+0000 7fc2d2796640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2c400a4f0 0x7fc2c4036020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.064+0000 7fc2d2796640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2c404ff50 0x7fc2c4036560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.064+0000 7fc2d2796640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2c4039630 con 0x7fc2c40551b0 2024-09-16T01:16:03.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.064+0000 7fc2d2796640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc2c4039910 con 0x7fc2c400a4f0 2024-09-16T01:16:03.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.064+0000 7fc2d2796640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c4039bf0 con 0x7fc2c404ff50 2024-09-16T01:16:03.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.064+0000 7fc2d0f93640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc2c40551b0 0x7fc2c4005a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42390/0 (socket says 172.21.15.81:42390) 2024-09-16T01:16:03.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.064+0000 7fc2d0f93640 1 -- 172.21.15.81:0/1031810533 learned_addr learned my addr 172.21.15.81:0/1031810533 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:03.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.064+0000 7fc2d1794640 1 --2- 172.21.15.81:0/1031810533 >> v2:172.21.15.81:3300/0 conn(0x7fc2c400a4f0 0x7fc2c4036020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.064+0000 7fc2d1f95640 1 --2- 172.21.15.81:0/1031810533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2c404ff50 0x7fc2c4036560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.065+0000 7fc2d1f95640 1 -- 172.21.15.81:0/1031810533 >> v2:172.21.15.81:3300/0 conn(0x7fc2c400a4f0 msgr2=0x7fc2c4036020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:03.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.065+0000 7fc2d1f95640 1 --2- 172.21.15.81:0/1031810533 >> v2:172.21.15.81:3300/0 conn(0x7fc2c400a4f0 0x7fc2c4036020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.065+0000 7fc2d1f95640 1 -- 172.21.15.81:0/1031810533 >> v1:172.21.15.81:6789/0 conn(0x7fc2c40551b0 legacy=0x7fc2c4005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.065+0000 7fc2d1f95640 1 -- 172.21.15.81:0/1031810533 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c4039ed0 con 0x7fc2c404ff50 2024-09-16T01:16:03.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.066+0000 7fc2d1f95640 1 --2- 172.21.15.81:0/1031810533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2c404ff50 0x7fc2c4036560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc06a6a0 tx=0x7fc2cc0a6100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4708c30c0496609 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.066+0000 7fc2c3fff640 1 -- 172.21.15.81:0/1031810533 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0b3070 con 0x7fc2c404ff50 2024-09-16T01:16:03.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.067+0000 7fc2c3fff640 1 -- 172.21.15.81:0/1031810533 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2cc0ae440 con 0x7fc2c404ff50 2024-09-16T01:16:03.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.067+0000 7fc2c3fff640 1 -- 172.21.15.81:0/1031810533 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0ae870 con 0x7fc2c404ff50 2024-09-16T01:16:03.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.068+0000 7fc2d2796640 1 -- 172.21.15.81:0/1031810533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2c404ff50 msgr2=0x7fc2c4036560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.068+0000 7fc2d2796640 1 --2- 172.21.15.81:0/1031810533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2c404ff50 0x7fc2c4036560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc06a6a0 tx=0x7fc2cc0a6100 comp rx=0 tx=0).stop 2024-09-16T01:16:03.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.069+0000 7fc2d2796640 1 -- 172.21.15.81:0/1031810533 shutdown_connections 2024-09-16T01:16:03.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.069+0000 7fc2d2796640 1 --2- 172.21.15.81:0/1031810533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2c404ff50 0x7fc2c4036560 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.069+0000 7fc2d2796640 1 --2- 172.21.15.81:0/1031810533 >> v2:172.21.15.81:3300/0 conn(0x7fc2c400a4f0 0x7fc2c4036020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.069+0000 7fc2d2796640 1 -- 172.21.15.81:0/1031810533 >> 172.21.15.81:0/1031810533 conn(0x7fc2c401d930 msgr2=0x7fc2c40545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.069+0000 7fc2d2796640 1 -- 172.21.15.81:0/1031810533 shutdown_connections 2024-09-16T01:16:03.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.069+0000 7fc2d2796640 1 -- 172.21.15.81:0/1031810533 wait complete. 2024-09-16T01:16:03.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.071+0000 7fc2d2796640 1 Processor -- start 2024-09-16T01:16:03.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.071+0000 7fc2d2796640 1 -- start start 2024-09-16T01:16:03.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.073+0000 7fc2d2796640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2c404ff50 0x7fc2c404a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.073+0000 7fc2d2796640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2c40551b0 0x7fc2c401e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.073+0000 7fc2d2796640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c40e18f0 0x7fc2c4185410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.074+0000 7fc2d0f93640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2c40551b0 0x7fc2c401e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.074+0000 7fc2d0f93640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2c40551b0 0x7fc2c401e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:35862/0 (socket says 172.21.15.81:35862) 2024-09-16T01:16:03.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.074+0000 7fc2d1f95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c40e18f0 0x7fc2c4185410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.074+0000 7fc2d1f95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c40e18f0 0x7fc2c4185410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41520/0 (socket says 172.21.15.81:41520) 2024-09-16T01:16:03.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.074+0000 7fc2d0f93640 1 -- 172.21.15.81:0/1402778099 learned_addr learned my addr 172.21.15.81:0/1402778099 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.074+0000 7fc2d2796640 1 -- 172.21.15.81:0/1402778099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c4054e30 con 0x7fc2c40e18f0 2024-09-16T01:16:03.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.074+0000 7fc2d2796640 1 -- 172.21.15.81:0/1402778099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c4054cb0 con 0x7fc2c40551b0 2024-09-16T01:16:03.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.074+0000 7fc2d2796640 1 -- 172.21.15.81:0/1402778099 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c4007070 con 0x7fc2c404ff50 2024-09-16T01:16:03.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.075+0000 7fc2d1794640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2c404ff50 0x7fc2c404a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.075+0000 7fc2d0f93640 1 -- 172.21.15.81:0/1402778099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2c404ff50 msgr2=0x7fc2c404a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.075+0000 7fc2d0f93640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2c404ff50 0x7fc2c404a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.075+0000 7fc2d0f93640 1 -- 172.21.15.81:0/1402778099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c40e18f0 msgr2=0x7fc2c4185410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.075+0000 7fc2d0f93640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c40e18f0 0x7fc2c4185410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.075+0000 7fc2d0f93640 1 -- 172.21.15.81:0/1402778099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c4049c40 con 0x7fc2c40551b0 2024-09-16T01:16:03.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.075+0000 7fc2d0f93640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2c40551b0 0x7fc2c401e2a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c4b0 tx=0x7fc2c800c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.076+0000 7fc2c1ffb640 1 -- 172.21.15.81:0/1402778099 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8017070 con 0x7fc2c40551b0 2024-09-16T01:16:03.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.076+0000 7fc2c1ffb640 1 -- 172.21.15.81:0/1402778099 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c8005ce0 con 0x7fc2c40551b0 2024-09-16T01:16:03.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.076+0000 7fc2d2796640 1 -- 172.21.15.81:0/1402778099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c40dd620 con 0x7fc2c40551b0 2024-09-16T01:16:03.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.076+0000 7fc2d2796640 1 -- 172.21.15.81:0/1402778099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c404a1c0 con 0x7fc2c40551b0 2024-09-16T01:16:03.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.076+0000 7fc2c1ffb640 1 -- 172.21.15.81:0/1402778099 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8007270 con 0x7fc2c40551b0 2024-09-16T01:16:03.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.077+0000 7fc2d1794640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2c404ff50 0x7fc2c404a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:03.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.077+0000 7fc2d1f95640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c40e18f0 0x7fc2c4185410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:03.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.079+0000 7fc2c1ffb640 1 -- 172.21.15.81:0/1402778099 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc2c801a070 con 0x7fc2c40551b0 2024-09-16T01:16:03.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.080+0000 7fc2c1ffb640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc2b006c380 0x7fc2b006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.080+0000 7fc2c1ffb640 1 -- 172.21.15.81:0/1402778099 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc2c808a960 con 0x7fc2c40551b0 2024-09-16T01:16:03.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.081+0000 7fc2d1794640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc2b006c380 0x7fc2b006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.084+0000 7fc2d1794640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc2b006c380 0x7fc2b006e840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009c00 tx=0x7fc2bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.084+0000 7fc2d2796640 1 -- 172.21.15.81:0/1402778099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ac005290 con 0x7fc2c40551b0 2024-09-16T01:16:03.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.090+0000 7fc2c1ffb640 1 -- 172.21.15.81:0/1402778099 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2c80587b0 con 0x7fc2c40551b0 2024-09-16T01:16:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.109+0000 7f2ea593f640 1 Processor -- start 2024-09-16T01:16:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.109+0000 7f2ea593f640 1 -- start start 2024-09-16T01:16:03.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.111+0000 7f2ea593f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ea0073860 0x7f2ea006f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.111+0000 7f2ea593f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2ea006f650 0x7f2ea00b3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.111+0000 7f2ea593f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea00722b0 con 0x7f2ea00b2920 2024-09-16T01:16:03.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.111+0000 7f2ea593f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea006fa90 con 0x7f2ea0073860 2024-09-16T01:16:03.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.111+0000 7f2ea593f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea0072590 con 0x7f2ea006f650 2024-09-16T01:16:03.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.111+0000 7f2e9ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ea0073860 0x7f2ea006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.111+0000 7f2e9ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ea0073860 0x7f2ea006f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41522/0 (socket says 172.21.15.81:41522) 2024-09-16T01:16:03.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.111+0000 7f2e9ffff640 1 -- 172.21.15.81:0/784168451 learned_addr learned my addr 172.21.15.81:0/784168451 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.112+0000 7f2e9ffff640 1 -- 172.21.15.81:0/784168451 >> v2:172.21.15.102:3300/0 conn(0x7f2ea006f650 msgr2=0x7f2ea00b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:03.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.112+0000 7f2e9ffff640 1 --2- 172.21.15.81:0/784168451 >> v2:172.21.15.102:3300/0 conn(0x7f2ea006f650 0x7f2ea00b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.112+0000 7f2e9ffff640 1 -- 172.21.15.81:0/784168451 >> v1:172.21.15.102:6789/0 conn(0x7f2ea00b2920 legacy=0x7f2ea015d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.112+0000 7f2e9ffff640 1 -- 172.21.15.81:0/784168451 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea0072870 con 0x7f2ea0073860 2024-09-16T01:16:03.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.113+0000 7f2e9ffff640 1 --2- 172.21.15.81:0/784168451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea0073860 0x7f2ea006f110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00cfff0 tx=0x7f2e9802a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59c83007649d6b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.113+0000 7f462f8b7640 1 Processor -- start 2024-09-16T01:16:03.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.114+0000 7f462f8b7640 1 -- start start 2024-09-16T01:16:03.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.115+0000 7f462f8b7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4628161c80 0x7f462806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.113+0000 7f2e9f7fe640 1 -- 172.21.15.81:0/784168451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98033610 con 0x7f2ea0073860 2024-09-16T01:16:03.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.114+0000 7f2e9f7fe640 1 -- 172.21.15.81:0/784168451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9802f070 con 0x7f2ea0073860 2024-09-16T01:16:03.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.115+0000 7f2ea593f640 1 -- 172.21.15.81:0/784168451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea0073860 msgr2=0x7f2ea006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.115+0000 7f2ea593f640 1 --2- 172.21.15.81:0/784168451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea0073860 0x7f2ea006f110 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00cfff0 tx=0x7f2e9802a7d0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.115+0000 7f2ea593f640 1 -- 172.21.15.81:0/784168451 shutdown_connections 2024-09-16T01:16:03.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.115+0000 7f2ea593f640 1 --2- 172.21.15.81:0/784168451 >> v2:172.21.15.102:3300/0 conn(0x7f2ea006f650 0x7f2ea00b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.115+0000 7f2ea593f640 1 --2- 172.21.15.81:0/784168451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea0073860 0x7f2ea006f110 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.115+0000 7f2ea593f640 1 -- 172.21.15.81:0/784168451 >> 172.21.15.81:0/784168451 conn(0x7f2ea00b1e00 msgr2=0x7f2ea00b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.115+0000 7f2ea593f640 1 -- 172.21.15.81:0/784168451 shutdown_connections 2024-09-16T01:16:03.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.113+0000 7f21addbe640 1 Processor -- start 2024-09-16T01:16:03.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.115+0000 7f21addbe640 1 -- start start 2024-09-16T01:16:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.115+0000 7f462d653640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4628161c80 0x7f462806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.116+0000 7f462d653640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4628161c80 0x7f462806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41524/0 (socket says 172.21.15.81:41524) 2024-09-16T01:16:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.116+0000 7f462d653640 1 -- 172.21.15.81:0/3539533785 learned_addr learned my addr 172.21.15.81:0/3539533785 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.116+0000 7f462f8b7640 1 --2- 172.21.15.81:0/3539533785 >> v2:172.21.15.102:3300/0 conn(0x7f4628162060 0x7f46280b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.116+0000 7f462f8b7640 1 -- 172.21.15.81:0/3539533785 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f462806e870 con 0x7f46280b64b0 2024-09-16T01:16:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.116+0000 7f462f8b7640 1 -- 172.21.15.81:0/3539533785 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f462806d9f0 con 0x7f4628161c80 2024-09-16T01:16:03.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.116+0000 7f462ce52640 1 --2- 172.21.15.81:0/3539533785 >> v2:172.21.15.102:3300/0 conn(0x7f4628162060 0x7f46280b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.116+0000 7f462f8b7640 1 -- 172.21.15.81:0/3539533785 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f462806dcd0 con 0x7f4628162060 2024-09-16T01:16:03.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.117+0000 7f21addbe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21a80727c0 0x7f21a815e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.117+0000 7f461ffff640 1 -- 172.21.15.81:0/3539533785 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395424114 0 0) 0x7f4618001110 con 0x7f46280b64b0 2024-09-16T01:16:03.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.117+0000 7f461ffff640 1 -- 172.21.15.81:0/3539533785 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4614003520 con 0x7f46280b64b0 2024-09-16T01:16:03.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.117+0000 7f462d653640 1 -- 172.21.15.81:0/3539533785 >> v2:172.21.15.102:3300/0 conn(0x7f4628162060 msgr2=0x7f46280b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:03.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.116+0000 7f2ea593f640 1 -- 172.21.15.81:0/784168451 wait complete. 2024-09-16T01:16:03.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.117+0000 7f2ea593f640 1 Processor -- start 2024-09-16T01:16:03.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.117+0000 7f219effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21a80727c0 0x7f21a815e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.117+0000 7f462d653640 1 --2- 172.21.15.81:0/3539533785 >> v2:172.21.15.102:3300/0 conn(0x7f4628162060 0x7f46280b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.117+0000 7f462d653640 1 -- 172.21.15.81:0/3539533785 >> v1:172.21.15.102:6789/0 conn(0x7f46280b64b0 legacy=0x7f4628162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.117+0000 7f462d653640 1 -- 172.21.15.81:0/3539533785 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462806dfb0 con 0x7f4628161c80 2024-09-16T01:16:03.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.117+0000 7f219effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f21a80727c0 0x7f21a815e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41536/0 (socket says 172.21.15.81:41536) 2024-09-16T01:16:03.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.117+0000 7f219effd640 1 -- 172.21.15.81:0/1407573740 learned_addr learned my addr 172.21.15.81:0/1407573740 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.118+0000 7f21addbe640 1 -- 172.21.15.81:0/1407573740 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a80b59d0 con 0x7f21a80701a0 2024-09-16T01:16:03.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.118+0000 7f21addbe640 1 -- 172.21.15.81:0/1407573740 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a815b980 con 0x7f21a8154a00 2024-09-16T01:16:03.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.118+0000 7f21addbe640 1 -- 172.21.15.81:0/1407573740 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f21a815a980 con 0x7f21a80727c0 2024-09-16T01:16:03.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.118+0000 7f21a6ffd640 1 -- 172.21.15.81:0/1407573740 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756135485 0 0) 0x7f21a80b59d0 con 0x7f21a80701a0 2024-09-16T01:16:03.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.118+0000 7f21a6ffd640 1 -- 172.21.15.81:0/1407573740 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2194003500 con 0x7f21a80701a0 2024-09-16T01:16:03.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.118+0000 7f219effd640 1 -- 172.21.15.81:0/1407573740 >> v1:172.21.15.102:6789/0 conn(0x7f21a8154a00 legacy=0x7f21a80720b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-16T01:16:03.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.118+0000 7f219effd640 1 -- 172.21.15.81:0/1407573740 >> v1:172.21.15.81:6789/0 conn(0x7f21a80701a0 legacy=0x7f21a815e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.118+0000 7f21a6ffd640 1 -- 172.21.15.81:0/1407573740 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3841184159 0 0) 0x7f2194003500 con 0x7f21a80701a0 2024-09-16T01:16:03.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f462d653640 1 --2- 172.21.15.81:0/3539533785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628161c80 0x7f462806e330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f462808e830 tx=0x7f462002a960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff352937f9924a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.117+0000 7f2ea593f640 1 -- start start 2024-09-16T01:16:03.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f2ea593f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea006f650 0x7f2ea00ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f2ea593f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea00b2920 0x7f2ea0157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f2ea593f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea015c6b0 0x7f2ea0172f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f2ea593f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea0073cd0 con 0x7f2ea015c6b0 2024-09-16T01:16:03.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f2ea593f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea00cfd10 con 0x7f2ea006f650 2024-09-16T01:16:03.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f2ea593f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea015dbd0 con 0x7f2ea00b2920 2024-09-16T01:16:03.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f2ea493d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea006f650 0x7f2ea00ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f2ea493d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea006f650 0x7f2ea00ade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:35880/0 (socket says 172.21.15.81:35880) 2024-09-16T01:16:03.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f219effd640 1 -- 172.21.15.81:0/1407573740 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a815abc0 con 0x7f21a80727c0 2024-09-16T01:16:03.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f461ffff640 1 -- 172.21.15.81:0/3539533785 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4620030410 con 0x7f4628161c80 2024-09-16T01:16:03.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f2ea493d640 1 -- 172.21.15.81:0/3782527413 learned_addr learned my addr 172.21.15.81:0/3782527413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f461ffff640 1 -- 172.21.15.81:0/3539533785 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4620035070 con 0x7f4628161c80 2024-09-16T01:16:03.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.119+0000 7f461ffff640 1 -- 172.21.15.81:0/3539533785 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46200307d0 con 0x7f4628161c80 2024-09-16T01:16:03.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.120+0000 7f2ea513e640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea015c6b0 0x7f2ea0172f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.120+0000 7f2ea493d640 1 -- 172.21.15.81:0/3782527413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea00b2920 msgr2=0x7f2ea0157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.120+0000 7f2e9ffff640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea00b2920 0x7f2ea0157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.120+0000 7f2ea493d640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea00b2920 0x7f2ea0157070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.120+0000 7f462ce52640 1 --2- 172.21.15.81:0/3539533785 >> v2:172.21.15.102:3300/0 conn(0x7f4628162060 0x7f46280b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:03.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.120+0000 7f2ea493d640 1 -- 172.21.15.81:0/3782527413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea015c6b0 msgr2=0x7f2ea0172f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.120+0000 7f2ea493d640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea015c6b0 0x7f2ea0172f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.120+0000 7f2ea493d640 1 -- 172.21.15.81:0/3782527413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea00ae490 con 0x7f2ea006f650 2024-09-16T01:16:03.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.120+0000 7f2e9ffff640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea00b2920 0x7f2ea0157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:03.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.120+0000 7f2ea513e640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea015c6b0 0x7f2ea0172f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:03.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.120+0000 7f219effd640 1 --2- 172.21.15.81:0/1407573740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a80727c0 0x7f21a815e1f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2190008650 tx=0x7f219000abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551bd027558fbfd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.120+0000 7f21a6ffd640 1 -- 172.21.15.81:0/1407573740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a0001670 con 0x7f21a80727c0 2024-09-16T01:16:03.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.121+0000 7f21a6ffd640 1 -- 172.21.15.81:0/1407573740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219002ab70 con 0x7f21a80727c0 2024-09-16T01:16:03.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.121+0000 7f21a6ffd640 1 -- 172.21.15.81:0/1407573740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21900089e0 con 0x7f21a80727c0 2024-09-16T01:16:03.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.121+0000 7f2ea493d640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea006f650 0x7f2ea00ade00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c400 tx=0x7f2e9000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.121+0000 7f462f8b7640 1 -- 172.21.15.81:0/3539533785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628161c80 msgr2=0x7f462806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.121+0000 7f462f8b7640 1 --2- 172.21.15.81:0/3539533785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628161c80 0x7f462806e330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f462808e830 tx=0x7f462002a960 comp rx=0 tx=0).stop 2024-09-16T01:16:03.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.121+0000 7f2e9d7fa640 1 -- 172.21.15.81:0/3782527413 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90017070 con 0x7f2ea006f650 2024-09-16T01:16:03.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.121+0000 7f2ea593f640 1 -- 172.21.15.81:0/3782527413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea00ae770 con 0x7f2ea006f650 2024-09-16T01:16:03.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.121+0000 7f2ea593f640 1 -- 172.21.15.81:0/3782527413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea00a9530 con 0x7f2ea006f650 2024-09-16T01:16:03.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f462f8b7640 1 -- 172.21.15.81:0/3539533785 shutdown_connections 2024-09-16T01:16:03.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f462f8b7640 1 --2- 172.21.15.81:0/3539533785 >> v2:172.21.15.102:3300/0 conn(0x7f4628162060 0x7f46280b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f462f8b7640 1 --2- 172.21.15.81:0/3539533785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628161c80 0x7f462806e330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f462f8b7640 1 -- 172.21.15.81:0/3539533785 >> 172.21.15.81:0/3539533785 conn(0x7f46280d44f0 msgr2=0x7f46280d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f21addbe640 1 -- 172.21.15.81:0/1407573740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a80727c0 msgr2=0x7f21a815e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f21addbe640 1 --2- 172.21.15.81:0/1407573740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a80727c0 0x7f21a815e1f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2190008650 tx=0x7f219000abe0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f462f8b7640 1 -- 172.21.15.81:0/3539533785 shutdown_connections 2024-09-16T01:16:03.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f462f8b7640 1 -- 172.21.15.81:0/3539533785 wait complete. 2024-09-16T01:16:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f2e9d7fa640 1 -- 172.21.15.81:0/3782527413 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e900052d0 con 0x7f2ea006f650 2024-09-16T01:16:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f21addbe640 1 -- 172.21.15.81:0/1407573740 shutdown_connections 2024-09-16T01:16:03.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f21addbe640 1 --2- 172.21.15.81:0/1407573740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a80727c0 0x7f21a815e1f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f21addbe640 1 -- 172.21.15.81:0/1407573740 >> 172.21.15.81:0/1407573740 conn(0x7f21a8067d70 msgr2=0x7f21a806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f2e9d7fa640 1 -- 172.21.15.81:0/3782527413 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90003830 con 0x7f2ea006f650 2024-09-16T01:16:03.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f21addbe640 1 -- 172.21.15.81:0/1407573740 shutdown_connections 2024-09-16T01:16:03.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.122+0000 7f21addbe640 1 -- 172.21.15.81:0/1407573740 wait complete. 2024-09-16T01:16:03.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.124+0000 7f462f8b7640 1 Processor -- start 2024-09-16T01:16:03.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.124+0000 7f462f8b7640 1 -- start start 2024-09-16T01:16:03.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.125+0000 7f21addbe640 1 Processor -- start 2024-09-16T01:16:03.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.125+0000 7f2ea593f640 1 -- 172.21.15.81:0/3782527413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e80005290 con 0x7f2ea006f650 2024-09-16T01:16:03.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.125+0000 7f21addbe640 1 -- start start 2024-09-16T01:16:03.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.126+0000 7f462f8b7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46280b64b0 0x7f46280cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.126+0000 7f462f8b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628161c80 0x7f46281f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.126+0000 7f21addbe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a80701a0 0x7f21a8159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.126+0000 7f21addbe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f21a80727c0 0x7f21a81f3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.126+0000 7f21addbe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a8154a00 0x7f21a81f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f21addbe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f21a815b460 con 0x7f21a80701a0 2024-09-16T01:16:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f21addbe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f21a815b180 con 0x7f21a8154a00 2024-09-16T01:16:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f21addbe640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f21a8154de0 con 0x7f21a80727c0 2024-09-16T01:16:03.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f462ce52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628161c80 0x7f46281f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f21a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a80701a0 0x7f21a8159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f21a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a80701a0 0x7f21a8159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41576/0 (socket says 172.21.15.81:41576) 2024-09-16T01:16:03.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f21a77fe640 1 -- 172.21.15.81:0/1701528600 learned_addr learned my addr 172.21.15.81:0/1701528600 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f219effd640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f21a80727c0 0x7f21a81f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.126+0000 7f2e9d7fa640 1 -- 172.21.15.81:0/3782527413 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2e9001a070 con 0x7f2ea006f650 2024-09-16T01:16:03.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f2e9d7fa640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e8c06c3b0 0x7f2e8c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f2e9d7fa640 1 -- 172.21.15.81:0/3782527413 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2e9008abd0 con 0x7f2ea006f650 2024-09-16T01:16:03.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f462d653640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46280b64b0 0x7f46280cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f462d653640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46280b64b0 0x7f46280cdfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:45140/0 (socket says 172.21.15.81:45140) 2024-09-16T01:16:03.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f462f8b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4628162060 0x7f46280c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f462f8b7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46280d2a10 con 0x7f4628161c80 2024-09-16T01:16:03.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f462f8b7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f46280d2890 con 0x7f4628162060 2024-09-16T01:16:03.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f462f8b7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f46280b6960 con 0x7f46280b64b0 2024-09-16T01:16:03.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f2e9ffff640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e8c06c3b0 0x7f2e8c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f21a7fff640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a8154a00 0x7f21a81f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.127+0000 7f21a77fe640 1 -- 172.21.15.81:0/1701528600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f21a80727c0 msgr2=0x7f21a81f3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f21a77fe640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f21a80727c0 0x7f21a81f3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f21a77fe640 1 -- 172.21.15.81:0/1701528600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a8154a00 msgr2=0x7f21a81f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f21a77fe640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a8154a00 0x7f21a81f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f21a77fe640 1 -- 172.21.15.81:0/1701528600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a8156090 con 0x7f21a80701a0 2024-09-16T01:16:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f462d653640 1 -- 172.21.15.81:0/3652978422 learned_addr learned my addr 172.21.15.81:0/3652978422 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f462ce52640 1 -- 172.21.15.81:0/3652978422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46280b64b0 msgr2=0x7f46280cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f462ce52640 1 --2- 172.21.15.81:0/3652978422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46280b64b0 0x7f46280cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f462ce52640 1 -- 172.21.15.81:0/3652978422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4628162060 msgr2=0x7f46280c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f462ce52640 1 --2- 172.21.15.81:0/3652978422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4628162060 0x7f46280c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f462ce52640 1 -- 172.21.15.81:0/3652978422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46280ca620 con 0x7f4628161c80 2024-09-16T01:16:03.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f2e9ffff640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e8c06c3b0 0x7f2e8c06e870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2e98034000 tx=0x7f2e98009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.128+0000 7f21a77fe640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a80701a0 0x7f21a8159840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f219800ba50 tx=0x7f219800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.129+0000 7f462ce52640 1 --2- 172.21.15.81:0/3652978422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628161c80 0x7f46281f3b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4624014f40 tx=0x7f4624007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.129+0000 7f21a4ff9640 1 -- 172.21.15.81:0/1701528600 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2198019070 con 0x7f21a80701a0 2024-09-16T01:16:03.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.129+0000 7f21addbe640 1 -- 172.21.15.81:0/1701528600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a8156370 con 0x7f21a80701a0 2024-09-16T01:16:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.129+0000 7f21addbe640 1 -- 172.21.15.81:0/1701528600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a8156930 con 0x7f21a80701a0 2024-09-16T01:16:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.129+0000 7f21a4ff9640 1 -- 172.21.15.81:0/1701528600 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f219800cb50 con 0x7f21a80701a0 2024-09-16T01:16:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.129+0000 7f21a4ff9640 1 -- 172.21.15.81:0/1701528600 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2198014440 con 0x7f21a80701a0 2024-09-16T01:16:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.130+0000 7f461dffb640 1 -- 172.21.15.81:0/3652978422 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624007d30 con 0x7f4628161c80 2024-09-16T01:16:03.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.131+0000 7f2e9d7fa640 1 -- 172.21.15.81:0/3782527413 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e9008ae20 con 0x7f2ea006f650 2024-09-16T01:16:03.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.131+0000 7f461dffb640 1 -- 172.21.15.81:0/3652978422 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46240108c0 con 0x7f4628161c80 2024-09-16T01:16:03.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.131+0000 7f462f8b7640 1 -- 172.21.15.81:0/3652978422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46280ca900 con 0x7f4628161c80 2024-09-16T01:16:03.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.131+0000 7f462f8b7640 1 -- 172.21.15.81:0/3652978422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462806ce40 con 0x7f4628161c80 2024-09-16T01:16:03.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.133+0000 7f462f8b7640 1 -- 172.21.15.81:0/3652978422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46280ba470 con 0x7f4628161c80 2024-09-16T01:16:03.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.134+0000 7f461dffb640 1 -- 172.21.15.81:0/3652978422 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624010c90 con 0x7f4628161c80 2024-09-16T01:16:03.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.134+0000 7f21addbe640 1 -- 172.21.15.81:0/1701528600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f218c005290 con 0x7f21a80701a0 2024-09-16T01:16:03.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.135+0000 7f21a4ff9640 1 -- 172.21.15.81:0/1701528600 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f219801c070 con 0x7f21a80701a0 2024-09-16T01:16:03.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.135+0000 7f21a4ff9640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f218806c2e0 0x7f218806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.136+0000 7f219effd640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f218806c2e0 0x7f218806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.136+0000 7f21a4ff9640 1 -- 172.21.15.81:0/1701528600 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f219808b1f0 con 0x7f21a80701a0 2024-09-16T01:16:03.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.137+0000 7f219effd640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f218806c2e0 0x7f218806e7a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2190033000 tx=0x7f219002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.138+0000 7f461dffb640 1 -- 172.21.15.81:0/3652978422 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4624012070 con 0x7f4628161c80 2024-09-16T01:16:03.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.139+0000 7f461dffb640 1 --2- 172.21.15.81:0/3652978422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f460c06c380 0x7f460c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.139+0000 7f462d653640 1 --2- 172.21.15.81:0/3652978422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f460c06c380 0x7f460c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.140+0000 7f462d653640 1 --2- 172.21.15.81:0/3652978422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f460c06c380 0x7f460c06e840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4620009c90 tx=0x7f4620009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.140+0000 7f461dffb640 1 -- 172.21.15.81:0/3652978422 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f46240943b0 con 0x7f4628161c80 2024-09-16T01:16:03.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.142+0000 7f461dffb640 1 -- 172.21.15.81:0/3652978422 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4624062850 con 0x7f4628161c80 2024-09-16T01:16:03.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.151+0000 7f21a4ff9640 1 -- 172.21.15.81:0/1701528600 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2198059620 con 0x7f21a80701a0 2024-09-16T01:16:03.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.175+0000 7f880e1ea640 1 Processor -- start 2024-09-16T01:16:03.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.175+0000 7f880e1ea640 1 -- start start 2024-09-16T01:16:03.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.176+0000 7f880e1ea640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8808162570 0x7f8808073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.176+0000 7f880e1ea640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8808072560 con 0x7f88080b31e0 2024-09-16T01:16:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.176+0000 7f880e1ea640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8808072840 con 0x7f8808162950 2024-09-16T01:16:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.176+0000 7f880e1ea640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8808073b40 con 0x7f8808162570 2024-09-16T01:16:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.177+0000 7f880c9e7640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f88080b31e0 0x7f8808071c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42404/0 (socket says 172.21.15.81:42404) 2024-09-16T01:16:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.177+0000 7f880c9e7640 1 -- 172.21.15.81:0/2445012062 learned_addr learned my addr 172.21.15.81:0/2445012062 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.177+0000 7f880d1e8640 1 --2- 172.21.15.81:0/2445012062 >> v2:172.21.15.102:3300/0 conn(0x7f8808162570 0x7f8808073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.178+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4053952207 0 0) 0x7f8808072560 con 0x7f88080b31e0 2024-09-16T01:16:03.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.178+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87f4003520 con 0x7f88080b31e0 2024-09-16T01:16:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.178+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4241668146 0 0) 0x7f87f4003520 con 0x7f88080b31e0 2024-09-16T01:16:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.178+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 >> v2:172.21.15.102:3300/0 conn(0x7f8808162570 msgr2=0x7f8808073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.178+0000 7f87fffff640 1 --2- 172.21.15.81:0/2445012062 >> v2:172.21.15.102:3300/0 conn(0x7f8808162570 0x7f8808073600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.178+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 >> v1:172.21.15.102:6789/0 conn(0x7f8808162950 legacy=0x7f880806dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.179+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8808072b20 con 0x7f88080b31e0 2024-09-16T01:16:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.179+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f88000019f0 con 0x7f88080b31e0 2024-09-16T01:16:03.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.179+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 >> v1:172.21.15.81:6789/0 conn(0x7f88080b31e0 legacy=0x7f8808071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.179+0000 7f87fffff640 1 --2- 172.21.15.81:0/2445012062 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87f4003a00 0x7f87f4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.179+0000 7f87fffff640 1 --2- 172.21.15.81:0/2445012062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f4004800 0x7f87f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.179+0000 7f87fffff640 1 --2- 172.21.15.81:0/2445012062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87f4005210 0x7f87f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.179+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8808073b40 con 0x7f87f4004800 2024-09-16T01:16:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.179+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f87f400c140 con 0x7f87f4005210 2024-09-16T01:16:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.179+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f87f400c340 con 0x7f87f4003a00 2024-09-16T01:16:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.179+0000 7f880c9e7640 1 --2- 172.21.15.81:0/2445012062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f4004800 0x7f87f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.180+0000 7f19359f1640 1 Processor -- start 2024-09-16T01:16:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.180+0000 7f19359f1640 1 -- start start 2024-09-16T01:16:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.180+0000 7f880c9e7640 1 -- 172.21.15.81:0/2445012062 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87f4003a00 msgr2=0x7f87f4003e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:16:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.180+0000 7f880c9e7640 1 --2- 172.21.15.81:0/2445012062 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87f4003a00 0x7f87f4003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.180+0000 7f880c9e7640 1 -- 172.21.15.81:0/2445012062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87f4005210 msgr2=0x7f87f400b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:16:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.180+0000 7f880c9e7640 1 --2- 172.21.15.81:0/2445012062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87f4005210 0x7f87f400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.180+0000 7f880c9e7640 1 -- 172.21.15.81:0/2445012062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f4003520 con 0x7f87f4004800 2024-09-16T01:16:03.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.180+0000 7f880d9e9640 1 -- 172.21.15.81:0/2445012062 reap_dead start 2024-09-16T01:16:03.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.180+0000 7f1adece6640 1 Processor -- start 2024-09-16T01:16:03.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.181+0000 7facb64a4640 1 Processor -- start 2024-09-16T01:16:03.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.181+0000 7facb64a4640 1 -- start start 2024-09-16T01:16:03.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.181+0000 7f19359f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19280e09c0 0x7f19280556a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.181+0000 7f192ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1928035a80 0x7f1928038230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42418/0 (socket says 172.21.15.81:42418) 2024-09-16T01:16:03.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.181+0000 7f192ffff640 1 -- 172.21.15.81:0/1825485474 learned_addr learned my addr 172.21.15.81:0/1825485474 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:03.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f19359f1640 1 --2- 172.21.15.81:0/1825485474 >> v2:172.21.15.81:3300/0 conn(0x7f19280354c0 0x7f1928038940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f19351f0640 1 --2- 172.21.15.81:0/1825485474 >> v2:172.21.15.81:3300/0 conn(0x7f19280354c0 0x7f1928038940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f19359f1640 1 -- 172.21.15.81:0/1825485474 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1928038e80 con 0x7f1928035a80 2024-09-16T01:16:03.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f19359f1640 1 -- 172.21.15.81:0/1825485474 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1928039100 con 0x7f19280354c0 2024-09-16T01:16:03.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7facb64a4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facb0154a00 0x7facb00720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7facb64a4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7facb00725f0 0x7facb015e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f192f7fe640 1 -- 172.21.15.81:0/1825485474 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796475272 0 0) 0x7f191c001110 con 0x7f1928035a80 2024-09-16T01:16:03.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f19359f1640 1 -- 172.21.15.81:0/1825485474 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1928009740 con 0x7f19280e09c0 2024-09-16T01:16:03.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7facb64a4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb00b59d0 con 0x7facb015e730 2024-09-16T01:16:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.181+0000 7f1adece6640 1 -- start start 2024-09-16T01:16:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f1adece6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ad8148ca0 0x7f1ad806f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f1adece6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ad806f630 0x7f1ad8162dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f1adece6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1ad8163310 0x7f1ad81663f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f1ad7fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ad806f630 0x7f1ad8162dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f1ad7fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ad806f630 0x7f1ad8162dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:45150/0 (socket says 172.21.15.81:45150) 2024-09-16T01:16:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f1adca82640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ad8148ca0 0x7f1ad806f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f1adca82640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ad8148ca0 0x7f1ad806f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41602/0 (socket says 172.21.15.81:41602) 2024-09-16T01:16:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7facaffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facb0154a00 0x7facb00720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f1ad7fff640 1 -- 172.21.15.81:0/1828210235 learned_addr learned my addr 172.21.15.81:0/1828210235 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7facaffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facb0154a00 0x7facb00720b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41616/0 (socket says 172.21.15.81:41616) 2024-09-16T01:16:03.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7facaffff640 1 -- 172.21.15.81:0/3876133189 learned_addr learned my addr 172.21.15.81:0/3876133189 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7facb64a4640 1 -- 172.21.15.81:0/3876133189 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7facb015a980 con 0x7facb0154a00 2024-09-16T01:16:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.182+0000 7f19349ef640 1 --2- 172.21.15.81:0/1825485474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19280e09c0 0x7f19280556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f192f7fe640 1 -- 172.21.15.81:0/1825485474 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1920003520 con 0x7f1928035a80 2024-09-16T01:16:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7facb64a4640 1 -- 172.21.15.81:0/3876133189 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7facb015b980 con 0x7facb00725f0 2024-09-16T01:16:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f1adece6640 1 -- 172.21.15.81:0/1828210235 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1ad806fa80 con 0x7f1ad8148ca0 2024-09-16T01:16:03.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f19351f0640 1 -- 172.21.15.81:0/1825485474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19280e09c0 msgr2=0x7f19280556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:03.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f1adece6640 1 -- 172.21.15.81:0/1828210235 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1ad81637a0 con 0x7f1ad8163310 2024-09-16T01:16:03.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f1adece6640 1 -- 172.21.15.81:0/1828210235 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad806fcd0 con 0x7f1ad806f630 2024-09-16T01:16:03.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f1add283640 1 --2- 172.21.15.81:0/1828210235 >> v2:172.21.15.102:3300/0 conn(0x7f1ad8163310 0x7f1ad81663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f19351f0640 1 --2- 172.21.15.81:0/1825485474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19280e09c0 0x7f19280556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f19351f0640 1 -- 172.21.15.81:0/1825485474 >> v1:172.21.15.81:6789/0 conn(0x7f1928035a80 legacy=0x7f1928038230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7facaf7fe640 1 --2- 172.21.15.81:0/3876133189 >> v2:172.21.15.102:3300/0 conn(0x7facb00725f0 0x7facb015e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f19351f0640 1 -- 172.21.15.81:0/1825485474 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1928057400 con 0x7f19280354c0 2024-09-16T01:16:03.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f1ad7fff640 1 -- 172.21.15.81:0/1828210235 >> v2:172.21.15.102:3300/0 conn(0x7f1ad8163310 msgr2=0x7f1ad81663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:03.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f1ad7fff640 1 --2- 172.21.15.81:0/1828210235 >> v2:172.21.15.102:3300/0 conn(0x7f1ad8163310 0x7f1ad81663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f1ad7fff640 1 -- 172.21.15.81:0/1828210235 >> v2:172.21.15.81:3300/0 conn(0x7f1ad8148ca0 msgr2=0x7f1ad806f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:03.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f1ad7fff640 1 --2- 172.21.15.81:0/1828210235 >> v2:172.21.15.81:3300/0 conn(0x7f1ad8148ca0 0x7f1ad806f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f1ad7fff640 1 -- 172.21.15.81:0/1828210235 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad806ffb0 con 0x7f1ad806f630 2024-09-16T01:16:03.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.183+0000 7f1add283640 1 --2- 172.21.15.81:0/1828210235 >> v2:172.21.15.102:3300/0 conn(0x7f1ad8163310 0x7f1ad81663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.184+0000 7facaf7fe640 1 -- 172.21.15.81:0/3876133189 >> v2:172.21.15.81:3300/0 conn(0x7facb0154a00 msgr2=0x7facb00720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.184+0000 7facaf7fe640 1 --2- 172.21.15.81:0/3876133189 >> v2:172.21.15.81:3300/0 conn(0x7facb0154a00 0x7facb00720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.184+0000 7facaf7fe640 1 -- 172.21.15.81:0/3876133189 >> v1:172.21.15.102:6789/0 conn(0x7facb015e730 legacy=0x7facb006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.184+0000 7facaf7fe640 1 -- 172.21.15.81:0/3876133189 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb015abc0 con 0x7facb00725f0 2024-09-16T01:16:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.184+0000 7facaffff640 1 --2- 172.21.15.81:0/3876133189 >> v2:172.21.15.81:3300/0 conn(0x7facb0154a00 0x7facb00720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.184+0000 7f19351f0640 1 --2- 172.21.15.81:0/1825485474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19280354c0 0x7f1928038940 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f193006a6a0 tx=0x7f19300a5fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16aa5d27bb1fd3c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.184+0000 7f192f7fe640 1 -- 172.21.15.81:0/1825485474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19300b3070 con 0x7f19280354c0 2024-09-16T01:16:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.184+0000 7f192f7fe640 1 -- 172.21.15.81:0/1825485474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19300a6dd0 con 0x7f19280354c0 2024-09-16T01:16:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.184+0000 7f192f7fe640 1 -- 172.21.15.81:0/1825485474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19300ae640 con 0x7f19280354c0 2024-09-16T01:16:03.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.181+0000 7f880c9e7640 1 --2- 172.21.15.81:0/2445012062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f4004800 0x7f87f4004c80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f880000a760 tx=0x7f87f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6464851e752ec58a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.181+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880000a3b0 con 0x7f87f4004800 2024-09-16T01:16:03.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.181+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f880002f070 con 0x7f87f4004800 2024-09-16T01:16:03.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.181+0000 7f87fffff640 1 -- 172.21.15.81:0/2445012062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880002bbd0 con 0x7f87f4004800 2024-09-16T01:16:03.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.185+0000 7f1ad7fff640 1 --2- 172.21.15.81:0/1828210235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ad806f630 0x7f1ad8162dd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8070e50 tx=0x7f1ac802a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39cc1e91a8a64aca server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.185+0000 7f1ad77fe640 1 -- 172.21.15.81:0/1828210235 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8037070 con 0x7f1ad806f630 2024-09-16T01:16:03.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.185+0000 7f1ad77fe640 1 -- 172.21.15.81:0/1828210235 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac8032440 con 0x7f1ad806f630 2024-09-16T01:16:03.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.185+0000 7f1ad77fe640 1 -- 172.21.15.81:0/1828210235 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8032810 con 0x7f1ad806f630 2024-09-16T01:16:03.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.185+0000 7f19359f1640 1 -- 172.21.15.81:0/1825485474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19280354c0 msgr2=0x7f1928038940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.185+0000 7f19359f1640 1 --2- 172.21.15.81:0/1825485474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19280354c0 0x7f1928038940 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f193006a6a0 tx=0x7f19300a5fc0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.185+0000 7f880e1ea640 1 -- 172.21.15.81:0/2445012062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f4004800 msgr2=0x7f87f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.185+0000 7facaf7fe640 1 --2- 172.21.15.81:0/3876133189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facb00725f0 0x7facb015e1f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7facb00b0000 tx=0x7faca402a010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52af4cc69af7204a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.185+0000 7f880e1ea640 1 --2- 172.21.15.81:0/2445012062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f4004800 0x7f87f4004c80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f880000a760 tx=0x7f87f4005830 comp rx=0 tx=0).stop 2024-09-16T01:16:03.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f880e1ea640 1 -- 172.21.15.81:0/2445012062 shutdown_connections 2024-09-16T01:16:03.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f880e1ea640 1 --2- 172.21.15.81:0/2445012062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f4004800 0x7f87f4004c80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f880e1ea640 1 -- 172.21.15.81:0/2445012062 >> 172.21.15.81:0/2445012062 conn(0x7f880806f560 msgr2=0x7f880806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f19359f1640 1 -- 172.21.15.81:0/1825485474 shutdown_connections 2024-09-16T01:16:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f19359f1640 1 --2- 172.21.15.81:0/1825485474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19280354c0 0x7f1928038940 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f19359f1640 1 --2- 172.21.15.81:0/1825485474 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19280e09c0 0x7f19280556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f19359f1640 1 -- 172.21.15.81:0/1825485474 >> 172.21.15.81:0/1825485474 conn(0x7f19280567b0 msgr2=0x7f1928056bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f1adece6640 1 -- 172.21.15.81:0/1828210235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ad806f630 msgr2=0x7f1ad8162dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f1adece6640 1 --2- 172.21.15.81:0/1828210235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ad806f630 0x7f1ad8162dd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8070e50 tx=0x7f1ac802a1e0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f880e1ea640 1 -- 172.21.15.81:0/2445012062 shutdown_connections 2024-09-16T01:16:03.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f880e1ea640 1 -- 172.21.15.81:0/2445012062 wait complete. 2024-09-16T01:16:03.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7facaeffd640 1 -- 172.21.15.81:0/3876133189 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4037070 con 0x7facb00725f0 2024-09-16T01:16:03.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f19359f1640 1 -- 172.21.15.81:0/1825485474 shutdown_connections 2024-09-16T01:16:03.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f19359f1640 1 -- 172.21.15.81:0/1825485474 wait complete. 2024-09-16T01:16:03.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7facaeffd640 1 -- 172.21.15.81:0/3876133189 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca402aca0 con 0x7facb00725f0 2024-09-16T01:16:03.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7facaeffd640 1 -- 172.21.15.81:0/3876133189 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca4032660 con 0x7facb00725f0 2024-09-16T01:16:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f1adece6640 1 -- 172.21.15.81:0/1828210235 shutdown_connections 2024-09-16T01:16:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f1adece6640 1 --2- 172.21.15.81:0/1828210235 >> v2:172.21.15.102:3300/0 conn(0x7f1ad8163310 0x7f1ad81663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f1adece6640 1 --2- 172.21.15.81:0/1828210235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ad806f630 0x7f1ad8162dd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f1adece6640 1 --2- 172.21.15.81:0/1828210235 >> v2:172.21.15.81:3300/0 conn(0x7f1ad8148ca0 0x7f1ad806f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f1adece6640 1 -- 172.21.15.81:0/1828210235 >> 172.21.15.81:0/1828210235 conn(0x7f1ad806bc10 msgr2=0x7f1ad806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.186+0000 7f1adece6640 1 -- 172.21.15.81:0/1828210235 shutdown_connections 2024-09-16T01:16:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.187+0000 7facb64a4640 1 -- 172.21.15.81:0/3876133189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facb00725f0 msgr2=0x7facb015e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.187+0000 7facb64a4640 1 --2- 172.21.15.81:0/3876133189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facb00725f0 0x7facb015e1f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7facb00b0000 tx=0x7faca402a010 comp rx=0 tx=0).stop 2024-09-16T01:16:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.187+0000 7f1adece6640 1 -- 172.21.15.81:0/1828210235 wait complete. 2024-09-16T01:16:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.187+0000 7facb64a4640 1 -- 172.21.15.81:0/3876133189 shutdown_connections 2024-09-16T01:16:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.188+0000 7facb64a4640 1 --2- 172.21.15.81:0/3876133189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facb00725f0 0x7facb015e1f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.188+0000 7facb64a4640 1 --2- 172.21.15.81:0/3876133189 >> v2:172.21.15.81:3300/0 conn(0x7facb0154a00 0x7facb00720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.188+0000 7facb64a4640 1 -- 172.21.15.81:0/3876133189 >> 172.21.15.81:0/3876133189 conn(0x7facb0067d70 msgr2=0x7facb006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.188+0000 7f880e1ea640 1 Processor -- start 2024-09-16T01:16:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.188+0000 7facb64a4640 1 -- 172.21.15.81:0/3876133189 shutdown_connections 2024-09-16T01:16:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.188+0000 7facb64a4640 1 -- 172.21.15.81:0/3876133189 wait complete. 2024-09-16T01:16:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.188+0000 7f880e1ea640 1 -- start start 2024-09-16T01:16:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.188+0000 7f19359f1640 1 Processor -- start 2024-09-16T01:16:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.188+0000 7f1adece6640 1 Processor -- start 2024-09-16T01:16:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.188+0000 7f19359f1640 1 -- start start 2024-09-16T01:16:03.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.189+0000 7f1adece6640 1 -- start start 2024-09-16T01:16:03.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f880e1ea640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87f4004800 0x7f88080ab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f880e1ea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88080cea90 0x7f88080cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7facb64a4640 1 Processor -- start 2024-09-16T01:16:03.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f880c9e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88080cea90 0x7f88080cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f880c9e7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88080cea90 0x7f88080cef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41626/0 (socket says 172.21.15.81:41626) 2024-09-16T01:16:03.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f19359f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19280354c0 0x7f1928038840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7facb64a4640 1 -- start start 2024-09-16T01:16:03.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f19359f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1928035a80 0x7f192804a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f880c9e7640 1 -- 172.21.15.81:0/788216507 learned_addr learned my addr 172.21.15.81:0/788216507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f1adece6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ad806f630 0x7f1ad8147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f1adece6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad8148ca0 0x7f1ad80cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f1adece6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad8163310 0x7f1ad80c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f1adece6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8149080 con 0x7f1ad8148ca0 2024-09-16T01:16:03.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f1adece6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad80ced90 con 0x7f1ad8163310 2024-09-16T01:16:03.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f1adece6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad80ce760 con 0x7f1ad806f630 2024-09-16T01:16:03.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.190+0000 7f19359f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19280e09c0 0x7f19280c2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f19359f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19280514a0 con 0x7f1928035a80 2024-09-16T01:16:03.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f1ad7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad8148ca0 0x7f1ad80cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f19351f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19280e09c0 0x7f19280c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f19351f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19280e09c0 0x7f19280c2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:35948/0 (socket says 172.21.15.81:35948) 2024-09-16T01:16:03.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f19351f0640 1 -- 172.21.15.81:0/2647659020 learned_addr learned my addr 172.21.15.81:0/2647659020 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f192ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1928035a80 0x7f192804a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f19349ef640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19280354c0 0x7f1928038840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f19359f1640 1 -- 172.21.15.81:0/2647659020 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f19280e0da0 con 0x7f19280e09c0 2024-09-16T01:16:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f19359f1640 1 -- 172.21.15.81:0/2647659020 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1928051620 con 0x7f19280354c0 2024-09-16T01:16:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f1add283640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad8163310 0x7f1ad80c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f1adca82640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ad806f630 0x7f1ad8147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f1add283640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad8163310 0x7f1ad80c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:35932/0 (socket says 172.21.15.81:35932) 2024-09-16T01:16:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f1add283640 1 -- 172.21.15.81:0/3974694504 learned_addr learned my addr 172.21.15.81:0/3974694504 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7f880e1ea640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f880814f260 0x7f880814f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.191+0000 7facb64a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facb00725f0 0x7facb014f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facb64a4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7facb0154a00 0x7facb01512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f192ffff640 1 -- 172.21.15.81:0/2647659020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19280354c0 msgr2=0x7f1928038840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f192ffff640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19280354c0 0x7f1928038840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f192ffff640 1 -- 172.21.15.81:0/2647659020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19280e09c0 msgr2=0x7f19280c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f192ffff640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19280e09c0 0x7f19280c2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f192ffff640 1 -- 172.21.15.81:0/2647659020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19280db2a0 con 0x7f1928035a80 2024-09-16T01:16:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f1add283640 1 -- 172.21.15.81:0/3974694504 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ad806f630 msgr2=0x7f1ad8147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f1add283640 1 --2- 172.21.15.81:0/3974694504 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ad806f630 0x7f1ad8147ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f1add283640 1 -- 172.21.15.81:0/3974694504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad8148ca0 msgr2=0x7f1ad80cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facb64a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facb015e730 0x7facb00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facb64a4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7facb015b460 con 0x7facb00725f0 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facb64a4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7facb015b180 con 0x7facb015e730 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facb64a4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7facb0154de0 con 0x7facb0154a00 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facaffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facb00725f0 0x7facb014f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facaffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facb00725f0 0x7facb014f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41660/0 (socket says 172.21.15.81:41660) 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facaffff640 1 -- 172.21.15.81:0/3889365175 learned_addr learned my addr 172.21.15.81:0/3889365175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facaf7fe640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7facb0154a00 0x7facb01512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facb4a41640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facb015e730 0x7facb00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facaffff640 1 -- 172.21.15.81:0/3889365175 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7facb0154a00 msgr2=0x7facb01512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facaffff640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7facb0154a00 0x7facb01512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facaffff640 1 -- 172.21.15.81:0/3889365175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facb015e730 msgr2=0x7facb00b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facaffff640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facb015e730 0x7facb00b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facaffff640 1 -- 172.21.15.81:0/3889365175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb013f990 con 0x7facb00725f0 2024-09-16T01:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f192ffff640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1928035a80 0x7f192804a250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f191c00c780 tx=0x7f191c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7facaffff640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facb00725f0 0x7facb014f880 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faca000e840 tx=0x7faca000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f880d1e8640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87f4004800 0x7f88080ab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f1add283640 1 --2- 172.21.15.81:0/3974694504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad8148ca0 0x7f1ad80cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8808073600 con 0x7f88080cea90 2024-09-16T01:16:03.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f88080730e0 con 0x7f880814f260 2024-09-16T01:16:03.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.192+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8808073780 con 0x7f87f4004800 2024-09-16T01:16:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f192d7fa640 1 -- 172.21.15.81:0/2647659020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c018070 con 0x7f1928035a80 2024-09-16T01:16:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f192d7fa640 1 -- 172.21.15.81:0/2647659020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c0070d0 con 0x7f1928035a80 2024-09-16T01:16:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f880c9e7640 1 -- 172.21.15.81:0/788216507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87f4004800 msgr2=0x7f88080ab2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f880c9e7640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87f4004800 0x7f88080ab2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f880d9e9640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f880814f260 0x7f880814f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f880c9e7640 1 -- 172.21.15.81:0/788216507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f880814f260 msgr2=0x7f880814f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f192d7fa640 1 -- 172.21.15.81:0/2647659020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c007500 con 0x7f1928035a80 2024-09-16T01:16:03.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f19359f1640 1 -- 172.21.15.81:0/2647659020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19280db540 con 0x7f1928035a80 2024-09-16T01:16:03.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f880c9e7640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f880814f260 0x7f880814f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f880c9e7640 1 -- 172.21.15.81:0/788216507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8808151030 con 0x7f88080cea90 2024-09-16T01:16:03.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7facacff9640 1 -- 172.21.15.81:0/3889365175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca000f040 con 0x7facb00725f0 2024-09-16T01:16:03.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7facacff9640 1 -- 172.21.15.81:0/3889365175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca0004230 con 0x7facb00725f0 2024-09-16T01:16:03.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f19359f1640 1 -- 172.21.15.81:0/2647659020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19280363b0 con 0x7f1928035a80 2024-09-16T01:16:03.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f1add283640 1 -- 172.21.15.81:0/3974694504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad80c5be0 con 0x7f1ad8163310 2024-09-16T01:16:03.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.193+0000 7f1add283640 1 --2- 172.21.15.81:0/3974694504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad8163310 0x7f1ad80c6c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0007e70 tx=0x7f1ad000d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.194+0000 7f880d1e8640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87f4004800 0x7f88080ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.194+0000 7f1ad57fa640 1 -- 172.21.15.81:0/3974694504 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad001a070 con 0x7f1ad8163310 2024-09-16T01:16:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.194+0000 7facacff9640 1 -- 172.21.15.81:0/3889365175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca000c6d0 con 0x7facb00725f0 2024-09-16T01:16:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.194+0000 7facb64a4640 1 -- 172.21.15.81:0/3889365175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb013fc70 con 0x7facb00725f0 2024-09-16T01:16:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.194+0000 7facb64a4640 1 -- 172.21.15.81:0/3889365175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb0140230 con 0x7facb00725f0 2024-09-16T01:16:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.195+0000 7facb64a4640 1 -- 172.21.15.81:0/3889365175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb015eba0 con 0x7facb00725f0 2024-09-16T01:16:03.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.194+0000 7f1adece6640 1 -- 172.21.15.81:0/3974694504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad80c5ee0 con 0x7f1ad8163310 2024-09-16T01:16:03.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.194+0000 7f1adece6640 1 -- 172.21.15.81:0/3974694504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad80c6720 con 0x7f1ad8163310 2024-09-16T01:16:03.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.195+0000 7f1ad57fa640 1 -- 172.21.15.81:0/3974694504 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad0003bb0 con 0x7f1ad8163310 2024-09-16T01:16:03.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.195+0000 7f1ad57fa640 1 -- 172.21.15.81:0/3974694504 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad0004030 con 0x7f1ad8163310 2024-09-16T01:16:03.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.197+0000 7f192d7fa640 1 -- 172.21.15.81:0/2647659020 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f191c01b070 con 0x7f1928035a80 2024-09-16T01:16:03.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.197+0000 7f192d7fa640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f191406c380 0x7f191406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.197+0000 7f192d7fa640 1 -- 172.21.15.81:0/2647659020 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f191c08aa70 con 0x7f1928035a80 2024-09-16T01:16:03.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.196+0000 7f191affd640 1 -- 172.21.15.81:0/2647659020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19280365b0 con 0x7f1928035a80 2024-09-16T01:16:03.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.197+0000 7facacff9640 1 -- 172.21.15.81:0/3889365175 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faca000c870 con 0x7facb00725f0 2024-09-16T01:16:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.198+0000 7facacff9640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fac9c06c380 0x7fac9c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.198+0000 7facacff9640 1 -- 172.21.15.81:0/3889365175 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faca008ba00 con 0x7facb00725f0 2024-09-16T01:16:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.198+0000 7facaf7fe640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fac9c06c380 0x7fac9c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.199+0000 7f19349ef640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f191406c380 0x7f191406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.199+0000 7f1adece6640 1 -- 172.21.15.81:0/3974694504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab8005290 con 0x7f1ad8163310 2024-09-16T01:16:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.194+0000 7f880c9e7640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88080cea90 0x7f88080cef10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f880000a880 tx=0x7f8808072cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.197+0000 7f87fdffb640 1 -- 172.21.15.81:0/788216507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880000a3b0 con 0x7f88080cea90 2024-09-16T01:16:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.197+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880814ff90 con 0x7f88080cea90 2024-09-16T01:16:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.197+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8808150550 con 0x7f88080cea90 2024-09-16T01:16:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.197+0000 7f87fdffb640 1 -- 172.21.15.81:0/788216507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8800043070 con 0x7f88080cea90 2024-09-16T01:16:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.197+0000 7f87fdffb640 1 -- 172.21.15.81:0/788216507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800034670 con 0x7f88080cea90 2024-09-16T01:16:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.199+0000 7facaf7fe640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fac9c06c380 0x7fac9c06e840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faca4034000 tx=0x7faca402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.200+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e8005290 con 0x7f88080cea90 2024-09-16T01:16:03.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.200+0000 7f19349ef640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f191406c380 0x7f191406e840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1924005990 tx=0x7f1924018040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.201+0000 7f1ad57fa640 1 -- 172.21.15.81:0/3974694504 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1ad001d070 con 0x7f1ad8163310 2024-09-16T01:16:03.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.201+0000 7f1ad57fa640 1 --2- 172.21.15.81:0/3974694504 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ac406c380 0x7f1ac406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.201+0000 7f1ad57fa640 1 -- 172.21.15.81:0/3974694504 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1ad008b970 con 0x7f1ad8163310 2024-09-16T01:16:03.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.201+0000 7f1adca82640 1 --2- 172.21.15.81:0/3974694504 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ac406c380 0x7f1ac406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.202+0000 7f1adca82640 1 --2- 172.21.15.81:0/3974694504 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ac406c380 0x7f1ac406e840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0098f0 tx=0x7f1acc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.206+0000 7f1ad57fa640 1 -- 172.21.15.81:0/3974694504 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ad80c5ee0 con 0x7f1ad8163310 2024-09-16T01:16:03.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.206+0000 7facacff9640 1 -- 172.21.15.81:0/3889365175 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faca0017020 con 0x7facb00725f0 2024-09-16T01:16:03.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.209+0000 7f87fdffb640 1 -- 172.21.15.81:0/788216507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8800034810 con 0x7f88080cea90 2024-09-16T01:16:03.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.209+0000 7f87fdffb640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f87ec06c2e0 0x7f87ec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.210+0000 7f880d1e8640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f87ec06c2e0 0x7f87ec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.210+0000 7f880d1e8640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f87ec06c2e0 0x7f87ec06e7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8804006fd0 tx=0x7f8804008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.214+0000 7f192d7fa640 1 -- 172.21.15.81:0/2647659020 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19280365b0 con 0x7f1928035a80 2024-09-16T01:16:03.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.214+0000 7f87fdffb640 1 -- 172.21.15.81:0/788216507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f880003fe00 con 0x7f88080cea90 2024-09-16T01:16:03.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.223+0000 7f87fdffb640 1 -- 172.21.15.81:0/788216507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f880007b230 con 0x7f88080cea90 2024-09-16T01:16:03.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.469+0000 7fc2d2796640 1 -- 172.21.15.81:0/1402778099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc2ac005580 con 0x7fc2c40551b0 2024-09-16T01:16:03.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.470+0000 7fc2c1ffb640 1 -- 172.21.15.81:0/1402778099 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc2c805cab0 con 0x7fc2c40551b0 2024-09-16T01:16:03.471 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:03.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.474+0000 7fc2b77fe640 1 -- 172.21.15.81:0/1402778099 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc2b006c380 msgr2=0x7fc2b006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.474+0000 7fc2b77fe640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc2b006c380 0x7fc2b006e840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009c00 tx=0x7fc2bc008040 comp rx=0 tx=0).stop 2024-09-16T01:16:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.474+0000 7fc2b77fe640 1 -- 172.21.15.81:0/1402778099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2c40551b0 msgr2=0x7fc2c401e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.474+0000 7fc2b77fe640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2c40551b0 0x7fc2c401e2a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c4b0 tx=0x7fc2c800c970 comp rx=0 tx=0).stop 2024-09-16T01:16:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.474+0000 7fc2b77fe640 1 -- 172.21.15.81:0/1402778099 shutdown_connections 2024-09-16T01:16:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.475+0000 7fc2b77fe640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc2b006c380 0x7fc2b006e840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.475+0000 7fc2b77fe640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2c40e18f0 0x7fc2c4185410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.475+0000 7fc2b77fe640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2c40551b0 0x7fc2c401e2a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.475+0000 7fc2b77fe640 1 --2- 172.21.15.81:0/1402778099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2c404ff50 0x7fc2c404a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.475+0000 7fc2b77fe640 1 -- 172.21.15.81:0/1402778099 >> 172.21.15.81:0/1402778099 conn(0x7fc2c401d930 msgr2=0x7fc2c40049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.475+0000 7fc2b77fe640 1 -- 172.21.15.81:0/1402778099 shutdown_connections 2024-09-16T01:16:03.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.475+0000 7fc2b77fe640 1 -- 172.21.15.81:0/1402778099 wait complete. 2024-09-16T01:16:03.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-09-16T01:16:03.492 DEBUG:teuthology.parallel:result is None 2024-09-16T01:16:03.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.505+0000 7f2ea593f640 1 -- 172.21.15.81:0/3782527413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2e80005850 con 0x7f2ea006f650 2024-09-16T01:16:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.505+0000 7f2e9d7fa640 1 -- 172.21.15.81:0/3782527413 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2e9005de20 con 0x7f2ea006f650 2024-09-16T01:16:03.506 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.508+0000 7f2ea593f640 1 -- 172.21.15.81:0/3782527413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e8c06c3b0 msgr2=0x7f2e8c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.508+0000 7f2ea593f640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e8c06c3b0 0x7f2e8c06e870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2e98034000 tx=0x7f2e98009000 comp rx=0 tx=0).stop 2024-09-16T01:16:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.508+0000 7f2ea593f640 1 -- 172.21.15.81:0/3782527413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea006f650 msgr2=0x7f2ea00ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.508+0000 7f2ea593f640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea006f650 0x7f2ea00ade00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c400 tx=0x7f2e9000c8c0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.508+0000 7f2ea593f640 1 -- 172.21.15.81:0/3782527413 shutdown_connections 2024-09-16T01:16:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.508+0000 7f2ea593f640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e8c06c3b0 0x7f2e8c06e870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.508+0000 7f2ea593f640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ea015c6b0 0x7f2ea0172f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.508+0000 7f2ea593f640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea00b2920 0x7f2ea0157070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.508+0000 7f2ea593f640 1 --2- 172.21.15.81:0/3782527413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea006f650 0x7f2ea00ade00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.508+0000 7f2ea593f640 1 -- 172.21.15.81:0/3782527413 >> 172.21.15.81:0/3782527413 conn(0x7f2ea00b1e00 msgr2=0x7f2ea00cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.508+0000 7f2ea593f640 1 -- 172.21.15.81:0/3782527413 shutdown_connections 2024-09-16T01:16:03.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.508+0000 7f2ea593f640 1 -- 172.21.15.81:0/3782527413 wait complete. 2024-09-16T01:16:03.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-09-16T01:16:03.520 DEBUG:teuthology.parallel:result is None 2024-09-16T01:16:03.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.533+0000 7f462f8b7640 1 -- 172.21.15.81:0/3652978422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f46280d42b0 con 0x7f4628161c80 2024-09-16T01:16:03.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.533+0000 7f461dffb640 1 -- 172.21.15.81:0/3652978422 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4624062150 con 0x7f4628161c80 2024-09-16T01:16:03.534 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:03.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.533+0000 7f21addbe640 1 -- 172.21.15.81:0/1701528600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f218c005850 con 0x7f21a80701a0 2024-09-16T01:16:03.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.534+0000 7f21a4ff9640 1 -- 172.21.15.81:0/1701528600 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2198058f20 con 0x7f21a80701a0 2024-09-16T01:16:03.535 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-16T01:16:03.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.536+0000 7f462f8b7640 1 -- 172.21.15.81:0/3652978422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f460c06c380 msgr2=0x7f460c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.536+0000 7f462f8b7640 1 --2- 172.21.15.81:0/3652978422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f460c06c380 0x7f460c06e840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4620009c90 tx=0x7f4620009000 comp rx=0 tx=0).stop 2024-09-16T01:16:03.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.536+0000 7f462f8b7640 1 -- 172.21.15.81:0/3652978422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628161c80 msgr2=0x7f46281f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.536+0000 7f462f8b7640 1 --2- 172.21.15.81:0/3652978422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628161c80 0x7f46281f3b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4624014f40 tx=0x7f4624007410 comp rx=0 tx=0).stop 2024-09-16T01:16:03.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.536+0000 7f462f8b7640 1 -- 172.21.15.81:0/3652978422 shutdown_connections 2024-09-16T01:16:03.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.536+0000 7f462f8b7640 1 --2- 172.21.15.81:0/3652978422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f460c06c380 0x7f460c06e840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.536+0000 7f462f8b7640 1 --2- 172.21.15.81:0/3652978422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4628162060 0x7f46280c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.536+0000 7f462f8b7640 1 --2- 172.21.15.81:0/3652978422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4628161c80 0x7f46281f3b80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.536+0000 7f462f8b7640 1 --2- 172.21.15.81:0/3652978422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46280b64b0 0x7f46280cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.536+0000 7f462f8b7640 1 -- 172.21.15.81:0/3652978422 >> 172.21.15.81:0/3652978422 conn(0x7f46280d44f0 msgr2=0x7f46280b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f21addbe640 1 -- 172.21.15.81:0/1701528600 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f218806c2e0 msgr2=0x7f218806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f462f8b7640 1 -- 172.21.15.81:0/3652978422 shutdown_connections 2024-09-16T01:16:03.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f462f8b7640 1 -- 172.21.15.81:0/3652978422 wait complete. 2024-09-16T01:16:03.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f21addbe640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f218806c2e0 0x7f218806e7a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2190033000 tx=0x7f219002e000 comp rx=0 tx=0).stop 2024-09-16T01:16:03.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f21addbe640 1 -- 172.21.15.81:0/1701528600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a80701a0 msgr2=0x7f21a8159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f21addbe640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a80701a0 0x7f21a8159840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f219800ba50 tx=0x7f219800bf10 comp rx=0 tx=0).stop 2024-09-16T01:16:03.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f21addbe640 1 -- 172.21.15.81:0/1701528600 shutdown_connections 2024-09-16T01:16:03.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f21addbe640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f218806c2e0 0x7f218806e7a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f21addbe640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f21a8154a00 0x7f21a81f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f21addbe640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f21a80727c0 0x7f21a81f3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f21addbe640 1 --2- 172.21.15.81:0/1701528600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21a80701a0 0x7f21a8159840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f21addbe640 1 -- 172.21.15.81:0/1701528600 >> 172.21.15.81:0/1701528600 conn(0x7f21a8067d70 msgr2=0x7f21a815bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f21addbe640 1 -- 172.21.15.81:0/1701528600 shutdown_connections 2024-09-16T01:16:03.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.537+0000 7f21addbe640 1 -- 172.21.15.81:0/1701528600 wait complete. 2024-09-16T01:16:03.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-09-16T01:16:03.554 DEBUG:teuthology.parallel:result is None 2024-09-16T01:16:03.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-09-16T01:16:03.555 DEBUG:teuthology.parallel:result is None 2024-09-16T01:16:03.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.572+0000 7facb64a4640 1 -- 172.21.15.81:0/3889365175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7facb00afde0 con 0x7facb00725f0 2024-09-16T01:16:03.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.572+0000 7facacff9640 1 -- 172.21.15.81:0/3889365175 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faca0059730 con 0x7facb00725f0 2024-09-16T01:16:03.573 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:03.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.574+0000 7facb64a4640 1 -- 172.21.15.81:0/3889365175 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fac9c06c380 msgr2=0x7fac9c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.574+0000 7facb64a4640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fac9c06c380 0x7fac9c06e840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faca4034000 tx=0x7faca402e000 comp rx=0 tx=0).stop 2024-09-16T01:16:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.574+0000 7facb64a4640 1 -- 172.21.15.81:0/3889365175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facb00725f0 msgr2=0x7facb014f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.574+0000 7facb64a4640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facb00725f0 0x7facb014f880 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faca000e840 tx=0x7faca000ed00 comp rx=0 tx=0).stop 2024-09-16T01:16:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.574+0000 7facb64a4640 1 -- 172.21.15.81:0/3889365175 shutdown_connections 2024-09-16T01:16:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.574+0000 7facb64a4640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fac9c06c380 0x7fac9c06e840 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.574+0000 7facb64a4640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facb015e730 0x7facb00b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.574+0000 7facb64a4640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7facb0154a00 0x7facb01512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.574+0000 7facb64a4640 1 --2- 172.21.15.81:0/3889365175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facb00725f0 0x7facb014f880 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.574+0000 7facb64a4640 1 -- 172.21.15.81:0/3889365175 >> 172.21.15.81:0/3889365175 conn(0x7facb0067d70 msgr2=0x7facb015d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.575+0000 7facb64a4640 1 -- 172.21.15.81:0/3889365175 shutdown_connections 2024-09-16T01:16:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.575+0000 7facb64a4640 1 -- 172.21.15.81:0/3889365175 wait complete. 2024-09-16T01:16:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.575+0000 7f1adece6640 1 -- 172.21.15.81:0/3974694504 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1ab8005580 con 0x7f1ad8163310 2024-09-16T01:16:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.576+0000 7f1ad57fa640 1 -- 172.21.15.81:0/3974694504 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ad0010070 con 0x7f1ad8163310 2024-09-16T01:16:03.577 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-16T01:16:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.578+0000 7f1adece6640 1 -- 172.21.15.81:0/3974694504 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ac406c380 msgr2=0x7f1ac406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.578+0000 7f1adece6640 1 --2- 172.21.15.81:0/3974694504 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ac406c380 0x7f1ac406e840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1acc0098f0 tx=0x7f1acc008040 comp rx=0 tx=0).stop 2024-09-16T01:16:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.578+0000 7f1adece6640 1 -- 172.21.15.81:0/3974694504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad8163310 msgr2=0x7f1ad80c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.578+0000 7f1adece6640 1 --2- 172.21.15.81:0/3974694504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad8163310 0x7f1ad80c6c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0007e70 tx=0x7f1ad000d4a0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.578+0000 7f1adece6640 1 -- 172.21.15.81:0/3974694504 shutdown_connections 2024-09-16T01:16:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.578+0000 7f1adece6640 1 --2- 172.21.15.81:0/3974694504 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ac406c380 0x7f1ac406e840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.578+0000 7f1adece6640 1 --2- 172.21.15.81:0/3974694504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ad8163310 0x7f1ad80c6c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.578+0000 7f1adece6640 1 --2- 172.21.15.81:0/3974694504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ad8148ca0 0x7f1ad80cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.578+0000 7f1adece6640 1 --2- 172.21.15.81:0/3974694504 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ad806f630 0x7f1ad8147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.578+0000 7f1adece6640 1 -- 172.21.15.81:0/3974694504 >> 172.21.15.81:0/3974694504 conn(0x7f1ad806bc10 msgr2=0x7f1ad806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.578+0000 7f1adece6640 1 -- 172.21.15.81:0/3974694504 shutdown_connections 2024-09-16T01:16:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.578+0000 7f1adece6640 1 -- 172.21.15.81:0/3974694504 wait complete. 2024-09-16T01:16:03.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-09-16T01:16:03.588 DEBUG:teuthology.parallel:result is None 2024-09-16T01:16:03.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-09-16T01:16:03.590 DEBUG:teuthology.parallel:result is None 2024-09-16T01:16:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.610+0000 7f191affd640 1 -- 172.21.15.81:0/2647659020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1928056d20 con 0x7f1928035a80 2024-09-16T01:16:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.610+0000 7f192d7fa640 1 -- 172.21.15.81:0/2647659020 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1928038e80 con 0x7f1928035a80 2024-09-16T01:16:03.611 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.612+0000 7f191affd640 1 -- 172.21.15.81:0/2647659020 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f191406c380 msgr2=0x7f191406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.612+0000 7f191affd640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f191406c380 0x7f191406e840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1924005990 tx=0x7f1924018040 comp rx=0 tx=0).stop 2024-09-16T01:16:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.612+0000 7f191affd640 1 -- 172.21.15.81:0/2647659020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1928035a80 msgr2=0x7f192804a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.612+0000 7f191affd640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1928035a80 0x7f192804a250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f191c00c780 tx=0x7f191c00cc40 comp rx=0 tx=0).stop 2024-09-16T01:16:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.612+0000 7f191affd640 1 -- 172.21.15.81:0/2647659020 shutdown_connections 2024-09-16T01:16:03.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.612+0000 7f191affd640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f191406c380 0x7f191406e840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.612+0000 7f191affd640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19280e09c0 0x7f19280c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.612+0000 7f191affd640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1928035a80 0x7f192804a250 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.612+0000 7f191affd640 1 --2- 172.21.15.81:0/2647659020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19280354c0 0x7f1928038840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.612+0000 7f191affd640 1 -- 172.21.15.81:0/2647659020 >> 172.21.15.81:0/2647659020 conn(0x7f19280567b0 msgr2=0x7f192800cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.612+0000 7f191affd640 1 -- 172.21.15.81:0/2647659020 shutdown_connections 2024-09-16T01:16:03.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.612+0000 7f191affd640 1 -- 172.21.15.81:0/2647659020 wait complete. 2024-09-16T01:16:03.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.614+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f87e8005850 con 0x7f88080cea90 2024-09-16T01:16:03.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.615+0000 7f87fdffb640 1 -- 172.21.15.81:0/788216507 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f880007ab30 con 0x7f88080cea90 2024-09-16T01:16:03.615 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-16T01:16:03.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.617+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f87ec06c2e0 msgr2=0x7f87ec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.617+0000 7f880e1ea640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f87ec06c2e0 0x7f87ec06e7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8804006fd0 tx=0x7f8804008040 comp rx=0 tx=0).stop 2024-09-16T01:16:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.617+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88080cea90 msgr2=0x7f88080cef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.617+0000 7f880e1ea640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88080cea90 0x7f88080cef10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f880000a880 tx=0x7f8808072cf0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.617+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 shutdown_connections 2024-09-16T01:16:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.617+0000 7f880e1ea640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f87ec06c2e0 0x7f87ec06e7a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.617+0000 7f880e1ea640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f880814f260 0x7f880814f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.617+0000 7f880e1ea640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88080cea90 0x7f88080cef10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.617+0000 7f880e1ea640 1 --2- 172.21.15.81:0/788216507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87f4004800 0x7f88080ab2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.617+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 >> 172.21.15.81:0/788216507 conn(0x7f880806f560 msgr2=0x7f88080afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.617+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 shutdown_connections 2024-09-16T01:16:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.617+0000 7f880e1ea640 1 -- 172.21.15.81:0/788216507 wait complete. 2024-09-16T01:16:03.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-09-16T01:16:03.625 DEBUG:teuthology.parallel:result is None 2024-09-16T01:16:03.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-09-16T01:16:03.629 DEBUG:teuthology.parallel:result is None 2024-09-16T01:16:03.629 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:16:03.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:16:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.769+0000 7fe4c3ad0640 1 Processor -- start 2024-09-16T01:16:03.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.769+0000 7fe4c3ad0640 1 -- start start 2024-09-16T01:16:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.770+0000 7fe4c3ad0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe4bc0b69d0 0x7fe4bc162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.770+0000 7fe4c3ad0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4bc0b0180 0x7fe4bc154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.770+0000 7fe4c3ad0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4bc15eb60 con 0x7fe4bc0af280 2024-09-16T01:16:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.770+0000 7fe4c3ad0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe4bc0b6db0 con 0x7fe4bc0b0180 2024-09-16T01:16:03.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.770+0000 7fe4c3ad0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe4bc15ee40 con 0x7fe4bc0b69d0 2024-09-16T01:16:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.770+0000 7fe4c206d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4bc0b0180 0x7fe4bc154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.770+0000 7fe4c206d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4bc0b0180 0x7fe4bc154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41666/0 (socket says 172.21.15.81:41666) 2024-09-16T01:16:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.770+0000 7fe4c206d640 1 -- 172.21.15.81:0/1102593617 learned_addr learned my addr 172.21.15.81:0/1102593617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.770+0000 7fe4c186c640 1 --2- 172.21.15.81:0/1102593617 >> v2:172.21.15.102:3300/0 conn(0x7fe4bc0b69d0 0x7fe4bc162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.771+0000 7fe4c206d640 1 -- 172.21.15.81:0/1102593617 >> v2:172.21.15.102:3300/0 conn(0x7fe4bc0b69d0 msgr2=0x7fe4bc162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.771+0000 7fe4c206d640 1 --2- 172.21.15.81:0/1102593617 >> v2:172.21.15.102:3300/0 conn(0x7fe4bc0b69d0 0x7fe4bc162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.771+0000 7fe4c206d640 1 -- 172.21.15.81:0/1102593617 >> v1:172.21.15.102:6789/0 conn(0x7fe4bc0af280 legacy=0x7fe4bc0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.771+0000 7fe4c206d640 1 -- 172.21.15.81:0/1102593617 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc15f120 con 0x7fe4bc0b0180 2024-09-16T01:16:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.771+0000 7fe4c206d640 1 --2- 172.21.15.81:0/1102593617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc0b0180 0x7fe4bc154d00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc070980 tx=0x7fe4b402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0bd302fc6857ff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.771+0000 7fe4c086a640 1 -- 172.21.15.81:0/1102593617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4036070 con 0x7fe4bc0b0180 2024-09-16T01:16:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.771+0000 7fe4c086a640 1 -- 172.21.15.81:0/1102593617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b4031600 con 0x7fe4bc0b0180 2024-09-16T01:16:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.772+0000 7fe4c086a640 1 -- 172.21.15.81:0/1102593617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40319d0 con 0x7fe4bc0b0180 2024-09-16T01:16:03.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.772+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1102593617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc0b0180 msgr2=0x7fe4bc154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.772+0000 7fe4c3ad0640 1 --2- 172.21.15.81:0/1102593617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc0b0180 0x7fe4bc154d00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc070980 tx=0x7fe4b402a5d0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.772+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1102593617 shutdown_connections 2024-09-16T01:16:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.772+0000 7fe4c3ad0640 1 --2- 172.21.15.81:0/1102593617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc0b0180 0x7fe4bc154d00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.772+0000 7fe4c3ad0640 1 --2- 172.21.15.81:0/1102593617 >> v2:172.21.15.102:3300/0 conn(0x7fe4bc0b69d0 0x7fe4bc162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.772+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1102593617 >> 172.21.15.81:0/1102593617 conn(0x7fe4bc06bc10 msgr2=0x7fe4bc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.772+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1102593617 shutdown_connections 2024-09-16T01:16:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.772+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1102593617 wait complete. 2024-09-16T01:16:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.773+0000 7fe4c3ad0640 1 Processor -- start 2024-09-16T01:16:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.773+0000 7fe4c3ad0640 1 -- start start 2024-09-16T01:16:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c3ad0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc0af280 0x7fe4bc153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c3ad0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc0b0180 0x7fe4bc141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c3ad0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc0b69d0 0x7fe4bc13e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c3ad0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc155240 con 0x7fe4bc0b69d0 2024-09-16T01:16:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c3ad0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc0af710 con 0x7fe4bc0af280 2024-09-16T01:16:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c3ad0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe4bc1553c0 con 0x7fe4bc0b0180 2024-09-16T01:16:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c206d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc0b69d0 0x7fe4bc13e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c206d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc0b69d0 0x7fe4bc13e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41668/0 (socket says 172.21.15.81:41668) 2024-09-16T01:16:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c206d640 1 -- 172.21.15.81:0/1385121715 learned_addr learned my addr 172.21.15.81:0/1385121715 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c186c640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc0af280 0x7fe4bc153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c106b640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc0b0180 0x7fe4bc141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c206d640 1 -- 172.21.15.81:0/1385121715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc0b0180 msgr2=0x7fe4bc141740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c206d640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc0b0180 0x7fe4bc141740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c206d640 1 -- 172.21.15.81:0/1385121715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc0af280 msgr2=0x7fe4bc153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c206d640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc0af280 0x7fe4bc153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.774+0000 7fe4c206d640 1 -- 172.21.15.81:0/1385121715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc141c80 con 0x7fe4bc0b69d0 2024-09-16T01:16:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.775+0000 7fe4c206d640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc0b69d0 0x7fe4bc13e3f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009f40 tx=0x7fe4b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.775+0000 7fe4b27fc640 1 -- 172.21.15.81:0/1385121715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4036050 con 0x7fe4bc0b69d0 2024-09-16T01:16:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.775+0000 7fe4b27fc640 1 -- 172.21.15.81:0/1385121715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b4042070 con 0x7fe4bc0b69d0 2024-09-16T01:16:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.775+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1385121715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4bc152a50 con 0x7fe4bc0b69d0 2024-09-16T01:16:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.775+0000 7fe4b27fc640 1 -- 172.21.15.81:0/1385121715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4007bd0 con 0x7fe4bc0b69d0 2024-09-16T01:16:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.775+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1385121715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4bc153010 con 0x7fe4bc0b69d0 2024-09-16T01:16:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.776+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1385121715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4bc155780 con 0x7fe4bc0b69d0 2024-09-16T01:16:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.776+0000 7fe4b27fc640 1 -- 172.21.15.81:0/1385121715 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe4b4047460 con 0x7fe4bc0b69d0 2024-09-16T01:16:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.777+0000 7fe4b27fc640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a006c2b0 0x7fe4a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.777+0000 7fe4c186c640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a006c2b0 0x7fe4a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.777+0000 7fe4b27fc640 1 -- 172.21.15.81:0/1385121715 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe4b40ac4d0 con 0x7fe4bc0b69d0 2024-09-16T01:16:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.777+0000 7fe4c186c640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a006c2b0 0x7fe4a006e770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc1e9a00 tx=0x7fe4b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:03.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.781+0000 7fe4b27fc640 1 -- 172.21.15.81:0/1385121715 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe4bc141c80 con 0x7fe4bc0b69d0 2024-09-16T01:16:03.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.946+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1385121715 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4bc13e930 con 0x7fe4a006c2b0 2024-09-16T01:16:03.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.954+0000 7fe4b27fc640 1 -- 172.21.15.81:0/1385121715 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fe4bc13e930 con 0x7fe4a006c2b0 2024-09-16T01:16:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:16:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.957+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1385121715 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a006c2b0 msgr2=0x7fe4a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.957+0000 7fe4c3ad0640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a006c2b0 0x7fe4a006e770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc1e9a00 tx=0x7fe4b8008040 comp rx=0 tx=0).stop 2024-09-16T01:16:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.957+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1385121715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc0b69d0 msgr2=0x7fe4bc13e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.957+0000 7fe4c3ad0640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc0b69d0 0x7fe4bc13e3f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009f40 tx=0x7fe4b4004a40 comp rx=0 tx=0).stop 2024-09-16T01:16:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.957+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1385121715 shutdown_connections 2024-09-16T01:16:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.957+0000 7fe4c3ad0640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a006c2b0 0x7fe4a006e770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.957+0000 7fe4c3ad0640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc0b69d0 0x7fe4bc13e3f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.957+0000 7fe4c3ad0640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc0b0180 0x7fe4bc141740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.957+0000 7fe4c3ad0640 1 --2- 172.21.15.81:0/1385121715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc0af280 0x7fe4bc153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.957+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1385121715 >> 172.21.15.81:0/1385121715 conn(0x7fe4bc06bc10 msgr2=0x7fe4bc154120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.957+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1385121715 shutdown_connections 2024-09-16T01:16:03.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:03.957+0000 7fe4c3ad0640 1 -- 172.21.15.81:0/1385121715 wait complete. 2024-09-16T01:16:03.969 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-16T01:16:02.063235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219432,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755288,"statfs":{"total":773094113280,"available":772869414912,"internally_reserved":0,"allocated":3284992,"data_stored":1992068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003475"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747622+0000","last_change":"2024-09-16T01:15:38.721067+0000","last_active":"2024-09-16T01:15:44.747622+0000","last_peered":"2024-09-16T01:15:44.747622+0000","last_clean":"2024-09-16T01:15:44.747622+0000","last_became_active":"2024-09-16T01:15:38.720869+0000","last_became_peered":"2024-09-16T01:15:38.720869+0000","last_unstale":"2024-09-16T01:15:44.747622+0000","last_undegraded":"2024-09-16T01:15:44.747622+0000","last_fullsized":"2024-09-16T01:15:44.747622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:37.356692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922559+0000","last_change":"2024-09-16T01:15:39.720014+0000","last_active":"2024-09-16T01:15:44.922559+0000","last_peered":"2024-09-16T01:15:44.922559+0000","last_clean":"2024-09-16T01:15:44.922559+0000","last_became_active":"2024-09-16T01:15:39.719700+0000","last_became_peered":"2024-09-16T01:15:39.719700+0000","last_unstale":"2024-09-16T01:15:44.922559+0000","last_undegraded":"2024-09-16T01:15:44.922559+0000","last_fullsized":"2024-09-16T01:15:44.922559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:15.851594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921951+0000","last_change":"2024-09-16T01:15:43.919879+0000","last_active":"2024-09-16T01:15:44.921951+0000","last_peered":"2024-09-16T01:15:44.921951+0000","last_clean":"2024-09-16T01:15:44.921951+0000","last_became_active":"2024-09-16T01:15:43.919471+0000","last_became_peered":"2024-09-16T01:15:43.919471+0000","last_unstale":"2024-09-16T01:15:44.921951+0000","last_undegraded":"2024-09-16T01:15:44.921951+0000","last_fullsized":"2024-09-16T01:15:44.921951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:48.711431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922637+0000","last_change":"2024-09-16T01:15:38.718512+0000","last_active":"2024-09-16T01:15:44.922637+0000","last_peered":"2024-09-16T01:15:44.922637+0000","last_clean":"2024-09-16T01:15:44.922637+0000","last_became_active":"2024-09-16T01:15:38.718193+0000","last_became_peered":"2024-09-16T01:15:38.718193+0000","last_unstale":"2024-09-16T01:15:44.922637+0000","last_undegraded":"2024-09-16T01:15:44.922637+0000","last_fullsized":"2024-09-16T01:15:44.922637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:36.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747347+0000","last_change":"2024-09-16T01:15:39.730526+0000","last_active":"2024-09-16T01:15:44.747347+0000","last_peered":"2024-09-16T01:15:44.747347+0000","last_clean":"2024-09-16T01:15:44.747347+0000","last_became_active":"2024-09-16T01:15:39.729904+0000","last_became_peered":"2024-09-16T01:15:39.729904+0000","last_unstale":"2024-09-16T01:15:44.747347+0000","last_undegraded":"2024-09-16T01:15:44.747347+0000","last_fullsized":"2024-09-16T01:15:44.747347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944132+0000","last_change":"2024-09-16T01:15:43.764125+0000","last_active":"2024-09-16T01:15:45.944132+0000","last_peered":"2024-09-16T01:15:45.944132+0000","last_clean":"2024-09-16T01:15:45.944132+0000","last_became_active":"2024-09-16T01:15:43.763689+0000","last_became_peered":"2024-09-16T01:15:43.763689+0000","last_unstale":"2024-09-16T01:15:45.944132+0000","last_undegraded":"2024-09-16T01:15:45.944132+0000","last_fullsized":"2024-09-16T01:15:45.944132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:36.873854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251413+0000","last_change":"2024-09-16T01:15:38.723925+0000","last_active":"2024-09-16T01:15:46.251413+0000","last_peered":"2024-09-16T01:15:46.251413+0000","last_clean":"2024-09-16T01:15:46.251413+0000","last_became_active":"2024-09-16T01:15:38.723660+0000","last_became_peered":"2024-09-16T01:15:38.723660+0000","last_unstale":"2024-09-16T01:15:46.251413+0000","last_undegraded":"2024-09-16T01:15:46.251413+0000","last_fullsized":"2024-09-16T01:15:46.251413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:50.843647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745352+0000","last_change":"2024-09-16T01:15:39.718658+0000","last_active":"2024-09-16T01:15:44.745352+0000","last_peered":"2024-09-16T01:15:44.745352+0000","last_clean":"2024-09-16T01:15:44.745352+0000","last_became_active":"2024-09-16T01:15:39.718360+0000","last_became_peered":"2024-09-16T01:15:39.718360+0000","last_unstale":"2024-09-16T01:15:44.745352+0000","last_undegraded":"2024-09-16T01:15:44.745352+0000","last_fullsized":"2024-09-16T01:15:44.745352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:51.270260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944453+0000","last_change":"2024-09-16T01:15:43.764643+0000","last_active":"2024-09-16T01:15:45.944453+0000","last_peered":"2024-09-16T01:15:45.944453+0000","last_clean":"2024-09-16T01:15:45.944453+0000","last_became_active":"2024-09-16T01:15:43.764229+0000","last_became_peered":"2024-09-16T01:15:43.764229+0000","last_unstale":"2024-09-16T01:15:45.944453+0000","last_undegraded":"2024-09-16T01:15:45.944453+0000","last_fullsized":"2024-09-16T01:15:45.944453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:57.315283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251049+0000","last_change":"2024-09-16T01:15:38.721191+0000","last_active":"2024-09-16T01:15:46.251049+0000","last_peered":"2024-09-16T01:15:46.251049+0000","last_clean":"2024-09-16T01:15:46.251049+0000","last_became_active":"2024-09-16T01:15:38.720832+0000","last_became_peered":"2024-09-16T01:15:38.720832+0000","last_unstale":"2024-09-16T01:15:46.251049+0000","last_undegraded":"2024-09-16T01:15:46.251049+0000","last_fullsized":"2024-09-16T01:15:46.251049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:35.717778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745724+0000","last_change":"2024-09-16T01:15:39.718836+0000","last_active":"2024-09-16T01:15:44.745724+0000","last_peered":"2024-09-16T01:15:44.745724+0000","last_clean":"2024-09-16T01:15:44.745724+0000","last_became_active":"2024-09-16T01:15:39.718367+0000","last_became_peered":"2024-09-16T01:15:39.718367+0000","last_unstale":"2024-09-16T01:15:44.745724+0000","last_undegraded":"2024-09-16T01:15:44.745724+0000","last_fullsized":"2024-09-16T01:15:44.745724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:39.132954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944337+0000","last_change":"2024-09-16T01:15:43.762123+0000","last_active":"2024-09-16T01:15:45.944337+0000","last_peered":"2024-09-16T01:15:45.944337+0000","last_clean":"2024-09-16T01:15:45.944337+0000","last_became_active":"2024-09-16T01:15:43.761634+0000","last_became_peered":"2024-09-16T01:15:43.761634+0000","last_unstale":"2024-09-16T01:15:45.944337+0000","last_undegraded":"2024-09-16T01:15:45.944337+0000","last_fullsized":"2024-09-16T01:15:45.944337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:26.316809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746166+0000","last_change":"2024-09-16T01:15:39.718972+0000","last_active":"2024-09-16T01:15:44.746166+0000","last_peered":"2024-09-16T01:15:44.746166+0000","last_clean":"2024-09-16T01:15:44.746166+0000","last_became_active":"2024-09-16T01:15:39.718666+0000","last_became_peered":"2024-09-16T01:15:39.718666+0000","last_unstale":"2024-09-16T01:15:44.746166+0000","last_undegraded":"2024-09-16T01:15:44.746166+0000","last_fullsized":"2024-09-16T01:15:44.746166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.166842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251231+0000","last_change":"2024-09-16T01:15:38.726840+0000","last_active":"2024-09-16T01:15:46.251231+0000","last_peered":"2024-09-16T01:15:46.251231+0000","last_clean":"2024-09-16T01:15:46.251231+0000","last_became_active":"2024-09-16T01:15:38.726541+0000","last_became_peered":"2024-09-16T01:15:38.726541+0000","last_unstale":"2024-09-16T01:15:46.251231+0000","last_undegraded":"2024-09-16T01:15:46.251231+0000","last_fullsized":"2024-09-16T01:15:46.251231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:54.657992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944947+0000","last_change":"2024-09-16T01:15:43.764429+0000","last_active":"2024-09-16T01:15:45.944947+0000","last_peered":"2024-09-16T01:15:45.944947+0000","last_clean":"2024-09-16T01:15:45.944947+0000","last_became_active":"2024-09-16T01:15:43.763453+0000","last_became_peered":"2024-09-16T01:15:43.763453+0000","last_unstale":"2024-09-16T01:15:45.944947+0000","last_undegraded":"2024-09-16T01:15:45.944947+0000","last_fullsized":"2024-09-16T01:15:45.944947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:54.978121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922348+0000","last_change":"2024-09-16T01:15:39.729023+0000","last_active":"2024-09-16T01:15:44.922348+0000","last_peered":"2024-09-16T01:15:44.922348+0000","last_clean":"2024-09-16T01:15:44.922348+0000","last_became_active":"2024-09-16T01:15:39.728164+0000","last_became_peered":"2024-09-16T01:15:39.728164+0000","last_unstale":"2024-09-16T01:15:44.922348+0000","last_undegraded":"2024-09-16T01:15:44.922348+0000","last_fullsized":"2024-09-16T01:15:44.922348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817115+0000","last_change":"2024-09-16T01:15:38.712201+0000","last_active":"2024-09-16T01:15:44.817115+0000","last_peered":"2024-09-16T01:15:44.817115+0000","last_clean":"2024-09-16T01:15:44.817115+0000","last_became_active":"2024-09-16T01:15:38.711909+0000","last_became_peered":"2024-09-16T01:15:38.711909+0000","last_unstale":"2024-09-16T01:15:44.817115+0000","last_undegraded":"2024-09-16T01:15:44.817115+0000","last_fullsized":"2024-09-16T01:15:44.817115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:46.439923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944544+0000","last_change":"2024-09-16T01:15:43.764651+0000","last_active":"2024-09-16T01:15:45.944544+0000","last_peered":"2024-09-16T01:15:45.944544+0000","last_clean":"2024-09-16T01:15:45.944544+0000","last_became_active":"2024-09-16T01:15:43.764198+0000","last_became_peered":"2024-09-16T01:15:43.764198+0000","last_unstale":"2024-09-16T01:15:45.944544+0000","last_undegraded":"2024-09-16T01:15:45.944544+0000","last_fullsized":"2024-09-16T01:15:45.944544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:55.307076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921967+0000","last_change":"2024-09-16T01:15:39.730357+0000","last_active":"2024-09-16T01:15:44.921967+0000","last_peered":"2024-09-16T01:15:44.921967+0000","last_clean":"2024-09-16T01:15:44.921967+0000","last_became_active":"2024-09-16T01:15:39.728252+0000","last_became_peered":"2024-09-16T01:15:39.728252+0000","last_unstale":"2024-09-16T01:15:44.921967+0000","last_undegraded":"2024-09-16T01:15:44.921967+0000","last_fullsized":"2024-09-16T01:15:44.921967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816830+0000","last_change":"2024-09-16T01:15:38.716181+0000","last_active":"2024-09-16T01:15:44.816830+0000","last_peered":"2024-09-16T01:15:44.816830+0000","last_clean":"2024-09-16T01:15:44.816830+0000","last_became_active":"2024-09-16T01:15:38.715894+0000","last_became_peered":"2024-09-16T01:15:38.715894+0000","last_unstale":"2024-09-16T01:15:44.816830+0000","last_undegraded":"2024-09-16T01:15:44.816830+0000","last_fullsized":"2024-09-16T01:15:44.816830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:58.925739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817629+0000","last_change":"2024-09-16T01:15:43.921354+0000","last_active":"2024-09-16T01:15:44.817629+0000","last_peered":"2024-09-16T01:15:44.817629+0000","last_clean":"2024-09-16T01:15:44.817629+0000","last_became_active":"2024-09-16T01:15:43.919480+0000","last_became_peered":"2024-09-16T01:15:43.919480+0000","last_unstale":"2024-09-16T01:15:44.817629+0000","last_undegraded":"2024-09-16T01:15:44.817629+0000","last_fullsized":"2024-09-16T01:15:44.817629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:34.196444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944562+0000","last_change":"2024-09-16T01:15:39.722840+0000","last_active":"2024-09-16T01:15:45.944562+0000","last_peered":"2024-09-16T01:15:45.944562+0000","last_clean":"2024-09-16T01:15:45.944562+0000","last_became_active":"2024-09-16T01:15:39.722566+0000","last_became_peered":"2024-09-16T01:15:39.722566+0000","last_unstale":"2024-09-16T01:15:45.944562+0000","last_undegraded":"2024-09-16T01:15:45.944562+0000","last_fullsized":"2024-09-16T01:15:45.944562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.000406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250736+0000","last_change":"2024-09-16T01:15:38.722591+0000","last_active":"2024-09-16T01:15:46.250736+0000","last_peered":"2024-09-16T01:15:46.250736+0000","last_clean":"2024-09-16T01:15:46.250736+0000","last_became_active":"2024-09-16T01:15:38.722331+0000","last_became_peered":"2024-09-16T01:15:38.722331+0000","last_unstale":"2024-09-16T01:15:46.250736+0000","last_undegraded":"2024-09-16T01:15:46.250736+0000","last_fullsized":"2024-09-16T01:15:46.250736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:58.925739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944801+0000","last_change":"2024-09-16T01:15:43.763545+0000","last_active":"2024-09-16T01:15:45.944801+0000","last_peered":"2024-09-16T01:15:45.944801+0000","last_clean":"2024-09-16T01:15:45.944801+0000","last_became_active":"2024-09-16T01:15:43.763123+0000","last_became_peered":"2024-09-16T01:15:43.763123+0000","last_unstale":"2024-09-16T01:15:45.944801+0000","last_undegraded":"2024-09-16T01:15:45.944801+0000","last_fullsized":"2024-09-16T01:15:45.944801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:27.078175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747527+0000","last_change":"2024-09-16T01:15:39.721956+0000","last_active":"2024-09-16T01:15:44.747527+0000","last_peered":"2024-09-16T01:15:44.747527+0000","last_clean":"2024-09-16T01:15:44.747527+0000","last_became_active":"2024-09-16T01:15:39.721349+0000","last_became_peered":"2024-09-16T01:15:39.721349+0000","last_unstale":"2024-09-16T01:15:44.747527+0000","last_undegraded":"2024-09-16T01:15:44.747527+0000","last_fullsized":"2024-09-16T01:15:44.747527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.089581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746703+0000","last_change":"2024-09-16T01:15:38.717450+0000","last_active":"2024-09-16T01:15:44.746703+0000","last_peered":"2024-09-16T01:15:44.746703+0000","last_clean":"2024-09-16T01:15:44.746703+0000","last_became_active":"2024-09-16T01:15:38.717143+0000","last_became_peered":"2024-09-16T01:15:38.717143+0000","last_unstale":"2024-09-16T01:15:44.746703+0000","last_undegraded":"2024-09-16T01:15:44.746703+0000","last_fullsized":"2024-09-16T01:15:44.746703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:46.439923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944225+0000","last_change":"2024-09-16T01:15:43.920611+0000","last_active":"2024-09-16T01:15:45.944225+0000","last_peered":"2024-09-16T01:15:45.944225+0000","last_clean":"2024-09-16T01:15:45.944225+0000","last_became_active":"2024-09-16T01:15:43.920154+0000","last_became_peered":"2024-09-16T01:15:43.920154+0000","last_unstale":"2024-09-16T01:15:45.944225+0000","last_undegraded":"2024-09-16T01:15:45.944225+0000","last_fullsized":"2024-09-16T01:15:45.944225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:43.169770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922664+0000","last_change":"2024-09-16T01:15:39.727833+0000","last_active":"2024-09-16T01:15:44.922664+0000","last_peered":"2024-09-16T01:15:44.922664+0000","last_clean":"2024-09-16T01:15:44.922664+0000","last_became_active":"2024-09-16T01:15:39.727573+0000","last_became_peered":"2024-09-16T01:15:39.727573+0000","last_unstale":"2024-09-16T01:15:44.922664+0000","last_undegraded":"2024-09-16T01:15:44.922664+0000","last_fullsized":"2024-09-16T01:15:44.922664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:22.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817625+0000","last_change":"2024-09-16T01:15:38.707107+0000","last_active":"2024-09-16T01:15:44.817625+0000","last_peered":"2024-09-16T01:15:44.817625+0000","last_clean":"2024-09-16T01:15:44.817625+0000","last_became_active":"2024-09-16T01:15:38.706848+0000","last_became_peered":"2024-09-16T01:15:38.706848+0000","last_unstale":"2024-09-16T01:15:44.817625+0000","last_undegraded":"2024-09-16T01:15:44.817625+0000","last_fullsized":"2024-09-16T01:15:44.817625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:08.518045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922236+0000","last_change":"2024-09-16T01:15:43.921496+0000","last_active":"2024-09-16T01:15:44.922236+0000","last_peered":"2024-09-16T01:15:44.922236+0000","last_clean":"2024-09-16T01:15:44.922236+0000","last_became_active":"2024-09-16T01:15:43.920197+0000","last_became_peered":"2024-09-16T01:15:43.920197+0000","last_unstale":"2024-09-16T01:15:44.922236+0000","last_undegraded":"2024-09-16T01:15:44.922236+0000","last_fullsized":"2024-09-16T01:15:44.922236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:09.951543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817435+0000","last_change":"2024-09-16T01:15:39.723117+0000","last_active":"2024-09-16T01:15:44.817435+0000","last_peered":"2024-09-16T01:15:44.817435+0000","last_clean":"2024-09-16T01:15:44.817435+0000","last_became_active":"2024-09-16T01:15:39.722836+0000","last_became_peered":"2024-09-16T01:15:39.722836+0000","last_unstale":"2024-09-16T01:15:44.817435+0000","last_undegraded":"2024-09-16T01:15:44.817435+0000","last_fullsized":"2024-09-16T01:15:44.817435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251484+0000","last_change":"2024-09-16T01:15:38.722596+0000","last_active":"2024-09-16T01:15:46.251484+0000","last_peered":"2024-09-16T01:15:46.251484+0000","last_clean":"2024-09-16T01:15:46.251484+0000","last_became_active":"2024-09-16T01:15:38.722356+0000","last_became_peered":"2024-09-16T01:15:38.722356+0000","last_unstale":"2024-09-16T01:15:46.251484+0000","last_undegraded":"2024-09-16T01:15:46.251484+0000","last_fullsized":"2024-09-16T01:15:46.251484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:31.352796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747052+0000","last_change":"2024-09-16T01:15:43.921163+0000","last_active":"2024-09-16T01:15:44.747052+0000","last_peered":"2024-09-16T01:15:44.747052+0000","last_clean":"2024-09-16T01:15:44.747052+0000","last_became_active":"2024-09-16T01:15:43.920789+0000","last_became_peered":"2024-09-16T01:15:43.920789+0000","last_unstale":"2024-09-16T01:15:44.747052+0000","last_undegraded":"2024-09-16T01:15:44.747052+0000","last_fullsized":"2024-09-16T01:15:44.747052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:24.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745802+0000","last_change":"2024-09-16T01:15:39.721863+0000","last_active":"2024-09-16T01:15:44.745802+0000","last_peered":"2024-09-16T01:15:44.745802+0000","last_clean":"2024-09-16T01:15:44.745802+0000","last_became_active":"2024-09-16T01:15:39.721445+0000","last_became_peered":"2024-09-16T01:15:39.721445+0000","last_unstale":"2024-09-16T01:15:44.745802+0000","last_undegraded":"2024-09-16T01:15:44.745802+0000","last_fullsized":"2024-09-16T01:15:44.745802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:53.278467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817489+0000","last_change":"2024-09-16T01:15:38.718239+0000","last_active":"2024-09-16T01:15:44.817489+0000","last_peered":"2024-09-16T01:15:44.817489+0000","last_clean":"2024-09-16T01:15:44.817489+0000","last_became_active":"2024-09-16T01:15:38.717981+0000","last_became_peered":"2024-09-16T01:15:38.717981+0000","last_unstale":"2024-09-16T01:15:44.817489+0000","last_undegraded":"2024-09-16T01:15:44.817489+0000","last_fullsized":"2024-09-16T01:15:44.817489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:35.717778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816857+0000","last_change":"2024-09-16T01:15:43.759115+0000","last_active":"2024-09-16T01:15:44.816857+0000","last_peered":"2024-09-16T01:15:44.816857+0000","last_clean":"2024-09-16T01:15:44.816857+0000","last_became_active":"2024-09-16T01:15:43.758725+0000","last_became_peered":"2024-09-16T01:15:43.758725+0000","last_unstale":"2024-09-16T01:15:44.816857+0000","last_undegraded":"2024-09-16T01:15:44.816857+0000","last_fullsized":"2024-09-16T01:15:44.816857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:27.078175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944821+0000","last_change":"2024-09-16T01:15:39.723087+0000","last_active":"2024-09-16T01:15:45.944821+0000","last_peered":"2024-09-16T01:15:45.944821+0000","last_clean":"2024-09-16T01:15:45.944821+0000","last_became_active":"2024-09-16T01:15:39.722204+0000","last_became_peered":"2024-09-16T01:15:39.722204+0000","last_unstale":"2024-09-16T01:15:45.944821+0000","last_undegraded":"2024-09-16T01:15:45.944821+0000","last_fullsized":"2024-09-16T01:15:45.944821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:36.723734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746291+0000","last_change":"2024-09-16T01:15:38.717252+0000","last_active":"2024-09-16T01:15:44.746291+0000","last_peered":"2024-09-16T01:15:44.746291+0000","last_clean":"2024-09-16T01:15:44.746291+0000","last_became_active":"2024-09-16T01:15:38.716781+0000","last_became_peered":"2024-09-16T01:15:38.716781+0000","last_unstale":"2024-09-16T01:15:44.746291+0000","last_undegraded":"2024-09-16T01:15:44.746291+0000","last_fullsized":"2024-09-16T01:15:44.746291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:58.925739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817388+0000","last_change":"2024-09-16T01:15:43.760901+0000","last_active":"2024-09-16T01:15:44.817388+0000","last_peered":"2024-09-16T01:15:44.817388+0000","last_clean":"2024-09-16T01:15:44.817388+0000","last_became_active":"2024-09-16T01:15:43.758844+0000","last_became_peered":"2024-09-16T01:15:43.758844+0000","last_unstale":"2024-09-16T01:15:44.817388+0000","last_undegraded":"2024-09-16T01:15:44.817388+0000","last_fullsized":"2024-09-16T01:15:44.817388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:23.908567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816870+0000","last_change":"2024-09-16T01:15:39.723832+0000","last_active":"2024-09-16T01:15:44.816870+0000","last_peered":"2024-09-16T01:15:44.816870+0000","last_clean":"2024-09-16T01:15:44.816870+0000","last_became_active":"2024-09-16T01:15:39.723596+0000","last_became_peered":"2024-09-16T01:15:39.723596+0000","last_unstale":"2024-09-16T01:15:44.816870+0000","last_undegraded":"2024-09-16T01:15:44.816870+0000","last_fullsized":"2024-09-16T01:15:44.816870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644673+0000","last_change":"2024-09-16T01:15:38.713951+0000","last_active":"2024-09-16T01:15:46.644673+0000","last_peered":"2024-09-16T01:15:46.644673+0000","last_clean":"2024-09-16T01:15:46.644673+0000","last_became_active":"2024-09-16T01:15:38.713670+0000","last_became_peered":"2024-09-16T01:15:38.713670+0000","last_unstale":"2024-09-16T01:15:46.644673+0000","last_undegraded":"2024-09-16T01:15:46.644673+0000","last_fullsized":"2024-09-16T01:15:46.644673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:24.701682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817651+0000","last_change":"2024-09-16T01:15:43.760201+0000","last_active":"2024-09-16T01:15:44.817651+0000","last_peered":"2024-09-16T01:15:44.817651+0000","last_clean":"2024-09-16T01:15:44.817651+0000","last_became_active":"2024-09-16T01:15:43.759329+0000","last_became_peered":"2024-09-16T01:15:43.759329+0000","last_unstale":"2024-09-16T01:15:44.817651+0000","last_undegraded":"2024-09-16T01:15:44.817651+0000","last_fullsized":"2024-09-16T01:15:44.817651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:00.235274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746870+0000","last_change":"2024-09-16T01:15:39.719776+0000","last_active":"2024-09-16T01:15:44.746870+0000","last_peered":"2024-09-16T01:15:44.746870+0000","last_clean":"2024-09-16T01:15:44.746870+0000","last_became_active":"2024-09-16T01:15:39.719492+0000","last_became_peered":"2024-09-16T01:15:39.719492+0000","last_unstale":"2024-09-16T01:15:44.746870+0000","last_undegraded":"2024-09-16T01:15:44.746870+0000","last_fullsized":"2024-09-16T01:15:44.746870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:18.272881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250816+0000","last_change":"2024-09-16T01:15:38.722446+0000","last_active":"2024-09-16T01:15:46.250816+0000","last_peered":"2024-09-16T01:15:46.250816+0000","last_clean":"2024-09-16T01:15:46.250816+0000","last_became_active":"2024-09-16T01:15:38.722134+0000","last_became_peered":"2024-09-16T01:15:38.722134+0000","last_unstale":"2024-09-16T01:15:46.250816+0000","last_undegraded":"2024-09-16T01:15:46.250816+0000","last_fullsized":"2024-09-16T01:15:46.250816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:43.994450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747413+0000","last_change":"2024-09-16T01:15:43.921254+0000","last_active":"2024-09-16T01:15:44.747413+0000","last_peered":"2024-09-16T01:15:44.747413+0000","last_clean":"2024-09-16T01:15:44.747413+0000","last_became_active":"2024-09-16T01:15:43.920320+0000","last_became_peered":"2024-09-16T01:15:43.920320+0000","last_unstale":"2024-09-16T01:15:44.747413+0000","last_undegraded":"2024-09-16T01:15:44.747413+0000","last_fullsized":"2024-09-16T01:15:44.747413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:23.908567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921967+0000","last_change":"2024-09-16T01:15:39.729053+0000","last_active":"2024-09-16T01:15:44.921967+0000","last_peered":"2024-09-16T01:15:44.921967+0000","last_clean":"2024-09-16T01:15:44.921967+0000","last_became_active":"2024-09-16T01:15:39.727897+0000","last_became_peered":"2024-09-16T01:15:39.727897+0000","last_unstale":"2024-09-16T01:15:44.921967+0000","last_undegraded":"2024-09-16T01:15:44.921967+0000","last_fullsized":"2024-09-16T01:15:44.921967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745582+0000","last_change":"2024-09-16T01:15:38.712828+0000","last_active":"2024-09-16T01:15:44.745582+0000","last_peered":"2024-09-16T01:15:44.745582+0000","last_clean":"2024-09-16T01:15:44.745582+0000","last_became_active":"2024-09-16T01:15:38.712543+0000","last_became_peered":"2024-09-16T01:15:38.712543+0000","last_unstale":"2024-09-16T01:15:44.745582+0000","last_undegraded":"2024-09-16T01:15:44.745582+0000","last_fullsized":"2024-09-16T01:15:44.745582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:52.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250598+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:15:46.250598+0000","last_peered":"2024-09-16T01:15:46.250598+0000","last_clean":"2024-09-16T01:15:46.250598+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:15:46.250598+0000","last_undegraded":"2024-09-16T01:15:46.250598+0000","last_fullsized":"2024-09-16T01:15:46.250598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745908+0000","last_change":"2024-09-16T01:15:43.920489+0000","last_active":"2024-09-16T01:15:44.745908+0000","last_peered":"2024-09-16T01:15:44.745908+0000","last_clean":"2024-09-16T01:15:44.745908+0000","last_became_active":"2024-09-16T01:15:43.920110+0000","last_became_peered":"2024-09-16T01:15:43.920110+0000","last_unstale":"2024-09-16T01:15:44.745908+0000","last_undegraded":"2024-09-16T01:15:44.745908+0000","last_fullsized":"2024-09-16T01:15:44.745908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:57.315283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251313+0000","last_change":"2024-09-16T01:15:39.728812+0000","last_active":"2024-09-16T01:15:46.251313+0000","last_peered":"2024-09-16T01:15:46.251313+0000","last_clean":"2024-09-16T01:15:46.251313+0000","last_became_active":"2024-09-16T01:15:39.728567+0000","last_became_peered":"2024-09-16T01:15:39.728567+0000","last_unstale":"2024-09-16T01:15:46.251313+0000","last_undegraded":"2024-09-16T01:15:46.251313+0000","last_fullsized":"2024-09-16T01:15:46.251313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:50.941305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644951+0000","last_change":"2024-09-16T01:15:38.714874+0000","last_active":"2024-09-16T01:15:46.644951+0000","last_peered":"2024-09-16T01:15:46.644951+0000","last_clean":"2024-09-16T01:15:46.644951+0000","last_became_active":"2024-09-16T01:15:38.714594+0000","last_became_peered":"2024-09-16T01:15:38.714594+0000","last_unstale":"2024-09-16T01:15:46.644951+0000","last_undegraded":"2024-09-16T01:15:46.644951+0000","last_fullsized":"2024-09-16T01:15:46.644951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:42.942780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746039+0000","last_change":"2024-09-16T01:15:43.917212+0000","last_active":"2024-09-16T01:15:44.746039+0000","last_peered":"2024-09-16T01:15:44.746039+0000","last_clean":"2024-09-16T01:15:44.746039+0000","last_became_active":"2024-09-16T01:15:43.916799+0000","last_became_peered":"2024-09-16T01:15:43.916799+0000","last_unstale":"2024-09-16T01:15:44.746039+0000","last_undegraded":"2024-09-16T01:15:44.746039+0000","last_fullsized":"2024-09-16T01:15:44.746039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:55.307076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745452+0000","last_change":"2024-09-16T01:15:39.716325+0000","last_active":"2024-09-16T01:15:44.745452+0000","last_peered":"2024-09-16T01:15:44.745452+0000","last_clean":"2024-09-16T01:15:44.745452+0000","last_became_active":"2024-09-16T01:15:39.716048+0000","last_became_peered":"2024-09-16T01:15:39.716048+0000","last_unstale":"2024-09-16T01:15:44.745452+0000","last_undegraded":"2024-09-16T01:15:44.745452+0000","last_fullsized":"2024-09-16T01:15:44.745452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:20.730699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817475+0000","last_change":"2024-09-16T01:15:38.710438+0000","last_active":"2024-09-16T01:15:44.817475+0000","last_peered":"2024-09-16T01:15:44.817475+0000","last_clean":"2024-09-16T01:15:44.817475+0000","last_became_active":"2024-09-16T01:15:38.710126+0000","last_became_peered":"2024-09-16T01:15:38.710126+0000","last_unstale":"2024-09-16T01:15:44.817475+0000","last_undegraded":"2024-09-16T01:15:44.817475+0000","last_fullsized":"2024-09-16T01:15:44.817475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:50.843647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747422+0000","last_change":"2024-09-16T01:15:43.755716+0000","last_active":"2024-09-16T01:15:44.747422+0000","last_peered":"2024-09-16T01:15:44.747422+0000","last_clean":"2024-09-16T01:15:44.747422+0000","last_became_active":"2024-09-16T01:15:43.755284+0000","last_became_peered":"2024-09-16T01:15:43.755284+0000","last_unstale":"2024-09-16T01:15:44.747422+0000","last_undegraded":"2024-09-16T01:15:44.747422+0000","last_fullsized":"2024-09-16T01:15:44.747422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:34.196444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251434+0000","last_change":"2024-09-16T01:15:39.721173+0000","last_active":"2024-09-16T01:15:46.251434+0000","last_peered":"2024-09-16T01:15:46.251434+0000","last_clean":"2024-09-16T01:15:46.251434+0000","last_became_active":"2024-09-16T01:15:39.720757+0000","last_became_peered":"2024-09-16T01:15:39.720757+0000","last_unstale":"2024-09-16T01:15:46.251434+0000","last_undegraded":"2024-09-16T01:15:46.251434+0000","last_fullsized":"2024-09-16T01:15:46.251434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:44.674615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644910+0000","last_change":"2024-09-16T01:15:38.713886+0000","last_active":"2024-09-16T01:15:46.644910+0000","last_peered":"2024-09-16T01:15:46.644910+0000","last_clean":"2024-09-16T01:15:46.644910+0000","last_became_active":"2024-09-16T01:15:38.713596+0000","last_became_peered":"2024-09-16T01:15:38.713596+0000","last_unstale":"2024-09-16T01:15:46.644910+0000","last_undegraded":"2024-09-16T01:15:46.644910+0000","last_fullsized":"2024-09-16T01:15:46.644910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:52.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744816+0000","last_change":"2024-09-16T01:15:43.917236+0000","last_active":"2024-09-16T01:15:44.744816+0000","last_peered":"2024-09-16T01:15:44.744816+0000","last_clean":"2024-09-16T01:15:44.744816+0000","last_became_active":"2024-09-16T01:15:43.916784+0000","last_became_peered":"2024-09-16T01:15:43.916784+0000","last_unstale":"2024-09-16T01:15:44.744816+0000","last_undegraded":"2024-09-16T01:15:44.744816+0000","last_fullsized":"2024-09-16T01:15:44.744816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:48.711431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251384+0000","last_change":"2024-09-16T01:15:39.721477+0000","last_active":"2024-09-16T01:15:46.251384+0000","last_peered":"2024-09-16T01:15:46.251384+0000","last_clean":"2024-09-16T01:15:46.251384+0000","last_became_active":"2024-09-16T01:15:39.720755+0000","last_became_peered":"2024-09-16T01:15:39.720755+0000","last_unstale":"2024-09-16T01:15:46.251384+0000","last_undegraded":"2024-09-16T01:15:46.251384+0000","last_fullsized":"2024-09-16T01:15:46.251384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:56.198457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944995+0000","last_change":"2024-09-16T01:15:38.718410+0000","last_active":"2024-09-16T01:15:45.944995+0000","last_peered":"2024-09-16T01:15:45.944995+0000","last_clean":"2024-09-16T01:15:45.944995+0000","last_became_active":"2024-09-16T01:15:38.718113+0000","last_became_peered":"2024-09-16T01:15:38.718113+0000","last_unstale":"2024-09-16T01:15:45.944995+0000","last_undegraded":"2024-09-16T01:15:45.944995+0000","last_fullsized":"2024-09-16T01:15:45.944995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:36.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944193+0000","last_change":"2024-09-16T01:15:43.763443+0000","last_active":"2024-09-16T01:15:45.944193+0000","last_peered":"2024-09-16T01:15:45.944193+0000","last_clean":"2024-09-16T01:15:45.944193+0000","last_became_active":"2024-09-16T01:15:43.763064+0000","last_became_peered":"2024-09-16T01:15:43.763064+0000","last_unstale":"2024-09-16T01:15:45.944193+0000","last_undegraded":"2024-09-16T01:15:45.944193+0000","last_fullsized":"2024-09-16T01:15:45.944193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:19.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251116+0000","last_change":"2024-09-16T01:15:39.721525+0000","last_active":"2024-09-16T01:15:46.251116+0000","last_peered":"2024-09-16T01:15:46.251116+0000","last_clean":"2024-09-16T01:15:46.251116+0000","last_became_active":"2024-09-16T01:15:39.721282+0000","last_became_peered":"2024-09-16T01:15:39.721282+0000","last_unstale":"2024-09-16T01:15:46.251116+0000","last_undegraded":"2024-09-16T01:15:46.251116+0000","last_fullsized":"2024-09-16T01:15:46.251116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:53.278467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644540+0000","last_change":"2024-09-16T01:15:38.716594+0000","last_active":"2024-09-16T01:15:46.644540+0000","last_peered":"2024-09-16T01:15:46.644540+0000","last_clean":"2024-09-16T01:15:46.644540+0000","last_became_active":"2024-09-16T01:15:38.716327+0000","last_became_peered":"2024-09-16T01:15:38.716327+0000","last_unstale":"2024-09-16T01:15:46.644540+0000","last_undegraded":"2024-09-16T01:15:46.644540+0000","last_fullsized":"2024-09-16T01:15:46.644540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:44.803896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747246+0000","last_change":"2024-09-16T01:15:43.763464+0000","last_active":"2024-09-16T01:15:44.747246+0000","last_peered":"2024-09-16T01:15:44.747246+0000","last_clean":"2024-09-16T01:15:44.747246+0000","last_became_active":"2024-09-16T01:15:43.763095+0000","last_became_peered":"2024-09-16T01:15:43.763095+0000","last_unstale":"2024-09-16T01:15:44.747246+0000","last_undegraded":"2024-09-16T01:15:44.747246+0000","last_fullsized":"2024-09-16T01:15:44.747246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:54.978121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745408+0000","last_change":"2024-09-16T01:15:39.726106+0000","last_active":"2024-09-16T01:15:44.745408+0000","last_peered":"2024-09-16T01:15:44.745408+0000","last_clean":"2024-09-16T01:15:44.745408+0000","last_became_active":"2024-09-16T01:15:39.725833+0000","last_became_peered":"2024-09-16T01:15:39.725833+0000","last_unstale":"2024-09-16T01:15:44.745408+0000","last_undegraded":"2024-09-16T01:15:44.745408+0000","last_fullsized":"2024-09-16T01:15:44.745408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745838+0000","last_change":"2024-09-16T01:15:38.710514+0000","last_active":"2024-09-16T01:15:44.745838+0000","last_peered":"2024-09-16T01:15:44.745838+0000","last_clean":"2024-09-16T01:15:44.745838+0000","last_became_active":"2024-09-16T01:15:38.710185+0000","last_became_peered":"2024-09-16T01:15:38.710185+0000","last_unstale":"2024-09-16T01:15:44.745838+0000","last_undegraded":"2024-09-16T01:15:44.745838+0000","last_fullsized":"2024-09-16T01:15:44.745838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:42.942780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922611+0000","last_change":"2024-09-16T01:15:43.919233+0000","last_active":"2024-09-16T01:15:44.922611+0000","last_peered":"2024-09-16T01:15:44.922611+0000","last_clean":"2024-09-16T01:15:44.922611+0000","last_became_active":"2024-09-16T01:15:43.918866+0000","last_became_peered":"2024-09-16T01:15:43.918866+0000","last_unstale":"2024-09-16T01:15:44.922611+0000","last_undegraded":"2024-09-16T01:15:44.922611+0000","last_fullsized":"2024-09-16T01:15:44.922611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:15.298412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251002+0000","last_change":"2024-09-16T01:15:39.722459+0000","last_active":"2024-09-16T01:15:46.251002+0000","last_peered":"2024-09-16T01:15:46.251002+0000","last_clean":"2024-09-16T01:15:46.251002+0000","last_became_active":"2024-09-16T01:15:39.722016+0000","last_became_peered":"2024-09-16T01:15:39.722016+0000","last_unstale":"2024-09-16T01:15:46.251002+0000","last_undegraded":"2024-09-16T01:15:46.251002+0000","last_fullsized":"2024-09-16T01:15:46.251002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:20.730699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746247+0000","last_change":"2024-09-16T01:15:38.715930+0000","last_active":"2024-09-16T01:15:44.746247+0000","last_peered":"2024-09-16T01:15:44.746247+0000","last_clean":"2024-09-16T01:15:44.746247+0000","last_became_active":"2024-09-16T01:15:38.715602+0000","last_became_peered":"2024-09-16T01:15:38.715602+0000","last_unstale":"2024-09-16T01:15:44.746247+0000","last_undegraded":"2024-09-16T01:15:44.746247+0000","last_fullsized":"2024-09-16T01:15:44.746247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:08.518045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922632+0000","last_change":"2024-09-16T01:15:43.917197+0000","last_active":"2024-09-16T01:15:44.922632+0000","last_peered":"2024-09-16T01:15:44.922632+0000","last_clean":"2024-09-16T01:15:44.922632+0000","last_became_active":"2024-09-16T01:15:43.916694+0000","last_became_peered":"2024-09-16T01:15:43.916694+0000","last_unstale":"2024-09-16T01:15:44.922632+0000","last_undegraded":"2024-09-16T01:15:44.922632+0000","last_fullsized":"2024-09-16T01:15:44.922632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:03:54.915059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747227+0000","last_change":"2024-09-16T01:15:39.731508+0000","last_active":"2024-09-16T01:15:44.747227+0000","last_peered":"2024-09-16T01:15:44.747227+0000","last_clean":"2024-09-16T01:15:44.747227+0000","last_became_active":"2024-09-16T01:15:39.730663+0000","last_became_peered":"2024-09-16T01:15:39.730663+0000","last_unstale":"2024-09-16T01:15:44.747227+0000","last_undegraded":"2024-09-16T01:15:44.747227+0000","last_fullsized":"2024-09-16T01:15:44.747227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:52.736329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747663+0000","last_change":"2024-09-16T01:15:38.715147+0000","last_active":"2024-09-16T01:15:44.747663+0000","last_peered":"2024-09-16T01:15:44.747663+0000","last_clean":"2024-09-16T01:15:44.747663+0000","last_became_active":"2024-09-16T01:15:38.714378+0000","last_became_peered":"2024-09-16T01:15:38.714378+0000","last_unstale":"2024-09-16T01:15:44.747663+0000","last_undegraded":"2024-09-16T01:15:44.747663+0000","last_fullsized":"2024-09-16T01:15:44.747663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:36.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745684+0000","last_change":"2024-09-16T01:15:43.917886+0000","last_active":"2024-09-16T01:15:44.745684+0000","last_peered":"2024-09-16T01:15:44.745684+0000","last_clean":"2024-09-16T01:15:44.745684+0000","last_became_active":"2024-09-16T01:15:43.917474+0000","last_became_peered":"2024-09-16T01:15:43.917474+0000","last_unstale":"2024-09-16T01:15:44.745684+0000","last_undegraded":"2024-09-16T01:15:44.745684+0000","last_fullsized":"2024-09-16T01:15:44.745684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:08.989590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251072+0000","last_change":"2024-09-16T01:15:39.727254+0000","last_active":"2024-09-16T01:15:46.251072+0000","last_peered":"2024-09-16T01:15:46.251072+0000","last_clean":"2024-09-16T01:15:46.251072+0000","last_became_active":"2024-09-16T01:15:39.726904+0000","last_became_peered":"2024-09-16T01:15:39.726904+0000","last_unstale":"2024-09-16T01:15:46.251072+0000","last_undegraded":"2024-09-16T01:15:46.251072+0000","last_fullsized":"2024-09-16T01:15:46.251072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:23.041359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:49.106598+0000","last_change":"2024-09-16T01:15:38.716774+0000","last_active":"2024-09-16T01:15:49.106598+0000","last_peered":"2024-09-16T01:15:49.106598+0000","last_clean":"2024-09-16T01:15:49.106598+0000","last_became_active":"2024-09-16T01:15:38.716441+0000","last_became_peered":"2024-09-16T01:15:38.716441+0000","last_unstale":"2024-09-16T01:15:49.106598+0000","last_undegraded":"2024-09-16T01:15:49.106598+0000","last_fullsized":"2024-09-16T01:15:49.106598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:08.518045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816941+0000","last_change":"2024-09-16T01:15:43.760938+0000","last_active":"2024-09-16T01:15:44.816941+0000","last_peered":"2024-09-16T01:15:44.816941+0000","last_clean":"2024-09-16T01:15:44.816941+0000","last_became_active":"2024-09-16T01:15:43.759362+0000","last_became_peered":"2024-09-16T01:15:43.759362+0000","last_unstale":"2024-09-16T01:15:44.816941+0000","last_undegraded":"2024-09-16T01:15:44.816941+0000","last_fullsized":"2024-09-16T01:15:44.816941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:54.978121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944687+0000","last_change":"2024-09-16T01:15:39.724557+0000","last_active":"2024-09-16T01:15:45.944687+0000","last_peered":"2024-09-16T01:15:45.944687+0000","last_clean":"2024-09-16T01:15:45.944687+0000","last_became_active":"2024-09-16T01:15:39.724253+0000","last_became_peered":"2024-09-16T01:15:39.724253+0000","last_unstale":"2024-09-16T01:15:45.944687+0000","last_undegraded":"2024-09-16T01:15:45.944687+0000","last_fullsized":"2024-09-16T01:15:45.944687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:51.849603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817542+0000","last_change":"2024-09-16T01:15:38.712961+0000","last_active":"2024-09-16T01:15:44.817542+0000","last_peered":"2024-09-16T01:15:44.817542+0000","last_clean":"2024-09-16T01:15:44.817542+0000","last_became_active":"2024-09-16T01:15:38.712701+0000","last_became_peered":"2024-09-16T01:15:38.712701+0000","last_unstale":"2024-09-16T01:15:44.817542+0000","last_undegraded":"2024-09-16T01:15:44.817542+0000","last_fullsized":"2024-09-16T01:15:44.817542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:43.994450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944656+0000","last_change":"2024-09-16T01:15:43.765439+0000","last_active":"2024-09-16T01:15:45.944656+0000","last_peered":"2024-09-16T01:15:45.944656+0000","last_clean":"2024-09-16T01:15:45.944656+0000","last_became_active":"2024-09-16T01:15:43.765020+0000","last_became_peered":"2024-09-16T01:15:43.765020+0000","last_unstale":"2024-09-16T01:15:45.944656+0000","last_undegraded":"2024-09-16T01:15:45.944656+0000","last_fullsized":"2024-09-16T01:15:45.944656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:24.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747568+0000","last_change":"2024-09-16T01:15:39.730738+0000","last_active":"2024-09-16T01:15:44.747568+0000","last_peered":"2024-09-16T01:15:44.747568+0000","last_clean":"2024-09-16T01:15:44.747568+0000","last_became_active":"2024-09-16T01:15:39.730255+0000","last_became_peered":"2024-09-16T01:15:39.730255+0000","last_unstale":"2024-09-16T01:15:44.747568+0000","last_undegraded":"2024-09-16T01:15:44.747568+0000","last_fullsized":"2024-09-16T01:15:44.747568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745379+0000","last_change":"2024-09-16T01:15:38.715232+0000","last_active":"2024-09-16T01:15:44.745379+0000","last_peered":"2024-09-16T01:15:44.745379+0000","last_clean":"2024-09-16T01:15:44.745379+0000","last_became_active":"2024-09-16T01:15:38.714944+0000","last_became_peered":"2024-09-16T01:15:38.714944+0000","last_unstale":"2024-09-16T01:15:44.745379+0000","last_undegraded":"2024-09-16T01:15:44.745379+0000","last_fullsized":"2024-09-16T01:15:44.745379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:24.701682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921870+0000","last_change":"2024-09-16T01:15:43.758834+0000","last_active":"2024-09-16T01:15:44.921870+0000","last_peered":"2024-09-16T01:15:44.921870+0000","last_clean":"2024-09-16T01:15:44.921870+0000","last_became_active":"2024-09-16T01:15:43.758362+0000","last_became_peered":"2024-09-16T01:15:43.758362+0000","last_unstale":"2024-09-16T01:15:44.921870+0000","last_undegraded":"2024-09-16T01:15:44.921870+0000","last_fullsized":"2024-09-16T01:15:44.921870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:10.924601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745261+0000","last_change":"2024-09-16T01:15:39.723043+0000","last_active":"2024-09-16T01:15:44.745261+0000","last_peered":"2024-09-16T01:15:44.745261+0000","last_clean":"2024-09-16T01:15:44.745261+0000","last_became_active":"2024-09-16T01:15:39.722068+0000","last_became_peered":"2024-09-16T01:15:39.722068+0000","last_unstale":"2024-09-16T01:15:44.745261+0000","last_undegraded":"2024-09-16T01:15:44.745261+0000","last_fullsized":"2024-09-16T01:15:44.745261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:15.851594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746622+0000","last_change":"2024-09-16T01:15:38.712075+0000","last_active":"2024-09-16T01:15:44.746622+0000","last_peered":"2024-09-16T01:15:44.746622+0000","last_clean":"2024-09-16T01:15:44.746622+0000","last_became_active":"2024-09-16T01:15:38.711796+0000","last_became_peered":"2024-09-16T01:15:38.711796+0000","last_unstale":"2024-09-16T01:15:44.746622+0000","last_undegraded":"2024-09-16T01:15:44.746622+0000","last_fullsized":"2024-09-16T01:15:44.746622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:24.701682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922056+0000","last_change":"2024-09-16T01:15:43.920754+0000","last_active":"2024-09-16T01:15:44.922056+0000","last_peered":"2024-09-16T01:15:44.922056+0000","last_clean":"2024-09-16T01:15:44.922056+0000","last_became_active":"2024-09-16T01:15:43.919569+0000","last_became_peered":"2024-09-16T01:15:43.919569+0000","last_unstale":"2024-09-16T01:15:44.922056+0000","last_undegraded":"2024-09-16T01:15:44.922056+0000","last_fullsized":"2024-09-16T01:15:44.922056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:08.989590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747159+0000","last_change":"2024-09-16T01:15:43.921667+0000","last_active":"2024-09-16T01:15:44.747159+0000","last_peered":"2024-09-16T01:15:44.747159+0000","last_clean":"2024-09-16T01:15:44.747159+0000","last_became_active":"2024-09-16T01:15:43.921261+0000","last_became_peered":"2024-09-16T01:15:43.921261+0000","last_unstale":"2024-09-16T01:15:44.747159+0000","last_undegraded":"2024-09-16T01:15:44.747159+0000","last_fullsized":"2024-09-16T01:15:44.747159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:27.078175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816721+0000","last_change":"2024-09-16T01:15:39.715516+0000","last_active":"2024-09-16T01:15:44.816721+0000","last_peered":"2024-09-16T01:15:44.816721+0000","last_clean":"2024-09-16T01:15:44.816721+0000","last_became_active":"2024-09-16T01:15:39.715303+0000","last_became_peered":"2024-09-16T01:15:39.715303+0000","last_unstale":"2024-09-16T01:15:44.816721+0000","last_undegraded":"2024-09-16T01:15:44.816721+0000","last_fullsized":"2024-09-16T01:15:44.816721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744965+0000","last_change":"2024-09-16T01:15:38.709515+0000","last_active":"2024-09-16T01:15:44.744965+0000","last_peered":"2024-09-16T01:15:44.744965+0000","last_clean":"2024-09-16T01:15:44.744965+0000","last_became_active":"2024-09-16T01:15:38.708945+0000","last_became_peered":"2024-09-16T01:15:38.708945+0000","last_unstale":"2024-09-16T01:15:44.744965+0000","last_undegraded":"2024-09-16T01:15:44.744965+0000","last_fullsized":"2024-09-16T01:15:44.744965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:46.439923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746558+0000","last_change":"2024-09-16T01:15:43.763256+0000","last_active":"2024-09-16T01:15:44.746558+0000","last_peered":"2024-09-16T01:15:44.746558+0000","last_clean":"2024-09-16T01:15:44.746558+0000","last_became_active":"2024-09-16T01:15:43.762837+0000","last_became_peered":"2024-09-16T01:15:43.762837+0000","last_unstale":"2024-09-16T01:15:44.746558+0000","last_undegraded":"2024-09-16T01:15:44.746558+0000","last_fullsized":"2024-09-16T01:15:44.746558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:24.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921881+0000","last_change":"2024-09-16T01:15:39.727402+0000","last_active":"2024-09-16T01:15:44.921881+0000","last_peered":"2024-09-16T01:15:44.921881+0000","last_clean":"2024-09-16T01:15:44.921881+0000","last_became_active":"2024-09-16T01:15:39.726906+0000","last_became_peered":"2024-09-16T01:15:39.726906+0000","last_unstale":"2024-09-16T01:15:44.921881+0000","last_undegraded":"2024-09-16T01:15:44.921881+0000","last_fullsized":"2024-09-16T01:15:44.921881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.166842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922185+0000","last_change":"2024-09-16T01:15:38.707171+0000","last_active":"2024-09-16T01:15:44.922185+0000","last_peered":"2024-09-16T01:15:44.922185+0000","last_clean":"2024-09-16T01:15:44.922185+0000","last_became_active":"2024-09-16T01:15:38.706905+0000","last_became_peered":"2024-09-16T01:15:38.706905+0000","last_unstale":"2024-09-16T01:15:44.922185+0000","last_undegraded":"2024-09-16T01:15:44.922185+0000","last_fullsized":"2024-09-16T01:15:44.922185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:42.942780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746293+0000","last_change":"2024-09-16T01:15:38.709634+0000","last_active":"2024-09-16T01:15:44.746293+0000","last_peered":"2024-09-16T01:15:44.746293+0000","last_clean":"2024-09-16T01:15:44.746293+0000","last_became_active":"2024-09-16T01:15:38.709327+0000","last_became_peered":"2024-09-16T01:15:38.709327+0000","last_unstale":"2024-09-16T01:15:44.746293+0000","last_undegraded":"2024-09-16T01:15:44.746293+0000","last_fullsized":"2024-09-16T01:15:44.746293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:52.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747564+0000","last_change":"2024-09-16T01:15:39.722400+0000","last_active":"2024-09-16T01:15:44.747564+0000","last_peered":"2024-09-16T01:15:44.747564+0000","last_clean":"2024-09-16T01:15:44.747564+0000","last_became_active":"2024-09-16T01:15:39.722125+0000","last_became_peered":"2024-09-16T01:15:39.722125+0000","last_unstale":"2024-09-16T01:15:44.747564+0000","last_undegraded":"2024-09-16T01:15:44.747564+0000","last_fullsized":"2024-09-16T01:15:44.747564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644833+0000","last_change":"2024-09-16T01:15:43.756363+0000","last_active":"2024-09-16T01:15:46.644833+0000","last_peered":"2024-09-16T01:15:46.644833+0000","last_clean":"2024-09-16T01:15:46.644833+0000","last_became_active":"2024-09-16T01:15:43.755986+0000","last_became_peered":"2024-09-16T01:15:43.755986+0000","last_unstale":"2024-09-16T01:15:46.644833+0000","last_undegraded":"2024-09-16T01:15:46.644833+0000","last_fullsized":"2024-09-16T01:15:46.644833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:59.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922374+0000","last_change":"2024-09-16T01:15:38.717144+0000","last_active":"2024-09-16T01:15:44.922374+0000","last_peered":"2024-09-16T01:15:44.922374+0000","last_clean":"2024-09-16T01:15:44.922374+0000","last_became_active":"2024-09-16T01:15:38.716925+0000","last_became_peered":"2024-09-16T01:15:38.716925+0000","last_unstale":"2024-09-16T01:15:44.922374+0000","last_undegraded":"2024-09-16T01:15:44.922374+0000","last_fullsized":"2024-09-16T01:15:44.922374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:44.803896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944458+0000","last_change":"2024-09-16T01:15:39.720645+0000","last_active":"2024-09-16T01:15:45.944458+0000","last_peered":"2024-09-16T01:15:45.944458+0000","last_clean":"2024-09-16T01:15:45.944458+0000","last_became_active":"2024-09-16T01:15:39.720391+0000","last_became_peered":"2024-09-16T01:15:39.720391+0000","last_unstale":"2024-09-16T01:15:45.944458+0000","last_undegraded":"2024-09-16T01:15:45.944458+0000","last_fullsized":"2024-09-16T01:15:45.944458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:09.524001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922230+0000","last_change":"2024-09-16T01:15:43.761796+0000","last_active":"2024-09-16T01:15:44.922230+0000","last_peered":"2024-09-16T01:15:44.922230+0000","last_clean":"2024-09-16T01:15:44.922230+0000","last_became_active":"2024-09-16T01:15:43.761242+0000","last_became_peered":"2024-09-16T01:15:43.761242+0000","last_unstale":"2024-09-16T01:15:44.922230+0000","last_undegraded":"2024-09-16T01:15:44.922230+0000","last_fullsized":"2024-09-16T01:15:44.922230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:41.757039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745300+0000","last_change":"2024-09-16T01:15:39.726420+0000","last_active":"2024-09-16T01:15:44.745300+0000","last_peered":"2024-09-16T01:15:44.745300+0000","last_clean":"2024-09-16T01:15:44.745300+0000","last_became_active":"2024-09-16T01:15:39.726142+0000","last_became_peered":"2024-09-16T01:15:39.726142+0000","last_unstale":"2024-09-16T01:15:44.745300+0000","last_undegraded":"2024-09-16T01:15:44.745300+0000","last_fullsized":"2024-09-16T01:15:44.745300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644670+0000","last_change":"2024-09-16T01:15:39.708234+0000","last_active":"2024-09-16T01:15:46.644670+0000","last_peered":"2024-09-16T01:15:46.644670+0000","last_clean":"2024-09-16T01:15:46.644670+0000","last_became_active":"2024-09-16T01:15:39.707935+0000","last_became_peered":"2024-09-16T01:15:39.707935+0000","last_unstale":"2024-09-16T01:15:46.644670+0000","last_undegraded":"2024-09-16T01:15:46.644670+0000","last_fullsized":"2024-09-16T01:15:46.644670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.000406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746151+0000","last_change":"2024-09-16T01:15:39.716296+0000","last_active":"2024-09-16T01:15:44.746151+0000","last_peered":"2024-09-16T01:15:44.746151+0000","last_clean":"2024-09-16T01:15:44.746151+0000","last_became_active":"2024-09-16T01:15:39.715998+0000","last_became_peered":"2024-09-16T01:15:39.715998+0000","last_unstale":"2024-09-16T01:15:44.746151+0000","last_undegraded":"2024-09-16T01:15:44.746151+0000","last_fullsized":"2024-09-16T01:15:44.746151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:19.871750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747461+0000","last_change":"2024-09-16T01:15:39.732779+0000","last_active":"2024-09-16T01:15:44.747461+0000","last_peered":"2024-09-16T01:15:44.747461+0000","last_clean":"2024-09-16T01:15:44.747461+0000","last_became_active":"2024-09-16T01:15:39.732514+0000","last_became_peered":"2024-09-16T01:15:39.732514+0000","last_unstale":"2024-09-16T01:15:44.747461+0000","last_undegraded":"2024-09-16T01:15:44.747461+0000","last_fullsized":"2024-09-16T01:15:44.747461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922366+0000","last_change":"2024-09-16T01:15:39.732741+0000","last_active":"2024-09-16T01:15:44.922366+0000","last_peered":"2024-09-16T01:15:44.922366+0000","last_clean":"2024-09-16T01:15:44.922366+0000","last_became_active":"2024-09-16T01:15:39.732480+0000","last_became_peered":"2024-09-16T01:15:39.732480+0000","last_unstale":"2024-09-16T01:15:44.922366+0000","last_undegraded":"2024-09-16T01:15:44.922366+0000","last_fullsized":"2024-09-16T01:15:44.922366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:32.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817305+0000","last_change":"2024-09-16T01:15:39.721673+0000","last_active":"2024-09-16T01:15:44.817305+0000","last_peered":"2024-09-16T01:15:44.817305+0000","last_clean":"2024-09-16T01:15:44.817305+0000","last_became_active":"2024-09-16T01:15:39.721038+0000","last_became_peered":"2024-09-16T01:15:39.721038+0000","last_unstale":"2024-09-16T01:15:44.817305+0000","last_undegraded":"2024-09-16T01:15:44.817305+0000","last_fullsized":"2024-09-16T01:15:44.817305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:32.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746704+0000","last_change":"2024-09-16T01:15:39.725684+0000","last_active":"2024-09-16T01:15:44.746704+0000","last_peered":"2024-09-16T01:15:44.746704+0000","last_clean":"2024-09-16T01:15:44.746704+0000","last_became_active":"2024-09-16T01:15:39.725383+0000","last_became_peered":"2024-09-16T01:15:39.725383+0000","last_unstale":"2024-09-16T01:15:44.746704+0000","last_undegraded":"2024-09-16T01:15:44.746704+0000","last_fullsized":"2024-09-16T01:15:44.746704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922579+0000","last_change":"2024-09-16T01:15:39.732120+0000","last_active":"2024-09-16T01:15:44.922579+0000","last_peered":"2024-09-16T01:15:44.922579+0000","last_clean":"2024-09-16T01:15:44.922579+0000","last_became_active":"2024-09-16T01:15:39.731874+0000","last_became_peered":"2024-09-16T01:15:39.731874+0000","last_unstale":"2024-09-16T01:15:44.922579+0000","last_undegraded":"2024-09-16T01:15:44.922579+0000","last_fullsized":"2024-09-16T01:15:44.922579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:39.132954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744949+0000","last_change":"2024-09-16T01:15:39.714218+0000","last_active":"2024-09-16T01:15:44.744949+0000","last_peered":"2024-09-16T01:15:44.744949+0000","last_clean":"2024-09-16T01:15:44.744949+0000","last_became_active":"2024-09-16T01:15:39.713937+0000","last_became_peered":"2024-09-16T01:15:39.713937+0000","last_unstale":"2024-09-16T01:15:44.744949+0000","last_undegraded":"2024-09-16T01:15:44.744949+0000","last_fullsized":"2024-09-16T01:15:44.744949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:32.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922164+0000","last_change":"2024-09-16T01:15:39.733311+0000","last_active":"2024-09-16T01:15:44.922164+0000","last_peered":"2024-09-16T01:15:44.922164+0000","last_clean":"2024-09-16T01:15:44.922164+0000","last_became_active":"2024-09-16T01:15:39.733144+0000","last_became_peered":"2024-09-16T01:15:39.733144+0000","last_unstale":"2024-09-16T01:15:44.922164+0000","last_undegraded":"2024-09-16T01:15:44.922164+0000","last_fullsized":"2024-09-16T01:15:44.922164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746055+0000","last_change":"2024-09-16T01:15:39.724420+0000","last_active":"2024-09-16T01:15:44.746055+0000","last_peered":"2024-09-16T01:15:44.746055+0000","last_clean":"2024-09-16T01:15:44.746055+0000","last_became_active":"2024-09-16T01:15:39.723819+0000","last_became_peered":"2024-09-16T01:15:39.723819+0000","last_unstale":"2024-09-16T01:15:44.746055+0000","last_undegraded":"2024-09-16T01:15:44.746055+0000","last_fullsized":"2024-09-16T01:15:44.746055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:50.941305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747222+0000","last_change":"2024-09-16T01:15:39.723569+0000","last_active":"2024-09-16T01:15:44.747222+0000","last_peered":"2024-09-16T01:15:44.747222+0000","last_clean":"2024-09-16T01:15:44.747222+0000","last_became_active":"2024-09-16T01:15:39.723316+0000","last_became_peered":"2024-09-16T01:15:39.723316+0000","last_unstale":"2024-09-16T01:15:44.747222+0000","last_undegraded":"2024-09-16T01:15:44.747222+0000","last_fullsized":"2024-09-16T01:15:44.747222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746161+0000","last_change":"2024-09-16T01:15:39.719774+0000","last_active":"2024-09-16T01:15:44.746161+0000","last_peered":"2024-09-16T01:15:44.746161+0000","last_clean":"2024-09-16T01:15:44.746161+0000","last_became_active":"2024-09-16T01:15:39.719499+0000","last_became_peered":"2024-09-16T01:15:39.719499+0000","last_unstale":"2024-09-16T01:15:44.746161+0000","last_undegraded":"2024-09-16T01:15:44.746161+0000","last_fullsized":"2024-09-16T01:15:44.746161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251449+0000","last_change":"2024-09-16T01:15:39.724488+0000","last_active":"2024-09-16T01:15:46.251449+0000","last_peered":"2024-09-16T01:15:46.251449+0000","last_clean":"2024-09-16T01:15:46.251449+0000","last_became_active":"2024-09-16T01:15:39.724205+0000","last_became_peered":"2024-09-16T01:15:39.724205+0000","last_unstale":"2024-09-16T01:15:46.251449+0000","last_undegraded":"2024-09-16T01:15:46.251449+0000","last_fullsized":"2024-09-16T01:15:46.251449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:06.887785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644890+0000","last_change":"2024-09-16T01:15:39.712637+0000","last_active":"2024-09-16T01:15:46.644890+0000","last_peered":"2024-09-16T01:15:46.644890+0000","last_clean":"2024-09-16T01:15:46.644890+0000","last_became_active":"2024-09-16T01:15:39.712015+0000","last_became_peered":"2024-09-16T01:15:39.712015+0000","last_unstale":"2024-09-16T01:15:46.644890+0000","last_undegraded":"2024-09-16T01:15:46.644890+0000","last_fullsized":"2024-09-16T01:15:46.644890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:51.849603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745814+0000","last_change":"2024-09-16T01:15:39.722757+0000","last_active":"2024-09-16T01:15:44.745814+0000","last_peered":"2024-09-16T01:15:44.745814+0000","last_clean":"2024-09-16T01:15:44.745814+0000","last_became_active":"2024-09-16T01:15:39.722500+0000","last_became_peered":"2024-09-16T01:15:39.722500+0000","last_unstale":"2024-09-16T01:15:44.745814+0000","last_undegraded":"2024-09-16T01:15:44.745814+0000","last_fullsized":"2024-09-16T01:15:44.745814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:23.041359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744838+0000","last_change":"2024-09-16T01:15:39.725209+0000","last_active":"2024-09-16T01:15:44.744838+0000","last_peered":"2024-09-16T01:15:44.744838+0000","last_clean":"2024-09-16T01:15:44.744838+0000","last_became_active":"2024-09-16T01:15:39.724906+0000","last_became_peered":"2024-09-16T01:15:39.724906+0000","last_unstale":"2024-09-16T01:15:44.744838+0000","last_undegraded":"2024-09-16T01:15:44.744838+0000","last_fullsized":"2024-09-16T01:15:44.744838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816777+0000","last_change":"2024-09-16T01:15:39.724771+0000","last_active":"2024-09-16T01:15:44.816777+0000","last_peered":"2024-09-16T01:15:44.816777+0000","last_clean":"2024-09-16T01:15:44.816777+0000","last_became_active":"2024-09-16T01:15:39.724512+0000","last_became_peered":"2024-09-16T01:15:39.724512+0000","last_unstale":"2024-09-16T01:15:44.816777+0000","last_undegraded":"2024-09-16T01:15:44.816777+0000","last_fullsized":"2024-09-16T01:15:44.816777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747162+0000","last_change":"2024-09-16T01:15:39.717182+0000","last_active":"2024-09-16T01:15:44.747162+0000","last_peered":"2024-09-16T01:15:44.747162+0000","last_clean":"2024-09-16T01:15:44.747162+0000","last_became_active":"2024-09-16T01:15:39.716928+0000","last_became_peered":"2024-09-16T01:15:39.716928+0000","last_unstale":"2024-09-16T01:15:44.747162+0000","last_undegraded":"2024-09-16T01:15:44.747162+0000","last_fullsized":"2024-09-16T01:15:44.747162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:55.663948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922288+0000","last_change":"2024-09-16T01:15:39.729915+0000","last_active":"2024-09-16T01:15:44.922288+0000","last_peered":"2024-09-16T01:15:44.922288+0000","last_clean":"2024-09-16T01:15:44.922288+0000","last_became_active":"2024-09-16T01:15:39.729619+0000","last_became_peered":"2024-09-16T01:15:39.729619+0000","last_unstale":"2024-09-16T01:15:44.922288+0000","last_undegraded":"2024-09-16T01:15:44.922288+0000","last_fullsized":"2024-09-16T01:15:44.922288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944679+0000","last_change":"2024-09-16T01:15:39.728860+0000","last_active":"2024-09-16T01:15:45.944679+0000","last_peered":"2024-09-16T01:15:45.944679+0000","last_clean":"2024-09-16T01:15:45.944679+0000","last_became_active":"2024-09-16T01:15:39.728186+0000","last_became_peered":"2024-09-16T01:15:39.728186+0000","last_unstale":"2024-09-16T01:15:45.944679+0000","last_undegraded":"2024-09-16T01:15:45.944679+0000","last_fullsized":"2024-09-16T01:15:45.944679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:59.931695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746379+0000","last_change":"2024-09-16T01:15:39.721095+0000","last_active":"2024-09-16T01:15:44.746379+0000","last_peered":"2024-09-16T01:15:44.746379+0000","last_clean":"2024-09-16T01:15:44.746379+0000","last_became_active":"2024-09-16T01:15:39.720129+0000","last_became_peered":"2024-09-16T01:15:39.720129+0000","last_unstale":"2024-09-16T01:15:44.746379+0000","last_undegraded":"2024-09-16T01:15:44.746379+0000","last_fullsized":"2024-09-16T01:15:44.746379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.089581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746705+0000","last_change":"2024-09-16T01:15:39.720408+0000","last_active":"2024-09-16T01:15:44.746705+0000","last_peered":"2024-09-16T01:15:44.746705+0000","last_clean":"2024-09-16T01:15:44.746705+0000","last_became_active":"2024-09-16T01:15:39.720126+0000","last_became_peered":"2024-09-16T01:15:39.720126+0000","last_unstale":"2024-09-16T01:15:44.746705+0000","last_undegraded":"2024-09-16T01:15:44.746705+0000","last_fullsized":"2024-09-16T01:15:44.746705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251410+0000","last_change":"2024-09-16T01:15:39.729127+0000","last_active":"2024-09-16T01:15:46.251410+0000","last_peered":"2024-09-16T01:15:46.251410+0000","last_clean":"2024-09-16T01:15:46.251410+0000","last_became_active":"2024-09-16T01:15:39.728867+0000","last_became_peered":"2024-09-16T01:15:39.728867+0000","last_unstale":"2024-09-16T01:15:46.251410+0000","last_undegraded":"2024-09-16T01:15:46.251410+0000","last_fullsized":"2024-09-16T01:15:46.251410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:30.159628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921788+0000","last_change":"2024-09-16T01:15:39.727163+0000","last_active":"2024-09-16T01:15:44.921788+0000","last_peered":"2024-09-16T01:15:44.921788+0000","last_clean":"2024-09-16T01:15:44.921788+0000","last_became_active":"2024-09-16T01:15:39.726499+0000","last_became_peered":"2024-09-16T01:15:39.726499+0000","last_unstale":"2024-09-16T01:15:44.921788+0000","last_undegraded":"2024-09-16T01:15:44.921788+0000","last_fullsized":"2024-09-16T01:15:44.921788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.089581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250973+0000","last_change":"2024-09-16T01:15:39.723869+0000","last_active":"2024-09-16T01:15:46.250973+0000","last_peered":"2024-09-16T01:15:46.250973+0000","last_clean":"2024-09-16T01:15:46.250973+0000","last_became_active":"2024-09-16T01:15:39.723601+0000","last_became_peered":"2024-09-16T01:15:39.723601+0000","last_unstale":"2024-09-16T01:15:46.250973+0000","last_undegraded":"2024-09-16T01:15:46.250973+0000","last_fullsized":"2024-09-16T01:15:46.250973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:22.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745944+0000","last_change":"2024-09-16T01:15:39.724663+0000","last_active":"2024-09-16T01:15:44.745944+0000","last_peered":"2024-09-16T01:15:44.745944+0000","last_clean":"2024-09-16T01:15:44.745944+0000","last_became_active":"2024-09-16T01:15:39.724164+0000","last_became_peered":"2024-09-16T01:15:39.724164+0000","last_unstale":"2024-09-16T01:15:44.745944+0000","last_undegraded":"2024-09-16T01:15:44.745944+0000","last_fullsized":"2024-09-16T01:15:44.745944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250875+0000","last_change":"2024-09-16T01:15:39.723119+0000","last_active":"2024-09-16T01:15:46.250875+0000","last_peered":"2024-09-16T01:15:46.250875+0000","last_clean":"2024-09-16T01:15:46.250875+0000","last_became_active":"2024-09-16T01:15:39.722798+0000","last_became_peered":"2024-09-16T01:15:39.722798+0000","last_unstale":"2024-09-16T01:15:46.250875+0000","last_undegraded":"2024-09-16T01:15:46.250875+0000","last_fullsized":"2024-09-16T01:15:46.250875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:51.270260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745254+0000","last_change":"2024-09-16T01:15:39.716987+0000","last_active":"2024-09-16T01:15:44.745254+0000","last_peered":"2024-09-16T01:15:44.745254+0000","last_clean":"2024-09-16T01:15:44.745254+0000","last_became_active":"2024-09-16T01:15:39.716715+0000","last_became_peered":"2024-09-16T01:15:39.716715+0000","last_unstale":"2024-09-16T01:15:44.745254+0000","last_undegraded":"2024-09-16T01:15:44.745254+0000","last_fullsized":"2024-09-16T01:15:44.745254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:22.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747307+0000","last_change":"2024-09-16T01:15:39.721824+0000","last_active":"2024-09-16T01:15:44.747307+0000","last_peered":"2024-09-16T01:15:44.747307+0000","last_clean":"2024-09-16T01:15:44.747307+0000","last_became_active":"2024-09-16T01:15:39.721566+0000","last_became_peered":"2024-09-16T01:15:39.721566+0000","last_unstale":"2024-09-16T01:15:44.747307+0000","last_undegraded":"2024-09-16T01:15:44.747307+0000","last_fullsized":"2024-09-16T01:15:44.747307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.166842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817619+0000","last_change":"2024-09-16T01:15:39.723439+0000","last_active":"2024-09-16T01:15:44.817619+0000","last_peered":"2024-09-16T01:15:44.817619+0000","last_clean":"2024-09-16T01:15:44.817619+0000","last_became_active":"2024-09-16T01:15:39.722822+0000","last_became_peered":"2024-09-16T01:15:39.722822+0000","last_unstale":"2024-09-16T01:15:44.817619+0000","last_undegraded":"2024-09-16T01:15:44.817619+0000","last_fullsized":"2024-09-16T01:15:44.817619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251286+0000","last_change":"2024-09-16T01:15:39.721668+0000","last_active":"2024-09-16T01:15:46.251286+0000","last_peered":"2024-09-16T01:15:46.251286+0000","last_clean":"2024-09-16T01:15:46.251286+0000","last_became_active":"2024-09-16T01:15:39.720818+0000","last_became_peered":"2024-09-16T01:15:39.720818+0000","last_unstale":"2024-09-16T01:15:46.251286+0000","last_undegraded":"2024-09-16T01:15:46.251286+0000","last_fullsized":"2024-09-16T01:15:46.251286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:19.871750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:16:03.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:16:04.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.107+0000 7f2926123640 1 Processor -- start 2024-09-16T01:16:04.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.108+0000 7f2926123640 1 -- start start 2024-09-16T01:16:04.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.108+0000 7f2926123640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f29200b6680 0x7f2920169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.108+0000 7f2926123640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f292006d9f0 con 0x7f2920162060 2024-09-16T01:16:04.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.108+0000 7f2926123640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f292006dcd0 con 0x7f2920161c80 2024-09-16T01:16:04.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.108+0000 7f2926123640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f292006dfb0 con 0x7f29200b6680 2024-09-16T01:16:04.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.108+0000 7f291effd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2920162060 0x7f29200b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42426/0 (socket says 172.21.15.81:42426) 2024-09-16T01:16:04.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.108+0000 7f291effd640 1 -- 172.21.15.81:0/385744284 learned_addr learned my addr 172.21.15.81:0/385744284 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:04.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.109+0000 7f291ffff640 1 --2- 172.21.15.81:0/385744284 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f29200b6680 0x7f2920169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.109+0000 7f291e7fc640 1 -- 172.21.15.81:0/385744284 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328288830 0 0) 0x7f292006d9f0 con 0x7f2920162060 2024-09-16T01:16:04.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.109+0000 7f291e7fc640 1 -- 172.21.15.81:0/385744284 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f290c003520 con 0x7f2920162060 2024-09-16T01:16:04.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.109+0000 7f291e7fc640 1 -- 172.21.15.81:0/385744284 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 406805198 0 0) 0x7f292006dcd0 con 0x7f2920161c80 2024-09-16T01:16:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.109+0000 7f291e7fc640 1 -- 172.21.15.81:0/385744284 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f292006d9f0 con 0x7f2920161c80 2024-09-16T01:16:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.109+0000 7f291ffff640 1 -- 172.21.15.81:0/385744284 >> v1:172.21.15.102:6789/0 conn(0x7f2920161c80 legacy=0x7f292006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.109+0000 7f291ffff640 1 -- 172.21.15.81:0/385744284 >> v1:172.21.15.81:6789/0 conn(0x7f2920162060 legacy=0x7f29200b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.109+0000 7f291e7fc640 1 -- 172.21.15.81:0/385744284 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3984410479 0 0) 0x7f290c003520 con 0x7f2920162060 2024-09-16T01:16:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.109+0000 7f291ffff640 1 -- 172.21.15.81:0/385744284 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29200d01f0 con 0x7f29200b6680 2024-09-16T01:16:04.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.110+0000 7f291ffff640 1 --2- 172.21.15.81:0/385744284 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f29200b6680 0x7f2920169830 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2918009dc0 tx=0x7f291802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac3abb5256d81b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.110+0000 7f291e7fc640 1 -- 172.21.15.81:0/385744284 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918007740 con 0x7f29200b6680 2024-09-16T01:16:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.110+0000 7f291e7fc640 1 -- 172.21.15.81:0/385744284 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29180078e0 con 0x7f29200b6680 2024-09-16T01:16:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.110+0000 7f291e7fc640 1 -- 172.21.15.81:0/385744284 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918007c90 con 0x7f29200b6680 2024-09-16T01:16:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.110+0000 7f2926123640 1 -- 172.21.15.81:0/385744284 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f29200b6680 msgr2=0x7f2920169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.110+0000 7f2926123640 1 --2- 172.21.15.81:0/385744284 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f29200b6680 0x7f2920169830 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2918009dc0 tx=0x7f291802a6d0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.110+0000 7f2926123640 1 -- 172.21.15.81:0/385744284 shutdown_connections 2024-09-16T01:16:04.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.110+0000 7f2926123640 1 --2- 172.21.15.81:0/385744284 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f29200b6680 0x7f2920169830 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.110+0000 7f2926123640 1 -- 172.21.15.81:0/385744284 >> 172.21.15.81:0/385744284 conn(0x7f29200d44f0 msgr2=0x7f29200d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:04.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.110+0000 7f2926123640 1 -- 172.21.15.81:0/385744284 shutdown_connections 2024-09-16T01:16:04.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.110+0000 7f2926123640 1 -- 172.21.15.81:0/385744284 wait complete. 2024-09-16T01:16:04.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.112+0000 7f2926123640 1 Processor -- start 2024-09-16T01:16:04.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.112+0000 7f2926123640 1 -- start start 2024-09-16T01:16:04.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.112+0000 7f2926123640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200b6680 0x7f292014f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.112+0000 7f2926123640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2920161c80 0x7f292014c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.112+0000 7f2926123640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2920162060 0x7f29200b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f2926123640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29200b6cb0 con 0x7f29200b6680 2024-09-16T01:16:04.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f2926123640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f29200b6b30 con 0x7f2920161c80 2024-09-16T01:16:04.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f2926123640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2920169d70 con 0x7f2920162060 2024-09-16T01:16:04.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f291f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200b6680 0x7f292014f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f291f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200b6680 0x7f292014f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41672/0 (socket says 172.21.15.81:41672) 2024-09-16T01:16:04.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f291f7fe640 1 -- 172.21.15.81:0/469624162 learned_addr learned my addr 172.21.15.81:0/469624162 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:04.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f291effd640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2920161c80 0x7f292014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f291ffff640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2920162060 0x7f29200b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f291f7fe640 1 -- 172.21.15.81:0/469624162 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2920162060 msgr2=0x7f29200b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f291f7fe640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2920162060 0x7f29200b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f291f7fe640 1 -- 172.21.15.81:0/469624162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2920161c80 msgr2=0x7f292014c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f291f7fe640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2920161c80 0x7f292014c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f291f7fe640 1 -- 172.21.15.81:0/469624162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29200ba010 con 0x7f29200b6680 2024-09-16T01:16:04.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f291f7fe640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200b6680 0x7f292014f610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f291000c430 tx=0x7f291000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:04.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f2917fff640 1 -- 172.21.15.81:0/469624162 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910017070 con 0x7f29200b6680 2024-09-16T01:16:04.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f2917fff640 1 -- 172.21.15.81:0/469624162 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29100052f0 con 0x7f29200b6680 2024-09-16T01:16:04.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f2926123640 1 -- 172.21.15.81:0/469624162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29200b1db0 con 0x7f29200b6680 2024-09-16T01:16:04.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f2917fff640 1 -- 172.21.15.81:0/469624162 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2910003830 con 0x7f29200b6680 2024-09-16T01:16:04.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.113+0000 7f2926123640 1 -- 172.21.15.81:0/469624162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f292014cd50 con 0x7f29200b6680 2024-09-16T01:16:04.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.114+0000 7f2926123640 1 -- 172.21.15.81:0/469624162 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29200b1bb0 con 0x7f29200b6680 2024-09-16T01:16:04.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.115+0000 7f2917fff640 1 -- 172.21.15.81:0/469624162 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f291001a070 con 0x7f29200b6680 2024-09-16T01:16:04.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.115+0000 7f2917fff640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f290006c2b0 0x7f290006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.115+0000 7f291effd640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f290006c2b0 0x7f290006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.115+0000 7f2917fff640 1 -- 172.21.15.81:0/469624162 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f291008ab70 con 0x7f29200b6680 2024-09-16T01:16:04.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.116+0000 7f291effd640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f290006c2b0 0x7f290006e770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2908007fd0 tx=0x7f2908009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:04.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.120+0000 7f2917fff640 1 -- 172.21.15.81:0/469624162 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2910058950 con 0x7f29200b6680 2024-09-16T01:16:04.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.281+0000 7f2926123640 1 -- 172.21.15.81:0/469624162 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29200ba470 con 0x7f290006c2b0 2024-09-16T01:16:04.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.289+0000 7f2917fff640 1 -- 172.21.15.81:0/469624162 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f29200ba470 con 0x7f290006c2b0 2024-09-16T01:16:04.296 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:04.299 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:16:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.292+0000 7f2926123640 1 -- 172.21.15.81:0/469624162 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f290006c2b0 msgr2=0x7f290006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.292+0000 7f2926123640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f290006c2b0 0x7f290006e770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2908007fd0 tx=0x7f2908009040 comp rx=0 tx=0).stop 2024-09-16T01:16:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.292+0000 7f2926123640 1 -- 172.21.15.81:0/469624162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200b6680 msgr2=0x7f292014f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.292+0000 7f2926123640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200b6680 0x7f292014f610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f291000c430 tx=0x7f291000c8f0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.292+0000 7f2926123640 1 -- 172.21.15.81:0/469624162 shutdown_connections 2024-09-16T01:16:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.292+0000 7f2926123640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f290006c2b0 0x7f290006e770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.292+0000 7f2926123640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2920162060 0x7f29200b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.292+0000 7f2926123640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2920161c80 0x7f292014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.292+0000 7f2926123640 1 --2- 172.21.15.81:0/469624162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29200b6680 0x7f292014f610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.292+0000 7f2926123640 1 -- 172.21.15.81:0/469624162 >> 172.21.15.81:0/469624162 conn(0x7f29200d44f0 msgr2=0x7f29200b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:04.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.292+0000 7f2926123640 1 -- 172.21.15.81:0/469624162 shutdown_connections 2024-09-16T01:16:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.292+0000 7f2926123640 1 -- 172.21.15.81:0/469624162 wait complete. 2024-09-16T01:16:04.305 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-16T01:16:04.063789+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219432,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755288,"statfs":{"total":773094113280,"available":772869414912,"internally_reserved":0,"allocated":3284992,"data_stored":1992068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003216"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747622+0000","last_change":"2024-09-16T01:15:38.721067+0000","last_active":"2024-09-16T01:15:44.747622+0000","last_peered":"2024-09-16T01:15:44.747622+0000","last_clean":"2024-09-16T01:15:44.747622+0000","last_became_active":"2024-09-16T01:15:38.720869+0000","last_became_peered":"2024-09-16T01:15:38.720869+0000","last_unstale":"2024-09-16T01:15:44.747622+0000","last_undegraded":"2024-09-16T01:15:44.747622+0000","last_fullsized":"2024-09-16T01:15:44.747622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:37.356692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922559+0000","last_change":"2024-09-16T01:15:39.720014+0000","last_active":"2024-09-16T01:15:44.922559+0000","last_peered":"2024-09-16T01:15:44.922559+0000","last_clean":"2024-09-16T01:15:44.922559+0000","last_became_active":"2024-09-16T01:15:39.719700+0000","last_became_peered":"2024-09-16T01:15:39.719700+0000","last_unstale":"2024-09-16T01:15:44.922559+0000","last_undegraded":"2024-09-16T01:15:44.922559+0000","last_fullsized":"2024-09-16T01:15:44.922559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:15.851594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921951+0000","last_change":"2024-09-16T01:15:43.919879+0000","last_active":"2024-09-16T01:15:44.921951+0000","last_peered":"2024-09-16T01:15:44.921951+0000","last_clean":"2024-09-16T01:15:44.921951+0000","last_became_active":"2024-09-16T01:15:43.919471+0000","last_became_peered":"2024-09-16T01:15:43.919471+0000","last_unstale":"2024-09-16T01:15:44.921951+0000","last_undegraded":"2024-09-16T01:15:44.921951+0000","last_fullsized":"2024-09-16T01:15:44.921951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:48.711431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922637+0000","last_change":"2024-09-16T01:15:38.718512+0000","last_active":"2024-09-16T01:15:44.922637+0000","last_peered":"2024-09-16T01:15:44.922637+0000","last_clean":"2024-09-16T01:15:44.922637+0000","last_became_active":"2024-09-16T01:15:38.718193+0000","last_became_peered":"2024-09-16T01:15:38.718193+0000","last_unstale":"2024-09-16T01:15:44.922637+0000","last_undegraded":"2024-09-16T01:15:44.922637+0000","last_fullsized":"2024-09-16T01:15:44.922637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:36.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747347+0000","last_change":"2024-09-16T01:15:39.730526+0000","last_active":"2024-09-16T01:15:44.747347+0000","last_peered":"2024-09-16T01:15:44.747347+0000","last_clean":"2024-09-16T01:15:44.747347+0000","last_became_active":"2024-09-16T01:15:39.729904+0000","last_became_peered":"2024-09-16T01:15:39.729904+0000","last_unstale":"2024-09-16T01:15:44.747347+0000","last_undegraded":"2024-09-16T01:15:44.747347+0000","last_fullsized":"2024-09-16T01:15:44.747347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944132+0000","last_change":"2024-09-16T01:15:43.764125+0000","last_active":"2024-09-16T01:15:45.944132+0000","last_peered":"2024-09-16T01:15:45.944132+0000","last_clean":"2024-09-16T01:15:45.944132+0000","last_became_active":"2024-09-16T01:15:43.763689+0000","last_became_peered":"2024-09-16T01:15:43.763689+0000","last_unstale":"2024-09-16T01:15:45.944132+0000","last_undegraded":"2024-09-16T01:15:45.944132+0000","last_fullsized":"2024-09-16T01:15:45.944132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:36.873854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251413+0000","last_change":"2024-09-16T01:15:38.723925+0000","last_active":"2024-09-16T01:15:46.251413+0000","last_peered":"2024-09-16T01:15:46.251413+0000","last_clean":"2024-09-16T01:15:46.251413+0000","last_became_active":"2024-09-16T01:15:38.723660+0000","last_became_peered":"2024-09-16T01:15:38.723660+0000","last_unstale":"2024-09-16T01:15:46.251413+0000","last_undegraded":"2024-09-16T01:15:46.251413+0000","last_fullsized":"2024-09-16T01:15:46.251413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:50.843647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745352+0000","last_change":"2024-09-16T01:15:39.718658+0000","last_active":"2024-09-16T01:15:44.745352+0000","last_peered":"2024-09-16T01:15:44.745352+0000","last_clean":"2024-09-16T01:15:44.745352+0000","last_became_active":"2024-09-16T01:15:39.718360+0000","last_became_peered":"2024-09-16T01:15:39.718360+0000","last_unstale":"2024-09-16T01:15:44.745352+0000","last_undegraded":"2024-09-16T01:15:44.745352+0000","last_fullsized":"2024-09-16T01:15:44.745352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:51.270260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944453+0000","last_change":"2024-09-16T01:15:43.764643+0000","last_active":"2024-09-16T01:15:45.944453+0000","last_peered":"2024-09-16T01:15:45.944453+0000","last_clean":"2024-09-16T01:15:45.944453+0000","last_became_active":"2024-09-16T01:15:43.764229+0000","last_became_peered":"2024-09-16T01:15:43.764229+0000","last_unstale":"2024-09-16T01:15:45.944453+0000","last_undegraded":"2024-09-16T01:15:45.944453+0000","last_fullsized":"2024-09-16T01:15:45.944453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:57.315283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251049+0000","last_change":"2024-09-16T01:15:38.721191+0000","last_active":"2024-09-16T01:15:46.251049+0000","last_peered":"2024-09-16T01:15:46.251049+0000","last_clean":"2024-09-16T01:15:46.251049+0000","last_became_active":"2024-09-16T01:15:38.720832+0000","last_became_peered":"2024-09-16T01:15:38.720832+0000","last_unstale":"2024-09-16T01:15:46.251049+0000","last_undegraded":"2024-09-16T01:15:46.251049+0000","last_fullsized":"2024-09-16T01:15:46.251049+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:35.717778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745724+0000","last_change":"2024-09-16T01:15:39.718836+0000","last_active":"2024-09-16T01:15:44.745724+0000","last_peered":"2024-09-16T01:15:44.745724+0000","last_clean":"2024-09-16T01:15:44.745724+0000","last_became_active":"2024-09-16T01:15:39.718367+0000","last_became_peered":"2024-09-16T01:15:39.718367+0000","last_unstale":"2024-09-16T01:15:44.745724+0000","last_undegraded":"2024-09-16T01:15:44.745724+0000","last_fullsized":"2024-09-16T01:15:44.745724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:39.132954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944337+0000","last_change":"2024-09-16T01:15:43.762123+0000","last_active":"2024-09-16T01:15:45.944337+0000","last_peered":"2024-09-16T01:15:45.944337+0000","last_clean":"2024-09-16T01:15:45.944337+0000","last_became_active":"2024-09-16T01:15:43.761634+0000","last_became_peered":"2024-09-16T01:15:43.761634+0000","last_unstale":"2024-09-16T01:15:45.944337+0000","last_undegraded":"2024-09-16T01:15:45.944337+0000","last_fullsized":"2024-09-16T01:15:45.944337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:26.316809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746166+0000","last_change":"2024-09-16T01:15:39.718972+0000","last_active":"2024-09-16T01:15:44.746166+0000","last_peered":"2024-09-16T01:15:44.746166+0000","last_clean":"2024-09-16T01:15:44.746166+0000","last_became_active":"2024-09-16T01:15:39.718666+0000","last_became_peered":"2024-09-16T01:15:39.718666+0000","last_unstale":"2024-09-16T01:15:44.746166+0000","last_undegraded":"2024-09-16T01:15:44.746166+0000","last_fullsized":"2024-09-16T01:15:44.746166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.166842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251231+0000","last_change":"2024-09-16T01:15:38.726840+0000","last_active":"2024-09-16T01:15:46.251231+0000","last_peered":"2024-09-16T01:15:46.251231+0000","last_clean":"2024-09-16T01:15:46.251231+0000","last_became_active":"2024-09-16T01:15:38.726541+0000","last_became_peered":"2024-09-16T01:15:38.726541+0000","last_unstale":"2024-09-16T01:15:46.251231+0000","last_undegraded":"2024-09-16T01:15:46.251231+0000","last_fullsized":"2024-09-16T01:15:46.251231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:54.657992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944947+0000","last_change":"2024-09-16T01:15:43.764429+0000","last_active":"2024-09-16T01:15:45.944947+0000","last_peered":"2024-09-16T01:15:45.944947+0000","last_clean":"2024-09-16T01:15:45.944947+0000","last_became_active":"2024-09-16T01:15:43.763453+0000","last_became_peered":"2024-09-16T01:15:43.763453+0000","last_unstale":"2024-09-16T01:15:45.944947+0000","last_undegraded":"2024-09-16T01:15:45.944947+0000","last_fullsized":"2024-09-16T01:15:45.944947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:54.978121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922348+0000","last_change":"2024-09-16T01:15:39.729023+0000","last_active":"2024-09-16T01:15:44.922348+0000","last_peered":"2024-09-16T01:15:44.922348+0000","last_clean":"2024-09-16T01:15:44.922348+0000","last_became_active":"2024-09-16T01:15:39.728164+0000","last_became_peered":"2024-09-16T01:15:39.728164+0000","last_unstale":"2024-09-16T01:15:44.922348+0000","last_undegraded":"2024-09-16T01:15:44.922348+0000","last_fullsized":"2024-09-16T01:15:44.922348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817115+0000","last_change":"2024-09-16T01:15:38.712201+0000","last_active":"2024-09-16T01:15:44.817115+0000","last_peered":"2024-09-16T01:15:44.817115+0000","last_clean":"2024-09-16T01:15:44.817115+0000","last_became_active":"2024-09-16T01:15:38.711909+0000","last_became_peered":"2024-09-16T01:15:38.711909+0000","last_unstale":"2024-09-16T01:15:44.817115+0000","last_undegraded":"2024-09-16T01:15:44.817115+0000","last_fullsized":"2024-09-16T01:15:44.817115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:46.439923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944544+0000","last_change":"2024-09-16T01:15:43.764651+0000","last_active":"2024-09-16T01:15:45.944544+0000","last_peered":"2024-09-16T01:15:45.944544+0000","last_clean":"2024-09-16T01:15:45.944544+0000","last_became_active":"2024-09-16T01:15:43.764198+0000","last_became_peered":"2024-09-16T01:15:43.764198+0000","last_unstale":"2024-09-16T01:15:45.944544+0000","last_undegraded":"2024-09-16T01:15:45.944544+0000","last_fullsized":"2024-09-16T01:15:45.944544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:55.307076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921967+0000","last_change":"2024-09-16T01:15:39.730357+0000","last_active":"2024-09-16T01:15:44.921967+0000","last_peered":"2024-09-16T01:15:44.921967+0000","last_clean":"2024-09-16T01:15:44.921967+0000","last_became_active":"2024-09-16T01:15:39.728252+0000","last_became_peered":"2024-09-16T01:15:39.728252+0000","last_unstale":"2024-09-16T01:15:44.921967+0000","last_undegraded":"2024-09-16T01:15:44.921967+0000","last_fullsized":"2024-09-16T01:15:44.921967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816830+0000","last_change":"2024-09-16T01:15:38.716181+0000","last_active":"2024-09-16T01:15:44.816830+0000","last_peered":"2024-09-16T01:15:44.816830+0000","last_clean":"2024-09-16T01:15:44.816830+0000","last_became_active":"2024-09-16T01:15:38.715894+0000","last_became_peered":"2024-09-16T01:15:38.715894+0000","last_unstale":"2024-09-16T01:15:44.816830+0000","last_undegraded":"2024-09-16T01:15:44.816830+0000","last_fullsized":"2024-09-16T01:15:44.816830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:58.925739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817629+0000","last_change":"2024-09-16T01:15:43.921354+0000","last_active":"2024-09-16T01:15:44.817629+0000","last_peered":"2024-09-16T01:15:44.817629+0000","last_clean":"2024-09-16T01:15:44.817629+0000","last_became_active":"2024-09-16T01:15:43.919480+0000","last_became_peered":"2024-09-16T01:15:43.919480+0000","last_unstale":"2024-09-16T01:15:44.817629+0000","last_undegraded":"2024-09-16T01:15:44.817629+0000","last_fullsized":"2024-09-16T01:15:44.817629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:34.196444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944562+0000","last_change":"2024-09-16T01:15:39.722840+0000","last_active":"2024-09-16T01:15:45.944562+0000","last_peered":"2024-09-16T01:15:45.944562+0000","last_clean":"2024-09-16T01:15:45.944562+0000","last_became_active":"2024-09-16T01:15:39.722566+0000","last_became_peered":"2024-09-16T01:15:39.722566+0000","last_unstale":"2024-09-16T01:15:45.944562+0000","last_undegraded":"2024-09-16T01:15:45.944562+0000","last_fullsized":"2024-09-16T01:15:45.944562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.000406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250736+0000","last_change":"2024-09-16T01:15:38.722591+0000","last_active":"2024-09-16T01:15:46.250736+0000","last_peered":"2024-09-16T01:15:46.250736+0000","last_clean":"2024-09-16T01:15:46.250736+0000","last_became_active":"2024-09-16T01:15:38.722331+0000","last_became_peered":"2024-09-16T01:15:38.722331+0000","last_unstale":"2024-09-16T01:15:46.250736+0000","last_undegraded":"2024-09-16T01:15:46.250736+0000","last_fullsized":"2024-09-16T01:15:46.250736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:58.925739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944801+0000","last_change":"2024-09-16T01:15:43.763545+0000","last_active":"2024-09-16T01:15:45.944801+0000","last_peered":"2024-09-16T01:15:45.944801+0000","last_clean":"2024-09-16T01:15:45.944801+0000","last_became_active":"2024-09-16T01:15:43.763123+0000","last_became_peered":"2024-09-16T01:15:43.763123+0000","last_unstale":"2024-09-16T01:15:45.944801+0000","last_undegraded":"2024-09-16T01:15:45.944801+0000","last_fullsized":"2024-09-16T01:15:45.944801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:27.078175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747527+0000","last_change":"2024-09-16T01:15:39.721956+0000","last_active":"2024-09-16T01:15:44.747527+0000","last_peered":"2024-09-16T01:15:44.747527+0000","last_clean":"2024-09-16T01:15:44.747527+0000","last_became_active":"2024-09-16T01:15:39.721349+0000","last_became_peered":"2024-09-16T01:15:39.721349+0000","last_unstale":"2024-09-16T01:15:44.747527+0000","last_undegraded":"2024-09-16T01:15:44.747527+0000","last_fullsized":"2024-09-16T01:15:44.747527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.089581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746703+0000","last_change":"2024-09-16T01:15:38.717450+0000","last_active":"2024-09-16T01:15:44.746703+0000","last_peered":"2024-09-16T01:15:44.746703+0000","last_clean":"2024-09-16T01:15:44.746703+0000","last_became_active":"2024-09-16T01:15:38.717143+0000","last_became_peered":"2024-09-16T01:15:38.717143+0000","last_unstale":"2024-09-16T01:15:44.746703+0000","last_undegraded":"2024-09-16T01:15:44.746703+0000","last_fullsized":"2024-09-16T01:15:44.746703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:46.439923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944225+0000","last_change":"2024-09-16T01:15:43.920611+0000","last_active":"2024-09-16T01:15:45.944225+0000","last_peered":"2024-09-16T01:15:45.944225+0000","last_clean":"2024-09-16T01:15:45.944225+0000","last_became_active":"2024-09-16T01:15:43.920154+0000","last_became_peered":"2024-09-16T01:15:43.920154+0000","last_unstale":"2024-09-16T01:15:45.944225+0000","last_undegraded":"2024-09-16T01:15:45.944225+0000","last_fullsized":"2024-09-16T01:15:45.944225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:43.169770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922664+0000","last_change":"2024-09-16T01:15:39.727833+0000","last_active":"2024-09-16T01:15:44.922664+0000","last_peered":"2024-09-16T01:15:44.922664+0000","last_clean":"2024-09-16T01:15:44.922664+0000","last_became_active":"2024-09-16T01:15:39.727573+0000","last_became_peered":"2024-09-16T01:15:39.727573+0000","last_unstale":"2024-09-16T01:15:44.922664+0000","last_undegraded":"2024-09-16T01:15:44.922664+0000","last_fullsized":"2024-09-16T01:15:44.922664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:22.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817625+0000","last_change":"2024-09-16T01:15:38.707107+0000","last_active":"2024-09-16T01:15:44.817625+0000","last_peered":"2024-09-16T01:15:44.817625+0000","last_clean":"2024-09-16T01:15:44.817625+0000","last_became_active":"2024-09-16T01:15:38.706848+0000","last_became_peered":"2024-09-16T01:15:38.706848+0000","last_unstale":"2024-09-16T01:15:44.817625+0000","last_undegraded":"2024-09-16T01:15:44.817625+0000","last_fullsized":"2024-09-16T01:15:44.817625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:08.518045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922236+0000","last_change":"2024-09-16T01:15:43.921496+0000","last_active":"2024-09-16T01:15:44.922236+0000","last_peered":"2024-09-16T01:15:44.922236+0000","last_clean":"2024-09-16T01:15:44.922236+0000","last_became_active":"2024-09-16T01:15:43.920197+0000","last_became_peered":"2024-09-16T01:15:43.920197+0000","last_unstale":"2024-09-16T01:15:44.922236+0000","last_undegraded":"2024-09-16T01:15:44.922236+0000","last_fullsized":"2024-09-16T01:15:44.922236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:09.951543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817435+0000","last_change":"2024-09-16T01:15:39.723117+0000","last_active":"2024-09-16T01:15:44.817435+0000","last_peered":"2024-09-16T01:15:44.817435+0000","last_clean":"2024-09-16T01:15:44.817435+0000","last_became_active":"2024-09-16T01:15:39.722836+0000","last_became_peered":"2024-09-16T01:15:39.722836+0000","last_unstale":"2024-09-16T01:15:44.817435+0000","last_undegraded":"2024-09-16T01:15:44.817435+0000","last_fullsized":"2024-09-16T01:15:44.817435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251484+0000","last_change":"2024-09-16T01:15:38.722596+0000","last_active":"2024-09-16T01:15:46.251484+0000","last_peered":"2024-09-16T01:15:46.251484+0000","last_clean":"2024-09-16T01:15:46.251484+0000","last_became_active":"2024-09-16T01:15:38.722356+0000","last_became_peered":"2024-09-16T01:15:38.722356+0000","last_unstale":"2024-09-16T01:15:46.251484+0000","last_undegraded":"2024-09-16T01:15:46.251484+0000","last_fullsized":"2024-09-16T01:15:46.251484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:25:31.352796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747052+0000","last_change":"2024-09-16T01:15:43.921163+0000","last_active":"2024-09-16T01:15:44.747052+0000","last_peered":"2024-09-16T01:15:44.747052+0000","last_clean":"2024-09-16T01:15:44.747052+0000","last_became_active":"2024-09-16T01:15:43.920789+0000","last_became_peered":"2024-09-16T01:15:43.920789+0000","last_unstale":"2024-09-16T01:15:44.747052+0000","last_undegraded":"2024-09-16T01:15:44.747052+0000","last_fullsized":"2024-09-16T01:15:44.747052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:24.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745802+0000","last_change":"2024-09-16T01:15:39.721863+0000","last_active":"2024-09-16T01:15:44.745802+0000","last_peered":"2024-09-16T01:15:44.745802+0000","last_clean":"2024-09-16T01:15:44.745802+0000","last_became_active":"2024-09-16T01:15:39.721445+0000","last_became_peered":"2024-09-16T01:15:39.721445+0000","last_unstale":"2024-09-16T01:15:44.745802+0000","last_undegraded":"2024-09-16T01:15:44.745802+0000","last_fullsized":"2024-09-16T01:15:44.745802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:53.278467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817489+0000","last_change":"2024-09-16T01:15:38.718239+0000","last_active":"2024-09-16T01:15:44.817489+0000","last_peered":"2024-09-16T01:15:44.817489+0000","last_clean":"2024-09-16T01:15:44.817489+0000","last_became_active":"2024-09-16T01:15:38.717981+0000","last_became_peered":"2024-09-16T01:15:38.717981+0000","last_unstale":"2024-09-16T01:15:44.817489+0000","last_undegraded":"2024-09-16T01:15:44.817489+0000","last_fullsized":"2024-09-16T01:15:44.817489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:35.717778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816857+0000","last_change":"2024-09-16T01:15:43.759115+0000","last_active":"2024-09-16T01:15:44.816857+0000","last_peered":"2024-09-16T01:15:44.816857+0000","last_clean":"2024-09-16T01:15:44.816857+0000","last_became_active":"2024-09-16T01:15:43.758725+0000","last_became_peered":"2024-09-16T01:15:43.758725+0000","last_unstale":"2024-09-16T01:15:44.816857+0000","last_undegraded":"2024-09-16T01:15:44.816857+0000","last_fullsized":"2024-09-16T01:15:44.816857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:27.078175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944821+0000","last_change":"2024-09-16T01:15:39.723087+0000","last_active":"2024-09-16T01:15:45.944821+0000","last_peered":"2024-09-16T01:15:45.944821+0000","last_clean":"2024-09-16T01:15:45.944821+0000","last_became_active":"2024-09-16T01:15:39.722204+0000","last_became_peered":"2024-09-16T01:15:39.722204+0000","last_unstale":"2024-09-16T01:15:45.944821+0000","last_undegraded":"2024-09-16T01:15:45.944821+0000","last_fullsized":"2024-09-16T01:15:45.944821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:36.723734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746291+0000","last_change":"2024-09-16T01:15:38.717252+0000","last_active":"2024-09-16T01:15:44.746291+0000","last_peered":"2024-09-16T01:15:44.746291+0000","last_clean":"2024-09-16T01:15:44.746291+0000","last_became_active":"2024-09-16T01:15:38.716781+0000","last_became_peered":"2024-09-16T01:15:38.716781+0000","last_unstale":"2024-09-16T01:15:44.746291+0000","last_undegraded":"2024-09-16T01:15:44.746291+0000","last_fullsized":"2024-09-16T01:15:44.746291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:58.925739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817388+0000","last_change":"2024-09-16T01:15:43.760901+0000","last_active":"2024-09-16T01:15:44.817388+0000","last_peered":"2024-09-16T01:15:44.817388+0000","last_clean":"2024-09-16T01:15:44.817388+0000","last_became_active":"2024-09-16T01:15:43.758844+0000","last_became_peered":"2024-09-16T01:15:43.758844+0000","last_unstale":"2024-09-16T01:15:44.817388+0000","last_undegraded":"2024-09-16T01:15:44.817388+0000","last_fullsized":"2024-09-16T01:15:44.817388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:23.908567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816870+0000","last_change":"2024-09-16T01:15:39.723832+0000","last_active":"2024-09-16T01:15:44.816870+0000","last_peered":"2024-09-16T01:15:44.816870+0000","last_clean":"2024-09-16T01:15:44.816870+0000","last_became_active":"2024-09-16T01:15:39.723596+0000","last_became_peered":"2024-09-16T01:15:39.723596+0000","last_unstale":"2024-09-16T01:15:44.816870+0000","last_undegraded":"2024-09-16T01:15:44.816870+0000","last_fullsized":"2024-09-16T01:15:44.816870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644673+0000","last_change":"2024-09-16T01:15:38.713951+0000","last_active":"2024-09-16T01:15:46.644673+0000","last_peered":"2024-09-16T01:15:46.644673+0000","last_clean":"2024-09-16T01:15:46.644673+0000","last_became_active":"2024-09-16T01:15:38.713670+0000","last_became_peered":"2024-09-16T01:15:38.713670+0000","last_unstale":"2024-09-16T01:15:46.644673+0000","last_undegraded":"2024-09-16T01:15:46.644673+0000","last_fullsized":"2024-09-16T01:15:46.644673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:24.701682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817651+0000","last_change":"2024-09-16T01:15:43.760201+0000","last_active":"2024-09-16T01:15:44.817651+0000","last_peered":"2024-09-16T01:15:44.817651+0000","last_clean":"2024-09-16T01:15:44.817651+0000","last_became_active":"2024-09-16T01:15:43.759329+0000","last_became_peered":"2024-09-16T01:15:43.759329+0000","last_unstale":"2024-09-16T01:15:44.817651+0000","last_undegraded":"2024-09-16T01:15:44.817651+0000","last_fullsized":"2024-09-16T01:15:44.817651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:00.235274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746870+0000","last_change":"2024-09-16T01:15:39.719776+0000","last_active":"2024-09-16T01:15:44.746870+0000","last_peered":"2024-09-16T01:15:44.746870+0000","last_clean":"2024-09-16T01:15:44.746870+0000","last_became_active":"2024-09-16T01:15:39.719492+0000","last_became_peered":"2024-09-16T01:15:39.719492+0000","last_unstale":"2024-09-16T01:15:44.746870+0000","last_undegraded":"2024-09-16T01:15:44.746870+0000","last_fullsized":"2024-09-16T01:15:44.746870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:18.272881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250816+0000","last_change":"2024-09-16T01:15:38.722446+0000","last_active":"2024-09-16T01:15:46.250816+0000","last_peered":"2024-09-16T01:15:46.250816+0000","last_clean":"2024-09-16T01:15:46.250816+0000","last_became_active":"2024-09-16T01:15:38.722134+0000","last_became_peered":"2024-09-16T01:15:38.722134+0000","last_unstale":"2024-09-16T01:15:46.250816+0000","last_undegraded":"2024-09-16T01:15:46.250816+0000","last_fullsized":"2024-09-16T01:15:46.250816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:43.994450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747413+0000","last_change":"2024-09-16T01:15:43.921254+0000","last_active":"2024-09-16T01:15:44.747413+0000","last_peered":"2024-09-16T01:15:44.747413+0000","last_clean":"2024-09-16T01:15:44.747413+0000","last_became_active":"2024-09-16T01:15:43.920320+0000","last_became_peered":"2024-09-16T01:15:43.920320+0000","last_unstale":"2024-09-16T01:15:44.747413+0000","last_undegraded":"2024-09-16T01:15:44.747413+0000","last_fullsized":"2024-09-16T01:15:44.747413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:23.908567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921967+0000","last_change":"2024-09-16T01:15:39.729053+0000","last_active":"2024-09-16T01:15:44.921967+0000","last_peered":"2024-09-16T01:15:44.921967+0000","last_clean":"2024-09-16T01:15:44.921967+0000","last_became_active":"2024-09-16T01:15:39.727897+0000","last_became_peered":"2024-09-16T01:15:39.727897+0000","last_unstale":"2024-09-16T01:15:44.921967+0000","last_undegraded":"2024-09-16T01:15:44.921967+0000","last_fullsized":"2024-09-16T01:15:44.921967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745582+0000","last_change":"2024-09-16T01:15:38.712828+0000","last_active":"2024-09-16T01:15:44.745582+0000","last_peered":"2024-09-16T01:15:44.745582+0000","last_clean":"2024-09-16T01:15:44.745582+0000","last_became_active":"2024-09-16T01:15:38.712543+0000","last_became_peered":"2024-09-16T01:15:38.712543+0000","last_unstale":"2024-09-16T01:15:44.745582+0000","last_undegraded":"2024-09-16T01:15:44.745582+0000","last_fullsized":"2024-09-16T01:15:44.745582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:52.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250598+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:15:46.250598+0000","last_peered":"2024-09-16T01:15:46.250598+0000","last_clean":"2024-09-16T01:15:46.250598+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:15:46.250598+0000","last_undegraded":"2024-09-16T01:15:46.250598+0000","last_fullsized":"2024-09-16T01:15:46.250598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745908+0000","last_change":"2024-09-16T01:15:43.920489+0000","last_active":"2024-09-16T01:15:44.745908+0000","last_peered":"2024-09-16T01:15:44.745908+0000","last_clean":"2024-09-16T01:15:44.745908+0000","last_became_active":"2024-09-16T01:15:43.920110+0000","last_became_peered":"2024-09-16T01:15:43.920110+0000","last_unstale":"2024-09-16T01:15:44.745908+0000","last_undegraded":"2024-09-16T01:15:44.745908+0000","last_fullsized":"2024-09-16T01:15:44.745908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:57.315283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251313+0000","last_change":"2024-09-16T01:15:39.728812+0000","last_active":"2024-09-16T01:15:46.251313+0000","last_peered":"2024-09-16T01:15:46.251313+0000","last_clean":"2024-09-16T01:15:46.251313+0000","last_became_active":"2024-09-16T01:15:39.728567+0000","last_became_peered":"2024-09-16T01:15:39.728567+0000","last_unstale":"2024-09-16T01:15:46.251313+0000","last_undegraded":"2024-09-16T01:15:46.251313+0000","last_fullsized":"2024-09-16T01:15:46.251313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:50.941305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644951+0000","last_change":"2024-09-16T01:15:38.714874+0000","last_active":"2024-09-16T01:15:46.644951+0000","last_peered":"2024-09-16T01:15:46.644951+0000","last_clean":"2024-09-16T01:15:46.644951+0000","last_became_active":"2024-09-16T01:15:38.714594+0000","last_became_peered":"2024-09-16T01:15:38.714594+0000","last_unstale":"2024-09-16T01:15:46.644951+0000","last_undegraded":"2024-09-16T01:15:46.644951+0000","last_fullsized":"2024-09-16T01:15:46.644951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:42.942780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746039+0000","last_change":"2024-09-16T01:15:43.917212+0000","last_active":"2024-09-16T01:15:44.746039+0000","last_peered":"2024-09-16T01:15:44.746039+0000","last_clean":"2024-09-16T01:15:44.746039+0000","last_became_active":"2024-09-16T01:15:43.916799+0000","last_became_peered":"2024-09-16T01:15:43.916799+0000","last_unstale":"2024-09-16T01:15:44.746039+0000","last_undegraded":"2024-09-16T01:15:44.746039+0000","last_fullsized":"2024-09-16T01:15:44.746039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:55.307076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745452+0000","last_change":"2024-09-16T01:15:39.716325+0000","last_active":"2024-09-16T01:15:44.745452+0000","last_peered":"2024-09-16T01:15:44.745452+0000","last_clean":"2024-09-16T01:15:44.745452+0000","last_became_active":"2024-09-16T01:15:39.716048+0000","last_became_peered":"2024-09-16T01:15:39.716048+0000","last_unstale":"2024-09-16T01:15:44.745452+0000","last_undegraded":"2024-09-16T01:15:44.745452+0000","last_fullsized":"2024-09-16T01:15:44.745452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:20.730699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817475+0000","last_change":"2024-09-16T01:15:38.710438+0000","last_active":"2024-09-16T01:15:44.817475+0000","last_peered":"2024-09-16T01:15:44.817475+0000","last_clean":"2024-09-16T01:15:44.817475+0000","last_became_active":"2024-09-16T01:15:38.710126+0000","last_became_peered":"2024-09-16T01:15:38.710126+0000","last_unstale":"2024-09-16T01:15:44.817475+0000","last_undegraded":"2024-09-16T01:15:44.817475+0000","last_fullsized":"2024-09-16T01:15:44.817475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:50.843647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747422+0000","last_change":"2024-09-16T01:15:43.755716+0000","last_active":"2024-09-16T01:15:44.747422+0000","last_peered":"2024-09-16T01:15:44.747422+0000","last_clean":"2024-09-16T01:15:44.747422+0000","last_became_active":"2024-09-16T01:15:43.755284+0000","last_became_peered":"2024-09-16T01:15:43.755284+0000","last_unstale":"2024-09-16T01:15:44.747422+0000","last_undegraded":"2024-09-16T01:15:44.747422+0000","last_fullsized":"2024-09-16T01:15:44.747422+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:34.196444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251434+0000","last_change":"2024-09-16T01:15:39.721173+0000","last_active":"2024-09-16T01:15:46.251434+0000","last_peered":"2024-09-16T01:15:46.251434+0000","last_clean":"2024-09-16T01:15:46.251434+0000","last_became_active":"2024-09-16T01:15:39.720757+0000","last_became_peered":"2024-09-16T01:15:39.720757+0000","last_unstale":"2024-09-16T01:15:46.251434+0000","last_undegraded":"2024-09-16T01:15:46.251434+0000","last_fullsized":"2024-09-16T01:15:46.251434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:44.674615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644910+0000","last_change":"2024-09-16T01:15:38.713886+0000","last_active":"2024-09-16T01:15:46.644910+0000","last_peered":"2024-09-16T01:15:46.644910+0000","last_clean":"2024-09-16T01:15:46.644910+0000","last_became_active":"2024-09-16T01:15:38.713596+0000","last_became_peered":"2024-09-16T01:15:38.713596+0000","last_unstale":"2024-09-16T01:15:46.644910+0000","last_undegraded":"2024-09-16T01:15:46.644910+0000","last_fullsized":"2024-09-16T01:15:46.644910+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:52.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744816+0000","last_change":"2024-09-16T01:15:43.917236+0000","last_active":"2024-09-16T01:15:44.744816+0000","last_peered":"2024-09-16T01:15:44.744816+0000","last_clean":"2024-09-16T01:15:44.744816+0000","last_became_active":"2024-09-16T01:15:43.916784+0000","last_became_peered":"2024-09-16T01:15:43.916784+0000","last_unstale":"2024-09-16T01:15:44.744816+0000","last_undegraded":"2024-09-16T01:15:44.744816+0000","last_fullsized":"2024-09-16T01:15:44.744816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:48.711431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251384+0000","last_change":"2024-09-16T01:15:39.721477+0000","last_active":"2024-09-16T01:15:46.251384+0000","last_peered":"2024-09-16T01:15:46.251384+0000","last_clean":"2024-09-16T01:15:46.251384+0000","last_became_active":"2024-09-16T01:15:39.720755+0000","last_became_peered":"2024-09-16T01:15:39.720755+0000","last_unstale":"2024-09-16T01:15:46.251384+0000","last_undegraded":"2024-09-16T01:15:46.251384+0000","last_fullsized":"2024-09-16T01:15:46.251384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:56.198457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944995+0000","last_change":"2024-09-16T01:15:38.718410+0000","last_active":"2024-09-16T01:15:45.944995+0000","last_peered":"2024-09-16T01:15:45.944995+0000","last_clean":"2024-09-16T01:15:45.944995+0000","last_became_active":"2024-09-16T01:15:38.718113+0000","last_became_peered":"2024-09-16T01:15:38.718113+0000","last_unstale":"2024-09-16T01:15:45.944995+0000","last_undegraded":"2024-09-16T01:15:45.944995+0000","last_fullsized":"2024-09-16T01:15:45.944995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:36.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944193+0000","last_change":"2024-09-16T01:15:43.763443+0000","last_active":"2024-09-16T01:15:45.944193+0000","last_peered":"2024-09-16T01:15:45.944193+0000","last_clean":"2024-09-16T01:15:45.944193+0000","last_became_active":"2024-09-16T01:15:43.763064+0000","last_became_peered":"2024-09-16T01:15:43.763064+0000","last_unstale":"2024-09-16T01:15:45.944193+0000","last_undegraded":"2024-09-16T01:15:45.944193+0000","last_fullsized":"2024-09-16T01:15:45.944193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:19.888410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251116+0000","last_change":"2024-09-16T01:15:39.721525+0000","last_active":"2024-09-16T01:15:46.251116+0000","last_peered":"2024-09-16T01:15:46.251116+0000","last_clean":"2024-09-16T01:15:46.251116+0000","last_became_active":"2024-09-16T01:15:39.721282+0000","last_became_peered":"2024-09-16T01:15:39.721282+0000","last_unstale":"2024-09-16T01:15:46.251116+0000","last_undegraded":"2024-09-16T01:15:46.251116+0000","last_fullsized":"2024-09-16T01:15:46.251116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:53.278467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644540+0000","last_change":"2024-09-16T01:15:38.716594+0000","last_active":"2024-09-16T01:15:46.644540+0000","last_peered":"2024-09-16T01:15:46.644540+0000","last_clean":"2024-09-16T01:15:46.644540+0000","last_became_active":"2024-09-16T01:15:38.716327+0000","last_became_peered":"2024-09-16T01:15:38.716327+0000","last_unstale":"2024-09-16T01:15:46.644540+0000","last_undegraded":"2024-09-16T01:15:46.644540+0000","last_fullsized":"2024-09-16T01:15:46.644540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:44.803896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747246+0000","last_change":"2024-09-16T01:15:43.763464+0000","last_active":"2024-09-16T01:15:44.747246+0000","last_peered":"2024-09-16T01:15:44.747246+0000","last_clean":"2024-09-16T01:15:44.747246+0000","last_became_active":"2024-09-16T01:15:43.763095+0000","last_became_peered":"2024-09-16T01:15:43.763095+0000","last_unstale":"2024-09-16T01:15:44.747246+0000","last_undegraded":"2024-09-16T01:15:44.747246+0000","last_fullsized":"2024-09-16T01:15:44.747246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:54.978121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745408+0000","last_change":"2024-09-16T01:15:39.726106+0000","last_active":"2024-09-16T01:15:44.745408+0000","last_peered":"2024-09-16T01:15:44.745408+0000","last_clean":"2024-09-16T01:15:44.745408+0000","last_became_active":"2024-09-16T01:15:39.725833+0000","last_became_peered":"2024-09-16T01:15:39.725833+0000","last_unstale":"2024-09-16T01:15:44.745408+0000","last_undegraded":"2024-09-16T01:15:44.745408+0000","last_fullsized":"2024-09-16T01:15:44.745408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745838+0000","last_change":"2024-09-16T01:15:38.710514+0000","last_active":"2024-09-16T01:15:44.745838+0000","last_peered":"2024-09-16T01:15:44.745838+0000","last_clean":"2024-09-16T01:15:44.745838+0000","last_became_active":"2024-09-16T01:15:38.710185+0000","last_became_peered":"2024-09-16T01:15:38.710185+0000","last_unstale":"2024-09-16T01:15:44.745838+0000","last_undegraded":"2024-09-16T01:15:44.745838+0000","last_fullsized":"2024-09-16T01:15:44.745838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:42.942780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922611+0000","last_change":"2024-09-16T01:15:43.919233+0000","last_active":"2024-09-16T01:15:44.922611+0000","last_peered":"2024-09-16T01:15:44.922611+0000","last_clean":"2024-09-16T01:15:44.922611+0000","last_became_active":"2024-09-16T01:15:43.918866+0000","last_became_peered":"2024-09-16T01:15:43.918866+0000","last_unstale":"2024-09-16T01:15:44.922611+0000","last_undegraded":"2024-09-16T01:15:44.922611+0000","last_fullsized":"2024-09-16T01:15:44.922611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:15.298412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251002+0000","last_change":"2024-09-16T01:15:39.722459+0000","last_active":"2024-09-16T01:15:46.251002+0000","last_peered":"2024-09-16T01:15:46.251002+0000","last_clean":"2024-09-16T01:15:46.251002+0000","last_became_active":"2024-09-16T01:15:39.722016+0000","last_became_peered":"2024-09-16T01:15:39.722016+0000","last_unstale":"2024-09-16T01:15:46.251002+0000","last_undegraded":"2024-09-16T01:15:46.251002+0000","last_fullsized":"2024-09-16T01:15:46.251002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:20.730699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746247+0000","last_change":"2024-09-16T01:15:38.715930+0000","last_active":"2024-09-16T01:15:44.746247+0000","last_peered":"2024-09-16T01:15:44.746247+0000","last_clean":"2024-09-16T01:15:44.746247+0000","last_became_active":"2024-09-16T01:15:38.715602+0000","last_became_peered":"2024-09-16T01:15:38.715602+0000","last_unstale":"2024-09-16T01:15:44.746247+0000","last_undegraded":"2024-09-16T01:15:44.746247+0000","last_fullsized":"2024-09-16T01:15:44.746247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:08.518045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922632+0000","last_change":"2024-09-16T01:15:43.917197+0000","last_active":"2024-09-16T01:15:44.922632+0000","last_peered":"2024-09-16T01:15:44.922632+0000","last_clean":"2024-09-16T01:15:44.922632+0000","last_became_active":"2024-09-16T01:15:43.916694+0000","last_became_peered":"2024-09-16T01:15:43.916694+0000","last_unstale":"2024-09-16T01:15:44.922632+0000","last_undegraded":"2024-09-16T01:15:44.922632+0000","last_fullsized":"2024-09-16T01:15:44.922632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:03:54.915059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747227+0000","last_change":"2024-09-16T01:15:39.731508+0000","last_active":"2024-09-16T01:15:44.747227+0000","last_peered":"2024-09-16T01:15:44.747227+0000","last_clean":"2024-09-16T01:15:44.747227+0000","last_became_active":"2024-09-16T01:15:39.730663+0000","last_became_peered":"2024-09-16T01:15:39.730663+0000","last_unstale":"2024-09-16T01:15:44.747227+0000","last_undegraded":"2024-09-16T01:15:44.747227+0000","last_fullsized":"2024-09-16T01:15:44.747227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:52.736329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747663+0000","last_change":"2024-09-16T01:15:38.715147+0000","last_active":"2024-09-16T01:15:44.747663+0000","last_peered":"2024-09-16T01:15:44.747663+0000","last_clean":"2024-09-16T01:15:44.747663+0000","last_became_active":"2024-09-16T01:15:38.714378+0000","last_became_peered":"2024-09-16T01:15:38.714378+0000","last_unstale":"2024-09-16T01:15:44.747663+0000","last_undegraded":"2024-09-16T01:15:44.747663+0000","last_fullsized":"2024-09-16T01:15:44.747663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:36.826678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745684+0000","last_change":"2024-09-16T01:15:43.917886+0000","last_active":"2024-09-16T01:15:44.745684+0000","last_peered":"2024-09-16T01:15:44.745684+0000","last_clean":"2024-09-16T01:15:44.745684+0000","last_became_active":"2024-09-16T01:15:43.917474+0000","last_became_peered":"2024-09-16T01:15:43.917474+0000","last_unstale":"2024-09-16T01:15:44.745684+0000","last_undegraded":"2024-09-16T01:15:44.745684+0000","last_fullsized":"2024-09-16T01:15:44.745684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:08.989590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251072+0000","last_change":"2024-09-16T01:15:39.727254+0000","last_active":"2024-09-16T01:15:46.251072+0000","last_peered":"2024-09-16T01:15:46.251072+0000","last_clean":"2024-09-16T01:15:46.251072+0000","last_became_active":"2024-09-16T01:15:39.726904+0000","last_became_peered":"2024-09-16T01:15:39.726904+0000","last_unstale":"2024-09-16T01:15:46.251072+0000","last_undegraded":"2024-09-16T01:15:46.251072+0000","last_fullsized":"2024-09-16T01:15:46.251072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:23.041359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:49.106598+0000","last_change":"2024-09-16T01:15:38.716774+0000","last_active":"2024-09-16T01:15:49.106598+0000","last_peered":"2024-09-16T01:15:49.106598+0000","last_clean":"2024-09-16T01:15:49.106598+0000","last_became_active":"2024-09-16T01:15:38.716441+0000","last_became_peered":"2024-09-16T01:15:38.716441+0000","last_unstale":"2024-09-16T01:15:49.106598+0000","last_undegraded":"2024-09-16T01:15:49.106598+0000","last_fullsized":"2024-09-16T01:15:49.106598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:08.518045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816941+0000","last_change":"2024-09-16T01:15:43.760938+0000","last_active":"2024-09-16T01:15:44.816941+0000","last_peered":"2024-09-16T01:15:44.816941+0000","last_clean":"2024-09-16T01:15:44.816941+0000","last_became_active":"2024-09-16T01:15:43.759362+0000","last_became_peered":"2024-09-16T01:15:43.759362+0000","last_unstale":"2024-09-16T01:15:44.816941+0000","last_undegraded":"2024-09-16T01:15:44.816941+0000","last_fullsized":"2024-09-16T01:15:44.816941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:54.978121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944687+0000","last_change":"2024-09-16T01:15:39.724557+0000","last_active":"2024-09-16T01:15:45.944687+0000","last_peered":"2024-09-16T01:15:45.944687+0000","last_clean":"2024-09-16T01:15:45.944687+0000","last_became_active":"2024-09-16T01:15:39.724253+0000","last_became_peered":"2024-09-16T01:15:39.724253+0000","last_unstale":"2024-09-16T01:15:45.944687+0000","last_undegraded":"2024-09-16T01:15:45.944687+0000","last_fullsized":"2024-09-16T01:15:45.944687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:51.849603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817542+0000","last_change":"2024-09-16T01:15:38.712961+0000","last_active":"2024-09-16T01:15:44.817542+0000","last_peered":"2024-09-16T01:15:44.817542+0000","last_clean":"2024-09-16T01:15:44.817542+0000","last_became_active":"2024-09-16T01:15:38.712701+0000","last_became_peered":"2024-09-16T01:15:38.712701+0000","last_unstale":"2024-09-16T01:15:44.817542+0000","last_undegraded":"2024-09-16T01:15:44.817542+0000","last_fullsized":"2024-09-16T01:15:44.817542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:43.994450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944656+0000","last_change":"2024-09-16T01:15:43.765439+0000","last_active":"2024-09-16T01:15:45.944656+0000","last_peered":"2024-09-16T01:15:45.944656+0000","last_clean":"2024-09-16T01:15:45.944656+0000","last_became_active":"2024-09-16T01:15:43.765020+0000","last_became_peered":"2024-09-16T01:15:43.765020+0000","last_unstale":"2024-09-16T01:15:45.944656+0000","last_undegraded":"2024-09-16T01:15:45.944656+0000","last_fullsized":"2024-09-16T01:15:45.944656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:24.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747568+0000","last_change":"2024-09-16T01:15:39.730738+0000","last_active":"2024-09-16T01:15:44.747568+0000","last_peered":"2024-09-16T01:15:44.747568+0000","last_clean":"2024-09-16T01:15:44.747568+0000","last_became_active":"2024-09-16T01:15:39.730255+0000","last_became_peered":"2024-09-16T01:15:39.730255+0000","last_unstale":"2024-09-16T01:15:44.747568+0000","last_undegraded":"2024-09-16T01:15:44.747568+0000","last_fullsized":"2024-09-16T01:15:44.747568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745379+0000","last_change":"2024-09-16T01:15:38.715232+0000","last_active":"2024-09-16T01:15:44.745379+0000","last_peered":"2024-09-16T01:15:44.745379+0000","last_clean":"2024-09-16T01:15:44.745379+0000","last_became_active":"2024-09-16T01:15:38.714944+0000","last_became_peered":"2024-09-16T01:15:38.714944+0000","last_unstale":"2024-09-16T01:15:44.745379+0000","last_undegraded":"2024-09-16T01:15:44.745379+0000","last_fullsized":"2024-09-16T01:15:44.745379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:24.701682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921870+0000","last_change":"2024-09-16T01:15:43.758834+0000","last_active":"2024-09-16T01:15:44.921870+0000","last_peered":"2024-09-16T01:15:44.921870+0000","last_clean":"2024-09-16T01:15:44.921870+0000","last_became_active":"2024-09-16T01:15:43.758362+0000","last_became_peered":"2024-09-16T01:15:43.758362+0000","last_unstale":"2024-09-16T01:15:44.921870+0000","last_undegraded":"2024-09-16T01:15:44.921870+0000","last_fullsized":"2024-09-16T01:15:44.921870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:10.924601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745261+0000","last_change":"2024-09-16T01:15:39.723043+0000","last_active":"2024-09-16T01:15:44.745261+0000","last_peered":"2024-09-16T01:15:44.745261+0000","last_clean":"2024-09-16T01:15:44.745261+0000","last_became_active":"2024-09-16T01:15:39.722068+0000","last_became_peered":"2024-09-16T01:15:39.722068+0000","last_unstale":"2024-09-16T01:15:44.745261+0000","last_undegraded":"2024-09-16T01:15:44.745261+0000","last_fullsized":"2024-09-16T01:15:44.745261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:15.851594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746622+0000","last_change":"2024-09-16T01:15:38.712075+0000","last_active":"2024-09-16T01:15:44.746622+0000","last_peered":"2024-09-16T01:15:44.746622+0000","last_clean":"2024-09-16T01:15:44.746622+0000","last_became_active":"2024-09-16T01:15:38.711796+0000","last_became_peered":"2024-09-16T01:15:38.711796+0000","last_unstale":"2024-09-16T01:15:44.746622+0000","last_undegraded":"2024-09-16T01:15:44.746622+0000","last_fullsized":"2024-09-16T01:15:44.746622+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:24.701682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922056+0000","last_change":"2024-09-16T01:15:43.920754+0000","last_active":"2024-09-16T01:15:44.922056+0000","last_peered":"2024-09-16T01:15:44.922056+0000","last_clean":"2024-09-16T01:15:44.922056+0000","last_became_active":"2024-09-16T01:15:43.919569+0000","last_became_peered":"2024-09-16T01:15:43.919569+0000","last_unstale":"2024-09-16T01:15:44.922056+0000","last_undegraded":"2024-09-16T01:15:44.922056+0000","last_fullsized":"2024-09-16T01:15:44.922056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:08.989590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747159+0000","last_change":"2024-09-16T01:15:43.921667+0000","last_active":"2024-09-16T01:15:44.747159+0000","last_peered":"2024-09-16T01:15:44.747159+0000","last_clean":"2024-09-16T01:15:44.747159+0000","last_became_active":"2024-09-16T01:15:43.921261+0000","last_became_peered":"2024-09-16T01:15:43.921261+0000","last_unstale":"2024-09-16T01:15:44.747159+0000","last_undegraded":"2024-09-16T01:15:44.747159+0000","last_fullsized":"2024-09-16T01:15:44.747159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:27.078175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816721+0000","last_change":"2024-09-16T01:15:39.715516+0000","last_active":"2024-09-16T01:15:44.816721+0000","last_peered":"2024-09-16T01:15:44.816721+0000","last_clean":"2024-09-16T01:15:44.816721+0000","last_became_active":"2024-09-16T01:15:39.715303+0000","last_became_peered":"2024-09-16T01:15:39.715303+0000","last_unstale":"2024-09-16T01:15:44.816721+0000","last_undegraded":"2024-09-16T01:15:44.816721+0000","last_fullsized":"2024-09-16T01:15:44.816721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744965+0000","last_change":"2024-09-16T01:15:38.709515+0000","last_active":"2024-09-16T01:15:44.744965+0000","last_peered":"2024-09-16T01:15:44.744965+0000","last_clean":"2024-09-16T01:15:44.744965+0000","last_became_active":"2024-09-16T01:15:38.708945+0000","last_became_peered":"2024-09-16T01:15:38.708945+0000","last_unstale":"2024-09-16T01:15:44.744965+0000","last_undegraded":"2024-09-16T01:15:44.744965+0000","last_fullsized":"2024-09-16T01:15:44.744965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:46.439923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746558+0000","last_change":"2024-09-16T01:15:43.763256+0000","last_active":"2024-09-16T01:15:44.746558+0000","last_peered":"2024-09-16T01:15:44.746558+0000","last_clean":"2024-09-16T01:15:44.746558+0000","last_became_active":"2024-09-16T01:15:43.762837+0000","last_became_peered":"2024-09-16T01:15:43.762837+0000","last_unstale":"2024-09-16T01:15:44.746558+0000","last_undegraded":"2024-09-16T01:15:44.746558+0000","last_fullsized":"2024-09-16T01:15:44.746558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:24.767516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921881+0000","last_change":"2024-09-16T01:15:39.727402+0000","last_active":"2024-09-16T01:15:44.921881+0000","last_peered":"2024-09-16T01:15:44.921881+0000","last_clean":"2024-09-16T01:15:44.921881+0000","last_became_active":"2024-09-16T01:15:39.726906+0000","last_became_peered":"2024-09-16T01:15:39.726906+0000","last_unstale":"2024-09-16T01:15:44.921881+0000","last_undegraded":"2024-09-16T01:15:44.921881+0000","last_fullsized":"2024-09-16T01:15:44.921881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.166842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922185+0000","last_change":"2024-09-16T01:15:38.707171+0000","last_active":"2024-09-16T01:15:44.922185+0000","last_peered":"2024-09-16T01:15:44.922185+0000","last_clean":"2024-09-16T01:15:44.922185+0000","last_became_active":"2024-09-16T01:15:38.706905+0000","last_became_peered":"2024-09-16T01:15:38.706905+0000","last_unstale":"2024-09-16T01:15:44.922185+0000","last_undegraded":"2024-09-16T01:15:44.922185+0000","last_fullsized":"2024-09-16T01:15:44.922185+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:42.942780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746293+0000","last_change":"2024-09-16T01:15:38.709634+0000","last_active":"2024-09-16T01:15:44.746293+0000","last_peered":"2024-09-16T01:15:44.746293+0000","last_clean":"2024-09-16T01:15:44.746293+0000","last_became_active":"2024-09-16T01:15:38.709327+0000","last_became_peered":"2024-09-16T01:15:38.709327+0000","last_unstale":"2024-09-16T01:15:44.746293+0000","last_undegraded":"2024-09-16T01:15:44.746293+0000","last_fullsized":"2024-09-16T01:15:44.746293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:52.200614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747564+0000","last_change":"2024-09-16T01:15:39.722400+0000","last_active":"2024-09-16T01:15:44.747564+0000","last_peered":"2024-09-16T01:15:44.747564+0000","last_clean":"2024-09-16T01:15:44.747564+0000","last_became_active":"2024-09-16T01:15:39.722125+0000","last_became_peered":"2024-09-16T01:15:39.722125+0000","last_unstale":"2024-09-16T01:15:44.747564+0000","last_undegraded":"2024-09-16T01:15:44.747564+0000","last_fullsized":"2024-09-16T01:15:44.747564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644833+0000","last_change":"2024-09-16T01:15:43.756363+0000","last_active":"2024-09-16T01:15:46.644833+0000","last_peered":"2024-09-16T01:15:46.644833+0000","last_clean":"2024-09-16T01:15:46.644833+0000","last_became_active":"2024-09-16T01:15:43.755986+0000","last_became_peered":"2024-09-16T01:15:43.755986+0000","last_unstale":"2024-09-16T01:15:46.644833+0000","last_undegraded":"2024-09-16T01:15:46.644833+0000","last_fullsized":"2024-09-16T01:15:46.644833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:59.700765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922374+0000","last_change":"2024-09-16T01:15:38.717144+0000","last_active":"2024-09-16T01:15:44.922374+0000","last_peered":"2024-09-16T01:15:44.922374+0000","last_clean":"2024-09-16T01:15:44.922374+0000","last_became_active":"2024-09-16T01:15:38.716925+0000","last_became_peered":"2024-09-16T01:15:38.716925+0000","last_unstale":"2024-09-16T01:15:44.922374+0000","last_undegraded":"2024-09-16T01:15:44.922374+0000","last_fullsized":"2024-09-16T01:15:44.922374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:37.685627+0000","last_clean_scrub_stamp":"2024-09-16T01:15:37.685627+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:44.803896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944458+0000","last_change":"2024-09-16T01:15:39.720645+0000","last_active":"2024-09-16T01:15:45.944458+0000","last_peered":"2024-09-16T01:15:45.944458+0000","last_clean":"2024-09-16T01:15:45.944458+0000","last_became_active":"2024-09-16T01:15:39.720391+0000","last_became_peered":"2024-09-16T01:15:39.720391+0000","last_unstale":"2024-09-16T01:15:45.944458+0000","last_undegraded":"2024-09-16T01:15:45.944458+0000","last_fullsized":"2024-09-16T01:15:45.944458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:09.524001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922230+0000","last_change":"2024-09-16T01:15:43.761796+0000","last_active":"2024-09-16T01:15:44.922230+0000","last_peered":"2024-09-16T01:15:44.922230+0000","last_clean":"2024-09-16T01:15:44.922230+0000","last_became_active":"2024-09-16T01:15:43.761242+0000","last_became_peered":"2024-09-16T01:15:43.761242+0000","last_unstale":"2024-09-16T01:15:44.922230+0000","last_undegraded":"2024-09-16T01:15:44.922230+0000","last_fullsized":"2024-09-16T01:15:44.922230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:42.728400+0000","last_clean_scrub_stamp":"2024-09-16T01:15:42.728400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:41.757039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745300+0000","last_change":"2024-09-16T01:15:39.726420+0000","last_active":"2024-09-16T01:15:44.745300+0000","last_peered":"2024-09-16T01:15:44.745300+0000","last_clean":"2024-09-16T01:15:44.745300+0000","last_became_active":"2024-09-16T01:15:39.726142+0000","last_became_peered":"2024-09-16T01:15:39.726142+0000","last_unstale":"2024-09-16T01:15:44.745300+0000","last_undegraded":"2024-09-16T01:15:44.745300+0000","last_fullsized":"2024-09-16T01:15:44.745300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644670+0000","last_change":"2024-09-16T01:15:39.708234+0000","last_active":"2024-09-16T01:15:46.644670+0000","last_peered":"2024-09-16T01:15:46.644670+0000","last_clean":"2024-09-16T01:15:46.644670+0000","last_became_active":"2024-09-16T01:15:39.707935+0000","last_became_peered":"2024-09-16T01:15:39.707935+0000","last_unstale":"2024-09-16T01:15:46.644670+0000","last_undegraded":"2024-09-16T01:15:46.644670+0000","last_fullsized":"2024-09-16T01:15:46.644670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:45.000406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746151+0000","last_change":"2024-09-16T01:15:39.716296+0000","last_active":"2024-09-16T01:15:44.746151+0000","last_peered":"2024-09-16T01:15:44.746151+0000","last_clean":"2024-09-16T01:15:44.746151+0000","last_became_active":"2024-09-16T01:15:39.715998+0000","last_became_peered":"2024-09-16T01:15:39.715998+0000","last_unstale":"2024-09-16T01:15:44.746151+0000","last_undegraded":"2024-09-16T01:15:44.746151+0000","last_fullsized":"2024-09-16T01:15:44.746151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:19.871750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747461+0000","last_change":"2024-09-16T01:15:39.732779+0000","last_active":"2024-09-16T01:15:44.747461+0000","last_peered":"2024-09-16T01:15:44.747461+0000","last_clean":"2024-09-16T01:15:44.747461+0000","last_became_active":"2024-09-16T01:15:39.732514+0000","last_became_peered":"2024-09-16T01:15:39.732514+0000","last_unstale":"2024-09-16T01:15:44.747461+0000","last_undegraded":"2024-09-16T01:15:44.747461+0000","last_fullsized":"2024-09-16T01:15:44.747461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922366+0000","last_change":"2024-09-16T01:15:39.732741+0000","last_active":"2024-09-16T01:15:44.922366+0000","last_peered":"2024-09-16T01:15:44.922366+0000","last_clean":"2024-09-16T01:15:44.922366+0000","last_became_active":"2024-09-16T01:15:39.732480+0000","last_became_peered":"2024-09-16T01:15:39.732480+0000","last_unstale":"2024-09-16T01:15:44.922366+0000","last_undegraded":"2024-09-16T01:15:44.922366+0000","last_fullsized":"2024-09-16T01:15:44.922366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:32.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817305+0000","last_change":"2024-09-16T01:15:39.721673+0000","last_active":"2024-09-16T01:15:44.817305+0000","last_peered":"2024-09-16T01:15:44.817305+0000","last_clean":"2024-09-16T01:15:44.817305+0000","last_became_active":"2024-09-16T01:15:39.721038+0000","last_became_peered":"2024-09-16T01:15:39.721038+0000","last_unstale":"2024-09-16T01:15:44.817305+0000","last_undegraded":"2024-09-16T01:15:44.817305+0000","last_fullsized":"2024-09-16T01:15:44.817305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:32.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746704+0000","last_change":"2024-09-16T01:15:39.725684+0000","last_active":"2024-09-16T01:15:44.746704+0000","last_peered":"2024-09-16T01:15:44.746704+0000","last_clean":"2024-09-16T01:15:44.746704+0000","last_became_active":"2024-09-16T01:15:39.725383+0000","last_became_peered":"2024-09-16T01:15:39.725383+0000","last_unstale":"2024-09-16T01:15:44.746704+0000","last_undegraded":"2024-09-16T01:15:44.746704+0000","last_fullsized":"2024-09-16T01:15:44.746704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:40.391076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922579+0000","last_change":"2024-09-16T01:15:39.732120+0000","last_active":"2024-09-16T01:15:44.922579+0000","last_peered":"2024-09-16T01:15:44.922579+0000","last_clean":"2024-09-16T01:15:44.922579+0000","last_became_active":"2024-09-16T01:15:39.731874+0000","last_became_peered":"2024-09-16T01:15:39.731874+0000","last_unstale":"2024-09-16T01:15:44.922579+0000","last_undegraded":"2024-09-16T01:15:44.922579+0000","last_fullsized":"2024-09-16T01:15:44.922579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:39.132954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744949+0000","last_change":"2024-09-16T01:15:39.714218+0000","last_active":"2024-09-16T01:15:44.744949+0000","last_peered":"2024-09-16T01:15:44.744949+0000","last_clean":"2024-09-16T01:15:44.744949+0000","last_became_active":"2024-09-16T01:15:39.713937+0000","last_became_peered":"2024-09-16T01:15:39.713937+0000","last_unstale":"2024-09-16T01:15:44.744949+0000","last_undegraded":"2024-09-16T01:15:44.744949+0000","last_fullsized":"2024-09-16T01:15:44.744949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:32.837038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922164+0000","last_change":"2024-09-16T01:15:39.733311+0000","last_active":"2024-09-16T01:15:44.922164+0000","last_peered":"2024-09-16T01:15:44.922164+0000","last_clean":"2024-09-16T01:15:44.922164+0000","last_became_active":"2024-09-16T01:15:39.733144+0000","last_became_peered":"2024-09-16T01:15:39.733144+0000","last_unstale":"2024-09-16T01:15:44.922164+0000","last_undegraded":"2024-09-16T01:15:44.922164+0000","last_fullsized":"2024-09-16T01:15:44.922164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:42.847982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746055+0000","last_change":"2024-09-16T01:15:39.724420+0000","last_active":"2024-09-16T01:15:44.746055+0000","last_peered":"2024-09-16T01:15:44.746055+0000","last_clean":"2024-09-16T01:15:44.746055+0000","last_became_active":"2024-09-16T01:15:39.723819+0000","last_became_peered":"2024-09-16T01:15:39.723819+0000","last_unstale":"2024-09-16T01:15:44.746055+0000","last_undegraded":"2024-09-16T01:15:44.746055+0000","last_fullsized":"2024-09-16T01:15:44.746055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:50.941305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747222+0000","last_change":"2024-09-16T01:15:39.723569+0000","last_active":"2024-09-16T01:15:44.747222+0000","last_peered":"2024-09-16T01:15:44.747222+0000","last_clean":"2024-09-16T01:15:44.747222+0000","last_became_active":"2024-09-16T01:15:39.723316+0000","last_became_peered":"2024-09-16T01:15:39.723316+0000","last_unstale":"2024-09-16T01:15:44.747222+0000","last_undegraded":"2024-09-16T01:15:44.747222+0000","last_fullsized":"2024-09-16T01:15:44.747222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746161+0000","last_change":"2024-09-16T01:15:39.719774+0000","last_active":"2024-09-16T01:15:44.746161+0000","last_peered":"2024-09-16T01:15:44.746161+0000","last_clean":"2024-09-16T01:15:44.746161+0000","last_became_active":"2024-09-16T01:15:39.719499+0000","last_became_peered":"2024-09-16T01:15:39.719499+0000","last_unstale":"2024-09-16T01:15:44.746161+0000","last_undegraded":"2024-09-16T01:15:44.746161+0000","last_fullsized":"2024-09-16T01:15:44.746161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251449+0000","last_change":"2024-09-16T01:15:39.724488+0000","last_active":"2024-09-16T01:15:46.251449+0000","last_peered":"2024-09-16T01:15:46.251449+0000","last_clean":"2024-09-16T01:15:46.251449+0000","last_became_active":"2024-09-16T01:15:39.724205+0000","last_became_peered":"2024-09-16T01:15:39.724205+0000","last_unstale":"2024-09-16T01:15:46.251449+0000","last_undegraded":"2024-09-16T01:15:46.251449+0000","last_fullsized":"2024-09-16T01:15:46.251449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:06.887785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.644890+0000","last_change":"2024-09-16T01:15:39.712637+0000","last_active":"2024-09-16T01:15:46.644890+0000","last_peered":"2024-09-16T01:15:46.644890+0000","last_clean":"2024-09-16T01:15:46.644890+0000","last_became_active":"2024-09-16T01:15:39.712015+0000","last_became_peered":"2024-09-16T01:15:39.712015+0000","last_unstale":"2024-09-16T01:15:46.644890+0000","last_undegraded":"2024-09-16T01:15:46.644890+0000","last_fullsized":"2024-09-16T01:15:46.644890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:51.849603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745814+0000","last_change":"2024-09-16T01:15:39.722757+0000","last_active":"2024-09-16T01:15:44.745814+0000","last_peered":"2024-09-16T01:15:44.745814+0000","last_clean":"2024-09-16T01:15:44.745814+0000","last_became_active":"2024-09-16T01:15:39.722500+0000","last_became_peered":"2024-09-16T01:15:39.722500+0000","last_unstale":"2024-09-16T01:15:44.745814+0000","last_undegraded":"2024-09-16T01:15:44.745814+0000","last_fullsized":"2024-09-16T01:15:44.745814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:23.041359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.744838+0000","last_change":"2024-09-16T01:15:39.725209+0000","last_active":"2024-09-16T01:15:44.744838+0000","last_peered":"2024-09-16T01:15:44.744838+0000","last_clean":"2024-09-16T01:15:44.744838+0000","last_became_active":"2024-09-16T01:15:39.724906+0000","last_became_peered":"2024-09-16T01:15:39.724906+0000","last_unstale":"2024-09-16T01:15:44.744838+0000","last_undegraded":"2024-09-16T01:15:44.744838+0000","last_fullsized":"2024-09-16T01:15:44.744838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.816777+0000","last_change":"2024-09-16T01:15:39.724771+0000","last_active":"2024-09-16T01:15:44.816777+0000","last_peered":"2024-09-16T01:15:44.816777+0000","last_clean":"2024-09-16T01:15:44.816777+0000","last_became_active":"2024-09-16T01:15:39.724512+0000","last_became_peered":"2024-09-16T01:15:39.724512+0000","last_unstale":"2024-09-16T01:15:44.816777+0000","last_undegraded":"2024-09-16T01:15:44.816777+0000","last_fullsized":"2024-09-16T01:15:44.816777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:44.794344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747162+0000","last_change":"2024-09-16T01:15:39.717182+0000","last_active":"2024-09-16T01:15:44.747162+0000","last_peered":"2024-09-16T01:15:44.747162+0000","last_clean":"2024-09-16T01:15:44.747162+0000","last_became_active":"2024-09-16T01:15:39.716928+0000","last_became_peered":"2024-09-16T01:15:39.716928+0000","last_unstale":"2024-09-16T01:15:44.747162+0000","last_undegraded":"2024-09-16T01:15:44.747162+0000","last_fullsized":"2024-09-16T01:15:44.747162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:55.663948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.922288+0000","last_change":"2024-09-16T01:15:39.729915+0000","last_active":"2024-09-16T01:15:44.922288+0000","last_peered":"2024-09-16T01:15:44.922288+0000","last_clean":"2024-09-16T01:15:44.922288+0000","last_became_active":"2024-09-16T01:15:39.729619+0000","last_became_peered":"2024-09-16T01:15:39.729619+0000","last_unstale":"2024-09-16T01:15:44.922288+0000","last_undegraded":"2024-09-16T01:15:44.922288+0000","last_fullsized":"2024-09-16T01:15:44.922288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:45.944679+0000","last_change":"2024-09-16T01:15:39.728860+0000","last_active":"2024-09-16T01:15:45.944679+0000","last_peered":"2024-09-16T01:15:45.944679+0000","last_clean":"2024-09-16T01:15:45.944679+0000","last_became_active":"2024-09-16T01:15:39.728186+0000","last_became_peered":"2024-09-16T01:15:39.728186+0000","last_unstale":"2024-09-16T01:15:45.944679+0000","last_undegraded":"2024-09-16T01:15:45.944679+0000","last_fullsized":"2024-09-16T01:15:45.944679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:59.931695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746379+0000","last_change":"2024-09-16T01:15:39.721095+0000","last_active":"2024-09-16T01:15:44.746379+0000","last_peered":"2024-09-16T01:15:44.746379+0000","last_clean":"2024-09-16T01:15:44.746379+0000","last_became_active":"2024-09-16T01:15:39.720129+0000","last_became_peered":"2024-09-16T01:15:39.720129+0000","last_unstale":"2024-09-16T01:15:44.746379+0000","last_undegraded":"2024-09-16T01:15:44.746379+0000","last_fullsized":"2024-09-16T01:15:44.746379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.089581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.746705+0000","last_change":"2024-09-16T01:15:39.720408+0000","last_active":"2024-09-16T01:15:44.746705+0000","last_peered":"2024-09-16T01:15:44.746705+0000","last_clean":"2024-09-16T01:15:44.746705+0000","last_became_active":"2024-09-16T01:15:39.720126+0000","last_became_peered":"2024-09-16T01:15:39.720126+0000","last_unstale":"2024-09-16T01:15:44.746705+0000","last_undegraded":"2024-09-16T01:15:44.746705+0000","last_fullsized":"2024-09-16T01:15:44.746705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:20.629269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251410+0000","last_change":"2024-09-16T01:15:39.729127+0000","last_active":"2024-09-16T01:15:46.251410+0000","last_peered":"2024-09-16T01:15:46.251410+0000","last_clean":"2024-09-16T01:15:46.251410+0000","last_became_active":"2024-09-16T01:15:39.728867+0000","last_became_peered":"2024-09-16T01:15:39.728867+0000","last_unstale":"2024-09-16T01:15:46.251410+0000","last_undegraded":"2024-09-16T01:15:46.251410+0000","last_fullsized":"2024-09-16T01:15:46.251410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:30.159628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.921788+0000","last_change":"2024-09-16T01:15:39.727163+0000","last_active":"2024-09-16T01:15:44.921788+0000","last_peered":"2024-09-16T01:15:44.921788+0000","last_clean":"2024-09-16T01:15:44.921788+0000","last_became_active":"2024-09-16T01:15:39.726499+0000","last_became_peered":"2024-09-16T01:15:39.726499+0000","last_unstale":"2024-09-16T01:15:44.921788+0000","last_undegraded":"2024-09-16T01:15:44.921788+0000","last_fullsized":"2024-09-16T01:15:44.921788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:54:24.089581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250973+0000","last_change":"2024-09-16T01:15:39.723869+0000","last_active":"2024-09-16T01:15:46.250973+0000","last_peered":"2024-09-16T01:15:46.250973+0000","last_clean":"2024-09-16T01:15:46.250973+0000","last_became_active":"2024-09-16T01:15:39.723601+0000","last_became_peered":"2024-09-16T01:15:39.723601+0000","last_unstale":"2024-09-16T01:15:46.250973+0000","last_undegraded":"2024-09-16T01:15:46.250973+0000","last_fullsized":"2024-09-16T01:15:46.250973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:22.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745944+0000","last_change":"2024-09-16T01:15:39.724663+0000","last_active":"2024-09-16T01:15:44.745944+0000","last_peered":"2024-09-16T01:15:44.745944+0000","last_clean":"2024-09-16T01:15:44.745944+0000","last_became_active":"2024-09-16T01:15:39.724164+0000","last_became_peered":"2024-09-16T01:15:39.724164+0000","last_unstale":"2024-09-16T01:15:44.745944+0000","last_undegraded":"2024-09-16T01:15:44.745944+0000","last_fullsized":"2024-09-16T01:15:44.745944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.250875+0000","last_change":"2024-09-16T01:15:39.723119+0000","last_active":"2024-09-16T01:15:46.250875+0000","last_peered":"2024-09-16T01:15:46.250875+0000","last_clean":"2024-09-16T01:15:46.250875+0000","last_became_active":"2024-09-16T01:15:39.722798+0000","last_became_peered":"2024-09-16T01:15:39.722798+0000","last_unstale":"2024-09-16T01:15:46.250875+0000","last_undegraded":"2024-09-16T01:15:46.250875+0000","last_fullsized":"2024-09-16T01:15:46.250875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:33:51.270260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.745254+0000","last_change":"2024-09-16T01:15:39.716987+0000","last_active":"2024-09-16T01:15:44.745254+0000","last_peered":"2024-09-16T01:15:44.745254+0000","last_clean":"2024-09-16T01:15:44.745254+0000","last_became_active":"2024-09-16T01:15:39.716715+0000","last_became_peered":"2024-09-16T01:15:39.716715+0000","last_unstale":"2024-09-16T01:15:44.745254+0000","last_undegraded":"2024-09-16T01:15:44.745254+0000","last_fullsized":"2024-09-16T01:15:44.745254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:22.279993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.747307+0000","last_change":"2024-09-16T01:15:39.721824+0000","last_active":"2024-09-16T01:15:44.747307+0000","last_peered":"2024-09-16T01:15:44.747307+0000","last_clean":"2024-09-16T01:15:44.747307+0000","last_became_active":"2024-09-16T01:15:39.721566+0000","last_became_peered":"2024-09-16T01:15:39.721566+0000","last_unstale":"2024-09-16T01:15:44.747307+0000","last_undegraded":"2024-09-16T01:15:44.747307+0000","last_fullsized":"2024-09-16T01:15:44.747307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.166842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:44.817619+0000","last_change":"2024-09-16T01:15:39.723439+0000","last_active":"2024-09-16T01:15:44.817619+0000","last_peered":"2024-09-16T01:15:44.817619+0000","last_clean":"2024-09-16T01:15:44.817619+0000","last_became_active":"2024-09-16T01:15:39.722822+0000","last_became_peered":"2024-09-16T01:15:39.722822+0000","last_unstale":"2024-09-16T01:15:44.817619+0000","last_undegraded":"2024-09-16T01:15:44.817619+0000","last_fullsized":"2024-09-16T01:15:44.817619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:47.973809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-16T01:15:46.251286+0000","last_change":"2024-09-16T01:15:39.721668+0000","last_active":"2024-09-16T01:15:46.251286+0000","last_peered":"2024-09-16T01:15:46.251286+0000","last_clean":"2024-09-16T01:15:46.251286+0000","last_became_active":"2024-09-16T01:15:39.720818+0000","last_became_peered":"2024-09-16T01:15:39.720818+0000","last_unstale":"2024-09-16T01:15:46.251286+0000","last_undegraded":"2024-09-16T01:15:46.251286+0000","last_fullsized":"2024-09-16T01:15:46.251286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:38.691583+0000","last_clean_scrub_stamp":"2024-09-16T01:15:38.691583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:19.871750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:16:04.312 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:16:04.312 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T01:16:04.312 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-16T01:16:04.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:16:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.443+0000 7fa563423640 1 Processor -- start 2024-09-16T01:16:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.443+0000 7fa563423640 1 -- start start 2024-09-16T01:16:04.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa563423640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa55c0b6690 0x7fa55c1691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa563423640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55c0d3690 con 0x7fa55c0d30f0 2024-09-16T01:16:04.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa563423640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55c0d3970 con 0x7fa55c15e5f0 2024-09-16T01:16:04.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa563423640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa55c06d530 con 0x7fa55c0b6690 2024-09-16T01:16:04.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa5609be640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa55c0d30f0 0x7fa55c0b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42442/0 (socket says 172.21.15.81:42442) 2024-09-16T01:16:04.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa5609be640 1 -- 172.21.15.81:0/1301730171 learned_addr learned my addr 172.21.15.81:0/1301730171 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:04.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa5619c0640 1 --2- 172.21.15.81:0/1301730171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa55c0b6690 0x7fa55c1691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa553fff640 1 -- 172.21.15.81:0/1301730171 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970246458 0 0) 0x7fa55c0d3690 con 0x7fa55c0d30f0 2024-09-16T01:16:04.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa553fff640 1 -- 172.21.15.81:0/1301730171 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa548003520 con 0x7fa55c0d30f0 2024-09-16T01:16:04.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa553fff640 1 -- 172.21.15.81:0/1301730171 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 33764489 0 0) 0x7fa55c0d3970 con 0x7fa55c15e5f0 2024-09-16T01:16:04.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa5619c0640 1 -- 172.21.15.81:0/1301730171 >> v1:172.21.15.102:6789/0 conn(0x7fa55c15e5f0 legacy=0x7fa55c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa5619c0640 1 -- 172.21.15.81:0/1301730171 >> v1:172.21.15.81:6789/0 conn(0x7fa55c0d30f0 legacy=0x7fa55c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.444+0000 7fa5619c0640 1 -- 172.21.15.81:0/1301730171 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c06cee0 con 0x7fa55c0b6690 2024-09-16T01:16:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.445+0000 7fa5619c0640 1 --2- 172.21.15.81:0/1301730171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa55c0b6690 0x7fa55c1691a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa554009dc0 tx=0x7fa55402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db8f3a1c4226d371 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.445+0000 7fa553fff640 1 -- 172.21.15.81:0/1301730171 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa554007740 con 0x7fa55c0b6690 2024-09-16T01:16:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.445+0000 7fa553fff640 1 -- 172.21.15.81:0/1301730171 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5540078e0 con 0x7fa55c0b6690 2024-09-16T01:16:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.445+0000 7fa553fff640 1 -- 172.21.15.81:0/1301730171 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa554007cb0 con 0x7fa55c0b6690 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.446+0000 7fa563423640 1 -- 172.21.15.81:0/1301730171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa55c0b6690 msgr2=0x7fa55c1691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.446+0000 7fa563423640 1 --2- 172.21.15.81:0/1301730171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa55c0b6690 0x7fa55c1691a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa554009dc0 tx=0x7fa55402a6d0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.446+0000 7fa563423640 1 -- 172.21.15.81:0/1301730171 shutdown_connections 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.446+0000 7fa563423640 1 --2- 172.21.15.81:0/1301730171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa55c0b6690 0x7fa55c1691a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.446+0000 7fa563423640 1 -- 172.21.15.81:0/1301730171 >> 172.21.15.81:0/1301730171 conn(0x7fa55c08bfc0 msgr2=0x7fa55c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.446+0000 7fa563423640 1 -- 172.21.15.81:0/1301730171 shutdown_connections 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.446+0000 7fa563423640 1 -- 172.21.15.81:0/1301730171 wait complete. 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.447+0000 7fa563423640 1 Processor -- start 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.447+0000 7fa563423640 1 -- start start 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa563423640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa55c0b6690 0x7fa55c160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa563423640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0d30f0 0x7fa55c0b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa563423640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa55c15e5f0 0x7fa55c0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa563423640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c06e9d0 con 0x7fa55c0d30f0 2024-09-16T01:16:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa563423640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c15e9d0 con 0x7fa55c0b6690 2024-09-16T01:16:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa563423640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa55c06eb50 con 0x7fa55c15e5f0 2024-09-16T01:16:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5609be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0d30f0 0x7fa55c0b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5609be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0d30f0 0x7fa55c0b1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41680/0 (socket says 172.21.15.81:41680) 2024-09-16T01:16:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5609be640 1 -- 172.21.15.81:0/1007175846 learned_addr learned my addr 172.21.15.81:0/1007175846 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5619c0640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa55c15e5f0 0x7fa55c0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5611bf640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa55c0b6690 0x7fa55c160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5609be640 1 -- 172.21.15.81:0/1007175846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa55c15e5f0 msgr2=0x7fa55c0b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5609be640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa55c15e5f0 0x7fa55c0b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5609be640 1 -- 172.21.15.81:0/1007175846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa55c0b6690 msgr2=0x7fa55c160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5609be640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa55c0b6690 0x7fa55c160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5609be640 1 -- 172.21.15.81:0/1007175846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c0b7350 con 0x7fa55c0d30f0 2024-09-16T01:16:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5619c0640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa55c15e5f0 0x7fa55c0b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5611bf640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa55c0b6690 0x7fa55c160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa5609be640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0d30f0 0x7fa55c0b1700 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0010e0 tx=0x7fa54c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa551ffb640 1 -- 172.21.15.81:0/1007175846 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c017070 con 0x7fa55c0d30f0 2024-09-16T01:16:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa551ffb640 1 -- 172.21.15.81:0/1007175846 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54c005d00 con 0x7fa55c0d30f0 2024-09-16T01:16:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa551ffb640 1 -- 172.21.15.81:0/1007175846 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0072b0 con 0x7fa55c0d30f0 2024-09-16T01:16:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.448+0000 7fa563423640 1 -- 172.21.15.81:0/1007175846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55c160670 con 0x7fa55c0d30f0 2024-09-16T01:16:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.449+0000 7fa563423640 1 -- 172.21.15.81:0/1007175846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55c0b75f0 con 0x7fa55c0d30f0 2024-09-16T01:16:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.450+0000 7fa563423640 1 -- 172.21.15.81:0/1007175846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa55c0b5f80 con 0x7fa55c0d30f0 2024-09-16T01:16:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.450+0000 7fa551ffb640 1 -- 172.21.15.81:0/1007175846 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa54c01a070 con 0x7fa55c0d30f0 2024-09-16T01:16:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.450+0000 7fa551ffb640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa54006c2b0 0x7fa54006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.450+0000 7fa551ffb640 1 -- 172.21.15.81:0/1007175846 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa54c08abc0 con 0x7fa55c0d30f0 2024-09-16T01:16:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.450+0000 7fa5611bf640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa54006c2b0 0x7fa54006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.451+0000 7fa5611bf640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa54006c2b0 0x7fa54006e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa558000f60 tx=0x7fa558009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:04.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.455+0000 7fa551ffb640 1 -- 172.21.15.81:0/1007175846 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa54c058ff0 con 0x7fa55c0d30f0 2024-09-16T01:16:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.653+0000 7fa563423640 1 -- 172.21.15.81:0/1007175846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa55c0cf990 con 0x7fa55c0d30f0 2024-09-16T01:16:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.654+0000 7fa551ffb640 1 -- 172.21.15.81:0/1007175846 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa54c0588f0 con 0x7fa55c0d30f0 2024-09-16T01:16:04.654 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:04.655 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T01:16:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.656+0000 7fa563423640 1 -- 172.21.15.81:0/1007175846 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa54006c2b0 msgr2=0x7fa54006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.656+0000 7fa563423640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa54006c2b0 0x7fa54006e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa558000f60 tx=0x7fa558009040 comp rx=0 tx=0).stop 2024-09-16T01:16:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.656+0000 7fa563423640 1 -- 172.21.15.81:0/1007175846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0d30f0 msgr2=0x7fa55c0b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.656+0000 7fa563423640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0d30f0 0x7fa55c0b1700 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0010e0 tx=0x7fa54c00c960 comp rx=0 tx=0).stop 2024-09-16T01:16:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.656+0000 7fa563423640 1 -- 172.21.15.81:0/1007175846 shutdown_connections 2024-09-16T01:16:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.656+0000 7fa563423640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa54006c2b0 0x7fa54006e770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.656+0000 7fa563423640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa55c15e5f0 0x7fa55c0b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.656+0000 7fa563423640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0d30f0 0x7fa55c0b1700 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.656+0000 7fa563423640 1 --2- 172.21.15.81:0/1007175846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa55c0b6690 0x7fa55c160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.656+0000 7fa563423640 1 -- 172.21.15.81:0/1007175846 >> 172.21.15.81:0/1007175846 conn(0x7fa55c08bfc0 msgr2=0x7fa55c0d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.656+0000 7fa563423640 1 -- 172.21.15.81:0/1007175846 shutdown_connections 2024-09-16T01:16:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.656+0000 7fa563423640 1 -- 172.21.15.81:0/1007175846 wait complete. 2024-09-16T01:16:04.667 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-16T01:16:04.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:16:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.764+0000 7fa98832c640 1 Processor -- start 2024-09-16T01:16:04.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.764+0000 7fa98832c640 1 -- start start 2024-09-16T01:16:04.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa98832c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa98015e760 0x7fa98006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa98832c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa9800cfcc0 0x7fa9800d2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa98832c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9800d2700 con 0x7fa9800d4fd0 2024-09-16T01:16:04.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa98832c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa9800cedb0 con 0x7fa98015e760 2024-09-16T01:16:04.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa98832c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa9800cf090 con 0x7fa9800cfcc0 2024-09-16T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa9860c8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa98015e760 0x7fa98006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa9858c7640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa9800d4fd0 0x7fa9800cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42458/0 (socket says 172.21.15.81:42458) 2024-09-16T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa9858c7640 1 -- 172.21.15.81:0/2691608372 learned_addr learned my addr 172.21.15.81:0/2691608372 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa9860c8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa98015e760 0x7fa98006cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41694/0 (socket says 172.21.15.81:41694) 2024-09-16T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa9868c9640 1 --2- 172.21.15.81:0/2691608372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa9800cfcc0 0x7fa9800d2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa9860c8640 1 -- 172.21.15.81:0/2691608372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa9800cfcc0 msgr2=0x7fa9800d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa9860c8640 1 --2- 172.21.15.81:0/2691608372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa9800cfcc0 0x7fa9800d2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa9860c8640 1 -- 172.21.15.81:0/2691608372 >> v1:172.21.15.81:6789/0 conn(0x7fa9800d4fd0 legacy=0x7fa9800cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa9860c8640 1 -- 172.21.15.81:0/2691608372 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9800b3c80 con 0x7fa98015e760 2024-09-16T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.765+0000 7fa9850c6640 1 -- 172.21.15.81:0/2691608372 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316423930 0 0) 0x7fa970001290 con 0x7fa9800d4fd0 2024-09-16T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.766+0000 7fa9860c8640 1 --2- 172.21.15.81:0/2691608372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa98015e760 0x7fa98006cdd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0097a0 tx=0x7fa97c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563aef8115999d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.766+0000 7fa9850c6640 1 -- 172.21.15.81:0/2691608372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c037070 con 0x7fa98015e760 2024-09-16T01:16:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.766+0000 7fa9850c6640 1 -- 172.21.15.81:0/2691608372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa97c032440 con 0x7fa98015e760 2024-09-16T01:16:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.766+0000 7fa9850c6640 1 -- 172.21.15.81:0/2691608372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c032810 con 0x7fa98015e760 2024-09-16T01:16:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.767+0000 7fa98832c640 1 -- 172.21.15.81:0/2691608372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa98015e760 msgr2=0x7fa98006cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.767+0000 7fa98832c640 1 --2- 172.21.15.81:0/2691608372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa98015e760 0x7fa98006cdd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0097a0 tx=0x7fa97c02a180 comp rx=0 tx=0).stop 2024-09-16T01:16:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.767+0000 7fa98832c640 1 -- 172.21.15.81:0/2691608372 shutdown_connections 2024-09-16T01:16:04.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.767+0000 7fa98832c640 1 --2- 172.21.15.81:0/2691608372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa9800cfcc0 0x7fa9800d2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.767+0000 7fa98832c640 1 --2- 172.21.15.81:0/2691608372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa98015e760 0x7fa98006cdd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.767+0000 7fa98832c640 1 -- 172.21.15.81:0/2691608372 >> 172.21.15.81:0/2691608372 conn(0x7fa98008bfc0 msgr2=0x7fa9800d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.767+0000 7fa98832c640 1 -- 172.21.15.81:0/2691608372 shutdown_connections 2024-09-16T01:16:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.767+0000 7fa98832c640 1 -- 172.21.15.81:0/2691608372 wait complete. 2024-09-16T01:16:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.768+0000 7fa98832c640 1 Processor -- start 2024-09-16T01:16:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.768+0000 7fa98832c640 1 -- start start 2024-09-16T01:16:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa98832c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9800cfcc0 0x7fa9801f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa98832c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9800d4fd0 0x7fa9801f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa98832c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa98015e760 0x7fa9800b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa98832c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9800d33e0 con 0x7fa9800d4fd0 2024-09-16T01:16:04.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa98832c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa9800b38e0 con 0x7fa9800cfcc0 2024-09-16T01:16:04.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa98832c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa9800d3560 con 0x7fa98015e760 2024-09-16T01:16:04.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa9858c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9800d4fd0 0x7fa9801f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa9858c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9800d4fd0 0x7fa9801f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41708/0 (socket says 172.21.15.81:41708) 2024-09-16T01:16:04.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa9858c7640 1 -- 172.21.15.81:0/3943317522 learned_addr learned my addr 172.21.15.81:0/3943317522 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:04.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa9868c9640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa98015e760 0x7fa9800b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa9860c8640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9800cfcc0 0x7fa9801f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa9858c7640 1 -- 172.21.15.81:0/3943317522 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa98015e760 msgr2=0x7fa9800b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa9858c7640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa98015e760 0x7fa9800b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa9858c7640 1 -- 172.21.15.81:0/3943317522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9800cfcc0 msgr2=0x7fa9801f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa9858c7640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9800cfcc0 0x7fa9801f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa9858c7640 1 -- 172.21.15.81:0/3943317522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9800b4240 con 0x7fa9800d4fd0 2024-09-16T01:16:04.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa9858c7640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9800d4fd0 0x7fa9801f4d30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa97000c500 tx=0x7fa97000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:04.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa976ffd640 1 -- 172.21.15.81:0/3943317522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa970007480 con 0x7fa9800d4fd0 2024-09-16T01:16:04.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa976ffd640 1 -- 172.21.15.81:0/3943317522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa970007620 con 0x7fa9800d4fd0 2024-09-16T01:16:04.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.769+0000 7fa98832c640 1 -- 172.21.15.81:0/3943317522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9801f5270 con 0x7fa9800d4fd0 2024-09-16T01:16:04.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.770+0000 7fa976ffd640 1 -- 172.21.15.81:0/3943317522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9700059e0 con 0x7fa9800d4fd0 2024-09-16T01:16:04.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.770+0000 7fa98832c640 1 -- 172.21.15.81:0/3943317522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9800b4790 con 0x7fa9800d4fd0 2024-09-16T01:16:04.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.770+0000 7fa98832c640 1 -- 172.21.15.81:0/3943317522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9800d4a10 con 0x7fa9800d4fd0 2024-09-16T01:16:04.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.771+0000 7fa976ffd640 1 -- 172.21.15.81:0/3943317522 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa970005b80 con 0x7fa9800d4fd0 2024-09-16T01:16:04.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.771+0000 7fa976ffd640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa96406c2e0 0x7fa96406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:04.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.771+0000 7fa976ffd640 1 -- 172.21.15.81:0/3943317522 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa97008b390 con 0x7fa9800d4fd0 2024-09-16T01:16:04.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.771+0000 7fa9860c8640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa96406c2e0 0x7fa96406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:04.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.772+0000 7fa9860c8640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa96406c2e0 0x7fa96406e7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa97c034000 tx=0x7fa97c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:04.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.776+0000 7fa976ffd640 1 -- 172.21.15.81:0/3943317522 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9800d2700 con 0x7fa9800d4fd0 2024-09-16T01:16:04.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.975+0000 7fa98832c640 1 -- 172.21.15.81:0/3943317522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa98006d430 con 0x7fa9800d4fd0 2024-09-16T01:16:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.976+0000 7fa976ffd640 1 -- 172.21.15.81:0/3943317522 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7fa970059850 con 0x7fa9800d4fd0 2024-09-16T01:16:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:04.977 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-16T01:15:58:778268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1441310273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1441310273},{"type":"v1","addr":"172.21.15.102:6834","nonce":1441310273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1086586307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1086586307},{"type":"v1","addr":"172.21.15.102:6835","nonce":1086586307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4105201682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4105201682},{"type":"v1","addr":"172.21.15.81:6835","nonce":4105201682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:15:39.037094+0000","modified":"2024-09-16T01:15:58.115389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2354333316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2354333316},{"type":"v1","addr":"172.21.15.81:6837","nonce":2354333316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-16T01:16:04.977 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-16T01:16:04.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.978+0000 7fa98832c640 1 -- 172.21.15.81:0/3943317522 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa96406c2e0 msgr2=0x7fa96406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.978+0000 7fa98832c640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa96406c2e0 0x7fa96406e7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa97c034000 tx=0x7fa97c02e000 comp rx=0 tx=0).stop 2024-09-16T01:16:04.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.978+0000 7fa98832c640 1 -- 172.21.15.81:0/3943317522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9800d4fd0 msgr2=0x7fa9801f4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:04.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.978+0000 7fa98832c640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9800d4fd0 0x7fa9801f4d30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa97000c500 tx=0x7fa97000c9c0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.978+0000 7fa98832c640 1 -- 172.21.15.81:0/3943317522 shutdown_connections 2024-09-16T01:16:04.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.978+0000 7fa98832c640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa96406c2e0 0x7fa96406e7a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.978+0000 7fa98832c640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa98015e760 0x7fa9800b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.978+0000 7fa98832c640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9800d4fd0 0x7fa9801f4d30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.978+0000 7fa98832c640 1 --2- 172.21.15.81:0/3943317522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9800cfcc0 0x7fa9801f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:04.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.978+0000 7fa98832c640 1 -- 172.21.15.81:0/3943317522 >> 172.21.15.81:0/3943317522 conn(0x7fa98008bfc0 msgr2=0x7fa98015cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:04.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.978+0000 7fa98832c640 1 -- 172.21.15.81:0/3943317522 shutdown_connections 2024-09-16T01:16:04.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:04.978+0000 7fa98832c640 1 -- 172.21.15.81:0/3943317522 wait complete. 2024-09-16T01:16:04.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:16:05.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.088+0000 7f825005e640 1 Processor -- start 2024-09-16T01:16:05.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.088+0000 7f825005e640 1 -- start start 2024-09-16T01:16:05.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.089+0000 7f825005e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f82480d0270 0x7f82480d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.089+0000 7f825005e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82480b6010 0x7f82480b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.089+0000 7f825005e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82480d2170 con 0x7f824815e710 2024-09-16T01:16:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.089+0000 7f825005e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f82480b69a0 con 0x7f82480b6010 2024-09-16T01:16:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.089+0000 7f825005e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f82480d2d20 con 0x7f82480d0270 2024-09-16T01:16:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.089+0000 7f824e5fb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82480b6010 0x7f82480b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.090+0000 7f824e5fb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82480b6010 0x7f82480b6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41716/0 (socket says 172.21.15.81:41716) 2024-09-16T01:16:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.090+0000 7f824e5fb640 1 -- 172.21.15.81:0/3118498505 learned_addr learned my addr 172.21.15.81:0/3118498505 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.090+0000 7f824d5f9640 1 --2- 172.21.15.81:0/3118498505 >> v2:172.21.15.102:3300/0 conn(0x7f82480d0270 0x7f82480d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.090+0000 7f824e5fb640 1 -- 172.21.15.81:0/3118498505 >> v2:172.21.15.102:3300/0 conn(0x7f82480d0270 msgr2=0x7f82480d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.090+0000 7f824e5fb640 1 --2- 172.21.15.81:0/3118498505 >> v2:172.21.15.102:3300/0 conn(0x7f82480d0270 0x7f82480d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.090+0000 7f824e5fb640 1 -- 172.21.15.81:0/3118498505 >> v1:172.21.15.102:6789/0 conn(0x7f824815e710 legacy=0x7f82480cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.090+0000 7f824e5fb640 1 -- 172.21.15.81:0/3118498505 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82480d2410 con 0x7f82480b6010 2024-09-16T01:16:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.090+0000 7f824e5fb640 1 --2- 172.21.15.81:0/3118498505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82480b6010 0x7f82480b6460 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f82480a2470 tx=0x7f824002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fddfa284d48dbf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.091+0000 7f824cdf8640 1 -- 172.21.15.81:0/3118498505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240037070 con 0x7f82480b6010 2024-09-16T01:16:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.091+0000 7f824cdf8640 1 -- 172.21.15.81:0/3118498505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8240032440 con 0x7f82480b6010 2024-09-16T01:16:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.091+0000 7f824cdf8640 1 -- 172.21.15.81:0/3118498505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240032810 con 0x7f82480b6010 2024-09-16T01:16:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.091+0000 7f825005e640 1 -- 172.21.15.81:0/3118498505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82480b6010 msgr2=0x7f82480b6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.091+0000 7f825005e640 1 --2- 172.21.15.81:0/3118498505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82480b6010 0x7f82480b6460 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f82480a2470 tx=0x7f824002a270 comp rx=0 tx=0).stop 2024-09-16T01:16:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.091+0000 7f825005e640 1 -- 172.21.15.81:0/3118498505 shutdown_connections 2024-09-16T01:16:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.091+0000 7f825005e640 1 --2- 172.21.15.81:0/3118498505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82480b6010 0x7f82480b6460 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.091+0000 7f825005e640 1 --2- 172.21.15.81:0/3118498505 >> v2:172.21.15.102:3300/0 conn(0x7f82480d0270 0x7f82480d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.091+0000 7f825005e640 1 -- 172.21.15.81:0/3118498505 >> 172.21.15.81:0/3118498505 conn(0x7f824808bfc0 msgr2=0x7f82480d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.091+0000 7f825005e640 1 -- 172.21.15.81:0/3118498505 shutdown_connections 2024-09-16T01:16:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.091+0000 7f825005e640 1 -- 172.21.15.81:0/3118498505 wait complete. 2024-09-16T01:16:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.092+0000 7f825005e640 1 Processor -- start 2024-09-16T01:16:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.093+0000 7f825005e640 1 -- start start 2024-09-16T01:16:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.093+0000 7f825005e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82480b6010 0x7f82480ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.093+0000 7f825005e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82480d0270 0x7f8248157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.093+0000 7f825005e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f824815e710 0x7f824815f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.093+0000 7f825005e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f82480d29b0 con 0x7f824815e710 2024-09-16T01:16:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.093+0000 7f825005e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f82480d26d0 con 0x7f82480d0270 2024-09-16T01:16:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.093+0000 7f825005e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f824806ce60 con 0x7f82480b6010 2024-09-16T01:16:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.093+0000 7f824e5fb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f824815e710 0x7f824815f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.093+0000 7f824e5fb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f824815e710 0x7f824815f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41730/0 (socket says 172.21.15.81:41730) 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.093+0000 7f824e5fb640 1 -- 172.21.15.81:0/2890549894 learned_addr learned my addr 172.21.15.81:0/2890549894 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.093+0000 7f824ddfa640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82480b6010 0x7f82480ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.093+0000 7f824d5f9640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82480d0270 0x7f8248157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.094+0000 7f824e5fb640 1 -- 172.21.15.81:0/2890549894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82480b6010 msgr2=0x7f82480ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.094+0000 7f824e5fb640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82480b6010 0x7f82480ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.094+0000 7f824e5fb640 1 -- 172.21.15.81:0/2890549894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82480d0270 msgr2=0x7f8248157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.094+0000 7f824e5fb640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82480d0270 0x7f8248157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.094+0000 7f824e5fb640 1 -- 172.21.15.81:0/2890549894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8248158230 con 0x7f824815e710 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.094+0000 7f824e5fb640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f824815e710 0x7f824815f270 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f82400090b0 tx=0x7f82400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.094+0000 7f82467fc640 1 -- 172.21.15.81:0/2890549894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240037040 con 0x7f824815e710 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.094+0000 7f82467fc640 1 -- 172.21.15.81:0/2890549894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8240042070 con 0x7f824815e710 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.094+0000 7f825005e640 1 -- 172.21.15.81:0/2890549894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824815f7b0 con 0x7f824815e710 2024-09-16T01:16:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.094+0000 7f82467fc640 1 -- 172.21.15.81:0/2890549894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240030920 con 0x7f824815e710 2024-09-16T01:16:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.094+0000 7f825005e640 1 -- 172.21.15.81:0/2890549894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824815fd60 con 0x7f824815e710 2024-09-16T01:16:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.095+0000 7f825005e640 1 -- 172.21.15.81:0/2890549894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82480b6460 con 0x7f824815e710 2024-09-16T01:16:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.096+0000 7f82467fc640 1 -- 172.21.15.81:0/2890549894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8240030ac0 con 0x7f824815e710 2024-09-16T01:16:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.096+0000 7f82467fc640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f823406c2e0 0x7f823406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.096+0000 7f82467fc640 1 -- 172.21.15.81:0/2890549894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f82400abf20 con 0x7f824815e710 2024-09-16T01:16:05.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.096+0000 7f824ddfa640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f823406c2e0 0x7f823406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.096+0000 7f824ddfa640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f823406c2e0 0x7f823406e7a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f82380012e0 tx=0x7f8238009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.100+0000 7f82467fc640 1 -- 172.21.15.81:0/2890549894 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8240079d00 con 0x7f824815e710 2024-09-16T01:16:05.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.301+0000 7f825005e640 1 -- 172.21.15.81:0/2890549894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82480b21b0 con 0x7f824815e710 2024-09-16T01:16:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.301+0000 7f82467fc640 1 -- 172.21.15.81:0/2890549894 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f824007e000 con 0x7f824815e710 2024-09-16T01:16:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:05.302 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-16T01:15:58:778268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1441310273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1441310273},{"type":"v1","addr":"172.21.15.102:6834","nonce":1441310273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1086586307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1086586307},{"type":"v1","addr":"172.21.15.102:6835","nonce":1086586307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4105201682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4105201682},{"type":"v1","addr":"172.21.15.81:6835","nonce":4105201682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:15:39.037094+0000","modified":"2024-09-16T01:15:58.115389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2354333316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2354333316},{"type":"v1","addr":"172.21.15.81:6837","nonce":2354333316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-16T01:16:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-16T01:16:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.303+0000 7f825005e640 1 -- 172.21.15.81:0/2890549894 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f823406c2e0 msgr2=0x7f823406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.303+0000 7f825005e640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f823406c2e0 0x7f823406e7a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f82380012e0 tx=0x7f8238009040 comp rx=0 tx=0).stop 2024-09-16T01:16:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.303+0000 7f825005e640 1 -- 172.21.15.81:0/2890549894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f824815e710 msgr2=0x7f824815f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.303+0000 7f825005e640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f824815e710 0x7f824815f270 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f82400090b0 tx=0x7f82400046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.303+0000 7f825005e640 1 -- 172.21.15.81:0/2890549894 shutdown_connections 2024-09-16T01:16:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.303+0000 7f825005e640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f823406c2e0 0x7f823406e7a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.303+0000 7f825005e640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f824815e710 0x7f824815f270 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.303+0000 7f825005e640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82480d0270 0x7f8248157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.303+0000 7f825005e640 1 --2- 172.21.15.81:0/2890549894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82480b6010 0x7f82480ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.303+0000 7f825005e640 1 -- 172.21.15.81:0/2890549894 >> 172.21.15.81:0/2890549894 conn(0x7f824808bfc0 msgr2=0x7f82480b5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.304+0000 7f825005e640 1 -- 172.21.15.81:0/2890549894 shutdown_connections 2024-09-16T01:16:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.304+0000 7f825005e640 1 -- 172.21.15.81:0/2890549894 wait complete. 2024-09-16T01:16:05.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:16:05.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.412+0000 7f8bdbd11640 1 Processor -- start 2024-09-16T01:16:05.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.413+0000 7f8bdbd11640 1 -- start start 2024-09-16T01:16:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.413+0000 7f8bdbd11640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8bd415c520 0x7f8bd409b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.413+0000 7f8bdbd11640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8bd40b1620 0x7f8bd40b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.413+0000 7f8bdbd11640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8bd40d0980 0x7f8bd40d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.413+0000 7f8bdbd11640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8bd40cec00 con 0x7f8bd40d0980 2024-09-16T01:16:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.413+0000 7f8bdbd11640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8bd409bd90 con 0x7f8bd415c520 2024-09-16T01:16:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.413+0000 7f8bdbd11640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd40d0010 con 0x7f8bd40b1620 2024-09-16T01:16:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.414+0000 7f8bda2ae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8bd40d0980 0x7f8bd40d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.414+0000 7f8bda2ae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8bd40d0980 0x7f8bd40d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41738/0 (socket says 172.21.15.81:41738) 2024-09-16T01:16:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.414+0000 7f8bda2ae640 1 -- 172.21.15.81:0/2908812898 learned_addr learned my addr 172.21.15.81:0/2908812898 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.414+0000 7f8bd92ac640 1 --2- 172.21.15.81:0/2908812898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8bd40b1620 0x7f8bd40b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.414+0000 7f8bd9aad640 1 --2- 172.21.15.81:0/2908812898 >> v2:172.21.15.102:3300/0 conn(0x7f8bd415c520 0x7f8bd409b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.414+0000 7f8bda2ae640 1 -- 172.21.15.81:0/2908812898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8bd40b1620 msgr2=0x7f8bd40b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:05.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.414+0000 7f8bda2ae640 1 --2- 172.21.15.81:0/2908812898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8bd40b1620 0x7f8bd40b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.414+0000 7f8bda2ae640 1 -- 172.21.15.81:0/2908812898 >> v2:172.21.15.102:3300/0 conn(0x7f8bd415c520 msgr2=0x7f8bd409b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.414+0000 7f8bda2ae640 1 --2- 172.21.15.81:0/2908812898 >> v2:172.21.15.102:3300/0 conn(0x7f8bd415c520 0x7f8bd409b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.414+0000 7f8bda2ae640 1 -- 172.21.15.81:0/2908812898 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd40d02f0 con 0x7f8bd40d0980 2024-09-16T01:16:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.414+0000 7f8bd9aad640 1 --2- 172.21.15.81:0/2908812898 >> v2:172.21.15.102:3300/0 conn(0x7f8bd415c520 0x7f8bd409b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.414+0000 7f8bd92ac640 1 --2- 172.21.15.81:0/2908812898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8bd40b1620 0x7f8bd40b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bda2ae640 1 --2- 172.21.15.81:0/2908812898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd40d0980 0x7f8bd40d0e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4073340 tx=0x7f8bcc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c710d653288dc9ac server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bd8aab640 1 -- 172.21.15.81:0/2908812898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc036070 con 0x7f8bd40d0980 2024-09-16T01:16:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bd8aab640 1 -- 172.21.15.81:0/2908812898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bcc031600 con 0x7f8bd40d0980 2024-09-16T01:16:05.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bd8aab640 1 -- 172.21.15.81:0/2908812898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0319d0 con 0x7f8bd40d0980 2024-09-16T01:16:05.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bdbd11640 1 -- 172.21.15.81:0/2908812898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd40d0980 msgr2=0x7f8bd40d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bdbd11640 1 --2- 172.21.15.81:0/2908812898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd40d0980 0x7f8bd40d0e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4073340 tx=0x7f8bcc02a6a0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bdbd11640 1 -- 172.21.15.81:0/2908812898 shutdown_connections 2024-09-16T01:16:05.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bdbd11640 1 --2- 172.21.15.81:0/2908812898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd40d0980 0x7f8bd40d0e10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bdbd11640 1 --2- 172.21.15.81:0/2908812898 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8bd40b1620 0x7f8bd40b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bdbd11640 1 --2- 172.21.15.81:0/2908812898 >> v2:172.21.15.102:3300/0 conn(0x7f8bd415c520 0x7f8bd409b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bdbd11640 1 -- 172.21.15.81:0/2908812898 >> 172.21.15.81:0/2908812898 conn(0x7f8bd40d23a0 msgr2=0x7f8bd40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:05.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bdbd11640 1 -- 172.21.15.81:0/2908812898 shutdown_connections 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.415+0000 7f8bdbd11640 1 -- 172.21.15.81:0/2908812898 wait complete. 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.417+0000 7f8bdbd11640 1 Processor -- start 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.417+0000 7f8bdbd11640 1 -- start start 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.417+0000 7f8bdbd11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd40b1620 0x7f8bd40c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.417+0000 7f8bdbd11640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8bd40d0980 0x7f8bd4154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.417+0000 7f8bdbd11640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bd415c520 0x7f8bd4155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.417+0000 7f8bdbd11640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd415c900 con 0x7f8bd40b1620 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.417+0000 7f8bdbd11640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd40d05d0 con 0x7f8bd415c520 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.417+0000 7f8bdbd11640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd40c9ac0 con 0x7f8bd40d0980 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.417+0000 7f8bd9aad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd40b1620 0x7f8bd40c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.417+0000 7f8bd9aad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd40b1620 0x7f8bd40c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41754/0 (socket says 172.21.15.81:41754) 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.417+0000 7f8bd9aad640 1 -- 172.21.15.81:0/1570975261 learned_addr learned my addr 172.21.15.81:0/1570975261 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:05.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bda2ae640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bd415c520 0x7f8bd4155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bd92ac640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8bd40d0980 0x7f8bd4154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bd9aad640 1 -- 172.21.15.81:0/1570975261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8bd40d0980 msgr2=0x7f8bd4154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bd9aad640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8bd40d0980 0x7f8bd4154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bd9aad640 1 -- 172.21.15.81:0/1570975261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bd415c520 msgr2=0x7f8bd4155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bd9aad640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bd415c520 0x7f8bd4155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bd9aad640 1 -- 172.21.15.81:0/1570975261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd40c97e0 con 0x7f8bd40b1620 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bda2ae640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bd415c520 0x7f8bd4155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bd9aad640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd40b1620 0x7f8bd40c8a50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000e810 tx=0x7f8bd000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bca7fc640 1 -- 172.21.15.81:0/1570975261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000f040 con 0x7f8bd40b1620 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bca7fc640 1 -- 172.21.15.81:0/1570975261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd0004030 con 0x7f8bd40b1620 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bdbd11640 1 -- 172.21.15.81:0/1570975261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd40c7f70 con 0x7f8bd40b1620 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bca7fc640 1 -- 172.21.15.81:0/1570975261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0004400 con 0x7f8bd40b1620 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.418+0000 7f8bdbd11640 1 -- 172.21.15.81:0/1570975261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd40c8530 con 0x7f8bd40b1620 2024-09-16T01:16:05.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.419+0000 7f8bdbd11640 1 -- 172.21.15.81:0/1570975261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd40b1d40 con 0x7f8bd40b1620 2024-09-16T01:16:05.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.419+0000 7f8bca7fc640 1 -- 172.21.15.81:0/1570975261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8bd000c6d0 con 0x7f8bd40b1620 2024-09-16T01:16:05.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.420+0000 7f8bca7fc640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8bb806c2e0 0x7f8bb806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.420+0000 7f8bd92ac640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8bb806c2e0 0x7f8bb806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.420+0000 7f8bca7fc640 1 -- 172.21.15.81:0/1570975261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8bd008b4a0 con 0x7f8bd40b1620 2024-09-16T01:16:05.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.420+0000 7f8bd92ac640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8bb806c2e0 0x7f8bb806e7a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4006fd0 tx=0x7f8bc4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.425+0000 7f8bca7fc640 1 -- 172.21.15.81:0/1570975261 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bd0017020 con 0x7f8bd40b1620 2024-09-16T01:16:05.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.590+0000 7f8bdbd11640 1 -- 172.21.15.81:0/1570975261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bd40b8320 con 0x7f8bd40b1620 2024-09-16T01:16:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.592+0000 7f8bca7fc640 1 -- 172.21.15.81:0/1570975261 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18598 (secure 0 0 0) 0x7f8bd0059960 con 0x7f8bd40b1620 2024-09-16T01:16:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:05.593 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:44.092404+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:15:36.856888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:15:38.066938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:15:41.748133+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:16:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.593+0000 7f8bdbd11640 1 -- 172.21.15.81:0/1570975261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8bb806c2e0 msgr2=0x7f8bb806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.593+0000 7f8bdbd11640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8bb806c2e0 0x7f8bb806e7a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4006fd0 tx=0x7f8bc4008040 comp rx=0 tx=0).stop 2024-09-16T01:16:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.594+0000 7f8bdbd11640 1 -- 172.21.15.81:0/1570975261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd40b1620 msgr2=0x7f8bd40c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.594+0000 7f8bdbd11640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd40b1620 0x7f8bd40c8a50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000e810 tx=0x7f8bd000ecd0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.594+0000 7f8bdbd11640 1 -- 172.21.15.81:0/1570975261 shutdown_connections 2024-09-16T01:16:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.594+0000 7f8bdbd11640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8bb806c2e0 0x7f8bb806e7a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.594+0000 7f8bdbd11640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bd415c520 0x7f8bd4155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.594+0000 7f8bdbd11640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8bd40d0980 0x7f8bd4154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.594+0000 7f8bdbd11640 1 --2- 172.21.15.81:0/1570975261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bd40b1620 0x7f8bd40c8a50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.594+0000 7f8bdbd11640 1 -- 172.21.15.81:0/1570975261 >> 172.21.15.81:0/1570975261 conn(0x7f8bd40d23a0 msgr2=0x7f8bd40706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.594+0000 7f8bdbd11640 1 -- 172.21.15.81:0/1570975261 shutdown_connections 2024-09-16T01:16:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.594+0000 7f8bdbd11640 1 -- 172.21.15.81:0/1570975261 wait complete. 2024-09-16T01:16:05.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:16:05.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.702+0000 7f29864ed640 1 Processor -- start 2024-09-16T01:16:05.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.703+0000 7f29864ed640 1 -- start start 2024-09-16T01:16:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.703+0000 7f29864ed640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f298015e5b0 0x7f29800b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.703+0000 7f29864ed640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f298015e990 0x7f29800b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.703+0000 7f29864ed640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29800b6520 con 0x7f29800ae140 2024-09-16T01:16:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.703+0000 7f29864ed640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f29800b17f0 con 0x7f298015e5b0 2024-09-16T01:16:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.703+0000 7f29864ed640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f29800b1a40 con 0x7f298015e990 2024-09-16T01:16:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.704+0000 7f297ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f298015e5b0 0x7f29800b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.704+0000 7f2984a8a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f29800ae140 0x7f298006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42468/0 (socket says 172.21.15.81:42468) 2024-09-16T01:16:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.704+0000 7f2984a8a640 1 -- 172.21.15.81:0/1231092387 learned_addr learned my addr 172.21.15.81:0/1231092387 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.704+0000 7f297f7fe640 1 --2- 172.21.15.81:0/1231092387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f298015e990 0x7f29800b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.704+0000 7f297ffff640 1 -- 172.21.15.81:0/1231092387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f298015e990 msgr2=0x7f29800b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:05.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.704+0000 7f297ffff640 1 --2- 172.21.15.81:0/1231092387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f298015e990 0x7f29800b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.704+0000 7f297ffff640 1 -- 172.21.15.81:0/1231092387 >> v1:172.21.15.81:6789/0 conn(0x7f29800ae140 legacy=0x7f298006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.704+0000 7f297ffff640 1 -- 172.21.15.81:0/1231092387 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29800b1d20 con 0x7f298015e5b0 2024-09-16T01:16:05.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.704+0000 7f297effd640 1 -- 172.21.15.81:0/1231092387 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3175759234 0 0) 0x7f29800b6520 con 0x7f29800ae140 2024-09-16T01:16:05.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.705+0000 7f297ffff640 1 --2- 172.21.15.81:0/1231092387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298015e5b0 0x7f29800b5f40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f29700097a0 tx=0x7f297002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd3baeeabe1e9d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:05.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.705+0000 7f297effd640 1 -- 172.21.15.81:0/1231092387 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970037070 con 0x7f298015e5b0 2024-09-16T01:16:05.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.705+0000 7f297effd640 1 -- 172.21.15.81:0/1231092387 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2970032440 con 0x7f298015e5b0 2024-09-16T01:16:05.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.705+0000 7f297effd640 1 -- 172.21.15.81:0/1231092387 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2970032810 con 0x7f298015e5b0 2024-09-16T01:16:05.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.705+0000 7f29864ed640 1 -- 172.21.15.81:0/1231092387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298015e5b0 msgr2=0x7f29800b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.705+0000 7f29864ed640 1 --2- 172.21.15.81:0/1231092387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298015e5b0 0x7f29800b5f40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f29700097a0 tx=0x7f297002a180 comp rx=0 tx=0).stop 2024-09-16T01:16:05.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.705+0000 7f29864ed640 1 -- 172.21.15.81:0/1231092387 shutdown_connections 2024-09-16T01:16:05.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.705+0000 7f29864ed640 1 --2- 172.21.15.81:0/1231092387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f298015e990 0x7f29800b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.705+0000 7f29864ed640 1 --2- 172.21.15.81:0/1231092387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298015e5b0 0x7f29800b5f40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.705+0000 7f29864ed640 1 -- 172.21.15.81:0/1231092387 >> 172.21.15.81:0/1231092387 conn(0x7f2980073490 msgr2=0x7f29800b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:05.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.705+0000 7f29864ed640 1 -- 172.21.15.81:0/1231092387 shutdown_connections 2024-09-16T01:16:05.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.705+0000 7f29864ed640 1 -- 172.21.15.81:0/1231092387 wait complete. 2024-09-16T01:16:05.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.706+0000 7f29864ed640 1 Processor -- start 2024-09-16T01:16:05.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.707+0000 7f29864ed640 1 -- start start 2024-09-16T01:16:05.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.707+0000 7f29864ed640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f29800ae140 0x7f29800ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.707+0000 7f29864ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298015e5b0 0x7f29800cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.707+0000 7f29864ed640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f298015e990 0x7f29801f7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.707+0000 7f29864ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29800b2a60 con 0x7f298015e5b0 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.707+0000 7f29864ed640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f29800b0490 con 0x7f298015e990 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.707+0000 7f29864ed640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f29800b2be0 con 0x7f29800ae140 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.707+0000 7f297f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298015e5b0 0x7f29800cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.707+0000 7f297f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298015e5b0 0x7f29800cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41772/0 (socket says 172.21.15.81:41772) 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.707+0000 7f297f7fe640 1 -- 172.21.15.81:0/1950169305 learned_addr learned my addr 172.21.15.81:0/1950169305 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f297ffff640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f29800ae140 0x7f29800ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f2984a8a640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f298015e990 0x7f29801f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f297f7fe640 1 -- 172.21.15.81:0/1950169305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f29800ae140 msgr2=0x7f29800ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f297f7fe640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f29800ae140 0x7f29800ca760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f297f7fe640 1 -- 172.21.15.81:0/1950169305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f298015e990 msgr2=0x7f29801f7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f297f7fe640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f298015e990 0x7f29801f7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f297f7fe640 1 -- 172.21.15.81:0/1950169305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29801f7cc0 con 0x7f298015e5b0 2024-09-16T01:16:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f297f7fe640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298015e5b0 0x7f29800cbe20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f297400d600 tx=0x7f297400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f297cff9640 1 -- 172.21.15.81:0/1950169305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974004240 con 0x7f298015e5b0 2024-09-16T01:16:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f297cff9640 1 -- 172.21.15.81:0/1950169305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29740043e0 con 0x7f298015e5b0 2024-09-16T01:16:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f297cff9640 1 -- 172.21.15.81:0/1950169305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974003830 con 0x7f298015e5b0 2024-09-16T01:16:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f29864ed640 1 -- 172.21.15.81:0/1950169305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29800cad80 con 0x7f298015e5b0 2024-09-16T01:16:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.708+0000 7f29864ed640 1 -- 172.21.15.81:0/1950169305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29800cb340 con 0x7f298015e5b0 2024-09-16T01:16:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.709+0000 7f29864ed640 1 -- 172.21.15.81:0/1950169305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2980070e60 con 0x7f298015e5b0 2024-09-16T01:16:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.710+0000 7f297cff9640 1 -- 172.21.15.81:0/1950169305 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f29740039d0 con 0x7f298015e5b0 2024-09-16T01:16:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.710+0000 7f297cff9640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f296c06c2b0 0x7f296c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.710+0000 7f297ffff640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f296c06c2b0 0x7f296c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.710+0000 7f297cff9640 1 -- 172.21.15.81:0/1950169305 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f297408b9f0 con 0x7f298015e5b0 2024-09-16T01:16:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.711+0000 7f297ffff640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f296c06c2b0 0x7f296c06e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2970034000 tx=0x7f297002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:05.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.715+0000 7f297cff9640 1 -- 172.21.15.81:0/1950169305 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2980070e60 con 0x7f298015e5b0 2024-09-16T01:16:05.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.914+0000 7f29864ed640 1 -- 172.21.15.81:0/1950169305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29800b5f40 con 0x7f298015e5b0 2024-09-16T01:16:05.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.914+0000 7f297cff9640 1 -- 172.21.15.81:0/1950169305 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f2974059eb0 con 0x7f298015e5b0 2024-09-16T01:16:05.915 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:05.916 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-16T01:15:58:778268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1441310273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1441310273},{"type":"v1","addr":"172.21.15.102:6834","nonce":1441310273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1086586307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1086586307},{"type":"v1","addr":"172.21.15.102:6835","nonce":1086586307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4105201682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4105201682},{"type":"v1","addr":"172.21.15.81:6835","nonce":4105201682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:15:39.037094+0000","modified":"2024-09-16T01:15:58.115389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2354333316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2354333316},{"type":"v1","addr":"172.21.15.81:6837","nonce":2354333316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-16T01:16:05.916 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-16T01:16:05.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.916+0000 7f29864ed640 1 -- 172.21.15.81:0/1950169305 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f296c06c2b0 msgr2=0x7f296c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.916+0000 7f29864ed640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f296c06c2b0 0x7f296c06e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2970034000 tx=0x7f297002e000 comp rx=0 tx=0).stop 2024-09-16T01:16:05.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.916+0000 7f29864ed640 1 -- 172.21.15.81:0/1950169305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298015e5b0 msgr2=0x7f29800cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:05.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.916+0000 7f29864ed640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298015e5b0 0x7f29800cbe20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f297400d600 tx=0x7f297400dac0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.917+0000 7f29864ed640 1 -- 172.21.15.81:0/1950169305 shutdown_connections 2024-09-16T01:16:05.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.917+0000 7f29864ed640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f296c06c2b0 0x7f296c06e770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.917+0000 7f29864ed640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f298015e990 0x7f29801f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.917+0000 7f29864ed640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f298015e5b0 0x7f29800cbe20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.917+0000 7f29864ed640 1 --2- 172.21.15.81:0/1950169305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f29800ae140 0x7f29800ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:05.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.917+0000 7f29864ed640 1 -- 172.21.15.81:0/1950169305 >> 172.21.15.81:0/1950169305 conn(0x7f2980073490 msgr2=0x7f2980070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:05.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.917+0000 7f29864ed640 1 -- 172.21.15.81:0/1950169305 shutdown_connections 2024-09-16T01:16:05.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:05.917+0000 7f29864ed640 1 -- 172.21.15.81:0/1950169305 wait complete. 2024-09-16T01:16:06.331 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:15:39.037094+0000', 'modified': '2024-09-16T01:15:58.115389+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2354333316', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 2354333316}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2354333316}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-09-16T01:16:06.331 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:16:06.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-16T01:16:06.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.431+0000 7f9a2ad8d640 1 Processor -- start 2024-09-16T01:16:06.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.431+0000 7f9a2ad8d640 1 -- start start 2024-09-16T01:16:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.432+0000 7f9a2ad8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a2415e5f0 0x7f9a240d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.432+0000 7f9a2ad8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a240d30f0 0x7f9a240b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.432+0000 7f9a2ad8d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a240d3690 con 0x7f9a240b64c0 2024-09-16T01:16:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.432+0000 7f9a2ad8d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9a2406d530 con 0x7f9a240d30f0 2024-09-16T01:16:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.432+0000 7f9a2ad8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a240d3970 con 0x7f9a2415e5f0 2024-09-16T01:16:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.432+0000 7f9a23fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a240d30f0 0x7f9a240b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.432+0000 7f9a23fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a240d30f0 0x7f9a240b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41776/0 (socket says 172.21.15.81:41776) 2024-09-16T01:16:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.432+0000 7f9a2932a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9a240b64c0 0x7f9a240cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42484/0 (socket says 172.21.15.81:42484) 2024-09-16T01:16:06.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.432+0000 7f9a23fff640 1 -- 172.21.15.81:0/765762471 learned_addr learned my addr 172.21.15.81:0/765762471 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.432+0000 7f9a28b29640 1 --2- 172.21.15.81:0/765762471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a2415e5f0 0x7f9a240d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.433+0000 7f9a23fff640 1 -- 172.21.15.81:0/765762471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a2415e5f0 msgr2=0x7f9a240d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.433+0000 7f9a23fff640 1 --2- 172.21.15.81:0/765762471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a2415e5f0 0x7f9a240d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.433+0000 7f9a23fff640 1 -- 172.21.15.81:0/765762471 >> v1:172.21.15.81:6789/0 conn(0x7f9a240b64c0 legacy=0x7f9a240cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.433+0000 7f9a23fff640 1 -- 172.21.15.81:0/765762471 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2406cee0 con 0x7f9a240d30f0 2024-09-16T01:16:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.433+0000 7f9a237fe640 1 -- 172.21.15.81:0/765762471 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241843972 0 0) 0x7f9a240d3690 con 0x7f9a240b64c0 2024-09-16T01:16:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.433+0000 7f9a23fff640 1 --2- 172.21.15.81:0/765762471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d30f0 0x7f9a240b5f80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009870 tx=0x7f9a1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139022de69824589 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.433+0000 7f9a237fe640 1 -- 172.21.15.81:0/765762471 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18037070 con 0x7f9a240d30f0 2024-09-16T01:16:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.433+0000 7f9a237fe640 1 -- 172.21.15.81:0/765762471 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a18032440 con 0x7f9a240d30f0 2024-09-16T01:16:06.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.433+0000 7f9a237fe640 1 -- 172.21.15.81:0/765762471 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18032810 con 0x7f9a240d30f0 2024-09-16T01:16:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.434+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/765762471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d30f0 msgr2=0x7f9a240b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.434+0000 7f9a2ad8d640 1 --2- 172.21.15.81:0/765762471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d30f0 0x7f9a240b5f80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009870 tx=0x7f9a1802a270 comp rx=0 tx=0).stop 2024-09-16T01:16:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.434+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/765762471 shutdown_connections 2024-09-16T01:16:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.434+0000 7f9a2ad8d640 1 --2- 172.21.15.81:0/765762471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d30f0 0x7f9a240b5f80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.434+0000 7f9a2ad8d640 1 --2- 172.21.15.81:0/765762471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a2415e5f0 0x7f9a240d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.434+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/765762471 >> 172.21.15.81:0/765762471 conn(0x7f9a2408bfc0 msgr2=0x7f9a240d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.434+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/765762471 shutdown_connections 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.434+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/765762471 wait complete. 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.435+0000 7f9a2ad8d640 1 Processor -- start 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.435+0000 7f9a2ad8d640 1 -- start start 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a2ad8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a240b64c0 0x7f9a24152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a2ad8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d30f0 0x7f9a241f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a2ad8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a2415e5f0 0x7f9a240ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a2ad8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a240d5310 con 0x7f9a240d30f0 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a2ad8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2415e9d0 con 0x7f9a2415e5f0 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a2ad8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a2406e9d0 con 0x7f9a240b64c0 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d30f0 0x7f9a241f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d30f0 0x7f9a241f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41780/0 (socket says 172.21.15.81:41780) 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a23fff640 1 -- 172.21.15.81:0/2130267112 learned_addr learned my addr 172.21.15.81:0/2130267112 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a28b29640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a240b64c0 0x7f9a24152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a2932a640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a2415e5f0 0x7f9a240ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a23fff640 1 -- 172.21.15.81:0/2130267112 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a240b64c0 msgr2=0x7f9a24152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a23fff640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a240b64c0 0x7f9a24152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a23fff640 1 -- 172.21.15.81:0/2130267112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a2415e5f0 msgr2=0x7f9a240ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a23fff640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a2415e5f0 0x7f9a240ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a23fff640 1 -- 172.21.15.81:0/2130267112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a240b81f0 con 0x7f9a240d30f0 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.436+0000 7f9a28b29640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a240b64c0 0x7f9a24152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.437+0000 7f9a23fff640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d30f0 0x7f9a241f4e20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009870 tx=0x7f9a180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.437+0000 7f9a217fa640 1 -- 172.21.15.81:0/2130267112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18041020 con 0x7f9a240d30f0 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.437+0000 7f9a217fa640 1 -- 172.21.15.81:0/2130267112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a18030640 con 0x7f9a240d30f0 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.437+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/2130267112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a240b84d0 con 0x7f9a240d30f0 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.437+0000 7f9a217fa640 1 -- 172.21.15.81:0/2130267112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18037040 con 0x7f9a240d30f0 2024-09-16T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.437+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/2130267112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a240b7550 con 0x7f9a240d30f0 2024-09-16T01:16:06.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.438+0000 7f9a217fa640 1 -- 172.21.15.81:0/2130267112 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a18044020 con 0x7f9a240d30f0 2024-09-16T01:16:06.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.439+0000 7f9a217fa640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a1006c2b0 0x7f9a1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.439+0000 7f9a28b29640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a1006c2b0 0x7f9a1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.439+0000 7f9a217fa640 1 -- 172.21.15.81:0/2130267112 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9a180abfb0 con 0x7f9a240d30f0 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.439+0000 7f9a28b29640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a1006c2b0 0x7f9a1006e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009a20 tx=0x7f9a14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.440+0000 7f9a2dc04740 1 Processor -- start 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.440+0000 7f9a2dc04740 1 -- start start 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.440+0000 7f9a2dc04740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 0x55b72ed28a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.440+0000 7f9a2dc04740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece0a80 0x55b72ece36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.440+0000 7f9a2dc04740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ece4a50 0x55b72ecdd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.440+0000 7f9a2dc04740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b72ec45520 con 0x55b72ece32c0 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.440+0000 7f9a2dc04740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b72ebed3e0 con 0x55b72ece0a80 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.440+0000 7f9a2dc04740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55b72ec414e0 con 0x55b72ece4a50 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.440+0000 7f9a28b29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 0x55b72ed28a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a28b29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 0x55b72ed28a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41794/0 (socket says 172.21.15.81:41794) 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a28b29640 1 -- 172.21.15.81:0/3452293412 learned_addr learned my addr 172.21.15.81:0/3452293412 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a23fff640 1 --2- 172.21.15.81:0/3452293412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece0a80 0x55b72ece36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a2932a640 1 --2- 172.21.15.81:0/3452293412 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ece4a50 0x55b72ecdd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a28b29640 1 -- 172.21.15.81:0/3452293412 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ece4a50 msgr2=0x55b72ecdd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a28b29640 1 --2- 172.21.15.81:0/3452293412 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ece4a50 0x55b72ecdd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a28b29640 1 -- 172.21.15.81:0/3452293412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece0a80 msgr2=0x55b72ece36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a28b29640 1 --2- 172.21.15.81:0/3452293412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece0a80 0x55b72ece36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a28b29640 1 -- 172.21.15.81:0/3452293412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b72ec082f0 con 0x55b72ece32c0 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a28b29640 1 --2- 172.21.15.81:0/3452293412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 0x55b72ed28a60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9a14004290 tx=0x7f9a14013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f4a06334ccbe80 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a0a7fc640 1 -- 172.21.15.81:0/3452293412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14027070 con 0x55b72ece32c0 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a0a7fc640 1 -- 172.21.15.81:0/3452293412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a140044c0 con 0x55b72ece32c0 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.441+0000 7f9a0a7fc640 1 -- 172.21.15.81:0/3452293412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400f040 con 0x55b72ece32c0 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.442+0000 7f9a2dc04740 1 -- 172.21.15.81:0/3452293412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 msgr2=0x55b72ed28a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:06.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.442+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/3452293412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 0x55b72ed28a60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9a14004290 tx=0x7f9a14013000 comp rx=0 tx=0).stop 2024-09-16T01:16:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.442+0000 7f9a2dc04740 1 -- 172.21.15.81:0/3452293412 shutdown_connections 2024-09-16T01:16:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.442+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/3452293412 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ece4a50 0x55b72ecdd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.442+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/3452293412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece0a80 0x55b72ece36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.442+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/3452293412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 0x55b72ed28a60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.442+0000 7f9a2dc04740 1 -- 172.21.15.81:0/3452293412 >> 172.21.15.81:0/3452293412 conn(0x55b72ecdfa80 msgr2=0x55b72ed27f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.442+0000 7f9a2dc04740 1 -- 172.21.15.81:0/3452293412 shutdown_connections 2024-09-16T01:16:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.442+0000 7f9a2dc04740 1 -- 172.21.15.81:0/3452293412 wait complete. 2024-09-16T01:16:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.442+0000 7f9a2dc04740 1 -- start start 2024-09-16T01:16:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.443+0000 7f9a2dc04740 1 Processor -- start 2024-09-16T01:16:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.443+0000 7f9a2dc04740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece32c0 0x55b72ed03c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.443+0000 7f9a2dc04740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 0x55b72ed03140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.443+0000 7f9a2dc04740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 0x55b72ecfe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.443+0000 7f9a2dc04740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b72ecdef20 con 0x55b72ece4a50 2024-09-16T01:16:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.443+0000 7f9a2dc04740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b72ebce450 con 0x55b72ece32c0 2024-09-16T01:16:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.443+0000 7f9a2dc04740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55b72ed29290 con 0x55b72ed020c0 2024-09-16T01:16:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.443+0000 7f9a2dc04740 10 client.0 _ll_register_callbacks cb 0x55b72e957ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:16:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.443+0000 7f9a23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 0x55b72ed03140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.443+0000 7f9a23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 0x55b72ed03140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41802/0 (socket says 172.21.15.81:41802) 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.443+0000 7f9a23fff640 1 -- 172.21.15.81:0/1758331101 learned_addr learned my addr 172.21.15.81:0/1758331101 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a28b29640 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece32c0 0x55b72ed03c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a2932a640 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 0x55b72ecfe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a23fff640 1 -- 172.21.15.81:0/1758331101 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 msgr2=0x55b72ecfe2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a23fff640 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 0x55b72ecfe2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a23fff640 1 -- 172.21.15.81:0/1758331101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece32c0 msgr2=0x55b72ed03c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a23fff640 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece32c0 0x55b72ed03c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a23fff640 1 -- 172.21.15.81:0/1758331101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72e9582d0 con 0x55b72ece4a50 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a23fff640 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 0x55b72ed03140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9a18079940 tx=0x7f9a18031e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33526d900421155 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a037fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a037fe640 1 -- 172.21.15.81:0/1758331101 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18090020 con 0x55b72ece4a50 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a037fe640 1 -- 172.21.15.81:0/1758331101 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9a18082590 con 0x55b72ece4a50 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1758331101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b72ec52c50 con 0x55b72ece4a50 2024-09-16T01:16:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a037fe640 1 -- 172.21.15.81:0/1758331101 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9a18082820 con 0x55b72ece4a50 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a2dc04740 10 client.4731 fetch_fsmap learned FSMap version 9 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1758331101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b72ea226b0 con 0x55b72ece4a50 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a037fe640 1 -- 172.21.15.81:0/1758331101 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55b72ec52c50 con 0x55b72ece4a50 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a037fe640 1 -- 172.21.15.81:0/1758331101 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f9a1803a030 con 0x55b72ece4a50 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a2dc04740 10 client.4731 fetch_fsmap finished waiting for FSMap version 9 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a2dc04740 10 client.4731 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a2dc04740 20 client.4731 populate_metadata read hostname 'smithi081' 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x55b72ed3bd90 0x55b72ecdc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a2dc04740 4 client.4731 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.444+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1758331101 --> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b72ec4cfa0 con 0x55b72ed3bd90 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.445+0000 7f9a28b29640 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x55b72ed3bd90 0x55b72ecdc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.445+0000 7f9a037fe640 10 client.4731 ms_handle_connect on v2:172.21.15.81:6836/2354333316 2024-09-16T01:16:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.445+0000 7f9a28b29640 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x55b72ed3bd90 0x55b72ecdc7d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=316addb178569fcc server_cookie=edbf895dbcaee41 in_seq=0 out_seq=0 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.445+0000 7f9a037fe640 1 -- 172.21.15.81:0/1758331101 <== mds.0 v2:172.21.15.81:6836/2354333316 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b72ec4cfa0 con 0x55b72ed3bd90 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.445+0000 7f9a037fe640 10 client.4731 handle_command_reply: tid=0 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.445+0000 7f9a2dc04740 1 client.4731 shutdown 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.446+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1758331101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 msgr2=0x55b72ed03140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.446+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 0x55b72ed03140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9a18079940 tx=0x7f9a18031e80 comp rx=0 tx=0).stop 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.446+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1758331101 shutdown_connections 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.446+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x55b72ed3bd90 0x55b72ecdc7d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.446+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 0x55b72ecfe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.446+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 0x55b72ed03140 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.446+0000 7f9a037fe640 0 client.4731 ms_handle_reset on v2:172.21.15.81:6836/2354333316 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.446+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/1758331101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece32c0 0x55b72ed03c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.446+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1758331101 >> 172.21.15.81:0/1758331101 conn(0x55b72ece0a80 msgr2=0x55b72ed25fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.446+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1758331101 shutdown_connections 2024-09-16T01:16:06.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.446+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1758331101 wait complete. 2024-09-16T01:16:06.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.446+0000 7f9a2dc04740 20 client.4731 trim_cache size 0 max 16384 2024-09-16T01:16:06.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.463+0000 7f9a2dc04740 1 Processor -- start 2024-09-16T01:16:06.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.463+0000 7f9a2dc04740 1 -- start start 2024-09-16T01:16:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a2dc04740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece32c0 0x55b72ed26620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a2dc04740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 0x55b72ed27e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a2dc04740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 0x55b72ed283a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a2dc04740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a24201050 con 0x55b72ece4a50 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a2dc04740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9a242004b0 con 0x55b72ece32c0 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a2dc04740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a24200a30 con 0x55b72ed020c0 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 0x55b72ed27e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a23fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 0x55b72ed27e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41818/0 (socket says 172.21.15.81:41818) 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a23fff640 1 -- 172.21.15.81:0/1153985095 learned_addr learned my addr 172.21.15.81:0/1153985095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a2932a640 1 --2- 172.21.15.81:0/1153985095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 0x55b72ed283a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a28b29640 1 --2- 172.21.15.81:0/1153985095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece32c0 0x55b72ed26620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a23fff640 1 -- 172.21.15.81:0/1153985095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 msgr2=0x55b72ed283a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a23fff640 1 --2- 172.21.15.81:0/1153985095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 0x55b72ed283a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a23fff640 1 -- 172.21.15.81:0/1153985095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece32c0 msgr2=0x55b72ed26620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a23fff640 1 --2- 172.21.15.81:0/1153985095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece32c0 0x55b72ed26620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a23fff640 1 -- 172.21.15.81:0/1153985095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b72ecdf810 con 0x55b72ece4a50 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a28b29640 1 --2- 172.21.15.81:0/1153985095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece32c0 0x55b72ed26620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.464+0000 7f9a23fff640 1 --2- 172.21.15.81:0/1153985095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 0x55b72ed27e60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a180790b0 tx=0x7f9a18048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39177d8406059204 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.465+0000 7f9a09ffb640 1 -- 172.21.15.81:0/1153985095 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a18090070 con 0x55b72ece4a50 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.465+0000 7f9a09ffb640 1 -- 172.21.15.81:0/1153985095 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a18080040 con 0x55b72ece4a50 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.465+0000 7f9a09ffb640 1 -- 172.21.15.81:0/1153985095 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a180795a0 con 0x55b72ece4a50 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.465+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1153985095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 msgr2=0x55b72ed27e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.465+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/1153985095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 0x55b72ed27e60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a180790b0 tx=0x7f9a18048000 comp rx=0 tx=0).stop 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.465+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1153985095 shutdown_connections 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.465+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/1153985095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 0x55b72ed283a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.465+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/1153985095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece4a50 0x55b72ed27e60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.465+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/1153985095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece32c0 0x55b72ed26620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.465+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1153985095 >> 172.21.15.81:0/1153985095 conn(0x55b72ece0a80 msgr2=0x55b72ece28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.465+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1153985095 shutdown_connections 2024-09-16T01:16:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.465+0000 7f9a2dc04740 1 -- 172.21.15.81:0/1153985095 wait complete. 2024-09-16T01:16:06.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.466+0000 7f9a2dc04740 1 -- start start 2024-09-16T01:16:06.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.466+0000 7f9a2dc04740 1 Processor -- start 2024-09-16T01:16:06.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a2dc04740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 0x55b72eda9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a2dc04740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece4a50 0x55b72ed00e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a2dc04740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 0x55b72ed01390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a2dc04740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b72ecfe860 con 0x55b72ece32c0 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a2dc04740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b72ed02c20 con 0x55b72ece4a50 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a2dc04740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55b72ece1890 con 0x55b72ed020c0 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a2dc04740 10 client.0 _ll_register_callbacks cb 0x7f9a18079b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a28b29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 0x55b72eda9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a28b29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 0x55b72eda9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41822/0 (socket says 172.21.15.81:41822) 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a28b29640 1 -- 172.21.15.81:0/26704341 learned_addr learned my addr 172.21.15.81:0/26704341 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a23fff640 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece4a50 0x55b72ed00e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a2932a640 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 0x55b72ed01390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a28b29640 1 -- 172.21.15.81:0/26704341 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 msgr2=0x55b72ed01390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a28b29640 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 0x55b72ed01390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a28b29640 1 -- 172.21.15.81:0/26704341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece4a50 msgr2=0x55b72ed00e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a28b29640 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece4a50 0x55b72ed00e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a28b29640 1 -- 172.21.15.81:0/26704341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72ed047a0 con 0x55b72ece32c0 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a23fff640 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece4a50 0x55b72ed00e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a28b29640 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 0x55b72eda9020 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9a14021000 tx=0x7f9a140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a6255e5127eac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a037fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a037fe640 1 -- 172.21.15.81:0/26704341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14027040 con 0x55b72ece32c0 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a037fe640 1 -- 172.21.15.81:0/26704341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9a14003d90 con 0x55b72ece32c0 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.467+0000 7f9a2dc04740 1 -- 172.21.15.81:0/26704341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a18080040 con 0x55b72ece32c0 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a037fe640 1 -- 172.21.15.81:0/26704341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9a1400f040 con 0x55b72ece32c0 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a2dc04740 10 client.4737 fetch_fsmap learned FSMap version 9 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a2dc04740 1 -- 172.21.15.81:0/26704341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b72ecfe090 con 0x55b72ece32c0 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a037fe640 1 -- 172.21.15.81:0/26704341 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a18080040 con 0x55b72ece32c0 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a037fe640 1 -- 172.21.15.81:0/26704341 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f9a1403e350 con 0x55b72ece32c0 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a2dc04740 10 client.4737 fetch_fsmap finished waiting for FSMap version 9 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a2dc04740 10 client.4737 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T01:16:06.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a2dc04740 20 client.4737 populate_metadata read hostname 'smithi081' 2024-09-16T01:16:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x55b72ed09610 0x55b72ed099f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a2dc04740 4 client.4737 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:16:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a2dc04740 1 -- 172.21.15.81:0/26704341 --> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] -- command(tid 0: {"prefix": "status"}) -- 0x55b72ebc9b80 con 0x55b72ed09610 2024-09-16T01:16:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a23fff640 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x55b72ed09610 0x55b72ed099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a037fe640 10 client.4737 ms_handle_connect on v2:172.21.15.81:6836/2354333316 2024-09-16T01:16:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a23fff640 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x55b72ed09610 0x55b72ed099f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72754c8b9c154079 server_cookie=124aa290fac38554 in_seq=0 out_seq=0 2024-09-16T01:16:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a037fe640 1 -- 172.21.15.81:0/26704341 <== mds.0 v2:172.21.15.81:6836/2354333316 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55b72ebc9b80 con 0x55b72ed09610 2024-09-16T01:16:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a037fe640 10 client.4737 handle_command_reply: tid=0 2024-09-16T01:16:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.468+0000 7f9a2dc04740 1 client.4737 shutdown 2024-09-16T01:16:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2dc04740 1 -- 172.21.15.81:0/26704341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 msgr2=0x55b72eda9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:06.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 0x55b72eda9020 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9a14021000 tx=0x7f9a140046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2dc04740 1 -- 172.21.15.81:0/26704341 shutdown_connections 2024-09-16T01:16:06.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.81:6836/2354333316,v1:172.21.15.81:6837/2354333316] conn(0x55b72ed09610 0x55b72ed099f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b72ed020c0 0x55b72ed01390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a037fe640 0 client.4737 ms_handle_reset on v2:172.21.15.81:6836/2354333316 2024-09-16T01:16:06.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b72ece4a50 0x55b72ed00e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2dc04740 1 --2- 172.21.15.81:0/26704341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b72ece32c0 0x55b72eda9020 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2dc04740 1 -- 172.21.15.81:0/26704341 >> 172.21.15.81:0/26704341 conn(0x55b72ece0a80 msgr2=0x55b72ed29a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:06.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2dc04740 1 -- 172.21.15.81:0/26704341 shutdown_connections 2024-09-16T01:16:06.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2dc04740 1 -- 172.21.15.81:0/26704341 wait complete. 2024-09-16T01:16:06.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2dc04740 20 client.4737 trim_cache size 0 max 16384 2024-09-16T01:16:06.477 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:16:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973", 2024-09-16T01:16:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-16T01:16:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4290, 2024-09-16T01:16:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-16T01:16:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-16T01:16:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-16T01:16:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 26.769234987000001, 2024-09-16T01:16:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 9, 2024-09-16T01:16:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 24, 2024-09-16T01:16:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 24, 2024-09-16T01:16:06.477 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 32.794204336 2024-09-16T01:16:06.478 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:16:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/2130267112 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a1006c2b0 msgr2=0x7f9a1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2ad8d640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a1006c2b0 0x7f9a1006e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009a20 tx=0x7f9a14008040 comp rx=0 tx=0).stop 2024-09-16T01:16:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/2130267112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d30f0 msgr2=0x7f9a241f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:06.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2ad8d640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d30f0 0x7f9a241f4e20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009870 tx=0x7f9a180046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/2130267112 shutdown_connections 2024-09-16T01:16:06.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2ad8d640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a1006c2b0 0x7f9a1006e770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2ad8d640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a2415e5f0 0x7f9a240ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2ad8d640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a240d30f0 0x7f9a241f4e20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2ad8d640 1 --2- 172.21.15.81:0/2130267112 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a240b64c0 0x7f9a24152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:06.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/2130267112 >> 172.21.15.81:0/2130267112 conn(0x7f9a2408bfc0 msgr2=0x7f9a240b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:06.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/2130267112 shutdown_connections 2024-09-16T01:16:06.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:06.469+0000 7f9a2ad8d640 1 -- 172.21.15.81:0/2130267112 wait complete. 2024-09-16T01:16:06.481 INFO:teuthology.run_tasks:Running task sequential... 2024-09-16T01:16:06.493 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-16T01:16:06.493 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-16T01:16:06.493 INFO:teuthology.task.print:Enabling mgr modules 2024-09-16T01:16:06.493 INFO:teuthology.run_tasks:Running task kclient... 2024-09-16T01:16:06.519 INFO:tasks.kclient:Mounting kernel clients... 2024-09-16T01:16:06.519 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-16T01:16:06.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:06.519 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:16:06.535 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-16T01:16:06.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:06.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-16T01:16:06.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:06.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-16T01:16:06.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:06.698 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:16:06.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:06.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-16T01:16:06.781 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-09-16T01:16:06.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:16:06.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:06.783 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:16:06.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:06.802 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-09-16T01:16:06.874 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2024-09-16T01:16:06.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:16:06.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:06.876 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:16:06.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:06.934 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-09-16T01:16:07.005 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2024-09-16T01:16:07.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:16:07.007 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-16T01:16:07.007 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:16:07.008 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:16:07.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:16:07.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.105+0000 7fe35df86640 1 Processor -- start 2024-09-16T01:16:07.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.105+0000 7fe35df86640 1 -- start start 2024-09-16T01:16:07.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.106+0000 7fe35df86640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe35815ba30 0x7fe35806f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.106+0000 7fe35df86640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe35806fd50 0x7fe358072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.106+0000 7fe35df86640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3580b3570 con 0x7fe358072e80 2024-09-16T01:16:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.106+0000 7fe35df86640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe3580732f0 con 0x7fe35815ba30 2024-09-16T01:16:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.106+0000 7fe35df86640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe3580b4180 con 0x7fe35806fd50 2024-09-16T01:16:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.106+0000 7fe3577fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe35815ba30 0x7fe35806f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.106+0000 7fe3577fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe35815ba30 0x7fe35806f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41836/0 (socket says 172.21.15.81:41836) 2024-09-16T01:16:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.106+0000 7fe3577fe640 1 -- 172.21.15.81:0/423320639 learned_addr learned my addr 172.21.15.81:0/423320639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.106+0000 7fe357fff640 1 --1- 172.21.15.81:0/423320639 >> v1:172.21.15.81:6789/0 conn(0x7fe358072e80 0x7fe35806e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42490/0 (socket says 172.21.15.81:42490) 2024-09-16T01:16:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.106+0000 7fe356ffd640 1 --2- 172.21.15.81:0/423320639 >> v2:172.21.15.102:3300/0 conn(0x7fe35806fd50 0x7fe358072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.107+0000 7fe3577fe640 1 -- 172.21.15.81:0/423320639 >> v2:172.21.15.102:3300/0 conn(0x7fe35806fd50 msgr2=0x7fe358072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.107+0000 7fe3577fe640 1 --2- 172.21.15.81:0/423320639 >> v2:172.21.15.102:3300/0 conn(0x7fe35806fd50 0x7fe358072940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:07.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.107+0000 7fe3577fe640 1 -- 172.21.15.81:0/423320639 >> v1:172.21.15.81:6789/0 conn(0x7fe358072e80 legacy=0x7fe35806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.107+0000 7fe3577fe640 1 -- 172.21.15.81:0/423320639 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3580b3850 con 0x7fe35815ba30 2024-09-16T01:16:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.107+0000 7fe3567fc640 1 -- 172.21.15.81:0/423320639 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940979389 0 0) 0x7fe3580b3570 con 0x7fe358072e80 2024-09-16T01:16:07.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.107+0000 7fe3577fe640 1 --2- 172.21.15.81:0/423320639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe35815ba30 0x7fe35806f810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe3580cfff0 tx=0x7fe34802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8131a337bf0b764 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:07.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.108+0000 7fe3567fc640 1 -- 172.21.15.81:0/423320639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348036070 con 0x7fe35815ba30 2024-09-16T01:16:07.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.108+0000 7fe3567fc640 1 -- 172.21.15.81:0/423320639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe348031600 con 0x7fe35815ba30 2024-09-16T01:16:07.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.108+0000 7fe3567fc640 1 -- 172.21.15.81:0/423320639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3480319d0 con 0x7fe35815ba30 2024-09-16T01:16:07.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.108+0000 7fe35df86640 1 -- 172.21.15.81:0/423320639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe35815ba30 msgr2=0x7fe35806f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:07.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.108+0000 7fe35df86640 1 --2- 172.21.15.81:0/423320639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe35815ba30 0x7fe35806f810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe3580cfff0 tx=0x7fe34802a730 comp rx=0 tx=0).stop 2024-09-16T01:16:07.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.108+0000 7fe35df86640 1 -- 172.21.15.81:0/423320639 shutdown_connections 2024-09-16T01:16:07.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.108+0000 7fe35df86640 1 --2- 172.21.15.81:0/423320639 >> v2:172.21.15.102:3300/0 conn(0x7fe35806fd50 0x7fe358072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:07.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.108+0000 7fe35df86640 1 --2- 172.21.15.81:0/423320639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe35815ba30 0x7fe35806f810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:07.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.108+0000 7fe35df86640 1 -- 172.21.15.81:0/423320639 >> 172.21.15.81:0/423320639 conn(0x7fe358067d70 msgr2=0x7fe35806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:07.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.108+0000 7fe35df86640 1 -- 172.21.15.81:0/423320639 shutdown_connections 2024-09-16T01:16:07.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.108+0000 7fe35df86640 1 -- 172.21.15.81:0/423320639 wait complete. 2024-09-16T01:16:07.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.109+0000 7fe35df86640 1 Processor -- start 2024-09-16T01:16:07.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.110+0000 7fe35df86640 1 -- start start 2024-09-16T01:16:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.110+0000 7fe35df86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe35806fd50 0x7fe35814e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.110+0000 7fe35df86640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe358072e80 0x7fe35815c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.110+0000 7fe35df86640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe35815ba30 0x7fe358157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.110+0000 7fe35df86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe3580ce810 con 0x7fe35806fd50 2024-09-16T01:16:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.110+0000 7fe35df86640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe3580b3e10 con 0x7fe358072e80 2024-09-16T01:16:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.110+0000 7fe35df86640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe3580b5890 con 0x7fe35815ba30 2024-09-16T01:16:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.110+0000 7fe3577fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe35806fd50 0x7fe35814e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.110+0000 7fe3577fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe35806fd50 0x7fe35814e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41838/0 (socket says 172.21.15.81:41838) 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.110+0000 7fe3577fe640 1 -- 172.21.15.81:0/525978539 learned_addr learned my addr 172.21.15.81:0/525978539 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe356ffd640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe358072e80 0x7fe35815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe357fff640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe35815ba30 0x7fe358157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe3577fe640 1 -- 172.21.15.81:0/525978539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe35815ba30 msgr2=0x7fe358157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe3577fe640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe35815ba30 0x7fe358157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe3577fe640 1 -- 172.21.15.81:0/525978539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe358072e80 msgr2=0x7fe35815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe3577fe640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe358072e80 0x7fe35815c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe3577fe640 1 -- 172.21.15.81:0/525978539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35814d4c0 con 0x7fe35806fd50 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe357fff640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe35815ba30 0x7fe358157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe356ffd640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe358072e80 0x7fe35815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe3577fe640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe35806fd50 0x7fe35814e3e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe348034040 tx=0x7fe348004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe33ffff640 1 -- 172.21.15.81:0/525978539 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348036050 con 0x7fe35806fd50 2024-09-16T01:16:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe33ffff640 1 -- 172.21.15.81:0/525978539 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe348042070 con 0x7fe35806fd50 2024-09-16T01:16:07.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe35df86640 1 -- 172.21.15.81:0/525978539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe35814e920 con 0x7fe35806fd50 2024-09-16T01:16:07.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe33ffff640 1 -- 172.21.15.81:0/525978539 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348009510 con 0x7fe35806fd50 2024-09-16T01:16:07.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.111+0000 7fe35df86640 1 -- 172.21.15.81:0/525978539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe35815bfb0 con 0x7fe35806fd50 2024-09-16T01:16:07.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.112+0000 7fe35df86640 1 -- 172.21.15.81:0/525978539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe35814d9a0 con 0x7fe35806fd50 2024-09-16T01:16:07.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.112+0000 7fe33ffff640 1 -- 172.21.15.81:0/525978539 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe348007c50 con 0x7fe35806fd50 2024-09-16T01:16:07.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.113+0000 7fe33ffff640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe34406c2b0 0x7fe34406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:07.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.113+0000 7fe33ffff640 1 -- 172.21.15.81:0/525978539 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe3480ac5a0 con 0x7fe35806fd50 2024-09-16T01:16:07.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.113+0000 7fe356ffd640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe34406c2b0 0x7fe34406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:07.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.113+0000 7fe356ffd640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe34406c2b0 0x7fe34406e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe3580729a0 tx=0x7fe34c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:07.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.117+0000 7fe33ffff640 1 -- 172.21.15.81:0/525978539 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe35814d9a0 con 0x7fe35806fd50 2024-09-16T01:16:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.317+0000 7fe35df86640 1 -- 172.21.15.81:0/525978539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe3580ccc30 con 0x7fe35806fd50 2024-09-16T01:16:07.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.318+0000 7fe33ffff640 1 -- 172.21.15.81:0/525978539 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fe348045360 con 0x7fe35806fd50 2024-09-16T01:16:07.318 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-16T01:16:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.319+0000 7fe35df86640 1 -- 172.21.15.81:0/525978539 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe34406c2b0 msgr2=0x7fe34406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.319+0000 7fe35df86640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe34406c2b0 0x7fe34406e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe3580729a0 tx=0x7fe34c008040 comp rx=0 tx=0).stop 2024-09-16T01:16:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.319+0000 7fe35df86640 1 -- 172.21.15.81:0/525978539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe35806fd50 msgr2=0x7fe35814e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.319+0000 7fe35df86640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe35806fd50 0x7fe35814e3e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe348034040 tx=0x7fe348004a40 comp rx=0 tx=0).stop 2024-09-16T01:16:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.320+0000 7fe35df86640 1 -- 172.21.15.81:0/525978539 shutdown_connections 2024-09-16T01:16:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.320+0000 7fe35df86640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe34406c2b0 0x7fe34406e770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.320+0000 7fe35df86640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe35815ba30 0x7fe358157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.320+0000 7fe35df86640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe358072e80 0x7fe35815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.320+0000 7fe35df86640 1 --2- 172.21.15.81:0/525978539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe35806fd50 0x7fe35814e3e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.320+0000 7fe35df86640 1 -- 172.21.15.81:0/525978539 >> 172.21.15.81:0/525978539 conn(0x7fe358067d70 msgr2=0x7fe3581595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.320+0000 7fe35df86640 1 -- 172.21.15.81:0/525978539 shutdown_connections 2024-09-16T01:16:07.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07.320+0000 7fe35df86640 1 -- 172.21.15.81:0/525978539 wait complete. 2024-09-16T01:16:07.331 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T01:16:07.331 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:16:07.331 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:16:07.331 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:16:07.331 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:16:07.331 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T01:16:07.331 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:16:07.331 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:16:07.331 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:16:07.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:07.332 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:16:07.347 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:16:07.347 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:16:07.347 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:16:07.347 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:07.348 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:16:07.348 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:07.348 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:07.348 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:07.348 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:16:07.348 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:07.348 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:07.348 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:16:07.348 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:07.348 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:07.348 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:16:07.348 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:07.349 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:16:07.349 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42771sec preferred_lft 42771sec 2024-09-16T01:16:07.349 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:16:07.349 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:07.349 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T01:16:07.349 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:07.349 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:16:07.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-16T01:16:07.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-16T01:16:07.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-16T01:16:07.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T01:16:07.350 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:16:07.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:07.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:07.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:07.485 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:16:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:16:07.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:07.509 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:16:07.566 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:16:07.566 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:16:07.567 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:16:07.567 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:16:07.567 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:16:07.567 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:07.567 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:16:07.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:16:07.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:16:07.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:16:07.568 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:16:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:07.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:07.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:07.693 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:16:07.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:07.709 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-16T01:16:07.764 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:07.764 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:16:07.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:16:07.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-16T01:16:07.765 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:16:07.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:07.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:07.880 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-16T01:16:07.881 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:07.881 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:16:07.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-16T01:16:07.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T01:16:07.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-16T01:16:07.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-16T01:16:07.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-16T01:16:07.881 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:16:07.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:07.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:16:07.944 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:16:07.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:07.996 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:07.996 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:16:07.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-16T01:16:07.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T01:16:07.996 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:16:08.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:08.074 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:16:08.074 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:16:08.130 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:16:08.130 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:16:08.130 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:16:08.185 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:16:08.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:08.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:16:08.268 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:16:08.269 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:16:08.269 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:16:08.405 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:16:08.405 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:16:08.405 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:16:08.405 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:16:08.405 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:16:08.415 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:16:08.415 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:16:08.415 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:16:08.415 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:16:08.415 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:16:08.415 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:16:08.415 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:16:08.415 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:16:08.416 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:16:08.416 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:16:08.416 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:16:08.416 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:16:08.416 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:16:08.417 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:16:08.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:08.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:16:08.483 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:08.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:08.579 INFO:teuthology.orchestra.run.smithi081.stdout:client4520 2024-09-16T01:16:08.579 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:08.579 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:08.595 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:08.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:08.690 INFO:teuthology.orchestra.run.smithi081.stdout:client4520 2024-09-16T01:16:08.690 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:08.746 INFO:teuthology.orchestra.run.smithi081.stdout:client4520 2024-09-16T01:16:08.746 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973.client4520/status') 2024-09-16T01:16:08.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:08.804 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.4520 (3)172.21.15.81:0/2232371606 2024-09-16T01:16:08.804 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-09-16T01:16:08.804 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-09-16T01:16:08.804 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-09-16T01:16:08.804 INFO:teuthology.orchestra.run.smithi081.stderr:70 bytes copied, 2.1452e-05 s, 3.3 MB/s 2024-09-16T01:16:08.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:08.811 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-16T01:16:08.811 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:16:08.812 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-16T01:16:08.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:16:08.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.909+0000 7fcef25e4640 1 Processor -- start 2024-09-16T01:16:08.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.909+0000 7fcef25e4640 1 -- start start 2024-09-16T01:16:08.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.909+0000 7fcef25e4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fceec15b300 0x7fceec0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:08.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.909+0000 7fcef25e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceec0cd3f0 0x7fceec06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:08.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.909+0000 7fcef25e4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fceec0cdbe0 con 0x7fceec072d30 2024-09-16T01:16:08.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.909+0000 7fcef25e4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fceec0728a0 con 0x7fceec15b300 2024-09-16T01:16:08.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.909+0000 7fcef25e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fceec0cd900 con 0x7fceec0cd3f0 2024-09-16T01:16:08.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fcef0b81640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fceec072d30 0x7fceec0b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42498/0 (socket says 172.21.15.81:42498) 2024-09-16T01:16:08.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fcef0b81640 1 -- 172.21.15.81:0/2817838331 learned_addr learned my addr 172.21.15.81:0/2817838331 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:08.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceebfff640 1 --2- 172.21.15.81:0/2817838331 >> v2:172.21.15.102:3300/0 conn(0x7fceec15b300 0x7fceec0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:08.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeb7fe640 1 --2- 172.21.15.81:0/2817838331 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceec0cd3f0 0x7fceec06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:08.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3751081835 0 0) 0x7fceec0cdbe0 con 0x7fceec072d30 2024-09-16T01:16:08.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fced8003520 con 0x7fceec072d30 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2133145809 0 0) 0x7fced8003520 con 0x7fceec072d30 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceec0cd3f0 msgr2=0x7fceec06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 --2- 172.21.15.81:0/2817838331 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceec0cd3f0 0x7fceec06f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 >> v2:172.21.15.102:3300/0 conn(0x7fceec15b300 msgr2=0x7fceec0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 --2- 172.21.15.81:0/2817838331 >> v2:172.21.15.102:3300/0 conn(0x7fceec15b300 0x7fceec0cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec072250 con 0x7fceec072d30 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fcee40019f0 con 0x7fceec072d30 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceebfff640 1 --2- 172.21.15.81:0/2817838331 >> v2:172.21.15.102:3300/0 conn(0x7fceec15b300 0x7fceec0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 >> v1:172.21.15.81:6789/0 conn(0x7fceec072d30 legacy=0x7fceec0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 --2- 172.21.15.81:0/2817838331 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fced80039b0 0x7fced8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 --2- 172.21.15.81:0/2817838331 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceec0cd3f0 0x7fced8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 --2- 172.21.15.81:0/2817838331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced8004d40 0x7fced80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fceec0728a0 con 0x7fced8004d40 2024-09-16T01:16:08.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fceec0cd900 con 0x7fced80039b0 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fced800b9c0 con 0x7fceec0cd3f0 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fcef0b81640 1 --2- 172.21.15.81:0/2817838331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced8004d40 0x7fced80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceebfff640 1 --2- 172.21.15.81:0/2817838331 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fced80039b0 0x7fced8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.910+0000 7fceeb7fe640 1 --2- 172.21.15.81:0/2817838331 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceec0cd3f0 0x7fced8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.911+0000 7fcef0b81640 1 -- 172.21.15.81:0/2817838331 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceec0cd3f0 msgr2=0x7fced8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.911+0000 7fcef0b81640 1 --2- 172.21.15.81:0/2817838331 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fceec0cd3f0 0x7fced8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.911+0000 7fcef0b81640 1 -- 172.21.15.81:0/2817838331 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fced80039b0 msgr2=0x7fced8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.911+0000 7fcef0b81640 1 --2- 172.21.15.81:0/2817838331 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fced80039b0 0x7fced8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.911+0000 7fcef0b81640 1 -- 172.21.15.81:0/2817838331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced8003520 con 0x7fced8004d40 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.911+0000 7fcef0b81640 1 --2- 172.21.15.81:0/2817838331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced8004d40 0x7fced80051c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcee400a890 tx=0x7fced8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121a85aa4e113702 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.912+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee400a4e0 con 0x7fced8004d40 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.912+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee402f070 con 0x7fced8004d40 2024-09-16T01:16:08.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.912+0000 7fceeaffd640 1 -- 172.21.15.81:0/2817838331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee402bcf0 con 0x7fced8004d40 2024-09-16T01:16:08.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.912+0000 7fcef25e4640 1 -- 172.21.15.81:0/2817838331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced8004d40 msgr2=0x7fced80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:08.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.912+0000 7fcef25e4640 1 --2- 172.21.15.81:0/2817838331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced8004d40 0x7fced80051c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcee400a890 tx=0x7fced8005830 comp rx=0 tx=0).stop 2024-09-16T01:16:08.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.912+0000 7fcef0b81640 1 -- 172.21.15.81:0/2817838331 reap_dead start 2024-09-16T01:16:08.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.912+0000 7fcef25e4640 1 -- 172.21.15.81:0/2817838331 shutdown_connections 2024-09-16T01:16:08.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.912+0000 7fcef25e4640 1 -- 172.21.15.81:0/2817838331 >> 172.21.15.81:0/2817838331 conn(0x7fceec067d70 msgr2=0x7fceec06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:08.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.912+0000 7fcef25e4640 1 -- 172.21.15.81:0/2817838331 shutdown_connections 2024-09-16T01:16:08.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.912+0000 7fcef25e4640 1 -- 172.21.15.81:0/2817838331 wait complete. 2024-09-16T01:16:08.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.913+0000 7fcef25e4640 1 Processor -- start 2024-09-16T01:16:08.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.914+0000 7fcef25e4640 1 -- start start 2024-09-16T01:16:08.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.914+0000 7fcef25e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fced8004d40 0x7fceec156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:08.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.914+0000 7fcef25e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fceec142c30 0x7fceec154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:08.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.914+0000 7fcef25e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec154550 0x7fceec155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:08.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.914+0000 7fcef25e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fceec0d0160 con 0x7fceec154550 2024-09-16T01:16:08.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.914+0000 7fcef25e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fceec0cffe0 con 0x7fceec142c30 2024-09-16T01:16:08.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.914+0000 7fcef25e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fceec0b4350 con 0x7fced8004d40 2024-09-16T01:16:08.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.914+0000 7fcef0b81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec154550 0x7fceec155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:08.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.914+0000 7fcef0b81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec154550 0x7fceec155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41864/0 (socket says 172.21.15.81:41864) 2024-09-16T01:16:08.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.914+0000 7fcef0b81640 1 -- 172.21.15.81:0/881102183 learned_addr learned my addr 172.21.15.81:0/881102183 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:08.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.914+0000 7fceebfff640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fced8004d40 0x7fceec156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.914+0000 7fceeb7fe640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fceec142c30 0x7fceec154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.915+0000 7fcef0b81640 1 -- 172.21.15.81:0/881102183 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fced8004d40 msgr2=0x7fceec156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.915+0000 7fcef0b81640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fced8004d40 0x7fceec156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.915+0000 7fcef0b81640 1 -- 172.21.15.81:0/881102183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fceec142c30 msgr2=0x7fceec154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.915+0000 7fcef0b81640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fceec142c30 0x7fceec154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.915+0000 7fcef0b81640 1 -- 172.21.15.81:0/881102183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceec155e50 con 0x7fceec154550 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.915+0000 7fcef0b81640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec154550 0x7fceec155120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcee400a890 tx=0x7fcee4001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.915+0000 7fcee8ff9640 1 -- 172.21.15.81:0/881102183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4002040 con 0x7fceec154550 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.915+0000 7fcee8ff9640 1 -- 172.21.15.81:0/881102183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee400a4c0 con 0x7fceec154550 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.915+0000 7fcef25e4640 1 -- 172.21.15.81:0/881102183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceec156130 con 0x7fceec154550 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.915+0000 7fcee8ff9640 1 -- 172.21.15.81:0/881102183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4034690 con 0x7fceec154550 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.915+0000 7fcef25e4640 1 -- 172.21.15.81:0/881102183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceec1566f0 con 0x7fceec154550 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.916+0000 7fcef25e4640 1 -- 172.21.15.81:0/881102183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fceec0b47b0 con 0x7fceec154550 2024-09-16T01:16:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.916+0000 7fcee8ff9640 1 -- 172.21.15.81:0/881102183 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcee4034830 con 0x7fceec154550 2024-09-16T01:16:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.917+0000 7fcee8ff9640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcecc06c2b0 0x7fcecc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.917+0000 7fceebfff640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcecc06c2b0 0x7fcecc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.917+0000 7fcee8ff9640 1 -- 172.21.15.81:0/881102183 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcee40ab6c0 con 0x7fceec154550 2024-09-16T01:16:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.917+0000 7fceebfff640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcecc06c2b0 0x7fcecc06e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0093d0 tx=0x7fcedc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:08.921+0000 7fcee8ff9640 1 -- 172.21.15.81:0/881102183 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcee4079af0 con 0x7fceec154550 2024-09-16T01:16:09.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.124+0000 7fcef25e4640 1 -- 172.21.15.81:0/881102183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fceec15da00 con 0x7fceec154550 2024-09-16T01:16:09.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.124+0000 7fcee8ff9640 1 -- 172.21.15.81:0/881102183 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fcee40793f0 con 0x7fceec154550 2024-09-16T01:16:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-16T01:16:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.126+0000 7fcef25e4640 1 -- 172.21.15.81:0/881102183 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcecc06c2b0 msgr2=0x7fcecc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.126+0000 7fcef25e4640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcecc06c2b0 0x7fcecc06e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0093d0 tx=0x7fcedc009190 comp rx=0 tx=0).stop 2024-09-16T01:16:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.126+0000 7fcef25e4640 1 -- 172.21.15.81:0/881102183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec154550 msgr2=0x7fceec155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.126+0000 7fcef25e4640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec154550 0x7fceec155120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcee400a890 tx=0x7fcee4001dc0 comp rx=0 tx=0).stop 2024-09-16T01:16:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.126+0000 7fcef25e4640 1 -- 172.21.15.81:0/881102183 shutdown_connections 2024-09-16T01:16:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.126+0000 7fcef25e4640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcecc06c2b0 0x7fcecc06e770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.126+0000 7fcef25e4640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fceec154550 0x7fceec155120 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.126+0000 7fcef25e4640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fceec142c30 0x7fceec154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.126+0000 7fcef25e4640 1 --2- 172.21.15.81:0/881102183 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fced8004d40 0x7fceec156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.126+0000 7fcef25e4640 1 -- 172.21.15.81:0/881102183 >> 172.21.15.81:0/881102183 conn(0x7fceec067d70 msgr2=0x7fceec15c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.126+0000 7fcef25e4640 1 -- 172.21.15.81:0/881102183 shutdown_connections 2024-09-16T01:16:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09.126+0000 7fcef25e4640 1 -- 172.21.15.81:0/881102183 wait complete. 2024-09-16T01:16:09.138 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T01:16:09.138 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:16:09.138 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:16:09.138 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-16T01:16:09.138 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-16T01:16:09.138 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T01:16:09.138 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:16:09.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:16:09.139 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-16T01:16:09.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:09.139 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:16:09.154 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:16:09.155 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:16:09.155 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:16:09.155 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.155 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:16:09.155 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.155 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:09.155 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:09.155 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:16:09.155 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:09.156 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:09.156 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:16:09.156 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:09.156 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:09.156 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:16:09.156 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:09.156 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:16:09.156 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42769sec preferred_lft 42769sec 2024-09-16T01:16:09.156 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:16:09.156 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.156 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:16:09.157 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 86:bb:d8:38:80:af brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:09.157 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:16:09.157 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.157 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::bc22:19ff:fe0c:8fb1/64 scope link tentative 2024-09-16T01:16:09.157 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.157 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:16:09.157 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 86:bb:d8:38:80:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:16:09.157 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::84bb:d8ff:fe38:80af/64 scope link tentative 2024-09-16T01:16:09.157 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:09.158 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:16:09.217 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:16:09.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:09.219 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:16:09.277 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:16:09.277 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:16:09.277 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:16:09.277 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:16:09.277 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:16:09.277 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:09.278 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:16:09.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:16:09.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:16:09.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:16:09.278 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:16:09.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:09.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:09.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:09.403 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:16:09.418 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:16:09.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:09.419 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-16T01:16:09.474 INFO:teuthology.orchestra.run.smithi081.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-16T01:16:09.474 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:09.474 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:16:09.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:16:09.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-16T01:16:09.475 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:16:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:09.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:09.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-16T01:16:09.615 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:16:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:16:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:16:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:16:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.615 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:16:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 4a:74:c7:44:b5:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T01:16:09.615 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T01:16:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4874:c7ff:fe44:b5b7/64 scope link 2024-09-16T01:16:09.616 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:09.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-16T01:16:09.681 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:16:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:16:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:16:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:16:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.681 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:16:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 4a:74:c7:44:b5:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T01:16:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T01:16:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.681 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4874:c7ff:fe44:b5b7/64 scope link 2024-09-16T01:16:09.682 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:09.683 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-16T01:16:09.683 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:09.683 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:16:09.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-16T01:16:09.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-16T01:16:09.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-16T01:16:09.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-16T01:16:09.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-16T01:16:09.683 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:16:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:09.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:09.833 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:09.833 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:16:09.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.1 up 2024-09-16T01:16:09.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.1 master ceph-brx 2024-09-16T01:16:09.833 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:16:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:09.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:09.909 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:16:09.909 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-16T01:16:09.924 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-16T01:16:09.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:16:09.925 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-16T01:16:09.979 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:16:09.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:09.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T01:16:10.063 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T01:16:10.063 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-16T01:16:10.063 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:16:10.072 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T01:16:10.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-16T01:16:10.072 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:16:10.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:16:10.072 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:16:10.081 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-16T01:16:10.081 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-16T01:16:10.081 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:16:10.081 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:16:10.081 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:16:10.081 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:16:10.081 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:16:10.081 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:16:10.082 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-16T01:16:10.082 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:16:10.082 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:16:10.082 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:16:10.082 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:16:10.083 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:16:10.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:10.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-16T01:16:10.148 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:10.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:10.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:10.244 INFO:teuthology.orchestra.run.smithi081.stdout:client4609 2024-09-16T01:16:10.244 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:10.244 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:10.260 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:10.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:10.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:10.356 INFO:teuthology.orchestra.run.smithi081.stdout:client4609 2024-09-16T01:16:10.357 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:10.412 INFO:teuthology.orchestra.run.smithi081.stdout:client4609 2024-09-16T01:16:10.412 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973.client4609/status') 2024-09-16T01:16:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:10.470 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.4609 (3)172.21.15.81:0/122680079 2024-09-16T01:16:10.470 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-09-16T01:16:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-09-16T01:16:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-09-16T01:16:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:69 bytes copied, 3.8029e-05 s, 1.8 MB/s 2024-09-16T01:16:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:10.477 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-16T01:16:10.477 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:16:10.477 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:16:10.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:16:10.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.575+0000 7fc1a8d03640 1 Processor -- start 2024-09-16T01:16:10.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.575+0000 7fc1a8d03640 1 -- start start 2024-09-16T01:16:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.575+0000 7fc1a8d03640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1a4161c80 0x7fc1a406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.575+0000 7fc1a8d03640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a406e870 con 0x7fc1a40b6680 2024-09-16T01:16:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.575+0000 7fc1a8d03640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a406d9f0 con 0x7fc1a4162060 2024-09-16T01:16:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.575+0000 7fc1a8d03640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc1a406dcd0 con 0x7fc1a4161c80 2024-09-16T01:16:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.576+0000 7fc1a259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1a4161c80 0x7fc1a406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.576+0000 7fc1a2d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc1a40b6680 0x7fc1a40cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42508/0 (socket says 172.21.15.81:42508) 2024-09-16T01:16:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.576+0000 7fc1a2d9d640 1 -- 172.21.15.81:0/4050721120 learned_addr learned my addr 172.21.15.81:0/4050721120 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.576+0000 7fc1a259c640 1 -- 172.21.15.81:0/4050721120 >> v1:172.21.15.102:6789/0 conn(0x7fc1a4162060 legacy=0x7fc1a40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.576+0000 7fc1a259c640 1 -- 172.21.15.81:0/4050721120 >> v1:172.21.15.81:6789/0 conn(0x7fc1a40b6680 legacy=0x7fc1a40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.576+0000 7fc1a259c640 1 -- 172.21.15.81:0/4050721120 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a406dfb0 con 0x7fc1a4161c80 2024-09-16T01:16:10.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.576+0000 7fc1a1d9b640 1 -- 172.21.15.81:0/4050721120 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842504225 0 0) 0x7fc19c001490 con 0x7fc1a40b6680 2024-09-16T01:16:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.577+0000 7fc1a259c640 1 --2- 172.21.15.81:0/4050721120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4161c80 0x7fc1a406e330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc1940097a0 tx=0x7fc19402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fe9a3cac86dd7c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.577+0000 7fc1a1d9b640 1 -- 172.21.15.81:0/4050721120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194037070 con 0x7fc1a4161c80 2024-09-16T01:16:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.577+0000 7fc1a1d9b640 1 -- 172.21.15.81:0/4050721120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc194032440 con 0x7fc1a4161c80 2024-09-16T01:16:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.577+0000 7fc1a1d9b640 1 -- 172.21.15.81:0/4050721120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc194032810 con 0x7fc1a4161c80 2024-09-16T01:16:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.577+0000 7fc1a8d03640 1 -- 172.21.15.81:0/4050721120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4161c80 msgr2=0x7fc1a406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.577+0000 7fc1a8d03640 1 --2- 172.21.15.81:0/4050721120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4161c80 0x7fc1a406e330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc1940097a0 tx=0x7fc19402a1e0 comp rx=0 tx=0).stop 2024-09-16T01:16:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.577+0000 7fc1a8d03640 1 -- 172.21.15.81:0/4050721120 shutdown_connections 2024-09-16T01:16:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.577+0000 7fc1a8d03640 1 --2- 172.21.15.81:0/4050721120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4161c80 0x7fc1a406e330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.577+0000 7fc1a8d03640 1 -- 172.21.15.81:0/4050721120 >> 172.21.15.81:0/4050721120 conn(0x7fc1a40d44f0 msgr2=0x7fc1a40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.577+0000 7fc1a8d03640 1 -- 172.21.15.81:0/4050721120 shutdown_connections 2024-09-16T01:16:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.577+0000 7fc1a8d03640 1 -- 172.21.15.81:0/4050721120 wait complete. 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.579+0000 7fc1a8d03640 1 Processor -- start 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.579+0000 7fc1a8d03640 1 -- start start 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.579+0000 7fc1a8d03640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1a40b6680 0x7fc1a40b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.579+0000 7fc1a8d03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4161c80 0x7fc1a4155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.579+0000 7fc1a8d03640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1a4162060 0x7fc1a4160000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.579+0000 7fc1a8d03640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a40b6b30 con 0x7fc1a4161c80 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.579+0000 7fc1a8d03640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a40d2aa0 con 0x7fc1a4162060 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.579+0000 7fc1a8d03640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a40b6cb0 con 0x7fc1a40b6680 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.579+0000 7fc19bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4161c80 0x7fc1a4155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.579+0000 7fc19bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4161c80 0x7fc1a4155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41892/0 (socket says 172.21.15.81:41892) 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.579+0000 7fc19bfff640 1 -- 172.21.15.81:0/2002661626 learned_addr learned my addr 172.21.15.81:0/2002661626 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc1a2d9d640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1a4162060 0x7fc1a4160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc19bfff640 1 -- 172.21.15.81:0/2002661626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1a40b6680 msgr2=0x7fc1a40b85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc1a259c640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1a40b6680 0x7fc1a40b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc19bfff640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1a40b6680 0x7fc1a40b85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc19bfff640 1 -- 172.21.15.81:0/2002661626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1a4162060 msgr2=0x7fc1a4160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc19bfff640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1a4162060 0x7fc1a4160000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc19bfff640 1 -- 172.21.15.81:0/2002661626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a4155e70 con 0x7fc1a4161c80 2024-09-16T01:16:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc19bfff640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4161c80 0x7fc1a4155930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00c400 tx=0x7fc18c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc19affd640 1 -- 172.21.15.81:0/2002661626 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c011790 con 0x7fc1a4161c80 2024-09-16T01:16:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc19affd640 1 -- 172.21.15.81:0/2002661626 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18c017070 con 0x7fc1a4161c80 2024-09-16T01:16:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc19affd640 1 -- 172.21.15.81:0/2002661626 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c011bb0 con 0x7fc1a4161c80 2024-09-16T01:16:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc1a8d03640 1 -- 172.21.15.81:0/2002661626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a40b7520 con 0x7fc1a4161c80 2024-09-16T01:16:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.580+0000 7fc1a8d03640 1 -- 172.21.15.81:0/2002661626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a40b7ae0 con 0x7fc1a4161c80 2024-09-16T01:16:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.581+0000 7fc1a8d03640 1 -- 172.21.15.81:0/2002661626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a40ceb20 con 0x7fc1a4161c80 2024-09-16T01:16:10.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.582+0000 7fc19affd640 1 -- 172.21.15.81:0/2002661626 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc18c01c460 con 0x7fc1a4161c80 2024-09-16T01:16:10.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.582+0000 7fc19affd640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc18406c2b0 0x7fc18406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:10.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.582+0000 7fc19affd640 1 -- 172.21.15.81:0/2002661626 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc18c08b5d0 con 0x7fc1a4161c80 2024-09-16T01:16:10.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.582+0000 7fc1a259c640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc18406c2b0 0x7fc18406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.583+0000 7fc1a259c640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc18406c2b0 0x7fc18406e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc194034000 tx=0x7fc19402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:10.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.586+0000 7fc19affd640 1 -- 172.21.15.81:0/2002661626 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1a40ceb20 con 0x7fc1a4161c80 2024-09-16T01:16:10.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.788+0000 7fc1a8d03640 1 -- 172.21.15.81:0/2002661626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc1a40d4290 con 0x7fc1a4161c80 2024-09-16T01:16:10.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.788+0000 7fc19affd640 1 -- 172.21.15.81:0/2002661626 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fc18c059a00 con 0x7fc1a4161c80 2024-09-16T01:16:10.789 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-16T01:16:10.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.790+0000 7fc1a8d03640 1 -- 172.21.15.81:0/2002661626 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc18406c2b0 msgr2=0x7fc18406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:10.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.790+0000 7fc1a8d03640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc18406c2b0 0x7fc18406e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc194034000 tx=0x7fc19402e000 comp rx=0 tx=0).stop 2024-09-16T01:16:10.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.790+0000 7fc1a8d03640 1 -- 172.21.15.81:0/2002661626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4161c80 msgr2=0x7fc1a4155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:10.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.790+0000 7fc1a8d03640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4161c80 0x7fc1a4155930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00c400 tx=0x7fc18c00c8c0 comp rx=0 tx=0).stop 2024-09-16T01:16:10.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.790+0000 7fc1a8d03640 1 -- 172.21.15.81:0/2002661626 shutdown_connections 2024-09-16T01:16:10.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.790+0000 7fc1a8d03640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc18406c2b0 0x7fc18406e770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:10.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.790+0000 7fc1a8d03640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1a4162060 0x7fc1a4160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:10.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.790+0000 7fc1a8d03640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4161c80 0x7fc1a4155930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:10.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.790+0000 7fc1a8d03640 1 --2- 172.21.15.81:0/2002661626 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1a40b6680 0x7fc1a40b85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:10.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.790+0000 7fc1a8d03640 1 -- 172.21.15.81:0/2002661626 >> 172.21.15.81:0/2002661626 conn(0x7fc1a40d44f0 msgr2=0x7fc1a40b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:10.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.790+0000 7fc1a8d03640 1 -- 172.21.15.81:0/2002661626 shutdown_connections 2024-09-16T01:16:10.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:10.790+0000 7fc1a8d03640 1 -- 172.21.15.81:0/2002661626 wait complete. 2024-09-16T01:16:10.802 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T01:16:10.802 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:16:10.802 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-16T01:16:10.802 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T01:16:10.802 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:16:10.802 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T01:16:10.802 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:16:10.802 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:16:10.802 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:16:10.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:10.803 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-16T01:16:10.822 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:16:10.822 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:16:10.822 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:16:10.822 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:10.822 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:16:10.822 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:10.822 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:10.822 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:10.823 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-16T01:16:10.823 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:10.823 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:10.823 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-16T01:16:10.823 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:10.823 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:10.823 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:16:10.823 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:10.823 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:16:10.824 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42769sec preferred_lft 42769sec 2024-09-16T01:16:10.824 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-16T01:16:10.824 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:10.824 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T01:16:10.824 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:10.825 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:16:10.825 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add name ceph-brx type bridge 2024-09-16T01:16:10.825 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr flush dev ceph-brx 2024-09-16T01:16:10.825 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set ceph-brx up 2024-09-16T01:16:10.825 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T01:16:10.825 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:16:10.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:11.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:11.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:11.289 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:16:11.314 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:16:11.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:11.316 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-16T01:16:11.400 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-16T01:16:11.400 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:16:11.400 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:16:11.400 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:16:11.400 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:16:11.400 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:11.400 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:16:11.401 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:16:11.401 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:16:11.401 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:16:11.401 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:16:11.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:11.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:11.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:11.689 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:16:11.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:11.705 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2024-09-16T01:16:11.760 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:11.760 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:16:11.760 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:16:11.761 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-16T01:16:11.761 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:16:11.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:11.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:11.878 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-16T01:16:11.879 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:11.879 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:16:11.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-16T01:16:11.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T01:16:11.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-16T01:16:11.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-16T01:16:11.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-16T01:16:11.879 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:16:11.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:11.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:11.998 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:11.998 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:16:11.998 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-16T01:16:11.998 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T01:16:11.998 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:16:12.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:12.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:12.074 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:16:12.074 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T01:16:12.089 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:16:12.089 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:16:12.089 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:16:12.145 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:16:12.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:12.145 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:16:12.239 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:16:12.239 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:16:12.239 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:16:12.373 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:16:12.373 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:16:12.373 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:16:12.373 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:16:12.373 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:16:12.378 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:16:12.378 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:16:12.378 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:16:12.378 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:16:12.379 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:16:12.379 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:16:12.379 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:16:12.379 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:16:12.379 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T01:16:12.379 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:16:12.379 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:16:12.379 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:16:12.379 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:16:12.381 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:16:12.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:12.381 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:16:12.405 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:12.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:12.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:12.502 INFO:teuthology.orchestra.run.smithi102.stdout:client4764 2024-09-16T01:16:12.503 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:16:12.503 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:12.519 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:12.614 INFO:teuthology.orchestra.run.smithi102.stdout:client4764 2024-09-16T01:16:12.614 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:12.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:12.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:12.670 INFO:teuthology.orchestra.run.smithi102.stdout:client4764 2024-09-16T01:16:12.670 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973.client4764/status') 2024-09-16T01:16:12.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:12.728 INFO:teuthology.orchestra.run.smithi102.stdout:instance: client.4764 (3)172.21.15.102:0/2234421058 2024-09-16T01:16:12.728 INFO:teuthology.orchestra.run.smithi102.stdout:blocklisted: false 2024-09-16T01:16:12.728 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records in 2024-09-16T01:16:12.729 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records out 2024-09-16T01:16:12.729 INFO:teuthology.orchestra.run.smithi102.stderr:71 bytes copied, 2.0658e-05 s, 3.4 MB/s 2024-09-16T01:16:12.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:12.736 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-16T01:16:12.736 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T01:16:12.736 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-16T01:16:12.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:16:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.847+0000 7f7a7fd81640 1 Processor -- start 2024-09-16T01:16:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.847+0000 7f7a7fd81640 1 -- start start 2024-09-16T01:16:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7fd81640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7a780b69d0 0x7f7a78162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7fd81640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7a780af280 0x7f7a780afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7fd81640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7815eb60 con 0x7f7a780affb0 2024-09-16T01:16:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7fd81640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7a780b0400 con 0x7f7a780af280 2024-09-16T01:16:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7fd81640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7a780b6db0 con 0x7f7a780b69d0 2024-09-16T01:16:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7d31c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7a780af280 0x7f7a780afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7d31c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7a780af280 0x7f7a780afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39288/0 (socket says 172.21.15.81:39288) 2024-09-16T01:16:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7d31c640 1 -- 172.21.15.81:0/463033814 learned_addr learned my addr 172.21.15.81:0/463033814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7db1d640 1 --2- 172.21.15.81:0/463033814 >> v2:172.21.15.102:3300/0 conn(0x7f7a780b69d0 0x7f7a78162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7d31c640 1 -- 172.21.15.81:0/463033814 >> v2:172.21.15.102:3300/0 conn(0x7f7a780b69d0 msgr2=0x7f7a78162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7d31c640 1 --2- 172.21.15.81:0/463033814 >> v2:172.21.15.102:3300/0 conn(0x7f7a780b69d0 0x7f7a78162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7d31c640 1 -- 172.21.15.81:0/463033814 >> v1:172.21.15.102:6789/0 conn(0x7f7a780affb0 legacy=0x7f7a78154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.848+0000 7f7a7d31c640 1 -- 172.21.15.81:0/463033814 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7815ee40 con 0x7f7a780af280 2024-09-16T01:16:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.849+0000 7f7a7d31c640 1 --2- 172.21.15.81:0/463033814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780af280 0x7f7a780afa70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7a78070980 tx=0x7f7a6802a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3621ad3ae4a4f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.849+0000 7f7a7cb1b640 1 -- 172.21.15.81:0/463033814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68037070 con 0x7f7a780af280 2024-09-16T01:16:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.849+0000 7f7a7cb1b640 1 -- 172.21.15.81:0/463033814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a68032440 con 0x7f7a780af280 2024-09-16T01:16:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.849+0000 7f7a7cb1b640 1 -- 172.21.15.81:0/463033814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68032810 con 0x7f7a780af280 2024-09-16T01:16:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.850+0000 7f7a7fd81640 1 -- 172.21.15.81:0/463033814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780af280 msgr2=0x7f7a780afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.850+0000 7f7a7fd81640 1 --2- 172.21.15.81:0/463033814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780af280 0x7f7a780afa70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7a78070980 tx=0x7f7a6802a150 comp rx=0 tx=0).stop 2024-09-16T01:16:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.850+0000 7f7a7fd81640 1 -- 172.21.15.81:0/463033814 shutdown_connections 2024-09-16T01:16:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.850+0000 7f7a7fd81640 1 --2- 172.21.15.81:0/463033814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780af280 0x7f7a780afa70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.850+0000 7f7a7fd81640 1 --2- 172.21.15.81:0/463033814 >> v2:172.21.15.102:3300/0 conn(0x7f7a780b69d0 0x7f7a78162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.850+0000 7f7a7fd81640 1 -- 172.21.15.81:0/463033814 >> 172.21.15.81:0/463033814 conn(0x7f7a7806bc10 msgr2=0x7f7a7806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.850+0000 7f7a7fd81640 1 -- 172.21.15.81:0/463033814 shutdown_connections 2024-09-16T01:16:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.850+0000 7f7a7fd81640 1 -- 172.21.15.81:0/463033814 wait complete. 2024-09-16T01:16:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.851+0000 7f7a7fd81640 1 Processor -- start 2024-09-16T01:16:12.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.851+0000 7f7a7fd81640 1 -- start start 2024-09-16T01:16:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7fd81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a780af280 0x7f7a781486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7fd81640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a780affb0 0x7f7a780cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7fd81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780b69d0 0x7f7a781f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7fd81640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7a780af710 con 0x7f7a780b69d0 2024-09-16T01:16:12.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7fd81640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7815f400 con 0x7f7a780af280 2024-09-16T01:16:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7fd81640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7a78155410 con 0x7f7a780affb0 2024-09-16T01:16:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7db1d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a780af280 0x7f7a781486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7e31e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780b69d0 0x7f7a781f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7db1d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a780af280 0x7f7a781486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:52320/0 (socket says 172.21.15.81:52320) 2024-09-16T01:16:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7db1d640 1 -- 172.21.15.81:0/985823353 learned_addr learned my addr 172.21.15.81:0/985823353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7d31c640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a780affb0 0x7f7a780cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7e31e640 1 -- 172.21.15.81:0/985823353 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a780affb0 msgr2=0x7f7a780cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7e31e640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a780affb0 0x7f7a780cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7e31e640 1 -- 172.21.15.81:0/985823353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a780af280 msgr2=0x7f7a781486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:12.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7e31e640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a780af280 0x7f7a781486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7e31e640 1 -- 172.21.15.81:0/985823353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7815a660 con 0x7f7a780b69d0 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7e31e640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780b69d0 0x7f7a781f4510 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c690 tx=0x7f7a7000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a6e7fc640 1 -- 172.21.15.81:0/985823353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70003b70 con 0x7f7a780b69d0 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a6e7fc640 1 -- 172.21.15.81:0/985823353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a70003d10 con 0x7f7a780b69d0 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.852+0000 7f7a7fd81640 1 -- 172.21.15.81:0/985823353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7815a940 con 0x7f7a780b69d0 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.853+0000 7f7a6e7fc640 1 -- 172.21.15.81:0/985823353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70005310 con 0x7f7a780b69d0 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.853+0000 7f7a7fd81640 1 -- 172.21.15.81:0/985823353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a7815af00 con 0x7f7a780b69d0 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.854+0000 7f7a7fd81640 1 -- 172.21.15.81:0/985823353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a781557a0 con 0x7f7a780b69d0 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.854+0000 7f7a6e7fc640 1 -- 172.21.15.81:0/985823353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7a700054b0 con 0x7f7a780b69d0 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.854+0000 7f7a6e7fc640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7a5c06c2e0 0x7f7a5c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.855+0000 7f7a6e7fc640 1 -- 172.21.15.81:0/985823353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7a7008b3b0 con 0x7f7a780b69d0 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.855+0000 7f7a7db1d640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7a5c06c2e0 0x7f7a5c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.855+0000 7f7a7db1d640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7a5c06c2e0 0x7f7a5c06e7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009b60 tx=0x7f7a74009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:12.859+0000 7f7a6e7fc640 1 -- 172.21.15.81:0/985823353 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a70059220 con 0x7f7a780b69d0 2024-09-16T01:16:13.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.062+0000 7f7a7fd81640 1 -- 172.21.15.81:0/985823353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7a780ae820 con 0x7f7a780b69d0 2024-09-16T01:16:13.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.062+0000 7f7a6e7fc640 1 -- 172.21.15.81:0/985823353 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f7a7005d520 con 0x7f7a780b69d0 2024-09-16T01:16:13.063 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-16T01:16:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.064+0000 7f7a7fd81640 1 -- 172.21.15.81:0/985823353 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7a5c06c2e0 msgr2=0x7f7a5c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.064+0000 7f7a7fd81640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7a5c06c2e0 0x7f7a5c06e7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009b60 tx=0x7f7a74009190 comp rx=0 tx=0).stop 2024-09-16T01:16:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.064+0000 7f7a7fd81640 1 -- 172.21.15.81:0/985823353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780b69d0 msgr2=0x7f7a781f4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.064+0000 7f7a7fd81640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780b69d0 0x7f7a781f4510 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c690 tx=0x7f7a7000cb50 comp rx=0 tx=0).stop 2024-09-16T01:16:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.064+0000 7f7a7fd81640 1 -- 172.21.15.81:0/985823353 shutdown_connections 2024-09-16T01:16:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.064+0000 7f7a7fd81640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7a5c06c2e0 0x7f7a5c06e7a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.064+0000 7f7a7fd81640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780b69d0 0x7f7a781f4510 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.064+0000 7f7a7fd81640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a780affb0 0x7f7a780cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.064+0000 7f7a7fd81640 1 --2- 172.21.15.81:0/985823353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a780af280 0x7f7a781486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.064+0000 7f7a7fd81640 1 -- 172.21.15.81:0/985823353 >> 172.21.15.81:0/985823353 conn(0x7f7a7806bc10 msgr2=0x7f7a7806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.064+0000 7f7a7fd81640 1 -- 172.21.15.81:0/985823353 shutdown_connections 2024-09-16T01:16:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:13.064+0000 7f7a7fd81640 1 -- 172.21.15.81:0/985823353 wait complete. 2024-09-16T01:16:13.076 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T01:16:13.076 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:16:13.076 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-16T01:16:13.076 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-16T01:16:13.076 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-16T01:16:13.076 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T01:16:13.076 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T01:16:13.076 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:16:13.076 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-16T01:16:13.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:13.077 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-16T01:16:13.093 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:16:13.093 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:13.094 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:16:13.095 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:13.095 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:16:13.095 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42767sec preferred_lft 42767sec 2024-09-16T01:16:13.095 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-16T01:16:13.095 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.095 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:16:13.095 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 2e:4a:65:c9:20:4f brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:13.095 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:16:13.095 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.095 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::fc48:18ff:fedc:b80f/64 scope link tentative 2024-09-16T01:16:13.095 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.095 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:16:13.096 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 2e:4a:65:c9:20:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:16:13.096 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::2c4a:65ff:fec9:204f/64 scope link tentative 2024-09-16T01:16:13.096 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:13.096 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:16:13.158 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:16:13.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:13.160 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-16T01:16:13.216 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-16T01:16:13.216 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:16:13.216 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:16:13.217 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:16:13.217 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:16:13.217 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:13.217 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:16:13.217 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:16:13.217 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:16:13.217 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:16:13.217 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:16:13.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:13.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:13.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:13.343 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:16:13.358 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:16:13.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:13.359 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2024-09-16T01:16:13.415 INFO:teuthology.orchestra.run.smithi102.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-16T01:16:13.415 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:13.415 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:16:13.415 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:16:13.415 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-16T01:16:13.415 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:16:13.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:13.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:13.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:13.532 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-16T01:16:13.556 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:16:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:16:13.556 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:16:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:16:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.557 INFO:teuthology.orchestra.run.smithi102.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:16:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 6e:b4:99:1c:7a:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T01:16:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T01:16:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::6cb4:99ff:fe1c:7ab7/64 scope link 2024-09-16T01:16:13.557 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:13.558 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-16T01:16:13.622 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:16:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:16:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:16:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:16:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.623 INFO:teuthology.orchestra.run.smithi102.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:16:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 6e:b4:99:1c:7a:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-16T01:16:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-16T01:16:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::6cb4:99ff:fe1c:7ab7/64 scope link 2024-09-16T01:16:13.623 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:13.624 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-16T01:16:13.625 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:13.625 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:16:13.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-16T01:16:13.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-16T01:16:13.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-16T01:16:13.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-16T01:16:13.625 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-16T01:16:13.625 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:16:13.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:13.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:13.776 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:13.777 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:16:13.777 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.1 up 2024-09-16T01:16:13.777 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.1 master ceph-brx 2024-09-16T01:16:13.777 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:16:13.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:13.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:13.854 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:16:13.854 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-16T01:16:13.869 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-16T01:16:13.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:16:13.870 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-16T01:16:13.925 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:16:13.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:13.926 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T01:16:14.009 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T01:16:14.009 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-16T01:16:14.009 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:16:14.018 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T01:16:14.018 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-16T01:16:14.018 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:16:14.018 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:16:14.018 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:16:14.023 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-16T01:16:14.023 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-16T01:16:14.023 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:16:14.023 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:16:14.023 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:16:14.023 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:16:14.023 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:16:14.024 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:16:14.024 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-16T01:16:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:16:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:16:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:16:14.024 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:16:14.026 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:16:14.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:14.026 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-16T01:16:14.090 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:14.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:14.187 INFO:teuthology.orchestra.run.smithi102.stdout:client4532 2024-09-16T01:16:14.187 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:16:14.188 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:14.203 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:14.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:14.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:14.299 INFO:teuthology.orchestra.run.smithi102.stdout:client4532 2024-09-16T01:16:14.299 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:14.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:14.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:14.355 INFO:teuthology.orchestra.run.smithi102.stdout:client4532 2024-09-16T01:16:14.355 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973.client4532/status') 2024-09-16T01:16:14.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:14.412 INFO:teuthology.orchestra.run.smithi102.stdout:instance: client.4532 (3)192.168.0.2:0/1896214904 2024-09-16T01:16:14.413 INFO:teuthology.orchestra.run.smithi102.stdout:blocklisted: false 2024-09-16T01:16:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records in 2024-09-16T01:16:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records out 2024-09-16T01:16:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:69 bytes copied, 2.371e-05 s, 2.9 MB/s 2024-09-16T01:16:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:14.420 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-16T01:16:14.466 INFO:tasks.cephfs_test_runner:Starting test: test_cap_acquisition_throttle_readdir (tasks.cephfs.test_client_limits.TestClientLimits) Mostly readdir acquires caps faster than the mds recalls, so the cap 2024-09-16T01:16:14.466 INFO:tasks.cephfs_test_runner:test_cap_acquisition_throttle_readdir (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-16T01:16:14.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:16:14.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.576+0000 7f0f7f58d640 1 Processor -- start 2024-09-16T01:16:14.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.576+0000 7f0f7f58d640 1 -- start start 2024-09-16T01:16:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.577+0000 7f0f7f58d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f780d30f0 0x7f0f780b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.577+0000 7f0f7f58d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0f780b64c0 0x7f0f7806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.577+0000 7f0f7f58d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f780d3690 con 0x7f0f7815e5f0 2024-09-16T01:16:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.577+0000 7f0f7f58d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0f7806d530 con 0x7f0f780d30f0 2024-09-16T01:16:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.577+0000 7f0f7f58d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0f780d3970 con 0x7f0f780b64c0 2024-09-16T01:16:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.577+0000 7f0f7cb28640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f780d30f0 0x7f0f780b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.577+0000 7f0f7cb28640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f780d30f0 0x7f0f780b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39316/0 (socket says 172.21.15.81:39316) 2024-09-16T01:16:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.577+0000 7f0f7cb28640 1 -- 172.21.15.81:0/2267824231 learned_addr learned my addr 172.21.15.81:0/2267824231 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.577+0000 7f0f7db2a640 1 --2- 172.21.15.81:0/2267824231 >> v2:172.21.15.102:3300/0 conn(0x7f0f780b64c0 0x7f0f7806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.578+0000 7f0f7cb28640 1 -- 172.21.15.81:0/2267824231 >> v2:172.21.15.102:3300/0 conn(0x7f0f780b64c0 msgr2=0x7f0f7806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.578+0000 7f0f7cb28640 1 --2- 172.21.15.81:0/2267824231 >> v2:172.21.15.102:3300/0 conn(0x7f0f780b64c0 0x7f0f7806d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.578+0000 7f0f6ffff640 1 -- 172.21.15.81:0/2267824231 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 918526388 0 0) 0x7f0f780d3690 con 0x7f0f7815e5f0 2024-09-16T01:16:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.578+0000 7f0f7cb28640 1 -- 172.21.15.81:0/2267824231 >> v1:172.21.15.102:6789/0 conn(0x7f0f7815e5f0 legacy=0x7f0f780d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.578+0000 7f0f7cb28640 1 -- 172.21.15.81:0/2267824231 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7806cee0 con 0x7f0f780d30f0 2024-09-16T01:16:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.578+0000 7f0f7cb28640 1 --2- 172.21.15.81:0/2267824231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f780d30f0 0x7f0f780b5f80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f780ba580 tx=0x7f0f6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81a3d5be4febb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.578+0000 7f0f6ffff640 1 -- 172.21.15.81:0/2267824231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68037070 con 0x7f0f780d30f0 2024-09-16T01:16:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.578+0000 7f0f6ffff640 1 -- 172.21.15.81:0/2267824231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f68032440 con 0x7f0f780d30f0 2024-09-16T01:16:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.578+0000 7f0f6ffff640 1 -- 172.21.15.81:0/2267824231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68032810 con 0x7f0f780d30f0 2024-09-16T01:16:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.579+0000 7f0f7f58d640 1 -- 172.21.15.81:0/2267824231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f780d30f0 msgr2=0x7f0f780b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.579+0000 7f0f7f58d640 1 --2- 172.21.15.81:0/2267824231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f780d30f0 0x7f0f780b5f80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f780ba580 tx=0x7f0f6802a270 comp rx=0 tx=0).stop 2024-09-16T01:16:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.579+0000 7f0f7f58d640 1 -- 172.21.15.81:0/2267824231 shutdown_connections 2024-09-16T01:16:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.579+0000 7f0f7f58d640 1 --2- 172.21.15.81:0/2267824231 >> v2:172.21.15.102:3300/0 conn(0x7f0f780b64c0 0x7f0f7806d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.579+0000 7f0f7f58d640 1 --2- 172.21.15.81:0/2267824231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f780d30f0 0x7f0f780b5f80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.579+0000 7f0f7f58d640 1 -- 172.21.15.81:0/2267824231 >> 172.21.15.81:0/2267824231 conn(0x7f0f7808bfc0 msgr2=0x7f0f780d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.579+0000 7f0f7f58d640 1 -- 172.21.15.81:0/2267824231 shutdown_connections 2024-09-16T01:16:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.579+0000 7f0f7f58d640 1 -- 172.21.15.81:0/2267824231 wait complete. 2024-09-16T01:16:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.580+0000 7f0f7f58d640 1 Processor -- start 2024-09-16T01:16:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.580+0000 7f0f7f58d640 1 -- start start 2024-09-16T01:16:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.581+0000 7f0f7f58d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f780b64c0 0x7f0f78160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.581+0000 7f0f7f58d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f780d30f0 0x7f0f78161560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.581+0000 7f0f7f58d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f7815e5f0 0x7f0f780b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.581+0000 7f0f7f58d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7806df00 con 0x7f0f780b64c0 2024-09-16T01:16:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.581+0000 7f0f7f58d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7815e9d0 con 0x7f0f7815e5f0 2024-09-16T01:16:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.581+0000 7f0f7f58d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7806e080 con 0x7f0f780d30f0 2024-09-16T01:16:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.581+0000 7f0f7d329640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f780b64c0 0x7f0f78160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.581+0000 7f0f7d329640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f780b64c0 0x7f0f78160b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39320/0 (socket says 172.21.15.81:39320) 2024-09-16T01:16:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.581+0000 7f0f7d329640 1 -- 172.21.15.81:0/1030024413 learned_addr learned my addr 172.21.15.81:0/1030024413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.581+0000 7f0f7db2a640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f7815e5f0 0x7f0f780b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.581+0000 7f0f7cb28640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f780d30f0 0x7f0f78161560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.582+0000 7f0f7d329640 1 -- 172.21.15.81:0/1030024413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f780d30f0 msgr2=0x7f0f78161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.582+0000 7f0f7d329640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f780d30f0 0x7f0f78161560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.582+0000 7f0f7d329640 1 -- 172.21.15.81:0/1030024413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f7815e5f0 msgr2=0x7f0f780b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.582+0000 7f0f7d329640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f7815e5f0 0x7f0f780b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.582+0000 7f0f7d329640 1 -- 172.21.15.81:0/1030024413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7815b3c0 con 0x7f0f780b64c0 2024-09-16T01:16:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.582+0000 7f0f7d329640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f780b64c0 0x7f0f78160b30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400c440 tx=0x7f0f7400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.582+0000 7f0f6dffb640 1 -- 172.21.15.81:0/1030024413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f74017070 con 0x7f0f780b64c0 2024-09-16T01:16:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.582+0000 7f0f6dffb640 1 -- 172.21.15.81:0/1030024413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f74005480 con 0x7f0f780b64c0 2024-09-16T01:16:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.582+0000 7f0f7f58d640 1 -- 172.21.15.81:0/1030024413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f7815b6a0 con 0x7f0f780b64c0 2024-09-16T01:16:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.582+0000 7f0f6dffb640 1 -- 172.21.15.81:0/1030024413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f74003830 con 0x7f0f780b64c0 2024-09-16T01:16:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.582+0000 7f0f7f58d640 1 -- 172.21.15.81:0/1030024413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f7815bc60 con 0x7f0f780b64c0 2024-09-16T01:16:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.583+0000 7f0f7f58d640 1 -- 172.21.15.81:0/1030024413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7815be30 con 0x7f0f780b64c0 2024-09-16T01:16:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.584+0000 7f0f6dffb640 1 -- 172.21.15.81:0/1030024413 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0f7401a070 con 0x7f0f780b64c0 2024-09-16T01:16:14.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.584+0000 7f0f6dffb640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0f5c06c2b0 0x7f0f5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:14.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.584+0000 7f0f6dffb640 1 -- 172.21.15.81:0/1030024413 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0f7408a9c0 con 0x7f0f780b64c0 2024-09-16T01:16:14.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.584+0000 7f0f7cb28640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0f5c06c2b0 0x7f0f5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:14.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.584+0000 7f0f7cb28640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0f5c06c2b0 0x7f0f5c06e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f68034000 tx=0x7f0f6802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:14.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.588+0000 7f0f6dffb640 1 -- 172.21.15.81:0/1030024413 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f7815be30 con 0x7f0f780b64c0 2024-09-16T01:16:14.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.757+0000 7f0f7f58d640 1 -- 172.21.15.81:0/1030024413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f7806d9c0 con 0x7f0f780b64c0 2024-09-16T01:16:14.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.759+0000 7f0f6dffb640 1 -- 172.21.15.81:0/1030024413 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18598 (secure 0 0 0) 0x7f0f7408ce20 con 0x7f0f780b64c0 2024-09-16T01:16:14.760 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:14.760 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:44.092404+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:15:36.856888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:15:38.066938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:15:41.748133+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:16:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.760+0000 7f0f7f58d640 1 -- 172.21.15.81:0/1030024413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0f5c06c2b0 msgr2=0x7f0f5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.761+0000 7f0f7f58d640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0f5c06c2b0 0x7f0f5c06e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f68034000 tx=0x7f0f6802e000 comp rx=0 tx=0).stop 2024-09-16T01:16:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.761+0000 7f0f7f58d640 1 -- 172.21.15.81:0/1030024413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f780b64c0 msgr2=0x7f0f78160b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.761+0000 7f0f7f58d640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f780b64c0 0x7f0f78160b30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400c440 tx=0x7f0f7400c900 comp rx=0 tx=0).stop 2024-09-16T01:16:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.761+0000 7f0f7f58d640 1 -- 172.21.15.81:0/1030024413 shutdown_connections 2024-09-16T01:16:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.761+0000 7f0f7f58d640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0f5c06c2b0 0x7f0f5c06e770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.761+0000 7f0f7f58d640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f7815e5f0 0x7f0f780b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.761+0000 7f0f7f58d640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f780d30f0 0x7f0f78161560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.761+0000 7f0f7f58d640 1 --2- 172.21.15.81:0/1030024413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f780b64c0 0x7f0f78160b30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.761+0000 7f0f7f58d640 1 -- 172.21.15.81:0/1030024413 >> 172.21.15.81:0/1030024413 conn(0x7f0f7808bfc0 msgr2=0x7f0f780b5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.761+0000 7f0f7f58d640 1 -- 172.21.15.81:0/1030024413 shutdown_connections 2024-09-16T01:16:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.761+0000 7f0f7f58d640 1 -- 172.21.15.81:0/1030024413 wait complete. 2024-09-16T01:16:14.772 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:15:28.088452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-16T01:15:36.856888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-16T01:15:38.066938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-16T01:15:41.748133+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-16T01:16:14.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:16:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.874+0000 7f8e0176f640 1 Processor -- start 2024-09-16T01:16:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.874+0000 7f8e0176f640 1 -- start start 2024-09-16T01:16:14.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.875+0000 7f8e0176f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8dfc158ec0 0x7f8dfc15c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:14.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.875+0000 7f8e0176f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8dfc15ca50 0x7f8dfc1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:14.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.875+0000 7f8e0176f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dfc15c850 con 0x7f8dfc0b4d50 2024-09-16T01:16:14.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.875+0000 7f8e0176f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8dfc1592a0 con 0x7f8dfc158ec0 2024-09-16T01:16:14.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.875+0000 7f8e0176f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8dfc15d010 con 0x7f8dfc15ca50 2024-09-16T01:16:14.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.875+0000 7f8dfaffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8dfc158ec0 0x7f8dfc15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:14.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.875+0000 7f8dfb7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8dfc0b4d50 0x7f8dfc15e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49724/0 (socket says 172.21.15.81:49724) 2024-09-16T01:16:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.875+0000 7f8dfb7fe640 1 -- 172.21.15.81:0/2784832373 learned_addr learned my addr 172.21.15.81:0/2784832373 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.875+0000 7f8df27fc640 1 --2- 172.21.15.81:0/2784832373 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8dfc15ca50 0x7f8dfc1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.876+0000 7f8dfaffd640 1 -- 172.21.15.81:0/2784832373 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8dfc15ca50 msgr2=0x7f8dfc1594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.876+0000 7f8dfaffd640 1 --2- 172.21.15.81:0/2784832373 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8dfc15ca50 0x7f8dfc1594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.876+0000 7f8dfaffd640 1 -- 172.21.15.81:0/2784832373 >> v1:172.21.15.81:6789/0 conn(0x7f8dfc0b4d50 legacy=0x7f8dfc15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.876+0000 7f8dfa7fc640 1 -- 172.21.15.81:0/2784832373 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092185698 0 0) 0x7f8df4001490 con 0x7f8dfc0b4d50 2024-09-16T01:16:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.876+0000 7f8dfaffd640 1 -- 172.21.15.81:0/2784832373 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc15d2f0 con 0x7f8dfc158ec0 2024-09-16T01:16:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.876+0000 7f8dfaffd640 1 --2- 172.21.15.81:0/2784832373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc158ec0 0x7f8dfc15c310 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0097a0 tx=0x7f8dec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42dd502a940036f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.876+0000 7f8dfa7fc640 1 -- 172.21.15.81:0/2784832373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec037070 con 0x7f8dfc158ec0 2024-09-16T01:16:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.876+0000 7f8dfa7fc640 1 -- 172.21.15.81:0/2784832373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dec032440 con 0x7f8dfc158ec0 2024-09-16T01:16:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.876+0000 7f8dfa7fc640 1 -- 172.21.15.81:0/2784832373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dec032810 con 0x7f8dfc158ec0 2024-09-16T01:16:14.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.877+0000 7f8e0176f640 1 -- 172.21.15.81:0/2784832373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc158ec0 msgr2=0x7f8dfc15c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.877+0000 7f8e0176f640 1 --2- 172.21.15.81:0/2784832373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc158ec0 0x7f8dfc15c310 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8dec0097a0 tx=0x7f8dec02a180 comp rx=0 tx=0).stop 2024-09-16T01:16:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.877+0000 7f8e0176f640 1 -- 172.21.15.81:0/2784832373 shutdown_connections 2024-09-16T01:16:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.877+0000 7f8e0176f640 1 --2- 172.21.15.81:0/2784832373 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8dfc15ca50 0x7f8dfc1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.877+0000 7f8e0176f640 1 --2- 172.21.15.81:0/2784832373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc158ec0 0x7f8dfc15c310 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.877+0000 7f8e0176f640 1 -- 172.21.15.81:0/2784832373 >> 172.21.15.81:0/2784832373 conn(0x7f8dfc09aa30 msgr2=0x7f8dfc0b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.877+0000 7f8e0176f640 1 -- 172.21.15.81:0/2784832373 shutdown_connections 2024-09-16T01:16:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.877+0000 7f8e0176f640 1 -- 172.21.15.81:0/2784832373 wait complete. 2024-09-16T01:16:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.878+0000 7f8e0176f640 1 Processor -- start 2024-09-16T01:16:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.878+0000 7f8e0176f640 1 -- start start 2024-09-16T01:16:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8e0176f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8dfc0b4d50 0x7f8dfc14a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8e0176f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc158ec0 0x7f8dfc0b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8e0176f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8dfc15ca50 0x7f8dfc0b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8e0176f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc15db90 con 0x7f8dfc158ec0 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8e0176f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8dfc15d8b0 con 0x7f8dfc0b4d50 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8e0176f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8dfc159a10 con 0x7f8dfc15ca50 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8df27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc158ec0 0x7f8dfc0b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8df27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc158ec0 0x7f8dfc0b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39336/0 (socket says 172.21.15.81:39336) 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8df27fc640 1 -- 172.21.15.81:0/2488388047 learned_addr learned my addr 172.21.15.81:0/2488388047 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8dfb7fe640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8dfc15ca50 0x7f8dfc0b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8dfaffd640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8dfc0b4d50 0x7f8dfc14a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8df27fc640 1 -- 172.21.15.81:0/2488388047 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8dfc15ca50 msgr2=0x7f8dfc0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8df27fc640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8dfc15ca50 0x7f8dfc0b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8df27fc640 1 -- 172.21.15.81:0/2488388047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8dfc0b4d50 msgr2=0x7f8dfc14a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:14.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8df27fc640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8dfc0b4d50 0x7f8dfc14a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:14.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.879+0000 7f8df27fc640 1 -- 172.21.15.81:0/2488388047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dfc1501d0 con 0x7f8dfc158ec0 2024-09-16T01:16:14.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.880+0000 7f8df27fc640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc158ec0 0x7f8dfc0b2ea0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8de400d5f0 tx=0x7f8de400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:14.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.880+0000 7f8df3fff640 1 -- 172.21.15.81:0/2488388047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de40125f0 con 0x7f8dfc158ec0 2024-09-16T01:16:14.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.880+0000 7f8df3fff640 1 -- 172.21.15.81:0/2488388047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de4019070 con 0x7f8dfc158ec0 2024-09-16T01:16:14.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.880+0000 7f8e0176f640 1 -- 172.21.15.81:0/2488388047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dfc1f6410 con 0x7f8dfc158ec0 2024-09-16T01:16:14.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.880+0000 7f8df3fff640 1 -- 172.21.15.81:0/2488388047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de40129d0 con 0x7f8dfc158ec0 2024-09-16T01:16:14.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.880+0000 7f8e0176f640 1 -- 172.21.15.81:0/2488388047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dfc14ad00 con 0x7f8dfc158ec0 2024-09-16T01:16:14.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.881+0000 7f8e0176f640 1 -- 172.21.15.81:0/2488388047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dfc15c310 con 0x7f8dfc158ec0 2024-09-16T01:16:14.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.881+0000 7f8df3fff640 1 -- 172.21.15.81:0/2488388047 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8de4012b70 con 0x7f8dfc158ec0 2024-09-16T01:16:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.882+0000 7f8df3fff640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ddc06c2b0 0x7f8ddc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.882+0000 7f8df3fff640 1 -- 172.21.15.81:0/2488388047 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8de408ba00 con 0x7f8dfc158ec0 2024-09-16T01:16:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.882+0000 7f8dfaffd640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ddc06c2b0 0x7f8ddc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.882+0000 7f8dfaffd640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ddc06c2b0 0x7f8ddc06e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8dec034000 tx=0x7f8dec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:14.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:14.886+0000 7f8df3fff640 1 -- 172.21.15.81:0/2488388047 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8de40597e0 con 0x7f8dfc158ec0 2024-09-16T01:16:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.052+0000 7f8e0176f640 1 -- 172.21.15.81:0/2488388047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8dfc14afc0 con 0x7f8dfc158ec0 2024-09-16T01:16:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.053+0000 7f8df3fff640 1 -- 172.21.15.81:0/2488388047 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f8de405dae0 con 0x7f8dfc158ec0 2024-09-16T01:16:15.054 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-16T01:16:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.055+0000 7f8e0176f640 1 -- 172.21.15.81:0/2488388047 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ddc06c2b0 msgr2=0x7f8ddc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.055+0000 7f8e0176f640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ddc06c2b0 0x7f8ddc06e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8dec034000 tx=0x7f8dec02e000 comp rx=0 tx=0).stop 2024-09-16T01:16:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.055+0000 7f8e0176f640 1 -- 172.21.15.81:0/2488388047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc158ec0 msgr2=0x7f8dfc0b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.055+0000 7f8e0176f640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc158ec0 0x7f8dfc0b2ea0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8de400d5f0 tx=0x7f8de400dab0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.055+0000 7f8e0176f640 1 -- 172.21.15.81:0/2488388047 shutdown_connections 2024-09-16T01:16:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.055+0000 7f8e0176f640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ddc06c2b0 0x7f8ddc06e770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.055+0000 7f8e0176f640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8dfc15ca50 0x7f8dfc0b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.055+0000 7f8e0176f640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dfc158ec0 0x7f8dfc0b2ea0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.055+0000 7f8e0176f640 1 --2- 172.21.15.81:0/2488388047 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8dfc0b4d50 0x7f8dfc14a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.055+0000 7f8e0176f640 1 -- 172.21.15.81:0/2488388047 >> 172.21.15.81:0/2488388047 conn(0x7f8dfc09aa30 msgr2=0x7f8dfc15f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.055+0000 7f8e0176f640 1 -- 172.21.15.81:0/2488388047 shutdown_connections 2024-09-16T01:16:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.055+0000 7f8e0176f640 1 -- 172.21.15.81:0/2488388047 wait complete. 2024-09-16T01:16:15.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-16T01:16:15.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.168+0000 7fdd5722e640 1 Processor -- start 2024-09-16T01:16:15.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.168+0000 7fdd5722e640 1 -- start start 2024-09-16T01:16:15.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.168+0000 7fdd5722e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd50158ec0 0x7fdd5015c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd5722e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd5015c850 con 0x7fdd500b4d50 2024-09-16T01:16:15.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd5722e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd501592a0 con 0x7fdd5015ca50 2024-09-16T01:16:15.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd5722e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdd5015d010 con 0x7fdd50158ec0 2024-09-16T01:16:15.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd557cb640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdd500b4d50 0x7fdd5015e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49732/0 (socket says 172.21.15.81:49732) 2024-09-16T01:16:15.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd557cb640 1 -- 172.21.15.81:0/2284177755 learned_addr learned my addr 172.21.15.81:0/2284177755 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:15.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd54fca640 1 --2- 172.21.15.81:0/2284177755 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd50158ec0 0x7fdd5015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd4f7fe640 1 -- 172.21.15.81:0/2284177755 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188474391 0 0) 0x7fdd48001490 con 0x7fdd500b4d50 2024-09-16T01:16:15.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd4f7fe640 1 -- 172.21.15.81:0/2284177755 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd40003520 con 0x7fdd500b4d50 2024-09-16T01:16:15.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd4f7fe640 1 -- 172.21.15.81:0/2284177755 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250495169 0 0) 0x7fdd501592a0 con 0x7fdd5015ca50 2024-09-16T01:16:15.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd4f7fe640 1 -- 172.21.15.81:0/2284177755 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd48001490 con 0x7fdd5015ca50 2024-09-16T01:16:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd54fca640 1 -- 172.21.15.81:0/2284177755 >> v1:172.21.15.102:6789/0 conn(0x7fdd5015ca50 legacy=0x7fdd501594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd54fca640 1 -- 172.21.15.81:0/2284177755 >> v1:172.21.15.81:6789/0 conn(0x7fdd500b4d50 legacy=0x7fdd5015e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.169+0000 7fdd54fca640 1 -- 172.21.15.81:0/2284177755 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd5015d2f0 con 0x7fdd50158ec0 2024-09-16T01:16:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.170+0000 7fdd54fca640 1 --2- 172.21.15.81:0/2284177755 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd50158ec0 0x7fdd5015c310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd440097d0 tx=0x7fdd4402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8db2f99d8baff72 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.170+0000 7fdd4f7fe640 1 -- 172.21.15.81:0/2284177755 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44037070 con 0x7fdd50158ec0 2024-09-16T01:16:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.170+0000 7fdd4f7fe640 1 -- 172.21.15.81:0/2284177755 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd44032440 con 0x7fdd50158ec0 2024-09-16T01:16:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.170+0000 7fdd4f7fe640 1 -- 172.21.15.81:0/2284177755 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd440327f0 con 0x7fdd50158ec0 2024-09-16T01:16:15.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.171+0000 7fdd5722e640 1 -- 172.21.15.81:0/2284177755 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd50158ec0 msgr2=0x7fdd5015c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.171+0000 7fdd5722e640 1 --2- 172.21.15.81:0/2284177755 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd50158ec0 0x7fdd5015c310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd440097d0 tx=0x7fdd4402a210 comp rx=0 tx=0).stop 2024-09-16T01:16:15.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.171+0000 7fdd5722e640 1 -- 172.21.15.81:0/2284177755 shutdown_connections 2024-09-16T01:16:15.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.171+0000 7fdd5722e640 1 --2- 172.21.15.81:0/2284177755 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd50158ec0 0x7fdd5015c310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.171+0000 7fdd5722e640 1 -- 172.21.15.81:0/2284177755 >> 172.21.15.81:0/2284177755 conn(0x7fdd5009aa30 msgr2=0x7fdd500b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:15.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.171+0000 7fdd5722e640 1 -- 172.21.15.81:0/2284177755 shutdown_connections 2024-09-16T01:16:15.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.171+0000 7fdd5722e640 1 -- 172.21.15.81:0/2284177755 wait complete. 2024-09-16T01:16:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.172+0000 7fdd5722e640 1 Processor -- start 2024-09-16T01:16:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.172+0000 7fdd5722e640 1 -- start start 2024-09-16T01:16:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd5722e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd500b4d50 0x7fdd50140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd5722e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd50158ec0 0x7fdd50150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd5722e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd5015ca50 0x7fdd500b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd5722e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5015db90 con 0x7fdd5015ca50 2024-09-16T01:16:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd5722e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdd5015d8b0 con 0x7fdd50158ec0 2024-09-16T01:16:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd5722e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdd5015e7c0 con 0x7fdd500b4d50 2024-09-16T01:16:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd557cb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd5015ca50 0x7fdd500b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd557cb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd5015ca50 0x7fdd500b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39344/0 (socket says 172.21.15.81:39344) 2024-09-16T01:16:15.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd557cb640 1 -- 172.21.15.81:0/2112846322 learned_addr learned my addr 172.21.15.81:0/2112846322 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd54fca640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd500b4d50 0x7fdd50140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd4ffff640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd50158ec0 0x7fdd50150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd557cb640 1 -- 172.21.15.81:0/2112846322 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd500b4d50 msgr2=0x7fdd50140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd557cb640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd500b4d50 0x7fdd50140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd557cb640 1 -- 172.21.15.81:0/2112846322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd50158ec0 msgr2=0x7fdd50150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd557cb640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd50158ec0 0x7fdd50150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd557cb640 1 -- 172.21.15.81:0/2112846322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd50152b90 con 0x7fdd5015ca50 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd4ffff640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd50158ec0 0x7fdd50150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd557cb640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd5015ca50 0x7fdd500b3180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdd48001f90 tx=0x7fdd4800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd4d7fa640 1 -- 172.21.15.81:0/2112846322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48017070 con 0x7fdd5015ca50 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd4d7fa640 1 -- 172.21.15.81:0/2112846322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd48012400 con 0x7fdd5015ca50 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd4d7fa640 1 -- 172.21.15.81:0/2112846322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480127b0 con 0x7fdd5015ca50 2024-09-16T01:16:15.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.173+0000 7fdd5722e640 1 -- 172.21.15.81:0/2112846322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd50152e70 con 0x7fdd5015ca50 2024-09-16T01:16:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.174+0000 7fdd5722e640 1 -- 172.21.15.81:0/2112846322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd5014d4c0 con 0x7fdd5015ca50 2024-09-16T01:16:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.175+0000 7fdd5722e640 1 -- 172.21.15.81:0/2112846322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd5015eb50 con 0x7fdd5015ca50 2024-09-16T01:16:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.175+0000 7fdd4d7fa640 1 -- 172.21.15.81:0/2112846322 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdd4801a070 con 0x7fdd5015ca50 2024-09-16T01:16:15.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.175+0000 7fdd4d7fa640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd3406c2b0 0x7fdd3406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.176+0000 7fdd4d7fa640 1 -- 172.21.15.81:0/2112846322 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdd4808b660 con 0x7fdd5015ca50 2024-09-16T01:16:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.176+0000 7fdd54fca640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd3406c2b0 0x7fdd3406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.176+0000 7fdd54fca640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd3406c2b0 0x7fdd3406e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdd44034000 tx=0x7fdd4402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:15.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.180+0000 7fdd4d7fa640 1 -- 172.21.15.81:0/2112846322 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd5015c850 con 0x7fdd5015ca50 2024-09-16T01:16:15.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.346+0000 7fdd5722e640 1 -- 172.21.15.81:0/2112846322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdd50070140 con 0x7fdd5015ca50 2024-09-16T01:16:15.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.346+0000 7fdd4d7fa640 1 -- 172.21.15.81:0/2112846322 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fdd48059450 con 0x7fdd5015ca50 2024-09-16T01:16:15.377 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-16T01:16:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.348+0000 7fdd5722e640 1 -- 172.21.15.81:0/2112846322 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd3406c2b0 msgr2=0x7fdd3406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.348+0000 7fdd5722e640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd3406c2b0 0x7fdd3406e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdd44034000 tx=0x7fdd4402e000 comp rx=0 tx=0).stop 2024-09-16T01:16:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.348+0000 7fdd5722e640 1 -- 172.21.15.81:0/2112846322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd5015ca50 msgr2=0x7fdd500b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.348+0000 7fdd5722e640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd5015ca50 0x7fdd500b3180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdd48001f90 tx=0x7fdd4800a430 comp rx=0 tx=0).stop 2024-09-16T01:16:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.348+0000 7fdd5722e640 1 -- 172.21.15.81:0/2112846322 shutdown_connections 2024-09-16T01:16:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.348+0000 7fdd5722e640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd3406c2b0 0x7fdd3406e770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.348+0000 7fdd5722e640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd5015ca50 0x7fdd500b3180 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.348+0000 7fdd5722e640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd50158ec0 0x7fdd50150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.348+0000 7fdd5722e640 1 --2- 172.21.15.81:0/2112846322 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd500b4d50 0x7fdd50140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.348+0000 7fdd5722e640 1 -- 172.21.15.81:0/2112846322 >> 172.21.15.81:0/2112846322 conn(0x7fdd5009aa30 msgr2=0x7fdd5006fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.348+0000 7fdd5722e640 1 -- 172.21.15.81:0/2112846322 shutdown_connections 2024-09-16T01:16:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.348+0000 7fdd5722e640 1 -- 172.21.15.81:0/2112846322 wait complete. 2024-09-16T01:16:15.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-16T01:16:15.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.481+0000 7f715dad2640 1 Processor -- start 2024-09-16T01:16:15.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.481+0000 7f715dad2640 1 -- start start 2024-09-16T01:16:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.482+0000 7f715dad2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7158072760 0x7f71580cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.482+0000 7f715dad2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71580cec90 con 0x7f715815b7f0 2024-09-16T01:16:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.482+0000 7f715dad2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71580cef70 con 0x7f715815b410 2024-09-16T01:16:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.482+0000 7f715dad2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f71580cf250 con 0x7f7158072760 2024-09-16T01:16:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.482+0000 7f7157fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f715815b7f0 0x7f71580b3260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49734/0 (socket says 172.21.15.81:49734) 2024-09-16T01:16:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.482+0000 7f7157fff640 1 -- 172.21.15.81:0/3960007975 learned_addr learned my addr 172.21.15.81:0/3960007975 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.482+0000 7f7156ffd640 1 --2- 172.21.15.81:0/3960007975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7158072760 0x7f71580cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.482+0000 7f71567fc640 1 -- 172.21.15.81:0/3960007975 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235483787 0 0) 0x7f71580cec90 con 0x7f715815b7f0 2024-09-16T01:16:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.482+0000 7f71567fc640 1 -- 172.21.15.81:0/3960007975 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7144003520 con 0x7f715815b7f0 2024-09-16T01:16:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.482+0000 7f71567fc640 1 -- 172.21.15.81:0/3960007975 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4179154315 0 0) 0x7f71580cef70 con 0x7f715815b410 2024-09-16T01:16:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.482+0000 7f71567fc640 1 -- 172.21.15.81:0/3960007975 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71580cec90 con 0x7f715815b410 2024-09-16T01:16:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.483+0000 7f7156ffd640 1 -- 172.21.15.81:0/3960007975 >> v1:172.21.15.102:6789/0 conn(0x7f715815b410 legacy=0x7f7158072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.483+0000 7f7156ffd640 1 -- 172.21.15.81:0/3960007975 >> v1:172.21.15.81:6789/0 conn(0x7f715815b7f0 legacy=0x7f71580b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.483+0000 7f7156ffd640 1 -- 172.21.15.81:0/3960007975 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71580cf530 con 0x7f7158072760 2024-09-16T01:16:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.483+0000 7f7156ffd640 1 --2- 172.21.15.81:0/3960007975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7158072760 0x7f71580cdfd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7140009df0 tx=0x7f714002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=572cbd1517b24a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.483+0000 7f71567fc640 1 -- 172.21.15.81:0/3960007975 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714002ae60 con 0x7f7158072760 2024-09-16T01:16:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.483+0000 7f71567fc640 1 -- 172.21.15.81:0/3960007975 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7140007740 con 0x7f7158072760 2024-09-16T01:16:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.483+0000 7f71567fc640 1 -- 172.21.15.81:0/3960007975 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7140007b10 con 0x7f7158072760 2024-09-16T01:16:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.484+0000 7f715dad2640 1 -- 172.21.15.81:0/3960007975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7158072760 msgr2=0x7f71580cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.484+0000 7f715dad2640 1 --2- 172.21.15.81:0/3960007975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7158072760 0x7f71580cdfd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7140009df0 tx=0x7f714002a680 comp rx=0 tx=0).stop 2024-09-16T01:16:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.484+0000 7f715dad2640 1 -- 172.21.15.81:0/3960007975 shutdown_connections 2024-09-16T01:16:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.484+0000 7f715dad2640 1 --2- 172.21.15.81:0/3960007975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7158072760 0x7f71580cdfd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.484+0000 7f715dad2640 1 -- 172.21.15.81:0/3960007975 >> 172.21.15.81:0/3960007975 conn(0x7f715806bdf0 msgr2=0x7f715806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.484+0000 7f715dad2640 1 -- 172.21.15.81:0/3960007975 shutdown_connections 2024-09-16T01:16:15.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.484+0000 7f715dad2640 1 -- 172.21.15.81:0/3960007975 wait complete. 2024-09-16T01:16:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.485+0000 7f715dad2640 1 Processor -- start 2024-09-16T01:16:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.485+0000 7f715dad2640 1 -- start start 2024-09-16T01:16:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f715dad2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158072760 0x7f715814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f715dad2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715815b410 0x7f715809dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f715dad2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f715815b7f0 0x7f715809bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f715dad2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71580ce690 con 0x7f7158072760 2024-09-16T01:16:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f715dad2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f71580ce510 con 0x7f715815b410 2024-09-16T01:16:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f715dad2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f71580ce810 con 0x7f715815b7f0 2024-09-16T01:16:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f71577fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158072760 0x7f715814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f71577fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158072760 0x7f715814d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39358/0 (socket says 172.21.15.81:39358) 2024-09-16T01:16:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f71577fe640 1 -- 172.21.15.81:0/1241159909 learned_addr learned my addr 172.21.15.81:0/1241159909 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f7156ffd640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715815b410 0x7f715809dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f7157fff640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f715815b7f0 0x7f715809bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f71577fe640 1 -- 172.21.15.81:0/1241159909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f715815b7f0 msgr2=0x7f715809bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f71577fe640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f715815b7f0 0x7f715809bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f71577fe640 1 -- 172.21.15.81:0/1241159909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715815b410 msgr2=0x7f715809dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f71577fe640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715815b410 0x7f715809dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.486+0000 7f71577fe640 1 -- 172.21.15.81:0/1241159909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715809ace0 con 0x7f7158072760 2024-09-16T01:16:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.487+0000 7f71577fe640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158072760 0x7f715814d4d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f714800c530 tx=0x7f714800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.487+0000 7f714ffff640 1 -- 172.21.15.81:0/1241159909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71480052d0 con 0x7f7158072760 2024-09-16T01:16:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.487+0000 7f715dad2640 1 -- 172.21.15.81:0/1241159909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715814da10 con 0x7f7158072760 2024-09-16T01:16:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.487+0000 7f714ffff640 1 -- 172.21.15.81:0/1241159909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7148005490 con 0x7f7158072760 2024-09-16T01:16:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.487+0000 7f714ffff640 1 -- 172.21.15.81:0/1241159909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148012870 con 0x7f7158072760 2024-09-16T01:16:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.487+0000 7f715dad2640 1 -- 172.21.15.81:0/1241159909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715809b260 con 0x7f7158072760 2024-09-16T01:16:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.488+0000 7f715dad2640 1 -- 172.21.15.81:0/1241159909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71580cdfd0 con 0x7f7158072760 2024-09-16T01:16:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.488+0000 7f714ffff640 1 -- 172.21.15.81:0/1241159909 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7148012a10 con 0x7f7158072760 2024-09-16T01:16:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.489+0000 7f714ffff640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f713806c2b0 0x7f713806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.489+0000 7f714ffff640 1 -- 172.21.15.81:0/1241159909 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f714808b250 con 0x7f7158072760 2024-09-16T01:16:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.489+0000 7f7156ffd640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f713806c2b0 0x7f713806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.489+0000 7f7156ffd640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f713806c2b0 0x7f713806e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7140034000 tx=0x7f714002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.493+0000 7f714ffff640 1 -- 172.21.15.81:0/1241159909 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7148059040 con 0x7f7158072760 2024-09-16T01:16:15.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.661+0000 7f715dad2640 1 -- 172.21.15.81:0/1241159909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f71580b4a50 con 0x7f7158072760 2024-09-16T01:16:15.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.662+0000 7f714ffff640 1 -- 172.21.15.81:0/1241159909 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f714805d340 con 0x7f7158072760 2024-09-16T01:16:15.663 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-16T01:16:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.664+0000 7f715dad2640 1 -- 172.21.15.81:0/1241159909 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f713806c2b0 msgr2=0x7f713806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.664+0000 7f715dad2640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f713806c2b0 0x7f713806e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7140034000 tx=0x7f714002f000 comp rx=0 tx=0).stop 2024-09-16T01:16:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.664+0000 7f715dad2640 1 -- 172.21.15.81:0/1241159909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158072760 msgr2=0x7f715814d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.664+0000 7f715dad2640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158072760 0x7f715814d4d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f714800c530 tx=0x7f714800c9f0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.664+0000 7f715dad2640 1 -- 172.21.15.81:0/1241159909 shutdown_connections 2024-09-16T01:16:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.664+0000 7f715dad2640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f713806c2b0 0x7f713806e770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.664+0000 7f715dad2640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f715815b7f0 0x7f715809bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.664+0000 7f715dad2640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f715815b410 0x7f715809dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.664+0000 7f715dad2640 1 --2- 172.21.15.81:0/1241159909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7158072760 0x7f715814d4d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.664+0000 7f715dad2640 1 -- 172.21.15.81:0/1241159909 >> 172.21.15.81:0/1241159909 conn(0x7f715806bdf0 msgr2=0x7f715806f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.664+0000 7f715dad2640 1 -- 172.21.15.81:0/1241159909 shutdown_connections 2024-09-16T01:16:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.664+0000 7f715dad2640 1 -- 172.21.15.81:0/1241159909 wait complete. 2024-09-16T01:16:15.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-16T01:16:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.818+0000 7fa6dc126640 1 Processor -- start 2024-09-16T01:16:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.818+0000 7fa6dc126640 1 -- start start 2024-09-16T01:16:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.819+0000 7fa6dc126640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6d415e7f0 0x7fa6d40b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.819+0000 7fa6dc126640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6d40af210 0x7fa6d4070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.819+0000 7fa6dc126640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6d406cdc0 con 0x7fa6d40b7250 2024-09-16T01:16:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.819+0000 7fa6dc126640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa6d406d0a0 con 0x7fa6d415e7f0 2024-09-16T01:16:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.819+0000 7fa6dc126640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d406d380 con 0x7fa6d40af210 2024-09-16T01:16:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.819+0000 7fa6d9ec2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6d415e7f0 0x7fa6d40b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.819+0000 7fa6d96c1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6d40af210 0x7fa6d4070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.819+0000 7fa6da6c3640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa6d40b7250 0x7fa6d409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:53152/0 (socket says 172.21.15.81:53152) 2024-09-16T01:16:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.819+0000 7fa6da6c3640 1 -- 172.21.15.81:0/1674492049 learned_addr learned my addr 172.21.15.81:0/1674492049 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.820+0000 7fa6d9ec2640 1 -- 172.21.15.81:0/1674492049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6d40af210 msgr2=0x7fa6d4070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.820+0000 7fa6d9ec2640 1 --2- 172.21.15.81:0/1674492049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6d40af210 0x7fa6d4070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.820+0000 7fa6d9ec2640 1 -- 172.21.15.81:0/1674492049 >> v1:172.21.15.102:6789/0 conn(0x7fa6d40b7250 legacy=0x7fa6d409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.820+0000 7fa6d9ec2640 1 -- 172.21.15.81:0/1674492049 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d406d660 con 0x7fa6d415e7f0 2024-09-16T01:16:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.820+0000 7fa6d8ec0640 1 -- 172.21.15.81:0/1674492049 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921589473 0 0) 0x7fa6d406cdc0 con 0x7fa6d40b7250 2024-09-16T01:16:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.820+0000 7fa6d96c1640 1 --2- 172.21.15.81:0/1674492049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6d40af210 0x7fa6d4070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:16:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.820+0000 7fa6d9ec2640 1 --2- 172.21.15.81:0/1674492049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6d415e7f0 0x7fa6d40b6d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00097a0 tx=0x7fa6d002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4176360069f9fab server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.821+0000 7fa6d8ec0640 1 -- 172.21.15.81:0/1674492049 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0037070 con 0x7fa6d415e7f0 2024-09-16T01:16:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.821+0000 7fa6d8ec0640 1 -- 172.21.15.81:0/1674492049 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6d0032440 con 0x7fa6d415e7f0 2024-09-16T01:16:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.821+0000 7fa6d8ec0640 1 -- 172.21.15.81:0/1674492049 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0032810 con 0x7fa6d415e7f0 2024-09-16T01:16:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.821+0000 7fa6dc126640 1 -- 172.21.15.81:0/1674492049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6d415e7f0 msgr2=0x7fa6d40b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.821+0000 7fa6dc126640 1 --2- 172.21.15.81:0/1674492049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6d415e7f0 0x7fa6d40b6d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00097a0 tx=0x7fa6d002a180 comp rx=0 tx=0).stop 2024-09-16T01:16:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.821+0000 7fa6dc126640 1 -- 172.21.15.81:0/1674492049 shutdown_connections 2024-09-16T01:16:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.821+0000 7fa6dc126640 1 --2- 172.21.15.81:0/1674492049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6d40af210 0x7fa6d4070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.821+0000 7fa6dc126640 1 --2- 172.21.15.81:0/1674492049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6d415e7f0 0x7fa6d40b6d10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.821+0000 7fa6dc126640 1 -- 172.21.15.81:0/1674492049 >> 172.21.15.81:0/1674492049 conn(0x7fa6d40b3f30 msgr2=0x7fa6d40b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.821+0000 7fa6dc126640 1 -- 172.21.15.81:0/1674492049 shutdown_connections 2024-09-16T01:16:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.821+0000 7fa6dc126640 1 -- 172.21.15.81:0/1674492049 wait complete. 2024-09-16T01:16:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.822+0000 7fa6dc126640 1 Processor -- start 2024-09-16T01:16:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.822+0000 7fa6dc126640 1 -- start start 2024-09-16T01:16:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.823+0000 7fa6dc126640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6d40af210 0x7fa6d414afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.823+0000 7fa6dc126640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6d40b7250 0x7fa6d4160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.823+0000 7fa6dc126640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d415e7f0 0x7fa6d4160580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.823+0000 7fa6dc126640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d4070fb0 con 0x7fa6d415e7f0 2024-09-16T01:16:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.823+0000 7fa6dc126640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d40b6150 con 0x7fa6d40b7250 2024-09-16T01:16:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.823+0000 7fa6dc126640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d4071130 con 0x7fa6d40af210 2024-09-16T01:16:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.823+0000 7fa6da6c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d415e7f0 0x7fa6d4160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.823+0000 7fa6da6c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d415e7f0 0x7fa6d4160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39368/0 (socket says 172.21.15.81:39368) 2024-09-16T01:16:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.823+0000 7fa6da6c3640 1 -- 172.21.15.81:0/1950836663 learned_addr learned my addr 172.21.15.81:0/1950836663 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.823+0000 7fa6d9ec2640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6d40af210 0x7fa6d414afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.823+0000 7fa6d96c1640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6d40b7250 0x7fa6d4160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.824+0000 7fa6da6c3640 1 -- 172.21.15.81:0/1950836663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6d40af210 msgr2=0x7fa6d414afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.824+0000 7fa6da6c3640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6d40af210 0x7fa6d414afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.824+0000 7fa6da6c3640 1 -- 172.21.15.81:0/1950836663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6d40b7250 msgr2=0x7fa6d4160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.824+0000 7fa6da6c3640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6d40b7250 0x7fa6d4160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.824+0000 7fa6da6c3640 1 -- 172.21.15.81:0/1950836663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d40cc2a0 con 0x7fa6d415e7f0 2024-09-16T01:16:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.824+0000 7fa6da6c3640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d415e7f0 0x7fa6d4160580 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00c730 tx=0x7fa6cc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.824+0000 7fa6ca7fc640 1 -- 172.21.15.81:0/1950836663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc018070 con 0x7fa6d415e7f0 2024-09-16T01:16:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.824+0000 7fa6ca7fc640 1 -- 172.21.15.81:0/1950836663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6cc00ce40 con 0x7fa6d415e7f0 2024-09-16T01:16:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.824+0000 7fa6dc126640 1 -- 172.21.15.81:0/1950836663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d40cc580 con 0x7fa6d415e7f0 2024-09-16T01:16:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.824+0000 7fa6ca7fc640 1 -- 172.21.15.81:0/1950836663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00a860 con 0x7fa6d415e7f0 2024-09-16T01:16:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.824+0000 7fa6dc126640 1 -- 172.21.15.81:0/1950836663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d40ccb40 con 0x7fa6d415e7f0 2024-09-16T01:16:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.825+0000 7fa6dc126640 1 -- 172.21.15.81:0/1950836663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d4070a70 con 0x7fa6d415e7f0 2024-09-16T01:16:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.825+0000 7fa6ca7fc640 1 -- 172.21.15.81:0/1950836663 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa6cc01b070 con 0x7fa6d415e7f0 2024-09-16T01:16:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.826+0000 7fa6ca7fc640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa6b806c2e0 0x7fa6b806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.826+0000 7fa6d9ec2640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa6b806c2e0 0x7fa6b806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.826+0000 7fa6ca7fc640 1 -- 172.21.15.81:0/1950836663 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa6cc08abd0 con 0x7fa6d415e7f0 2024-09-16T01:16:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.826+0000 7fa6d9ec2640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa6b806c2e0 0x7fa6b806e7a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0034000 tx=0x7fa6d002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:15.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:15.834+0000 7fa6ca7fc640 1 -- 172.21.15.81:0/1950836663 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6cc058a40 con 0x7fa6d415e7f0 2024-09-16T01:16:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.000+0000 7fa6dc126640 1 -- 172.21.15.81:0/1950836663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa6d40b2390 con 0x7fa6d415e7f0 2024-09-16T01:16:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.001+0000 7fa6ca7fc640 1 -- 172.21.15.81:0/1950836663 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7fa6cc05cd40 con 0x7fa6d415e7f0 2024-09-16T01:16:16.002 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-16T01:16:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.003+0000 7fa6dc126640 1 -- 172.21.15.81:0/1950836663 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa6b806c2e0 msgr2=0x7fa6b806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.003+0000 7fa6dc126640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa6b806c2e0 0x7fa6b806e7a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0034000 tx=0x7fa6d002e000 comp rx=0 tx=0).stop 2024-09-16T01:16:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.003+0000 7fa6dc126640 1 -- 172.21.15.81:0/1950836663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d415e7f0 msgr2=0x7fa6d4160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.003+0000 7fa6dc126640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d415e7f0 0x7fa6d4160580 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00c730 tx=0x7fa6cc00cbf0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.003+0000 7fa6dc126640 1 -- 172.21.15.81:0/1950836663 shutdown_connections 2024-09-16T01:16:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.003+0000 7fa6dc126640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa6b806c2e0 0x7fa6b806e7a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.003+0000 7fa6dc126640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d415e7f0 0x7fa6d4160580 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.003+0000 7fa6dc126640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa6d40b7250 0x7fa6d4160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.003+0000 7fa6dc126640 1 --2- 172.21.15.81:0/1950836663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa6d40af210 0x7fa6d414afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.003+0000 7fa6dc126640 1 -- 172.21.15.81:0/1950836663 >> 172.21.15.81:0/1950836663 conn(0x7fa6d40b3f30 msgr2=0x7fa6d4161570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.003+0000 7fa6dc126640 1 -- 172.21.15.81:0/1950836663 shutdown_connections 2024-09-16T01:16:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.003+0000 7fa6dc126640 1 -- 172.21.15.81:0/1950836663 wait complete. 2024-09-16T01:16:16.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir' 2024-09-16T01:16:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.113+0000 7f829b9c4640 1 Processor -- start 2024-09-16T01:16:16.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.114+0000 7f829b9c4640 1 -- start start 2024-09-16T01:16:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.114+0000 7f829b9c4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f82940d1090 0x7f829409b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.114+0000 7f829b9c4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82940b1620 0x7f82940b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.114+0000 7f829b9c4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82940cec00 con 0x7f829415c520 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.114+0000 7f829b9c4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f829409bd90 con 0x7f82940b1620 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.114+0000 7f829b9c4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f82940d0010 con 0x7f82940d1090 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.114+0000 7f8299760640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f829415c520 0x7f82940d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49750/0 (socket says 172.21.15.81:49750) 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.114+0000 7f8299760640 1 -- 172.21.15.81:0/2922781656 learned_addr learned my addr 172.21.15.81:0/2922781656 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.115+0000 7f8299f61640 1 --2- 172.21.15.81:0/2922781656 >> v2:172.21.15.81:3300/0 conn(0x7f82940b1620 0x7f82940b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.115+0000 7f8287fff640 1 -- 172.21.15.81:0/2922781656 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309374933 0 0) 0x7f82940cec00 con 0x7f829415c520 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.115+0000 7f8287fff640 1 -- 172.21.15.81:0/2922781656 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8280003520 con 0x7f829415c520 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.115+0000 7f8298f5f640 1 --2- 172.21.15.81:0/2922781656 >> v2:172.21.15.102:3300/0 conn(0x7f82940d1090 0x7f829409b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.115+0000 7f8299f61640 1 -- 172.21.15.81:0/2922781656 >> v2:172.21.15.102:3300/0 conn(0x7f82940d1090 msgr2=0x7f829409b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.115+0000 7f8299f61640 1 --2- 172.21.15.81:0/2922781656 >> v2:172.21.15.102:3300/0 conn(0x7f82940d1090 0x7f829409b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.115+0000 7f8299f61640 1 -- 172.21.15.81:0/2922781656 >> v1:172.21.15.81:6789/0 conn(0x7f829415c520 legacy=0x7f82940d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.115+0000 7f8299f61640 1 -- 172.21.15.81:0/2922781656 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82940d02f0 con 0x7f82940b1620 2024-09-16T01:16:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.116+0000 7f8299f61640 1 --2- 172.21.15.81:0/2922781656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82940b1620 0x7f82940b1d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f82940730f0 tx=0x7f828c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312911a0b9e4ef9e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.116+0000 7f8287fff640 1 -- 172.21.15.81:0/2922781656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c007740 con 0x7f82940b1620 2024-09-16T01:16:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.116+0000 7f8287fff640 1 -- 172.21.15.81:0/2922781656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828c0078e0 con 0x7f82940b1620 2024-09-16T01:16:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.116+0000 7f8287fff640 1 -- 172.21.15.81:0/2922781656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c007cb0 con 0x7f82940b1620 2024-09-16T01:16:16.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.116+0000 7f829b9c4640 1 -- 172.21.15.81:0/2922781656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82940b1620 msgr2=0x7f82940b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.116+0000 7f829b9c4640 1 --2- 172.21.15.81:0/2922781656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82940b1620 0x7f82940b1d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f82940730f0 tx=0x7f828c02a680 comp rx=0 tx=0).stop 2024-09-16T01:16:16.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.116+0000 7f829b9c4640 1 -- 172.21.15.81:0/2922781656 shutdown_connections 2024-09-16T01:16:16.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.116+0000 7f829b9c4640 1 --2- 172.21.15.81:0/2922781656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82940b1620 0x7f82940b1d40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.116+0000 7f829b9c4640 1 --2- 172.21.15.81:0/2922781656 >> v2:172.21.15.102:3300/0 conn(0x7f82940d1090 0x7f829409b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.116+0000 7f829b9c4640 1 -- 172.21.15.81:0/2922781656 >> 172.21.15.81:0/2922781656 conn(0x7f82940d23a0 msgr2=0x7f82940d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.116+0000 7f829b9c4640 1 -- 172.21.15.81:0/2922781656 shutdown_connections 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.116+0000 7f829b9c4640 1 -- 172.21.15.81:0/2922781656 wait complete. 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.117+0000 7f829b9c4640 1 Processor -- start 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.118+0000 7f829b9c4640 1 -- start start 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.118+0000 7f829b9c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82940b1620 0x7f829406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.118+0000 7f829b9c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82940d1090 0x7f82941f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.118+0000 7f829b9c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f829415c520 0x7f82941f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.118+0000 7f829b9c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f829415c900 con 0x7f82940b1620 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.118+0000 7f829b9c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f82940d05d0 con 0x7f82940d1090 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.118+0000 7f829b9c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f829415b0c0 con 0x7f829415c520 2024-09-16T01:16:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.118+0000 7f8299760640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82940b1620 0x7f829406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.118+0000 7f8299760640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82940b1620 0x7f829406d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39386/0 (socket says 172.21.15.81:39386) 2024-09-16T01:16:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.118+0000 7f8299760640 1 -- 172.21.15.81:0/760168074 learned_addr learned my addr 172.21.15.81:0/760168074 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.118+0000 7f8298f5f640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82940d1090 0x7f82941f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.119+0000 7f8299f61640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f829415c520 0x7f82941f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.119+0000 7f8299760640 1 -- 172.21.15.81:0/760168074 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f829415c520 msgr2=0x7f82941f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.119+0000 7f8299760640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f829415c520 0x7f82941f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.119+0000 7f8299760640 1 -- 172.21.15.81:0/760168074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82940d1090 msgr2=0x7f82941f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.119+0000 7f8299760640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82940d1090 0x7f82941f45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.119+0000 7f8299760640 1 -- 172.21.15.81:0/760168074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82941e6ce0 con 0x7f82940b1620 2024-09-16T01:16:16.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.119+0000 7f8299760640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82940b1620 0x7f829406d9b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f829000c3c0 tx=0x7f829000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:16.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.119+0000 7f8285ffb640 1 -- 172.21.15.81:0/760168074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290017070 con 0x7f82940b1620 2024-09-16T01:16:16.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.119+0000 7f8285ffb640 1 -- 172.21.15.81:0/760168074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8290005ce0 con 0x7f82940b1620 2024-09-16T01:16:16.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.119+0000 7f8285ffb640 1 -- 172.21.15.81:0/760168074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82900072f0 con 0x7f82940b1620 2024-09-16T01:16:16.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.119+0000 7f829b9c4640 1 -- 172.21.15.81:0/760168074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82941e6fc0 con 0x7f82940b1620 2024-09-16T01:16:16.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.119+0000 7f829b9c4640 1 -- 172.21.15.81:0/760168074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82941e7580 con 0x7f82940b1620 2024-09-16T01:16:16.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.120+0000 7f829b9c4640 1 -- 172.21.15.81:0/760168074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82940b1d40 con 0x7f82940b1620 2024-09-16T01:16:16.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.120+0000 7f8285ffb640 1 -- 172.21.15.81:0/760168074 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f829001a070 con 0x7f82940b1620 2024-09-16T01:16:16.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.121+0000 7f8285ffb640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f827806c2b0 0x7f827806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.121+0000 7f8285ffb640 1 -- 172.21.15.81:0/760168074 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f829008ab90 con 0x7f82940b1620 2024-09-16T01:16:16.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.121+0000 7f8298f5f640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f827806c2b0 0x7f827806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.121+0000 7f8298f5f640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f827806c2b0 0x7f827806e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f829406d630 tx=0x7f8288008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:16.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.125+0000 7f8285ffb640 1 -- 172.21.15.81:0/760168074 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8290058fa0 con 0x7f82940b1620 2024-09-16T01:16:16.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.355+0000 7f829b9c4640 1 -- 172.21.15.81:0/760168074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]} v 0) -- 0x7f82940c5820 con 0x7f82940b1620 2024-09-16T01:16:16.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.833+0000 7f8285ffb640 1 -- 172.21.15.81:0/760168074 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]}]=0 v56) ==== 168+0+0 (secure 0 0 0) 0x7f82900588a0 con 0x7f82940b1620 2024-09-16T01:16:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.836+0000 7f829b9c4640 1 -- 172.21.15.81:0/760168074 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f827806c2b0 msgr2=0x7f827806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.836+0000 7f829b9c4640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f827806c2b0 0x7f827806e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f829406d630 tx=0x7f8288008040 comp rx=0 tx=0).stop 2024-09-16T01:16:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.836+0000 7f829b9c4640 1 -- 172.21.15.81:0/760168074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82940b1620 msgr2=0x7f829406d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.836+0000 7f829b9c4640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82940b1620 0x7f829406d9b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f829000c3c0 tx=0x7f829000c880 comp rx=0 tx=0).stop 2024-09-16T01:16:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.836+0000 7f829b9c4640 1 -- 172.21.15.81:0/760168074 shutdown_connections 2024-09-16T01:16:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.836+0000 7f829b9c4640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f827806c2b0 0x7f827806e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.836+0000 7f829b9c4640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f829415c520 0x7f82941f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.836+0000 7f829b9c4640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82940d1090 0x7f82941f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.836+0000 7f829b9c4640 1 --2- 172.21.15.81:0/760168074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82940b1620 0x7f829406d9b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.836+0000 7f829b9c4640 1 -- 172.21.15.81:0/760168074 >> 172.21.15.81:0/760168074 conn(0x7f82940d23a0 msgr2=0x7f82940d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.836+0000 7f829b9c4640 1 -- 172.21.15.81:0/760168074 shutdown_connections 2024-09-16T01:16:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.836+0000 7f829b9c4640 1 -- 172.21.15.81:0/760168074 wait complete. 2024-09-16T01:16:16.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T01:16:16.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.951+0000 7f1c86db7640 1 Processor -- start 2024-09-16T01:16:16.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.951+0000 7f1c86db7640 1 -- start start 2024-09-16T01:16:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.952+0000 7f1c86db7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c80156740 0x7f1c800b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.952+0000 7f1c86db7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c800b30e0 con 0x7f1c800cfea0 2024-09-16T01:16:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.952+0000 7f1c86db7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c800b33c0 con 0x7f1c800b4af0 2024-09-16T01:16:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.952+0000 7f1c86db7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1c8006edc0 con 0x7f1c80156740 2024-09-16T01:16:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.952+0000 7f1c85354640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1c800cfea0 0x7f1c800ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49766/0 (socket says 172.21.15.81:49766) 2024-09-16T01:16:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.952+0000 7f1c85354640 1 -- 172.21.15.81:0/1405719097 learned_addr learned my addr 172.21.15.81:0/1405719097 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.952+0000 7f1c84b53640 1 --2- 172.21.15.81:0/1405719097 >> v2:172.21.15.102:3300/0 conn(0x7f1c80156740 0x7f1c800b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.952+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506217395 0 0) 0x7f1c800b30e0 con 0x7f1c800cfea0 2024-09-16T01:16:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.952+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c68003520 con 0x7f1c800cfea0 2024-09-16T01:16:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2109599797 0 0) 0x7f1c800b33c0 con 0x7f1c800b4af0 2024-09-16T01:16:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c800b30e0 con 0x7f1c800b4af0 2024-09-16T01:16:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 958926918 0 0) 0x7f1c68003520 con 0x7f1c800cfea0 2024-09-16T01:16:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 >> v2:172.21.15.102:3300/0 conn(0x7f1c80156740 msgr2=0x7f1c800b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 --2- 172.21.15.81:0/1405719097 >> v2:172.21.15.102:3300/0 conn(0x7f1c80156740 0x7f1c800b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 >> v1:172.21.15.102:6789/0 conn(0x7f1c800b4af0 legacy=0x7f1c800cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c800b36a0 con 0x7f1c800cfea0 2024-09-16T01:16:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f1c780019f0 con 0x7f1c800cfea0 2024-09-16T01:16:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 >> v1:172.21.15.81:6789/0 conn(0x7f1c800cfea0 legacy=0x7f1c800ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 --2- 172.21.15.81:0/1405719097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68003b90 0x7f1c68003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 --2- 172.21.15.81:0/1405719097 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c68004800 0x7f1c68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 --2- 172.21.15.81:0/1405719097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c680051c0 0x7f1c6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8006edc0 con 0x7f1c68003b90 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6800c090 con 0x7f1c680051c0 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1c6800c290 con 0x7f1c68004800 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c84b53640 1 --2- 172.21.15.81:0/1405719097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68003b90 0x7f1c68003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c85354640 1 --2- 172.21.15.81:0/1405719097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c680051c0 0x7f1c6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c7ffff640 1 --2- 172.21.15.81:0/1405719097 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c68004800 0x7f1c68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c84b53640 1 -- 172.21.15.81:0/1405719097 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c68004800 msgr2=0x7f1c68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c84b53640 1 --2- 172.21.15.81:0/1405719097 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c68004800 0x7f1c68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c84b53640 1 -- 172.21.15.81:0/1405719097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c680051c0 msgr2=0x7f1c6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c84b53640 1 --2- 172.21.15.81:0/1405719097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c680051c0 0x7f1c6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c85354640 1 -- 172.21.15.81:0/1405719097 reap_dead start 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.953+0000 7f1c84b53640 1 -- 172.21.15.81:0/1405719097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c68003520 con 0x7f1c68003b90 2024-09-16T01:16:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.954+0000 7f1c84b53640 1 --2- 172.21.15.81:0/1405719097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68003b90 0x7f1c68003f90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009ac0 tx=0x7f1c68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f38f3aeeb29c1bc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.954+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70036070 con 0x7f1c68003b90 2024-09-16T01:16:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.954+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c70031400 con 0x7f1c68003b90 2024-09-16T01:16:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.954+0000 7f1c7f7fe640 1 -- 172.21.15.81:0/1405719097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70009690 con 0x7f1c68003b90 2024-09-16T01:16:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.954+0000 7f1c86db7640 1 -- 172.21.15.81:0/1405719097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68003b90 msgr2=0x7f1c68003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.954+0000 7f1c86db7640 1 --2- 172.21.15.81:0/1405719097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68003b90 0x7f1c68003f90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009ac0 tx=0x7f1c68005830 comp rx=0 tx=0).stop 2024-09-16T01:16:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.954+0000 7f1c86db7640 1 -- 172.21.15.81:0/1405719097 shutdown_connections 2024-09-16T01:16:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.954+0000 7f1c86db7640 1 --2- 172.21.15.81:0/1405719097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c68003b90 0x7f1c68003f90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.954+0000 7f1c86db7640 1 -- 172.21.15.81:0/1405719097 >> 172.21.15.81:0/1405719097 conn(0x7f1c8006bdf0 msgr2=0x7f1c8006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.954+0000 7f1c86db7640 1 -- 172.21.15.81:0/1405719097 shutdown_connections 2024-09-16T01:16:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.955+0000 7f1c86db7640 1 -- 172.21.15.81:0/1405719097 wait complete. 2024-09-16T01:16:16.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.956+0000 7f1c86db7640 1 Processor -- start 2024-09-16T01:16:16.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.956+0000 7f1c86db7640 1 -- start start 2024-09-16T01:16:16.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.956+0000 7f1c86db7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c68003b90 0x7f1c801f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.956+0000 7f1c86db7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c801586a0 0x7f1c801577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.956+0000 7f1c86db7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8014e5c0 0x7f1c801501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c86db7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c800d0890 con 0x7f1c8014e5c0 2024-09-16T01:16:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c86db7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1c800b3c60 con 0x7f1c68003b90 2024-09-16T01:16:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c86db7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1c800d0a10 con 0x7f1c801586a0 2024-09-16T01:16:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c85354640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8014e5c0 0x7f1c801501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c85354640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8014e5c0 0x7f1c801501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39416/0 (socket says 172.21.15.81:39416) 2024-09-16T01:16:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c85354640 1 -- 172.21.15.81:0/3346953690 learned_addr learned my addr 172.21.15.81:0/3346953690 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c84b53640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c68003b90 0x7f1c801f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c7ffff640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c801586a0 0x7f1c801577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c85354640 1 -- 172.21.15.81:0/3346953690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c801586a0 msgr2=0x7f1c801577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c85354640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c801586a0 0x7f1c801577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c85354640 1 -- 172.21.15.81:0/3346953690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c68003b90 msgr2=0x7f1c801f1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c85354640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c68003b90 0x7f1c801f1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c85354640 1 -- 172.21.15.81:0/3346953690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c801528c0 con 0x7f1c8014e5c0 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c85354640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8014e5c0 0x7f1c801501f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1c800740b0 tx=0x7f1c78007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c7d7fa640 1 -- 172.21.15.81:0/3346953690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7800e9e0 con 0x7f1c8014e5c0 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c7d7fa640 1 -- 172.21.15.81:0/3346953690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c7800eb80 con 0x7f1c8014e5c0 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c86db7640 1 -- 172.21.15.81:0/3346953690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c80152ba0 con 0x7f1c8014e5c0 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c7d7fa640 1 -- 172.21.15.81:0/3346953690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c78014430 con 0x7f1c8014e5c0 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.957+0000 7f1c86db7640 1 -- 172.21.15.81:0/3346953690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c80153160 con 0x7f1c8014e5c0 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.958+0000 7f1c86db7640 1 -- 172.21.15.81:0/3346953690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c80156bb0 con 0x7f1c8014e5c0 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.959+0000 7f1c7d7fa640 1 -- 172.21.15.81:0/3346953690 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1c780145d0 con 0x7f1c8014e5c0 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.959+0000 7f1c7d7fa640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c6c06c2e0 0x7f1c6c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.959+0000 7f1c7d7fa640 1 -- 172.21.15.81:0/3346953690 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1c7808b3e0 con 0x7f1c8014e5c0 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.959+0000 7f1c84b53640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c6c06c2e0 0x7f1c6c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.960+0000 7f1c84b53640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c6c06c2e0 0x7f1c6c06e7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c70033000 tx=0x7f1c70008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:16.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:16.963+0000 7f1c7d7fa640 1 -- 172.21.15.81:0/3346953690 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c78059810 con 0x7f1c8014e5c0 2024-09-16T01:16:17.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.130+0000 7f1c86db7640 1 -- 172.21.15.81:0/3346953690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1c801521c0 con 0x7f1c8014e5c0 2024-09-16T01:16:17.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.135+0000 7f1c7d7fa640 1 -- 172.21.15.81:0/3346953690 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f1c78059110 con 0x7f1c8014e5c0 2024-09-16T01:16:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.138+0000 7f1c86db7640 1 -- 172.21.15.81:0/3346953690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c6c06c2e0 msgr2=0x7f1c6c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.138+0000 7f1c86db7640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c6c06c2e0 0x7f1c6c06e7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c70033000 tx=0x7f1c70008030 comp rx=0 tx=0).stop 2024-09-16T01:16:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.138+0000 7f1c86db7640 1 -- 172.21.15.81:0/3346953690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8014e5c0 msgr2=0x7f1c801501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.138+0000 7f1c86db7640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8014e5c0 0x7f1c801501f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1c800740b0 tx=0x7f1c78007a80 comp rx=0 tx=0).stop 2024-09-16T01:16:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.138+0000 7f1c86db7640 1 -- 172.21.15.81:0/3346953690 shutdown_connections 2024-09-16T01:16:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.138+0000 7f1c86db7640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c6c06c2e0 0x7f1c6c06e7a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.138+0000 7f1c86db7640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c8014e5c0 0x7f1c801501f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.138+0000 7f1c86db7640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c801586a0 0x7f1c801577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.138+0000 7f1c86db7640 1 --2- 172.21.15.81:0/3346953690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c68003b90 0x7f1c801f1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.138+0000 7f1c86db7640 1 -- 172.21.15.81:0/3346953690 >> 172.21.15.81:0/3346953690 conn(0x7f1c8006bdf0 msgr2=0x7f1c8015bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:17.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.138+0000 7f1c86db7640 1 -- 172.21.15.81:0/3346953690 shutdown_connections 2024-09-16T01:16:17.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.138+0000 7f1c86db7640 1 -- 172.21.15.81:0/3346953690 wait complete. 2024-09-16T01:16:17.150 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:16:17.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:16:17.186 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:16:17.232 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:16:17.232 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:17.232 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:17.248 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:17.248 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:17.303 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:17.303 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:17.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:16:17.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.497+0000 7f8659bc4640 1 Processor -- start 2024-09-16T01:16:17.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.497+0000 7f8659bc4640 1 -- start start 2024-09-16T01:16:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.498+0000 7f8659bc4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f865415e740 0x7f86540d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.498+0000 7f8659bc4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f865409b690 0x7f865406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:17.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.498+0000 7f8659bc4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f865406e020 con 0x7f865406d4c0 2024-09-16T01:16:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.498+0000 7f8659bc4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f865415eb20 con 0x7f865409b690 2024-09-16T01:16:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.498+0000 7f8659bc4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f865406d260 con 0x7f865415e740 2024-09-16T01:16:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.498+0000 7f8652ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f865409b690 0x7f865406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.498+0000 7f8652ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f865409b690 0x7f865406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39418/0 (socket says 172.21.15.81:39418) 2024-09-16T01:16:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.498+0000 7f8652ffd640 1 -- 172.21.15.81:0/3201395486 learned_addr learned my addr 172.21.15.81:0/3201395486 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.499+0000 7f86537fe640 1 --2- 172.21.15.81:0/3201395486 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f865415e740 0x7f86540d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.499+0000 7f8652ffd640 1 -- 172.21.15.81:0/3201395486 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f865415e740 msgr2=0x7f86540d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.499+0000 7f8652ffd640 1 --2- 172.21.15.81:0/3201395486 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f865415e740 0x7f86540d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.499+0000 7f8652ffd640 1 -- 172.21.15.81:0/3201395486 >> v1:172.21.15.102:6789/0 conn(0x7f865406d4c0 legacy=0x7f865406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.499+0000 7f8652ffd640 1 -- 172.21.15.81:0/3201395486 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86540d0780 con 0x7f865409b690 2024-09-16T01:16:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.499+0000 7f8652ffd640 1 --2- 172.21.15.81:0/3201395486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865409b690 0x7f865406cd20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f86480098a0 tx=0x7f864802a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de71b3287b8ef7de server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.499+0000 7f86527fc640 1 -- 172.21.15.81:0/3201395486 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648037070 con 0x7f865409b690 2024-09-16T01:16:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.499+0000 7f86527fc640 1 -- 172.21.15.81:0/3201395486 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8648032440 con 0x7f865409b690 2024-09-16T01:16:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.500+0000 7f86527fc640 1 -- 172.21.15.81:0/3201395486 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648032810 con 0x7f865409b690 2024-09-16T01:16:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.500+0000 7f8659bc4640 1 -- 172.21.15.81:0/3201395486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865409b690 msgr2=0x7f865406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.500+0000 7f8659bc4640 1 --2- 172.21.15.81:0/3201395486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865409b690 0x7f865406cd20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f86480098a0 tx=0x7f864802a2e0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.500+0000 7f8659bc4640 1 -- 172.21.15.81:0/3201395486 shutdown_connections 2024-09-16T01:16:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.500+0000 7f8659bc4640 1 --2- 172.21.15.81:0/3201395486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865409b690 0x7f865406cd20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.500+0000 7f8659bc4640 1 --2- 172.21.15.81:0/3201395486 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f865415e740 0x7f86540d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.500+0000 7f8659bc4640 1 -- 172.21.15.81:0/3201395486 >> 172.21.15.81:0/3201395486 conn(0x7f86540d23a0 msgr2=0x7f86540d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.500+0000 7f8659bc4640 1 -- 172.21.15.81:0/3201395486 shutdown_connections 2024-09-16T01:16:17.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.500+0000 7f8659bc4640 1 -- 172.21.15.81:0/3201395486 wait complete. 2024-09-16T01:16:17.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.502+0000 7f8659bc4640 1 Processor -- start 2024-09-16T01:16:17.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.502+0000 7f8659bc4640 1 -- start start 2024-09-16T01:16:17.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f8659bc4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406d4c0 0x7f865414f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:17.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f8659bc4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f865409b690 0x7f86541f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f8659bc4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f865415e740 0x7f86541f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f8659bc4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f86540d1020 con 0x7f865406d4c0 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f8659bc4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f86540d0d40 con 0x7f865415e740 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f8659bc4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f865409ba90 con 0x7f865409b690 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f86537fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406d4c0 0x7f865414f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f86537fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406d4c0 0x7f865414f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39432/0 (socket says 172.21.15.81:39432) 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f86537fe640 1 -- 172.21.15.81:0/1013972018 learned_addr learned my addr 172.21.15.81:0/1013972018 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f8652ffd640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f865409b690 0x7f86541f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f8653fff640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f865415e740 0x7f86541f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f86537fe640 1 -- 172.21.15.81:0/1013972018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f865409b690 msgr2=0x7f86541f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f86537fe640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f865409b690 0x7f86541f7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f86537fe640 1 -- 172.21.15.81:0/1013972018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f865415e740 msgr2=0x7f86541f84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:17.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f86537fe640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f865415e740 0x7f86541f84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f86537fe640 1 -- 172.21.15.81:0/1013972018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865414f6d0 con 0x7f865406d4c0 2024-09-16T01:16:17.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f86537fe640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406d4c0 0x7f865414f190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f864400d830 tx=0x7f864400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:17.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f863bfff640 1 -- 172.21.15.81:0/1013972018 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864400b6c0 con 0x7f865406d4c0 2024-09-16T01:16:17.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f863bfff640 1 -- 172.21.15.81:0/1013972018 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8644019070 con 0x7f865406d4c0 2024-09-16T01:16:17.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f8659bc4640 1 -- 172.21.15.81:0/1013972018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86540b7b70 con 0x7f865406d4c0 2024-09-16T01:16:17.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.503+0000 7f863bfff640 1 -- 172.21.15.81:0/1013972018 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864400ba80 con 0x7f865406d4c0 2024-09-16T01:16:17.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.504+0000 7f8659bc4640 1 -- 172.21.15.81:0/1013972018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865414fb40 con 0x7f865406d4c0 2024-09-16T01:16:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.505+0000 7f8659bc4640 1 -- 172.21.15.81:0/1013972018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86540b8090 con 0x7f865406d4c0 2024-09-16T01:16:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.505+0000 7f863bfff640 1 -- 172.21.15.81:0/1013972018 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f864400bc20 con 0x7f865406d4c0 2024-09-16T01:16:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.505+0000 7f863bfff640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f864006c2b0 0x7f864006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.505+0000 7f863bfff640 1 -- 172.21.15.81:0/1013972018 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f864408bae0 con 0x7f865406d4c0 2024-09-16T01:16:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.505+0000 7f8652ffd640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f864006c2b0 0x7f864006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:17.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.506+0000 7f8652ffd640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f864006c2b0 0x7f864006e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8648034000 tx=0x7f864802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:17.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.510+0000 7f863bfff640 1 -- 172.21.15.81:0/1013972018 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86540b8090 con 0x7f865406d4c0 2024-09-16T01:16:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.690+0000 7f8659bc4640 1 -- 172.21.15.81:0/1013972018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f865406cd20 con 0x7f865406d4c0 2024-09-16T01:16:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.691+0000 7f863bfff640 1 -- 172.21.15.81:0/1013972018 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f8644090070 con 0x7f865406d4c0 2024-09-16T01:16:17.691 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:16:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.693+0000 7f8659bc4640 1 -- 172.21.15.81:0/1013972018 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f864006c2b0 msgr2=0x7f864006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.693+0000 7f8659bc4640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f864006c2b0 0x7f864006e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8648034000 tx=0x7f864802e000 comp rx=0 tx=0).stop 2024-09-16T01:16:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.693+0000 7f8659bc4640 1 -- 172.21.15.81:0/1013972018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406d4c0 msgr2=0x7f865414f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.693+0000 7f8659bc4640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406d4c0 0x7f865414f190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f864400d830 tx=0x7f864400dcf0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.693+0000 7f8659bc4640 1 -- 172.21.15.81:0/1013972018 shutdown_connections 2024-09-16T01:16:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.693+0000 7f8659bc4640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f864006c2b0 0x7f864006e770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.693+0000 7f8659bc4640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f865415e740 0x7f86541f84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.693+0000 7f8659bc4640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f865409b690 0x7f86541f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.693+0000 7f8659bc4640 1 --2- 172.21.15.81:0/1013972018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406d4c0 0x7f865414f190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.693+0000 7f8659bc4640 1 -- 172.21.15.81:0/1013972018 >> 172.21.15.81:0/1013972018 conn(0x7f86540d23a0 msgr2=0x7f86540d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.693+0000 7f8659bc4640 1 -- 172.21.15.81:0/1013972018 shutdown_connections 2024-09-16T01:16:17.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:17.693+0000 7f8659bc4640 1 -- 172.21.15.81:0/1013972018 wait complete. 2024-09-16T01:16:17.705 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:16:17.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:17.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-16T01:16:17.731 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:16:17.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:17.731 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:16:17.787 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:16:17.787 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:17.806 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:16:17.806 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:17.865 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:16:17.865 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:17.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:16:18.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.022+0000 7f661fcc9640 1 Processor -- start 2024-09-16T01:16:18.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.022+0000 7f661fcc9640 1 -- start start 2024-09-16T01:16:18.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.023+0000 7f661fcc9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f66180afd70 0x7f6618160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.023+0000 7f661fcc9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66180b5f80 0x7f66180b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.023+0000 7f661fcc9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f661806e7d0 0x7f661806ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.023+0000 7f661fcc9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f66180b68e0 con 0x7f661806e7d0 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.023+0000 7f661fcc9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6618160d60 con 0x7f66180afd70 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.023+0000 7f661fcc9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f661806fdb0 con 0x7f66180b5f80 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.023+0000 7f661e266640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f661806e7d0 0x7f661806ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.023+0000 7f661e266640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f661806e7d0 0x7f661806ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39442/0 (socket says 172.21.15.81:39442) 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.024+0000 7f661e266640 1 -- 172.21.15.81:0/298784137 learned_addr learned my addr 172.21.15.81:0/298784137 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.024+0000 7f661da65640 1 --2- 172.21.15.81:0/298784137 >> v2:172.21.15.102:3300/0 conn(0x7f66180afd70 0x7f6618160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.024+0000 7f661d264640 1 --2- 172.21.15.81:0/298784137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66180b5f80 0x7f66180b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.024+0000 7f661e266640 1 -- 172.21.15.81:0/298784137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66180b5f80 msgr2=0x7f66180b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.024+0000 7f661e266640 1 --2- 172.21.15.81:0/298784137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66180b5f80 0x7f66180b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.024+0000 7f661e266640 1 -- 172.21.15.81:0/298784137 >> v2:172.21.15.102:3300/0 conn(0x7f66180afd70 msgr2=0x7f6618160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:18.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.024+0000 7f661e266640 1 --2- 172.21.15.81:0/298784137 >> v2:172.21.15.102:3300/0 conn(0x7f66180afd70 0x7f6618160820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.024+0000 7f661e266640 1 -- 172.21.15.81:0/298784137 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6618070090 con 0x7f661806e7d0 2024-09-16T01:16:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.024+0000 7f661e266640 1 --2- 172.21.15.81:0/298784137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661806e7d0 0x7f661806ec50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f66180742e0 tx=0x7f660802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1f05053e8a5a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.025+0000 7f661ca63640 1 -- 172.21.15.81:0/298784137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608036070 con 0x7f661806e7d0 2024-09-16T01:16:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.025+0000 7f661ca63640 1 -- 172.21.15.81:0/298784137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6608031600 con 0x7f661806e7d0 2024-09-16T01:16:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.025+0000 7f661ca63640 1 -- 172.21.15.81:0/298784137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66080319d0 con 0x7f661806e7d0 2024-09-16T01:16:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.025+0000 7f661fcc9640 1 -- 172.21.15.81:0/298784137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661806e7d0 msgr2=0x7f661806ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.025+0000 7f661fcc9640 1 --2- 172.21.15.81:0/298784137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661806e7d0 0x7f661806ec50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f66180742e0 tx=0x7f660802a6a0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.025+0000 7f661fcc9640 1 -- 172.21.15.81:0/298784137 shutdown_connections 2024-09-16T01:16:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.025+0000 7f661fcc9640 1 --2- 172.21.15.81:0/298784137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661806e7d0 0x7f661806ec50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.025+0000 7f661fcc9640 1 --2- 172.21.15.81:0/298784137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66180b5f80 0x7f66180b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.025+0000 7f661fcc9640 1 --2- 172.21.15.81:0/298784137 >> v2:172.21.15.102:3300/0 conn(0x7f66180afd70 0x7f6618160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.025+0000 7f661fcc9640 1 -- 172.21.15.81:0/298784137 >> 172.21.15.81:0/298784137 conn(0x7f661806bc10 msgr2=0x7f661806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:18.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.025+0000 7f661fcc9640 1 -- 172.21.15.81:0/298784137 shutdown_connections 2024-09-16T01:16:18.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.025+0000 7f661fcc9640 1 -- 172.21.15.81:0/298784137 wait complete. 2024-09-16T01:16:18.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.026+0000 7f661fcc9640 1 Processor -- start 2024-09-16T01:16:18.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.026+0000 7f661fcc9640 1 -- start start 2024-09-16T01:16:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661fcc9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f661806e7d0 0x7f66181f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661fcc9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66180afd70 0x7f66180b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661fcc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66180b5f80 0x7f661815e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661fcc9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f661806fa80 con 0x7f66180b5f80 2024-09-16T01:16:18.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661fcc9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6618070650 con 0x7f661806e7d0 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661fcc9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f66180b0150 con 0x7f66180afd70 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661e266640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66180b5f80 0x7f661815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661e266640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66180b5f80 0x7f661815e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39458/0 (socket says 172.21.15.81:39458) 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661e266640 1 -- 172.21.15.81:0/653268935 learned_addr learned my addr 172.21.15.81:0/653268935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661d264640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66180afd70 0x7f66180b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661da65640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f661806e7d0 0x7f66181f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661e266640 1 -- 172.21.15.81:0/653268935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66180afd70 msgr2=0x7f66180b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661e266640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66180afd70 0x7f66180b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661e266640 1 -- 172.21.15.81:0/653268935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f661806e7d0 msgr2=0x7f66181f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661e266640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f661806e7d0 0x7f66181f4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.027+0000 7f661e266640 1 -- 172.21.15.81:0/653268935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66181e5cc0 con 0x7f66180b5f80 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.028+0000 7f661e266640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66180b5f80 0x7f661815e850 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6608009f40 tx=0x7f6608004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.028+0000 7f66167fc640 1 -- 172.21.15.81:0/653268935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608036050 con 0x7f66180b5f80 2024-09-16T01:16:18.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.028+0000 7f66167fc640 1 -- 172.21.15.81:0/653268935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6608042070 con 0x7f66180b5f80 2024-09-16T01:16:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.028+0000 7f661fcc9640 1 -- 172.21.15.81:0/653268935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66181e5fa0 con 0x7f66180b5f80 2024-09-16T01:16:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.028+0000 7f66167fc640 1 -- 172.21.15.81:0/653268935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6608009510 con 0x7f66180b5f80 2024-09-16T01:16:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.028+0000 7f661fcc9640 1 -- 172.21.15.81:0/653268935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66181e6560 con 0x7f66180b5f80 2024-09-16T01:16:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.029+0000 7f661fcc9640 1 -- 172.21.15.81:0/653268935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6618160060 con 0x7f66180b5f80 2024-09-16T01:16:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.029+0000 7f66167fc640 1 -- 172.21.15.81:0/653268935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6608007bf0 con 0x7f66180b5f80 2024-09-16T01:16:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.030+0000 7f66167fc640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f660406c2b0 0x7f660406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.030+0000 7f66167fc640 1 -- 172.21.15.81:0/653268935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f66080ac530 con 0x7f66180b5f80 2024-09-16T01:16:18.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.030+0000 7f661da65640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f660406c2b0 0x7f660406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:18.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.030+0000 7f661da65640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f660406c2b0 0x7f660406e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6610009990 tx=0x7f6610008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:18.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.034+0000 7f66167fc640 1 -- 172.21.15.81:0/653268935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f660807a960 con 0x7f66180b5f80 2024-09-16T01:16:18.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.213+0000 7f661fcc9640 1 -- 172.21.15.81:0/653268935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6618067fc0 con 0x7f66180b5f80 2024-09-16T01:16:18.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.214+0000 7f66167fc640 1 -- 172.21.15.81:0/653268935 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f660807a260 con 0x7f66180b5f80 2024-09-16T01:16:18.215 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:16:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.216+0000 7f661fcc9640 1 -- 172.21.15.81:0/653268935 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f660406c2b0 msgr2=0x7f660406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.216+0000 7f661fcc9640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f660406c2b0 0x7f660406e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6610009990 tx=0x7f6610008040 comp rx=0 tx=0).stop 2024-09-16T01:16:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.216+0000 7f661fcc9640 1 -- 172.21.15.81:0/653268935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66180b5f80 msgr2=0x7f661815e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.216+0000 7f661fcc9640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66180b5f80 0x7f661815e850 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6608009f40 tx=0x7f6608004a40 comp rx=0 tx=0).stop 2024-09-16T01:16:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.216+0000 7f661fcc9640 1 -- 172.21.15.81:0/653268935 shutdown_connections 2024-09-16T01:16:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.216+0000 7f661fcc9640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f660406c2b0 0x7f660406e770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.216+0000 7f661fcc9640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66180b5f80 0x7f661815e850 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.216+0000 7f661fcc9640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66180afd70 0x7f66180b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.216+0000 7f661fcc9640 1 --2- 172.21.15.81:0/653268935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f661806e7d0 0x7f66181f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.216+0000 7f661fcc9640 1 -- 172.21.15.81:0/653268935 >> 172.21.15.81:0/653268935 conn(0x7f661806bc10 msgr2=0x7f66180b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:18.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.216+0000 7f661fcc9640 1 -- 172.21.15.81:0/653268935 shutdown_connections 2024-09-16T01:16:18.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.216+0000 7f661fcc9640 1 -- 172.21.15.81:0/653268935 wait complete. 2024-09-16T01:16:18.227 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:16:18.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:18.228 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-16T01:16:18.259 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:16:18.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:18.259 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:16:18.333 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:18.333 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:18.349 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:18.349 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:18.405 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:18.405 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:18.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:16:18.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.599+0000 7f447e877640 1 Processor -- start 2024-09-16T01:16:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.599+0000 7f447e877640 1 -- start start 2024-09-16T01:16:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.599+0000 7f447e877640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f44780afd70 0x7f4478160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.599+0000 7f447e877640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4478160d60 con 0x7f44780b5f80 2024-09-16T01:16:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.599+0000 7f447e877640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f447806f5f0 con 0x7f44780ce660 2024-09-16T01:16:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.600+0000 7f447e877640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f447806fdb0 con 0x7f44780afd70 2024-09-16T01:16:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.600+0000 7f4477fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f44780afd70 0x7f4478160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.600+0000 7f44777fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f44780b5f80 0x7f447806e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49770/0 (socket says 172.21.15.81:49770) 2024-09-16T01:16:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.600+0000 7f44777fe640 1 -- 172.21.15.81:0/89430149 learned_addr learned my addr 172.21.15.81:0/89430149 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.600+0000 7f4477fff640 1 -- 172.21.15.81:0/89430149 >> v1:172.21.15.102:6789/0 conn(0x7f44780ce660 legacy=0x7f447806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.600+0000 7f4477fff640 1 -- 172.21.15.81:0/89430149 >> v1:172.21.15.81:6789/0 conn(0x7f44780b5f80 legacy=0x7f447806e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.600+0000 7f4476ffd640 1 -- 172.21.15.81:0/89430149 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35474309 0 0) 0x7f446c001110 con 0x7f44780b5f80 2024-09-16T01:16:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.600+0000 7f4477fff640 1 -- 172.21.15.81:0/89430149 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4478070090 con 0x7f44780afd70 2024-09-16T01:16:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.601+0000 7f4477fff640 1 --2- 172.21.15.81:0/89430149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44780afd70 0x7f4478160820 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f44680097a0 tx=0x7f446802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ea7275a459ecd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.601+0000 7f4476ffd640 1 -- 172.21.15.81:0/89430149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468037070 con 0x7f44780afd70 2024-09-16T01:16:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.601+0000 7f4476ffd640 1 -- 172.21.15.81:0/89430149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4468032440 con 0x7f44780afd70 2024-09-16T01:16:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.601+0000 7f4476ffd640 1 -- 172.21.15.81:0/89430149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4468032810 con 0x7f44780afd70 2024-09-16T01:16:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.601+0000 7f447e877640 1 -- 172.21.15.81:0/89430149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44780afd70 msgr2=0x7f4478160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.601+0000 7f447e877640 1 --2- 172.21.15.81:0/89430149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44780afd70 0x7f4478160820 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f44680097a0 tx=0x7f446802a1e0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.601+0000 7f447e877640 1 -- 172.21.15.81:0/89430149 shutdown_connections 2024-09-16T01:16:18.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.601+0000 7f447e877640 1 --2- 172.21.15.81:0/89430149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44780afd70 0x7f4478160820 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.601+0000 7f447e877640 1 -- 172.21.15.81:0/89430149 >> 172.21.15.81:0/89430149 conn(0x7f447806bc10 msgr2=0x7f447806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:18.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.601+0000 7f447e877640 1 -- 172.21.15.81:0/89430149 shutdown_connections 2024-09-16T01:16:18.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.601+0000 7f447e877640 1 -- 172.21.15.81:0/89430149 wait complete. 2024-09-16T01:16:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.603+0000 7f447e877640 1 Processor -- start 2024-09-16T01:16:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.603+0000 7f447e877640 1 -- start start 2024-09-16T01:16:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.603+0000 7f447e877640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780afd70 0x7f4478144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.603+0000 7f447e877640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44780b5f80 0x7f44781442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.603+0000 7f447e877640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44780ce660 0x7f44781564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.603+0000 7f447e877640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f447806fa80 con 0x7f44780ce660 2024-09-16T01:16:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.603+0000 7f447e877640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4478070650 con 0x7f44780afd70 2024-09-16T01:16:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.603+0000 7f447e877640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f44780b0150 con 0x7f44780b5f80 2024-09-16T01:16:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f447ce14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44780ce660 0x7f44781564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f447ce14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44780ce660 0x7f44781564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39474/0 (socket says 172.21.15.81:39474) 2024-09-16T01:16:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f447ce14640 1 -- 172.21.15.81:0/3851489401 learned_addr learned my addr 172.21.15.81:0/3851489401 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f44777fe640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44780b5f80 0x7f44781442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f4477fff640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780afd70 0x7f4478144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f447ce14640 1 -- 172.21.15.81:0/3851489401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44780b5f80 msgr2=0x7f44781442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f447ce14640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44780b5f80 0x7f44781442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f447ce14640 1 -- 172.21.15.81:0/3851489401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780afd70 msgr2=0x7f4478144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f447ce14640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780afd70 0x7f4478144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f447ce14640 1 -- 172.21.15.81:0/3851489401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4478156a30 con 0x7f44780ce660 2024-09-16T01:16:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f447ce14640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44780ce660 0x7f44781564f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f447000b9e0 tx=0x7f447000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f4474ff9640 1 -- 172.21.15.81:0/3851489401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470019070 con 0x7f44780ce660 2024-09-16T01:16:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f4474ff9640 1 -- 172.21.15.81:0/3851489401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447000cb20 con 0x7f44780ce660 2024-09-16T01:16:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f447e877640 1 -- 172.21.15.81:0/3851489401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4478154480 con 0x7f44780ce660 2024-09-16T01:16:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f4474ff9640 1 -- 172.21.15.81:0/3851489401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4470014440 con 0x7f44780ce660 2024-09-16T01:16:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.604+0000 7f447e877640 1 -- 172.21.15.81:0/3851489401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4478154a40 con 0x7f44780ce660 2024-09-16T01:16:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.605+0000 7f447e877640 1 -- 172.21.15.81:0/3851489401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4478160060 con 0x7f44780ce660 2024-09-16T01:16:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.606+0000 7f4474ff9640 1 -- 172.21.15.81:0/3851489401 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f447001c070 con 0x7f44780ce660 2024-09-16T01:16:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.606+0000 7f4474ff9640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f446406c2b0 0x7f446406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.606+0000 7f4477fff640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f446406c2b0 0x7f446406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.606+0000 7f4474ff9640 1 -- 172.21.15.81:0/3851489401 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f447008b3f0 con 0x7f44780ce660 2024-09-16T01:16:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.607+0000 7f4477fff640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f446406c2b0 0x7f446406e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4468034000 tx=0x7f446802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.610+0000 7f4474ff9640 1 -- 172.21.15.81:0/3851489401 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4478156a30 con 0x7f44780ce660 2024-09-16T01:16:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.794+0000 7f447e877640 1 -- 172.21.15.81:0/3851489401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4478067fc0 con 0x7f44780ce660 2024-09-16T01:16:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.794+0000 7f4474ff9640 1 -- 172.21.15.81:0/3851489401 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f44700598b0 con 0x7f44780ce660 2024-09-16T01:16:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:16:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.796+0000 7f447e877640 1 -- 172.21.15.81:0/3851489401 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f446406c2b0 msgr2=0x7f446406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.796+0000 7f447e877640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f446406c2b0 0x7f446406e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4468034000 tx=0x7f446802e000 comp rx=0 tx=0).stop 2024-09-16T01:16:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.796+0000 7f447e877640 1 -- 172.21.15.81:0/3851489401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44780ce660 msgr2=0x7f44781564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.796+0000 7f447e877640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44780ce660 0x7f44781564f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f447000b9e0 tx=0x7f447000bea0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.796+0000 7f447e877640 1 -- 172.21.15.81:0/3851489401 shutdown_connections 2024-09-16T01:16:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.796+0000 7f447e877640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f446406c2b0 0x7f446406e770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.796+0000 7f447e877640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44780ce660 0x7f44781564f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.796+0000 7f447e877640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f44780b5f80 0x7f44781442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.796+0000 7f447e877640 1 --2- 172.21.15.81:0/3851489401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44780afd70 0x7f4478144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.796+0000 7f447e877640 1 -- 172.21.15.81:0/3851489401 >> 172.21.15.81:0/3851489401 conn(0x7f447806bc10 msgr2=0x7f44780b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.796+0000 7f447e877640 1 -- 172.21.15.81:0/3851489401 shutdown_connections 2024-09-16T01:16:18.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:18.796+0000 7f447e877640 1 -- 172.21.15.81:0/3851489401 wait complete. 2024-09-16T01:16:18.808 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-16T01:16:18.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:18.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-16T01:16:18.834 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:16:18.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:18.834 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-16T01:16:18.889 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:16:18.889 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:18.908 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:16:18.908 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:18.965 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:16:18.965 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:19.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:16:19.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.121+0000 7f93ba5fd640 1 Processor -- start 2024-09-16T01:16:19.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.121+0000 7f93ba5fd640 1 -- start start 2024-09-16T01:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.121+0000 7f93ba5fd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93b409b140 0x7f93b4071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.121+0000 7f93ba5fd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93b409ba30 con 0x7f93b40b17d0 2024-09-16T01:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.121+0000 7f93ba5fd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93b409bcf0 con 0x7f93b415fc30 2024-09-16T01:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.121+0000 7f93ba5fd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f93b40b1590 con 0x7f93b409b140 2024-09-16T01:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.122+0000 7f93b8b9a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f93b40b17d0 0x7f93b40704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49780/0 (socket says 172.21.15.81:49780) 2024-09-16T01:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.122+0000 7f93b8b9a640 1 -- 172.21.15.81:0/3339339607 learned_addr learned my addr 172.21.15.81:0/3339339607 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.122+0000 7f93abfff640 1 --2- 172.21.15.81:0/3339339607 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93b409b140 0x7f93b4071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.122+0000 7f93b37fe640 1 -- 172.21.15.81:0/3339339607 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1648185964 0 0) 0x7f93b409ba30 con 0x7f93b40b17d0 2024-09-16T01:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.122+0000 7f93b37fe640 1 -- 172.21.15.81:0/3339339607 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93a0003520 con 0x7f93b40b17d0 2024-09-16T01:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.122+0000 7f93b37fe640 1 -- 172.21.15.81:0/3339339607 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 700630095 0 0) 0x7f93b409bcf0 con 0x7f93b415fc30 2024-09-16T01:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.122+0000 7f93b37fe640 1 -- 172.21.15.81:0/3339339607 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93b409ba30 con 0x7f93b415fc30 2024-09-16T01:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.122+0000 7f93abfff640 1 -- 172.21.15.81:0/3339339607 >> v1:172.21.15.102:6789/0 conn(0x7f93b415fc30 legacy=0x7f93b409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.122+0000 7f93abfff640 1 -- 172.21.15.81:0/3339339607 >> v1:172.21.15.81:6789/0 conn(0x7f93b40b17d0 legacy=0x7f93b40704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.122+0000 7f93abfff640 1 -- 172.21.15.81:0/3339339607 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b4160d00 con 0x7f93b409b140 2024-09-16T01:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.123+0000 7f93abfff640 1 --2- 172.21.15.81:0/3339339607 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93b409b140 0x7f93b4071e40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f939c0097d0 tx=0x7f939c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa82574c9c5d765b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.123+0000 7f93b37fe640 1 -- 172.21.15.81:0/3339339607 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c037070 con 0x7f93b409b140 2024-09-16T01:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.123+0000 7f93b37fe640 1 -- 172.21.15.81:0/3339339607 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939c032440 con 0x7f93b409b140 2024-09-16T01:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.123+0000 7f93b37fe640 1 -- 172.21.15.81:0/3339339607 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c0327f0 con 0x7f93b409b140 2024-09-16T01:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.124+0000 7f93ba5fd640 1 -- 172.21.15.81:0/3339339607 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93b409b140 msgr2=0x7f93b4071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.124+0000 7f93ba5fd640 1 --2- 172.21.15.81:0/3339339607 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93b409b140 0x7f93b4071e40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f939c0097d0 tx=0x7f939c02a180 comp rx=0 tx=0).stop 2024-09-16T01:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.124+0000 7f93ba5fd640 1 -- 172.21.15.81:0/3339339607 shutdown_connections 2024-09-16T01:16:19.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.124+0000 7f93ba5fd640 1 --2- 172.21.15.81:0/3339339607 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93b409b140 0x7f93b4071e40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.124+0000 7f93ba5fd640 1 -- 172.21.15.81:0/3339339607 >> 172.21.15.81:0/3339339607 conn(0x7f93b40d23a0 msgr2=0x7f93b40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.124+0000 7f93ba5fd640 1 -- 172.21.15.81:0/3339339607 shutdown_connections 2024-09-16T01:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.124+0000 7f93ba5fd640 1 -- 172.21.15.81:0/3339339607 wait complete. 2024-09-16T01:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.125+0000 7f93ba5fd640 1 Processor -- start 2024-09-16T01:16:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.125+0000 7f93ba5fd640 1 -- start start 2024-09-16T01:16:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93ba5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b409b140 0x7f93b415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93ba5fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93b40b17d0 0x7f93b41f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93ba5fd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93b415fc30 0x7f93b415b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93ba5fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93b4070f90 con 0x7f93b409b140 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93ba5fd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f93b4070e10 con 0x7f93b40b17d0 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93ba5fd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f93b4071110 con 0x7f93b415fc30 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b409b140 0x7f93b415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b409b140 0x7f93b415a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39478/0 (socket says 172.21.15.81:39478) 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b3fff640 1 -- 172.21.15.81:0/2956297683 learned_addr learned my addr 172.21.15.81:0/2956297683 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b8b9a640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93b415fc30 0x7f93b415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93abfff640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93b40b17d0 0x7f93b41f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b3fff640 1 -- 172.21.15.81:0/2956297683 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93b415fc30 msgr2=0x7f93b415b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b3fff640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93b415fc30 0x7f93b415b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b3fff640 1 -- 172.21.15.81:0/2956297683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93b40b17d0 msgr2=0x7f93b41f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b3fff640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93b40b17d0 0x7f93b41f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b3fff640 1 -- 172.21.15.81:0/2956297683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b415af20 con 0x7f93b409b140 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b3fff640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b409b140 0x7f93b415a790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f93a400c430 tx=0x7f93a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b17fa640 1 -- 172.21.15.81:0/2956297683 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4017070 con 0x7f93b409b140 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b17fa640 1 -- 172.21.15.81:0/2956297683 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a40052f0 con 0x7f93b409b140 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93ba5fd640 1 -- 172.21.15.81:0/2956297683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b40b7000 con 0x7f93b409b140 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93b17fa640 1 -- 172.21.15.81:0/2956297683 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4003830 con 0x7f93b409b140 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.126+0000 7f93ba5fd640 1 -- 172.21.15.81:0/2956297683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b40b7a80 con 0x7f93b409b140 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.127+0000 7f93ba5fd640 1 -- 172.21.15.81:0/2956297683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b4071500 con 0x7f93b409b140 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.128+0000 7f93b17fa640 1 -- 172.21.15.81:0/2956297683 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f93a401a070 con 0x7f93b409b140 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.128+0000 7f93b17fa640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f939406c2e0 0x7f939406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.128+0000 7f93abfff640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f939406c2e0 0x7f939406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.128+0000 7f93b17fa640 1 -- 172.21.15.81:0/2956297683 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f93a408aa60 con 0x7f93b409b140 2024-09-16T01:16:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.129+0000 7f93abfff640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f939406c2e0 0x7f939406e7a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f939c034000 tx=0x7f939c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.132+0000 7f93b17fa640 1 -- 172.21.15.81:0/2956297683 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93a4058840 con 0x7f93b409b140 2024-09-16T01:16:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.309+0000 7f93ba5fd640 1 -- 172.21.15.81:0/2956297683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f93b409ae90 con 0x7f93b409b140 2024-09-16T01:16:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.310+0000 7f93b17fa640 1 -- 172.21.15.81:0/2956297683 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f93a405cb40 con 0x7f93b409b140 2024-09-16T01:16:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:16:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.312+0000 7f93ba5fd640 1 -- 172.21.15.81:0/2956297683 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f939406c2e0 msgr2=0x7f939406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.312+0000 7f93ba5fd640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f939406c2e0 0x7f939406e7a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f939c034000 tx=0x7f939c02e000 comp rx=0 tx=0).stop 2024-09-16T01:16:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.312+0000 7f93ba5fd640 1 -- 172.21.15.81:0/2956297683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b409b140 msgr2=0x7f93b415a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.312+0000 7f93ba5fd640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b409b140 0x7f93b415a790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f93a400c430 tx=0x7f93a400c8f0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.312+0000 7f93ba5fd640 1 -- 172.21.15.81:0/2956297683 shutdown_connections 2024-09-16T01:16:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.312+0000 7f93ba5fd640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f939406c2e0 0x7f939406e7a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.312+0000 7f93ba5fd640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93b415fc30 0x7f93b415b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.312+0000 7f93ba5fd640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93b40b17d0 0x7f93b41f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.312+0000 7f93ba5fd640 1 --2- 172.21.15.81:0/2956297683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93b409b140 0x7f93b415a790 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.312+0000 7f93ba5fd640 1 -- 172.21.15.81:0/2956297683 >> 172.21.15.81:0/2956297683 conn(0x7f93b40d23a0 msgr2=0x7f93b4160010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.312+0000 7f93ba5fd640 1 -- 172.21.15.81:0/2956297683 shutdown_connections 2024-09-16T01:16:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.312+0000 7f93ba5fd640 1 -- 172.21.15.81:0/2956297683 wait complete. 2024-09-16T01:16:19.324 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-16T01:16:19.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:19.324 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-16T01:16:19.355 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:16:19.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:19.356 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-16T01:16:19.414 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T01:16:19.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:16:19.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.510+0000 7f31a17a6640 1 Processor -- start 2024-09-16T01:16:19.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.511+0000 7f31a17a6640 1 -- start start 2024-09-16T01:16:19.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.511+0000 7f31a17a6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f319c15e990 0x7f319c0b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.511+0000 7f31a17a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f319c0ae140 0x7f319c0ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.511+0000 7f31a17a6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f319c0aeb10 con 0x7f319c15e5b0 2024-09-16T01:16:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.511+0000 7f31a17a6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f319c0b2c30 con 0x7f319c15e990 2024-09-16T01:16:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.511+0000 7f31a17a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f319c0b17f0 con 0x7f319c0ae140 2024-09-16T01:16:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.512+0000 7f319affd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f319c15e5b0 0x7f319c0b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49782/0 (socket says 172.21.15.81:49782) 2024-09-16T01:16:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.512+0000 7f319affd640 1 -- 172.21.15.81:0/1566713867 learned_addr learned my addr 172.21.15.81:0/1566713867 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.512+0000 7f319a7fc640 1 --2- 172.21.15.81:0/1566713867 >> v2:172.21.15.81:3300/0 conn(0x7f319c15e990 0x7f319c0b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.512+0000 7f319b7fe640 1 --2- 172.21.15.81:0/1566713867 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f319c0ae140 0x7f319c0ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.512+0000 7f3199ffb640 1 -- 172.21.15.81:0/1566713867 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3467042578 0 0) 0x7f319c0aeb10 con 0x7f319c15e5b0 2024-09-16T01:16:19.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.512+0000 7f3199ffb640 1 -- 172.21.15.81:0/1566713867 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3188003520 con 0x7f319c15e5b0 2024-09-16T01:16:19.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.512+0000 7f319a7fc640 1 -- 172.21.15.81:0/1566713867 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f319c0ae140 msgr2=0x7f319c0ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:19.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.512+0000 7f319a7fc640 1 --2- 172.21.15.81:0/1566713867 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f319c0ae140 0x7f319c0ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.512+0000 7f319a7fc640 1 -- 172.21.15.81:0/1566713867 >> v1:172.21.15.81:6789/0 conn(0x7f319c15e5b0 legacy=0x7f319c0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.512+0000 7f319a7fc640 1 -- 172.21.15.81:0/1566713867 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319c0b6520 con 0x7f319c15e990 2024-09-16T01:16:19.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.513+0000 7f319a7fc640 1 --2- 172.21.15.81:0/1566713867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f319c15e990 0x7f319c0b5f40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f31840097a0 tx=0x7f318402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39df8c001f43784f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:19.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.513+0000 7f3199ffb640 1 -- 172.21.15.81:0/1566713867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184037070 con 0x7f319c15e990 2024-09-16T01:16:19.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.513+0000 7f3199ffb640 1 -- 172.21.15.81:0/1566713867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3184032440 con 0x7f319c15e990 2024-09-16T01:16:19.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.513+0000 7f3199ffb640 1 -- 172.21.15.81:0/1566713867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31840327f0 con 0x7f319c15e990 2024-09-16T01:16:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.513+0000 7f31a17a6640 1 -- 172.21.15.81:0/1566713867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f319c15e990 msgr2=0x7f319c0b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.513+0000 7f31a17a6640 1 --2- 172.21.15.81:0/1566713867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f319c15e990 0x7f319c0b5f40 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f31840097a0 tx=0x7f318402a180 comp rx=0 tx=0).stop 2024-09-16T01:16:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.513+0000 7f31a17a6640 1 -- 172.21.15.81:0/1566713867 shutdown_connections 2024-09-16T01:16:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.513+0000 7f31a17a6640 1 --2- 172.21.15.81:0/1566713867 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f319c0ae140 0x7f319c0ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.513+0000 7f31a17a6640 1 --2- 172.21.15.81:0/1566713867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f319c15e990 0x7f319c0b5f40 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.513+0000 7f31a17a6640 1 -- 172.21.15.81:0/1566713867 >> 172.21.15.81:0/1566713867 conn(0x7f319c073490 msgr2=0x7f319c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.513+0000 7f31a17a6640 1 -- 172.21.15.81:0/1566713867 shutdown_connections 2024-09-16T01:16:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.513+0000 7f31a17a6640 1 -- 172.21.15.81:0/1566713867 wait complete. 2024-09-16T01:16:19.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.515+0000 7f31a17a6640 1 Processor -- start 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.515+0000 7f31a17a6640 1 -- start start 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.515+0000 7f31a17a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f319c0ae140 0x7f319c1f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.515+0000 7f31a17a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f319c15e5b0 0x7f319c153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.515+0000 7f31a17a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f319c15e990 0x7f319c1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.515+0000 7f31a17a6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f319c0b2000 con 0x7f319c0ae140 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.515+0000 7f31a17a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f319c0b1d20 con 0x7f319c15e990 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.515+0000 7f31a17a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f319c0b0490 con 0x7f319c15e5b0 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.515+0000 7f319affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f319c0ae140 0x7f319c1f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.515+0000 7f319affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f319c0ae140 0x7f319c1f3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39488/0 (socket says 172.21.15.81:39488) 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.515+0000 7f319affd640 1 -- 172.21.15.81:0/4236392932 learned_addr learned my addr 172.21.15.81:0/4236392932 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.516+0000 7f319affd640 1 -- 172.21.15.81:0/4236392932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f319c15e5b0 msgr2=0x7f319c153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.516+0000 7f319a7fc640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f319c15e5b0 0x7f319c153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.516+0000 7f319affd640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f319c15e5b0 0x7f319c153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.516+0000 7f319affd640 1 -- 172.21.15.81:0/4236392932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f319c15e990 msgr2=0x7f319c1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.516+0000 7f319affd640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f319c15e990 0x7f319c1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.516+0000 7f319affd640 1 -- 172.21.15.81:0/4236392932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319c161ad0 con 0x7f319c0ae140 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.516+0000 7f319affd640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f319c0ae140 0x7f319c1f3750 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f318c00cb70 tx=0x7f318c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.516+0000 7f31937fe640 1 -- 172.21.15.81:0/4236392932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c017070 con 0x7f319c0ae140 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.516+0000 7f31937fe640 1 -- 172.21.15.81:0/4236392932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c00ad40 con 0x7f319c0ae140 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.516+0000 7f31a17a6640 1 -- 172.21.15.81:0/4236392932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f319c15fa60 con 0x7f319c0ae140 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.516+0000 7f31937fe640 1 -- 172.21.15.81:0/4236392932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c012620 con 0x7f319c0ae140 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.516+0000 7f31a17a6640 1 -- 172.21.15.81:0/4236392932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f319c1f3c90 con 0x7f319c0ae140 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.517+0000 7f31a17a6640 1 -- 172.21.15.81:0/4236392932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f319c0b5f40 con 0x7f319c0ae140 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.518+0000 7f31937fe640 1 -- 172.21.15.81:0/4236392932 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f318c01a070 con 0x7f319c0ae140 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.518+0000 7f31937fe640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f317c06c2b0 0x7f317c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.518+0000 7f31937fe640 1 -- 172.21.15.81:0/4236392932 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f318c08b640 con 0x7f319c0ae140 2024-09-16T01:16:19.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.518+0000 7f319a7fc640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f317c06c2b0 0x7f317c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.519+0000 7f319a7fc640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f317c06c2b0 0x7f317c06e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3184034000 tx=0x7f318402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:19.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.522+0000 7f31937fe640 1 -- 172.21.15.81:0/4236392932 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f318c059a70 con 0x7f319c0ae140 2024-09-16T01:16:19.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.723+0000 7f31a17a6640 1 -- 172.21.15.81:0/4236392932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f319c0b3a90 con 0x7f319c0ae140 2024-09-16T01:16:19.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.723+0000 7f31937fe640 1 -- 172.21.15.81:0/4236392932 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f318c059370 con 0x7f319c0ae140 2024-09-16T01:16:19.724 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:19.724 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-16T01:15:58:778268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1441310273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1441310273},{"type":"v1","addr":"172.21.15.102:6834","nonce":1441310273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1086586307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1086586307},{"type":"v1","addr":"172.21.15.102:6835","nonce":1086586307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4105201682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4105201682},{"type":"v1","addr":"172.21.15.81:6835","nonce":4105201682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:15:39.037094+0000","modified":"2024-09-16T01:15:58.115389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2354333316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2354333316},{"type":"v1","addr":"172.21.15.81:6837","nonce":2354333316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-16T01:16:19.724 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-16T01:16:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.725+0000 7f31a17a6640 1 -- 172.21.15.81:0/4236392932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f317c06c2b0 msgr2=0x7f317c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.725+0000 7f31a17a6640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f317c06c2b0 0x7f317c06e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3184034000 tx=0x7f318402e000 comp rx=0 tx=0).stop 2024-09-16T01:16:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.725+0000 7f31a17a6640 1 -- 172.21.15.81:0/4236392932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f319c0ae140 msgr2=0x7f319c1f3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.725+0000 7f31a17a6640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f319c0ae140 0x7f319c1f3750 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f318c00cb70 tx=0x7f318c00a430 comp rx=0 tx=0).stop 2024-09-16T01:16:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.725+0000 7f31a17a6640 1 -- 172.21.15.81:0/4236392932 shutdown_connections 2024-09-16T01:16:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.725+0000 7f31a17a6640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f317c06c2b0 0x7f317c06e770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.725+0000 7f31a17a6640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f319c15e990 0x7f319c1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.725+0000 7f31a17a6640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f319c15e5b0 0x7f319c153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.725+0000 7f31a17a6640 1 --2- 172.21.15.81:0/4236392932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f319c0ae140 0x7f319c1f3750 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.725+0000 7f31a17a6640 1 -- 172.21.15.81:0/4236392932 >> 172.21.15.81:0/4236392932 conn(0x7f319c073490 msgr2=0x7f319c15cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.725+0000 7f31a17a6640 1 -- 172.21.15.81:0/4236392932 shutdown_connections 2024-09-16T01:16:19.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.725+0000 7f31a17a6640 1 -- 172.21.15.81:0/4236392932 wait complete. 2024-09-16T01:16:19.737 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:16:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.834+0000 7f11c7cba640 1 Processor -- start 2024-09-16T01:16:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.834+0000 7f11c7cba640 1 -- start start 2024-09-16T01:16:19.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.835+0000 7f11c7cba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11c015b300 0x7f11c00cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.835+0000 7f11c7cba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11c006f8d0 0x7f11c015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.835+0000 7f11c7cba640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c00cdbe0 con 0x7f11c00cd3f0 2024-09-16T01:16:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.835+0000 7f11c7cba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f11c00728a0 con 0x7f11c006f8d0 2024-09-16T01:16:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.835+0000 7f11c7cba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f11c00cd900 con 0x7f11c015b300 2024-09-16T01:16:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.835+0000 7f11c6257640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11c006f8d0 0x7f11c015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.835+0000 7f11c5255640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f11c00cd3f0 0x7f11c006f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49788/0 (socket says 172.21.15.81:49788) 2024-09-16T01:16:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.835+0000 7f11c5255640 1 -- 172.21.15.81:0/1277398349 learned_addr learned my addr 172.21.15.81:0/1277398349 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.835+0000 7f11c5a56640 1 --2- 172.21.15.81:0/1277398349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11c015b300 0x7f11c00cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.836+0000 7f11c6257640 1 -- 172.21.15.81:0/1277398349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11c015b300 msgr2=0x7f11c00cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.836+0000 7f11c6257640 1 --2- 172.21.15.81:0/1277398349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11c015b300 0x7f11c00cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.836+0000 7f11c6257640 1 -- 172.21.15.81:0/1277398349 >> v1:172.21.15.81:6789/0 conn(0x7f11c00cd3f0 legacy=0x7f11c006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.836+0000 7f11c4a54640 1 -- 172.21.15.81:0/1277398349 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990861755 0 0) 0x7f11c00cdbe0 con 0x7f11c00cd3f0 2024-09-16T01:16:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.836+0000 7f11c6257640 1 -- 172.21.15.81:0/1277398349 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c0072250 con 0x7f11c006f8d0 2024-09-16T01:16:19.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.836+0000 7f11c6257640 1 --2- 172.21.15.81:0/1277398349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c006f8d0 0x7f11c015b6e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009d90 tx=0x7f11b802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8975074e9e96b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:19.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.836+0000 7f11c4a54640 1 -- 172.21.15.81:0/1277398349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8007740 con 0x7f11c006f8d0 2024-09-16T01:16:19.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.836+0000 7f11c4a54640 1 -- 172.21.15.81:0/1277398349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b80078e0 con 0x7f11c006f8d0 2024-09-16T01:16:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.836+0000 7f11c4a54640 1 -- 172.21.15.81:0/1277398349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8007cb0 con 0x7f11c006f8d0 2024-09-16T01:16:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.837+0000 7f11c7cba640 1 -- 172.21.15.81:0/1277398349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c006f8d0 msgr2=0x7f11c015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.837+0000 7f11c7cba640 1 --2- 172.21.15.81:0/1277398349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c006f8d0 0x7f11c015b6e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009d90 tx=0x7f11b802a660 comp rx=0 tx=0).stop 2024-09-16T01:16:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.837+0000 7f11c7cba640 1 -- 172.21.15.81:0/1277398349 shutdown_connections 2024-09-16T01:16:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.837+0000 7f11c7cba640 1 --2- 172.21.15.81:0/1277398349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c006f8d0 0x7f11c015b6e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.837+0000 7f11c7cba640 1 --2- 172.21.15.81:0/1277398349 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11c015b300 0x7f11c00cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.837+0000 7f11c7cba640 1 -- 172.21.15.81:0/1277398349 >> 172.21.15.81:0/1277398349 conn(0x7f11c0067d70 msgr2=0x7f11c006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.837+0000 7f11c7cba640 1 -- 172.21.15.81:0/1277398349 shutdown_connections 2024-09-16T01:16:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.837+0000 7f11c7cba640 1 -- 172.21.15.81:0/1277398349 wait complete. 2024-09-16T01:16:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.838+0000 7f11c7cba640 1 Processor -- start 2024-09-16T01:16:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.838+0000 7f11c7cba640 1 -- start start 2024-09-16T01:16:19.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c7cba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11c006f8d0 0x7f11c01e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c7cba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11c00cd3f0 0x7f11c0151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c7cba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c015b300 0x7f11c015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c7cba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11c00d0160 con 0x7f11c015b300 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c7cba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f11c00cffe0 con 0x7f11c006f8d0 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c7cba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f11c0072d30 con 0x7f11c00cd3f0 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c6257640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c015b300 0x7f11c015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c6257640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c015b300 0x7f11c015b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39506/0 (socket says 172.21.15.81:39506) 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c6257640 1 -- 172.21.15.81:0/2769227174 learned_addr learned my addr 172.21.15.81:0/2769227174 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c5255640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11c00cd3f0 0x7f11c0151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c5a56640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11c006f8d0 0x7f11c01e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c6257640 1 -- 172.21.15.81:0/2769227174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11c00cd3f0 msgr2=0x7f11c0151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c6257640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11c00cd3f0 0x7f11c0151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c6257640 1 -- 172.21.15.81:0/2769227174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11c006f8d0 msgr2=0x7f11c01e36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:19.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c6257640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11c006f8d0 0x7f11c01e36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:19.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c6257640 1 -- 172.21.15.81:0/2769227174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c015bc20 con 0x7f11c015b300 2024-09-16T01:16:19.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.839+0000 7f11c5255640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11c00cd3f0 0x7f11c0151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:19.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.840+0000 7f11c6257640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c015b300 0x7f11c015b6e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009d90 tx=0x7f11b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:19.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.840+0000 7f11b67fc640 1 -- 172.21.15.81:0/2769227174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8040070 con 0x7f11c015b300 2024-09-16T01:16:19.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.840+0000 7f11b67fc640 1 -- 172.21.15.81:0/2769227174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11b8031bc0 con 0x7f11c015b300 2024-09-16T01:16:19.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.840+0000 7f11c7cba640 1 -- 172.21.15.81:0/2769227174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c01e3df0 con 0x7f11c015b300 2024-09-16T01:16:19.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.840+0000 7f11b67fc640 1 -- 172.21.15.81:0/2769227174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b803c420 con 0x7f11c015b300 2024-09-16T01:16:19.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.840+0000 7f11c7cba640 1 -- 172.21.15.81:0/2769227174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c01f5210 con 0x7f11c015b300 2024-09-16T01:16:19.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.841+0000 7f11c7cba640 1 -- 172.21.15.81:0/2769227174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c00b58a0 con 0x7f11c015b300 2024-09-16T01:16:19.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.843+0000 7f11b67fc640 1 -- 172.21.15.81:0/2769227174 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f11b8039040 con 0x7f11c015b300 2024-09-16T01:16:19.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.844+0000 7f11b67fc640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f11a406c2b0 0x7f11a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.844+0000 7f11b67fc640 1 -- 172.21.15.81:0/2769227174 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f11b80aced0 con 0x7f11c015b300 2024-09-16T01:16:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.844+0000 7f11c5a56640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f11a406c2b0 0x7f11a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.844+0000 7f11c5a56640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f11a406c2b0 0x7f11a406e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f11bc006fd0 tx=0x7f11bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:19.847+0000 7f11b67fc640 1 -- 172.21.15.81:0/2769227174 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11c00b58a0 con 0x7f11c015b300 2024-09-16T01:16:20.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.048+0000 7f11c7cba640 1 -- 172.21.15.81:0/2769227174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11c00c5930 con 0x7f11c015b300 2024-09-16T01:16:20.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.048+0000 7f11b67fc640 1 -- 172.21.15.81:0/2769227174 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f11c01e3df0 con 0x7f11c015b300 2024-09-16T01:16:20.049 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:20.049 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-16T01:15:58:778268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1441310273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1441310273},{"type":"v1","addr":"172.21.15.102:6834","nonce":1441310273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1086586307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1086586307},{"type":"v1","addr":"172.21.15.102:6835","nonce":1086586307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4105201682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4105201682},{"type":"v1","addr":"172.21.15.81:6835","nonce":4105201682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:15:39.037094+0000","modified":"2024-09-16T01:15:58.115389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2354333316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2354333316},{"type":"v1","addr":"172.21.15.81:6837","nonce":2354333316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-16T01:16:20.050 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-16T01:16:20.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.050+0000 7f11c7cba640 1 -- 172.21.15.81:0/2769227174 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f11a406c2b0 msgr2=0x7f11a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.050+0000 7f11c7cba640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f11a406c2b0 0x7f11a406e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f11bc006fd0 tx=0x7f11bc008040 comp rx=0 tx=0).stop 2024-09-16T01:16:20.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.050+0000 7f11c7cba640 1 -- 172.21.15.81:0/2769227174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c015b300 msgr2=0x7f11c015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.050+0000 7f11c7cba640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c015b300 0x7f11c015b6e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f11b8009d90 tx=0x7f11b8004a40 comp rx=0 tx=0).stop 2024-09-16T01:16:20.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.050+0000 7f11c7cba640 1 -- 172.21.15.81:0/2769227174 shutdown_connections 2024-09-16T01:16:20.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.050+0000 7f11c7cba640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f11a406c2b0 0x7f11a406e770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.050+0000 7f11c7cba640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11c015b300 0x7f11c015b6e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.050+0000 7f11c7cba640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f11c00cd3f0 0x7f11c0151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.050+0000 7f11c7cba640 1 --2- 172.21.15.81:0/2769227174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11c006f8d0 0x7f11c01e36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.050+0000 7f11c7cba640 1 -- 172.21.15.81:0/2769227174 >> 172.21.15.81:0/2769227174 conn(0x7f11c0067d70 msgr2=0x7f11c01581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.050+0000 7f11c7cba640 1 -- 172.21.15.81:0/2769227174 shutdown_connections 2024-09-16T01:16:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.050+0000 7f11c7cba640 1 -- 172.21.15.81:0/2769227174 wait complete. 2024-09-16T01:16:20.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:16:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.159+0000 7f657e80a640 1 Processor -- start 2024-09-16T01:16:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.159+0000 7f657e80a640 1 -- start start 2024-09-16T01:16:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.160+0000 7f657e80a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f657815c490 0x7f657809b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.160+0000 7f657e80a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f657815cf80 0x7f65780ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.160+0000 7f657e80a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65780d01c0 con 0x7f657809b980 2024-09-16T01:16:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.160+0000 7f657e80a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f65780cff70 con 0x7f657815c490 2024-09-16T01:16:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.160+0000 7f657e80a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f65780d0dd0 con 0x7f657815cf80 2024-09-16T01:16:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.160+0000 7f6577fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f657815c490 0x7f657809b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.160+0000 7f65777fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f657809b980 0x7f657815c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49790/0 (socket says 172.21.15.81:49790) 2024-09-16T01:16:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.160+0000 7f65777fe640 1 -- 172.21.15.81:0/443829776 learned_addr learned my addr 172.21.15.81:0/443829776 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.160+0000 7f657cda7640 1 --2- 172.21.15.81:0/443829776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f657815cf80 0x7f65780ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.161+0000 7f6577fff640 1 -- 172.21.15.81:0/443829776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f657815cf80 msgr2=0x7f65780ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.161+0000 7f6577fff640 1 --2- 172.21.15.81:0/443829776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f657815cf80 0x7f65780ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.161+0000 7f6577fff640 1 -- 172.21.15.81:0/443829776 >> v1:172.21.15.81:6789/0 conn(0x7f657809b980 legacy=0x7f657815c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.161+0000 7f6576ffd640 1 -- 172.21.15.81:0/443829776 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 93421480 0 0) 0x7f65780d01c0 con 0x7f657809b980 2024-09-16T01:16:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.161+0000 7f6577fff640 1 -- 172.21.15.81:0/443829776 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65780d04a0 con 0x7f657815c490 2024-09-16T01:16:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.161+0000 7f6577fff640 1 --2- 172.21.15.81:0/443829776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657815c490 0x7f657809b440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f65680097a0 tx=0x7f656802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f9c67094c09fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.161+0000 7f6576ffd640 1 -- 172.21.15.81:0/443829776 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568037070 con 0x7f657815c490 2024-09-16T01:16:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.161+0000 7f6576ffd640 1 -- 172.21.15.81:0/443829776 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6568032440 con 0x7f657815c490 2024-09-16T01:16:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.161+0000 7f6576ffd640 1 -- 172.21.15.81:0/443829776 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568032810 con 0x7f657815c490 2024-09-16T01:16:20.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.162+0000 7f657e80a640 1 -- 172.21.15.81:0/443829776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657815c490 msgr2=0x7f657809b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.162+0000 7f657e80a640 1 --2- 172.21.15.81:0/443829776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657815c490 0x7f657809b440 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f65680097a0 tx=0x7f656802a210 comp rx=0 tx=0).stop 2024-09-16T01:16:20.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.162+0000 7f657e80a640 1 -- 172.21.15.81:0/443829776 shutdown_connections 2024-09-16T01:16:20.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.162+0000 7f657e80a640 1 --2- 172.21.15.81:0/443829776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f657815cf80 0x7f65780ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.162+0000 7f657e80a640 1 --2- 172.21.15.81:0/443829776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657815c490 0x7f657809b440 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.162+0000 7f657e80a640 1 -- 172.21.15.81:0/443829776 >> 172.21.15.81:0/443829776 conn(0x7f65780d23a0 msgr2=0x7f65780d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:20.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.162+0000 7f657e80a640 1 -- 172.21.15.81:0/443829776 shutdown_connections 2024-09-16T01:16:20.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.162+0000 7f657e80a640 1 -- 172.21.15.81:0/443829776 wait complete. 2024-09-16T01:16:20.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.163+0000 7f657e80a640 1 Processor -- start 2024-09-16T01:16:20.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.163+0000 7f657e80a640 1 -- start start 2024-09-16T01:16:20.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f657e80a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657809b980 0x7f6578155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f657e80a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f657815c490 0x7f657815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f657e80a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f657815cf80 0x7f657815b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f657e80a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65780d1260 con 0x7f657809b980 2024-09-16T01:16:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f657e80a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f65780d0a60 con 0x7f657815c490 2024-09-16T01:16:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f657e80a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f65780b51f0 con 0x7f657815cf80 2024-09-16T01:16:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f6577fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657809b980 0x7f6578155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f6577fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657809b980 0x7f6578155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39512/0 (socket says 172.21.15.81:39512) 2024-09-16T01:16:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f6577fff640 1 -- 172.21.15.81:0/297693005 learned_addr learned my addr 172.21.15.81:0/297693005 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f65777fe640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f657815c490 0x7f657815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f657cda7640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f657815cf80 0x7f657815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f6577fff640 1 -- 172.21.15.81:0/297693005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f657815cf80 msgr2=0x7f657815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f6577fff640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f657815cf80 0x7f657815b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f6577fff640 1 -- 172.21.15.81:0/297693005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f657815c490 msgr2=0x7f657815ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f6577fff640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f657815c490 0x7f657815ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f6577fff640 1 -- 172.21.15.81:0/297693005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65780b5440 con 0x7f657809b980 2024-09-16T01:16:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f657cda7640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f657815cf80 0x7f657815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.164+0000 7f65777fe640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f657815c490 0x7f657815ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.165+0000 7f6577fff640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657809b980 0x7f6578155420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6568000c00 tx=0x7f65680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.165+0000 7f6574ff9640 1 -- 172.21.15.81:0/297693005 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568037040 con 0x7f657809b980 2024-09-16T01:16:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.165+0000 7f6574ff9640 1 -- 172.21.15.81:0/297693005 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6568042070 con 0x7f657809b980 2024-09-16T01:16:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.165+0000 7f657e80a640 1 -- 172.21.15.81:0/297693005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65780b5720 con 0x7f657809b980 2024-09-16T01:16:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.165+0000 7f6574ff9640 1 -- 172.21.15.81:0/297693005 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6568030bb0 con 0x7f657809b980 2024-09-16T01:16:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.165+0000 7f657e80a640 1 -- 172.21.15.81:0/297693005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65780b5ce0 con 0x7f657809b980 2024-09-16T01:16:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.166+0000 7f657e80a640 1 -- 172.21.15.81:0/297693005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65780d01c0 con 0x7f657809b980 2024-09-16T01:16:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.166+0000 7f6574ff9640 1 -- 172.21.15.81:0/297693005 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6568047460 con 0x7f657809b980 2024-09-16T01:16:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.167+0000 7f6574ff9640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f656406c2b0 0x7f656406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.167+0000 7f6574ff9640 1 -- 172.21.15.81:0/297693005 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f65680ac360 con 0x7f657809b980 2024-09-16T01:16:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.167+0000 7f65777fe640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f656406c2b0 0x7f656406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.167+0000 7f65777fe640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f656406c2b0 0x7f656406e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f65780cf790 tx=0x7f656c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.171+0000 7f6574ff9640 1 -- 172.21.15.81:0/297693005 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6568032e20 con 0x7f657809b980 2024-09-16T01:16:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.339+0000 7f657e80a640 1 -- 172.21.15.81:0/297693005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65780d3190 con 0x7f657809b980 2024-09-16T01:16:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.341+0000 7f6574ff9640 1 -- 172.21.15.81:0/297693005 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18598 (secure 0 0 0) 0x7f656807a790 con 0x7f657809b980 2024-09-16T01:16:20.342 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:20.342 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:15:44.092404+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:15:36.856888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:15:38.066938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:15:41.748133+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:16:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.343+0000 7f657e80a640 1 -- 172.21.15.81:0/297693005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f656406c2b0 msgr2=0x7f656406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.343+0000 7f657e80a640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f656406c2b0 0x7f656406e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f65780cf790 tx=0x7f656c009040 comp rx=0 tx=0).stop 2024-09-16T01:16:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.343+0000 7f657e80a640 1 -- 172.21.15.81:0/297693005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657809b980 msgr2=0x7f6578155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.343+0000 7f657e80a640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657809b980 0x7f6578155420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6568000c00 tx=0x7f65680046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.343+0000 7f657e80a640 1 -- 172.21.15.81:0/297693005 shutdown_connections 2024-09-16T01:16:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.343+0000 7f657e80a640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f656406c2b0 0x7f656406e770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.343+0000 7f657e80a640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f657815cf80 0x7f657815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.343+0000 7f657e80a640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f657815c490 0x7f657815ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.343+0000 7f657e80a640 1 --2- 172.21.15.81:0/297693005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f657809b980 0x7f6578155420 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.343+0000 7f657e80a640 1 -- 172.21.15.81:0/297693005 >> 172.21.15.81:0/297693005 conn(0x7f65780d23a0 msgr2=0x7f6578070960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:20.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.343+0000 7f657e80a640 1 -- 172.21.15.81:0/297693005 shutdown_connections 2024-09-16T01:16:20.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.343+0000 7f657e80a640 1 -- 172.21.15.81:0/297693005 wait complete. 2024-09-16T01:16:20.355 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:16:20.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:16:20.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.453+0000 7f4a42918640 1 Processor -- start 2024-09-16T01:16:20.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.453+0000 7f4a42918640 1 -- start start 2024-09-16T01:16:20.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a42918640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a3c0d30f0 0x7f4a3c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a42918640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4a3c0b64c0 0x7f4a3c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a42918640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3c0d3690 con 0x7f4a3c15e5f0 2024-09-16T01:16:20.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a42918640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4a3c06d530 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a42918640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4a3c0d3970 con 0x7f4a3c0b64c0 2024-09-16T01:16:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a3b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a3c0d30f0 0x7f4a3c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a3b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a3c0d30f0 0x7f4a3c0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39526/0 (socket says 172.21.15.81:39526) 2024-09-16T01:16:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a3b7fe640 1 -- 172.21.15.81:0/1787593853 learned_addr learned my addr 172.21.15.81:0/1787593853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a40eb5640 1 --2- 172.21.15.81:0/1787593853 >> v2:172.21.15.102:3300/0 conn(0x7f4a3c0b64c0 0x7f4a3c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a3b7fe640 1 -- 172.21.15.81:0/1787593853 >> v2:172.21.15.102:3300/0 conn(0x7f4a3c0b64c0 msgr2=0x7f4a3c06d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a3b7fe640 1 --2- 172.21.15.81:0/1787593853 >> v2:172.21.15.102:3300/0 conn(0x7f4a3c0b64c0 0x7f4a3c06d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a3b7fe640 1 -- 172.21.15.81:0/1787593853 >> v1:172.21.15.102:6789/0 conn(0x7f4a3c15e5f0 legacy=0x7f4a3c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.454+0000 7f4a3b7fe640 1 -- 172.21.15.81:0/1787593853 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c06cee0 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.455+0000 7f4a3b7fe640 1 --2- 172.21.15.81:0/1787593853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a3c0d30f0 0x7f4a3c0b5f80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0ba580 tx=0x7f4a3002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b42ca750eef2bb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.455+0000 7f4a3affd640 1 -- 172.21.15.81:0/1787593853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30037070 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.455+0000 7f4a3affd640 1 -- 172.21.15.81:0/1787593853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a30032440 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.455+0000 7f4a3affd640 1 -- 172.21.15.81:0/1787593853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30032810 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.456+0000 7f4a42918640 1 -- 172.21.15.81:0/1787593853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a3c0d30f0 msgr2=0x7f4a3c0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.456+0000 7f4a42918640 1 --2- 172.21.15.81:0/1787593853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a3c0d30f0 0x7f4a3c0b5f80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0ba580 tx=0x7f4a3002a230 comp rx=0 tx=0).stop 2024-09-16T01:16:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.456+0000 7f4a42918640 1 -- 172.21.15.81:0/1787593853 shutdown_connections 2024-09-16T01:16:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.456+0000 7f4a42918640 1 --2- 172.21.15.81:0/1787593853 >> v2:172.21.15.102:3300/0 conn(0x7f4a3c0b64c0 0x7f4a3c06d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.456+0000 7f4a42918640 1 --2- 172.21.15.81:0/1787593853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a3c0d30f0 0x7f4a3c0b5f80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.456+0000 7f4a42918640 1 -- 172.21.15.81:0/1787593853 >> 172.21.15.81:0/1787593853 conn(0x7f4a3c08bfc0 msgr2=0x7f4a3c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:20.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.456+0000 7f4a42918640 1 -- 172.21.15.81:0/1787593853 shutdown_connections 2024-09-16T01:16:20.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.456+0000 7f4a42918640 1 -- 172.21.15.81:0/1787593853 wait complete. 2024-09-16T01:16:20.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.457+0000 7f4a42918640 1 Processor -- start 2024-09-16T01:16:20.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.457+0000 7f4a42918640 1 -- start start 2024-09-16T01:16:20.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a42918640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a3c0b64c0 0x7f4a3c15d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a42918640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a3c0d30f0 0x7f4a3c15fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a42918640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a3c15e5f0 0x7f4a3c0b8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a42918640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c06df00 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a42918640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3c15e9d0 con 0x7f4a3c0b64c0 2024-09-16T01:16:20.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a42918640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3c06e080 con 0x7f4a3c15e5f0 2024-09-16T01:16:20.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a3b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a3c0d30f0 0x7f4a3c15fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a3b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a3c0d30f0 0x7f4a3c15fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39534/0 (socket says 172.21.15.81:39534) 2024-09-16T01:16:20.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a3b7fe640 1 -- 172.21.15.81:0/3589414462 learned_addr learned my addr 172.21.15.81:0/3589414462 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:20.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a40eb5640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a3c15e5f0 0x7f4a3c0b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a3bfff640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a3c0b64c0 0x7f4a3c15d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a3b7fe640 1 -- 172.21.15.81:0/3589414462 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a3c15e5f0 msgr2=0x7f4a3c0b8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a3b7fe640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a3c15e5f0 0x7f4a3c0b8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a3b7fe640 1 -- 172.21.15.81:0/3589414462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a3c0b64c0 msgr2=0x7f4a3c15d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a3b7fe640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a3c0b64c0 0x7f4a3c15d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a3b7fe640 1 -- 172.21.15.81:0/3589414462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3c0a09e0 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a3bfff640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a3c0b64c0 0x7f4a3c15d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:20.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a3b7fe640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a3c0d30f0 0x7f4a3c15fe00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a30000c00 tx=0x7f4a300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:20.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.458+0000 7f4a38ff9640 1 -- 172.21.15.81:0/3589414462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30041020 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.459+0000 7f4a38ff9640 1 -- 172.21.15.81:0/3589414462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a300306c0 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.459+0000 7f4a42918640 1 -- 172.21.15.81:0/3589414462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3c0a0cc0 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.459+0000 7f4a38ff9640 1 -- 172.21.15.81:0/3589414462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a30037040 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.459+0000 7f4a42918640 1 -- 172.21.15.81:0/3589414462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a3c09f2f0 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.460+0000 7f4a42918640 1 -- 172.21.15.81:0/3589414462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a3c06d9c0 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.460+0000 7f4a38ff9640 1 -- 172.21.15.81:0/3589414462 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4a30044020 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.460+0000 7f4a38ff9640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4a2806c2e0 0x7f4a2806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.461+0000 7f4a38ff9640 1 -- 172.21.15.81:0/3589414462 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4a300abfa0 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.461+0000 7f4a3bfff640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4a2806c2e0 0x7f4a2806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.461+0000 7f4a3bfff640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4a2806c2e0 0x7f4a2806e7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0b2400 tx=0x7f4a2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:20.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.465+0000 7f4a38ff9640 1 -- 172.21.15.81:0/3589414462 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a3004b030 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.664+0000 7f4a42918640 1 -- 172.21.15.81:0/3589414462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a3c06bda0 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.664+0000 7f4a38ff9640 1 -- 172.21.15.81:0/3589414462 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f4a3007a400 con 0x7f4a3c0d30f0 2024-09-16T01:16:20.667 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:20.667 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-16T01:15:58:778268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1441310273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1441310273},{"type":"v1","addr":"172.21.15.102:6834","nonce":1441310273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1086586307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1086586307},{"type":"v1","addr":"172.21.15.102:6835","nonce":1086586307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4105201682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4105201682},{"type":"v1","addr":"172.21.15.81:6835","nonce":4105201682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:15:39.037094+0000","modified":"2024-09-16T01:15:58.115389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2354333316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2354333316},{"type":"v1","addr":"172.21.15.81:6837","nonce":2354333316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-16T01:16:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-16T01:16:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.666+0000 7f4a42918640 1 -- 172.21.15.81:0/3589414462 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4a2806c2e0 msgr2=0x7f4a2806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.666+0000 7f4a42918640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4a2806c2e0 0x7f4a2806e7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0b2400 tx=0x7f4a2c008040 comp rx=0 tx=0).stop 2024-09-16T01:16:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.666+0000 7f4a42918640 1 -- 172.21.15.81:0/3589414462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a3c0d30f0 msgr2=0x7f4a3c15fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.666+0000 7f4a42918640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a3c0d30f0 0x7f4a3c15fe00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a30000c00 tx=0x7f4a300046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.666+0000 7f4a42918640 1 -- 172.21.15.81:0/3589414462 shutdown_connections 2024-09-16T01:16:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.666+0000 7f4a42918640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4a2806c2e0 0x7f4a2806e7a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.666+0000 7f4a42918640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a3c15e5f0 0x7f4a3c0b8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.666+0000 7f4a42918640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a3c0d30f0 0x7f4a3c15fe00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.666+0000 7f4a42918640 1 --2- 172.21.15.81:0/3589414462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a3c0b64c0 0x7f4a3c15d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.666+0000 7f4a42918640 1 -- 172.21.15.81:0/3589414462 >> 172.21.15.81:0/3589414462 conn(0x7f4a3c08bfc0 msgr2=0x7f4a3c0b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.666+0000 7f4a42918640 1 -- 172.21.15.81:0/3589414462 shutdown_connections 2024-09-16T01:16:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.666+0000 7f4a42918640 1 -- 172.21.15.81:0/3589414462 wait complete. 2024-09-16T01:16:20.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:16:20.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.780+0000 7f57729fd640 1 Processor -- start 2024-09-16T01:16:20.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.780+0000 7f57729fd640 1 -- start start 2024-09-16T01:16:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.781+0000 7f57729fd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576c161c80 0x7f576c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.781+0000 7f57729fd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f576c162060 0x7f576c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.781+0000 7f57729fd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f576c06e870 con 0x7f576c0b64b0 2024-09-16T01:16:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.781+0000 7f57729fd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f576c06d9f0 con 0x7f576c162060 2024-09-16T01:16:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.781+0000 7f57729fd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f576c06dcd0 con 0x7f576c161c80 2024-09-16T01:16:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.781+0000 7f576b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f576c162060 0x7f576c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.781+0000 7f5770f9a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f576c0b64b0 0x7f576c162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49796/0 (socket says 172.21.15.81:49796) 2024-09-16T01:16:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.781+0000 7f576b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f576c162060 0x7f576c0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39542/0 (socket says 172.21.15.81:39542) 2024-09-16T01:16:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.781+0000 7f5770f9a640 1 -- 172.21.15.81:0/2376726273 learned_addr learned my addr 172.21.15.81:0/2376726273 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.781+0000 7f576bfff640 1 --2- 172.21.15.81:0/2376726273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576c161c80 0x7f576c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.782+0000 7f576b7fe640 1 -- 172.21.15.81:0/2376726273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576c161c80 msgr2=0x7f576c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.782+0000 7f576b7fe640 1 --2- 172.21.15.81:0/2376726273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576c161c80 0x7f576c06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.782+0000 7f576b7fe640 1 -- 172.21.15.81:0/2376726273 >> v1:172.21.15.81:6789/0 conn(0x7f576c0b64b0 legacy=0x7f576c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.782+0000 7f576b7fe640 1 -- 172.21.15.81:0/2376726273 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576c06dfb0 con 0x7f576c162060 2024-09-16T01:16:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.782+0000 7f576affd640 1 -- 172.21.15.81:0/2376726273 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250362499 0 0) 0x7f5764001490 con 0x7f576c0b64b0 2024-09-16T01:16:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.782+0000 7f576b7fe640 1 --2- 172.21.15.81:0/2376726273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f576c162060 0x7f576c0b5f70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f57600097a0 tx=0x7f576002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636fe76581c38215 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.782+0000 7f576affd640 1 -- 172.21.15.81:0/2376726273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760037070 con 0x7f576c162060 2024-09-16T01:16:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.782+0000 7f576affd640 1 -- 172.21.15.81:0/2376726273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5760032440 con 0x7f576c162060 2024-09-16T01:16:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.782+0000 7f576affd640 1 -- 172.21.15.81:0/2376726273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5760032810 con 0x7f576c162060 2024-09-16T01:16:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.783+0000 7f57729fd640 1 -- 172.21.15.81:0/2376726273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f576c162060 msgr2=0x7f576c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.783+0000 7f57729fd640 1 --2- 172.21.15.81:0/2376726273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f576c162060 0x7f576c0b5f70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f57600097a0 tx=0x7f576002a180 comp rx=0 tx=0).stop 2024-09-16T01:16:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.783+0000 7f57729fd640 1 -- 172.21.15.81:0/2376726273 shutdown_connections 2024-09-16T01:16:20.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.783+0000 7f57729fd640 1 --2- 172.21.15.81:0/2376726273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f576c162060 0x7f576c0b5f70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.783+0000 7f57729fd640 1 --2- 172.21.15.81:0/2376726273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576c161c80 0x7f576c06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.783+0000 7f57729fd640 1 -- 172.21.15.81:0/2376726273 >> 172.21.15.81:0/2376726273 conn(0x7f576c0d44f0 msgr2=0x7f576c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:20.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.783+0000 7f57729fd640 1 -- 172.21.15.81:0/2376726273 shutdown_connections 2024-09-16T01:16:20.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.783+0000 7f57729fd640 1 -- 172.21.15.81:0/2376726273 wait complete. 2024-09-16T01:16:20.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.784+0000 7f57729fd640 1 Processor -- start 2024-09-16T01:16:20.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.784+0000 7f57729fd640 1 -- start start 2024-09-16T01:16:20.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.785+0000 7f57729fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f576c0b64b0 0x7f576c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.785+0000 7f57729fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c161c80 0x7f576c0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.785+0000 7f57729fd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576c162060 0x7f576c0ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.785+0000 7f57729fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f576c0d2a10 con 0x7f576c0b64b0 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.785+0000 7f57729fd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f576c0d2890 con 0x7f576c161c80 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.785+0000 7f57729fd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f576c0b6960 con 0x7f576c162060 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.785+0000 7f576bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f576c0b64b0 0x7f576c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.785+0000 7f576bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f576c0b64b0 0x7f576c1560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39554/0 (socket says 172.21.15.81:39554) 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.785+0000 7f576bfff640 1 -- 172.21.15.81:0/3653065099 learned_addr learned my addr 172.21.15.81:0/3653065099 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f576b7fe640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c161c80 0x7f576c0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f576bfff640 1 -- 172.21.15.81:0/3653065099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576c162060 msgr2=0x7f576c0ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f5770f9a640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576c162060 0x7f576c0ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f576bfff640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576c162060 0x7f576c0ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f576bfff640 1 -- 172.21.15.81:0/3653065099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c161c80 msgr2=0x7f576c0ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f576bfff640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c161c80 0x7f576c0ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f576bfff640 1 -- 172.21.15.81:0/3653065099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576c1f5dc0 con 0x7f576c0b64b0 2024-09-16T01:16:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f576bfff640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f576c0b64b0 0x7f576c1560c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f575c00e9b0 tx=0x7f575c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f5768ff9640 1 -- 172.21.15.81:0/3653065099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c017070 con 0x7f576c0b64b0 2024-09-16T01:16:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f5768ff9640 1 -- 172.21.15.81:0/3653065099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f575c00c9a0 con 0x7f576c0b64b0 2024-09-16T01:16:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f57729fd640 1 -- 172.21.15.81:0/3653065099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576c1f5ae0 con 0x7f576c0b64b0 2024-09-16T01:16:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f5768ff9640 1 -- 172.21.15.81:0/3653065099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c00cd90 con 0x7f576c0b64b0 2024-09-16T01:16:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.786+0000 7f57729fd640 1 -- 172.21.15.81:0/3653065099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f576c1f8820 con 0x7f576c0b64b0 2024-09-16T01:16:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.787+0000 7f57729fd640 1 -- 172.21.15.81:0/3653065099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f576c06e330 con 0x7f576c0b64b0 2024-09-16T01:16:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.787+0000 7f5768ff9640 1 -- 172.21.15.81:0/3653065099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f575c01a070 con 0x7f576c0b64b0 2024-09-16T01:16:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.788+0000 7f5768ff9640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f575806c2b0 0x7f575806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.788+0000 7f576b7fe640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f575806c2b0 0x7f575806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.788+0000 7f5768ff9640 1 -- 172.21.15.81:0/3653065099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f575c08b710 con 0x7f576c0b64b0 2024-09-16T01:16:20.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.788+0000 7f576b7fe640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f575806c2b0 0x7f575806e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5760034000 tx=0x7f576002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:20.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:20.792+0000 7f5768ff9640 1 -- 172.21.15.81:0/3653065099 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f575c059bd0 con 0x7f576c0b64b0 2024-09-16T01:16:21.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.000+0000 7f57729fd640 1 -- 172.21.15.81:0/3653065099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f576c0ba470 con 0x7f576c0b64b0 2024-09-16T01:16:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.000+0000 7f5768ff9640 1 -- 172.21.15.81:0/3653065099 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5225 (secure 0 0 0) 0x7f575c0594d0 con 0x7f576c0b64b0 2024-09-16T01:16:21.001 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:21.001 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"btime":"2024-09-16T01:15:58:778268+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1441310273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1441310273},{"type":"v1","addr":"172.21.15.102:6834","nonce":1441310273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1086586307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1086586307},{"type":"v1","addr":"172.21.15.102:6835","nonce":1086586307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4105201682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4105201682},{"type":"v1","addr":"172.21.15.81:6835","nonce":4105201682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:15:39.037094+0000","modified":"2024-09-16T01:15:58.115389+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2354333316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2354333316},{"type":"v1","addr":"172.21.15.81:6837","nonce":2354333316}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-16T01:16:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-16T01:16:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.002+0000 7f57729fd640 1 -- 172.21.15.81:0/3653065099 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f575806c2b0 msgr2=0x7f575806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.002+0000 7f57729fd640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f575806c2b0 0x7f575806e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5760034000 tx=0x7f576002e000 comp rx=0 tx=0).stop 2024-09-16T01:16:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.002+0000 7f57729fd640 1 -- 172.21.15.81:0/3653065099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f576c0b64b0 msgr2=0x7f576c1560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.002+0000 7f57729fd640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f576c0b64b0 0x7f576c1560c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f575c00e9b0 tx=0x7f575c00ee70 comp rx=0 tx=0).stop 2024-09-16T01:16:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.002+0000 7f57729fd640 1 -- 172.21.15.81:0/3653065099 shutdown_connections 2024-09-16T01:16:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.002+0000 7f57729fd640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f575806c2b0 0x7f575806e770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.002+0000 7f57729fd640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576c162060 0x7f576c0ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.002+0000 7f57729fd640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f576c161c80 0x7f576c0ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.002+0000 7f57729fd640 1 --2- 172.21.15.81:0/3653065099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f576c0b64b0 0x7f576c1560c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.002+0000 7f57729fd640 1 -- 172.21.15.81:0/3653065099 >> 172.21.15.81:0/3653065099 conn(0x7f576c0d44f0 msgr2=0x7f576c0d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.002+0000 7f57729fd640 1 -- 172.21.15.81:0/3653065099 shutdown_connections 2024-09-16T01:16:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.002+0000 7f57729fd640 1 -- 172.21.15.81:0/3653065099 wait complete. 2024-09-16T01:16:21.014 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:16:21.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.112+0000 7f1828bc4640 1 Processor -- start 2024-09-16T01:16:21.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.112+0000 7f1828bc4640 1 -- start start 2024-09-16T01:16:21.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.113+0000 7f1828bc4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415b340 0x7f182409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.113+0000 7f1828bc4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18240b3830 con 0x7f18240b5050 2024-09-16T01:16:21.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.113+0000 7f1828bc4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18240b5610 con 0x7f18240b43f0 2024-09-16T01:16:21.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.113+0000 7f1828bc4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f18240b5bd0 con 0x7f182415b340 2024-09-16T01:16:21.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f1822d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f18240b5050 0x7f182415b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45178/0 (socket says 172.21.15.81:45178) 2024-09-16T01:16:21.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f1822d9d640 1 -- 172.21.15.81:0/686061963 learned_addr learned my addr 172.21.15.81:0/686061963 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:21.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392562834 0 0) 0x7f18240b3830 con 0x7f18240b5050 2024-09-16T01:16:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182259c640 1 --2- 172.21.15.81:0/686061963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415b340 0x7f182409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f180c003520 con 0x7f18240b5050 2024-09-16T01:16:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3643683379 0 0) 0x7f180c003520 con 0x7f18240b5050 2024-09-16T01:16:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415b340 msgr2=0x7f182409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 --2- 172.21.15.81:0/686061963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415b340 0x7f182409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 >> v1:172.21.15.102:6789/0 conn(0x7f18240b43f0 legacy=0x7f18240b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18240b58f0 con 0x7f18240b5050 2024-09-16T01:16:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f181c001670 con 0x7f18240b5050 2024-09-16T01:16:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 >> v1:172.21.15.81:6789/0 conn(0x7f18240b5050 legacy=0x7f182415b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 --2- 172.21.15.81:0/686061963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c0039e0 0x7f180c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 --2- 172.21.15.81:0/686061963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f180c004800 0x7f180c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 --2- 172.21.15.81:0/686061963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415b340 0x7f180c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18240b5bd0 con 0x7f180c0039e0 2024-09-16T01:16:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f180c00bb00 con 0x7f180c004800 2024-09-16T01:16:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f180c00bd00 con 0x7f182415b340 2024-09-16T01:16:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f182259c640 1 --2- 172.21.15.81:0/686061963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c0039e0 0x7f180c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f1822d9d640 1 --2- 172.21.15.81:0/686061963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415b340 0x7f180c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.114+0000 7f1821d9b640 1 --2- 172.21.15.81:0/686061963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f180c004800 0x7f180c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.115+0000 7f182259c640 1 -- 172.21.15.81:0/686061963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415b340 msgr2=0x7f180c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.115+0000 7f182259c640 1 --2- 172.21.15.81:0/686061963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415b340 0x7f180c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.115+0000 7f182259c640 1 -- 172.21.15.81:0/686061963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f180c004800 msgr2=0x7f180c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.115+0000 7f182259c640 1 --2- 172.21.15.81:0/686061963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f180c004800 0x7f180c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.115+0000 7f182259c640 1 -- 172.21.15.81:0/686061963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180c003520 con 0x7f180c0039e0 2024-09-16T01:16:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.115+0000 7f182259c640 1 --2- 172.21.15.81:0/686061963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c0039e0 0x7f180c003e00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1814009f90 tx=0x7f180c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541901e81b35a1ec server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.115+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814009c10 con 0x7f180c0039e0 2024-09-16T01:16:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.115+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1814036070 con 0x7f180c0039e0 2024-09-16T01:16:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.115+0000 7f182159a640 1 -- 172.21.15.81:0/686061963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814031830 con 0x7f180c0039e0 2024-09-16T01:16:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.116+0000 7f1828bc4640 1 -- 172.21.15.81:0/686061963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c0039e0 msgr2=0x7f180c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.116+0000 7f1828bc4640 1 --2- 172.21.15.81:0/686061963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c0039e0 0x7f180c003e00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1814009f90 tx=0x7f180c005830 comp rx=0 tx=0).stop 2024-09-16T01:16:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.116+0000 7f1822d9d640 1 -- 172.21.15.81:0/686061963 reap_dead start 2024-09-16T01:16:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.116+0000 7f1828bc4640 1 -- 172.21.15.81:0/686061963 shutdown_connections 2024-09-16T01:16:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.116+0000 7f1828bc4640 1 -- 172.21.15.81:0/686061963 >> 172.21.15.81:0/686061963 conn(0x7f1824073490 msgr2=0x7f18240b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.116+0000 7f1828bc4640 1 -- 172.21.15.81:0/686061963 shutdown_connections 2024-09-16T01:16:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.116+0000 7f1828bc4640 1 -- 172.21.15.81:0/686061963 wait complete. 2024-09-16T01:16:21.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.117+0000 7f1828bc4640 1 Processor -- start 2024-09-16T01:16:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.117+0000 7f1828bc4640 1 -- start start 2024-09-16T01:16:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f1828bc4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c0039e0 0x7f18241518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f1828bc4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18240d0840 0x7f182406bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f1828bc4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18240d0cc0 0x7f182406c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f1828bc4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18240cdb30 con 0x7f180c0039e0 2024-09-16T01:16:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f1828bc4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f182415d8f0 con 0x7f18240d0840 2024-09-16T01:16:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f1828bc4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f18240cdcb0 con 0x7f18240d0cc0 2024-09-16T01:16:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f182259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c0039e0 0x7f18241518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f182259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c0039e0 0x7f18241518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51368/0 (socket says 172.21.15.81:51368) 2024-09-16T01:16:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f182259c640 1 -- 172.21.15.81:0/3861012543 learned_addr learned my addr 172.21.15.81:0/3861012543 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f1821d9b640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18240d0840 0x7f182406bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f1822d9d640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18240d0cc0 0x7f182406c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f182259c640 1 -- 172.21.15.81:0/3861012543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18240d0cc0 msgr2=0x7f182406c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f182259c640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18240d0cc0 0x7f182406c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f182259c640 1 -- 172.21.15.81:0/3861012543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18240d0840 msgr2=0x7f182406bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f182259c640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18240d0840 0x7f182406bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.118+0000 7f182259c640 1 -- 172.21.15.81:0/3861012543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18241e3fe0 con 0x7f180c0039e0 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.119+0000 7f182259c640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c0039e0 0x7f18241518c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1814009f90 tx=0x7f1814009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.119+0000 7f1812ffd640 1 -- 172.21.15.81:0/3861012543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814003b90 con 0x7f180c0039e0 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.119+0000 7f1812ffd640 1 -- 172.21.15.81:0/3861012543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1814003d30 con 0x7f180c0039e0 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.119+0000 7f1828bc4640 1 -- 172.21.15.81:0/3861012543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18241e42c0 con 0x7f180c0039e0 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.119+0000 7f1812ffd640 1 -- 172.21.15.81:0/3861012543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814004260 con 0x7f180c0039e0 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.119+0000 7f1828bc4640 1 -- 172.21.15.81:0/3861012543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18241e4880 con 0x7f180c0039e0 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.120+0000 7f1828bc4640 1 -- 172.21.15.81:0/3861012543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f182409aa30 con 0x7f180c0039e0 2024-09-16T01:16:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.120+0000 7f1812ffd640 1 -- 172.21.15.81:0/3861012543 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1814005d10 con 0x7f180c0039e0 2024-09-16T01:16:21.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.121+0000 7f1812ffd640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f180406c2e0 0x7f180406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.121+0000 7f1812ffd640 1 -- 172.21.15.81:0/3861012543 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6764+0+0 (secure 0 0 0) 0x7f18140aca10 con 0x7f180c0039e0 2024-09-16T01:16:21.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.121+0000 7f1821d9b640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f180406c2e0 0x7f180406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.121+0000 7f1821d9b640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f180406c2e0 0x7f180406e7a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f18240d0440 tx=0x7f1818009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:21.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.125+0000 7f1812ffd640 1 -- 172.21.15.81:0/3861012543 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f181407a710 con 0x7f180c0039e0 2024-09-16T01:16:21.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.290+0000 7f1828bc4640 1 -- 172.21.15.81:0/3861012543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1824159c30 con 0x7f180c0039e0 2024-09-16T01:16:21.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.291+0000 7f1812ffd640 1 -- 172.21.15.81:0/3861012543 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+19033 (secure 0 0 0) 0x7f181407ea10 con 0x7f180c0039e0 2024-09-16T01:16:21.292 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:21.293 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:16:20.841095+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:15:36.856888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-16T01:15:38.066938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-16T01:15:41.748133+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:16:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.294+0000 7f1828bc4640 1 -- 172.21.15.81:0/3861012543 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f180406c2e0 msgr2=0x7f180406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.294+0000 7f1828bc4640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f180406c2e0 0x7f180406e7a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f18240d0440 tx=0x7f1818009040 comp rx=0 tx=0).stop 2024-09-16T01:16:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.294+0000 7f1828bc4640 1 -- 172.21.15.81:0/3861012543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c0039e0 msgr2=0x7f18241518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.294+0000 7f1828bc4640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c0039e0 0x7f18241518c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1814009f90 tx=0x7f1814009750 comp rx=0 tx=0).stop 2024-09-16T01:16:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.294+0000 7f1828bc4640 1 -- 172.21.15.81:0/3861012543 shutdown_connections 2024-09-16T01:16:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.294+0000 7f1828bc4640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f180406c2e0 0x7f180406e7a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.294+0000 7f1828bc4640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18240d0cc0 0x7f182406c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.294+0000 7f1828bc4640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18240d0840 0x7f182406bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.294+0000 7f1828bc4640 1 --2- 172.21.15.81:0/3861012543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f180c0039e0 0x7f18241518c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.294+0000 7f1828bc4640 1 -- 172.21.15.81:0/3861012543 >> 172.21.15.81:0/3861012543 conn(0x7f1824073490 msgr2=0x7f1824158810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.294+0000 7f1828bc4640 1 -- 172.21.15.81:0/3861012543 shutdown_connections 2024-09-16T01:16:21.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.294+0000 7f1828bc4640 1 -- 172.21.15.81:0/3861012543 wait complete. 2024-09-16T01:16:21.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:16:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.404+0000 7f018ed5b640 1 Processor -- start 2024-09-16T01:16:21.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.404+0000 7f018ed5b640 1 -- start start 2024-09-16T01:16:21.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.405+0000 7f018ed5b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f018815e5f0 0x7f01880d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.405+0000 7f018ed5b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01880b6690 0x7f018806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.405+0000 7f018ed5b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01880d3690 con 0x7f01880d30f0 2024-09-16T01:16:21.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.405+0000 7f018ed5b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f018806d530 con 0x7f01880b6690 2024-09-16T01:16:21.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.405+0000 7f018ed5b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f01880d3970 con 0x7f018815e5f0 2024-09-16T01:16:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.405+0000 7f018d2f8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01880b6690 0x7f018806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.405+0000 7f018d2f8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01880b6690 0x7f018806d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51376/0 (socket says 172.21.15.81:51376) 2024-09-16T01:16:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.405+0000 7f018d2f8640 1 -- 172.21.15.81:0/3690690472 learned_addr learned my addr 172.21.15.81:0/3690690472 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.405+0000 7f018caf7640 1 --2- 172.21.15.81:0/3690690472 >> v2:172.21.15.102:3300/0 conn(0x7f018815e5f0 0x7f01880d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.406+0000 7f018d2f8640 1 -- 172.21.15.81:0/3690690472 >> v2:172.21.15.102:3300/0 conn(0x7f018815e5f0 msgr2=0x7f01880d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.406+0000 7f018d2f8640 1 --2- 172.21.15.81:0/3690690472 >> v2:172.21.15.102:3300/0 conn(0x7f018815e5f0 0x7f01880d4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.406+0000 7f018d2f8640 1 -- 172.21.15.81:0/3690690472 >> v1:172.21.15.102:6789/0 conn(0x7f01880d30f0 legacy=0x7f01880b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:21.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.406+0000 7f018d2f8640 1 -- 172.21.15.81:0/3690690472 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018806cee0 con 0x7f01880b6690 2024-09-16T01:16:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.406+0000 7f018d2f8640 1 --2- 172.21.15.81:0/3690690472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880b6690 0x7f018806d9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0180009e50 tx=0x7f018002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc51d128edb2d99 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.406+0000 7f01877fe640 1 -- 172.21.15.81:0/3690690472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0180036070 con 0x7f01880b6690 2024-09-16T01:16:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.406+0000 7f01877fe640 1 -- 172.21.15.81:0/3690690472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0180031600 con 0x7f01880b6690 2024-09-16T01:16:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.406+0000 7f01877fe640 1 -- 172.21.15.81:0/3690690472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01800319d0 con 0x7f01880b6690 2024-09-16T01:16:21.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.407+0000 7f018ed5b640 1 -- 172.21.15.81:0/3690690472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880b6690 msgr2=0x7f018806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.407+0000 7f018ed5b640 1 --2- 172.21.15.81:0/3690690472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880b6690 0x7f018806d9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0180009e50 tx=0x7f018002a760 comp rx=0 tx=0).stop 2024-09-16T01:16:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.407+0000 7f018ed5b640 1 -- 172.21.15.81:0/3690690472 shutdown_connections 2024-09-16T01:16:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.407+0000 7f018ed5b640 1 --2- 172.21.15.81:0/3690690472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880b6690 0x7f018806d9c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.407+0000 7f018ed5b640 1 --2- 172.21.15.81:0/3690690472 >> v2:172.21.15.102:3300/0 conn(0x7f018815e5f0 0x7f01880d4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.407+0000 7f018ed5b640 1 -- 172.21.15.81:0/3690690472 >> 172.21.15.81:0/3690690472 conn(0x7f018808bfc0 msgr2=0x7f01880d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.407+0000 7f018ed5b640 1 -- 172.21.15.81:0/3690690472 shutdown_connections 2024-09-16T01:16:21.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.407+0000 7f018ed5b640 1 -- 172.21.15.81:0/3690690472 wait complete. 2024-09-16T01:16:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.408+0000 7f018ed5b640 1 Processor -- start 2024-09-16T01:16:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.408+0000 7f018ed5b640 1 -- start start 2024-09-16T01:16:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.409+0000 7f018ed5b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01880b6690 0x7f01880cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.409+0000 7f018ed5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880d30f0 0x7f018815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.409+0000 7f018ed5b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018815e5f0 0x7f018815d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.409+0000 7f018ed5b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f01880d5310 con 0x7f01880d30f0 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.409+0000 7f018ed5b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f018815e9d0 con 0x7f018815e5f0 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.409+0000 7f018ed5b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f018806df00 con 0x7f01880b6690 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.409+0000 7f0187fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880d30f0 0x7f018815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.409+0000 7f0187fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880d30f0 0x7f018815cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51378/0 (socket says 172.21.15.81:51378) 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.409+0000 7f0187fff640 1 -- 172.21.15.81:0/1945707629 learned_addr learned my addr 172.21.15.81:0/1945707629 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.409+0000 7f018d2f8640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018815e5f0 0x7f018815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.409+0000 7f018caf7640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01880b6690 0x7f01880cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.410+0000 7f0187fff640 1 -- 172.21.15.81:0/1945707629 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01880b6690 msgr2=0x7f01880cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.410+0000 7f0187fff640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01880b6690 0x7f01880cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.410+0000 7f0187fff640 1 -- 172.21.15.81:0/1945707629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018815e5f0 msgr2=0x7f018815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.410+0000 7f0187fff640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018815e5f0 0x7f018815d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.410+0000 7f0187fff640 1 -- 172.21.15.81:0/1945707629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0188161410 con 0x7f01880d30f0 2024-09-16T01:16:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.410+0000 7f0187fff640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880d30f0 0x7f018815cc50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f017c00c450 tx=0x7f017c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.410+0000 7f01857fa640 1 -- 172.21.15.81:0/1945707629 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c0052d0 con 0x7f01880d30f0 2024-09-16T01:16:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.410+0000 7f01857fa640 1 -- 172.21.15.81:0/1945707629 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017c005470 con 0x7f01880d30f0 2024-09-16T01:16:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.410+0000 7f01857fa640 1 -- 172.21.15.81:0/1945707629 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c012870 con 0x7f01880d30f0 2024-09-16T01:16:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.410+0000 7f018ed5b640 1 -- 172.21.15.81:0/1945707629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01880cccb0 con 0x7f01880d30f0 2024-09-16T01:16:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.410+0000 7f018ed5b640 1 -- 172.21.15.81:0/1945707629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01880cd270 con 0x7f01880d30f0 2024-09-16T01:16:21.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.411+0000 7f018ed5b640 1 -- 172.21.15.81:0/1945707629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f018806d9c0 con 0x7f01880d30f0 2024-09-16T01:16:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.411+0000 7f01857fa640 1 -- 172.21.15.81:0/1945707629 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f017c012a10 con 0x7f01880d30f0 2024-09-16T01:16:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.412+0000 7f01857fa640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f017406c2b0 0x7f017406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.412+0000 7f01857fa640 1 -- 172.21.15.81:0/1945707629 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6764+0+0 (secure 0 0 0) 0x7f017c08b300 con 0x7f01880d30f0 2024-09-16T01:16:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.412+0000 7f018caf7640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f017406c2b0 0x7f017406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.412+0000 7f018caf7640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f017406c2b0 0x7f017406e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0188075720 tx=0x7f0178008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:21.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.416+0000 7f01857fa640 1 -- 172.21.15.81:0/1945707629 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f017c059000 con 0x7f01880d30f0 2024-09-16T01:16:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.613+0000 7f018ed5b640 1 -- 172.21.15.81:0/1945707629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f01880cd440 con 0x7f01880d30f0 2024-09-16T01:16:21.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-16T01:16:21.614+0000 7f4e951a0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:16:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.615+0000 7f01857fa640 1 -- 172.21.15.81:0/1945707629 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f017c05d300 con 0x7f01880d30f0 2024-09-16T01:16:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:16:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.618+0000 7f018ed5b640 1 -- 172.21.15.81:0/1945707629 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f017406c2b0 msgr2=0x7f017406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.618+0000 7f018ed5b640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f017406c2b0 0x7f017406e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0188075720 tx=0x7f0178008040 comp rx=0 tx=0).stop 2024-09-16T01:16:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.618+0000 7f018ed5b640 1 -- 172.21.15.81:0/1945707629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880d30f0 msgr2=0x7f018815cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.618+0000 7f018ed5b640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880d30f0 0x7f018815cc50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f017c00c450 tx=0x7f017c00c910 comp rx=0 tx=0).stop 2024-09-16T01:16:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.619+0000 7f018ed5b640 1 -- 172.21.15.81:0/1945707629 shutdown_connections 2024-09-16T01:16:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.619+0000 7f018ed5b640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f017406c2b0 0x7f017406e770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.619+0000 7f018ed5b640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f018815e5f0 0x7f018815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.619+0000 7f018ed5b640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01880d30f0 0x7f018815cc50 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f017c00c450 tx=0x7f017c00c910 comp rx=0 tx=0).stop 2024-09-16T01:16:21.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.619+0000 7f018ed5b640 1 --2- 172.21.15.81:0/1945707629 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f01880b6690 0x7f01880cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.619+0000 7f018ed5b640 1 -- 172.21.15.81:0/1945707629 >> 172.21.15.81:0/1945707629 conn(0x7f018808bfc0 msgr2=0x7f01880b9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.619+0000 7f018ed5b640 1 -- 172.21.15.81:0/1945707629 shutdown_connections 2024-09-16T01:16:21.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.619+0000 7f018ed5b640 1 -- 172.21.15.81:0/1945707629 wait complete. 2024-09-16T01:16:21.622 INFO:tasks.ceph.mds.c.smithi081.stderr: -4172> 2024-09-16T01:15:44.684+0000 7f709ecfb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:16:21.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:16:21.656 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:16:21.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.737+0000 7ff423ed0640 1 Processor -- start 2024-09-16T01:16:21.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.737+0000 7ff423ed0640 1 -- start start 2024-09-16T01:16:21.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.738+0000 7ff423ed0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff41c09b140 0x7ff41c169380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.738+0000 7ff423ed0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41c0b6820 con 0x7ff41c158b50 2024-09-16T01:16:21.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.738+0000 7ff423ed0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41c0b6b00 con 0x7ff41c15f950 2024-09-16T01:16:21.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.738+0000 7ff423ed0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff41c0b6de0 con 0x7ff41c09b140 2024-09-16T01:16:21.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.738+0000 7ff42246d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff41c09b140 0x7ff41c169380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.738+0000 7ff421c6c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff41c158b50 0x7ff41c0b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45206/0 (socket says 172.21.15.81:45206) 2024-09-16T01:16:21.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.738+0000 7ff421c6c640 1 -- 172.21.15.81:0/2644664821 learned_addr learned my addr 172.21.15.81:0/2644664821 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:21.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.739+0000 7ff42246d640 1 -- 172.21.15.81:0/2644664821 >> v1:172.21.15.102:6789/0 conn(0x7ff41c15f950 legacy=0x7ff41c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:21.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.739+0000 7ff42246d640 1 -- 172.21.15.81:0/2644664821 >> v1:172.21.15.81:6789/0 conn(0x7ff41c158b50 legacy=0x7ff41c0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.739+0000 7ff42246d640 1 -- 172.21.15.81:0/2644664821 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c0b70c0 con 0x7ff41c09b140 2024-09-16T01:16:21.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.739+0000 7ff420c6a640 1 -- 172.21.15.81:0/2644664821 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749267082 0 0) 0x7ff41c0b6820 con 0x7ff41c158b50 2024-09-16T01:16:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.739+0000 7ff42246d640 1 --2- 172.21.15.81:0/2644664821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff41c09b140 0x7ff41c169380 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff414009d90 tx=0x7ff41402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2ed4116610ae55 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.739+0000 7ff420c6a640 1 -- 172.21.15.81:0/2644664821 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414007740 con 0x7ff41c09b140 2024-09-16T01:16:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.740+0000 7ff420c6a640 1 -- 172.21.15.81:0/2644664821 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4140078e0 con 0x7ff41c09b140 2024-09-16T01:16:21.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.740+0000 7ff420c6a640 1 -- 172.21.15.81:0/2644664821 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414007cb0 con 0x7ff41c09b140 2024-09-16T01:16:21.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.740+0000 7ff423ed0640 1 -- 172.21.15.81:0/2644664821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff41c09b140 msgr2=0x7ff41c169380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.740+0000 7ff423ed0640 1 --2- 172.21.15.81:0/2644664821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff41c09b140 0x7ff41c169380 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff414009d90 tx=0x7ff41402a6f0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.740+0000 7ff423ed0640 1 -- 172.21.15.81:0/2644664821 shutdown_connections 2024-09-16T01:16:21.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.740+0000 7ff423ed0640 1 --2- 172.21.15.81:0/2644664821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff41c09b140 0x7ff41c169380 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.740+0000 7ff423ed0640 1 -- 172.21.15.81:0/2644664821 >> 172.21.15.81:0/2644664821 conn(0x7ff41c0b79e0 msgr2=0x7ff41c0b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:21.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.740+0000 7ff423ed0640 1 -- 172.21.15.81:0/2644664821 shutdown_connections 2024-09-16T01:16:21.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.740+0000 7ff423ed0640 1 -- 172.21.15.81:0/2644664821 wait complete. 2024-09-16T01:16:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.741+0000 7ff423ed0640 1 Processor -- start 2024-09-16T01:16:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.741+0000 7ff423ed0640 1 -- start start 2024-09-16T01:16:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff423ed0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff41c09b140 0x7ff41c0d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff423ed0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff41c158b50 0x7ff41c157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff423ed0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff41c15f950 0x7ff41c0cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff423ed0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c158f30 con 0x7ff41c15f950 2024-09-16T01:16:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff423ed0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c0b6530 con 0x7ff41c158b50 2024-09-16T01:16:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff423ed0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff41c1590b0 con 0x7ff41c09b140 2024-09-16T01:16:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff42246d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff41c15f950 0x7ff41c0cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff42246d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff41c15f950 0x7ff41c0cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51416/0 (socket says 172.21.15.81:51416) 2024-09-16T01:16:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff42246d640 1 -- 172.21.15.81:0/2076653854 learned_addr learned my addr 172.21.15.81:0/2076653854 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff421c6c640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff41c09b140 0x7ff41c0d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff42146b640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff41c158b50 0x7ff41c157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff42246d640 1 -- 172.21.15.81:0/2076653854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff41c09b140 msgr2=0x7ff41c0d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff42246d640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff41c09b140 0x7ff41c0d0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff42246d640 1 -- 172.21.15.81:0/2076653854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff41c158b50 msgr2=0x7ff41c157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff42246d640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff41c158b50 0x7ff41c157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.742+0000 7ff42246d640 1 -- 172.21.15.81:0/2076653854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c1584b0 con 0x7ff41c15f950 2024-09-16T01:16:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.743+0000 7ff42246d640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff41c15f950 0x7ff41c0cdcc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff414009d90 tx=0x7ff414004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.743+0000 7ff4127fc640 1 -- 172.21.15.81:0/2076653854 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff414040070 con 0x7ff41c15f950 2024-09-16T01:16:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.743+0000 7ff4127fc640 1 -- 172.21.15.81:0/2076653854 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff414031c90 con 0x7ff41c15f950 2024-09-16T01:16:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.743+0000 7ff423ed0640 1 -- 172.21.15.81:0/2076653854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41c1f8230 con 0x7ff41c15f950 2024-09-16T01:16:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.743+0000 7ff4127fc640 1 -- 172.21.15.81:0/2076653854 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41403c640 con 0x7ff41c15f950 2024-09-16T01:16:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.743+0000 7ff423ed0640 1 -- 172.21.15.81:0/2076653854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41c0d05d0 con 0x7ff41c15f950 2024-09-16T01:16:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.744+0000 7ff423ed0640 1 -- 172.21.15.81:0/2076653854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff41c070fc0 con 0x7ff41c15f950 2024-09-16T01:16:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.744+0000 7ff4127fc640 1 -- 172.21.15.81:0/2076653854 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff414039040 con 0x7ff41c15f950 2024-09-16T01:16:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.745+0000 7ff4127fc640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff40006c2b0 0x7ff40006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.745+0000 7ff421c6c640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff40006c2b0 0x7ff40006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.745+0000 7ff4127fc640 1 -- 172.21.15.81:0/2076653854 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6850+0+0 (secure 0 0 0) 0x7ff4140ace90 con 0x7ff41c15f950 2024-09-16T01:16:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.745+0000 7ff421c6c640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff40006c2b0 0x7ff40006e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff418000f60 tx=0x7ff418007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.749+0000 7ff4127fc640 1 -- 172.21.15.81:0/2076653854 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff41c1584b0 con 0x7ff41c15f950 2024-09-16T01:16:21.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:21.951+0000 7ff423ed0640 1 -- 172.21.15.81:0/2076653854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff41c0b77a0 con 0x7ff41c15f950 2024-09-16T01:16:22.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.617+0000 7ff4127fc640 1 -- 172.21.15.81:0/2076653854 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7ff41407b2d0 con 0x7ff41c15f950 2024-09-16T01:16:22.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.619+0000 7ff423ed0640 1 -- 172.21.15.81:0/2076653854 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff40006c2b0 msgr2=0x7ff40006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.619+0000 7ff423ed0640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff40006c2b0 0x7ff40006e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff418000f60 tx=0x7ff418007b90 comp rx=0 tx=0).stop 2024-09-16T01:16:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.619+0000 7ff423ed0640 1 -- 172.21.15.81:0/2076653854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff41c15f950 msgr2=0x7ff41c0cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.619+0000 7ff423ed0640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff41c15f950 0x7ff41c0cdcc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff414009d90 tx=0x7ff414004a40 comp rx=0 tx=0).stop 2024-09-16T01:16:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.619+0000 7ff423ed0640 1 -- 172.21.15.81:0/2076653854 shutdown_connections 2024-09-16T01:16:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.619+0000 7ff423ed0640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff40006c2b0 0x7ff40006e770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.619+0000 7ff423ed0640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff41c15f950 0x7ff41c0cdcc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.619+0000 7ff423ed0640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff41c158b50 0x7ff41c157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.619+0000 7ff423ed0640 1 --2- 172.21.15.81:0/2076653854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff41c09b140 0x7ff41c0d0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.619+0000 7ff423ed0640 1 -- 172.21.15.81:0/2076653854 >> 172.21.15.81:0/2076653854 conn(0x7ff41c0b79e0 msgr2=0x7ff41c161620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.619+0000 7ff423ed0640 1 -- 172.21.15.81:0/2076653854 shutdown_connections 2024-09-16T01:16:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.620+0000 7ff423ed0640 1 -- 172.21.15.81:0/2076653854 wait complete. 2024-09-16T01:16:22.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:16:22.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.782+0000 7f1342c77640 1 Processor -- start 2024-09-16T01:16:22.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.783+0000 7f1342c77640 1 -- start start 2024-09-16T01:16:22.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.783+0000 7f1342c77640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f133c0b1920 0x7f133c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.783+0000 7f1342c77640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133c0ce720 con 0x7f133c071160 2024-09-16T01:16:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.783+0000 7f1342c77640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133c0cea00 con 0x7f133c09af70 2024-09-16T01:16:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.783+0000 7f1342c77640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f133c0ccfe0 con 0x7f133c0b1920 2024-09-16T01:16:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.783+0000 7f1341214640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f133c071160 0x7f133c0700c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45214/0 (socket says 172.21.15.81:45214) 2024-09-16T01:16:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.783+0000 7f1341214640 1 -- 172.21.15.81:0/487950066 learned_addr learned my addr 172.21.15.81:0/487950066 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3742288673 0 0) 0x7f133c0ce720 con 0x7f133c071160 2024-09-16T01:16:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1324003520 con 0x7f133c071160 2024-09-16T01:16:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f1340a13640 1 --2- 172.21.15.81:0/487950066 >> v2:172.21.15.102:3300/0 conn(0x7f133c0b1920 0x7f133c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1058623258 0 0) 0x7f1324003520 con 0x7f133c071160 2024-09-16T01:16:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 >> v2:172.21.15.102:3300/0 conn(0x7f133c0b1920 msgr2=0x7f133c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 --2- 172.21.15.81:0/487950066 >> v2:172.21.15.102:3300/0 conn(0x7f133c0b1920 0x7f133c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 >> v1:172.21.15.102:6789/0 conn(0x7f133c09af70 legacy=0x7f133c0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133c0cd2c0 con 0x7f133c071160 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f13340019f0 con 0x7f133c071160 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 >> v1:172.21.15.81:6789/0 conn(0x7f133c071160 legacy=0x7f133c0700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 --2- 172.21.15.81:0/487950066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13240039b0 0x7f1324003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 --2- 172.21.15.81:0/487950066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1324004800 0x7f1324004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 --2- 172.21.15.81:0/487950066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240052e0 0x7f132400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f133c0ccfe0 con 0x7f13240052e0 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f132400c1b0 con 0x7f1324004800 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f132400c3b0 con 0x7f13240039b0 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f1341214640 1 --2- 172.21.15.81:0/487950066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240052e0 0x7f132400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f1340a13640 1 --2- 172.21.15.81:0/487950066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13240039b0 0x7f1324003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133bfff640 1 --2- 172.21.15.81:0/487950066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1324004800 0x7f1324004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f1341214640 1 -- 172.21.15.81:0/487950066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13240039b0 msgr2=0x7f1324003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f1341214640 1 --2- 172.21.15.81:0/487950066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13240039b0 0x7f1324003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f1341214640 1 -- 172.21.15.81:0/487950066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1324004800 msgr2=0x7f1324004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f1341214640 1 --2- 172.21.15.81:0/487950066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1324004800 0x7f1324004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f1341214640 1 -- 172.21.15.81:0/487950066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1324003520 con 0x7f13240052e0 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.784+0000 7f133bfff640 1 --2- 172.21.15.81:0/487950066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1324004800 0x7f1324004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.785+0000 7f1341214640 1 -- 172.21.15.81:0/487950066 reap_dead start 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.785+0000 7f1341214640 1 --2- 172.21.15.81:0/487950066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240052e0 0x7f132400b9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1334002230 tx=0x7f1324005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3bc0363ca2d876 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.785+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133400a4a0 con 0x7f13240052e0 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.785+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133402f070 con 0x7f13240052e0 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.785+0000 7f133b7fe640 1 -- 172.21.15.81:0/487950066 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133402bcb0 con 0x7f13240052e0 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.786+0000 7f1342c77640 1 -- 172.21.15.81:0/487950066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240052e0 msgr2=0x7f132400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.786+0000 7f1342c77640 1 --2- 172.21.15.81:0/487950066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240052e0 0x7f132400b9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1334002230 tx=0x7f1324005830 comp rx=0 tx=0).stop 2024-09-16T01:16:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.786+0000 7f1342c77640 1 -- 172.21.15.81:0/487950066 shutdown_connections 2024-09-16T01:16:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.786+0000 7f1342c77640 1 --2- 172.21.15.81:0/487950066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13240052e0 0x7f132400b9c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.786+0000 7f1342c77640 1 -- 172.21.15.81:0/487950066 >> 172.21.15.81:0/487950066 conn(0x7f133c0b3de0 msgr2=0x7f133c0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.786+0000 7f1342c77640 1 -- 172.21.15.81:0/487950066 shutdown_connections 2024-09-16T01:16:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.786+0000 7f1342c77640 1 -- 172.21.15.81:0/487950066 wait complete. 2024-09-16T01:16:22.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.787+0000 7f1342c77640 1 Processor -- start 2024-09-16T01:16:22.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.787+0000 7f1342c77640 1 -- start start 2024-09-16T01:16:22.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1342c77640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13240052e0 0x7f133c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:22.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1342c77640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f133c0b5120 0x7f133c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:22.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1342c77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b6010 0x7f133c0c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1342c77640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f133c0d01f0 con 0x7f133c0b6010 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1342c77640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f133c0d0070 con 0x7f13240052e0 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1342c77640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f133c09aa30 con 0x7f133c0b5120 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1341214640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b6010 0x7f133c0c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1341214640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b6010 0x7f133c0c7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51434/0 (socket says 172.21.15.81:51434) 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1341214640 1 -- 172.21.15.81:0/59429858 learned_addr learned my addr 172.21.15.81:0/59429858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f133bfff640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f133c0b5120 0x7f133c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1340a13640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13240052e0 0x7f133c1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1341214640 1 -- 172.21.15.81:0/59429858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f133c0b5120 msgr2=0x7f133c0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1341214640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f133c0b5120 0x7f133c0c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1341214640 1 -- 172.21.15.81:0/59429858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13240052e0 msgr2=0x7f133c1549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1341214640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13240052e0 0x7f133c1549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1341214640 1 -- 172.21.15.81:0/59429858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f133c0b65e0 con 0x7f133c0b6010 2024-09-16T01:16:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.788+0000 7f1341214640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b6010 0x7f133c0c7740 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1334000f80 tx=0x7f133402d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.789+0000 7f13397fa640 1 -- 172.21.15.81:0/59429858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133402b850 con 0x7f133c0b6010 2024-09-16T01:16:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.789+0000 7f13397fa640 1 -- 172.21.15.81:0/59429858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133402b9f0 con 0x7f133c0b6010 2024-09-16T01:16:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.789+0000 7f1342c77640 1 -- 172.21.15.81:0/59429858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f133c0b68c0 con 0x7f133c0b6010 2024-09-16T01:16:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.789+0000 7f13397fa640 1 -- 172.21.15.81:0/59429858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133402bda0 con 0x7f133c0b6010 2024-09-16T01:16:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.789+0000 7f1342c77640 1 -- 172.21.15.81:0/59429858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f133c0b6e80 con 0x7f133c0b6010 2024-09-16T01:16:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.790+0000 7f1342c77640 1 -- 172.21.15.81:0/59429858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f133c0ce720 con 0x7f133c0b6010 2024-09-16T01:16:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.790+0000 7f13397fa640 1 -- 172.21.15.81:0/59429858 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1334034470 con 0x7f133c0b6010 2024-09-16T01:16:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.791+0000 7f13397fa640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f132806c2b0 0x7f132806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.791+0000 7f1340a13640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f132806c2b0 0x7f132806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.791+0000 7f13397fa640 1 -- 172.21.15.81:0/59429858 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6850+0+0 (secure 0 0 0) 0x7f13340aba70 con 0x7f133c0b6010 2024-09-16T01:16:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.791+0000 7f1340a13640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f132806c2b0 0x7f132806e770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f132c006fd0 tx=0x7f132c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.795+0000 7f13397fa640 1 -- 172.21.15.81:0/59429858 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1334079710 con 0x7f133c0b6010 2024-09-16T01:16:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:22.962+0000 7f1342c77640 1 -- 172.21.15.81:0/59429858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f133c0ce720 con 0x7f133c0b6010 2024-09-16T01:16:23.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.856+0000 7f13397fa640 1 -- 172.21.15.81:0/59429858 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) ==== 181+0+0 (secure 0 0 0) 0x7f133407da10 con 0x7f133c0b6010 2024-09-16T01:16:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:16:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.859+0000 7f1342c77640 1 -- 172.21.15.81:0/59429858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f132806c2b0 msgr2=0x7f132806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.859+0000 7f1342c77640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f132806c2b0 0x7f132806e770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f132c006fd0 tx=0x7f132c008040 comp rx=0 tx=0).stop 2024-09-16T01:16:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.859+0000 7f1342c77640 1 -- 172.21.15.81:0/59429858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b6010 msgr2=0x7f133c0c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.859+0000 7f1342c77640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b6010 0x7f133c0c7740 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1334000f80 tx=0x7f133402d070 comp rx=0 tx=0).stop 2024-09-16T01:16:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.860+0000 7f1342c77640 1 -- 172.21.15.81:0/59429858 shutdown_connections 2024-09-16T01:16:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.860+0000 7f1342c77640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f132806c2b0 0x7f132806e770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.860+0000 7f1342c77640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f133c0b6010 0x7f133c0c7740 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.860+0000 7f1342c77640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f133c0b5120 0x7f133c0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.860+0000 7f1342c77640 1 --2- 172.21.15.81:0/59429858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13240052e0 0x7f133c1549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.860+0000 7f1342c77640 1 -- 172.21.15.81:0/59429858 >> 172.21.15.81:0/59429858 conn(0x7f133c0b3de0 msgr2=0x7f133c0cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.860+0000 7f1342c77640 1 -- 172.21.15.81:0/59429858 shutdown_connections 2024-09-16T01:16:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.860+0000 7f1342c77640 1 -- 172.21.15.81:0/59429858 wait complete. 2024-09-16T01:16:23.875 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:16:23.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.988+0000 7f3fcbcba640 1 Processor -- start 2024-09-16T01:16:23.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.989+0000 7f3fcbcba640 1 -- start start 2024-09-16T01:16:23.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.989+0000 7f3fcbcba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fc4162340 0x7f3fc406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:23.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.989+0000 7f3fcbcba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3fc40cf280 0x7f3fc4162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:23.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.989+0000 7f3fcbcba640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3fc4162c60 0x7f3fc40d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:23.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.989+0000 7f3fcbcba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3fc406de90 con 0x7f3fc40cf280 2024-09-16T01:16:23.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.989+0000 7f3fcbcba640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3fc415ff70 con 0x7f3fc4162c60 2024-09-16T01:16:23.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.989+0000 7f3fcbcba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc40d4d10 con 0x7f3fc4162340 2024-09-16T01:16:23.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.990+0000 7f3fc9255640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3fc40cf280 0x7f3fc4162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:23.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.990+0000 7f3fc9255640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3fc40cf280 0x7f3fc4162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51450/0 (socket says 172.21.15.81:51450) 2024-09-16T01:16:23.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.990+0000 7f3fc9255640 1 -- 172.21.15.81:0/3246816436 learned_addr learned my addr 172.21.15.81:0/3246816436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:23.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.990+0000 7f3fc9a56640 1 --2- 172.21.15.81:0/3246816436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fc4162340 0x7f3fc406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:23.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.990+0000 7f3fca257640 1 --2- 172.21.15.81:0/3246816436 >> v2:172.21.15.102:3300/0 conn(0x7f3fc4162c60 0x7f3fc40d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:23.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.990+0000 7f3fc9255640 1 -- 172.21.15.81:0/3246816436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fc4162340 msgr2=0x7f3fc406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:23.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.990+0000 7f3fc9255640 1 --2- 172.21.15.81:0/3246816436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fc4162340 0x7f3fc406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:23.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.990+0000 7f3fc9255640 1 -- 172.21.15.81:0/3246816436 >> v2:172.21.15.102:3300/0 conn(0x7f3fc4162c60 msgr2=0x7f3fc40d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:23.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.990+0000 7f3fc9255640 1 --2- 172.21.15.81:0/3246816436 >> v2:172.21.15.102:3300/0 conn(0x7f3fc4162c60 0x7f3fc40d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:23.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.990+0000 7f3fc9255640 1 -- 172.21.15.81:0/3246816436 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc40d4ff0 con 0x7f3fc40cf280 2024-09-16T01:16:23.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fc9255640 1 --2- 172.21.15.81:0/3246816436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc40cf280 0x7f3fc4162720 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40c7f30 tx=0x7f3fb802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2dfadbb8ab91b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:23.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fc8a54640 1 -- 172.21.15.81:0/3246816436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8004030 con 0x7f3fc40cf280 2024-09-16T01:16:23.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fc8a54640 1 -- 172.21.15.81:0/3246816436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb80041d0 con 0x7f3fc40cf280 2024-09-16T01:16:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fc8a54640 1 -- 172.21.15.81:0/3246816436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8003610 con 0x7f3fc40cf280 2024-09-16T01:16:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3246816436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc40cf280 msgr2=0x7f3fc4162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fcbcba640 1 --2- 172.21.15.81:0/3246816436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc40cf280 0x7f3fc4162720 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40c7f30 tx=0x7f3fb802a130 comp rx=0 tx=0).stop 2024-09-16T01:16:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3246816436 shutdown_connections 2024-09-16T01:16:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fcbcba640 1 --2- 172.21.15.81:0/3246816436 >> v2:172.21.15.102:3300/0 conn(0x7f3fc4162c60 0x7f3fc40d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fcbcba640 1 --2- 172.21.15.81:0/3246816436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc40cf280 0x7f3fc4162720 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fcbcba640 1 --2- 172.21.15.81:0/3246816436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fc4162340 0x7f3fc406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3246816436 >> 172.21.15.81:0/3246816436 conn(0x7f3fc408bfc0 msgr2=0x7f3fc40d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3246816436 shutdown_connections 2024-09-16T01:16:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.991+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3246816436 wait complete. 2024-09-16T01:16:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.993+0000 7f3fcbcba640 1 Processor -- start 2024-09-16T01:16:23.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.993+0000 7f3fcbcba640 1 -- start start 2024-09-16T01:16:23.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.993+0000 7f3fcbcba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc40cf280 0x7f3fc40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:23.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.993+0000 7f3fcbcba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fc4162340 0x7f3fc4156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:23.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.993+0000 7f3fcbcba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fc4162c60 0x7f3fc40b9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:23.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.993+0000 7f3fcbcba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc40cf6c0 con 0x7f3fc40cf280 2024-09-16T01:16:23.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.993+0000 7f3fcbcba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3fc40d52d0 con 0x7f3fc4162340 2024-09-16T01:16:23.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.993+0000 7f3fcbcba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3fc4163110 con 0x7f3fc4162c60 2024-09-16T01:16:23.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.993+0000 7f3fc9a56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc40cf280 0x7f3fc40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:23.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.993+0000 7f3fc9a56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc40cf280 0x7f3fc40b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51466/0 (socket says 172.21.15.81:51466) 2024-09-16T01:16:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.993+0000 7f3fc9a56640 1 -- 172.21.15.81:0/3695172625 learned_addr learned my addr 172.21.15.81:0/3695172625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fc9255640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fc4162340 0x7f3fc4156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fca257640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fc4162c60 0x7f3fc40b9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fc9a56640 1 -- 172.21.15.81:0/3695172625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fc4162c60 msgr2=0x7f3fc40b9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fc9a56640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fc4162c60 0x7f3fc40b9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fc9a56640 1 -- 172.21.15.81:0/3695172625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fc4162340 msgr2=0x7f3fc4156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fc9a56640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fc4162340 0x7f3fc4156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fc9a56640 1 -- 172.21.15.81:0/3695172625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fc40b5220 con 0x7f3fc40cf280 2024-09-16T01:16:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fc9a56640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc40cf280 0x7f3fc40b3f30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000d800 tx=0x7f3fc000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fb67fc640 1 -- 172.21.15.81:0/3695172625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0018030 con 0x7f3fc40cf280 2024-09-16T01:16:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fb67fc640 1 -- 172.21.15.81:0/3695172625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc00096a0 con 0x7f3fc40cf280 2024-09-16T01:16:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3695172625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fc4157320 con 0x7f3fc40cf280 2024-09-16T01:16:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fb67fc640 1 -- 172.21.15.81:0/3695172625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0009870 con 0x7f3fc40cf280 2024-09-16T01:16:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.994+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3695172625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fc40b4980 con 0x7f3fc40cf280 2024-09-16T01:16:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.995+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3695172625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fc4162720 con 0x7f3fc40cf280 2024-09-16T01:16:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.995+0000 7f3fb67fc640 1 -- 172.21.15.81:0/3695172625 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3fc001b070 con 0x7f3fc40cf280 2024-09-16T01:16:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.996+0000 7f3fb67fc640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3fa806c2b0 0x7f3fa806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.996+0000 7f3fb67fc640 1 -- 172.21.15.81:0/3695172625 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6412+0+0 (secure 0 0 0) 0x7f3fc008b940 con 0x7f3fc40cf280 2024-09-16T01:16:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.996+0000 7f3fc9255640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3fa806c2b0 0x7f3fa806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:23.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:23.996+0000 7f3fc9255640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3fa806c2b0 0x7f3fa806e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8033000 tx=0x7f3fb802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:24.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.000+0000 7f3fb67fc640 1 -- 172.21.15.81:0/3695172625 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3fc0059df0 con 0x7f3fc40cf280 2024-09-16T01:16:24.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.168+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3695172625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3fc408e640 con 0x7f3fc40cf280 2024-09-16T01:16:24.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.862+0000 7f3fb67fc640 1 -- 172.21.15.81:0/3695172625 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) ==== 169+0+0 (secure 0 0 0) 0x7f3fc00596f0 con 0x7f3fc40cf280 2024-09-16T01:16:24.863 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-16T01:16:24.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.865+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3695172625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3fa806c2b0 msgr2=0x7f3fa806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:24.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.865+0000 7f3fcbcba640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3fa806c2b0 0x7f3fa806e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8033000 tx=0x7f3fb802e000 comp rx=0 tx=0).stop 2024-09-16T01:16:24.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.865+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3695172625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc40cf280 msgr2=0x7f3fc40b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:24.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.865+0000 7f3fcbcba640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc40cf280 0x7f3fc40b3f30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000d800 tx=0x7f3fc000dcc0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.865+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3695172625 shutdown_connections 2024-09-16T01:16:24.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.865+0000 7f3fcbcba640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3fa806c2b0 0x7f3fa806e770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.865+0000 7f3fcbcba640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fc4162c60 0x7f3fc40b9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.865+0000 7f3fcbcba640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fc4162340 0x7f3fc4156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.865+0000 7f3fcbcba640 1 --2- 172.21.15.81:0/3695172625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fc40cf280 0x7f3fc40b3f30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.865+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3695172625 >> 172.21.15.81:0/3695172625 conn(0x7f3fc408bfc0 msgr2=0x7f3fc4160240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:24.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.865+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3695172625 shutdown_connections 2024-09-16T01:16:24.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.865+0000 7f3fcbcba640 1 -- 172.21.15.81:0/3695172625 wait complete. 2024-09-16T01:16:24.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-16T01:16:24.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.980+0000 7f3f77711640 1 Processor -- start 2024-09-16T01:16:24.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.980+0000 7f3f77711640 1 -- start start 2024-09-16T01:16:24.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.981+0000 7f3f77711640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3f7015e7f0 0x7f3f700b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:24.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.981+0000 7f3f77711640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7006cdc0 con 0x7f3f700af210 2024-09-16T01:16:24.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.981+0000 7f3f77711640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7006d0a0 con 0x7f3f70071180 2024-09-16T01:16:24.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.981+0000 7f3f77711640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3f7006d380 con 0x7f3f7015e7f0 2024-09-16T01:16:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.981+0000 7f3f74cac640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3f700af210 0x7f3f70070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45216/0 (socket says 172.21.15.81:45216) 2024-09-16T01:16:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.981+0000 7f3f74cac640 1 -- 172.21.15.81:0/2118546374 learned_addr learned my addr 172.21.15.81:0/2118546374 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.981+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2660773041 0 0) 0x7f3f7006cdc0 con 0x7f3f700af210 2024-09-16T01:16:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.981+0000 7f3f754ad640 1 --2- 172.21.15.81:0/2118546374 >> v2:172.21.15.102:3300/0 conn(0x7f3f7015e7f0 0x7f3f700b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.981+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f5c003520 con 0x7f3f700af210 2024-09-16T01:16:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 900534891 0 0) 0x7f3f5c003520 con 0x7f3f700af210 2024-09-16T01:16:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 >> v2:172.21.15.102:3300/0 conn(0x7f3f7015e7f0 msgr2=0x7f3f700b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 --2- 172.21.15.81:0/2118546374 >> v2:172.21.15.102:3300/0 conn(0x7f3f7015e7f0 0x7f3f700b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 >> v1:172.21.15.102:6789/0 conn(0x7f3f70071180 legacy=0x7f3f7006de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7006d660 con 0x7f3f700af210 2024-09-16T01:16:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f3f60001670 con 0x7f3f700af210 2024-09-16T01:16:24.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 >> v1:172.21.15.81:6789/0 conn(0x7f3f700af210 legacy=0x7f3f70070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 --2- 172.21.15.81:0/2118546374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f5c0039b0 0x7f3f5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 --2- 172.21.15.81:0/2118546374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c004800 0x7f3f5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 --2- 172.21.15.81:0/2118546374 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f5c0051c0 0x7f3f5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7006d380 con 0x7f3f5c004800 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5c00c060 con 0x7f3f5c0039b0 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3f5c00c260 con 0x7f3f5c0051c0 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f74cac640 1 --2- 172.21.15.81:0/2118546374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c004800 0x7f3f5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f754ad640 1 --2- 172.21.15.81:0/2118546374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f5c0039b0 0x7f3f5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f75cae640 1 --2- 172.21.15.81:0/2118546374 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f5c0051c0 0x7f3f5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f74cac640 1 -- 172.21.15.81:0/2118546374 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f5c0051c0 msgr2=0x7f3f5c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f74cac640 1 --2- 172.21.15.81:0/2118546374 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f5c0051c0 0x7f3f5c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f74cac640 1 -- 172.21.15.81:0/2118546374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f5c0039b0 msgr2=0x7f3f5c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f74cac640 1 --2- 172.21.15.81:0/2118546374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f5c0039b0 0x7f3f5c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f74cac640 1 -- 172.21.15.81:0/2118546374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5c003520 con 0x7f3f5c004800 2024-09-16T01:16:24.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.982+0000 7f3f75cae640 1 -- 172.21.15.81:0/2118546374 reap_dead start 2024-09-16T01:16:24.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.983+0000 7f3f74cac640 1 --2- 172.21.15.81:0/2118546374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c004800 0x7f3f5c004c80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000c210 tx=0x7f3f5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7f217d36e65764 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:24.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.983+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f60007d10 con 0x7f3f5c004800 2024-09-16T01:16:24.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.983+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f600058d0 con 0x7f3f5c004800 2024-09-16T01:16:24.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.983+0000 7f3f67fff640 1 -- 172.21.15.81:0/2118546374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f60005d40 con 0x7f3f5c004800 2024-09-16T01:16:24.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.983+0000 7f3f77711640 1 -- 172.21.15.81:0/2118546374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c004800 msgr2=0x7f3f5c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:24.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.983+0000 7f3f77711640 1 --2- 172.21.15.81:0/2118546374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c004800 0x7f3f5c004c80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000c210 tx=0x7f3f5c005830 comp rx=0 tx=0).stop 2024-09-16T01:16:24.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.983+0000 7f3f77711640 1 -- 172.21.15.81:0/2118546374 shutdown_connections 2024-09-16T01:16:24.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.983+0000 7f3f77711640 1 --2- 172.21.15.81:0/2118546374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f5c004800 0x7f3f5c004c80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.983+0000 7f3f77711640 1 -- 172.21.15.81:0/2118546374 >> 172.21.15.81:0/2118546374 conn(0x7f3f700b3f30 msgr2=0x7f3f700b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:24.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.984+0000 7f3f77711640 1 -- 172.21.15.81:0/2118546374 shutdown_connections 2024-09-16T01:16:24.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.984+0000 7f3f77711640 1 -- 172.21.15.81:0/2118546374 wait complete. 2024-09-16T01:16:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.985+0000 7f3f77711640 1 Processor -- start 2024-09-16T01:16:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.985+0000 7f3f77711640 1 -- start start 2024-09-16T01:16:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.985+0000 7f3f77711640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f5c004800 0x7f3f70155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.985+0000 7f3f77711640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f70149910 0x7f3f70149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.985+0000 7f3f77711640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f701f4590 0x7f3f701f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.985+0000 7f3f77711640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f70070a70 con 0x7f3f701f4590 2024-09-16T01:16:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f77711640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3f700b6150 con 0x7f3f70149910 2024-09-16T01:16:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f77711640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3f70070bf0 con 0x7f3f5c004800 2024-09-16T01:16:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f75cae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f701f4590 0x7f3f701f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:24.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f75cae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f701f4590 0x7f3f701f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51478/0 (socket says 172.21.15.81:51478) 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f75cae640 1 -- 172.21.15.81:0/477068027 learned_addr learned my addr 172.21.15.81:0/477068027 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f754ad640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f5c004800 0x7f3f70155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f74cac640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f70149910 0x7f3f70149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f75cae640 1 -- 172.21.15.81:0/477068027 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f5c004800 msgr2=0x7f3f70155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f75cae640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f5c004800 0x7f3f70155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f75cae640 1 -- 172.21.15.81:0/477068027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f70149910 msgr2=0x7f3f70149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f75cae640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f70149910 0x7f3f70149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f75cae640 1 -- 172.21.15.81:0/477068027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f70156340 con 0x7f3f701f4590 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f75cae640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f701f4590 0x7f3f701f49d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3f68007fd0 tx=0x7f3f6800ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f65ffb640 1 -- 172.21.15.81:0/477068027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f68019070 con 0x7f3f701f4590 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f65ffb640 1 -- 172.21.15.81:0/477068027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f68003b80 con 0x7f3f701f4590 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f77711640 1 -- 172.21.15.81:0/477068027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f70156620 con 0x7f3f701f4590 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.986+0000 7f3f65ffb640 1 -- 172.21.15.81:0/477068027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f680050d0 con 0x7f3f701f4590 2024-09-16T01:16:24.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.987+0000 7f3f77711640 1 -- 172.21.15.81:0/477068027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7015bbc0 con 0x7f3f701f4590 2024-09-16T01:16:24.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.987+0000 7f3f77711640 1 -- 172.21.15.81:0/477068027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f700b6d10 con 0x7f3f701f4590 2024-09-16T01:16:24.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.988+0000 7f3f65ffb640 1 -- 172.21.15.81:0/477068027 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3f6801c070 con 0x7f3f701f4590 2024-09-16T01:16:24.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.988+0000 7f3f65ffb640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3f5406c2b0 0x7f3f5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:24.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.988+0000 7f3f65ffb640 1 -- 172.21.15.81:0/477068027 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5853+0+0 (secure 0 0 0) 0x7f3f6808a9e0 con 0x7f3f701f4590 2024-09-16T01:16:24.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.988+0000 7f3f754ad640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3f5406c2b0 0x7f3f5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:24.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.989+0000 7f3f754ad640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3f5406c2b0 0x7f3f5406e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009c40 tx=0x7f3f6c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:24.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:24.992+0000 7f3f65ffb640 1 -- 172.21.15.81:0/477068027 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f68058a70 con 0x7f3f701f4590 2024-09-16T01:16:25.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.158+0000 7f3f77711640 1 -- 172.21.15.81:0/477068027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3f700b2cc0 con 0x7f3f701f4590 2024-09-16T01:16:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.867+0000 7f3f65ffb640 1 -- 172.21.15.81:0/477068027 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v29) ==== 178+0+0 (secure 0 0 0) 0x7f3f6805cd70 con 0x7f3f701f4590 2024-09-16T01:16:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' removed 2024-09-16T01:16:25.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.871+0000 7f3f77711640 1 -- 172.21.15.81:0/477068027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3f5406c2b0 msgr2=0x7f3f5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.871+0000 7f3f77711640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3f5406c2b0 0x7f3f5406e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009c40 tx=0x7f3f6c009190 comp rx=0 tx=0).stop 2024-09-16T01:16:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.871+0000 7f3f77711640 1 -- 172.21.15.81:0/477068027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f701f4590 msgr2=0x7f3f701f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.871+0000 7f3f77711640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f701f4590 0x7f3f701f49d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3f68007fd0 tx=0x7f3f6800ead0 comp rx=0 tx=0).stop 2024-09-16T01:16:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.871+0000 7f3f77711640 1 -- 172.21.15.81:0/477068027 shutdown_connections 2024-09-16T01:16:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.871+0000 7f3f77711640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3f5406c2b0 0x7f3f5406e770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:25.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.871+0000 7f3f77711640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f701f4590 0x7f3f701f49d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:25.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.871+0000 7f3f77711640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f70149910 0x7f3f70149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:25.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.871+0000 7f3f77711640 1 --2- 172.21.15.81:0/477068027 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f5c004800 0x7f3f70155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:25.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.872+0000 7f3f77711640 1 -- 172.21.15.81:0/477068027 >> 172.21.15.81:0/477068027 conn(0x7f3f700b3f30 msgr2=0x7f3f700b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:25.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.872+0000 7f3f77711640 1 -- 172.21.15.81:0/477068027 shutdown_connections 2024-09-16T01:16:25.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:25.872+0000 7f3f77711640 1 -- 172.21.15.81:0/477068027 wait complete. 2024-09-16T01:16:25.888 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:16:25.888 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T01:16:25.888 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:16:25.889 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:16:25.889 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:16:25.889 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T01:16:25.889 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:16:25.889 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:16:25.889 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:16:25.890 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T01:16:25.890 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:16:25.890 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:16:25.890 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:16:25.890 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T01:16:25.890 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:16:25.891 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:16:25.899 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:16:25.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:16:25.900 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:16:25.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:16:25.902 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:16:25.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:16:25.903 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:16:25.903 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:16:25.942 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:16:25.943 DEBUG:teuthology.parallel:result is None 2024-09-16T01:16:25.944 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:16:25.944 DEBUG:teuthology.parallel:result is None 2024-09-16T01:16:25.945 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:16:25.945 DEBUG:teuthology.parallel:result is None 2024-09-16T01:16:25.946 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:16:25.946 DEBUG:teuthology.parallel:result is None 2024-09-16T01:16:25.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T01:16:26.020 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:16:26.021 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:16:26.026 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:16:26.026 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-16T01:16:26.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.052+0000 7f780c9f6640 1 Processor -- start 2024-09-16T01:16:26.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.052+0000 7f780c9f6640 1 -- start start 2024-09-16T01:16:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f780c9f6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7808161c80 0x7f780806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f780c9f6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f78080b6680 0x7f78080cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f780c9f6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f780806e870 con 0x7f7808162060 2024-09-16T01:16:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f780c9f6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f780806d9f0 con 0x7f78080b6680 2024-09-16T01:16:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f780c9f6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f780806dcd0 con 0x7f7808161c80 2024-09-16T01:16:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f7805d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7808162060 0x7f78080b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45238/0 (socket says 172.21.15.81:45238) 2024-09-16T01:16:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f7805d9b640 1 -- 172.21.15.81:0/3497106406 learned_addr learned my addr 172.21.15.81:0/3497106406 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f7806d9d640 1 --2- 172.21.15.81:0/3497106406 >> v2:172.21.15.81:3300/0 conn(0x7f78080b6680 0x7f78080cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f780659c640 1 --2- 172.21.15.81:0/3497106406 >> v2:172.21.15.102:3300/0 conn(0x7f7808161c80 0x7f780806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:26.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f780559a640 1 -- 172.21.15.81:0/3497106406 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4061614277 0 0) 0x7f77fc001110 con 0x7f7808162060 2024-09-16T01:16:26.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f7806d9d640 1 -- 172.21.15.81:0/3497106406 >> v2:172.21.15.102:3300/0 conn(0x7f7808161c80 msgr2=0x7f780806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:26.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f7806d9d640 1 --2- 172.21.15.81:0/3497106406 >> v2:172.21.15.102:3300/0 conn(0x7f7808161c80 0x7f780806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:26.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f7806d9d640 1 -- 172.21.15.81:0/3497106406 >> v1:172.21.15.81:6789/0 conn(0x7f7808162060 legacy=0x7f78080b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:26.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.053+0000 7f7806d9d640 1 -- 172.21.15.81:0/3497106406 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780806dfb0 con 0x7f78080b6680 2024-09-16T01:16:26.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.054+0000 7f7806d9d640 1 --2- 172.21.15.81:0/3497106406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78080b6680 0x7f78080cf1e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f780808d7a0 tx=0x7f780002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7e17f016b3c06c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:26.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.054+0000 7f780559a640 1 -- 172.21.15.81:0/3497106406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800007740 con 0x7f78080b6680 2024-09-16T01:16:26.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.054+0000 7f780559a640 1 -- 172.21.15.81:0/3497106406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78000078e0 con 0x7f78080b6680 2024-09-16T01:16:26.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.054+0000 7f780559a640 1 -- 172.21.15.81:0/3497106406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800007cb0 con 0x7f78080b6680 2024-09-16T01:16:26.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.054+0000 7f780c9f6640 1 -- 172.21.15.81:0/3497106406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78080b6680 msgr2=0x7f78080cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.054+0000 7f780c9f6640 1 --2- 172.21.15.81:0/3497106406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78080b6680 0x7f78080cf1e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f780808d7a0 tx=0x7f780002a680 comp rx=0 tx=0).stop 2024-09-16T01:16:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.055+0000 7f780c9f6640 1 -- 172.21.15.81:0/3497106406 shutdown_connections 2024-09-16T01:16:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.055+0000 7f780c9f6640 1 --2- 172.21.15.81:0/3497106406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78080b6680 0x7f78080cf1e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.055+0000 7f780c9f6640 1 --2- 172.21.15.81:0/3497106406 >> v2:172.21.15.102:3300/0 conn(0x7f7808161c80 0x7f780806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.055+0000 7f780c9f6640 1 -- 172.21.15.81:0/3497106406 >> 172.21.15.81:0/3497106406 conn(0x7f78080d44f0 msgr2=0x7f78080d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.055+0000 7f780c9f6640 1 -- 172.21.15.81:0/3497106406 shutdown_connections 2024-09-16T01:16:26.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.055+0000 7f780c9f6640 1 -- 172.21.15.81:0/3497106406 wait complete. 2024-09-16T01:16:26.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.056+0000 7f780c9f6640 1 Processor -- start 2024-09-16T01:16:26.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.056+0000 7f780c9f6640 1 -- start start 2024-09-16T01:16:26.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f780c9f6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f78080b6680 0x7f7808153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:26.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f780c9f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7808161c80 0x7f78080b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:26.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f780c9f6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7808162060 0x7f78080b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:26.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f780c9f6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78080b6b30 con 0x7f7808161c80 2024-09-16T01:16:26.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f780c9f6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f78080d2aa0 con 0x7f7808162060 2024-09-16T01:16:26.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f780c9f6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f78080b6cb0 con 0x7f78080b6680 2024-09-16T01:16:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f7805d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7808161c80 0x7f78080b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f7805d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7808161c80 0x7f78080b7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51528/0 (socket says 172.21.15.81:51528) 2024-09-16T01:16:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f7805d9b640 1 -- 172.21.15.81:0/691199501 learned_addr learned my addr 172.21.15.81:0/691199501 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f7806d9d640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7808162060 0x7f78080b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f780659c640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f78080b6680 0x7f7808153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f7805d9b640 1 -- 172.21.15.81:0/691199501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f78080b6680 msgr2=0x7f7808153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f7805d9b640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f78080b6680 0x7f7808153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f7805d9b640 1 -- 172.21.15.81:0/691199501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7808162060 msgr2=0x7f78080b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f7805d9b640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7808162060 0x7f78080b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.057+0000 7f7805d9b640 1 -- 172.21.15.81:0/691199501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78081536b0 con 0x7f7808161c80 2024-09-16T01:16:26.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.058+0000 7f7805d9b640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7808161c80 0x7f78080b7d50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00c750 tx=0x7f77fc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:26.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.058+0000 7f77f6ffd640 1 -- 172.21.15.81:0/691199501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc018070 con 0x7f7808161c80 2024-09-16T01:16:26.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.058+0000 7f77f6ffd640 1 -- 172.21.15.81:0/691199501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77fc0072d0 con 0x7f7808161c80 2024-09-16T01:16:26.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.058+0000 7f780c9f6640 1 -- 172.21.15.81:0/691199501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78080c9940 con 0x7f7808161c80 2024-09-16T01:16:26.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.058+0000 7f77f6ffd640 1 -- 172.21.15.81:0/691199501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0047e0 con 0x7f7808161c80 2024-09-16T01:16:26.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.058+0000 7f780c9f6640 1 -- 172.21.15.81:0/691199501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78080c9380 con 0x7f7808161c80 2024-09-16T01:16:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.059+0000 7f780c9f6640 1 -- 172.21.15.81:0/691199501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f780806e330 con 0x7f7808161c80 2024-09-16T01:16:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.059+0000 7f77f6ffd640 1 -- 172.21.15.81:0/691199501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f77fc01b070 con 0x7f7808161c80 2024-09-16T01:16:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.060+0000 7f77f6ffd640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f77e806c2b0 0x7f77e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.060+0000 7f77f6ffd640 1 -- 172.21.15.81:0/691199501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5335+0+0 (secure 0 0 0) 0x7f77fc08a450 con 0x7f7808161c80 2024-09-16T01:16:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.060+0000 7f780659c640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f77e806c2b0 0x7f77e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.060+0000 7f780659c640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f77e806c2b0 0x7f77e806e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f77f8006fd0 tx=0x7f77f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.064+0000 7f77f6ffd640 1 -- 172.21.15.81:0/691199501 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78081536b0 con 0x7f7808161c80 2024-09-16T01:16:26.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.240+0000 7f780c9f6640 1 -- 172.21.15.81:0/691199501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f78080cb350 con 0x7f7808161c80 2024-09-16T01:16:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.881+0000 7f77f6ffd640 1 -- 172.21.15.81:0/691199501 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) ==== 97+0+0 (secure 0 0 0) 0x7f780806e870 con 0x7f7808161c80 2024-09-16T01:16:26.885 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-16T01:16:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.884+0000 7f780c9f6640 1 -- 172.21.15.81:0/691199501 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f77e806c2b0 msgr2=0x7f77e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.884+0000 7f780c9f6640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f77e806c2b0 0x7f77e806e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f77f8006fd0 tx=0x7f77f8008040 comp rx=0 tx=0).stop 2024-09-16T01:16:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.884+0000 7f780c9f6640 1 -- 172.21.15.81:0/691199501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7808161c80 msgr2=0x7f78080b7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.884+0000 7f780c9f6640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7808161c80 0x7f78080b7d50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00c750 tx=0x7f77fc00cc10 comp rx=0 tx=0).stop 2024-09-16T01:16:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.884+0000 7f780c9f6640 1 -- 172.21.15.81:0/691199501 shutdown_connections 2024-09-16T01:16:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.884+0000 7f780c9f6640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f77e806c2b0 0x7f77e806e770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.884+0000 7f780c9f6640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7808162060 0x7f78080b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.884+0000 7f780c9f6640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7808161c80 0x7f78080b7d50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.884+0000 7f780c9f6640 1 --2- 172.21.15.81:0/691199501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f78080b6680 0x7f7808153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.884+0000 7f780c9f6640 1 -- 172.21.15.81:0/691199501 >> 172.21.15.81:0/691199501 conn(0x7f78080d44f0 msgr2=0x7f78080b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.884+0000 7f780c9f6640 1 -- 172.21.15.81:0/691199501 shutdown_connections 2024-09-16T01:16:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.884+0000 7f780c9f6640 1 -- 172.21.15.81:0/691199501 wait complete. 2024-09-16T01:16:26.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T01:16:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.995+0000 7f1584111640 1 Processor -- start 2024-09-16T01:16:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.996+0000 7f1584111640 1 -- start start 2024-09-16T01:16:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.996+0000 7f1584111640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f157c162060 0x7f157c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.996+0000 7f1584111640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f157c06d9f0 con 0x7f157c161c80 2024-09-16T01:16:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.996+0000 7f1584111640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f157c06dcd0 con 0x7f157c0b64b0 2024-09-16T01:16:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.996+0000 7f1584111640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f157c06dfb0 con 0x7f157c162060 2024-09-16T01:16:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.997+0000 7f15816ac640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f157c162060 0x7f157c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.997+0000 7f1581ead640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f157c161c80 0x7f157c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45248/0 (socket says 172.21.15.81:45248) 2024-09-16T01:16:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.997+0000 7f1581ead640 1 -- 172.21.15.81:0/2523627317 learned_addr learned my addr 172.21.15.81:0/2523627317 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.997+0000 7f15816ac640 1 -- 172.21.15.81:0/2523627317 >> v1:172.21.15.102:6789/0 conn(0x7f157c0b64b0 legacy=0x7f157c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.997+0000 7f15816ac640 1 -- 172.21.15.81:0/2523627317 >> v1:172.21.15.81:6789/0 conn(0x7f157c161c80 legacy=0x7f157c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.997+0000 7f15816ac640 1 -- 172.21.15.81:0/2523627317 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157c0d2890 con 0x7f157c162060 2024-09-16T01:16:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.998+0000 7f15816ac640 1 --2- 172.21.15.81:0/2523627317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c162060 0x7f157c0b5f70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f15780097a0 tx=0x7f157802a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a0c30892492072 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.998+0000 7f1580eab640 1 -- 172.21.15.81:0/2523627317 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578037070 con 0x7f157c162060 2024-09-16T01:16:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.998+0000 7f1580eab640 1 -- 172.21.15.81:0/2523627317 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157802ad60 con 0x7f157c162060 2024-09-16T01:16:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.998+0000 7f1580eab640 1 -- 172.21.15.81:0/2523627317 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578032660 con 0x7f157c162060 2024-09-16T01:16:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.998+0000 7f1584111640 1 -- 172.21.15.81:0/2523627317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c162060 msgr2=0x7f157c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.998+0000 7f1584111640 1 --2- 172.21.15.81:0/2523627317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c162060 0x7f157c0b5f70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f15780097a0 tx=0x7f157802a0d0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.998+0000 7f1584111640 1 -- 172.21.15.81:0/2523627317 shutdown_connections 2024-09-16T01:16:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.998+0000 7f1584111640 1 --2- 172.21.15.81:0/2523627317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c162060 0x7f157c0b5f70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.998+0000 7f1584111640 1 -- 172.21.15.81:0/2523627317 >> 172.21.15.81:0/2523627317 conn(0x7f157c0d44f0 msgr2=0x7f157c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.998+0000 7f1584111640 1 -- 172.21.15.81:0/2523627317 shutdown_connections 2024-09-16T01:16:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.998+0000 7f1584111640 1 -- 172.21.15.81:0/2523627317 wait complete. 2024-09-16T01:16:27.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:26.999+0000 7f1584111640 1 Processor -- start 2024-09-16T01:16:27.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.000+0000 7f1584111640 1 -- start start 2024-09-16T01:16:27.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.000+0000 7f1584111640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0b64b0 0x7f157c15f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.000+0000 7f1584111640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c161c80 0x7f157c0d3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.000+0000 7f1584111640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f157c162060 0x7f157c0d3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.000+0000 7f1584111640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f157c0b6d30 con 0x7f157c0b64b0 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.000+0000 7f1584111640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f157c0b6bb0 con 0x7f157c161c80 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.000+0000 7f1584111640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f157c0cf8f0 con 0x7f157c162060 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.000+0000 7f1581ead640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0b64b0 0x7f157c15f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.000+0000 7f1581ead640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0b64b0 0x7f157c15f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51548/0 (socket says 172.21.15.81:51548) 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.000+0000 7f1581ead640 1 -- 172.21.15.81:0/3115486847 learned_addr learned my addr 172.21.15.81:0/3115486847 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.001+0000 7f1581ead640 1 -- 172.21.15.81:0/3115486847 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f157c162060 msgr2=0x7f157c0d3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.001+0000 7f1581ead640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f157c162060 0x7f157c0d3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.001+0000 7f1581ead640 1 -- 172.21.15.81:0/3115486847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c161c80 msgr2=0x7f157c0d3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.001+0000 7f15816ac640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c161c80 0x7f157c0d3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.001+0000 7f1581ead640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c161c80 0x7f157c0d3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.001+0000 7f1581ead640 1 -- 172.21.15.81:0/3115486847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157c1f46a0 con 0x7f157c0b64b0 2024-09-16T01:16:27.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.001+0000 7f1581ead640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0b64b0 0x7f157c15f3c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f156c00c780 tx=0x7f156c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:27.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.001+0000 7f15727fc640 1 -- 172.21.15.81:0/3115486847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c018070 con 0x7f157c0b64b0 2024-09-16T01:16:27.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.001+0000 7f15727fc640 1 -- 172.21.15.81:0/3115486847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f156c0072f0 con 0x7f157c0b64b0 2024-09-16T01:16:27.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.001+0000 7f1584111640 1 -- 172.21.15.81:0/3115486847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157c1f4980 con 0x7f157c0b64b0 2024-09-16T01:16:27.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.001+0000 7f15727fc640 1 -- 172.21.15.81:0/3115486847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156c0047e0 con 0x7f157c0b64b0 2024-09-16T01:16:27.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.001+0000 7f1584111640 1 -- 172.21.15.81:0/3115486847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f157c1f4f40 con 0x7f157c0b64b0 2024-09-16T01:16:27.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.002+0000 7f1584111640 1 -- 172.21.15.81:0/3115486847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f157c0ba470 con 0x7f157c0b64b0 2024-09-16T01:16:27.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.002+0000 7f15727fc640 1 -- 172.21.15.81:0/3115486847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f156c01b070 con 0x7f157c0b64b0 2024-09-16T01:16:27.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.003+0000 7f15727fc640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f156006c2b0 0x7f156006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.003+0000 7f15727fc640 1 -- 172.21.15.81:0/3115486847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f156c08a6f0 con 0x7f157c0b64b0 2024-09-16T01:16:27.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.003+0000 7f15816ac640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f156006c2b0 0x7f156006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.003+0000 7f15816ac640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f156006c2b0 0x7f156006e770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1578034000 tx=0x7f157802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.007+0000 7f15727fc640 1 -- 172.21.15.81:0/3115486847 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f156c0590b0 con 0x7f157c0b64b0 2024-09-16T01:16:27.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.236+0000 7f1584111640 1 -- 172.21.15.81:0/3115486847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f157c0b5f50 con 0x7f157c0b64b0 2024-09-16T01:16:27.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.236+0000 7f15727fc640 1 -- 172.21.15.81:0/3115486847 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f156c0589b0 con 0x7f157c0b64b0 2024-09-16T01:16:27.238 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:27.238 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:16:27.238 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-16T01:16:27.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.238 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-16T01:16:27.238 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmx4OgCRAAkmpWDpuwqbDuz0taNg8bag==", 2024-09-16T01:16:27.238 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmSNpLFRAAzc9Sr8b65zH9VZFYvqsYpA==", 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:16:27.239 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmcCavEBAA0CuddD0zPcjqrMSOD5c6OA==", 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmVeRcHBAANIL7HFYSc43qv7Zg0llkYQ==", 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDhudmUtTqORAAkZKChid+qoa+0nIgpuun7g==", 2024-09-16T01:16:27.241 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCHhudmUhtiABAA2vDoACv8RJ2KD9p1cdKClA==", 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCKhudmhOmRHxAAbGjJkUZLras/b6omekdz7A==", 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCNhudmA+csIRAAW1kenpimaWIak/qgG+UeXw==", 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.243 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCThudmvgQBLxAAWLto5pG0iyiQPSnxldWYwg==", 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCXhudmKfyiIhAALbJHvDeQtVgSCKjD1X3OYg==", 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCahudmPG/9JBAA6d/gK0K/5c9Gp4uKOLCCOw==", 2024-09-16T01:16:27.245 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCdhudmVdY3NhAAXlOaeE0XidHVCaeQrirBAg==", 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg==", 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-16T01:16:27.247 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmMgEhKRAAUD2kJ9eOFJscZ6ATlO5PmQ==", 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmwfD5JRAAPhdVLFZD07Uy75g3zStblg==", 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:16:27.248 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudm8/qzLhAAVFRbGhXH00h2LS9ZC9rraA==", 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/hudmBWr2KRAA/hELsRHNpxj3KqJbOSY74g==", 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mds", 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCkhudmLa+HARAAELVoW9hsqFCGfn52GZIGqw==", 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mds" 2024-09-16T01:16:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mgr", 2024-09-16T01:16:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCkhudm/LqHARAARys3JfWqYJdedp0ZsbJ1Gw==", 2024-09-16T01:16:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-16T01:16:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-osd", 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCkhudmLMKHARAAoh/5sVj1Pu61ptBfcZzCXA==", 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-osd" 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd", 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCkhudmxMmHARAAn3Kzn/oRl0eLiD+ciu+pXw==", 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCkhudm0NKHARAAbSwWf56TkMLfQ1LO1JXU3A==", 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rgw", 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCkhudmTdmHARAAE9Fmt8W/kLici7kXtsyaRA==", 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmRdtyBhAAMQngXCuTHg6AjACCw/SmCg==", 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmqULCAhAAMbYmGXWGiINwif20O1JG3g==", 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:16:27.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:16:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:16:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:16:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:27.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-16T01:16:27.255 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:16:27.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.238+0000 7f1584111640 1 -- 172.21.15.81:0/3115486847 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f156006c2b0 msgr2=0x7f156006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.238+0000 7f1584111640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f156006c2b0 0x7f156006e770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1578034000 tx=0x7f157802e000 comp rx=0 tx=0).stop 2024-09-16T01:16:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.238+0000 7f1584111640 1 -- 172.21.15.81:0/3115486847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0b64b0 msgr2=0x7f157c15f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.238+0000 7f1584111640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0b64b0 0x7f157c15f3c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f156c00c780 tx=0x7f156c00cc40 comp rx=0 tx=0).stop 2024-09-16T01:16:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.238+0000 7f1584111640 1 -- 172.21.15.81:0/3115486847 shutdown_connections 2024-09-16T01:16:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.238+0000 7f1584111640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f156006c2b0 0x7f156006e770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.238+0000 7f1584111640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f157c162060 0x7f157c0d3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.238+0000 7f1584111640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c161c80 0x7f157c0d3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.238+0000 7f1584111640 1 --2- 172.21.15.81:0/3115486847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0b64b0 0x7f157c15f3c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.238+0000 7f1584111640 1 -- 172.21.15.81:0/3115486847 >> 172.21.15.81:0/3115486847 conn(0x7f157c0d44f0 msgr2=0x7f157c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.238+0000 7f1584111640 1 -- 172.21.15.81:0/3115486847 shutdown_connections 2024-09-16T01:16:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.238+0000 7f1584111640 1 -- 172.21.15.81:0/3115486847 wait complete. 2024-09-16T01:16:27.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-16T01:16:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.354+0000 7f2f2261e640 1 Processor -- start 2024-09-16T01:16:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.354+0000 7f2f2261e640 1 -- start start 2024-09-16T01:16:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.354+0000 7f2f2261e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2f1c15e740 0x7f2f1c0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.354+0000 7f2f2261e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f1c06dbd0 0x7f2f1c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.354+0000 7f2f2261e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f1c0d0780 con 0x7f2f1c09b690 2024-09-16T01:16:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.354+0000 7f2f2261e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2f1c15eb20 con 0x7f2f1c06dbd0 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.354+0000 7f2f2261e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2f1c06d260 con 0x7f2f1c15e740 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.355+0000 7f2f20bbb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f1c06dbd0 0x7f2f1c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.355+0000 7f2f1b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2f1c09b690 0x7f2f1c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45258/0 (socket says 172.21.15.81:45258) 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.355+0000 7f2f1b7fe640 1 -- 172.21.15.81:0/267518793 learned_addr learned my addr 172.21.15.81:0/267518793 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.355+0000 7f2f1bfff640 1 --2- 172.21.15.81:0/267518793 >> v2:172.21.15.102:3300/0 conn(0x7f2f1c15e740 0x7f2f1c0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.355+0000 7f2f20bbb640 1 -- 172.21.15.81:0/267518793 >> v2:172.21.15.102:3300/0 conn(0x7f2f1c15e740 msgr2=0x7f2f1c0d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.355+0000 7f2f20bbb640 1 --2- 172.21.15.81:0/267518793 >> v2:172.21.15.102:3300/0 conn(0x7f2f1c15e740 0x7f2f1c0d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.355+0000 7f2f20bbb640 1 -- 172.21.15.81:0/267518793 >> v1:172.21.15.81:6789/0 conn(0x7f2f1c09b690 legacy=0x7f2f1c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.355+0000 7f2f20bbb640 1 -- 172.21.15.81:0/267518793 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1c0d0a60 con 0x7f2f1c06dbd0 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.355+0000 7f2f1affd640 1 -- 172.21.15.81:0/267518793 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 756203507 0 0) 0x7f2f1c0d0780 con 0x7f2f1c09b690 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.356+0000 7f2f20bbb640 1 --2- 172.21.15.81:0/267518793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c06dbd0 0x7f2f1c06cd20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c074070 tx=0x7f2f1402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a272046d4d56f11 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.356+0000 7f2f1affd640 1 -- 172.21.15.81:0/267518793 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f14007740 con 0x7f2f1c06dbd0 2024-09-16T01:16:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.356+0000 7f2f1affd640 1 -- 172.21.15.81:0/267518793 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f140078e0 con 0x7f2f1c06dbd0 2024-09-16T01:16:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.356+0000 7f2f1affd640 1 -- 172.21.15.81:0/267518793 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f14007cb0 con 0x7f2f1c06dbd0 2024-09-16T01:16:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.356+0000 7f2f2261e640 1 -- 172.21.15.81:0/267518793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c06dbd0 msgr2=0x7f2f1c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.356+0000 7f2f2261e640 1 --2- 172.21.15.81:0/267518793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c06dbd0 0x7f2f1c06cd20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c074070 tx=0x7f2f1402a710 comp rx=0 tx=0).stop 2024-09-16T01:16:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.356+0000 7f2f2261e640 1 -- 172.21.15.81:0/267518793 shutdown_connections 2024-09-16T01:16:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.356+0000 7f2f2261e640 1 --2- 172.21.15.81:0/267518793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c06dbd0 0x7f2f1c06cd20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.356+0000 7f2f2261e640 1 --2- 172.21.15.81:0/267518793 >> v2:172.21.15.102:3300/0 conn(0x7f2f1c15e740 0x7f2f1c0d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.356+0000 7f2f2261e640 1 -- 172.21.15.81:0/267518793 >> 172.21.15.81:0/267518793 conn(0x7f2f1c0d23a0 msgr2=0x7f2f1c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.356+0000 7f2f2261e640 1 -- 172.21.15.81:0/267518793 shutdown_connections 2024-09-16T01:16:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.356+0000 7f2f2261e640 1 -- 172.21.15.81:0/267518793 wait complete. 2024-09-16T01:16:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.357+0000 7f2f2261e640 1 Processor -- start 2024-09-16T01:16:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.358+0000 7f2f2261e640 1 -- start start 2024-09-16T01:16:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.358+0000 7f2f2261e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f1c06dbd0 0x7f2f1c14b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.358+0000 7f2f2261e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f1c09b690 0x7f2f1c0cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.358+0000 7f2f2261e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c15e740 0x7f2f1c0ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.358+0000 7f2f2261e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c09bac0 con 0x7f2f1c15e740 2024-09-16T01:16:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.358+0000 7f2f2261e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c0d1020 con 0x7f2f1c06dbd0 2024-09-16T01:16:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.358+0000 7f2f2261e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1c06dfe0 con 0x7f2f1c09b690 2024-09-16T01:16:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.358+0000 7f2f20bbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c15e740 0x7f2f1c0ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f20bbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c15e740 0x7f2f1c0ce470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51570/0 (socket says 172.21.15.81:51570) 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f20bbb640 1 -- 172.21.15.81:0/2374783049 learned_addr learned my addr 172.21.15.81:0/2374783049 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f1bfff640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f1c06dbd0 0x7f2f1c14b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f1b7fe640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f1c09b690 0x7f2f1c0cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f20bbb640 1 -- 172.21.15.81:0/2374783049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f1c09b690 msgr2=0x7f2f1c0cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f20bbb640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f1c09b690 0x7f2f1c0cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f20bbb640 1 -- 172.21.15.81:0/2374783049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f1c06dbd0 msgr2=0x7f2f1c14b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f20bbb640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f1c06dbd0 0x7f2f1c14b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f20bbb640 1 -- 172.21.15.81:0/2374783049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1c0c9690 con 0x7f2f1c15e740 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f1bfff640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f1c06dbd0 0x7f2f1c14b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f20bbb640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c15e740 0x7f2f1c0ce470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009e80 tx=0x7f2f14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f18ff9640 1 -- 172.21.15.81:0/2374783049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1403f070 con 0x7f2f1c15e740 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f18ff9640 1 -- 172.21.15.81:0/2374783049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f14031c40 con 0x7f2f1c15e740 2024-09-16T01:16:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f2261e640 1 -- 172.21.15.81:0/2374783049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f1c0c9900 con 0x7f2f1c15e740 2024-09-16T01:16:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f18ff9640 1 -- 172.21.15.81:0/2374783049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f14009450 con 0x7f2f1c15e740 2024-09-16T01:16:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.359+0000 7f2f2261e640 1 -- 172.21.15.81:0/2374783049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f1c0c9ec0 con 0x7f2f1c15e740 2024-09-16T01:16:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.360+0000 7f2f2261e640 1 -- 172.21.15.81:0/2374783049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f1c0c90e0 con 0x7f2f1c15e740 2024-09-16T01:16:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.361+0000 7f2f18ff9640 1 -- 172.21.15.81:0/2374783049 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2f14003990 con 0x7f2f1c15e740 2024-09-16T01:16:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.361+0000 7f2f18ff9640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2f0806c2b0 0x7f2f0806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.361+0000 7f2f1bfff640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2f0806c2b0 0x7f2f0806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.361+0000 7f2f18ff9640 1 -- 172.21.15.81:0/2374783049 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f2f140ac330 con 0x7f2f1c15e740 2024-09-16T01:16:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.362+0000 7f2f1bfff640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2f0806c2b0 0x7f2f0806e770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009b90 tx=0x7f2f0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:27.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.366+0000 7f2f18ff9640 1 -- 172.21.15.81:0/2374783049 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f1c0c90e0 con 0x7f2f1c15e740 2024-09-16T01:16:27.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.592+0000 7f2f2261e640 1 -- 172.21.15.81:0/2374783049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f2f1c0d1cb0 con 0x7f2f1c15e740 2024-09-16T01:16:27.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.594+0000 7f2f18ff9640 1 -- 172.21.15.81:0/2374783049 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f2f1407acf0 con 0x7f2f1c15e740 2024-09-16T01:16:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.597+0000 7f2f2261e640 1 -- 172.21.15.81:0/2374783049 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2f0806c2b0 msgr2=0x7f2f0806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.597+0000 7f2f2261e640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2f0806c2b0 0x7f2f0806e770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009b90 tx=0x7f2f0c008040 comp rx=0 tx=0).stop 2024-09-16T01:16:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.597+0000 7f2f2261e640 1 -- 172.21.15.81:0/2374783049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c15e740 msgr2=0x7f2f1c0ce470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.597+0000 7f2f2261e640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c15e740 0x7f2f1c0ce470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009e80 tx=0x7f2f14004a40 comp rx=0 tx=0).stop 2024-09-16T01:16:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.597+0000 7f2f2261e640 1 -- 172.21.15.81:0/2374783049 shutdown_connections 2024-09-16T01:16:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.597+0000 7f2f2261e640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2f0806c2b0 0x7f2f0806e770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.597+0000 7f2f2261e640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f1c15e740 0x7f2f1c0ce470 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.597+0000 7f2f2261e640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f1c09b690 0x7f2f1c0cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.597+0000 7f2f2261e640 1 --2- 172.21.15.81:0/2374783049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f1c06dbd0 0x7f2f1c14b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.597+0000 7f2f2261e640 1 -- 172.21.15.81:0/2374783049 >> 172.21.15.81:0/2374783049 conn(0x7f2f1c0d23a0 msgr2=0x7f2f1c0af220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.597+0000 7f2f2261e640 1 -- 172.21.15.81:0/2374783049 shutdown_connections 2024-09-16T01:16:27.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.597+0000 7f2f2261e640 1 -- 172.21.15.81:0/2374783049 wait complete. 2024-09-16T01:16:27.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-16T01:16:27.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.706+0000 7f532c311640 1 Processor -- start 2024-09-16T01:16:27.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.707+0000 7f532c311640 1 -- start start 2024-09-16T01:16:27.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.707+0000 7f532c311640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f532415fc30 0x7f5324071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.707+0000 7f532c311640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f532409b140 0x7f53240704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.707+0000 7f532c311640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f532409ba30 con 0x7f53240b17d0 2024-09-16T01:16:27.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.707+0000 7f532c311640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f53240b1590 con 0x7f532415fc30 2024-09-16T01:16:27.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.707+0000 7f532c311640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5324160ab0 con 0x7f532409b140 2024-09-16T01:16:27.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53298ac640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f53240b17d0 0x7f532409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45266/0 (socket says 172.21.15.81:45266) 2024-09-16T01:16:27.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53298ac640 1 -- 172.21.15.81:0/4009487262 learned_addr learned my addr 172.21.15.81:0/4009487262 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:27.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377838731 0 0) 0x7f532409ba30 con 0x7f53240b17d0 2024-09-16T01:16:27.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f532a0ad640 1 --2- 172.21.15.81:0/4009487262 >> v2:172.21.15.102:3300/0 conn(0x7f532415fc30 0x7f5324071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5310003520 con 0x7f53240b17d0 2024-09-16T01:16:27.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f532a8ae640 1 --2- 172.21.15.81:0/4009487262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f532409b140 0x7f53240704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4153151639 0 0) 0x7f5310003520 con 0x7f53240b17d0 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f532409b140 msgr2=0x7f53240704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 --2- 172.21.15.81:0/4009487262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f532409b140 0x7f53240704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 >> v2:172.21.15.102:3300/0 conn(0x7f532415fc30 msgr2=0x7f5324071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 --2- 172.21.15.81:0/4009487262 >> v2:172.21.15.102:3300/0 conn(0x7f532415fc30 0x7f5324071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532409bcf0 con 0x7f53240b17d0 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f5314001670 con 0x7f53240b17d0 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 >> v1:172.21.15.81:6789/0 conn(0x7f53240b17d0 legacy=0x7f532409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 --2- 172.21.15.81:0/4009487262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100039b0 0x7f5310003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 --2- 172.21.15.81:0/4009487262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5310004800 0x7f5310004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 --2- 172.21.15.81:0/4009487262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f532409b140 0x7f53100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53240b1590 con 0x7f53100039b0 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5324160ab0 con 0x7f5310004800 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f531000b9f0 con 0x7f532409b140 2024-09-16T01:16:27.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f532a0ad640 1 --2- 172.21.15.81:0/4009487262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100039b0 0x7f5310003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f53298ac640 1 --2- 172.21.15.81:0/4009487262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5310004800 0x7f5310004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.708+0000 7f532a8ae640 1 --2- 172.21.15.81:0/4009487262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f532409b140 0x7f53100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.709+0000 7f532a0ad640 1 -- 172.21.15.81:0/4009487262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f532409b140 msgr2=0x7f53100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.709+0000 7f532a0ad640 1 --2- 172.21.15.81:0/4009487262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f532409b140 0x7f53100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.709+0000 7f532a0ad640 1 -- 172.21.15.81:0/4009487262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5310004800 msgr2=0x7f5310004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.709+0000 7f532a0ad640 1 --2- 172.21.15.81:0/4009487262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5310004800 0x7f5310004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.709+0000 7f532a0ad640 1 -- 172.21.15.81:0/4009487262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5310003520 con 0x7f53100039b0 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.709+0000 7f532a0ad640 1 --2- 172.21.15.81:0/4009487262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100039b0 0x7f5310003dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5320009ac0 tx=0x7f5310005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6e3993f5551739 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.709+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320036070 con 0x7f53100039b0 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.709+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5320031400 con 0x7f53100039b0 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.709+0000 7f53290ab640 1 -- 172.21.15.81:0/4009487262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320009690 con 0x7f53100039b0 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.710+0000 7f532c311640 1 -- 172.21.15.81:0/4009487262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100039b0 msgr2=0x7f5310003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.710+0000 7f532c311640 1 --2- 172.21.15.81:0/4009487262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100039b0 0x7f5310003dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5320009ac0 tx=0x7f5310005830 comp rx=0 tx=0).stop 2024-09-16T01:16:27.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.710+0000 7f532a8ae640 1 -- 172.21.15.81:0/4009487262 reap_dead start 2024-09-16T01:16:27.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.710+0000 7f532c311640 1 -- 172.21.15.81:0/4009487262 shutdown_connections 2024-09-16T01:16:27.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.710+0000 7f532c311640 1 -- 172.21.15.81:0/4009487262 >> 172.21.15.81:0/4009487262 conn(0x7f53240d23a0 msgr2=0x7f53240d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:27.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.710+0000 7f532c311640 1 -- 172.21.15.81:0/4009487262 shutdown_connections 2024-09-16T01:16:27.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.710+0000 7f532c311640 1 -- 172.21.15.81:0/4009487262 wait complete. 2024-09-16T01:16:27.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.711+0000 7f532c311640 1 Processor -- start 2024-09-16T01:16:27.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.711+0000 7f532c311640 1 -- start start 2024-09-16T01:16:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532c311640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100039b0 0x7f53241e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532c311640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53241548d0 0x7f53240cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532c311640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53240cb080 0x7f53240c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532c311640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53240b1bd0 con 0x7f53100039b0 2024-09-16T01:16:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532c311640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5324160fe0 con 0x7f53240cb080 2024-09-16T01:16:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532c311640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f53240704f0 con 0x7f53241548d0 2024-09-16T01:16:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532a0ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100039b0 0x7f53241e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532a0ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100039b0 0x7f53241e8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51594/0 (socket says 172.21.15.81:51594) 2024-09-16T01:16:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532a0ad640 1 -- 172.21.15.81:0/276452151 learned_addr learned my addr 172.21.15.81:0/276452151 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f53298ac640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53241548d0 0x7f53240cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532a8ae640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53240cb080 0x7f53240c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532a0ad640 1 -- 172.21.15.81:0/276452151 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53241548d0 msgr2=0x7f53240cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532a0ad640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53241548d0 0x7f53240cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532a0ad640 1 -- 172.21.15.81:0/276452151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53240cb080 msgr2=0x7f53240c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532a0ad640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53240cb080 0x7f53240c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532a0ad640 1 -- 172.21.15.81:0/276452151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53240cb530 con 0x7f53100039b0 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.712+0000 7f532a0ad640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100039b0 0x7f53241e8b60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5320009be0 tx=0x7f5320004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.713+0000 7f531affd640 1 -- 172.21.15.81:0/276452151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320040070 con 0x7f53100039b0 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.713+0000 7f531affd640 1 -- 172.21.15.81:0/276452151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532003b460 con 0x7f53100039b0 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.713+0000 7f532c311640 1 -- 172.21.15.81:0/276452151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53241e90a0 con 0x7f53100039b0 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.713+0000 7f531affd640 1 -- 172.21.15.81:0/276452151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320036040 con 0x7f53100039b0 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.713+0000 7f532c311640 1 -- 172.21.15.81:0/276452151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f532406dd50 con 0x7f53100039b0 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.714+0000 7f532c311640 1 -- 172.21.15.81:0/276452151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5324068ea0 con 0x7f53100039b0 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.714+0000 7f531affd640 1 -- 172.21.15.81:0/276452151 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5320039070 con 0x7f53100039b0 2024-09-16T01:16:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.714+0000 7f531affd640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f530806c2b0 0x7f530806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:27.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.715+0000 7f531affd640 1 -- 172.21.15.81:0/276452151 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f53200ab5b0 con 0x7f53100039b0 2024-09-16T01:16:27.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.715+0000 7f53298ac640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f530806c2b0 0x7f530806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:27.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.715+0000 7f53298ac640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f530806c2b0 0x7f530806e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f53240d1470 tx=0x7f5314007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:27.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.719+0000 7f531affd640 1 -- 172.21.15.81:0/276452151 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53241e90a0 con 0x7f53100039b0 2024-09-16T01:16:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.949+0000 7f532c311640 1 -- 172.21.15.81:0/276452151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f5324071e40 con 0x7f53100039b0 2024-09-16T01:16:27.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.951+0000 7f531affd640 1 -- 172.21.15.81:0/276452151 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f5320079890 con 0x7f53100039b0 2024-09-16T01:16:27.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.953+0000 7f532c311640 1 -- 172.21.15.81:0/276452151 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f530806c2b0 msgr2=0x7f530806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.953+0000 7f532c311640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f530806c2b0 0x7f530806e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f53240d1470 tx=0x7f5314007040 comp rx=0 tx=0).stop 2024-09-16T01:16:27.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.953+0000 7f532c311640 1 -- 172.21.15.81:0/276452151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100039b0 msgr2=0x7f53241e8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:27.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.953+0000 7f532c311640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100039b0 0x7f53241e8b60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5320009be0 tx=0x7f5320004730 comp rx=0 tx=0).stop 2024-09-16T01:16:27.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.953+0000 7f532c311640 1 -- 172.21.15.81:0/276452151 shutdown_connections 2024-09-16T01:16:27.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.953+0000 7f532c311640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f530806c2b0 0x7f530806e770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.953+0000 7f532c311640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53240cb080 0x7f53240c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.953+0000 7f532c311640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53241548d0 0x7f53240cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.953+0000 7f532c311640 1 --2- 172.21.15.81:0/276452151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100039b0 0x7f53241e8b60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:27.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.953+0000 7f532c311640 1 -- 172.21.15.81:0/276452151 >> 172.21.15.81:0/276452151 conn(0x7f53240d23a0 msgr2=0x7f53240b6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:27.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.953+0000 7f532c311640 1 -- 172.21.15.81:0/276452151 shutdown_connections 2024-09-16T01:16:27.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:27.953+0000 7f532c311640 1 -- 172.21.15.81:0/276452151 wait complete. 2024-09-16T01:16:27.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-16T01:16:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.063+0000 7f58d4c84640 1 Processor -- start 2024-09-16T01:16:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.063+0000 7f58d4c84640 1 -- start start 2024-09-16T01:16:28.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58d4c84640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58d00afd70 0x7f58d0160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58d4c84640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58d00ce660 0x7f58d00b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58d4c84640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d0160d60 con 0x7f58d00b5f80 2024-09-16T01:16:28.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58d4c84640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f58d00b6910 con 0x7f58d00afd70 2024-09-16T01:16:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58d4c84640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f58d006fdb0 con 0x7f58d00ce660 2024-09-16T01:16:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58ce59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58d00afd70 0x7f58d0160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58ce59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58d00afd70 0x7f58d0160820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51606/0 (socket says 172.21.15.81:51606) 2024-09-16T01:16:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58ce59c640 1 -- 172.21.15.81:0/828231065 learned_addr learned my addr 172.21.15.81:0/828231065 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58ced9d640 1 --2- 172.21.15.81:0/828231065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58d00ce660 0x7f58d00b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58ce59c640 1 -- 172.21.15.81:0/828231065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58d00ce660 msgr2=0x7f58d00b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58ce59c640 1 --2- 172.21.15.81:0/828231065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58d00ce660 0x7f58d00b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58ce59c640 1 -- 172.21.15.81:0/828231065 >> v1:172.21.15.102:6789/0 conn(0x7f58d00b5f80 legacy=0x7f58d006e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58ce59c640 1 -- 172.21.15.81:0/828231065 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d0070090 con 0x7f58d00afd70 2024-09-16T01:16:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.064+0000 7f58ced9d640 1 --2- 172.21.15.81:0/828231065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58d00ce660 0x7f58d00b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.065+0000 7f58ce59c640 1 --2- 172.21.15.81:0/828231065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d00afd70 0x7f58d0160820 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009870 tx=0x7f58c002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07822e71c99a1b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.065+0000 7f58cdd9b640 1 -- 172.21.15.81:0/828231065 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c0037070 con 0x7f58d00afd70 2024-09-16T01:16:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.065+0000 7f58cdd9b640 1 -- 172.21.15.81:0/828231065 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c0032440 con 0x7f58d00afd70 2024-09-16T01:16:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.065+0000 7f58cdd9b640 1 -- 172.21.15.81:0/828231065 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c0032810 con 0x7f58d00afd70 2024-09-16T01:16:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.066+0000 7f58d4c84640 1 -- 172.21.15.81:0/828231065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d00afd70 msgr2=0x7f58d0160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.066+0000 7f58d4c84640 1 --2- 172.21.15.81:0/828231065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d00afd70 0x7f58d0160820 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f58c0009870 tx=0x7f58c002a210 comp rx=0 tx=0).stop 2024-09-16T01:16:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.066+0000 7f58d4c84640 1 -- 172.21.15.81:0/828231065 shutdown_connections 2024-09-16T01:16:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.066+0000 7f58d4c84640 1 --2- 172.21.15.81:0/828231065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58d00ce660 0x7f58d00b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.066+0000 7f58d4c84640 1 --2- 172.21.15.81:0/828231065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d00afd70 0x7f58d0160820 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.066+0000 7f58d4c84640 1 -- 172.21.15.81:0/828231065 >> 172.21.15.81:0/828231065 conn(0x7f58d006bc10 msgr2=0x7f58d006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.066+0000 7f58d4c84640 1 -- 172.21.15.81:0/828231065 shutdown_connections 2024-09-16T01:16:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.066+0000 7f58d4c84640 1 -- 172.21.15.81:0/828231065 wait complete. 2024-09-16T01:16:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.067+0000 7f58d4c84640 1 Processor -- start 2024-09-16T01:16:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.067+0000 7f58d4c84640 1 -- start start 2024-09-16T01:16:28.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58d4c84640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d00afd70 0x7f58d00aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58d4c84640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58d00b5f80 0x7f58d00b5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58d4c84640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d00ce660 0x7f58d0153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58d4c84640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f58d006fa80 con 0x7f58d00ce660 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58d4c84640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f58d0070650 con 0x7f58d00afd70 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58d4c84640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f58d00b0150 con 0x7f58d00b5f80 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58ced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d00ce660 0x7f58d0153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58ced9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d00ce660 0x7f58d0153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51620/0 (socket says 172.21.15.81:51620) 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58ced9d640 1 -- 172.21.15.81:0/1977430024 learned_addr learned my addr 172.21.15.81:0/1977430024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58ce59c640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d00afd70 0x7f58d00aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58c5d9b640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58d00b5f80 0x7f58d00b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58ced9d640 1 -- 172.21.15.81:0/1977430024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58d00b5f80 msgr2=0x7f58d00b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.068+0000 7f58ced9d640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58d00b5f80 0x7f58d00b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.069+0000 7f58ced9d640 1 -- 172.21.15.81:0/1977430024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d00afd70 msgr2=0x7f58d00aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.069+0000 7f58ced9d640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d00afd70 0x7f58d00aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.069+0000 7f58ced9d640 1 -- 172.21.15.81:0/1977430024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d0155930 con 0x7f58d00ce660 2024-09-16T01:16:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.069+0000 7f58ced9d640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d00ce660 0x7f58d0153940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f58c800cd80 tx=0x7f58c800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.069+0000 7f58c77fe640 1 -- 172.21.15.81:0/1977430024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c800f680 con 0x7f58d00ce660 2024-09-16T01:16:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.069+0000 7f58c77fe640 1 -- 172.21.15.81:0/1977430024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c800f840 con 0x7f58d00ce660 2024-09-16T01:16:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.069+0000 7f58d4c84640 1 -- 172.21.15.81:0/1977430024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d01518a0 con 0x7f58d00ce660 2024-09-16T01:16:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.069+0000 7f58c77fe640 1 -- 172.21.15.81:0/1977430024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c800fc30 con 0x7f58d00ce660 2024-09-16T01:16:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.069+0000 7f58d4c84640 1 -- 172.21.15.81:0/1977430024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d0155e80 con 0x7f58d00ce660 2024-09-16T01:16:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.070+0000 7f58d4c84640 1 -- 172.21.15.81:0/1977430024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d0156080 con 0x7f58d00ce660 2024-09-16T01:16:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.070+0000 7f58c77fe640 1 -- 172.21.15.81:0/1977430024 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f58c80213f0 con 0x7f58d00ce660 2024-09-16T01:16:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.071+0000 7f58c77fe640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f58b006c2b0 0x7f58b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.071+0000 7f58c77fe640 1 -- 172.21.15.81:0/1977430024 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f58c808bef0 con 0x7f58d00ce660 2024-09-16T01:16:28.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.071+0000 7f58ce59c640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f58b006c2b0 0x7f58b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.071+0000 7f58ce59c640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f58b006c2b0 0x7f58b006e770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58c0034000 tx=0x7f58c002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:28.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.075+0000 7f58c77fe640 1 -- 172.21.15.81:0/1977430024 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58d0156080 con 0x7f58d00ce660 2024-09-16T01:16:28.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.305+0000 7f58d4c84640 1 -- 172.21.15.81:0/1977430024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f58d0067fc0 con 0x7f58d00ce660 2024-09-16T01:16:28.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.309+0000 7f58c77fe640 1 -- 172.21.15.81:0/1977430024 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f58c8014030 con 0x7f58d00ce660 2024-09-16T01:16:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.311+0000 7f58d4c84640 1 -- 172.21.15.81:0/1977430024 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f58b006c2b0 msgr2=0x7f58b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.311+0000 7f58d4c84640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f58b006c2b0 0x7f58b006e770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58c0034000 tx=0x7f58c002e000 comp rx=0 tx=0).stop 2024-09-16T01:16:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.311+0000 7f58d4c84640 1 -- 172.21.15.81:0/1977430024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d00ce660 msgr2=0x7f58d0153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.311+0000 7f58d4c84640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d00ce660 0x7f58d0153940 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f58c800cd80 tx=0x7f58c800a650 comp rx=0 tx=0).stop 2024-09-16T01:16:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.311+0000 7f58d4c84640 1 -- 172.21.15.81:0/1977430024 shutdown_connections 2024-09-16T01:16:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.311+0000 7f58d4c84640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f58b006c2b0 0x7f58b006e770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.311+0000 7f58d4c84640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d00ce660 0x7f58d0153940 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.311+0000 7f58d4c84640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58d00b5f80 0x7f58d00b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.311+0000 7f58d4c84640 1 --2- 172.21.15.81:0/1977430024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58d00afd70 0x7f58d00aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.311+0000 7f58d4c84640 1 -- 172.21.15.81:0/1977430024 >> 172.21.15.81:0/1977430024 conn(0x7f58d006bc10 msgr2=0x7f58d006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:28.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.311+0000 7f58d4c84640 1 -- 172.21.15.81:0/1977430024 shutdown_connections 2024-09-16T01:16:28.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.311+0000 7f58d4c84640 1 -- 172.21.15.81:0/1977430024 wait complete. 2024-09-16T01:16:28.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-16T01:16:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.421+0000 7fd0da0d9640 1 Processor -- start 2024-09-16T01:16:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.421+0000 7fd0da0d9640 1 -- start start 2024-09-16T01:16:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0da0d9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd0d4147230 0x7fd0d406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0da0d9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0d40727c0 0x7fd0d40aee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0da0d9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d406f480 con 0x7fd0d4147e90 2024-09-16T01:16:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0da0d9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd0d40b34d0 con 0x7fd0d4147230 2024-09-16T01:16:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0da0d9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d40ae9e0 con 0x7fd0d40727c0 2024-09-16T01:16:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0d37fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd0d4147230 0x7fd0d406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0d37fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd0d4147230 0x7fd0d406e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51624/0 (socket says 172.21.15.81:51624) 2024-09-16T01:16:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0d37fe640 1 -- 172.21.15.81:0/1650842414 learned_addr learned my addr 172.21.15.81:0/1650842414 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0d37fe640 1 -- 172.21.15.81:0/1650842414 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0d40727c0 msgr2=0x7fd0d40aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0d3fff640 1 --2- 172.21.15.81:0/1650842414 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0d40727c0 0x7fd0d40aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0d37fe640 1 --2- 172.21.15.81:0/1650842414 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0d40727c0 0x7fd0d40aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0d37fe640 1 -- 172.21.15.81:0/1650842414 >> v1:172.21.15.102:6789/0 conn(0x7fd0d4147e90 legacy=0x7fd0d40720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0d37fe640 1 -- 172.21.15.81:0/1650842414 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d406e900 con 0x7fd0d4147230 2024-09-16T01:16:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.422+0000 7fd0d3fff640 1 --2- 172.21.15.81:0/1650842414 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0d40727c0 0x7fd0d40aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.423+0000 7fd0d37fe640 1 --2- 172.21.15.81:0/1650842414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d4147230 0x7fd0d406e0b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009870 tx=0x7fd0c402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bd711abba69967 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.423+0000 7fd0d27fc640 1 -- 172.21.15.81:0/1650842414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4037070 con 0x7fd0d4147230 2024-09-16T01:16:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.423+0000 7fd0d27fc640 1 -- 172.21.15.81:0/1650842414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c4032440 con 0x7fd0d4147230 2024-09-16T01:16:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.423+0000 7fd0d27fc640 1 -- 172.21.15.81:0/1650842414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4032810 con 0x7fd0d4147230 2024-09-16T01:16:28.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.424+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1650842414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d4147230 msgr2=0x7fd0d406e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.424+0000 7fd0da0d9640 1 --2- 172.21.15.81:0/1650842414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d4147230 0x7fd0d406e0b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009870 tx=0x7fd0c402a210 comp rx=0 tx=0).stop 2024-09-16T01:16:28.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.424+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1650842414 shutdown_connections 2024-09-16T01:16:28.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.424+0000 7fd0da0d9640 1 --2- 172.21.15.81:0/1650842414 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0d40727c0 0x7fd0d40aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.424+0000 7fd0da0d9640 1 --2- 172.21.15.81:0/1650842414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d4147230 0x7fd0d406e0b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.424+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1650842414 >> 172.21.15.81:0/1650842414 conn(0x7fd0d4067d70 msgr2=0x7fd0d406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.424+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1650842414 shutdown_connections 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.424+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1650842414 wait complete. 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.425+0000 7fd0da0d9640 1 Processor -- start 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.425+0000 7fd0da0d9640 1 -- start start 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0da0d9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0d40727c0 0x7fd0d415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0da0d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0d4147230 0x7fd0d413b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0da0d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d4147e90 0x7fd0d414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0da0d9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d406f1a0 con 0x7fd0d4147e90 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0da0d9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d406eec0 con 0x7fd0d4147230 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0da0d9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d406e5f0 con 0x7fd0d40727c0 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d4147e90 0x7fd0d414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d4147e90 0x7fd0d414ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51630/0 (socket says 172.21.15.81:51630) 2024-09-16T01:16:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0d3fff640 1 -- 172.21.15.81:0/1219004512 learned_addr learned my addr 172.21.15.81:0/1219004512 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0d2ffd640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0d4147230 0x7fd0d413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0d37fe640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0d40727c0 0x7fd0d415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0d3fff640 1 -- 172.21.15.81:0/1219004512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0d40727c0 msgr2=0x7fd0d415ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0d3fff640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0d40727c0 0x7fd0d415ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0d3fff640 1 -- 172.21.15.81:0/1219004512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0d4147230 msgr2=0x7fd0d413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0d3fff640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0d4147230 0x7fd0d413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0d3fff640 1 -- 172.21.15.81:0/1219004512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d415f440 con 0x7fd0d4147e90 2024-09-16T01:16:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0d37fe640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0d40727c0 0x7fd0d415ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0d3fff640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d4147e90 0x7fd0d414ea90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00cea0 tx=0x7fd0cc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0bbfff640 1 -- 172.21.15.81:0/1219004512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc003b90 con 0x7fd0d4147e90 2024-09-16T01:16:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0bbfff640 1 -- 172.21.15.81:0/1219004512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0cc003d50 con 0x7fd0d4147e90 2024-09-16T01:16:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0bbfff640 1 -- 172.21.15.81:0/1219004512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc004260 con 0x7fd0d4147e90 2024-09-16T01:16:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1219004512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d415f720 con 0x7fd0d4147e90 2024-09-16T01:16:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.426+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1219004512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d415fce0 con 0x7fd0d4147e90 2024-09-16T01:16:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.427+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1219004512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d4147610 con 0x7fd0d4147e90 2024-09-16T01:16:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.428+0000 7fd0bbfff640 1 -- 172.21.15.81:0/1219004512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd0cc004400 con 0x7fd0d4147e90 2024-09-16T01:16:28.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.428+0000 7fd0bbfff640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd0c006c2e0 0x7fd0c006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.428+0000 7fd0bbfff640 1 -- 172.21.15.81:0/1219004512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7fd0cc08bcc0 con 0x7fd0d4147e90 2024-09-16T01:16:28.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.428+0000 7fd0d37fe640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd0c006c2e0 0x7fd0c006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.429+0000 7fd0d37fe640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd0c006c2e0 0x7fd0c006e7a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4034000 tx=0x7fd0c402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:28.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.433+0000 7fd0bbfff640 1 -- 172.21.15.81:0/1219004512 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0cc05a5f0 con 0x7fd0d4147e90 2024-09-16T01:16:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.661+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1219004512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fd0d40b5470 con 0x7fd0d4147e90 2024-09-16T01:16:28.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.663+0000 7fd0bbfff640 1 -- 172.21.15.81:0/1219004512 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fd0cc059ef0 con 0x7fd0d4147e90 2024-09-16T01:16:28.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.665+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1219004512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd0c006c2e0 msgr2=0x7fd0c006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.665+0000 7fd0da0d9640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd0c006c2e0 0x7fd0c006e7a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4034000 tx=0x7fd0c402e000 comp rx=0 tx=0).stop 2024-09-16T01:16:28.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.665+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1219004512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d4147e90 msgr2=0x7fd0d414ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.665+0000 7fd0da0d9640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d4147e90 0x7fd0d414ea90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc00cea0 tx=0x7fd0cc00cf90 comp rx=0 tx=0).stop 2024-09-16T01:16:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.665+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1219004512 shutdown_connections 2024-09-16T01:16:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.665+0000 7fd0da0d9640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd0c006c2e0 0x7fd0c006e7a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.665+0000 7fd0da0d9640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0d4147e90 0x7fd0d414ea90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.665+0000 7fd0da0d9640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0d4147230 0x7fd0d413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.665+0000 7fd0da0d9640 1 --2- 172.21.15.81:0/1219004512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0d40727c0 0x7fd0d415ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.665+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1219004512 >> 172.21.15.81:0/1219004512 conn(0x7fd0d4067d70 msgr2=0x7fd0d40af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.665+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1219004512 shutdown_connections 2024-09-16T01:16:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.665+0000 7fd0da0d9640 1 -- 172.21.15.81:0/1219004512 wait complete. 2024-09-16T01:16:28.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-16T01:16:28.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.775+0000 7f64a9526640 1 Processor -- start 2024-09-16T01:16:28.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.775+0000 7f64a9526640 1 -- start start 2024-09-16T01:16:28.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.776+0000 7f64a9526640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64a4072d30 0x7f64a406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.776+0000 7f64a9526640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64a406f700 0x7f64a415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.776+0000 7f64a9526640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a40cdbe0 con 0x7f64a415b300 2024-09-16T01:16:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.776+0000 7f64a9526640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f64a406fb50 con 0x7f64a406f700 2024-09-16T01:16:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.776+0000 7f64a9526640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f64a40728a0 con 0x7f64a4072d30 2024-09-16T01:16:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.776+0000 7f64a37fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64a406f700 0x7f64a415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.776+0000 7f64a37fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64a406f700 0x7f64a415b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51644/0 (socket says 172.21.15.81:51644) 2024-09-16T01:16:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.776+0000 7f64a37fe640 1 -- 172.21.15.81:0/1442511583 learned_addr learned my addr 172.21.15.81:0/1442511583 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.776+0000 7f64a27fc640 1 --2- 172.21.15.81:0/1442511583 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64a4072d30 0x7f64a406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.777+0000 7f64a37fe640 1 -- 172.21.15.81:0/1442511583 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64a4072d30 msgr2=0x7f64a406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.777+0000 7f64a37fe640 1 --2- 172.21.15.81:0/1442511583 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64a4072d30 0x7f64a406f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.777+0000 7f64a37fe640 1 -- 172.21.15.81:0/1442511583 >> v1:172.21.15.102:6789/0 conn(0x7f64a415b300 legacy=0x7f64a40cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.777+0000 7f64a37fe640 1 -- 172.21.15.81:0/1442511583 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a40cd900 con 0x7f64a406f700 2024-09-16T01:16:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.777+0000 7f64a37fe640 1 --2- 172.21.15.81:0/1442511583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64a406f700 0x7f64a415b6e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f649c00d150 tx=0x7f649c02c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3f08a7f7a82dca server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.777+0000 7f64a1ffb640 1 -- 172.21.15.81:0/1442511583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c009600 con 0x7f64a406f700 2024-09-16T01:16:28.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.777+0000 7f64a1ffb640 1 -- 172.21.15.81:0/1442511583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f649c037070 con 0x7f64a406f700 2024-09-16T01:16:28.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.777+0000 7f64a1ffb640 1 -- 172.21.15.81:0/1442511583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c0099c0 con 0x7f64a406f700 2024-09-16T01:16:28.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.778+0000 7f64a9526640 1 -- 172.21.15.81:0/1442511583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64a406f700 msgr2=0x7f64a415b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.778+0000 7f64a9526640 1 --2- 172.21.15.81:0/1442511583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64a406f700 0x7f64a415b6e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f649c00d150 tx=0x7f649c02c930 comp rx=0 tx=0).stop 2024-09-16T01:16:28.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.778+0000 7f64a9526640 1 -- 172.21.15.81:0/1442511583 shutdown_connections 2024-09-16T01:16:28.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.778+0000 7f64a9526640 1 --2- 172.21.15.81:0/1442511583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64a406f700 0x7f64a415b6e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.778+0000 7f64a9526640 1 --2- 172.21.15.81:0/1442511583 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64a4072d30 0x7f64a406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.778+0000 7f64a9526640 1 -- 172.21.15.81:0/1442511583 >> 172.21.15.81:0/1442511583 conn(0x7f64a4067d70 msgr2=0x7f64a406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:28.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.778+0000 7f64a9526640 1 -- 172.21.15.81:0/1442511583 shutdown_connections 2024-09-16T01:16:28.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.778+0000 7f64a9526640 1 -- 172.21.15.81:0/1442511583 wait complete. 2024-09-16T01:16:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.779+0000 7f64a9526640 1 Processor -- start 2024-09-16T01:16:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.779+0000 7f64a9526640 1 -- start start 2024-09-16T01:16:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a9526640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64a406f700 0x7f64a4150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a9526640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64a4072d30 0x7f64a41f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a9526640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64a415b300 0x7f64a41f8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a9526640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f64a40cd5c0 con 0x7f64a4072d30 2024-09-16T01:16:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a9526640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f64a4072530 con 0x7f64a415b300 2024-09-16T01:16:28.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a9526640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f64a40cffe0 con 0x7f64a406f700 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64a4072d30 0x7f64a41f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64a4072d30 0x7f64a41f7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51646/0 (socket says 172.21.15.81:51646) 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a27fc640 1 -- 172.21.15.81:0/3575035877 learned_addr learned my addr 172.21.15.81:0/3575035877 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a37fe640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64a415b300 0x7f64a41f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a2ffd640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64a406f700 0x7f64a4150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a27fc640 1 -- 172.21.15.81:0/3575035877 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64a406f700 msgr2=0x7f64a4150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a27fc640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64a406f700 0x7f64a4150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a27fc640 1 -- 172.21.15.81:0/3575035877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64a415b300 msgr2=0x7f64a41f8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a27fc640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64a415b300 0x7f64a41f8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.780+0000 7f64a27fc640 1 -- 172.21.15.81:0/3575035877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a4151470 con 0x7f64a4072d30 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.781+0000 7f64a27fc640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64a4072d30 0x7f64a41f7c40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f649800d800 tx=0x7f649800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.781+0000 7f648b7fe640 1 -- 172.21.15.81:0/3575035877 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649800b6c0 con 0x7f64a4072d30 2024-09-16T01:16:28.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.781+0000 7f648b7fe640 1 -- 172.21.15.81:0/3575035877 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6498019070 con 0x7f64a4072d30 2024-09-16T01:16:28.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.781+0000 7f64a9526640 1 -- 172.21.15.81:0/3575035877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a4151750 con 0x7f64a4072d30 2024-09-16T01:16:28.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.781+0000 7f648b7fe640 1 -- 172.21.15.81:0/3575035877 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649800bac0 con 0x7f64a4072d30 2024-09-16T01:16:28.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.781+0000 7f64a9526640 1 -- 172.21.15.81:0/3575035877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a4151d10 con 0x7f64a4072d30 2024-09-16T01:16:28.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.782+0000 7f64a9526640 1 -- 172.21.15.81:0/3575035877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a41520b0 con 0x7f64a4072d30 2024-09-16T01:16:28.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.783+0000 7f648b7fe640 1 -- 172.21.15.81:0/3575035877 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f649800bc60 con 0x7f64a4072d30 2024-09-16T01:16:28.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.783+0000 7f648b7fe640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f649006c2b0 0x7f649006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:28.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.783+0000 7f648b7fe640 1 -- 172.21.15.81:0/3575035877 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f649808b560 con 0x7f64a4072d30 2024-09-16T01:16:28.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.783+0000 7f64a2ffd640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f649006c2b0 0x7f649006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:28.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.783+0000 7f64a2ffd640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f649006c2b0 0x7f649006e770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64940016e0 tx=0x7f6494009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:28.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:28.787+0000 7f648b7fe640 1 -- 172.21.15.81:0/3575035877 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64980598d0 con 0x7f64a4072d30 2024-09-16T01:16:29.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.017+0000 7f64a9526640 1 -- 172.21.15.81:0/3575035877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f64a4150690 con 0x7f64a4072d30 2024-09-16T01:16:29.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.019+0000 7f648b7fe640 1 -- 172.21.15.81:0/3575035877 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f64980600f0 con 0x7f64a4072d30 2024-09-16T01:16:29.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.021+0000 7f64a9526640 1 -- 172.21.15.81:0/3575035877 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f649006c2b0 msgr2=0x7f649006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.021+0000 7f64a9526640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f649006c2b0 0x7f649006e770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64940016e0 tx=0x7f6494009040 comp rx=0 tx=0).stop 2024-09-16T01:16:29.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.021+0000 7f64a9526640 1 -- 172.21.15.81:0/3575035877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64a4072d30 msgr2=0x7f64a41f7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.021+0000 7f64a9526640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64a4072d30 0x7f64a41f7c40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f649800d800 tx=0x7f649800dcc0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.021+0000 7f64a9526640 1 -- 172.21.15.81:0/3575035877 shutdown_connections 2024-09-16T01:16:29.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.021+0000 7f64a9526640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f649006c2b0 0x7f649006e770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.021+0000 7f64a9526640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64a415b300 0x7f64a41f8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.021+0000 7f64a9526640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64a4072d30 0x7f64a41f7c40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.021+0000 7f64a9526640 1 --2- 172.21.15.81:0/3575035877 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64a406f700 0x7f64a4150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.021+0000 7f64a9526640 1 -- 172.21.15.81:0/3575035877 >> 172.21.15.81:0/3575035877 conn(0x7f64a4067d70 msgr2=0x7f64a406ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:29.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.021+0000 7f64a9526640 1 -- 172.21.15.81:0/3575035877 shutdown_connections 2024-09-16T01:16:29.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.021+0000 7f64a9526640 1 -- 172.21.15.81:0/3575035877 wait complete. 2024-09-16T01:16:29.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-16T01:16:29.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.130+0000 7f17bfdd6640 1 Processor -- start 2024-09-16T01:16:29.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.131+0000 7f17bfdd6640 1 -- start start 2024-09-16T01:16:29.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.131+0000 7f17bfdd6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17b815ba30 0x7f17b806f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.131+0000 7f17bfdd6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f17b806fd50 0x7f17b8072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.131+0000 7f17bfdd6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17b80b3570 con 0x7f17b8072e80 2024-09-16T01:16:29.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.131+0000 7f17bfdd6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f17b80b4180 con 0x7f17b806fd50 2024-09-16T01:16:29.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.131+0000 7f17bfdd6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f17b80b3850 con 0x7f17b815ba30 2024-09-16T01:16:29.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.132+0000 7f17bd371640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f17b806fd50 0x7f17b8072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.132+0000 7f17be373640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f17b8072e80 0x7f17b806e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45272/0 (socket says 172.21.15.81:45272) 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.132+0000 7f17be373640 1 -- 172.21.15.81:0/4143771408 learned_addr learned my addr 172.21.15.81:0/4143771408 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.132+0000 7f17bd371640 1 -- 172.21.15.81:0/4143771408 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17b815ba30 msgr2=0x7f17b806f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.132+0000 7f17bdb72640 1 --2- 172.21.15.81:0/4143771408 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17b815ba30 0x7f17b806f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.132+0000 7f17bcb70640 1 -- 172.21.15.81:0/4143771408 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 111976428 0 0) 0x7f17b80b3570 con 0x7f17b8072e80 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.132+0000 7f17bd371640 1 --2- 172.21.15.81:0/4143771408 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17b815ba30 0x7f17b806f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.132+0000 7f17bd371640 1 -- 172.21.15.81:0/4143771408 >> v1:172.21.15.81:6789/0 conn(0x7f17b8072e80 legacy=0x7f17b806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.132+0000 7f17bd371640 1 -- 172.21.15.81:0/4143771408 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b80b3b30 con 0x7f17b806fd50 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.132+0000 7f17bdb72640 1 --2- 172.21.15.81:0/4143771408 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17b815ba30 0x7f17b806f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.133+0000 7f17bd371640 1 --2- 172.21.15.81:0/4143771408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b806fd50 0x7f17b8072940 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f17b40097a0 tx=0x7f17b402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f260aa3d87127908 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.133+0000 7f17bcb70640 1 -- 172.21.15.81:0/4143771408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4037070 con 0x7f17b806fd50 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.133+0000 7f17bcb70640 1 -- 172.21.15.81:0/4143771408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b4032440 con 0x7f17b806fd50 2024-09-16T01:16:29.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.133+0000 7f17bcb70640 1 -- 172.21.15.81:0/4143771408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4032810 con 0x7f17b806fd50 2024-09-16T01:16:29.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.133+0000 7f17bfdd6640 1 -- 172.21.15.81:0/4143771408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b806fd50 msgr2=0x7f17b8072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.133+0000 7f17bfdd6640 1 --2- 172.21.15.81:0/4143771408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b806fd50 0x7f17b8072940 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f17b40097a0 tx=0x7f17b402a180 comp rx=0 tx=0).stop 2024-09-16T01:16:29.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.133+0000 7f17bfdd6640 1 -- 172.21.15.81:0/4143771408 shutdown_connections 2024-09-16T01:16:29.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.133+0000 7f17bfdd6640 1 --2- 172.21.15.81:0/4143771408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b806fd50 0x7f17b8072940 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.133+0000 7f17bfdd6640 1 --2- 172.21.15.81:0/4143771408 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17b815ba30 0x7f17b806f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.133+0000 7f17bfdd6640 1 -- 172.21.15.81:0/4143771408 >> 172.21.15.81:0/4143771408 conn(0x7f17b8067d70 msgr2=0x7f17b806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:29.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.133+0000 7f17bfdd6640 1 -- 172.21.15.81:0/4143771408 shutdown_connections 2024-09-16T01:16:29.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.133+0000 7f17bfdd6640 1 -- 172.21.15.81:0/4143771408 wait complete. 2024-09-16T01:16:29.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.135+0000 7f17bfdd6640 1 Processor -- start 2024-09-16T01:16:29.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.135+0000 7f17bfdd6640 1 -- start start 2024-09-16T01:16:29.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.135+0000 7f17bfdd6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17b806fd50 0x7f17b815c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.135+0000 7f17bfdd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8072e80 0x7f17b8146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.135+0000 7f17bfdd6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17b815ba30 0x7f17b8142220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.135+0000 7f17bfdd6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17b80ce810 con 0x7f17b8072e80 2024-09-16T01:16:29.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.135+0000 7f17bfdd6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f17b80732f0 con 0x7f17b815ba30 2024-09-16T01:16:29.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.135+0000 7f17bfdd6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f17b80b5890 con 0x7f17b806fd50 2024-09-16T01:16:29.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.135+0000 7f17bd371640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8072e80 0x7f17b8146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.135+0000 7f17bd371640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8072e80 0x7f17b8146420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51668/0 (socket says 172.21.15.81:51668) 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.135+0000 7f17bd371640 1 -- 172.21.15.81:0/3864534073 learned_addr learned my addr 172.21.15.81:0/3864534073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.135+0000 7f17bdb72640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17b806fd50 0x7f17b815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17bd371640 1 -- 172.21.15.81:0/3864534073 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17b806fd50 msgr2=0x7f17b815c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17be373640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17b815ba30 0x7f17b8142220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17bd371640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17b806fd50 0x7f17b815c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17bd371640 1 -- 172.21.15.81:0/3864534073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17b815ba30 msgr2=0x7f17b8142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17bd371640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17b815ba30 0x7f17b8142220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17bd371640 1 -- 172.21.15.81:0/3864534073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b815d170 con 0x7f17b8072e80 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17be373640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17b815ba30 0x7f17b8142220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17bd371640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8072e80 0x7f17b8146420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f17b4035040 tx=0x7f17b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17aa7fc640 1 -- 172.21.15.81:0/3864534073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4037040 con 0x7f17b8072e80 2024-09-16T01:16:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17aa7fc640 1 -- 172.21.15.81:0/3864534073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b4030770 con 0x7f17b8072e80 2024-09-16T01:16:29.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17bfdd6640 1 -- 172.21.15.81:0/3864534073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b815d450 con 0x7f17b8072e80 2024-09-16T01:16:29.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17aa7fc640 1 -- 172.21.15.81:0/3864534073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4030b80 con 0x7f17b8072e80 2024-09-16T01:16:29.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.136+0000 7f17bfdd6640 1 -- 172.21.15.81:0/3864534073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b81526b0 con 0x7f17b8072e80 2024-09-16T01:16:29.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.137+0000 7f17bfdd6640 1 -- 172.21.15.81:0/3864534073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b80ccfe0 con 0x7f17b8072e80 2024-09-16T01:16:29.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.137+0000 7f17aa7fc640 1 -- 172.21.15.81:0/3864534073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f17b4044020 con 0x7f17b8072e80 2024-09-16T01:16:29.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.138+0000 7f17aa7fc640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f179c06c2b0 0x7f179c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.138+0000 7f17aa7fc640 1 -- 172.21.15.81:0/3864534073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f17b40ab860 con 0x7f17b8072e80 2024-09-16T01:16:29.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.138+0000 7f17bdb72640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f179c06c2b0 0x7f179c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.138+0000 7f17bdb72640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f179c06c2b0 0x7f179c06e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00a950 tx=0x7f17ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:29.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.142+0000 7f17aa7fc640 1 -- 172.21.15.81:0/3864534073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f17b4032e20 con 0x7f17b8072e80 2024-09-16T01:16:29.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.367+0000 7f17bfdd6640 1 -- 172.21.15.81:0/3864534073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f17b8154df0 con 0x7f17b8072e80 2024-09-16T01:16:29.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.369+0000 7f17aa7fc640 1 -- 172.21.15.81:0/3864534073 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f17b407a190 con 0x7f17b8072e80 2024-09-16T01:16:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.371+0000 7f17bfdd6640 1 -- 172.21.15.81:0/3864534073 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f179c06c2b0 msgr2=0x7f179c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.371+0000 7f17bfdd6640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f179c06c2b0 0x7f179c06e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00a950 tx=0x7f17ac008040 comp rx=0 tx=0).stop 2024-09-16T01:16:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.371+0000 7f17bfdd6640 1 -- 172.21.15.81:0/3864534073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8072e80 msgr2=0x7f17b8146420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.371+0000 7f17bfdd6640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8072e80 0x7f17b8146420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f17b4035040 tx=0x7f17b40046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.371+0000 7f17bfdd6640 1 -- 172.21.15.81:0/3864534073 shutdown_connections 2024-09-16T01:16:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.371+0000 7f17bfdd6640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f179c06c2b0 0x7f179c06e770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.371+0000 7f17bfdd6640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17b815ba30 0x7f17b8142220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.371+0000 7f17bfdd6640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17b8072e80 0x7f17b8146420 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.371+0000 7f17bfdd6640 1 --2- 172.21.15.81:0/3864534073 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17b806fd50 0x7f17b815c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.371+0000 7f17bfdd6640 1 -- 172.21.15.81:0/3864534073 >> 172.21.15.81:0/3864534073 conn(0x7f17b8067d70 msgr2=0x7f17b80b4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.371+0000 7f17bfdd6640 1 -- 172.21.15.81:0/3864534073 shutdown_connections 2024-09-16T01:16:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.371+0000 7f17bfdd6640 1 -- 172.21.15.81:0/3864534073 wait complete. 2024-09-16T01:16:29.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:16:29.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.479+0000 7fbb15865640 1 Processor -- start 2024-09-16T01:16:29.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.480+0000 7fbb15865640 1 -- start start 2024-09-16T01:16:29.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.480+0000 7fbb15865640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb100b43f0 0x7fbb1009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.480+0000 7fbb15865640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbb100b5050 0x7fbb1015b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.480+0000 7fbb15865640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb100b3830 con 0x7fbb1015b340 2024-09-16T01:16:29.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.480+0000 7fbb15865640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fbb100b5bd0 con 0x7fbb100b5050 2024-09-16T01:16:29.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.480+0000 7fbb15865640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbb100b5610 con 0x7fbb100b43f0 2024-09-16T01:16:29.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.480+0000 7fbb0f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbb100b5050 0x7fbb1015b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.481+0000 7fbb0f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbb100b5050 0x7fbb1015b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51678/0 (socket says 172.21.15.81:51678) 2024-09-16T01:16:29.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.481+0000 7fbb0f7fe640 1 -- 172.21.15.81:0/952766555 learned_addr learned my addr 172.21.15.81:0/952766555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:29.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.481+0000 7fbb067fc640 1 --2- 172.21.15.81:0/952766555 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb100b43f0 0x7fbb1009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.481+0000 7fbb0f7fe640 1 -- 172.21.15.81:0/952766555 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb100b43f0 msgr2=0x7fbb1009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:29.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.481+0000 7fbb0f7fe640 1 --2- 172.21.15.81:0/952766555 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb100b43f0 0x7fbb1009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.481+0000 7fbb0f7fe640 1 -- 172.21.15.81:0/952766555 >> v1:172.21.15.102:6789/0 conn(0x7fbb1015b340 legacy=0x7fbb100b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.481+0000 7fbb0f7fe640 1 -- 172.21.15.81:0/952766555 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb100b58f0 con 0x7fbb100b5050 2024-09-16T01:16:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.482+0000 7fbb0f7fe640 1 --2- 172.21.15.81:0/952766555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb100b5050 0x7fbb1015b720 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009e50 tx=0x7fbb0802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a1a58ffa75e3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.482+0000 7fbb0e7fc640 1 -- 172.21.15.81:0/952766555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08036070 con 0x7fbb100b5050 2024-09-16T01:16:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.482+0000 7fbb0e7fc640 1 -- 172.21.15.81:0/952766555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb08031600 con 0x7fbb100b5050 2024-09-16T01:16:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.482+0000 7fbb0e7fc640 1 -- 172.21.15.81:0/952766555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb080319d0 con 0x7fbb100b5050 2024-09-16T01:16:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.482+0000 7fbb15865640 1 -- 172.21.15.81:0/952766555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb100b5050 msgr2=0x7fbb1015b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.482+0000 7fbb15865640 1 --2- 172.21.15.81:0/952766555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb100b5050 0x7fbb1015b720 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009e50 tx=0x7fbb0802a7a0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.482+0000 7fbb15865640 1 -- 172.21.15.81:0/952766555 shutdown_connections 2024-09-16T01:16:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.482+0000 7fbb15865640 1 --2- 172.21.15.81:0/952766555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb100b5050 0x7fbb1015b720 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.482+0000 7fbb15865640 1 --2- 172.21.15.81:0/952766555 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb100b43f0 0x7fbb1009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.482+0000 7fbb15865640 1 -- 172.21.15.81:0/952766555 >> 172.21.15.81:0/952766555 conn(0x7fbb10073490 msgr2=0x7fbb100b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.482+0000 7fbb15865640 1 -- 172.21.15.81:0/952766555 shutdown_connections 2024-09-16T01:16:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.482+0000 7fbb15865640 1 -- 172.21.15.81:0/952766555 wait complete. 2024-09-16T01:16:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.483+0000 7fbb15865640 1 Processor -- start 2024-09-16T01:16:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.484+0000 7fbb15865640 1 -- start start 2024-09-16T01:16:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.484+0000 7fbb15865640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb100b43f0 0x7fbb100ce050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.484+0000 7fbb15865640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb100b5050 0x7fbb100ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.484+0000 7fbb15865640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1015b340 0x7fbb10148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.484+0000 7fbb15865640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbb100cdb30 con 0x7fbb1015b340 2024-09-16T01:16:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.484+0000 7fbb15865640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1015d8f0 con 0x7fbb100b43f0 2024-09-16T01:16:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.484+0000 7fbb15865640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbb100cdcb0 con 0x7fbb100b5050 2024-09-16T01:16:29.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.484+0000 7fbb0f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1015b340 0x7fbb10148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.484+0000 7fbb0effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb100b43f0 0x7fbb100ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.484+0000 7fbb0f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1015b340 0x7fbb10148980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51680/0 (socket says 172.21.15.81:51680) 2024-09-16T01:16:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.484+0000 7fbb0f7fe640 1 -- 172.21.15.81:0/2553255712 learned_addr learned my addr 172.21.15.81:0/2553255712 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.485+0000 7fbb067fc640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb100b5050 0x7fbb100ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.485+0000 7fbb0f7fe640 1 -- 172.21.15.81:0/2553255712 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb100b5050 msgr2=0x7fbb100ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.485+0000 7fbb0f7fe640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb100b5050 0x7fbb100ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.485+0000 7fbb0f7fe640 1 -- 172.21.15.81:0/2553255712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb100b43f0 msgr2=0x7fbb100ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.485+0000 7fbb0f7fe640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb100b43f0 0x7fbb100ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.485+0000 7fbb0f7fe640 1 -- 172.21.15.81:0/2553255712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb101498f0 con 0x7fbb1015b340 2024-09-16T01:16:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.485+0000 7fbb0f7fe640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1015b340 0x7fbb10148980 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009e50 tx=0x7fbb08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:29.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.485+0000 7fbb0cff9640 1 -- 172.21.15.81:0/2553255712 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08036050 con 0x7fbb1015b340 2024-09-16T01:16:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.485+0000 7fbb0cff9640 1 -- 172.21.15.81:0/2553255712 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb08042070 con 0x7fbb1015b340 2024-09-16T01:16:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.485+0000 7fbb15865640 1 -- 172.21.15.81:0/2553255712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb10153870 con 0x7fbb1015b340 2024-09-16T01:16:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.485+0000 7fbb0cff9640 1 -- 172.21.15.81:0/2553255712 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb08009510 con 0x7fbb1015b340 2024-09-16T01:16:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.485+0000 7fbb15865640 1 -- 172.21.15.81:0/2553255712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb101481b0 con 0x7fbb1015b340 2024-09-16T01:16:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.486+0000 7fbb15865640 1 -- 172.21.15.81:0/2553255712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb10153660 con 0x7fbb1015b340 2024-09-16T01:16:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.487+0000 7fbb0cff9640 1 -- 172.21.15.81:0/2553255712 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbb08007b30 con 0x7fbb1015b340 2024-09-16T01:16:29.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.487+0000 7fbb0cff9640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbaf006c2b0 0x7fbaf006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.487+0000 7fbb0cff9640 1 -- 172.21.15.81:0/2553255712 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7fbb080abed0 con 0x7fbb1015b340 2024-09-16T01:16:29.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.487+0000 7fbb0effd640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbaf006c2b0 0x7fbaf006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.487+0000 7fbb0effd640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbaf006c2b0 0x7fbaf006e770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbb101f57e0 tx=0x7fbb00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:29.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.491+0000 7fbb0cff9640 1 -- 172.21.15.81:0/2553255712 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb08007e20 con 0x7fbb1015b340 2024-09-16T01:16:29.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.658+0000 7fbb15865640 1 -- 172.21.15.81:0/2553255712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbb10148410 con 0x7fbb1015b340 2024-09-16T01:16:29.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.659+0000 7fbb0cff9640 1 -- 172.21.15.81:0/2553255712 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) ==== 84+0+65 (secure 0 0 0) 0x7fbb0807a240 con 0x7fbb1015b340 2024-09-16T01:16:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:29.661 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-16T01:16:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:16:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-16T01:16:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-16T01:16:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:16:29.661 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-16T01:16:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.661+0000 7fbb15865640 1 -- 172.21.15.81:0/2553255712 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbaf006c2b0 msgr2=0x7fbaf006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.661+0000 7fbb15865640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbaf006c2b0 0x7fbaf006e770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbb101f57e0 tx=0x7fbb00009040 comp rx=0 tx=0).stop 2024-09-16T01:16:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.661+0000 7fbb15865640 1 -- 172.21.15.81:0/2553255712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1015b340 msgr2=0x7fbb10148980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.661+0000 7fbb15865640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1015b340 0x7fbb10148980 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009e50 tx=0x7fbb08004a40 comp rx=0 tx=0).stop 2024-09-16T01:16:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.661+0000 7fbb15865640 1 -- 172.21.15.81:0/2553255712 shutdown_connections 2024-09-16T01:16:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.661+0000 7fbb15865640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbaf006c2b0 0x7fbaf006e770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.661+0000 7fbb15865640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb1015b340 0x7fbb10148980 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.661+0000 7fbb15865640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb100b5050 0x7fbb100ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.661+0000 7fbb15865640 1 --2- 172.21.15.81:0/2553255712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb100b43f0 0x7fbb100ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.661+0000 7fbb15865640 1 -- 172.21.15.81:0/2553255712 >> 172.21.15.81:0/2553255712 conn(0x7fbb10073490 msgr2=0x7fbb1014a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:29.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.661+0000 7fbb15865640 1 -- 172.21.15.81:0/2553255712 shutdown_connections 2024-09-16T01:16:29.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.661+0000 7fbb15865640 1 -- 172.21.15.81:0/2553255712 wait complete. 2024-09-16T01:16:29.673 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:16:29.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:16:29.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.773+0000 7f5d1cd33640 1 Processor -- start 2024-09-16T01:16:29.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.773+0000 7f5d1cd33640 1 -- start start 2024-09-16T01:16:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.774+0000 7f5d1cd33640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5d180cf330 0x7f5d18169070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.774+0000 7f5d1cd33640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d1806e820 con 0x7f5d180d15f0 2024-09-16T01:16:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.774+0000 7f5d1cd33640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d180cf980 con 0x7f5d18161a20 2024-09-16T01:16:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.774+0000 7f5d1cd33640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5d180cf760 con 0x7f5d180cf330 2024-09-16T01:16:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.774+0000 7f5d16d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5d180cf330 0x7f5d18169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.774+0000 7f5d0dd9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5d180d15f0 0x7f5d180cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45280/0 (socket says 172.21.15.81:45280) 2024-09-16T01:16:29.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.774+0000 7f5d0dd9b640 1 -- 172.21.15.81:0/3983710413 learned_addr learned my addr 172.21.15.81:0/3983710413 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:29.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.774+0000 7f5d16d9d640 1 -- 172.21.15.81:0/3983710413 >> v1:172.21.15.102:6789/0 conn(0x7f5d18161a20 legacy=0x7f5d180d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.774+0000 7f5d16d9d640 1 -- 172.21.15.81:0/3983710413 >> v1:172.21.15.81:6789/0 conn(0x7f5d180d15f0 legacy=0x7f5d180cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.774+0000 7f5d16d9d640 1 -- 172.21.15.81:0/3983710413 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d1806d050 con 0x7f5d180cf330 2024-09-16T01:16:29.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.774+0000 7f5d15d9b640 1 -- 172.21.15.81:0/3983710413 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88095649 0 0) 0x7f5d1806e820 con 0x7f5d180d15f0 2024-09-16T01:16:29.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.775+0000 7f5d16d9d640 1 --2- 172.21.15.81:0/3983710413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d180cf330 0x7f5d18169070 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009d90 tx=0x7f5d1002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29365fedbccef0b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:29.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.775+0000 7f5d15d9b640 1 -- 172.21.15.81:0/3983710413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10007740 con 0x7f5d180cf330 2024-09-16T01:16:29.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.775+0000 7f5d15d9b640 1 -- 172.21.15.81:0/3983710413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d100078e0 con 0x7f5d180cf330 2024-09-16T01:16:29.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.775+0000 7f5d15d9b640 1 -- 172.21.15.81:0/3983710413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10007cb0 con 0x7f5d180cf330 2024-09-16T01:16:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.776+0000 7f5d1cd33640 1 -- 172.21.15.81:0/3983710413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d180cf330 msgr2=0x7f5d18169070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.776+0000 7f5d1cd33640 1 --2- 172.21.15.81:0/3983710413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d180cf330 0x7f5d18169070 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009d90 tx=0x7f5d1002a6f0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.776+0000 7f5d1cd33640 1 -- 172.21.15.81:0/3983710413 shutdown_connections 2024-09-16T01:16:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.776+0000 7f5d1cd33640 1 --2- 172.21.15.81:0/3983710413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d180cf330 0x7f5d18169070 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.776+0000 7f5d1cd33640 1 -- 172.21.15.81:0/3983710413 >> 172.21.15.81:0/3983710413 conn(0x7f5d1809d850 msgr2=0x7f5d1808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.776+0000 7f5d1cd33640 1 -- 172.21.15.81:0/3983710413 shutdown_connections 2024-09-16T01:16:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.776+0000 7f5d1cd33640 1 -- 172.21.15.81:0/3983710413 wait complete. 2024-09-16T01:16:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.777+0000 7f5d1cd33640 1 Processor -- start 2024-09-16T01:16:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.777+0000 7f5d1cd33640 1 -- start start 2024-09-16T01:16:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.778+0000 7f5d1cd33640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d180cf330 0x7f5d180ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.778+0000 7f5d1cd33640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d180d15f0 0x7f5d1815f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.778+0000 7f5d1cd33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d18161a20 0x7f5d1815bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.778+0000 7f5d1cd33640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d180cff00 con 0x7f5d18161a20 2024-09-16T01:16:29.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.778+0000 7f5d1cd33640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5d18161e00 con 0x7f5d180d15f0 2024-09-16T01:16:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.778+0000 7f5d1cd33640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1806d2f0 con 0x7f5d180cf330 2024-09-16T01:16:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.778+0000 7f5d16d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d18161a20 0x7f5d1815bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.778+0000 7f5d16d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d18161a20 0x7f5d1815bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51694/0 (socket says 172.21.15.81:51694) 2024-09-16T01:16:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.778+0000 7f5d16d9d640 1 -- 172.21.15.81:0/1841116400 learned_addr learned my addr 172.21.15.81:0/1841116400 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.778+0000 7f5d0dd9b640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d180d15f0 0x7f5d1815f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.778+0000 7f5d1659c640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d180cf330 0x7f5d180ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.779+0000 7f5d16d9d640 1 -- 172.21.15.81:0/1841116400 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d180cf330 msgr2=0x7f5d180ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.779+0000 7f5d16d9d640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d180cf330 0x7f5d180ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.779+0000 7f5d16d9d640 1 -- 172.21.15.81:0/1841116400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d180d15f0 msgr2=0x7f5d1815f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.779+0000 7f5d16d9d640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d180d15f0 0x7f5d1815f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:29.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.779+0000 7f5d16d9d640 1 -- 172.21.15.81:0/1841116400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d180c9700 con 0x7f5d18161a20 2024-09-16T01:16:29.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.779+0000 7f5d16d9d640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d18161a20 0x7f5d1815bb00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009d90 tx=0x7f5d10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:29.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.779+0000 7f5d0f7fe640 1 -- 172.21.15.81:0/1841116400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10040070 con 0x7f5d18161a20 2024-09-16T01:16:29.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.779+0000 7f5d0f7fe640 1 -- 172.21.15.81:0/1841116400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d10031c40 con 0x7f5d18161a20 2024-09-16T01:16:29.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.779+0000 7f5d0f7fe640 1 -- 172.21.15.81:0/1841116400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10003990 con 0x7f5d18161a20 2024-09-16T01:16:29.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.779+0000 7f5d1cd33640 1 -- 172.21.15.81:0/1841116400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d180c99e0 con 0x7f5d18161a20 2024-09-16T01:16:29.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.779+0000 7f5d1cd33640 1 -- 172.21.15.81:0/1841116400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d180caa00 con 0x7f5d18161a20 2024-09-16T01:16:29.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.780+0000 7f5d1cd33640 1 -- 172.21.15.81:0/1841116400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d180b1040 con 0x7f5d18161a20 2024-09-16T01:16:29.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.780+0000 7f5d0f7fe640 1 -- 172.21.15.81:0/1841116400 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5d10039040 con 0x7f5d18161a20 2024-09-16T01:16:29.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.781+0000 7f5d0f7fe640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5cf806c2b0 0x7f5cf806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:29.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.781+0000 7f5d0f7fe640 1 -- 172.21.15.81:0/1841116400 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5249+0+0 (secure 0 0 0) 0x7f5d100ac580 con 0x7f5d18161a20 2024-09-16T01:16:29.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.781+0000 7f5d1659c640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5cf806c2b0 0x7f5cf806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:29.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.781+0000 7f5d1659c640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5cf806c2b0 0x7f5cf806e770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5d08000f60 tx=0x7f5d08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:29.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.785+0000 7f5d0f7fe640 1 -- 172.21.15.81:0/1841116400 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d1007a860 con 0x7f5d18161a20 2024-09-16T01:16:29.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:29.955+0000 7f5d1cd33640 1 -- 172.21.15.81:0/1841116400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5d180c9d70 con 0x7f5d18161a20 2024-09-16T01:16:30.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.958+0000 7f5d0f7fe640 1 -- 172.21.15.81:0/1841116400 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) ==== 138+0+0 (secure 0 0 0) 0x7f5d1007eb60 con 0x7f5d18161a20 2024-09-16T01:16:30.960 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-16T01:16:30.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.961+0000 7f5d1cd33640 1 -- 172.21.15.81:0/1841116400 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5cf806c2b0 msgr2=0x7f5cf806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:30.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.961+0000 7f5d1cd33640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5cf806c2b0 0x7f5cf806e770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5d08000f60 tx=0x7f5d08009040 comp rx=0 tx=0).stop 2024-09-16T01:16:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.961+0000 7f5d1cd33640 1 -- 172.21.15.81:0/1841116400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d18161a20 msgr2=0x7f5d1815bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.961+0000 7f5d1cd33640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d18161a20 0x7f5d1815bb00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009d90 tx=0x7f5d10004a40 comp rx=0 tx=0).stop 2024-09-16T01:16:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.961+0000 7f5d1cd33640 1 -- 172.21.15.81:0/1841116400 shutdown_connections 2024-09-16T01:16:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.961+0000 7f5d1cd33640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5cf806c2b0 0x7f5cf806e770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.961+0000 7f5d1cd33640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d18161a20 0x7f5d1815bb00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.961+0000 7f5d1cd33640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d180d15f0 0x7f5d1815f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.961+0000 7f5d1cd33640 1 --2- 172.21.15.81:0/1841116400 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d180cf330 0x7f5d180ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.962+0000 7f5d1cd33640 1 -- 172.21.15.81:0/1841116400 >> 172.21.15.81:0/1841116400 conn(0x7f5d1809d850 msgr2=0x7f5d180d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.962+0000 7f5d1cd33640 1 -- 172.21.15.81:0/1841116400 shutdown_connections 2024-09-16T01:16:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:30.962+0000 7f5d1cd33640 1 -- 172.21.15.81:0/1841116400 wait complete. 2024-09-16T01:16:30.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:16:31.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.091+0000 7f053e16d640 1 Processor -- start 2024-09-16T01:16:31.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.091+0000 7f053e16d640 1 -- start start 2024-09-16T01:16:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f053e16d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f053815e2e0 0x7f05380b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f053e16d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0538067ae0 0x7f053815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f053e16d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f053815f8f0 con 0x7f05380adce0 2024-09-16T01:16:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f053e16d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f05380aec30 con 0x7f0538067ae0 2024-09-16T01:16:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f053e16d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0538067ff0 con 0x7f053815e2e0 2024-09-16T01:16:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f0536ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0538067ae0 0x7f053815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f0537fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f05380adce0 0x7f05380ae150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38562/0 (socket says 172.21.15.81:38562) 2024-09-16T01:16:31.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f0537fff640 1 -- 172.21.15.81:0/3617567113 learned_addr learned my addr 172.21.15.81:0/3617567113 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:31.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f0536ffd640 1 -- 172.21.15.81:0/3617567113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f053815e2e0 msgr2=0x7f05380b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:31.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f0536ffd640 1 --2- 172.21.15.81:0/3617567113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f053815e2e0 0x7f05380b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:31.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f0536ffd640 1 -- 172.21.15.81:0/3617567113 >> v1:172.21.15.81:6789/0 conn(0x7f05380adce0 legacy=0x7f05380ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:31.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f05367fc640 1 -- 172.21.15.81:0/3617567113 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 866138114 0 0) 0x7f0530001490 con 0x7f05380adce0 2024-09-16T01:16:31.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.092+0000 7f0536ffd640 1 -- 172.21.15.81:0/3617567113 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05380af390 con 0x7f0538067ae0 2024-09-16T01:16:31.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.093+0000 7f0536ffd640 1 --2- 172.21.15.81:0/3617567113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0538067ae0 0x7f053815f3b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f052c0097a0 tx=0x7f052c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb89ed7baa6818b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:31.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.093+0000 7f05367fc640 1 -- 172.21.15.81:0/3617567113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c037070 con 0x7f0538067ae0 2024-09-16T01:16:31.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.093+0000 7f05367fc640 1 -- 172.21.15.81:0/3617567113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f052c032440 con 0x7f0538067ae0 2024-09-16T01:16:31.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.093+0000 7f05367fc640 1 -- 172.21.15.81:0/3617567113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c032810 con 0x7f0538067ae0 2024-09-16T01:16:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.094+0000 7f053e16d640 1 -- 172.21.15.81:0/3617567113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0538067ae0 msgr2=0x7f053815f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.094+0000 7f053e16d640 1 --2- 172.21.15.81:0/3617567113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0538067ae0 0x7f053815f3b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f052c0097a0 tx=0x7f052c02a180 comp rx=0 tx=0).stop 2024-09-16T01:16:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.094+0000 7f053e16d640 1 -- 172.21.15.81:0/3617567113 shutdown_connections 2024-09-16T01:16:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.094+0000 7f053e16d640 1 --2- 172.21.15.81:0/3617567113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0538067ae0 0x7f053815f3b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.094+0000 7f053e16d640 1 --2- 172.21.15.81:0/3617567113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f053815e2e0 0x7f05380b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.094+0000 7f053e16d640 1 -- 172.21.15.81:0/3617567113 >> 172.21.15.81:0/3617567113 conn(0x7f0538073590 msgr2=0x7f053806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.094+0000 7f053e16d640 1 -- 172.21.15.81:0/3617567113 shutdown_connections 2024-09-16T01:16:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.094+0000 7f053e16d640 1 -- 172.21.15.81:0/3617567113 wait complete. 2024-09-16T01:16:31.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.095+0000 7f053e16d640 1 Processor -- start 2024-09-16T01:16:31.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.095+0000 7f053e16d640 1 -- start start 2024-09-16T01:16:31.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f053e16d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0538067ae0 0x7f05380cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:31.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f053e16d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05380adce0 0x7f05380cff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:31.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f053e16d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053815e2e0 0x7f0538146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:31.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f053e16d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f05380afc30 con 0x7f053815e2e0 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f053e16d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f05380af950 con 0x7f0538067ae0 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f053e16d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f053815e6c0 con 0x7f05380adce0 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f0537fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053815e2e0 0x7f0538146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f0537fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053815e2e0 0x7f0538146720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39578/0 (socket says 172.21.15.81:39578) 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f0537fff640 1 -- 172.21.15.81:0/1961205144 learned_addr learned my addr 172.21.15.81:0/1961205144 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f05377fe640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0538067ae0 0x7f05380cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f0536ffd640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05380adce0 0x7f05380cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f0537fff640 1 -- 172.21.15.81:0/1961205144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05380adce0 msgr2=0x7f05380cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f0537fff640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05380adce0 0x7f05380cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f0537fff640 1 -- 172.21.15.81:0/1961205144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0538067ae0 msgr2=0x7f05380cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f0537fff640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0538067ae0 0x7f05380cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f0537fff640 1 -- 172.21.15.81:0/1961205144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0538146ef0 con 0x7f053815e2e0 2024-09-16T01:16:31.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f0536ffd640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05380adce0 0x7f05380cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:31.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.096+0000 7f0537fff640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053815e2e0 0x7f0538146720 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f053000c7f0 tx=0x7f053000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:31.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.097+0000 7f051ffff640 1 -- 172.21.15.81:0/1961205144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530018070 con 0x7f053815e2e0 2024-09-16T01:16:31.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.097+0000 7f051ffff640 1 -- 172.21.15.81:0/1961205144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053000a5e0 con 0x7f053815e2e0 2024-09-16T01:16:31.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.097+0000 7f053e16d640 1 -- 172.21.15.81:0/1961205144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0538146c60 con 0x7f053815e2e0 2024-09-16T01:16:31.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.097+0000 7f051ffff640 1 -- 172.21.15.81:0/1961205144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053000aa10 con 0x7f053815e2e0 2024-09-16T01:16:31.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.097+0000 7f053e16d640 1 -- 172.21.15.81:0/1961205144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0538147440 con 0x7f053815e2e0 2024-09-16T01:16:31.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.098+0000 7f053e16d640 1 -- 172.21.15.81:0/1961205144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05380b2200 con 0x7f053815e2e0 2024-09-16T01:16:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.098+0000 7f051ffff640 1 -- 172.21.15.81:0/1961205144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f053001b070 con 0x7f053815e2e0 2024-09-16T01:16:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.098+0000 7f051ffff640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f052406c2b0 0x7f052406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.099+0000 7f051ffff640 1 -- 172.21.15.81:0/1961205144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5619+0+0 (secure 0 0 0) 0x7f053008a8d0 con 0x7f053815e2e0 2024-09-16T01:16:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.099+0000 7f05377fe640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f052406c2b0 0x7f052406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:31.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.099+0000 7f05377fe640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f052406c2b0 0x7f052406e770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f05280098e0 tx=0x7f0528009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:31.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.103+0000 7f051ffff640 1 -- 172.21.15.81:0/1961205144 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05380b2200 con 0x7f053815e2e0 2024-09-16T01:16:31.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.270+0000 7f053e16d640 1 -- 172.21.15.81:0/1961205144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f05380b08f0 con 0x7f053815e2e0 2024-09-16T01:16:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.961+0000 7f051ffff640 1 -- 172.21.15.81:0/1961205144 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) ==== 170+0+0 (secure 0 0 0) 0x7f053815f8f0 con 0x7f053815e2e0 2024-09-16T01:16:31.963 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-16T01:16:31.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.963+0000 7f053e16d640 1 -- 172.21.15.81:0/1961205144 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f052406c2b0 msgr2=0x7f052406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:31.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.963+0000 7f053e16d640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f052406c2b0 0x7f052406e770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f05280098e0 tx=0x7f0528009060 comp rx=0 tx=0).stop 2024-09-16T01:16:31.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.963+0000 7f053e16d640 1 -- 172.21.15.81:0/1961205144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053815e2e0 msgr2=0x7f0538146720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:31.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.963+0000 7f053e16d640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053815e2e0 0x7f0538146720 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f053000c7f0 tx=0x7f053000ccb0 comp rx=0 tx=0).stop 2024-09-16T01:16:31.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.964+0000 7f053e16d640 1 -- 172.21.15.81:0/1961205144 shutdown_connections 2024-09-16T01:16:31.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.964+0000 7f053e16d640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f052406c2b0 0x7f052406e770 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:31.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.964+0000 7f053e16d640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f053815e2e0 0x7f0538146720 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:31.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.964+0000 7f053e16d640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f05380adce0 0x7f05380cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:31.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.964+0000 7f053e16d640 1 --2- 172.21.15.81:0/1961205144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0538067ae0 0x7f05380cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:31.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.964+0000 7f053e16d640 1 -- 172.21.15.81:0/1961205144 >> 172.21.15.81:0/1961205144 conn(0x7f0538073590 msgr2=0x7f053815d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:31.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.964+0000 7f053e16d640 1 -- 172.21.15.81:0/1961205144 shutdown_connections 2024-09-16T01:16:31.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:31.964+0000 7f053e16d640 1 -- 172.21.15.81:0/1961205144 wait complete. 2024-09-16T01:16:31.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:16:32.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.098+0000 7fabc35b0640 1 Processor -- start 2024-09-16T01:16:32.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.098+0000 7fabc35b0640 1 -- start start 2024-09-16T01:16:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.099+0000 7fabc35b0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabbc15e7f0 0x7fabbc0b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.099+0000 7fabc35b0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabbc0af210 0x7fabbc070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.099+0000 7fabc35b0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fabbc0b7250 0x7fabbc070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:32.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.099+0000 7fabc35b0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fabbc06cdc0 con 0x7fabbc15e7f0 2024-09-16T01:16:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.099+0000 7fabc35b0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fabbc06d0a0 con 0x7fabbc0b7250 2024-09-16T01:16:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.099+0000 7fabc35b0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fabbc06d380 con 0x7fabbc0af210 2024-09-16T01:16:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.099+0000 7fabc134c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabbc15e7f0 0x7fabbc0b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.099+0000 7fabc134c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabbc15e7f0 0x7fabbc0b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39594/0 (socket says 172.21.15.81:39594) 2024-09-16T01:16:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.099+0000 7fabc134c640 1 -- 172.21.15.81:0/724873309 learned_addr learned my addr 172.21.15.81:0/724873309 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.100+0000 7fabc0b4b640 1 --2- 172.21.15.81:0/724873309 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabbc0af210 0x7fabbc070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.100+0000 7fabc1b4d640 1 --2- 172.21.15.81:0/724873309 >> v2:172.21.15.102:3300/0 conn(0x7fabbc0b7250 0x7fabbc070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.100+0000 7fabc134c640 1 -- 172.21.15.81:0/724873309 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabbc0af210 msgr2=0x7fabbc070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.100+0000 7fabc134c640 1 --2- 172.21.15.81:0/724873309 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabbc0af210 0x7fabbc070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.100+0000 7fabc134c640 1 -- 172.21.15.81:0/724873309 >> v2:172.21.15.102:3300/0 conn(0x7fabbc0b7250 msgr2=0x7fabbc070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.100+0000 7fabc134c640 1 --2- 172.21.15.81:0/724873309 >> v2:172.21.15.102:3300/0 conn(0x7fabbc0b7250 0x7fabbc070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.100+0000 7fabc134c640 1 -- 172.21.15.81:0/724873309 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabbc06d660 con 0x7fabbc15e7f0 2024-09-16T01:16:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.100+0000 7fabc0b4b640 1 --2- 172.21.15.81:0/724873309 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabbc0af210 0x7fabbc070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.100+0000 7fabc1b4d640 1 --2- 172.21.15.81:0/724873309 >> v2:172.21.15.102:3300/0 conn(0x7fabbc0b7250 0x7fabbc070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.100+0000 7fabc134c640 1 --2- 172.21.15.81:0/724873309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabbc15e7f0 0x7fabbc0b6d10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fabbc09bfc0 tx=0x7fabb802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f7a166692d75ce server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.100+0000 7fabb3fff640 1 -- 172.21.15.81:0/724873309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb8037070 con 0x7fabbc15e7f0 2024-09-16T01:16:32.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.101+0000 7fabb3fff640 1 -- 172.21.15.81:0/724873309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb8032440 con 0x7fabbc15e7f0 2024-09-16T01:16:32.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.101+0000 7fabb3fff640 1 -- 172.21.15.81:0/724873309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb8032810 con 0x7fabbc15e7f0 2024-09-16T01:16:32.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.101+0000 7fabc35b0640 1 -- 172.21.15.81:0/724873309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabbc15e7f0 msgr2=0x7fabbc0b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:32.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.101+0000 7fabc35b0640 1 --2- 172.21.15.81:0/724873309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabbc15e7f0 0x7fabbc0b6d10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fabbc09bfc0 tx=0x7fabb802a1e0 comp rx=0 tx=0).stop 2024-09-16T01:16:32.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.101+0000 7fabc35b0640 1 -- 172.21.15.81:0/724873309 shutdown_connections 2024-09-16T01:16:32.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.101+0000 7fabc35b0640 1 --2- 172.21.15.81:0/724873309 >> v2:172.21.15.102:3300/0 conn(0x7fabbc0b7250 0x7fabbc070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:32.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.101+0000 7fabc35b0640 1 --2- 172.21.15.81:0/724873309 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabbc0af210 0x7fabbc070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:32.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.101+0000 7fabc35b0640 1 --2- 172.21.15.81:0/724873309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabbc15e7f0 0x7fabbc0b6d10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:32.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.101+0000 7fabc35b0640 1 -- 172.21.15.81:0/724873309 >> 172.21.15.81:0/724873309 conn(0x7fabbc0b3f30 msgr2=0x7fabbc0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:32.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.101+0000 7fabc35b0640 1 -- 172.21.15.81:0/724873309 shutdown_connections 2024-09-16T01:16:32.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.101+0000 7fabc35b0640 1 -- 172.21.15.81:0/724873309 wait complete. 2024-09-16T01:16:32.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.102+0000 7fabc35b0640 1 Processor -- start 2024-09-16T01:16:32.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.102+0000 7fabc35b0640 1 -- start start 2024-09-16T01:16:32.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc35b0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabbc0af210 0x7fabbc158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:32.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc35b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabbc0b7250 0x7fabbc153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:32.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc35b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabbc15e7f0 0x7fabbc156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:32.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc35b0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fabbc09aa30 con 0x7fabbc0b7250 2024-09-16T01:16:32.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc35b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fabbc0b6150 con 0x7fabbc15e7f0 2024-09-16T01:16:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc35b0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fabbc09abb0 con 0x7fabbc0af210 2024-09-16T01:16:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc0b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabbc0b7250 0x7fabbc153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc0b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabbc0b7250 0x7fabbc153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39606/0 (socket says 172.21.15.81:39606) 2024-09-16T01:16:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc0b4b640 1 -- 172.21.15.81:0/1425699253 learned_addr learned my addr 172.21.15.81:0/1425699253 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc134c640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabbc0af210 0x7fabbc158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:32.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc1b4d640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabbc15e7f0 0x7fabbc156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:32.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc0b4b640 1 -- 172.21.15.81:0/1425699253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabbc0af210 msgr2=0x7fabbc158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:32.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc0b4b640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabbc0af210 0x7fabbc158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:32.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc0b4b640 1 -- 172.21.15.81:0/1425699253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabbc15e7f0 msgr2=0x7fabbc156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:32.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc0b4b640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabbc15e7f0 0x7fabbc156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:32.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.103+0000 7fabc0b4b640 1 -- 172.21.15.81:0/1425699253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabbc0ccc60 con 0x7fabbc0b7250 2024-09-16T01:16:32.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.104+0000 7fabc0b4b640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabbc0b7250 0x7fabbc153b20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c7c0 tx=0x7fabac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:32.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.104+0000 7fabb1ffb640 1 -- 172.21.15.81:0/1425699253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac015070 con 0x7fabbc0b7250 2024-09-16T01:16:32.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.104+0000 7fabb1ffb640 1 -- 172.21.15.81:0/1425699253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabac004220 con 0x7fabbc0b7250 2024-09-16T01:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.104+0000 7fabc35b0640 1 -- 172.21.15.81:0/1425699253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabbc0ccf40 con 0x7fabbc0b7250 2024-09-16T01:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.104+0000 7fabb1ffb640 1 -- 172.21.15.81:0/1425699253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabac003610 con 0x7fabbc0b7250 2024-09-16T01:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.104+0000 7fabc35b0640 1 -- 172.21.15.81:0/1425699253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabbc0cb650 con 0x7fabbc0b7250 2024-09-16T01:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.105+0000 7fabc35b0640 1 -- 172.21.15.81:0/1425699253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabbc0b6d10 con 0x7fabbc0b7250 2024-09-16T01:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.105+0000 7fabb1ffb640 1 -- 172.21.15.81:0/1425699253 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fabac0037b0 con 0x7fabbc0b7250 2024-09-16T01:16:32.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.106+0000 7fabb1ffb640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faba006c2b0 0x7faba006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.106+0000 7fabb1ffb640 1 -- 172.21.15.81:0/1425699253 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6001+0+0 (secure 0 0 0) 0x7fabac08b460 con 0x7fabbc0b7250 2024-09-16T01:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.106+0000 7fabc134c640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faba006c2b0 0x7faba006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.106+0000 7fabc134c640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faba006c2b0 0x7faba006e770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fabb8034000 tx=0x7fabb802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.110+0000 7fabb1ffb640 1 -- 172.21.15.81:0/1425699253 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabac059a10 con 0x7fabbc0b7250 2024-09-16T01:16:32.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.309+0000 7fabc35b0640 1 -- 172.21.15.81:0/1425699253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fabbc0ceaa0 con 0x7fabbc0b7250 2024-09-16T01:16:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.981+0000 7fabb1ffb640 1 -- 172.21.15.81:0/1425699253 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7fabac059310 con 0x7fabbc0b7250 2024-09-16T01:16:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 5 and data pool 6 2024-09-16T01:16:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.992+0000 7fabc35b0640 1 -- 172.21.15.81:0/1425699253 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faba006c2b0 msgr2=0x7faba006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.992+0000 7fabc35b0640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faba006c2b0 0x7faba006e770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fabb8034000 tx=0x7fabb802e000 comp rx=0 tx=0).stop 2024-09-16T01:16:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.992+0000 7fabc35b0640 1 -- 172.21.15.81:0/1425699253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabbc0b7250 msgr2=0x7fabbc153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.992+0000 7fabc35b0640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabbc0b7250 0x7fabbc153b20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fabac00c7c0 tx=0x7fabac00cc80 comp rx=0 tx=0).stop 2024-09-16T01:16:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.995+0000 7fabc35b0640 1 -- 172.21.15.81:0/1425699253 shutdown_connections 2024-09-16T01:16:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.995+0000 7fabc35b0640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faba006c2b0 0x7faba006e770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.995+0000 7fabc35b0640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabbc15e7f0 0x7fabbc156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.995+0000 7fabc35b0640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabbc0b7250 0x7fabbc153b20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.995+0000 7fabc35b0640 1 --2- 172.21.15.81:0/1425699253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabbc0af210 0x7fabbc158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.995+0000 7fabc35b0640 1 -- 172.21.15.81:0/1425699253 >> 172.21.15.81:0/1425699253 conn(0x7fabbc0b3f30 msgr2=0x7fabbc160f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.996+0000 7fabc35b0640 1 -- 172.21.15.81:0/1425699253 shutdown_connections 2024-09-16T01:16:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:32.996+0000 7fabc35b0640 1 -- 172.21.15.81:0/1425699253 wait complete. 2024-09-16T01:16:33.014 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:16:33.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.116+0000 7fde70f66640 1 Processor -- start 2024-09-16T01:16:33.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.116+0000 7fde70f66640 1 -- start start 2024-09-16T01:16:33.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde70f66640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fde6c0afd70 0x7fde6c160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde70f66640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde6c0ce660 0x7fde6c0b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde70f66640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde6c160d60 con 0x7fde6c0b5f80 2024-09-16T01:16:33.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde70f66640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fde6c0b6910 con 0x7fde6c0afd70 2024-09-16T01:16:33.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde70f66640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fde6c06fdb0 con 0x7fde6c0ce660 2024-09-16T01:16:33.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde6a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fde6c0afd70 0x7fde6c160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde63fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fde6c0b5f80 0x7fde6c06e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38574/0 (socket says 172.21.15.81:38574) 2024-09-16T01:16:33.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde6a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fde6c0afd70 0x7fde6c160820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39608/0 (socket says 172.21.15.81:39608) 2024-09-16T01:16:33.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde63fff640 1 -- 172.21.15.81:0/1746884136 learned_addr learned my addr 172.21.15.81:0/1746884136 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:33.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde6a59c640 1 -- 172.21.15.81:0/1746884136 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde6c0ce660 msgr2=0x7fde6c0b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:33.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde6a59c640 1 --2- 172.21.15.81:0/1746884136 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde6c0ce660 0x7fde6c0b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde6a59c640 1 -- 172.21.15.81:0/1746884136 >> v1:172.21.15.81:6789/0 conn(0x7fde6c0b5f80 legacy=0x7fde6c06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde6a59c640 1 -- 172.21.15.81:0/1746884136 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6c070090 con 0x7fde6c0afd70 2024-09-16T01:16:33.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.117+0000 7fde69d9b640 1 -- 172.21.15.81:0/1746884136 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2381192672 0 0) 0x7fde54001110 con 0x7fde6c0b5f80 2024-09-16T01:16:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.118+0000 7fde6a59c640 1 --2- 172.21.15.81:0/1746884136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde6c0afd70 0x7fde6c160820 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0097a0 tx=0x7fde5c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6af1ae86977be6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.118+0000 7fde69d9b640 1 -- 172.21.15.81:0/1746884136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c037070 con 0x7fde6c0afd70 2024-09-16T01:16:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.118+0000 7fde69d9b640 1 -- 172.21.15.81:0/1746884136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde5c032440 con 0x7fde6c0afd70 2024-09-16T01:16:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.118+0000 7fde69d9b640 1 -- 172.21.15.81:0/1746884136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c032810 con 0x7fde6c0afd70 2024-09-16T01:16:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.119+0000 7fde70f66640 1 -- 172.21.15.81:0/1746884136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde6c0afd70 msgr2=0x7fde6c160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.119+0000 7fde70f66640 1 --2- 172.21.15.81:0/1746884136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde6c0afd70 0x7fde6c160820 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0097a0 tx=0x7fde5c02a180 comp rx=0 tx=0).stop 2024-09-16T01:16:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.119+0000 7fde70f66640 1 -- 172.21.15.81:0/1746884136 shutdown_connections 2024-09-16T01:16:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.119+0000 7fde70f66640 1 --2- 172.21.15.81:0/1746884136 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde6c0ce660 0x7fde6c0b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.119+0000 7fde70f66640 1 --2- 172.21.15.81:0/1746884136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde6c0afd70 0x7fde6c160820 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.119+0000 7fde70f66640 1 -- 172.21.15.81:0/1746884136 >> 172.21.15.81:0/1746884136 conn(0x7fde6c06bc10 msgr2=0x7fde6c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.119+0000 7fde70f66640 1 -- 172.21.15.81:0/1746884136 shutdown_connections 2024-09-16T01:16:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.119+0000 7fde70f66640 1 -- 172.21.15.81:0/1746884136 wait complete. 2024-09-16T01:16:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.120+0000 7fde70f66640 1 Processor -- start 2024-09-16T01:16:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.120+0000 7fde70f66640 1 -- start start 2024-09-16T01:16:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde70f66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde6c0afd70 0x7fde6c158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde70f66640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde6c0b5f80 0x7fde6c14f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde70f66640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde6c0ce660 0x7fde6c15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde70f66640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c06fa80 con 0x7fde6c0afd70 2024-09-16T01:16:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde70f66640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c070650 con 0x7fde6c0ce660 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde70f66640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fde6c0b0150 con 0x7fde6c0b5f80 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde6a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde6c0afd70 0x7fde6c158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde6a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde6c0afd70 0x7fde6c158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39624/0 (socket says 172.21.15.81:39624) 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde6a59c640 1 -- 172.21.15.81:0/3953942032 learned_addr learned my addr 172.21.15.81:0/3953942032 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde63fff640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde6c0b5f80 0x7fde6c14f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde6ad9d640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde6c0ce660 0x7fde6c15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde6a59c640 1 -- 172.21.15.81:0/3953942032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde6c0b5f80 msgr2=0x7fde6c14f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde6a59c640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde6c0b5f80 0x7fde6c14f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde6a59c640 1 -- 172.21.15.81:0/3953942032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde6c0ce660 msgr2=0x7fde6c15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde6a59c640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde6c0ce660 0x7fde6c15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde6a59c640 1 -- 172.21.15.81:0/3953942032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6c14fdb0 con 0x7fde6c0afd70 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde63fff640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde6c0b5f80 0x7fde6c14f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde6ad9d640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde6c0ce660 0x7fde6c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.121+0000 7fde6a59c640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde6c0afd70 0x7fde6c158c30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0097a0 tx=0x7fde5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.122+0000 7fde62ffd640 1 -- 172.21.15.81:0/3953942032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c041070 con 0x7fde6c0afd70 2024-09-16T01:16:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.122+0000 7fde62ffd640 1 -- 172.21.15.81:0/3953942032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde5c03c870 con 0x7fde6c0afd70 2024-09-16T01:16:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.122+0000 7fde70f66640 1 -- 172.21.15.81:0/3953942032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde6c1578f0 con 0x7fde6c0afd70 2024-09-16T01:16:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.122+0000 7fde62ffd640 1 -- 172.21.15.81:0/3953942032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c037040 con 0x7fde6c0afd70 2024-09-16T01:16:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.122+0000 7fde70f66640 1 -- 172.21.15.81:0/3953942032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde6c158150 con 0x7fde6c0afd70 2024-09-16T01:16:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.123+0000 7fde70f66640 1 -- 172.21.15.81:0/3953942032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde6c160060 con 0x7fde6c0afd70 2024-09-16T01:16:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.123+0000 7fde62ffd640 1 -- 172.21.15.81:0/3953942032 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fde5c044070 con 0x7fde6c0afd70 2024-09-16T01:16:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.124+0000 7fde62ffd640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fde4c06c2b0 0x7fde4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.124+0000 7fde62ffd640 1 -- 172.21.15.81:0/3953942032 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fde5c0ac1a0 con 0x7fde6c0afd70 2024-09-16T01:16:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.124+0000 7fde63fff640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fde4c06c2b0 0x7fde4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.124+0000 7fde63fff640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fde4c06c2b0 0x7fde4c06e770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fde540013b0 tx=0x7fde54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.128+0000 7fde62ffd640 1 -- 172.21.15.81:0/3953942032 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde5c07a930 con 0x7fde6c0afd70 2024-09-16T01:16:33.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.294+0000 7fde70f66640 1 -- 172.21.15.81:0/3953942032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde6c067fc0 con 0x7fde6c0afd70 2024-09-16T01:16:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.295+0000 7fde62ffd640 1 -- 172.21.15.81:0/3953942032 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+17015 (secure 0 0 0) 0x7fde5c07a230 con 0x7fde6c0afd70 2024-09-16T01:16:33.298 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:33.298 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:16:32.311625+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:16:29.974908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-16T01:16:31.289690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:16:33.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.297+0000 7fde70f66640 1 -- 172.21.15.81:0/3953942032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fde4c06c2b0 msgr2=0x7fde4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.297+0000 7fde70f66640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fde4c06c2b0 0x7fde4c06e770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fde540013b0 tx=0x7fde54009040 comp rx=0 tx=0).stop 2024-09-16T01:16:33.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.297+0000 7fde70f66640 1 -- 172.21.15.81:0/3953942032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde6c0afd70 msgr2=0x7fde6c158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.297+0000 7fde70f66640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde6c0afd70 0x7fde6c158c30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0097a0 tx=0x7fde5c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.297+0000 7fde70f66640 1 -- 172.21.15.81:0/3953942032 shutdown_connections 2024-09-16T01:16:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.297+0000 7fde70f66640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fde4c06c2b0 0x7fde4c06e770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.297+0000 7fde70f66640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde6c0ce660 0x7fde6c15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.297+0000 7fde70f66640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde6c0b5f80 0x7fde6c14f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.297+0000 7fde70f66640 1 --2- 172.21.15.81:0/3953942032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde6c0afd70 0x7fde6c158c30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.298+0000 7fde70f66640 1 -- 172.21.15.81:0/3953942032 >> 172.21.15.81:0/3953942032 conn(0x7fde6c06bc10 msgr2=0x7fde6c0b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.298+0000 7fde70f66640 1 -- 172.21.15.81:0/3953942032 shutdown_connections 2024-09-16T01:16:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.298+0000 7fde70f66640 1 -- 172.21.15.81:0/3953942032 wait complete. 2024-09-16T01:16:33.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:16:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.408+0000 7f7d17a1e640 1 Processor -- start 2024-09-16T01:16:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.408+0000 7f7d17a1e640 1 -- start start 2024-09-16T01:16:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d17a1e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d100afd60 0x7f7d100726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d17a1e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d100b44c0 con 0x7f7d100b3e60 2024-09-16T01:16:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d17a1e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d1015ead0 con 0x7f7d10072bf0 2024-09-16T01:16:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d17a1e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7d100b0140 con 0x7f7d100afd60 2024-09-16T01:16:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d15fbb640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7d100b3e60 0x7f7d1006f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38586/0 (socket says 172.21.15.81:38586) 2024-09-16T01:16:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d15fbb640 1 -- 172.21.15.81:0/557271431 learned_addr learned my addr 172.21.15.81:0/557271431 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d157ba640 1 --2- 172.21.15.81:0/557271431 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d100afd60 0x7f7d100726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152048492 0 0) 0x7f7d100b44c0 con 0x7f7d100b3e60 2024-09-16T01:16:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cfc003520 con 0x7f7d100b3e60 2024-09-16T01:16:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2630285419 0 0) 0x7f7cfc003520 con 0x7f7d100b3e60 2024-09-16T01:16:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d100afd60 msgr2=0x7f7d100726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 --2- 172.21.15.81:0/557271431 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d100afd60 0x7f7d100726b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 >> v1:172.21.15.102:6789/0 conn(0x7f7d10072bf0 legacy=0x7f7d100b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1015edb0 con 0x7f7d100b3e60 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f7d080019f0 con 0x7f7d100b3e60 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 >> v1:172.21.15.81:6789/0 conn(0x7f7d100b3e60 legacy=0x7f7d1006f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 --2- 172.21.15.81:0/557271431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cfc0039e0 0x7f7cfc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 --2- 172.21.15.81:0/557271431 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d100afd60 0x7f7cfc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 --2- 172.21.15.81:0/557271431 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc004d40 0x7f7cfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d100b0140 con 0x7f7cfc0039e0 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7cfc00ba70 con 0x7f7cfc004d40 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7cfc00bc70 con 0x7f7d100afd60 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.409+0000 7f7d157ba640 1 --2- 172.21.15.81:0/557271431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cfc0039e0 0x7f7cfc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.410+0000 7f7d14fb9640 1 --2- 172.21.15.81:0/557271431 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d100afd60 0x7f7cfc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.410+0000 7f7d15fbb640 1 --2- 172.21.15.81:0/557271431 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc004d40 0x7f7cfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.410+0000 7f7d157ba640 1 -- 172.21.15.81:0/557271431 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d100afd60 msgr2=0x7f7cfc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.410+0000 7f7d157ba640 1 --2- 172.21.15.81:0/557271431 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7d100afd60 0x7f7cfc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.410+0000 7f7d157ba640 1 -- 172.21.15.81:0/557271431 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc004d40 msgr2=0x7f7cfc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.410+0000 7f7d157ba640 1 --2- 172.21.15.81:0/557271431 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cfc004d40 0x7f7cfc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.410+0000 7f7d157ba640 1 -- 172.21.15.81:0/557271431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cfc003520 con 0x7f7cfc0039e0 2024-09-16T01:16:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.410+0000 7f7d157ba640 1 --2- 172.21.15.81:0/557271431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cfc0039e0 0x7f7cfc003e00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009a90 tx=0x7f7cfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fc306c2fadf195 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.410+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04036070 con 0x7f7cfc0039e0 2024-09-16T01:16:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.411+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d04031400 con 0x7f7cfc0039e0 2024-09-16T01:16:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.411+0000 7f7d03fff640 1 -- 172.21.15.81:0/557271431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04009690 con 0x7f7cfc0039e0 2024-09-16T01:16:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.411+0000 7f7d17a1e640 1 -- 172.21.15.81:0/557271431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cfc0039e0 msgr2=0x7f7cfc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.411+0000 7f7d17a1e640 1 --2- 172.21.15.81:0/557271431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cfc0039e0 0x7f7cfc003e00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009a90 tx=0x7f7cfc005830 comp rx=0 tx=0).stop 2024-09-16T01:16:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.411+0000 7f7d15fbb640 1 -- 172.21.15.81:0/557271431 reap_dead start 2024-09-16T01:16:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.411+0000 7f7d17a1e640 1 -- 172.21.15.81:0/557271431 shutdown_connections 2024-09-16T01:16:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.411+0000 7f7d17a1e640 1 -- 172.21.15.81:0/557271431 >> 172.21.15.81:0/557271431 conn(0x7f7d1006c030 msgr2=0x7f7d1006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.411+0000 7f7d17a1e640 1 -- 172.21.15.81:0/557271431 shutdown_connections 2024-09-16T01:16:33.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.411+0000 7f7d17a1e640 1 -- 172.21.15.81:0/557271431 wait complete. 2024-09-16T01:16:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.412+0000 7f7d17a1e640 1 Processor -- start 2024-09-16T01:16:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.412+0000 7f7d17a1e640 1 -- start start 2024-09-16T01:16:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d17a1e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cfc0039e0 0x7f7d101562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d17a1e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d101574b0 0x7f7d101547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d17a1e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d10143a20 0x7f7d10143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d17a1e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1015f370 con 0x7f7d10143a20 2024-09-16T01:16:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d17a1e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7d10073030 con 0x7f7d101574b0 2024-09-16T01:16:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d17a1e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1015f890 con 0x7f7cfc0039e0 2024-09-16T01:16:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d15fbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d10143a20 0x7f7d10143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d15fbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d10143a20 0x7f7d10143ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39638/0 (socket says 172.21.15.81:39638) 2024-09-16T01:16:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d15fbb640 1 -- 172.21.15.81:0/976941656 learned_addr learned my addr 172.21.15.81:0/976941656 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d14fb9640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d101574b0 0x7f7d101547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d157ba640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cfc0039e0 0x7f7d101562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d15fbb640 1 -- 172.21.15.81:0/976941656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cfc0039e0 msgr2=0x7f7d101562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d15fbb640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cfc0039e0 0x7f7d101562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d15fbb640 1 -- 172.21.15.81:0/976941656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d101574b0 msgr2=0x7f7d101547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d15fbb640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d101574b0 0x7f7d101547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.413+0000 7f7d15fbb640 1 -- 172.21.15.81:0/976941656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d10157940 con 0x7f7d10143a20 2024-09-16T01:16:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.414+0000 7f7d15fbb640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d10143a20 0x7f7d10143ed0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7d100b4240 tx=0x7f7d0800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.414+0000 7f7d01ffb640 1 -- 172.21.15.81:0/976941656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800ebb0 con 0x7f7d10143a20 2024-09-16T01:16:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.414+0000 7f7d01ffb640 1 -- 172.21.15.81:0/976941656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d08018070 con 0x7f7d10143a20 2024-09-16T01:16:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.414+0000 7f7d17a1e640 1 -- 172.21.15.81:0/976941656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d10157c20 con 0x7f7d10143a20 2024-09-16T01:16:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.414+0000 7f7d01ffb640 1 -- 172.21.15.81:0/976941656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d08013420 con 0x7f7d10143a20 2024-09-16T01:16:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.414+0000 7f7d17a1e640 1 -- 172.21.15.81:0/976941656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d101581e0 con 0x7f7d10143a20 2024-09-16T01:16:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.415+0000 7f7d17a1e640 1 -- 172.21.15.81:0/976941656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d100726b0 con 0x7f7d10143a20 2024-09-16T01:16:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.415+0000 7f7d01ffb640 1 -- 172.21.15.81:0/976941656 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7d080135c0 con 0x7f7d10143a20 2024-09-16T01:16:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.416+0000 7f7d01ffb640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7cf406c2b0 0x7f7cf406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.416+0000 7f7d01ffb640 1 -- 172.21.15.81:0/976941656 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f7d0808b8d0 con 0x7f7d10143a20 2024-09-16T01:16:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.416+0000 7f7d157ba640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7cf406c2b0 0x7f7cf406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.416+0000 7f7d157ba640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7cf406c2b0 0x7f7cf406e770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7d04033000 tx=0x7f7d04008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.420+0000 7f7d01ffb640 1 -- 172.21.15.81:0/976941656 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d080597d0 con 0x7f7d10143a20 2024-09-16T01:16:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.585+0000 7f7d17a1e640 1 -- 172.21.15.81:0/976941656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d100b4ee0 con 0x7f7d10143a20 2024-09-16T01:16:33.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.586+0000 7f7d01ffb640 1 -- 172.21.15.81:0/976941656 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+17015 (secure 0 0 0) 0x7f7d0805dad0 con 0x7f7d10143a20 2024-09-16T01:16:33.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:33.588 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:16:32.311625+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:16:29.974908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-16T01:16:31.289690+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:16:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.588+0000 7f7d17a1e640 1 -- 172.21.15.81:0/976941656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7cf406c2b0 msgr2=0x7f7cf406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.588+0000 7f7d17a1e640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7cf406c2b0 0x7f7cf406e770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7d04033000 tx=0x7f7d04008030 comp rx=0 tx=0).stop 2024-09-16T01:16:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.588+0000 7f7d17a1e640 1 -- 172.21.15.81:0/976941656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d10143a20 msgr2=0x7f7d10143ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.588+0000 7f7d17a1e640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d10143a20 0x7f7d10143ed0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7d100b4240 tx=0x7f7d0800e530 comp rx=0 tx=0).stop 2024-09-16T01:16:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.588+0000 7f7d17a1e640 1 -- 172.21.15.81:0/976941656 shutdown_connections 2024-09-16T01:16:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.588+0000 7f7d17a1e640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7cf406c2b0 0x7f7cf406e770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.588+0000 7f7d17a1e640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d10143a20 0x7f7d10143ed0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.588+0000 7f7d17a1e640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d101574b0 0x7f7d101547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.588+0000 7f7d17a1e640 1 --2- 172.21.15.81:0/976941656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cfc0039e0 0x7f7d101562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.588+0000 7f7d17a1e640 1 -- 172.21.15.81:0/976941656 >> 172.21.15.81:0/976941656 conn(0x7f7d1006c030 msgr2=0x7f7d100b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.588+0000 7f7d17a1e640 1 -- 172.21.15.81:0/976941656 shutdown_connections 2024-09-16T01:16:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.588+0000 7f7d17a1e640 1 -- 172.21.15.81:0/976941656 wait complete. 2024-09-16T01:16:33.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:16:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.700+0000 7f9e58fa6640 1 Processor -- start 2024-09-16T01:16:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.701+0000 7f9e58fa6640 1 -- start start 2024-09-16T01:16:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.701+0000 7f9e58fa6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e5415c490 0x7f9e5409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.701+0000 7f9e58fa6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e54071100 0x7f9e54071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.701+0000 7f9e58fa6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e54072180 con 0x7f9e5409af70 2024-09-16T01:16:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.701+0000 7f9e58fa6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9e5409b3b0 con 0x7f9e5415c490 2024-09-16T01:16:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.701+0000 7f9e58fa6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5415c870 con 0x7f9e54071100 2024-09-16T01:16:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.702+0000 7f9e5259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e5415c490 0x7f9e5409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.702+0000 7f9e5259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e5415c490 0x7f9e5409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39642/0 (socket says 172.21.15.81:39642) 2024-09-16T01:16:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.702+0000 7f9e5259c640 1 -- 172.21.15.81:0/2123893099 learned_addr learned my addr 172.21.15.81:0/2123893099 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.702+0000 7f9e52d9d640 1 --2- 172.21.15.81:0/2123893099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e54071100 0x7f9e54071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.702+0000 7f9e5259c640 1 -- 172.21.15.81:0/2123893099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e54071100 msgr2=0x7f9e54071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.702+0000 7f9e5259c640 1 --2- 172.21.15.81:0/2123893099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e54071100 0x7f9e54071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.702+0000 7f9e5259c640 1 -- 172.21.15.81:0/2123893099 >> v1:172.21.15.102:6789/0 conn(0x7f9e5409af70 legacy=0x7f9e540b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.702+0000 7f9e5259c640 1 -- 172.21.15.81:0/2123893099 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e54071bc0 con 0x7f9e5415c490 2024-09-16T01:16:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.703+0000 7f9e5259c640 1 --2- 172.21.15.81:0/2123893099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e5415c490 0x7f9e5409aa30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009870 tx=0x7f9e4c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1219ceb4722c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.703+0000 7f9e5159a640 1 -- 172.21.15.81:0/2123893099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c037070 con 0x7f9e5415c490 2024-09-16T01:16:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.703+0000 7f9e5159a640 1 -- 172.21.15.81:0/2123893099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e4c032440 con 0x7f9e5415c490 2024-09-16T01:16:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.703+0000 7f9e5159a640 1 -- 172.21.15.81:0/2123893099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c032810 con 0x7f9e5415c490 2024-09-16T01:16:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.703+0000 7f9e58fa6640 1 -- 172.21.15.81:0/2123893099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e5415c490 msgr2=0x7f9e5409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.703+0000 7f9e58fa6640 1 --2- 172.21.15.81:0/2123893099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e5415c490 0x7f9e5409aa30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009870 tx=0x7f9e4c02a210 comp rx=0 tx=0).stop 2024-09-16T01:16:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.703+0000 7f9e58fa6640 1 -- 172.21.15.81:0/2123893099 shutdown_connections 2024-09-16T01:16:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.703+0000 7f9e58fa6640 1 --2- 172.21.15.81:0/2123893099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e54071100 0x7f9e54071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.703+0000 7f9e58fa6640 1 --2- 172.21.15.81:0/2123893099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e5415c490 0x7f9e5409aa30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.703+0000 7f9e58fa6640 1 -- 172.21.15.81:0/2123893099 >> 172.21.15.81:0/2123893099 conn(0x7f9e540b3f30 msgr2=0x7f9e540b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.703+0000 7f9e58fa6640 1 -- 172.21.15.81:0/2123893099 shutdown_connections 2024-09-16T01:16:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.703+0000 7f9e58fa6640 1 -- 172.21.15.81:0/2123893099 wait complete. 2024-09-16T01:16:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.705+0000 7f9e58fa6640 1 Processor -- start 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.705+0000 7f9e58fa6640 1 -- start start 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.705+0000 7f9e58fa6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e54071100 0x7f9e54145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.705+0000 7f9e58fa6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e5409af70 0x7f9e541583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.705+0000 7f9e58fa6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e5415c490 0x7f9e541588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.705+0000 7f9e58fa6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e540affa0 con 0x7f9e5415c490 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.705+0000 7f9e58fa6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e540afcc0 con 0x7f9e54071100 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.705+0000 7f9e58fa6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5409b8f0 con 0x7f9e5409af70 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e52d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e5415c490 0x7f9e541588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e52d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e5415c490 0x7f9e541588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39654/0 (socket says 172.21.15.81:39654) 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e52d9d640 1 -- 172.21.15.81:0/3911962265 learned_addr learned my addr 172.21.15.81:0/3911962265 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e5259c640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e54071100 0x7f9e54145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e51d9b640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e5409af70 0x7f9e541583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e52d9d640 1 -- 172.21.15.81:0/3911962265 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e5409af70 msgr2=0x7f9e541583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e52d9d640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e5409af70 0x7f9e541583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e52d9d640 1 -- 172.21.15.81:0/3911962265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e54071100 msgr2=0x7f9e54145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e52d9d640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e54071100 0x7f9e54145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e52d9d640 1 -- 172.21.15.81:0/3911962265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e541e6f50 con 0x7f9e5415c490 2024-09-16T01:16:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e5259c640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e54071100 0x7f9e54145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e52d9d640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e5415c490 0x7f9e541588e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400cc30 tx=0x7f9e4400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e4affd640 1 -- 172.21.15.81:0/3911962265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4400ce40 con 0x7f9e5415c490 2024-09-16T01:16:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e4affd640 1 -- 172.21.15.81:0/3911962265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e44003990 con 0x7f9e5415c490 2024-09-16T01:16:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e58fa6640 1 -- 172.21.15.81:0/3911962265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e541e7230 con 0x7f9e5415c490 2024-09-16T01:16:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e4affd640 1 -- 172.21.15.81:0/3911962265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44003d40 con 0x7f9e5415c490 2024-09-16T01:16:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.706+0000 7f9e58fa6640 1 -- 172.21.15.81:0/3911962265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5406cdc0 con 0x7f9e5415c490 2024-09-16T01:16:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.707+0000 7f9e58fa6640 1 -- 172.21.15.81:0/3911962265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e54071570 con 0x7f9e5415c490 2024-09-16T01:16:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.708+0000 7f9e4affd640 1 -- 172.21.15.81:0/3911962265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9e44003ee0 con 0x7f9e5415c490 2024-09-16T01:16:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.708+0000 7f9e4affd640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e3406c2e0 0x7f9e3406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.708+0000 7f9e4affd640 1 -- 172.21.15.81:0/3911962265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f9e4408b9d0 con 0x7f9e5415c490 2024-09-16T01:16:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.708+0000 7f9e5259c640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e3406c2e0 0x7f9e3406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.709+0000 7f9e5259c640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e3406c2e0 0x7f9e3406e7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c034000 tx=0x7f9e4c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.712+0000 7f9e4affd640 1 -- 172.21.15.81:0/3911962265 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e44014030 con 0x7f9e5415c490 2024-09-16T01:16:33.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.916+0000 7f9e58fa6640 1 -- 172.21.15.81:0/3911962265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9e540b6910 con 0x7f9e5415c490 2024-09-16T01:16:33.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.982+0000 7f9e4affd640 1 -- 172.21.15.81:0/3911962265 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f9e4405a040 con 0x7f9e5415c490 2024-09-16T01:16:33.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.984+0000 7f9e58fa6640 1 -- 172.21.15.81:0/3911962265 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e3406c2e0 msgr2=0x7f9e3406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.984+0000 7f9e58fa6640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e3406c2e0 0x7f9e3406e7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c034000 tx=0x7f9e4c02e000 comp rx=0 tx=0).stop 2024-09-16T01:16:33.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.984+0000 7f9e58fa6640 1 -- 172.21.15.81:0/3911962265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e5415c490 msgr2=0x7f9e541588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:33.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.984+0000 7f9e58fa6640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e5415c490 0x7f9e541588e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400cc30 tx=0x7f9e4400a5c0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.984+0000 7f9e58fa6640 1 -- 172.21.15.81:0/3911962265 shutdown_connections 2024-09-16T01:16:33.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.984+0000 7f9e58fa6640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e3406c2e0 0x7f9e3406e7a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.984+0000 7f9e58fa6640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e5415c490 0x7f9e541588e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.984+0000 7f9e58fa6640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e5409af70 0x7f9e541583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.984+0000 7f9e58fa6640 1 --2- 172.21.15.81:0/3911962265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e54071100 0x7f9e54145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:33.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.984+0000 7f9e58fa6640 1 -- 172.21.15.81:0/3911962265 >> 172.21.15.81:0/3911962265 conn(0x7f9e540b3f30 msgr2=0x7f9e540b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:33.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.985+0000 7f9e58fa6640 1 -- 172.21.15.81:0/3911962265 shutdown_connections 2024-09-16T01:16:33.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:33.985+0000 7f9e58fa6640 1 -- 172.21.15.81:0/3911962265 wait complete. 2024-09-16T01:16:33.998 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T01:16:33.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:16:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.099+0000 7f0b65da2640 1 Processor -- start 2024-09-16T01:16:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.099+0000 7f0b65da2640 1 -- start start 2024-09-16T01:16:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.100+0000 7f0b65da2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0b60161ac0 0x7f0b6006e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.100+0000 7f0b65da2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b600d2ac0 0x7f0b600b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.100+0000 7f0b65da2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b600b1170 con 0x7f0b600b3640 2024-09-16T01:16:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.100+0000 7f0b65da2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0b600ceba0 con 0x7f0b600d2ac0 2024-09-16T01:16:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.100+0000 7f0b65da2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0b6006dfb0 con 0x7f0b60161ac0 2024-09-16T01:16:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.100+0000 7f0b655a1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b600d2ac0 0x7f0b600b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.100+0000 7f0b655a1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b600d2ac0 0x7f0b600b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39664/0 (socket says 172.21.15.81:39664) 2024-09-16T01:16:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.100+0000 7f0b655a1640 1 -- 172.21.15.81:0/3654059697 learned_addr learned my addr 172.21.15.81:0/3654059697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.100+0000 7f0b64da0640 1 --2- 172.21.15.81:0/3654059697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0b60161ac0 0x7f0b6006e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.101+0000 7f0b655a1640 1 -- 172.21.15.81:0/3654059697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0b60161ac0 msgr2=0x7f0b6006e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.101+0000 7f0b655a1640 1 --2- 172.21.15.81:0/3654059697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0b60161ac0 0x7f0b6006e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.101+0000 7f0b655a1640 1 -- 172.21.15.81:0/3654059697 >> v1:172.21.15.102:6789/0 conn(0x7f0b600b3640 legacy=0x7f0b600d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.101+0000 7f0b655a1640 1 -- 172.21.15.81:0/3654059697 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b600b1450 con 0x7f0b600d2ac0 2024-09-16T01:16:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.101+0000 7f0b655a1640 1 --2- 172.21.15.81:0/3654059697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b600d2ac0 0x7f0b600b1f30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009e80 tx=0x7f0b5802a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac9c48abde6b0c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.101+0000 7f0b577fe640 1 -- 172.21.15.81:0/3654059697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b58036070 con 0x7f0b600d2ac0 2024-09-16T01:16:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.101+0000 7f0b577fe640 1 -- 172.21.15.81:0/3654059697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b58031600 con 0x7f0b600d2ac0 2024-09-16T01:16:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.101+0000 7f0b577fe640 1 -- 172.21.15.81:0/3654059697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b580319d0 con 0x7f0b600d2ac0 2024-09-16T01:16:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.102+0000 7f0b65da2640 1 -- 172.21.15.81:0/3654059697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b600d2ac0 msgr2=0x7f0b600b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.102+0000 7f0b65da2640 1 --2- 172.21.15.81:0/3654059697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b600d2ac0 0x7f0b600b1f30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009e80 tx=0x7f0b5802a7e0 comp rx=0 tx=0).stop 2024-09-16T01:16:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.102+0000 7f0b65da2640 1 -- 172.21.15.81:0/3654059697 shutdown_connections 2024-09-16T01:16:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.102+0000 7f0b65da2640 1 --2- 172.21.15.81:0/3654059697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b600d2ac0 0x7f0b600b1f30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.102+0000 7f0b65da2640 1 --2- 172.21.15.81:0/3654059697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0b60161ac0 0x7f0b6006e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.102+0000 7f0b65da2640 1 -- 172.21.15.81:0/3654059697 >> 172.21.15.81:0/3654059697 conn(0x7f0b6008bfc0 msgr2=0x7f0b600d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:34.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.102+0000 7f0b65da2640 1 -- 172.21.15.81:0/3654059697 shutdown_connections 2024-09-16T01:16:34.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.102+0000 7f0b65da2640 1 -- 172.21.15.81:0/3654059697 wait complete. 2024-09-16T01:16:34.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.103+0000 7f0b65da2640 1 Processor -- start 2024-09-16T01:16:34.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.103+0000 7f0b65da2640 1 -- start start 2024-09-16T01:16:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b65da2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0b600b3640 0x7f0b601e7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b65da2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b600d2ac0 0x7f0b60157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b65da2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b60161ac0 0x7f0b60157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b65da2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b60161ea0 con 0x7f0b600d2ac0 2024-09-16T01:16:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b65da2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0b600b1a10 con 0x7f0b60161ac0 2024-09-16T01:16:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b65da2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0b60162020 con 0x7f0b600b3640 2024-09-16T01:16:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b600d2ac0 0x7f0b60157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b600d2ac0 0x7f0b60157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39680/0 (socket says 172.21.15.81:39680) 2024-09-16T01:16:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b57fff640 1 -- 172.21.15.81:0/2968538030 learned_addr learned my addr 172.21.15.81:0/2968538030 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b64da0640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0b600b3640 0x7f0b601e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b655a1640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b60161ac0 0x7f0b60157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b57fff640 1 -- 172.21.15.81:0/2968538030 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0b600b3640 msgr2=0x7f0b601e7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b57fff640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0b600b3640 0x7f0b601e7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b57fff640 1 -- 172.21.15.81:0/2968538030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b60161ac0 msgr2=0x7f0b60157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b57fff640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b60161ac0 0x7f0b60157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.104+0000 7f0b57fff640 1 -- 172.21.15.81:0/2968538030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b600ca2e0 con 0x7f0b600d2ac0 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.105+0000 7f0b57fff640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b600d2ac0 0x7f0b60157130 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000c400 tx=0x7f0b5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.105+0000 7f0b557fa640 1 -- 172.21.15.81:0/2968538030 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50017070 con 0x7f0b600d2ac0 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.105+0000 7f0b557fa640 1 -- 172.21.15.81:0/2968538030 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b500052d0 con 0x7f0b600d2ac0 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.105+0000 7f0b557fa640 1 -- 172.21.15.81:0/2968538030 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50003830 con 0x7f0b600d2ac0 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.105+0000 7f0b65da2640 1 -- 172.21.15.81:0/2968538030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b600ca5c0 con 0x7f0b600d2ac0 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.105+0000 7f0b65da2640 1 -- 172.21.15.81:0/2968538030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b600b41d0 con 0x7f0b600d2ac0 2024-09-16T01:16:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.106+0000 7f0b65da2640 1 -- 172.21.15.81:0/2968538030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b600b43d0 con 0x7f0b600d2ac0 2024-09-16T01:16:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.106+0000 7f0b557fa640 1 -- 172.21.15.81:0/2968538030 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0b5001a070 con 0x7f0b600d2ac0 2024-09-16T01:16:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.107+0000 7f0b557fa640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0b4c06c2b0 0x7f0b4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.107+0000 7f0b64da0640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0b4c06c2b0 0x7f0b4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.107+0000 7f0b557fa640 1 -- 172.21.15.81:0/2968538030 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f0b5008a880 con 0x7f0b600d2ac0 2024-09-16T01:16:34.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.107+0000 7f0b64da0640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0b4c06c2b0 0x7f0b4c06e770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0079a0 tx=0x7f0b5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:34.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.111+0000 7f0b557fa640 1 -- 172.21.15.81:0/2968538030 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b600b43d0 con 0x7f0b600d2ac0 2024-09-16T01:16:34.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.311+0000 7f0b65da2640 1 -- 172.21.15.81:0/2968538030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0b6006e6c0 con 0x7f0b600d2ac0 2024-09-16T01:16:34.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.993+0000 7f0b557fa640 1 -- 172.21.15.81:0/2968538030 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f0b500588a0 con 0x7f0b600d2ac0 2024-09-16T01:16:34.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.995+0000 7f0b65da2640 1 -- 172.21.15.81:0/2968538030 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0b4c06c2b0 msgr2=0x7f0b4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:34.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.995+0000 7f0b65da2640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0b4c06c2b0 0x7f0b4c06e770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0079a0 tx=0x7f0b5c008040 comp rx=0 tx=0).stop 2024-09-16T01:16:34.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.995+0000 7f0b65da2640 1 -- 172.21.15.81:0/2968538030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b600d2ac0 msgr2=0x7f0b60157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:34.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.995+0000 7f0b65da2640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b600d2ac0 0x7f0b60157130 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000c400 tx=0x7f0b5000c8c0 comp rx=0 tx=0).stop 2024-09-16T01:16:34.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.995+0000 7f0b65da2640 1 -- 172.21.15.81:0/2968538030 shutdown_connections 2024-09-16T01:16:34.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.995+0000 7f0b65da2640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0b4c06c2b0 0x7f0b4c06e770 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:34.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.995+0000 7f0b65da2640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b60161ac0 0x7f0b60157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:34.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.995+0000 7f0b65da2640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b600d2ac0 0x7f0b60157130 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:34.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.995+0000 7f0b65da2640 1 --2- 172.21.15.81:0/2968538030 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0b600b3640 0x7f0b601e7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:34.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.995+0000 7f0b65da2640 1 -- 172.21.15.81:0/2968538030 >> 172.21.15.81:0/2968538030 conn(0x7f0b6008bfc0 msgr2=0x7f0b6006d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:34.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.995+0000 7f0b65da2640 1 -- 172.21.15.81:0/2968538030 shutdown_connections 2024-09-16T01:16:34.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:34.995+0000 7f0b65da2640 1 -- 172.21.15.81:0/2968538030 wait complete. 2024-09-16T01:16:35.008 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:16:35.009 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:16:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.108+0000 7f7007aaf640 1 Processor -- start 2024-09-16T01:16:35.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.109+0000 7f7007aaf640 1 -- start start 2024-09-16T01:16:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.109+0000 7f7007aaf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7000161c80 0x7f700006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.109+0000 7f7007aaf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f700006e870 con 0x7f70000b6680 2024-09-16T01:16:35.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.109+0000 7f7007aaf640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f700006d9f0 con 0x7f7000162060 2024-09-16T01:16:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.109+0000 7f7007aaf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f700006dcd0 con 0x7f7000161c80 2024-09-16T01:16:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.110+0000 7f700584b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7000161c80 0x7f700006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.110+0000 7f700604c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f70000b6680 0x7f70000cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38588/0 (socket says 172.21.15.81:38588) 2024-09-16T01:16:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.110+0000 7f700604c640 1 -- 172.21.15.81:0/2364434217 learned_addr learned my addr 172.21.15.81:0/2364434217 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.110+0000 7f700584b640 1 -- 172.21.15.81:0/2364434217 >> v1:172.21.15.102:6789/0 conn(0x7f7000162060 legacy=0x7f70000b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.110+0000 7f700584b640 1 -- 172.21.15.81:0/2364434217 >> v1:172.21.15.81:6789/0 conn(0x7f70000b6680 legacy=0x7f70000cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.110+0000 7f7004849640 1 -- 172.21.15.81:0/2364434217 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3686468073 0 0) 0x7f6ff8001490 con 0x7f70000b6680 2024-09-16T01:16:35.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.110+0000 7f700584b640 1 -- 172.21.15.81:0/2364434217 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f700006dfb0 con 0x7f7000161c80 2024-09-16T01:16:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.111+0000 7f700584b640 1 --2- 172.21.15.81:0/2364434217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7000161c80 0x7f700006e330 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0097a0 tx=0x7f6ffc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb459eb2a26e851 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.111+0000 7f7004849640 1 -- 172.21.15.81:0/2364434217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc037070 con 0x7f7000161c80 2024-09-16T01:16:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.111+0000 7f7004849640 1 -- 172.21.15.81:0/2364434217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ffc032440 con 0x7f7000161c80 2024-09-16T01:16:35.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.111+0000 7f7004849640 1 -- 172.21.15.81:0/2364434217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc032810 con 0x7f7000161c80 2024-09-16T01:16:35.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.111+0000 7f7007aaf640 1 -- 172.21.15.81:0/2364434217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7000161c80 msgr2=0x7f700006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.111+0000 7f7007aaf640 1 --2- 172.21.15.81:0/2364434217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7000161c80 0x7f700006e330 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0097a0 tx=0x7f6ffc02a1e0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.111+0000 7f7007aaf640 1 -- 172.21.15.81:0/2364434217 shutdown_connections 2024-09-16T01:16:35.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.111+0000 7f7007aaf640 1 --2- 172.21.15.81:0/2364434217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7000161c80 0x7f700006e330 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.111+0000 7f7007aaf640 1 -- 172.21.15.81:0/2364434217 >> 172.21.15.81:0/2364434217 conn(0x7f70000d44f0 msgr2=0x7f70000d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:35.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.111+0000 7f7007aaf640 1 -- 172.21.15.81:0/2364434217 shutdown_connections 2024-09-16T01:16:35.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.111+0000 7f7007aaf640 1 -- 172.21.15.81:0/2364434217 wait complete. 2024-09-16T01:16:35.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.112+0000 7f7007aaf640 1 Processor -- start 2024-09-16T01:16:35.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.113+0000 7f7007aaf640 1 -- start start 2024-09-16T01:16:35.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.113+0000 7f7007aaf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70000b6680 0x7f70000b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.113+0000 7f7007aaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7000161c80 0x7f70000c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.113+0000 7f7007aaf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7000162060 0x7f70000ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.113+0000 7f7007aaf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70000b6b30 con 0x7f7000162060 2024-09-16T01:16:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.113+0000 7f7007aaf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f70000d2aa0 con 0x7f7000161c80 2024-09-16T01:16:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.113+0000 7f7007aaf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f70000b6cb0 con 0x7f70000b6680 2024-09-16T01:16:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.113+0000 7f700604c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7000162060 0x7f70000ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.113+0000 7f700604c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7000162060 0x7f70000ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39688/0 (socket says 172.21.15.81:39688) 2024-09-16T01:16:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.113+0000 7f700604c640 1 -- 172.21.15.81:0/1650042616 learned_addr learned my addr 172.21.15.81:0/1650042616 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f700584b640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70000b6680 0x7f70000b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f700504a640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7000161c80 0x7f70000c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f700604c640 1 -- 172.21.15.81:0/1650042616 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70000b6680 msgr2=0x7f70000b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f700604c640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70000b6680 0x7f70000b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f700604c640 1 -- 172.21.15.81:0/1650042616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7000161c80 msgr2=0x7f70000c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f700604c640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7000161c80 0x7f70000c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f700604c640 1 -- 172.21.15.81:0/1650042616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70000b3b70 con 0x7f7000162060 2024-09-16T01:16:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f700604c640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7000162060 0x7f70000ca700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800c7b0 tx=0x7f6ff800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f6ff67fc640 1 -- 172.21.15.81:0/1650042616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8018070 con 0x7f7000162060 2024-09-16T01:16:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f6ff67fc640 1 -- 172.21.15.81:0/1650042616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff800a640 con 0x7f7000162060 2024-09-16T01:16:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f7007aaf640 1 -- 172.21.15.81:0/1650042616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70000c8f30 con 0x7f7000162060 2024-09-16T01:16:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f6ff67fc640 1 -- 172.21.15.81:0/1650042616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800aa30 con 0x7f7000162060 2024-09-16T01:16:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.114+0000 7f7007aaf640 1 -- 172.21.15.81:0/1650042616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70000b3890 con 0x7f7000162060 2024-09-16T01:16:35.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.115+0000 7f7007aaf640 1 -- 172.21.15.81:0/1650042616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f700006e330 con 0x7f7000162060 2024-09-16T01:16:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.116+0000 7f6ff67fc640 1 -- 172.21.15.81:0/1650042616 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6ff801b070 con 0x7f7000162060 2024-09-16T01:16:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.116+0000 7f6ff67fc640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6fe406c2b0 0x7f6fe406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.116+0000 7f6ff67fc640 1 -- 172.21.15.81:0/1650042616 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f6ff808ab60 con 0x7f7000162060 2024-09-16T01:16:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.116+0000 7f700584b640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6fe406c2b0 0x7f6fe406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.117+0000 7f700584b640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6fe406c2b0 0x7f6fe406e770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc034000 tx=0x7f6ffc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:35.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.120+0000 7f6ff67fc640 1 -- 172.21.15.81:0/1650042616 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70000c8f30 con 0x7f7000162060 2024-09-16T01:16:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.322+0000 7f7007aaf640 1 -- 172.21.15.81:0/1650042616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70000ba470 con 0x7f7000162060 2024-09-16T01:16:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.323+0000 7f6ff67fc640 1 -- 172.21.15.81:0/1650042616 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5223 (secure 0 0 0) 0x7f700006e870 con 0x7f7000162060 2024-09-16T01:16:35.325 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:35.325 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"btime":"2024-09-16T01:16:34:988023+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2179103223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2179103223},{"type":"v1","addr":"172.21.15.81:6836","nonce":2179103223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4649,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/4263439893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":4263439893},{"type":"v1","addr":"172.21.15.102:6834","nonce":4263439893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/27716817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":27716817},{"type":"v1","addr":"172.21.15.102:6835","nonce":27716817}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:16:32.311950+0000","modified":"2024-09-16T01:16:34.313044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3051272390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3051272390},{"type":"v1","addr":"172.21.15.81:6837","nonce":3051272390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-16T01:16:35.325 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 16 2024-09-16T01:16:35.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.324+0000 7f7007aaf640 1 -- 172.21.15.81:0/1650042616 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6fe406c2b0 msgr2=0x7f6fe406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.324+0000 7f7007aaf640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6fe406c2b0 0x7f6fe406e770 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc034000 tx=0x7f6ffc02e000 comp rx=0 tx=0).stop 2024-09-16T01:16:35.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.325+0000 7f7007aaf640 1 -- 172.21.15.81:0/1650042616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7000162060 msgr2=0x7f70000ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.325+0000 7f7007aaf640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7000162060 0x7f70000ca700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800c7b0 tx=0x7f6ff800cc70 comp rx=0 tx=0).stop 2024-09-16T01:16:35.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.325+0000 7f7007aaf640 1 -- 172.21.15.81:0/1650042616 shutdown_connections 2024-09-16T01:16:35.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.325+0000 7f7007aaf640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6fe406c2b0 0x7f6fe406e770 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.325+0000 7f7007aaf640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7000162060 0x7f70000ca700 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.325+0000 7f7007aaf640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7000161c80 0x7f70000c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.325+0000 7f7007aaf640 1 --2- 172.21.15.81:0/1650042616 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70000b6680 0x7f70000b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.325+0000 7f7007aaf640 1 -- 172.21.15.81:0/1650042616 >> 172.21.15.81:0/1650042616 conn(0x7f70000d44f0 msgr2=0x7f70000d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:35.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.325+0000 7f7007aaf640 1 -- 172.21.15.81:0/1650042616 shutdown_connections 2024-09-16T01:16:35.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.325+0000 7f7007aaf640 1 -- 172.21.15.81:0/1650042616 wait complete. 2024-09-16T01:16:35.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:16:35.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.433+0000 7fc70cf86640 1 Processor -- start 2024-09-16T01:16:35.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.433+0000 7fc70cf86640 1 -- start start 2024-09-16T01:16:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.434+0000 7fc70cf86640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc7080afd70 0x7fc708160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.434+0000 7fc70cf86640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7080b5f80 0x7fc7080b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.434+0000 7fc70cf86640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc70806e7d0 0x7fc70806ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.434+0000 7fc70cf86640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc7080b6910 con 0x7fc7080b5f80 2024-09-16T01:16:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.434+0000 7fc70cf86640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc708160d60 con 0x7fc7080afd70 2024-09-16T01:16:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.434+0000 7fc70cf86640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc70806fdb0 con 0x7fc70806e7d0 2024-09-16T01:16:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.434+0000 7fc705d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7080b5f80 0x7fc7080b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.434+0000 7fc705d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7080b5f80 0x7fc7080b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39704/0 (socket says 172.21.15.81:39704) 2024-09-16T01:16:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.434+0000 7fc705d9b640 1 -- 172.21.15.81:0/30771882 learned_addr learned my addr 172.21.15.81:0/30771882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.435+0000 7fc706d9d640 1 --2- 172.21.15.81:0/30771882 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc70806e7d0 0x7fc70806ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.435+0000 7fc70659c640 1 --2- 172.21.15.81:0/30771882 >> v2:172.21.15.102:3300/0 conn(0x7fc7080afd70 0x7fc708160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.435+0000 7fc705d9b640 1 -- 172.21.15.81:0/30771882 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc70806e7d0 msgr2=0x7fc70806ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.435+0000 7fc705d9b640 1 --2- 172.21.15.81:0/30771882 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc70806e7d0 0x7fc70806ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.435+0000 7fc705d9b640 1 -- 172.21.15.81:0/30771882 >> v2:172.21.15.102:3300/0 conn(0x7fc7080afd70 msgr2=0x7fc708160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:35.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.435+0000 7fc705d9b640 1 --2- 172.21.15.81:0/30771882 >> v2:172.21.15.102:3300/0 conn(0x7fc7080afd70 0x7fc708160820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.435+0000 7fc705d9b640 1 -- 172.21.15.81:0/30771882 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc708070090 con 0x7fc7080b5f80 2024-09-16T01:16:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.435+0000 7fc705d9b640 1 --2- 172.21.15.81:0/30771882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7080b5f80 0x7fc7080b63d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc7080742e0 tx=0x7fc6fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30dcadea0cc9b90f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.435+0000 7fc70559a640 1 -- 172.21.15.81:0/30771882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc037070 con 0x7fc7080b5f80 2024-09-16T01:16:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.435+0000 7fc70559a640 1 -- 172.21.15.81:0/30771882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6fc032440 con 0x7fc7080b5f80 2024-09-16T01:16:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.435+0000 7fc70559a640 1 -- 172.21.15.81:0/30771882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc032810 con 0x7fc7080b5f80 2024-09-16T01:16:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.436+0000 7fc70cf86640 1 -- 172.21.15.81:0/30771882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7080b5f80 msgr2=0x7fc7080b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.436+0000 7fc70cf86640 1 --2- 172.21.15.81:0/30771882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7080b5f80 0x7fc7080b63d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc7080742e0 tx=0x7fc6fc02a1e0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.436+0000 7fc70cf86640 1 -- 172.21.15.81:0/30771882 shutdown_connections 2024-09-16T01:16:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.436+0000 7fc70cf86640 1 --2- 172.21.15.81:0/30771882 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc70806e7d0 0x7fc70806ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.436+0000 7fc70cf86640 1 --2- 172.21.15.81:0/30771882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7080b5f80 0x7fc7080b63d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.436+0000 7fc70cf86640 1 --2- 172.21.15.81:0/30771882 >> v2:172.21.15.102:3300/0 conn(0x7fc7080afd70 0x7fc708160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.436+0000 7fc70cf86640 1 -- 172.21.15.81:0/30771882 >> 172.21.15.81:0/30771882 conn(0x7fc70806bc10 msgr2=0x7fc70806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.436+0000 7fc70cf86640 1 -- 172.21.15.81:0/30771882 shutdown_connections 2024-09-16T01:16:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.436+0000 7fc70cf86640 1 -- 172.21.15.81:0/30771882 wait complete. 2024-09-16T01:16:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.437+0000 7fc70cf86640 1 Processor -- start 2024-09-16T01:16:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.437+0000 7fc70cf86640 1 -- start start 2024-09-16T01:16:35.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.438+0000 7fc70cf86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc70806e7d0 0x7fc7081589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.438+0000 7fc70cf86640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7080afd70 0x7fc70815b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.438+0000 7fc70cf86640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc7080b5f80 0x7fc708150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.438+0000 7fc70cf86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc70806fa80 con 0x7fc70806e7d0 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.438+0000 7fc70cf86640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc708070650 con 0x7fc7080afd70 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.438+0000 7fc70cf86640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc7080b0150 con 0x7fc7080b5f80 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.438+0000 7fc70659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc70806e7d0 0x7fc7081589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.438+0000 7fc70659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc70806e7d0 0x7fc7081589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39706/0 (socket says 172.21.15.81:39706) 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.438+0000 7fc70659c640 1 -- 172.21.15.81:0/75443113 learned_addr learned my addr 172.21.15.81:0/75443113 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.438+0000 7fc705d9b640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7080afd70 0x7fc70815b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.438+0000 7fc706d9d640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc7080b5f80 0x7fc708150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.439+0000 7fc70659c640 1 -- 172.21.15.81:0/75443113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc7080b5f80 msgr2=0x7fc708150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.439+0000 7fc70659c640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc7080b5f80 0x7fc708150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.439+0000 7fc70659c640 1 -- 172.21.15.81:0/75443113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7080afd70 msgr2=0x7fc70815b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.439+0000 7fc70659c640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7080afd70 0x7fc70815b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.439+0000 7fc70659c640 1 -- 172.21.15.81:0/75443113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70815b6e0 con 0x7fc70806e7d0 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.439+0000 7fc706d9d640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc7080b5f80 0x7fc708150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.439+0000 7fc70659c640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc70806e7d0 0x7fc7081589f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800ce10 tx=0x7fc6f800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.439+0000 7fc6f6ffd640 1 -- 172.21.15.81:0/75443113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8003b90 con 0x7fc70806e7d0 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.439+0000 7fc6f6ffd640 1 -- 172.21.15.81:0/75443113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f8003d30 con 0x7fc70806e7d0 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.439+0000 7fc6f6ffd640 1 -- 172.21.15.81:0/75443113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8004240 con 0x7fc70806e7d0 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.439+0000 7fc70cf86640 1 -- 172.21.15.81:0/75443113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7081590d0 con 0x7fc70806e7d0 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.439+0000 7fc70cf86640 1 -- 172.21.15.81:0/75443113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc708159970 con 0x7fc70806e7d0 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.440+0000 7fc70cf86640 1 -- 172.21.15.81:0/75443113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7081594c0 con 0x7fc70806e7d0 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.440+0000 7fc6f6ffd640 1 -- 172.21.15.81:0/75443113 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc6f80043e0 con 0x7fc70806e7d0 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.441+0000 7fc6f6ffd640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc6e806c2b0 0x7fc6e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.441+0000 7fc6f6ffd640 1 -- 172.21.15.81:0/75443113 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fc6f808c060 con 0x7fc70806e7d0 2024-09-16T01:16:35.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.441+0000 7fc705d9b640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc6e806c2b0 0x7fc6e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.441+0000 7fc705d9b640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc6e806c2b0 0x7fc6e806e770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc034000 tx=0x7fc6fc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:35.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.445+0000 7fc6f6ffd640 1 -- 172.21.15.81:0/75443113 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6f805a640 con 0x7fc70806e7d0 2024-09-16T01:16:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.610+0000 7fc70cf86640 1 -- 172.21.15.81:0/75443113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc708160060 con 0x7fc70806e7d0 2024-09-16T01:16:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.611+0000 7fc6f6ffd640 1 -- 172.21.15.81:0/75443113 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+17002 (secure 0 0 0) 0x7fc6f8059f40 con 0x7fc70806e7d0 2024-09-16T01:16:35.613 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:35.613 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":37,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:16:33.982983+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:16:29.974908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-16T01:16:31.289690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.613+0000 7fc70cf86640 1 -- 172.21.15.81:0/75443113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc6e806c2b0 msgr2=0x7fc6e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.613+0000 7fc70cf86640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc6e806c2b0 0x7fc6e806e770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc034000 tx=0x7fc6fc02e000 comp rx=0 tx=0).stop 2024-09-16T01:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.613+0000 7fc70cf86640 1 -- 172.21.15.81:0/75443113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc70806e7d0 msgr2=0x7fc7081589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.613+0000 7fc70cf86640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc70806e7d0 0x7fc7081589f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800ce10 tx=0x7fc6f800a660 comp rx=0 tx=0).stop 2024-09-16T01:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.613+0000 7fc70cf86640 1 -- 172.21.15.81:0/75443113 shutdown_connections 2024-09-16T01:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.613+0000 7fc70cf86640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc6e806c2b0 0x7fc6e806e770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.613+0000 7fc70cf86640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc7080b5f80 0x7fc708150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.613+0000 7fc70cf86640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7080afd70 0x7fc70815b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.613+0000 7fc70cf86640 1 --2- 172.21.15.81:0/75443113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc70806e7d0 0x7fc7081589f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.613+0000 7fc70cf86640 1 -- 172.21.15.81:0/75443113 >> 172.21.15.81:0/75443113 conn(0x7fc70806bc10 msgr2=0x7fc708153b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.613+0000 7fc70cf86640 1 -- 172.21.15.81:0/75443113 shutdown_connections 2024-09-16T01:16:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.613+0000 7fc70cf86640 1 -- 172.21.15.81:0/75443113 wait complete. 2024-09-16T01:16:35.626 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:16:35.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:16:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.722+0000 7f751d277640 1 Processor -- start 2024-09-16T01:16:35.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.722+0000 7f751d277640 1 -- start start 2024-09-16T01:16:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.722+0000 7f751d277640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7518161c80 0x7f751806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f751d277640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7518162060 0x7f75180b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f751d277640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f751806e870 con 0x7f75180b64b0 2024-09-16T01:16:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f751d277640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f751806d9f0 con 0x7f7518162060 2024-09-16T01:16:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f751d277640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f751806dcd0 con 0x7f7518161c80 2024-09-16T01:16:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75177fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f75180b64b0 0x7f7518162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38598/0 (socket says 172.21.15.81:38598) 2024-09-16T01:16:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75177fe640 1 -- 172.21.15.81:0/662150611 learned_addr learned my addr 172.21.15.81:0/662150611 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:35.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f750e7fc640 1 --2- 172.21.15.81:0/662150611 >> v2:172.21.15.102:3300/0 conn(0x7f7518162060 0x7f75180b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755825269 0 0) 0x7f7510001490 con 0x7f75180b64b0 2024-09-16T01:16:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f7516ffd640 1 --2- 172.21.15.81:0/662150611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7518161c80 0x7f751806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7504003520 con 0x7f75180b64b0 2024-09-16T01:16:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 124142803 0 0) 0x7f7504003520 con 0x7f75180b64b0 2024-09-16T01:16:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7518161c80 msgr2=0x7f751806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 --2- 172.21.15.81:0/662150611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7518161c80 0x7f751806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 >> v2:172.21.15.102:3300/0 conn(0x7f7518162060 msgr2=0x7f75180b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 --2- 172.21.15.81:0/662150611 >> v2:172.21.15.102:3300/0 conn(0x7f7518162060 0x7f75180b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751806dfb0 con 0x7f75180b64b0 2024-09-16T01:16:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f7510001bc0 con 0x7f75180b64b0 2024-09-16T01:16:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f750e7fc640 1 --2- 172.21.15.81:0/662150611 >> v2:172.21.15.102:3300/0 conn(0x7f7518162060 0x7f75180b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:35.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 >> v1:172.21.15.81:6789/0 conn(0x7f75180b64b0 legacy=0x7f7518162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 --2- 172.21.15.81:0/662150611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7518161c80 0x7f75040039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 --2- 172.21.15.81:0/662150611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7504003f30 0x7f7504004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 --2- 172.21.15.81:0/662150611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7504004d40 0x7f75040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f751806d9f0 con 0x7f7504004d40 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f751806dcd0 con 0x7f7504003f30 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f750400ba10 con 0x7f7518161c80 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.723+0000 7f75177fe640 1 --2- 172.21.15.81:0/662150611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7504004d40 0x7f75040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.724+0000 7f7516ffd640 1 --2- 172.21.15.81:0/662150611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7518161c80 0x7f75040039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.724+0000 7f750e7fc640 1 --2- 172.21.15.81:0/662150611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7504003f30 0x7f7504004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.724+0000 7f75177fe640 1 -- 172.21.15.81:0/662150611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7518161c80 msgr2=0x7f75040039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.724+0000 7f75177fe640 1 --2- 172.21.15.81:0/662150611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7518161c80 0x7f75040039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.724+0000 7f75177fe640 1 -- 172.21.15.81:0/662150611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7504003f30 msgr2=0x7f7504004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:35.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.724+0000 7f75177fe640 1 --2- 172.21.15.81:0/662150611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7504003f30 0x7f7504004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.724+0000 7f75177fe640 1 -- 172.21.15.81:0/662150611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7504003520 con 0x7f7504004d40 2024-09-16T01:16:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.724+0000 7f75177fe640 1 --2- 172.21.15.81:0/662150611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7504004d40 0x7f75040051c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f751000aa70 tx=0x7f7504005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c946495025d88012 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.725+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751000a690 con 0x7f7504004d40 2024-09-16T01:16:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.725+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f751002f070 con 0x7f7504004d40 2024-09-16T01:16:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.725+0000 7f75167fc640 1 -- 172.21.15.81:0/662150611 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7510034470 con 0x7f7504004d40 2024-09-16T01:16:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.725+0000 7f751d277640 1 -- 172.21.15.81:0/662150611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7504004d40 msgr2=0x7f75040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.725+0000 7f751d277640 1 --2- 172.21.15.81:0/662150611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7504004d40 0x7f75040051c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f751000aa70 tx=0x7f7504005830 comp rx=0 tx=0).stop 2024-09-16T01:16:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.725+0000 7f75177fe640 1 -- 172.21.15.81:0/662150611 reap_dead start 2024-09-16T01:16:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.725+0000 7f751d277640 1 -- 172.21.15.81:0/662150611 shutdown_connections 2024-09-16T01:16:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.725+0000 7f751d277640 1 -- 172.21.15.81:0/662150611 >> 172.21.15.81:0/662150611 conn(0x7f75180d44f0 msgr2=0x7f75180d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.725+0000 7f751d277640 1 -- 172.21.15.81:0/662150611 shutdown_connections 2024-09-16T01:16:35.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.725+0000 7f751d277640 1 -- 172.21.15.81:0/662150611 wait complete. 2024-09-16T01:16:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.726+0000 7f751d277640 1 Processor -- start 2024-09-16T01:16:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.727+0000 7f751d277640 1 -- start start 2024-09-16T01:16:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.727+0000 7f751d277640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75181567f0 0x7f75180b8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.727+0000 7f751d277640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75180b9390 0x7f75180b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.727+0000 7f751d277640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75180b2720 0x7f75180cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.727+0000 7f751d277640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75180d2a10 con 0x7f75180b9390 2024-09-16T01:16:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.727+0000 7f751d277640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f75180d2890 con 0x7f75181567f0 2024-09-16T01:16:35.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.727+0000 7f751d277640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f751806e330 con 0x7f75180b2720 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.727+0000 7f750e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75180b9390 0x7f75180b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.727+0000 7f750e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75180b9390 0x7f75180b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39728/0 (socket says 172.21.15.81:39728) 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.727+0000 7f750e7fc640 1 -- 172.21.15.81:0/3777643827 learned_addr learned my addr 172.21.15.81:0/3777643827 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.727+0000 7f75177fe640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75180b2720 0x7f75180cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.727+0000 7f7516ffd640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75181567f0 0x7f75180b8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.728+0000 7f750e7fc640 1 -- 172.21.15.81:0/3777643827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75180b2720 msgr2=0x7f75180cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.728+0000 7f750e7fc640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75180b2720 0x7f75180cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.728+0000 7f750e7fc640 1 -- 172.21.15.81:0/3777643827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75181567f0 msgr2=0x7f75180b8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.728+0000 7f750e7fc640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75181567f0 0x7f75180b8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.728+0000 7f750e7fc640 1 -- 172.21.15.81:0/3777643827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75180b7700 con 0x7f75180b9390 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.728+0000 7f750e7fc640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75180b9390 0x7f75180b21e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7500011610 tx=0x7f7500011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.728+0000 7f750ffff640 1 -- 172.21.15.81:0/3777643827 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750000f040 con 0x7f75180b9390 2024-09-16T01:16:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.728+0000 7f750ffff640 1 -- 172.21.15.81:0/3777643827 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7500004230 con 0x7f75180b9390 2024-09-16T01:16:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.728+0000 7f751d277640 1 -- 172.21.15.81:0/3777643827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75180b79e0 con 0x7f75180b9390 2024-09-16T01:16:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.728+0000 7f750ffff640 1 -- 172.21.15.81:0/3777643827 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7500015730 con 0x7f75180b9390 2024-09-16T01:16:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.728+0000 7f751d277640 1 -- 172.21.15.81:0/3777643827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75180b7fa0 con 0x7f75180b9390 2024-09-16T01:16:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.729+0000 7f751d277640 1 -- 172.21.15.81:0/3777643827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7518075670 con 0x7f75180b9390 2024-09-16T01:16:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.729+0000 7f750ffff640 1 -- 172.21.15.81:0/3777643827 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f75000158d0 con 0x7f75180b9390 2024-09-16T01:16:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.730+0000 7f750ffff640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74f806c2b0 0x7f74f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.730+0000 7f750ffff640 1 -- 172.21.15.81:0/3777643827 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f750008b930 con 0x7f75180b9390 2024-09-16T01:16:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.730+0000 7f7516ffd640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74f806c2b0 0x7f74f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.730+0000 7f7516ffd640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74f806c2b0 0x7f74f806e770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7508009a80 tx=0x7f7508008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:35.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.734+0000 7f750ffff640 1 -- 172.21.15.81:0/3777643827 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7518075670 con 0x7f75180b9390 2024-09-16T01:16:35.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.896+0000 7f751d277640 1 -- 172.21.15.81:0/3777643827 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75180b5f70 con 0x7f74f806c2b0 2024-09-16T01:16:35.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.902+0000 7f750ffff640 1 -- 172.21.15.81:0/3777643827 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251882 (secure 0 0 0) 0x7f75180b5f70 con 0x7f74f806c2b0 2024-09-16T01:16:35.907 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:35.908 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:16:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.906+0000 7f751d277640 1 -- 172.21.15.81:0/3777643827 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74f806c2b0 msgr2=0x7f74f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.906+0000 7f751d277640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74f806c2b0 0x7f74f806e770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7508009a80 tx=0x7f7508008040 comp rx=0 tx=0).stop 2024-09-16T01:16:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.906+0000 7f751d277640 1 -- 172.21.15.81:0/3777643827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75180b9390 msgr2=0x7f75180b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.906+0000 7f751d277640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75180b9390 0x7f75180b21e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7500011610 tx=0x7f7500011ad0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.906+0000 7f751d277640 1 -- 172.21.15.81:0/3777643827 shutdown_connections 2024-09-16T01:16:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.906+0000 7f751d277640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74f806c2b0 0x7f74f806e770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.906+0000 7f751d277640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75180b2720 0x7f75180cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.906+0000 7f751d277640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75180b9390 0x7f75180b21e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.906+0000 7f751d277640 1 --2- 172.21.15.81:0/3777643827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75181567f0 0x7f75180b8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.906+0000 7f751d277640 1 -- 172.21.15.81:0/3777643827 >> 172.21.15.81:0/3777643827 conn(0x7f75180d44f0 msgr2=0x7f7518162440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.906+0000 7f751d277640 1 -- 172.21.15.81:0/3777643827 shutdown_connections 2024-09-16T01:16:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:35.906+0000 7f751d277640 1 -- 172.21.15.81:0/3777643827 wait complete. 2024-09-16T01:16:35.919 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-09-16T01:16:34.069600+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220552,"kb_used_data":4324,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754168,"statfs":{"total":773094113280,"available":772868268032,"internally_reserved":0,"allocated":4427776,"data_stored":2550012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000670"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996343+0000","last_change":"2024-09-16T01:16:32.993080+0000","last_active":"2024-09-16T01:16:32.996343+0000","last_peered":"2024-09-16T01:16:32.996343+0000","last_clean":"2024-09-16T01:16:32.996343+0000","last_became_active":"2024-09-16T01:16:32.991866+0000","last_became_peered":"2024-09-16T01:16:32.991866+0000","last_unstale":"2024-09-16T01:16:32.996343+0000","last_undegraded":"2024-09-16T01:16:32.996343+0000","last_fullsized":"2024-09-16T01:16:32.996343+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:23.606455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.992497+0000","last_change":"2024-09-16T01:16:32.984711+0000","last_active":"2024-09-16T01:16:32.992497+0000","last_peered":"2024-09-16T01:16:32.992497+0000","last_clean":"2024-09-16T01:16:32.992497+0000","last_became_active":"2024-09-16T01:16:32.984415+0000","last_became_peered":"2024-09-16T01:16:32.984415+0000","last_unstale":"2024-09-16T01:16:32.992497+0000","last_undegraded":"2024-09-16T01:16:32.992497+0000","last_fullsized":"2024-09-16T01:16:32.992497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:50.788597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.009102+0000","last_change":"2024-09-16T01:16:33.001847+0000","last_active":"2024-09-16T01:16:33.009102+0000","last_peered":"2024-09-16T01:16:33.009102+0000","last_clean":"2024-09-16T01:16:33.009102+0000","last_became_active":"2024-09-16T01:16:33.001551+0000","last_became_peered":"2024-09-16T01:16:33.001551+0000","last_unstale":"2024-09-16T01:16:33.009102+0000","last_undegraded":"2024-09-16T01:16:33.009102+0000","last_fullsized":"2024-09-16T01:16:33.009102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:47.577734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.995821+0000","last_change":"2024-09-16T01:16:32.989556+0000","last_active":"2024-09-16T01:16:32.995821+0000","last_peered":"2024-09-16T01:16:32.995821+0000","last_clean":"2024-09-16T01:16:32.995821+0000","last_became_active":"2024-09-16T01:16:32.989026+0000","last_became_peered":"2024-09-16T01:16:32.989026+0000","last_unstale":"2024-09-16T01:16:32.995821+0000","last_undegraded":"2024-09-16T01:16:32.995821+0000","last_fullsized":"2024-09-16T01:16:32.995821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:46.517261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.991199+0000","last_change":"2024-09-16T01:16:32.983168+0000","last_active":"2024-09-16T01:16:32.991199+0000","last_peered":"2024-09-16T01:16:32.991199+0000","last_clean":"2024-09-16T01:16:32.991199+0000","last_became_active":"2024-09-16T01:16:32.982880+0000","last_became_peered":"2024-09-16T01:16:32.982880+0000","last_unstale":"2024-09-16T01:16:32.991199+0000","last_undegraded":"2024-09-16T01:16:32.991199+0000","last_fullsized":"2024-09-16T01:16:32.991199+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:57:58.197440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.993210+0000","last_change":"2024-09-16T01:16:32.987908+0000","last_active":"2024-09-16T01:16:32.993210+0000","last_peered":"2024-09-16T01:16:32.993210+0000","last_clean":"2024-09-16T01:16:32.993210+0000","last_became_active":"2024-09-16T01:16:32.987617+0000","last_became_peered":"2024-09-16T01:16:32.987617+0000","last_unstale":"2024-09-16T01:16:32.993210+0000","last_undegraded":"2024-09-16T01:16:32.993210+0000","last_fullsized":"2024-09-16T01:16:32.993210+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:33.162352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003245+0000","last_change":"2024-09-16T01:16:32.998565+0000","last_active":"2024-09-16T01:16:33.003245+0000","last_peered":"2024-09-16T01:16:33.003245+0000","last_clean":"2024-09-16T01:16:33.003245+0000","last_became_active":"2024-09-16T01:16:32.996265+0000","last_became_peered":"2024-09-16T01:16:32.996265+0000","last_unstale":"2024-09-16T01:16:33.003245+0000","last_undegraded":"2024-09-16T01:16:33.003245+0000","last_fullsized":"2024-09-16T01:16:33.003245+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:56.771628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996698+0000","last_change":"2024-09-16T01:16:32.993716+0000","last_active":"2024-09-16T01:16:32.996698+0000","last_peered":"2024-09-16T01:16:32.996698+0000","last_clean":"2024-09-16T01:16:32.996698+0000","last_became_active":"2024-09-16T01:16:32.993454+0000","last_became_peered":"2024-09-16T01:16:32.993454+0000","last_unstale":"2024-09-16T01:16:32.996698+0000","last_undegraded":"2024-09-16T01:16:32.996698+0000","last_fullsized":"2024-09-16T01:16:32.996698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:23.994772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.009077+0000","last_change":"2024-09-16T01:16:33.001127+0000","last_active":"2024-09-16T01:16:33.009077+0000","last_peered":"2024-09-16T01:16:33.009077+0000","last_clean":"2024-09-16T01:16:33.009077+0000","last_became_active":"2024-09-16T01:16:33.000819+0000","last_became_peered":"2024-09-16T01:16:33.000819+0000","last_unstale":"2024-09-16T01:16:33.009077+0000","last_undegraded":"2024-09-16T01:16:33.009077+0000","last_fullsized":"2024-09-16T01:16:33.009077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:14.970777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.005745+0000","last_change":"2024-09-16T01:16:33.000126+0000","last_active":"2024-09-16T01:16:33.005745+0000","last_peered":"2024-09-16T01:16:33.005745+0000","last_clean":"2024-09-16T01:16:33.005745+0000","last_became_active":"2024-09-16T01:16:32.999846+0000","last_became_peered":"2024-09-16T01:16:32.999846+0000","last_unstale":"2024-09-16T01:16:33.005745+0000","last_undegraded":"2024-09-16T01:16:33.005745+0000","last_fullsized":"2024-09-16T01:16:33.005745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:23.994772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.002683+0000","last_change":"2024-09-16T01:16:32.997550+0000","last_active":"2024-09-16T01:16:33.002683+0000","last_peered":"2024-09-16T01:16:33.002683+0000","last_clean":"2024-09-16T01:16:33.002683+0000","last_became_active":"2024-09-16T01:16:32.997254+0000","last_became_peered":"2024-09-16T01:16:32.997254+0000","last_unstale":"2024-09-16T01:16:33.002683+0000","last_undegraded":"2024-09-16T01:16:33.002683+0000","last_fullsized":"2024-09-16T01:16:33.002683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:17.334349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996493+0000","last_change":"2024-09-16T01:16:32.987237+0000","last_active":"2024-09-16T01:16:32.996493+0000","last_peered":"2024-09-16T01:16:32.996493+0000","last_clean":"2024-09-16T01:16:32.996493+0000","last_became_active":"2024-09-16T01:16:32.986849+0000","last_became_peered":"2024-09-16T01:16:32.986849+0000","last_unstale":"2024-09-16T01:16:32.996493+0000","last_undegraded":"2024-09-16T01:16:32.996493+0000","last_fullsized":"2024-09-16T01:16:32.996493+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:49.573942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.001501+0000","last_change":"2024-09-16T01:16:32.994312+0000","last_active":"2024-09-16T01:16:33.001501+0000","last_peered":"2024-09-16T01:16:33.001501+0000","last_clean":"2024-09-16T01:16:33.001501+0000","last_became_active":"2024-09-16T01:16:32.993929+0000","last_became_peered":"2024-09-16T01:16:32.993929+0000","last_unstale":"2024-09-16T01:16:33.001501+0000","last_undegraded":"2024-09-16T01:16:33.001501+0000","last_fullsized":"2024-09-16T01:16:33.001501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:59.827475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996966+0000","last_change":"2024-09-16T01:16:32.994724+0000","last_active":"2024-09-16T01:16:32.996966+0000","last_peered":"2024-09-16T01:16:32.996966+0000","last_clean":"2024-09-16T01:16:32.996966+0000","last_became_active":"2024-09-16T01:16:32.994432+0000","last_became_peered":"2024-09-16T01:16:32.994432+0000","last_unstale":"2024-09-16T01:16:32.996966+0000","last_undegraded":"2024-09-16T01:16:32.996966+0000","last_fullsized":"2024-09-16T01:16:32.996966+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:14.970777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003776+0000","last_change":"2024-09-16T01:16:32.998801+0000","last_active":"2024-09-16T01:16:33.003776+0000","last_peered":"2024-09-16T01:16:33.003776+0000","last_clean":"2024-09-16T01:16:33.003776+0000","last_became_active":"2024-09-16T01:16:32.997355+0000","last_became_peered":"2024-09-16T01:16:32.997355+0000","last_unstale":"2024-09-16T01:16:33.003776+0000","last_undegraded":"2024-09-16T01:16:33.003776+0000","last_fullsized":"2024-09-16T01:16:33.003776+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:16.165512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.004827+0000","last_change":"2024-09-16T01:16:33.000984+0000","last_active":"2024-09-16T01:16:33.004827+0000","last_peered":"2024-09-16T01:16:33.004827+0000","last_clean":"2024-09-16T01:16:33.004827+0000","last_became_active":"2024-09-16T01:16:33.000692+0000","last_became_peered":"2024-09-16T01:16:33.000692+0000","last_unstale":"2024-09-16T01:16:33.004827+0000","last_undegraded":"2024-09-16T01:16:33.004827+0000","last_fullsized":"2024-09-16T01:16:33.004827+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:23.606455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.004514+0000","last_change":"2024-09-16T01:16:33.000166+0000","last_active":"2024-09-16T01:16:33.004514+0000","last_peered":"2024-09-16T01:16:33.004514+0000","last_clean":"2024-09-16T01:16:33.004514+0000","last_became_active":"2024-09-16T01:16:32.999845+0000","last_became_peered":"2024-09-16T01:16:32.999845+0000","last_unstale":"2024-09-16T01:16:33.004514+0000","last_undegraded":"2024-09-16T01:16:33.004514+0000","last_fullsized":"2024-09-16T01:16:33.004514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:43.595520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.005224+0000","last_change":"2024-09-16T01:16:32.997175+0000","last_active":"2024-09-16T01:16:33.005224+0000","last_peered":"2024-09-16T01:16:33.005224+0000","last_clean":"2024-09-16T01:16:33.005224+0000","last_became_active":"2024-09-16T01:16:32.996644+0000","last_became_peered":"2024-09-16T01:16:32.996644+0000","last_unstale":"2024-09-16T01:16:33.005224+0000","last_undegraded":"2024-09-16T01:16:33.005224+0000","last_fullsized":"2024-09-16T01:16:33.005224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:34.999077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.995845+0000","last_change":"2024-09-16T01:16:32.989572+0000","last_active":"2024-09-16T01:16:32.995845+0000","last_peered":"2024-09-16T01:16:32.995845+0000","last_clean":"2024-09-16T01:16:32.995845+0000","last_became_active":"2024-09-16T01:16:32.989289+0000","last_became_peered":"2024-09-16T01:16:32.989289+0000","last_unstale":"2024-09-16T01:16:32.995845+0000","last_undegraded":"2024-09-16T01:16:32.995845+0000","last_fullsized":"2024-09-16T01:16:32.995845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:12.242165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.994233+0000","last_change":"2024-09-16T01:16:32.991901+0000","last_active":"2024-09-16T01:16:32.994233+0000","last_peered":"2024-09-16T01:16:32.994233+0000","last_clean":"2024-09-16T01:16:32.994233+0000","last_became_active":"2024-09-16T01:16:32.991576+0000","last_became_peered":"2024-09-16T01:16:32.991576+0000","last_unstale":"2024-09-16T01:16:32.994233+0000","last_undegraded":"2024-09-16T01:16:32.994233+0000","last_fullsized":"2024-09-16T01:16:32.994233+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:49.573942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.001587+0000","last_change":"2024-09-16T01:16:32.995272+0000","last_active":"2024-09-16T01:16:33.001587+0000","last_peered":"2024-09-16T01:16:33.001587+0000","last_clean":"2024-09-16T01:16:33.001587+0000","last_became_active":"2024-09-16T01:16:32.994924+0000","last_became_peered":"2024-09-16T01:16:32.994924+0000","last_unstale":"2024-09-16T01:16:33.001587+0000","last_undegraded":"2024-09-16T01:16:33.001587+0000","last_fullsized":"2024-09-16T01:16:33.001587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:56.381615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.991145+0000","last_change":"2024-09-16T01:16:32.986735+0000","last_active":"2024-09-16T01:16:32.991145+0000","last_peered":"2024-09-16T01:16:32.991145+0000","last_clean":"2024-09-16T01:16:32.991145+0000","last_became_active":"2024-09-16T01:16:32.986052+0000","last_became_peered":"2024-09-16T01:16:32.986052+0000","last_unstale":"2024-09-16T01:16:32.991145+0000","last_undegraded":"2024-09-16T01:16:32.991145+0000","last_fullsized":"2024-09-16T01:16:32.991145+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:34.557706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.998087+0000","last_change":"2024-09-16T01:16:32.992745+0000","last_active":"2024-09-16T01:16:32.998087+0000","last_peered":"2024-09-16T01:16:32.998087+0000","last_clean":"2024-09-16T01:16:32.998087+0000","last_became_active":"2024-09-16T01:16:32.992206+0000","last_became_peered":"2024-09-16T01:16:32.992206+0000","last_unstale":"2024-09-16T01:16:32.998087+0000","last_undegraded":"2024-09-16T01:16:32.998087+0000","last_fullsized":"2024-09-16T01:16:32.998087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:50.788597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996990+0000","last_change":"2024-09-16T01:16:32.994810+0000","last_active":"2024-09-16T01:16:32.996990+0000","last_peered":"2024-09-16T01:16:32.996990+0000","last_clean":"2024-09-16T01:16:32.996990+0000","last_became_active":"2024-09-16T01:16:32.994545+0000","last_became_peered":"2024-09-16T01:16:32.994545+0000","last_unstale":"2024-09-16T01:16:32.996990+0000","last_undegraded":"2024-09-16T01:16:32.996990+0000","last_fullsized":"2024-09-16T01:16:32.996990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:03:51.272109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.994844+0000","last_change":"2024-09-16T01:16:32.992112+0000","last_active":"2024-09-16T01:16:32.994844+0000","last_peered":"2024-09-16T01:16:32.994844+0000","last_clean":"2024-09-16T01:16:32.994844+0000","last_became_active":"2024-09-16T01:16:32.991809+0000","last_became_peered":"2024-09-16T01:16:32.991809+0000","last_unstale":"2024-09-16T01:16:32.994844+0000","last_undegraded":"2024-09-16T01:16:32.994844+0000","last_fullsized":"2024-09-16T01:16:32.994844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:00.383914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.004103+0000","last_change":"2024-09-16T01:16:33.000521+0000","last_active":"2024-09-16T01:16:33.004103+0000","last_peered":"2024-09-16T01:16:33.004103+0000","last_clean":"2024-09-16T01:16:33.004103+0000","last_became_active":"2024-09-16T01:16:33.000226+0000","last_became_peered":"2024-09-16T01:16:33.000226+0000","last_unstale":"2024-09-16T01:16:33.004103+0000","last_undegraded":"2024-09-16T01:16:33.004103+0000","last_fullsized":"2024-09-16T01:16:33.004103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:59.320553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.992243+0000","last_change":"2024-09-16T01:16:32.984796+0000","last_active":"2024-09-16T01:16:32.992243+0000","last_peered":"2024-09-16T01:16:32.992243+0000","last_clean":"2024-09-16T01:16:32.992243+0000","last_became_active":"2024-09-16T01:16:32.984525+0000","last_became_peered":"2024-09-16T01:16:32.984525+0000","last_unstale":"2024-09-16T01:16:32.992243+0000","last_undegraded":"2024-09-16T01:16:32.992243+0000","last_fullsized":"2024-09-16T01:16:32.992243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:55.428488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003690+0000","last_change":"2024-09-16T01:16:32.999514+0000","last_active":"2024-09-16T01:16:33.003690+0000","last_peered":"2024-09-16T01:16:33.003690+0000","last_clean":"2024-09-16T01:16:33.003690+0000","last_became_active":"2024-09-16T01:16:32.998595+0000","last_became_peered":"2024-09-16T01:16:32.998595+0000","last_unstale":"2024-09-16T01:16:33.003690+0000","last_undegraded":"2024-09-16T01:16:33.003690+0000","last_fullsized":"2024-09-16T01:16:33.003690+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:43.595520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.992499+0000","last_change":"2024-09-16T01:16:32.989188+0000","last_active":"2024-09-16T01:16:32.992499+0000","last_peered":"2024-09-16T01:16:32.992499+0000","last_clean":"2024-09-16T01:16:32.992499+0000","last_became_active":"2024-09-16T01:16:32.988909+0000","last_became_peered":"2024-09-16T01:16:32.988909+0000","last_unstale":"2024-09-16T01:16:32.992499+0000","last_undegraded":"2024-09-16T01:16:32.992499+0000","last_fullsized":"2024-09-16T01:16:32.992499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:34.557706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.992348+0000","last_change":"2024-09-16T01:16:32.986802+0000","last_active":"2024-09-16T01:16:32.992348+0000","last_peered":"2024-09-16T01:16:32.992348+0000","last_clean":"2024-09-16T01:16:32.992348+0000","last_became_active":"2024-09-16T01:16:32.986444+0000","last_became_peered":"2024-09-16T01:16:32.986444+0000","last_unstale":"2024-09-16T01:16:32.992348+0000","last_undegraded":"2024-09-16T01:16:32.992348+0000","last_fullsized":"2024-09-16T01:16:32.992348+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:23.223883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.998068+0000","last_change":"2024-09-16T01:16:32.992480+0000","last_active":"2024-09-16T01:16:32.998068+0000","last_peered":"2024-09-16T01:16:32.998068+0000","last_clean":"2024-09-16T01:16:32.998068+0000","last_became_active":"2024-09-16T01:16:32.991870+0000","last_became_peered":"2024-09-16T01:16:32.991870+0000","last_unstale":"2024-09-16T01:16:32.998068+0000","last_undegraded":"2024-09-16T01:16:32.998068+0000","last_fullsized":"2024-09-16T01:16:32.998068+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:56.381615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.993136+0000","last_change":"2024-09-16T01:16:32.989371+0000","last_active":"2024-09-16T01:16:32.993136+0000","last_peered":"2024-09-16T01:16:32.993136+0000","last_clean":"2024-09-16T01:16:32.993136+0000","last_became_active":"2024-09-16T01:16:32.989090+0000","last_became_peered":"2024-09-16T01:16:32.989090+0000","last_unstale":"2024-09-16T01:16:32.993136+0000","last_undegraded":"2024-09-16T01:16:32.993136+0000","last_fullsized":"2024-09-16T01:16:32.993136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:14.970777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.004742+0000","last_change":"2024-09-16T01:16:33.001826+0000","last_active":"2024-09-16T01:16:33.004742+0000","last_peered":"2024-09-16T01:16:33.004742+0000","last_clean":"2024-09-16T01:16:33.004742+0000","last_became_active":"2024-09-16T01:16:33.000851+0000","last_became_peered":"2024-09-16T01:16:33.000851+0000","last_unstale":"2024-09-16T01:16:33.004742+0000","last_undegraded":"2024-09-16T01:16:33.004742+0000","last_fullsized":"2024-09-16T01:16:33.004742+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:23.994772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010692+0000","last_change":"2024-09-16T01:16:31.978481+0000","last_active":"2024-09-16T01:16:33.010692+0000","last_peered":"2024-09-16T01:16:33.010692+0000","last_clean":"2024-09-16T01:16:33.010692+0000","last_became_active":"2024-09-16T01:16:31.977954+0000","last_became_peered":"2024-09-16T01:16:31.977954+0000","last_unstale":"2024-09-16T01:16:33.010692+0000","last_undegraded":"2024-09-16T01:16:33.010692+0000","last_fullsized":"2024-09-16T01:16:33.010692+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:27.450409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.001617+0000","last_change":"2024-09-16T01:16:32.999835+0000","last_active":"2024-09-16T01:16:33.001617+0000","last_peered":"2024-09-16T01:16:33.001617+0000","last_clean":"2024-09-16T01:16:33.001617+0000","last_became_active":"2024-09-16T01:16:32.999546+0000","last_became_peered":"2024-09-16T01:16:32.999546+0000","last_unstale":"2024-09-16T01:16:33.001617+0000","last_undegraded":"2024-09-16T01:16:33.001617+0000","last_fullsized":"2024-09-16T01:16:33.001617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:15.201448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.005761+0000","last_change":"2024-09-16T01:16:31.981724+0000","last_active":"2024-09-16T01:16:33.005761+0000","last_peered":"2024-09-16T01:16:33.005761+0000","last_clean":"2024-09-16T01:16:33.005761+0000","last_became_active":"2024-09-16T01:16:31.981462+0000","last_became_peered":"2024-09-16T01:16:31.981462+0000","last_unstale":"2024-09-16T01:16:33.005761+0000","last_undegraded":"2024-09-16T01:16:33.005761+0000","last_fullsized":"2024-09-16T01:16:33.005761+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:27.450409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996939+0000","last_change":"2024-09-16T01:16:32.994242+0000","last_active":"2024-09-16T01:16:32.996939+0000","last_peered":"2024-09-16T01:16:32.996939+0000","last_clean":"2024-09-16T01:16:32.996939+0000","last_became_active":"2024-09-16T01:16:32.993956+0000","last_became_peered":"2024-09-16T01:16:32.993956+0000","last_unstale":"2024-09-16T01:16:32.996939+0000","last_undegraded":"2024-09-16T01:16:32.996939+0000","last_fullsized":"2024-09-16T01:16:32.996939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:33.162352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.007988+0000","last_change":"2024-09-16T01:16:31.985397+0000","last_active":"2024-09-16T01:16:33.007988+0000","last_peered":"2024-09-16T01:16:33.007988+0000","last_clean":"2024-09-16T01:16:33.007988+0000","last_became_active":"2024-09-16T01:16:31.985139+0000","last_became_peered":"2024-09-16T01:16:31.985139+0000","last_unstale":"2024-09-16T01:16:33.007988+0000","last_undegraded":"2024-09-16T01:16:33.007988+0000","last_fullsized":"2024-09-16T01:16:33.007988+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:48.569386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.993234+0000","last_change":"2024-09-16T01:16:32.986181+0000","last_active":"2024-09-16T01:16:32.993234+0000","last_peered":"2024-09-16T01:16:32.993234+0000","last_clean":"2024-09-16T01:16:32.993234+0000","last_became_active":"2024-09-16T01:16:32.985910+0000","last_became_peered":"2024-09-16T01:16:32.985910+0000","last_unstale":"2024-09-16T01:16:32.993234+0000","last_undegraded":"2024-09-16T01:16:32.993234+0000","last_fullsized":"2024-09-16T01:16:32.993234+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:17.334349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.004800+0000","last_change":"2024-09-16T01:16:31.978132+0000","last_active":"2024-09-16T01:16:33.004800+0000","last_peered":"2024-09-16T01:16:33.004800+0000","last_clean":"2024-09-16T01:16:33.004800+0000","last_became_active":"2024-09-16T01:16:31.977867+0000","last_became_peered":"2024-09-16T01:16:31.977867+0000","last_unstale":"2024-09-16T01:16:33.004800+0000","last_undegraded":"2024-09-16T01:16:33.004800+0000","last_fullsized":"2024-09-16T01:16:33.004800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:22.219326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.997009+0000","last_change":"2024-09-16T01:16:32.989663+0000","last_active":"2024-09-16T01:16:32.997009+0000","last_peered":"2024-09-16T01:16:32.997009+0000","last_clean":"2024-09-16T01:16:32.997009+0000","last_became_active":"2024-09-16T01:16:32.989386+0000","last_became_peered":"2024-09-16T01:16:32.989386+0000","last_unstale":"2024-09-16T01:16:32.997009+0000","last_undegraded":"2024-09-16T01:16:32.997009+0000","last_fullsized":"2024-09-16T01:16:32.997009+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:00.383914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010134+0000","last_change":"2024-09-16T01:16:31.980708+0000","last_active":"2024-09-16T01:16:33.010134+0000","last_peered":"2024-09-16T01:16:33.010134+0000","last_clean":"2024-09-16T01:16:33.010134+0000","last_became_active":"2024-09-16T01:16:31.980400+0000","last_became_peered":"2024-09-16T01:16:31.980400+0000","last_unstale":"2024-09-16T01:16:33.010134+0000","last_undegraded":"2024-09-16T01:16:33.010134+0000","last_fullsized":"2024-09-16T01:16:33.010134+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:33.994520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003756+0000","last_change":"2024-09-16T01:16:32.999591+0000","last_active":"2024-09-16T01:16:33.003756+0000","last_peered":"2024-09-16T01:16:33.003756+0000","last_clean":"2024-09-16T01:16:33.003756+0000","last_became_active":"2024-09-16T01:16:32.998287+0000","last_became_peered":"2024-09-16T01:16:32.998287+0000","last_unstale":"2024-09-16T01:16:33.003756+0000","last_undegraded":"2024-09-16T01:16:33.003756+0000","last_fullsized":"2024-09-16T01:16:33.003756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:23.606455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.007905+0000","last_change":"2024-09-16T01:16:31.979319+0000","last_active":"2024-09-16T01:16:33.007905+0000","last_peered":"2024-09-16T01:16:33.007905+0000","last_clean":"2024-09-16T01:16:33.007905+0000","last_became_active":"2024-09-16T01:16:31.979040+0000","last_became_peered":"2024-09-16T01:16:31.979040+0000","last_unstale":"2024-09-16T01:16:33.007905+0000","last_undegraded":"2024-09-16T01:16:33.007905+0000","last_fullsized":"2024-09-16T01:16:33.007905+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:14.196891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.007650+0000","last_change":"2024-09-16T01:16:33.002222+0000","last_active":"2024-09-16T01:16:33.007650+0000","last_peered":"2024-09-16T01:16:33.007650+0000","last_clean":"2024-09-16T01:16:33.007650+0000","last_became_active":"2024-09-16T01:16:33.001956+0000","last_became_peered":"2024-09-16T01:16:33.001956+0000","last_unstale":"2024-09-16T01:16:33.007650+0000","last_undegraded":"2024-09-16T01:16:33.007650+0000","last_fullsized":"2024-09-16T01:16:33.007650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:47.577734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.980491+0000","last_change":"2024-09-16T01:16:31.984324+0000","last_active":"2024-09-16T01:16:32.980491+0000","last_peered":"2024-09-16T01:16:32.980491+0000","last_clean":"2024-09-16T01:16:32.980491+0000","last_became_active":"2024-09-16T01:16:31.984053+0000","last_became_peered":"2024-09-16T01:16:31.984053+0000","last_unstale":"2024-09-16T01:16:32.980491+0000","last_undegraded":"2024-09-16T01:16:32.980491+0000","last_fullsized":"2024-09-16T01:16:32.980491+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:33.553150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003314+0000","last_change":"2024-09-16T01:16:32.994856+0000","last_active":"2024-09-16T01:16:33.003314+0000","last_peered":"2024-09-16T01:16:33.003314+0000","last_clean":"2024-09-16T01:16:33.003314+0000","last_became_active":"2024-09-16T01:16:32.994547+0000","last_became_peered":"2024-09-16T01:16:32.994547+0000","last_unstale":"2024-09-16T01:16:33.003314+0000","last_undegraded":"2024-09-16T01:16:33.003314+0000","last_fullsized":"2024-09-16T01:16:33.003314+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:16.165512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.979833+0000","last_change":"2024-09-16T01:16:31.971913+0000","last_active":"2024-09-16T01:16:32.979833+0000","last_peered":"2024-09-16T01:16:32.979833+0000","last_clean":"2024-09-16T01:16:32.979833+0000","last_became_active":"2024-09-16T01:16:31.971612+0000","last_became_peered":"2024-09-16T01:16:31.971612+0000","last_unstale":"2024-09-16T01:16:32.979833+0000","last_undegraded":"2024-09-16T01:16:32.979833+0000","last_fullsized":"2024-09-16T01:16:32.979833+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:12.937101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.995796+0000","last_change":"2024-09-16T01:16:32.989287+0000","last_active":"2024-09-16T01:16:32.995796+0000","last_peered":"2024-09-16T01:16:32.995796+0000","last_clean":"2024-09-16T01:16:32.995796+0000","last_became_active":"2024-09-16T01:16:32.988655+0000","last_became_peered":"2024-09-16T01:16:32.988655+0000","last_unstale":"2024-09-16T01:16:32.995796+0000","last_undegraded":"2024-09-16T01:16:32.995796+0000","last_fullsized":"2024-09-16T01:16:32.995796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:36.796830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.979686+0000","last_change":"2024-09-16T01:16:31.976654+0000","last_active":"2024-09-16T01:16:32.979686+0000","last_peered":"2024-09-16T01:16:32.979686+0000","last_clean":"2024-09-16T01:16:32.979686+0000","last_became_active":"2024-09-16T01:16:31.976366+0000","last_became_peered":"2024-09-16T01:16:31.976366+0000","last_unstale":"2024-09-16T01:16:32.979686+0000","last_undegraded":"2024-09-16T01:16:32.979686+0000","last_fullsized":"2024-09-16T01:16:32.979686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:58.315996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996397+0000","last_change":"2024-09-16T01:16:32.991360+0000","last_active":"2024-09-16T01:16:32.996397+0000","last_peered":"2024-09-16T01:16:32.996397+0000","last_clean":"2024-09-16T01:16:32.996397+0000","last_became_active":"2024-09-16T01:16:32.991075+0000","last_became_peered":"2024-09-16T01:16:32.991075+0000","last_unstale":"2024-09-16T01:16:32.996397+0000","last_undegraded":"2024-09-16T01:16:32.996397+0000","last_fullsized":"2024-09-16T01:16:32.996397+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:59.320553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.990770+0000","last_change":"2024-09-16T01:16:31.982339+0000","last_active":"2024-09-16T01:16:32.990770+0000","last_peered":"2024-09-16T01:16:32.990770+0000","last_clean":"2024-09-16T01:16:32.990770+0000","last_became_active":"2024-09-16T01:16:31.981976+0000","last_became_peered":"2024-09-16T01:16:31.981976+0000","last_unstale":"2024-09-16T01:16:32.990770+0000","last_undegraded":"2024-09-16T01:16:32.990770+0000","last_fullsized":"2024-09-16T01:16:32.990770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:14.196891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996511+0000","last_change":"2024-09-16T01:16:32.990935+0000","last_active":"2024-09-16T01:16:32.996511+0000","last_peered":"2024-09-16T01:16:32.996511+0000","last_clean":"2024-09-16T01:16:32.996511+0000","last_became_active":"2024-09-16T01:16:32.990676+0000","last_became_peered":"2024-09-16T01:16:32.990676+0000","last_unstale":"2024-09-16T01:16:32.996511+0000","last_undegraded":"2024-09-16T01:16:32.996511+0000","last_fullsized":"2024-09-16T01:16:32.996511+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:34.999077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010329+0000","last_change":"2024-09-16T01:16:31.977635+0000","last_active":"2024-09-16T01:16:33.010329+0000","last_peered":"2024-09-16T01:16:33.010329+0000","last_clean":"2024-09-16T01:16:33.010329+0000","last_became_active":"2024-09-16T01:16:31.977346+0000","last_became_peered":"2024-09-16T01:16:31.977346+0000","last_unstale":"2024-09-16T01:16:33.010329+0000","last_undegraded":"2024-09-16T01:16:33.010329+0000","last_fullsized":"2024-09-16T01:16:33.010329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:32.157795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.995228+0000","last_change":"2024-09-16T01:16:32.989538+0000","last_active":"2024-09-16T01:16:32.995228+0000","last_peered":"2024-09-16T01:16:32.995228+0000","last_clean":"2024-09-16T01:16:32.995228+0000","last_became_active":"2024-09-16T01:16:32.989262+0000","last_became_peered":"2024-09-16T01:16:32.989262+0000","last_unstale":"2024-09-16T01:16:32.995228+0000","last_undegraded":"2024-09-16T01:16:32.995228+0000","last_fullsized":"2024-09-16T01:16:32.995228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:00.383914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.012626+0000","last_change":"2024-09-16T01:16:31.978417+0000","last_active":"2024-09-16T01:16:33.012626+0000","last_peered":"2024-09-16T01:16:33.012626+0000","last_clean":"2024-09-16T01:16:33.012626+0000","last_became_active":"2024-09-16T01:16:31.978115+0000","last_became_peered":"2024-09-16T01:16:31.978115+0000","last_unstale":"2024-09-16T01:16:33.012626+0000","last_undegraded":"2024-09-16T01:16:33.012626+0000","last_fullsized":"2024-09-16T01:16:33.012626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:58.822918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.009145+0000","last_change":"2024-09-16T01:16:33.002514+0000","last_active":"2024-09-16T01:16:33.009145+0000","last_peered":"2024-09-16T01:16:33.009145+0000","last_clean":"2024-09-16T01:16:33.009145+0000","last_became_active":"2024-09-16T01:16:33.002220+0000","last_became_peered":"2024-09-16T01:16:33.002220+0000","last_unstale":"2024-09-16T01:16:33.009145+0000","last_undegraded":"2024-09-16T01:16:33.009145+0000","last_fullsized":"2024-09-16T01:16:33.009145+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:15.201448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.009511+0000","last_change":"2024-09-16T01:16:31.983149+0000","last_active":"2024-09-16T01:16:33.009511+0000","last_peered":"2024-09-16T01:16:33.009511+0000","last_clean":"2024-09-16T01:16:33.009511+0000","last_became_active":"2024-09-16T01:16:31.982880+0000","last_became_peered":"2024-09-16T01:16:31.982880+0000","last_unstale":"2024-09-16T01:16:33.009511+0000","last_undegraded":"2024-09-16T01:16:33.009511+0000","last_fullsized":"2024-09-16T01:16:33.009511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:14.196891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996199+0000","last_change":"2024-09-16T01:16:32.992498+0000","last_active":"2024-09-16T01:16:32.996199+0000","last_peered":"2024-09-16T01:16:32.996199+0000","last_clean":"2024-09-16T01:16:32.996199+0000","last_became_active":"2024-09-16T01:16:32.992017+0000","last_became_peered":"2024-09-16T01:16:32.992017+0000","last_unstale":"2024-09-16T01:16:32.996199+0000","last_undegraded":"2024-09-16T01:16:32.996199+0000","last_fullsized":"2024-09-16T01:16:32.996199+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:43.595520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.982057+0000","last_change":"2024-09-16T01:16:31.985790+0000","last_active":"2024-09-16T01:16:32.982057+0000","last_peered":"2024-09-16T01:16:32.982057+0000","last_clean":"2024-09-16T01:16:32.982057+0000","last_became_active":"2024-09-16T01:16:31.985497+0000","last_became_peered":"2024-09-16T01:16:31.985497+0000","last_unstale":"2024-09-16T01:16:32.982057+0000","last_undegraded":"2024-09-16T01:16:32.982057+0000","last_fullsized":"2024-09-16T01:16:32.982057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:59.379357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.998034+0000","last_change":"2024-09-16T01:16:32.993239+0000","last_active":"2024-09-16T01:16:32.998034+0000","last_peered":"2024-09-16T01:16:32.998034+0000","last_clean":"2024-09-16T01:16:32.998034+0000","last_became_active":"2024-09-16T01:16:32.992883+0000","last_became_peered":"2024-09-16T01:16:32.992883+0000","last_unstale":"2024-09-16T01:16:32.998034+0000","last_undegraded":"2024-09-16T01:16:32.998034+0000","last_fullsized":"2024-09-16T01:16:32.998034+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:17.334349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.979296+0000","last_change":"2024-09-16T01:16:31.978418+0000","last_active":"2024-09-16T01:16:32.979296+0000","last_peered":"2024-09-16T01:16:32.979296+0000","last_clean":"2024-09-16T01:16:32.979296+0000","last_became_active":"2024-09-16T01:16:31.978050+0000","last_became_peered":"2024-09-16T01:16:31.978050+0000","last_unstale":"2024-09-16T01:16:32.979296+0000","last_undegraded":"2024-09-16T01:16:32.979296+0000","last_fullsized":"2024-09-16T01:16:32.979296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:03:50.267552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996292+0000","last_change":"2024-09-16T01:16:32.992307+0000","last_active":"2024-09-16T01:16:32.996292+0000","last_peered":"2024-09-16T01:16:32.996292+0000","last_clean":"2024-09-16T01:16:32.996292+0000","last_became_active":"2024-09-16T01:16:32.992050+0000","last_became_peered":"2024-09-16T01:16:32.992050+0000","last_unstale":"2024-09-16T01:16:32.996292+0000","last_undegraded":"2024-09-16T01:16:32.996292+0000","last_fullsized":"2024-09-16T01:16:32.996292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:56.771628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010959+0000","last_change":"2024-09-16T01:16:31.981494+0000","last_active":"2024-09-16T01:16:33.010959+0000","last_peered":"2024-09-16T01:16:33.010959+0000","last_clean":"2024-09-16T01:16:33.010959+0000","last_became_active":"2024-09-16T01:16:31.981218+0000","last_became_peered":"2024-09-16T01:16:31.981218+0000","last_unstale":"2024-09-16T01:16:33.010959+0000","last_undegraded":"2024-09-16T01:16:33.010959+0000","last_fullsized":"2024-09-16T01:16:33.010959+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:13.966221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.993003+0000","last_change":"2024-09-16T01:16:32.984608+0000","last_active":"2024-09-16T01:16:32.993003+0000","last_peered":"2024-09-16T01:16:32.993003+0000","last_clean":"2024-09-16T01:16:32.993003+0000","last_became_active":"2024-09-16T01:16:32.984315+0000","last_became_peered":"2024-09-16T01:16:32.984315+0000","last_unstale":"2024-09-16T01:16:32.993003+0000","last_undegraded":"2024-09-16T01:16:32.993003+0000","last_fullsized":"2024-09-16T01:16:32.993003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:56.381615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010343+0000","last_change":"2024-09-16T01:16:31.980996+0000","last_active":"2024-09-16T01:16:33.010343+0000","last_peered":"2024-09-16T01:16:33.010343+0000","last_clean":"2024-09-16T01:16:33.010343+0000","last_became_active":"2024-09-16T01:16:31.980698+0000","last_became_peered":"2024-09-16T01:16:31.980698+0000","last_unstale":"2024-09-16T01:16:33.010343+0000","last_undegraded":"2024-09-16T01:16:33.010343+0000","last_fullsized":"2024-09-16T01:16:33.010343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:13.966221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.001621+0000","last_change":"2024-09-16T01:16:32.993599+0000","last_active":"2024-09-16T01:16:33.001621+0000","last_peered":"2024-09-16T01:16:33.001621+0000","last_clean":"2024-09-16T01:16:33.001621+0000","last_became_active":"2024-09-16T01:16:32.993305+0000","last_became_peered":"2024-09-16T01:16:32.993305+0000","last_unstale":"2024-09-16T01:16:33.001621+0000","last_undegraded":"2024-09-16T01:16:33.001621+0000","last_fullsized":"2024-09-16T01:16:33.001621+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:59.320553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010720+0000","last_change":"2024-09-16T01:16:31.981009+0000","last_active":"2024-09-16T01:16:33.010720+0000","last_peered":"2024-09-16T01:16:33.010720+0000","last_clean":"2024-09-16T01:16:33.010720+0000","last_became_active":"2024-09-16T01:16:31.980756+0000","last_became_peered":"2024-09-16T01:16:31.980756+0000","last_unstale":"2024-09-16T01:16:33.010720+0000","last_undegraded":"2024-09-16T01:16:33.010720+0000","last_fullsized":"2024-09-16T01:16:33.010720+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:54.423931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996868+0000","last_change":"2024-09-16T01:16:32.992941+0000","last_active":"2024-09-16T01:16:32.996868+0000","last_peered":"2024-09-16T01:16:32.996868+0000","last_clean":"2024-09-16T01:16:32.996868+0000","last_became_active":"2024-09-16T01:16:32.992656+0000","last_became_peered":"2024-09-16T01:16:32.992656+0000","last_unstale":"2024-09-16T01:16:32.996868+0000","last_undegraded":"2024-09-16T01:16:32.996868+0000","last_fullsized":"2024-09-16T01:16:32.996868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:34.999077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.005679+0000","last_change":"2024-09-16T01:16:31.978228+0000","last_active":"2024-09-16T01:16:33.005679+0000","last_peered":"2024-09-16T01:16:33.005679+0000","last_clean":"2024-09-16T01:16:33.005679+0000","last_became_active":"2024-09-16T01:16:31.977960+0000","last_became_peered":"2024-09-16T01:16:31.977960+0000","last_unstale":"2024-09-16T01:16:33.005679+0000","last_undegraded":"2024-09-16T01:16:33.005679+0000","last_fullsized":"2024-09-16T01:16:33.005679+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:56.210995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.991331+0000","last_change":"2024-09-16T01:16:32.986666+0000","last_active":"2024-09-16T01:16:32.991331+0000","last_peered":"2024-09-16T01:16:32.991331+0000","last_clean":"2024-09-16T01:16:32.991331+0000","last_became_active":"2024-09-16T01:16:32.985230+0000","last_became_peered":"2024-09-16T01:16:32.985230+0000","last_unstale":"2024-09-16T01:16:32.991331+0000","last_undegraded":"2024-09-16T01:16:32.991331+0000","last_fullsized":"2024-09-16T01:16:32.991331+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:01.119263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.982283+0000","last_change":"2024-09-16T01:16:31.984576+0000","last_active":"2024-09-16T01:16:32.982283+0000","last_peered":"2024-09-16T01:16:32.982283+0000","last_clean":"2024-09-16T01:16:32.982283+0000","last_became_active":"2024-09-16T01:16:31.984302+0000","last_became_peered":"2024-09-16T01:16:31.984302+0000","last_unstale":"2024-09-16T01:16:32.982283+0000","last_undegraded":"2024-09-16T01:16:32.982283+0000","last_fullsized":"2024-09-16T01:16:32.982283+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:33.994520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.998139+0000","last_change":"2024-09-16T01:16:32.992345+0000","last_active":"2024-09-16T01:16:32.998139+0000","last_peered":"2024-09-16T01:16:32.998139+0000","last_clean":"2024-09-16T01:16:32.998139+0000","last_became_active":"2024-09-16T01:16:32.992011+0000","last_became_peered":"2024-09-16T01:16:32.992011+0000","last_unstale":"2024-09-16T01:16:32.998139+0000","last_undegraded":"2024-09-16T01:16:32.998139+0000","last_fullsized":"2024-09-16T01:16:32.998139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:59.827475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.009355+0000","last_change":"2024-09-16T01:16:31.982873+0000","last_active":"2024-09-16T01:16:33.009355+0000","last_peered":"2024-09-16T01:16:33.009355+0000","last_clean":"2024-09-16T01:16:33.009355+0000","last_became_active":"2024-09-16T01:16:31.982606+0000","last_became_peered":"2024-09-16T01:16:31.982606+0000","last_unstale":"2024-09-16T01:16:33.009355+0000","last_undegraded":"2024-09-16T01:16:33.009355+0000","last_fullsized":"2024-09-16T01:16:33.009355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:29.984341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996933+0000","last_change":"2024-09-16T01:16:32.995519+0000","last_active":"2024-09-16T01:16:32.996933+0000","last_peered":"2024-09-16T01:16:32.996933+0000","last_clean":"2024-09-16T01:16:32.996933+0000","last_became_active":"2024-09-16T01:16:32.995240+0000","last_became_peered":"2024-09-16T01:16:32.995240+0000","last_unstale":"2024-09-16T01:16:32.996933+0000","last_undegraded":"2024-09-16T01:16:32.996933+0000","last_fullsized":"2024-09-16T01:16:32.996933+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:33.162352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.973599+0000","last_change":"2024-09-16T01:16:31.978052+0000","last_active":"2024-09-16T01:16:32.973599+0000","last_peered":"2024-09-16T01:16:32.973599+0000","last_clean":"2024-09-16T01:16:32.973599+0000","last_became_active":"2024-09-16T01:16:31.977746+0000","last_became_peered":"2024-09-16T01:16:31.977746+0000","last_unstale":"2024-09-16T01:16:32.973599+0000","last_undegraded":"2024-09-16T01:16:32.973599+0000","last_fullsized":"2024-09-16T01:16:32.973599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:04:43.142361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.002589+0000","last_change":"2024-09-16T01:16:32.997002+0000","last_active":"2024-09-16T01:16:33.002589+0000","last_peered":"2024-09-16T01:16:33.002589+0000","last_clean":"2024-09-16T01:16:33.002589+0000","last_became_active":"2024-09-16T01:16:32.996728+0000","last_became_peered":"2024-09-16T01:16:32.996728+0000","last_unstale":"2024-09-16T01:16:33.002589+0000","last_undegraded":"2024-09-16T01:16:33.002589+0000","last_fullsized":"2024-09-16T01:16:33.002589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:50.788597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.982286+0000","last_change":"2024-09-16T01:16:31.980527+0000","last_active":"2024-09-16T01:16:32.982286+0000","last_peered":"2024-09-16T01:16:32.982286+0000","last_clean":"2024-09-16T01:16:32.982286+0000","last_became_active":"2024-09-16T01:16:31.980258+0000","last_became_peered":"2024-09-16T01:16:31.980258+0000","last_unstale":"2024-09-16T01:16:32.982286+0000","last_undegraded":"2024-09-16T01:16:32.982286+0000","last_fullsized":"2024-09-16T01:16:32.982286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:46.573177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003339+0000","last_change":"2024-09-16T01:16:32.995085+0000","last_active":"2024-09-16T01:16:33.003339+0000","last_peered":"2024-09-16T01:16:33.003339+0000","last_clean":"2024-09-16T01:16:33.003339+0000","last_became_active":"2024-09-16T01:16:32.994260+0000","last_became_peered":"2024-09-16T01:16:32.994260+0000","last_unstale":"2024-09-16T01:16:33.003339+0000","last_undegraded":"2024-09-16T01:16:33.003339+0000","last_fullsized":"2024-09-16T01:16:33.003339+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:35.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.973377+0000","last_change":"2024-09-16T01:16:31.983582+0000","last_active":"2024-09-16T01:16:32.973377+0000","last_peered":"2024-09-16T01:16:32.973377+0000","last_clean":"2024-09-16T01:16:32.973377+0000","last_became_active":"2024-09-16T01:16:31.983298+0000","last_became_peered":"2024-09-16T01:16:31.983298+0000","last_unstale":"2024-09-16T01:16:32.973377+0000","last_undegraded":"2024-09-16T01:16:32.973377+0000","last_fullsized":"2024-09-16T01:16:32.973377+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:58.178845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.005042+0000","last_change":"2024-09-16T01:16:33.001837+0000","last_active":"2024-09-16T01:16:33.005042+0000","last_peered":"2024-09-16T01:16:33.005042+0000","last_clean":"2024-09-16T01:16:33.005042+0000","last_became_active":"2024-09-16T01:16:33.001572+0000","last_became_peered":"2024-09-16T01:16:33.001572+0000","last_unstale":"2024-09-16T01:16:33.005042+0000","last_undegraded":"2024-09-16T01:16:33.005042+0000","last_fullsized":"2024-09-16T01:16:33.005042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:59.827475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010101+0000","last_change":"2024-09-16T01:16:31.984591+0000","last_active":"2024-09-16T01:16:33.010101+0000","last_peered":"2024-09-16T01:16:33.010101+0000","last_clean":"2024-09-16T01:16:33.010101+0000","last_became_active":"2024-09-16T01:16:31.984304+0000","last_became_peered":"2024-09-16T01:16:31.984304+0000","last_unstale":"2024-09-16T01:16:33.010101+0000","last_undegraded":"2024-09-16T01:16:33.010101+0000","last_fullsized":"2024-09-16T01:16:33.010101+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:46.573177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.000326+0000","last_change":"2024-09-16T01:16:32.995763+0000","last_active":"2024-09-16T01:16:33.000326+0000","last_peered":"2024-09-16T01:16:33.000326+0000","last_clean":"2024-09-16T01:16:33.000326+0000","last_became_active":"2024-09-16T01:16:32.995503+0000","last_became_peered":"2024-09-16T01:16:32.995503+0000","last_unstale":"2024-09-16T01:16:33.000326+0000","last_undegraded":"2024-09-16T01:16:33.000326+0000","last_fullsized":"2024-09-16T01:16:33.000326+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.973535+0000","last_change":"2024-09-16T01:16:31.981481+0000","last_active":"2024-09-16T01:16:32.973535+0000","last_peered":"2024-09-16T01:16:32.973535+0000","last_clean":"2024-09-16T01:16:32.973535+0000","last_became_active":"2024-09-16T01:16:31.981206+0000","last_became_peered":"2024-09-16T01:16:31.981206+0000","last_unstale":"2024-09-16T01:16:32.973535+0000","last_undegraded":"2024-09-16T01:16:32.973535+0000","last_fullsized":"2024-09-16T01:16:32.973535+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:03.525714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.995019+0000","last_change":"2024-09-16T01:16:32.988627+0000","last_active":"2024-09-16T01:16:32.995019+0000","last_peered":"2024-09-16T01:16:32.995019+0000","last_clean":"2024-09-16T01:16:32.995019+0000","last_became_active":"2024-09-16T01:16:32.988359+0000","last_became_peered":"2024-09-16T01:16:32.988359+0000","last_unstale":"2024-09-16T01:16:32.995019+0000","last_undegraded":"2024-09-16T01:16:32.995019+0000","last_fullsized":"2024-09-16T01:16:32.995019+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.978704+0000","last_change":"2024-09-16T01:16:31.980470+0000","last_active":"2024-09-16T01:16:32.978704+0000","last_peered":"2024-09-16T01:16:32.978704+0000","last_clean":"2024-09-16T01:16:32.978704+0000","last_became_active":"2024-09-16T01:16:31.980185+0000","last_became_peered":"2024-09-16T01:16:31.980185+0000","last_unstale":"2024-09-16T01:16:32.978704+0000","last_undegraded":"2024-09-16T01:16:32.978704+0000","last_fullsized":"2024-09-16T01:16:32.978704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:54.423931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996988+0000","last_change":"2024-09-16T01:16:32.986506+0000","last_active":"2024-09-16T01:16:32.996988+0000","last_peered":"2024-09-16T01:16:32.996988+0000","last_clean":"2024-09-16T01:16:32.996988+0000","last_became_active":"2024-09-16T01:16:32.986175+0000","last_became_peered":"2024-09-16T01:16:32.986175+0000","last_unstale":"2024-09-16T01:16:32.996988+0000","last_undegraded":"2024-09-16T01:16:32.996988+0000","last_fullsized":"2024-09-16T01:16:32.996988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:34.557706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.981487+0000","last_change":"2024-09-16T01:16:31.980786+0000","last_active":"2024-09-16T01:16:32.981487+0000","last_peered":"2024-09-16T01:16:32.981487+0000","last_clean":"2024-09-16T01:16:32.981487+0000","last_became_active":"2024-09-16T01:16:31.980519+0000","last_became_peered":"2024-09-16T01:16:31.980519+0000","last_unstale":"2024-09-16T01:16:32.981487+0000","last_undegraded":"2024-09-16T01:16:32.981487+0000","last_fullsized":"2024-09-16T01:16:32.981487+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:22.219326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.997940+0000","last_change":"2024-09-16T01:16:32.995252+0000","last_active":"2024-09-16T01:16:32.997940+0000","last_peered":"2024-09-16T01:16:32.997940+0000","last_clean":"2024-09-16T01:16:32.997940+0000","last_became_active":"2024-09-16T01:16:32.994990+0000","last_became_peered":"2024-09-16T01:16:32.994990+0000","last_unstale":"2024-09-16T01:16:32.997940+0000","last_undegraded":"2024-09-16T01:16:32.997940+0000","last_fullsized":"2024-09-16T01:16:32.997940+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:47.577734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.979603+0000","last_change":"2024-09-16T01:16:31.980900+0000","last_active":"2024-09-16T01:16:32.979603+0000","last_peered":"2024-09-16T01:16:32.979603+0000","last_clean":"2024-09-16T01:16:32.979603+0000","last_became_active":"2024-09-16T01:16:31.980635+0000","last_became_peered":"2024-09-16T01:16:31.980635+0000","last_unstale":"2024-09-16T01:16:32.979603+0000","last_undegraded":"2024-09-16T01:16:32.979603+0000","last_fullsized":"2024-09-16T01:16:32.979603+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:12.937101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.995920+0000","last_change":"2024-09-16T01:16:32.987733+0000","last_active":"2024-09-16T01:16:32.995920+0000","last_peered":"2024-09-16T01:16:32.995920+0000","last_clean":"2024-09-16T01:16:32.995920+0000","last_became_active":"2024-09-16T01:16:32.987351+0000","last_became_peered":"2024-09-16T01:16:32.987351+0000","last_unstale":"2024-09-16T01:16:32.995920+0000","last_undegraded":"2024-09-16T01:16:32.995920+0000","last_fullsized":"2024-09-16T01:16:32.995920+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:49.573942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.980709+0000","last_change":"2024-09-16T01:16:31.978672+0000","last_active":"2024-09-16T01:16:32.980709+0000","last_peered":"2024-09-16T01:16:32.980709+0000","last_clean":"2024-09-16T01:16:32.980709+0000","last_became_active":"2024-09-16T01:16:31.978429+0000","last_became_peered":"2024-09-16T01:16:31.978429+0000","last_unstale":"2024-09-16T01:16:32.980709+0000","last_undegraded":"2024-09-16T01:16:32.980709+0000","last_fullsized":"2024-09-16T01:16:32.980709+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:27.450409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003501+0000","last_change":"2024-09-16T01:16:32.996857+0000","last_active":"2024-09-16T01:16:33.003501+0000","last_peered":"2024-09-16T01:16:33.003501+0000","last_clean":"2024-09-16T01:16:33.003501+0000","last_became_active":"2024-09-16T01:16:32.996438+0000","last_became_peered":"2024-09-16T01:16:32.996438+0000","last_unstale":"2024-09-16T01:16:33.003501+0000","last_undegraded":"2024-09-16T01:16:33.003501+0000","last_fullsized":"2024-09-16T01:16:33.003501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:56.771628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.979620+0000","last_change":"2024-09-16T01:16:31.981160+0000","last_active":"2024-09-16T01:16:32.979620+0000","last_peered":"2024-09-16T01:16:32.979620+0000","last_clean":"2024-09-16T01:16:32.979620+0000","last_became_active":"2024-09-16T01:16:31.980857+0000","last_became_peered":"2024-09-16T01:16:31.980857+0000","last_unstale":"2024-09-16T01:16:32.979620+0000","last_undegraded":"2024-09-16T01:16:32.979620+0000","last_fullsized":"2024-09-16T01:16:32.979620+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:46.573177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003305+0000","last_change":"2024-09-16T01:16:32.998115+0000","last_active":"2024-09-16T01:16:33.003305+0000","last_peered":"2024-09-16T01:16:33.003305+0000","last_clean":"2024-09-16T01:16:33.003305+0000","last_became_active":"2024-09-16T01:16:32.997844+0000","last_became_peered":"2024-09-16T01:16:32.997844+0000","last_unstale":"2024-09-16T01:16:33.003305+0000","last_undegraded":"2024-09-16T01:16:33.003305+0000","last_fullsized":"2024-09-16T01:16:33.003305+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.981555+0000","last_change":"2024-09-16T01:16:31.983389+0000","last_active":"2024-09-16T01:16:32.981555+0000","last_peered":"2024-09-16T01:16:32.981555+0000","last_clean":"2024-09-16T01:16:32.981555+0000","last_became_active":"2024-09-16T01:16:31.982950+0000","last_became_peered":"2024-09-16T01:16:31.982950+0000","last_unstale":"2024-09-16T01:16:32.981555+0000","last_undegraded":"2024-09-16T01:16:32.981555+0000","last_fullsized":"2024-09-16T01:16:32.981555+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:32.157795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.982262+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:16:32.982262+0000","last_peered":"2024-09-16T01:16:32.982262+0000","last_clean":"2024-09-16T01:16:32.982262+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:16:32.982262+0000","last_undegraded":"2024-09-16T01:16:32.982262+0000","last_fullsized":"2024-09-16T01:16:32.982262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":759727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":169359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":169359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":169359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":413696,"data_stored":176526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":169359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":759727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:16:35.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:16:36.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.056+0000 7fb2024d7640 1 Processor -- start 2024-09-16T01:16:36.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.056+0000 7fb2024d7640 1 -- start start 2024-09-16T01:16:36.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb2024d7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1fc15c490 0x7fb1fc09b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb2024d7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1fc09b980 0x7fb1fc15c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb2024d7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb1fc15cdb0 0x7fb1fc15ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb2024d7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb1fc0cff70 con 0x7fb1fc15c490 2024-09-16T01:16:36.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb2024d7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb1fc0d0dd0 con 0x7fb1fc15cdb0 2024-09-16T01:16:36.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb2024d7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb1fc0d01c0 con 0x7fb1fc09b980 2024-09-16T01:16:36.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb1fbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1fc15c490 0x7fb1fc09b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb1fbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1fc15c490 0x7fb1fc09b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39732/0 (socket says 172.21.15.81:39732) 2024-09-16T01:16:36.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb1fbfff640 1 -- 172.21.15.81:0/4228972281 learned_addr learned my addr 172.21.15.81:0/4228972281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:36.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb1fb7fe640 1 --2- 172.21.15.81:0/4228972281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1fc09b980 0x7fb1fc15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb200a74640 1 --2- 172.21.15.81:0/4228972281 >> v2:172.21.15.102:3300/0 conn(0x7fb1fc15cdb0 0x7fb1fc15ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb1fbfff640 1 -- 172.21.15.81:0/4228972281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1fc09b980 msgr2=0x7fb1fc15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb1fbfff640 1 --2- 172.21.15.81:0/4228972281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1fc09b980 0x7fb1fc15c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb1fbfff640 1 -- 172.21.15.81:0/4228972281 >> v2:172.21.15.102:3300/0 conn(0x7fb1fc15cdb0 msgr2=0x7fb1fc15ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb1fbfff640 1 --2- 172.21.15.81:0/4228972281 >> v2:172.21.15.102:3300/0 conn(0x7fb1fc15cdb0 0x7fb1fc15ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb1fbfff640 1 -- 172.21.15.81:0/4228972281 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1fc0d04a0 con 0x7fb1fc15c490 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.057+0000 7fb200a74640 1 --2- 172.21.15.81:0/4228972281 >> v2:172.21.15.102:3300/0 conn(0x7fb1fc15cdb0 0x7fb1fc15ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.058+0000 7fb1fbfff640 1 --2- 172.21.15.81:0/4228972281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1fc15c490 0x7fb1fc09b440 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc072390 tx=0x7fb1ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50bdda0ffd78920b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.058+0000 7fb1faffd640 1 -- 172.21.15.81:0/4228972281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec037070 con 0x7fb1fc15c490 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.058+0000 7fb1faffd640 1 -- 172.21.15.81:0/4228972281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ec032440 con 0x7fb1fc15c490 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.058+0000 7fb1faffd640 1 -- 172.21.15.81:0/4228972281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ec032810 con 0x7fb1fc15c490 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.059+0000 7fb2024d7640 1 -- 172.21.15.81:0/4228972281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1fc15c490 msgr2=0x7fb1fc09b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.059+0000 7fb2024d7640 1 --2- 172.21.15.81:0/4228972281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1fc15c490 0x7fb1fc09b440 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc072390 tx=0x7fb1ec02a270 comp rx=0 tx=0).stop 2024-09-16T01:16:36.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.059+0000 7fb2024d7640 1 -- 172.21.15.81:0/4228972281 shutdown_connections 2024-09-16T01:16:36.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.059+0000 7fb2024d7640 1 --2- 172.21.15.81:0/4228972281 >> v2:172.21.15.102:3300/0 conn(0x7fb1fc15cdb0 0x7fb1fc15ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.059+0000 7fb2024d7640 1 --2- 172.21.15.81:0/4228972281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1fc09b980 0x7fb1fc15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.059+0000 7fb2024d7640 1 --2- 172.21.15.81:0/4228972281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1fc15c490 0x7fb1fc09b440 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.059+0000 7fb2024d7640 1 -- 172.21.15.81:0/4228972281 >> 172.21.15.81:0/4228972281 conn(0x7fb1fc0d23a0 msgr2=0x7fb1fc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:36.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.059+0000 7fb2024d7640 1 -- 172.21.15.81:0/4228972281 shutdown_connections 2024-09-16T01:16:36.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.059+0000 7fb2024d7640 1 -- 172.21.15.81:0/4228972281 wait complete. 2024-09-16T01:16:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.060+0000 7fb2024d7640 1 Processor -- start 2024-09-16T01:16:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.060+0000 7fb2024d7640 1 -- start start 2024-09-16T01:16:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb2024d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1fc09b980 0x7fb1fc1f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb2024d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1fc15c490 0x7fb1fc0b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb2024d7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1fc15cdb0 0x7fb1fc1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb2024d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1fc15d260 con 0x7fb1fc15c490 2024-09-16T01:16:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb2024d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb1fc0d0a60 con 0x7fb1fc09b980 2024-09-16T01:16:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb2024d7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb1fc0d1260 con 0x7fb1fc15cdb0 2024-09-16T01:16:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb1fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1fc15c490 0x7fb1fc0b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb1fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1fc15c490 0x7fb1fc0b6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39738/0 (socket says 172.21.15.81:39738) 2024-09-16T01:16:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb1fb7fe640 1 -- 172.21.15.81:0/1820642993 learned_addr learned my addr 172.21.15.81:0/1820642993 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb1fbfff640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1fc09b980 0x7fb1fc1f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb200a74640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1fc15cdb0 0x7fb1fc1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb1fb7fe640 1 -- 172.21.15.81:0/1820642993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1fc15cdb0 msgr2=0x7fb1fc1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb1fb7fe640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1fc15cdb0 0x7fb1fc1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb1fb7fe640 1 -- 172.21.15.81:0/1820642993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1fc09b980 msgr2=0x7fb1fc1f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb1fb7fe640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1fc09b980 0x7fb1fc1f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb1fb7fe640 1 -- 172.21.15.81:0/1820642993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1fc0b7a60 con 0x7fb1fc15c490 2024-09-16T01:16:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.061+0000 7fb1fbfff640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1fc09b980 0x7fb1fc1f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.062+0000 7fb1fb7fe640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1fc15c490 0x7fb1fc0b6ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000d7d0 tx=0x7fb1f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.062+0000 7fb1f8ff9640 1 -- 172.21.15.81:0/1820642993 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0004020 con 0x7fb1fc15c490 2024-09-16T01:16:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.062+0000 7fb1f8ff9640 1 -- 172.21.15.81:0/1820642993 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f00041e0 con 0x7fb1fc15c490 2024-09-16T01:16:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.062+0000 7fb2024d7640 1 -- 172.21.15.81:0/1820642993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1fc1f57d0 con 0x7fb1fc15c490 2024-09-16T01:16:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.062+0000 7fb1f8ff9640 1 -- 172.21.15.81:0/1820642993 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f00043d0 con 0x7fb1fc15c490 2024-09-16T01:16:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.062+0000 7fb2024d7640 1 -- 172.21.15.81:0/1820642993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1fc0b7cd0 con 0x7fb1fc15c490 2024-09-16T01:16:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.063+0000 7fb2024d7640 1 -- 172.21.15.81:0/1820642993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1fc15c870 con 0x7fb1fc15c490 2024-09-16T01:16:36.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.063+0000 7fb1f8ff9640 1 -- 172.21.15.81:0/1820642993 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb1f001b020 con 0x7fb1fc15c490 2024-09-16T01:16:36.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.064+0000 7fb1f8ff9640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb1e806c2b0 0x7fb1e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.064+0000 7fb1f8ff9640 1 -- 172.21.15.81:0/1820642993 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fb1f008b3a0 con 0x7fb1fc15c490 2024-09-16T01:16:36.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.064+0000 7fb1fbfff640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb1e806c2b0 0x7fb1e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.064+0000 7fb1fbfff640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb1e806c2b0 0x7fb1e806e770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec034000 tx=0x7fb1ec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:36.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.068+0000 7fb1f8ff9640 1 -- 172.21.15.81:0/1820642993 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb1fc1f57d0 con 0x7fb1fc15c490 2024-09-16T01:16:36.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.234+0000 7fb2024d7640 1 -- 172.21.15.81:0/1820642993 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1fc09be60 con 0x7fb1e806c2b0 2024-09-16T01:16:36.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.240+0000 7fb1f8ff9640 1 -- 172.21.15.81:0/1820642993 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251882 (secure 0 0 0) 0x7fb1fc09be60 con 0x7fb1e806c2b0 2024-09-16T01:16:36.245 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:36.246 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:16:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.244+0000 7fb2024d7640 1 -- 172.21.15.81:0/1820642993 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb1e806c2b0 msgr2=0x7fb1e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.244+0000 7fb2024d7640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb1e806c2b0 0x7fb1e806e770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec034000 tx=0x7fb1ec02e000 comp rx=0 tx=0).stop 2024-09-16T01:16:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.244+0000 7fb2024d7640 1 -- 172.21.15.81:0/1820642993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1fc15c490 msgr2=0x7fb1fc0b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.244+0000 7fb2024d7640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1fc15c490 0x7fb1fc0b6ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000d7d0 tx=0x7fb1f000dc90 comp rx=0 tx=0).stop 2024-09-16T01:16:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.244+0000 7fb2024d7640 1 -- 172.21.15.81:0/1820642993 shutdown_connections 2024-09-16T01:16:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.244+0000 7fb2024d7640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb1e806c2b0 0x7fb1e806e770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.244+0000 7fb2024d7640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1fc15cdb0 0x7fb1fc1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.244+0000 7fb2024d7640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1fc15c490 0x7fb1fc0b6ce0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.244+0000 7fb2024d7640 1 --2- 172.21.15.81:0/1820642993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1fc09b980 0x7fb1fc1f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.244+0000 7fb2024d7640 1 -- 172.21.15.81:0/1820642993 >> 172.21.15.81:0/1820642993 conn(0x7fb1fc0d23a0 msgr2=0x7fb1fc070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.244+0000 7fb2024d7640 1 -- 172.21.15.81:0/1820642993 shutdown_connections 2024-09-16T01:16:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.244+0000 7fb2024d7640 1 -- 172.21.15.81:0/1820642993 wait complete. 2024-09-16T01:16:36.257 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-09-16T01:16:36.069941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220552,"kb_used_data":4324,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754168,"statfs":{"total":773094113280,"available":772868268032,"internally_reserved":0,"allocated":4427776,"data_stored":2550012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.109147"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996343+0000","last_change":"2024-09-16T01:16:32.993080+0000","last_active":"2024-09-16T01:16:32.996343+0000","last_peered":"2024-09-16T01:16:32.996343+0000","last_clean":"2024-09-16T01:16:32.996343+0000","last_became_active":"2024-09-16T01:16:32.991866+0000","last_became_peered":"2024-09-16T01:16:32.991866+0000","last_unstale":"2024-09-16T01:16:32.996343+0000","last_undegraded":"2024-09-16T01:16:32.996343+0000","last_fullsized":"2024-09-16T01:16:32.996343+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:23.606455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.992497+0000","last_change":"2024-09-16T01:16:32.984711+0000","last_active":"2024-09-16T01:16:32.992497+0000","last_peered":"2024-09-16T01:16:32.992497+0000","last_clean":"2024-09-16T01:16:32.992497+0000","last_became_active":"2024-09-16T01:16:32.984415+0000","last_became_peered":"2024-09-16T01:16:32.984415+0000","last_unstale":"2024-09-16T01:16:32.992497+0000","last_undegraded":"2024-09-16T01:16:32.992497+0000","last_fullsized":"2024-09-16T01:16:32.992497+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:50.788597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.009102+0000","last_change":"2024-09-16T01:16:33.001847+0000","last_active":"2024-09-16T01:16:33.009102+0000","last_peered":"2024-09-16T01:16:33.009102+0000","last_clean":"2024-09-16T01:16:33.009102+0000","last_became_active":"2024-09-16T01:16:33.001551+0000","last_became_peered":"2024-09-16T01:16:33.001551+0000","last_unstale":"2024-09-16T01:16:33.009102+0000","last_undegraded":"2024-09-16T01:16:33.009102+0000","last_fullsized":"2024-09-16T01:16:33.009102+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:47.577734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.995821+0000","last_change":"2024-09-16T01:16:32.989556+0000","last_active":"2024-09-16T01:16:32.995821+0000","last_peered":"2024-09-16T01:16:32.995821+0000","last_clean":"2024-09-16T01:16:32.995821+0000","last_became_active":"2024-09-16T01:16:32.989026+0000","last_became_peered":"2024-09-16T01:16:32.989026+0000","last_unstale":"2024-09-16T01:16:32.995821+0000","last_undegraded":"2024-09-16T01:16:32.995821+0000","last_fullsized":"2024-09-16T01:16:32.995821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:46.517261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.991199+0000","last_change":"2024-09-16T01:16:32.983168+0000","last_active":"2024-09-16T01:16:32.991199+0000","last_peered":"2024-09-16T01:16:32.991199+0000","last_clean":"2024-09-16T01:16:32.991199+0000","last_became_active":"2024-09-16T01:16:32.982880+0000","last_became_peered":"2024-09-16T01:16:32.982880+0000","last_unstale":"2024-09-16T01:16:32.991199+0000","last_undegraded":"2024-09-16T01:16:32.991199+0000","last_fullsized":"2024-09-16T01:16:32.991199+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:57:58.197440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.993210+0000","last_change":"2024-09-16T01:16:32.987908+0000","last_active":"2024-09-16T01:16:32.993210+0000","last_peered":"2024-09-16T01:16:32.993210+0000","last_clean":"2024-09-16T01:16:32.993210+0000","last_became_active":"2024-09-16T01:16:32.987617+0000","last_became_peered":"2024-09-16T01:16:32.987617+0000","last_unstale":"2024-09-16T01:16:32.993210+0000","last_undegraded":"2024-09-16T01:16:32.993210+0000","last_fullsized":"2024-09-16T01:16:32.993210+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:33.162352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003245+0000","last_change":"2024-09-16T01:16:32.998565+0000","last_active":"2024-09-16T01:16:33.003245+0000","last_peered":"2024-09-16T01:16:33.003245+0000","last_clean":"2024-09-16T01:16:33.003245+0000","last_became_active":"2024-09-16T01:16:32.996265+0000","last_became_peered":"2024-09-16T01:16:32.996265+0000","last_unstale":"2024-09-16T01:16:33.003245+0000","last_undegraded":"2024-09-16T01:16:33.003245+0000","last_fullsized":"2024-09-16T01:16:33.003245+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:56.771628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996698+0000","last_change":"2024-09-16T01:16:32.993716+0000","last_active":"2024-09-16T01:16:32.996698+0000","last_peered":"2024-09-16T01:16:32.996698+0000","last_clean":"2024-09-16T01:16:32.996698+0000","last_became_active":"2024-09-16T01:16:32.993454+0000","last_became_peered":"2024-09-16T01:16:32.993454+0000","last_unstale":"2024-09-16T01:16:32.996698+0000","last_undegraded":"2024-09-16T01:16:32.996698+0000","last_fullsized":"2024-09-16T01:16:32.996698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:23.994772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.009077+0000","last_change":"2024-09-16T01:16:33.001127+0000","last_active":"2024-09-16T01:16:33.009077+0000","last_peered":"2024-09-16T01:16:33.009077+0000","last_clean":"2024-09-16T01:16:33.009077+0000","last_became_active":"2024-09-16T01:16:33.000819+0000","last_became_peered":"2024-09-16T01:16:33.000819+0000","last_unstale":"2024-09-16T01:16:33.009077+0000","last_undegraded":"2024-09-16T01:16:33.009077+0000","last_fullsized":"2024-09-16T01:16:33.009077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:14.970777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.005745+0000","last_change":"2024-09-16T01:16:33.000126+0000","last_active":"2024-09-16T01:16:33.005745+0000","last_peered":"2024-09-16T01:16:33.005745+0000","last_clean":"2024-09-16T01:16:33.005745+0000","last_became_active":"2024-09-16T01:16:32.999846+0000","last_became_peered":"2024-09-16T01:16:32.999846+0000","last_unstale":"2024-09-16T01:16:33.005745+0000","last_undegraded":"2024-09-16T01:16:33.005745+0000","last_fullsized":"2024-09-16T01:16:33.005745+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:23.994772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.002683+0000","last_change":"2024-09-16T01:16:32.997550+0000","last_active":"2024-09-16T01:16:33.002683+0000","last_peered":"2024-09-16T01:16:33.002683+0000","last_clean":"2024-09-16T01:16:33.002683+0000","last_became_active":"2024-09-16T01:16:32.997254+0000","last_became_peered":"2024-09-16T01:16:32.997254+0000","last_unstale":"2024-09-16T01:16:33.002683+0000","last_undegraded":"2024-09-16T01:16:33.002683+0000","last_fullsized":"2024-09-16T01:16:33.002683+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:17.334349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996493+0000","last_change":"2024-09-16T01:16:32.987237+0000","last_active":"2024-09-16T01:16:32.996493+0000","last_peered":"2024-09-16T01:16:32.996493+0000","last_clean":"2024-09-16T01:16:32.996493+0000","last_became_active":"2024-09-16T01:16:32.986849+0000","last_became_peered":"2024-09-16T01:16:32.986849+0000","last_unstale":"2024-09-16T01:16:32.996493+0000","last_undegraded":"2024-09-16T01:16:32.996493+0000","last_fullsized":"2024-09-16T01:16:32.996493+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:49.573942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.001501+0000","last_change":"2024-09-16T01:16:32.994312+0000","last_active":"2024-09-16T01:16:33.001501+0000","last_peered":"2024-09-16T01:16:33.001501+0000","last_clean":"2024-09-16T01:16:33.001501+0000","last_became_active":"2024-09-16T01:16:32.993929+0000","last_became_peered":"2024-09-16T01:16:32.993929+0000","last_unstale":"2024-09-16T01:16:33.001501+0000","last_undegraded":"2024-09-16T01:16:33.001501+0000","last_fullsized":"2024-09-16T01:16:33.001501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:59.827475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996966+0000","last_change":"2024-09-16T01:16:32.994724+0000","last_active":"2024-09-16T01:16:32.996966+0000","last_peered":"2024-09-16T01:16:32.996966+0000","last_clean":"2024-09-16T01:16:32.996966+0000","last_became_active":"2024-09-16T01:16:32.994432+0000","last_became_peered":"2024-09-16T01:16:32.994432+0000","last_unstale":"2024-09-16T01:16:32.996966+0000","last_undegraded":"2024-09-16T01:16:32.996966+0000","last_fullsized":"2024-09-16T01:16:32.996966+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:14.970777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003776+0000","last_change":"2024-09-16T01:16:32.998801+0000","last_active":"2024-09-16T01:16:33.003776+0000","last_peered":"2024-09-16T01:16:33.003776+0000","last_clean":"2024-09-16T01:16:33.003776+0000","last_became_active":"2024-09-16T01:16:32.997355+0000","last_became_peered":"2024-09-16T01:16:32.997355+0000","last_unstale":"2024-09-16T01:16:33.003776+0000","last_undegraded":"2024-09-16T01:16:33.003776+0000","last_fullsized":"2024-09-16T01:16:33.003776+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:16.165512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.004827+0000","last_change":"2024-09-16T01:16:33.000984+0000","last_active":"2024-09-16T01:16:33.004827+0000","last_peered":"2024-09-16T01:16:33.004827+0000","last_clean":"2024-09-16T01:16:33.004827+0000","last_became_active":"2024-09-16T01:16:33.000692+0000","last_became_peered":"2024-09-16T01:16:33.000692+0000","last_unstale":"2024-09-16T01:16:33.004827+0000","last_undegraded":"2024-09-16T01:16:33.004827+0000","last_fullsized":"2024-09-16T01:16:33.004827+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:23.606455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.004514+0000","last_change":"2024-09-16T01:16:33.000166+0000","last_active":"2024-09-16T01:16:33.004514+0000","last_peered":"2024-09-16T01:16:33.004514+0000","last_clean":"2024-09-16T01:16:33.004514+0000","last_became_active":"2024-09-16T01:16:32.999845+0000","last_became_peered":"2024-09-16T01:16:32.999845+0000","last_unstale":"2024-09-16T01:16:33.004514+0000","last_undegraded":"2024-09-16T01:16:33.004514+0000","last_fullsized":"2024-09-16T01:16:33.004514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:43.595520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.005224+0000","last_change":"2024-09-16T01:16:32.997175+0000","last_active":"2024-09-16T01:16:33.005224+0000","last_peered":"2024-09-16T01:16:33.005224+0000","last_clean":"2024-09-16T01:16:33.005224+0000","last_became_active":"2024-09-16T01:16:32.996644+0000","last_became_peered":"2024-09-16T01:16:32.996644+0000","last_unstale":"2024-09-16T01:16:33.005224+0000","last_undegraded":"2024-09-16T01:16:33.005224+0000","last_fullsized":"2024-09-16T01:16:33.005224+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:34.999077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.995845+0000","last_change":"2024-09-16T01:16:32.989572+0000","last_active":"2024-09-16T01:16:32.995845+0000","last_peered":"2024-09-16T01:16:32.995845+0000","last_clean":"2024-09-16T01:16:32.995845+0000","last_became_active":"2024-09-16T01:16:32.989289+0000","last_became_peered":"2024-09-16T01:16:32.989289+0000","last_unstale":"2024-09-16T01:16:32.995845+0000","last_undegraded":"2024-09-16T01:16:32.995845+0000","last_fullsized":"2024-09-16T01:16:32.995845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:12.242165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.994233+0000","last_change":"2024-09-16T01:16:32.991901+0000","last_active":"2024-09-16T01:16:32.994233+0000","last_peered":"2024-09-16T01:16:32.994233+0000","last_clean":"2024-09-16T01:16:32.994233+0000","last_became_active":"2024-09-16T01:16:32.991576+0000","last_became_peered":"2024-09-16T01:16:32.991576+0000","last_unstale":"2024-09-16T01:16:32.994233+0000","last_undegraded":"2024-09-16T01:16:32.994233+0000","last_fullsized":"2024-09-16T01:16:32.994233+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:49.573942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.001587+0000","last_change":"2024-09-16T01:16:32.995272+0000","last_active":"2024-09-16T01:16:33.001587+0000","last_peered":"2024-09-16T01:16:33.001587+0000","last_clean":"2024-09-16T01:16:33.001587+0000","last_became_active":"2024-09-16T01:16:32.994924+0000","last_became_peered":"2024-09-16T01:16:32.994924+0000","last_unstale":"2024-09-16T01:16:33.001587+0000","last_undegraded":"2024-09-16T01:16:33.001587+0000","last_fullsized":"2024-09-16T01:16:33.001587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:56.381615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.991145+0000","last_change":"2024-09-16T01:16:32.986735+0000","last_active":"2024-09-16T01:16:32.991145+0000","last_peered":"2024-09-16T01:16:32.991145+0000","last_clean":"2024-09-16T01:16:32.991145+0000","last_became_active":"2024-09-16T01:16:32.986052+0000","last_became_peered":"2024-09-16T01:16:32.986052+0000","last_unstale":"2024-09-16T01:16:32.991145+0000","last_undegraded":"2024-09-16T01:16:32.991145+0000","last_fullsized":"2024-09-16T01:16:32.991145+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:34.557706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.998087+0000","last_change":"2024-09-16T01:16:32.992745+0000","last_active":"2024-09-16T01:16:32.998087+0000","last_peered":"2024-09-16T01:16:32.998087+0000","last_clean":"2024-09-16T01:16:32.998087+0000","last_became_active":"2024-09-16T01:16:32.992206+0000","last_became_peered":"2024-09-16T01:16:32.992206+0000","last_unstale":"2024-09-16T01:16:32.998087+0000","last_undegraded":"2024-09-16T01:16:32.998087+0000","last_fullsized":"2024-09-16T01:16:32.998087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:50.788597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996990+0000","last_change":"2024-09-16T01:16:32.994810+0000","last_active":"2024-09-16T01:16:32.996990+0000","last_peered":"2024-09-16T01:16:32.996990+0000","last_clean":"2024-09-16T01:16:32.996990+0000","last_became_active":"2024-09-16T01:16:32.994545+0000","last_became_peered":"2024-09-16T01:16:32.994545+0000","last_unstale":"2024-09-16T01:16:32.996990+0000","last_undegraded":"2024-09-16T01:16:32.996990+0000","last_fullsized":"2024-09-16T01:16:32.996990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:03:51.272109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.994844+0000","last_change":"2024-09-16T01:16:32.992112+0000","last_active":"2024-09-16T01:16:32.994844+0000","last_peered":"2024-09-16T01:16:32.994844+0000","last_clean":"2024-09-16T01:16:32.994844+0000","last_became_active":"2024-09-16T01:16:32.991809+0000","last_became_peered":"2024-09-16T01:16:32.991809+0000","last_unstale":"2024-09-16T01:16:32.994844+0000","last_undegraded":"2024-09-16T01:16:32.994844+0000","last_fullsized":"2024-09-16T01:16:32.994844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:00.383914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.004103+0000","last_change":"2024-09-16T01:16:33.000521+0000","last_active":"2024-09-16T01:16:33.004103+0000","last_peered":"2024-09-16T01:16:33.004103+0000","last_clean":"2024-09-16T01:16:33.004103+0000","last_became_active":"2024-09-16T01:16:33.000226+0000","last_became_peered":"2024-09-16T01:16:33.000226+0000","last_unstale":"2024-09-16T01:16:33.004103+0000","last_undegraded":"2024-09-16T01:16:33.004103+0000","last_fullsized":"2024-09-16T01:16:33.004103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:59.320553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.992243+0000","last_change":"2024-09-16T01:16:32.984796+0000","last_active":"2024-09-16T01:16:32.992243+0000","last_peered":"2024-09-16T01:16:32.992243+0000","last_clean":"2024-09-16T01:16:32.992243+0000","last_became_active":"2024-09-16T01:16:32.984525+0000","last_became_peered":"2024-09-16T01:16:32.984525+0000","last_unstale":"2024-09-16T01:16:32.992243+0000","last_undegraded":"2024-09-16T01:16:32.992243+0000","last_fullsized":"2024-09-16T01:16:32.992243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:55.428488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003690+0000","last_change":"2024-09-16T01:16:32.999514+0000","last_active":"2024-09-16T01:16:33.003690+0000","last_peered":"2024-09-16T01:16:33.003690+0000","last_clean":"2024-09-16T01:16:33.003690+0000","last_became_active":"2024-09-16T01:16:32.998595+0000","last_became_peered":"2024-09-16T01:16:32.998595+0000","last_unstale":"2024-09-16T01:16:33.003690+0000","last_undegraded":"2024-09-16T01:16:33.003690+0000","last_fullsized":"2024-09-16T01:16:33.003690+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:43.595520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.992499+0000","last_change":"2024-09-16T01:16:32.989188+0000","last_active":"2024-09-16T01:16:32.992499+0000","last_peered":"2024-09-16T01:16:32.992499+0000","last_clean":"2024-09-16T01:16:32.992499+0000","last_became_active":"2024-09-16T01:16:32.988909+0000","last_became_peered":"2024-09-16T01:16:32.988909+0000","last_unstale":"2024-09-16T01:16:32.992499+0000","last_undegraded":"2024-09-16T01:16:32.992499+0000","last_fullsized":"2024-09-16T01:16:32.992499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:34.557706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.992348+0000","last_change":"2024-09-16T01:16:32.986802+0000","last_active":"2024-09-16T01:16:32.992348+0000","last_peered":"2024-09-16T01:16:32.992348+0000","last_clean":"2024-09-16T01:16:32.992348+0000","last_became_active":"2024-09-16T01:16:32.986444+0000","last_became_peered":"2024-09-16T01:16:32.986444+0000","last_unstale":"2024-09-16T01:16:32.992348+0000","last_undegraded":"2024-09-16T01:16:32.992348+0000","last_fullsized":"2024-09-16T01:16:32.992348+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:23.223883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.998068+0000","last_change":"2024-09-16T01:16:32.992480+0000","last_active":"2024-09-16T01:16:32.998068+0000","last_peered":"2024-09-16T01:16:32.998068+0000","last_clean":"2024-09-16T01:16:32.998068+0000","last_became_active":"2024-09-16T01:16:32.991870+0000","last_became_peered":"2024-09-16T01:16:32.991870+0000","last_unstale":"2024-09-16T01:16:32.998068+0000","last_undegraded":"2024-09-16T01:16:32.998068+0000","last_fullsized":"2024-09-16T01:16:32.998068+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:56.381615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.993136+0000","last_change":"2024-09-16T01:16:32.989371+0000","last_active":"2024-09-16T01:16:32.993136+0000","last_peered":"2024-09-16T01:16:32.993136+0000","last_clean":"2024-09-16T01:16:32.993136+0000","last_became_active":"2024-09-16T01:16:32.989090+0000","last_became_peered":"2024-09-16T01:16:32.989090+0000","last_unstale":"2024-09-16T01:16:32.993136+0000","last_undegraded":"2024-09-16T01:16:32.993136+0000","last_fullsized":"2024-09-16T01:16:32.993136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:14.970777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.004742+0000","last_change":"2024-09-16T01:16:33.001826+0000","last_active":"2024-09-16T01:16:33.004742+0000","last_peered":"2024-09-16T01:16:33.004742+0000","last_clean":"2024-09-16T01:16:33.004742+0000","last_became_active":"2024-09-16T01:16:33.000851+0000","last_became_peered":"2024-09-16T01:16:33.000851+0000","last_unstale":"2024-09-16T01:16:33.004742+0000","last_undegraded":"2024-09-16T01:16:33.004742+0000","last_fullsized":"2024-09-16T01:16:33.004742+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:23.994772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010692+0000","last_change":"2024-09-16T01:16:31.978481+0000","last_active":"2024-09-16T01:16:33.010692+0000","last_peered":"2024-09-16T01:16:33.010692+0000","last_clean":"2024-09-16T01:16:33.010692+0000","last_became_active":"2024-09-16T01:16:31.977954+0000","last_became_peered":"2024-09-16T01:16:31.977954+0000","last_unstale":"2024-09-16T01:16:33.010692+0000","last_undegraded":"2024-09-16T01:16:33.010692+0000","last_fullsized":"2024-09-16T01:16:33.010692+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:27.450409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.001617+0000","last_change":"2024-09-16T01:16:32.999835+0000","last_active":"2024-09-16T01:16:33.001617+0000","last_peered":"2024-09-16T01:16:33.001617+0000","last_clean":"2024-09-16T01:16:33.001617+0000","last_became_active":"2024-09-16T01:16:32.999546+0000","last_became_peered":"2024-09-16T01:16:32.999546+0000","last_unstale":"2024-09-16T01:16:33.001617+0000","last_undegraded":"2024-09-16T01:16:33.001617+0000","last_fullsized":"2024-09-16T01:16:33.001617+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:15.201448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.005761+0000","last_change":"2024-09-16T01:16:31.981724+0000","last_active":"2024-09-16T01:16:33.005761+0000","last_peered":"2024-09-16T01:16:33.005761+0000","last_clean":"2024-09-16T01:16:33.005761+0000","last_became_active":"2024-09-16T01:16:31.981462+0000","last_became_peered":"2024-09-16T01:16:31.981462+0000","last_unstale":"2024-09-16T01:16:33.005761+0000","last_undegraded":"2024-09-16T01:16:33.005761+0000","last_fullsized":"2024-09-16T01:16:33.005761+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:27.450409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996939+0000","last_change":"2024-09-16T01:16:32.994242+0000","last_active":"2024-09-16T01:16:32.996939+0000","last_peered":"2024-09-16T01:16:32.996939+0000","last_clean":"2024-09-16T01:16:32.996939+0000","last_became_active":"2024-09-16T01:16:32.993956+0000","last_became_peered":"2024-09-16T01:16:32.993956+0000","last_unstale":"2024-09-16T01:16:32.996939+0000","last_undegraded":"2024-09-16T01:16:32.996939+0000","last_fullsized":"2024-09-16T01:16:32.996939+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:33.162352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.007988+0000","last_change":"2024-09-16T01:16:31.985397+0000","last_active":"2024-09-16T01:16:33.007988+0000","last_peered":"2024-09-16T01:16:33.007988+0000","last_clean":"2024-09-16T01:16:33.007988+0000","last_became_active":"2024-09-16T01:16:31.985139+0000","last_became_peered":"2024-09-16T01:16:31.985139+0000","last_unstale":"2024-09-16T01:16:33.007988+0000","last_undegraded":"2024-09-16T01:16:33.007988+0000","last_fullsized":"2024-09-16T01:16:33.007988+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:48.569386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.993234+0000","last_change":"2024-09-16T01:16:32.986181+0000","last_active":"2024-09-16T01:16:32.993234+0000","last_peered":"2024-09-16T01:16:32.993234+0000","last_clean":"2024-09-16T01:16:32.993234+0000","last_became_active":"2024-09-16T01:16:32.985910+0000","last_became_peered":"2024-09-16T01:16:32.985910+0000","last_unstale":"2024-09-16T01:16:32.993234+0000","last_undegraded":"2024-09-16T01:16:32.993234+0000","last_fullsized":"2024-09-16T01:16:32.993234+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:17.334349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.004800+0000","last_change":"2024-09-16T01:16:31.978132+0000","last_active":"2024-09-16T01:16:33.004800+0000","last_peered":"2024-09-16T01:16:33.004800+0000","last_clean":"2024-09-16T01:16:33.004800+0000","last_became_active":"2024-09-16T01:16:31.977867+0000","last_became_peered":"2024-09-16T01:16:31.977867+0000","last_unstale":"2024-09-16T01:16:33.004800+0000","last_undegraded":"2024-09-16T01:16:33.004800+0000","last_fullsized":"2024-09-16T01:16:33.004800+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:22.219326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.997009+0000","last_change":"2024-09-16T01:16:32.989663+0000","last_active":"2024-09-16T01:16:32.997009+0000","last_peered":"2024-09-16T01:16:32.997009+0000","last_clean":"2024-09-16T01:16:32.997009+0000","last_became_active":"2024-09-16T01:16:32.989386+0000","last_became_peered":"2024-09-16T01:16:32.989386+0000","last_unstale":"2024-09-16T01:16:32.997009+0000","last_undegraded":"2024-09-16T01:16:32.997009+0000","last_fullsized":"2024-09-16T01:16:32.997009+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:00.383914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010134+0000","last_change":"2024-09-16T01:16:31.980708+0000","last_active":"2024-09-16T01:16:33.010134+0000","last_peered":"2024-09-16T01:16:33.010134+0000","last_clean":"2024-09-16T01:16:33.010134+0000","last_became_active":"2024-09-16T01:16:31.980400+0000","last_became_peered":"2024-09-16T01:16:31.980400+0000","last_unstale":"2024-09-16T01:16:33.010134+0000","last_undegraded":"2024-09-16T01:16:33.010134+0000","last_fullsized":"2024-09-16T01:16:33.010134+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:33.994520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003756+0000","last_change":"2024-09-16T01:16:32.999591+0000","last_active":"2024-09-16T01:16:33.003756+0000","last_peered":"2024-09-16T01:16:33.003756+0000","last_clean":"2024-09-16T01:16:33.003756+0000","last_became_active":"2024-09-16T01:16:32.998287+0000","last_became_peered":"2024-09-16T01:16:32.998287+0000","last_unstale":"2024-09-16T01:16:33.003756+0000","last_undegraded":"2024-09-16T01:16:33.003756+0000","last_fullsized":"2024-09-16T01:16:33.003756+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:23.606455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.007905+0000","last_change":"2024-09-16T01:16:31.979319+0000","last_active":"2024-09-16T01:16:33.007905+0000","last_peered":"2024-09-16T01:16:33.007905+0000","last_clean":"2024-09-16T01:16:33.007905+0000","last_became_active":"2024-09-16T01:16:31.979040+0000","last_became_peered":"2024-09-16T01:16:31.979040+0000","last_unstale":"2024-09-16T01:16:33.007905+0000","last_undegraded":"2024-09-16T01:16:33.007905+0000","last_fullsized":"2024-09-16T01:16:33.007905+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:14.196891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.007650+0000","last_change":"2024-09-16T01:16:33.002222+0000","last_active":"2024-09-16T01:16:33.007650+0000","last_peered":"2024-09-16T01:16:33.007650+0000","last_clean":"2024-09-16T01:16:33.007650+0000","last_became_active":"2024-09-16T01:16:33.001956+0000","last_became_peered":"2024-09-16T01:16:33.001956+0000","last_unstale":"2024-09-16T01:16:33.007650+0000","last_undegraded":"2024-09-16T01:16:33.007650+0000","last_fullsized":"2024-09-16T01:16:33.007650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:47.577734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.980491+0000","last_change":"2024-09-16T01:16:31.984324+0000","last_active":"2024-09-16T01:16:32.980491+0000","last_peered":"2024-09-16T01:16:32.980491+0000","last_clean":"2024-09-16T01:16:32.980491+0000","last_became_active":"2024-09-16T01:16:31.984053+0000","last_became_peered":"2024-09-16T01:16:31.984053+0000","last_unstale":"2024-09-16T01:16:32.980491+0000","last_undegraded":"2024-09-16T01:16:32.980491+0000","last_fullsized":"2024-09-16T01:16:32.980491+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:33.553150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003314+0000","last_change":"2024-09-16T01:16:32.994856+0000","last_active":"2024-09-16T01:16:33.003314+0000","last_peered":"2024-09-16T01:16:33.003314+0000","last_clean":"2024-09-16T01:16:33.003314+0000","last_became_active":"2024-09-16T01:16:32.994547+0000","last_became_peered":"2024-09-16T01:16:32.994547+0000","last_unstale":"2024-09-16T01:16:33.003314+0000","last_undegraded":"2024-09-16T01:16:33.003314+0000","last_fullsized":"2024-09-16T01:16:33.003314+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:16.165512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.979833+0000","last_change":"2024-09-16T01:16:31.971913+0000","last_active":"2024-09-16T01:16:32.979833+0000","last_peered":"2024-09-16T01:16:32.979833+0000","last_clean":"2024-09-16T01:16:32.979833+0000","last_became_active":"2024-09-16T01:16:31.971612+0000","last_became_peered":"2024-09-16T01:16:31.971612+0000","last_unstale":"2024-09-16T01:16:32.979833+0000","last_undegraded":"2024-09-16T01:16:32.979833+0000","last_fullsized":"2024-09-16T01:16:32.979833+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:12.937101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.995796+0000","last_change":"2024-09-16T01:16:32.989287+0000","last_active":"2024-09-16T01:16:32.995796+0000","last_peered":"2024-09-16T01:16:32.995796+0000","last_clean":"2024-09-16T01:16:32.995796+0000","last_became_active":"2024-09-16T01:16:32.988655+0000","last_became_peered":"2024-09-16T01:16:32.988655+0000","last_unstale":"2024-09-16T01:16:32.995796+0000","last_undegraded":"2024-09-16T01:16:32.995796+0000","last_fullsized":"2024-09-16T01:16:32.995796+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:36.796830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.979686+0000","last_change":"2024-09-16T01:16:31.976654+0000","last_active":"2024-09-16T01:16:32.979686+0000","last_peered":"2024-09-16T01:16:32.979686+0000","last_clean":"2024-09-16T01:16:32.979686+0000","last_became_active":"2024-09-16T01:16:31.976366+0000","last_became_peered":"2024-09-16T01:16:31.976366+0000","last_unstale":"2024-09-16T01:16:32.979686+0000","last_undegraded":"2024-09-16T01:16:32.979686+0000","last_fullsized":"2024-09-16T01:16:32.979686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:58.315996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996397+0000","last_change":"2024-09-16T01:16:32.991360+0000","last_active":"2024-09-16T01:16:32.996397+0000","last_peered":"2024-09-16T01:16:32.996397+0000","last_clean":"2024-09-16T01:16:32.996397+0000","last_became_active":"2024-09-16T01:16:32.991075+0000","last_became_peered":"2024-09-16T01:16:32.991075+0000","last_unstale":"2024-09-16T01:16:32.996397+0000","last_undegraded":"2024-09-16T01:16:32.996397+0000","last_fullsized":"2024-09-16T01:16:32.996397+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:59.320553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.990770+0000","last_change":"2024-09-16T01:16:31.982339+0000","last_active":"2024-09-16T01:16:32.990770+0000","last_peered":"2024-09-16T01:16:32.990770+0000","last_clean":"2024-09-16T01:16:32.990770+0000","last_became_active":"2024-09-16T01:16:31.981976+0000","last_became_peered":"2024-09-16T01:16:31.981976+0000","last_unstale":"2024-09-16T01:16:32.990770+0000","last_undegraded":"2024-09-16T01:16:32.990770+0000","last_fullsized":"2024-09-16T01:16:32.990770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:14.196891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996511+0000","last_change":"2024-09-16T01:16:32.990935+0000","last_active":"2024-09-16T01:16:32.996511+0000","last_peered":"2024-09-16T01:16:32.996511+0000","last_clean":"2024-09-16T01:16:32.996511+0000","last_became_active":"2024-09-16T01:16:32.990676+0000","last_became_peered":"2024-09-16T01:16:32.990676+0000","last_unstale":"2024-09-16T01:16:32.996511+0000","last_undegraded":"2024-09-16T01:16:32.996511+0000","last_fullsized":"2024-09-16T01:16:32.996511+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:34.999077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010329+0000","last_change":"2024-09-16T01:16:31.977635+0000","last_active":"2024-09-16T01:16:33.010329+0000","last_peered":"2024-09-16T01:16:33.010329+0000","last_clean":"2024-09-16T01:16:33.010329+0000","last_became_active":"2024-09-16T01:16:31.977346+0000","last_became_peered":"2024-09-16T01:16:31.977346+0000","last_unstale":"2024-09-16T01:16:33.010329+0000","last_undegraded":"2024-09-16T01:16:33.010329+0000","last_fullsized":"2024-09-16T01:16:33.010329+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:32.157795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.995228+0000","last_change":"2024-09-16T01:16:32.989538+0000","last_active":"2024-09-16T01:16:32.995228+0000","last_peered":"2024-09-16T01:16:32.995228+0000","last_clean":"2024-09-16T01:16:32.995228+0000","last_became_active":"2024-09-16T01:16:32.989262+0000","last_became_peered":"2024-09-16T01:16:32.989262+0000","last_unstale":"2024-09-16T01:16:32.995228+0000","last_undegraded":"2024-09-16T01:16:32.995228+0000","last_fullsized":"2024-09-16T01:16:32.995228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:00.383914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.012626+0000","last_change":"2024-09-16T01:16:31.978417+0000","last_active":"2024-09-16T01:16:33.012626+0000","last_peered":"2024-09-16T01:16:33.012626+0000","last_clean":"2024-09-16T01:16:33.012626+0000","last_became_active":"2024-09-16T01:16:31.978115+0000","last_became_peered":"2024-09-16T01:16:31.978115+0000","last_unstale":"2024-09-16T01:16:33.012626+0000","last_undegraded":"2024-09-16T01:16:33.012626+0000","last_fullsized":"2024-09-16T01:16:33.012626+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:58.822918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.009145+0000","last_change":"2024-09-16T01:16:33.002514+0000","last_active":"2024-09-16T01:16:33.009145+0000","last_peered":"2024-09-16T01:16:33.009145+0000","last_clean":"2024-09-16T01:16:33.009145+0000","last_became_active":"2024-09-16T01:16:33.002220+0000","last_became_peered":"2024-09-16T01:16:33.002220+0000","last_unstale":"2024-09-16T01:16:33.009145+0000","last_undegraded":"2024-09-16T01:16:33.009145+0000","last_fullsized":"2024-09-16T01:16:33.009145+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:15.201448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.009511+0000","last_change":"2024-09-16T01:16:31.983149+0000","last_active":"2024-09-16T01:16:33.009511+0000","last_peered":"2024-09-16T01:16:33.009511+0000","last_clean":"2024-09-16T01:16:33.009511+0000","last_became_active":"2024-09-16T01:16:31.982880+0000","last_became_peered":"2024-09-16T01:16:31.982880+0000","last_unstale":"2024-09-16T01:16:33.009511+0000","last_undegraded":"2024-09-16T01:16:33.009511+0000","last_fullsized":"2024-09-16T01:16:33.009511+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:14.196891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996199+0000","last_change":"2024-09-16T01:16:32.992498+0000","last_active":"2024-09-16T01:16:32.996199+0000","last_peered":"2024-09-16T01:16:32.996199+0000","last_clean":"2024-09-16T01:16:32.996199+0000","last_became_active":"2024-09-16T01:16:32.992017+0000","last_became_peered":"2024-09-16T01:16:32.992017+0000","last_unstale":"2024-09-16T01:16:32.996199+0000","last_undegraded":"2024-09-16T01:16:32.996199+0000","last_fullsized":"2024-09-16T01:16:32.996199+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:43.595520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.982057+0000","last_change":"2024-09-16T01:16:31.985790+0000","last_active":"2024-09-16T01:16:32.982057+0000","last_peered":"2024-09-16T01:16:32.982057+0000","last_clean":"2024-09-16T01:16:32.982057+0000","last_became_active":"2024-09-16T01:16:31.985497+0000","last_became_peered":"2024-09-16T01:16:31.985497+0000","last_unstale":"2024-09-16T01:16:32.982057+0000","last_undegraded":"2024-09-16T01:16:32.982057+0000","last_fullsized":"2024-09-16T01:16:32.982057+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:59.379357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.998034+0000","last_change":"2024-09-16T01:16:32.993239+0000","last_active":"2024-09-16T01:16:32.998034+0000","last_peered":"2024-09-16T01:16:32.998034+0000","last_clean":"2024-09-16T01:16:32.998034+0000","last_became_active":"2024-09-16T01:16:32.992883+0000","last_became_peered":"2024-09-16T01:16:32.992883+0000","last_unstale":"2024-09-16T01:16:32.998034+0000","last_undegraded":"2024-09-16T01:16:32.998034+0000","last_fullsized":"2024-09-16T01:16:32.998034+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:13:17.334349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.979296+0000","last_change":"2024-09-16T01:16:31.978418+0000","last_active":"2024-09-16T01:16:32.979296+0000","last_peered":"2024-09-16T01:16:32.979296+0000","last_clean":"2024-09-16T01:16:32.979296+0000","last_became_active":"2024-09-16T01:16:31.978050+0000","last_became_peered":"2024-09-16T01:16:31.978050+0000","last_unstale":"2024-09-16T01:16:32.979296+0000","last_undegraded":"2024-09-16T01:16:32.979296+0000","last_fullsized":"2024-09-16T01:16:32.979296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:03:50.267552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996292+0000","last_change":"2024-09-16T01:16:32.992307+0000","last_active":"2024-09-16T01:16:32.996292+0000","last_peered":"2024-09-16T01:16:32.996292+0000","last_clean":"2024-09-16T01:16:32.996292+0000","last_became_active":"2024-09-16T01:16:32.992050+0000","last_became_peered":"2024-09-16T01:16:32.992050+0000","last_unstale":"2024-09-16T01:16:32.996292+0000","last_undegraded":"2024-09-16T01:16:32.996292+0000","last_fullsized":"2024-09-16T01:16:32.996292+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:56.771628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010959+0000","last_change":"2024-09-16T01:16:31.981494+0000","last_active":"2024-09-16T01:16:33.010959+0000","last_peered":"2024-09-16T01:16:33.010959+0000","last_clean":"2024-09-16T01:16:33.010959+0000","last_became_active":"2024-09-16T01:16:31.981218+0000","last_became_peered":"2024-09-16T01:16:31.981218+0000","last_unstale":"2024-09-16T01:16:33.010959+0000","last_undegraded":"2024-09-16T01:16:33.010959+0000","last_fullsized":"2024-09-16T01:16:33.010959+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:13.966221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.993003+0000","last_change":"2024-09-16T01:16:32.984608+0000","last_active":"2024-09-16T01:16:32.993003+0000","last_peered":"2024-09-16T01:16:32.993003+0000","last_clean":"2024-09-16T01:16:32.993003+0000","last_became_active":"2024-09-16T01:16:32.984315+0000","last_became_peered":"2024-09-16T01:16:32.984315+0000","last_unstale":"2024-09-16T01:16:32.993003+0000","last_undegraded":"2024-09-16T01:16:32.993003+0000","last_fullsized":"2024-09-16T01:16:32.993003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:28:56.381615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010343+0000","last_change":"2024-09-16T01:16:31.980996+0000","last_active":"2024-09-16T01:16:33.010343+0000","last_peered":"2024-09-16T01:16:33.010343+0000","last_clean":"2024-09-16T01:16:33.010343+0000","last_became_active":"2024-09-16T01:16:31.980698+0000","last_became_peered":"2024-09-16T01:16:31.980698+0000","last_unstale":"2024-09-16T01:16:33.010343+0000","last_undegraded":"2024-09-16T01:16:33.010343+0000","last_fullsized":"2024-09-16T01:16:33.010343+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:13.966221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.001621+0000","last_change":"2024-09-16T01:16:32.993599+0000","last_active":"2024-09-16T01:16:33.001621+0000","last_peered":"2024-09-16T01:16:33.001621+0000","last_clean":"2024-09-16T01:16:33.001621+0000","last_became_active":"2024-09-16T01:16:32.993305+0000","last_became_peered":"2024-09-16T01:16:32.993305+0000","last_unstale":"2024-09-16T01:16:33.001621+0000","last_undegraded":"2024-09-16T01:16:33.001621+0000","last_fullsized":"2024-09-16T01:16:33.001621+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:59.320553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010720+0000","last_change":"2024-09-16T01:16:31.981009+0000","last_active":"2024-09-16T01:16:33.010720+0000","last_peered":"2024-09-16T01:16:33.010720+0000","last_clean":"2024-09-16T01:16:33.010720+0000","last_became_active":"2024-09-16T01:16:31.980756+0000","last_became_peered":"2024-09-16T01:16:31.980756+0000","last_unstale":"2024-09-16T01:16:33.010720+0000","last_undegraded":"2024-09-16T01:16:33.010720+0000","last_fullsized":"2024-09-16T01:16:33.010720+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:54.423931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996868+0000","last_change":"2024-09-16T01:16:32.992941+0000","last_active":"2024-09-16T01:16:32.996868+0000","last_peered":"2024-09-16T01:16:32.996868+0000","last_clean":"2024-09-16T01:16:32.996868+0000","last_became_active":"2024-09-16T01:16:32.992656+0000","last_became_peered":"2024-09-16T01:16:32.992656+0000","last_unstale":"2024-09-16T01:16:32.996868+0000","last_undegraded":"2024-09-16T01:16:32.996868+0000","last_fullsized":"2024-09-16T01:16:32.996868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:34.999077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.005679+0000","last_change":"2024-09-16T01:16:31.978228+0000","last_active":"2024-09-16T01:16:33.005679+0000","last_peered":"2024-09-16T01:16:33.005679+0000","last_clean":"2024-09-16T01:16:33.005679+0000","last_became_active":"2024-09-16T01:16:31.977960+0000","last_became_peered":"2024-09-16T01:16:31.977960+0000","last_unstale":"2024-09-16T01:16:33.005679+0000","last_undegraded":"2024-09-16T01:16:33.005679+0000","last_fullsized":"2024-09-16T01:16:33.005679+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:56.210995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.991331+0000","last_change":"2024-09-16T01:16:32.986666+0000","last_active":"2024-09-16T01:16:32.991331+0000","last_peered":"2024-09-16T01:16:32.991331+0000","last_clean":"2024-09-16T01:16:32.991331+0000","last_became_active":"2024-09-16T01:16:32.985230+0000","last_became_peered":"2024-09-16T01:16:32.985230+0000","last_unstale":"2024-09-16T01:16:32.991331+0000","last_undegraded":"2024-09-16T01:16:32.991331+0000","last_fullsized":"2024-09-16T01:16:32.991331+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:01.119263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.982283+0000","last_change":"2024-09-16T01:16:31.984576+0000","last_active":"2024-09-16T01:16:32.982283+0000","last_peered":"2024-09-16T01:16:32.982283+0000","last_clean":"2024-09-16T01:16:32.982283+0000","last_became_active":"2024-09-16T01:16:31.984302+0000","last_became_peered":"2024-09-16T01:16:31.984302+0000","last_unstale":"2024-09-16T01:16:32.982283+0000","last_undegraded":"2024-09-16T01:16:32.982283+0000","last_fullsized":"2024-09-16T01:16:32.982283+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:33.994520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.998139+0000","last_change":"2024-09-16T01:16:32.992345+0000","last_active":"2024-09-16T01:16:32.998139+0000","last_peered":"2024-09-16T01:16:32.998139+0000","last_clean":"2024-09-16T01:16:32.998139+0000","last_became_active":"2024-09-16T01:16:32.992011+0000","last_became_peered":"2024-09-16T01:16:32.992011+0000","last_unstale":"2024-09-16T01:16:32.998139+0000","last_undegraded":"2024-09-16T01:16:32.998139+0000","last_fullsized":"2024-09-16T01:16:32.998139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:59.827475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.009355+0000","last_change":"2024-09-16T01:16:31.982873+0000","last_active":"2024-09-16T01:16:33.009355+0000","last_peered":"2024-09-16T01:16:33.009355+0000","last_clean":"2024-09-16T01:16:33.009355+0000","last_became_active":"2024-09-16T01:16:31.982606+0000","last_became_peered":"2024-09-16T01:16:31.982606+0000","last_unstale":"2024-09-16T01:16:33.009355+0000","last_undegraded":"2024-09-16T01:16:33.009355+0000","last_fullsized":"2024-09-16T01:16:33.009355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:29.984341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996933+0000","last_change":"2024-09-16T01:16:32.995519+0000","last_active":"2024-09-16T01:16:32.996933+0000","last_peered":"2024-09-16T01:16:32.996933+0000","last_clean":"2024-09-16T01:16:32.996933+0000","last_became_active":"2024-09-16T01:16:32.995240+0000","last_became_peered":"2024-09-16T01:16:32.995240+0000","last_unstale":"2024-09-16T01:16:32.996933+0000","last_undegraded":"2024-09-16T01:16:32.996933+0000","last_fullsized":"2024-09-16T01:16:32.996933+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:33.162352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.973599+0000","last_change":"2024-09-16T01:16:31.978052+0000","last_active":"2024-09-16T01:16:32.973599+0000","last_peered":"2024-09-16T01:16:32.973599+0000","last_clean":"2024-09-16T01:16:32.973599+0000","last_became_active":"2024-09-16T01:16:31.977746+0000","last_became_peered":"2024-09-16T01:16:31.977746+0000","last_unstale":"2024-09-16T01:16:32.973599+0000","last_undegraded":"2024-09-16T01:16:32.973599+0000","last_fullsized":"2024-09-16T01:16:32.973599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:04:43.142361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.002589+0000","last_change":"2024-09-16T01:16:32.997002+0000","last_active":"2024-09-16T01:16:33.002589+0000","last_peered":"2024-09-16T01:16:33.002589+0000","last_clean":"2024-09-16T01:16:33.002589+0000","last_became_active":"2024-09-16T01:16:32.996728+0000","last_became_peered":"2024-09-16T01:16:32.996728+0000","last_unstale":"2024-09-16T01:16:33.002589+0000","last_undegraded":"2024-09-16T01:16:33.002589+0000","last_fullsized":"2024-09-16T01:16:33.002589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:50.788597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.982286+0000","last_change":"2024-09-16T01:16:31.980527+0000","last_active":"2024-09-16T01:16:32.982286+0000","last_peered":"2024-09-16T01:16:32.982286+0000","last_clean":"2024-09-16T01:16:32.982286+0000","last_became_active":"2024-09-16T01:16:31.980258+0000","last_became_peered":"2024-09-16T01:16:31.980258+0000","last_unstale":"2024-09-16T01:16:32.982286+0000","last_undegraded":"2024-09-16T01:16:32.982286+0000","last_fullsized":"2024-09-16T01:16:32.982286+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:46.573177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003339+0000","last_change":"2024-09-16T01:16:32.995085+0000","last_active":"2024-09-16T01:16:33.003339+0000","last_peered":"2024-09-16T01:16:33.003339+0000","last_clean":"2024-09-16T01:16:33.003339+0000","last_became_active":"2024-09-16T01:16:32.994260+0000","last_became_peered":"2024-09-16T01:16:32.994260+0000","last_unstale":"2024-09-16T01:16:33.003339+0000","last_undegraded":"2024-09-16T01:16:33.003339+0000","last_fullsized":"2024-09-16T01:16:33.003339+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:35.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.973377+0000","last_change":"2024-09-16T01:16:31.983582+0000","last_active":"2024-09-16T01:16:32.973377+0000","last_peered":"2024-09-16T01:16:32.973377+0000","last_clean":"2024-09-16T01:16:32.973377+0000","last_became_active":"2024-09-16T01:16:31.983298+0000","last_became_peered":"2024-09-16T01:16:31.983298+0000","last_unstale":"2024-09-16T01:16:32.973377+0000","last_undegraded":"2024-09-16T01:16:32.973377+0000","last_fullsized":"2024-09-16T01:16:32.973377+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:58.178845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.005042+0000","last_change":"2024-09-16T01:16:33.001837+0000","last_active":"2024-09-16T01:16:33.005042+0000","last_peered":"2024-09-16T01:16:33.005042+0000","last_clean":"2024-09-16T01:16:33.005042+0000","last_became_active":"2024-09-16T01:16:33.001572+0000","last_became_peered":"2024-09-16T01:16:33.001572+0000","last_unstale":"2024-09-16T01:16:33.005042+0000","last_undegraded":"2024-09-16T01:16:33.005042+0000","last_fullsized":"2024-09-16T01:16:33.005042+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:59.827475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.010101+0000","last_change":"2024-09-16T01:16:31.984591+0000","last_active":"2024-09-16T01:16:33.010101+0000","last_peered":"2024-09-16T01:16:33.010101+0000","last_clean":"2024-09-16T01:16:33.010101+0000","last_became_active":"2024-09-16T01:16:31.984304+0000","last_became_peered":"2024-09-16T01:16:31.984304+0000","last_unstale":"2024-09-16T01:16:33.010101+0000","last_undegraded":"2024-09-16T01:16:33.010101+0000","last_fullsized":"2024-09-16T01:16:33.010101+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:46.573177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.000326+0000","last_change":"2024-09-16T01:16:32.995763+0000","last_active":"2024-09-16T01:16:33.000326+0000","last_peered":"2024-09-16T01:16:33.000326+0000","last_clean":"2024-09-16T01:16:33.000326+0000","last_became_active":"2024-09-16T01:16:32.995503+0000","last_became_peered":"2024-09-16T01:16:32.995503+0000","last_unstale":"2024-09-16T01:16:33.000326+0000","last_undegraded":"2024-09-16T01:16:33.000326+0000","last_fullsized":"2024-09-16T01:16:33.000326+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.973535+0000","last_change":"2024-09-16T01:16:31.981481+0000","last_active":"2024-09-16T01:16:32.973535+0000","last_peered":"2024-09-16T01:16:32.973535+0000","last_clean":"2024-09-16T01:16:32.973535+0000","last_became_active":"2024-09-16T01:16:31.981206+0000","last_became_peered":"2024-09-16T01:16:31.981206+0000","last_unstale":"2024-09-16T01:16:32.973535+0000","last_undegraded":"2024-09-16T01:16:32.973535+0000","last_fullsized":"2024-09-16T01:16:32.973535+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:03.525714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.995019+0000","last_change":"2024-09-16T01:16:32.988627+0000","last_active":"2024-09-16T01:16:32.995019+0000","last_peered":"2024-09-16T01:16:32.995019+0000","last_clean":"2024-09-16T01:16:32.995019+0000","last_became_active":"2024-09-16T01:16:32.988359+0000","last_became_peered":"2024-09-16T01:16:32.988359+0000","last_unstale":"2024-09-16T01:16:32.995019+0000","last_undegraded":"2024-09-16T01:16:32.995019+0000","last_fullsized":"2024-09-16T01:16:32.995019+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.978704+0000","last_change":"2024-09-16T01:16:31.980470+0000","last_active":"2024-09-16T01:16:32.978704+0000","last_peered":"2024-09-16T01:16:32.978704+0000","last_clean":"2024-09-16T01:16:32.978704+0000","last_became_active":"2024-09-16T01:16:31.980185+0000","last_became_peered":"2024-09-16T01:16:31.980185+0000","last_unstale":"2024-09-16T01:16:32.978704+0000","last_undegraded":"2024-09-16T01:16:32.978704+0000","last_fullsized":"2024-09-16T01:16:32.978704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:54.423931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.996988+0000","last_change":"2024-09-16T01:16:32.986506+0000","last_active":"2024-09-16T01:16:32.996988+0000","last_peered":"2024-09-16T01:16:32.996988+0000","last_clean":"2024-09-16T01:16:32.996988+0000","last_became_active":"2024-09-16T01:16:32.986175+0000","last_became_peered":"2024-09-16T01:16:32.986175+0000","last_unstale":"2024-09-16T01:16:32.996988+0000","last_undegraded":"2024-09-16T01:16:32.996988+0000","last_fullsized":"2024-09-16T01:16:32.996988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:34.557706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.981487+0000","last_change":"2024-09-16T01:16:31.980786+0000","last_active":"2024-09-16T01:16:32.981487+0000","last_peered":"2024-09-16T01:16:32.981487+0000","last_clean":"2024-09-16T01:16:32.981487+0000","last_became_active":"2024-09-16T01:16:31.980519+0000","last_became_peered":"2024-09-16T01:16:31.980519+0000","last_unstale":"2024-09-16T01:16:32.981487+0000","last_undegraded":"2024-09-16T01:16:32.981487+0000","last_fullsized":"2024-09-16T01:16:32.981487+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:22.219326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.997940+0000","last_change":"2024-09-16T01:16:32.995252+0000","last_active":"2024-09-16T01:16:32.997940+0000","last_peered":"2024-09-16T01:16:32.997940+0000","last_clean":"2024-09-16T01:16:32.997940+0000","last_became_active":"2024-09-16T01:16:32.994990+0000","last_became_peered":"2024-09-16T01:16:32.994990+0000","last_unstale":"2024-09-16T01:16:32.997940+0000","last_undegraded":"2024-09-16T01:16:32.997940+0000","last_fullsized":"2024-09-16T01:16:32.997940+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:47.577734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.979603+0000","last_change":"2024-09-16T01:16:31.980900+0000","last_active":"2024-09-16T01:16:32.979603+0000","last_peered":"2024-09-16T01:16:32.979603+0000","last_clean":"2024-09-16T01:16:32.979603+0000","last_became_active":"2024-09-16T01:16:31.980635+0000","last_became_peered":"2024-09-16T01:16:31.980635+0000","last_unstale":"2024-09-16T01:16:32.979603+0000","last_undegraded":"2024-09-16T01:16:32.979603+0000","last_fullsized":"2024-09-16T01:16:32.979603+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:12.937101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.995920+0000","last_change":"2024-09-16T01:16:32.987733+0000","last_active":"2024-09-16T01:16:32.995920+0000","last_peered":"2024-09-16T01:16:32.995920+0000","last_clean":"2024-09-16T01:16:32.995920+0000","last_became_active":"2024-09-16T01:16:32.987351+0000","last_became_peered":"2024-09-16T01:16:32.987351+0000","last_unstale":"2024-09-16T01:16:32.995920+0000","last_undegraded":"2024-09-16T01:16:32.995920+0000","last_fullsized":"2024-09-16T01:16:32.995920+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:49.573942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.980709+0000","last_change":"2024-09-16T01:16:31.978672+0000","last_active":"2024-09-16T01:16:32.980709+0000","last_peered":"2024-09-16T01:16:32.980709+0000","last_clean":"2024-09-16T01:16:32.980709+0000","last_became_active":"2024-09-16T01:16:31.978429+0000","last_became_peered":"2024-09-16T01:16:31.978429+0000","last_unstale":"2024-09-16T01:16:32.980709+0000","last_undegraded":"2024-09-16T01:16:32.980709+0000","last_fullsized":"2024-09-16T01:16:32.980709+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:27.450409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003501+0000","last_change":"2024-09-16T01:16:32.996857+0000","last_active":"2024-09-16T01:16:33.003501+0000","last_peered":"2024-09-16T01:16:33.003501+0000","last_clean":"2024-09-16T01:16:33.003501+0000","last_became_active":"2024-09-16T01:16:32.996438+0000","last_became_peered":"2024-09-16T01:16:32.996438+0000","last_unstale":"2024-09-16T01:16:33.003501+0000","last_undegraded":"2024-09-16T01:16:33.003501+0000","last_fullsized":"2024-09-16T01:16:33.003501+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:56.771628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.979620+0000","last_change":"2024-09-16T01:16:31.981160+0000","last_active":"2024-09-16T01:16:32.979620+0000","last_peered":"2024-09-16T01:16:32.979620+0000","last_clean":"2024-09-16T01:16:32.979620+0000","last_became_active":"2024-09-16T01:16:31.980857+0000","last_became_peered":"2024-09-16T01:16:31.980857+0000","last_unstale":"2024-09-16T01:16:32.979620+0000","last_undegraded":"2024-09-16T01:16:32.979620+0000","last_fullsized":"2024-09-16T01:16:32.979620+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:46.573177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:33.003305+0000","last_change":"2024-09-16T01:16:32.998115+0000","last_active":"2024-09-16T01:16:33.003305+0000","last_peered":"2024-09-16T01:16:33.003305+0000","last_clean":"2024-09-16T01:16:33.003305+0000","last_became_active":"2024-09-16T01:16:32.997844+0000","last_became_peered":"2024-09-16T01:16:32.997844+0000","last_unstale":"2024-09-16T01:16:33.003305+0000","last_undegraded":"2024-09-16T01:16:33.003305+0000","last_fullsized":"2024-09-16T01:16:33.003305+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:31.960258+0000","last_clean_scrub_stamp":"2024-09-16T01:16:31.960258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:24.577836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.981555+0000","last_change":"2024-09-16T01:16:31.983389+0000","last_active":"2024-09-16T01:16:32.981555+0000","last_peered":"2024-09-16T01:16:32.981555+0000","last_clean":"2024-09-16T01:16:32.981555+0000","last_became_active":"2024-09-16T01:16:31.982950+0000","last_became_peered":"2024-09-16T01:16:31.982950+0000","last_unstale":"2024-09-16T01:16:32.981555+0000","last_undegraded":"2024-09-16T01:16:32.981555+0000","last_fullsized":"2024-09-16T01:16:32.981555+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:16:30.955702+0000","last_clean_scrub_stamp":"2024-09-16T01:16:30.955702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:32.157795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":199,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-16T01:16:32.982262+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:16:32.982262+0000","last_peered":"2024-09-16T01:16:32.982262+0000","last_clean":"2024-09-16T01:16:32.982262+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:16:32.982262+0000","last_undegraded":"2024-09-16T01:16:32.982262+0000","last_fullsized":"2024-09-16T01:16:32.982262+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":759727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":169359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":169359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":169359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":413696,"data_stored":176526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":417792,"data_stored":176596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":169359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":759727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:16:36.260 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:16:36.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T01:16:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.401+0000 7f32bb82e640 1 Processor -- start 2024-09-16T01:16:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.401+0000 7f32bb82e640 1 -- start start 2024-09-16T01:16:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32bb82e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32b40d4c10 0x7f32b4162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32bb82e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b40d2600 con 0x7f32b40b5f80 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32bb82e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b40b3c10 con 0x7f32b40d3320 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32bb82e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f32b40d5420 con 0x7f32b40d4c10 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32b95ca640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f32b40b5f80 0x7f32b40b6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38600/0 (socket says 172.21.15.81:38600) 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32b95ca640 1 -- 172.21.15.81:0/3366643377 learned_addr learned my addr 172.21.15.81:0/3366643377 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2379161064 0 0) 0x7f32b0001110 con 0x7f32b40b5f80 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32b8dc9640 1 --2- 172.21.15.81:0/3366643377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32b40d4c10 0x7f32b4162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32a0003520 con 0x7f32b40b5f80 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 424713523 0 0) 0x7f32a0003520 con 0x7f32b40b5f80 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32b40d4c10 msgr2=0x7f32b4162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 --2- 172.21.15.81:0/3366643377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32b40d4c10 0x7f32b4162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 >> v1:172.21.15.102:6789/0 conn(0x7f32b40d3320 legacy=0x7f32b40ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b40d2880 con 0x7f32b40b5f80 2024-09-16T01:16:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f32b0001840 con 0x7f32b40b5f80 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 >> v1:172.21.15.81:6789/0 conn(0x7f32b40b5f80 legacy=0x7f32b40b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 --2- 172.21.15.81:0/3366643377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a00039e0 0x7f32a0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 --2- 172.21.15.81:0/3366643377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32b40d4c10 0x7f32a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 --2- 172.21.15.81:0/3366643377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0004d40 0x7f32a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32b40d5420 con 0x7f32a0004d40 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f32a000baa0 con 0x7f32a00039e0 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.402+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f32a000bca0 con 0x7f32b40d4c10 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.403+0000 7f32b9dcb640 1 --2- 172.21.15.81:0/3366643377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0004d40 0x7f32a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.403+0000 7f32b95ca640 1 --2- 172.21.15.81:0/3366643377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a00039e0 0x7f32a0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.403+0000 7f32b8dc9640 1 --2- 172.21.15.81:0/3366643377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32b40d4c10 0x7f32a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.403+0000 7f32b9dcb640 1 -- 172.21.15.81:0/3366643377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32b40d4c10 msgr2=0x7f32a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.403+0000 7f32b9dcb640 1 --2- 172.21.15.81:0/3366643377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32b40d4c10 0x7f32a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.403+0000 7f32b9dcb640 1 -- 172.21.15.81:0/3366643377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a00039e0 msgr2=0x7f32a0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.403+0000 7f32b9dcb640 1 --2- 172.21.15.81:0/3366643377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a00039e0 0x7f32a0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.403+0000 7f32b9dcb640 1 -- 172.21.15.81:0/3366643377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a0003520 con 0x7f32a0004d40 2024-09-16T01:16:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.404+0000 7f32b9dcb640 1 --2- 172.21.15.81:0/3366643377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0004d40 0x7f32a00051c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f32ac001e20 tx=0x7f32a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6fc962a25def745 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.404+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac001a70 con 0x7f32a0004d40 2024-09-16T01:16:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.404+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac02ae40 con 0x7f32a0004d40 2024-09-16T01:16:36.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.404+0000 7f32abfff640 1 -- 172.21.15.81:0/3366643377 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac003bb0 con 0x7f32a0004d40 2024-09-16T01:16:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.404+0000 7f32bb82e640 1 -- 172.21.15.81:0/3366643377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0004d40 msgr2=0x7f32a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.404+0000 7f32bb82e640 1 --2- 172.21.15.81:0/3366643377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0004d40 0x7f32a00051c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f32ac001e20 tx=0x7f32a0005830 comp rx=0 tx=0).stop 2024-09-16T01:16:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.404+0000 7f32b9dcb640 1 -- 172.21.15.81:0/3366643377 reap_dead start 2024-09-16T01:16:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.404+0000 7f32bb82e640 1 -- 172.21.15.81:0/3366643377 shutdown_connections 2024-09-16T01:16:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.404+0000 7f32bb82e640 1 -- 172.21.15.81:0/3366643377 >> 172.21.15.81:0/3366643377 conn(0x7f32b408bfc0 msgr2=0x7f32b40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.404+0000 7f32bb82e640 1 -- 172.21.15.81:0/3366643377 shutdown_connections 2024-09-16T01:16:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.404+0000 7f32bb82e640 1 -- 172.21.15.81:0/3366643377 wait complete. 2024-09-16T01:16:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.406+0000 7f32bb82e640 1 Processor -- start 2024-09-16T01:16:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.406+0000 7f32bb82e640 1 -- start start 2024-09-16T01:16:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.406+0000 7f32bb82e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a0004d40 0x7f32b40a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.406+0000 7f32bb82e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32b40b8800 0x7f32b40b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.406+0000 7f32bb82e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b40b8c80 0x7f32b40b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.406+0000 7f32bb82e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32b40d2b20 con 0x7f32b40b8c80 2024-09-16T01:16:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.406+0000 7f32bb82e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f32b40d2e90 con 0x7f32b40b8800 2024-09-16T01:16:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.406+0000 7f32bb82e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f32b415f690 con 0x7f32a0004d40 2024-09-16T01:16:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32b9dcb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b40b8c80 0x7f32b40b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32b9dcb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b40b8c80 0x7f32b40b7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39762/0 (socket says 172.21.15.81:39762) 2024-09-16T01:16:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32b9dcb640 1 -- 172.21.15.81:0/654171759 learned_addr learned my addr 172.21.15.81:0/654171759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32b8dc9640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32b40b8800 0x7f32b40b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32b95ca640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a0004d40 0x7f32b40a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32b9dcb640 1 -- 172.21.15.81:0/654171759 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a0004d40 msgr2=0x7f32b40a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32b9dcb640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a0004d40 0x7f32b40a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32b9dcb640 1 -- 172.21.15.81:0/654171759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32b40b8800 msgr2=0x7f32b40b7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32b9dcb640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32b40b8800 0x7f32b40b7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32b9dcb640 1 -- 172.21.15.81:0/654171759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b40a1d60 con 0x7f32b40b8c80 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32b9dcb640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b40b8c80 0x7f32b40b7870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32ac008fd0 tx=0x7f32ac0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32a9ffb640 1 -- 172.21.15.81:0/654171759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac001a70 con 0x7f32b40b8c80 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32a9ffb640 1 -- 172.21.15.81:0/654171759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac02ac40 con 0x7f32b40b8c80 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32a9ffb640 1 -- 172.21.15.81:0/654171759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac007db0 con 0x7f32b40b8c80 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32bb82e640 1 -- 172.21.15.81:0/654171759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b40b91e0 con 0x7f32b40b8c80 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.407+0000 7f32bb82e640 1 -- 172.21.15.81:0/654171759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b40b97a0 con 0x7f32b40b8c80 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.408+0000 7f32bb82e640 1 -- 172.21.15.81:0/654171759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b40d37b0 con 0x7f32b40b8c80 2024-09-16T01:16:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.409+0000 7f32a9ffb640 1 -- 172.21.15.81:0/654171759 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f32ac043020 con 0x7f32b40b8c80 2024-09-16T01:16:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.409+0000 7f32a9ffb640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f329806c2e0 0x7f329806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.409+0000 7f32a9ffb640 1 -- 172.21.15.81:0/654171759 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f32ac0aa8e0 con 0x7f32b40b8c80 2024-09-16T01:16:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.409+0000 7f32b95ca640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f329806c2e0 0x7f329806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.410+0000 7f32b95ca640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f329806c2e0 0x7f329806e7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f32b0001050 tx=0x7f32b0000fa0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:36.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.413+0000 7f32a9ffb640 1 -- 172.21.15.81:0/654171759 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32b40a1d60 con 0x7f32b40b8c80 2024-09-16T01:16:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.640+0000 7f32bb82e640 1 -- 172.21.15.81:0/654171759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f32b40b45c0 con 0x7f32b40b8c80 2024-09-16T01:16:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.642+0000 7f32a9ffb640 1 -- 172.21.15.81:0/654171759 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f32b40b3c10 con 0x7f32b40b8c80 2024-09-16T01:16:36.644 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-16T01:16:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg== 2024-09-16T01:16:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-16T01:16:36.644 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-16T01:16:36.645 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T01:16:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-16T01:16:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.644+0000 7f32bb82e640 1 -- 172.21.15.81:0/654171759 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f329806c2e0 msgr2=0x7f329806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.644+0000 7f32bb82e640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f329806c2e0 0x7f329806e7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f32b0001050 tx=0x7f32b0000fa0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.644+0000 7f32bb82e640 1 -- 172.21.15.81:0/654171759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b40b8c80 msgr2=0x7f32b40b7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.644+0000 7f32bb82e640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b40b8c80 0x7f32b40b7870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32ac008fd0 tx=0x7f32ac0014a0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.645+0000 7f32bb82e640 1 -- 172.21.15.81:0/654171759 shutdown_connections 2024-09-16T01:16:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.645+0000 7f32bb82e640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f329806c2e0 0x7f329806e7a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.645+0000 7f32bb82e640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b40b8c80 0x7f32b40b7870 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.645+0000 7f32bb82e640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32b40b8800 0x7f32b40b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.645+0000 7f32bb82e640 1 --2- 172.21.15.81:0/654171759 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a0004d40 0x7f32b40a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.645+0000 7f32bb82e640 1 -- 172.21.15.81:0/654171759 >> 172.21.15.81:0/654171759 conn(0x7f32b408bfc0 msgr2=0x7f32b406d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.645+0000 7f32bb82e640 1 -- 172.21.15.81:0/654171759 shutdown_connections 2024-09-16T01:16:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.645+0000 7f32bb82e640 1 -- 172.21.15.81:0/654171759 wait complete. 2024-09-16T01:16:36.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:16:36.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.753+0000 7f54468f8640 1 Processor -- start 2024-09-16T01:16:36.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.753+0000 7f54468f8640 1 -- start start 2024-09-16T01:16:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.754+0000 7f54468f8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54400d04a0 0x7f54400d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.754+0000 7f54468f8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f544006cb30 con 0x7f5440147360 2024-09-16T01:16:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.754+0000 7f54468f8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f544006bfb0 con 0x7f54400ae550 2024-09-16T01:16:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.754+0000 7f54468f8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f544006c290 con 0x7f54400d04a0 2024-09-16T01:16:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.754+0000 7f543ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5440147360 0x7f5440070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38612/0 (socket says 172.21.15.81:38612) 2024-09-16T01:16:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.754+0000 7f543ffff640 1 -- 172.21.15.81:0/2619740292 learned_addr learned my addr 172.21.15.81:0/2619740292 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.754+0000 7f543f7fe640 1 --2- 172.21.15.81:0/2619740292 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54400d04a0 0x7f54400d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.754+0000 7f543effd640 1 -- 172.21.15.81:0/2619740292 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230501215 0 0) 0x7f544006cb30 con 0x7f5440147360 2024-09-16T01:16:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.754+0000 7f543effd640 1 -- 172.21.15.81:0/2619740292 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5428003520 con 0x7f5440147360 2024-09-16T01:16:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.754+0000 7f543effd640 1 -- 172.21.15.81:0/2619740292 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318927373 0 0) 0x7f544006bfb0 con 0x7f54400ae550 2024-09-16T01:16:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.754+0000 7f543effd640 1 -- 172.21.15.81:0/2619740292 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f544006cb30 con 0x7f54400ae550 2024-09-16T01:16:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.755+0000 7f543effd640 1 -- 172.21.15.81:0/2619740292 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 92545836 0 0) 0x7f5428003520 con 0x7f5440147360 2024-09-16T01:16:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.755+0000 7f543f7fe640 1 -- 172.21.15.81:0/2619740292 >> v1:172.21.15.102:6789/0 conn(0x7f54400ae550 legacy=0x7f54400ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.755+0000 7f543f7fe640 1 -- 172.21.15.81:0/2619740292 >> v1:172.21.15.81:6789/0 conn(0x7f5440147360 legacy=0x7f5440070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.755+0000 7f543f7fe640 1 -- 172.21.15.81:0/2619740292 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544006c570 con 0x7f54400d04a0 2024-09-16T01:16:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.755+0000 7f543f7fe640 1 --2- 172.21.15.81:0/2619740292 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54400d04a0 0x7f54400d08e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f54340097d0 tx=0x7f543402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d0321d9bd3b18e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.755+0000 7f543effd640 1 -- 172.21.15.81:0/2619740292 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5434037070 con 0x7f54400d04a0 2024-09-16T01:16:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.755+0000 7f543effd640 1 -- 172.21.15.81:0/2619740292 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f543402ab90 con 0x7f54400d04a0 2024-09-16T01:16:36.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.755+0000 7f543effd640 1 -- 172.21.15.81:0/2619740292 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430001670 con 0x7f54400d04a0 2024-09-16T01:16:36.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.756+0000 7f54468f8640 1 -- 172.21.15.81:0/2619740292 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54400d04a0 msgr2=0x7f54400d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.756+0000 7f54468f8640 1 --2- 172.21.15.81:0/2619740292 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54400d04a0 0x7f54400d08e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f54340097d0 tx=0x7f543402a100 comp rx=0 tx=0).stop 2024-09-16T01:16:36.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.756+0000 7f54468f8640 1 -- 172.21.15.81:0/2619740292 shutdown_connections 2024-09-16T01:16:36.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.756+0000 7f54468f8640 1 --2- 172.21.15.81:0/2619740292 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54400d04a0 0x7f54400d08e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.756+0000 7f54468f8640 1 -- 172.21.15.81:0/2619740292 >> 172.21.15.81:0/2619740292 conn(0x7f54400b2f40 msgr2=0x7f54400b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:36.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.756+0000 7f54468f8640 1 -- 172.21.15.81:0/2619740292 shutdown_connections 2024-09-16T01:16:36.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.756+0000 7f54468f8640 1 -- 172.21.15.81:0/2619740292 wait complete. 2024-09-16T01:16:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.757+0000 7f54468f8640 1 Processor -- start 2024-09-16T01:16:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.757+0000 7f54468f8640 1 -- start start 2024-09-16T01:16:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f54468f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54400ae550 0x7f54401452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f54468f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54400d04a0 0x7f544015d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f54468f8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5440147360 0x7f544015ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f54468f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5440070fa0 con 0x7f54400ae550 2024-09-16T01:16:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f54468f8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f54400d0e20 con 0x7f54400d04a0 2024-09-16T01:16:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f54468f8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f544006bc10 con 0x7f5440147360 2024-09-16T01:16:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f543ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54400ae550 0x7f54401452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f543ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54400ae550 0x7f54401452d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39768/0 (socket says 172.21.15.81:39768) 2024-09-16T01:16:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f543ffff640 1 -- 172.21.15.81:0/2675227556 learned_addr learned my addr 172.21.15.81:0/2675227556 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f543f7fe640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54400d04a0 0x7f544015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f5444e95640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5440147360 0x7f544015ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f543ffff640 1 -- 172.21.15.81:0/2675227556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5440147360 msgr2=0x7f544015ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f543ffff640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5440147360 0x7f544015ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f543ffff640 1 -- 172.21.15.81:0/2675227556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54400d04a0 msgr2=0x7f544015d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f543ffff640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54400d04a0 0x7f544015d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f543ffff640 1 -- 172.21.15.81:0/2675227556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544015dcb0 con 0x7f54400ae550 2024-09-16T01:16:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f543f7fe640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54400d04a0 0x7f544015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.758+0000 7f5444e95640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5440147360 0x7f544015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.759+0000 7f543ffff640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54400ae550 0x7f54401452d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f543000c520 tx=0x7f543000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:36.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.759+0000 7f543cff9640 1 -- 172.21.15.81:0/2675227556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430017070 con 0x7f54400ae550 2024-09-16T01:16:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.759+0000 7f543cff9640 1 -- 172.21.15.81:0/2675227556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5430005ce0 con 0x7f54400ae550 2024-09-16T01:16:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.759+0000 7f543cff9640 1 -- 172.21.15.81:0/2675227556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54300072b0 con 0x7f54400ae550 2024-09-16T01:16:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.759+0000 7f54468f8640 1 -- 172.21.15.81:0/2675227556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f544015df90 con 0x7f54400ae550 2024-09-16T01:16:36.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.759+0000 7f54468f8640 1 -- 172.21.15.81:0/2675227556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f544015e550 con 0x7f54400ae550 2024-09-16T01:16:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.760+0000 7f54468f8640 1 -- 172.21.15.81:0/2675227556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54400d08e0 con 0x7f54400ae550 2024-09-16T01:16:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.760+0000 7f543cff9640 1 -- 172.21.15.81:0/2675227556 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f543001a070 con 0x7f54400ae550 2024-09-16T01:16:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.761+0000 7f543cff9640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f542c06c2b0 0x7f542c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.761+0000 7f543cff9640 1 -- 172.21.15.81:0/2675227556 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f543008aac0 con 0x7f54400ae550 2024-09-16T01:16:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.761+0000 7f543f7fe640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f542c06c2b0 0x7f542c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:36.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.761+0000 7f543f7fe640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f542c06c2b0 0x7f542c06e770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5434034000 tx=0x7f543402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:36.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.765+0000 7f543cff9640 1 -- 172.21.15.81:0/2675227556 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54300590a0 con 0x7f54400ae550 2024-09-16T01:16:36.884 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-16T01:16:36.882+0000 7f14542de640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:16:36.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.964+0000 7f54468f8640 1 -- 172.21.15.81:0/2675227556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54400b3c40 con 0x7f54400ae550 2024-09-16T01:16:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.964+0000 7f543cff9640 1 -- 172.21.15.81:0/2675227556 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5223 (secure 0 0 0) 0x7f54300589a0 con 0x7f54400ae550 2024-09-16T01:16:36.966 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:16:36.967 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"btime":"2024-09-16T01:16:34:988023+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2179103223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2179103223},{"type":"v1","addr":"172.21.15.81:6836","nonce":2179103223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4649,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/4263439893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":4263439893},{"type":"v1","addr":"172.21.15.102:6834","nonce":4263439893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/27716817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":27716817},{"type":"v1","addr":"172.21.15.102:6835","nonce":27716817}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:16:32.311950+0000","modified":"2024-09-16T01:16:34.313044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3051272390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3051272390},{"type":"v1","addr":"172.21.15.81:6837","nonce":3051272390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-16T01:16:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 16 2024-09-16T01:16:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.966+0000 7f54468f8640 1 -- 172.21.15.81:0/2675227556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f542c06c2b0 msgr2=0x7f542c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.966+0000 7f54468f8640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f542c06c2b0 0x7f542c06e770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5434034000 tx=0x7f543402e000 comp rx=0 tx=0).stop 2024-09-16T01:16:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.966+0000 7f54468f8640 1 -- 172.21.15.81:0/2675227556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54400ae550 msgr2=0x7f54401452d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.966+0000 7f54468f8640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54400ae550 0x7f54401452d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f543000c520 tx=0x7f543000c9e0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.966+0000 7f54468f8640 1 -- 172.21.15.81:0/2675227556 shutdown_connections 2024-09-16T01:16:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.966+0000 7f54468f8640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f542c06c2b0 0x7f542c06e770 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.966+0000 7f54468f8640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5440147360 0x7f544015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.966+0000 7f54468f8640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54400d04a0 0x7f544015d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.966+0000 7f54468f8640 1 --2- 172.21.15.81:0/2675227556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54400ae550 0x7f54401452d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.966+0000 7f54468f8640 1 -- 172.21.15.81:0/2675227556 >> 172.21.15.81:0/2675227556 conn(0x7f54400b2f40 msgr2=0x7f54400b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.966+0000 7f54468f8640 1 -- 172.21.15.81:0/2675227556 shutdown_connections 2024-09-16T01:16:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:36.966+0000 7f54468f8640 1 -- 172.21.15.81:0/2675227556 wait complete. 2024-09-16T01:16:37.381 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:16:32.311950+0000', 'modified': '2024-09-16T01:16:34.313044+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4956}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4956': {'gid': 4956, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/3051272390', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 3051272390}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3051272390}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4956, 'qdb_cluster': [4956]} 2024-09-16T01:16:37.382 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:16:37.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-16T01:16:37.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.481+0000 7fe707998640 1 Processor -- start 2024-09-16T01:16:37.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.481+0000 7fe707998640 1 -- start start 2024-09-16T01:16:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe707998640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe700072320 0x7fe7000cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe707998640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe70015e1f0 0x7fe70006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe707998640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe700146140 con 0x7fe700072de0 2024-09-16T01:16:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe707998640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe7000cd740 con 0x7fe70015e1f0 2024-09-16T01:16:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe707998640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe7000cda20 con 0x7fe700072320 2024-09-16T01:16:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe705f35640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe70015e1f0 0x7fe70006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe704f33640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe700072de0 0x7fe70006e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38614/0 (socket says 172.21.15.81:38614) 2024-09-16T01:16:37.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe704f33640 1 -- 172.21.15.81:0/698413273 learned_addr learned my addr 172.21.15.81:0/698413273 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe705734640 1 --2- 172.21.15.81:0/698413273 >> v2:172.21.15.102:3300/0 conn(0x7fe700072320 0x7fe7000cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe705f35640 1 -- 172.21.15.81:0/698413273 >> v2:172.21.15.102:3300/0 conn(0x7fe700072320 msgr2=0x7fe7000cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe705f35640 1 --2- 172.21.15.81:0/698413273 >> v2:172.21.15.102:3300/0 conn(0x7fe700072320 0x7fe7000cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe705f35640 1 -- 172.21.15.81:0/698413273 >> v1:172.21.15.81:6789/0 conn(0x7fe700072de0 legacy=0x7fe70006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe6f7fff640 1 -- 172.21.15.81:0/698413273 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557351173 0 0) 0x7fe700146140 con 0x7fe700072de0 2024-09-16T01:16:37.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.482+0000 7fe705f35640 1 -- 172.21.15.81:0/698413273 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7000cdd00 con 0x7fe70015e1f0 2024-09-16T01:16:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.483+0000 7fe705f35640 1 --2- 172.21.15.81:0/698413273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70015e1f0 0x7fe70006e7c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe7000b31e0 tx=0x7fe6f802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ed94c027ce9e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.483+0000 7fe6f7fff640 1 -- 172.21.15.81:0/698413273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8037070 con 0x7fe70015e1f0 2024-09-16T01:16:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.483+0000 7fe6f7fff640 1 -- 172.21.15.81:0/698413273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f8032440 con 0x7fe70015e1f0 2024-09-16T01:16:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.483+0000 7fe6f7fff640 1 -- 172.21.15.81:0/698413273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f802ae60 con 0x7fe70015e1f0 2024-09-16T01:16:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.484+0000 7fe707998640 1 -- 172.21.15.81:0/698413273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70015e1f0 msgr2=0x7fe70006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.484+0000 7fe707998640 1 --2- 172.21.15.81:0/698413273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70015e1f0 0x7fe70006e7c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe7000b31e0 tx=0x7fe6f802a110 comp rx=0 tx=0).stop 2024-09-16T01:16:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.484+0000 7fe707998640 1 -- 172.21.15.81:0/698413273 shutdown_connections 2024-09-16T01:16:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.484+0000 7fe707998640 1 --2- 172.21.15.81:0/698413273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70015e1f0 0x7fe70006e7c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.484+0000 7fe707998640 1 --2- 172.21.15.81:0/698413273 >> v2:172.21.15.102:3300/0 conn(0x7fe700072320 0x7fe7000cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.484+0000 7fe707998640 1 -- 172.21.15.81:0/698413273 >> 172.21.15.81:0/698413273 conn(0x7fe700067d70 msgr2=0x7fe70006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.484+0000 7fe707998640 1 -- 172.21.15.81:0/698413273 shutdown_connections 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.484+0000 7fe707998640 1 -- 172.21.15.81:0/698413273 wait complete. 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.485+0000 7fe707998640 1 Processor -- start 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.485+0000 7fe707998640 1 -- start start 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe707998640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe700072320 0x7fe70015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe707998640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe700072de0 0x7fe7001e6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe707998640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70015e1f0 0x7fe7001e68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe707998640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7000cd520 con 0x7fe70015e1f0 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe707998640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe7000cd3a0 con 0x7fe700072320 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe707998640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe70006ed00 con 0x7fe700072de0 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe705f35640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70015e1f0 0x7fe7001e68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe705f35640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70015e1f0 0x7fe7001e68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39792/0 (socket says 172.21.15.81:39792) 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe705f35640 1 -- 172.21.15.81:0/3466896484 learned_addr learned my addr 172.21.15.81:0/3466896484 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:37.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe705734640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe700072320 0x7fe70015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe704f33640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe700072de0 0x7fe7001e6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe705f35640 1 -- 172.21.15.81:0/3466896484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe700072de0 msgr2=0x7fe7001e6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe705f35640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe700072de0 0x7fe7001e6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe705f35640 1 -- 172.21.15.81:0/3466896484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe700072320 msgr2=0x7fe70015bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe705f35640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe700072320 0x7fe70015bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe705f35640 1 -- 172.21.15.81:0/3466896484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7000c9460 con 0x7fe70015e1f0 2024-09-16T01:16:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe705f35640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70015e1f0 0x7fe7001e68b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8035040 tx=0x7fe6f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe6f5ffb640 1 -- 172.21.15.81:0/3466896484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8037050 con 0x7fe70015e1f0 2024-09-16T01:16:37.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe6f5ffb640 1 -- 172.21.15.81:0/3466896484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f8038040 con 0x7fe70015e1f0 2024-09-16T01:16:37.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe707998640 1 -- 172.21.15.81:0/3466896484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7000c9740 con 0x7fe70015e1f0 2024-09-16T01:16:37.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.486+0000 7fe6f5ffb640 1 -- 172.21.15.81:0/3466896484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8004490 con 0x7fe70015e1f0 2024-09-16T01:16:37.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.487+0000 7fe707998640 1 -- 172.21.15.81:0/3466896484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7000c9d00 con 0x7fe70015e1f0 2024-09-16T01:16:37.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.488+0000 7fe6f5ffb640 1 -- 172.21.15.81:0/3466896484 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe6f8030980 con 0x7fe70015e1f0 2024-09-16T01:16:37.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.489+0000 7fe6f5ffb640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe6e406c2b0 0x7fe6e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.489+0000 7fe6f5ffb640 1 -- 172.21.15.81:0/3466896484 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fe6f80ac2c0 con 0x7fe70015e1f0 2024-09-16T01:16:37.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.489+0000 7fe705734640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe6e406c2b0 0x7fe6e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.489+0000 7fe705734640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe6e406c2b0 0x7fe6e406e770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0070b0 tx=0x7fe6fc007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.490+0000 7fe70a813740 1 Processor -- start 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.490+0000 7fe70a813740 1 -- start start 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.490+0000 7fe70a813740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e7da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.490+0000 7fe70a813740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e35a80 0x55b8b1e386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.490+0000 7fe70a813740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e328b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.490+0000 7fe70a813740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b8b1d9a520 con 0x55b8b1e39a50 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.490+0000 7fe70a813740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b8b1d423e0 con 0x55b8b1e35a80 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.490+0000 7fe70a813740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55b8b1d964e0 con 0x55b8b1e382c0 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe705f35640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e328b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe705f35640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e328b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39798/0 (socket says 172.21.15.81:39798) 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe705f35640 1 -- 172.21.15.81:0/3823829600 learned_addr learned my addr 172.21.15.81:0/3823829600 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe705f35640 1 -- 172.21.15.81:0/3823829600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 msgr2=0x55b8b1e7da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe705734640 1 --2- 172.21.15.81:0/3823829600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e7da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe704f33640 1 --2- 172.21.15.81:0/3823829600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e35a80 0x55b8b1e386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe705f35640 1 --2- 172.21.15.81:0/3823829600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e7da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe705f35640 1 -- 172.21.15.81:0/3823829600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e35a80 msgr2=0x55b8b1e386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:37.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe705f35640 1 --2- 172.21.15.81:0/3823829600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e35a80 0x55b8b1e386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe705f35640 1 -- 172.21.15.81:0/3823829600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8b1d5d2f0 con 0x55b8b1e39a50 2024-09-16T01:16:37.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe705734640 1 --2- 172.21.15.81:0/3823829600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e7da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:37.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe704f33640 1 --2- 172.21.15.81:0/3823829600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e35a80 0x55b8b1e386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:37.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe705f35640 1 --2- 172.21.15.81:0/3823829600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e328b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8076720 tx=0x7fe6f8076560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fa77bbfdac767f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:37.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe6eaffd640 1 -- 172.21.15.81:0/3823829600 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f807a9c0 con 0x55b8b1e39a50 2024-09-16T01:16:37.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe6eaffd640 1 -- 172.21.15.81:0/3823829600 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f807a2c0 con 0x55b8b1e39a50 2024-09-16T01:16:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.491+0000 7fe6eaffd640 1 -- 172.21.15.81:0/3823829600 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f807e670 con 0x55b8b1e39a50 2024-09-16T01:16:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.492+0000 7fe70a813740 1 -- 172.21.15.81:0/3823829600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 msgr2=0x55b8b1e328b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.492+0000 7fe70a813740 1 --2- 172.21.15.81:0/3823829600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e328b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8076720 tx=0x7fe6f8076560 comp rx=0 tx=0).stop 2024-09-16T01:16:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.492+0000 7fe70a813740 1 -- 172.21.15.81:0/3823829600 shutdown_connections 2024-09-16T01:16:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.492+0000 7fe70a813740 1 --2- 172.21.15.81:0/3823829600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e328b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.492+0000 7fe70a813740 1 --2- 172.21.15.81:0/3823829600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e35a80 0x55b8b1e386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.492+0000 7fe70a813740 1 --2- 172.21.15.81:0/3823829600 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e7da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.492+0000 7fe70a813740 1 -- 172.21.15.81:0/3823829600 >> 172.21.15.81:0/3823829600 conn(0x55b8b1e34a80 msgr2=0x55b8b1e7cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.492+0000 7fe70a813740 1 -- 172.21.15.81:0/3823829600 shutdown_connections 2024-09-16T01:16:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.492+0000 7fe70a813740 1 -- 172.21.15.81:0/3823829600 wait complete. 2024-09-16T01:16:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.492+0000 7fe70a813740 1 -- start start 2024-09-16T01:16:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.492+0000 7fe70a813740 1 Processor -- start 2024-09-16T01:16:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.493+0000 7fe70a813740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e335e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.493+0000 7fe70a813740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e56d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.493+0000 7fe70a813740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e317d0 0x55b8b1e58f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.493+0000 7fe70a813740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b8b1d9a520 con 0x55b8b1e39a50 2024-09-16T01:16:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.493+0000 7fe70a813740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b8b1d23450 con 0x55b8b1e317d0 2024-09-16T01:16:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.493+0000 7fe70a813740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55b8b1e33f20 con 0x55b8b1e382c0 2024-09-16T01:16:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.493+0000 7fe70a813740 10 client.0 _ll_register_callbacks cb 0x55b8b1aacac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:16:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.493+0000 7fe704f33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e56d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.493+0000 7fe704f33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e56d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39814/0 (socket says 172.21.15.81:39814) 2024-09-16T01:16:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.493+0000 7fe704f33640 1 -- 172.21.15.81:0/1369381118 learned_addr learned my addr 172.21.15.81:0/1369381118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.493+0000 7fe705f35640 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e317d0 0x55b8b1e58f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.493+0000 7fe705734640 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e335e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe704f33640 1 -- 172.21.15.81:0/1369381118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 msgr2=0x55b8b1e335e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe704f33640 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e335e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe704f33640 1 -- 172.21.15.81:0/1369381118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e317d0 msgr2=0x55b8b1e58f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:37.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe704f33640 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e317d0 0x55b8b1e58f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe704f33640 1 -- 172.21.15.81:0/1369381118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8b1aad2d0 con 0x55b8b1e39a50 2024-09-16T01:16:37.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe705f35640 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e317d0 0x55b8b1e58f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:37.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe704f33640 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e56d70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0005e90 tx=0x7fe6f0001680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891d0d99005d916a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:37.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe6dffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:16:37.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe6dffff640 1 -- 172.21.15.81:0/1369381118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f001a060 con 0x55b8b1e39a50 2024-09-16T01:16:37.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe6dffff640 1 -- 172.21.15.81:0/1369381118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fe6f0015c30 con 0x55b8b1e39a50 2024-09-16T01:16:37.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe70a813740 1 -- 172.21.15.81:0/1369381118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6f807a2c0 con 0x55b8b1e39a50 2024-09-16T01:16:37.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe6dffff640 1 -- 172.21.15.81:0/1369381118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fe6f000d070 con 0x55b8b1e39a50 2024-09-16T01:16:37.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe70a813740 10 client.5133 fetch_fsmap learned FSMap version 16 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe70a813740 1 -- 172.21.15.81:0/1369381118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55b8b1b776b0 con 0x55b8b1e39a50 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe6dffff640 1 -- 172.21.15.81:0/1369381118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f807a2c0 con 0x55b8b1e39a50 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe6dffff640 1 -- 172.21.15.81:0/1369381118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7fe6f0013030 con 0x55b8b1e39a50 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe70a813740 10 client.5133 fetch_fsmap finished waiting for FSMap version 16 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe70a813740 10 client.5133 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe70a813740 20 client.5133 populate_metadata read hostname 'smithi081' 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe70a813740 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55b8b1e90a60 0x55b8b1e90e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe70a813740 4 client.5133 mds_command: new command op to 4956 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.494+0000 7fe70a813740 1 -- 172.21.15.81:0/1369381118 --> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8b1da7c50 con 0x55b8b1e90a60 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.495+0000 7fe705734640 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55b8b1e90a60 0x55b8b1e90e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.495+0000 7fe6dffff640 10 client.5133 ms_handle_connect on v2:172.21.15.81:6835/3051272390 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.495+0000 7fe705734640 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55b8b1e90a60 0x55b8b1e90e40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fa2c1386dee331f server_cookie=484b8c878ec1466c in_seq=0 out_seq=0 2024-09-16T01:16:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.495+0000 7fe6dffff640 1 -- 172.21.15.81:0/1369381118 <== mds.0 v2:172.21.15.81:6835/3051272390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8b1da7c50 con 0x55b8b1e90a60 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.495+0000 7fe6dffff640 10 client.5133 handle_command_reply: tid=0 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.495+0000 7fe70a813740 1 client.5133 shutdown 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.496+0000 7fe70a813740 1 -- 172.21.15.81:0/1369381118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 msgr2=0x55b8b1e56d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.496+0000 7fe70a813740 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e56d70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0005e90 tx=0x7fe6f0001680 comp rx=0 tx=0).stop 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.496+0000 7fe70a813740 1 -- 172.21.15.81:0/1369381118 shutdown_connections 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.496+0000 7fe70a813740 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55b8b1e90a60 0x55b8b1e90e40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.496+0000 7fe70a813740 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e317d0 0x55b8b1e58f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.496+0000 7fe70a813740 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e56d70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.496+0000 7fe6dffff640 0 client.5133 ms_handle_reset on v2:172.21.15.81:6835/3051272390 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.496+0000 7fe70a813740 1 --2- 172.21.15.81:0/1369381118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e335e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.496+0000 7fe70a813740 1 -- 172.21.15.81:0/1369381118 >> 172.21.15.81:0/1369381118 conn(0x55b8b1e35a80 msgr2=0x55b8b1e7c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.496+0000 7fe70a813740 1 -- 172.21.15.81:0/1369381118 shutdown_connections 2024-09-16T01:16:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.496+0000 7fe70a813740 1 -- 172.21.15.81:0/1369381118 wait complete. 2024-09-16T01:16:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.496+0000 7fe70a813740 20 client.5133 trim_cache size 0 max 16384 2024-09-16T01:16:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.513+0000 7fe70a813740 1 Processor -- start 2024-09-16T01:16:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.513+0000 7fe70a813740 1 -- start start 2024-09-16T01:16:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.514+0000 7fe70a813740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e317d0 0x55b8b1e5d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.514+0000 7fe70a813740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e382c0 0x55b8b1e7ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.514+0000 7fe70a813740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e39a50 0x55b8b1e569c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.514+0000 7fe70a813740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7001fdcc0 con 0x55b8b1e382c0 2024-09-16T01:16:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.514+0000 7fe70a813740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe7001f2890 con 0x55b8b1e39a50 2024-09-16T01:16:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.514+0000 7fe70a813740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe7001fd670 con 0x55b8b1e317d0 2024-09-16T01:16:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.514+0000 7fe704f33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e382c0 0x55b8b1e7ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.514+0000 7fe704f33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e382c0 0x55b8b1e7ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39824/0 (socket says 172.21.15.81:39824) 2024-09-16T01:16:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.514+0000 7fe704f33640 1 -- 172.21.15.81:0/2878815402 learned_addr learned my addr 172.21.15.81:0/2878815402 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe705f35640 1 --2- 172.21.15.81:0/2878815402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e39a50 0x55b8b1e569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe705734640 1 --2- 172.21.15.81:0/2878815402 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e317d0 0x55b8b1e5d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe704f33640 1 -- 172.21.15.81:0/2878815402 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e317d0 msgr2=0x55b8b1e5d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe704f33640 1 --2- 172.21.15.81:0/2878815402 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e317d0 0x55b8b1e5d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe704f33640 1 -- 172.21.15.81:0/2878815402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e39a50 msgr2=0x55b8b1e569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe704f33640 1 --2- 172.21.15.81:0/2878815402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e39a50 0x55b8b1e569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe704f33640 1 -- 172.21.15.81:0/2878815402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8b1e5dee0 con 0x55b8b1e382c0 2024-09-16T01:16:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe704f33640 1 --2- 172.21.15.81:0/2878815402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e382c0 0x55b8b1e7ec30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0007540 tx=0x7fe6f0007050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fa99f15f39cfdb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe6ea7fc640 1 -- 172.21.15.81:0/2878815402 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0010040 con 0x55b8b1e382c0 2024-09-16T01:16:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe6ea7fc640 1 -- 172.21.15.81:0/2878815402 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f00122f0 con 0x55b8b1e382c0 2024-09-16T01:16:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe6ea7fc640 1 -- 172.21.15.81:0/2878815402 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0012810 con 0x55b8b1e382c0 2024-09-16T01:16:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe70a813740 1 -- 172.21.15.81:0/2878815402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e382c0 msgr2=0x55b8b1e7ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe70a813740 1 --2- 172.21.15.81:0/2878815402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e382c0 0x55b8b1e7ec30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0007540 tx=0x7fe6f0007050 comp rx=0 tx=0).stop 2024-09-16T01:16:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe70a813740 1 -- 172.21.15.81:0/2878815402 shutdown_connections 2024-09-16T01:16:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe70a813740 1 --2- 172.21.15.81:0/2878815402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e39a50 0x55b8b1e569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe70a813740 1 --2- 172.21.15.81:0/2878815402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e382c0 0x55b8b1e7ec30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe70a813740 1 --2- 172.21.15.81:0/2878815402 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e317d0 0x55b8b1e5d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.515+0000 7fe70a813740 1 -- 172.21.15.81:0/2878815402 >> 172.21.15.81:0/2878815402 conn(0x55b8b1e35a80 msgr2=0x55b8b1e60260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.516+0000 7fe70a813740 1 -- 172.21.15.81:0/2878815402 shutdown_connections 2024-09-16T01:16:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.516+0000 7fe70a813740 1 -- 172.21.15.81:0/2878815402 wait complete. 2024-09-16T01:16:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.516+0000 7fe70a813740 1 -- start start 2024-09-16T01:16:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.516+0000 7fe70a813740 1 Processor -- start 2024-09-16T01:16:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe70a813740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e317d0 0x55b8b1e5e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe70a813740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e79d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe70a813740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e537a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe70a813740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b8b1e572b0 con 0x55b8b1e39a50 2024-09-16T01:16:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe70a813740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b8b1e61a10 con 0x55b8b1e317d0 2024-09-16T01:16:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe70a813740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55b8b1e57d10 con 0x55b8b1e382c0 2024-09-16T01:16:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe70a813740 10 client.0 _ll_register_callbacks cb 0x7fe6f0007cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:16:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe705f35640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe705f35640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39828/0 (socket says 172.21.15.81:39828) 2024-09-16T01:16:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe705f35640 1 -- 172.21.15.81:0/121495099 learned_addr learned my addr 172.21.15.81:0/121495099 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe705734640 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e317d0 0x55b8b1e5e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe704f33640 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e79d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe705f35640 1 -- 172.21.15.81:0/121495099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 msgr2=0x55b8b1e79d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe705f35640 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e79d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe705f35640 1 -- 172.21.15.81:0/121495099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e317d0 msgr2=0x55b8b1e5e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe705f35640 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e317d0 0x55b8b1e5e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe705f35640 1 -- 172.21.15.81:0/121495099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8b1e503c0 con 0x55b8b1e39a50 2024-09-16T01:16:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe705734640 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e317d0 0x55b8b1e5e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:16:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe705f35640 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e537a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80aa6b0 tx=0x7fe6f807d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5da87b4e49fa10c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.517+0000 7fe6dffff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:16:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe6dffff640 1 -- 172.21.15.81:0/121495099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f8076560 con 0x55b8b1e39a50 2024-09-16T01:16:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe6dffff640 1 -- 172.21.15.81:0/121495099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fe6f80ac040 con 0x55b8b1e39a50 2024-09-16T01:16:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe70a813740 1 -- 172.21.15.81:0/121495099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6f00122f0 con 0x55b8b1e39a50 2024-09-16T01:16:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe6dffff640 1 -- 172.21.15.81:0/121495099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7fe6f8082ea0 con 0x55b8b1e39a50 2024-09-16T01:16:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe70a813740 10 client.5139 fetch_fsmap learned FSMap version 16 2024-09-16T01:16:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe70a813740 1 -- 172.21.15.81:0/121495099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55b8b1e53e70 con 0x55b8b1e39a50 2024-09-16T01:16:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe6dffff640 1 -- 172.21.15.81:0/121495099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f00122f0 con 0x55b8b1e39a50 2024-09-16T01:16:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe6dffff640 1 -- 172.21.15.81:0/121495099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7fe6f8092170 con 0x55b8b1e39a50 2024-09-16T01:16:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe70a813740 10 client.5139 fetch_fsmap finished waiting for FSMap version 16 2024-09-16T01:16:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe70a813740 10 client.5139 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:16:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe70a813740 20 client.5139 populate_metadata read hostname 'smithi081' 2024-09-16T01:16:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe70a813740 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55b8b1e8fcf0 0x55b8b1efabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe70a813740 4 client.5139 mds_command: new command op to 4956 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:16:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe70a813740 1 -- 172.21.15.81:0/121495099 --> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] -- command(tid 0: {"prefix": "status"}) -- 0x55b8b1e613e0 con 0x55b8b1e8fcf0 2024-09-16T01:16:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe705734640 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55b8b1e8fcf0 0x55b8b1efabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe6dffff640 10 client.5139 ms_handle_connect on v2:172.21.15.81:6835/3051272390 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.518+0000 7fe705734640 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55b8b1e8fcf0 0x55b8b1efabd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54d3f0b0f972145 server_cookie=76169977b315584 in_seq=0 out_seq=0 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe6dffff640 1 -- 172.21.15.81:0/121495099 <== mds.0 v2:172.21.15.81:6835/3051272390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55b8b1e613e0 con 0x55b8b1e8fcf0 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe6dffff640 10 client.5139 handle_command_reply: tid=0 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe70a813740 1 client.5139 shutdown 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe70a813740 1 -- 172.21.15.81:0/121495099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 msgr2=0x55b8b1e537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe70a813740 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e537a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80aa6b0 tx=0x7fe6f807d070 comp rx=0 tx=0).stop 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe70a813740 1 -- 172.21.15.81:0/121495099 shutdown_connections 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe70a813740 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55b8b1e8fcf0 0x55b8b1efabd0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe70a813740 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8b1e39a50 0x55b8b1e537a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe70a813740 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b8b1e382c0 0x55b8b1e79d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe6dffff640 0 client.5139 ms_handle_reset on v2:172.21.15.81:6835/3051272390 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe70a813740 1 --2- 172.21.15.81:0/121495099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b8b1e317d0 0x55b8b1e5e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe70a813740 1 -- 172.21.15.81:0/121495099 >> 172.21.15.81:0/121495099 conn(0x55b8b1e35a80 msgr2=0x55b8b1e60260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:37.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe70a813740 1 -- 172.21.15.81:0/121495099 shutdown_connections 2024-09-16T01:16:37.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe70a813740 1 -- 172.21.15.81:0/121495099 wait complete. 2024-09-16T01:16:37.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe70a813740 20 client.5139 trim_cache size 0 max 16384 2024-09-16T01:16:37.535 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:16:37.535 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973", 2024-09-16T01:16:37.535 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-16T01:16:37.535 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4956, 2024-09-16T01:16:37.535 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-16T01:16:37.535 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-16T01:16:37.535 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-16T01:16:37.536 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.536399179, 2024-09-16T01:16:37.536 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 16, 2024-09-16T01:16:37.536 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 37, 2024-09-16T01:16:37.536 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 37, 2024-09-16T01:16:37.536 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.498568438 2024-09-16T01:16:37.536 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:16:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.519+0000 7fe707998640 1 -- 172.21.15.81:0/3466896484 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe6e406c2b0 msgr2=0x7fe6e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.520+0000 7fe707998640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe6e406c2b0 0x7fe6e406e770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0070b0 tx=0x7fe6fc007040 comp rx=0 tx=0).stop 2024-09-16T01:16:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.520+0000 7fe707998640 1 -- 172.21.15.81:0/3466896484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70015e1f0 msgr2=0x7fe7001e68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.520+0000 7fe707998640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70015e1f0 0x7fe7001e68b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8035040 tx=0x7fe6f80046c0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.520+0000 7fe707998640 1 -- 172.21.15.81:0/3466896484 shutdown_connections 2024-09-16T01:16:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.520+0000 7fe707998640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe6e406c2b0 0x7fe6e406e770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.520+0000 7fe707998640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe70015e1f0 0x7fe7001e68b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.520+0000 7fe707998640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe700072de0 0x7fe7001e6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.520+0000 7fe707998640 1 --2- 172.21.15.81:0/3466896484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe700072320 0x7fe70015bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.520+0000 7fe707998640 1 -- 172.21.15.81:0/3466896484 >> 172.21.15.81:0/3466896484 conn(0x7fe700067d70 msgr2=0x7fe7000c5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.520+0000 7fe707998640 1 -- 172.21.15.81:0/3466896484 shutdown_connections 2024-09-16T01:16:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.520+0000 7fe707998640 1 -- 172.21.15.81:0/3466896484 wait complete. 2024-09-16T01:16:37.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:16:37.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.635+0000 7f110649b640 1 Processor -- start 2024-09-16T01:16:37.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.635+0000 7f110649b640 1 -- start start 2024-09-16T01:16:37.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.635+0000 7f110649b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f110009b140 0x7f1100071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.635+0000 7f110649b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11000b17d0 0x7f11000704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.635+0000 7f110649b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110009ba30 con 0x7f110015fc30 2024-09-16T01:16:37.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.635+0000 7f110649b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f11000b1590 con 0x7f11000b17d0 2024-09-16T01:16:37.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.635+0000 7f110649b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1100160ab0 con 0x7f110009b140 2024-09-16T01:16:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.636+0000 7f1104a38640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11000b17d0 0x7f11000704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.636+0000 7f1104a38640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11000b17d0 0x7f11000704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39844/0 (socket says 172.21.15.81:39844) 2024-09-16T01:16:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.636+0000 7f1104a38640 1 -- 172.21.15.81:0/1589449548 learned_addr learned my addr 172.21.15.81:0/1589449548 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.636+0000 7f10ff7fe640 1 --2- 172.21.15.81:0/1589449548 >> v2:172.21.15.102:3300/0 conn(0x7f110009b140 0x7f1100071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.636+0000 7f1104a38640 1 -- 172.21.15.81:0/1589449548 >> v2:172.21.15.102:3300/0 conn(0x7f110009b140 msgr2=0x7f1100071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.636+0000 7f1104a38640 1 --2- 172.21.15.81:0/1589449548 >> v2:172.21.15.102:3300/0 conn(0x7f110009b140 0x7f1100071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.636+0000 7f1104a38640 1 -- 172.21.15.81:0/1589449548 >> v1:172.21.15.102:6789/0 conn(0x7f110015fc30 legacy=0x7f110009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.636+0000 7f1104a38640 1 -- 172.21.15.81:0/1589449548 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110009bcf0 con 0x7f11000b17d0 2024-09-16T01:16:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.637+0000 7f1104a38640 1 --2- 172.21.15.81:0/1589449548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11000b17d0 0x7f11000704f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f110006cbf0 tx=0x7f10f802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee67982becd44766 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.637+0000 7f10feffd640 1 -- 172.21.15.81:0/1589449548 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8036070 con 0x7f11000b17d0 2024-09-16T01:16:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.637+0000 7f10feffd640 1 -- 172.21.15.81:0/1589449548 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f8031600 con 0x7f11000b17d0 2024-09-16T01:16:37.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.637+0000 7f10feffd640 1 -- 172.21.15.81:0/1589449548 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f80319d0 con 0x7f11000b17d0 2024-09-16T01:16:37.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.637+0000 7f110649b640 1 -- 172.21.15.81:0/1589449548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11000b17d0 msgr2=0x7f11000704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.637+0000 7f110649b640 1 --2- 172.21.15.81:0/1589449548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11000b17d0 0x7f11000704f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f110006cbf0 tx=0x7f10f802a6a0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.637+0000 7f110649b640 1 -- 172.21.15.81:0/1589449548 shutdown_connections 2024-09-16T01:16:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.637+0000 7f110649b640 1 --2- 172.21.15.81:0/1589449548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11000b17d0 0x7f11000704f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.637+0000 7f110649b640 1 --2- 172.21.15.81:0/1589449548 >> v2:172.21.15.102:3300/0 conn(0x7f110009b140 0x7f1100071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.637+0000 7f110649b640 1 -- 172.21.15.81:0/1589449548 >> 172.21.15.81:0/1589449548 conn(0x7f11000d23a0 msgr2=0x7f11000d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.637+0000 7f110649b640 1 -- 172.21.15.81:0/1589449548 shutdown_connections 2024-09-16T01:16:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.637+0000 7f110649b640 1 -- 172.21.15.81:0/1589449548 wait complete. 2024-09-16T01:16:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.638+0000 7f110649b640 1 Processor -- start 2024-09-16T01:16:37.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.639+0000 7f110649b640 1 -- start start 2024-09-16T01:16:37.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.639+0000 7f110649b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f110009b140 0x7f1100153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.639+0000 7f110649b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11000b17d0 0x7f11000cf610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.639+0000 7f110649b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110015fc30 0x7f1100159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.639+0000 7f110649b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1100070a30 con 0x7f110015fc30 2024-09-16T01:16:37.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.639+0000 7f110649b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1100160fe0 con 0x7f11000b17d0 2024-09-16T01:16:37.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.639+0000 7f110649b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1100070bb0 con 0x7f110009b140 2024-09-16T01:16:37.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f1104a38640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110015fc30 0x7f1100159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f1104a38640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110015fc30 0x7f1100159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39850/0 (socket says 172.21.15.81:39850) 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f1104a38640 1 -- 172.21.15.81:0/2161272093 learned_addr learned my addr 172.21.15.81:0/2161272093 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f10ff7fe640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11000b17d0 0x7f11000cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f10fffff640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f110009b140 0x7f1100153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f1104a38640 1 -- 172.21.15.81:0/2161272093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f110009b140 msgr2=0x7f1100153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f1104a38640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f110009b140 0x7f1100153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f1104a38640 1 -- 172.21.15.81:0/2161272093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11000b17d0 msgr2=0x7f11000cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f1104a38640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11000b17d0 0x7f11000cf610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f1104a38640 1 -- 172.21.15.81:0/2161272093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11000b5510 con 0x7f110015fc30 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f1104a38640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110015fc30 0x7f1100159c90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009f40 tx=0x7f10f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f10fcff9640 1 -- 172.21.15.81:0/2161272093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8036050 con 0x7f110015fc30 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f10fcff9640 1 -- 172.21.15.81:0/2161272093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f8042070 con 0x7f110015fc30 2024-09-16T01:16:37.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f110649b640 1 -- 172.21.15.81:0/2161272093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11000b57f0 con 0x7f110015fc30 2024-09-16T01:16:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f10fcff9640 1 -- 172.21.15.81:0/2161272093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8009510 con 0x7f110015fc30 2024-09-16T01:16:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.640+0000 7f110649b640 1 -- 172.21.15.81:0/2161272093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11000b5db0 con 0x7f110015fc30 2024-09-16T01:16:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.641+0000 7f110649b640 1 -- 172.21.15.81:0/2161272093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1100068ea0 con 0x7f110015fc30 2024-09-16T01:16:37.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.642+0000 7f10fcff9640 1 -- 172.21.15.81:0/2161272093 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f10f8007bf0 con 0x7f110015fc30 2024-09-16T01:16:37.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.642+0000 7f10fcff9640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f10ec06c2e0 0x7f10ec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:37.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.642+0000 7f10fcff9640 1 -- 172.21.15.81:0/2161272093 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f10f80ac150 con 0x7f110015fc30 2024-09-16T01:16:37.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.643+0000 7f10fffff640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f10ec06c2e0 0x7f10ec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:37.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.643+0000 7f10fffff640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f10ec06c2e0 0x7f10ec06e7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f11000cf010 tx=0x7f10f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:37.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.647+0000 7f10fcff9640 1 -- 172.21.15.81:0/2161272093 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1100068ea0 con 0x7f110015fc30 2024-09-16T01:16:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.846+0000 7f110649b640 1 -- 172.21.15.81:0/2161272093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1100071e40 con 0x7f110015fc30 2024-09-16T01:16:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.847+0000 7f10fcff9640 1 -- 172.21.15.81:0/2161272093 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f10f807a290 con 0x7f110015fc30 2024-09-16T01:16:37.848 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:16:37.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.848+0000 7f110649b640 1 -- 172.21.15.81:0/2161272093 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f10ec06c2e0 msgr2=0x7f10ec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.849+0000 7f110649b640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f10ec06c2e0 0x7f10ec06e7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f11000cf010 tx=0x7f10f0009040 comp rx=0 tx=0).stop 2024-09-16T01:16:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.849+0000 7f110649b640 1 -- 172.21.15.81:0/2161272093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110015fc30 msgr2=0x7f1100159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.849+0000 7f110649b640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110015fc30 0x7f1100159c90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009f40 tx=0x7f10f8004a40 comp rx=0 tx=0).stop 2024-09-16T01:16:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.849+0000 7f110649b640 1 -- 172.21.15.81:0/2161272093 shutdown_connections 2024-09-16T01:16:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.849+0000 7f110649b640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f10ec06c2e0 0x7f10ec06e7a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.849+0000 7f110649b640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f110015fc30 0x7f1100159c90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.849+0000 7f110649b640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11000b17d0 0x7f11000cf610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.849+0000 7f110649b640 1 --2- 172.21.15.81:0/2161272093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f110009b140 0x7f1100153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.849+0000 7f110649b640 1 -- 172.21.15.81:0/2161272093 >> 172.21.15.81:0/2161272093 conn(0x7f11000d23a0 msgr2=0x7f11000d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.849+0000 7f110649b640 1 -- 172.21.15.81:0/2161272093 shutdown_connections 2024-09-16T01:16:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:37.849+0000 7f110649b640 1 -- 172.21.15.81:0/2161272093 wait complete. 2024-09-16T01:16:37.861 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:16:37.861 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:16:37.861 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:16:37.861 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:16:37.861 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:16:37.861 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:16:37.861 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:16:37.861 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:16:37.862 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:16:37.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:37.862 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:16:37.877 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:16:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:16:37.877 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:16:37.878 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42740sec preferred_lft 42740sec 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::bc22:19ff:fe0c:8fb1/64 scope link 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 86:bb:d8:38:80:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::84bb:d8ff:fe38:80af/64 scope link 2024-09-16T01:16:37.879 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:37.880 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:16:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:16:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::828:dff:febd:ee39/64 scope link 2024-09-16T01:16:37.880 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:37.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:37.880 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:16:37.940 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:16:37.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:37.942 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:16:38.000 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:16:38.000 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:16:38.001 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:16:38.001 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:16:38.001 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:16:38.001 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:38.001 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:16:38.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:16:38.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:16:38.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:16:38.001 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:16:38.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:16:38.044 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:16:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:38.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:38.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:38.128 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:16:38.183 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:16:38.183 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:16:38.183 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:16:38.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:38.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-16T01:16:38.248 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:16:38.249 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:16:38.304 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:16:38.304 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:16:38.304 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:16:38.359 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:16:38.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:38.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:16:38.442 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:16:38.442 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:16:38.442 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:16:38.451 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:16:38.451 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:16:38.451 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:16:38.451 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:16:38.451 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:16:38.456 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:16:38.456 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:16:38.456 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:16:38.456 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:16:38.456 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:16:38.456 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:16:38.456 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:16:38.456 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:16:38.457 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:16:38.457 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:16:38.457 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:16:38.457 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:16:38.457 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:16:38.458 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:16:38.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:38.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:16:38.524 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:38.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:38.624 INFO:teuthology.orchestra.run.smithi081.stdout:client4867 2024-09-16T01:16:38.625 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:38.625 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:38.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:16:38.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.776+0000 7f8f9a253640 1 Processor -- start 2024-09-16T01:16:38.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.776+0000 7f8f9a253640 1 -- start start 2024-09-16T01:16:38.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.777+0000 7f8f9a253640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8f94072940 0x7f8f94072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.777+0000 7f8f9a253640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f940b3570 con 0x7f8f940b4880 2024-09-16T01:16:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.777+0000 7f8f9a253640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f940b3850 con 0x7f8f9415ba30 2024-09-16T01:16:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.777+0000 7f8f9a253640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8f940732e0 con 0x7f8f94072940 2024-09-16T01:16:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.777+0000 7f8f93fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8f940b4880 0x7f8f940b4d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38618/0 (socket says 172.21.15.81:38618) 2024-09-16T01:16:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.777+0000 7f8f93fff640 1 -- 172.21.15.81:0/1415806796 learned_addr learned my addr 172.21.15.81:0/1415806796 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.777+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/1415806796 >> v2:172.21.15.102:3300/0 conn(0x7f8f94072940 0x7f8f94072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.777+0000 7f8f927fc640 1 -- 172.21.15.81:0/1415806796 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180563246 0 0) 0x7f8f940b3570 con 0x7f8f940b4880 2024-09-16T01:16:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.778+0000 7f8f927fc640 1 -- 172.21.15.81:0/1415806796 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f7c003520 con 0x7f8f940b4880 2024-09-16T01:16:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.778+0000 7f8f92ffd640 1 -- 172.21.15.81:0/1415806796 >> v1:172.21.15.102:6789/0 conn(0x7f8f9415ba30 legacy=0x7f8f9406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.778+0000 7f8f92ffd640 1 -- 172.21.15.81:0/1415806796 >> v1:172.21.15.81:6789/0 conn(0x7f8f940b4880 legacy=0x7f8f940b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:38.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.778+0000 7f8f92ffd640 1 -- 172.21.15.81:0/1415806796 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f940b3b30 con 0x7f8f94072940 2024-09-16T01:16:38.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.778+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/1415806796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f94072940 0x7f8f94072da0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8f880097a0 tx=0x7f8f8802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3b04e3ca9035f16 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.779+0000 7f8f927fc640 1 -- 172.21.15.81:0/1415806796 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f88037070 con 0x7f8f94072940 2024-09-16T01:16:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.779+0000 7f8f927fc640 1 -- 172.21.15.81:0/1415806796 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f88032440 con 0x7f8f94072940 2024-09-16T01:16:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.779+0000 7f8f927fc640 1 -- 172.21.15.81:0/1415806796 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f880327f0 con 0x7f8f94072940 2024-09-16T01:16:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.779+0000 7f8f9a253640 1 -- 172.21.15.81:0/1415806796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f94072940 msgr2=0x7f8f94072da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.779+0000 7f8f9a253640 1 --2- 172.21.15.81:0/1415806796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f94072940 0x7f8f94072da0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8f880097a0 tx=0x7f8f8802a230 comp rx=0 tx=0).stop 2024-09-16T01:16:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.779+0000 7f8f9a253640 1 -- 172.21.15.81:0/1415806796 shutdown_connections 2024-09-16T01:16:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.779+0000 7f8f9a253640 1 --2- 172.21.15.81:0/1415806796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f94072940 0x7f8f94072da0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.779+0000 7f8f9a253640 1 -- 172.21.15.81:0/1415806796 >> 172.21.15.81:0/1415806796 conn(0x7f8f94067d70 msgr2=0x7f8f9406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:38.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.779+0000 7f8f9a253640 1 -- 172.21.15.81:0/1415806796 shutdown_connections 2024-09-16T01:16:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.779+0000 7f8f9a253640 1 -- 172.21.15.81:0/1415806796 wait complete. 2024-09-16T01:16:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.780+0000 7f8f9a253640 1 Processor -- start 2024-09-16T01:16:38.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.781+0000 7f8f9a253640 1 -- start start 2024-09-16T01:16:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.781+0000 7f8f9a253640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f94072940 0x7f8f940a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.781+0000 7f8f9a253640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f940b4880 0x7f8f9414f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.781+0000 7f8f9a253640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9415ba30 0x7f8f94146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.781+0000 7f8f9a253640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9406ff20 con 0x7f8f9415ba30 2024-09-16T01:16:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.781+0000 7f8f9a253640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8f940b4180 con 0x7f8f940b4880 2024-09-16T01:16:38.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.781+0000 7f8f9a253640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8f940ce810 con 0x7f8f94072940 2024-09-16T01:16:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.781+0000 7f8f93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9415ba30 0x7f8f94146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.781+0000 7f8f93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9415ba30 0x7f8f94146320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39866/0 (socket says 172.21.15.81:39866) 2024-09-16T01:16:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.781+0000 7f8f93fff640 1 -- 172.21.15.81:0/3177139932 learned_addr learned my addr 172.21.15.81:0/3177139932 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.781+0000 7f8f92ffd640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f940b4880 0x7f8f9414f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.782+0000 7f8f937fe640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f94072940 0x7f8f940a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.782+0000 7f8f93fff640 1 -- 172.21.15.81:0/3177139932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f94072940 msgr2=0x7f8f940a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.782+0000 7f8f93fff640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f94072940 0x7f8f940a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.782+0000 7f8f93fff640 1 -- 172.21.15.81:0/3177139932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f940b4880 msgr2=0x7f8f9414f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.782+0000 7f8f93fff640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f940b4880 0x7f8f9414f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:38.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.782+0000 7f8f93fff640 1 -- 172.21.15.81:0/3177139932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f941501f0 con 0x7f8f9415ba30 2024-09-16T01:16:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.782+0000 7f8f93fff640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9415ba30 0x7f8f94146320 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c460 tx=0x7f8f8c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.782+0000 7f8f7bfff640 1 -- 172.21.15.81:0/3177139932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c017070 con 0x7f8f9415ba30 2024-09-16T01:16:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.782+0000 7f8f7bfff640 1 -- 172.21.15.81:0/3177139932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8c005ce0 con 0x7f8f9415ba30 2024-09-16T01:16:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.782+0000 7f8f9a253640 1 -- 172.21.15.81:0/3177139932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9414fc40 con 0x7f8f9415ba30 2024-09-16T01:16:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.782+0000 7f8f7bfff640 1 -- 172.21.15.81:0/3177139932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c0072b0 con 0x7f8f9415ba30 2024-09-16T01:16:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.782+0000 7f8f9a253640 1 -- 172.21.15.81:0/3177139932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9414ab20 con 0x7f8f9415ba30 2024-09-16T01:16:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.783+0000 7f8f9a253640 1 -- 172.21.15.81:0/3177139932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f940cd8a0 con 0x7f8f9415ba30 2024-09-16T01:16:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.784+0000 7f8f7bfff640 1 -- 172.21.15.81:0/3177139932 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8f8c01a070 con 0x7f8f9415ba30 2024-09-16T01:16:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.784+0000 7f8f7bfff640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8f8006c2e0 0x7f8f8006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.784+0000 7f8f7bfff640 1 -- 172.21.15.81:0/3177139932 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f8f8c08a7f0 con 0x7f8f9415ba30 2024-09-16T01:16:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.784+0000 7f8f937fe640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8f8006c2e0 0x7f8f8006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:38.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.784+0000 7f8f937fe640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8f8006c2e0 0x7f8f8006e7a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8f84001e70 tx=0x7f8f84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:38.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.788+0000 7f8f7bfff640 1 -- 172.21.15.81:0/3177139932 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f940cd8a0 con 0x7f8f9415ba30 2024-09-16T01:16:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.987+0000 7f8f9a253640 1 -- 172.21.15.81:0/3177139932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8f940ccfe0 con 0x7f8f9415ba30 2024-09-16T01:16:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.988+0000 7f8f7bfff640 1 -- 172.21.15.81:0/3177139932 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f8f8c058810 con 0x7f8f9415ba30 2024-09-16T01:16:38.990 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:16:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.990+0000 7f8f9a253640 1 -- 172.21.15.81:0/3177139932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8f8006c2e0 msgr2=0x7f8f8006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.990+0000 7f8f9a253640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8f8006c2e0 0x7f8f8006e7a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8f84001e70 tx=0x7f8f84009040 comp rx=0 tx=0).stop 2024-09-16T01:16:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.990+0000 7f8f9a253640 1 -- 172.21.15.81:0/3177139932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9415ba30 msgr2=0x7f8f94146320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.990+0000 7f8f9a253640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9415ba30 0x7f8f94146320 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c460 tx=0x7f8f8c00c920 comp rx=0 tx=0).stop 2024-09-16T01:16:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.990+0000 7f8f9a253640 1 -- 172.21.15.81:0/3177139932 shutdown_connections 2024-09-16T01:16:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.990+0000 7f8f9a253640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8f8006c2e0 0x7f8f8006e7a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.990+0000 7f8f9a253640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9415ba30 0x7f8f94146320 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.990+0000 7f8f9a253640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f940b4880 0x7f8f9414f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.990+0000 7f8f9a253640 1 --2- 172.21.15.81:0/3177139932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f94072940 0x7f8f940a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.990+0000 7f8f9a253640 1 -- 172.21.15.81:0/3177139932 >> 172.21.15.81:0/3177139932 conn(0x7f8f94067d70 msgr2=0x7f8f940cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.990+0000 7f8f9a253640 1 -- 172.21.15.81:0/3177139932 shutdown_connections 2024-09-16T01:16:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:38.990+0000 7f8f9a253640 1 -- 172.21.15.81:0/3177139932 wait complete. 2024-09-16T01:16:39.002 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:16:39.002 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:16:39.002 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-16T01:16:39.003 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T01:16:39.003 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:16:39.003 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:16:39.003 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:16:39.003 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:16:39.003 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:16:39.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:39.003 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-16T01:16:39.020 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:16:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:16:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:16:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:16:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:39.020 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:39.020 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42741sec preferred_lft 42741sec 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:16:39.021 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:16:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:16:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::fc48:18ff:fedc:b80f/64 scope link 2024-09-16T01:16:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:39.022 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:16:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 2e:4a:65:c9:20:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:16:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::2c4a:65ff:fec9:204f/64 scope link 2024-09-16T01:16:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:39.022 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:16:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:16:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::1072:70ff:fefd:f9f1/64 scope link 2024-09-16T01:16:39.022 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:16:39.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:39.023 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:16:39.085 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:16:39.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:39.086 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-16T01:16:39.143 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-16T01:16:39.144 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:16:39.144 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:16:39.144 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:16:39.144 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:16:39.144 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:16:39.144 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:16:39.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:16:39.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:16:39.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:16:39.145 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:16:39.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:16:39.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:39.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:39.271 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:16:39.286 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T01:16:39.286 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:16:39.286 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:16:39.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:39.286 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-16T01:16:39.351 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:16:39.351 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T01:16:39.406 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:16:39.406 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:16:39.407 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:16:39.462 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:16:39.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:39.462 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:16:39.545 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:16:39.545 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:16:39.546 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:16:39.554 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:16:39.554 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:16:39.554 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:16:39.555 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:16:39.555 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:16:39.560 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:16:39.560 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:16:39.560 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:16:39.560 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:16:39.560 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:16:39.560 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:16:39.560 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:16:39.561 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:16:39.561 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T01:16:39.561 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:16:39.561 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:16:39.561 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:16:39.561 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:16:39.562 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:16:39.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:16:39.562 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:16:39.627 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:39.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:39.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:16:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:39.735 INFO:teuthology.orchestra.run.smithi102.stdout:client4757 2024-09-16T01:16:39.735 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:16:39.735 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:39.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_max_caps_per_client 1 2024-09-16T01:16:39.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.856+0000 7fb609949640 1 Processor -- start 2024-09-16T01:16:39.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.856+0000 7fb609949640 1 -- start start 2024-09-16T01:16:39.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.856+0000 7fb609949640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb604162e30 0x7fb60406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:39.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.856+0000 7fb609949640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb60415ff70 con 0x7fb604162340 2024-09-16T01:16:39.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.856+0000 7fb609949640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6040d4d10 con 0x7fb6040cf280 2024-09-16T01:16:39.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.856+0000 7fb609949640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb60406de90 con 0x7fb604162e30 2024-09-16T01:16:39.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.857+0000 7fb602ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb604162340 0x7fb604162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38620/0 (socket says 172.21.15.81:38620) 2024-09-16T01:16:39.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.857+0000 7fb602ffd640 1 -- 172.21.15.81:0/2225183916 learned_addr learned my addr 172.21.15.81:0/2225183916 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:16:39.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.857+0000 7fb6027fc640 1 --2- 172.21.15.81:0/2225183916 >> v2:172.21.15.81:3300/0 conn(0x7fb604162e30 0x7fb60406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:39.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.857+0000 7fb601ffb640 1 -- 172.21.15.81:0/2225183916 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612472206 0 0) 0x7fb60415ff70 con 0x7fb604162340 2024-09-16T01:16:39.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.857+0000 7fb601ffb640 1 -- 172.21.15.81:0/2225183916 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5ec003520 con 0x7fb604162340 2024-09-16T01:16:39.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.857+0000 7fb6027fc640 1 -- 172.21.15.81:0/2225183916 >> v1:172.21.15.102:6789/0 conn(0x7fb6040cf280 legacy=0x7fb6040d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:39.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.857+0000 7fb6027fc640 1 -- 172.21.15.81:0/2225183916 >> v1:172.21.15.81:6789/0 conn(0x7fb604162340 legacy=0x7fb604162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:39.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.857+0000 7fb6027fc640 1 -- 172.21.15.81:0/2225183916 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6040d4ff0 con 0x7fb604162e30 2024-09-16T01:16:39.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.858+0000 7fb6027fc640 1 --2- 172.21.15.81:0/2225183916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb604162e30 0x7fb60406d740 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009790 tx=0x7fb5f802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d1369e116f5d00 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:39.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.858+0000 7fb601ffb640 1 -- 172.21.15.81:0/2225183916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8037070 con 0x7fb604162e30 2024-09-16T01:16:39.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.858+0000 7fb601ffb640 1 -- 172.21.15.81:0/2225183916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f8032440 con 0x7fb604162e30 2024-09-16T01:16:39.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.858+0000 7fb601ffb640 1 -- 172.21.15.81:0/2225183916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8032810 con 0x7fb604162e30 2024-09-16T01:16:39.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.858+0000 7fb609949640 1 -- 172.21.15.81:0/2225183916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb604162e30 msgr2=0x7fb60406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:39.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.858+0000 7fb609949640 1 --2- 172.21.15.81:0/2225183916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb604162e30 0x7fb60406d740 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009790 tx=0x7fb5f802a180 comp rx=0 tx=0).stop 2024-09-16T01:16:39.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.858+0000 7fb609949640 1 -- 172.21.15.81:0/2225183916 shutdown_connections 2024-09-16T01:16:39.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.858+0000 7fb609949640 1 --2- 172.21.15.81:0/2225183916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb604162e30 0x7fb60406d740 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:39.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.858+0000 7fb609949640 1 -- 172.21.15.81:0/2225183916 >> 172.21.15.81:0/2225183916 conn(0x7fb60408bfc0 msgr2=0x7fb6040d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:39.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.858+0000 7fb609949640 1 -- 172.21.15.81:0/2225183916 shutdown_connections 2024-09-16T01:16:39.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.858+0000 7fb609949640 1 -- 172.21.15.81:0/2225183916 wait complete. 2024-09-16T01:16:39.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.860+0000 7fb609949640 1 Processor -- start 2024-09-16T01:16:39.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.860+0000 7fb609949640 1 -- start start 2024-09-16T01:16:39.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.860+0000 7fb609949640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6040cf280 0x7fb6040b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:39.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.860+0000 7fb609949640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb604162340 0x7fb6040b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:39.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.860+0000 7fb609949640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb604162e30 0x7fb6040b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:39.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.860+0000 7fb609949640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6040cf6f0 con 0x7fb6040cf280 2024-09-16T01:16:39.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.860+0000 7fb609949640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb604163270 con 0x7fb604162340 2024-09-16T01:16:39.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.860+0000 7fb609949640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb6040d52d0 con 0x7fb604162e30 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb602ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6040cf280 0x7fb6040b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb602ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6040cf280 0x7fb6040b6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39896/0 (socket says 172.21.15.81:39896) 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb602ffd640 1 -- 172.21.15.81:0/2282798102 learned_addr learned my addr 172.21.15.81:0/2282798102 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb6027fc640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb604162340 0x7fb6040b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb6037fe640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb604162e30 0x7fb6040b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb602ffd640 1 -- 172.21.15.81:0/2282798102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb604162e30 msgr2=0x7fb6040b92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb602ffd640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb604162e30 0x7fb6040b92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb602ffd640 1 -- 172.21.15.81:0/2282798102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb604162340 msgr2=0x7fb6040b8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb602ffd640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb604162340 0x7fb6040b8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb602ffd640 1 -- 172.21.15.81:0/2282798102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6040b40c0 con 0x7fb6040cf280 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb6037fe640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb604162e30 0x7fb6040b92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb602ffd640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6040cf280 0x7fb6040b6a70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400cbc0 tx=0x7fb5f400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:39.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb5ebfff640 1 -- 172.21.15.81:0/2282798102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4017070 con 0x7fb6040cf280 2024-09-16T01:16:39.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb5ebfff640 1 -- 172.21.15.81:0/2282798102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5f400ad40 con 0x7fb6040cf280 2024-09-16T01:16:39.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb609949640 1 -- 172.21.15.81:0/2282798102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6040b7480 con 0x7fb6040cf280 2024-09-16T01:16:39.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb5ebfff640 1 -- 172.21.15.81:0/2282798102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4012600 con 0x7fb6040cf280 2024-09-16T01:16:39.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.861+0000 7fb609949640 1 -- 172.21.15.81:0/2282798102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6040b4360 con 0x7fb6040cf280 2024-09-16T01:16:39.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.862+0000 7fb609949640 1 -- 172.21.15.81:0/2282798102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb60406d740 con 0x7fb6040cf280 2024-09-16T01:16:39.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.863+0000 7fb5ebfff640 1 -- 172.21.15.81:0/2282798102 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb5f401a070 con 0x7fb6040cf280 2024-09-16T01:16:39.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.863+0000 7fb5ebfff640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5f006c2b0 0x7fb5f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:39.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.863+0000 7fb6027fc640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5f006c2b0 0x7fb5f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:39.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.863+0000 7fb5ebfff640 1 -- 172.21.15.81:0/2282798102 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fb5f408b280 con 0x7fb6040cf280 2024-09-16T01:16:39.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.864+0000 7fb6027fc640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5f006c2b0 0x7fb5f006e770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8034000 tx=0x7fb5f802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:39.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:39.868+0000 7fb5ebfff640 1 -- 172.21.15.81:0/2282798102 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5f40592a0 con 0x7fb6040cf280 2024-09-16T01:16:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.036+0000 7fb609949640 1 -- 172.21.15.81:0/2282798102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_max_caps_per_client}] v 0) -- 0x7fb60408e640 con 0x7fb6040cf280 2024-09-16T01:16:40.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.039+0000 7fb5ebfff640 1 -- 172.21.15.81:0/2282798102 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_max_caps_per_client}]=0 v11)=0 v11) ==== 121+0+0 (secure 0 0 0) 0x7fb5f405d5a0 con 0x7fb6040cf280 2024-09-16T01:16:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.042+0000 7fb609949640 1 -- 172.21.15.81:0/2282798102 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5f006c2b0 msgr2=0x7fb5f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.042+0000 7fb609949640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5f006c2b0 0x7fb5f006e770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8034000 tx=0x7fb5f802e000 comp rx=0 tx=0).stop 2024-09-16T01:16:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.042+0000 7fb609949640 1 -- 172.21.15.81:0/2282798102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6040cf280 msgr2=0x7fb6040b6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.042+0000 7fb609949640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6040cf280 0x7fb6040b6a70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400cbc0 tx=0x7fb5f400a430 comp rx=0 tx=0).stop 2024-09-16T01:16:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.042+0000 7fb609949640 1 -- 172.21.15.81:0/2282798102 shutdown_connections 2024-09-16T01:16:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.042+0000 7fb609949640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5f006c2b0 0x7fb5f006e770 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.042+0000 7fb609949640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb604162e30 0x7fb6040b92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.042+0000 7fb609949640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb604162340 0x7fb6040b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.042+0000 7fb609949640 1 --2- 172.21.15.81:0/2282798102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6040cf280 0x7fb6040b6a70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.042+0000 7fb609949640 1 -- 172.21.15.81:0/2282798102 >> 172.21.15.81:0/2282798102 conn(0x7fb60408bfc0 msgr2=0x7fb6040b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.042+0000 7fb609949640 1 -- 172.21.15.81:0/2282798102 shutdown_connections 2024-09-16T01:16:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.042+0000 7fb609949640 1 -- 172.21.15.81:0/2282798102 wait complete. 2024-09-16T01:16:40.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_session_cap_acquisition_throttle 37 2024-09-16T01:16:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.156+0000 7fb029dfd640 1 Processor -- start 2024-09-16T01:16:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.156+0000 7fb029dfd640 1 -- start start 2024-09-16T01:16:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.157+0000 7fb029dfd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb02415e7f0 0x7fb0240b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.157+0000 7fb029dfd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb024071180 0x7fb02406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.157+0000 7fb029dfd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb02406cdc0 con 0x7fb0240af210 2024-09-16T01:16:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.157+0000 7fb029dfd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb02406d0a0 con 0x7fb024071180 2024-09-16T01:16:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.157+0000 7fb029dfd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb02406d380 con 0x7fb02415e7f0 2024-09-16T01:16:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.157+0000 7fb0237fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb02415e7f0 0x7fb0240b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.157+0000 7fb023fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb024071180 0x7fb02406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.157+0000 7fb0237fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb02415e7f0 0x7fb0240b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:42426/0 (socket says 172.21.15.81:42426) 2024-09-16T01:16:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.157+0000 7fb0237fe640 1 -- 172.21.15.81:0/2027044963 learned_addr learned my addr 172.21.15.81:0/2027044963 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.157+0000 7fb022ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb0240af210 0x7fb024070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:59954/0 (socket says 172.21.15.81:59954) 2024-09-16T01:16:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.157+0000 7fb023fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb024071180 0x7fb02406de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:59620/0 (socket says 172.21.15.81:59620) 2024-09-16T01:16:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.158+0000 7fb0227fc640 1 -- 172.21.15.81:0/2027044963 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344134594 0 0) 0x7fb02406cdc0 con 0x7fb0240af210 2024-09-16T01:16:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.158+0000 7fb0237fe640 1 -- 172.21.15.81:0/2027044963 >> v2:172.21.15.102:3300/0 conn(0x7fb024071180 msgr2=0x7fb02406de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:16:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.158+0000 7fb0237fe640 1 --2- 172.21.15.81:0/2027044963 >> v2:172.21.15.102:3300/0 conn(0x7fb024071180 0x7fb02406de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.158+0000 7fb0237fe640 1 -- 172.21.15.81:0/2027044963 >> v1:172.21.15.102:6789/0 conn(0x7fb0240af210 legacy=0x7fb024070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.158+0000 7fb0237fe640 1 -- 172.21.15.81:0/2027044963 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb02406d660 con 0x7fb02415e7f0 2024-09-16T01:16:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.158+0000 7fb023fff640 1 --2- 172.21.15.81:0/2027044963 >> v2:172.21.15.102:3300/0 conn(0x7fb024071180 0x7fb02406de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:16:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.158+0000 7fb0237fe640 1 --2- 172.21.15.81:0/2027044963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb02415e7f0 0x7fb0240b6d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb014009e50 tx=0x7fb01402a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92477f09deaf387b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.159+0000 7fb0227fc640 1 -- 172.21.15.81:0/2027044963 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb014036070 con 0x7fb02415e7f0 2024-09-16T01:16:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.159+0000 7fb0227fc640 1 -- 172.21.15.81:0/2027044963 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb014031600 con 0x7fb02415e7f0 2024-09-16T01:16:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.159+0000 7fb0227fc640 1 -- 172.21.15.81:0/2027044963 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0140319d0 con 0x7fb02415e7f0 2024-09-16T01:16:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.159+0000 7fb029dfd640 1 -- 172.21.15.81:0/2027044963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb02415e7f0 msgr2=0x7fb0240b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.159+0000 7fb029dfd640 1 --2- 172.21.15.81:0/2027044963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb02415e7f0 0x7fb0240b6d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb014009e50 tx=0x7fb01402a730 comp rx=0 tx=0).stop 2024-09-16T01:16:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.159+0000 7fb029dfd640 1 -- 172.21.15.81:0/2027044963 shutdown_connections 2024-09-16T01:16:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.159+0000 7fb029dfd640 1 --2- 172.21.15.81:0/2027044963 >> v2:172.21.15.102:3300/0 conn(0x7fb024071180 0x7fb02406de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.159+0000 7fb029dfd640 1 --2- 172.21.15.81:0/2027044963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb02415e7f0 0x7fb0240b6d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.159+0000 7fb029dfd640 1 -- 172.21.15.81:0/2027044963 >> 172.21.15.81:0/2027044963 conn(0x7fb0240b3f30 msgr2=0x7fb0240b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.159+0000 7fb029dfd640 1 -- 172.21.15.81:0/2027044963 shutdown_connections 2024-09-16T01:16:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.159+0000 7fb029dfd640 1 -- 172.21.15.81:0/2027044963 wait complete. 2024-09-16T01:16:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.160+0000 7fb029dfd640 1 Processor -- start 2024-09-16T01:16:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.160+0000 7fb029dfd640 1 -- start start 2024-09-16T01:16:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.161+0000 7fb029dfd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb024071180 0x7fb0241521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.161+0000 7fb029dfd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0240af210 0x7fb024153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.161+0000 7fb029dfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb02415e7f0 0x7fb0241543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.161+0000 7fb029dfd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0240b7250 con 0x7fb02415e7f0 2024-09-16T01:16:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.161+0000 7fb029dfd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb0240b6150 con 0x7fb024071180 2024-09-16T01:16:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.161+0000 7fb029dfd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb0240b73d0 con 0x7fb0240af210 2024-09-16T01:16:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.161+0000 7fb023fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb02415e7f0 0x7fb0241543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.161+0000 7fb023fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb02415e7f0 0x7fb0241543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39912/0 (socket says 172.21.15.81:39912) 2024-09-16T01:16:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.161+0000 7fb023fff640 1 -- 172.21.15.81:0/3850351642 learned_addr learned my addr 172.21.15.81:0/3850351642 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:16:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.161+0000 7fb0237fe640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb024071180 0x7fb0241521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.161+0000 7fb022ffd640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0240af210 0x7fb024153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.162+0000 7fb023fff640 1 -- 172.21.15.81:0/3850351642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0240af210 msgr2=0x7fb024153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.162+0000 7fb023fff640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0240af210 0x7fb024153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.162+0000 7fb023fff640 1 -- 172.21.15.81:0/3850351642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb024071180 msgr2=0x7fb0241521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.162+0000 7fb023fff640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb024071180 0x7fb0241521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.162+0000 7fb023fff640 1 -- 172.21.15.81:0/3850351642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0241f4400 con 0x7fb02415e7f0 2024-09-16T01:16:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.162+0000 7fb023fff640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb02415e7f0 0x7fb0241543b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00e860 tx=0x7fb01c00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.162+0000 7fb00bfff640 1 -- 172.21.15.81:0/3850351642 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c017070 con 0x7fb02415e7f0 2024-09-16T01:16:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.162+0000 7fb00bfff640 1 -- 172.21.15.81:0/3850351642 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb01c00c940 con 0x7fb02415e7f0 2024-09-16T01:16:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.162+0000 7fb00bfff640 1 -- 172.21.15.81:0/3850351642 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c00cd10 con 0x7fb02415e7f0 2024-09-16T01:16:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.162+0000 7fb029dfd640 1 -- 172.21.15.81:0/3850351642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0241f46e0 con 0x7fb02415e7f0 2024-09-16T01:16:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.162+0000 7fb029dfd640 1 -- 172.21.15.81:0/3850351642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0241f4ca0 con 0x7fb02415e7f0 2024-09-16T01:16:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.163+0000 7fb029dfd640 1 -- 172.21.15.81:0/3850351642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0240b6d10 con 0x7fb02415e7f0 2024-09-16T01:16:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.163+0000 7fb00bfff640 1 -- 172.21.15.81:0/3850351642 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb01c01a070 con 0x7fb02415e7f0 2024-09-16T01:16:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.164+0000 7fb00bfff640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb01006c2b0 0x7fb01006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:16:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.164+0000 7fb0237fe640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb01006c2b0 0x7fb01006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:16:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.164+0000 7fb00bfff640 1 -- 172.21.15.81:0/3850351642 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fb01c08b800 con 0x7fb02415e7f0 2024-09-16T01:16:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.165+0000 7fb0237fe640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb01006c2b0 0x7fb01006e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb014033000 tx=0x7fb014009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:16:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.168+0000 7fb00bfff640 1 -- 172.21.15.81:0/3850351642 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb01c059710 con 0x7fb02415e7f0 2024-09-16T01:16:40.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.332+0000 7fb029dfd640 1 -- 172.21.15.81:0/3850351642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_session_cap_acquisition_throttle}] v 0) -- 0x7fb0240b0360 con 0x7fb02415e7f0 2024-09-16T01:16:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.335+0000 7fb00bfff640 1 -- 172.21.15.81:0/3850351642 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_session_cap_acquisition_throttle}]=0 v12)=0 v12) ==== 135+0+0 (secure 0 0 0) 0x7fb01c05da10 con 0x7fb02415e7f0 2024-09-16T01:16:40.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.338+0000 7fb029dfd640 1 -- 172.21.15.81:0/3850351642 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb01006c2b0 msgr2=0x7fb01006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.338+0000 7fb029dfd640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb01006c2b0 0x7fb01006e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb014033000 tx=0x7fb014009000 comp rx=0 tx=0).stop 2024-09-16T01:16:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.338+0000 7fb029dfd640 1 -- 172.21.15.81:0/3850351642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb02415e7f0 msgr2=0x7fb0241543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:16:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.338+0000 7fb029dfd640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb02415e7f0 0x7fb0241543b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00e860 tx=0x7fb01c00ed20 comp rx=0 tx=0).stop 2024-09-16T01:16:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.338+0000 7fb029dfd640 1 -- 172.21.15.81:0/3850351642 shutdown_connections 2024-09-16T01:16:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.338+0000 7fb029dfd640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb01006c2b0 0x7fb01006e770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.338+0000 7fb029dfd640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb02415e7f0 0x7fb0241543b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.338+0000 7fb029dfd640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0240af210 0x7fb024153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.338+0000 7fb029dfd640 1 --2- 172.21.15.81:0/3850351642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb024071180 0x7fb0241521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:16:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.338+0000 7fb029dfd640 1 -- 172.21.15.81:0/3850351642 >> 172.21.15.81:0/3850351642 conn(0x7fb0240b3f30 msgr2=0x7fb0240b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:16:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.338+0000 7fb029dfd640 1 -- 172.21.15.81:0/3850351642 shutdown_connections 2024-09-16T01:16:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40.338+0000 7fb029dfd640 1 -- 172.21.15.81:0/3850351642 wait complete. 2024-09-16T01:16:40.351 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:40.351 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:40.367 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-16T01:16:40.367 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-16T01:16:40.367 DEBUG:teuthology.orchestra.run.smithi081:> import uuid 2024-09-16T01:16:40.367 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:40.367 DEBUG:teuthology.orchestra.run.smithi081:> n = 25 2024-09-16T01:16:40.367 DEBUG:teuthology.orchestra.run.smithi081:> create_hard_links = False 2024-09-16T01:16:40.367 DEBUG:teuthology.orchestra.run.smithi081:> if 0 > 0: 2024-09-16T01:16:40.367 DEBUG:teuthology.orchestra.run.smithi081:> create_hard_links = True 2024-09-16T01:16:40.367 DEBUG:teuthology.orchestra.run.smithi081:> path = "/home/ubuntu/cephtest/mnt.0/dir1/file" 2024-09-16T01:16:40.367 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> dpath = os.path.dirname(path) 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> fnameprefix = os.path.basename(path) 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> os.makedirs(dpath, exist_ok=True) 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> for i in range(n): 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> with open(fpath, '"'"'w'"'"') as f: 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> f.write(f"{i}") 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> if True: 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> f.flush() 2024-09-16T01:16:40.368 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f.fileno()) 2024-09-16T01:16:40.369 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:16:40.369 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink(fpath) 2024-09-16T01:16:40.369 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:16:40.369 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(dirfd) 2024-09-16T01:16:40.369 DEBUG:teuthology.orchestra.run.smithi081:> if create_hard_links: 2024-09-16T01:16:40.369 DEBUG:teuthology.orchestra.run.smithi081:> for j in range(0): 2024-09-16T01:16:40.369 DEBUG:teuthology.orchestra.run.smithi081:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-16T01:16:40.369 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:16:40.369 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(dirfd) 2024-09-16T01:16:40.369 DEBUG:teuthology.orchestra.run.smithi081:> finally: 2024-09-16T01:16:40.369 DEBUG:teuthology.orchestra.run.smithi081:> os.close(dirfd) 2024-09-16T01:16:40.369 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-16T01:16:40.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:40.598 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:40.598 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> import uuid 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> n = 25 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> create_hard_links = False 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> if 0 > 0: 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> create_hard_links = True 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> path = "/home/ubuntu/cephtest/mnt.0/dir2/file" 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> dpath = os.path.dirname(path) 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> fnameprefix = os.path.basename(path) 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> os.makedirs(dpath, exist_ok=True) 2024-09-16T01:16:40.654 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> for i in range(n): 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> with open(fpath, '"'"'w'"'"') as f: 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> f.write(f"{i}") 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> if True: 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> f.flush() 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f.fileno()) 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink(fpath) 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(dirfd) 2024-09-16T01:16:40.655 DEBUG:teuthology.orchestra.run.smithi081:> if create_hard_links: 2024-09-16T01:16:40.656 DEBUG:teuthology.orchestra.run.smithi081:> for j in range(0): 2024-09-16T01:16:40.656 DEBUG:teuthology.orchestra.run.smithi081:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-16T01:16:40.656 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:16:40.656 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(dirfd) 2024-09-16T01:16:40.656 DEBUG:teuthology.orchestra.run.smithi081:> finally: 2024-09-16T01:16:40.656 DEBUG:teuthology.orchestra.run.smithi081:> os.close(dirfd) 2024-09-16T01:16:40.656 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-16T01:16:40.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:40.890 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:40.890 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:40.946 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> import uuid 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> n = 25 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> create_hard_links = False 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> if 0 > 0: 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> create_hard_links = True 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> path = "/home/ubuntu/cephtest/mnt.0/dir3/file" 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> dpath = os.path.dirname(path) 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> fnameprefix = os.path.basename(path) 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> os.makedirs(dpath, exist_ok=True) 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-16T01:16:40.947 DEBUG:teuthology.orchestra.run.smithi081:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> for i in range(n): 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> with open(fpath, '"'"'w'"'"') as f: 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> f.write(f"{i}") 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> if True: 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> f.flush() 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f.fileno()) 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink(fpath) 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(dirfd) 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> if create_hard_links: 2024-09-16T01:16:40.948 DEBUG:teuthology.orchestra.run.smithi081:> for j in range(0): 2024-09-16T01:16:40.949 DEBUG:teuthology.orchestra.run.smithi081:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-16T01:16:40.949 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:16:40.949 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(dirfd) 2024-09-16T01:16:40.949 DEBUG:teuthology.orchestra.run.smithi081:> finally: 2024-09-16T01:16:40.949 DEBUG:teuthology.orchestra.run.smithi081:> os.close(dirfd) 2024-09-16T01:16:40.949 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-16T01:16:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:41.197 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:41.198 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:41.254 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-16T01:16:41.254 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-16T01:16:41.254 DEBUG:teuthology.orchestra.run.smithi081:> import uuid 2024-09-16T01:16:41.254 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:41.254 DEBUG:teuthology.orchestra.run.smithi081:> n = 25 2024-09-16T01:16:41.254 DEBUG:teuthology.orchestra.run.smithi081:> create_hard_links = False 2024-09-16T01:16:41.254 DEBUG:teuthology.orchestra.run.smithi081:> if 0 > 0: 2024-09-16T01:16:41.254 DEBUG:teuthology.orchestra.run.smithi081:> create_hard_links = True 2024-09-16T01:16:41.254 DEBUG:teuthology.orchestra.run.smithi081:> path = "/home/ubuntu/cephtest/mnt.0/dir4/file" 2024-09-16T01:16:41.254 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:41.254 DEBUG:teuthology.orchestra.run.smithi081:> dpath = os.path.dirname(path) 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> fnameprefix = os.path.basename(path) 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> os.makedirs(dpath, exist_ok=True) 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> for i in range(n): 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> with open(fpath, '"'"'w'"'"') as f: 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> f.write(f"{i}") 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> if True: 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> f.flush() 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f.fileno()) 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:16:41.255 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink(fpath) 2024-09-16T01:16:41.256 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:16:41.256 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(dirfd) 2024-09-16T01:16:41.256 DEBUG:teuthology.orchestra.run.smithi081:> if create_hard_links: 2024-09-16T01:16:41.256 DEBUG:teuthology.orchestra.run.smithi081:> for j in range(0): 2024-09-16T01:16:41.256 DEBUG:teuthology.orchestra.run.smithi081:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-16T01:16:41.256 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:16:41.256 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(dirfd) 2024-09-16T01:16:41.256 DEBUG:teuthology.orchestra.run.smithi081:> finally: 2024-09-16T01:16:41.256 DEBUG:teuthology.orchestra.run.smithi081:> os.close(dirfd) 2024-09-16T01:16:41.256 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-16T01:16:41.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:41.479 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:16:41.479 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:16:41.535 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:16:41.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:16:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:16:41.631 INFO:teuthology.orchestra.run.smithi081.stdout:client4867 2024-09-16T01:16:41.631 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'find . | wc') 2024-09-16T01:16:41.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:16:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:17:08.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:17:08.183 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:17:20.698 INFO:teuthology.orchestra.run.smithi081.stdout: 105 105 1490 2024-09-16T01:17:20.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:17:20.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.813+0000 7f83b731f640 1 Processor -- start 2024-09-16T01:17:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.813+0000 7f83b731f640 1 -- start start 2024-09-16T01:17:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.814+0000 7f83b731f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f83b015e5d0 0x7f83b00d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.814+0000 7f83b731f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b009b140 0x7f83b0168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.814+0000 7f83b731f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83b006cec0 con 0x7f83b006df60 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.814+0000 7f83b731f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f83b006dad0 con 0x7f83b015e5d0 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.814+0000 7f83b731f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f83b006d1a0 con 0x7f83b009b140 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.814+0000 7f83b48ba640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f83b006df60 0x7f83b009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33932/0 (socket says 172.21.15.81:33932) 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.814+0000 7f83b48ba640 1 -- 172.21.15.81:0/2214424816 learned_addr learned my addr 172.21.15.81:0/2214424816 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.814+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2797966956 0 0) 0x7f83b006cec0 con 0x7f83b006df60 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.814+0000 7f83b50bb640 1 --2- 172.21.15.81:0/2214424816 >> v2:172.21.15.102:3300/0 conn(0x7f83b015e5d0 0x7f83b00d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.814+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f839c003520 con 0x7f83b006df60 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.814+0000 7f83b58bc640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b009b140 0x7f83b0168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2967754324 0 0) 0x7f839c003520 con 0x7f83b006df60 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b009b140 msgr2=0x7f83b0168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b009b140 0x7f83b0168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 >> v2:172.21.15.102:3300/0 conn(0x7f83b015e5d0 msgr2=0x7f83b00d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 --2- 172.21.15.81:0/2214424816 >> v2:172.21.15.102:3300/0 conn(0x7f83b015e5d0 0x7f83b00d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b006d480 con 0x7f83b006df60 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f83a0001670 con 0x7f83b006df60 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83b58bc640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b009b140 0x7f83b0168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 >> v1:172.21.15.81:6789/0 conn(0x7f83b006df60 legacy=0x7f83b009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f839c0039b0 0x7f839c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b009b140 0x7f839c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839c004d40 0x7f839c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f83b006dad0 con 0x7f839c004d40 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f83b006d1a0 con 0x7f839c0039b0 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f839c00bb00 con 0x7f83b009b140 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83b50bb640 1 --2- 172.21.15.81:0/2214424816 >> v2:172.21.15.102:3300/0 conn(0x7f83b015e5d0 0x7f83b00d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:20.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83b58bc640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839c004d40 0x7f839c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83b48ba640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b009b140 0x7f839c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83b50bb640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f839c0039b0 0x7f839c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83b58bc640 1 -- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b009b140 msgr2=0x7f839c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83b58bc640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b009b140 0x7f839c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83b58bc640 1 -- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f839c0039b0 msgr2=0x7f839c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83b58bc640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f839c0039b0 0x7f839c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83b58bc640 1 -- 172.21.15.81:0/2214424816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c003520 con 0x7f839c004d40 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.815+0000 7f83b50bb640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f839c0039b0 0x7f839c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.816+0000 7f83b58bc640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839c004d40 0x7f839c0051c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0098a0 tx=0x7f839c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d679eb9e6520af server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.816+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00f040 con 0x7f839c004d40 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.816+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ac02ace0 con 0x7f839c004d40 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.816+0000 7f83a7fff640 1 -- 172.21.15.81:0/2214424816 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac004250 con 0x7f839c004d40 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.816+0000 7f83b731f640 1 -- 172.21.15.81:0/2214424816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839c004d40 msgr2=0x7f839c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.816+0000 7f83b731f640 1 --2- 172.21.15.81:0/2214424816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f839c004d40 0x7f839c0051c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0098a0 tx=0x7f839c005830 comp rx=0 tx=0).stop 2024-09-16T01:17:20.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.817+0000 7f83b58bc640 1 -- 172.21.15.81:0/2214424816 reap_dead start 2024-09-16T01:17:20.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.817+0000 7f83b731f640 1 -- 172.21.15.81:0/2214424816 shutdown_connections 2024-09-16T01:17:20.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.817+0000 7f83b731f640 1 -- 172.21.15.81:0/2214424816 >> 172.21.15.81:0/2214424816 conn(0x7f83b00d23a0 msgr2=0x7f83b00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:20.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.817+0000 7f83b731f640 1 -- 172.21.15.81:0/2214424816 shutdown_connections 2024-09-16T01:17:20.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.817+0000 7f83b731f640 1 -- 172.21.15.81:0/2214424816 wait complete. 2024-09-16T01:17:20.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.818+0000 7f83b731f640 1 Processor -- start 2024-09-16T01:17:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.818+0000 7f83b731f640 1 -- start start 2024-09-16T01:17:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b731f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f839c004d40 0x7f83b01f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b731f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b01f5240 0x7f83b00b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b731f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83b00b7070 0x7f83b01f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b731f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f83b015eb30 con 0x7f83b00b7070 2024-09-16T01:17:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b731f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f83b015e9b0 con 0x7f839c004d40 2024-09-16T01:17:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b731f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f83b00d1630 con 0x7f83b01f5240 2024-09-16T01:17:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b58bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83b00b7070 0x7f83b01f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b58bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83b00b7070 0x7f83b01f4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51910/0 (socket says 172.21.15.81:51910) 2024-09-16T01:17:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b58bc640 1 -- 172.21.15.81:0/2751184082 learned_addr learned my addr 172.21.15.81:0/2751184082 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b50bb640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f839c004d40 0x7f83b01f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b48ba640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b01f5240 0x7f83b00b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b58bc640 1 -- 172.21.15.81:0/2751184082 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b01f5240 msgr2=0x7f83b00b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b58bc640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b01f5240 0x7f83b00b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b58bc640 1 -- 172.21.15.81:0/2751184082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f839c004d40 msgr2=0x7f83b01f3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b58bc640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f839c004d40 0x7f83b01f3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b58bc640 1 -- 172.21.15.81:0/2751184082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b01f4f40 con 0x7f83b00b7070 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b58bc640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83b00b7070 0x7f83b01f4210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0098a0 tx=0x7f83ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83a5ffb640 1 -- 172.21.15.81:0/2751184082 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00f000 con 0x7f83b00b7070 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83a5ffb640 1 -- 172.21.15.81:0/2751184082 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83ac044070 con 0x7f83b00b7070 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83b731f640 1 -- 172.21.15.81:0/2751184082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b00c5ed0 con 0x7f83b00b7070 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.819+0000 7f83a5ffb640 1 -- 172.21.15.81:0/2751184082 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ac003b30 con 0x7f83b00b7070 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.820+0000 7f83b731f640 1 -- 172.21.15.81:0/2751184082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b00c6490 con 0x7f83b00b7070 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.821+0000 7f83b731f640 1 -- 172.21.15.81:0/2751184082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b00d10f0 con 0x7f83b00b7070 2024-09-16T01:17:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.821+0000 7f83a5ffb640 1 -- 172.21.15.81:0/2751184082 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f83ac03b040 con 0x7f83b00b7070 2024-09-16T01:17:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.821+0000 7f83a5ffb640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f839406c2e0 0x7f839406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.822+0000 7f83a5ffb640 1 -- 172.21.15.81:0/2751184082 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f83ac0ab280 con 0x7f83b00b7070 2024-09-16T01:17:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.822+0000 7f83b50bb640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f839406c2e0 0x7f839406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.822+0000 7f83b50bb640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f839406c2e0 0x7f839406e7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f83b00b2c70 tx=0x7f83a8003c70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:20.826+0000 7f83a5ffb640 1 -- 172.21.15.81:0/2751184082 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83ac079180 con 0x7f83b00b7070 2024-09-16T01:17:21.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.032+0000 7f83b731f640 1 -- 172.21.15.81:0/2751184082 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83b00b8320 con 0x7f83b00b7070 2024-09-16T01:17:21.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.032+0000 7f83a5ffb640 1 -- 172.21.15.81:0/2751184082 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5223 (secure 0 0 0) 0x7f83ac07d480 con 0x7f83b00b7070 2024-09-16T01:17:21.034 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:21.034 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"btime":"2024-09-16T01:16:34:988023+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2179103223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2179103223},{"type":"v1","addr":"172.21.15.81:6836","nonce":2179103223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4649,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/4263439893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":4263439893},{"type":"v1","addr":"172.21.15.102:6834","nonce":4263439893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/27716817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":27716817},{"type":"v1","addr":"172.21.15.102:6835","nonce":27716817}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:16:32.311950+0000","modified":"2024-09-16T01:16:34.313044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3051272390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3051272390},{"type":"v1","addr":"172.21.15.81:6837","nonce":3051272390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-16T01:17:21.034 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 16 2024-09-16T01:17:21.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.034+0000 7f83b731f640 1 -- 172.21.15.81:0/2751184082 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f839406c2e0 msgr2=0x7f839406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.034+0000 7f83b731f640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f839406c2e0 0x7f839406e7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f83b00b2c70 tx=0x7f83a8003c70 comp rx=0 tx=0).stop 2024-09-16T01:17:21.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.034+0000 7f83b731f640 1 -- 172.21.15.81:0/2751184082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83b00b7070 msgr2=0x7f83b01f4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.034+0000 7f83b731f640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83b00b7070 0x7f83b01f4210 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0098a0 tx=0x7f83ac004730 comp rx=0 tx=0).stop 2024-09-16T01:17:21.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.034+0000 7f83b731f640 1 -- 172.21.15.81:0/2751184082 shutdown_connections 2024-09-16T01:17:21.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.034+0000 7f83b731f640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f839406c2e0 0x7f839406e7a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.034+0000 7f83b731f640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83b00b7070 0x7f83b01f4210 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.034+0000 7f83b731f640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83b01f5240 0x7f83b00b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.034+0000 7f83b731f640 1 --2- 172.21.15.81:0/2751184082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f839c004d40 0x7f83b01f3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.034+0000 7f83b731f640 1 -- 172.21.15.81:0/2751184082 >> 172.21.15.81:0/2751184082 conn(0x7f83b00d23a0 msgr2=0x7f83b00b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:21.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.034+0000 7f83b731f640 1 -- 172.21.15.81:0/2751184082 shutdown_connections 2024-09-16T01:17:21.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.034+0000 7f83b731f640 1 -- 172.21.15.81:0/2751184082 wait complete. 2024-09-16T01:17:21.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-16T01:17:21.163 INFO:teuthology.orchestra.run.smithi081.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":189,"msgr_send_messages":152,"msgr_recv_bytes":54200,"msgr_send_bytes":508708,"msgr_created_connections":8,"msgr_active_connections":4,"msgr_running_total_time":0.019662819,"msgr_running_send_time":0.005186803,"msgr_running_recv_time":0.007708315,"msgr_running_fast_dispatch_time":0.005037964,"msgr_send_messages_queue_lat":{"avgcount":151,"sum":0.044080918,"avgtime":0.000291926},"msgr_handle_ack_lat":{"avgcount":15,"sum":0.000006947,"avgtime":0.000000463},"msgr_recv_encrypted_bytes":1568,"msgr_send_encrypted_bytes":448},"AsyncMessenger::Worker-1":{"msgr_recv_messages":76,"msgr_send_messages":71,"msgr_recv_bytes":118152,"msgr_send_bytes":22126,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.010311717,"msgr_running_send_time":0.004926820,"msgr_running_recv_time":0.007119432,"msgr_running_fast_dispatch_time":0.000211180,"msgr_send_messages_queue_lat":{"avgcount":70,"sum":0.061557831,"avgtime":0.000879397},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":115440,"msgr_send_encrypted_bytes":17472},"AsyncMessenger::Worker-2":{"msgr_recv_messages":402,"msgr_send_messages":489,"msgr_recv_bytes":108773,"msgr_send_bytes":372263,"msgr_created_connections":8,"msgr_active_connections":7,"msgr_running_total_time":0.029408132,"msgr_running_send_time":0.013910790,"msgr_running_recv_time":0.017943010,"msgr_running_fast_dispatch_time":0.002365151,"msgr_send_messages_queue_lat":{"avgcount":488,"sum":0.033289510,"avgtime":0.000068216},"msgr_handle_ack_lat":{"avgcount":466,"sum":0.000099892,"avgtime":0.000000214},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":106704},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":269,"sum":0.060694591,"avgtime":0.000225630}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000012044,"avgtime":0.000006022}},"mds":{"request":148,"reply":148,"reply_latency":{"avgcount":148,"sum":39.090799642,"avgtime":0.264127024},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":114,"inodes_top":0,"inodes_bottom":114,"inodes_pin_tail":0,"inodes_pinned":114,"inodes_expired":0,"inodes_with_caps":100,"caps":101,"subtrees":2,"traverse":188,"traverse_hit":174,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":100,"root_rbytes":160,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":4,"ceph_cap_op_grant":112,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":104,"handle_client_caps_dirty":100,"handle_client_cap_release":1,"process_request_cap_release":14},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":219,"evex":0,"evtrm":0,"ev":219,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4639776,"rdpos":0,"jlat":{"avgcount":109,"sum":0.198462973,"avgtime":0.001820761},"replayed":0},"mds_mem":{"ino":117,"ino+":117,"ino-":0,"dir":16,"dir+":16,"dir-":0,"dn":114,"dn+":115,"dn-":1,"cap":101,"cap+":106,"cap-":5,"rss":50624,"heap":231788},"mds_server":{"dispatch_client_request":230,"dispatch_server_request":0,"handle_client_request":148,"handle_client_session":106,"handle_peer_request":0,"req_create_latency":{"avgcount":100,"sum":0.062832390,"avgtime":0.000628323},"req_getattr_latency":{"avgcount":32,"sum":0.005254014,"avgtime":0.000164187},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":4,"sum":0.000402231,"avgtime":0.000100557},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":4,"sum":0.005991297,"avgtime":0.001497824},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000310763,"avgtime":0.000155381},"req_readdir_latency":{"avgcount":5,"sum":39.015742322,"avgtime":7.803148464},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000266625,"avgtime":0.000266625},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":78,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":2,"session_add":2,"session_remove":0,"sessions_open":2,"sessions_stale":0,"total_load":93,"average_load":46,"avg_session_uptime":42,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":246432,"buffer_anon_items":214,"buffer_meta_bytes":1496,"buffer_meta_items":17,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5424,"osdmap_items":76,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":420136,"mds_co_items":4385,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":151,"op_send_bytes":463251,"op_resend":37,"op_reply":151,"op_latency":{"avgcount":151,"sum":0.656986797,"avgtime":0.004350905},"op_inflight":0,"oplen_avg":{"avgcount":151,"sum":178},"op":151,"op_r":0,"op_w":151,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":109,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":37,"map_full":0,"map_inc":1,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":20,"omap_rd":0,"omap_del":2},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":2},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":663,"get_sum":223809,"get_or_fail_fail":0,"get_or_fail_success":663,"take":0,"take_sum":0,"put":663,"put_sum":223809,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":151,"take_sum":463251,"put":151,"put_sum":463251,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":151,"take_sum":151,"put":151,"put_sum":151,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55580ffba500":{"val":0,"max":3758096384,"get_started":0,"get":219,"get_sum":445472,"get_or_fail_fail":0,"get_or_fail_success":219,"take":0,"take_sum":0,"put":109,"put_sum":445472,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-16T01:17:21.164 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 15, "avgtime": 4.63e-07, "sum": 6.947e-06 }, "msgr_recv_bytes": 54200, "msgr_recv_encrypted_bytes": 1568, "msgr_recv_messages": 189, "msgr_running_fast_dispatch_time": 0.005037964, "msgr_running_recv_time": 0.007708315, "msgr_running_send_time": 0.005186803, "msgr_running_total_time": 0.019662819, "msgr_send_bytes": 508708, "msgr_send_encrypted_bytes": 448, "msgr_send_messages": 152, "msgr_send_messages_queue_lat": { "avgcount": 151, "avgtime": 0.000291926, "sum": 0.044080918 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 118152, "msgr_recv_encrypted_bytes": 115440, "msgr_recv_messages": 76, "msgr_running_fast_dispatch_time": 0.00021118, "msgr_running_recv_time": 0.007119432, "msgr_running_send_time": 0.00492682, "msgr_running_total_time": 0.010311717, "msgr_send_bytes": 22126, "msgr_send_encrypted_bytes": 17472, "msgr_send_messages": 71, "msgr_send_messages_queue_lat": { "avgcount": 70, "avgtime": 0.000879397, "sum": 0.061557831 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 7, "msgr_created_connections": 8, "msgr_handle_ack_lat": { "avgcount": 466, "avgtime": 2.14e-07, "sum": 9.9892e-05 }, "msgr_recv_bytes": 108773, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 402, "msgr_running_fast_dispatch_time": 0.002365151, "msgr_running_recv_time": 0.01794301, "msgr_running_send_time": 0.01391079, "msgr_running_total_time": 0.029408132, "msgr_send_bytes": 372263, "msgr_send_encrypted_bytes": 106704, "msgr_send_messages": 489, "msgr_send_messages_queue_lat": { "avgcount": 488, "avgtime": 6.8216e-05, "sum": 0.03328951 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 269, "avgtime": 0.00022563, "sum": 0.060694591 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.022e-06, "sum": 1.2044e-05 }, "queue_len": 0 }, "mds": { "caps": 101, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 112, "ceph_cap_op_revoke": 4, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 104, "handle_client_caps_dirty": 100, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 114, "inodes_bottom": 114, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 114, "inodes_top": 0, "inodes_with_caps": 100, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 14, "q": 0, "reply": 148, "reply_latency": { "avgcount": 148, "avgtime": 0.264127024, "sum": 39.090799642 }, "request": 148, "root_rbytes": 160, "root_rfiles": 100, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 188, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 174, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 219, "evadd": 219, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 109, "avgtime": 0.001820761, "sum": 0.198462973 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4639776 }, "mds_mem": { "cap": 101, "cap+": 106, "cap-": 5, "dir": 16, "dir+": 16, "dir-": 0, "dn": 114, "dn+": 115, "dn-": 1, "heap": 231788, "ino": 117, "ino+": 117, "ino-": 0, "rss": 50624 }, "mds_server": { "cap_acquisition_throttle": 78, "cap_revoke_eviction": 0, "dispatch_client_request": 230, "dispatch_server_request": 0, "handle_client_request": 148, "handle_client_session": 106, "handle_peer_request": 0, "req_create_latency": { "avgcount": 100, "avgtime": 0.000628323, "sum": 0.06283239 }, "req_getattr_latency": { "avgcount": 32, "avgtime": 0.000164187, "sum": 0.005254014 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 4, "avgtime": 0.000100557, "sum": 0.000402231 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 4, "avgtime": 0.001497824, "sum": 0.005991297 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000155381, "sum": 0.000310763 }, "req_readdir_latency": { "avgcount": 5, "avgtime": 7.803148464, "sum": 39.015742322 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000266625, "sum": 0.000266625 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 46, "avg_session_uptime": 42, "mdthresh_evicted": 0, "session_add": 2, "session_count": 2, "session_remove": 0, "sessions_open": 2, "sessions_stale": 0, "total_load": 93 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 246432, "buffer_anon_items": 214, "buffer_meta_bytes": 1496, "buffer_meta_items": 17, "mds_co_bytes": 420136, "mds_co_items": 4385, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5424, "osdmap_items": 76, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 37, "map_full": 0, "map_inc": 1, "omap_del": 2, "omap_rd": 0, "omap_wr": 20, "op": 151, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 151, "avgtime": 0.004350905, "sum": 0.656986797 }, "op_pg": 0, "op_r": 0, "op_reply": 151, "op_resend": 37, "op_rmw": 0, "op_send": 151, "op_send_bytes": 463251, "op_w": 151, "oplen_avg": { "avgcount": 151, "sum": 178 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 109, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 2 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 663, "get_or_fail_fail": 0, "get_or_fail_success": 663, "get_started": 0, "get_sum": 223809, "max": 104857600, "put": 663, "put_sum": 223809, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 151, "put_sum": 463251, "take": 151, "take_sum": 463251, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 151, "put_sum": 151, "take": 151, "take_sum": 151, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55580ffba500": { "get": 219, "get_or_fail_fail": 0, "get_or_fail_success": 219, "get_started": 0, "get_sum": 445472, "max": 3758096384, "put": 109, "put_sum": 445472, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-16T01:17:21.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.260+0000 7f7e7f952640 1 Processor -- start 2024-09-16T01:17:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.261+0000 7f7e7f952640 1 -- start start 2024-09-16T01:17:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.261+0000 7f7e7f952640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e780b6570 0x7f7e780ae240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.261+0000 7f7e7f952640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e7806c320 0x7f7e7815de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.261+0000 7f7e7f952640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e7815d4a0 con 0x7f7e78145fa0 2024-09-16T01:17:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.261+0000 7f7e7f952640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7e7806cb10 con 0x7f7e7806c320 2024-09-16T01:17:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.261+0000 7f7e7f952640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7e780b3ac0 con 0x7f7e780b6570 2024-09-16T01:17:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.262+0000 7f7e7deef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e7806c320 0x7f7e7815de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.262+0000 7f7e7deef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e7806c320 0x7f7e7815de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46300/0 (socket says 172.21.15.81:46300) 2024-09-16T01:17:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.262+0000 7f7e7deef640 1 -- 172.21.15.81:0/4121976334 learned_addr learned my addr 172.21.15.81:0/4121976334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.262+0000 7f7e7ceed640 1 --2- 172.21.15.81:0/4121976334 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e780b6570 0x7f7e780ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.262+0000 7f7e7deef640 1 -- 172.21.15.81:0/4121976334 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e780b6570 msgr2=0x7f7e780ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.262+0000 7f7e7deef640 1 --2- 172.21.15.81:0/4121976334 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e780b6570 0x7f7e780ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.262+0000 7f7e7deef640 1 -- 172.21.15.81:0/4121976334 >> v1:172.21.15.102:6789/0 conn(0x7f7e78145fa0 legacy=0x7f7e7806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.262+0000 7f7e7deef640 1 -- 172.21.15.81:0/4121976334 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7815d710 con 0x7f7e7806c320 2024-09-16T01:17:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.263+0000 7f7e7deef640 1 --2- 172.21.15.81:0/4121976334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7806c320 0x7f7e7815de70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009e50 tx=0x7f7e6802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab5761173e275fa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.263+0000 7f7e77fff640 1 -- 172.21.15.81:0/4121976334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68036070 con 0x7f7e7806c320 2024-09-16T01:17:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.263+0000 7f7e77fff640 1 -- 172.21.15.81:0/4121976334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e68031600 con 0x7f7e7806c320 2024-09-16T01:17:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.263+0000 7f7e77fff640 1 -- 172.21.15.81:0/4121976334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e680319d0 con 0x7f7e7806c320 2024-09-16T01:17:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.263+0000 7f7e7f952640 1 -- 172.21.15.81:0/4121976334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7806c320 msgr2=0x7f7e7815de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.263+0000 7f7e7f952640 1 --2- 172.21.15.81:0/4121976334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7806c320 0x7f7e7815de70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009e50 tx=0x7f7e6802a680 comp rx=0 tx=0).stop 2024-09-16T01:17:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.263+0000 7f7e7f952640 1 -- 172.21.15.81:0/4121976334 shutdown_connections 2024-09-16T01:17:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.263+0000 7f7e7f952640 1 --2- 172.21.15.81:0/4121976334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7806c320 0x7f7e7815de70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.263+0000 7f7e7f952640 1 --2- 172.21.15.81:0/4121976334 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e780b6570 0x7f7e780ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.263+0000 7f7e7f952640 1 -- 172.21.15.81:0/4121976334 >> 172.21.15.81:0/4121976334 conn(0x7f7e78073490 msgr2=0x7f7e780b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.263+0000 7f7e7f952640 1 -- 172.21.15.81:0/4121976334 shutdown_connections 2024-09-16T01:17:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.263+0000 7f7e7f952640 1 -- 172.21.15.81:0/4121976334 wait complete. 2024-09-16T01:17:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.265+0000 7f7e7f952640 1 Processor -- start 2024-09-16T01:17:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.265+0000 7f7e7f952640 1 -- start start 2024-09-16T01:17:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.265+0000 7f7e7f952640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e7806c320 0x7f7e781e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.265+0000 7f7e7f952640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780b6570 0x7f7e781e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.265+0000 7f7e7f952640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e78145fa0 0x7f7e781e78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.265+0000 7f7e7f952640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7815e3b0 con 0x7f7e780b6570 2024-09-16T01:17:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.265+0000 7f7e7f952640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7809aa30 con 0x7f7e7806c320 2024-09-16T01:17:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.265+0000 7f7e7f952640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7815e530 con 0x7f7e78145fa0 2024-09-16T01:17:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.265+0000 7f7e7ceed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780b6570 0x7f7e781e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.265+0000 7f7e7ceed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780b6570 0x7f7e781e7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46316/0 (socket says 172.21.15.81:46316) 2024-09-16T01:17:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.265+0000 7f7e7ceed640 1 -- 172.21.15.81:0/4005288999 learned_addr learned my addr 172.21.15.81:0/4005288999 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e7deef640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e78145fa0 0x7f7e781e78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e7d6ee640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e7806c320 0x7f7e781e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e7ceed640 1 -- 172.21.15.81:0/4005288999 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e78145fa0 msgr2=0x7f7e781e78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e7ceed640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e78145fa0 0x7f7e781e78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e7ceed640 1 -- 172.21.15.81:0/4005288999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e7806c320 msgr2=0x7f7e781e61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e7ceed640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e7806c320 0x7f7e781e61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e7ceed640 1 -- 172.21.15.81:0/4005288999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e781e68a0 con 0x7f7e780b6570 2024-09-16T01:17:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e7ceed640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780b6570 0x7f7e781e7380 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00d7d0 tx=0x7f7e6c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e75ffb640 1 -- 172.21.15.81:0/4005288999 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00b6c0 con 0x7f7e780b6570 2024-09-16T01:17:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e75ffb640 1 -- 172.21.15.81:0/4005288999 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6c019070 con 0x7f7e780b6570 2024-09-16T01:17:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e7f952640 1 -- 172.21.15.81:0/4005288999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e781e6b80 con 0x7f7e780b6570 2024-09-16T01:17:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e75ffb640 1 -- 172.21.15.81:0/4005288999 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00bac0 con 0x7f7e780b6570 2024-09-16T01:17:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.266+0000 7f7e7f952640 1 -- 172.21.15.81:0/4005288999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e780b0ae0 con 0x7f7e780b6570 2024-09-16T01:17:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.267+0000 7f7e7f952640 1 -- 172.21.15.81:0/4005288999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e780af600 con 0x7f7e780b6570 2024-09-16T01:17:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.267+0000 7f7e75ffb640 1 -- 172.21.15.81:0/4005288999 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7e6c00bc60 con 0x7f7e780b6570 2024-09-16T01:17:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.268+0000 7f7e75ffb640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e6406c2b0 0x7f7e6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.268+0000 7f7e7d6ee640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e6406c2b0 0x7f7e6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.268+0000 7f7e75ffb640 1 -- 172.21.15.81:0/4005288999 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6130+0+0 (secure 0 0 0) 0x7f7e6c08ba20 con 0x7f7e780b6570 2024-09-16T01:17:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.268+0000 7f7e7d6ee640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e6406c2b0 0x7f7e6406e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e70007fd0 tx=0x7f7e70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.272+0000 7f7e75ffb640 1 -- 172.21.15.81:0/4005288999 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e780af600 con 0x7f7e780b6570 2024-09-16T01:17:21.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.473+0000 7f7e7f952640 1 -- 172.21.15.81:0/4005288999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e7815de70 con 0x7f7e780b6570 2024-09-16T01:17:21.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.473+0000 7f7e75ffb640 1 -- 172.21.15.81:0/4005288999 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5223 (secure 0 0 0) 0x7f7e6c05a070 con 0x7f7e780b6570 2024-09-16T01:17:21.475 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:21.475 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"btime":"2024-09-16T01:16:34:988023+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2179103223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2179103223},{"type":"v1","addr":"172.21.15.81:6836","nonce":2179103223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4649,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/4263439893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":4263439893},{"type":"v1","addr":"172.21.15.102:6834","nonce":4263439893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/27716817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":27716817},{"type":"v1","addr":"172.21.15.102:6835","nonce":27716817}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:16:32.311950+0000","modified":"2024-09-16T01:16:34.313044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3051272390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3051272390},{"type":"v1","addr":"172.21.15.81:6837","nonce":3051272390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-16T01:17:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 16 2024-09-16T01:17:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.476+0000 7f7e7f952640 1 -- 172.21.15.81:0/4005288999 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e6406c2b0 msgr2=0x7f7e6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.476+0000 7f7e7f952640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e6406c2b0 0x7f7e6406e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e70007fd0 tx=0x7f7e70009040 comp rx=0 tx=0).stop 2024-09-16T01:17:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.476+0000 7f7e7f952640 1 -- 172.21.15.81:0/4005288999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780b6570 msgr2=0x7f7e781e7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.476+0000 7f7e7f952640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780b6570 0x7f7e781e7380 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00d7d0 tx=0x7f7e6c00dc90 comp rx=0 tx=0).stop 2024-09-16T01:17:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.476+0000 7f7e7f952640 1 -- 172.21.15.81:0/4005288999 shutdown_connections 2024-09-16T01:17:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.476+0000 7f7e7f952640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e6406c2b0 0x7f7e6406e770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.476+0000 7f7e7f952640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e78145fa0 0x7f7e781e78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.476+0000 7f7e7f952640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780b6570 0x7f7e781e7380 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.476+0000 7f7e7f952640 1 --2- 172.21.15.81:0/4005288999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e7806c320 0x7f7e781e61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.476+0000 7f7e7f952640 1 -- 172.21.15.81:0/4005288999 >> 172.21.15.81:0/4005288999 conn(0x7f7e78073490 msgr2=0x7f7e78070840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.476+0000 7f7e7f952640 1 -- 172.21.15.81:0/4005288999 shutdown_connections 2024-09-16T01:17:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.476+0000 7f7e7f952640 1 -- 172.21.15.81:0/4005288999 wait complete. 2024-09-16T01:17:21.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T01:17:21.604 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":4757,"entity":{"name":{"type":"client","num":4757},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":1643801277}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":2,"uptime":42.039154574000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":8.1897760302282112,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.4757 v1:192.168.0.1:0/1643801277","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi102","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":4867,"entity":{"name":{"type":"client","num":4867},"addr":{"type":"v1","addr":"172.21.15.81:0","nonce":483559150}},"state":"open","num_leases":1,"num_caps":100,"request_load_avg":90,"uptime":43.143132377999997,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":12.880450893128648,"halflife":60},"release_caps":{"value":3.3143440208544659,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":194.8208090796571,"halflife":300},"cap_acquisition":{"value":60.516256154594039,"halflife":30},"last_trim_completed_requests_tid":144,"last_trim_completed_flushes_tid":101,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.4867 v1:172.21.15.81:0/483559150","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000025c","length":899}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi081","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-16T01:17:21.605 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi102", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 1643801277, "type": "v1" }, "name": { "num": 4757, "type": "client" } }, "id": 4757, "inst": "client.4757 v1:192.168.0.1:0/1643801277", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 8.189776030228211 }, "state": "open", "uptime": 42.039154574 }, { "cap_acquisition": { "halflife": 30, "value": 60.51625615459404 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi081", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 483559150, "type": "v1" }, "name": { "num": 4867, "type": "client" } }, "id": 4867, "inst": "client.4867 v1:172.21.15.81:0/483559150", "last_trim_completed_flushes_tid": 101, "last_trim_completed_requests_tid": 144, "num_caps": 100, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 899, "start": "0x1000000025c" } ], "recall_caps": { "halflife": 60, "value": 12.880450893128648 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 3.314344020854466 }, "request_load_avg": 90, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 194.8208090796571 }, "state": "open", "uptime": 43.143132378 } ] 2024-09-16T01:17:21.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump_historic_ops 2024-09-16T01:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.703+0000 7f50f0a2e640 1 Processor -- start 2024-09-16T01:17:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.703+0000 7f50f0a2e640 1 -- start start 2024-09-16T01:17:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50f0a2e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f50ec0b69d0 0x7f50ec162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50f0a2e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f50ec0af280 0x7f50ec0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50f0a2e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50ec0affb0 0x7f50ec154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50f0a2e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f50ec0b6db0 con 0x7f50ec0b69d0 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50f0a2e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f50ec15eb60 con 0x7f50ec0af280 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50f0a2e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f50ec15ee40 con 0x7f50ec0affb0 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50ea59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f50ec0b69d0 0x7f50ec162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50ea59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f50ec0b69d0 0x7f50ec162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46332/0 (socket says 172.21.15.81:46332) 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50ea59c640 1 -- 172.21.15.81:0/3849313610 learned_addr learned my addr 172.21.15.81:0/3849313610 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/3849313610 >> v2:172.21.15.102:3300/0 conn(0x7f50ec0af280 0x7f50ec0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50ead9d640 1 --2- 172.21.15.81:0/3849313610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50ec0affb0 0x7f50ec154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50ea59c640 1 -- 172.21.15.81:0/3849313610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50ec0affb0 msgr2=0x7f50ec154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50ea59c640 1 --2- 172.21.15.81:0/3849313610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50ec0affb0 0x7f50ec154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.704+0000 7f50ea59c640 1 -- 172.21.15.81:0/3849313610 >> v2:172.21.15.102:3300/0 conn(0x7f50ec0af280 msgr2=0x7f50ec0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.705+0000 7f50ea59c640 1 --2- 172.21.15.81:0/3849313610 >> v2:172.21.15.102:3300/0 conn(0x7f50ec0af280 0x7f50ec0afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.705+0000 7f50ea59c640 1 -- 172.21.15.81:0/3849313610 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ec15f120 con 0x7f50ec0b69d0 2024-09-16T01:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.705+0000 7f50ea59c640 1 --2- 172.21.15.81:0/3849313610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50ec0b69d0 0x7f50ec162a50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f50ec067bf0 tx=0x7f50dc02a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd5cbd01b1a04ac server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.705+0000 7f50e959a640 1 -- 172.21.15.81:0/3849313610 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc036070 con 0x7f50ec0b69d0 2024-09-16T01:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.705+0000 7f50e959a640 1 -- 172.21.15.81:0/3849313610 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50dc031600 con 0x7f50ec0b69d0 2024-09-16T01:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.705+0000 7f50e959a640 1 -- 172.21.15.81:0/3849313610 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0319d0 con 0x7f50ec0b69d0 2024-09-16T01:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.706+0000 7f50f0a2e640 1 -- 172.21.15.81:0/3849313610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50ec0b69d0 msgr2=0x7f50ec162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.706+0000 7f50f0a2e640 1 --2- 172.21.15.81:0/3849313610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50ec0b69d0 0x7f50ec162a50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f50ec067bf0 tx=0x7f50dc02a570 comp rx=0 tx=0).stop 2024-09-16T01:17:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.706+0000 7f50f0a2e640 1 -- 172.21.15.81:0/3849313610 shutdown_connections 2024-09-16T01:17:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.706+0000 7f50f0a2e640 1 --2- 172.21.15.81:0/3849313610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50ec0affb0 0x7f50ec154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.706+0000 7f50f0a2e640 1 --2- 172.21.15.81:0/3849313610 >> v2:172.21.15.102:3300/0 conn(0x7f50ec0af280 0x7f50ec0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.706+0000 7f50f0a2e640 1 --2- 172.21.15.81:0/3849313610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50ec0b69d0 0x7f50ec162a50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.706+0000 7f50f0a2e640 1 -- 172.21.15.81:0/3849313610 >> 172.21.15.81:0/3849313610 conn(0x7f50ec06bc10 msgr2=0x7f50ec06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.706+0000 7f50f0a2e640 1 -- 172.21.15.81:0/3849313610 shutdown_connections 2024-09-16T01:17:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.706+0000 7f50f0a2e640 1 -- 172.21.15.81:0/3849313610 wait complete. 2024-09-16T01:17:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.707+0000 7f50f0a2e640 1 Processor -- start 2024-09-16T01:17:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.707+0000 7f50f0a2e640 1 -- start start 2024-09-16T01:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50f0a2e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50ec0af280 0x7f50ec146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50f0a2e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50ec0affb0 0x7f50ec0cec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50f0a2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50ec0b69d0 0x7f50ec0ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50f0a2e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec155240 con 0x7f50ec0b69d0 2024-09-16T01:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50f0a2e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec0af710 con 0x7f50ec0af280 2024-09-16T01:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50f0a2e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f50ec1553c0 con 0x7f50ec0affb0 2024-09-16T01:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50ead9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50ec0b69d0 0x7f50ec0ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50ead9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50ec0b69d0 0x7f50ec0ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46336/0 (socket says 172.21.15.81:46336) 2024-09-16T01:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50ead9d640 1 -- 172.21.15.81:0/2629677959 learned_addr learned my addr 172.21.15.81:0/2629677959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50ea59c640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50ec0af280 0x7f50ec146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50ec0affb0 0x7f50ec0cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50ead9d640 1 -- 172.21.15.81:0/2629677959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50ec0affb0 msgr2=0x7f50ec0cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50ead9d640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50ec0affb0 0x7f50ec0cec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50ead9d640 1 -- 172.21.15.81:0/2629677959 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50ec0af280 msgr2=0x7f50ec146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50ead9d640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50ec0af280 0x7f50ec146570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.708+0000 7f50ead9d640 1 -- 172.21.15.81:0/2629677959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ec0cf170 con 0x7f50ec0b69d0 2024-09-16T01:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.709+0000 7f50ead9d640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50ec0b69d0 0x7f50ec0ae4e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f50e400d800 tx=0x7f50e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.709+0000 7f50daffd640 1 -- 172.21.15.81:0/2629677959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e400b6c0 con 0x7f50ec0b69d0 2024-09-16T01:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.709+0000 7f50daffd640 1 -- 172.21.15.81:0/2629677959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e4019070 con 0x7f50ec0b69d0 2024-09-16T01:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.709+0000 7f50f0a2e640 1 -- 172.21.15.81:0/2629677959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ec0cf3f0 con 0x7f50ec0b69d0 2024-09-16T01:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.709+0000 7f50daffd640 1 -- 172.21.15.81:0/2629677959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e400bac0 con 0x7f50ec0b69d0 2024-09-16T01:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.709+0000 7f50f0a2e640 1 -- 172.21.15.81:0/2629677959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ec0cf9b0 con 0x7f50ec0b69d0 2024-09-16T01:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.710+0000 7f50daffd640 1 -- 172.21.15.81:0/2629677959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f50e400bc60 con 0x7f50ec0b69d0 2024-09-16T01:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.711+0000 7f50daffd640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f50cc06c2b0 0x7f50cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.711+0000 7f50daffd640 1 -- 172.21.15.81:0/2629677959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6130+0+0 (secure 0 0 0) 0x7f50e408b910 con 0x7f50ec0b69d0 2024-09-16T01:17:21.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.711+0000 7f50ea59c640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f50cc06c2b0 0x7f50cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.711+0000 7f50ea59c640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f50cc06c2b0 0x7f50cc06e770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f50dc033000 tx=0x7f50dc009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:21.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.712+0000 7f50f37cd740 1 Processor -- start 2024-09-16T01:17:21.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.712+0000 7f50f37cd740 1 -- start start 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.712+0000 7f50f37cd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657acff540 0x55657ad44ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.712+0000 7f50f37cd740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657acfcd00 0x55657acff920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.712+0000 7f50f37cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 0x55657acf9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.712+0000 7f50f37cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55657ac625e0 con 0x55657ad00cd0 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.712+0000 7f50f37cd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55657ac0a400 con 0x55657acff540 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.712+0000 7f50f37cd740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55657ac5e5a0 con 0x55657acfcd00 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50ead9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 0x55657acf9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50ead9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 0x55657acf9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46350/0 (socket says 172.21.15.81:46350) 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50ead9d640 1 -- 172.21.15.81:0/2193162995 learned_addr learned my addr 172.21.15.81:0/2193162995 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50ea59c640 1 --2- 172.21.15.81:0/2193162995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657acff540 0x55657ad44ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/2193162995 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657acfcd00 0x55657acff920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50ead9d640 1 -- 172.21.15.81:0/2193162995 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657acfcd00 msgr2=0x55657acff920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:21.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50ead9d640 1 --2- 172.21.15.81:0/2193162995 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657acfcd00 0x55657acff920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50ead9d640 1 -- 172.21.15.81:0/2193162995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657acff540 msgr2=0x55657ad44ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:21.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50ead9d640 1 --2- 172.21.15.81:0/2193162995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657acff540 0x55657ad44ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50ead9d640 1 -- 172.21.15.81:0/2193162995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55657ac2fe90 con 0x55657ad00cd0 2024-09-16T01:17:21.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50ead9d640 1 --2- 172.21.15.81:0/2193162995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 0x55657acf9ae0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f50e4061e80 tx=0x7f50e40594d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d64adec041a6a05 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:21.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50cbfff640 1 -- 172.21.15.81:0/2193162995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e40600c0 con 0x55657ad00cd0 2024-09-16T01:17:21.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50cbfff640 1 -- 172.21.15.81:0/2193162995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e4057b80 con 0x55657ad00cd0 2024-09-16T01:17:21.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.713+0000 7f50cbfff640 1 -- 172.21.15.81:0/2193162995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4058cd0 con 0x55657ad00cd0 2024-09-16T01:17:21.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.714+0000 7f50f37cd740 1 -- 172.21.15.81:0/2193162995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 msgr2=0x55657acf9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.714+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2193162995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 0x55657acf9ae0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f50e4061e80 tx=0x7f50e40594d0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.714+0000 7f50f37cd740 1 -- 172.21.15.81:0/2193162995 shutdown_connections 2024-09-16T01:17:21.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.714+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2193162995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 0x55657acf9ae0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.714+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2193162995 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657acfcd00 0x55657acff920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.714+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2193162995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657acff540 0x55657ad44ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.714+0000 7f50f37cd740 1 -- 172.21.15.81:0/2193162995 >> 172.21.15.81:0/2193162995 conn(0x55657acfbd00 msgr2=0x55657ad441b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:21.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.714+0000 7f50f37cd740 1 -- 172.21.15.81:0/2193162995 shutdown_connections 2024-09-16T01:17:21.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.714+0000 7f50f37cd740 1 -- 172.21.15.81:0/2193162995 wait complete. 2024-09-16T01:17:21.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.714+0000 7f50f37cd740 1 -- start start 2024-09-16T01:17:21.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.715+0000 7f50f37cd740 1 Processor -- start 2024-09-16T01:17:21.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.715+0000 7f50f37cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 0x55657ad41900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.715+0000 7f50f37cd740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad00cd0 0x55657ad23a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.715+0000 7f50f37cd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657ad25550 0x55657ad259d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.715+0000 7f50f37cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55657acfb150 con 0x55657acff540 2024-09-16T01:17:21.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.715+0000 7f50f37cd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55657abeb350 con 0x55657ad25550 2024-09-16T01:17:21.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.715+0000 7f50f37cd740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55657ad45510 con 0x55657ad00cd0 2024-09-16T01:17:21.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50f37cd740 10 client.0 _ll_register_callbacks cb 0x55657ac0f3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50ea59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 0x55657ad41900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50ea59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 0x55657ad41900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46358/0 (socket says 172.21.15.81:46358) 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50ea59c640 1 -- 172.21.15.81:0/2390837049 learned_addr learned my addr 172.21.15.81:0/2390837049 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50ead9d640 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657ad25550 0x55657ad259d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad00cd0 0x55657ad23a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50ea59c640 1 -- 172.21.15.81:0/2390837049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad00cd0 msgr2=0x55657ad23a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50ea59c640 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad00cd0 0x55657ad23a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50ea59c640 1 -- 172.21.15.81:0/2390837049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657ad25550 msgr2=0x55657ad259d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50ea59c640 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657ad25550 0x55657ad259d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50ea59c640 1 -- 172.21.15.81:0/2390837049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55657a9753f0 con 0x55657acff540 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad00cd0 0x55657ad23a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50ea59c640 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 0x55657ad41900 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009f10 tx=0x7f50dc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e9cf5710b2ce9f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:21.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50c97fa640 1 -- 172.21.15.81:0/2390837049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc04e030 con 0x55657acff540 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50c97fa640 1 -- 172.21.15.81:0/2390837049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6130+0+0 (secure 0 0 0) 0x7f50dc03ca80 con 0x55657acff540 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50f37cd740 1 -- 172.21.15.81:0/2390837049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50e4057b80 con 0x55657acff540 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50c97fa640 1 -- 172.21.15.81:0/2390837049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f50dc036040 con 0x55657acff540 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50f37cd740 10 client.5187 fetch_fsmap learned FSMap version 16 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.716+0000 7f50f37cd740 1 -- 172.21.15.81:0/2390837049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55657aa3d760 con 0x55657acff540 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.717+0000 7f50c97fa640 1 -- 172.21.15.81:0/2390837049 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e4057b80 con 0x55657acff540 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.717+0000 7f50c97fa640 1 -- 172.21.15.81:0/2390837049 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f50dc008040 con 0x55657acff540 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.717+0000 7f50f37cd740 10 client.5187 fetch_fsmap finished waiting for FSMap version 16 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.717+0000 7f50f37cd740 10 client.5187 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.717+0000 7f50f37cd740 20 client.5187 populate_metadata read hostname 'smithi081' 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.717+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55657ad224a0 0x55657ad228e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.717+0000 7f50f37cd740 4 client.5187 mds_command: new command op to 4956 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:17:21.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.717+0000 7f50f37cd740 1 -- 172.21.15.81:0/2390837049 --> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55657ac6fd10 con 0x55657ad224a0 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.717+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55657ad224a0 0x55657ad228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.717+0000 7f50c97fa640 10 client.5187 ms_handle_connect on v2:172.21.15.81:6835/3051272390 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.717+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55657ad224a0 0x55657ad228e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7882ca054330f9f3 server_cookie=15ca7f2cebc773 in_seq=0 out_seq=0 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50c97fa640 1 -- 172.21.15.81:0/2390837049 <== mds.0 v2:172.21.15.81:6835/3051272390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55657ac6fd10 con 0x55657ad224a0 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50c97fa640 10 client.5187 handle_command_reply: tid=0 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50f37cd740 1 client.5187 shutdown 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50f37cd740 1 -- 172.21.15.81:0/2390837049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 msgr2=0x55657ad41900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 0x55657ad41900 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009f10 tx=0x7f50dc004ab0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50f37cd740 1 -- 172.21.15.81:0/2390837049 shutdown_connections 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55657ad224a0 0x55657ad228e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657ad25550 0x55657ad259d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50c97fa640 0 client.5187 ms_handle_reset on v2:172.21.15.81:6835/3051272390 2024-09-16T01:17:21.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad00cd0 0x55657ad23a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2390837049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 0x55657ad41900 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50f37cd740 1 -- 172.21.15.81:0/2390837049 >> 172.21.15.81:0/2390837049 conn(0x55657acfcd00 msgr2=0x55657ad42230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50f37cd740 1 -- 172.21.15.81:0/2390837049 shutdown_connections 2024-09-16T01:17:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50f37cd740 1 -- 172.21.15.81:0/2390837049 wait complete. 2024-09-16T01:17:21.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.718+0000 7f50f37cd740 20 client.5187 trim_cache size 0 max 16384 2024-09-16T01:17:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.732+0000 7f50f37cd740 1 Processor -- start 2024-09-16T01:17:21.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.732+0000 7f50f37cd740 1 -- start start 2024-09-16T01:17:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50f37cd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657acff540 0x55657ad42230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50f37cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 0x55657ad42770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50f37cd740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad25550 0x55657ad21180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50f37cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec201110 con 0x55657ad00cd0 2024-09-16T01:17:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50f37cd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec200150 con 0x55657acff540 2024-09-16T01:17:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50f37cd740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f50ec15dd40 con 0x55657ad25550 2024-09-16T01:17:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50e9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 0x55657ad42770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50e9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 0x55657ad42770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46372/0 (socket says 172.21.15.81:46372) 2024-09-16T01:17:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50e9d9b640 1 -- 172.21.15.81:0/984946547 learned_addr learned my addr 172.21.15.81:0/984946547 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50ea59c640 1 --2- 172.21.15.81:0/984946547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657acff540 0x55657ad42230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50e9d9b640 1 -- 172.21.15.81:0/984946547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad25550 msgr2=0x55657ad21180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50ead9d640 1 --2- 172.21.15.81:0/984946547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad25550 0x55657ad21180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/984946547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad25550 0x55657ad21180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50e9d9b640 1 -- 172.21.15.81:0/984946547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657acff540 msgr2=0x55657ad42230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/984946547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657acff540 0x55657ad42230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50e9d9b640 1 -- 172.21.15.81:0/984946547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55657ad28110 con 0x55657ad00cd0 2024-09-16T01:17:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50ea59c640 1 --2- 172.21.15.81:0/984946547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657acff540 0x55657ad42230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50ead9d640 1 --2- 172.21.15.81:0/984946547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad25550 0x55657ad21180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/984946547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 0x55657ad42770 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f50e0004360 tx=0x7f50e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d63f0e92355cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50cb7fe640 1 -- 172.21.15.81:0/984946547 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0025070 con 0x55657ad00cd0 2024-09-16T01:17:21.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50cb7fe640 1 -- 172.21.15.81:0/984946547 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e000bae0 con 0x55657ad00cd0 2024-09-16T01:17:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.733+0000 7f50cb7fe640 1 -- 172.21.15.81:0/984946547 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e001f3b0 con 0x55657ad00cd0 2024-09-16T01:17:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.734+0000 7f50f37cd740 1 -- 172.21.15.81:0/984946547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 msgr2=0x55657ad42770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.734+0000 7f50f37cd740 1 --2- 172.21.15.81:0/984946547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 0x55657ad42770 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f50e0004360 tx=0x7f50e0008040 comp rx=0 tx=0).stop 2024-09-16T01:17:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.734+0000 7f50f37cd740 1 -- 172.21.15.81:0/984946547 shutdown_connections 2024-09-16T01:17:21.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.734+0000 7f50f37cd740 1 --2- 172.21.15.81:0/984946547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad25550 0x55657ad21180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.734+0000 7f50f37cd740 1 --2- 172.21.15.81:0/984946547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657ad00cd0 0x55657ad42770 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.734+0000 7f50f37cd740 1 --2- 172.21.15.81:0/984946547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657acff540 0x55657ad42230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.734+0000 7f50f37cd740 1 -- 172.21.15.81:0/984946547 >> 172.21.15.81:0/984946547 conn(0x55657acfcd00 msgr2=0x55657ad43040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:21.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.734+0000 7f50f37cd740 1 -- 172.21.15.81:0/984946547 shutdown_connections 2024-09-16T01:17:21.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.734+0000 7f50f37cd740 1 -- 172.21.15.81:0/984946547 wait complete. 2024-09-16T01:17:21.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.735+0000 7f50f37cd740 1 -- start start 2024-09-16T01:17:21.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.735+0000 7f50f37cd740 1 Processor -- start 2024-09-16T01:17:21.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.735+0000 7f50f37cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 0x55657ad40330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50f37cd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657ad00cd0 0x55657adc2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50f37cd740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad25550 0x55657ad53720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50f37cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55657ad23b60 con 0x55657acff540 2024-09-16T01:17:21.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50f37cd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec15e390 con 0x55657ad00cd0 2024-09-16T01:17:21.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50f37cd740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55657ad28a40 con 0x55657ad25550 2024-09-16T01:17:21.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50f37cd740 10 client.0 _ll_register_callbacks cb 0x7f50dc031690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:17:21.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50ea59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 0x55657ad40330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50ea59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 0x55657ad40330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46388/0 (socket says 172.21.15.81:46388) 2024-09-16T01:17:21.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50ea59c640 1 -- 172.21.15.81:0/2652604276 learned_addr learned my addr 172.21.15.81:0/2652604276 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:21.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657ad00cd0 0x55657adc2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50ead9d640 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad25550 0x55657ad53720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50ea59c640 1 -- 172.21.15.81:0/2652604276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad25550 msgr2=0x55657ad53720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50ea59c640 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad25550 0x55657ad53720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50ea59c640 1 -- 172.21.15.81:0/2652604276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657ad00cd0 msgr2=0x55657adc2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50ea59c640 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657ad00cd0 0x55657adc2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50ea59c640 1 -- 172.21.15.81:0/2652604276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55657ad40870 con 0x55657acff540 2024-09-16T01:17:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50ea59c640 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 0x55657ad40330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f50dc02a5b0 tx=0x7f50dc03c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88408bd86a6dd72 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:17:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50c97fa640 1 -- 172.21.15.81:0/2652604276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc04e070 con 0x55657acff540 2024-09-16T01:17:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50c97fa640 1 -- 172.21.15.81:0/2652604276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6130+0+0 (secure 0 0 0) 0x7f50dc04a600 con 0x55657acff540 2024-09-16T01:17:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50f37cd740 1 -- 172.21.15.81:0/2652604276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50e000bae0 con 0x55657acff540 2024-09-16T01:17:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50c97fa640 1 -- 172.21.15.81:0/2652604276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f50dc068050 con 0x55657acff540 2024-09-16T01:17:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50f37cd740 10 client.5193 fetch_fsmap learned FSMap version 16 2024-09-16T01:17:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.736+0000 7f50f37cd740 1 -- 172.21.15.81:0/2652604276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x55657ad1ec70 con 0x55657acff540 2024-09-16T01:17:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.737+0000 7f50c97fa640 1 -- 172.21.15.81:0/2652604276 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e000bae0 con 0x55657acff540 2024-09-16T01:17:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.737+0000 7f50c97fa640 1 -- 172.21.15.81:0/2652604276 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f50dc06b020 con 0x55657acff540 2024-09-16T01:17:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.737+0000 7f50f37cd740 10 client.5193 fetch_fsmap finished waiting for FSMap version 16 2024-09-16T01:17:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.737+0000 7f50f37cd740 10 client.5193 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-16T01:17:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.737+0000 7f50f37cd740 20 client.5193 populate_metadata read hostname 'smithi081' 2024-09-16T01:17:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.737+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55657ad42230 0x55657ad42630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.737+0000 7f50f37cd740 4 client.5193 mds_command: new command op to 4956 tid=0 multi_id=0 [{"prefix": "dump_historic_ops"}] 2024-09-16T01:17:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.737+0000 7f50f37cd740 1 -- 172.21.15.81:0/2652604276 --> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] -- command(tid 0: {"prefix": "dump_historic_ops"}) -- 0x55657ac6a060 con 0x55657ad42230 2024-09-16T01:17:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.737+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55657ad42230 0x55657ad42630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.737+0000 7f50c97fa640 10 client.5193 ms_handle_connect on v2:172.21.15.81:6835/3051272390 2024-09-16T01:17:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.737+0000 7f50e9d9b640 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55657ad42230 0x55657ad42630 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5d5c6b8547f5713 server_cookie=7bb473791944620 in_seq=0 out_seq=0 2024-09-16T01:17:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.738+0000 7f50c97fa640 1 -- 172.21.15.81:0/2652604276 <== mds.0 v2:172.21.15.81:6835/3051272390 1 ==== command_reply(tid 0: 0 ) ==== 8+0+71062 (crc 0 0 0) 0x55657ac6a060 con 0x55657ad42230 2024-09-16T01:17:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.738+0000 7f50c97fa640 10 client.5193 handle_command_reply: tid=0 2024-09-16T01:17:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.738+0000 7f50f37cd740 1 client.5193 shutdown 2024-09-16T01:17:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.738+0000 7f50f37cd740 1 -- 172.21.15.81:0/2652604276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 msgr2=0x55657ad40330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.738+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 0x55657ad40330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f50dc02a5b0 tx=0x7f50dc03c000 comp rx=0 tx=0).stop 2024-09-16T01:17:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f37cd740 1 -- 172.21.15.81:0/2652604276 shutdown_connections 2024-09-16T01:17:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.81:6835/3051272390,v1:172.21.15.81:6837/3051272390] conn(0x55657ad42230 0x55657ad42630 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55657ad25550 0x55657ad53720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55657ad00cd0 0x55657adc2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f37cd740 1 --2- 172.21.15.81:0/2652604276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55657acff540 0x55657ad40330 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50c97fa640 0 client.5193 ms_handle_reset on v2:172.21.15.81:6835/3051272390 2024-09-16T01:17:21.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f37cd740 1 -- 172.21.15.81:0/2652604276 >> 172.21.15.81:0/2652604276 conn(0x55657acfcd00 msgr2=0x55657ad13450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:21.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f37cd740 1 -- 172.21.15.81:0/2652604276 shutdown_connections 2024-09-16T01:17:21.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f37cd740 1 -- 172.21.15.81:0/2652604276 wait complete. 2024-09-16T01:17:21.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f37cd740 20 client.5193 trim_cache size 0 max 16384 2024-09-16T01:17:21.755 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:17:21.755 INFO:teuthology.orchestra.run.smithi081.stdout: "size": 20, 2024-09-16T01:17:21.755 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 600, 2024-09-16T01:17:21.755 INFO:teuthology.orchestra.run.smithi081.stdout: "ops": [ 2024-09-16T01:17:21.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.755 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:2 setattr mode=041777 #0x1 2024-09-16T01:16:38.520727+0000 caller_uid=0, caller_gid=0{0,})", 2024-09-16T01:17:21.755 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:38.522408+0000", 2024-09-16T01:17:21.755 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 43.216702159, 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 1.0364313190000001, 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 2 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.756 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.757 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:38.522408+0000", 2024-09-16T01:17:21.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.757 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:38.522408+0000", 2024-09-16T01:17:21.757 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:38.522411+0000", 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:38.522423+0000", 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:38.522465+0000", 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.758 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:38.522615+0000", 2024-09-16T01:17:21.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:38.522680+0000", 2024-09-16T01:17:21.759 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.759 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:38.522681+0000", 2024-09-16T01:17:21.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.760 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:39.558717+0000", 2024-09-16T01:17:21.760 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:39.558753+0000", 2024-09-16T01:17:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:39.558824+0000", 2024-09-16T01:17:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:39.558839+0000", 2024-09-16T01:17:21.761 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:39.558840+0000", 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:27 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_0 2024-09-16T01:16:40.479688+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:40.480838+0000", 2024-09-16T01:17:21.762 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.258272904999998, 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0055819160000000001, 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 27 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.763 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.480838+0000", 2024-09-16T01:17:21.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.480838+0000", 2024-09-16T01:17:21.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.764 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.480838+0000", 2024-09-16T01:17:21.764 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.480843+0000", 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.480861+0000", 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.481032+0000", 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.481300+0000", 2024-09-16T01:17:21.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.481301+0000", 2024-09-16T01:17:21.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.766 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.486121+0000", 2024-09-16T01:17:21.766 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.486258+0000", 2024-09-16T01:17:21.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.767 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.486337+0000", 2024-09-16T01:17:21.767 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.486419+0000", 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.486420+0000", 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.769 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:29 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_2 2024-09-16T01:16:40.490688+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.769 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:40.491695+0000", 2024-09-16T01:17:21.769 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 41.247415601, 2024-09-16T01:17:21.769 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069151229999999996, 2024-09-16T01:17:21.769 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.769 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.769 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.769 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 29 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.491695+0000", 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.491695+0000", 2024-09-16T01:17:21.770 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.491696+0000", 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.491700+0000", 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.491718+0000", 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.491986+0000", 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.492300+0000", 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.492300+0000", 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.498319+0000", 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.498439+0000", 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.498527+0000", 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.773 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.498609+0000", 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.498610+0000", 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:58 create owner_uid=1000, owner_gid=1333 #0x1000000020e/file_3 2024-09-16T01:16:40.775682+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.774 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:40.777292+0000", 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.961818911000002, 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0054744260000000001, 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 58 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.775 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.776 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.777292+0000", 2024-09-16T01:17:21.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.777292+0000", 2024-09-16T01:17:21.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.776 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.777292+0000", 2024-09-16T01:17:21.776 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.777298+0000", 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.777338+0000", 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.777586+0000", 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.777894+0000", 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.777894+0000", 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.782474+0000", 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.782601+0000", 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.782683+0000", 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.782766+0000", 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.782766+0000", 2024-09-16T01:17:21.779 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:69 create owner_uid=1000, owner_gid=1333 #0x1000000020e/file_14 2024-09-16T01:16:40.822681+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:40.824284+0000", 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.914826916999999, 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0088177329999999995, 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 69 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.824284+0000", 2024-09-16T01:17:21.781 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.824284+0000", 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.824284+0000", 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.824289+0000", 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.824305+0000", 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.824576+0000", 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.824883+0000", 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.783 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.824884+0000", 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.832810+0000", 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.832939+0000", 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.833018+0000", 2024-09-16T01:17:21.784 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.833101+0000", 2024-09-16T01:17:21.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.785 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.833101+0000", 2024-09-16T01:17:21.785 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.785 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.785 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.785 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:72 create owner_uid=1000, owner_gid=1333 #0x1000000020e/file_17 2024-09-16T01:16:40.840681+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:40.842185+0000", 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.896925127999999, 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063089349999999999, 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.786 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 72 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.842185+0000", 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.842185+0000", 2024-09-16T01:17:21.787 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.842186+0000", 2024-09-16T01:17:21.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.842191+0000", 2024-09-16T01:17:21.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.788 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.842208+0000", 2024-09-16T01:17:21.788 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.842472+0000", 2024-09-16T01:17:21.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.842772+0000", 2024-09-16T01:17:21.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.789 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.842772+0000", 2024-09-16T01:17:21.789 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.848198+0000", 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.848326+0000", 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.848406+0000", 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.848494+0000", 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.848494+0000", 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.792 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:76 create owner_uid=1000, owner_gid=1333 #0x1000000020e/file_21 2024-09-16T01:16:40.860680+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.792 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:40.861611+0000", 2024-09-16T01:17:21.792 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.877499319999998, 2024-09-16T01:17:21.792 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0063194119999999999, 2024-09-16T01:17:21.792 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.792 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.792 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.792 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.793 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 76 2024-09-16T01:17:21.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.793 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.861611+0000", 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.861611+0000", 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.861612+0000", 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.861615+0000", 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.861632+0000", 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.861900+0000", 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.862210+0000", 2024-09-16T01:17:21.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.862210+0000", 2024-09-16T01:17:21.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.796 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.867646+0000", 2024-09-16T01:17:21.796 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.867770+0000", 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.867852+0000", 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.867930+0000", 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:40.867931+0000", 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:85 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_2 2024-09-16T01:16:41.067676+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:41.068696+0000", 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.670415081000002, 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0069175779999999997, 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 85 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.799 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.068696+0000", 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.068696+0000", 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.068696+0000", 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.068701+0000", 2024-09-16T01:17:21.800 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.068723+0000", 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.068945+0000", 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.069276+0000", 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.069277+0000", 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.075267+0000", 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.075386+0000", 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.075475+0000", 2024-09-16T01:17:21.802 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.075612+0000", 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.075613+0000", 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:86 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_3 2024-09-16T01:16:41.074676+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:41.075572+0000", 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.663538496000001, 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0065495019999999996, 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 86 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.075572+0000", 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.075572+0000", 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.075573+0000", 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.075577+0000", 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.075602+0000", 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.075831+0000", 2024-09-16T01:17:21.806 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.076145+0000", 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.076145+0000", 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.081779+0000", 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.081902+0000", 2024-09-16T01:17:21.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.081982+0000", 2024-09-16T01:17:21.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.808 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.082120+0000", 2024-09-16T01:17:21.808 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.809 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.082122+0000", 2024-09-16T01:17:21.809 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.809 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.809 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.809 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:89 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_6 2024-09-16T01:16:41.088676+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.809 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:41.089951+0000", 2024-09-16T01:17:21.809 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.649159398000002, 2024-09-16T01:17:21.809 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066960300000000004, 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 89 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.810 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.089951+0000", 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.089951+0000", 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.089952+0000", 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.811 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.089956+0000", 2024-09-16T01:17:21.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.089977+0000", 2024-09-16T01:17:21.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.812 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.090203+0000", 2024-09-16T01:17:21.812 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.090523+0000", 2024-09-16T01:17:21.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.090523+0000", 2024-09-16T01:17:21.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.813 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.096292+0000", 2024-09-16T01:17:21.813 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.096418+0000", 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.096510+0000", 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.096646+0000", 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.096647+0000", 2024-09-16T01:17:21.814 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:90 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_7 2024-09-16T01:16:41.095675+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:41.096610+0000", 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.642500552999998, 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0079650180000000008, 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.815 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 90 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.096610+0000", 2024-09-16T01:17:21.816 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.096610+0000", 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.096611+0000", 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.096615+0000", 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.096636+0000", 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.096865+0000", 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.097183+0000", 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.818 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.097183+0000", 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.104225+0000", 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.104348+0000", 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.104427+0000", 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.104574+0000", 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.104575+0000", 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.820 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:91 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_8 2024-09-16T01:16:41.103675+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:41.104535+0000", 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.634575839, 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006400963, 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 91 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.104535+0000", 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.104535+0000", 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.104535+0000", 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.104540+0000", 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.104562+0000", 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.104793+0000", 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.105112+0000", 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.105113+0000", 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.110596+0000", 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.110718+0000", 2024-09-16T01:17:21.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.110798+0000", 2024-09-16T01:17:21.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.825 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.110934+0000", 2024-09-16T01:17:21.825 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.110936+0000", 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:92 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_9 2024-09-16T01:16:41.109675+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:41.110895+0000", 2024-09-16T01:17:21.826 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.628215632, 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.006697616, 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 92 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.827 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.110895+0000", 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.110895+0000", 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.110896+0000", 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.110900+0000", 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.110921+0000", 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.111149+0000", 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.111484+0000", 2024-09-16T01:17:21.829 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.111484+0000", 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.117245+0000", 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.117369+0000", 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.117456+0000", 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.117591+0000", 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.117593+0000", 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.831 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:93 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_10 2024-09-16T01:16:41.116675+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:41.117558+0000", 2024-09-16T01:17:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.621552489999999, 2024-09-16T01:17:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0067968860000000002, 2024-09-16T01:17:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 93 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.833 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.117558+0000", 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.117558+0000", 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.117559+0000", 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.117563+0000", 2024-09-16T01:17:21.834 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.117587+0000", 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.117808+0000", 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.118127+0000", 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.118128+0000", 2024-09-16T01:17:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.124015+0000", 2024-09-16T01:17:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.836 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.124140+0000", 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.124219+0000", 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.124354+0000", 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.124355+0000", 2024-09-16T01:17:21.837 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:98 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_15 2024-09-16T01:16:41.140675+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:41.141796+0000", 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.597314492999999, 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0066529909999999996, 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.838 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 98 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.141796+0000", 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.141796+0000", 2024-09-16T01:17:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.141797+0000", 2024-09-16T01:17:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.141803+0000", 2024-09-16T01:17:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.141824+0000", 2024-09-16T01:17:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.142106+0000", 2024-09-16T01:17:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.142414+0000", 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.142414+0000", 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.148163+0000", 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.148289+0000", 2024-09-16T01:17:21.842 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.148363+0000", 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.148449+0000", 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.148449+0000", 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:102 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_19 2024-09-16T01:16:41.159674+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:41.160745+0000", 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.578365402999999, 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0058618580000000002, 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 102 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.160745+0000", 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.845 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.160745+0000", 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.160746+0000", 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.160751+0000", 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.160776+0000", 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.161045+0000", 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.161349+0000", 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.161350+0000", 2024-09-16T01:17:21.847 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.166306+0000", 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.166432+0000", 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.166526+0000", 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.166607+0000", 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.166607+0000", 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.849 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:113 create owner_uid=1000, owner_gid=1333 #0x10000000242/file_2 2024-09-16T01:16:41.374670+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:41.375578+0000", 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.363532927000001, 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0062279639999999999, 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 113 2024-09-16T01:17:21.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.375578+0000", 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.375578+0000", 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.375578+0000", 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.375584+0000", 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.375606+0000", 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.375867+0000", 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.376167+0000", 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.376168+0000", 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.381532+0000", 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.853 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.381651+0000", 2024-09-16T01:17:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.381725+0000", 2024-09-16T01:17:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.381805+0000", 2024-09-16T01:17:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.381806+0000", 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:115 create owner_uid=1000, owner_gid=1333 #0x10000000242/file_4 2024-09-16T01:16:41.384670+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:41.385923+0000", 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.353187124999998, 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 0.0061624619999999996, 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.856 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 115 2024-09-16T01:17:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.385923+0000", 2024-09-16T01:17:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.385923+0000", 2024-09-16T01:17:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.385924+0000", 2024-09-16T01:17:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.385930+0000", 2024-09-16T01:17:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.385952+0000", 2024-09-16T01:17:21.858 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.386225+0000", 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.386539+0000", 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "early_replied" 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.386539+0000", 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "submit entry: journal_and_reply" 2024-09-16T01:17:21.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.391806+0000", 2024-09-16T01:17:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "journal_committed: " 2024-09-16T01:17:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.391930+0000", 2024-09-16T01:17:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.392007+0000", 2024-09-16T01:17:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.392086+0000", 2024-09-16T01:17:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.392086+0000", 2024-09-16T01:17:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:143 readdir #0x10000000242 2024-09-16T01:16:41.681664+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:41.683187+0000", 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 40.055923208000003, 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 16.506551961, 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 143 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.683187+0000", 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.683187+0000", 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.864 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.683188+0000", 2024-09-16T01:17:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.683191+0000", 2024-09-16T01:17:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.683204+0000", 2024-09-16T01:17:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:41.683278+0000", 2024-09-16T01:17:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:42.183476+0000", 2024-09-16T01:17:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:42.683639+0000", 2024-09-16T01:17:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:43.183810+0000", 2024-09-16T01:17:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:43.683975+0000", 2024-09-16T01:17:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.867 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:44.184149+0000", 2024-09-16T01:17:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:44.684329+0000", 2024-09-16T01:17:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:45.184505+0000", 2024-09-16T01:17:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:45.684664+0000", 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:46.184806+0000", 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:46.684970+0000", 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.869 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:47.185140+0000", 2024-09-16T01:17:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:47.685303+0000", 2024-09-16T01:17:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:48.185487+0000", 2024-09-16T01:17:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.870 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:48.685660+0000", 2024-09-16T01:17:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:49.185792+0000", 2024-09-16T01:17:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:49.685940+0000", 2024-09-16T01:17:21.871 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:50.186155+0000", 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:50.686325+0000", 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:51.186516+0000", 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:51.686682+0000", 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:52.186856+0000", 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:52.687033+0000", 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.873 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:53.187221+0000", 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:53.687384+0000", 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:54.187512+0000", 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:54.687686+0000", 2024-09-16T01:17:21.874 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:55.187830+0000", 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:55.687991+0000", 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:56.188160+0000", 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:56.688324+0000", 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:57.188466+0000", 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:57.688648+0000", 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:58.189005+0000", 2024-09-16T01:17:21.876 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:58.189494+0000", 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:58.189544+0000", 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:58.189737+0000", 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:58.189739+0000", 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "description": "client_request(client.4867:144 readdir #0x10000000228 2024-09-16T01:16:58.189332+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "initiated_at": "2024-09-16T01:16:58.189896+0000", 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "age": 23.549214334999998, 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "duration": 22.508270304, 2024-09-16T01:17:21.878 INFO:teuthology.orchestra.run.smithi081.stdout: "continuous": false, 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type_data": { 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "result": 0, 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "flag_point": "done", 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "reqid": { 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": { 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4867 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "tid": 144 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "op_type": "client_request", 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "events": [ 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.879 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:58.189896+0000", 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "initiated" 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:58.189896+0000", 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "header_read" 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:58.189897+0000", 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "throttled" 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:58.189901+0000", 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "all_read" 2024-09-16T01:17:21.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:58.189962+0000", 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "dispatched" 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:58.190063+0000", 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:58.690254+0000", 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.881 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:59.190420+0000", 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:16:59.690560+0000", 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:00.190690+0000", 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:00.690847+0000", 2024-09-16T01:17:21.882 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:01.191016+0000", 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:01.691192+0000", 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:02.191358+0000", 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:02.691513+0000", 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:03.191684+0000", 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:03.691850+0000", 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:04.191976+0000", 2024-09-16T01:17:21.884 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:04.692149+0000", 2024-09-16T01:17:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:05.192319+0000", 2024-09-16T01:17:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:05.692496+0000", 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:06.192627+0000", 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:06.692798+0000", 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.886 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:07.192975+0000", 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:07.693151+0000", 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:08.193286+0000", 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:08.693484+0000", 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:09.193660+0000", 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:09.693837+0000", 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:10.194040+0000", 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:10.694216+0000", 2024-09-16T01:17:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:11.194392+0000", 2024-09-16T01:17:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:11.694538+0000", 2024-09-16T01:17:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:12.194690+0000", 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:12.694868+0000", 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:13.195011+0000", 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:13.695141+0000", 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:14.195329+0000", 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:14.695467+0000", 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:15.195610+0000", 2024-09-16T01:17:21.891 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:15.695789+0000", 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:16.195966+0000", 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:16.696151+0000", 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:17.196326+0000", 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:17.696510+0000", 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:18.196640+0000", 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.893 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:18.696809+0000", 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:19.196954+0000", 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:19.697076+0000", 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:20.197253+0000", 2024-09-16T01:17:21.894 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cap_acquisition_throttle" 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:20.697509+0000", 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "acquired locks" 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:20.697969+0000", 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "replying" 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:20.698030+0000", 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "finishing request" 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:20.698165+0000", 2024-09-16T01:17:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "cleaned up request" 2024-09-16T01:17:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "time": "2024-09-16T01:17:20.698167+0000", 2024-09-16T01:17:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "event": "done" 2024-09-16T01:17:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-16T01:17:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: "locks": null 2024-09-16T01:17:21.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:21.897 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-16T01:17:21.897 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:17:21.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f0a2e640 1 -- 172.21.15.81:0/2629677959 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f50cc06c2b0 msgr2=0x7f50cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f0a2e640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f50cc06c2b0 0x7f50cc06e770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f50dc033000 tx=0x7f50dc009000 comp rx=0 tx=0).stop 2024-09-16T01:17:21.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f0a2e640 1 -- 172.21.15.81:0/2629677959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50ec0b69d0 msgr2=0x7f50ec0ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:21.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f0a2e640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50ec0b69d0 0x7f50ec0ae4e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f50e400d800 tx=0x7f50e400dcc0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f0a2e640 1 -- 172.21.15.81:0/2629677959 shutdown_connections 2024-09-16T01:17:21.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f0a2e640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f50cc06c2b0 0x7f50cc06e770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f0a2e640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50ec0b69d0 0x7f50ec0ae4e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f0a2e640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50ec0affb0 0x7f50ec0cec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f0a2e640 1 --2- 172.21.15.81:0/2629677959 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50ec0af280 0x7f50ec146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:21.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f0a2e640 1 -- 172.21.15.81:0/2629677959 >> 172.21.15.81:0/2629677959 conn(0x7f50ec06bc10 msgr2=0x7f50ec153f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:21.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f0a2e640 1 -- 172.21.15.81:0/2629677959 shutdown_connections 2024-09-16T01:17:21.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:21.739+0000 7f50f0a2e640 1 -- 172.21.15.81:0/2629677959 wait complete. 2024-09-16T01:17:21.900 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:17:21.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:17:21.946 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:17:21.996 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:17:21.996 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:17:21.996 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:17:21.996 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:22.012 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:17:22.012 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:22.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:17:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.209+0000 7fa3efe5e640 1 Processor -- start 2024-09-16T01:17:22.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.209+0000 7fa3efe5e640 1 -- start start 2024-09-16T01:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3efe5e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3e815e740 0x7fa3e80d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3efe5e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa3e806dbd0 0x7fa3e806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3efe5e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e80d0780 con 0x7fa3e809b690 2024-09-16T01:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3efe5e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e815eb20 con 0x7fa3e815e740 2024-09-16T01:17:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3efe5e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e806d260 con 0x7fa3e806dbd0 2024-09-16T01:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3edbfa640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa3e815e740 0x7fa3e80d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3ed3f9640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa3e809b690 0x7fa3e806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46608/0 (socket says 172.21.15.81:46608) 2024-09-16T01:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3ed3f9640 1 -- 172.21.15.81:0/1935821411 learned_addr learned my addr 172.21.15.81:0/1935821411 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3edbfa640 1 -- 172.21.15.81:0/1935821411 >> v2:172.21.15.102:3300/0 conn(0x7fa3e806dbd0 msgr2=0x7fa3e806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3edbfa640 1 --2- 172.21.15.81:0/1935821411 >> v2:172.21.15.102:3300/0 conn(0x7fa3e806dbd0 0x7fa3e806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3edbfa640 1 -- 172.21.15.81:0/1935821411 >> v1:172.21.15.81:6789/0 conn(0x7fa3e809b690 legacy=0x7fa3e806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3edbfa640 1 -- 172.21.15.81:0/1935821411 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e80d0a60 con 0x7fa3e815e740 2024-09-16T01:17:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.210+0000 7fa3ecbf8640 1 -- 172.21.15.81:0/1935821411 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 804455459 0 0) 0x7fa3e80d0780 con 0x7fa3e809b690 2024-09-16T01:17:22.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.211+0000 7fa3edbfa640 1 --2- 172.21.15.81:0/1935821411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3e815e740 0x7fa3e80d1540 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa3e806cba0 tx=0x7fa3d802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bb27d08579d9ab server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.211+0000 7fa3ecbf8640 1 -- 172.21.15.81:0/1935821411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8037070 con 0x7fa3e815e740 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.211+0000 7fa3ecbf8640 1 -- 172.21.15.81:0/1935821411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d8032440 con 0x7fa3e815e740 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.211+0000 7fa3ecbf8640 1 -- 172.21.15.81:0/1935821411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8032810 con 0x7fa3e815e740 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.212+0000 7fa3efe5e640 1 -- 172.21.15.81:0/1935821411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3e815e740 msgr2=0x7fa3e80d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.212+0000 7fa3efe5e640 1 --2- 172.21.15.81:0/1935821411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3e815e740 0x7fa3e80d1540 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa3e806cba0 tx=0x7fa3d802a230 comp rx=0 tx=0).stop 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.212+0000 7fa3efe5e640 1 -- 172.21.15.81:0/1935821411 shutdown_connections 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.212+0000 7fa3efe5e640 1 --2- 172.21.15.81:0/1935821411 >> v2:172.21.15.102:3300/0 conn(0x7fa3e806dbd0 0x7fa3e806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.212+0000 7fa3efe5e640 1 --2- 172.21.15.81:0/1935821411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3e815e740 0x7fa3e80d1540 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.212+0000 7fa3efe5e640 1 -- 172.21.15.81:0/1935821411 >> 172.21.15.81:0/1935821411 conn(0x7fa3e80d23a0 msgr2=0x7fa3e80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.212+0000 7fa3efe5e640 1 -- 172.21.15.81:0/1935821411 shutdown_connections 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.212+0000 7fa3efe5e640 1 -- 172.21.15.81:0/1935821411 wait complete. 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.213+0000 7fa3efe5e640 1 Processor -- start 2024-09-16T01:17:22.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.213+0000 7fa3efe5e640 1 -- start start 2024-09-16T01:17:22.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3efe5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3e806dbd0 0x7fa3e81f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:22.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3efe5e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3e809b690 0x7fa3e80cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:22.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3efe5e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3e815e740 0x7fa3e80cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3efe5e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e809bac0 con 0x7fa3e806dbd0 2024-09-16T01:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3efe5e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e80d1020 con 0x7fa3e809b690 2024-09-16T01:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3efe5e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e806dfe0 con 0x7fa3e815e740 2024-09-16T01:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3edbfa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3e806dbd0 0x7fa3e81f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3edbfa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3e806dbd0 0x7fa3e81f74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46394/0 (socket says 172.21.15.81:46394) 2024-09-16T01:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3edbfa640 1 -- 172.21.15.81:0/3086077690 learned_addr learned my addr 172.21.15.81:0/3086077690 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3edbfa640 1 -- 172.21.15.81:0/3086077690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3e815e740 msgr2=0x7fa3e80cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3edbfa640 1 --2- 172.21.15.81:0/3086077690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3e815e740 0x7fa3e80cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3edbfa640 1 -- 172.21.15.81:0/3086077690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3e809b690 msgr2=0x7fa3e80cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3edbfa640 1 --2- 172.21.15.81:0/3086077690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3e809b690 0x7fa3e80cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3edbfa640 1 -- 172.21.15.81:0/3086077690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e81f7a00 con 0x7fa3e806dbd0 2024-09-16T01:17:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3edbfa640 1 --2- 172.21.15.81:0/3086077690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3e806dbd0 0x7fa3e81f74c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8000c00 tx=0x7fa3d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3de7fc640 1 -- 172.21.15.81:0/3086077690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8041070 con 0x7fa3e806dbd0 2024-09-16T01:17:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3de7fc640 1 -- 172.21.15.81:0/3086077690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d803c950 con 0x7fa3e806dbd0 2024-09-16T01:17:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3efe5e640 1 -- 172.21.15.81:0/3086077690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e81f4820 con 0x7fa3e806dbd0 2024-09-16T01:17:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.214+0000 7fa3de7fc640 1 -- 172.21.15.81:0/3086077690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8037040 con 0x7fa3e806dbd0 2024-09-16T01:17:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.215+0000 7fa3efe5e640 1 -- 172.21.15.81:0/3086077690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e81f4de0 con 0x7fa3e806dbd0 2024-09-16T01:17:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.215+0000 7fa3efe5e640 1 -- 172.21.15.81:0/3086077690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e80d0780 con 0x7fa3e806dbd0 2024-09-16T01:17:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.216+0000 7fa3de7fc640 1 -- 172.21.15.81:0/3086077690 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa3d8044070 con 0x7fa3e806dbd0 2024-09-16T01:17:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.217+0000 7fa3de7fc640 1 --2- 172.21.15.81:0/3086077690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa3cc06c2b0 0x7fa3cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.217+0000 7fa3ed3f9640 1 --2- 172.21.15.81:0/3086077690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa3cc06c2b0 0x7fa3cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.217+0000 7fa3de7fc640 1 -- 172.21.15.81:0/3086077690 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6130+0+0 (secure 0 0 0) 0x7fa3d80ac3c0 con 0x7fa3e806dbd0 2024-09-16T01:17:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.217+0000 7fa3ed3f9640 1 --2- 172.21.15.81:0/3086077690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa3cc06c2b0 0x7fa3cc06e770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4000c00 tx=0x7fa3e40079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.221+0000 7fa3de7fc640 1 -- 172.21.15.81:0/3086077690 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa3d807ab30 con 0x7fa3e806dbd0 2024-09-16T01:17:22.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.399+0000 7fa3efe5e640 1 -- 172.21.15.81:0/3086077690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa3e80d1cb0 con 0x7fa3e806dbd0 2024-09-16T01:17:22.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.399+0000 7fa3de7fc640 1 -- 172.21.15.81:0/3086077690 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7fa3d807a430 con 0x7fa3e806dbd0 2024-09-16T01:17:22.401 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:17:22.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.401+0000 7fa3efe5e640 1 -- 172.21.15.81:0/3086077690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa3cc06c2b0 msgr2=0x7fa3cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:22.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.401+0000 7fa3efe5e640 1 --2- 172.21.15.81:0/3086077690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa3cc06c2b0 0x7fa3cc06e770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4000c00 tx=0x7fa3e40079c0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.401+0000 7fa3efe5e640 1 -- 172.21.15.81:0/3086077690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3e806dbd0 msgr2=0x7fa3e81f74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:22.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.401+0000 7fa3efe5e640 1 --2- 172.21.15.81:0/3086077690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3e806dbd0 0x7fa3e81f74c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8000c00 tx=0x7fa3d80046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.401+0000 7fa3efe5e640 1 -- 172.21.15.81:0/3086077690 shutdown_connections 2024-09-16T01:17:22.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.401+0000 7fa3efe5e640 1 --2- 172.21.15.81:0/3086077690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa3cc06c2b0 0x7fa3cc06e770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.401+0000 7fa3efe5e640 1 --2- 172.21.15.81:0/3086077690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa3e815e740 0x7fa3e80cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.401+0000 7fa3efe5e640 1 --2- 172.21.15.81:0/3086077690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3e809b690 0x7fa3e80cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.401+0000 7fa3efe5e640 1 --2- 172.21.15.81:0/3086077690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3e806dbd0 0x7fa3e81f74c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.401+0000 7fa3efe5e640 1 -- 172.21.15.81:0/3086077690 >> 172.21.15.81:0/3086077690 conn(0x7fa3e80d23a0 msgr2=0x7fa3e80cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:22.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.401+0000 7fa3efe5e640 1 -- 172.21.15.81:0/3086077690 shutdown_connections 2024-09-16T01:17:22.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.401+0000 7fa3efe5e640 1 -- 172.21.15.81:0/3086077690 wait complete. 2024-09-16T01:17:22.414 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:17:22.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:22.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:17:22.504 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:17:22.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:22.504 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:17:22.519 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:17:22.519 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:17:22.519 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:22.536 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:17:22.536 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:22.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:17:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.692+0000 7f64f3b52640 1 Processor -- start 2024-09-16T01:17:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.692+0000 7f64f3b52640 1 -- start start 2024-09-16T01:17:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.693+0000 7f64f3b52640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f64ec161c80 0x7f64ec06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.693+0000 7f64f3b52640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64ec0b6680 0x7f64ec0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.693+0000 7f64f3b52640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64ec06e870 con 0x7f64ec162060 2024-09-16T01:17:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.693+0000 7f64f3b52640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f64ec06d9f0 con 0x7f64ec161c80 2024-09-16T01:17:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.693+0000 7f64f3b52640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec06dcd0 con 0x7f64ec0b6680 2024-09-16T01:17:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.693+0000 7f64f18ee640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f64ec161c80 0x7f64ec06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.693+0000 7f64f20ef640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64ec0b6680 0x7f64ec0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.693+0000 7f64f10ed640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f64ec162060 0x7f64ec0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:57084/0 (socket says 172.21.15.81:57084) 2024-09-16T01:17:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.693+0000 7f64f10ed640 1 -- 172.21.15.81:0/1663004021 learned_addr learned my addr 172.21.15.81:0/1663004021 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.694+0000 7f64f20ef640 1 -- 172.21.15.81:0/1663004021 >> v2:172.21.15.102:3300/0 conn(0x7f64ec161c80 msgr2=0x7f64ec06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.694+0000 7f64f20ef640 1 --2- 172.21.15.81:0/1663004021 >> v2:172.21.15.102:3300/0 conn(0x7f64ec161c80 0x7f64ec06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.694+0000 7f64f20ef640 1 -- 172.21.15.81:0/1663004021 >> v1:172.21.15.102:6789/0 conn(0x7f64ec162060 legacy=0x7f64ec0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.694+0000 7f64f20ef640 1 -- 172.21.15.81:0/1663004021 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec06dfb0 con 0x7f64ec0b6680 2024-09-16T01:17:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.694+0000 7f64f18ee640 1 --2- 172.21.15.81:0/1663004021 >> v2:172.21.15.102:3300/0 conn(0x7f64ec161c80 0x7f64ec06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:17:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.695+0000 7f64f20ef640 1 --2- 172.21.15.81:0/1663004021 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64ec0b6680 0x7f64ec0cf1e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009d90 tx=0x7f64e402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5f5832cdb1b0be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.695+0000 7f64f08ec640 1 -- 172.21.15.81:0/1663004021 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4007740 con 0x7f64ec0b6680 2024-09-16T01:17:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.695+0000 7f64f08ec640 1 -- 172.21.15.81:0/1663004021 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e40078e0 con 0x7f64ec0b6680 2024-09-16T01:17:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.695+0000 7f64f08ec640 1 -- 172.21.15.81:0/1663004021 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4007cb0 con 0x7f64ec0b6680 2024-09-16T01:17:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.695+0000 7f64f3b52640 1 -- 172.21.15.81:0/1663004021 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64ec0b6680 msgr2=0x7f64ec0cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.695+0000 7f64f3b52640 1 --2- 172.21.15.81:0/1663004021 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64ec0b6680 0x7f64ec0cf1e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009d90 tx=0x7f64e402a660 comp rx=0 tx=0).stop 2024-09-16T01:17:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.695+0000 7f64f3b52640 1 -- 172.21.15.81:0/1663004021 shutdown_connections 2024-09-16T01:17:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.695+0000 7f64f3b52640 1 --2- 172.21.15.81:0/1663004021 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64ec0b6680 0x7f64ec0cf1e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.695+0000 7f64f3b52640 1 --2- 172.21.15.81:0/1663004021 >> v2:172.21.15.102:3300/0 conn(0x7f64ec161c80 0x7f64ec06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.695+0000 7f64f3b52640 1 -- 172.21.15.81:0/1663004021 >> 172.21.15.81:0/1663004021 conn(0x7f64ec0d44f0 msgr2=0x7f64ec0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.695+0000 7f64f3b52640 1 -- 172.21.15.81:0/1663004021 shutdown_connections 2024-09-16T01:17:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.695+0000 7f64f3b52640 1 -- 172.21.15.81:0/1663004021 wait complete. 2024-09-16T01:17:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.697+0000 7f64f3b52640 1 Processor -- start 2024-09-16T01:17:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.697+0000 7f64f3b52640 1 -- start start 2024-09-16T01:17:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.697+0000 7f64f3b52640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64ec0b6680 0x7f64ec0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.697+0000 7f64f3b52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64ec161c80 0x7f64ec159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.697+0000 7f64f3b52640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64ec162060 0x7f64ec0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.697+0000 7f64f3b52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec0b6cb0 con 0x7f64ec161c80 2024-09-16T01:17:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.697+0000 7f64f3b52640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f64ec0b6b30 con 0x7f64ec162060 2024-09-16T01:17:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.697+0000 7f64f3b52640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f64ec0cf720 con 0x7f64ec0b6680 2024-09-16T01:17:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.697+0000 7f64f10ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64ec161c80 0x7f64ec159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64f10ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64ec161c80 0x7f64ec159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46410/0 (socket says 172.21.15.81:46410) 2024-09-16T01:17:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64f10ed640 1 -- 172.21.15.81:0/4030602662 learned_addr learned my addr 172.21.15.81:0/4030602662 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64f20ef640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64ec162060 0x7f64ec0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64f18ee640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64ec0b6680 0x7f64ec0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64f10ed640 1 -- 172.21.15.81:0/4030602662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64ec0b6680 msgr2=0x7f64ec0cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64f10ed640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64ec0b6680 0x7f64ec0cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64f10ed640 1 -- 172.21.15.81:0/4030602662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64ec162060 msgr2=0x7f64ec0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64f10ed640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64ec162060 0x7f64ec0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64f10ed640 1 -- 172.21.15.81:0/4030602662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ec0ce3e0 con 0x7f64ec161c80 2024-09-16T01:17:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64f10ed640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64ec161c80 0x7f64ec159720 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00c470 tx=0x7f64dc00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64e27fc640 1 -- 172.21.15.81:0/4030602662 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc017070 con 0x7f64ec161c80 2024-09-16T01:17:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64e27fc640 1 -- 172.21.15.81:0/4030602662 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64dc005ce0 con 0x7f64ec161c80 2024-09-16T01:17:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64e27fc640 1 -- 172.21.15.81:0/4030602662 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64dc0072d0 con 0x7f64ec161c80 2024-09-16T01:17:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64f3b52640 1 -- 172.21.15.81:0/4030602662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ec0b84f0 con 0x7f64ec161c80 2024-09-16T01:17:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.698+0000 7f64f3b52640 1 -- 172.21.15.81:0/4030602662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ec0b8ab0 con 0x7f64ec161c80 2024-09-16T01:17:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.699+0000 7f64f3b52640 1 -- 172.21.15.81:0/4030602662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ec0cf1e0 con 0x7f64ec161c80 2024-09-16T01:17:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.700+0000 7f64e27fc640 1 -- 172.21.15.81:0/4030602662 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f64dc01a070 con 0x7f64ec161c80 2024-09-16T01:17:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.700+0000 7f64e27fc640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f64d006c2b0 0x7f64d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.700+0000 7f64e27fc640 1 -- 172.21.15.81:0/4030602662 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6130+0+0 (secure 0 0 0) 0x7f64dc08a7c0 con 0x7f64ec161c80 2024-09-16T01:17:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.700+0000 7f64f18ee640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f64d006c2b0 0x7f64d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.701+0000 7f64f18ee640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f64d006c2b0 0x7f64d006e770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009560 tx=0x7f64e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.704+0000 7f64e27fc640 1 -- 172.21.15.81:0/4030602662 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64ec06e870 con 0x7f64ec161c80 2024-09-16T01:17:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.881+0000 7f64f3b52640 1 -- 172.21.15.81:0/4030602662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f64ec0ba470 con 0x7f64ec161c80 2024-09-16T01:17:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.882+0000 7f64e27fc640 1 -- 172.21.15.81:0/4030602662 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7f64dc058730 con 0x7f64ec161c80 2024-09-16T01:17:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:17:22.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.884+0000 7f64f3b52640 1 -- 172.21.15.81:0/4030602662 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f64d006c2b0 msgr2=0x7f64d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:22.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.884+0000 7f64f3b52640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f64d006c2b0 0x7f64d006e770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009560 tx=0x7f64e8008040 comp rx=0 tx=0).stop 2024-09-16T01:17:22.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.884+0000 7f64f3b52640 1 -- 172.21.15.81:0/4030602662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64ec161c80 msgr2=0x7f64ec159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:22.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.884+0000 7f64f3b52640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64ec161c80 0x7f64ec159720 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00c470 tx=0x7f64dc00c930 comp rx=0 tx=0).stop 2024-09-16T01:17:22.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.884+0000 7f64f3b52640 1 -- 172.21.15.81:0/4030602662 shutdown_connections 2024-09-16T01:17:22.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.884+0000 7f64f3b52640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f64d006c2b0 0x7f64d006e770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.884+0000 7f64f3b52640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64ec162060 0x7f64ec0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.884+0000 7f64f3b52640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64ec161c80 0x7f64ec159720 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.884+0000 7f64f3b52640 1 --2- 172.21.15.81:0/4030602662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64ec0b6680 0x7f64ec0cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.884+0000 7f64f3b52640 1 -- 172.21.15.81:0/4030602662 >> 172.21.15.81:0/4030602662 conn(0x7f64ec0d44f0 msgr2=0x7f64ec160450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.884+0000 7f64f3b52640 1 -- 172.21.15.81:0/4030602662 shutdown_connections 2024-09-16T01:17:22.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:22.884+0000 7f64f3b52640 1 -- 172.21.15.81:0/4030602662 wait complete. 2024-09-16T01:17:22.896 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:17:22.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:22.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T01:17:22.933 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:17:22.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:22.933 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:17:22.992 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:17:22.992 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:17:22.992 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:23.009 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:17:23.009 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:17:23.009 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:17:23.009 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:23.051 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:17:23.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:23.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.148+0000 7f2af3a47640 1 Processor -- start 2024-09-16T01:17:23.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.148+0000 7f2af3a47640 1 -- start start 2024-09-16T01:17:23.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.149+0000 7f2af3a47640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2aec15e5d0 0x7f2aec0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.149+0000 7f2af3a47640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aec09b140 0x7f2aec168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.149+0000 7f2af3a47640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aec06cec0 con 0x7f2aec06df60 2024-09-16T01:17:23.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.149+0000 7f2af3a47640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2aec06dad0 con 0x7f2aec15e5d0 2024-09-16T01:17:23.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.149+0000 7f2af3a47640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2aec06d1a0 con 0x7f2aec09b140 2024-09-16T01:17:23.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.149+0000 7f2af17e3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2aec15e5d0 0x7f2aec0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.149+0000 7f2af0fe2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2aec06df60 0x7f2aec09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46624/0 (socket says 172.21.15.81:46624) 2024-09-16T01:17:23.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.149+0000 7f2af0fe2640 1 -- 172.21.15.81:0/1156058726 learned_addr learned my addr 172.21.15.81:0/1156058726 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:23.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.150+0000 7f2af1fe4640 1 --2- 172.21.15.81:0/1156058726 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aec09b140 0x7f2aec168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.150+0000 7f2af17e3640 1 -- 172.21.15.81:0/1156058726 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aec09b140 msgr2=0x7f2aec168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:23.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.150+0000 7f2af17e3640 1 --2- 172.21.15.81:0/1156058726 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aec09b140 0x7f2aec168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.150+0000 7f2af17e3640 1 -- 172.21.15.81:0/1156058726 >> v1:172.21.15.81:6789/0 conn(0x7f2aec06df60 legacy=0x7f2aec09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.150+0000 7f2af17e3640 1 -- 172.21.15.81:0/1156058726 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec06d480 con 0x7f2aec15e5d0 2024-09-16T01:17:23.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.150+0000 7f2aebfff640 1 -- 172.21.15.81:0/1156058726 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899729867 0 0) 0x7f2aec06cec0 con 0x7f2aec06df60 2024-09-16T01:17:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.150+0000 7f2af17e3640 1 --2- 172.21.15.81:0/1156058726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2aec15e5d0 0x7f2aec0d10f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40097a0 tx=0x7f2ae402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7423f37df8aec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.151+0000 7f2aebfff640 1 -- 172.21.15.81:0/1156058726 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4037070 con 0x7f2aec15e5d0 2024-09-16T01:17:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.151+0000 7f2aebfff640 1 -- 172.21.15.81:0/1156058726 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae4032440 con 0x7f2aec15e5d0 2024-09-16T01:17:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.151+0000 7f2aebfff640 1 -- 172.21.15.81:0/1156058726 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4032810 con 0x7f2aec15e5d0 2024-09-16T01:17:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.151+0000 7f2af3a47640 1 -- 172.21.15.81:0/1156058726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2aec15e5d0 msgr2=0x7f2aec0d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.151+0000 7f2af3a47640 1 --2- 172.21.15.81:0/1156058726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2aec15e5d0 0x7f2aec0d10f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40097a0 tx=0x7f2ae402a210 comp rx=0 tx=0).stop 2024-09-16T01:17:23.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.151+0000 7f2af3a47640 1 -- 172.21.15.81:0/1156058726 shutdown_connections 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.151+0000 7f2af3a47640 1 --2- 172.21.15.81:0/1156058726 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aec09b140 0x7f2aec168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.151+0000 7f2af3a47640 1 --2- 172.21.15.81:0/1156058726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2aec15e5d0 0x7f2aec0d10f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.151+0000 7f2af3a47640 1 -- 172.21.15.81:0/1156058726 >> 172.21.15.81:0/1156058726 conn(0x7f2aec0d23a0 msgr2=0x7f2aec0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.151+0000 7f2af3a47640 1 -- 172.21.15.81:0/1156058726 shutdown_connections 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.151+0000 7f2af3a47640 1 -- 172.21.15.81:0/1156058726 wait complete. 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.152+0000 7f2af3a47640 1 Processor -- start 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.153+0000 7f2af3a47640 1 -- start start 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.153+0000 7f2af3a47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2aec06df60 0x7f2aec0b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.153+0000 7f2af3a47640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aec09b140 0x7f2aec158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.153+0000 7f2af3a47640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aec15e5d0 0x7f2aec156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.153+0000 7f2af3a47640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec15eb30 con 0x7f2aec06df60 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.153+0000 7f2af3a47640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec15e9b0 con 0x7f2aec15e5d0 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.153+0000 7f2af3a47640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2aec0d1630 con 0x7f2aec09b140 2024-09-16T01:17:23.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.153+0000 7f2af17e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2aec06df60 0x7f2aec0b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.153+0000 7f2af17e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2aec06df60 0x7f2aec0b7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46438/0 (socket says 172.21.15.81:46438) 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.153+0000 7f2af17e3640 1 -- 172.21.15.81:0/3440220930 learned_addr learned my addr 172.21.15.81:0/3440220930 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2af17e3640 1 -- 172.21.15.81:0/3440220930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aec09b140 msgr2=0x7f2aec158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2af0fe2640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aec09b140 0x7f2aec158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2af1fe4640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aec15e5d0 0x7f2aec156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2af17e3640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aec09b140 0x7f2aec158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2af17e3640 1 -- 172.21.15.81:0/3440220930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aec15e5d0 msgr2=0x7f2aec156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2af17e3640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aec15e5d0 0x7f2aec156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2af17e3640 1 -- 172.21.15.81:0/3440220930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec159f20 con 0x7f2aec06df60 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2af1fe4640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aec15e5d0 0x7f2aec156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2af0fe2640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aec09b140 0x7f2aec158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2af17e3640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2aec06df60 0x7f2aec0b7ca0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40098c0 tx=0x7f2ae40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:23.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2ae9ffb640 1 -- 172.21.15.81:0/3440220930 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4037040 con 0x7f2aec06df60 2024-09-16T01:17:23.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2ae9ffb640 1 -- 172.21.15.81:0/3440220930 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae4030770 con 0x7f2aec06df60 2024-09-16T01:17:23.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2af3a47640 1 -- 172.21.15.81:0/3440220930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aec158e80 con 0x7f2aec06df60 2024-09-16T01:17:23.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2ae9ffb640 1 -- 172.21.15.81:0/3440220930 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4030b40 con 0x7f2aec06df60 2024-09-16T01:17:23.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.154+0000 7f2af3a47640 1 -- 172.21.15.81:0/3440220930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aec159440 con 0x7f2aec06df60 2024-09-16T01:17:23.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.155+0000 7f2af3a47640 1 -- 172.21.15.81:0/3440220930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aec0d10f0 con 0x7f2aec06df60 2024-09-16T01:17:23.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.156+0000 7f2ae9ffb640 1 -- 172.21.15.81:0/3440220930 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2ae4044020 con 0x7f2aec06df60 2024-09-16T01:17:23.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.156+0000 7f2ae9ffb640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2ad806c2b0 0x7f2ad806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.157+0000 7f2af0fe2640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2ad806c2b0 0x7f2ad806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.157+0000 7f2ae9ffb640 1 -- 172.21.15.81:0/3440220930 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6130+0+0 (secure 0 0 0) 0x7f2ae40abb30 con 0x7f2aec06df60 2024-09-16T01:17:23.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.157+0000 7f2af0fe2640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2ad806c2b0 0x7f2ad806e770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2aec1f7d10 tx=0x7f2ae0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:23.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.161+0000 7f2ae9ffb640 1 -- 172.21.15.81:0/3440220930 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2aec159f20 con 0x7f2aec06df60 2024-09-16T01:17:23.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.360+0000 7f2af3a47640 1 -- 172.21.15.81:0/3440220930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2aec0b8320 con 0x7f2aec06df60 2024-09-16T01:17:23.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.360+0000 7f2ae9ffb640 1 -- 172.21.15.81:0/3440220930 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5223 (secure 0 0 0) 0x7f2ae4032e20 con 0x7f2aec06df60 2024-09-16T01:17:23.362 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:23.362 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"btime":"2024-09-16T01:16:34:988023+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2179103223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2179103223},{"type":"v1","addr":"172.21.15.81:6836","nonce":2179103223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4649,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/4263439893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":4263439893},{"type":"v1","addr":"172.21.15.102:6834","nonce":4263439893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/27716817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":27716817},{"type":"v1","addr":"172.21.15.102:6835","nonce":27716817}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:16:32.311950+0000","modified":"2024-09-16T01:16:34.313044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3051272390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3051272390},{"type":"v1","addr":"172.21.15.81:6837","nonce":3051272390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-16T01:17:23.362 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 16 2024-09-16T01:17:23.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.362+0000 7f2af3a47640 1 -- 172.21.15.81:0/3440220930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2ad806c2b0 msgr2=0x7f2ad806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.362+0000 7f2af3a47640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2ad806c2b0 0x7f2ad806e770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2aec1f7d10 tx=0x7f2ae0009040 comp rx=0 tx=0).stop 2024-09-16T01:17:23.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.362+0000 7f2af3a47640 1 -- 172.21.15.81:0/3440220930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2aec06df60 msgr2=0x7f2aec0b7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.362+0000 7f2af3a47640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2aec06df60 0x7f2aec0b7ca0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40098c0 tx=0x7f2ae40046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.362+0000 7f2af3a47640 1 -- 172.21.15.81:0/3440220930 shutdown_connections 2024-09-16T01:17:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.362+0000 7f2af3a47640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2ad806c2b0 0x7f2ad806e770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.362+0000 7f2af3a47640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2aec15e5d0 0x7f2aec156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.362+0000 7f2af3a47640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2aec09b140 0x7f2aec158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.362+0000 7f2af3a47640 1 --2- 172.21.15.81:0/3440220930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2aec06df60 0x7f2aec0b7ca0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.362+0000 7f2af3a47640 1 -- 172.21.15.81:0/3440220930 >> 172.21.15.81:0/3440220930 conn(0x7f2aec0d23a0 msgr2=0x7f2aec09b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.362+0000 7f2af3a47640 1 -- 172.21.15.81:0/3440220930 shutdown_connections 2024-09-16T01:17:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.362+0000 7f2af3a47640 1 -- 172.21.15.81:0/3440220930 wait complete. 2024-09-16T01:17:23.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:23.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.472+0000 7fe813b52640 1 Processor -- start 2024-09-16T01:17:23.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.472+0000 7fe813b52640 1 -- start start 2024-09-16T01:17:23.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe813b52640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe80c0d04a0 0x7fe80c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe813b52640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c06cb30 con 0x7fe80c147360 2024-09-16T01:17:23.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe813b52640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c0d0e50 con 0x7fe80c0ae550 2024-09-16T01:17:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe813b52640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe80c06bfb0 con 0x7fe80c0d04a0 2024-09-16T01:17:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8118ee640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe80c147360 0x7fe80c070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46630/0 (socket says 172.21.15.81:46630) 2024-09-16T01:17:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8118ee640 1 -- 172.21.15.81:0/2979392206 learned_addr learned my addr 172.21.15.81:0/2979392206 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8110ed640 1 --2- 172.21.15.81:0/2979392206 >> v2:172.21.15.102:3300/0 conn(0x7fe80c0d04a0 0x7fe80c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3785974724 0 0) 0x7fe80c06cb30 con 0x7fe80c147360 2024-09-16T01:17:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7f8003520 con 0x7fe80c147360 2024-09-16T01:17:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 642402650 0 0) 0x7fe7f8003520 con 0x7fe80c147360 2024-09-16T01:17:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 >> v2:172.21.15.102:3300/0 conn(0x7fe80c0d04a0 msgr2=0x7fe80c0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8108ec640 1 --2- 172.21.15.81:0/2979392206 >> v2:172.21.15.102:3300/0 conn(0x7fe80c0d04a0 0x7fe80c0d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 >> v1:172.21.15.102:6789/0 conn(0x7fe80c0ae550 legacy=0x7fe80c0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c06c290 con 0x7fe80c147360 2024-09-16T01:17:23.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fe808001670 con 0x7fe80c147360 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 >> v1:172.21.15.81:6789/0 conn(0x7fe80c147360 legacy=0x7fe80c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.473+0000 7fe8108ec640 1 --2- 172.21.15.81:0/2979392206 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7f80039b0 0x7fe7f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8108ec640 1 --2- 172.21.15.81:0/2979392206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7f8004800 0x7fe7f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8108ec640 1 --2- 172.21.15.81:0/2979392206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80051c0 0x7fe7f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c06bfb0 con 0x7fe7f80051c0 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f800c160 con 0x7fe7f8004800 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f800c360 con 0x7fe7f80039b0 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8120ef640 1 --2- 172.21.15.81:0/2979392206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80051c0 0x7fe7f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8110ed640 1 --2- 172.21.15.81:0/2979392206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7f8004800 0x7fe7f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8118ee640 1 --2- 172.21.15.81:0/2979392206 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7f80039b0 0x7fe7f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8120ef640 1 -- 172.21.15.81:0/2979392206 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7f80039b0 msgr2=0x7fe7f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8120ef640 1 --2- 172.21.15.81:0/2979392206 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7f80039b0 0x7fe7f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8120ef640 1 -- 172.21.15.81:0/2979392206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7f8004800 msgr2=0x7fe7f8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:23.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8120ef640 1 --2- 172.21.15.81:0/2979392206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7f8004800 0x7fe7f8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8120ef640 1 -- 172.21.15.81:0/2979392206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f8003520 con 0x7fe7f80051c0 2024-09-16T01:17:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.474+0000 7fe8120ef640 1 -- 172.21.15.81:0/2979392206 reap_dead start 2024-09-16T01:17:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.475+0000 7fe8120ef640 1 --2- 172.21.15.81:0/2979392206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80051c0 0x7fe7f800b9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe804001e50 tx=0x7fe7f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff1f1634a788357 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.475+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804001a70 con 0x7fe7f80051c0 2024-09-16T01:17:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.475+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe804003970 con 0x7fe7f80051c0 2024-09-16T01:17:23.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.475+0000 7fe8108ec640 1 -- 172.21.15.81:0/2979392206 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804003d60 con 0x7fe7f80051c0 2024-09-16T01:17:23.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.475+0000 7fe813b52640 1 -- 172.21.15.81:0/2979392206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80051c0 msgr2=0x7fe7f800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.475+0000 7fe813b52640 1 --2- 172.21.15.81:0/2979392206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80051c0 0x7fe7f800b9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe804001e50 tx=0x7fe7f8005830 comp rx=0 tx=0).stop 2024-09-16T01:17:23.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.475+0000 7fe813b52640 1 -- 172.21.15.81:0/2979392206 shutdown_connections 2024-09-16T01:17:23.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.475+0000 7fe813b52640 1 --2- 172.21.15.81:0/2979392206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80051c0 0x7fe7f800b9c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.475+0000 7fe813b52640 1 -- 172.21.15.81:0/2979392206 >> 172.21.15.81:0/2979392206 conn(0x7fe80c0b2f40 msgr2=0x7fe80c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:23.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.475+0000 7fe813b52640 1 -- 172.21.15.81:0/2979392206 shutdown_connections 2024-09-16T01:17:23.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.475+0000 7fe813b52640 1 -- 172.21.15.81:0/2979392206 wait complete. 2024-09-16T01:17:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.476+0000 7fe813b52640 1 Processor -- start 2024-09-16T01:17:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.477+0000 7fe813b52640 1 -- start start 2024-09-16T01:17:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.477+0000 7fe813b52640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7f80051c0 0x7fe80c13d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.477+0000 7fe813b52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c0b6b40 0x7fe80c0b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.477+0000 7fe813b52640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe80c1f4410 0x7fe80c1f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.477+0000 7fe813b52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c06bc10 con 0x7fe80c0b6b40 2024-09-16T01:17:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.477+0000 7fe813b52640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c06c850 con 0x7fe7f80051c0 2024-09-16T01:17:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.477+0000 7fe813b52640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe80c06bd90 con 0x7fe80c1f4410 2024-09-16T01:17:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.477+0000 7fe8110ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c0b6b40 0x7fe80c0b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.477+0000 7fe8110ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c0b6b40 0x7fe80c0b6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46448/0 (socket says 172.21.15.81:46448) 2024-09-16T01:17:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.477+0000 7fe8110ed640 1 -- 172.21.15.81:0/2585457771 learned_addr learned my addr 172.21.15.81:0/2585457771 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.477+0000 7fe8120ef640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe80c1f4410 0x7fe80c1f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.477+0000 7fe8118ee640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7f80051c0 0x7fe80c13d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.478+0000 7fe8110ed640 1 -- 172.21.15.81:0/2585457771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe80c1f4410 msgr2=0x7fe80c1f4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.478+0000 7fe8110ed640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe80c1f4410 0x7fe80c1f4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.478+0000 7fe8110ed640 1 -- 172.21.15.81:0/2585457771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7f80051c0 msgr2=0x7fe80c13d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.478+0000 7fe8110ed640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7f80051c0 0x7fe80c13d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.478+0000 7fe8110ed640 1 -- 172.21.15.81:0/2585457771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c13b2d0 con 0x7fe80c0b6b40 2024-09-16T01:17:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.478+0000 7fe8110ed640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c0b6b40 0x7fe80c0b6fc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc011910 tx=0x7fe7fc011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.478+0000 7fe8027fc640 1 -- 172.21.15.81:0/2585457771 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc00faf0 con 0x7fe80c0b6b40 2024-09-16T01:17:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.478+0000 7fe8027fc640 1 -- 172.21.15.81:0/2585457771 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7fc00fc90 con 0x7fe80c0b6b40 2024-09-16T01:17:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.478+0000 7fe8027fc640 1 -- 172.21.15.81:0/2585457771 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc014440 con 0x7fe80c0b6b40 2024-09-16T01:17:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.478+0000 7fe813b52640 1 -- 172.21.15.81:0/2585457771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe80c13b5b0 con 0x7fe80c0b6b40 2024-09-16T01:17:23.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.478+0000 7fe813b52640 1 -- 172.21.15.81:0/2585457771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe80c13bb70 con 0x7fe80c0b6b40 2024-09-16T01:17:23.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.479+0000 7fe813b52640 1 -- 172.21.15.81:0/2585457771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe80c0d0910 con 0x7fe80c0b6b40 2024-09-16T01:17:23.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.479+0000 7fe8027fc640 1 -- 172.21.15.81:0/2585457771 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe7fc012040 con 0x7fe80c0b6b40 2024-09-16T01:17:23.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.480+0000 7fe8027fc640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe7f006c2b0 0x7fe7f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.480+0000 7fe8027fc640 1 -- 172.21.15.81:0/2585457771 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6130+0+0 (secure 0 0 0) 0x7fe7fc08bb00 con 0x7fe80c0b6b40 2024-09-16T01:17:23.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.480+0000 7fe8118ee640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe7f006c2b0 0x7fe7f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.480+0000 7fe8118ee640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe7f006c2b0 0x7fe7f006e770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe808001050 tx=0x7fe808007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:23.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.484+0000 7fe8027fc640 1 -- 172.21.15.81:0/2585457771 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7fc019030 con 0x7fe80c0b6b40 2024-09-16T01:17:23.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.682+0000 7fe813b52640 1 -- 172.21.15.81:0/2585457771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe80c0ce890 con 0x7fe80c0b6b40 2024-09-16T01:17:23.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.682+0000 7fe8027fc640 1 -- 172.21.15.81:0/2585457771 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5223 (secure 0 0 0) 0x7fe7fc059a70 con 0x7fe80c0b6b40 2024-09-16T01:17:23.684 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:23.684 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"btime":"2024-09-16T01:16:34:988023+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2179103223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2179103223},{"type":"v1","addr":"172.21.15.81:6836","nonce":2179103223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4649,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/4263439893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":4263439893},{"type":"v1","addr":"172.21.15.102:6834","nonce":4263439893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/27716817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":27716817},{"type":"v1","addr":"172.21.15.102:6835","nonce":27716817}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:16:32.311950+0000","modified":"2024-09-16T01:16:34.313044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3051272390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3051272390},{"type":"v1","addr":"172.21.15.81:6837","nonce":3051272390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-16T01:17:23.684 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 16 2024-09-16T01:17:23.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.684+0000 7fe813b52640 1 -- 172.21.15.81:0/2585457771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe7f006c2b0 msgr2=0x7fe7f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.684+0000 7fe813b52640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe7f006c2b0 0x7fe7f006e770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe808001050 tx=0x7fe808007040 comp rx=0 tx=0).stop 2024-09-16T01:17:23.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.684+0000 7fe813b52640 1 -- 172.21.15.81:0/2585457771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c0b6b40 msgr2=0x7fe80c0b6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.684+0000 7fe813b52640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c0b6b40 0x7fe80c0b6fc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc011910 tx=0x7fe7fc011dd0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.684+0000 7fe813b52640 1 -- 172.21.15.81:0/2585457771 shutdown_connections 2024-09-16T01:17:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.684+0000 7fe813b52640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe7f006c2b0 0x7fe7f006e770 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.684+0000 7fe813b52640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe80c1f4410 0x7fe80c1f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.684+0000 7fe813b52640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c0b6b40 0x7fe80c0b6fc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.684+0000 7fe813b52640 1 --2- 172.21.15.81:0/2585457771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7f80051c0 0x7fe80c13d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.684+0000 7fe813b52640 1 -- 172.21.15.81:0/2585457771 >> 172.21.15.81:0/2585457771 conn(0x7fe80c0b2f40 msgr2=0x7fe80c144710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.684+0000 7fe813b52640 1 -- 172.21.15.81:0/2585457771 shutdown_connections 2024-09-16T01:17:23.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.684+0000 7fe813b52640 1 -- 172.21.15.81:0/2585457771 wait complete. 2024-09-16T01:17:23.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:17:23.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.793+0000 7f68cc1fd640 1 Processor -- start 2024-09-16T01:17:23.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.793+0000 7f68cc1fd640 1 -- start start 2024-09-16T01:17:23.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68cc1fd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68c415ba30 0x7f68c406f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68cc1fd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f68c4073050 0x7f68c40b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68cc1fd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c40b3570 con 0x7f68c406fd50 2024-09-16T01:17:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68cc1fd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f68c40b4180 con 0x7f68c4073050 2024-09-16T01:17:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68cc1fd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f68c40b3850 con 0x7f68c415ba30 2024-09-16T01:17:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68c9798640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f68c406fd50 0x7f68c4072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46640/0 (socket says 172.21.15.81:46640) 2024-09-16T01:17:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68c9798640 1 -- 172.21.15.81:0/3758448378 learned_addr learned my addr 172.21.15.81:0/3758448378 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68c9f99640 1 --2- 172.21.15.81:0/3758448378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68c415ba30 0x7f68c406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68ca79a640 1 --2- 172.21.15.81:0/3758448378 >> v2:172.21.15.102:3300/0 conn(0x7f68c4073050 0x7f68c40b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68c8f97640 1 -- 172.21.15.81:0/3758448378 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981260385 0 0) 0x7f68c40b3570 con 0x7f68c406fd50 2024-09-16T01:17:23.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68c8f97640 1 -- 172.21.15.81:0/3758448378 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68b0003520 con 0x7f68c406fd50 2024-09-16T01:17:23.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68c8f97640 1 -- 172.21.15.81:0/3758448378 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 803038113 0 0) 0x7f68b0003520 con 0x7f68c406fd50 2024-09-16T01:17:23.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68ca79a640 1 -- 172.21.15.81:0/3758448378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68c415ba30 msgr2=0x7f68c406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:23.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68ca79a640 1 --2- 172.21.15.81:0/3758448378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68c415ba30 0x7f68c406f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68ca79a640 1 -- 172.21.15.81:0/3758448378 >> v1:172.21.15.81:6789/0 conn(0x7f68c406fd50 legacy=0x7f68c4072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68ca79a640 1 -- 172.21.15.81:0/3758448378 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c40b3b30 con 0x7f68c4073050 2024-09-16T01:17:23.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.794+0000 7f68c9f99640 1 --2- 172.21.15.81:0/3758448378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68c415ba30 0x7f68c406f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:17:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.795+0000 7f68ca79a640 1 --2- 172.21.15.81:0/3758448378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c4073050 0x7f68c40b4880 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009d90 tx=0x7f68bc02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9195adb4ad29f48d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.796+0000 7f68c8f97640 1 -- 172.21.15.81:0/3758448378 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b4001670 con 0x7f68c4073050 2024-09-16T01:17:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.796+0000 7f68c8f97640 1 -- 172.21.15.81:0/3758448378 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc007540 con 0x7f68c4073050 2024-09-16T01:17:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.796+0000 7f68c8f97640 1 -- 172.21.15.81:0/3758448378 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc0078f0 con 0x7f68c4073050 2024-09-16T01:17:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.796+0000 7f68cc1fd640 1 -- 172.21.15.81:0/3758448378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c4073050 msgr2=0x7f68c40b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.796+0000 7f68cc1fd640 1 --2- 172.21.15.81:0/3758448378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c4073050 0x7f68c40b4880 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009d90 tx=0x7f68bc02a5f0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.796+0000 7f68cc1fd640 1 -- 172.21.15.81:0/3758448378 shutdown_connections 2024-09-16T01:17:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.796+0000 7f68cc1fd640 1 --2- 172.21.15.81:0/3758448378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c4073050 0x7f68c40b4880 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.796+0000 7f68cc1fd640 1 --2- 172.21.15.81:0/3758448378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68c415ba30 0x7f68c406f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.796+0000 7f68cc1fd640 1 -- 172.21.15.81:0/3758448378 >> 172.21.15.81:0/3758448378 conn(0x7f68c4067d70 msgr2=0x7f68c406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.796+0000 7f68cc1fd640 1 -- 172.21.15.81:0/3758448378 shutdown_connections 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.796+0000 7f68cc1fd640 1 -- 172.21.15.81:0/3758448378 wait complete. 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.797+0000 7f68cc1fd640 1 Processor -- start 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.797+0000 7f68cc1fd640 1 -- start start 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68cc1fd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68c406fd50 0x7f68c414abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68cc1fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c4073050 0x7f68c414ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68cc1fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c415ba30 0x7f68c414d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68cc1fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68c40ccfe0 con 0x7f68c415ba30 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68cc1fd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f68c40ce810 con 0x7f68c4073050 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68cc1fd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f68c40cd160 con 0x7f68c406fd50 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68ca79a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c415ba30 0x7f68c414d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68ca79a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c415ba30 0x7f68c414d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46452/0 (socket says 172.21.15.81:46452) 2024-09-16T01:17:23.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68ca79a640 1 -- 172.21.15.81:0/645171717 learned_addr learned my addr 172.21.15.81:0/645171717 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:23.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68c9f99640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68c406fd50 0x7f68c414abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68c9798640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c4073050 0x7f68c414ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68ca79a640 1 -- 172.21.15.81:0/645171717 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68c406fd50 msgr2=0x7f68c414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68ca79a640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68c406fd50 0x7f68c414abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68ca79a640 1 -- 172.21.15.81:0/645171717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c4073050 msgr2=0x7f68c414ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68ca79a640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c4073050 0x7f68c414ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.798+0000 7f68ca79a640 1 -- 172.21.15.81:0/645171717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c4148950 con 0x7f68c415ba30 2024-09-16T01:17:23.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.799+0000 7f68ca79a640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c415ba30 0x7f68c414d370 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009eb0 tx=0x7f68bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:23.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.799+0000 7f68ba7fc640 1 -- 172.21.15.81:0/645171717 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc009450 con 0x7f68c415ba30 2024-09-16T01:17:23.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.799+0000 7f68ba7fc640 1 -- 172.21.15.81:0/645171717 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc004240 con 0x7f68c415ba30 2024-09-16T01:17:23.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.799+0000 7f68cc1fd640 1 -- 172.21.15.81:0/645171717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c414d8b0 con 0x7f68c415ba30 2024-09-16T01:17:23.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.799+0000 7f68ba7fc640 1 -- 172.21.15.81:0/645171717 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc0045f0 con 0x7f68c415ba30 2024-09-16T01:17:23.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.799+0000 7f68cc1fd640 1 -- 172.21.15.81:0/645171717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c414de50 con 0x7f68c415ba30 2024-09-16T01:17:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.800+0000 7f68cc1fd640 1 -- 172.21.15.81:0/645171717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c406f810 con 0x7f68c415ba30 2024-09-16T01:17:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.800+0000 7f68ba7fc640 1 -- 172.21.15.81:0/645171717 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f68bc039040 con 0x7f68c415ba30 2024-09-16T01:17:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.801+0000 7f68ba7fc640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f68a806c2b0 0x7f68a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.801+0000 7f68ba7fc640 1 -- 172.21.15.81:0/645171717 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6130+0+0 (secure 0 0 0) 0x7f68bc0ac960 con 0x7f68c415ba30 2024-09-16T01:17:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.801+0000 7f68c9f99640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f68a806c2b0 0x7f68a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:23.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.801+0000 7f68c9f99640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f68a806c2b0 0x7f68a806e770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009a30 tx=0x7f68c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:23.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.805+0000 7f68ba7fc640 1 -- 172.21.15.81:0/645171717 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f68bc040030 con 0x7f68c415ba30 2024-09-16T01:17:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.970+0000 7f68cc1fd640 1 -- 172.21.15.81:0/645171717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68c4151ce0 con 0x7f68c415ba30 2024-09-16T01:17:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.971+0000 7f68ba7fc640 1 -- 172.21.15.81:0/645171717 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17051 (secure 0 0 0) 0x7f68bc07ae00 con 0x7f68c415ba30 2024-09-16T01:17:23.973 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:23.974 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":39,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:17:22.163170+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:16:29.974908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-16T01:16:31.289690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:17:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.973+0000 7f68cc1fd640 1 -- 172.21.15.81:0/645171717 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f68a806c2b0 msgr2=0x7f68a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.973+0000 7f68cc1fd640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f68a806c2b0 0x7f68a806e770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009a30 tx=0x7f68c0008040 comp rx=0 tx=0).stop 2024-09-16T01:17:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.973+0000 7f68cc1fd640 1 -- 172.21.15.81:0/645171717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c415ba30 msgr2=0x7f68c414d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.973+0000 7f68cc1fd640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c415ba30 0x7f68c414d370 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009eb0 tx=0x7f68bc004a40 comp rx=0 tx=0).stop 2024-09-16T01:17:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.973+0000 7f68cc1fd640 1 -- 172.21.15.81:0/645171717 shutdown_connections 2024-09-16T01:17:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.973+0000 7f68cc1fd640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f68a806c2b0 0x7f68a806e770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.974+0000 7f68cc1fd640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68c415ba30 0x7f68c414d370 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.974+0000 7f68cc1fd640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c4073050 0x7f68c414ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.974+0000 7f68cc1fd640 1 --2- 172.21.15.81:0/645171717 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68c406fd50 0x7f68c414abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.974+0000 7f68cc1fd640 1 -- 172.21.15.81:0/645171717 >> 172.21.15.81:0/645171717 conn(0x7f68c4067d70 msgr2=0x7f68c40b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:23.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.974+0000 7f68cc1fd640 1 -- 172.21.15.81:0/645171717 shutdown_connections 2024-09-16T01:17:23.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:23.974+0000 7f68cc1fd640 1 -- 172.21.15.81:0/645171717 wait complete. 2024-09-16T01:17:23.986 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:17:23.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.084+0000 7fa1e4fe8640 1 Processor -- start 2024-09-16T01:17:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.084+0000 7fa1e4fe8640 1 -- start start 2024-09-16T01:17:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.084+0000 7fa1e4fe8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa1e0162060 0x7fa1e00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.084+0000 7fa1e4fe8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00b64b0 0x7fa1e00b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.084+0000 7fa1e4fe8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e006d9f0 con 0x7fa1e0161c80 2024-09-16T01:17:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.084+0000 7fa1e4fe8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e006dcd0 con 0x7fa1e0162060 2024-09-16T01:17:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.084+0000 7fa1e4fe8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e006dfb0 con 0x7fa1e00b64b0 2024-09-16T01:17:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.085+0000 7fa1ded9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00b64b0 0x7fa1e00b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.085+0000 7fa1d7fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa1e0162060 0x7fa1e00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.085+0000 7fa1ded9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00b64b0 0x7fa1e00b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:46284/0 (socket says 172.21.15.81:46284) 2024-09-16T01:17:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.085+0000 7fa1ded9d640 1 -- 172.21.15.81:0/3590419830 learned_addr learned my addr 172.21.15.81:0/3590419830 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.085+0000 7fa1de59c640 1 --1- 172.21.15.81:0/3590419830 >> v1:172.21.15.102:6789/0 conn(0x7fa1e0161c80 0x7fa1e006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:57100/0 (socket says 172.21.15.81:57100) 2024-09-16T01:17:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.085+0000 7fa1ded9d640 1 -- 172.21.15.81:0/3590419830 >> v2:172.21.15.102:3300/0 conn(0x7fa1e0162060 msgr2=0x7fa1e00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.085+0000 7fa1ded9d640 1 --2- 172.21.15.81:0/3590419830 >> v2:172.21.15.102:3300/0 conn(0x7fa1e0162060 0x7fa1e00b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.085+0000 7fa1ded9d640 1 -- 172.21.15.81:0/3590419830 >> v1:172.21.15.102:6789/0 conn(0x7fa1e0161c80 legacy=0x7fa1e006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.085+0000 7fa1ded9d640 1 -- 172.21.15.81:0/3590419830 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e00d01f0 con 0x7fa1e00b64b0 2024-09-16T01:17:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.086+0000 7fa1ded9d640 1 --2- 172.21.15.81:0/3590419830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00b64b0 0x7fa1e00b6960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009e50 tx=0x7fa1d802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ae1ff288ae62a7e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.086+0000 7fa1ddd9b640 1 -- 172.21.15.81:0/3590419830 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8036070 con 0x7fa1e00b64b0 2024-09-16T01:17:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.086+0000 7fa1ddd9b640 1 -- 172.21.15.81:0/3590419830 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d8031600 con 0x7fa1e00b64b0 2024-09-16T01:17:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.086+0000 7fa1ddd9b640 1 -- 172.21.15.81:0/3590419830 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d80319d0 con 0x7fa1e00b64b0 2024-09-16T01:17:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.086+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/3590419830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00b64b0 msgr2=0x7fa1e00b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.086+0000 7fa1e4fe8640 1 --2- 172.21.15.81:0/3590419830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00b64b0 0x7fa1e00b6960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009e50 tx=0x7fa1d802a710 comp rx=0 tx=0).stop 2024-09-16T01:17:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.086+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/3590419830 shutdown_connections 2024-09-16T01:17:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.086+0000 7fa1e4fe8640 1 --2- 172.21.15.81:0/3590419830 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00b64b0 0x7fa1e00b6960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.086+0000 7fa1e4fe8640 1 --2- 172.21.15.81:0/3590419830 >> v2:172.21.15.102:3300/0 conn(0x7fa1e0162060 0x7fa1e00b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.086+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/3590419830 >> 172.21.15.81:0/3590419830 conn(0x7fa1e00d44f0 msgr2=0x7fa1e00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:24.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.087+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/3590419830 shutdown_connections 2024-09-16T01:17:24.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.087+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/3590419830 wait complete. 2024-09-16T01:17:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.088+0000 7fa1e4fe8640 1 Processor -- start 2024-09-16T01:17:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.088+0000 7fa1e4fe8640 1 -- start start 2024-09-16T01:17:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1e4fe8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00b64b0 0x7fa1e00c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1e4fe8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1e0161c80 0x7fa1e00ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1e4fe8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e0162060 0x7fa1e015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1e4fe8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e00cf360 con 0x7fa1e0162060 2024-09-16T01:17:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1e4fe8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e00cf1e0 con 0x7fa1e0161c80 2024-09-16T01:17:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1e4fe8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e00cf4e0 con 0x7fa1e00b64b0 2024-09-16T01:17:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1ded9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e0162060 0x7fa1e015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1ded9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e0162060 0x7fa1e015eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46464/0 (socket says 172.21.15.81:46464) 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1ded9d640 1 -- 172.21.15.81:0/897098090 learned_addr learned my addr 172.21.15.81:0/897098090 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1de59c640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00b64b0 0x7fa1e00c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1d7fff640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1e0161c80 0x7fa1e00ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1ded9d640 1 -- 172.21.15.81:0/897098090 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00b64b0 msgr2=0x7fa1e00c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1ded9d640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00b64b0 0x7fa1e00c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1ded9d640 1 -- 172.21.15.81:0/897098090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1e0161c80 msgr2=0x7fa1e00ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1ded9d640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1e0161c80 0x7fa1e00ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1ded9d640 1 -- 172.21.15.81:0/897098090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e00b8190 con 0x7fa1e0162060 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1ded9d640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e0162060 0x7fa1e015eb20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009f70 tx=0x7fa1d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1d6ffd640 1 -- 172.21.15.81:0/897098090 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d803f020 con 0x7fa1e0162060 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1d6ffd640 1 -- 172.21.15.81:0/897098090 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d8037040 con 0x7fa1e0162060 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/897098090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e00b8470 con 0x7fa1e0162060 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1d6ffd640 1 -- 172.21.15.81:0/897098090 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8036070 con 0x7fa1e0162060 2024-09-16T01:17:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.089+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/897098090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e00b8cf0 con 0x7fa1e0162060 2024-09-16T01:17:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.090+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/897098090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e00b5f70 con 0x7fa1e0162060 2024-09-16T01:17:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.091+0000 7fa1d6ffd640 1 -- 172.21.15.81:0/897098090 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa1d8042020 con 0x7fa1e0162060 2024-09-16T01:17:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.091+0000 7fa1d6ffd640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa1c006c2b0 0x7fa1c006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.091+0000 7fa1de59c640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa1c006c2b0 0x7fa1c006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.091+0000 7fa1d6ffd640 1 -- 172.21.15.81:0/897098090 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6130+0+0 (secure 0 0 0) 0x7fa1d80ab900 con 0x7fa1e0162060 2024-09-16T01:17:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.092+0000 7fa1de59c640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa1c006c2b0 0x7fa1c006e770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0007fd0 tx=0x7fa1d0007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:24.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.095+0000 7fa1d6ffd640 1 -- 172.21.15.81:0/897098090 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1d8049030 con 0x7fa1e0162060 2024-09-16T01:17:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.298+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/897098090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1e00ba470 con 0x7fa1e0162060 2024-09-16T01:17:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.298+0000 7fa1d6ffd640 1 -- 172.21.15.81:0/897098090 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5223 (secure 0 0 0) 0x7fa1d8079870 con 0x7fa1e0162060 2024-09-16T01:17:24.300 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:24.301 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"btime":"2024-09-16T01:16:34:988023+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2179103223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2179103223},{"type":"v1","addr":"172.21.15.81:6836","nonce":2179103223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4649,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/4263439893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":4263439893},{"type":"v1","addr":"172.21.15.102:6834","nonce":4263439893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/27716817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":27716817},{"type":"v1","addr":"172.21.15.102:6835","nonce":27716817}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:16:32.311950+0000","modified":"2024-09-16T01:16:34.313044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3051272390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3051272390},{"type":"v1","addr":"172.21.15.81:6837","nonce":3051272390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-16T01:17:24.301 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 16 2024-09-16T01:17:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.300+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/897098090 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa1c006c2b0 msgr2=0x7fa1c006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.300+0000 7fa1e4fe8640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa1c006c2b0 0x7fa1c006e770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0007fd0 tx=0x7fa1d0007e80 comp rx=0 tx=0).stop 2024-09-16T01:17:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.300+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/897098090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e0162060 msgr2=0x7fa1e015eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.300+0000 7fa1e4fe8640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e0162060 0x7fa1e015eb20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009f70 tx=0x7fa1d8004a40 comp rx=0 tx=0).stop 2024-09-16T01:17:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.300+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/897098090 shutdown_connections 2024-09-16T01:17:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.300+0000 7fa1e4fe8640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa1c006c2b0 0x7fa1c006e770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.300+0000 7fa1e4fe8640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1e0162060 0x7fa1e015eb20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.300+0000 7fa1e4fe8640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1e0161c80 0x7fa1e00ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.300+0000 7fa1e4fe8640 1 --2- 172.21.15.81:0/897098090 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1e00b64b0 0x7fa1e00c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.300+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/897098090 >> 172.21.15.81:0/897098090 conn(0x7fa1e00d44f0 msgr2=0x7fa1e00d3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.300+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/897098090 shutdown_connections 2024-09-16T01:17:24.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.300+0000 7fa1e4fe8640 1 -- 172.21.15.81:0/897098090 wait complete. 2024-09-16T01:17:24.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.408+0000 7fe4c1ef1640 1 Processor -- start 2024-09-16T01:17:24.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.408+0000 7fe4c1ef1640 1 -- start start 2024-09-16T01:17:24.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.409+0000 7fe4c1ef1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe4bc072d30 0x7fe4bc06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.409+0000 7fe4c1ef1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc06f700 0x7fe4bc15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.409+0000 7fe4c1ef1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4bc0cdbe0 con 0x7fe4bc15b300 2024-09-16T01:17:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.409+0000 7fe4c1ef1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe4bc0728a0 con 0x7fe4bc072d30 2024-09-16T01:17:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.409+0000 7fe4c1ef1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe4bc06fb30 con 0x7fe4bc06f700 2024-09-16T01:17:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.409+0000 7fe4bb7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe4bc15b300 0x7fe4bc0cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46650/0 (socket says 172.21.15.81:46650) 2024-09-16T01:17:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.409+0000 7fe4bb7fe640 1 -- 172.21.15.81:0/3813240735 learned_addr learned my addr 172.21.15.81:0/3813240735 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.409+0000 7fe4bbfff640 1 --2- 172.21.15.81:0/3813240735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc06f700 0x7fe4bc15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.409+0000 7fe4baffd640 1 --2- 172.21.15.81:0/3813240735 >> v2:172.21.15.102:3300/0 conn(0x7fe4bc072d30 0x7fe4bc06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.409+0000 7fe4ba7fc640 1 -- 172.21.15.81:0/3813240735 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233479553 0 0) 0x7fe4bc0cdbe0 con 0x7fe4bc15b300 2024-09-16T01:17:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.409+0000 7fe4ba7fc640 1 -- 172.21.15.81:0/3813240735 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4a4003520 con 0x7fe4bc15b300 2024-09-16T01:17:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.410+0000 7fe4ba7fc640 1 -- 172.21.15.81:0/3813240735 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1086136013 0 0) 0x7fe4a4003520 con 0x7fe4bc15b300 2024-09-16T01:17:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.410+0000 7fe4baffd640 1 -- 172.21.15.81:0/3813240735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc06f700 msgr2=0x7fe4bc15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:24.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.410+0000 7fe4baffd640 1 --2- 172.21.15.81:0/3813240735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc06f700 0x7fe4bc15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.410+0000 7fe4baffd640 1 -- 172.21.15.81:0/3813240735 >> v1:172.21.15.81:6789/0 conn(0x7fe4bc15b300 legacy=0x7fe4bc0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.410+0000 7fe4baffd640 1 -- 172.21.15.81:0/3813240735 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc0cd900 con 0x7fe4bc072d30 2024-09-16T01:17:24.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.410+0000 7fe4bbfff640 1 --2- 172.21.15.81:0/3813240735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc06f700 0x7fe4bc15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:17:24.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.411+0000 7fe4baffd640 1 --2- 172.21.15.81:0/3813240735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc072d30 0x7fe4bc06f1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00097a0 tx=0x7fe4b002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=675a8b813593577 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:24.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.411+0000 7fe4ba7fc640 1 -- 172.21.15.81:0/3813240735 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0037070 con 0x7fe4bc072d30 2024-09-16T01:17:24.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.411+0000 7fe4ba7fc640 1 -- 172.21.15.81:0/3813240735 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b002ab10 con 0x7fe4bc072d30 2024-09-16T01:17:24.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.411+0000 7fe4ba7fc640 1 -- 172.21.15.81:0/3813240735 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac001690 con 0x7fe4bc072d30 2024-09-16T01:17:24.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.411+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3813240735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc072d30 msgr2=0x7fe4bc06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.411+0000 7fe4c1ef1640 1 --2- 172.21.15.81:0/3813240735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc072d30 0x7fe4bc06f1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe4b00097a0 tx=0x7fe4b002a080 comp rx=0 tx=0).stop 2024-09-16T01:17:24.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.411+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3813240735 shutdown_connections 2024-09-16T01:17:24.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.411+0000 7fe4c1ef1640 1 --2- 172.21.15.81:0/3813240735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc06f700 0x7fe4bc15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.411+0000 7fe4c1ef1640 1 --2- 172.21.15.81:0/3813240735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc072d30 0x7fe4bc06f1c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.411+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3813240735 >> 172.21.15.81:0/3813240735 conn(0x7fe4bc067d70 msgr2=0x7fe4bc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:24.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.412+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3813240735 shutdown_connections 2024-09-16T01:17:24.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.412+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3813240735 wait complete. 2024-09-16T01:17:24.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.413+0000 7fe4c1ef1640 1 Processor -- start 2024-09-16T01:17:24.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.413+0000 7fe4c1ef1640 1 -- start start 2024-09-16T01:17:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4c1ef1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc06f700 0x7fe4bc15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4c1ef1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc072d30 0x7fe4bc158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4c1ef1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc15b300 0x7fe4bc0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4c1ef1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc0cd5c0 con 0x7fe4bc15b300 2024-09-16T01:17:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4c1ef1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe4bc072530 con 0x7fe4bc06f700 2024-09-16T01:17:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4c1ef1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe4bc0cffe0 con 0x7fe4bc072d30 2024-09-16T01:17:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc15b300 0x7fe4bc0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4bbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc15b300 0x7fe4bc0cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46474/0 (socket says 172.21.15.81:46474) 2024-09-16T01:17:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4bbfff640 1 -- 172.21.15.81:0/3577041343 learned_addr learned my addr 172.21.15.81:0/3577041343 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:24.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4baffd640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc072d30 0x7fe4bc158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4bb7fe640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc06f700 0x7fe4bc15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4bbfff640 1 -- 172.21.15.81:0/3577041343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc072d30 msgr2=0x7fe4bc158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4bbfff640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc072d30 0x7fe4bc158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4bbfff640 1 -- 172.21.15.81:0/3577041343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc06f700 msgr2=0x7fe4bc15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4bbfff640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc06f700 0x7fe4bc15c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4bbfff640 1 -- 172.21.15.81:0/3577041343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc15d150 con 0x7fe4bc15b300 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4bb7fe640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc06f700 0x7fe4bc15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4bbfff640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc15b300 0x7fe4bc0cb3d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400efc0 tx=0x7fe4b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4a3fff640 1 -- 172.21.15.81:0/3577041343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4018030 con 0x7fe4bc15b300 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4a3fff640 1 -- 172.21.15.81:0/3577041343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b400cdf0 con 0x7fe4bc15b300 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4a3fff640 1 -- 172.21.15.81:0/3577041343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4003bb0 con 0x7fe4bc15b300 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.414+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3577041343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4bc15d430 con 0x7fe4bc15b300 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.415+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3577041343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4bc0c7c90 con 0x7fe4bc15b300 2024-09-16T01:17:24.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.416+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3577041343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4bc06f1c0 con 0x7fe4bc15b300 2024-09-16T01:17:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.416+0000 7fe4a3fff640 1 -- 172.21.15.81:0/3577041343 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe4b401b070 con 0x7fe4bc15b300 2024-09-16T01:17:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.416+0000 7fe4a3fff640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a806c2b0 0x7fe4a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.416+0000 7fe4a3fff640 1 -- 172.21.15.81:0/3577041343 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6130+0+0 (secure 0 0 0) 0x7fe4b408be90 con 0x7fe4bc15b300 2024-09-16T01:17:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.416+0000 7fe4bb7fe640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a806c2b0 0x7fe4a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.417+0000 7fe4bb7fe640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a806c2b0 0x7fe4a806e770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac001eb0 tx=0x7fe4ac001d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:24.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.421+0000 7fe4a3fff640 1 -- 172.21.15.81:0/3577041343 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe4b4010040 con 0x7fe4bc15b300 2024-09-16T01:17:24.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.620+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3577041343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4bc1e7900 con 0x7fe4bc15b300 2024-09-16T01:17:24.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.620+0000 7fe4a3fff640 1 -- 172.21.15.81:0/3577041343 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5223 (secure 0 0 0) 0x7fe4b405a4e0 con 0x7fe4bc15b300 2024-09-16T01:17:24.622 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:24.622 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"btime":"2024-09-16T01:16:34:988023+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2179103223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2179103223},{"type":"v1","addr":"172.21.15.81:6836","nonce":2179103223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4649,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/4263439893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":4263439893},{"type":"v1","addr":"172.21.15.102:6834","nonce":4263439893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/27716817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":27716817},{"type":"v1","addr":"172.21.15.102:6835","nonce":27716817}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:16:32.311950+0000","modified":"2024-09-16T01:16:34.313044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4956},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4956":{"gid":4956,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3051272390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3051272390},{"type":"v1","addr":"172.21.15.81:6837","nonce":3051272390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4956,"qdb_cluster":[4956]},"id":2}]} 2024-09-16T01:17:24.623 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 16 2024-09-16T01:17:24.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.622+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3577041343 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a806c2b0 msgr2=0x7fe4a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.622+0000 7fe4c1ef1640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a806c2b0 0x7fe4a806e770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac001eb0 tx=0x7fe4ac001d80 comp rx=0 tx=0).stop 2024-09-16T01:17:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.622+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3577041343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc15b300 msgr2=0x7fe4bc0cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.622+0000 7fe4c1ef1640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc15b300 0x7fe4bc0cb3d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400efc0 tx=0x7fe4b400c490 comp rx=0 tx=0).stop 2024-09-16T01:17:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.622+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3577041343 shutdown_connections 2024-09-16T01:17:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.622+0000 7fe4c1ef1640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a806c2b0 0x7fe4a806e770 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.622+0000 7fe4c1ef1640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4bc15b300 0x7fe4bc0cb3d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.622+0000 7fe4c1ef1640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4bc072d30 0x7fe4bc158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.622+0000 7fe4c1ef1640 1 --2- 172.21.15.81:0/3577041343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4bc06f700 0x7fe4bc15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.622+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3577041343 >> 172.21.15.81:0/3577041343 conn(0x7fe4bc067d70 msgr2=0x7fe4bc15d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.623+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3577041343 shutdown_connections 2024-09-16T01:17:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.623+0000 7fe4c1ef1640 1 -- 172.21.15.81:0/3577041343 wait complete. 2024-09-16T01:17:24.635 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:17:24.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.731+0000 7f9e267d6640 1 Processor -- start 2024-09-16T01:17:24.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.731+0000 7f9e267d6640 1 -- start start 2024-09-16T01:17:24.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e267d6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e20072940 0x7f9e20072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e267d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e200b4880 0x7f9e200b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e267d6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e200b3570 con 0x7f9e2015ba30 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e267d6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9e200732e0 con 0x7f9e20072940 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e267d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e200b4180 con 0x7f9e200b4880 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e1f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e20072940 0x7f9e20072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e1ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9e2015ba30 0x7f9e2006f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46664/0 (socket says 172.21.15.81:46664) 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e1ffff640 1 -- 172.21.15.81:0/735248138 learned_addr learned my addr 172.21.15.81:0/735248138 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e1f7fe640 1 -- 172.21.15.81:0/735248138 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e200b4880 msgr2=0x7f9e200b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e24d73640 1 --2- 172.21.15.81:0/735248138 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e200b4880 0x7f9e200b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e1f7fe640 1 --2- 172.21.15.81:0/735248138 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e200b4880 0x7f9e200b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e1f7fe640 1 -- 172.21.15.81:0/735248138 >> v1:172.21.15.81:6789/0 conn(0x7f9e2015ba30 legacy=0x7f9e2006f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e1effd640 1 -- 172.21.15.81:0/735248138 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193337889 0 0) 0x7f9e200b3570 con 0x7f9e2015ba30 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e1f7fe640 1 -- 172.21.15.81:0/735248138 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e200b3850 con 0x7f9e20072940 2024-09-16T01:17:24.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.732+0000 7f9e24d73640 1 --2- 172.21.15.81:0/735248138 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e200b4880 0x7f9e200b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.733+0000 7f9e1f7fe640 1 --2- 172.21.15.81:0/735248138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e20072940 0x7f9e20072da0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9e080097a0 tx=0x7f9e0802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4984978419ddaa2a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.733+0000 7f9e1effd640 1 -- 172.21.15.81:0/735248138 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08037070 con 0x7f9e20072940 2024-09-16T01:17:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.733+0000 7f9e1effd640 1 -- 172.21.15.81:0/735248138 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e08032440 con 0x7f9e20072940 2024-09-16T01:17:24.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.733+0000 7f9e1effd640 1 -- 172.21.15.81:0/735248138 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08032810 con 0x7f9e20072940 2024-09-16T01:17:24.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.733+0000 7f9e267d6640 1 -- 172.21.15.81:0/735248138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e20072940 msgr2=0x7f9e20072da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.733+0000 7f9e267d6640 1 --2- 172.21.15.81:0/735248138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e20072940 0x7f9e20072da0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9e080097a0 tx=0x7f9e0802a180 comp rx=0 tx=0).stop 2024-09-16T01:17:24.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.734+0000 7f9e267d6640 1 -- 172.21.15.81:0/735248138 shutdown_connections 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.734+0000 7f9e267d6640 1 --2- 172.21.15.81:0/735248138 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e200b4880 0x7f9e200b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.734+0000 7f9e267d6640 1 --2- 172.21.15.81:0/735248138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e20072940 0x7f9e20072da0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.734+0000 7f9e267d6640 1 -- 172.21.15.81:0/735248138 >> 172.21.15.81:0/735248138 conn(0x7f9e20067d70 msgr2=0x7f9e2006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.734+0000 7f9e267d6640 1 -- 172.21.15.81:0/735248138 shutdown_connections 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.734+0000 7f9e267d6640 1 -- 172.21.15.81:0/735248138 wait complete. 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.735+0000 7f9e267d6640 1 Processor -- start 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.735+0000 7f9e267d6640 1 -- start start 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e267d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e20072940 0x7f9e20149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e267d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e200b4880 0x7f9e20152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e267d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e2015ba30 0x7f9e200b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e267d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2006ff20 con 0x7f9e20072940 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e267d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e200b3e10 con 0x7f9e2015ba30 2024-09-16T01:17:24.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e267d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e200ce810 con 0x7f9e200b4880 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e20072940 0x7f9e20149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e20072940 0x7f9e20149670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46482/0 (socket says 172.21.15.81:46482) 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1ffff640 1 -- 172.21.15.81:0/2018575129 learned_addr learned my addr 172.21.15.81:0/2018575129 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1f7fe640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e200b4880 0x7f9e20152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1ffff640 1 -- 172.21.15.81:0/2018575129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e200b4880 msgr2=0x7f9e20152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1ffff640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e200b4880 0x7f9e20152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e24d73640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e2015ba30 0x7f9e200b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1ffff640 1 -- 172.21.15.81:0/2018575129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e2015ba30 msgr2=0x7f9e200b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1ffff640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e2015ba30 0x7f9e200b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1ffff640 1 -- 172.21.15.81:0/2018575129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e2014c930 con 0x7f9e20072940 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e24d73640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e2015ba30 0x7f9e200b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1ffff640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e20072940 0x7f9e20149670 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c460 tx=0x7f9e1000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:24.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1cff9640 1 -- 172.21.15.81:0/2018575129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e10018070 con 0x7f9e20072940 2024-09-16T01:17:24.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1cff9640 1 -- 172.21.15.81:0/2018575129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e10007500 con 0x7f9e20072940 2024-09-16T01:17:24.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e1cff9640 1 -- 172.21.15.81:0/2018575129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e10004a20 con 0x7f9e20072940 2024-09-16T01:17:24.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e267d6640 1 -- 172.21.15.81:0/2018575129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e2014cc10 con 0x7f9e20072940 2024-09-16T01:17:24.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.736+0000 7f9e267d6640 1 -- 172.21.15.81:0/2018575129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e2014d1d0 con 0x7f9e20072940 2024-09-16T01:17:24.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.737+0000 7f9e267d6640 1 -- 172.21.15.81:0/2018575129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e200cd590 con 0x7f9e20072940 2024-09-16T01:17:24.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.738+0000 7f9e1cff9640 1 -- 172.21.15.81:0/2018575129 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9e1001b070 con 0x7f9e20072940 2024-09-16T01:17:24.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.738+0000 7f9e1cff9640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e0006c2b0 0x7f9e0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:24.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.738+0000 7f9e1f7fe640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e0006c2b0 0x7f9e0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:24.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.738+0000 7f9e1cff9640 1 -- 172.21.15.81:0/2018575129 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6130+0+0 (secure 0 0 0) 0x7f9e1008a890 con 0x7f9e20072940 2024-09-16T01:17:24.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.739+0000 7f9e1f7fe640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e0006c2b0 0x7f9e0006e770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e08034000 tx=0x7f9e0802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:24.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.743+0000 7f9e1cff9640 1 -- 172.21.15.81:0/2018575129 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e200cd590 con 0x7f9e20072940 2024-09-16T01:17:24.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.908+0000 7f9e267d6640 1 -- 172.21.15.81:0/2018575129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e200ccfe0 con 0x7f9e20072940 2024-09-16T01:17:24.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.910+0000 7f9e1cff9640 1 -- 172.21.15.81:0/2018575129 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17051 (secure 0 0 0) 0x7f9e10058e50 con 0x7f9e20072940 2024-09-16T01:17:24.912 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:24.912 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":39,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:17:22.163170+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:16:29.974908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-16T01:16:31.289690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.2f","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:17:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.912+0000 7f9e267d6640 1 -- 172.21.15.81:0/2018575129 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e0006c2b0 msgr2=0x7f9e0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.912+0000 7f9e267d6640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e0006c2b0 0x7f9e0006e770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e08034000 tx=0x7f9e0802e000 comp rx=0 tx=0).stop 2024-09-16T01:17:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.912+0000 7f9e267d6640 1 -- 172.21.15.81:0/2018575129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e20072940 msgr2=0x7f9e20149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.912+0000 7f9e267d6640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e20072940 0x7f9e20149670 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c460 tx=0x7f9e1000c920 comp rx=0 tx=0).stop 2024-09-16T01:17:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.912+0000 7f9e267d6640 1 -- 172.21.15.81:0/2018575129 shutdown_connections 2024-09-16T01:17:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.912+0000 7f9e267d6640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e0006c2b0 0x7f9e0006e770 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.912+0000 7f9e267d6640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e2015ba30 0x7f9e200b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.912+0000 7f9e267d6640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e200b4880 0x7f9e20152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.912+0000 7f9e267d6640 1 --2- 172.21.15.81:0/2018575129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e20072940 0x7f9e20149670 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:24.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.912+0000 7f9e267d6640 1 -- 172.21.15.81:0/2018575129 >> 172.21.15.81:0/2018575129 conn(0x7f9e20067d70 msgr2=0x7f9e200b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:24.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.912+0000 7f9e267d6640 1 -- 172.21.15.81:0/2018575129 shutdown_connections 2024-09-16T01:17:24.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:24.912+0000 7f9e267d6640 1 -- 172.21.15.81:0/2018575129 wait complete. 2024-09-16T01:17:24.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:17:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.022+0000 7f976f827640 1 Processor -- start 2024-09-16T01:17:25.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.023+0000 7f976f827640 1 -- start start 2024-09-16T01:17:25.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.023+0000 7f976f827640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9768161c80 0x7f976806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.023+0000 7f976f827640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9768162060 0x7f97680b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.023+0000 7f976f827640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f97680b64b0 0x7f97680b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.023+0000 7f976f827640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f976806e870 con 0x7f9768162060 2024-09-16T01:17:25.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.023+0000 7f976f827640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f976806d9f0 con 0x7f97680b64b0 2024-09-16T01:17:25.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.023+0000 7f976f827640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f976806dcd0 con 0x7f9768161c80 2024-09-16T01:17:25.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.024+0000 7f976cdc2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9768162060 0x7f97680b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.024+0000 7f976cdc2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9768162060 0x7f97680b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46498/0 (socket says 172.21.15.81:46498) 2024-09-16T01:17:25.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.024+0000 7f976cdc2640 1 -- 172.21.15.81:0/3285120192 learned_addr learned my addr 172.21.15.81:0/3285120192 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:25.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.024+0000 7f976d5c3640 1 --2- 172.21.15.81:0/3285120192 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9768161c80 0x7f976806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.024+0000 7f976ddc4640 1 --2- 172.21.15.81:0/3285120192 >> v2:172.21.15.102:3300/0 conn(0x7f97680b64b0 0x7f97680b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.024+0000 7f976cdc2640 1 -- 172.21.15.81:0/3285120192 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9768161c80 msgr2=0x7f976806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:25.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.024+0000 7f976cdc2640 1 --2- 172.21.15.81:0/3285120192 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9768161c80 0x7f976806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.024+0000 7f976cdc2640 1 -- 172.21.15.81:0/3285120192 >> v2:172.21.15.102:3300/0 conn(0x7f97680b64b0 msgr2=0x7f97680b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:25.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.024+0000 7f976cdc2640 1 --2- 172.21.15.81:0/3285120192 >> v2:172.21.15.102:3300/0 conn(0x7f97680b64b0 0x7f97680b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.024+0000 7f976cdc2640 1 -- 172.21.15.81:0/3285120192 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976806dfb0 con 0x7f9768162060 2024-09-16T01:17:25.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f976cdc2640 1 --2- 172.21.15.81:0/3285120192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768162060 0x7f97680b5f70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f97680687b0 tx=0x7f975c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a07ffba1e2ec4f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:25.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f9767fff640 1 -- 172.21.15.81:0/3285120192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c036070 con 0x7f9768162060 2024-09-16T01:17:25.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f9767fff640 1 -- 172.21.15.81:0/3285120192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f975c031600 con 0x7f9768162060 2024-09-16T01:17:25.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f9767fff640 1 -- 172.21.15.81:0/3285120192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c0319d0 con 0x7f9768162060 2024-09-16T01:17:25.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f976f827640 1 -- 172.21.15.81:0/3285120192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768162060 msgr2=0x7f97680b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:25.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f976f827640 1 --2- 172.21.15.81:0/3285120192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768162060 0x7f97680b5f70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f97680687b0 tx=0x7f975c02a6a0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f976f827640 1 -- 172.21.15.81:0/3285120192 shutdown_connections 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f976f827640 1 --2- 172.21.15.81:0/3285120192 >> v2:172.21.15.102:3300/0 conn(0x7f97680b64b0 0x7f97680b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f976f827640 1 --2- 172.21.15.81:0/3285120192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768162060 0x7f97680b5f70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f976f827640 1 --2- 172.21.15.81:0/3285120192 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9768161c80 0x7f976806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f976f827640 1 -- 172.21.15.81:0/3285120192 >> 172.21.15.81:0/3285120192 conn(0x7f97680d44f0 msgr2=0x7f97680d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f976f827640 1 -- 172.21.15.81:0/3285120192 shutdown_connections 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.025+0000 7f976f827640 1 -- 172.21.15.81:0/3285120192 wait complete. 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.027+0000 7f976f827640 1 Processor -- start 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.027+0000 7f976f827640 1 -- start start 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.027+0000 7f976f827640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97680b64b0 0x7f976815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.027+0000 7f976f827640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9768161c80 0x7f976815d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.027+0000 7f976f827640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768162060 0x7f97680cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.027+0000 7f976f827640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9768162500 con 0x7f9768162060 2024-09-16T01:17:25.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.027+0000 7f976f827640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97680d2aa0 con 0x7f97680b64b0 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.027+0000 7f976f827640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9768162680 con 0x7f9768161c80 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.027+0000 7f976ddc4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768162060 0x7f97680cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.027+0000 7f976ddc4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768162060 0x7f97680cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46510/0 (socket says 172.21.15.81:46510) 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976ddc4640 1 -- 172.21.15.81:0/2320843225 learned_addr learned my addr 172.21.15.81:0/2320843225 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976d5c3640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97680b64b0 0x7f976815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976cdc2640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9768161c80 0x7f976815d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976ddc4640 1 -- 172.21.15.81:0/2320843225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9768161c80 msgr2=0x7f976815d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976ddc4640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9768161c80 0x7f976815d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976ddc4640 1 -- 172.21.15.81:0/2320843225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97680b64b0 msgr2=0x7f976815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976ddc4640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97680b64b0 0x7f976815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976ddc4640 1 -- 172.21.15.81:0/2320843225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976815df10 con 0x7f9768162060 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976d5c3640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97680b64b0 0x7f976815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:25.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976cdc2640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9768161c80 0x7f976815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:25.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976ddc4640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768162060 0x7f97680cceb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f975800e860 tx=0x7f975800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:25.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f9765ffb640 1 -- 172.21.15.81:0/2320843225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758017070 con 0x7f9768162060 2024-09-16T01:17:25.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f9765ffb640 1 -- 172.21.15.81:0/2320843225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f975800c940 con 0x7f9768162060 2024-09-16T01:17:25.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976f827640 1 -- 172.21.15.81:0/2320843225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f976815e1f0 con 0x7f9768162060 2024-09-16T01:17:25.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f9765ffb640 1 -- 172.21.15.81:0/2320843225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975800cd30 con 0x7f9768162060 2024-09-16T01:17:25.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.028+0000 7f976f827640 1 -- 172.21.15.81:0/2320843225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97680cc6b0 con 0x7f9768162060 2024-09-16T01:17:25.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.029+0000 7f976f827640 1 -- 172.21.15.81:0/2320843225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f976806e330 con 0x7f9768162060 2024-09-16T01:17:25.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.030+0000 7f9765ffb640 1 -- 172.21.15.81:0/2320843225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f975801a070 con 0x7f9768162060 2024-09-16T01:17:25.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.030+0000 7f9765ffb640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f975406c2b0 0x7f975406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.030+0000 7f976d5c3640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f975406c2b0 0x7f975406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.030+0000 7f9765ffb640 1 -- 172.21.15.81:0/2320843225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6130+0+0 (secure 0 0 0) 0x7f975808b900 con 0x7f9768162060 2024-09-16T01:17:25.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.031+0000 7f976d5c3640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f975406c2b0 0x7f975406e770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9760009b90 tx=0x7f9760008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:25.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.035+0000 7f9765ffb640 1 -- 172.21.15.81:0/2320843225 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9758059ec0 con 0x7f9768162060 2024-09-16T01:17:25.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.234+0000 7f976f827640 1 -- 172.21.15.81:0/2320843225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f97680b3630 con 0x7f9768162060 2024-09-16T01:17:25.236 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-16T01:17:25.234+0000 7f4e951a0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:17:25.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.238+0000 7f9765ffb640 1 -- 172.21.15.81:0/2320843225 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f97580597c0 con 0x7f9768162060 2024-09-16T01:17:25.239 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:17:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.240+0000 7f976f827640 1 -- 172.21.15.81:0/2320843225 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f975406c2b0 msgr2=0x7f975406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.240+0000 7f976f827640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f975406c2b0 0x7f975406e770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9760009b90 tx=0x7f9760008040 comp rx=0 tx=0).stop 2024-09-16T01:17:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.240+0000 7f976f827640 1 -- 172.21.15.81:0/2320843225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768162060 msgr2=0x7f97680cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.240+0000 7f976f827640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768162060 0x7f97680cceb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f975800e860 tx=0x7f975800ed20 comp rx=0 tx=0).stop 2024-09-16T01:17:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.240+0000 7f976f827640 1 -- 172.21.15.81:0/2320843225 shutdown_connections 2024-09-16T01:17:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.240+0000 7f976f827640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f975406c2b0 0x7f975406e770 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.240+0000 7f976f827640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9768162060 0x7f97680cceb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.240+0000 7f976f827640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9768161c80 0x7f976815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.240+0000 7f976f827640 1 --2- 172.21.15.81:0/2320843225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97680b64b0 0x7f976815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.240+0000 7f976f827640 1 -- 172.21.15.81:0/2320843225 >> 172.21.15.81:0/2320843225 conn(0x7f97680d44f0 msgr2=0x7f97680b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.240+0000 7f976f827640 1 -- 172.21.15.81:0/2320843225 shutdown_connections 2024-09-16T01:17:25.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.240+0000 7f976f827640 1 -- 172.21.15.81:0/2320843225 wait complete. 2024-09-16T01:17:25.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:17:25.280 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:17:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.354+0000 7fbae11c4640 1 Processor -- start 2024-09-16T01:17:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.354+0000 7fbae11c4640 1 -- start start 2024-09-16T01:17:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbae11c4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbadc0cee90 0x7fbadc1608b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbae11c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbadc0afde0 0x7fbadc06e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbae11c4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbadc0b0250 con 0x7fbadc1533e0 2024-09-16T01:17:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbae11c4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fbadc0b0510 con 0x7fbadc0cee90 2024-09-16T01:17:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbae11c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbadc15c910 con 0x7fbadc0afde0 2024-09-16T01:17:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbada59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbadc0cee90 0x7fbadc1608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbada59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbadc0cee90 0x7fbadc1608b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46530/0 (socket says 172.21.15.81:46530) 2024-09-16T01:17:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbadad9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbadc1533e0 0x7fbadc0ce780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46676/0 (socket says 172.21.15.81:46676) 2024-09-16T01:17:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbada59c640 1 -- 172.21.15.81:0/2826688674 learned_addr learned my addr 172.21.15.81:0/2826688674 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbadb59e640 1 --2- 172.21.15.81:0/2826688674 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbadc0afde0 0x7fbadc06e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbada59c640 1 -- 172.21.15.81:0/2826688674 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbadc0afde0 msgr2=0x7fbadc06e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbada59c640 1 --2- 172.21.15.81:0/2826688674 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbadc0afde0 0x7fbadc06e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbada59c640 1 -- 172.21.15.81:0/2826688674 >> v1:172.21.15.81:6789/0 conn(0x7fbadc1533e0 legacy=0x7fbadc0ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbad9d9b640 1 -- 172.21.15.81:0/2826688674 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 108268826 0 0) 0x7fbadc0b0250 con 0x7fbadc1533e0 2024-09-16T01:17:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.355+0000 7fbada59c640 1 -- 172.21.15.81:0/2826688674 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbadc15cbf0 con 0x7fbadc0cee90 2024-09-16T01:17:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.356+0000 7fbada59c640 1 --2- 172.21.15.81:0/2826688674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc0cee90 0x7fbadc1608b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009870 tx=0x7fbad002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f4700f4e015fb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.356+0000 7fbad9d9b640 1 -- 172.21.15.81:0/2826688674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad0037070 con 0x7fbadc0cee90 2024-09-16T01:17:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.356+0000 7fbad9d9b640 1 -- 172.21.15.81:0/2826688674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad0032440 con 0x7fbadc0cee90 2024-09-16T01:17:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.356+0000 7fbad9d9b640 1 -- 172.21.15.81:0/2826688674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad0032810 con 0x7fbadc0cee90 2024-09-16T01:17:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.357+0000 7fbae11c4640 1 -- 172.21.15.81:0/2826688674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc0cee90 msgr2=0x7fbadc1608b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.357+0000 7fbae11c4640 1 --2- 172.21.15.81:0/2826688674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc0cee90 0x7fbadc1608b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbad0009870 tx=0x7fbad002a270 comp rx=0 tx=0).stop 2024-09-16T01:17:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.357+0000 7fbae11c4640 1 -- 172.21.15.81:0/2826688674 shutdown_connections 2024-09-16T01:17:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.357+0000 7fbae11c4640 1 --2- 172.21.15.81:0/2826688674 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbadc0afde0 0x7fbadc06e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.357+0000 7fbae11c4640 1 --2- 172.21.15.81:0/2826688674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc0cee90 0x7fbadc1608b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.357+0000 7fbae11c4640 1 -- 172.21.15.81:0/2826688674 >> 172.21.15.81:0/2826688674 conn(0x7fbadc073530 msgr2=0x7fbadc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.357+0000 7fbae11c4640 1 -- 172.21.15.81:0/2826688674 shutdown_connections 2024-09-16T01:17:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.357+0000 7fbae11c4640 1 -- 172.21.15.81:0/2826688674 wait complete. 2024-09-16T01:17:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.358+0000 7fbae11c4640 1 Processor -- start 2024-09-16T01:17:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.358+0000 7fbae11c4640 1 -- start start 2024-09-16T01:17:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbae11c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbadc0afde0 0x7fbadc0add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbae11c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbadc0cee90 0x7fbadc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbae11c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc1533e0 0x7fbadc06c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbae11c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc15d6d0 con 0x7fbadc1533e0 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbae11c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc15d1b0 con 0x7fbadc0afde0 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbae11c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbadc06e9a0 con 0x7fbadc0cee90 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbadb59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc1533e0 0x7fbadc06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbadb59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc1533e0 0x7fbadc06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46538/0 (socket says 172.21.15.81:46538) 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbadb59e640 1 -- 172.21.15.81:0/4141940646 learned_addr learned my addr 172.21.15.81:0/4141940646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbadad9d640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbadc0afde0 0x7fbadc0add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbada59c640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbadc0cee90 0x7fbadc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbadb59e640 1 -- 172.21.15.81:0/4141940646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbadc0cee90 msgr2=0x7fbadc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbadb59e640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbadc0cee90 0x7fbadc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbadb59e640 1 -- 172.21.15.81:0/4141940646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbadc0afde0 msgr2=0x7fbadc0add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbadb59e640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbadc0afde0 0x7fbadc0add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbadb59e640 1 -- 172.21.15.81:0/4141940646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbadc0aa460 con 0x7fbadc1533e0 2024-09-16T01:17:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.359+0000 7fbada59c640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbadc0cee90 0x7fbadc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.360+0000 7fbadb59e640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc1533e0 0x7fbadc06c150 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbad400c820 tx=0x7fbad400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.360+0000 7fbac37fe640 1 -- 172.21.15.81:0/4141940646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad4015070 con 0x7fbadc1533e0 2024-09-16T01:17:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.360+0000 7fbac37fe640 1 -- 172.21.15.81:0/4141940646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad4004020 con 0x7fbadc1533e0 2024-09-16T01:17:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.360+0000 7fbae11c4640 1 -- 172.21.15.81:0/4141940646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbadc13e060 con 0x7fbadc1533e0 2024-09-16T01:17:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.360+0000 7fbac37fe640 1 -- 172.21.15.81:0/4141940646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad4004410 con 0x7fbadc1533e0 2024-09-16T01:17:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.360+0000 7fbae11c4640 1 -- 172.21.15.81:0/4141940646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbadc13e620 con 0x7fbadc1533e0 2024-09-16T01:17:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.361+0000 7fbae11c4640 1 -- 172.21.15.81:0/4141940646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbadc06e460 con 0x7fbadc1533e0 2024-09-16T01:17:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.361+0000 7fbac37fe640 1 -- 172.21.15.81:0/4141940646 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbad4007830 con 0x7fbadc1533e0 2024-09-16T01:17:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.362+0000 7fbac37fe640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbac806c2b0 0x7fbac806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.362+0000 7fbac37fe640 1 -- 172.21.15.81:0/4141940646 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6216+0+0 (secure 0 0 0) 0x7fbad408b4a0 con 0x7fbadc1533e0 2024-09-16T01:17:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.362+0000 7fbadad9d640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbac806c2b0 0x7fbac806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.362+0000 7fbadad9d640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbac806c2b0 0x7fbac806e770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0012e0 tx=0x7fbacc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:25.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.366+0000 7fbac37fe640 1 -- 172.21.15.81:0/4141940646 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbad4059a10 con 0x7fbadc1533e0 2024-09-16T01:17:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:25.565+0000 7fbae11c4640 1 -- 172.21.15.81:0/4141940646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbadc06cd80 con 0x7fbadc1533e0 2024-09-16T01:17:26.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.242+0000 7fbac37fe640 1 -- 172.21.15.81:0/4141940646 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7fbad4059310 con 0x7fbadc1533e0 2024-09-16T01:17:26.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.245+0000 7fbae11c4640 1 -- 172.21.15.81:0/4141940646 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbac806c2b0 msgr2=0x7fbac806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:26.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.245+0000 7fbae11c4640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbac806c2b0 0x7fbac806e770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0012e0 tx=0x7fbacc009040 comp rx=0 tx=0).stop 2024-09-16T01:17:26.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.245+0000 7fbae11c4640 1 -- 172.21.15.81:0/4141940646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc1533e0 msgr2=0x7fbadc06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:26.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.245+0000 7fbae11c4640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc1533e0 0x7fbadc06c150 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbad400c820 tx=0x7fbad400cce0 comp rx=0 tx=0).stop 2024-09-16T01:17:26.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.245+0000 7fbae11c4640 1 -- 172.21.15.81:0/4141940646 shutdown_connections 2024-09-16T01:17:26.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.245+0000 7fbae11c4640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbac806c2b0 0x7fbac806e770 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:26.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.245+0000 7fbae11c4640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbadc1533e0 0x7fbadc06c150 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:26.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.245+0000 7fbae11c4640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbadc0cee90 0x7fbadc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:26.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.245+0000 7fbae11c4640 1 --2- 172.21.15.81:0/4141940646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbadc0afde0 0x7fbadc0add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:26.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.245+0000 7fbae11c4640 1 -- 172.21.15.81:0/4141940646 >> 172.21.15.81:0/4141940646 conn(0x7fbadc073530 msgr2=0x7fbadc15f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:26.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.245+0000 7fbae11c4640 1 -- 172.21.15.81:0/4141940646 shutdown_connections 2024-09-16T01:17:26.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.245+0000 7fbae11c4640 1 -- 172.21.15.81:0/4141940646 wait complete. 2024-09-16T01:17:26.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:17:26.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.409+0000 7f536b7cf640 1 Processor -- start 2024-09-16T01:17:26.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.410+0000 7f536b7cf640 1 -- start start 2024-09-16T01:17:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.410+0000 7f536b7cf640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5364071160 0x7f53640cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.410+0000 7f536b7cf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53640cdd20 0x7f53640700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.410+0000 7f536b7cf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53640ce720 con 0x7f53640b1920 2024-09-16T01:17:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.410+0000 7f536b7cf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f53640cea00 con 0x7f53640cdd20 2024-09-16T01:17:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.410+0000 7f536b7cf640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f53640ccfe0 con 0x7f5364071160 2024-09-16T01:17:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.410+0000 7f5369d6c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53640cdd20 0x7f53640700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.410+0000 7f536956b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f53640b1920 0x7f536409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46680/0 (socket says 172.21.15.81:46680) 2024-09-16T01:17:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.411+0000 7f536956b640 1 -- 172.21.15.81:0/519757718 learned_addr learned my addr 172.21.15.81:0/519757718 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.411+0000 7f5369d6c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53640cdd20 0x7f53640700c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46546/0 (socket says 172.21.15.81:46546) 2024-09-16T01:17:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.411+0000 7f5368d6a640 1 --2- 172.21.15.81:0/519757718 >> v2:172.21.15.102:3300/0 conn(0x7f5364071160 0x7f53640cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.411+0000 7f5369d6c640 1 -- 172.21.15.81:0/519757718 >> v2:172.21.15.102:3300/0 conn(0x7f5364071160 msgr2=0x7f53640cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.411+0000 7f5369d6c640 1 --2- 172.21.15.81:0/519757718 >> v2:172.21.15.102:3300/0 conn(0x7f5364071160 0x7f53640cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:26.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.411+0000 7f5369d6c640 1 -- 172.21.15.81:0/519757718 >> v1:172.21.15.81:6789/0 conn(0x7f53640b1920 legacy=0x7f536409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:26.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.411+0000 7f5363fff640 1 -- 172.21.15.81:0/519757718 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926434897 0 0) 0x7f53640ce720 con 0x7f53640b1920 2024-09-16T01:17:26.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.411+0000 7f5369d6c640 1 -- 172.21.15.81:0/519757718 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53640cd2c0 con 0x7f53640cdd20 2024-09-16T01:17:26.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.411+0000 7f5368d6a640 1 --2- 172.21.15.81:0/519757718 >> v2:172.21.15.102:3300/0 conn(0x7f5364071160 0x7f53640cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.412+0000 7f5369d6c640 1 --2- 172.21.15.81:0/519757718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53640cdd20 0x7f53640700c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5364073680 tx=0x7f535c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8503514325b8f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.412+0000 7f5363fff640 1 -- 172.21.15.81:0/519757718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c037070 con 0x7f53640cdd20 2024-09-16T01:17:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.412+0000 7f5363fff640 1 -- 172.21.15.81:0/519757718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f535c032440 con 0x7f53640cdd20 2024-09-16T01:17:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.412+0000 7f5363fff640 1 -- 172.21.15.81:0/519757718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c02ae60 con 0x7f53640cdd20 2024-09-16T01:17:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.412+0000 7f536b7cf640 1 -- 172.21.15.81:0/519757718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53640cdd20 msgr2=0x7f53640700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.412+0000 7f536b7cf640 1 --2- 172.21.15.81:0/519757718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53640cdd20 0x7f53640700c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5364073680 tx=0x7f535c02a110 comp rx=0 tx=0).stop 2024-09-16T01:17:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.412+0000 7f536b7cf640 1 -- 172.21.15.81:0/519757718 shutdown_connections 2024-09-16T01:17:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.412+0000 7f536b7cf640 1 --2- 172.21.15.81:0/519757718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53640cdd20 0x7f53640700c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.412+0000 7f536b7cf640 1 --2- 172.21.15.81:0/519757718 >> v2:172.21.15.102:3300/0 conn(0x7f5364071160 0x7f53640cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.412+0000 7f536b7cf640 1 -- 172.21.15.81:0/519757718 >> 172.21.15.81:0/519757718 conn(0x7f53640b3de0 msgr2=0x7f53640b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.412+0000 7f536b7cf640 1 -- 172.21.15.81:0/519757718 shutdown_connections 2024-09-16T01:17:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.412+0000 7f536b7cf640 1 -- 172.21.15.81:0/519757718 wait complete. 2024-09-16T01:17:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.413+0000 7f536b7cf640 1 Processor -- start 2024-09-16T01:17:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.413+0000 7f536b7cf640 1 -- start start 2024-09-16T01:17:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.414+0000 7f536b7cf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5364071160 0x7f53640b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.414+0000 7f536b7cf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53640b1920 0x7f536414d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.414+0000 7f536b7cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53640cdd20 0x7f536415d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.414+0000 7f536b7cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53640d01f0 con 0x7f53640cdd20 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.414+0000 7f536b7cf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f53640d0070 con 0x7f53640b1920 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.414+0000 7f536b7cf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f536409b140 con 0x7f5364071160 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.414+0000 7f5369d6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53640cdd20 0x7f536415d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.414+0000 7f5369d6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53640cdd20 0x7f536415d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46556/0 (socket says 172.21.15.81:46556) 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.414+0000 7f5369d6c640 1 -- 172.21.15.81:0/942988615 learned_addr learned my addr 172.21.15.81:0/942988615 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.414+0000 7f536956b640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5364071160 0x7f53640b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.414+0000 7f5368d6a640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53640b1920 0x7f536414d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.415+0000 7f5369d6c640 1 -- 172.21.15.81:0/942988615 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5364071160 msgr2=0x7f53640b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.415+0000 7f5369d6c640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5364071160 0x7f53640b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.415+0000 7f5369d6c640 1 -- 172.21.15.81:0/942988615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53640b1920 msgr2=0x7f536414d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.415+0000 7f5369d6c640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53640b1920 0x7f536414d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.415+0000 7f5369d6c640 1 -- 172.21.15.81:0/942988615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53640b7eb0 con 0x7f53640cdd20 2024-09-16T01:17:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.415+0000 7f5369d6c640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53640cdd20 0x7f536415d480 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f535c035040 tx=0x7f535c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.415+0000 7f5361ffb640 1 -- 172.21.15.81:0/942988615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c037040 con 0x7f53640cdd20 2024-09-16T01:17:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.415+0000 7f5361ffb640 1 -- 172.21.15.81:0/942988615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f535c042070 con 0x7f53640cdd20 2024-09-16T01:17:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.415+0000 7f5361ffb640 1 -- 172.21.15.81:0/942988615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c030b30 con 0x7f53640cdd20 2024-09-16T01:17:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.415+0000 7f536b7cf640 1 -- 172.21.15.81:0/942988615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53640b5120 con 0x7f53640cdd20 2024-09-16T01:17:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.415+0000 7f536b7cf640 1 -- 172.21.15.81:0/942988615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53640b56e0 con 0x7f53640cdd20 2024-09-16T01:17:26.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.416+0000 7f536b7cf640 1 -- 172.21.15.81:0/942988615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53640ce720 con 0x7f53640cdd20 2024-09-16T01:17:26.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.416+0000 7f5361ffb640 1 -- 172.21.15.81:0/942988615 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f535c030cd0 con 0x7f53640cdd20 2024-09-16T01:17:26.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.417+0000 7f5361ffb640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f535006c2e0 0x7f535006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:26.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.417+0000 7f5361ffb640 1 -- 172.21.15.81:0/942988615 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6216+0+0 (secure 0 0 0) 0x7f535c0ac140 con 0x7f53640cdd20 2024-09-16T01:17:26.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.417+0000 7f536956b640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f535006c2e0 0x7f535006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:26.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.417+0000 7f536956b640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f535006c2e0 0x7f535006e7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f53540012e0 tx=0x7f5354007ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:26.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.421+0000 7f5361ffb640 1 -- 172.21.15.81:0/942988615 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f535c045360 con 0x7f53640cdd20 2024-09-16T01:17:26.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:26.587+0000 7f536b7cf640 1 -- 172.21.15.81:0/942988615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f53640b4cf0 con 0x7f53640cdd20 2024-09-16T01:17:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.243+0000 7f5361ffb640 1 -- 172.21.15.81:0/942988615 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) ==== 181+0+0 (secure 0 0 0) 0x7f535c07a740 con 0x7f53640cdd20 2024-09-16T01:17:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:17:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.247+0000 7f536b7cf640 1 -- 172.21.15.81:0/942988615 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f535006c2e0 msgr2=0x7f535006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.247+0000 7f536b7cf640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f535006c2e0 0x7f535006e7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f53540012e0 tx=0x7f5354007ed0 comp rx=0 tx=0).stop 2024-09-16T01:17:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.247+0000 7f536b7cf640 1 -- 172.21.15.81:0/942988615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53640cdd20 msgr2=0x7f536415d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.247+0000 7f536b7cf640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53640cdd20 0x7f536415d480 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f535c035040 tx=0x7f535c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.247+0000 7f536b7cf640 1 -- 172.21.15.81:0/942988615 shutdown_connections 2024-09-16T01:17:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.247+0000 7f536b7cf640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f535006c2e0 0x7f535006e7a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.247+0000 7f536b7cf640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53640cdd20 0x7f536415d480 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.247+0000 7f536b7cf640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53640b1920 0x7f536414d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.247+0000 7f536b7cf640 1 --2- 172.21.15.81:0/942988615 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5364071160 0x7f53640b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.247+0000 7f536b7cf640 1 -- 172.21.15.81:0/942988615 >> 172.21.15.81:0/942988615 conn(0x7f53640b3de0 msgr2=0x7f53640d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.247+0000 7f536b7cf640 1 -- 172.21.15.81:0/942988615 shutdown_connections 2024-09-16T01:17:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.247+0000 7f536b7cf640 1 -- 172.21.15.81:0/942988615 wait complete. 2024-09-16T01:17:27.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:17:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.369+0000 7f46eaf11640 1 Processor -- start 2024-09-16T01:17:27.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.369+0000 7f46eaf11640 1 -- start start 2024-09-16T01:17:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.370+0000 7f46eaf11640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e4162340 0x7f46e406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.370+0000 7f46eaf11640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f46e40cf280 0x7f46e4162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.370+0000 7f46eaf11640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e415ff70 con 0x7f46e4162c60 2024-09-16T01:17:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.370+0000 7f46eaf11640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f46e406de90 con 0x7f46e40cf280 2024-09-16T01:17:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.370+0000 7f46eaf11640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f46e40d4d10 con 0x7f46e4162340 2024-09-16T01:17:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.370+0000 7f46e94ae640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f46e4162c60 0x7f46e40d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46690/0 (socket says 172.21.15.81:46690) 2024-09-16T01:17:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.370+0000 7f46e94ae640 1 -- 172.21.15.81:0/3151391681 learned_addr learned my addr 172.21.15.81:0/3151391681 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.370+0000 7f46e3fff640 1 --2- 172.21.15.81:0/3151391681 >> v2:172.21.15.102:3300/0 conn(0x7f46e40cf280 0x7f46e4162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:27.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.370+0000 7f46e8cad640 1 --2- 172.21.15.81:0/3151391681 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e4162340 0x7f46e406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.371+0000 7f46e37fe640 1 -- 172.21.15.81:0/3151391681 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3631661750 0 0) 0x7f46e415ff70 con 0x7f46e4162c60 2024-09-16T01:17:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.371+0000 7f46e37fe640 1 -- 172.21.15.81:0/3151391681 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46d4003520 con 0x7f46e4162c60 2024-09-16T01:17:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.371+0000 7f46e3fff640 1 -- 172.21.15.81:0/3151391681 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e4162340 msgr2=0x7f46e406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.371+0000 7f46e3fff640 1 --2- 172.21.15.81:0/3151391681 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e4162340 0x7f46e406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.371+0000 7f46e3fff640 1 -- 172.21.15.81:0/3151391681 >> v1:172.21.15.81:6789/0 conn(0x7f46e4162c60 legacy=0x7f46e40d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:27.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.371+0000 7f46e3fff640 1 -- 172.21.15.81:0/3151391681 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e40d4ff0 con 0x7f46e40cf280 2024-09-16T01:17:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.372+0000 7f46e3fff640 1 --2- 172.21.15.81:0/3151391681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e40cf280 0x7f46e4162720 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009790 tx=0x7f46d002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83e7a96aacaacb21 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:27.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.372+0000 7f46e37fe640 1 -- 172.21.15.81:0/3151391681 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0037070 con 0x7f46e40cf280 2024-09-16T01:17:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.372+0000 7f46e37fe640 1 -- 172.21.15.81:0/3151391681 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d002ae50 con 0x7f46e40cf280 2024-09-16T01:17:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.372+0000 7f46e37fe640 1 -- 172.21.15.81:0/3151391681 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0032640 con 0x7f46e40cf280 2024-09-16T01:17:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.373+0000 7f46eaf11640 1 -- 172.21.15.81:0/3151391681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e40cf280 msgr2=0x7f46e4162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.373+0000 7f46eaf11640 1 --2- 172.21.15.81:0/3151391681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e40cf280 0x7f46e4162720 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f46d0009790 tx=0x7f46d002a100 comp rx=0 tx=0).stop 2024-09-16T01:17:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.373+0000 7f46eaf11640 1 -- 172.21.15.81:0/3151391681 shutdown_connections 2024-09-16T01:17:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.373+0000 7f46eaf11640 1 --2- 172.21.15.81:0/3151391681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e40cf280 0x7f46e4162720 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.373+0000 7f46eaf11640 1 --2- 172.21.15.81:0/3151391681 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e4162340 0x7f46e406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.373+0000 7f46eaf11640 1 -- 172.21.15.81:0/3151391681 >> 172.21.15.81:0/3151391681 conn(0x7f46e408bfc0 msgr2=0x7f46e40d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.373+0000 7f46eaf11640 1 -- 172.21.15.81:0/3151391681 shutdown_connections 2024-09-16T01:17:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.373+0000 7f46eaf11640 1 -- 172.21.15.81:0/3151391681 wait complete. 2024-09-16T01:17:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.374+0000 7f46eaf11640 1 Processor -- start 2024-09-16T01:17:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.374+0000 7f46eaf11640 1 -- start start 2024-09-16T01:17:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.375+0000 7f46eaf11640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e40cf280 0x7f46e40b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.375+0000 7f46eaf11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e4162340 0x7f46e40cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.375+0000 7f46eaf11640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e4162c60 0x7f46e41f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.375+0000 7f46eaf11640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46e40cf6c0 con 0x7f46e4162340 2024-09-16T01:17:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.375+0000 7f46eaf11640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f46e40d52d0 con 0x7f46e4162c60 2024-09-16T01:17:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.375+0000 7f46eaf11640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f46e4163110 con 0x7f46e40cf280 2024-09-16T01:17:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.375+0000 7f46e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e4162340 0x7f46e40cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.375+0000 7f46e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e4162340 0x7f46e40cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46570/0 (socket says 172.21.15.81:46570) 2024-09-16T01:17:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.375+0000 7f46e3fff640 1 -- 172.21.15.81:0/2090664941 learned_addr learned my addr 172.21.15.81:0/2090664941 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46e94ae640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e4162c60 0x7f46e41f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46e8cad640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e40cf280 0x7f46e40b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46e3fff640 1 -- 172.21.15.81:0/2090664941 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e40cf280 msgr2=0x7f46e40b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46e3fff640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e40cf280 0x7f46e40b6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46e3fff640 1 -- 172.21.15.81:0/2090664941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e4162c60 msgr2=0x7f46e41f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46e3fff640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e4162c60 0x7f46e41f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46e3fff640 1 -- 172.21.15.81:0/2090664941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e40b9040 con 0x7f46e4162340 2024-09-16T01:17:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46e3fff640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e4162340 0x7f46e40cdd70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f46d002a140 tx=0x7f46d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46e17fa640 1 -- 172.21.15.81:0/2090664941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0042020 con 0x7f46e4162340 2024-09-16T01:17:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46e17fa640 1 -- 172.21.15.81:0/2090664941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d00044c0 con 0x7f46e4162340 2024-09-16T01:17:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46eaf11640 1 -- 172.21.15.81:0/2090664941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e40b9320 con 0x7f46e4162340 2024-09-16T01:17:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46e17fa640 1 -- 172.21.15.81:0/2090664941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0037040 con 0x7f46e4162340 2024-09-16T01:17:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.376+0000 7f46eaf11640 1 -- 172.21.15.81:0/2090664941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e40cb640 con 0x7f46e4162340 2024-09-16T01:17:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.377+0000 7f46eaf11640 1 -- 172.21.15.81:0/2090664941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e4162720 con 0x7f46e4162340 2024-09-16T01:17:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.378+0000 7f46e17fa640 1 -- 172.21.15.81:0/2090664941 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f46d0045020 con 0x7f46e4162340 2024-09-16T01:17:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.378+0000 7f46e17fa640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46c806c2b0 0x7f46c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.378+0000 7f46e17fa640 1 -- 172.21.15.81:0/2090664941 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5778+0+0 (secure 0 0 0) 0x7f46d00abc00 con 0x7f46e4162340 2024-09-16T01:17:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.378+0000 7f46e8cad640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46c806c2b0 0x7f46c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:27.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.379+0000 7f46e8cad640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46c806c2b0 0x7f46c806e770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f46e4158720 tx=0x7f46d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.383+0000 7f46e17fa640 1 -- 172.21.15.81:0/2090664941 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46d00b2080 con 0x7f46e4162340 2024-09-16T01:17:27.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:27.548+0000 7f46eaf11640 1 -- 172.21.15.81:0/2090664941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f46e40d3fc0 con 0x7f46e4162340 2024-09-16T01:17:28.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.248+0000 7f46e17fa640 1 -- 172.21.15.81:0/2090664941 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) ==== 169+0+0 (secure 0 0 0) 0x7f46d004c030 con 0x7f46e4162340 2024-09-16T01:17:28.250 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-16T01:17:28.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.251+0000 7f46eaf11640 1 -- 172.21.15.81:0/2090664941 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46c806c2b0 msgr2=0x7f46c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.251+0000 7f46eaf11640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46c806c2b0 0x7f46c806e770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f46e4158720 tx=0x7f46d8008040 comp rx=0 tx=0).stop 2024-09-16T01:17:28.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.251+0000 7f46eaf11640 1 -- 172.21.15.81:0/2090664941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e4162340 msgr2=0x7f46e40cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.251+0000 7f46eaf11640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e4162340 0x7f46e40cdd70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f46d002a140 tx=0x7f46d00046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.251+0000 7f46eaf11640 1 -- 172.21.15.81:0/2090664941 shutdown_connections 2024-09-16T01:17:28.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.251+0000 7f46eaf11640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46c806c2b0 0x7f46c806e770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.251+0000 7f46eaf11640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e4162c60 0x7f46e41f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.251+0000 7f46eaf11640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e4162340 0x7f46e40cdd70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.251+0000 7f46eaf11640 1 --2- 172.21.15.81:0/2090664941 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e40cf280 0x7f46e40b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.251+0000 7f46eaf11640 1 -- 172.21.15.81:0/2090664941 >> 172.21.15.81:0/2090664941 conn(0x7f46e408bfc0 msgr2=0x7f46e406e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:28.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.251+0000 7f46eaf11640 1 -- 172.21.15.81:0/2090664941 shutdown_connections 2024-09-16T01:17:28.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.251+0000 7f46eaf11640 1 -- 172.21.15.81:0/2090664941 wait complete. 2024-09-16T01:17:28.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-16T01:17:28.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.371+0000 7f2344ea6640 1 Processor -- start 2024-09-16T01:17:28.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.371+0000 7f2344ea6640 1 -- start start 2024-09-16T01:17:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.372+0000 7f2344ea6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f234009b140 0x7f2340169380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.372+0000 7f2344ea6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23400b6820 con 0x7f234015f950 2024-09-16T01:17:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.372+0000 7f2344ea6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23400b6b00 con 0x7f2340158b50 2024-09-16T01:17:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.372+0000 7f2344ea6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f23400b6de0 con 0x7f234009b140 2024-09-16T01:17:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.372+0000 7f233dd9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f234015f950 0x7f234009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46694/0 (socket says 172.21.15.81:46694) 2024-09-16T01:17:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.372+0000 7f233dd9b640 1 -- 172.21.15.81:0/1681473887 learned_addr learned my addr 172.21.15.81:0/1681473887 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.373+0000 7f233ed9d640 1 --2- 172.21.15.81:0/1681473887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f234009b140 0x7f2340169380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.373+0000 7f233d59a640 1 -- 172.21.15.81:0/1681473887 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277325389 0 0) 0x7f23400b6820 con 0x7f234015f950 2024-09-16T01:17:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.373+0000 7f233d59a640 1 -- 172.21.15.81:0/1681473887 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2328003520 con 0x7f234015f950 2024-09-16T01:17:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.373+0000 7f233d59a640 1 -- 172.21.15.81:0/1681473887 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364541203 0 0) 0x7f23400b6b00 con 0x7f2340158b50 2024-09-16T01:17:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.373+0000 7f233d59a640 1 -- 172.21.15.81:0/1681473887 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23400b6820 con 0x7f2340158b50 2024-09-16T01:17:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.373+0000 7f233d59a640 1 -- 172.21.15.81:0/1681473887 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 574823245 0 0) 0x7f2328003520 con 0x7f234015f950 2024-09-16T01:17:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.373+0000 7f233ed9d640 1 -- 172.21.15.81:0/1681473887 >> v1:172.21.15.102:6789/0 conn(0x7f2340158b50 legacy=0x7f23400b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.373+0000 7f233ed9d640 1 -- 172.21.15.81:0/1681473887 >> v1:172.21.15.81:6789/0 conn(0x7f234015f950 legacy=0x7f234009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.373+0000 7f233ed9d640 1 -- 172.21.15.81:0/1681473887 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23400b70c0 con 0x7f234009b140 2024-09-16T01:17:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.374+0000 7f233ed9d640 1 --2- 172.21.15.81:0/1681473887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f234009b140 0x7f2340169380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2338009dc0 tx=0x7f233802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fb28643e451fa99 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.374+0000 7f233d59a640 1 -- 172.21.15.81:0/1681473887 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334001670 con 0x7f234009b140 2024-09-16T01:17:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.374+0000 7f233d59a640 1 -- 172.21.15.81:0/1681473887 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2338007540 con 0x7f234009b140 2024-09-16T01:17:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.374+0000 7f233d59a640 1 -- 172.21.15.81:0/1681473887 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23380078f0 con 0x7f234009b140 2024-09-16T01:17:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.374+0000 7f2344ea6640 1 -- 172.21.15.81:0/1681473887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f234009b140 msgr2=0x7f2340169380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.374+0000 7f2344ea6640 1 --2- 172.21.15.81:0/1681473887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f234009b140 0x7f2340169380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2338009dc0 tx=0x7f233802a660 comp rx=0 tx=0).stop 2024-09-16T01:17:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.375+0000 7f2344ea6640 1 -- 172.21.15.81:0/1681473887 shutdown_connections 2024-09-16T01:17:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.375+0000 7f2344ea6640 1 --2- 172.21.15.81:0/1681473887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f234009b140 0x7f2340169380 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.375+0000 7f2344ea6640 1 -- 172.21.15.81:0/1681473887 >> 172.21.15.81:0/1681473887 conn(0x7f23400b79e0 msgr2=0x7f23400b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.375+0000 7f2344ea6640 1 -- 172.21.15.81:0/1681473887 shutdown_connections 2024-09-16T01:17:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.375+0000 7f2344ea6640 1 -- 172.21.15.81:0/1681473887 wait complete. 2024-09-16T01:17:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.376+0000 7f2344ea6640 1 Processor -- start 2024-09-16T01:17:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.376+0000 7f2344ea6640 1 -- start start 2024-09-16T01:17:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f2344ea6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f234009b140 0x7f234006e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f2344ea6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340158b50 0x7f23400cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f2344ea6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f234015f950 0x7f234014a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f2344ea6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2340158f30 con 0x7f2340158b50 2024-09-16T01:17:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f2344ea6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f23400b6530 con 0x7f234009b140 2024-09-16T01:17:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f2344ea6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f23401590b0 con 0x7f234015f950 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f233dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340158b50 0x7f23400cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f233dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340158b50 0x7f23400cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46574/0 (socket says 172.21.15.81:46574) 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f233dd9b640 1 -- 172.21.15.81:0/1321857704 learned_addr learned my addr 172.21.15.81:0/1321857704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f233dd9b640 1 -- 172.21.15.81:0/1321857704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f234015f950 msgr2=0x7f234014a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f233dd9b640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f234015f950 0x7f234014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f233dd9b640 1 -- 172.21.15.81:0/1321857704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f234009b140 msgr2=0x7f234006e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f233e59c640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f234009b140 0x7f234006e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f233dd9b640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f234009b140 0x7f234006e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f233dd9b640 1 -- 172.21.15.81:0/1321857704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23400cdcf0 con 0x7f2340158b50 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f233dd9b640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340158b50 0x7f23400cd2c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2334000fd0 tx=0x7f233400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f232effd640 1 -- 172.21.15.81:0/1321857704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334017070 con 0x7f2340158b50 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f232effd640 1 -- 172.21.15.81:0/1321857704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2334005ce0 con 0x7f2340158b50 2024-09-16T01:17:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f232effd640 1 -- 172.21.15.81:0/1321857704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23340072b0 con 0x7f2340158b50 2024-09-16T01:17:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.377+0000 7f2344ea6640 1 -- 172.21.15.81:0/1321857704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23400cf830 con 0x7f2340158b50 2024-09-16T01:17:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.378+0000 7f2344ea6640 1 -- 172.21.15.81:0/1321857704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23400cfdf0 con 0x7f2340158b50 2024-09-16T01:17:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.378+0000 7f2344ea6640 1 -- 172.21.15.81:0/1321857704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2340070f80 con 0x7f2340158b50 2024-09-16T01:17:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.379+0000 7f232effd640 1 -- 172.21.15.81:0/1321857704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f233401a070 con 0x7f2340158b50 2024-09-16T01:17:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.379+0000 7f232effd640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f232006c2b0 0x7f232006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.379+0000 7f232effd640 1 -- 172.21.15.81:0/1321857704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f233408a5f0 con 0x7f2340158b50 2024-09-16T01:17:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.379+0000 7f233e59c640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f232006c2b0 0x7f232006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.380+0000 7f233e59c640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f232006c2b0 0x7f232006e770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f23300010e0 tx=0x7f2330009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.384+0000 7f232effd640 1 -- 172.21.15.81:0/1321857704 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2334058880 con 0x7f2340158b50 2024-09-16T01:17:28.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.549+0000 7f2344ea6640 1 -- 172.21.15.81:0/1321857704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f23400b77a0 con 0x7f2340158b50 2024-09-16T01:17:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.553+0000 7f232effd640 1 -- 172.21.15.81:0/1321857704 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f233405cb80 con 0x7f2340158b50 2024-09-16T01:17:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.555+0000 7f2344ea6640 1 -- 172.21.15.81:0/1321857704 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f232006c2b0 msgr2=0x7f232006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.555+0000 7f2344ea6640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f232006c2b0 0x7f232006e770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f23300010e0 tx=0x7f2330009040 comp rx=0 tx=0).stop 2024-09-16T01:17:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.555+0000 7f2344ea6640 1 -- 172.21.15.81:0/1321857704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340158b50 msgr2=0x7f23400cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.555+0000 7f2344ea6640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340158b50 0x7f23400cd2c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2334000fd0 tx=0x7f233400c9b0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.555+0000 7f2344ea6640 1 -- 172.21.15.81:0/1321857704 shutdown_connections 2024-09-16T01:17:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.555+0000 7f2344ea6640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f232006c2b0 0x7f232006e770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.555+0000 7f2344ea6640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f234015f950 0x7f234014a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.555+0000 7f2344ea6640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2340158b50 0x7f23400cd2c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.555+0000 7f2344ea6640 1 --2- 172.21.15.81:0/1321857704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f234009b140 0x7f234006e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.555+0000 7f2344ea6640 1 -- 172.21.15.81:0/1321857704 >> 172.21.15.81:0/1321857704 conn(0x7f23400b79e0 msgr2=0x7f23401615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.555+0000 7f2344ea6640 1 -- 172.21.15.81:0/1321857704 shutdown_connections 2024-09-16T01:17:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.555+0000 7f2344ea6640 1 -- 172.21.15.81:0/1321857704 wait complete. 2024-09-16T01:17:28.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_session_cap_acquisition_throttle 2024-09-16T01:17:28.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.665+0000 7ffa656af640 1 Processor -- start 2024-09-16T01:17:28.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.665+0000 7ffa656af640 1 -- start start 2024-09-16T01:17:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa656af640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa600b7c30 0x7ffa600cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa656af640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffa600b4a50 0x7ffa600cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa656af640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffa600cd340 0x7ffa6009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa656af640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ffa600ce1a0 con 0x7ffa600cd340 2024-09-16T01:17:28.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa656af640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ffa600b3010 con 0x7ffa600b4a50 2024-09-16T01:17:28.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa656af640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffa600b32f0 con 0x7ffa600b7c30 2024-09-16T01:17:28.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa5f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffa600cd340 0x7ffa6009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa5f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffa600cd340 0x7ffa6009aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46580/0 (socket says 172.21.15.81:46580) 2024-09-16T01:17:28.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa5f7fe640 1 -- 172.21.15.81:0/2997994280 learned_addr learned my addr 172.21.15.81:0/2997994280 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:28.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa5effd640 1 --2- 172.21.15.81:0/2997994280 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa600b7c30 0x7ffa600cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa5e7fc640 1 --2- 172.21.15.81:0/2997994280 >> v2:172.21.15.102:3300/0 conn(0x7ffa600b4a50 0x7ffa600cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa5f7fe640 1 -- 172.21.15.81:0/2997994280 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa600b7c30 msgr2=0x7ffa600cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:28.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa5f7fe640 1 --2- 172.21.15.81:0/2997994280 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa600b7c30 0x7ffa600cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa5f7fe640 1 -- 172.21.15.81:0/2997994280 >> v2:172.21.15.102:3300/0 conn(0x7ffa600b4a50 msgr2=0x7ffa600cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:28.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa5f7fe640 1 --2- 172.21.15.81:0/2997994280 >> v2:172.21.15.102:3300/0 conn(0x7ffa600b4a50 0x7ffa600cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.666+0000 7ffa5f7fe640 1 -- 172.21.15.81:0/2997994280 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa600b35d0 con 0x7ffa600cd340 2024-09-16T01:17:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.667+0000 7ffa5f7fe640 1 --2- 172.21.15.81:0/2997994280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa600cd340 0x7ffa6009aa30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffa60073cc0 tx=0x7ffa5802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9ca1d3d819b403 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.667+0000 7ffa5dffb640 1 -- 172.21.15.81:0/2997994280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58037070 con 0x7ffa600cd340 2024-09-16T01:17:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.667+0000 7ffa5dffb640 1 -- 172.21.15.81:0/2997994280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa58032440 con 0x7ffa600cd340 2024-09-16T01:17:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.667+0000 7ffa5dffb640 1 -- 172.21.15.81:0/2997994280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa58032810 con 0x7ffa600cd340 2024-09-16T01:17:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.668+0000 7ffa656af640 1 -- 172.21.15.81:0/2997994280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa600cd340 msgr2=0x7ffa6009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.668+0000 7ffa656af640 1 --2- 172.21.15.81:0/2997994280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa600cd340 0x7ffa6009aa30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffa60073cc0 tx=0x7ffa5802a140 comp rx=0 tx=0).stop 2024-09-16T01:17:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.668+0000 7ffa656af640 1 -- 172.21.15.81:0/2997994280 shutdown_connections 2024-09-16T01:17:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.668+0000 7ffa656af640 1 --2- 172.21.15.81:0/2997994280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa600cd340 0x7ffa6009aa30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.668+0000 7ffa656af640 1 --2- 172.21.15.81:0/2997994280 >> v2:172.21.15.102:3300/0 conn(0x7ffa600b4a50 0x7ffa600cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.668+0000 7ffa656af640 1 --2- 172.21.15.81:0/2997994280 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa600b7c30 0x7ffa600cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.668+0000 7ffa656af640 1 -- 172.21.15.81:0/2997994280 >> 172.21.15.81:0/2997994280 conn(0x7ffa600b3de0 msgr2=0x7ffa600b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.668+0000 7ffa656af640 1 -- 172.21.15.81:0/2997994280 shutdown_connections 2024-09-16T01:17:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.668+0000 7ffa656af640 1 -- 172.21.15.81:0/2997994280 wait complete. 2024-09-16T01:17:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.669+0000 7ffa656af640 1 Processor -- start 2024-09-16T01:17:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.669+0000 7ffa656af640 1 -- start start 2024-09-16T01:17:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa656af640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa600b4a50 0x7ffa600cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa656af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa600b7c30 0x7ffa600c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa656af640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa600cd340 0x7ffa6014e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa656af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffa600d0580 con 0x7ffa600b7c30 2024-09-16T01:17:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa656af640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffa600d0400 con 0x7ffa600cd340 2024-09-16T01:17:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa656af640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffa600b8010 con 0x7ffa600b4a50 2024-09-16T01:17:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa5e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa600b7c30 0x7ffa600c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa5e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa600b7c30 0x7ffa600c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46584/0 (socket says 172.21.15.81:46584) 2024-09-16T01:17:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa5e7fc640 1 -- 172.21.15.81:0/3412414667 learned_addr learned my addr 172.21.15.81:0/3412414667 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa5effd640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa600b4a50 0x7ffa600cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa5f7fe640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa600cd340 0x7ffa6014e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa5e7fc640 1 -- 172.21.15.81:0/3412414667 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa600b4a50 msgr2=0x7ffa600cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa5e7fc640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa600b4a50 0x7ffa600cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa5e7fc640 1 -- 172.21.15.81:0/3412414667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa600cd340 msgr2=0x7ffa6014e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa5e7fc640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa600cd340 0x7ffa6014e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa5e7fc640 1 -- 172.21.15.81:0/3412414667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa600ca390 con 0x7ffa600b7c30 2024-09-16T01:17:28.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa5e7fc640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa600b7c30 0x7ffa600c9c30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400e840 tx=0x7ffa5400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:28.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa477fe640 1 -- 172.21.15.81:0/3412414667 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54017070 con 0x7ffa600b7c30 2024-09-16T01:17:28.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.670+0000 7ffa477fe640 1 -- 172.21.15.81:0/3412414667 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5400c940 con 0x7ffa600b7c30 2024-09-16T01:17:28.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.671+0000 7ffa656af640 1 -- 172.21.15.81:0/3412414667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa600ca670 con 0x7ffa600b7c30 2024-09-16T01:17:28.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.671+0000 7ffa477fe640 1 -- 172.21.15.81:0/3412414667 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400cd10 con 0x7ffa600b7c30 2024-09-16T01:17:28.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.671+0000 7ffa656af640 1 -- 172.21.15.81:0/3412414667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa600cac30 con 0x7ffa600b7c30 2024-09-16T01:17:28.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.672+0000 7ffa656af640 1 -- 172.21.15.81:0/3412414667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa600ce8c0 con 0x7ffa600b7c30 2024-09-16T01:17:28.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.672+0000 7ffa477fe640 1 -- 172.21.15.81:0/3412414667 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffa5401a070 con 0x7ffa600b7c30 2024-09-16T01:17:28.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.672+0000 7ffa477fe640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffa4c06c2b0 0x7ffa4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.673+0000 7ffa477fe640 1 -- 172.21.15.81:0/3412414667 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7ffa5408b430 con 0x7ffa600b7c30 2024-09-16T01:17:28.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.673+0000 7ffa5effd640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffa4c06c2b0 0x7ffa4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.673+0000 7ffa5effd640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffa4c06c2b0 0x7ffa4c06e770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffa500073f0 tx=0x7ffa5000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:28.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.677+0000 7ffa477fe640 1 -- 172.21.15.81:0/3412414667 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa600ce8c0 con 0x7ffa600b7c30 2024-09-16T01:17:28.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.843+0000 7ffa656af640 1 -- 172.21.15.81:0/3412414667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_session_cap_acquisition_throttle"} v 0) -- 0x7ffa600cd7d0 con 0x7ffa600b7c30 2024-09-16T01:17:28.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.846+0000 7ffa477fe640 1 -- 172.21.15.81:0/3412414667 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_session_cap_acquisition_throttle"}]=0 v14) ==== 119+0+0 (secure 0 0 0) 0x7ffa54059da0 con 0x7ffa600b7c30 2024-09-16T01:17:28.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.848+0000 7ffa656af640 1 -- 172.21.15.81:0/3412414667 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffa4c06c2b0 msgr2=0x7ffa4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.848+0000 7ffa656af640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffa4c06c2b0 0x7ffa4c06e770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffa500073f0 tx=0x7ffa5000b040 comp rx=0 tx=0).stop 2024-09-16T01:17:28.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.848+0000 7ffa656af640 1 -- 172.21.15.81:0/3412414667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa600b7c30 msgr2=0x7ffa600c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.848+0000 7ffa656af640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa600b7c30 0x7ffa600c9c30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400e840 tx=0x7ffa5400ed00 comp rx=0 tx=0).stop 2024-09-16T01:17:28.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.848+0000 7ffa656af640 1 -- 172.21.15.81:0/3412414667 shutdown_connections 2024-09-16T01:17:28.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.848+0000 7ffa656af640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffa4c06c2b0 0x7ffa4c06e770 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.848+0000 7ffa656af640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa600cd340 0x7ffa6014e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.848+0000 7ffa656af640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa600b7c30 0x7ffa600c9c30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.848+0000 7ffa656af640 1 --2- 172.21.15.81:0/3412414667 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa600b4a50 0x7ffa600cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.848+0000 7ffa656af640 1 -- 172.21.15.81:0/3412414667 >> 172.21.15.81:0/3412414667 conn(0x7ffa600b3de0 msgr2=0x7ffa600b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:28.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.848+0000 7ffa656af640 1 -- 172.21.15.81:0/3412414667 shutdown_connections 2024-09-16T01:17:28.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.848+0000 7ffa656af640 1 -- 172.21.15.81:0/3412414667 wait complete. 2024-09-16T01:17:28.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_max_caps_per_client 2024-09-16T01:17:28.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.963+0000 7fd7a3f42640 1 Processor -- start 2024-09-16T01:17:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.963+0000 7fd7a3f42640 1 -- start start 2024-09-16T01:17:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.964+0000 7fd7a3f42640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd79c0ad2c0 0x7fd79c0ae350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.964+0000 7fd7a3f42640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd79c0ae980 con 0x7fd79c15e690 2024-09-16T01:17:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.964+0000 7fd7a3f42640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd79c0d0dd0 con 0x7fd79c0b16a0 2024-09-16T01:17:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.964+0000 7fd7a3f42640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd79c0aec60 con 0x7fd79c0ad2c0 2024-09-16T01:17:28.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.965+0000 7fd7a1cde640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd79c15e690 0x7fd79c0adc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46698/0 (socket says 172.21.15.81:46698) 2024-09-16T01:17:28.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.966+0000 7fd7a1cde640 1 -- 172.21.15.81:0/512502269 learned_addr learned my addr 172.21.15.81:0/512502269 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:28.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.966+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231160098 0 0) 0x7fd79c0ae980 con 0x7fd79c15e690 2024-09-16T01:17:28.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.966+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd788003520 con 0x7fd79c15e690 2024-09-16T01:17:28.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.967+0000 7fd7a14dd640 1 --2- 172.21.15.81:0/512502269 >> v2:172.21.15.102:3300/0 conn(0x7fd79c0ad2c0 0x7fd79c0ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.967+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 564289754 0 0) 0x7fd788003520 con 0x7fd79c15e690 2024-09-16T01:17:28.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.967+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 >> v2:172.21.15.102:3300/0 conn(0x7fd79c0ad2c0 msgr2=0x7fd79c0ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:28.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.967+0000 7fd7a0cdc640 1 --2- 172.21.15.81:0/512502269 >> v2:172.21.15.102:3300/0 conn(0x7fd79c0ad2c0 0x7fd79c0ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.967+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 >> v1:172.21.15.102:6789/0 conn(0x7fd79c0b16a0 legacy=0x7fd79c0b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.967+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c15ea70 con 0x7fd79c15e690 2024-09-16T01:17:28.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.967+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fd798001670 con 0x7fd79c15e690 2024-09-16T01:17:28.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.968+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 >> v1:172.21.15.81:6789/0 conn(0x7fd79c15e690 legacy=0x7fd79c0adc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.968+0000 7fd7a0cdc640 1 --2- 172.21.15.81:0/512502269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 0x7fd788003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.968+0000 7fd7a1cde640 1 --2- 172.21.15.81:0/512502269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 0x7fd788003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.968+0000 7fd7a0cdc640 1 --2- 172.21.15.81:0/512502269 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd788004800 0x7fd788004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.968+0000 7fd7a0cdc640 1 --2- 172.21.15.81:0/512502269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7880052e0 0x7fd78800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.968+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c0aec60 con 0x7fd788003a00 2024-09-16T01:17:28.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.968+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd78800c1b0 con 0x7fd7880052e0 2024-09-16T01:17:28.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.968+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd78800c3b0 con 0x7fd788004800 2024-09-16T01:17:28.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.969+0000 7fd7a1cde640 1 -- 172.21.15.81:0/512502269 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd788004800 msgr2=0x7fd788004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-16T01:17:28.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.969+0000 7fd7a1cde640 1 --2- 172.21.15.81:0/512502269 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd788004800 0x7fd788004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.969+0000 7fd7a1cde640 1 -- 172.21.15.81:0/512502269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7880052e0 msgr2=0x7fd78800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:28.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.969+0000 7fd7a1cde640 1 --2- 172.21.15.81:0/512502269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd7880052e0 0x7fd78800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.969+0000 7fd7a1cde640 1 -- 172.21.15.81:0/512502269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd788003520 con 0x7fd788003a00 2024-09-16T01:17:28.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.969+0000 7fd7a24df640 1 -- 172.21.15.81:0/512502269 reap_dead start 2024-09-16T01:17:28.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.970+0000 7fd7a1cde640 1 --2- 172.21.15.81:0/512502269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 0x7fd788003de0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd798004f80 tx=0x7fd788005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12542ded5fd6239b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:28.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.971+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798004ba0 con 0x7fd788003a00 2024-09-16T01:17:28.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.971+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd79802f030 con 0x7fd788003a00 2024-09-16T01:17:28.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.971+0000 7fd7a0cdc640 1 -- 172.21.15.81:0/512502269 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798005cd0 con 0x7fd788003a00 2024-09-16T01:17:28.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.972+0000 7fd7a3f42640 1 -- 172.21.15.81:0/512502269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 msgr2=0x7fd788003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.972+0000 7fd7a3f42640 1 --2- 172.21.15.81:0/512502269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 0x7fd788003de0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd798004f80 tx=0x7fd788005830 comp rx=0 tx=0).stop 2024-09-16T01:17:28.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.973+0000 7fd7a3f42640 1 -- 172.21.15.81:0/512502269 shutdown_connections 2024-09-16T01:17:28.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.973+0000 7fd7a3f42640 1 --2- 172.21.15.81:0/512502269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 0x7fd788003de0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.973+0000 7fd7a3f42640 1 -- 172.21.15.81:0/512502269 >> 172.21.15.81:0/512502269 conn(0x7fd79c0d0130 msgr2=0x7fd79c0d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.973+0000 7fd7a3f42640 1 -- 172.21.15.81:0/512502269 shutdown_connections 2024-09-16T01:17:28.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.973+0000 7fd7a3f42640 1 -- 172.21.15.81:0/512502269 wait complete. 2024-09-16T01:17:28.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.974+0000 7fd7a3f42640 1 Processor -- start 2024-09-16T01:17:28.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.974+0000 7fd7a3f42640 1 -- start start 2024-09-16T01:17:28.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.975+0000 7fd7a3f42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 0x7fd79c14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.975+0000 7fd7a3f42640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd79c15fdb0 0x7fd79c0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.975+0000 7fd7a3f42640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd79c152780 0x7fd79c154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.975+0000 7fd7a3f42640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c0ad870 con 0x7fd788003a00 2024-09-16T01:17:28.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.975+0000 7fd7a3f42640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd79c0ad6f0 con 0x7fd79c15fdb0 2024-09-16T01:17:28.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.975+0000 7fd7a3f42640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd79c0ad9f0 con 0x7fd79c152780 2024-09-16T01:17:28.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.975+0000 7fd7a1cde640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 0x7fd79c14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.975+0000 7fd7a1cde640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 0x7fd79c14fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46598/0 (socket says 172.21.15.81:46598) 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.975+0000 7fd7a1cde640 1 -- 172.21.15.81:0/3921294390 learned_addr learned my addr 172.21.15.81:0/3921294390 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.975+0000 7fd7a14dd640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd79c15fdb0 0x7fd79c0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.975+0000 7fd7a24df640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd79c152780 0x7fd79c154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.976+0000 7fd7a1cde640 1 -- 172.21.15.81:0/3921294390 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd79c152780 msgr2=0x7fd79c154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.976+0000 7fd7a1cde640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd79c152780 0x7fd79c154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.976+0000 7fd7a1cde640 1 -- 172.21.15.81:0/3921294390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd79c15fdb0 msgr2=0x7fd79c0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.976+0000 7fd7a1cde640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd79c15fdb0 0x7fd79c0b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.976+0000 7fd7a1cde640 1 -- 172.21.15.81:0/3921294390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79c160300 con 0x7fd788003a00 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.976+0000 7fd7a1cde640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 0x7fd79c14fb80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd798005070 tx=0x7fd79802d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.976+0000 7fd7927fc640 1 -- 172.21.15.81:0/3921294390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798039030 con 0x7fd788003a00 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.976+0000 7fd7927fc640 1 -- 172.21.15.81:0/3921294390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7980058b0 con 0x7fd788003a00 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.976+0000 7fd7a3f42640 1 -- 172.21.15.81:0/3921294390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79c160650 con 0x7fd788003a00 2024-09-16T01:17:28.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.976+0000 7fd7927fc640 1 -- 172.21.15.81:0/3921294390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd798005ca0 con 0x7fd788003a00 2024-09-16T01:17:28.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.976+0000 7fd7a3f42640 1 -- 172.21.15.81:0/3921294390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd79c160c10 con 0x7fd788003a00 2024-09-16T01:17:28.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.977+0000 7fd7a3f42640 1 -- 172.21.15.81:0/3921294390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd79c0adc40 con 0x7fd788003a00 2024-09-16T01:17:28.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.978+0000 7fd7927fc640 1 -- 172.21.15.81:0/3921294390 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd7980080f0 con 0x7fd788003a00 2024-09-16T01:17:28.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.978+0000 7fd7927fc640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd78006c2e0 0x7fd78006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:28.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.978+0000 7fd7927fc640 1 -- 172.21.15.81:0/3921294390 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7fd7980aaff0 con 0x7fd788003a00 2024-09-16T01:17:28.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.978+0000 7fd7a14dd640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd78006c2e0 0x7fd78006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:28.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.979+0000 7fd7a14dd640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd78006c2e0 0x7fd78006e7a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd78c006fd0 tx=0x7fd78c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:28.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:28.983+0000 7fd7927fc640 1 -- 172.21.15.81:0/3921294390 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd798047020 con 0x7fd788003a00 2024-09-16T01:17:29.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.151+0000 7fd7a3f42640 1 -- 172.21.15.81:0/3921294390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"} v 0) -- 0x7fd79c15c530 con 0x7fd788003a00 2024-09-16T01:17:29.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.154+0000 7fd7927fc640 1 -- 172.21.15.81:0/3921294390 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"}]=0 v15) ==== 106+0+0 (secure 0 0 0) 0x7fd798079280 con 0x7fd788003a00 2024-09-16T01:17:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.157+0000 7fd7a3f42640 1 -- 172.21.15.81:0/3921294390 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd78006c2e0 msgr2=0x7fd78006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.157+0000 7fd7a3f42640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd78006c2e0 0x7fd78006e7a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd78c006fd0 tx=0x7fd78c008040 comp rx=0 tx=0).stop 2024-09-16T01:17:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.157+0000 7fd7a3f42640 1 -- 172.21.15.81:0/3921294390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 msgr2=0x7fd79c14fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.157+0000 7fd7a3f42640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 0x7fd79c14fb80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd798005070 tx=0x7fd79802d070 comp rx=0 tx=0).stop 2024-09-16T01:17:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.157+0000 7fd7a3f42640 1 -- 172.21.15.81:0/3921294390 shutdown_connections 2024-09-16T01:17:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.157+0000 7fd7a3f42640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd78006c2e0 0x7fd78006e7a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.157+0000 7fd7a3f42640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd79c152780 0x7fd79c154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.157+0000 7fd7a3f42640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd79c15fdb0 0x7fd79c0b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.157+0000 7fd7a3f42640 1 --2- 172.21.15.81:0/3921294390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd788003a00 0x7fd79c14fb80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.157+0000 7fd7a3f42640 1 -- 172.21.15.81:0/3921294390 >> 172.21.15.81:0/3921294390 conn(0x7fd79c0d0130 msgr2=0x7fd79c15cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.157+0000 7fd7a3f42640 1 -- 172.21.15.81:0/3921294390 shutdown_connections 2024-09-16T01:17:29.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.157+0000 7fd7a3f42640 1 -- 172.21.15.81:0/3921294390 wait complete. 2024-09-16T01:17:29.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir' 2024-09-16T01:17:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.266+0000 7f37b8ec9640 1 Processor -- start 2024-09-16T01:17:29.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.266+0000 7f37b8ec9640 1 -- start start 2024-09-16T01:17:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.267+0000 7f37b8ec9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f37b40d1540 0x7f37b406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.267+0000 7f37b8ec9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b40d1970 con 0x7f37b415e740 2024-09-16T01:17:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.267+0000 7f37b8ec9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b40d0780 con 0x7f37b409b690 2024-09-16T01:17:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.267+0000 7f37b8ec9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f37b415eb20 con 0x7f37b40d1540 2024-09-16T01:17:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.267+0000 7f37b259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f37b415e740 0x7f37b406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46706/0 (socket says 172.21.15.81:46706) 2024-09-16T01:17:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.267+0000 7f37b259c640 1 -- 172.21.15.81:0/1460864907 learned_addr learned my addr 172.21.15.81:0/1460864907 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.267+0000 7f37b1d9b640 1 --2- 172.21.15.81:0/1460864907 >> v2:172.21.15.102:3300/0 conn(0x7f37b40d1540 0x7f37b406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.267+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719963601 0 0) 0x7f37b40d1970 con 0x7f37b415e740 2024-09-16T01:17:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.267+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f379c003520 con 0x7f37b415e740 2024-09-16T01:17:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 248948331 0 0) 0x7f379c003520 con 0x7f37b415e740 2024-09-16T01:17:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 >> v2:172.21.15.102:3300/0 conn(0x7f37b40d1540 msgr2=0x7f37b406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 --2- 172.21.15.81:0/1460864907 >> v2:172.21.15.102:3300/0 conn(0x7f37b40d1540 0x7f37b406dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 >> v1:172.21.15.102:6789/0 conn(0x7f37b409b690 legacy=0x7f37b4070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b40d0a60 con 0x7f37b415e740 2024-09-16T01:17:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f37a4001670 con 0x7f37b415e740 2024-09-16T01:17:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 >> v1:172.21.15.81:6789/0 conn(0x7f37b415e740 legacy=0x7f37b406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 --2- 172.21.15.81:0/1460864907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f379c0039b0 0x7f379c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 --2- 172.21.15.81:0/1460864907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f379c004800 0x7f379c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 --2- 172.21.15.81:0/1460864907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f379c0051c0 0x7f379c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37b415eb20 con 0x7f379c0051c0 2024-09-16T01:17:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f379c00c070 con 0x7f379c004800 2024-09-16T01:17:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f379c00c270 con 0x7f379c0039b0 2024-09-16T01:17:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b2d9d640 1 --2- 172.21.15.81:0/1460864907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f379c0051c0 0x7f379c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b1d9b640 1 --2- 172.21.15.81:0/1460864907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f379c004800 0x7f379c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b259c640 1 --2- 172.21.15.81:0/1460864907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f379c0039b0 0x7f379c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b2d9d640 1 -- 172.21.15.81:0/1460864907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f379c0039b0 msgr2=0x7f379c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b2d9d640 1 --2- 172.21.15.81:0/1460864907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f379c0039b0 0x7f379c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b2d9d640 1 -- 172.21.15.81:0/1460864907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f379c004800 msgr2=0x7f379c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b2d9d640 1 --2- 172.21.15.81:0/1460864907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f379c004800 0x7f379c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b2d9d640 1 -- 172.21.15.81:0/1460864907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379c003520 con 0x7f379c0051c0 2024-09-16T01:17:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.268+0000 7f37b259c640 1 --2- 172.21.15.81:0/1460864907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f379c0039b0 0x7f379c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.269+0000 7f37b2d9d640 1 -- 172.21.15.81:0/1460864907 reap_dead start 2024-09-16T01:17:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.269+0000 7f37b2d9d640 1 --2- 172.21.15.81:0/1460864907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f379c0051c0 0x7f379c00b9c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f37ac001e50 tx=0x7f379c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83856516c74c0e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.269+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac001a70 con 0x7f379c0051c0 2024-09-16T01:17:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.269+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ac003970 con 0x7f379c0051c0 2024-09-16T01:17:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.269+0000 7f37b159a640 1 -- 172.21.15.81:0/1460864907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac003d60 con 0x7f379c0051c0 2024-09-16T01:17:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.270+0000 7f37b8ec9640 1 -- 172.21.15.81:0/1460864907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f379c0051c0 msgr2=0x7f379c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.270+0000 7f37b8ec9640 1 --2- 172.21.15.81:0/1460864907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f379c0051c0 0x7f379c00b9c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f37ac001e50 tx=0x7f379c005830 comp rx=0 tx=0).stop 2024-09-16T01:17:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.270+0000 7f37b8ec9640 1 -- 172.21.15.81:0/1460864907 shutdown_connections 2024-09-16T01:17:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.270+0000 7f37b8ec9640 1 --2- 172.21.15.81:0/1460864907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f379c0051c0 0x7f379c00b9c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.270+0000 7f37b8ec9640 1 -- 172.21.15.81:0/1460864907 >> 172.21.15.81:0/1460864907 conn(0x7f37b40d23a0 msgr2=0x7f37b40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.270+0000 7f37b8ec9640 1 -- 172.21.15.81:0/1460864907 shutdown_connections 2024-09-16T01:17:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.270+0000 7f37b8ec9640 1 -- 172.21.15.81:0/1460864907 wait complete. 2024-09-16T01:17:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.271+0000 7f37b8ec9640 1 Processor -- start 2024-09-16T01:17:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.271+0000 7f37b8ec9640 1 -- start start 2024-09-16T01:17:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b8ec9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f379c0051c0 0x7f37b414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b8ec9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37b40c5ed0 0x7f37b40c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b8ec9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b40c7e10 0x7f37b40c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b8ec9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37b409baa0 con 0x7f37b40c7e10 2024-09-16T01:17:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b8ec9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f37b40d1020 con 0x7f379c0051c0 2024-09-16T01:17:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b8ec9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f37b406cd20 con 0x7f37b40c5ed0 2024-09-16T01:17:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b40c7e10 0x7f37b40c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b40c7e10 0x7f37b40c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46612/0 (socket says 172.21.15.81:46612) 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b2d9d640 1 -- 172.21.15.81:0/913740792 learned_addr learned my addr 172.21.15.81:0/913740792 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b259c640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f379c0051c0 0x7f37b414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b1d9b640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37b40c5ed0 0x7f37b40c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b2d9d640 1 -- 172.21.15.81:0/913740792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37b40c5ed0 msgr2=0x7f37b40c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b2d9d640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37b40c5ed0 0x7f37b40c6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b2d9d640 1 -- 172.21.15.81:0/913740792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f379c0051c0 msgr2=0x7f37b414c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b2d9d640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f379c0051c0 0x7f37b414c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b2d9d640 1 -- 172.21.15.81:0/913740792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b40c8a10 con 0x7f37b40c7e10 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37b2d9d640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b40c7e10 0x7f37b40c8290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f37ac001f40 tx=0x7f37ac0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37a2ffd640 1 -- 172.21.15.81:0/913740792 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac001a70 con 0x7f37b40c7e10 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.272+0000 7f37a2ffd640 1 -- 172.21.15.81:0/913740792 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ac02ac70 con 0x7f37b40c7e10 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.273+0000 7f37a2ffd640 1 -- 172.21.15.81:0/913740792 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac006d90 con 0x7f37b40c7e10 2024-09-16T01:17:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.273+0000 7f37b8ec9640 1 -- 172.21.15.81:0/913740792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b40c8cf0 con 0x7f37b40c7e10 2024-09-16T01:17:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.273+0000 7f37b8ec9640 1 -- 172.21.15.81:0/913740792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b4159d90 con 0x7f37b40c7e10 2024-09-16T01:17:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.273+0000 7f37b8ec9640 1 -- 172.21.15.81:0/913740792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b40b57e0 con 0x7f37b40c7e10 2024-09-16T01:17:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.274+0000 7f37a2ffd640 1 -- 172.21.15.81:0/913740792 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f37ac007030 con 0x7f37b40c7e10 2024-09-16T01:17:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.274+0000 7f37a2ffd640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f379406c2e0 0x7f379406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.274+0000 7f37a2ffd640 1 -- 172.21.15.81:0/913740792 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f37ac0aaba0 con 0x7f37b40c7e10 2024-09-16T01:17:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.274+0000 7f37b259c640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f379406c2e0 0x7f379406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.275+0000 7f37b259c640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f379406c2e0 0x7f379406e7a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f37a4000f60 tx=0x7f37a4001150 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:29.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.278+0000 7f37a2ffd640 1 -- 172.21.15.81:0/913740792 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37b40b57e0 con 0x7f37b40c7e10 2024-09-16T01:17:29.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:29.505+0000 7f37b8ec9640 1 -- 172.21.15.81:0/913740792 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]} v 0) -- 0x7f37b406d050 con 0x7f37b40c7e10 2024-09-16T01:17:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.254+0000 7f37a2ffd640 1 -- 172.21.15.81:0/913740792 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]}]=0 v110) ==== 165+0+0 (secure 0 0 0) 0x7f37ac043060 con 0x7f37b40c7e10 2024-09-16T01:17:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.257+0000 7f37b8ec9640 1 -- 172.21.15.81:0/913740792 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f379406c2e0 msgr2=0x7f379406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.257+0000 7f37b8ec9640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f379406c2e0 0x7f379406e7a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f37a4000f60 tx=0x7f37a4001150 comp rx=0 tx=0).stop 2024-09-16T01:17:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.257+0000 7f37b8ec9640 1 -- 172.21.15.81:0/913740792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b40c7e10 msgr2=0x7f37b40c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.257+0000 7f37b8ec9640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b40c7e10 0x7f37b40c8290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f37ac001f40 tx=0x7f37ac0014a0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.257+0000 7f37b8ec9640 1 -- 172.21.15.81:0/913740792 shutdown_connections 2024-09-16T01:17:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.257+0000 7f37b8ec9640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f379406c2e0 0x7f379406e7a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.257+0000 7f37b8ec9640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37b40c7e10 0x7f37b40c8290 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.257+0000 7f37b8ec9640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37b40c5ed0 0x7f37b40c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.257+0000 7f37b8ec9640 1 --2- 172.21.15.81:0/913740792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f379c0051c0 0x7f37b414c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.257+0000 7f37b8ec9640 1 -- 172.21.15.81:0/913740792 >> 172.21.15.81:0/913740792 conn(0x7f37b40d23a0 msgr2=0x7f37b4070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.257+0000 7f37b8ec9640 1 -- 172.21.15.81:0/913740792 shutdown_connections 2024-09-16T01:17:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.257+0000 7f37b8ec9640 1 -- 172.21.15.81:0/913740792 wait complete. 2024-09-16T01:17:30.272 INFO:tasks.cephfs_test_runner:Mostly readdir acquires caps faster than the mds recalls, so the cap ... ok 2024-09-16T01:17:30.272 INFO:tasks.cephfs_test_runner:Starting test: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) that a client is blocklisted when its encoded session metadata exceeds the 2024-09-16T01:17:30.272 INFO:tasks.cephfs_test_runner:test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-16T01:17:30.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:17:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.373+0000 7f2844074640 1 Processor -- start 2024-09-16T01:17:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.373+0000 7f2844074640 1 -- start start 2024-09-16T01:17:30.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.374+0000 7f2844074640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f283c15e740 0x7f283c0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.374+0000 7f2844074640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f283c09b690 0x7f283c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.374+0000 7f2844074640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f283c06e020 con 0x7f283c06d4c0 2024-09-16T01:17:30.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.374+0000 7f2844074640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f283c15eb20 con 0x7f283c09b690 2024-09-16T01:17:30.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.374+0000 7f2844074640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f283c06d260 con 0x7f283c15e740 2024-09-16T01:17:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.374+0000 7f284160f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f283c09b690 0x7f283c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.374+0000 7f284160f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f283c09b690 0x7f283c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46620/0 (socket says 172.21.15.81:46620) 2024-09-16T01:17:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.374+0000 7f284160f640 1 -- 172.21.15.81:0/981323003 learned_addr learned my addr 172.21.15.81:0/981323003 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.375+0000 7f2841e10640 1 --2- 172.21.15.81:0/981323003 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f283c15e740 0x7f283c0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.375+0000 7f284160f640 1 -- 172.21.15.81:0/981323003 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f283c15e740 msgr2=0x7f283c0d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.375+0000 7f284160f640 1 --2- 172.21.15.81:0/981323003 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f283c15e740 0x7f283c0d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.375+0000 7f284160f640 1 -- 172.21.15.81:0/981323003 >> v1:172.21.15.102:6789/0 conn(0x7f283c06d4c0 legacy=0x7f283c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.375+0000 7f284160f640 1 -- 172.21.15.81:0/981323003 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283c0d0780 con 0x7f283c09b690 2024-09-16T01:17:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.375+0000 7f2841e10640 1 --2- 172.21.15.81:0/981323003 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f283c15e740 0x7f283c0d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.375+0000 7f284160f640 1 --2- 172.21.15.81:0/981323003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c09b690 0x7f283c06cd20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f28300098a0 tx=0x7f283002a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a63b831c8154196 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:30.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.376+0000 7f2840e0e640 1 -- 172.21.15.81:0/981323003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2830037070 con 0x7f283c09b690 2024-09-16T01:17:30.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.376+0000 7f2840e0e640 1 -- 172.21.15.81:0/981323003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2830032440 con 0x7f283c09b690 2024-09-16T01:17:30.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.376+0000 7f2840e0e640 1 -- 172.21.15.81:0/981323003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2830032810 con 0x7f283c09b690 2024-09-16T01:17:30.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.376+0000 7f2844074640 1 -- 172.21.15.81:0/981323003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c09b690 msgr2=0x7f283c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.376+0000 7f2844074640 1 --2- 172.21.15.81:0/981323003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c09b690 0x7f283c06cd20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f28300098a0 tx=0x7f283002a2e0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.376+0000 7f2844074640 1 -- 172.21.15.81:0/981323003 shutdown_connections 2024-09-16T01:17:30.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.376+0000 7f2844074640 1 --2- 172.21.15.81:0/981323003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c09b690 0x7f283c06cd20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.376+0000 7f2844074640 1 --2- 172.21.15.81:0/981323003 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f283c15e740 0x7f283c0d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.376+0000 7f2844074640 1 -- 172.21.15.81:0/981323003 >> 172.21.15.81:0/981323003 conn(0x7f283c0d23a0 msgr2=0x7f283c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:30.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.376+0000 7f2844074640 1 -- 172.21.15.81:0/981323003 shutdown_connections 2024-09-16T01:17:30.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.376+0000 7f2844074640 1 -- 172.21.15.81:0/981323003 wait complete. 2024-09-16T01:17:30.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.377+0000 7f2844074640 1 Processor -- start 2024-09-16T01:17:30.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.377+0000 7f2844074640 1 -- start start 2024-09-16T01:17:30.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.378+0000 7f2844074640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c06d4c0 0x7f283c0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.378+0000 7f2844074640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f283c09b690 0x7f283c0cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.378+0000 7f2844074640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f283c15e740 0x7f283c0c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.378+0000 7f2844074640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f283c0d1020 con 0x7f283c06d4c0 2024-09-16T01:17:30.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.378+0000 7f2844074640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f283c0d0d40 con 0x7f283c09b690 2024-09-16T01:17:30.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.378+0000 7f2844074640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f283c09ba90 con 0x7f283c15e740 2024-09-16T01:17:30.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.378+0000 7f2841e10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c06d4c0 0x7f283c0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.378+0000 7f2841e10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c06d4c0 0x7f283c0cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46628/0 (socket says 172.21.15.81:46628) 2024-09-16T01:17:30.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.378+0000 7f2841e10640 1 -- 172.21.15.81:0/699179071 learned_addr learned my addr 172.21.15.81:0/699179071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:30.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.378+0000 7f284160f640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f283c09b690 0x7f283c0cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.378+0000 7f2842611640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f283c15e740 0x7f283c0c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.379+0000 7f2841e10640 1 -- 172.21.15.81:0/699179071 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f283c15e740 msgr2=0x7f283c0c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.379+0000 7f2841e10640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f283c15e740 0x7f283c0c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.379+0000 7f2841e10640 1 -- 172.21.15.81:0/699179071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f283c09b690 msgr2=0x7f283c0cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.379+0000 7f2841e10640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f283c09b690 0x7f283c0cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.379+0000 7f2841e10640 1 -- 172.21.15.81:0/699179071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283c0b7e00 con 0x7f283c06d4c0 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.379+0000 7f2841e10640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c06d4c0 0x7f283c0cbd70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f282c00c7f0 tx=0x7f282c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.379+0000 7f283a7fc640 1 -- 172.21.15.81:0/699179071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c015070 con 0x7f283c06d4c0 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.379+0000 7f283a7fc640 1 -- 172.21.15.81:0/699179071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c007a30 con 0x7f283c06d4c0 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.379+0000 7f2844074640 1 -- 172.21.15.81:0/699179071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283c0b80e0 con 0x7f283c06d4c0 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.379+0000 7f283a7fc640 1 -- 172.21.15.81:0/699179071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c007e00 con 0x7f283c06d4c0 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.379+0000 7f2844074640 1 -- 172.21.15.81:0/699179071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283c0c97f0 con 0x7f283c06d4c0 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.380+0000 7f2844074640 1 -- 172.21.15.81:0/699179071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f283c06cd20 con 0x7f283c06d4c0 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.380+0000 7f283a7fc640 1 -- 172.21.15.81:0/699179071 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f282c018070 con 0x7f283c06d4c0 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.381+0000 7f283a7fc640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f282806c2b0 0x7f282806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.381+0000 7f283a7fc640 1 -- 172.21.15.81:0/699179071 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f282c08b200 con 0x7f283c06d4c0 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.381+0000 7f284160f640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f282806c2b0 0x7f282806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.381+0000 7f284160f640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f282806c2b0 0x7f282806e770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2830034000 tx=0x7f283002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:30.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.385+0000 7f283a7fc640 1 -- 172.21.15.81:0/699179071 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f282c059490 con 0x7f283c06d4c0 2024-09-16T01:17:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.552+0000 7f2844074640 1 -- 172.21.15.81:0/699179071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f283c0d1cb0 con 0x7f283c06d4c0 2024-09-16T01:17:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.553+0000 7f283a7fc640 1 -- 172.21.15.81:0/699179071 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+13305 (secure 0 0 0) 0x7f282c05d790 con 0x7f283c06d4c0 2024-09-16T01:17:30.555 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:30.555 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":42,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:17:28.245552+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/3051272390":"2024-09-17T01:17:25.235985+0000","172.21.15.81:6835/3051272390":"2024-09-17T01:17:25.235985+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:17:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.555+0000 7f2844074640 1 -- 172.21.15.81:0/699179071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f282806c2b0 msgr2=0x7f282806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.555+0000 7f2844074640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f282806c2b0 0x7f282806e770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2830034000 tx=0x7f283002e000 comp rx=0 tx=0).stop 2024-09-16T01:17:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.555+0000 7f2844074640 1 -- 172.21.15.81:0/699179071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c06d4c0 msgr2=0x7f283c0cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.555+0000 7f2844074640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c06d4c0 0x7f283c0cbd70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f282c00c7f0 tx=0x7f282c00cbf0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.555+0000 7f2844074640 1 -- 172.21.15.81:0/699179071 shutdown_connections 2024-09-16T01:17:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.555+0000 7f2844074640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f282806c2b0 0x7f282806e770 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.555+0000 7f2844074640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f283c15e740 0x7f283c0c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.555+0000 7f2844074640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f283c09b690 0x7f283c0cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.555+0000 7f2844074640 1 --2- 172.21.15.81:0/699179071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c06d4c0 0x7f283c0cbd70 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.555+0000 7f2844074640 1 -- 172.21.15.81:0/699179071 >> 172.21.15.81:0/699179071 conn(0x7f283c0d23a0 msgr2=0x7f283c0d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.555+0000 7f2844074640 1 -- 172.21.15.81:0/699179071 shutdown_connections 2024-09-16T01:17:30.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.555+0000 7f2844074640 1 -- 172.21.15.81:0/699179071 wait complete. 2024-09-16T01:17:30.567 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:15:28.088452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:17:30.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:17:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.667+0000 7f5d1e653640 1 Processor -- start 2024-09-16T01:17:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.667+0000 7f5d1e653640 1 -- start start 2024-09-16T01:17:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.668+0000 7f5d1e653640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d180b5fe0 0x7f5d180aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.668+0000 7f5d1e653640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5d1806bc10 0x7f5d1806c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.668+0000 7f5d1e653640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d180ae240 con 0x7f5d1815e410 2024-09-16T01:17:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.668+0000 7f5d1e653640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5d180b6430 con 0x7f5d1806bc10 2024-09-16T01:17:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.668+0000 7f5d1e653640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1806c580 con 0x7f5d180b5fe0 2024-09-16T01:17:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.668+0000 7f5d1cbf0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5d1806bc10 0x7f5d1806c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.668+0000 7f5d1cbf0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5d1806bc10 0x7f5d1806c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46634/0 (socket says 172.21.15.81:46634) 2024-09-16T01:17:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.668+0000 7f5d1cbf0640 1 -- 172.21.15.81:0/4031085037 learned_addr learned my addr 172.21.15.81:0/4031085037 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.668+0000 7f5d17fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5d1815e410 0x7f5d180b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46720/0 (socket says 172.21.15.81:46720) 2024-09-16T01:17:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.669+0000 7f5d177fe640 1 --2- 172.21.15.81:0/4031085037 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d180b5fe0 0x7f5d180aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.669+0000 7f5d1cbf0640 1 -- 172.21.15.81:0/4031085037 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d180b5fe0 msgr2=0x7f5d180aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.669+0000 7f5d1cbf0640 1 --2- 172.21.15.81:0/4031085037 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d180b5fe0 0x7f5d180aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.669+0000 7f5d1cbf0640 1 -- 172.21.15.81:0/4031085037 >> v1:172.21.15.81:6789/0 conn(0x7f5d1815e410 legacy=0x7f5d180b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.669+0000 7f5d16ffd640 1 -- 172.21.15.81:0/4031085037 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1401577099 0 0) 0x7f5d180ae240 con 0x7f5d1815e410 2024-09-16T01:17:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.669+0000 7f5d1cbf0640 1 -- 172.21.15.81:0/4031085037 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d180ae520 con 0x7f5d1806bc10 2024-09-16T01:17:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.669+0000 7f5d177fe640 1 --2- 172.21.15.81:0/4031085037 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d180b5fe0 0x7f5d180aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.669+0000 7f5d1cbf0640 1 --2- 172.21.15.81:0/4031085037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d1806bc10 0x7f5d1806c040 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009e80 tx=0x7f5d1002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ab6220cac30389 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.669+0000 7f5d16ffd640 1 -- 172.21.15.81:0/4031085037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10036070 con 0x7f5d1806bc10 2024-09-16T01:17:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.670+0000 7f5d16ffd640 1 -- 172.21.15.81:0/4031085037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d10031600 con 0x7f5d1806bc10 2024-09-16T01:17:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.670+0000 7f5d16ffd640 1 -- 172.21.15.81:0/4031085037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d100319d0 con 0x7f5d1806bc10 2024-09-16T01:17:30.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.670+0000 7f5d1e653640 1 -- 172.21.15.81:0/4031085037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d1806bc10 msgr2=0x7f5d1806c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.670+0000 7f5d1e653640 1 --2- 172.21.15.81:0/4031085037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d1806bc10 0x7f5d1806c040 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009e80 tx=0x7f5d1002a6c0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.670+0000 7f5d1e653640 1 -- 172.21.15.81:0/4031085037 shutdown_connections 2024-09-16T01:17:30.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.670+0000 7f5d1e653640 1 --2- 172.21.15.81:0/4031085037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d1806bc10 0x7f5d1806c040 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.670+0000 7f5d1e653640 1 --2- 172.21.15.81:0/4031085037 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d180b5fe0 0x7f5d180aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.670+0000 7f5d1e653640 1 -- 172.21.15.81:0/4031085037 >> 172.21.15.81:0/4031085037 conn(0x7f5d1809aa30 msgr2=0x7f5d180b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:30.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.670+0000 7f5d1e653640 1 -- 172.21.15.81:0/4031085037 shutdown_connections 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.670+0000 7f5d1e653640 1 -- 172.21.15.81:0/4031085037 wait complete. 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.671+0000 7f5d1e653640 1 Processor -- start 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.672+0000 7f5d1e653640 1 -- start start 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.672+0000 7f5d1e653640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d1806bc10 0x7f5d181f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.672+0000 7f5d1e653640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d180b5fe0 0x7f5d181562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.672+0000 7f5d1e653640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d1815e410 0x7f5d181f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.672+0000 7f5d1e653640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d180b0480 con 0x7f5d180b5fe0 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.672+0000 7f5d1e653640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5d180aeae0 con 0x7f5d1806bc10 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.672+0000 7f5d1e653640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5d1815e7f0 con 0x7f5d1815e410 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.672+0000 7f5d177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d180b5fe0 0x7f5d181562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.672+0000 7f5d177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d180b5fe0 0x7f5d181562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46646/0 (socket says 172.21.15.81:46646) 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.672+0000 7f5d177fe640 1 -- 172.21.15.81:0/189574027 learned_addr learned my addr 172.21.15.81:0/189574027 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:30.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d17fff640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d1806bc10 0x7f5d181f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d177fe640 1 -- 172.21.15.81:0/189574027 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d1815e410 msgr2=0x7f5d181f7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d177fe640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d1815e410 0x7f5d181f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d177fe640 1 -- 172.21.15.81:0/189574027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d1806bc10 msgr2=0x7f5d181f4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d177fe640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d1806bc10 0x7f5d181f4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d177fe640 1 -- 172.21.15.81:0/189574027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d180cc280 con 0x7f5d180b5fe0 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d17fff640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d1806bc10 0x7f5d181f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d177fe640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d180b5fe0 0x7f5d181562a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00e7e0 tx=0x7f5d0c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d14ff9640 1 -- 172.21.15.81:0/189574027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c00f040 con 0x7f5d180b5fe0 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d14ff9640 1 -- 172.21.15.81:0/189574027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d0c004030 con 0x7f5d180b5fe0 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d1e653640 1 -- 172.21.15.81:0/189574027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d180cc560 con 0x7f5d180b5fe0 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d14ff9640 1 -- 172.21.15.81:0/189574027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c004400 con 0x7f5d180b5fe0 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.673+0000 7f5d1e653640 1 -- 172.21.15.81:0/189574027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d180ccb20 con 0x7f5d180b5fe0 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.674+0000 7f5d1e653640 1 -- 172.21.15.81:0/189574027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d181454b0 con 0x7f5d180b5fe0 2024-09-16T01:17:30.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.674+0000 7f5d14ff9640 1 -- 172.21.15.81:0/189574027 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5d0c00c6d0 con 0x7f5d180b5fe0 2024-09-16T01:17:30.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.675+0000 7f5d14ff9640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5d0406c2b0 0x7f5d0406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.675+0000 7f5d14ff9640 1 -- 172.21.15.81:0/189574027 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f5d0c08b0b0 con 0x7f5d180b5fe0 2024-09-16T01:17:30.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.675+0000 7f5d17fff640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5d0406c2b0 0x7f5d0406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.675+0000 7f5d17fff640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5d0406c2b0 0x7f5d0406e770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d08000f60 tx=0x7f5d08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:30.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.679+0000 7f5d14ff9640 1 -- 172.21.15.81:0/189574027 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d181454b0 con 0x7f5d180b5fe0 2024-09-16T01:17:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.845+0000 7f5d1e653640 1 -- 172.21.15.81:0/189574027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5d1806c040 con 0x7f5d180b5fe0 2024-09-16T01:17:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.845+0000 7f5d14ff9640 1 -- 172.21.15.81:0/189574027 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7f5d0c017020 con 0x7f5d180b5fe0 2024-09-16T01:17:30.847 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-16T01:17:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.847+0000 7f5d1e653640 1 -- 172.21.15.81:0/189574027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5d0406c2b0 msgr2=0x7f5d0406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.847+0000 7f5d1e653640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5d0406c2b0 0x7f5d0406e770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5d08000f60 tx=0x7f5d08009040 comp rx=0 tx=0).stop 2024-09-16T01:17:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.847+0000 7f5d1e653640 1 -- 172.21.15.81:0/189574027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d180b5fe0 msgr2=0x7f5d181562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.847+0000 7f5d1e653640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d180b5fe0 0x7f5d181562a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c00e7e0 tx=0x7f5d0c00eca0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.847+0000 7f5d1e653640 1 -- 172.21.15.81:0/189574027 shutdown_connections 2024-09-16T01:17:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.847+0000 7f5d1e653640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5d0406c2b0 0x7f5d0406e770 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.847+0000 7f5d1e653640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d1815e410 0x7f5d181f7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.847+0000 7f5d1e653640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d180b5fe0 0x7f5d181562a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.847+0000 7f5d1e653640 1 --2- 172.21.15.81:0/189574027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d1806bc10 0x7f5d181f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.847+0000 7f5d1e653640 1 -- 172.21.15.81:0/189574027 >> 172.21.15.81:0/189574027 conn(0x7f5d1809aa30 msgr2=0x7f5d18161170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.847+0000 7f5d1e653640 1 -- 172.21.15.81:0/189574027 shutdown_connections 2024-09-16T01:17:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.847+0000 7f5d1e653640 1 -- 172.21.15.81:0/189574027 wait complete. 2024-09-16T01:17:30.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid' 2024-09-16T01:17:30.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.955+0000 7f9832823640 1 Processor -- start 2024-09-16T01:17:30.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.955+0000 7f9832823640 1 -- start start 2024-09-16T01:17:30.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.956+0000 7f9832823640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f982c06f8d0 0x7f982c165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.956+0000 7f9832823640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c0cdbe0 con 0x7f982c15b300 2024-09-16T01:17:30.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.956+0000 7f9832823640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c0cd900 con 0x7f982c072d30 2024-09-16T01:17:30.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.956+0000 7f9832823640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f982c0728a0 con 0x7f982c06f8d0 2024-09-16T01:17:30.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.956+0000 7f9830dc0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f982c06f8d0 0x7f982c165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.956+0000 7f9830dc0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f982c06f8d0 0x7f982c165de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46648/0 (socket says 172.21.15.81:46648) 2024-09-16T01:17:30.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.956+0000 7f982bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f982c15b300 0x7f982c0cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46722/0 (socket says 172.21.15.81:46722) 2024-09-16T01:17:30.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.956+0000 7f9830dc0640 1 -- 172.21.15.81:0/1174749627 learned_addr learned my addr 172.21.15.81:0/1174749627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:30.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.956+0000 7f9830dc0640 1 -- 172.21.15.81:0/1174749627 >> v1:172.21.15.102:6789/0 conn(0x7f982c072d30 legacy=0x7f982c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.956+0000 7f9830dc0640 1 -- 172.21.15.81:0/1174749627 >> v1:172.21.15.81:6789/0 conn(0x7f982c15b300 legacy=0x7f982c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.956+0000 7f9830dc0640 1 -- 172.21.15.81:0/1174749627 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c072250 con 0x7f982c06f8d0 2024-09-16T01:17:30.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.957+0000 7f9830dc0640 1 --2- 172.21.15.81:0/1174749627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f982c06f8d0 0x7f982c165de0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f982400d150 tx=0x7f982402c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e65556e040938c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:30.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.957+0000 7f982affd640 1 -- 172.21.15.81:0/1174749627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9824038070 con 0x7f982c06f8d0 2024-09-16T01:17:30.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.957+0000 7f982affd640 1 -- 172.21.15.81:0/1174749627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9824009600 con 0x7f982c06f8d0 2024-09-16T01:17:30.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.957+0000 7f982affd640 1 -- 172.21.15.81:0/1174749627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98240099d0 con 0x7f982c06f8d0 2024-09-16T01:17:30.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.958+0000 7f9832823640 1 -- 172.21.15.81:0/1174749627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f982c06f8d0 msgr2=0x7f982c165de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.958+0000 7f9832823640 1 --2- 172.21.15.81:0/1174749627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f982c06f8d0 0x7f982c165de0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f982400d150 tx=0x7f982402c830 comp rx=0 tx=0).stop 2024-09-16T01:17:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.958+0000 7f9832823640 1 -- 172.21.15.81:0/1174749627 shutdown_connections 2024-09-16T01:17:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.958+0000 7f9832823640 1 --2- 172.21.15.81:0/1174749627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f982c06f8d0 0x7f982c165de0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.958+0000 7f9832823640 1 -- 172.21.15.81:0/1174749627 >> 172.21.15.81:0/1174749627 conn(0x7f982c067d70 msgr2=0x7f982c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.958+0000 7f9832823640 1 -- 172.21.15.81:0/1174749627 shutdown_connections 2024-09-16T01:17:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.958+0000 7f9832823640 1 -- 172.21.15.81:0/1174749627 wait complete. 2024-09-16T01:17:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.959+0000 7f9832823640 1 Processor -- start 2024-09-16T01:17:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.959+0000 7f9832823640 1 -- start start 2024-09-16T01:17:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f9832823640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f982c06f8d0 0x7f982c14ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f9832823640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f982c072d30 0x7f982c14f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f9832823640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f982c15b300 0x7f982c1547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f9832823640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0cffe0 con 0x7f982c072d30 2024-09-16T01:17:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f9832823640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f982c0cd5c0 con 0x7f982c06f8d0 2024-09-16T01:17:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f9832823640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f982c0d0160 con 0x7f982c15b300 2024-09-16T01:17:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f982b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f982c072d30 0x7f982c14f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f982b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f982c072d30 0x7f982c14f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46650/0 (socket says 172.21.15.81:46650) 2024-09-16T01:17:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f982b7fe640 1 -- 172.21.15.81:0/1256194008 learned_addr learned my addr 172.21.15.81:0/1256194008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f9830dc0640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f982c15b300 0x7f982c1547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f982bfff640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f982c06f8d0 0x7f982c14ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f982b7fe640 1 -- 172.21.15.81:0/1256194008 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f982c15b300 msgr2=0x7f982c1547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f982b7fe640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f982c15b300 0x7f982c1547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f982b7fe640 1 -- 172.21.15.81:0/1256194008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f982c06f8d0 msgr2=0x7f982c14ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f982b7fe640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f982c06f8d0 0x7f982c14ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f982b7fe640 1 -- 172.21.15.81:0/1256194008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c1555f0 con 0x7f982c072d30 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f982bfff640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f982c06f8d0 0x7f982c14ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f982b7fe640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f982c072d30 0x7f982c14f9b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f982000c400 tx=0x7f982000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.960+0000 7f9828ff9640 1 -- 172.21.15.81:0/1256194008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98200052d0 con 0x7f982c072d30 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.961+0000 7f9828ff9640 1 -- 172.21.15.81:0/1256194008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9820005490 con 0x7f982c072d30 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.961+0000 7f9828ff9640 1 -- 172.21.15.81:0/1256194008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820007260 con 0x7f982c072d30 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.961+0000 7f9832823640 1 -- 172.21.15.81:0/1256194008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c1568d0 con 0x7f982c072d30 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.961+0000 7f9832823640 1 -- 172.21.15.81:0/1256194008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c156e90 con 0x7f982c072d30 2024-09-16T01:17:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.962+0000 7f9832823640 1 -- 172.21.15.81:0/1256194008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982c150ea0 con 0x7f982c072d30 2024-09-16T01:17:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.962+0000 7f9828ff9640 1 -- 172.21.15.81:0/1256194008 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9820007400 con 0x7f982c072d30 2024-09-16T01:17:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.962+0000 7f9828ff9640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f981806c2b0 0x7f981806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.962+0000 7f9828ff9640 1 -- 172.21.15.81:0/1256194008 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f982008a6c0 con 0x7f982c072d30 2024-09-16T01:17:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.962+0000 7f982bfff640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f981806c2b0 0x7f981806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.963+0000 7f982bfff640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f981806c2b0 0x7f981806e770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f981c000f60 tx=0x7f981c007ce0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:30.967+0000 7f9828ff9640 1 -- 172.21.15.81:0/1256194008 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98200589e0 con 0x7f982c072d30 2024-09-16T01:17:31.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.194+0000 7f9832823640 1 -- 172.21.15.81:0/1256194008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]} v 0) -- 0x7f982c1545c0 con 0x7f982c072d30 2024-09-16T01:17:31.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.256+0000 7f9828ff9640 1 -- 172.21.15.81:0/1256194008 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]}]=0 v111) ==== 165+0+0 (secure 0 0 0) 0x7f982005cce0 con 0x7f982c072d30 2024-09-16T01:17:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.258+0000 7f9832823640 1 -- 172.21.15.81:0/1256194008 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f981806c2b0 msgr2=0x7f981806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.258+0000 7f9832823640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f981806c2b0 0x7f981806e770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f981c000f60 tx=0x7f981c007ce0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.258+0000 7f9832823640 1 -- 172.21.15.81:0/1256194008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f982c072d30 msgr2=0x7f982c14f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.258+0000 7f9832823640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f982c072d30 0x7f982c14f9b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f982000c400 tx=0x7f982000c8c0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.258+0000 7f9832823640 1 -- 172.21.15.81:0/1256194008 shutdown_connections 2024-09-16T01:17:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.258+0000 7f9832823640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f981806c2b0 0x7f981806e770 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.258+0000 7f9832823640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f982c15b300 0x7f982c1547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.258+0000 7f9832823640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f982c072d30 0x7f982c14f9b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.258+0000 7f9832823640 1 --2- 172.21.15.81:0/1256194008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f982c06f8d0 0x7f982c14ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.258+0000 7f9832823640 1 -- 172.21.15.81:0/1256194008 >> 172.21.15.81:0/1256194008 conn(0x7f982c067d70 msgr2=0x7f982c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:31.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.258+0000 7f9832823640 1 -- 172.21.15.81:0/1256194008 shutdown_connections 2024-09-16T01:17:31.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.258+0000 7f9832823640 1 -- 172.21.15.81:0/1256194008 wait complete. 2024-09-16T01:17:31.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T01:17:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.369+0000 7f9ecf966640 1 Processor -- start 2024-09-16T01:17:31.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.369+0000 7f9ecf966640 1 -- start start 2024-09-16T01:17:31.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.370+0000 7f9ecf966640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ec8145e50 0x7f9ec80b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.370+0000 7f9ecf966640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec806c320 0x7f9ec8165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.370+0000 7f9ecf966640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec815d8a0 con 0x7f9ec815d350 2024-09-16T01:17:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.370+0000 7f9ecf966640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9ec80b7230 con 0x7f9ec8145e50 2024-09-16T01:17:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.370+0000 7f9ecf966640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec80ae420 con 0x7f9ec806c320 2024-09-16T01:17:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.370+0000 7f9eccf01640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9ec815d350 0x7f9ec806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60384/0 (socket says 172.21.15.81:60384) 2024-09-16T01:17:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.370+0000 7f9eccf01640 1 -- 172.21.15.81:0/3351802029 learned_addr learned my addr 172.21.15.81:0/3351802029 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.370+0000 7f9ecd702640 1 --2- 172.21.15.81:0/3351802029 >> v2:172.21.15.102:3300/0 conn(0x7f9ec8145e50 0x7f9ec80b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.370+0000 7f9ecdf03640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec806c320 0x7f9ec8165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.370+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3271668104 0 0) 0x7f9ec815d8a0 con 0x7f9ec815d350 2024-09-16T01:17:31.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9eb4003520 con 0x7f9ec815d350 2024-09-16T01:17:31.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3972671107 0 0) 0x7f9eb4003520 con 0x7f9ec815d350 2024-09-16T01:17:31.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec806c320 msgr2=0x7f9ec8165ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:31.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec806c320 0x7f9ec8165ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 >> v2:172.21.15.102:3300/0 conn(0x7f9ec8145e50 msgr2=0x7f9ec80b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:31.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 --2- 172.21.15.81:0/3351802029 >> v2:172.21.15.102:3300/0 conn(0x7f9ec8145e50 0x7f9ec80b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec815dba0 con 0x7f9ec815d350 2024-09-16T01:17:31.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f9eb8001670 con 0x7f9ec815d350 2024-09-16T01:17:31.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 >> v1:172.21.15.81:6789/0 conn(0x7f9ec815d350 legacy=0x7f9ec806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9eb40039b0 0x7f9eb4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec806c320 0x7f9eb4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4004d40 0x7f9eb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec80b7230 con 0x7f9eb40039b0 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb400b9c0 con 0x7f9eb4004d40 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb400bb40 con 0x7f9ec806c320 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ecd702640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9eb40039b0 0x7f9eb4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9eccf01640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec806c320 0x7f9eb4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ecdf03640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4004d40 0x7f9eb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ecd702640 1 -- 172.21.15.81:0/3351802029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec806c320 msgr2=0x7f9eb4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ecd702640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec806c320 0x7f9eb4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ecd702640 1 -- 172.21.15.81:0/3351802029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4004d40 msgr2=0x7f9eb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ecd702640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4004d40 0x7f9eb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ecd702640 1 -- 172.21.15.81:0/3351802029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb4003520 con 0x7f9eb40039b0 2024-09-16T01:17:31.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.371+0000 7f9ecdf03640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb4004d40 0x7f9eb40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.372+0000 7f9ecd702640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9eb40039b0 0x7f9eb4003dd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009ac0 tx=0x7f9eb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e1fe5bfa7ff2fc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.372+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4036070 con 0x7f9eb40039b0 2024-09-16T01:17:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.372+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec4031400 con 0x7f9eb40039b0 2024-09-16T01:17:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.372+0000 7f9ebffff640 1 -- 172.21.15.81:0/3351802029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4009690 con 0x7f9eb40039b0 2024-09-16T01:17:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.373+0000 7f9ecf966640 1 -- 172.21.15.81:0/3351802029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9eb40039b0 msgr2=0x7f9eb4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.373+0000 7f9ecf966640 1 --2- 172.21.15.81:0/3351802029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9eb40039b0 0x7f9eb4003dd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009ac0 tx=0x7f9eb4005830 comp rx=0 tx=0).stop 2024-09-16T01:17:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.373+0000 7f9ecdf03640 1 -- 172.21.15.81:0/3351802029 reap_dead start 2024-09-16T01:17:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.373+0000 7f9ecf966640 1 -- 172.21.15.81:0/3351802029 shutdown_connections 2024-09-16T01:17:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.373+0000 7f9ecf966640 1 -- 172.21.15.81:0/3351802029 >> 172.21.15.81:0/3351802029 conn(0x7f9ec809aa30 msgr2=0x7f9ec80b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.373+0000 7f9ecf966640 1 -- 172.21.15.81:0/3351802029 shutdown_connections 2024-09-16T01:17:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.373+0000 7f9ecf966640 1 -- 172.21.15.81:0/3351802029 wait complete. 2024-09-16T01:17:31.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.374+0000 7f9ecf966640 1 Processor -- start 2024-09-16T01:17:31.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.374+0000 7f9ecf966640 1 -- start start 2024-09-16T01:17:31.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecf966640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb40039b0 0x7f9ec815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecf966640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec8159180 0x7f9ec8144d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecf966640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec80d0bf0 0x7f9ec80d1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecf966640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec815e160 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecf966640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec815e4d0 con 0x7f9eb40039b0 2024-09-16T01:17:31.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecf966640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec815f970 con 0x7f9ec8159180 2024-09-16T01:17:31.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecdf03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec80d0bf0 0x7f9ec80d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecdf03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec80d0bf0 0x7f9ec80d1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57540/0 (socket says 172.21.15.81:57540) 2024-09-16T01:17:31.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecdf03640 1 -- 172.21.15.81:0/2172541625 learned_addr learned my addr 172.21.15.81:0/2172541625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:31.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecdf03640 1 -- 172.21.15.81:0/2172541625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec8159180 msgr2=0x7f9ec8144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecd702640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb40039b0 0x7f9ec815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9eccf01640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec8159180 0x7f9ec8144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecdf03640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec8159180 0x7f9ec8144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecdf03640 1 -- 172.21.15.81:0/2172541625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb40039b0 msgr2=0x7f9ec815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecdf03640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb40039b0 0x7f9ec815ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecdf03640 1 -- 172.21.15.81:0/2172541625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec815b390 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecd702640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb40039b0 0x7f9ec815ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:31.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9eccf01640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec8159180 0x7f9ec8144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecdf03640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec80d0bf0 0x7f9ec80d1070 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80cd4f0 tx=0x7f9ec0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ebdffb640 1 -- 172.21.15.81:0/2172541625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec001a030 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ebdffb640 1 -- 172.21.15.81:0/2172541625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec0010d80 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ecf966640 1 -- 172.21.15.81:0/2172541625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec815b670 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.375+0000 7f9ebdffb640 1 -- 172.21.15.81:0/2172541625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0003bd0 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.376+0000 7f9ecf966640 1 -- 172.21.15.81:0/2172541625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec815bc30 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.376+0000 7f9ecf966640 1 -- 172.21.15.81:0/2172541625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec80b6cf0 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.377+0000 7f9ebdffb640 1 -- 172.21.15.81:0/2172541625 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9ec001d070 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.377+0000 7f9ebdffb640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9eac06c2b0 0x7f9eac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.378+0000 7f9ebdffb640 1 -- 172.21.15.81:0/2172541625 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f9ec008b8b0 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.378+0000 7f9ecd702640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9eac06c2b0 0x7f9eac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.378+0000 7f9ecd702640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9eac06c2b0 0x7f9eac06e770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4033000 tx=0x7f9ec4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:31.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.382+0000 7f9ebdffb640 1 -- 172.21.15.81:0/2172541625 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ec005a220 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.546+0000 7f9ecf966640 1 -- 172.21.15.81:0/2172541625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9ec8070760 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.549+0000 7f9ebdffb640 1 -- 172.21.15.81:0/2172541625 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f9ec0059b20 con 0x7f9ec80d0bf0 2024-09-16T01:17:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.551+0000 7f9ecf966640 1 -- 172.21.15.81:0/2172541625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9eac06c2b0 msgr2=0x7f9eac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.551+0000 7f9ecf966640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9eac06c2b0 0x7f9eac06e770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4033000 tx=0x7f9ec4008030 comp rx=0 tx=0).stop 2024-09-16T01:17:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.552+0000 7f9ecf966640 1 -- 172.21.15.81:0/2172541625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec80d0bf0 msgr2=0x7f9ec80d1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.552+0000 7f9ecf966640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec80d0bf0 0x7f9ec80d1070 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80cd4f0 tx=0x7f9ec0010590 comp rx=0 tx=0).stop 2024-09-16T01:17:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.552+0000 7f9ecf966640 1 -- 172.21.15.81:0/2172541625 shutdown_connections 2024-09-16T01:17:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.552+0000 7f9ecf966640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9eac06c2b0 0x7f9eac06e770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.552+0000 7f9ecf966640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ec80d0bf0 0x7f9ec80d1070 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.552+0000 7f9ecf966640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ec8159180 0x7f9ec8144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.552+0000 7f9ecf966640 1 --2- 172.21.15.81:0/2172541625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9eb40039b0 0x7f9ec815ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.552+0000 7f9ecf966640 1 -- 172.21.15.81:0/2172541625 >> 172.21.15.81:0/2172541625 conn(0x7f9ec809aa30 msgr2=0x7f9ec806ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.552+0000 7f9ecf966640 1 -- 172.21.15.81:0/2172541625 shutdown_connections 2024-09-16T01:17:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.552+0000 7f9ecf966640 1 -- 172.21.15.81:0/2172541625 wait complete. 2024-09-16T01:17:31.564 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:17:31.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:17:31.606 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:17:31.643 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:17:31.643 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:17:31.643 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:31.662 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:17:31.662 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:17:31.662 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:31.701 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:17:31.701 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:17:31.701 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:31.717 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:17:31.717 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:17:31.718 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:31.760 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:17:31.760 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T01:17:31.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.856+0000 7f17f9303640 1 Processor -- start 2024-09-16T01:17:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.856+0000 7f17f9303640 1 -- start start 2024-09-16T01:17:31.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f9303640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f415e760 0x7f17f406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f9303640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f40d2700 con 0x7f17f40cfcc0 2024-09-16T01:17:31.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f9303640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f40cedb0 con 0x7f17f40d4fd0 2024-09-16T01:17:31.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f9303640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f17f40cf090 con 0x7f17f415e760 2024-09-16T01:17:31.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f37fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f17f40cfcc0 0x7f17f40d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60388/0 (socket says 172.21.15.81:60388) 2024-09-16T01:17:31.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f37fe640 1 -- 172.21.15.81:0/3710981450 learned_addr learned my addr 172.21.15.81:0/3710981450 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:31.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 830105996 0 0) 0x7f17ec001490 con 0x7f17f40cfcc0 2024-09-16T01:17:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17e0003520 con 0x7f17f40cfcc0 2024-09-16T01:17:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f2ffd640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f415e760 0x7f17f406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2736561937 0 0) 0x7f17e0003520 con 0x7f17f40cfcc0 2024-09-16T01:17:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f415e760 msgr2=0x7f17f406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f27fc640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f415e760 0x7f17f406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.857+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 >> v1:172.21.15.102:6789/0 conn(0x7f17f40d4fd0 legacy=0x7f17f40cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f40b3c80 con 0x7f17f40cfcc0 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f17ec001be0 con 0x7f17f40cfcc0 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f2ffd640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f415e760 0x7f17f406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 >> v1:172.21.15.81:6789/0 conn(0x7f17f40cfcc0 legacy=0x7f17f40d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f27fc640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e00039e0 0x7f17e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f27fc640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f415e760 0x7f17e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f27fc640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17e0004d40 0x7f17e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40cf090 con 0x7f17e00039e0 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f17e000bb50 con 0x7f17e0004d40 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f17e000bd50 con 0x7f17f415e760 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f2ffd640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e00039e0 0x7f17e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f37fe640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17e0004d40 0x7f17e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17ebfff640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f415e760 0x7f17e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f2ffd640 1 -- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f415e760 msgr2=0x7f17e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f2ffd640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f415e760 0x7f17e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f2ffd640 1 -- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17e0004d40 msgr2=0x7f17e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f2ffd640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17e0004d40 0x7f17e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17f2ffd640 1 -- 172.21.15.81:0/3710981450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e0003520 con 0x7f17e00039e0 2024-09-16T01:17:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.858+0000 7f17ebfff640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f415e760 0x7f17e0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.859+0000 7f17f2ffd640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e00039e0 0x7f17e0003e00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f17e40098a0 tx=0x7f17e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc425bdc604b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.859+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e400f040 con 0x7f17e00039e0 2024-09-16T01:17:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.859+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e402ace0 con 0x7f17e00039e0 2024-09-16T01:17:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.859+0000 7f17f27fc640 1 -- 172.21.15.81:0/3710981450 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4004250 con 0x7f17e00039e0 2024-09-16T01:17:31.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.859+0000 7f17f9303640 1 -- 172.21.15.81:0/3710981450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e00039e0 msgr2=0x7f17e0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.859+0000 7f17f9303640 1 --2- 172.21.15.81:0/3710981450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17e00039e0 0x7f17e0003e00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f17e40098a0 tx=0x7f17e0005830 comp rx=0 tx=0).stop 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.859+0000 7f17f37fe640 1 -- 172.21.15.81:0/3710981450 reap_dead start 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.859+0000 7f17f9303640 1 -- 172.21.15.81:0/3710981450 shutdown_connections 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.859+0000 7f17f9303640 1 -- 172.21.15.81:0/3710981450 >> 172.21.15.81:0/3710981450 conn(0x7f17f408bfc0 msgr2=0x7f17f40d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.859+0000 7f17f9303640 1 -- 172.21.15.81:0/3710981450 shutdown_connections 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.859+0000 7f17f9303640 1 -- 172.21.15.81:0/3710981450 wait complete. 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.860+0000 7f17f9303640 1 Processor -- start 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.861+0000 7f17f9303640 1 -- start start 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.861+0000 7f17f9303640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17e00039e0 0x7f17f41f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.861+0000 7f17f9303640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f40b6500 0x7f17f415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.861+0000 7f17f9303640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f4155c50 0x7f17f4153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.861+0000 7f17f9303640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17f406cdd0 con 0x7f17f4155c50 2024-09-16T01:17:31.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.861+0000 7f17f9303640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40b38a0 con 0x7f17e00039e0 2024-09-16T01:17:31.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.861+0000 7f17f9303640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f17f406cf50 con 0x7f17f40b6500 2024-09-16T01:17:31.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.861+0000 7f17f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f4155c50 0x7f17f4153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.861+0000 7f17f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f4155c50 0x7f17f4153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57558/0 (socket says 172.21.15.81:57558) 2024-09-16T01:17:31.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.861+0000 7f17f37fe640 1 -- 172.21.15.81:0/1831721422 learned_addr learned my addr 172.21.15.81:0/1831721422 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:31.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.861+0000 7f17ebfff640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f40b6500 0x7f17f415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17f2ffd640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17e00039e0 0x7f17f41f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17f37fe640 1 -- 172.21.15.81:0/1831721422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f40b6500 msgr2=0x7f17f415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17f37fe640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f40b6500 0x7f17f415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17f37fe640 1 -- 172.21.15.81:0/1831721422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17e00039e0 msgr2=0x7f17f41f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17f37fe640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17e00039e0 0x7f17f41f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17f37fe640 1 -- 172.21.15.81:0/1831721422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f41f5190 con 0x7f17f4155c50 2024-09-16T01:17:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17ebfff640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f40b6500 0x7f17f415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17f37fe640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f4155c50 0x7f17f4153060 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0013d0 tx=0x7f17ec007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17eb7fe640 1 -- 172.21.15.81:0/1831721422 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec017020 con 0x7f17f4155c50 2024-09-16T01:17:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17eb7fe640 1 -- 172.21.15.81:0/1831721422 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec00ea20 con 0x7f17f4155c50 2024-09-16T01:17:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17f9303640 1 -- 172.21.15.81:0/1831721422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f41f5470 con 0x7f17f4155c50 2024-09-16T01:17:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17eb7fe640 1 -- 172.21.15.81:0/1831721422 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00ee10 con 0x7f17f4155c50 2024-09-16T01:17:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.862+0000 7f17f9303640 1 -- 172.21.15.81:0/1831721422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f41f5a30 con 0x7f17f4155c50 2024-09-16T01:17:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.863+0000 7f17f9303640 1 -- 172.21.15.81:0/1831721422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f40b6d20 con 0x7f17f4155c50 2024-09-16T01:17:31.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.863+0000 7f17eb7fe640 1 -- 172.21.15.81:0/1831721422 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f17ec01a020 con 0x7f17f4155c50 2024-09-16T01:17:31.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.864+0000 7f17eb7fe640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f17d406c2b0 0x7f17d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:31.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.864+0000 7f17f2ffd640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f17d406c2b0 0x7f17d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:31.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.864+0000 7f17eb7fe640 1 -- 172.21.15.81:0/1831721422 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f17ec08b300 con 0x7f17f4155c50 2024-09-16T01:17:31.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.864+0000 7f17f2ffd640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f17d406c2b0 0x7f17d406e770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17e4033000 tx=0x7f17e402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:31.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:31.868+0000 7f17eb7fe640 1 -- 172.21.15.81:0/1831721422 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f17ec021030 con 0x7f17f4155c50 2024-09-16T01:17:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.072+0000 7f17f9303640 1 -- 172.21.15.81:0/1831721422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17f406d970 con 0x7f17f4155c50 2024-09-16T01:17:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.072+0000 7f17eb7fe640 1 -- 172.21.15.81:0/1831721422 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3908 (secure 0 0 0) 0x7f17f40d2700 con 0x7f17f4155c50 2024-09-16T01:17:32.074 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:32.074 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":18,"btime":"2024-09-16T01:17:26:239653+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2179103223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2179103223},{"type":"v1","addr":"172.21.15.81:6836","nonce":2179103223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4649,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/4263439893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":4263439893},{"type":"v1","addr":"172.21.15.102:6834","nonce":4263439893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4652,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/27716817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":27716817},{"type":"v1","addr":"172.21.15.102:6835","nonce":27716817}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5256,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/202137001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":202137001},{"type":"v1","addr":"172.21.15.81:6837","nonce":202137001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-09-16T01:17:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 18 2024-09-16T01:17:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.074+0000 7f17f9303640 1 -- 172.21.15.81:0/1831721422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f17d406c2b0 msgr2=0x7f17d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.074+0000 7f17f9303640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f17d406c2b0 0x7f17d406e770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17e4033000 tx=0x7f17e402e000 comp rx=0 tx=0).stop 2024-09-16T01:17:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.074+0000 7f17f9303640 1 -- 172.21.15.81:0/1831721422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f4155c50 msgr2=0x7f17f4153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.074+0000 7f17f9303640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f4155c50 0x7f17f4153060 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0013d0 tx=0x7f17ec007bc0 comp rx=0 tx=0).stop 2024-09-16T01:17:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.074+0000 7f17f9303640 1 -- 172.21.15.81:0/1831721422 shutdown_connections 2024-09-16T01:17:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.074+0000 7f17f9303640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f17d406c2b0 0x7f17d406e770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.074+0000 7f17f9303640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f4155c50 0x7f17f4153060 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.074+0000 7f17f9303640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17f40b6500 0x7f17f415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.074+0000 7f17f9303640 1 --2- 172.21.15.81:0/1831721422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17e00039e0 0x7f17f41f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.074+0000 7f17f9303640 1 -- 172.21.15.81:0/1831721422 >> 172.21.15.81:0/1831721422 conn(0x7f17f408bfc0 msgr2=0x7f17f40d4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.074+0000 7f17f9303640 1 -- 172.21.15.81:0/1831721422 shutdown_connections 2024-09-16T01:17:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.074+0000 7f17f9303640 1 -- 172.21.15.81:0/1831721422 wait complete. 2024-09-16T01:17:32.088 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:17:32.088 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T01:17:32.088 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:17:32.088 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:17:32.088 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:17:32.088 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T01:17:32.089 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:17:32.089 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:17:32.089 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:17:32.089 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T01:17:32.089 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:17:32.089 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:17:32.089 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:17:32.090 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T01:17:32.090 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:17:32.090 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:17:32.098 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:17:32.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:17:32.099 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:17:32.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:17:32.101 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:17:32.101 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:17:32.102 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:17:32.102 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:17:32.141 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:17:32.141 DEBUG:teuthology.parallel:result is None 2024-09-16T01:17:32.142 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:17:32.142 DEBUG:teuthology.parallel:result is None 2024-09-16T01:17:32.144 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:17:32.144 DEBUG:teuthology.parallel:result is None 2024-09-16T01:17:32.145 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:17:32.145 DEBUG:teuthology.parallel:result is None 2024-09-16T01:17:32.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T01:17:32.216 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:17:32.217 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:17:32.231 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:17:32.231 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-16T01:17:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.248+0000 7f56c281e640 1 Processor -- start 2024-09-16T01:17:32.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.248+0000 7f56c281e640 1 -- start start 2024-09-16T01:17:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.248+0000 7f56c281e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc161c80 0x7f56bc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56c281e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f56bc0b6680 0x7f56bc0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56c281e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56bc06e870 con 0x7f56bc162060 2024-09-16T01:17:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56c281e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f56bc06d9f0 con 0x7f56bc0b6680 2024-09-16T01:17:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56c281e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f56bc06dcd0 con 0x7f56bc161c80 2024-09-16T01:17:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56bb7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f56bc162060 0x7f56bc0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60410/0 (socket says 172.21.15.81:60410) 2024-09-16T01:17:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56bb7fe640 1 -- 172.21.15.81:0/963137024 learned_addr learned my addr 172.21.15.81:0/963137024 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56c0dbb640 1 --2- 172.21.15.81:0/963137024 >> v2:172.21.15.102:3300/0 conn(0x7f56bc0b6680 0x7f56bc0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871501917 0 0) 0x7f56b0001110 con 0x7f56bc162060 2024-09-16T01:17:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56a4003520 con 0x7f56bc162060 2024-09-16T01:17:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56bbfff640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc161c80 0x7f56bc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2940148865 0 0) 0x7f56a4003520 con 0x7f56bc162060 2024-09-16T01:17:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc161c80 msgr2=0x7f56bc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc161c80 0x7f56bc06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 >> v2:172.21.15.102:3300/0 conn(0x7f56bc0b6680 msgr2=0x7f56bc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 --2- 172.21.15.81:0/963137024 >> v2:172.21.15.102:3300/0 conn(0x7f56bc0b6680 0x7f56bc0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56bc06dfb0 con 0x7f56bc162060 2024-09-16T01:17:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f56b0001840 con 0x7f56bc162060 2024-09-16T01:17:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 >> v1:172.21.15.81:6789/0 conn(0x7f56bc162060 legacy=0x7f56bc0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a40039b0 0x7f56a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc161c80 0x7f56a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56a4004d40 0x7f56a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc06d9f0 con 0x7f56a40039b0 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc06dcd0 con 0x7f56a4004d40 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f56a400b9c0 con 0x7f56bc161c80 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56bbfff640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a40039b0 0x7f56a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56bb7fe640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc161c80 0x7f56a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.249+0000 7f56c0dbb640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56a4004d40 0x7f56a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.250+0000 7f56bbfff640 1 -- 172.21.15.81:0/963137024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc161c80 msgr2=0x7f56a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.250+0000 7f56bbfff640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc161c80 0x7f56a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.250+0000 7f56bbfff640 1 -- 172.21.15.81:0/963137024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56a4004d40 msgr2=0x7f56a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.250+0000 7f56bbfff640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56a4004d40 0x7f56a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.250+0000 7f56bbfff640 1 -- 172.21.15.81:0/963137024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a4003520 con 0x7f56a40039b0 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.250+0000 7f56c0dbb640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56a4004d40 0x7f56a40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.250+0000 7f56bbfff640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a40039b0 0x7f56a4003dd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009ac0 tx=0x7f56a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6980d907715be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.250+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac036070 con 0x7f56a40039b0 2024-09-16T01:17:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.250+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ac031400 con 0x7f56a40039b0 2024-09-16T01:17:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.250+0000 7f56baffd640 1 -- 172.21.15.81:0/963137024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac009690 con 0x7f56a40039b0 2024-09-16T01:17:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.251+0000 7f56c281e640 1 -- 172.21.15.81:0/963137024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a40039b0 msgr2=0x7f56a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.251+0000 7f56c281e640 1 --2- 172.21.15.81:0/963137024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a40039b0 0x7f56a4003dd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009ac0 tx=0x7f56a4005830 comp rx=0 tx=0).stop 2024-09-16T01:17:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.251+0000 7f56c0dbb640 1 -- 172.21.15.81:0/963137024 reap_dead start 2024-09-16T01:17:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.251+0000 7f56c281e640 1 -- 172.21.15.81:0/963137024 shutdown_connections 2024-09-16T01:17:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.251+0000 7f56c281e640 1 -- 172.21.15.81:0/963137024 >> 172.21.15.81:0/963137024 conn(0x7f56bc0d44f0 msgr2=0x7f56bc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.251+0000 7f56c281e640 1 -- 172.21.15.81:0/963137024 shutdown_connections 2024-09-16T01:17:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.251+0000 7f56c281e640 1 -- 172.21.15.81:0/963137024 wait complete. 2024-09-16T01:17:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.252+0000 7f56c281e640 1 Processor -- start 2024-09-16T01:17:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.252+0000 7f56c281e640 1 -- start start 2024-09-16T01:17:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c281e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56a40039b0 0x7f56bc0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c281e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc0b8fa0 0x7f56bc1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c281e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc156830 0x7f56bc15e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c281e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc0b6b30 con 0x7f56bc156830 2024-09-16T01:17:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c281e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc0d2aa0 con 0x7f56a40039b0 2024-09-16T01:17:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c281e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f56bc0b6cb0 con 0x7f56bc0b8fa0 2024-09-16T01:17:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c0dbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc156830 0x7f56bc15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c0dbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc156830 0x7f56bc15e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57594/0 (socket says 172.21.15.81:57594) 2024-09-16T01:17:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c0dbb640 1 -- 172.21.15.81:0/144132237 learned_addr learned my addr 172.21.15.81:0/144132237 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56bbfff640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56a40039b0 0x7f56bc0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56bb7fe640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc0b8fa0 0x7f56bc1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c0dbb640 1 -- 172.21.15.81:0/144132237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc0b8fa0 msgr2=0x7f56bc1562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c0dbb640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc0b8fa0 0x7f56bc1562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c0dbb640 1 -- 172.21.15.81:0/144132237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56a40039b0 msgr2=0x7f56bc0b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c0dbb640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56a40039b0 0x7f56bc0b8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.253+0000 7f56c0dbb640 1 -- 172.21.15.81:0/144132237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56bc0b9470 con 0x7f56bc156830 2024-09-16T01:17:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.254+0000 7f56c0dbb640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc156830 0x7f56bc15e590 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f56bc08e1d0 tx=0x7f56b4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.254+0000 7f56b8ff9640 1 -- 172.21.15.81:0/144132237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4010d80 con 0x7f56bc156830 2024-09-16T01:17:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.254+0000 7f56b8ff9640 1 -- 172.21.15.81:0/144132237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56b4003990 con 0x7f56bc156830 2024-09-16T01:17:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.254+0000 7f56c281e640 1 -- 172.21.15.81:0/144132237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56bc0b9750 con 0x7f56bc156830 2024-09-16T01:17:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.254+0000 7f56b8ff9640 1 -- 172.21.15.81:0/144132237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4003d80 con 0x7f56bc156830 2024-09-16T01:17:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.254+0000 7f56c281e640 1 -- 172.21.15.81:0/144132237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56bc0b9d10 con 0x7f56bc156830 2024-09-16T01:17:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.255+0000 7f56c281e640 1 -- 172.21.15.81:0/144132237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56bc06e330 con 0x7f56bc156830 2024-09-16T01:17:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.255+0000 7f56b8ff9640 1 -- 172.21.15.81:0/144132237 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f56b4005d10 con 0x7f56bc156830 2024-09-16T01:17:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.256+0000 7f56b8ff9640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f56a806c2b0 0x7f56a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.256+0000 7f56b8ff9640 1 -- 172.21.15.81:0/144132237 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5335+0+0 (secure 0 0 0) 0x7f56b408b830 con 0x7f56bc156830 2024-09-16T01:17:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.256+0000 7f56bbfff640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f56a806c2b0 0x7f56a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.256+0000 7f56bbfff640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f56a806c2b0 0x7f56a806e770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f56ac033000 tx=0x7f56ac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.260+0000 7f56b8ff9640 1 -- 172.21.15.81:0/144132237 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f56b4025020 con 0x7f56bc156830 2024-09-16T01:17:32.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:32.441+0000 7f56c281e640 1 -- 172.21.15.81:0/144132237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f56bc0b5ed0 con 0x7f56bc156830 2024-09-16T01:17:33.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.280+0000 7f56b8ff9640 1 -- 172.21.15.81:0/144132237 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) ==== 97+0+0 (secure 0 0 0) 0x7f56b405a110 con 0x7f56bc156830 2024-09-16T01:17:33.282 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-16T01:17:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.282+0000 7f56c281e640 1 -- 172.21.15.81:0/144132237 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f56a806c2b0 msgr2=0x7f56a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.282+0000 7f56c281e640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f56a806c2b0 0x7f56a806e770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f56ac033000 tx=0x7f56ac008030 comp rx=0 tx=0).stop 2024-09-16T01:17:33.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.282+0000 7f56c281e640 1 -- 172.21.15.81:0/144132237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc156830 msgr2=0x7f56bc15e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.282+0000 7f56c281e640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc156830 0x7f56bc15e590 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f56bc08e1d0 tx=0x7f56b4010590 comp rx=0 tx=0).stop 2024-09-16T01:17:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.283+0000 7f56c281e640 1 -- 172.21.15.81:0/144132237 shutdown_connections 2024-09-16T01:17:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.283+0000 7f56c281e640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f56a806c2b0 0x7f56a806e770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.283+0000 7f56c281e640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc156830 0x7f56bc15e590 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.283+0000 7f56c281e640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56bc0b8fa0 0x7f56bc1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.283+0000 7f56c281e640 1 --2- 172.21.15.81:0/144132237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56a40039b0 0x7f56bc0b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.283+0000 7f56c281e640 1 -- 172.21.15.81:0/144132237 >> 172.21.15.81:0/144132237 conn(0x7f56bc0d44f0 msgr2=0x7f56bc0cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.283+0000 7f56c281e640 1 -- 172.21.15.81:0/144132237 shutdown_connections 2024-09-16T01:17:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.283+0000 7f56c281e640 1 -- 172.21.15.81:0/144132237 wait complete. 2024-09-16T01:17:33.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T01:17:33.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.399+0000 7fc00ef2c640 1 Processor -- start 2024-09-16T01:17:33.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.399+0000 7fc00ef2c640 1 -- start start 2024-09-16T01:17:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.400+0000 7fc00ef2c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc008072320 0x7fc0080cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.400+0000 7fc00ef2c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc008072de0 0x7fc00806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.400+0000 7fc00ef2c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc008072700 0x7fc00806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.400+0000 7fc00ef2c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc008146140 con 0x7fc008072700 2024-09-16T01:17:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.400+0000 7fc00ef2c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc0080cd740 con 0x7fc008072de0 2024-09-16T01:17:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.400+0000 7fc00ef2c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc0080cda20 con 0x7fc008072320 2024-09-16T01:17:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.400+0000 7fc00d4c9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc008072700 0x7fc00806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.400+0000 7fc00d4c9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc008072700 0x7fc00806e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57608/0 (socket says 172.21.15.81:57608) 2024-09-16T01:17:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.400+0000 7fc00d4c9640 1 -- 172.21.15.81:0/1164002858 learned_addr learned my addr 172.21.15.81:0/1164002858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.401+0000 7fc00d4c9640 1 -- 172.21.15.81:0/1164002858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc008072320 msgr2=0x7fc0080cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.401+0000 7fc00d4c9640 1 --2- 172.21.15.81:0/1164002858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc008072320 0x7fc0080cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.401+0000 7fc00d4c9640 1 -- 172.21.15.81:0/1164002858 >> v2:172.21.15.102:3300/0 conn(0x7fc008072de0 msgr2=0x7fc00806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.401+0000 7fc00d4c9640 1 --2- 172.21.15.81:0/1164002858 >> v2:172.21.15.102:3300/0 conn(0x7fc008072de0 0x7fc00806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.401+0000 7fc00d4c9640 1 -- 172.21.15.81:0/1164002858 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0080cdd00 con 0x7fc008072700 2024-09-16T01:17:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.401+0000 7fc00d4c9640 1 --2- 172.21.15.81:0/1164002858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008072700 0x7fc00806e5f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc0080701f0 tx=0x7fc00002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ae9b69dc0240bd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.401+0000 7fc0077fe640 1 -- 172.21.15.81:0/1164002858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000037070 con 0x7fc008072700 2024-09-16T01:17:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.401+0000 7fc0077fe640 1 -- 172.21.15.81:0/1164002858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc000032440 con 0x7fc008072700 2024-09-16T01:17:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.401+0000 7fc0077fe640 1 -- 172.21.15.81:0/1164002858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000032810 con 0x7fc008072700 2024-09-16T01:17:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.402+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1164002858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008072700 msgr2=0x7fc00806e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.402+0000 7fc00ef2c640 1 --2- 172.21.15.81:0/1164002858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008072700 0x7fc00806e5f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc0080701f0 tx=0x7fc00002a140 comp rx=0 tx=0).stop 2024-09-16T01:17:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.402+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1164002858 shutdown_connections 2024-09-16T01:17:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.402+0000 7fc00ef2c640 1 --2- 172.21.15.81:0/1164002858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008072700 0x7fc00806e5f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.402+0000 7fc00ef2c640 1 --2- 172.21.15.81:0/1164002858 >> v2:172.21.15.102:3300/0 conn(0x7fc008072de0 0x7fc00806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.402+0000 7fc00ef2c640 1 --2- 172.21.15.81:0/1164002858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc008072320 0x7fc0080cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.402+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1164002858 >> 172.21.15.81:0/1164002858 conn(0x7fc008067d70 msgr2=0x7fc00806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.402+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1164002858 shutdown_connections 2024-09-16T01:17:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.402+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1164002858 wait complete. 2024-09-16T01:17:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.403+0000 7fc00ef2c640 1 Processor -- start 2024-09-16T01:17:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.403+0000 7fc00ef2c640 1 -- start start 2024-09-16T01:17:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc00ef2c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc008072320 0x7fc00815be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc00ef2c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008072700 0x7fc0081f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc00ef2c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc008072de0 0x7fc0081f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc00ef2c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0080cd520 con 0x7fc008072700 2024-09-16T01:17:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc00ef2c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc0080cd3a0 con 0x7fc008072320 2024-09-16T01:17:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc00ef2c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc00806eb30 con 0x7fc008072de0 2024-09-16T01:17:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc007fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008072700 0x7fc0081f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc007fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008072700 0x7fc0081f5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57624/0 (socket says 172.21.15.81:57624) 2024-09-16T01:17:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc007fff640 1 -- 172.21.15.81:0/1359541317 learned_addr learned my addr 172.21.15.81:0/1359541317 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc00ccc8640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc008072320 0x7fc00815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc00d4c9640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc008072de0 0x7fc0081f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc007fff640 1 -- 172.21.15.81:0/1359541317 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc008072de0 msgr2=0x7fc0081f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc007fff640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc008072de0 0x7fc0081f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc007fff640 1 -- 172.21.15.81:0/1359541317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc008072320 msgr2=0x7fc00815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc007fff640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc008072320 0x7fc00815be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc007fff640 1 -- 172.21.15.81:0/1359541317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00815c390 con 0x7fc008072700 2024-09-16T01:17:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc00d4c9640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc008072de0 0x7fc0081f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.404+0000 7fc00ccc8640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc008072320 0x7fc00815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.405+0000 7fc007fff640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008072700 0x7fc0081f5200 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbff000b440 tx=0x7fbff000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.405+0000 7fc0057fa640 1 -- 172.21.15.81:0/1359541317 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0015020 con 0x7fc008072700 2024-09-16T01:17:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.405+0000 7fc0057fa640 1 -- 172.21.15.81:0/1359541317 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff00118b0 con 0x7fc008072700 2024-09-16T01:17:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.405+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1359541317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc008135610 con 0x7fc008072700 2024-09-16T01:17:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.405+0000 7fc0057fa640 1 -- 172.21.15.81:0/1359541317 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0011ca0 con 0x7fc008072700 2024-09-16T01:17:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.405+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1359541317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc008135bd0 con 0x7fc008072700 2024-09-16T01:17:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.406+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1359541317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0080cce60 con 0x7fc008072700 2024-09-16T01:17:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.406+0000 7fc0057fa640 1 -- 172.21.15.81:0/1359541317 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbff0018020 con 0x7fc008072700 2024-09-16T01:17:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.407+0000 7fc0057fa640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbfe806c2b0 0x7fbfe806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.407+0000 7fc0057fa640 1 -- 172.21.15.81:0/1359541317 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7fbff008b330 con 0x7fc008072700 2024-09-16T01:17:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.407+0000 7fc00ccc8640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbfe806c2b0 0x7fbfe806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.407+0000 7fc00ccc8640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbfe806c2b0 0x7fbfe806e770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0081f5160 tx=0x7fbff8009570 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.411+0000 7fc0057fa640 1 -- 172.21.15.81:0/1359541317 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbff001f020 con 0x7fc008072700 2024-09-16T01:17:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.638+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1359541317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc00806d090 con 0x7fc008072700 2024-09-16T01:17:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.639+0000 7fc0057fa640 1 -- 172.21.15.81:0/1359541317 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7fbff000d040 con 0x7fc008072700 2024-09-16T01:17:33.641 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:33.641 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:17:33.641 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-16T01:17:33.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.641 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-16T01:17:33.641 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmx4OgCRAAkmpWDpuwqbDuz0taNg8bag==", 2024-09-16T01:17:33.641 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.641 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:33.641 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:17:33.641 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:17:33.641 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmSNpLFRAAzc9Sr8b65zH9VZFYvqsYpA==", 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-16T01:17:33.642 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmcCavEBAA0CuddD0zPcjqrMSOD5c6OA==", 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmVeRcHBAANIL7HFYSc43qv7Zg0llkYQ==", 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:17:33.643 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDhudmUtTqORAAkZKChid+qoa+0nIgpuun7g==", 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCHhudmUhtiABAA2vDoACv8RJ2KD9p1cdKClA==", 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCKhudmhOmRHxAAbGjJkUZLras/b6omekdz7A==", 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:33.645 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCNhudmA+csIRAAW1kenpimaWIak/qgG+UeXw==", 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCThudmvgQBLxAAWLto5pG0iyiQPSnxldWYwg==", 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCXhudmKfyiIhAALbJHvDeQtVgSCKjD1X3OYg==", 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:33.647 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCahudmPG/9JBAA6d/gK0K/5c9Gp4uKOLCCOw==", 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-16T01:17:33.648 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCdhudmVdY3NhAAXlOaeE0XidHVCaeQrirBAg==", 2024-09-16T01:17:33.649 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.649 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:33.649 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:33.649 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.649 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.649 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-16T01:17:33.649 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg==", 2024-09-16T01:17:33.649 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.649 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmMgEhKRAAUD2kJ9eOFJscZ6ATlO5PmQ==", 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmwfD5JRAAPhdVLFZD07Uy75g3zStblg==", 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudm8/qzLhAAVFRbGhXH00h2LS9ZC9rraA==", 2024-09-16T01:17:33.651 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/hudmBWr2KRAA/hELsRHNpxj3KqJbOSY74g==", 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:17:33.652 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmRdtyBhAAMQngXCuTHg6AjACCw/SmCg==", 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-16T01:17:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmqULCAhAAMbYmGXWGiINwif20O1JG3g==", 2024-09-16T01:17:33.654 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:33.654 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:17:33.654 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:17:33.654 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:33.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-16T01:17:33.654 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:17:33.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.641+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1359541317 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbfe806c2b0 msgr2=0x7fbfe806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.641+0000 7fc00ef2c640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbfe806c2b0 0x7fbfe806e770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0081f5160 tx=0x7fbff8009570 comp rx=0 tx=0).stop 2024-09-16T01:17:33.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.641+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1359541317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008072700 msgr2=0x7fc0081f5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.641+0000 7fc00ef2c640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008072700 0x7fc0081f5200 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbff000b440 tx=0x7fbff000b900 comp rx=0 tx=0).stop 2024-09-16T01:17:33.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.641+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1359541317 shutdown_connections 2024-09-16T01:17:33.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.641+0000 7fc00ef2c640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbfe806c2b0 0x7fbfe806e770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.641+0000 7fc00ef2c640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc008072de0 0x7fc0081f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.641+0000 7fc00ef2c640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc008072700 0x7fc0081f5200 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.641+0000 7fc00ef2c640 1 --2- 172.21.15.81:0/1359541317 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc008072320 0x7fc00815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.641+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1359541317 >> 172.21.15.81:0/1359541317 conn(0x7fc008067d70 msgr2=0x7fc0080cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:33.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.641+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1359541317 shutdown_connections 2024-09-16T01:17:33.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.641+0000 7fc00ef2c640 1 -- 172.21.15.81:0/1359541317 wait complete. 2024-09-16T01:17:33.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:17:33.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.753+0000 7f43bcdd6640 1 Processor -- start 2024-09-16T01:17:33.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.753+0000 7f43bcdd6640 1 -- start start 2024-09-16T01:17:33.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.754+0000 7f43bcdd6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f43b8161c80 0x7f43b806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.754+0000 7f43bcdd6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b8162060 0x7f43b80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.754+0000 7f43bcdd6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b806e870 con 0x7f43b80b64b0 2024-09-16T01:17:33.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.754+0000 7f43bcdd6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f43b806d9f0 con 0x7f43b8161c80 2024-09-16T01:17:33.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.754+0000 7f43bcdd6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f43b806dcd0 con 0x7f43b8162060 2024-09-16T01:17:33.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.754+0000 7f43b6d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f43b80b64b0 0x7f43b8162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60426/0 (socket says 172.21.15.81:60426) 2024-09-16T01:17:33.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.754+0000 7f43b6d9d640 1 -- 172.21.15.81:0/2176677499 learned_addr learned my addr 172.21.15.81:0/2176677499 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:33.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b659c640 1 --2- 172.21.15.81:0/2176677499 >> v2:172.21.15.102:3300/0 conn(0x7f43b8161c80 0x7f43b806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b5d9b640 1 --2- 172.21.15.81:0/2176677499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b8162060 0x7f43b80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932681929 0 0) 0x7f43a8001110 con 0x7f43b80b64b0 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43a4003520 con 0x7f43b80b64b0 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2820666951 0 0) 0x7f43a4003520 con 0x7f43b80b64b0 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b8162060 msgr2=0x7f43b80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 --2- 172.21.15.81:0/2176677499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b8162060 0x7f43b80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 >> v2:172.21.15.102:3300/0 conn(0x7f43b8161c80 msgr2=0x7f43b806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 --2- 172.21.15.81:0/2176677499 >> v2:172.21.15.102:3300/0 conn(0x7f43b8161c80 0x7f43b806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b806dfb0 con 0x7f43b80b64b0 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f43a8001840 con 0x7f43b80b64b0 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 >> v1:172.21.15.81:6789/0 conn(0x7f43b80b64b0 legacy=0x7f43b8162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 --2- 172.21.15.81:0/2176677499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b8162060 0x7f43a40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 --2- 172.21.15.81:0/2176677499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a4003f30 0x7f43a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 --2- 172.21.15.81:0/2176677499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a4004d40 0x7f43a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43b806d9f0 con 0x7f43a4004d40 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f43b806dcd0 con 0x7f43a4003f30 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f43a400b9c0 con 0x7f43b8162060 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b6d9d640 1 --2- 172.21.15.81:0/2176677499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a4004d40 0x7f43a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b659c640 1 --2- 172.21.15.81:0/2176677499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b8162060 0x7f43a40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b5d9b640 1 --2- 172.21.15.81:0/2176677499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a4003f30 0x7f43a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b6d9d640 1 -- 172.21.15.81:0/2176677499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b8162060 msgr2=0x7f43a40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b6d9d640 1 --2- 172.21.15.81:0/2176677499 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b8162060 0x7f43a40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b6d9d640 1 -- 172.21.15.81:0/2176677499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a4003f30 msgr2=0x7f43a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b6d9d640 1 --2- 172.21.15.81:0/2176677499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a4003f30 0x7f43a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.755+0000 7f43b6d9d640 1 -- 172.21.15.81:0/2176677499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a4003520 con 0x7f43a4004d40 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.756+0000 7f43b6d9d640 1 --2- 172.21.15.81:0/2176677499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a4004d40 0x7f43a40051c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f43a800c3e0 tx=0x7f43a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbaec4a52f295ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.756+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a8032020 con 0x7f43a4004d40 2024-09-16T01:17:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.756+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a8005af0 con 0x7f43a4004d40 2024-09-16T01:17:33.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.756+0000 7f43b559a640 1 -- 172.21.15.81:0/2176677499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a800c0e0 con 0x7f43a4004d40 2024-09-16T01:17:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.757+0000 7f43bcdd6640 1 -- 172.21.15.81:0/2176677499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a4004d40 msgr2=0x7f43a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.757+0000 7f43bcdd6640 1 --2- 172.21.15.81:0/2176677499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43a4004d40 0x7f43a40051c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f43a800c3e0 tx=0x7f43a4005830 comp rx=0 tx=0).stop 2024-09-16T01:17:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.757+0000 7f43b6d9d640 1 -- 172.21.15.81:0/2176677499 reap_dead start 2024-09-16T01:17:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.757+0000 7f43bcdd6640 1 -- 172.21.15.81:0/2176677499 shutdown_connections 2024-09-16T01:17:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.757+0000 7f43bcdd6640 1 -- 172.21.15.81:0/2176677499 >> 172.21.15.81:0/2176677499 conn(0x7f43b80d44f0 msgr2=0x7f43b80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.757+0000 7f43bcdd6640 1 -- 172.21.15.81:0/2176677499 shutdown_connections 2024-09-16T01:17:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.757+0000 7f43bcdd6640 1 -- 172.21.15.81:0/2176677499 wait complete. 2024-09-16T01:17:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.758+0000 7f43bcdd6640 1 Processor -- start 2024-09-16T01:17:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.758+0000 7f43bcdd6640 1 -- start start 2024-09-16T01:17:33.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43bcdd6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a4004d40 0x7f43b8155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43bcdd6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b80cd120 0x7f43b80cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43bcdd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80cbb00 0x7f43b815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43bcdd6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43b80d2a10 con 0x7f43b80cbb00 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43bcdd6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f43b80d2890 con 0x7f43a4004d40 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43bcdd6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f43b80b5f70 con 0x7f43b80cd120 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43b6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80cbb00 0x7f43b815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43b6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80cbb00 0x7f43b815ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57654/0 (socket says 172.21.15.81:57654) 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43b6d9d640 1 -- 172.21.15.81:0/3510954468 learned_addr learned my addr 172.21.15.81:0/3510954468 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43b659c640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a4004d40 0x7f43b8155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43b5d9b640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b80cd120 0x7f43b80cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43b6d9d640 1 -- 172.21.15.81:0/3510954468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b80cd120 msgr2=0x7f43b80cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43b6d9d640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b80cd120 0x7f43b80cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43b6d9d640 1 -- 172.21.15.81:0/3510954468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a4004d40 msgr2=0x7f43b8155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43b6d9d640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a4004d40 0x7f43b8155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.759+0000 7f43b6d9d640 1 -- 172.21.15.81:0/3510954468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b80cc080 con 0x7f43b80cbb00 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.760+0000 7f43b6d9d640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80cbb00 0x7f43b815ea70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f43a802b010 tx=0x7f43b806e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.760+0000 7f43aeffd640 1 -- 172.21.15.81:0/3510954468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a8032030 con 0x7f43b80cbb00 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.760+0000 7f43aeffd640 1 -- 172.21.15.81:0/3510954468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a8004e20 con 0x7f43b80cbb00 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.760+0000 7f43bcdd6640 1 -- 172.21.15.81:0/3510954468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b80cc360 con 0x7f43b80cbb00 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.760+0000 7f43aeffd640 1 -- 172.21.15.81:0/3510954468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a80072b0 con 0x7f43b80cbb00 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.760+0000 7f43bcdd6640 1 -- 172.21.15.81:0/3510954468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b80cc920 con 0x7f43b80cbb00 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.761+0000 7f43bcdd6640 1 -- 172.21.15.81:0/3510954468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b8073710 con 0x7f43b80cbb00 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.761+0000 7f43aeffd640 1 -- 172.21.15.81:0/3510954468 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f43a8035020 con 0x7f43b80cbb00 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.762+0000 7f43aeffd640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f439806c2b0 0x7f439806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.762+0000 7f43aeffd640 1 -- 172.21.15.81:0/3510954468 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7f43a80aa4c0 con 0x7f43b80cbb00 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.762+0000 7f43b659c640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f439806c2b0 0x7f439806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.762+0000 7f43b659c640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f439806c2b0 0x7f439806e770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f43b0014510 tx=0x7f43b000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:33.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.766+0000 7f43aeffd640 1 -- 172.21.15.81:0/3510954468 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43b8073710 con 0x7f43b80cbb00 2024-09-16T01:17:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.932+0000 7f43bcdd6640 1 -- 172.21.15.81:0/3510954468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f43b806e330 con 0x7f43b80cbb00 2024-09-16T01:17:33.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.933+0000 7f43aeffd640 1 -- 172.21.15.81:0/3510954468 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) ==== 84+0+65 (secure 0 0 0) 0x7f43a8047020 con 0x7f43b80cbb00 2024-09-16T01:17:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-16T01:17:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-16T01:17:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-16T01:17:33.935 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:33.935 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-16T01:17:33.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.934+0000 7f43bcdd6640 1 -- 172.21.15.81:0/3510954468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f439806c2b0 msgr2=0x7f439806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.935+0000 7f43bcdd6640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f439806c2b0 0x7f439806e770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f43b0014510 tx=0x7f43b000b040 comp rx=0 tx=0).stop 2024-09-16T01:17:33.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.935+0000 7f43bcdd6640 1 -- 172.21.15.81:0/3510954468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80cbb00 msgr2=0x7f43b815ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:33.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.935+0000 7f43bcdd6640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80cbb00 0x7f43b815ea70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f43a802b010 tx=0x7f43b806e180 comp rx=0 tx=0).stop 2024-09-16T01:17:33.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.935+0000 7f43bcdd6640 1 -- 172.21.15.81:0/3510954468 shutdown_connections 2024-09-16T01:17:33.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.935+0000 7f43bcdd6640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f439806c2b0 0x7f439806e770 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.935+0000 7f43bcdd6640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80cbb00 0x7f43b815ea70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.935+0000 7f43bcdd6640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b80cd120 0x7f43b80cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.935+0000 7f43bcdd6640 1 --2- 172.21.15.81:0/3510954468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43a4004d40 0x7f43b8155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:33.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.935+0000 7f43bcdd6640 1 -- 172.21.15.81:0/3510954468 >> 172.21.15.81:0/3510954468 conn(0x7f43b80d44f0 msgr2=0x7f43b80b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:33.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.935+0000 7f43bcdd6640 1 -- 172.21.15.81:0/3510954468 shutdown_connections 2024-09-16T01:17:33.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:33.935+0000 7f43bcdd6640 1 -- 172.21.15.81:0/3510954468 wait complete. 2024-09-16T01:17:33.947 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:17:33.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:17:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.048+0000 7fcbe563c640 1 Processor -- start 2024-09-16T01:17:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.048+0000 7fcbe563c640 1 -- start start 2024-09-16T01:17:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.049+0000 7fcbe563c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcbe00b2420 0x7fcbe00b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.049+0000 7fcbe563c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcbe00b01f0 0x7fcbe00b0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.049+0000 7fcbe563c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbe00afa60 con 0x7fcbe0145f20 2024-09-16T01:17:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.049+0000 7fcbe563c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe00b2dc0 con 0x7fcbe00b2420 2024-09-16T01:17:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.049+0000 7fcbe563c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fcbe00d1a40 con 0x7fcbe00b01f0 2024-09-16T01:17:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.049+0000 7fcbd67fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcbe00b2420 0x7fcbe00b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.049+0000 7fcbd67fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcbe00b2420 0x7fcbe00b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57662/0 (socket says 172.21.15.81:57662) 2024-09-16T01:17:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.049+0000 7fcbd67fc640 1 -- 172.21.15.81:0/1305329899 learned_addr learned my addr 172.21.15.81:0/1305329899 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.050+0000 7fcbdf7fe640 1 --2- 172.21.15.81:0/1305329899 >> v2:172.21.15.102:3300/0 conn(0x7fcbe00b01f0 0x7fcbe00b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.050+0000 7fcbd67fc640 1 -- 172.21.15.81:0/1305329899 >> v2:172.21.15.102:3300/0 conn(0x7fcbe00b01f0 msgr2=0x7fcbe00b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.050+0000 7fcbd67fc640 1 --2- 172.21.15.81:0/1305329899 >> v2:172.21.15.102:3300/0 conn(0x7fcbe00b01f0 0x7fcbe00b0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.050+0000 7fcbd67fc640 1 -- 172.21.15.81:0/1305329899 >> v1:172.21.15.102:6789/0 conn(0x7fcbe0145f20 legacy=0x7fcbe00d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.050+0000 7fcbd67fc640 1 -- 172.21.15.81:0/1305329899 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe00d1d20 con 0x7fcbe00b2420 2024-09-16T01:17:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.050+0000 7fcbd67fc640 1 --2- 172.21.15.81:0/1305329899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe00b2420 0x7fcbe00b2880 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0072e00 tx=0x7fcbc802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf14e1078b334792 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.051+0000 7fcbde7fc640 1 -- 172.21.15.81:0/1305329899 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8037070 con 0x7fcbe00b2420 2024-09-16T01:17:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.051+0000 7fcbde7fc640 1 -- 172.21.15.81:0/1305329899 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc8032440 con 0x7fcbe00b2420 2024-09-16T01:17:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.051+0000 7fcbde7fc640 1 -- 172.21.15.81:0/1305329899 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8032810 con 0x7fcbe00b2420 2024-09-16T01:17:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.051+0000 7fcbe563c640 1 -- 172.21.15.81:0/1305329899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe00b2420 msgr2=0x7fcbe00b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.051+0000 7fcbe563c640 1 --2- 172.21.15.81:0/1305329899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe00b2420 0x7fcbe00b2880 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0072e00 tx=0x7fcbc802a1a0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.051+0000 7fcbe563c640 1 -- 172.21.15.81:0/1305329899 shutdown_connections 2024-09-16T01:17:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.051+0000 7fcbe563c640 1 --2- 172.21.15.81:0/1305329899 >> v2:172.21.15.102:3300/0 conn(0x7fcbe00b01f0 0x7fcbe00b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.051+0000 7fcbe563c640 1 --2- 172.21.15.81:0/1305329899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe00b2420 0x7fcbe00b2880 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.051+0000 7fcbe563c640 1 -- 172.21.15.81:0/1305329899 >> 172.21.15.81:0/1305329899 conn(0x7fcbe009aa30 msgr2=0x7fcbe00b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.051+0000 7fcbe563c640 1 -- 172.21.15.81:0/1305329899 shutdown_connections 2024-09-16T01:17:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.051+0000 7fcbe563c640 1 -- 172.21.15.81:0/1305329899 wait complete. 2024-09-16T01:17:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.052+0000 7fcbe563c640 1 Processor -- start 2024-09-16T01:17:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.052+0000 7fcbe563c640 1 -- start start 2024-09-16T01:17:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.053+0000 7fcbe563c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbe00b01f0 0x7fcbe01423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.053+0000 7fcbe563c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe00b2420 0x7fcbe0157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.053+0000 7fcbe563c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbe0145f20 0x7fcbe0158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.053+0000 7fcbe563c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe006bde0 con 0x7fcbe00b2420 2024-09-16T01:17:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.053+0000 7fcbe563c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe00d2000 con 0x7fcbe0145f20 2024-09-16T01:17:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.053+0000 7fcbe563c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcbe006bf60 con 0x7fcbe00b01f0 2024-09-16T01:17:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.053+0000 7fcbd67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe00b2420 0x7fcbe0157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.053+0000 7fcbd67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe00b2420 0x7fcbe0157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57672/0 (socket says 172.21.15.81:57672) 2024-09-16T01:17:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.053+0000 7fcbd67fc640 1 -- 172.21.15.81:0/2419523818 learned_addr learned my addr 172.21.15.81:0/2419523818 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.053+0000 7fcbdeffd640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbe00b01f0 0x7fcbe01423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.053+0000 7fcbdf7fe640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbe0145f20 0x7fcbe0158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.054+0000 7fcbd67fc640 1 -- 172.21.15.81:0/2419523818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbe00b01f0 msgr2=0x7fcbe01423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.054+0000 7fcbd67fc640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbe00b01f0 0x7fcbe01423d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.054+0000 7fcbd67fc640 1 -- 172.21.15.81:0/2419523818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbe0145f20 msgr2=0x7fcbe0158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.054+0000 7fcbd67fc640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbe0145f20 0x7fcbe0158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.054+0000 7fcbd67fc640 1 -- 172.21.15.81:0/2419523818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe015dbd0 con 0x7fcbe00b2420 2024-09-16T01:17:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.054+0000 7fcbd67fc640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe00b2420 0x7fcbe0157c00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcbc802a1e0 tx=0x7fcbc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.054+0000 7fcbd7fff640 1 -- 172.21.15.81:0/2419523818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8041020 con 0x7fcbe00b2420 2024-09-16T01:17:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.054+0000 7fcbd7fff640 1 -- 172.21.15.81:0/2419523818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc80306c0 con 0x7fcbe00b2420 2024-09-16T01:17:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.054+0000 7fcbe563c640 1 -- 172.21.15.81:0/2419523818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe015cb30 con 0x7fcbe00b2420 2024-09-16T01:17:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.054+0000 7fcbd7fff640 1 -- 172.21.15.81:0/2419523818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8037040 con 0x7fcbe00b2420 2024-09-16T01:17:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.054+0000 7fcbe563c640 1 -- 172.21.15.81:0/2419523818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe015d0f0 con 0x7fcbe00b2420 2024-09-16T01:17:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.055+0000 7fcbe563c640 1 -- 172.21.15.81:0/2419523818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe00b2880 con 0x7fcbe00b2420 2024-09-16T01:17:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.055+0000 7fcbd7fff640 1 -- 172.21.15.81:0/2419523818 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcbc8044020 con 0x7fcbe00b2420 2024-09-16T01:17:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.056+0000 7fcbd7fff640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcbc006c2b0 0x7fcbc006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.056+0000 7fcbd7fff640 1 -- 172.21.15.81:0/2419523818 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5249+0+0 (secure 0 0 0) 0x7fcbc80ab900 con 0x7fcbe00b2420 2024-09-16T01:17:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.056+0000 7fcbdeffd640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcbc006c2b0 0x7fcbc006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.056+0000 7fcbdeffd640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcbc006c2b0 0x7fcbc006e770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcbe015b5b0 tx=0x7fcbd0009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.060+0000 7fcbd7fff640 1 -- 172.21.15.81:0/2419523818 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcbc804b030 con 0x7fcbe00b2420 2024-09-16T01:17:34.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.229+0000 7fcbe563c640 1 -- 172.21.15.81:0/2419523818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcbe015a720 con 0x7fcbe00b2420 2024-09-16T01:17:34.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.286+0000 7fcbd7fff640 1 -- 172.21.15.81:0/2419523818 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) ==== 138+0+0 (secure 0 0 0) 0x7fcbc8079c70 con 0x7fcbe00b2420 2024-09-16T01:17:34.288 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-16T01:17:34.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.288+0000 7fcbe563c640 1 -- 172.21.15.81:0/2419523818 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcbc006c2b0 msgr2=0x7fcbc006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:34.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.288+0000 7fcbe563c640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcbc006c2b0 0x7fcbc006e770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fcbe015b5b0 tx=0x7fcbd0009060 comp rx=0 tx=0).stop 2024-09-16T01:17:34.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.288+0000 7fcbe563c640 1 -- 172.21.15.81:0/2419523818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe00b2420 msgr2=0x7fcbe0157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:34.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.288+0000 7fcbe563c640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe00b2420 0x7fcbe0157c00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcbc802a1e0 tx=0x7fcbc80046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.288+0000 7fcbe563c640 1 -- 172.21.15.81:0/2419523818 shutdown_connections 2024-09-16T01:17:34.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.288+0000 7fcbe563c640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcbc006c2b0 0x7fcbc006e770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.288+0000 7fcbe563c640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcbe0145f20 0x7fcbe0158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.288+0000 7fcbe563c640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbe00b2420 0x7fcbe0157c00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.288+0000 7fcbe563c640 1 --2- 172.21.15.81:0/2419523818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcbe00b01f0 0x7fcbe01423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.288+0000 7fcbe563c640 1 -- 172.21.15.81:0/2419523818 >> 172.21.15.81:0/2419523818 conn(0x7fcbe009aa30 msgr2=0x7fcbe015b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:34.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.288+0000 7fcbe563c640 1 -- 172.21.15.81:0/2419523818 shutdown_connections 2024-09-16T01:17:34.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.288+0000 7fcbe563c640 1 -- 172.21.15.81:0/2419523818 wait complete. 2024-09-16T01:17:34.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:17:34.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.408+0000 7faa011c6640 1 Processor -- start 2024-09-16T01:17:34.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.408+0000 7faa011c6640 1 -- start start 2024-09-16T01:17:34.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.409+0000 7faa011c6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa9fc15b570 0x7fa9fc071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:34.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.409+0000 7faa011c6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa9fc0cd120 0x7fa9fc15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:34.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.409+0000 7faa011c6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9fc073b20 con 0x7fa9fc15b950 2024-09-16T01:17:34.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.409+0000 7faa011c6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa9fc0740e0 con 0x7fa9fc0cd120 2024-09-16T01:17:34.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.409+0000 7faa011c6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa9fc073e00 con 0x7fa9fc15b570 2024-09-16T01:17:34.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.409+0000 7fa9fb59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa9fc0cd120 0x7fa9fc15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:34.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.409+0000 7fa9fb59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa9fc0cd120 0x7fa9fc15e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57674/0 (socket says 172.21.15.81:57674) 2024-09-16T01:17:34.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.409+0000 7fa9fb59e640 1 -- 172.21.15.81:0/1388355149 learned_addr learned my addr 172.21.15.81:0/1388355149 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:34.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.409+0000 7fa9fb59e640 1 -- 172.21.15.81:0/1388355149 >> v2:172.21.15.102:3300/0 conn(0x7fa9fc15b570 msgr2=0x7fa9fc071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:34.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.409+0000 7fa9fb59e640 1 --2- 172.21.15.81:0/1388355149 >> v2:172.21.15.102:3300/0 conn(0x7fa9fc15b570 0x7fa9fc071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.409+0000 7fa9fb59e640 1 -- 172.21.15.81:0/1388355149 >> v1:172.21.15.102:6789/0 conn(0x7fa9fc15b950 legacy=0x7fa9fc0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:34.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.409+0000 7fa9fb59e640 1 -- 172.21.15.81:0/1388355149 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9fc0cf320 con 0x7fa9fc0cd120 2024-09-16T01:17:34.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.410+0000 7fa9fb59e640 1 --2- 172.21.15.81:0/1388355149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9fc0cd120 0x7fa9fc15e4e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc0b1cd0 tx=0x7fa9f402b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71445be838cc057d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:34.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.410+0000 7fa9fa59c640 1 -- 172.21.15.81:0/1388355149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f4037070 con 0x7fa9fc0cd120 2024-09-16T01:17:34.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.410+0000 7fa9fa59c640 1 -- 172.21.15.81:0/1388355149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f4032600 con 0x7fa9fc0cd120 2024-09-16T01:17:34.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.410+0000 7fa9fa59c640 1 -- 172.21.15.81:0/1388355149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40329d0 con 0x7fa9fc0cd120 2024-09-16T01:17:34.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.411+0000 7faa011c6640 1 -- 172.21.15.81:0/1388355149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9fc0cd120 msgr2=0x7fa9fc15e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.411+0000 7faa011c6640 1 --2- 172.21.15.81:0/1388355149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9fc0cd120 0x7fa9fc15e4e0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc0b1cd0 tx=0x7fa9f402b750 comp rx=0 tx=0).stop 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.411+0000 7faa011c6640 1 -- 172.21.15.81:0/1388355149 shutdown_connections 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.411+0000 7faa011c6640 1 --2- 172.21.15.81:0/1388355149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9fc0cd120 0x7fa9fc15e4e0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.411+0000 7faa011c6640 1 --2- 172.21.15.81:0/1388355149 >> v2:172.21.15.102:3300/0 conn(0x7fa9fc15b570 0x7fa9fc071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.411+0000 7faa011c6640 1 -- 172.21.15.81:0/1388355149 >> 172.21.15.81:0/1388355149 conn(0x7fa9fc06bdf0 msgr2=0x7fa9fc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.411+0000 7faa011c6640 1 -- 172.21.15.81:0/1388355149 shutdown_connections 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.411+0000 7faa011c6640 1 -- 172.21.15.81:0/1388355149 wait complete. 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.412+0000 7faa011c6640 1 Processor -- start 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.412+0000 7faa011c6640 1 -- start start 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7faa011c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9fc0cd120 0x7fa9fc14d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7faa011c6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9fc15b570 0x7fa9fc0b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7faa011c6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa9fc15b950 0x7fa9fc15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:34.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7faa011c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa9fc0cf840 con 0x7fa9fc0cd120 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7faa011c6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa9fc072450 con 0x7fa9fc15b570 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7faa011c6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa9fc0cf9c0 con 0x7fa9fc15b950 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7fa9fad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9fc0cd120 0x7fa9fc14d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7fa9fad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9fc0cd120 0x7fa9fc14d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57676/0 (socket says 172.21.15.81:57676) 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7fa9fad9d640 1 -- 172.21.15.81:0/2416402597 learned_addr learned my addr 172.21.15.81:0/2416402597 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7fa9f259c640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9fc15b570 0x7fa9fc0b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7fa9fb59e640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa9fc15b950 0x7fa9fc15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7fa9fad9d640 1 -- 172.21.15.81:0/2416402597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa9fc15b950 msgr2=0x7fa9fc15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7fa9fad9d640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa9fc15b950 0x7fa9fc15a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7fa9fad9d640 1 -- 172.21.15.81:0/2416402597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9fc15b570 msgr2=0x7fa9fc0b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7fa9fad9d640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9fc15b570 0x7fa9fc0b26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7fa9fad9d640 1 -- 172.21.15.81:0/2416402597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9fc159bb0 con 0x7fa9fc0cd120 2024-09-16T01:17:34.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7fa9f259c640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9fc15b570 0x7fa9fc0b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.413+0000 7fa9fb59e640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa9fc15b950 0x7fa9fc15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.414+0000 7fa9fad9d640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9fc0cd120 0x7fa9fc14d260 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00b4a0 tx=0x7fa9ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.414+0000 7fa9f3fff640 1 -- 172.21.15.81:0/2416402597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec014070 con 0x7fa9fc0cd120 2024-09-16T01:17:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.414+0000 7fa9f3fff640 1 -- 172.21.15.81:0/2416402597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec010610 con 0x7fa9fc0cd120 2024-09-16T01:17:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.414+0000 7fa9f3fff640 1 -- 172.21.15.81:0/2416402597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec010a00 con 0x7fa9fc0cd120 2024-09-16T01:17:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.414+0000 7faa011c6640 1 -- 172.21.15.81:0/2416402597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9fc159e90 con 0x7fa9fc0cd120 2024-09-16T01:17:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.414+0000 7faa011c6640 1 -- 172.21.15.81:0/2416402597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9fc15a450 con 0x7fa9fc0cd120 2024-09-16T01:17:34.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.415+0000 7faa011c6640 1 -- 172.21.15.81:0/2416402597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9fc068f50 con 0x7fa9fc0cd120 2024-09-16T01:17:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.415+0000 7fa9f3fff640 1 -- 172.21.15.81:0/2416402597 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa9ec017070 con 0x7fa9fc0cd120 2024-09-16T01:17:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.416+0000 7fa9f3fff640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa9dc06c2b0 0x7fa9dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.416+0000 7fa9f3fff640 1 -- 172.21.15.81:0/2416402597 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5619+0+0 (secure 0 0 0) 0x7fa9ec08ade0 con 0x7fa9fc0cd120 2024-09-16T01:17:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.416+0000 7fa9f259c640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa9dc06c2b0 0x7fa9dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.416+0000 7fa9f259c640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa9dc06c2b0 0x7fa9dc06e770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc15ee60 tx=0x7fa9e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.420+0000 7fa9f3fff640 1 -- 172.21.15.81:0/2416402597 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9fc068f50 con 0x7fa9fc0cd120 2024-09-16T01:17:34.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:34.585+0000 7faa011c6640 1 -- 172.21.15.81:0/2416402597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa9fc15d5e0 con 0x7fa9fc0cd120 2024-09-16T01:17:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.291+0000 7fa9f3fff640 1 -- 172.21.15.81:0/2416402597 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) ==== 170+0+0 (secure 0 0 0) 0x7fa9ec059630 con 0x7fa9fc0cd120 2024-09-16T01:17:35.293 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-16T01:17:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.294+0000 7faa011c6640 1 -- 172.21.15.81:0/2416402597 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa9dc06c2b0 msgr2=0x7fa9dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:35.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.294+0000 7faa011c6640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa9dc06c2b0 0x7fa9dc06e770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc15ee60 tx=0x7fa9e4009040 comp rx=0 tx=0).stop 2024-09-16T01:17:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.294+0000 7faa011c6640 1 -- 172.21.15.81:0/2416402597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9fc0cd120 msgr2=0x7fa9fc14d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.294+0000 7faa011c6640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9fc0cd120 0x7fa9fc14d260 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00b4a0 tx=0x7fa9ec00b960 comp rx=0 tx=0).stop 2024-09-16T01:17:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.295+0000 7faa011c6640 1 -- 172.21.15.81:0/2416402597 shutdown_connections 2024-09-16T01:17:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.295+0000 7faa011c6640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa9dc06c2b0 0x7fa9dc06e770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.295+0000 7faa011c6640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa9fc15b950 0x7fa9fc15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.295+0000 7faa011c6640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa9fc15b570 0x7fa9fc0b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.295+0000 7faa011c6640 1 --2- 172.21.15.81:0/2416402597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9fc0cd120 0x7fa9fc14d260 secure :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00b4a0 tx=0x7fa9ec00b960 comp rx=0 tx=0).stop 2024-09-16T01:17:35.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.295+0000 7faa011c6640 1 -- 172.21.15.81:0/2416402597 >> 172.21.15.81:0/2416402597 conn(0x7fa9fc06bdf0 msgr2=0x7fa9fc0aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:35.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.298+0000 7faa011c6640 1 -- 172.21.15.81:0/2416402597 shutdown_connections 2024-09-16T01:17:35.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.298+0000 7faa011c6640 1 -- 172.21.15.81:0/2416402597 wait complete. 2024-09-16T01:17:35.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:17:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.427+0000 7f2e5ac8d640 1 Processor -- start 2024-09-16T01:17:35.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.427+0000 7f2e5ac8d640 1 -- start start 2024-09-16T01:17:35.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e5ac8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e54072270 0x7f2e54072650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:35.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e5ac8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e5406e2d0 0x7f2e5406e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:35.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e5ac8d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e54072b90 con 0x7f2e5415fdf0 2024-09-16T01:17:35.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e5ac8d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2e540b00b0 con 0x7f2e54072270 2024-09-16T01:17:35.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e5ac8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2e54156ca0 con 0x7f2e5406e2d0 2024-09-16T01:17:35.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e58a29640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e54072270 0x7f2e54072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:35.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e58a29640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e54072270 0x7f2e54072650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57686/0 (socket says 172.21.15.81:57686) 2024-09-16T01:17:35.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e58a29640 1 -- 172.21.15.81:0/1291293254 learned_addr learned my addr 172.21.15.81:0/1291293254 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:35.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e4bfff640 1 --2- 172.21.15.81:0/1291293254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e5406e2d0 0x7f2e5406e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:35.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e58a29640 1 -- 172.21.15.81:0/1291293254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e5406e2d0 msgr2=0x7f2e5406e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:35.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e58a29640 1 --2- 172.21.15.81:0/1291293254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e5406e2d0 0x7f2e5406e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:35.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e58a29640 1 -- 172.21.15.81:0/1291293254 >> v1:172.21.15.102:6789/0 conn(0x7f2e5415fdf0 legacy=0x7f2e54160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:35.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.428+0000 7f2e58a29640 1 -- 172.21.15.81:0/1291293254 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5406ed90 con 0x7f2e54072270 2024-09-16T01:17:35.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.429+0000 7f2e58a29640 1 --2- 172.21.15.81:0/1291293254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54072270 0x7f2e54072650 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009870 tx=0x7f2e5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c039456cdf37faa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:35.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.429+0000 7f2e4b7fe640 1 -- 172.21.15.81:0/1291293254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50037070 con 0x7f2e54072270 2024-09-16T01:17:35.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.429+0000 7f2e4b7fe640 1 -- 172.21.15.81:0/1291293254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e50032440 con 0x7f2e54072270 2024-09-16T01:17:35.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.429+0000 7f2e4b7fe640 1 -- 172.21.15.81:0/1291293254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50032810 con 0x7f2e54072270 2024-09-16T01:17:35.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.430+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1291293254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54072270 msgr2=0x7f2e54072650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:35.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.430+0000 7f2e5ac8d640 1 --2- 172.21.15.81:0/1291293254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54072270 0x7f2e54072650 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009870 tx=0x7f2e5002a270 comp rx=0 tx=0).stop 2024-09-16T01:17:35.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.430+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1291293254 shutdown_connections 2024-09-16T01:17:35.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.430+0000 7f2e5ac8d640 1 --2- 172.21.15.81:0/1291293254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e5406e2d0 0x7f2e5406e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:35.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.430+0000 7f2e5ac8d640 1 --2- 172.21.15.81:0/1291293254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54072270 0x7f2e54072650 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:35.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.430+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1291293254 >> 172.21.15.81:0/1291293254 conn(0x7f2e5406bc10 msgr2=0x7f2e5406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:35.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.430+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1291293254 shutdown_connections 2024-09-16T01:17:35.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.430+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1291293254 wait complete. 2024-09-16T01:17:35.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.431+0000 7f2e5ac8d640 1 Processor -- start 2024-09-16T01:17:35.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.431+0000 7f2e5ac8d640 1 -- start start 2024-09-16T01:17:35.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5ac8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e5406e2d0 0x7f2e541f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:35.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5ac8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e54072270 0x7f2e541f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:35.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5ac8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415fdf0 0x7f2e540a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5ac8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e540cd170 con 0x7f2e5415fdf0 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5ac8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5406f350 con 0x7f2e54072270 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5ac8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5415ca20 con 0x7f2e5406e2d0 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5922a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415fdf0 0x7f2e540a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5922a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415fdf0 0x7f2e540a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57700/0 (socket says 172.21.15.81:57700) 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5922a640 1 -- 172.21.15.81:0/1558498114 learned_addr learned my addr 172.21.15.81:0/1558498114 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e58a29640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e5406e2d0 0x7f2e541f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e4bfff640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e54072270 0x7f2e541f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5922a640 1 -- 172.21.15.81:0/1558498114 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e5406e2d0 msgr2=0x7f2e541f5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5922a640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e5406e2d0 0x7f2e541f5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5922a640 1 -- 172.21.15.81:0/1558498114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e54072270 msgr2=0x7f2e541f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5922a640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e54072270 0x7f2e541f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5922a640 1 -- 172.21.15.81:0/1558498114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5415a680 con 0x7f2e5415fdf0 2024-09-16T01:17:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.432+0000 7f2e5922a640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415fdf0 0x7f2e540a9490 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00c7a0 tx=0x7f2e4c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.433+0000 7f2e497fa640 1 -- 172.21.15.81:0/1558498114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c003b70 con 0x7f2e5415fdf0 2024-09-16T01:17:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.433+0000 7f2e497fa640 1 -- 172.21.15.81:0/1558498114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e4c003d30 con 0x7f2e5415fdf0 2024-09-16T01:17:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.433+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1558498114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5415a960 con 0x7f2e5415fdf0 2024-09-16T01:17:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.433+0000 7f2e497fa640 1 -- 172.21.15.81:0/1558498114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00aa90 con 0x7f2e5415fdf0 2024-09-16T01:17:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.433+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1558498114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5415b200 con 0x7f2e5415fdf0 2024-09-16T01:17:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.434+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1558498114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e5406cba0 con 0x7f2e5415fdf0 2024-09-16T01:17:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.434+0000 7f2e497fa640 1 -- 172.21.15.81:0/1558498114 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2e4c00ac30 con 0x7f2e5415fdf0 2024-09-16T01:17:35.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.435+0000 7f2e497fa640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e4006c2b0 0x7f2e4006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.435+0000 7f2e497fa640 1 -- 172.21.15.81:0/1558498114 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6001+0+0 (secure 0 0 0) 0x7f2e4c08b460 con 0x7f2e5415fdf0 2024-09-16T01:17:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.435+0000 7f2e58a29640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e4006c2b0 0x7f2e4006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:35.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.435+0000 7f2e58a29640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e4006c2b0 0x7f2e4006e770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2e50034000 tx=0x7f2e5002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:35.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.439+0000 7f2e497fa640 1 -- 172.21.15.81:0/1558498114 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e4c059b30 con 0x7f2e5415fdf0 2024-09-16T01:17:35.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:35.637+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1558498114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2e5415b400 con 0x7f2e5415fdf0 2024-09-16T01:17:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.304+0000 7f2e497fa640 1 -- 172.21.15.81:0/1558498114 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) ==== 172+0+0 (secure 0 0 0) 0x7f2e5415b400 con 0x7f2e5415fdf0 2024-09-16T01:17:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 7 and data pool 8 2024-09-16T01:17:36.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.313+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1558498114 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e4006c2b0 msgr2=0x7f2e4006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.313+0000 7f2e5ac8d640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e4006c2b0 0x7f2e4006e770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2e50034000 tx=0x7f2e5002e000 comp rx=0 tx=0).stop 2024-09-16T01:17:36.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.313+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1558498114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415fdf0 msgr2=0x7f2e540a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.313+0000 7f2e5ac8d640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415fdf0 0x7f2e540a9490 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c00c7a0 tx=0x7f2e4c00cc60 comp rx=0 tx=0).stop 2024-09-16T01:17:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.316+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1558498114 shutdown_connections 2024-09-16T01:17:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.316+0000 7f2e5ac8d640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e4006c2b0 0x7f2e4006e770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.316+0000 7f2e5ac8d640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415fdf0 0x7f2e540a9490 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.316+0000 7f2e5ac8d640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e54072270 0x7f2e541f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.316+0000 7f2e5ac8d640 1 --2- 172.21.15.81:0/1558498114 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e5406e2d0 0x7f2e541f5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.316+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1558498114 >> 172.21.15.81:0/1558498114 conn(0x7f2e5406bc10 msgr2=0x7f2e54160240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.316+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1558498114 shutdown_connections 2024-09-16T01:17:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.317+0000 7f2e5ac8d640 1 -- 172.21.15.81:0/1558498114 wait complete. 2024-09-16T01:17:36.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:17:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.435+0000 7f124658f640 1 Processor -- start 2024-09-16T01:17:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.435+0000 7f124658f640 1 -- start start 2024-09-16T01:17:36.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.436+0000 7f124658f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f124015e740 0x7f12400d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.436+0000 7f124658f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f124009b690 0x7f124006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.436+0000 7f124658f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f124006d4c0 0x7f124006d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.436+0000 7f124658f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f124015eb20 con 0x7f124006d4c0 2024-09-16T01:17:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.436+0000 7f124658f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f124006d260 con 0x7f124015e740 2024-09-16T01:17:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.436+0000 7f124658f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f12400d0780 con 0x7f124009b690 2024-09-16T01:17:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.436+0000 7f1244b2c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f124006d4c0 0x7f124006d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.436+0000 7f1244b2c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f124006d4c0 0x7f124006d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57702/0 (socket says 172.21.15.81:57702) 2024-09-16T01:17:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.436+0000 7f1244b2c640 1 -- 172.21.15.81:0/354330635 learned_addr learned my addr 172.21.15.81:0/354330635 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.436+0000 7f123f7fe640 1 --2- 172.21.15.81:0/354330635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f124009b690 0x7f124006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.436+0000 7f123ffff640 1 --2- 172.21.15.81:0/354330635 >> v2:172.21.15.102:3300/0 conn(0x7f124015e740 0x7f12400d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.437+0000 7f1244b2c640 1 -- 172.21.15.81:0/354330635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f124009b690 msgr2=0x7f124006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.437+0000 7f1244b2c640 1 --2- 172.21.15.81:0/354330635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f124009b690 0x7f124006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.437+0000 7f1244b2c640 1 -- 172.21.15.81:0/354330635 >> v2:172.21.15.102:3300/0 conn(0x7f124015e740 msgr2=0x7f12400d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.437+0000 7f1244b2c640 1 --2- 172.21.15.81:0/354330635 >> v2:172.21.15.102:3300/0 conn(0x7f124015e740 0x7f12400d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.437+0000 7f1244b2c640 1 -- 172.21.15.81:0/354330635 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12400d0a60 con 0x7f124006d4c0 2024-09-16T01:17:36.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.437+0000 7f1244b2c640 1 --2- 172.21.15.81:0/354330635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124006d4c0 0x7f124006d8f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1240074070 tx=0x7f123802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4c5a4c0049cc4e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:36.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.438+0000 7f123effd640 1 -- 172.21.15.81:0/354330635 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238036070 con 0x7f124006d4c0 2024-09-16T01:17:36.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.438+0000 7f123effd640 1 -- 172.21.15.81:0/354330635 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1238031600 con 0x7f124006d4c0 2024-09-16T01:17:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.438+0000 7f123effd640 1 -- 172.21.15.81:0/354330635 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12380319d0 con 0x7f124006d4c0 2024-09-16T01:17:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.438+0000 7f124658f640 1 -- 172.21.15.81:0/354330635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124006d4c0 msgr2=0x7f124006d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.438+0000 7f124658f640 1 --2- 172.21.15.81:0/354330635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124006d4c0 0x7f124006d8f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1240074070 tx=0x7f123802a750 comp rx=0 tx=0).stop 2024-09-16T01:17:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.438+0000 7f124658f640 1 -- 172.21.15.81:0/354330635 shutdown_connections 2024-09-16T01:17:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.438+0000 7f124658f640 1 --2- 172.21.15.81:0/354330635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124006d4c0 0x7f124006d8f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.438+0000 7f124658f640 1 --2- 172.21.15.81:0/354330635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f124009b690 0x7f124006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.438+0000 7f124658f640 1 --2- 172.21.15.81:0/354330635 >> v2:172.21.15.102:3300/0 conn(0x7f124015e740 0x7f12400d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.438+0000 7f124658f640 1 -- 172.21.15.81:0/354330635 >> 172.21.15.81:0/354330635 conn(0x7f12400d23a0 msgr2=0x7f12400d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.438+0000 7f124658f640 1 -- 172.21.15.81:0/354330635 shutdown_connections 2024-09-16T01:17:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.438+0000 7f124658f640 1 -- 172.21.15.81:0/354330635 wait complete. 2024-09-16T01:17:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.439+0000 7f124658f640 1 Processor -- start 2024-09-16T01:17:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.440+0000 7f124658f640 1 -- start start 2024-09-16T01:17:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.440+0000 7f124658f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f124006d4c0 0x7f124009ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.440+0000 7f124658f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f124009b690 0x7f124015d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.440+0000 7f124658f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124015e740 0x7f12401f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.440+0000 7f124658f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f124009ba90 con 0x7f124015e740 2024-09-16T01:17:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.440+0000 7f124658f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f12400d1020 con 0x7f124009b690 2024-09-16T01:17:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.440+0000 7f124658f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f124006de30 con 0x7f124006d4c0 2024-09-16T01:17:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.440+0000 7f1244b2c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124015e740 0x7f12401f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.440+0000 7f1244b2c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124015e740 0x7f12401f7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57712/0 (socket says 172.21.15.81:57712) 2024-09-16T01:17:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.440+0000 7f1244b2c640 1 -- 172.21.15.81:0/2161834078 learned_addr learned my addr 172.21.15.81:0/2161834078 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.440+0000 7f123f7fe640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f124009b690 0x7f124015d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.441+0000 7f123ffff640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f124006d4c0 0x7f124009ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.441+0000 7f1244b2c640 1 -- 172.21.15.81:0/2161834078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f124006d4c0 msgr2=0x7f124009ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.441+0000 7f1244b2c640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f124006d4c0 0x7f124009ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.441+0000 7f1244b2c640 1 -- 172.21.15.81:0/2161834078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f124009b690 msgr2=0x7f124015d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.441+0000 7f1244b2c640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f124009b690 0x7f124015d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.441+0000 7f1244b2c640 1 -- 172.21.15.81:0/2161834078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124009d390 con 0x7f124015e740 2024-09-16T01:17:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.441+0000 7f1244b2c640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124015e740 0x7f12401f7f60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1238009e50 tx=0x7f1238004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.441+0000 7f123cff9640 1 -- 172.21.15.81:0/2161834078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238036050 con 0x7f124015e740 2024-09-16T01:17:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.441+0000 7f123cff9640 1 -- 172.21.15.81:0/2161834078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1238042070 con 0x7f124015e740 2024-09-16T01:17:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.441+0000 7f124658f640 1 -- 172.21.15.81:0/2161834078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124009d670 con 0x7f124015e740 2024-09-16T01:17:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.441+0000 7f123cff9640 1 -- 172.21.15.81:0/2161834078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238009510 con 0x7f124015e740 2024-09-16T01:17:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.441+0000 7f124658f640 1 -- 172.21.15.81:0/2161834078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f124009ecc0 con 0x7f124015e740 2024-09-16T01:17:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.442+0000 7f124658f640 1 -- 172.21.15.81:0/2161834078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f124006d8f0 con 0x7f124015e740 2024-09-16T01:17:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.442+0000 7f123cff9640 1 -- 172.21.15.81:0/2161834078 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1238007bf0 con 0x7f124015e740 2024-09-16T01:17:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.443+0000 7f123cff9640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f122c06c2b0 0x7f122c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.443+0000 7f123cff9640 1 -- 172.21.15.81:0/2161834078 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f12380ac2c0 con 0x7f124015e740 2024-09-16T01:17:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.443+0000 7f123ffff640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f122c06c2b0 0x7f122c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.443+0000 7f123ffff640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f122c06c2b0 0x7f122c06e770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f124009cb90 tx=0x7f1230008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:36.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.447+0000 7f123cff9640 1 -- 172.21.15.81:0/2161834078 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f123807a8a0 con 0x7f124015e740 2024-09-16T01:17:36.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.615+0000 7f124658f640 1 -- 172.21.15.81:0/2161834078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12400d1cb0 con 0x7f124015e740 2024-09-16T01:17:36.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.616+0000 7f123cff9640 1 -- 172.21.15.81:0/2161834078 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+17015 (secure 0 0 0) 0x7f12380ac0e0 con 0x7f124015e740 2024-09-16T01:17:36.618 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:36.618 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:17:35.639425+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:17:34.249166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-16T01:17:34.605034+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:17:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.618+0000 7f124658f640 1 -- 172.21.15.81:0/2161834078 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f122c06c2b0 msgr2=0x7f122c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.618+0000 7f124658f640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f122c06c2b0 0x7f122c06e770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f124009cb90 tx=0x7f1230008040 comp rx=0 tx=0).stop 2024-09-16T01:17:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.618+0000 7f124658f640 1 -- 172.21.15.81:0/2161834078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124015e740 msgr2=0x7f12401f7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.618+0000 7f124658f640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124015e740 0x7f12401f7f60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1238009e50 tx=0x7f1238004a40 comp rx=0 tx=0).stop 2024-09-16T01:17:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.618+0000 7f124658f640 1 -- 172.21.15.81:0/2161834078 shutdown_connections 2024-09-16T01:17:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.618+0000 7f124658f640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f122c06c2b0 0x7f122c06e770 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.618+0000 7f124658f640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f124015e740 0x7f12401f7f60 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.618+0000 7f124658f640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f124009b690 0x7f124015d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.618+0000 7f124658f640 1 --2- 172.21.15.81:0/2161834078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f124006d4c0 0x7f124009ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.618+0000 7f124658f640 1 -- 172.21.15.81:0/2161834078 >> 172.21.15.81:0/2161834078 conn(0x7f12400d23a0 msgr2=0x7f12400b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.618+0000 7f124658f640 1 -- 172.21.15.81:0/2161834078 shutdown_connections 2024-09-16T01:17:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.618+0000 7f124658f640 1 -- 172.21.15.81:0/2161834078 wait complete. 2024-09-16T01:17:36.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:17:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.729+0000 7f285b074640 1 Processor -- start 2024-09-16T01:17:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.729+0000 7f285b074640 1 -- start start 2024-09-16T01:17:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.730+0000 7f285b074640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f285415b300 0x7f28540cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.730+0000 7f285b074640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f285406f8d0 0x7f285415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.730+0000 7f285b074640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28540cdbe0 con 0x7f28540cd3f0 2024-09-16T01:17:36.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.730+0000 7f285b074640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f28540728a0 con 0x7f285406f8d0 2024-09-16T01:17:36.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.730+0000 7f285b074640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f28540cd900 con 0x7f285415b300 2024-09-16T01:17:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.730+0000 7f2858e10640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f285415b300 0x7f28540cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.730+0000 7f2859611640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f285406f8d0 0x7f285415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.730+0000 7f2853fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f28540cd3f0 0x7f285406f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:60764/0 (socket says 172.21.15.81:60764) 2024-09-16T01:17:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.730+0000 7f2853fff640 1 -- 172.21.15.81:0/1440321703 learned_addr learned my addr 172.21.15.81:0/1440321703 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.731+0000 7f2858e10640 1 -- 172.21.15.81:0/1440321703 >> v2:172.21.15.102:3300/0 conn(0x7f285406f8d0 msgr2=0x7f285415b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.731+0000 7f2858e10640 1 --2- 172.21.15.81:0/1440321703 >> v2:172.21.15.102:3300/0 conn(0x7f285406f8d0 0x7f285415b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.731+0000 7f2858e10640 1 -- 172.21.15.81:0/1440321703 >> v1:172.21.15.102:6789/0 conn(0x7f28540cd3f0 legacy=0x7f285406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.731+0000 7f2858e10640 1 -- 172.21.15.81:0/1440321703 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2854072250 con 0x7f285415b300 2024-09-16T01:17:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.731+0000 7f28537fe640 1 -- 172.21.15.81:0/1440321703 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828940939 0 0) 0x7f28540cdbe0 con 0x7f28540cd3f0 2024-09-16T01:17:36.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.731+0000 7f2858e10640 1 --2- 172.21.15.81:0/1440321703 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f285415b300 0x7f28540cceb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f28480097a0 tx=0x7f284802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=521e56754304794c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:36.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.731+0000 7f28537fe640 1 -- 172.21.15.81:0/1440321703 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2848037070 con 0x7f285415b300 2024-09-16T01:17:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.732+0000 7f28537fe640 1 -- 172.21.15.81:0/1440321703 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2848032440 con 0x7f285415b300 2024-09-16T01:17:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.732+0000 7f28537fe640 1 -- 172.21.15.81:0/1440321703 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2848032810 con 0x7f285415b300 2024-09-16T01:17:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.732+0000 7f285b074640 1 -- 172.21.15.81:0/1440321703 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f285415b300 msgr2=0x7f28540cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.732+0000 7f285b074640 1 --2- 172.21.15.81:0/1440321703 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f285415b300 0x7f28540cceb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f28480097a0 tx=0x7f284802a180 comp rx=0 tx=0).stop 2024-09-16T01:17:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.732+0000 7f285b074640 1 -- 172.21.15.81:0/1440321703 shutdown_connections 2024-09-16T01:17:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.732+0000 7f285b074640 1 --2- 172.21.15.81:0/1440321703 >> v2:172.21.15.102:3300/0 conn(0x7f285406f8d0 0x7f285415b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.732+0000 7f285b074640 1 --2- 172.21.15.81:0/1440321703 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f285415b300 0x7f28540cceb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.732+0000 7f285b074640 1 -- 172.21.15.81:0/1440321703 >> 172.21.15.81:0/1440321703 conn(0x7f2854067d70 msgr2=0x7f285406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.732+0000 7f285b074640 1 -- 172.21.15.81:0/1440321703 shutdown_connections 2024-09-16T01:17:36.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.732+0000 7f285b074640 1 -- 172.21.15.81:0/1440321703 wait complete. 2024-09-16T01:17:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.733+0000 7f285b074640 1 Processor -- start 2024-09-16T01:17:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.733+0000 7f285b074640 1 -- start start 2024-09-16T01:17:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.734+0000 7f285b074640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f285406f8d0 0x7f285415c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.734+0000 7f285b074640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28540cd3f0 0x7f28540cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.734+0000 7f285b074640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285415b300 0x7f28540cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.734+0000 7f285b074640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28540d0160 con 0x7f285406f8d0 2024-09-16T01:17:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.734+0000 7f285b074640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f28540cffe0 con 0x7f285415b300 2024-09-16T01:17:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.734+0000 7f285b074640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2854072d30 con 0x7f28540cd3f0 2024-09-16T01:17:36.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.734+0000 7f2858e10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f285406f8d0 0x7f285415c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.734+0000 7f2858e10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f285406f8d0 0x7f285415c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57716/0 (socket says 172.21.15.81:57716) 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.734+0000 7f2858e10640 1 -- 172.21.15.81:0/4074196851 learned_addr learned my addr 172.21.15.81:0/4074196851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.734+0000 7f2853fff640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28540cd3f0 0x7f28540cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.734+0000 7f2859611640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285415b300 0x7f28540cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.735+0000 7f2858e10640 1 -- 172.21.15.81:0/4074196851 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28540cd3f0 msgr2=0x7f28540cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.735+0000 7f2858e10640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28540cd3f0 0x7f28540cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.735+0000 7f2858e10640 1 -- 172.21.15.81:0/4074196851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285415b300 msgr2=0x7f28540cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.735+0000 7f2858e10640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285415b300 0x7f28540cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.735+0000 7f2858e10640 1 -- 172.21.15.81:0/4074196851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285415b930 con 0x7f285406f8d0 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.735+0000 7f2858e10640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f285406f8d0 0x7f285415c9d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f28480097a0 tx=0x7f28480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.735+0000 7f28517fa640 1 -- 172.21.15.81:0/4074196851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2848037040 con 0x7f285406f8d0 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.735+0000 7f28517fa640 1 -- 172.21.15.81:0/4074196851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2848004230 con 0x7f285406f8d0 2024-09-16T01:17:36.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.735+0000 7f285b074640 1 -- 172.21.15.81:0/4074196851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f285415bc10 con 0x7f285406f8d0 2024-09-16T01:17:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.735+0000 7f28517fa640 1 -- 172.21.15.81:0/4074196851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2848003610 con 0x7f285406f8d0 2024-09-16T01:17:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.735+0000 7f285b074640 1 -- 172.21.15.81:0/4074196851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f285415c1d0 con 0x7f285406f8d0 2024-09-16T01:17:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.736+0000 7f285b074640 1 -- 172.21.15.81:0/4074196851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28540c6b80 con 0x7f285406f8d0 2024-09-16T01:17:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.736+0000 7f28517fa640 1 -- 172.21.15.81:0/4074196851 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f28480037b0 con 0x7f285406f8d0 2024-09-16T01:17:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.737+0000 7f28517fa640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f283806c2b0 0x7f283806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:36.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.737+0000 7f2853fff640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f283806c2b0 0x7f283806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:36.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.737+0000 7f28517fa640 1 -- 172.21.15.81:0/4074196851 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f28480ac5d0 con 0x7f285406f8d0 2024-09-16T01:17:36.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.737+0000 7f2853fff640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f283806c2b0 0x7f283806e770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f28540b2b40 tx=0x7f2840007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:36.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.741+0000 7f28517fa640 1 -- 172.21.15.81:0/4074196851 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f284807a710 con 0x7f285406f8d0 2024-09-16T01:17:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.909+0000 7f285b074640 1 -- 172.21.15.81:0/4074196851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28540c5e10 con 0x7f285406f8d0 2024-09-16T01:17:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.910+0000 7f28517fa640 1 -- 172.21.15.81:0/4074196851 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+17015 (secure 0 0 0) 0x7f284807ea10 con 0x7f285406f8d0 2024-09-16T01:17:36.912 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:36.912 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:17:35.639425+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:17:34.249166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-16T01:17:34.605034+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:17:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.912+0000 7f285b074640 1 -- 172.21.15.81:0/4074196851 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f283806c2b0 msgr2=0x7f283806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.912+0000 7f285b074640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f283806c2b0 0x7f283806e770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f28540b2b40 tx=0x7f2840007d50 comp rx=0 tx=0).stop 2024-09-16T01:17:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.912+0000 7f285b074640 1 -- 172.21.15.81:0/4074196851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f285406f8d0 msgr2=0x7f285415c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.912+0000 7f285b074640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f285406f8d0 0x7f285415c9d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f28480097a0 tx=0x7f28480046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.912+0000 7f285b074640 1 -- 172.21.15.81:0/4074196851 shutdown_connections 2024-09-16T01:17:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.912+0000 7f285b074640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f283806c2b0 0x7f283806e770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.912+0000 7f285b074640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f285415b300 0x7f28540cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.912+0000 7f285b074640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28540cd3f0 0x7f28540cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.912+0000 7f285b074640 1 --2- 172.21.15.81:0/4074196851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f285406f8d0 0x7f285415c9d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.912+0000 7f285b074640 1 -- 172.21.15.81:0/4074196851 >> 172.21.15.81:0/4074196851 conn(0x7f2854067d70 msgr2=0x7f28540c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.912+0000 7f285b074640 1 -- 172.21.15.81:0/4074196851 shutdown_connections 2024-09-16T01:17:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:36.912+0000 7f285b074640 1 -- 172.21.15.81:0/4074196851 wait complete. 2024-09-16T01:17:36.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:17:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.025+0000 7f9115da6640 1 Processor -- start 2024-09-16T01:17:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.025+0000 7f9115da6640 1 -- start start 2024-09-16T01:17:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.025+0000 7f9115da6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9110162340 0x7f911006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.025+0000 7f9115da6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f91100cf280 0x7f9110162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.025+0000 7f9115da6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f911015ff70 con 0x7f9110162c60 2024-09-16T01:17:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.025+0000 7f9115da6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f911006de90 con 0x7f9110162340 2024-09-16T01:17:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.025+0000 7f9115da6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f91100d4d10 con 0x7f91100cf280 2024-09-16T01:17:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.026+0000 7f910f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9110162340 0x7f911006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.026+0000 7f910f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9110162340 0x7f911006d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57728/0 (socket says 172.21.15.81:57728) 2024-09-16T01:17:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.026+0000 7f910f7fe640 1 -- 172.21.15.81:0/1826847847 learned_addr learned my addr 172.21.15.81:0/1826847847 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.026+0000 7f9106ffd640 1 --2- 172.21.15.81:0/1826847847 >> v2:172.21.15.102:3300/0 conn(0x7f91100cf280 0x7f9110162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.026+0000 7f910f7fe640 1 -- 172.21.15.81:0/1826847847 >> v2:172.21.15.102:3300/0 conn(0x7f91100cf280 msgr2=0x7f9110162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.026+0000 7f910f7fe640 1 --2- 172.21.15.81:0/1826847847 >> v2:172.21.15.102:3300/0 conn(0x7f91100cf280 0x7f9110162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.026+0000 7f910f7fe640 1 -- 172.21.15.81:0/1826847847 >> v1:172.21.15.102:6789/0 conn(0x7f9110162c60 legacy=0x7f91100d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.026+0000 7f910f7fe640 1 -- 172.21.15.81:0/1826847847 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91100d4ff0 con 0x7f9110162340 2024-09-16T01:17:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.027+0000 7f910f7fe640 1 --2- 172.21.15.81:0/1826847847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9110162340 0x7f911006d740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f91100a23d0 tx=0x7f910002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25683fc6a8c5ac8c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.027+0000 7f910effd640 1 -- 172.21.15.81:0/1826847847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100037070 con 0x7f9110162340 2024-09-16T01:17:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.027+0000 7f910effd640 1 -- 172.21.15.81:0/1826847847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9100032440 con 0x7f9110162340 2024-09-16T01:17:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.027+0000 7f910effd640 1 -- 172.21.15.81:0/1826847847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100032810 con 0x7f9110162340 2024-09-16T01:17:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.027+0000 7f9115da6640 1 -- 172.21.15.81:0/1826847847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9110162340 msgr2=0x7f911006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.027+0000 7f9115da6640 1 --2- 172.21.15.81:0/1826847847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9110162340 0x7f911006d740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f91100a23d0 tx=0x7f910002a1e0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.027+0000 7f9115da6640 1 -- 172.21.15.81:0/1826847847 shutdown_connections 2024-09-16T01:17:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.027+0000 7f9115da6640 1 --2- 172.21.15.81:0/1826847847 >> v2:172.21.15.102:3300/0 conn(0x7f91100cf280 0x7f9110162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.027+0000 7f9115da6640 1 --2- 172.21.15.81:0/1826847847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9110162340 0x7f911006d740 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.027+0000 7f9115da6640 1 -- 172.21.15.81:0/1826847847 >> 172.21.15.81:0/1826847847 conn(0x7f911008bfc0 msgr2=0x7f91100d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.027+0000 7f9115da6640 1 -- 172.21.15.81:0/1826847847 shutdown_connections 2024-09-16T01:17:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.027+0000 7f9115da6640 1 -- 172.21.15.81:0/1826847847 wait complete. 2024-09-16T01:17:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.028+0000 7f9115da6640 1 Processor -- start 2024-09-16T01:17:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.029+0000 7f9115da6640 1 -- start start 2024-09-16T01:17:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.029+0000 7f9115da6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91100cf280 0x7f9110154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.029+0000 7f9115da6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9110162340 0x7f91100cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.029+0000 7f9115da6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9110162c60 0x7f91100b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.029+0000 7f9115da6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91100cf6c0 con 0x7f91100cf280 2024-09-16T01:17:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.029+0000 7f9115da6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f91100d52d0 con 0x7f9110162c60 2024-09-16T01:17:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.029+0000 7f9115da6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f91101630d0 con 0x7f9110162340 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.029+0000 7f910f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91100cf280 0x7f9110154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f910f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91100cf280 0x7f9110154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57740/0 (socket says 172.21.15.81:57740) 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f910f7fe640 1 -- 172.21.15.81:0/3794435679 learned_addr learned my addr 172.21.15.81:0/3794435679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f910ffff640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9110162c60 0x7f91100b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f9106ffd640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9110162340 0x7f91100cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f910f7fe640 1 -- 172.21.15.81:0/3794435679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9110162340 msgr2=0x7f91100cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f910f7fe640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9110162340 0x7f91100cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f910f7fe640 1 -- 172.21.15.81:0/3794435679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9110162c60 msgr2=0x7f91100b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f910f7fe640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9110162c60 0x7f91100b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f910f7fe640 1 -- 172.21.15.81:0/3794435679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91100c80a0 con 0x7f91100cf280 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f9106ffd640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9110162340 0x7f91100cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f910f7fe640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91100cf280 0x7f9110154160 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f910002a220 tx=0x7f91000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f910cff9640 1 -- 172.21.15.81:0/3794435679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100041020 con 0x7f91100cf280 2024-09-16T01:17:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f910cff9640 1 -- 172.21.15.81:0/3794435679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91000306c0 con 0x7f91100cf280 2024-09-16T01:17:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f9115da6640 1 -- 172.21.15.81:0/3794435679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91101546a0 con 0x7f91100cf280 2024-09-16T01:17:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f910cff9640 1 -- 172.21.15.81:0/3794435679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9100037040 con 0x7f91100cf280 2024-09-16T01:17:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.030+0000 7f9115da6640 1 -- 172.21.15.81:0/3794435679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91100b5fe0 con 0x7f91100cf280 2024-09-16T01:17:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.031+0000 7f9115da6640 1 -- 172.21.15.81:0/3794435679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9110162720 con 0x7f91100cf280 2024-09-16T01:17:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.032+0000 7f910cff9640 1 -- 172.21.15.81:0/3794435679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9100044020 con 0x7f91100cf280 2024-09-16T01:17:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.032+0000 7f910cff9640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f90f006c2e0 0x7f90f006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.032+0000 7f9106ffd640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f90f006c2e0 0x7f90f006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.032+0000 7f910cff9640 1 -- 172.21.15.81:0/3794435679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6101+0+0 (secure 0 0 0) 0x7f91000abca0 con 0x7f91100cf280 2024-09-16T01:17:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.033+0000 7f9106ffd640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f90f006c2e0 0x7f90f006e7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91100b6fc0 tx=0x7f90f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.036+0000 7f910cff9640 1 -- 172.21.15.81:0/3794435679 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f910004b030 con 0x7f91100cf280 2024-09-16T01:17:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.237+0000 7f9115da6640 1 -- 172.21.15.81:0/3794435679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f911008e640 con 0x7f91100cf280 2024-09-16T01:17:37.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.309+0000 7f910cff9640 1 -- 172.21.15.81:0/3794435679 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) ==== 118+0+0 (secure 0 0 0) 0x7f910007a310 con 0x7f91100cf280 2024-09-16T01:17:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.312+0000 7f9115da6640 1 -- 172.21.15.81:0/3794435679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f90f006c2e0 msgr2=0x7f90f006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.312+0000 7f9115da6640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f90f006c2e0 0x7f90f006e7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f91100b6fc0 tx=0x7f90f8008040 comp rx=0 tx=0).stop 2024-09-16T01:17:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.312+0000 7f9115da6640 1 -- 172.21.15.81:0/3794435679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91100cf280 msgr2=0x7f9110154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.312+0000 7f9115da6640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91100cf280 0x7f9110154160 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f910002a220 tx=0x7f91000046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.312+0000 7f9115da6640 1 -- 172.21.15.81:0/3794435679 shutdown_connections 2024-09-16T01:17:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.312+0000 7f9115da6640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f90f006c2e0 0x7f90f006e7a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.312+0000 7f9115da6640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9110162c60 0x7f91100b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.312+0000 7f9115da6640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9110162340 0x7f91100cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.312+0000 7f9115da6640 1 --2- 172.21.15.81:0/3794435679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91100cf280 0x7f9110154160 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.312+0000 7f9115da6640 1 -- 172.21.15.81:0/3794435679 >> 172.21.15.81:0/3794435679 conn(0x7f911008bfc0 msgr2=0x7f911006e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.312+0000 7f9115da6640 1 -- 172.21.15.81:0/3794435679 shutdown_connections 2024-09-16T01:17:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.312+0000 7f9115da6640 1 -- 172.21.15.81:0/3794435679 wait complete. 2024-09-16T01:17:37.325 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T01:17:37.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:17:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.424+0000 7f1f08fe4640 1 Processor -- start 2024-09-16T01:17:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.425+0000 7f1f08fe4640 1 -- start start 2024-09-16T01:17:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.425+0000 7f1f08fe4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f0415e7f0 0x7f1f040b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.426+0000 7f1f08fe4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f040af210 0x7f1f04070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.426+0000 7f1f08fe4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f0406cdc0 con 0x7f1f040b7250 2024-09-16T01:17:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.426+0000 7f1f08fe4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1f0406d0a0 con 0x7f1f0415e7f0 2024-09-16T01:17:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.426+0000 7f1f08fe4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0406d380 con 0x7f1f040af210 2024-09-16T01:17:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.426+0000 7f1f0259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f0415e7f0 0x7f1f040b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.426+0000 7f1f0259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f0415e7f0 0x7f1f040b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57752/0 (socket says 172.21.15.81:57752) 2024-09-16T01:17:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.426+0000 7f1f0259c640 1 -- 172.21.15.81:0/195833861 learned_addr learned my addr 172.21.15.81:0/195833861 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.426+0000 7f1f01d9b640 1 --2- 172.21.15.81:0/195833861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f040af210 0x7f1f04070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.426+0000 7f1f0259c640 1 -- 172.21.15.81:0/195833861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f040af210 msgr2=0x7f1f04070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:37.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.426+0000 7f1f0259c640 1 --2- 172.21.15.81:0/195833861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f040af210 0x7f1f04070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.426+0000 7f1f0259c640 1 -- 172.21.15.81:0/195833861 >> v1:172.21.15.102:6789/0 conn(0x7f1f040b7250 legacy=0x7f1f0409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:37.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.426+0000 7f1f0259c640 1 -- 172.21.15.81:0/195833861 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0406d660 con 0x7f1f0415e7f0 2024-09-16T01:17:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.427+0000 7f1f0259c640 1 --2- 172.21.15.81:0/195833861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0415e7f0 0x7f1f040b6d10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1eec009870 tx=0x7f1eec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0c64878909c66f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.427+0000 7f1f0159a640 1 -- 172.21.15.81:0/195833861 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec037070 con 0x7f1f0415e7f0 2024-09-16T01:17:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.427+0000 7f1f0159a640 1 -- 172.21.15.81:0/195833861 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eec032440 con 0x7f1f0415e7f0 2024-09-16T01:17:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.427+0000 7f1f0159a640 1 -- 172.21.15.81:0/195833861 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec032810 con 0x7f1f0415e7f0 2024-09-16T01:17:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.427+0000 7f1f08fe4640 1 -- 172.21.15.81:0/195833861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0415e7f0 msgr2=0x7f1f040b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.427+0000 7f1f08fe4640 1 --2- 172.21.15.81:0/195833861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0415e7f0 0x7f1f040b6d10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1eec009870 tx=0x7f1eec02a270 comp rx=0 tx=0).stop 2024-09-16T01:17:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.427+0000 7f1f08fe4640 1 -- 172.21.15.81:0/195833861 shutdown_connections 2024-09-16T01:17:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.427+0000 7f1f08fe4640 1 --2- 172.21.15.81:0/195833861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f040af210 0x7f1f04070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.427+0000 7f1f08fe4640 1 --2- 172.21.15.81:0/195833861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0415e7f0 0x7f1f040b6d10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.427+0000 7f1f08fe4640 1 -- 172.21.15.81:0/195833861 >> 172.21.15.81:0/195833861 conn(0x7f1f040b3f30 msgr2=0x7f1f040b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.427+0000 7f1f08fe4640 1 -- 172.21.15.81:0/195833861 shutdown_connections 2024-09-16T01:17:37.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.428+0000 7f1f08fe4640 1 -- 172.21.15.81:0/195833861 wait complete. 2024-09-16T01:17:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.429+0000 7f1f08fe4640 1 Processor -- start 2024-09-16T01:17:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.429+0000 7f1f08fe4640 1 -- start start 2024-09-16T01:17:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.429+0000 7f1f08fe4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f040af210 0x7f1f041529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.429+0000 7f1f08fe4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f040b7250 0x7f1f041e8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f08fe4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0415e7f0 0x7f1f0415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f08fe4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f04070fb0 con 0x7f1f0415e7f0 2024-09-16T01:17:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f08fe4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f040b6150 con 0x7f1f040b7250 2024-09-16T01:17:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f08fe4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1f04071130 con 0x7f1f040af210 2024-09-16T01:17:37.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f02d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0415e7f0 0x7f1f0415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f02d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0415e7f0 0x7f1f0415cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57758/0 (socket says 172.21.15.81:57758) 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f02d9d640 1 -- 172.21.15.81:0/271424135 learned_addr learned my addr 172.21.15.81:0/271424135 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f0259c640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f040af210 0x7f1f041529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f01d9b640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f040b7250 0x7f1f041e8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f02d9d640 1 -- 172.21.15.81:0/271424135 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f040af210 msgr2=0x7f1f041529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f02d9d640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f040af210 0x7f1f041529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f02d9d640 1 -- 172.21.15.81:0/271424135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f040b7250 msgr2=0x7f1f041e8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f02d9d640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f040b7250 0x7f1f041e8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f02d9d640 1 -- 172.21.15.81:0/271424135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f040cd090 con 0x7f1f0415e7f0 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f02d9d640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0415e7f0 0x7f1f0415cbf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00c730 tx=0x7f1efc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1efaffd640 1 -- 172.21.15.81:0/271424135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc003b70 con 0x7f1f0415e7f0 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1efaffd640 1 -- 172.21.15.81:0/271424135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1efc003d10 con 0x7f1f0415e7f0 2024-09-16T01:17:37.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1efaffd640 1 -- 172.21.15.81:0/271424135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00aa90 con 0x7f1f0415e7f0 2024-09-16T01:17:37.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f08fe4640 1 -- 172.21.15.81:0/271424135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f040cd370 con 0x7f1f0415e7f0 2024-09-16T01:17:37.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.430+0000 7f1f08fe4640 1 -- 172.21.15.81:0/271424135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f040cd930 con 0x7f1f0415e7f0 2024-09-16T01:17:37.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.431+0000 7f1f08fe4640 1 -- 172.21.15.81:0/271424135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f04070a70 con 0x7f1f0415e7f0 2024-09-16T01:17:37.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.432+0000 7f1efaffd640 1 -- 172.21.15.81:0/271424135 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1efc00ac30 con 0x7f1f0415e7f0 2024-09-16T01:17:37.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.432+0000 7f1efaffd640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ee406c2b0 0x7f1ee406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:37.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.432+0000 7f1f0259c640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ee406c2b0 0x7f1ee406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:37.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.432+0000 7f1efaffd640 1 -- 172.21.15.81:0/271424135 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f1efc08b340 con 0x7f1f0415e7f0 2024-09-16T01:17:37.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.433+0000 7f1f0259c640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ee406c2b0 0x7f1ee406e770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1eec034000 tx=0x7f1eec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:37.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.437+0000 7f1efaffd640 1 -- 172.21.15.81:0/271424135 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1efc0592d0 con 0x7f1f0415e7f0 2024-09-16T01:17:37.564 INFO:tasks.ceph.mds.b.smithi102.stderr:2024-09-16T01:17:37.563+0000 7f0cae328640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:17:37.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:37.636+0000 7f1f08fe4640 1 -- 172.21.15.81:0/271424135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1f040b31e0 con 0x7f1f0415e7f0 2024-09-16T01:17:38.243 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:17:38.246 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:17:38.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.317+0000 7f1efaffd640 1 -- 172.21.15.81:0/271424135 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f1efc05d5d0 con 0x7f1f0415e7f0 2024-09-16T01:17:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.319+0000 7f1f08fe4640 1 -- 172.21.15.81:0/271424135 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ee406c2b0 msgr2=0x7f1ee406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.319+0000 7f1f08fe4640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ee406c2b0 0x7f1ee406e770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1eec034000 tx=0x7f1eec02e000 comp rx=0 tx=0).stop 2024-09-16T01:17:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.319+0000 7f1f08fe4640 1 -- 172.21.15.81:0/271424135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0415e7f0 msgr2=0x7f1f0415cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.319+0000 7f1f08fe4640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0415e7f0 0x7f1f0415cbf0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00c730 tx=0x7f1efc00cbf0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.320+0000 7f1f08fe4640 1 -- 172.21.15.81:0/271424135 shutdown_connections 2024-09-16T01:17:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.320+0000 7f1f08fe4640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ee406c2b0 0x7f1ee406e770 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.320+0000 7f1f08fe4640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f0415e7f0 0x7f1f0415cbf0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.320+0000 7f1f08fe4640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f040b7250 0x7f1f041e8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.320+0000 7f1f08fe4640 1 --2- 172.21.15.81:0/271424135 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f040af210 0x7f1f041529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.320+0000 7f1f08fe4640 1 -- 172.21.15.81:0/271424135 >> 172.21.15.81:0/271424135 conn(0x7f1f040b3f30 msgr2=0x7f1f040b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.320+0000 7f1f08fe4640 1 -- 172.21.15.81:0/271424135 shutdown_connections 2024-09-16T01:17:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.320+0000 7f1f08fe4640 1 -- 172.21.15.81:0/271424135 wait complete. 2024-09-16T01:17:38.334 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:17:38.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:38.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.474+0000 7f57d3f91640 1 Processor -- start 2024-09-16T01:17:38.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.475+0000 7f57d3f91640 1 -- start start 2024-09-16T01:17:38.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.475+0000 7f57d3f91640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f57cc0b6680 0x7f57cc169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.475+0000 7f57d3f91640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57cc06d9f0 con 0x7f57cc161c80 2024-09-16T01:17:38.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.475+0000 7f57d3f91640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57cc06dcd0 con 0x7f57cc162060 2024-09-16T01:17:38.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.475+0000 7f57d3f91640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f57cc06dfb0 con 0x7f57cc0b6680 2024-09-16T01:17:38.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d1d2d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f57cc161c80 0x7f57cc06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60442/0 (socket says 172.21.15.81:60442) 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d1d2d640 1 -- 172.21.15.81:0/1501638241 learned_addr learned my addr 172.21.15.81:0/1501638241 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d252e640 1 --2- 172.21.15.81:0/1501638241 >> v2:172.21.15.102:3300/0 conn(0x7f57cc0b6680 0x7f57cc169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528637111 0 0) 0x7f57cc06d9f0 con 0x7f57cc161c80 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57b8003520 con 0x7f57cc161c80 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1372427701 0 0) 0x7f57b8003520 con 0x7f57cc161c80 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 >> v2:172.21.15.102:3300/0 conn(0x7f57cc0b6680 msgr2=0x7f57cc169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 --2- 172.21.15.81:0/1501638241 >> v2:172.21.15.102:3300/0 conn(0x7f57cc0b6680 0x7f57cc169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 >> v1:172.21.15.102:6789/0 conn(0x7f57cc162060 legacy=0x7f57cc0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57cc0d01f0 con 0x7f57cc161c80 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f57c8001670 con 0x7f57cc161c80 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 >> v1:172.21.15.81:6789/0 conn(0x7f57cc161c80 legacy=0x7f57cc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 --2- 172.21.15.81:0/1501638241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b80039b0 0x7f57b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 --2- 172.21.15.81:0/1501638241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57b80043b0 0x7f57b8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 --2- 172.21.15.81:0/1501638241 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f57b8005080 0x7f57b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f57cc06dfb0 con 0x7f57b80039b0 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f57b800bfe0 con 0x7f57b80043b0 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f57b800c1e0 con 0x7f57b8005080 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d1d2d640 1 --2- 172.21.15.81:0/1501638241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b80039b0 0x7f57b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d252e640 1 --2- 172.21.15.81:0/1501638241 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f57b8005080 0x7f57b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d152c640 1 --2- 172.21.15.81:0/1501638241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57b80043b0 0x7f57b8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d1d2d640 1 -- 172.21.15.81:0/1501638241 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f57b8005080 msgr2=0x7f57b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d1d2d640 1 --2- 172.21.15.81:0/1501638241 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f57b8005080 0x7f57b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d1d2d640 1 -- 172.21.15.81:0/1501638241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57b80043b0 msgr2=0x7f57b8004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d1d2d640 1 --2- 172.21.15.81:0/1501638241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57b80043b0 0x7f57b8004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d1d2d640 1 -- 172.21.15.81:0/1501638241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b8003520 con 0x7f57b80039b0 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.476+0000 7f57d252e640 1 -- 172.21.15.81:0/1501638241 reap_dead start 2024-09-16T01:17:38.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.477+0000 7f57d1d2d640 1 --2- 172.21.15.81:0/1501638241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b80039b0 0x7f57b8003d90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c290 tx=0x7f57b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96eb480385df01dc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:38.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.477+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8007d50 con 0x7f57b80039b0 2024-09-16T01:17:38.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.477+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c8005af0 con 0x7f57b80039b0 2024-09-16T01:17:38.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.477+0000 7f57d0d2b640 1 -- 172.21.15.81:0/1501638241 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c8007070 con 0x7f57b80039b0 2024-09-16T01:17:38.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.478+0000 7f57d3f91640 1 -- 172.21.15.81:0/1501638241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b80039b0 msgr2=0x7f57b8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.478+0000 7f57d3f91640 1 --2- 172.21.15.81:0/1501638241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b80039b0 0x7f57b8003d90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c290 tx=0x7f57b8005830 comp rx=0 tx=0).stop 2024-09-16T01:17:38.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.478+0000 7f57d3f91640 1 -- 172.21.15.81:0/1501638241 shutdown_connections 2024-09-16T01:17:38.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.478+0000 7f57d3f91640 1 --2- 172.21.15.81:0/1501638241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b80039b0 0x7f57b8003d90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.478+0000 7f57d3f91640 1 -- 172.21.15.81:0/1501638241 >> 172.21.15.81:0/1501638241 conn(0x7f57cc0d44f0 msgr2=0x7f57cc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:38.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.478+0000 7f57d3f91640 1 -- 172.21.15.81:0/1501638241 shutdown_connections 2024-09-16T01:17:38.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.478+0000 7f57d3f91640 1 -- 172.21.15.81:0/1501638241 wait complete. 2024-09-16T01:17:38.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.479+0000 7f57d3f91640 1 Processor -- start 2024-09-16T01:17:38.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.479+0000 7f57d3f91640 1 -- start start 2024-09-16T01:17:38.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d3f91640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57b80039b0 0x7f57cc1f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d3f91640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57cc0b2450 0x7f57cc1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d3f91640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f57cc0b28d0 0x7f57cc159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d3f91640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f57cc0b6b30 con 0x7f57cc0b2450 2024-09-16T01:17:38.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d3f91640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f57cc0d2aa0 con 0x7f57b80039b0 2024-09-16T01:17:38.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d3f91640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f57cc0b6cb0 con 0x7f57cc0b28d0 2024-09-16T01:17:38.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d152c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57cc0b2450 0x7f57cc1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d152c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57cc0b2450 0x7f57cc1595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57780/0 (socket says 172.21.15.81:57780) 2024-09-16T01:17:38.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d152c640 1 -- 172.21.15.81:0/2861980328 learned_addr learned my addr 172.21.15.81:0/2861980328 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:38.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d1d2d640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57b80039b0 0x7f57cc1f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d252e640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f57cc0b28d0 0x7f57cc159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d152c640 1 -- 172.21.15.81:0/2861980328 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f57cc0b28d0 msgr2=0x7f57cc159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d152c640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f57cc0b28d0 0x7f57cc159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d152c640 1 -- 172.21.15.81:0/2861980328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57b80039b0 msgr2=0x7f57cc1f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d152c640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57b80039b0 0x7f57cc1f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d152c640 1 -- 172.21.15.81:0/2861980328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57cc1f5190 con 0x7f57cc0b2450 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.480+0000 7f57d152c640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57cc0b2450 0x7f57cc1595d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00e5b0 tx=0x7f57bc00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.481+0000 7f57c27fc640 1 -- 172.21.15.81:0/2861980328 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0052e0 con 0x7f57cc0b2450 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.481+0000 7f57c27fc640 1 -- 172.21.15.81:0/2861980328 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57bc018070 con 0x7f57cc0b2450 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.481+0000 7f57d3f91640 1 -- 172.21.15.81:0/2861980328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57cc0ccc80 con 0x7f57cc0b2450 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.481+0000 7f57c27fc640 1 -- 172.21.15.81:0/2861980328 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57bc003830 con 0x7f57cc0b2450 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.481+0000 7f57d3f91640 1 -- 172.21.15.81:0/2861980328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57cc0cd240 con 0x7f57cc0b2450 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.482+0000 7f57d3f91640 1 -- 172.21.15.81:0/2861980328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57cc0b5f70 con 0x7f57cc0b2450 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.482+0000 7f57c27fc640 1 -- 172.21.15.81:0/2861980328 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f57bc0039d0 con 0x7f57cc0b2450 2024-09-16T01:17:38.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.483+0000 7f57c27fc640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f57b006c2b0 0x7f57b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.483+0000 7f57c27fc640 1 -- 172.21.15.81:0/2861980328 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f57bc08b1b0 con 0x7f57cc0b2450 2024-09-16T01:17:38.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.483+0000 7f57d1d2d640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f57b006c2b0 0x7f57b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.483+0000 7f57d1d2d640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f57b006c2b0 0x7f57b006e770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f57c8032000 tx=0x7f57c802d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:38.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.487+0000 7f57c27fc640 1 -- 172.21.15.81:0/2861980328 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57bc059290 con 0x7f57cc0b2450 2024-09-16T01:17:38.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.688+0000 7f57d3f91640 1 -- 172.21.15.81:0/2861980328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57cc0b3cb0 con 0x7f57cc0b2450 2024-09-16T01:17:38.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.688+0000 7f57c27fc640 1 -- 172.21.15.81:0/2861980328 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f57bc05d590 con 0x7f57cc0b2450 2024-09-16T01:17:38.690 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:38.690 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"btime":"2024-09-16T01:17:38:311750+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3508058089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3508058089},{"type":"v1","addr":"172.21.15.102:6835","nonce":3508058089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5349,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/763632631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":763632631},{"type":"v1","addr":"172.21.15.81:6835","nonce":763632631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3139124613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3139124613},{"type":"v1","addr":"172.21.15.81:6837","nonce":3139124613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:17:35.639749+0000","modified":"2024-09-16T01:17:37.638233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/52529574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":52529574},{"type":"v1","addr":"172.21.15.102:6834","nonce":52529574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5361,"qdb_cluster":[5361]},"id":3}]} 2024-09-16T01:17:38.690 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-16T01:17:38.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.690+0000 7f57d3f91640 1 -- 172.21.15.81:0/2861980328 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f57b006c2b0 msgr2=0x7f57b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.690+0000 7f57d3f91640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f57b006c2b0 0x7f57b006e770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f57c8032000 tx=0x7f57c802d000 comp rx=0 tx=0).stop 2024-09-16T01:17:38.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.690+0000 7f57d3f91640 1 -- 172.21.15.81:0/2861980328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57cc0b2450 msgr2=0x7f57cc1595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.690+0000 7f57d3f91640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57cc0b2450 0x7f57cc1595d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00e5b0 tx=0x7f57bc00ea70 comp rx=0 tx=0).stop 2024-09-16T01:17:38.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.690+0000 7f57d3f91640 1 -- 172.21.15.81:0/2861980328 shutdown_connections 2024-09-16T01:17:38.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.690+0000 7f57d3f91640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f57b006c2b0 0x7f57b006e770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.690+0000 7f57d3f91640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f57cc0b28d0 0x7f57cc159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.690+0000 7f57d3f91640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57cc0b2450 0x7f57cc1595d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.690+0000 7f57d3f91640 1 --2- 172.21.15.81:0/2861980328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57b80039b0 0x7f57cc1f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.690+0000 7f57d3f91640 1 -- 172.21.15.81:0/2861980328 >> 172.21.15.81:0/2861980328 conn(0x7f57cc0d44f0 msgr2=0x7f57cc0d3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:38.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.690+0000 7f57d3f91640 1 -- 172.21.15.81:0/2861980328 shutdown_connections 2024-09-16T01:17:38.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.690+0000 7f57d3f91640 1 -- 172.21.15.81:0/2861980328 wait complete. 2024-09-16T01:17:38.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:17:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.799+0000 7ff744dd6640 1 Processor -- start 2024-09-16T01:17:38.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.799+0000 7ff744dd6640 1 -- start start 2024-09-16T01:17:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff744dd6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff740162060 0x7ff7400b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff744dd6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff74006d9f0 con 0x7ff740161c80 2024-09-16T01:17:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff744dd6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff74006dcd0 con 0x7ff7400b64b0 2024-09-16T01:17:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff744dd6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff74006dfb0 con 0x7ff740162060 2024-09-16T01:17:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff73e59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff740161c80 0x7ff74006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60458/0 (socket says 172.21.15.81:60458) 2024-09-16T01:17:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff73e59c640 1 -- 172.21.15.81:0/171413307 learned_addr learned my addr 172.21.15.81:0/171413307 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff73dd9b640 1 --2- 172.21.15.81:0/171413307 >> v2:172.21.15.102:3300/0 conn(0x7ff740162060 0x7ff7400b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff73d59a640 1 -- 172.21.15.81:0/171413307 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880923520 0 0) 0x7ff74006d9f0 con 0x7ff740161c80 2024-09-16T01:17:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff73d59a640 1 -- 172.21.15.81:0/171413307 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff72c003520 con 0x7ff740161c80 2024-09-16T01:17:38.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff73d59a640 1 -- 172.21.15.81:0/171413307 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2474899811 0 0) 0x7ff72c003520 con 0x7ff740161c80 2024-09-16T01:17:38.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff73dd9b640 1 -- 172.21.15.81:0/171413307 >> v1:172.21.15.102:6789/0 conn(0x7ff7400b64b0 legacy=0x7ff7400cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff73dd9b640 1 -- 172.21.15.81:0/171413307 >> v1:172.21.15.81:6789/0 conn(0x7ff740161c80 legacy=0x7ff74006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.800+0000 7ff73dd9b640 1 -- 172.21.15.81:0/171413307 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7400d2890 con 0x7ff740162060 2024-09-16T01:17:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.801+0000 7ff73dd9b640 1 --2- 172.21.15.81:0/171413307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff740162060 0x7ff7400b5f70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff7280097a0 tx=0x7ff72802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32f77272db18a5d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.801+0000 7ff73d59a640 1 -- 172.21.15.81:0/171413307 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff728037070 con 0x7ff740162060 2024-09-16T01:17:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.801+0000 7ff73d59a640 1 -- 172.21.15.81:0/171413307 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff72802ac50 con 0x7ff740162060 2024-09-16T01:17:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.801+0000 7ff73d59a640 1 -- 172.21.15.81:0/171413307 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738001670 con 0x7ff740162060 2024-09-16T01:17:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.802+0000 7ff744dd6640 1 -- 172.21.15.81:0/171413307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff740162060 msgr2=0x7ff7400b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.802+0000 7ff744dd6640 1 --2- 172.21.15.81:0/171413307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff740162060 0x7ff7400b5f70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff7280097a0 tx=0x7ff72802a1c0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.802+0000 7ff744dd6640 1 -- 172.21.15.81:0/171413307 shutdown_connections 2024-09-16T01:17:38.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.802+0000 7ff744dd6640 1 --2- 172.21.15.81:0/171413307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff740162060 0x7ff7400b5f70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.802+0000 7ff744dd6640 1 -- 172.21.15.81:0/171413307 >> 172.21.15.81:0/171413307 conn(0x7ff7400d44f0 msgr2=0x7ff7400d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:38.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.802+0000 7ff744dd6640 1 -- 172.21.15.81:0/171413307 shutdown_connections 2024-09-16T01:17:38.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.802+0000 7ff744dd6640 1 -- 172.21.15.81:0/171413307 wait complete. 2024-09-16T01:17:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.803+0000 7ff744dd6640 1 Processor -- start 2024-09-16T01:17:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.803+0000 7ff744dd6640 1 -- start start 2024-09-16T01:17:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff744dd6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7400b64b0 0x7ff740156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff744dd6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff740161c80 0x7ff7400c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff744dd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff740162060 0x7ff74015e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff744dd6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7400b6d30 con 0x7ff740162060 2024-09-16T01:17:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff744dd6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff7400b6bb0 con 0x7ff740161c80 2024-09-16T01:17:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff744dd6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff7400cf8f0 con 0x7ff7400b64b0 2024-09-16T01:17:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff73ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff740162060 0x7ff74015e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff73ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff740162060 0x7ff74015e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57786/0 (socket says 172.21.15.81:57786) 2024-09-16T01:17:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff73ed9d640 1 -- 172.21.15.81:0/614662507 learned_addr learned my addr 172.21.15.81:0/614662507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff73dd9b640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff740161c80 0x7ff7400c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff73e59c640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7400b64b0 0x7ff740156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff73ed9d640 1 -- 172.21.15.81:0/614662507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7400b64b0 msgr2=0x7ff740156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff73ed9d640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7400b64b0 0x7ff740156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff73ed9d640 1 -- 172.21.15.81:0/614662507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff740161c80 msgr2=0x7ff7400c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff73ed9d640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff740161c80 0x7ff7400c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff73ed9d640 1 -- 172.21.15.81:0/614662507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7401f4870 con 0x7ff740162060 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.804+0000 7ff73ed9d640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff740162060 0x7ff74015e860 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c7a0 tx=0x7ff73000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.805+0000 7ff736ffd640 1 -- 172.21.15.81:0/614662507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730003b70 con 0x7ff740162060 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.805+0000 7ff736ffd640 1 -- 172.21.15.81:0/614662507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff730003d30 con 0x7ff740162060 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.805+0000 7ff744dd6640 1 -- 172.21.15.81:0/614662507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7401f4b50 con 0x7ff740162060 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.805+0000 7ff736ffd640 1 -- 172.21.15.81:0/614662507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73000aa90 con 0x7ff740162060 2024-09-16T01:17:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.805+0000 7ff744dd6640 1 -- 172.21.15.81:0/614662507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff740156aa0 con 0x7ff740162060 2024-09-16T01:17:38.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.806+0000 7ff744dd6640 1 -- 172.21.15.81:0/614662507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff74006d9f0 con 0x7ff740162060 2024-09-16T01:17:38.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.806+0000 7ff736ffd640 1 -- 172.21.15.81:0/614662507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff73000ac30 con 0x7ff740162060 2024-09-16T01:17:38.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.807+0000 7ff736ffd640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff72006c2b0 0x7ff72006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:38.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.807+0000 7ff73e59c640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff72006c2b0 0x7ff72006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:38.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.807+0000 7ff736ffd640 1 -- 172.21.15.81:0/614662507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7ff73008b3d0 con 0x7ff740162060 2024-09-16T01:17:38.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.807+0000 7ff73e59c640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff72006c2b0 0x7ff72006e770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff738005880 tx=0x7ff738000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:38.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.811+0000 7ff736ffd640 1 -- 172.21.15.81:0/614662507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff730059360 con 0x7ff740162060 2024-09-16T01:17:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.977+0000 7ff744dd6640 1 -- 172.21.15.81:0/614662507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7400ba470 con 0x7ff740162060 2024-09-16T01:17:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.978+0000 7ff736ffd640 1 -- 172.21.15.81:0/614662507 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17002 (secure 0 0 0) 0x7ff73005d660 con 0x7ff740162060 2024-09-16T01:17:38.980 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:38.980 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":51,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:17:37.305680+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:17:34.249166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-16T01:17:34.605034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:17:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.980+0000 7ff744dd6640 1 -- 172.21.15.81:0/614662507 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff72006c2b0 msgr2=0x7ff72006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.980+0000 7ff744dd6640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff72006c2b0 0x7ff72006e770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff738005880 tx=0x7ff738000bc0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.980+0000 7ff744dd6640 1 -- 172.21.15.81:0/614662507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff740162060 msgr2=0x7ff74015e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.980+0000 7ff744dd6640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff740162060 0x7ff74015e860 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c7a0 tx=0x7ff73000cc60 comp rx=0 tx=0).stop 2024-09-16T01:17:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.980+0000 7ff744dd6640 1 -- 172.21.15.81:0/614662507 shutdown_connections 2024-09-16T01:17:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.980+0000 7ff744dd6640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff72006c2b0 0x7ff72006e770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.980+0000 7ff744dd6640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff740162060 0x7ff74015e860 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.980+0000 7ff744dd6640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff740161c80 0x7ff7400c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.980+0000 7ff744dd6640 1 --2- 172.21.15.81:0/614662507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7400b64b0 0x7ff740156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.980+0000 7ff744dd6640 1 -- 172.21.15.81:0/614662507 >> 172.21.15.81:0/614662507 conn(0x7ff7400d44f0 msgr2=0x7ff7400cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.980+0000 7ff744dd6640 1 -- 172.21.15.81:0/614662507 shutdown_connections 2024-09-16T01:17:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:38.980+0000 7ff744dd6640 1 -- 172.21.15.81:0/614662507 wait complete. 2024-09-16T01:17:38.993 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:17:38.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:17:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.089+0000 7f8418949640 1 Processor -- start 2024-09-16T01:17:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.089+0000 7f8418949640 1 -- start start 2024-09-16T01:17:39.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.090+0000 7f8418949640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f841409aca0 0x7f841409b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.090+0000 7f8418949640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f841409b5c0 0x7f84140d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.090+0000 7f8418949640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84140d12c0 con 0x7f84140d0b20 2024-09-16T01:17:39.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.090+0000 7f8418949640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f841406d040 con 0x7f841409aca0 2024-09-16T01:17:39.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.090+0000 7f8418949640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f84140d15a0 con 0x7f841409b5c0 2024-09-16T01:17:39.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.090+0000 7f8412d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f84140d0b20 0x7f8414070740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60466/0 (socket says 172.21.15.81:60466) 2024-09-16T01:17:39.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.090+0000 7f8412d9d640 1 -- 172.21.15.81:0/3757773721 learned_addr learned my addr 172.21.15.81:0/3757773721 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:39.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.090+0000 7f8411d9b640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f841409b5c0 0x7f84140d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.090+0000 7f841259c640 1 --2- 172.21.15.81:0/3757773721 >> v2:172.21.15.102:3300/0 conn(0x7f841409aca0 0x7f841409b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.090+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2022901549 0 0) 0x7f84140d12c0 con 0x7f84140d0b20 2024-09-16T01:17:39.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.090+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83fc003520 con 0x7f84140d0b20 2024-09-16T01:17:39.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 653965445 0 0) 0x7f83fc003520 con 0x7f84140d0b20 2024-09-16T01:17:39.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f841409b5c0 msgr2=0x7f84140d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:39.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f841409b5c0 0x7f84140d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 >> v2:172.21.15.102:3300/0 conn(0x7f841409aca0 msgr2=0x7f841409b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:39.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 --2- 172.21.15.81:0/3757773721 >> v2:172.21.15.102:3300/0 conn(0x7f841409aca0 0x7f841409b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84140d1880 con 0x7f84140d0b20 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f840c0019f0 con 0x7f84140d0b20 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841259c640 1 --2- 172.21.15.81:0/3757773721 >> v2:172.21.15.102:3300/0 conn(0x7f841409aca0 0x7f841409b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 >> v1:172.21.15.81:6789/0 conn(0x7f84140d0b20 legacy=0x7f8414070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83fc0039b0 0x7f83fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83fc004800 0x7f83fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f841409b5c0 0x7f83fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f841406d040 con 0x7f83fc0039b0 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f84140d15a0 con 0x7f83fc004800 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f83fc00b9c0 con 0x7f841409b5c0 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841259c640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83fc0039b0 0x7f83fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f8411d9b640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83fc004800 0x7f83fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f8412d9d640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f841409b5c0 0x7f83fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841259c640 1 -- 172.21.15.81:0/3757773721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f841409b5c0 msgr2=0x7f83fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841259c640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f841409b5c0 0x7f83fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841259c640 1 -- 172.21.15.81:0/3757773721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83fc004800 msgr2=0x7f83fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841259c640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83fc004800 0x7f83fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f841259c640 1 -- 172.21.15.81:0/3757773721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83fc003520 con 0x7f83fc0039b0 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.091+0000 7f8411d9b640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f83fc004800 0x7f83fc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.092+0000 7f841259c640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83fc0039b0 0x7f83fc003dd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8404009c90 tx=0x7f83fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73def648167bc7e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.092+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404036070 con 0x7f83fc0039b0 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.092+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8404031400 con 0x7f83fc0039b0 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.092+0000 7f841159a640 1 -- 172.21.15.81:0/3757773721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8404009860 con 0x7f83fc0039b0 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.092+0000 7f8418949640 1 -- 172.21.15.81:0/3757773721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83fc0039b0 msgr2=0x7f83fc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.092+0000 7f8418949640 1 --2- 172.21.15.81:0/3757773721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83fc0039b0 0x7f83fc003dd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8404009c90 tx=0x7f83fc005830 comp rx=0 tx=0).stop 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.092+0000 7f8412d9d640 1 -- 172.21.15.81:0/3757773721 reap_dead start 2024-09-16T01:17:39.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.092+0000 7f8418949640 1 -- 172.21.15.81:0/3757773721 shutdown_connections 2024-09-16T01:17:39.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.092+0000 7f8418949640 1 -- 172.21.15.81:0/3757773721 >> 172.21.15.81:0/3757773721 conn(0x7f84140d23a0 msgr2=0x7f84140d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:39.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.092+0000 7f8418949640 1 -- 172.21.15.81:0/3757773721 shutdown_connections 2024-09-16T01:17:39.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.093+0000 7f8418949640 1 -- 172.21.15.81:0/3757773721 wait complete. 2024-09-16T01:17:39.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.094+0000 7f8418949640 1 Processor -- start 2024-09-16T01:17:39.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.094+0000 7f8418949640 1 -- start start 2024-09-16T01:17:39.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8418949640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83fc0039b0 0x7f841415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8418949640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84141f7540 0x7f84141f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8418949640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84141f4f10 0x7f84140cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8418949640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f84140d0fd0 con 0x7f84141f7540 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8418949640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8414070220 con 0x7f84141f4f10 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8418949640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f84140d05e0 con 0x7f83fc0039b0 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8411d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84141f7540 0x7f84141f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8411d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84141f7540 0x7f84141f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57796/0 (socket says 172.21.15.81:57796) 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8411d9b640 1 -- 172.21.15.81:0/4086654174 learned_addr learned my addr 172.21.15.81:0/4086654174 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8412d9d640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84141f4f10 0x7f84140cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f841259c640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83fc0039b0 0x7f841415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8411d9b640 1 -- 172.21.15.81:0/4086654174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83fc0039b0 msgr2=0x7f841415b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8411d9b640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83fc0039b0 0x7f841415b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8411d9b640 1 -- 172.21.15.81:0/4086654174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84141f4f10 msgr2=0x7f84140cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8411d9b640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84141f4f10 0x7f84140cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8411d9b640 1 -- 172.21.15.81:0/4086654174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84140b1140 con 0x7f84141f7540 2024-09-16T01:17:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8411d9b640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84141f7540 0x7f84141f49d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f84080116d0 tx=0x7f8408011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8402ffd640 1 -- 172.21.15.81:0/4086654174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408015870 con 0x7f84141f7540 2024-09-16T01:17:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8402ffd640 1 -- 172.21.15.81:0/4086654174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8408015a10 con 0x7f84141f7540 2024-09-16T01:17:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8418949640 1 -- 172.21.15.81:0/4086654174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84141f7a00 con 0x7f84141f7540 2024-09-16T01:17:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8402ffd640 1 -- 172.21.15.81:0/4086654174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8408015e00 con 0x7f84141f7540 2024-09-16T01:17:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.095+0000 7f8418949640 1 -- 172.21.15.81:0/4086654174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84141f82a0 con 0x7f84141f7540 2024-09-16T01:17:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.096+0000 7f8418949640 1 -- 172.21.15.81:0/4086654174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84141f7df0 con 0x7f84141f7540 2024-09-16T01:17:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.097+0000 7f8402ffd640 1 -- 172.21.15.81:0/4086654174 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f840800f460 con 0x7f84141f7540 2024-09-16T01:17:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.097+0000 7f8402ffd640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f83f406c2b0 0x7f83f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.097+0000 7f8402ffd640 1 -- 172.21.15.81:0/4086654174 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f840808bdf0 con 0x7f84141f7540 2024-09-16T01:17:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.097+0000 7f841259c640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f83f406c2b0 0x7f83f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.098+0000 7f841259c640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f83f406c2b0 0x7f83f406e770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8404033000 tx=0x7f8404008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:39.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.102+0000 7f8402ffd640 1 -- 172.21.15.81:0/4086654174 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8408019030 con 0x7f84141f7540 2024-09-16T01:17:39.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.263+0000 7f8418949640 1 -- 172.21.15.81:0/4086654174 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84140b1870 con 0x7f83f406c2b0 2024-09-16T01:17:39.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.268+0000 7f8402ffd640 1 -- 172.21.15.81:0/4086654174 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237202 (secure 0 0 0) 0x7f84140b1870 con 0x7f83f406c2b0 2024-09-16T01:17:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:39.274 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:17:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.271+0000 7f8418949640 1 -- 172.21.15.81:0/4086654174 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f83f406c2b0 msgr2=0x7f83f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.271+0000 7f8418949640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f83f406c2b0 0x7f83f406e770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8404033000 tx=0x7f8404008030 comp rx=0 tx=0).stop 2024-09-16T01:17:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.271+0000 7f8418949640 1 -- 172.21.15.81:0/4086654174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84141f7540 msgr2=0x7f84141f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.271+0000 7f8418949640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84141f7540 0x7f84141f49d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f84080116d0 tx=0x7f8408011ad0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.271+0000 7f8418949640 1 -- 172.21.15.81:0/4086654174 shutdown_connections 2024-09-16T01:17:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.271+0000 7f8418949640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f83f406c2b0 0x7f83f406e770 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.271+0000 7f8418949640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84141f4f10 0x7f84140cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.271+0000 7f8418949640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84141f7540 0x7f84141f49d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.271+0000 7f8418949640 1 --2- 172.21.15.81:0/4086654174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f83fc0039b0 0x7f841415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.271+0000 7f8418949640 1 -- 172.21.15.81:0/4086654174 >> 172.21.15.81:0/4086654174 conn(0x7f84140d23a0 msgr2=0x7f841415c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.271+0000 7f8418949640 1 -- 172.21.15.81:0/4086654174 shutdown_connections 2024-09-16T01:17:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.271+0000 7f8418949640 1 -- 172.21.15.81:0/4086654174 wait complete. 2024-09-16T01:17:39.283 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-09-16T01:17:38.084112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221528,"kb_used_data":5260,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753192,"statfs":{"total":773094113280,"available":772867268608,"internally_reserved":0,"allocated":5386240,"data_stored":3004421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000716"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":214,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T01:17:33.027268+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:17:33.027268+0000","last_peered":"2024-09-16T01:17:33.027268+0000","last_clean":"2024-09-16T01:17:33.027268+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:17:33.027268+0000","last_undegraded":"2024-09-16T01:17:33.027268+0000","last_fullsized":"2024-09-16T01:17:33.027268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":805183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27572,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":544768,"data_stored":236955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27572,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":544768,"data_stored":236955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":544768,"data_stored":236955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":231420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":544768,"data_stored":236955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":214815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":805183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:17:39.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:17:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.420+0000 7f5cfa023640 1 Processor -- start 2024-09-16T01:17:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.420+0000 7f5cfa023640 1 -- start start 2024-09-16T01:17:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cfa023640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5cf40b0180 0x7f5cf4162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cfa023640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5cf40af280 0x7f5cf4154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cfa023640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cf415eb60 con 0x7f5cf40b69d0 2024-09-16T01:17:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cfa023640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf40b6db0 con 0x7f5cf40af280 2024-09-16T01:17:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cfa023640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5cf415ee40 con 0x7f5cf40b0180 2024-09-16T01:17:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cf3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5cf40af280 0x7f5cf4154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cf37fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5cf40b69d0 0x7f5cf40afa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60472/0 (socket says 172.21.15.81:60472) 2024-09-16T01:17:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cf37fe640 1 -- 172.21.15.81:0/478792583 learned_addr learned my addr 172.21.15.81:0/478792583 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cf2ffd640 1 --2- 172.21.15.81:0/478792583 >> v2:172.21.15.102:3300/0 conn(0x7f5cf40b0180 0x7f5cf4162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cf3fff640 1 -- 172.21.15.81:0/478792583 >> v2:172.21.15.102:3300/0 conn(0x7f5cf40b0180 msgr2=0x7f5cf4162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cf3fff640 1 --2- 172.21.15.81:0/478792583 >> v2:172.21.15.102:3300/0 conn(0x7f5cf40b0180 0x7f5cf4162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cf3fff640 1 -- 172.21.15.81:0/478792583 >> v1:172.21.15.81:6789/0 conn(0x7f5cf40b69d0 legacy=0x7f5cf40afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cf3fff640 1 -- 172.21.15.81:0/478792583 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf415f120 con 0x7f5cf40af280 2024-09-16T01:17:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.421+0000 7f5cf27fc640 1 -- 172.21.15.81:0/478792583 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3968052974 0 0) 0x7f5cf415eb60 con 0x7f5cf40b69d0 2024-09-16T01:17:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.422+0000 7f5cf3fff640 1 --2- 172.21.15.81:0/478792583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40af280 0x7f5cf4154d00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4067bf0 tx=0x7f5cec02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c837ba6de4858ba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.422+0000 7f5cf27fc640 1 -- 172.21.15.81:0/478792583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec037070 con 0x7f5cf40af280 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.422+0000 7f5cf27fc640 1 -- 172.21.15.81:0/478792583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cec02add0 con 0x7f5cf40af280 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.422+0000 7f5cf27fc640 1 -- 172.21.15.81:0/478792583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec032660 con 0x7f5cf40af280 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.423+0000 7f5cfa023640 1 -- 172.21.15.81:0/478792583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40af280 msgr2=0x7f5cf4154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.423+0000 7f5cfa023640 1 --2- 172.21.15.81:0/478792583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40af280 0x7f5cf4154d00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4067bf0 tx=0x7f5cec02a080 comp rx=0 tx=0).stop 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.423+0000 7f5cfa023640 1 -- 172.21.15.81:0/478792583 shutdown_connections 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.423+0000 7f5cfa023640 1 --2- 172.21.15.81:0/478792583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40af280 0x7f5cf4154d00 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.423+0000 7f5cfa023640 1 --2- 172.21.15.81:0/478792583 >> v2:172.21.15.102:3300/0 conn(0x7f5cf40b0180 0x7f5cf4162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.423+0000 7f5cfa023640 1 -- 172.21.15.81:0/478792583 >> 172.21.15.81:0/478792583 conn(0x7f5cf406bc10 msgr2=0x7f5cf406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.423+0000 7f5cfa023640 1 -- 172.21.15.81:0/478792583 shutdown_connections 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.423+0000 7f5cfa023640 1 -- 172.21.15.81:0/478792583 wait complete. 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.424+0000 7f5cfa023640 1 Processor -- start 2024-09-16T01:17:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.424+0000 7f5cfa023640 1 -- start start 2024-09-16T01:17:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cfa023640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cf40af280 0x7f5cf41530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cfa023640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cf40b0180 0x7f5cf4159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cfa023640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40b69d0 0x7f5cf415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cfa023640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf4155240 con 0x7f5cf40b69d0 2024-09-16T01:17:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cfa023640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf40af6d0 con 0x7f5cf40b0180 2024-09-16T01:17:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cfa023640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5cf41553c0 con 0x7f5cf40af280 2024-09-16T01:17:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cf3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40b69d0 0x7f5cf415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cf3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40b69d0 0x7f5cf415dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57810/0 (socket says 172.21.15.81:57810) 2024-09-16T01:17:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cf3fff640 1 -- 172.21.15.81:0/3025107078 learned_addr learned my addr 172.21.15.81:0/3025107078 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cf37fe640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cf40af280 0x7f5cf41530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cf2ffd640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cf40b0180 0x7f5cf4159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cf3fff640 1 -- 172.21.15.81:0/3025107078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cf40af280 msgr2=0x7f5cf41530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cf3fff640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cf40af280 0x7f5cf41530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cf3fff640 1 -- 172.21.15.81:0/3025107078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cf40b0180 msgr2=0x7f5cf4159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cf3fff640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cf40b0180 0x7f5cf4159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cf3fff640 1 -- 172.21.15.81:0/3025107078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf4159ac0 con 0x7f5cf40b69d0 2024-09-16T01:17:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cf37fe640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cf40af280 0x7f5cf41530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.425+0000 7f5cf3fff640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40b69d0 0x7f5cf415dbb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5cec035040 tx=0x7f5cec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.426+0000 7f5cdbfff640 1 -- 172.21.15.81:0/3025107078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec037050 con 0x7f5cf40b69d0 2024-09-16T01:17:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.426+0000 7f5cdbfff640 1 -- 172.21.15.81:0/3025107078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cec038040 con 0x7f5cf40b69d0 2024-09-16T01:17:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.426+0000 7f5cfa023640 1 -- 172.21.15.81:0/3025107078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf4159da0 con 0x7f5cf40b69d0 2024-09-16T01:17:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.426+0000 7f5cdbfff640 1 -- 172.21.15.81:0/3025107078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec004270 con 0x7f5cf40b69d0 2024-09-16T01:17:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.426+0000 7f5cfa023640 1 -- 172.21.15.81:0/3025107078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf415a360 con 0x7f5cf40b69d0 2024-09-16T01:17:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.427+0000 7f5cfa023640 1 -- 172.21.15.81:0/3025107078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf4155750 con 0x7f5cf40b69d0 2024-09-16T01:17:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.427+0000 7f5cdbfff640 1 -- 172.21.15.81:0/3025107078 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5cec003610 con 0x7f5cf40b69d0 2024-09-16T01:17:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.427+0000 7f5cdbfff640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5ce006c2b0 0x7f5ce006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.428+0000 7f5cdbfff640 1 -- 172.21.15.81:0/3025107078 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f5cec0abc10 con 0x7f5cf40b69d0 2024-09-16T01:17:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.428+0000 7f5cf37fe640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5ce006c2b0 0x7f5ce006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.428+0000 7f5cf37fe640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5ce006c2b0 0x7f5ce006e770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40012e0 tx=0x7f5ce4005bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:39.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.432+0000 7f5cdbfff640 1 -- 172.21.15.81:0/3025107078 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5cec07a280 con 0x7f5cf40b69d0 2024-09-16T01:17:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.593+0000 7f5cfa023640 1 -- 172.21.15.81:0/3025107078 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5cf406ec70 con 0x7f5ce006c2b0 2024-09-16T01:17:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.598+0000 7f5cdbfff640 1 -- 172.21.15.81:0/3025107078 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237202 (secure 0 0 0) 0x7f5cf406ec70 con 0x7f5ce006c2b0 2024-09-16T01:17:39.603 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:17:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.601+0000 7f5cfa023640 1 -- 172.21.15.81:0/3025107078 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5ce006c2b0 msgr2=0x7f5ce006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.601+0000 7f5cfa023640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5ce006c2b0 0x7f5ce006e770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40012e0 tx=0x7f5ce4005bb0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.601+0000 7f5cfa023640 1 -- 172.21.15.81:0/3025107078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40b69d0 msgr2=0x7f5cf415dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.601+0000 7f5cfa023640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40b69d0 0x7f5cf415dbb0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5cec035040 tx=0x7f5cec0046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.601+0000 7f5cfa023640 1 -- 172.21.15.81:0/3025107078 shutdown_connections 2024-09-16T01:17:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.601+0000 7f5cfa023640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5ce006c2b0 0x7f5ce006e770 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.601+0000 7f5cfa023640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40b69d0 0x7f5cf415dbb0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.601+0000 7f5cfa023640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5cf40b0180 0x7f5cf4159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.601+0000 7f5cfa023640 1 --2- 172.21.15.81:0/3025107078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5cf40af280 0x7f5cf41530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.601+0000 7f5cfa023640 1 -- 172.21.15.81:0/3025107078 >> 172.21.15.81:0/3025107078 conn(0x7f5cf406bc10 msgr2=0x7f5cf40b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.601+0000 7f5cfa023640 1 -- 172.21.15.81:0/3025107078 shutdown_connections 2024-09-16T01:17:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.601+0000 7f5cfa023640 1 -- 172.21.15.81:0/3025107078 wait complete. 2024-09-16T01:17:39.614 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-09-16T01:17:38.084112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221528,"kb_used_data":5260,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753192,"statfs":{"total":773094113280,"available":772867268608,"internally_reserved":0,"allocated":5386240,"data_stored":3004421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000716"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":214,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T01:17:33.027268+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:17:33.027268+0000","last_peered":"2024-09-16T01:17:33.027268+0000","last_clean":"2024-09-16T01:17:33.027268+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:17:33.027268+0000","last_undegraded":"2024-09-16T01:17:33.027268+0000","last_fullsized":"2024-09-16T01:17:33.027268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":805183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27572,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":544768,"data_stored":236955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27572,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":544768,"data_stored":236955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":544768,"data_stored":236955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":231420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":544768,"data_stored":236955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":214815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":805183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:17:39.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:17:39.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.751+0000 7f2c0d3d6640 1 Processor -- start 2024-09-16T01:17:39.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.751+0000 7f2c0d3d6640 1 -- start start 2024-09-16T01:17:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.752+0000 7f2c0d3d6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2c08162ad0 0x7f2c0809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.752+0000 7f2c0d3d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c080b31a0 0x7f2c080c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.752+0000 7f2c0d3d6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c08162eb0 con 0x7f2c080c5370 2024-09-16T01:17:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.752+0000 7f2c0d3d6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2c080c5cf0 con 0x7f2c08162ad0 2024-09-16T01:17:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.752+0000 7f2c0d3d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2c080b1c80 con 0x7f2c080b31a0 2024-09-16T01:17:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.753+0000 7f2c06ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2c08162ad0 0x7f2c0809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.753+0000 7f2c077fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c080b31a0 0x7f2c080c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.753+0000 7f2c067fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2c080c5370 0x7f2c081665a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:60806/0 (socket says 172.21.15.81:60806) 2024-09-16T01:17:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.753+0000 7f2c067fc640 1 -- 172.21.15.81:0/3980064992 learned_addr learned my addr 172.21.15.81:0/3980064992 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.753+0000 7f2c05ffb640 1 -- 172.21.15.81:0/3980064992 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 337970455 0 0) 0x7f2c08162eb0 con 0x7f2c080c5370 2024-09-16T01:17:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.753+0000 7f2c05ffb640 1 -- 172.21.15.81:0/3980064992 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bf4003520 con 0x7f2c080c5370 2024-09-16T01:17:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.753+0000 7f2c06ffd640 1 -- 172.21.15.81:0/3980064992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c080b31a0 msgr2=0x7f2c080c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.753+0000 7f2c06ffd640 1 --2- 172.21.15.81:0/3980064992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c080b31a0 0x7f2c080c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.753+0000 7f2c06ffd640 1 -- 172.21.15.81:0/3980064992 >> v1:172.21.15.102:6789/0 conn(0x7f2c080c5370 legacy=0x7f2c081665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.753+0000 7f2c06ffd640 1 -- 172.21.15.81:0/3980064992 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0809b3d0 con 0x7f2c08162ad0 2024-09-16T01:17:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.753+0000 7f2c077fe640 1 --2- 172.21.15.81:0/3980064992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c080b31a0 0x7f2c080c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:17:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.754+0000 7f2c06ffd640 1 --2- 172.21.15.81:0/3980064992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c08162ad0 0x7f2c0809aa30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009d90 tx=0x7f2bf802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=281a66e99a4be86e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.754+0000 7f2c05ffb640 1 -- 172.21.15.81:0/3980064992 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8031600 con 0x7f2c08162ad0 2024-09-16T01:17:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.754+0000 7f2c05ffb640 1 -- 172.21.15.81:0/3980064992 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf80317a0 con 0x7f2c08162ad0 2024-09-16T01:17:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.754+0000 7f2c05ffb640 1 -- 172.21.15.81:0/3980064992 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8031b50 con 0x7f2c08162ad0 2024-09-16T01:17:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.754+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/3980064992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c08162ad0 msgr2=0x7f2c0809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.754+0000 7f2c0d3d6640 1 --2- 172.21.15.81:0/3980064992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c08162ad0 0x7f2c0809aa30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009d90 tx=0x7f2bf802a5d0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.754+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/3980064992 shutdown_connections 2024-09-16T01:17:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.755+0000 7f2c0d3d6640 1 --2- 172.21.15.81:0/3980064992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c080b31a0 0x7f2c080c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.755+0000 7f2c0d3d6640 1 --2- 172.21.15.81:0/3980064992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c08162ad0 0x7f2c0809aa30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.755+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/3980064992 >> 172.21.15.81:0/3980064992 conn(0x7f2c080d23a0 msgr2=0x7f2c080d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.755+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/3980064992 shutdown_connections 2024-09-16T01:17:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.755+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/3980064992 wait complete. 2024-09-16T01:17:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.756+0000 7f2c0d3d6640 1 Processor -- start 2024-09-16T01:17:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.756+0000 7f2c0d3d6640 1 -- start start 2024-09-16T01:17:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c0d3d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c080b31a0 0x7f2c080d1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c0d3d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c080c5370 0x7f2c080b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c0d3d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c08162ad0 0x7f2c08161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c0d3d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0809bc70 con 0x7f2c080c5370 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c0d3d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0809b990 con 0x7f2c08162ad0 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c0d3d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2c0809af70 con 0x7f2c080b31a0 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c067fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c080c5370 0x7f2c080b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c067fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c080c5370 0x7f2c080b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57826/0 (socket says 172.21.15.81:57826) 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c067fc640 1 -- 172.21.15.81:0/2395562134 learned_addr learned my addr 172.21.15.81:0/2395562134 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c06ffd640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c080b31a0 0x7f2c080d1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c077fe640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c08162ad0 0x7f2c08161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c067fc640 1 -- 172.21.15.81:0/2395562134 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c080b31a0 msgr2=0x7f2c080d1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c067fc640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c080b31a0 0x7f2c080d1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c067fc640 1 -- 172.21.15.81:0/2395562134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c08162ad0 msgr2=0x7f2c08161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c067fc640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c08162ad0 0x7f2c08161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c067fc640 1 -- 172.21.15.81:0/2395562134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c081eae50 con 0x7f2c080c5370 2024-09-16T01:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c06ffd640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c080b31a0 0x7f2c080d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c077fe640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c08162ad0 0x7f2c08161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c067fc640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c080c5370 0x7f2c080b51d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2bf000c390 tx=0x7f2bf000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2bff7fe640 1 -- 172.21.15.81:0/2395562134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0017070 con 0x7f2c080c5370 2024-09-16T01:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2bff7fe640 1 -- 172.21.15.81:0/2395562134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf0005ce0 con 0x7f2c080c5370 2024-09-16T01:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2bff7fe640 1 -- 172.21.15.81:0/2395562134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf00072f0 con 0x7f2c080c5370 2024-09-16T01:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/2395562134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c080d1f40 con 0x7f2c080c5370 2024-09-16T01:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.757+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/2395562134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c081eab70 con 0x7f2c080c5370 2024-09-16T01:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.759+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/2395562134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c080d30c0 con 0x7f2c080c5370 2024-09-16T01:17:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.759+0000 7f2bff7fe640 1 -- 172.21.15.81:0/2395562134 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2bf001a070 con 0x7f2c080c5370 2024-09-16T01:17:39.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.759+0000 7f2bff7fe640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2be806c2b0 0x7f2be806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:39.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.759+0000 7f2bff7fe640 1 -- 172.21.15.81:0/2395562134 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f2bf008a970 con 0x7f2c080c5370 2024-09-16T01:17:39.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.759+0000 7f2c06ffd640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2be806c2b0 0x7f2be806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:39.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.760+0000 7f2c06ffd640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2be806c2b0 0x7f2be806e770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8034000 tx=0x7f2bf802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.764+0000 7f2bff7fe640 1 -- 172.21.15.81:0/2395562134 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c081eae50 con 0x7f2c080c5370 2024-09-16T01:17:39.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.924+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/2395562134 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2c080c69a0 con 0x7f2be806c2b0 2024-09-16T01:17:39.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.929+0000 7f2bff7fe640 1 -- 172.21.15.81:0/2395562134 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237202 (secure 0 0 0) 0x7f2c080c69a0 con 0x7f2be806c2b0 2024-09-16T01:17:39.933 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:39.934 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:17:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.932+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/2395562134 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2be806c2b0 msgr2=0x7f2be806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.932+0000 7f2c0d3d6640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2be806c2b0 0x7f2be806e770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8034000 tx=0x7f2bf802f000 comp rx=0 tx=0).stop 2024-09-16T01:17:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.932+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/2395562134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c080c5370 msgr2=0x7f2c080b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.932+0000 7f2c0d3d6640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c080c5370 0x7f2c080b51d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2bf000c390 tx=0x7f2bf000c850 comp rx=0 tx=0).stop 2024-09-16T01:17:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.932+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/2395562134 shutdown_connections 2024-09-16T01:17:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.932+0000 7f2c0d3d6640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2be806c2b0 0x7f2be806e770 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.932+0000 7f2c0d3d6640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c08162ad0 0x7f2c08161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.932+0000 7f2c0d3d6640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c080c5370 0x7f2c080b51d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.932+0000 7f2c0d3d6640 1 --2- 172.21.15.81:0/2395562134 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c080b31a0 0x7f2c080d1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.932+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/2395562134 >> 172.21.15.81:0/2395562134 conn(0x7f2c080d23a0 msgr2=0x7f2c080b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.932+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/2395562134 shutdown_connections 2024-09-16T01:17:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:39.932+0000 7f2c0d3d6640 1 -- 172.21.15.81:0/2395562134 wait complete. 2024-09-16T01:17:39.944 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-09-16T01:17:38.084112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221528,"kb_used_data":5260,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753192,"statfs":{"total":773094113280,"available":772867268608,"internally_reserved":0,"allocated":5386240,"data_stored":3004421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000716"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:35.288125+0000","last_change":"2024-09-16T01:17:35.288125+0000","last_active":"2024-09-16T01:17:35.288125+0000","last_peered":"2024-09-16T01:17:35.288125+0000","last_clean":"2024-09-16T01:17:35.288125+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:35.288125+0000","last_undegraded":"2024-09-16T01:17:35.288125+0000","last_fullsized":"2024-09-16T01:17:35.288125+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:34.281943+0000","last_change":"2024-09-16T01:17:34.281943+0000","last_active":"2024-09-16T01:17:34.281943+0000","last_peered":"2024-09-16T01:17:34.281943+0000","last_clean":"2024-09-16T01:17:34.281943+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:34.281943+0000","last_undegraded":"2024-09-16T01:17:34.281943+0000","last_fullsized":"2024-09-16T01:17:34.281943+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":214,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-16T01:17:33.027268+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:17:33.027268+0000","last_peered":"2024-09-16T01:17:33.027268+0000","last_clean":"2024-09-16T01:17:33.027268+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:17:33.027268+0000","last_undegraded":"2024-09-16T01:17:33.027268+0000","last_fullsized":"2024-09-16T01:17:33.027268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":805183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27572,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":544768,"data_stored":236955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27572,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":544768,"data_stored":236955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27560,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":544768,"data_stored":236955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27548,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":532480,"data_stored":231420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":544768,"data_stored":236955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":214815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":805183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:17:39.947 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3f is not active+clean 2024-09-16T01:17:39.947 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.948 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3e is not active+clean 2024-09-16T01:17:39.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.948 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3d is not active+clean 2024-09-16T01:17:39.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.948 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3c is not active+clean 2024-09-16T01:17:39.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.948 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3b is not active+clean 2024-09-16T01:17:39.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.948 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3a is not active+clean 2024-09-16T01:17:39.948 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.948 INFO:tasks.ceph.ceph_manager.ceph:PG 8.39 is not active+clean 2024-09-16T01:17:39.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.949 INFO:tasks.ceph.ceph_manager.ceph:PG 8.38 is not active+clean 2024-09-16T01:17:39.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.949 INFO:tasks.ceph.ceph_manager.ceph:PG 8.37 is not active+clean 2024-09-16T01:17:39.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.949 INFO:tasks.ceph.ceph_manager.ceph:PG 8.36 is not active+clean 2024-09-16T01:17:39.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.949 INFO:tasks.ceph.ceph_manager.ceph:PG 8.35 is not active+clean 2024-09-16T01:17:39.949 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.949 INFO:tasks.ceph.ceph_manager.ceph:PG 8.34 is not active+clean 2024-09-16T01:17:39.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.950 INFO:tasks.ceph.ceph_manager.ceph:PG 8.33 is not active+clean 2024-09-16T01:17:39.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.950 INFO:tasks.ceph.ceph_manager.ceph:PG 8.32 is not active+clean 2024-09-16T01:17:39.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.950 INFO:tasks.ceph.ceph_manager.ceph:PG 8.31 is not active+clean 2024-09-16T01:17:39.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.950 INFO:tasks.ceph.ceph_manager.ceph:PG 8.30 is not active+clean 2024-09-16T01:17:39.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.950 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2f is not active+clean 2024-09-16T01:17:39.950 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.951 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2e is not active+clean 2024-09-16T01:17:39.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.951 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2d is not active+clean 2024-09-16T01:17:39.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.951 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2c is not active+clean 2024-09-16T01:17:39.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.951 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2b is not active+clean 2024-09-16T01:17:39.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.951 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2a is not active+clean 2024-09-16T01:17:39.951 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.951 INFO:tasks.ceph.ceph_manager.ceph:PG 8.29 is not active+clean 2024-09-16T01:17:39.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.952 INFO:tasks.ceph.ceph_manager.ceph:PG 8.28 is not active+clean 2024-09-16T01:17:39.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.952 INFO:tasks.ceph.ceph_manager.ceph:PG 8.27 is not active+clean 2024-09-16T01:17:39.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.952 INFO:tasks.ceph.ceph_manager.ceph:PG 8.26 is not active+clean 2024-09-16T01:17:39.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.952 INFO:tasks.ceph.ceph_manager.ceph:PG 8.25 is not active+clean 2024-09-16T01:17:39.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.952 INFO:tasks.ceph.ceph_manager.ceph:PG 8.24 is not active+clean 2024-09-16T01:17:39.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.953 INFO:tasks.ceph.ceph_manager.ceph:PG 8.23 is not active+clean 2024-09-16T01:17:39.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.953 INFO:tasks.ceph.ceph_manager.ceph:PG 8.22 is not active+clean 2024-09-16T01:17:39.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.953 INFO:tasks.ceph.ceph_manager.ceph:PG 8.21 is not active+clean 2024-09-16T01:17:39.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.953 INFO:tasks.ceph.ceph_manager.ceph:PG 8.20 is not active+clean 2024-09-16T01:17:39.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.953 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-09-16T01:17:39.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.954 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-09-16T01:17:39.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.954 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-09-16T01:17:39.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.954 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-09-16T01:17:39.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.954 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-09-16T01:17:39.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.954 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-16T01:17:39.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.954 INFO:tasks.ceph.ceph_manager.ceph:PG 8.13 is not active+clean 2024-09-16T01:17:39.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.955 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-09-16T01:17:39.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.955 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-09-16T01:17:39.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.955 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-16T01:17:39.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.955 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-09-16T01:17:39.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.955 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-09-16T01:17:39.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.956 INFO:tasks.ceph.ceph_manager.ceph:PG 8.16 is not active+clean 2024-09-16T01:17:39.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.956 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-09-16T01:17:39.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.956 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-09-16T01:17:39.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.956 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-16T01:17:39.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.956 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-09-16T01:17:39.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.957 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-09-16T01:17:39.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.957 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-09-16T01:17:39.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.957 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-09-16T01:17:39.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.957 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1a is not active+clean 2024-09-16T01:17:39.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.957 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-09-16T01:17:39.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.958 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-09-16T01:17:39.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.958 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-09-16T01:17:39.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.958 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-09-16T01:17:39.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.958 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-16T01:17:39.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.958 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1d is not active+clean 2024-09-16T01:17:39.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.958 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-09-16T01:17:39.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.959 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1e is not active+clean 2024-09-16T01:17:39.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.959 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-09-16T01:17:39.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.959 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1f is not active+clean 2024-09-16T01:17:39.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.959 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-09-16T01:17:39.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.959 INFO:tasks.ceph.ceph_manager.ceph:PG 8.0 is not active+clean 2024-09-16T01:17:39.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.960 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-16T01:17:39.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.960 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-09-16T01:17:39.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.960 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-09-16T01:17:39.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.960 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-09-16T01:17:39.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.960 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-09-16T01:17:39.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.961 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-09-16T01:17:39.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.961 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-09-16T01:17:39.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.961 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-09-16T01:17:39.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.961 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-09-16T01:17:39.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.961 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-09-16T01:17:39.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.962 INFO:tasks.ceph.ceph_manager.ceph:PG 7.a is not active+clean 2024-09-16T01:17:39.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.962 INFO:tasks.ceph.ceph_manager.ceph:PG 8.6 is not active+clean 2024-09-16T01:17:39.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.962 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-16T01:17:39.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.962 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-09-16T01:17:39.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.962 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-09-16T01:17:39.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.962 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-09-16T01:17:39.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.963 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-09-16T01:17:39.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.963 INFO:tasks.ceph.ceph_manager.ceph:PG 8.a is not active+clean 2024-09-16T01:17:39.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.963 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-09-16T01:17:39.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.963 INFO:tasks.ceph.ceph_manager.ceph:PG 8.b is not active+clean 2024-09-16T01:17:39.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.963 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-16T01:17:39.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.964 INFO:tasks.ceph.ceph_manager.ceph:PG 8.c is not active+clean 2024-09-16T01:17:39.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.964 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-09-16T01:17:39.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.964 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-09-16T01:17:39.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.964 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2 is not active+clean 2024-09-16T01:17:39.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.964 INFO:tasks.ceph.ceph_manager.ceph:PG 8.e is not active+clean 2024-09-16T01:17:39.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.964 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-09-16T01:17:39.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.965 INFO:tasks.ceph.ceph_manager.ceph:PG 8.f is not active+clean 2024-09-16T01:17:39.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.965 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-09-16T01:17:39.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.965 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-09-16T01:17:39.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:35.288125+0000', 'last_change': '2024-09-16T01:17:35.288125+0000', 'last_active': '2024-09-16T01:17:35.288125+0000', 'last_peered': '2024-09-16T01:17:35.288125+0000', 'last_clean': '2024-09-16T01:17:35.288125+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:35.288125+0000', 'last_undegraded': '2024-09-16T01:17:35.288125+0000', 'last_fullsized': '2024-09-16T01:17:35.288125+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:35.288125+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.965 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-16T01:17:39.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:17:34.281943+0000', 'last_change': '2024-09-16T01:17:34.281943+0000', 'last_active': '2024-09-16T01:17:34.281943+0000', 'last_peered': '2024-09-16T01:17:34.281943+0000', 'last_clean': '2024-09-16T01:17:34.281943+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:17:34.281943+0000', 'last_undegraded': '2024-09-16T01:17:34.281943+0000', 'last_fullsized': '2024-09-16T01:17:34.281943+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'last_clean_scrub_stamp': '2024-09-16T01:17:34.281943+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:17:39.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T01:17:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.080+0000 7f8afb542640 1 Processor -- start 2024-09-16T01:17:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.080+0000 7f8afb542640 1 -- start start 2024-09-16T01:17:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8afb542640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8af415e740 0x7f8af40d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8afb542640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af409b690 0x7f8af406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8afb542640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8af406d4c0 0x7f8af406d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8afb542640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8af415eb20 con 0x7f8af406d4c0 2024-09-16T01:17:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8afb542640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8af406d260 con 0x7f8af415e740 2024-09-16T01:17:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8afb542640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8af40d0780 con 0x7f8af409b690 2024-09-16T01:17:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8af9adf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8af406d4c0 0x7f8af406d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8af9adf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8af406d4c0 0x7f8af406d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57840/0 (socket says 172.21.15.81:57840) 2024-09-16T01:17:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8af9adf640 1 -- 172.21.15.81:0/4100125453 learned_addr learned my addr 172.21.15.81:0/4100125453 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8af92de640 1 --2- 172.21.15.81:0/4100125453 >> v2:172.21.15.102:3300/0 conn(0x7f8af415e740 0x7f8af40d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8af8add640 1 --2- 172.21.15.81:0/4100125453 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af409b690 0x7f8af406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8af9adf640 1 -- 172.21.15.81:0/4100125453 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af409b690 msgr2=0x7f8af406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8af9adf640 1 --2- 172.21.15.81:0/4100125453 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af409b690 0x7f8af406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8af9adf640 1 -- 172.21.15.81:0/4100125453 >> v2:172.21.15.102:3300/0 conn(0x7f8af415e740 msgr2=0x7f8af40d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8af9adf640 1 --2- 172.21.15.81:0/4100125453 >> v2:172.21.15.102:3300/0 conn(0x7f8af415e740 0x7f8af40d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8af9adf640 1 -- 172.21.15.81:0/4100125453 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af40d0a60 con 0x7f8af406d4c0 2024-09-16T01:17:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8af92de640 1 --2- 172.21.15.81:0/4100125453 >> v2:172.21.15.102:3300/0 conn(0x7f8af415e740 0x7f8af40d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.081+0000 7f8af8add640 1 --2- 172.21.15.81:0/4100125453 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af409b690 0x7f8af406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:40.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.082+0000 7f8af9adf640 1 --2- 172.21.15.81:0/4100125453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8af406d4c0 0x7f8af406d8f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8af4074070 tx=0x7f8aec02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0532ba30761c82c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.082+0000 7f8aebfff640 1 -- 172.21.15.81:0/4100125453 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec036070 con 0x7f8af406d4c0 2024-09-16T01:17:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.082+0000 7f8aebfff640 1 -- 172.21.15.81:0/4100125453 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aec031600 con 0x7f8af406d4c0 2024-09-16T01:17:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.082+0000 7f8aebfff640 1 -- 172.21.15.81:0/4100125453 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0319d0 con 0x7f8af406d4c0 2024-09-16T01:17:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.083+0000 7f8afb542640 1 -- 172.21.15.81:0/4100125453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8af406d4c0 msgr2=0x7f8af406d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.083+0000 7f8afb542640 1 --2- 172.21.15.81:0/4100125453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8af406d4c0 0x7f8af406d8f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8af4074070 tx=0x7f8aec02a750 comp rx=0 tx=0).stop 2024-09-16T01:17:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.083+0000 7f8afb542640 1 -- 172.21.15.81:0/4100125453 shutdown_connections 2024-09-16T01:17:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.083+0000 7f8afb542640 1 --2- 172.21.15.81:0/4100125453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8af406d4c0 0x7f8af406d8f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.083+0000 7f8afb542640 1 --2- 172.21.15.81:0/4100125453 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af409b690 0x7f8af406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.083+0000 7f8afb542640 1 --2- 172.21.15.81:0/4100125453 >> v2:172.21.15.102:3300/0 conn(0x7f8af415e740 0x7f8af40d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.083+0000 7f8afb542640 1 -- 172.21.15.81:0/4100125453 >> 172.21.15.81:0/4100125453 conn(0x7f8af40d23a0 msgr2=0x7f8af40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.083+0000 7f8afb542640 1 -- 172.21.15.81:0/4100125453 shutdown_connections 2024-09-16T01:17:40.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.083+0000 7f8afb542640 1 -- 172.21.15.81:0/4100125453 wait complete. 2024-09-16T01:17:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.084+0000 7f8afb542640 1 Processor -- start 2024-09-16T01:17:40.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.084+0000 7f8afb542640 1 -- start start 2024-09-16T01:17:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8afb542640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8af406d4c0 0x7f8af4154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8afb542640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8af409b690 0x7f8af40b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8afb542640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af415e740 0x7f8af40b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8afb542640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8af409ba90 con 0x7f8af409b690 2024-09-16T01:17:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8afb542640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8af40d1020 con 0x7f8af406d4c0 2024-09-16T01:17:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8afb542640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8af406de30 con 0x7f8af415e740 2024-09-16T01:17:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8af8add640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8af409b690 0x7f8af40b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8af8add640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8af409b690 0x7f8af40b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57842/0 (socket says 172.21.15.81:57842) 2024-09-16T01:17:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8af8add640 1 -- 172.21.15.81:0/3479013134 learned_addr learned my addr 172.21.15.81:0/3479013134 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8af92de640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8af406d4c0 0x7f8af4154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8af9adf640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af415e740 0x7f8af40b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8af8add640 1 -- 172.21.15.81:0/3479013134 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af415e740 msgr2=0x7f8af40b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8af8add640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af415e740 0x7f8af40b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8af8add640 1 -- 172.21.15.81:0/3479013134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8af406d4c0 msgr2=0x7f8af4154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8af8add640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8af406d4c0 0x7f8af4154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8af8add640 1 -- 172.21.15.81:0/3479013134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af41554c0 con 0x7f8af409b690 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8af92de640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8af406d4c0 0x7f8af4154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8af8add640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8af409b690 0x7f8af40b64e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c7f0 tx=0x7f8ae400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.085+0000 7f8ae9ffb640 1 -- 172.21.15.81:0/3479013134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4015070 con 0x7f8af409b690 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.086+0000 7f8ae9ffb640 1 -- 172.21.15.81:0/3479013134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae4007a30 con 0x7f8af409b690 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.086+0000 7f8afb542640 1 -- 172.21.15.81:0/3479013134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af40b5440 con 0x7f8af409b690 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.086+0000 7f8ae9ffb640 1 -- 172.21.15.81:0/3479013134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4007e00 con 0x7f8af409b690 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.086+0000 7f8afb542640 1 -- 172.21.15.81:0/3479013134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af40b5a00 con 0x7f8af409b690 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.087+0000 7f8afb542640 1 -- 172.21.15.81:0/3479013134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af406e480 con 0x7f8af409b690 2024-09-16T01:17:40.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.087+0000 7f8ae9ffb640 1 -- 172.21.15.81:0/3479013134 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8ae4018070 con 0x7f8af409b690 2024-09-16T01:17:40.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.087+0000 7f8ae9ffb640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ad806c2b0 0x7f8ad806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.088+0000 7f8ae9ffb640 1 -- 172.21.15.81:0/3479013134 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f8ae408b580 con 0x7f8af409b690 2024-09-16T01:17:40.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.088+0000 7f8af92de640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ad806c2b0 0x7f8ad806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.088+0000 7f8af92de640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ad806c2b0 0x7f8ad806e770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8af000a910 tx=0x7f8af0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:40.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.092+0000 7f8ae9ffb640 1 -- 172.21.15.81:0/3479013134 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8af406e480 con 0x7f8af409b690 2024-09-16T01:17:40.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.318+0000 7f8afb542640 1 -- 172.21.15.81:0/3479013134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8af406d8f0 con 0x7f8af409b690 2024-09-16T01:17:40.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.318+0000 7f8ae9ffb640 1 -- 172.21.15.81:0/3479013134 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1226 (secure 0 0 0) 0x7f8ae4059b60 con 0x7f8af409b690 2024-09-16T01:17:40.320 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:40.320 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":144,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":51,"num_osds":8,"num_up_osds":8,"osd_up_since":1726449328,"num_in_osds":8,"osd_in_since":1726449318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":226844672,"bytes_avail":772867268608,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":22,"btime":"2024-09-16T01:17:38:311750+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5361}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-16T01:17:28.082318+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T01:17:40.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.320+0000 7f8afb542640 1 -- 172.21.15.81:0/3479013134 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ad806c2b0 msgr2=0x7f8ad806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:40.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.320+0000 7f8afb542640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ad806c2b0 0x7f8ad806e770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8af000a910 tx=0x7f8af0008040 comp rx=0 tx=0).stop 2024-09-16T01:17:40.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.320+0000 7f8afb542640 1 -- 172.21.15.81:0/3479013134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8af409b690 msgr2=0x7f8af40b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:40.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.320+0000 7f8afb542640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8af409b690 0x7f8af40b64e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c7f0 tx=0x7f8ae400cbf0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.320+0000 7f8afb542640 1 -- 172.21.15.81:0/3479013134 shutdown_connections 2024-09-16T01:17:40.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.320+0000 7f8afb542640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ad806c2b0 0x7f8ad806e770 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.320+0000 7f8afb542640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8af415e740 0x7f8af40b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.320+0000 7f8afb542640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8af409b690 0x7f8af40b64e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.320+0000 7f8afb542640 1 --2- 172.21.15.81:0/3479013134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8af406d4c0 0x7f8af4154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.320+0000 7f8afb542640 1 -- 172.21.15.81:0/3479013134 >> 172.21.15.81:0/3479013134 conn(0x7f8af40d23a0 msgr2=0x7f8af40ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:40.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.320+0000 7f8afb542640 1 -- 172.21.15.81:0/3479013134 shutdown_connections 2024-09-16T01:17:40.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.320+0000 7f8afb542640 1 -- 172.21.15.81:0/3479013134 wait complete. 2024-09-16T01:17:40.334 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T01:17:40.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:17:40.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.431+0000 7fc39a804640 1 Processor -- start 2024-09-16T01:17:40.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.431+0000 7fc39a804640 1 -- start start 2024-09-16T01:17:40.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.431+0000 7fc39a804640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc39409aca0 0x7fc39409b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.431+0000 7fc39a804640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc39409b5c0 0x7fc3940d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.431+0000 7fc39a804640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3940d12c0 con 0x7fc3940d0b20 2024-09-16T01:17:40.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.431+0000 7fc39a804640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc39406d040 con 0x7fc39409b5c0 2024-09-16T01:17:40.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.431+0000 7fc39a804640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc3940d15a0 con 0x7fc39409aca0 2024-09-16T01:17:40.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.432+0000 7fc393fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc39409aca0 0x7fc39409b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.432+0000 7fc3937fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc39409b5c0 0x7fc3940d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.432+0000 7fc393fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc39409aca0 0x7fc39409b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:53274/0 (socket says 172.21.15.81:53274) 2024-09-16T01:17:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.432+0000 7fc398da1640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc3940d0b20 0x7fc394070740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:60818/0 (socket says 172.21.15.81:60818) 2024-09-16T01:17:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.432+0000 7fc393fff640 1 -- 172.21.15.81:0/144163590 learned_addr learned my addr 172.21.15.81:0/144163590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.432+0000 7fc393fff640 1 -- 172.21.15.81:0/144163590 >> v2:172.21.15.102:3300/0 conn(0x7fc39409b5c0 msgr2=0x7fc3940d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.432+0000 7fc393fff640 1 --2- 172.21.15.81:0/144163590 >> v2:172.21.15.102:3300/0 conn(0x7fc39409b5c0 0x7fc3940d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.432+0000 7fc393fff640 1 -- 172.21.15.81:0/144163590 >> v1:172.21.15.102:6789/0 conn(0x7fc3940d0b20 legacy=0x7fc394070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.432+0000 7fc393fff640 1 -- 172.21.15.81:0/144163590 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3940d1880 con 0x7fc39409aca0 2024-09-16T01:17:40.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.432+0000 7fc3937fe640 1 --2- 172.21.15.81:0/144163590 >> v2:172.21.15.102:3300/0 conn(0x7fc39409b5c0 0x7fc3940d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:17:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.433+0000 7fc393fff640 1 --2- 172.21.15.81:0/144163590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc39409aca0 0x7fc39409b080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc384009870 tx=0x7fc38402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc9398cf29df7b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.433+0000 7fc392ffd640 1 -- 172.21.15.81:0/144163590 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc384037070 con 0x7fc39409aca0 2024-09-16T01:17:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.433+0000 7fc392ffd640 1 -- 172.21.15.81:0/144163590 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc384032440 con 0x7fc39409aca0 2024-09-16T01:17:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.433+0000 7fc392ffd640 1 -- 172.21.15.81:0/144163590 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc384032810 con 0x7fc39409aca0 2024-09-16T01:17:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.434+0000 7fc39a804640 1 -- 172.21.15.81:0/144163590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc39409aca0 msgr2=0x7fc39409b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.434+0000 7fc39a804640 1 --2- 172.21.15.81:0/144163590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc39409aca0 0x7fc39409b080 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc384009870 tx=0x7fc38402a270 comp rx=0 tx=0).stop 2024-09-16T01:17:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.434+0000 7fc39a804640 1 -- 172.21.15.81:0/144163590 shutdown_connections 2024-09-16T01:17:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.434+0000 7fc39a804640 1 --2- 172.21.15.81:0/144163590 >> v2:172.21.15.102:3300/0 conn(0x7fc39409b5c0 0x7fc3940d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.434+0000 7fc39a804640 1 --2- 172.21.15.81:0/144163590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc39409aca0 0x7fc39409b080 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.434+0000 7fc39a804640 1 -- 172.21.15.81:0/144163590 >> 172.21.15.81:0/144163590 conn(0x7fc3940d23a0 msgr2=0x7fc3940d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.434+0000 7fc39a804640 1 -- 172.21.15.81:0/144163590 shutdown_connections 2024-09-16T01:17:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.434+0000 7fc39a804640 1 -- 172.21.15.81:0/144163590 wait complete. 2024-09-16T01:17:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.435+0000 7fc39a804640 1 Processor -- start 2024-09-16T01:17:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.435+0000 7fc39a804640 1 -- start start 2024-09-16T01:17:40.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc39a804640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc39409aca0 0x7fc394160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc39a804640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc39409b5c0 0x7fc39415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc39a804640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3940d0b20 0x7fc3940ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc39a804640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc3940d0fd0 con 0x7fc3940d0b20 2024-09-16T01:17:40.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc39a804640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc394070220 con 0x7fc39409b5c0 2024-09-16T01:17:40.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc39a804640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc394070e50 con 0x7fc39409aca0 2024-09-16T01:17:40.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc398da1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3940d0b20 0x7fc3940ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc398da1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3940d0b20 0x7fc3940ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57856/0 (socket says 172.21.15.81:57856) 2024-09-16T01:17:40.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc398da1640 1 -- 172.21.15.81:0/3994763180 learned_addr learned my addr 172.21.15.81:0/3994763180 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:40.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc393fff640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc39409aca0 0x7fc394160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc3937fe640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc39409b5c0 0x7fc39415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc398da1640 1 -- 172.21.15.81:0/3994763180 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc39409aca0 msgr2=0x7fc394160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc398da1640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc39409aca0 0x7fc394160a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc398da1640 1 -- 172.21.15.81:0/3994763180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc39409b5c0 msgr2=0x7fc39415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc398da1640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc39409b5c0 0x7fc39415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.436+0000 7fc398da1640 1 -- 172.21.15.81:0/3994763180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3940cd980 con 0x7fc3940d0b20 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.437+0000 7fc398da1640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3940d0b20 0x7fc3940ce2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c760 tx=0x7fc38c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.437+0000 7fc390ff9640 1 -- 172.21.15.81:0/3994763180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c017070 con 0x7fc3940d0b20 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.437+0000 7fc390ff9640 1 -- 172.21.15.81:0/3994763180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc38c00a640 con 0x7fc3940d0b20 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.437+0000 7fc39a804640 1 -- 172.21.15.81:0/3994763180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc394160fd0 con 0x7fc3940d0b20 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.437+0000 7fc390ff9640 1 -- 172.21.15.81:0/3994763180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00a9f0 con 0x7fc3940d0b20 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.437+0000 7fc39a804640 1 -- 172.21.15.81:0/3994763180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3940c9ad0 con 0x7fc3940d0b20 2024-09-16T01:17:40.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.438+0000 7fc39a804640 1 -- 172.21.15.81:0/3994763180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc39409b080 con 0x7fc3940d0b20 2024-09-16T01:17:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.438+0000 7fc390ff9640 1 -- 172.21.15.81:0/3994763180 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc38c01a070 con 0x7fc3940d0b20 2024-09-16T01:17:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.439+0000 7fc390ff9640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc37406c2b0 0x7fc37406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.439+0000 7fc390ff9640 1 -- 172.21.15.81:0/3994763180 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fc38c08aa40 con 0x7fc3940d0b20 2024-09-16T01:17:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.439+0000 7fc393fff640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc37406c2b0 0x7fc37406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.439+0000 7fc393fff640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc37406c2b0 0x7fc37406e770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc384034000 tx=0x7fc38402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:40.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.443+0000 7fc390ff9640 1 -- 172.21.15.81:0/3994763180 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3940cd980 con 0x7fc3940d0b20 2024-09-16T01:17:40.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.605+0000 7fc39a804640 1 -- 172.21.15.81:0/3994763180 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc39415bf10 con 0x7fc37406c2b0 2024-09-16T01:17:40.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.610+0000 7fc390ff9640 1 -- 172.21.15.81:0/3994763180 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251956 (secure 0 0 0) 0x7fc39415bf10 con 0x7fc37406c2b0 2024-09-16T01:17:40.615 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:40.616 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:17:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.613+0000 7fc39a804640 1 -- 172.21.15.81:0/3994763180 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc37406c2b0 msgr2=0x7fc37406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.613+0000 7fc39a804640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc37406c2b0 0x7fc37406e770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc384034000 tx=0x7fc38402e000 comp rx=0 tx=0).stop 2024-09-16T01:17:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.613+0000 7fc39a804640 1 -- 172.21.15.81:0/3994763180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3940d0b20 msgr2=0x7fc3940ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.613+0000 7fc39a804640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3940d0b20 0x7fc3940ce2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c760 tx=0x7fc38c00cc20 comp rx=0 tx=0).stop 2024-09-16T01:17:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.613+0000 7fc39a804640 1 -- 172.21.15.81:0/3994763180 shutdown_connections 2024-09-16T01:17:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.613+0000 7fc39a804640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc37406c2b0 0x7fc37406e770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.613+0000 7fc39a804640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3940d0b20 0x7fc3940ce2f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.613+0000 7fc39a804640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc39409b5c0 0x7fc39415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.613+0000 7fc39a804640 1 --2- 172.21.15.81:0/3994763180 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc39409aca0 0x7fc394160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:40.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.614+0000 7fc39a804640 1 -- 172.21.15.81:0/3994763180 >> 172.21.15.81:0/3994763180 conn(0x7fc3940d23a0 msgr2=0x7fc39415aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:40.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.614+0000 7fc39a804640 1 -- 172.21.15.81:0/3994763180 shutdown_connections 2024-09-16T01:17:40.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:40.614+0000 7fc39a804640 1 -- 172.21.15.81:0/3994763180 wait complete. 2024-09-16T01:17:40.626 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-16T01:17:40.084419+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222192,"kb_used_data":5924,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752528,"statfs":{"total":773094113280,"available":772866588672,"internally_reserved":0,"allocated":6066176,"data_stored":3319152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.793879"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661160+0000","last_change":"2024-09-16T01:17:36.308552+0000","last_active":"2024-09-16T01:17:37.661160+0000","last_peered":"2024-09-16T01:17:37.661160+0000","last_clean":"2024-09-16T01:17:37.661160+0000","last_became_active":"2024-09-16T01:17:36.308321+0000","last_became_peered":"2024-09-16T01:17:36.308321+0000","last_unstale":"2024-09-16T01:17:37.661160+0000","last_undegraded":"2024-09-16T01:17:37.661160+0000","last_fullsized":"2024-09-16T01:17:37.661160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.539675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661874+0000","last_change":"2024-09-16T01:17:36.320583+0000","last_active":"2024-09-16T01:17:37.661874+0000","last_peered":"2024-09-16T01:17:37.661874+0000","last_clean":"2024-09-16T01:17:37.661874+0000","last_became_active":"2024-09-16T01:17:36.320127+0000","last_became_peered":"2024-09-16T01:17:36.320127+0000","last_unstale":"2024-09-16T01:17:37.661874+0000","last_undegraded":"2024-09-16T01:17:37.661874+0000","last_fullsized":"2024-09-16T01:17:37.661874+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:32.674822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661457+0000","last_change":"2024-09-16T01:17:36.315876+0000","last_active":"2024-09-16T01:17:37.661457+0000","last_peered":"2024-09-16T01:17:37.661457+0000","last_clean":"2024-09-16T01:17:37.661457+0000","last_became_active":"2024-09-16T01:17:36.315641+0000","last_became_peered":"2024-09-16T01:17:36.315641+0000","last_unstale":"2024-09-16T01:17:37.661457+0000","last_undegraded":"2024-09-16T01:17:37.661457+0000","last_fullsized":"2024-09-16T01:17:37.661457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:32.692533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661738+0000","last_change":"2024-09-16T01:17:36.329350+0000","last_active":"2024-09-16T01:17:37.661738+0000","last_peered":"2024-09-16T01:17:37.661738+0000","last_clean":"2024-09-16T01:17:37.661738+0000","last_became_active":"2024-09-16T01:17:36.328973+0000","last_became_peered":"2024-09-16T01:17:36.328973+0000","last_unstale":"2024-09-16T01:17:37.661738+0000","last_undegraded":"2024-09-16T01:17:37.661738+0000","last_fullsized":"2024-09-16T01:17:37.661738+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:04.077254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661213+0000","last_change":"2024-09-16T01:17:36.313019+0000","last_active":"2024-09-16T01:17:37.661213+0000","last_peered":"2024-09-16T01:17:37.661213+0000","last_clean":"2024-09-16T01:17:37.661213+0000","last_became_active":"2024-09-16T01:17:36.312754+0000","last_became_peered":"2024-09-16T01:17:36.312754+0000","last_unstale":"2024-09-16T01:17:37.661213+0000","last_undegraded":"2024-09-16T01:17:37.661213+0000","last_fullsized":"2024-09-16T01:17:37.661213+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:50.936600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661162+0000","last_change":"2024-09-16T01:17:36.311606+0000","last_active":"2024-09-16T01:17:37.661162+0000","last_peered":"2024-09-16T01:17:37.661162+0000","last_clean":"2024-09-16T01:17:37.661162+0000","last_became_active":"2024-09-16T01:17:36.311351+0000","last_became_peered":"2024-09-16T01:17:36.311351+0000","last_unstale":"2024-09-16T01:17:37.661162+0000","last_undegraded":"2024-09-16T01:17:37.661162+0000","last_fullsized":"2024-09-16T01:17:37.661162+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:59.353648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662247+0000","last_change":"2024-09-16T01:17:36.315479+0000","last_active":"2024-09-16T01:17:37.662247+0000","last_peered":"2024-09-16T01:17:37.662247+0000","last_clean":"2024-09-16T01:17:37.662247+0000","last_became_active":"2024-09-16T01:17:36.315207+0000","last_became_peered":"2024-09-16T01:17:36.315207+0000","last_unstale":"2024-09-16T01:17:37.662247+0000","last_undegraded":"2024-09-16T01:17:37.662247+0000","last_fullsized":"2024-09-16T01:17:37.662247+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:03.209320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661173+0000","last_change":"2024-09-16T01:17:36.324191+0000","last_active":"2024-09-16T01:17:37.661173+0000","last_peered":"2024-09-16T01:17:37.661173+0000","last_clean":"2024-09-16T01:17:37.661173+0000","last_became_active":"2024-09-16T01:17:36.323915+0000","last_became_peered":"2024-09-16T01:17:36.323915+0000","last_unstale":"2024-09-16T01:17:37.661173+0000","last_undegraded":"2024-09-16T01:17:37.661173+0000","last_fullsized":"2024-09-16T01:17:37.661173+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:32.674822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662260+0000","last_change":"2024-09-16T01:17:36.323171+0000","last_active":"2024-09-16T01:17:37.662260+0000","last_peered":"2024-09-16T01:17:37.662260+0000","last_clean":"2024-09-16T01:17:37.662260+0000","last_became_active":"2024-09-16T01:17:36.322868+0000","last_became_peered":"2024-09-16T01:17:36.322868+0000","last_unstale":"2024-09-16T01:17:37.662260+0000","last_undegraded":"2024-09-16T01:17:37.662260+0000","last_fullsized":"2024-09-16T01:17:37.662260+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:03.209320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661423+0000","last_change":"2024-09-16T01:17:36.313011+0000","last_active":"2024-09-16T01:17:37.661423+0000","last_peered":"2024-09-16T01:17:37.661423+0000","last_clean":"2024-09-16T01:17:37.661423+0000","last_became_active":"2024-09-16T01:17:36.312746+0000","last_became_peered":"2024-09-16T01:17:36.312746+0000","last_unstale":"2024-09-16T01:17:37.661423+0000","last_undegraded":"2024-09-16T01:17:37.661423+0000","last_fullsized":"2024-09-16T01:17:37.661423+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:02.006993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.313486+0000","last_change":"2024-09-16T01:17:36.323377+0000","last_active":"2024-09-16T01:17:37.313486+0000","last_peered":"2024-09-16T01:17:37.313486+0000","last_clean":"2024-09-16T01:17:37.313486+0000","last_became_active":"2024-09-16T01:17:36.321215+0000","last_became_peered":"2024-09-16T01:17:36.321215+0000","last_unstale":"2024-09-16T01:17:37.313486+0000","last_undegraded":"2024-09-16T01:17:37.313486+0000","last_fullsized":"2024-09-16T01:17:37.313486+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:40.194542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662466+0000","last_change":"2024-09-16T01:17:36.308766+0000","last_active":"2024-09-16T01:17:37.662466+0000","last_peered":"2024-09-16T01:17:37.662466+0000","last_clean":"2024-09-16T01:17:37.662466+0000","last_became_active":"2024-09-16T01:17:36.308516+0000","last_became_peered":"2024-09-16T01:17:36.308516+0000","last_unstale":"2024-09-16T01:17:37.662466+0000","last_undegraded":"2024-09-16T01:17:37.662466+0000","last_fullsized":"2024-09-16T01:17:37.662466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:42.049285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661422+0000","last_change":"2024-09-16T01:17:36.313321+0000","last_active":"2024-09-16T01:17:37.661422+0000","last_peered":"2024-09-16T01:17:37.661422+0000","last_clean":"2024-09-16T01:17:37.661422+0000","last_became_active":"2024-09-16T01:17:36.312874+0000","last_became_peered":"2024-09-16T01:17:36.312874+0000","last_unstale":"2024-09-16T01:17:37.661422+0000","last_undegraded":"2024-09-16T01:17:37.661422+0000","last_fullsized":"2024-09-16T01:17:37.661422+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:45.994646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662020+0000","last_change":"2024-09-16T01:17:36.317618+0000","last_active":"2024-09-16T01:17:37.662020+0000","last_peered":"2024-09-16T01:17:37.662020+0000","last_clean":"2024-09-16T01:17:37.662020+0000","last_became_active":"2024-09-16T01:17:36.317346+0000","last_became_peered":"2024-09-16T01:17:36.317346+0000","last_unstale":"2024-09-16T01:17:37.662020+0000","last_undegraded":"2024-09-16T01:17:37.662020+0000","last_fullsized":"2024-09-16T01:17:37.662020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:32.674822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661377+0000","last_change":"2024-09-16T01:17:36.322354+0000","last_active":"2024-09-16T01:17:37.661377+0000","last_peered":"2024-09-16T01:17:37.661377+0000","last_clean":"2024-09-16T01:17:37.661377+0000","last_became_active":"2024-09-16T01:17:36.322029+0000","last_became_peered":"2024-09-16T01:17:36.322029+0000","last_unstale":"2024-09-16T01:17:37.661377+0000","last_undegraded":"2024-09-16T01:17:37.661377+0000","last_fullsized":"2024-09-16T01:17:37.661377+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:32.692533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.660883+0000","last_change":"2024-09-16T01:17:36.314023+0000","last_active":"2024-09-16T01:17:37.660883+0000","last_peered":"2024-09-16T01:17:37.660883+0000","last_clean":"2024-09-16T01:17:37.660883+0000","last_became_active":"2024-09-16T01:17:36.313753+0000","last_became_peered":"2024-09-16T01:17:36.313753+0000","last_unstale":"2024-09-16T01:17:37.660883+0000","last_undegraded":"2024-09-16T01:17:37.660883+0000","last_fullsized":"2024-09-16T01:17:37.660883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:15.310099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662087+0000","last_change":"2024-09-16T01:17:36.313331+0000","last_active":"2024-09-16T01:17:37.662087+0000","last_peered":"2024-09-16T01:17:37.662087+0000","last_clean":"2024-09-16T01:17:37.662087+0000","last_became_active":"2024-09-16T01:17:36.313080+0000","last_became_peered":"2024-09-16T01:17:36.313080+0000","last_unstale":"2024-09-16T01:17:37.662087+0000","last_undegraded":"2024-09-16T01:17:37.662087+0000","last_fullsized":"2024-09-16T01:17:37.662087+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:28.079552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661939+0000","last_change":"2024-09-16T01:17:36.320920+0000","last_active":"2024-09-16T01:17:37.661939+0000","last_peered":"2024-09-16T01:17:37.661939+0000","last_clean":"2024-09-16T01:17:37.661939+0000","last_became_active":"2024-09-16T01:17:36.320482+0000","last_became_peered":"2024-09-16T01:17:36.320482+0000","last_unstale":"2024-09-16T01:17:37.661939+0000","last_undegraded":"2024-09-16T01:17:37.661939+0000","last_fullsized":"2024-09-16T01:17:37.661939+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:28.079552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661592+0000","last_change":"2024-09-16T01:17:36.312722+0000","last_active":"2024-09-16T01:17:37.661592+0000","last_peered":"2024-09-16T01:17:37.661592+0000","last_clean":"2024-09-16T01:17:37.661592+0000","last_became_active":"2024-09-16T01:17:36.312423+0000","last_became_peered":"2024-09-16T01:17:36.312423+0000","last_unstale":"2024-09-16T01:17:37.661592+0000","last_undegraded":"2024-09-16T01:17:37.661592+0000","last_fullsized":"2024-09-16T01:17:37.661592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:18.069334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321500+0000","last_change":"2024-09-16T01:17:36.314444+0000","last_active":"2024-09-16T01:17:37.321500+0000","last_peered":"2024-09-16T01:17:37.321500+0000","last_clean":"2024-09-16T01:17:37.321500+0000","last_became_active":"2024-09-16T01:17:36.314137+0000","last_became_peered":"2024-09-16T01:17:36.314137+0000","last_unstale":"2024-09-16T01:17:37.321500+0000","last_undegraded":"2024-09-16T01:17:37.321500+0000","last_fullsized":"2024-09-16T01:17:37.321500+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:29:00.109633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321550+0000","last_change":"2024-09-16T01:17:36.312767+0000","last_active":"2024-09-16T01:17:37.321550+0000","last_peered":"2024-09-16T01:17:37.321550+0000","last_clean":"2024-09-16T01:17:37.321550+0000","last_became_active":"2024-09-16T01:17:36.312496+0000","last_became_peered":"2024-09-16T01:17:36.312496+0000","last_unstale":"2024-09-16T01:17:37.321550+0000","last_undegraded":"2024-09-16T01:17:37.321550+0000","last_fullsized":"2024-09-16T01:17:37.321550+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:15:27.761276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661573+0000","last_change":"2024-09-16T01:17:36.324241+0000","last_active":"2024-09-16T01:17:37.661573+0000","last_peered":"2024-09-16T01:17:37.661573+0000","last_clean":"2024-09-16T01:17:37.661573+0000","last_became_active":"2024-09-16T01:17:36.323961+0000","last_became_peered":"2024-09-16T01:17:36.323961+0000","last_unstale":"2024-09-16T01:17:37.661573+0000","last_undegraded":"2024-09-16T01:17:37.661573+0000","last_fullsized":"2024-09-16T01:17:37.661573+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:43.728028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.313400+0000","last_change":"2024-09-16T01:17:36.321415+0000","last_active":"2024-09-16T01:17:37.313400+0000","last_peered":"2024-09-16T01:17:37.313400+0000","last_clean":"2024-09-16T01:17:37.313400+0000","last_became_active":"2024-09-16T01:17:36.321154+0000","last_became_peered":"2024-09-16T01:17:36.321154+0000","last_unstale":"2024-09-16T01:17:37.313400+0000","last_undegraded":"2024-09-16T01:17:37.313400+0000","last_fullsized":"2024-09-16T01:17:37.313400+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:19.331674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661724+0000","last_change":"2024-09-16T01:17:36.316723+0000","last_active":"2024-09-16T01:17:37.661724+0000","last_peered":"2024-09-16T01:17:37.661724+0000","last_clean":"2024-09-16T01:17:37.661724+0000","last_became_active":"2024-09-16T01:17:36.316456+0000","last_became_peered":"2024-09-16T01:17:36.316456+0000","last_unstale":"2024-09-16T01:17:37.661724+0000","last_undegraded":"2024-09-16T01:17:37.661724+0000","last_fullsized":"2024-09-16T01:17:37.661724+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:14.136243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662229+0000","last_change":"2024-09-16T01:17:36.322956+0000","last_active":"2024-09-16T01:17:37.662229+0000","last_peered":"2024-09-16T01:17:37.662229+0000","last_clean":"2024-09-16T01:17:37.662229+0000","last_became_active":"2024-09-16T01:17:36.322671+0000","last_became_peered":"2024-09-16T01:17:36.322671+0000","last_unstale":"2024-09-16T01:17:37.662229+0000","last_undegraded":"2024-09-16T01:17:37.662229+0000","last_fullsized":"2024-09-16T01:17:37.662229+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:43.728028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661148+0000","last_change":"2024-09-16T01:17:36.323849+0000","last_active":"2024-09-16T01:17:37.661148+0000","last_peered":"2024-09-16T01:17:37.661148+0000","last_clean":"2024-09-16T01:17:37.661148+0000","last_became_active":"2024-09-16T01:17:36.323578+0000","last_became_peered":"2024-09-16T01:17:36.323578+0000","last_unstale":"2024-09-16T01:17:37.661148+0000","last_undegraded":"2024-09-16T01:17:37.661148+0000","last_fullsized":"2024-09-16T01:17:37.661148+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:39.661466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661936+0000","last_change":"2024-09-16T01:17:36.309596+0000","last_active":"2024-09-16T01:17:37.661936+0000","last_peered":"2024-09-16T01:17:37.661936+0000","last_clean":"2024-09-16T01:17:37.661936+0000","last_became_active":"2024-09-16T01:17:36.309303+0000","last_became_peered":"2024-09-16T01:17:36.309303+0000","last_unstale":"2024-09-16T01:17:37.661936+0000","last_undegraded":"2024-09-16T01:17:37.661936+0000","last_fullsized":"2024-09-16T01:17:37.661936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:35.674463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321578+0000","last_change":"2024-09-16T01:17:36.319531+0000","last_active":"2024-09-16T01:17:37.321578+0000","last_peered":"2024-09-16T01:17:37.321578+0000","last_clean":"2024-09-16T01:17:37.321578+0000","last_became_active":"2024-09-16T01:17:36.319256+0000","last_became_peered":"2024-09-16T01:17:36.319256+0000","last_unstale":"2024-09-16T01:17:37.321578+0000","last_undegraded":"2024-09-16T01:17:37.321578+0000","last_fullsized":"2024-09-16T01:17:37.321578+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:31:53.142305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661901+0000","last_change":"2024-09-16T01:17:36.314030+0000","last_active":"2024-09-16T01:17:37.661901+0000","last_peered":"2024-09-16T01:17:37.661901+0000","last_clean":"2024-09-16T01:17:37.661901+0000","last_became_active":"2024-09-16T01:17:36.313775+0000","last_became_peered":"2024-09-16T01:17:36.313775+0000","last_unstale":"2024-09-16T01:17:37.661901+0000","last_undegraded":"2024-09-16T01:17:37.661901+0000","last_fullsized":"2024-09-16T01:17:37.661901+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:39.661466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661596+0000","last_change":"2024-09-16T01:17:36.316666+0000","last_active":"2024-09-16T01:17:37.661596+0000","last_peered":"2024-09-16T01:17:37.661596+0000","last_clean":"2024-09-16T01:17:37.661596+0000","last_became_active":"2024-09-16T01:17:36.316405+0000","last_became_peered":"2024-09-16T01:17:36.316405+0000","last_unstale":"2024-09-16T01:17:37.661596+0000","last_undegraded":"2024-09-16T01:17:37.661596+0000","last_fullsized":"2024-09-16T01:17:37.661596+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:18.069334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662247+0000","last_change":"2024-09-16T01:17:36.312050+0000","last_active":"2024-09-16T01:17:37.662247+0000","last_peered":"2024-09-16T01:17:37.662247+0000","last_clean":"2024-09-16T01:17:37.662247+0000","last_became_active":"2024-09-16T01:17:36.311692+0000","last_became_peered":"2024-09-16T01:17:36.311692+0000","last_unstale":"2024-09-16T01:17:37.662247+0000","last_undegraded":"2024-09-16T01:17:37.662247+0000","last_fullsized":"2024-09-16T01:17:37.662247+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:04.502983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320662+0000","last_change":"2024-09-16T01:17:36.309730+0000","last_active":"2024-09-16T01:17:37.320662+0000","last_peered":"2024-09-16T01:17:37.320662+0000","last_clean":"2024-09-16T01:17:37.320662+0000","last_became_active":"2024-09-16T01:17:36.309236+0000","last_became_peered":"2024-09-16T01:17:36.309236+0000","last_unstale":"2024-09-16T01:17:37.320662+0000","last_undegraded":"2024-09-16T01:17:37.320662+0000","last_fullsized":"2024-09-16T01:17:37.320662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:39.902021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661098+0000","last_change":"2024-09-16T01:17:36.319720+0000","last_active":"2024-09-16T01:17:37.661098+0000","last_peered":"2024-09-16T01:17:37.661098+0000","last_clean":"2024-09-16T01:17:37.661098+0000","last_became_active":"2024-09-16T01:17:36.319471+0000","last_became_peered":"2024-09-16T01:17:36.319471+0000","last_unstale":"2024-09-16T01:17:37.661098+0000","last_undegraded":"2024-09-16T01:17:37.661098+0000","last_fullsized":"2024-09-16T01:17:37.661098+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:40.971734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321673+0000","last_change":"2024-09-16T01:17:35.307519+0000","last_active":"2024-09-16T01:17:37.321673+0000","last_peered":"2024-09-16T01:17:37.321673+0000","last_clean":"2024-09-16T01:17:37.321673+0000","last_became_active":"2024-09-16T01:17:35.307224+0000","last_became_peered":"2024-09-16T01:17:35.307224+0000","last_unstale":"2024-09-16T01:17:37.321673+0000","last_undegraded":"2024-09-16T01:17:37.321673+0000","last_fullsized":"2024-09-16T01:17:37.321673+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:41.245307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320872+0000","last_change":"2024-09-16T01:17:36.310902+0000","last_active":"2024-09-16T01:17:37.320872+0000","last_peered":"2024-09-16T01:17:37.320872+0000","last_clean":"2024-09-16T01:17:37.320872+0000","last_became_active":"2024-09-16T01:17:36.310636+0000","last_became_peered":"2024-09-16T01:17:36.310636+0000","last_unstale":"2024-09-16T01:17:37.320872+0000","last_undegraded":"2024-09-16T01:17:37.320872+0000","last_fullsized":"2024-09-16T01:17:37.320872+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:15.305540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661514+0000","last_change":"2024-09-16T01:17:35.305084+0000","last_active":"2024-09-16T01:17:37.661514+0000","last_peered":"2024-09-16T01:17:37.661514+0000","last_clean":"2024-09-16T01:17:37.661514+0000","last_became_active":"2024-09-16T01:17:35.304833+0000","last_became_peered":"2024-09-16T01:17:35.304833+0000","last_unstale":"2024-09-16T01:17:37.661514+0000","last_undegraded":"2024-09-16T01:17:37.661514+0000","last_fullsized":"2024-09-16T01:17:37.661514+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:58.284242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321473+0000","last_change":"2024-09-16T01:17:36.310763+0000","last_active":"2024-09-16T01:17:37.321473+0000","last_peered":"2024-09-16T01:17:37.321473+0000","last_clean":"2024-09-16T01:17:37.321473+0000","last_became_active":"2024-09-16T01:17:36.310512+0000","last_became_peered":"2024-09-16T01:17:36.310512+0000","last_unstale":"2024-09-16T01:17:37.321473+0000","last_undegraded":"2024-09-16T01:17:37.321473+0000","last_fullsized":"2024-09-16T01:17:37.321473+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:31.015927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661945+0000","last_change":"2024-09-16T01:17:35.304477+0000","last_active":"2024-09-16T01:17:37.661945+0000","last_peered":"2024-09-16T01:17:37.661945+0000","last_clean":"2024-09-16T01:17:37.661945+0000","last_became_active":"2024-09-16T01:17:35.303831+0000","last_became_peered":"2024-09-16T01:17:35.303831+0000","last_unstale":"2024-09-16T01:17:37.661945+0000","last_undegraded":"2024-09-16T01:17:37.661945+0000","last_fullsized":"2024-09-16T01:17:37.661945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:20.685445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661773+0000","last_change":"2024-09-16T01:17:36.323020+0000","last_active":"2024-09-16T01:17:37.661773+0000","last_peered":"2024-09-16T01:17:37.661773+0000","last_clean":"2024-09-16T01:17:37.661773+0000","last_became_active":"2024-09-16T01:17:36.322758+0000","last_became_peered":"2024-09-16T01:17:36.322758+0000","last_unstale":"2024-09-16T01:17:37.661773+0000","last_undegraded":"2024-09-16T01:17:37.661773+0000","last_fullsized":"2024-09-16T01:17:37.661773+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:04.502983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320993+0000","last_change":"2024-09-16T01:17:35.304669+0000","last_active":"2024-09-16T01:17:37.320993+0000","last_peered":"2024-09-16T01:17:37.320993+0000","last_clean":"2024-09-16T01:17:37.320993+0000","last_became_active":"2024-09-16T01:17:35.304226+0000","last_became_peered":"2024-09-16T01:17:35.304226+0000","last_unstale":"2024-09-16T01:17:37.320993+0000","last_undegraded":"2024-09-16T01:17:37.320993+0000","last_fullsized":"2024-09-16T01:17:37.320993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:14.303917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661257+0000","last_change":"2024-09-16T01:17:36.318037+0000","last_active":"2024-09-16T01:17:37.661257+0000","last_peered":"2024-09-16T01:17:37.661257+0000","last_clean":"2024-09-16T01:17:37.661257+0000","last_became_active":"2024-09-16T01:17:36.317731+0000","last_became_peered":"2024-09-16T01:17:36.317731+0000","last_unstale":"2024-09-16T01:17:37.661257+0000","last_undegraded":"2024-09-16T01:17:37.661257+0000","last_fullsized":"2024-09-16T01:17:37.661257+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:13.726140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662000+0000","last_change":"2024-09-16T01:17:35.314026+0000","last_active":"2024-09-16T01:17:37.662000+0000","last_peered":"2024-09-16T01:17:37.662000+0000","last_clean":"2024-09-16T01:17:37.662000+0000","last_became_active":"2024-09-16T01:17:35.313777+0000","last_became_peered":"2024-09-16T01:17:35.313777+0000","last_unstale":"2024-09-16T01:17:37.662000+0000","last_undegraded":"2024-09-16T01:17:37.662000+0000","last_fullsized":"2024-09-16T01:17:37.662000+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:20.685445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661915+0000","last_change":"2024-09-16T01:17:36.316071+0000","last_active":"2024-09-16T01:17:37.661915+0000","last_peered":"2024-09-16T01:17:37.661915+0000","last_clean":"2024-09-16T01:17:37.661915+0000","last_became_active":"2024-09-16T01:17:36.315807+0000","last_became_peered":"2024-09-16T01:17:36.315807+0000","last_unstale":"2024-09-16T01:17:37.661915+0000","last_undegraded":"2024-09-16T01:17:37.661915+0000","last_fullsized":"2024-09-16T01:17:37.661915+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:14.136243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661317+0000","last_change":"2024-09-16T01:17:35.303802+0000","last_active":"2024-09-16T01:17:37.661317+0000","last_peered":"2024-09-16T01:17:37.661317+0000","last_clean":"2024-09-16T01:17:37.661317+0000","last_became_active":"2024-09-16T01:17:35.303342+0000","last_became_peered":"2024-09-16T01:17:35.303342+0000","last_unstale":"2024-09-16T01:17:37.661317+0000","last_undegraded":"2024-09-16T01:17:37.661317+0000","last_fullsized":"2024-09-16T01:17:37.661317+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:07.446431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661423+0000","last_change":"2024-09-16T01:17:36.319166+0000","last_active":"2024-09-16T01:17:37.661423+0000","last_peered":"2024-09-16T01:17:37.661423+0000","last_clean":"2024-09-16T01:17:37.661423+0000","last_became_active":"2024-09-16T01:17:36.318918+0000","last_became_peered":"2024-09-16T01:17:36.318918+0000","last_unstale":"2024-09-16T01:17:37.661423+0000","last_undegraded":"2024-09-16T01:17:37.661423+0000","last_fullsized":"2024-09-16T01:17:37.661423+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:02.848662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321288+0000","last_change":"2024-09-16T01:17:35.307860+0000","last_active":"2024-09-16T01:17:37.321288+0000","last_peered":"2024-09-16T01:17:37.321288+0000","last_clean":"2024-09-16T01:17:37.321288+0000","last_became_active":"2024-09-16T01:17:35.307368+0000","last_became_peered":"2024-09-16T01:17:35.307368+0000","last_unstale":"2024-09-16T01:17:37.321288+0000","last_undegraded":"2024-09-16T01:17:37.321288+0000","last_fullsized":"2024-09-16T01:17:37.321288+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:05.666664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661873+0000","last_change":"2024-09-16T01:17:36.320522+0000","last_active":"2024-09-16T01:17:37.661873+0000","last_peered":"2024-09-16T01:17:37.661873+0000","last_clean":"2024-09-16T01:17:37.661873+0000","last_became_active":"2024-09-16T01:17:36.320254+0000","last_became_peered":"2024-09-16T01:17:36.320254+0000","last_unstale":"2024-09-16T01:17:37.661873+0000","last_undegraded":"2024-09-16T01:17:37.661873+0000","last_fullsized":"2024-09-16T01:17:37.661873+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:39.661466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661692+0000","last_change":"2024-09-16T01:17:35.313616+0000","last_active":"2024-09-16T01:17:37.661692+0000","last_peered":"2024-09-16T01:17:37.661692+0000","last_clean":"2024-09-16T01:17:37.661692+0000","last_became_active":"2024-09-16T01:17:35.313006+0000","last_became_peered":"2024-09-16T01:17:35.313006+0000","last_unstale":"2024-09-16T01:17:37.661692+0000","last_undegraded":"2024-09-16T01:17:37.661692+0000","last_fullsized":"2024-09-16T01:17:37.661692+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:58.284242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.660991+0000","last_change":"2024-09-16T01:17:36.311596+0000","last_active":"2024-09-16T01:17:37.660991+0000","last_peered":"2024-09-16T01:17:37.660991+0000","last_clean":"2024-09-16T01:17:37.660991+0000","last_became_active":"2024-09-16T01:17:36.311304+0000","last_became_peered":"2024-09-16T01:17:36.311304+0000","last_unstale":"2024-09-16T01:17:37.660991+0000","last_undegraded":"2024-09-16T01:17:37.660991+0000","last_fullsized":"2024-09-16T01:17:37.660991+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:05.461965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661818+0000","last_change":"2024-09-16T01:17:35.306832+0000","last_active":"2024-09-16T01:17:37.661818+0000","last_peered":"2024-09-16T01:17:37.661818+0000","last_clean":"2024-09-16T01:17:37.661818+0000","last_became_active":"2024-09-16T01:17:35.306570+0000","last_became_peered":"2024-09-16T01:17:35.306570+0000","last_unstale":"2024-09-16T01:17:37.661818+0000","last_undegraded":"2024-09-16T01:17:37.661818+0000","last_fullsized":"2024-09-16T01:17:37.661818+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:33.574312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320931+0000","last_change":"2024-09-16T01:17:36.317231+0000","last_active":"2024-09-16T01:17:37.320931+0000","last_peered":"2024-09-16T01:17:37.320931+0000","last_clean":"2024-09-16T01:17:37.320931+0000","last_became_active":"2024-09-16T01:17:36.316940+0000","last_became_peered":"2024-09-16T01:17:36.316940+0000","last_unstale":"2024-09-16T01:17:37.320931+0000","last_undegraded":"2024-09-16T01:17:37.320931+0000","last_fullsized":"2024-09-16T01:17:37.320931+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:32.692533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661186+0000","last_change":"2024-09-16T01:17:35.314381+0000","last_active":"2024-09-16T01:17:37.661186+0000","last_peered":"2024-09-16T01:17:37.661186+0000","last_clean":"2024-09-16T01:17:37.661186+0000","last_became_active":"2024-09-16T01:17:35.314136+0000","last_became_peered":"2024-09-16T01:17:35.314136+0000","last_unstale":"2024-09-16T01:17:37.661186+0000","last_undegraded":"2024-09-16T01:17:37.661186+0000","last_fullsized":"2024-09-16T01:17:37.661186+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:37.045757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662111+0000","last_change":"2024-09-16T01:17:36.317809+0000","last_active":"2024-09-16T01:17:37.662111+0000","last_peered":"2024-09-16T01:17:37.662111+0000","last_clean":"2024-09-16T01:17:37.662111+0000","last_became_active":"2024-09-16T01:17:36.317484+0000","last_became_peered":"2024-09-16T01:17:36.317484+0000","last_unstale":"2024-09-16T01:17:37.662111+0000","last_undegraded":"2024-09-16T01:17:37.662111+0000","last_fullsized":"2024-09-16T01:17:37.662111+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:26.064988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661797+0000","last_change":"2024-09-16T01:17:35.309175+0000","last_active":"2024-09-16T01:17:37.661797+0000","last_peered":"2024-09-16T01:17:37.661797+0000","last_clean":"2024-09-16T01:17:37.661797+0000","last_became_active":"2024-09-16T01:17:35.308597+0000","last_became_peered":"2024-09-16T01:17:35.308597+0000","last_unstale":"2024-09-16T01:17:37.661797+0000","last_undegraded":"2024-09-16T01:17:37.661797+0000","last_fullsized":"2024-09-16T01:17:37.661797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:31:52.136123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661330+0000","last_change":"2024-09-16T01:17:36.315376+0000","last_active":"2024-09-16T01:17:37.661330+0000","last_peered":"2024-09-16T01:17:37.661330+0000","last_clean":"2024-09-16T01:17:37.661330+0000","last_became_active":"2024-09-16T01:17:36.315119+0000","last_became_peered":"2024-09-16T01:17:36.315119+0000","last_unstale":"2024-09-16T01:17:37.661330+0000","last_undegraded":"2024-09-16T01:17:37.661330+0000","last_fullsized":"2024-09-16T01:17:37.661330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:49.667239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662519+0000","last_change":"2024-09-16T01:17:35.309225+0000","last_active":"2024-09-16T01:17:37.662519+0000","last_peered":"2024-09-16T01:17:37.662519+0000","last_clean":"2024-09-16T01:17:37.662519+0000","last_became_active":"2024-09-16T01:17:35.308384+0000","last_became_peered":"2024-09-16T01:17:35.308384+0000","last_unstale":"2024-09-16T01:17:37.662519+0000","last_undegraded":"2024-09-16T01:17:37.662519+0000","last_fullsized":"2024-09-16T01:17:37.662519+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:46.502859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321024+0000","last_change":"2024-09-16T01:17:36.314020+0000","last_active":"2024-09-16T01:17:37.321024+0000","last_peered":"2024-09-16T01:17:37.321024+0000","last_clean":"2024-09-16T01:17:37.321024+0000","last_became_active":"2024-09-16T01:17:36.313333+0000","last_became_peered":"2024-09-16T01:17:36.313333+0000","last_unstale":"2024-09-16T01:17:37.321024+0000","last_undegraded":"2024-09-16T01:17:37.321024+0000","last_fullsized":"2024-09-16T01:17:37.321024+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:18.069334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662100+0000","last_change":"2024-09-16T01:17:35.314241+0000","last_active":"2024-09-16T01:17:37.662100+0000","last_peered":"2024-09-16T01:17:37.662100+0000","last_clean":"2024-09-16T01:17:37.662100+0000","last_became_active":"2024-09-16T01:17:35.313020+0000","last_became_peered":"2024-09-16T01:17:35.313020+0000","last_unstale":"2024-09-16T01:17:37.662100+0000","last_undegraded":"2024-09-16T01:17:37.662100+0000","last_fullsized":"2024-09-16T01:17:37.662100+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:04.455783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661727+0000","last_change":"2024-09-16T01:17:36.308846+0000","last_active":"2024-09-16T01:17:37.661727+0000","last_peered":"2024-09-16T01:17:37.661727+0000","last_clean":"2024-09-16T01:17:37.661727+0000","last_became_active":"2024-09-16T01:17:36.307989+0000","last_became_peered":"2024-09-16T01:17:36.307989+0000","last_unstale":"2024-09-16T01:17:37.661727+0000","last_undegraded":"2024-09-16T01:17:37.661727+0000","last_fullsized":"2024-09-16T01:17:37.661727+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:04.077254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321367+0000","last_change":"2024-09-16T01:17:35.315242+0000","last_active":"2024-09-16T01:17:37.321367+0000","last_peered":"2024-09-16T01:17:37.321367+0000","last_clean":"2024-09-16T01:17:37.321367+0000","last_became_active":"2024-09-16T01:17:35.314959+0000","last_became_peered":"2024-09-16T01:17:35.314959+0000","last_unstale":"2024-09-16T01:17:37.321367+0000","last_undegraded":"2024-09-16T01:17:37.321367+0000","last_fullsized":"2024-09-16T01:17:37.321367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:37.045757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661289+0000","last_change":"2024-09-16T01:17:36.319609+0000","last_active":"2024-09-16T01:17:37.661289+0000","last_peered":"2024-09-16T01:17:37.661289+0000","last_clean":"2024-09-16T01:17:37.661289+0000","last_became_active":"2024-09-16T01:17:36.319353+0000","last_became_peered":"2024-09-16T01:17:36.319353+0000","last_unstale":"2024-09-16T01:17:37.661289+0000","last_undegraded":"2024-09-16T01:17:37.661289+0000","last_fullsized":"2024-09-16T01:17:37.661289+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:28.079552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661494+0000","last_change":"2024-09-16T01:17:35.310236+0000","last_active":"2024-09-16T01:17:37.661494+0000","last_peered":"2024-09-16T01:17:37.661494+0000","last_clean":"2024-09-16T01:17:37.661494+0000","last_became_active":"2024-09-16T01:17:35.309956+0000","last_became_peered":"2024-09-16T01:17:35.309956+0000","last_unstale":"2024-09-16T01:17:37.661494+0000","last_undegraded":"2024-09-16T01:17:37.661494+0000","last_fullsized":"2024-09-16T01:17:37.661494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:14.303917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662194+0000","last_change":"2024-09-16T01:17:36.312714+0000","last_active":"2024-09-16T01:17:37.662194+0000","last_peered":"2024-09-16T01:17:37.662194+0000","last_clean":"2024-09-16T01:17:37.662194+0000","last_became_active":"2024-09-16T01:17:36.312455+0000","last_became_peered":"2024-09-16T01:17:36.312455+0000","last_unstale":"2024-09-16T01:17:37.662194+0000","last_undegraded":"2024-09-16T01:17:37.662194+0000","last_fullsized":"2024-09-16T01:17:37.662194+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:02.848662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661401+0000","last_change":"2024-09-16T01:17:35.308107+0000","last_active":"2024-09-16T01:17:37.661401+0000","last_peered":"2024-09-16T01:17:37.661401+0000","last_clean":"2024-09-16T01:17:37.661401+0000","last_became_active":"2024-09-16T01:17:35.307829+0000","last_became_peered":"2024-09-16T01:17:35.307829+0000","last_unstale":"2024-09-16T01:17:37.661401+0000","last_undegraded":"2024-09-16T01:17:37.661401+0000","last_fullsized":"2024-09-16T01:17:37.661401+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:58.347467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661307+0000","last_change":"2024-09-16T01:17:36.310830+0000","last_active":"2024-09-16T01:17:37.661307+0000","last_peered":"2024-09-16T01:17:37.661307+0000","last_clean":"2024-09-16T01:17:37.661307+0000","last_became_active":"2024-09-16T01:17:36.310550+0000","last_became_peered":"2024-09-16T01:17:36.310550+0000","last_unstale":"2024-09-16T01:17:37.661307+0000","last_undegraded":"2024-09-16T01:17:37.661307+0000","last_fullsized":"2024-09-16T01:17:37.661307+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:26.064988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662332+0000","last_change":"2024-09-16T01:17:35.316125+0000","last_active":"2024-09-16T01:17:37.662332+0000","last_peered":"2024-09-16T01:17:37.662332+0000","last_clean":"2024-09-16T01:17:37.662332+0000","last_became_active":"2024-09-16T01:17:35.315753+0000","last_became_peered":"2024-09-16T01:17:35.315753+0000","last_unstale":"2024-09-16T01:17:37.662332+0000","last_undegraded":"2024-09-16T01:17:37.662332+0000","last_fullsized":"2024-09-16T01:17:37.662332+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:53.763255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661027+0000","last_change":"2024-09-16T01:17:36.305965+0000","last_active":"2024-09-16T01:17:37.661027+0000","last_peered":"2024-09-16T01:17:37.661027+0000","last_clean":"2024-09-16T01:17:37.661027+0000","last_became_active":"2024-09-16T01:17:36.305690+0000","last_became_peered":"2024-09-16T01:17:36.305690+0000","last_unstale":"2024-09-16T01:17:37.661027+0000","last_undegraded":"2024-09-16T01:17:37.661027+0000","last_fullsized":"2024-09-16T01:17:37.661027+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:34.580493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.313389+0000","last_change":"2024-09-16T01:17:35.307265+0000","last_active":"2024-09-16T01:17:37.313389+0000","last_peered":"2024-09-16T01:17:37.313389+0000","last_clean":"2024-09-16T01:17:37.313389+0000","last_became_active":"2024-09-16T01:17:35.306986+0000","last_became_peered":"2024-09-16T01:17:35.306986+0000","last_unstale":"2024-09-16T01:17:37.313389+0000","last_undegraded":"2024-09-16T01:17:37.313389+0000","last_fullsized":"2024-09-16T01:17:37.313389+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:58:25.006284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661349+0000","last_change":"2024-09-16T01:17:36.318863+0000","last_active":"2024-09-16T01:17:37.661349+0000","last_peered":"2024-09-16T01:17:37.661349+0000","last_clean":"2024-09-16T01:17:37.661349+0000","last_became_active":"2024-09-16T01:17:36.318599+0000","last_became_peered":"2024-09-16T01:17:36.318599+0000","last_unstale":"2024-09-16T01:17:37.661349+0000","last_undegraded":"2024-09-16T01:17:37.661349+0000","last_fullsized":"2024-09-16T01:17:37.661349+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:54.769436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321714+0000","last_change":"2024-09-16T01:17:35.307033+0000","last_active":"2024-09-16T01:17:37.321714+0000","last_peered":"2024-09-16T01:17:37.321714+0000","last_clean":"2024-09-16T01:17:37.321714+0000","last_became_active":"2024-09-16T01:17:35.306077+0000","last_became_peered":"2024-09-16T01:17:35.306077+0000","last_unstale":"2024-09-16T01:17:37.321714+0000","last_undegraded":"2024-09-16T01:17:37.321714+0000","last_fullsized":"2024-09-16T01:17:37.321714+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:52.820522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661551+0000","last_change":"2024-09-16T01:17:36.309189+0000","last_active":"2024-09-16T01:17:37.661551+0000","last_peered":"2024-09-16T01:17:37.661551+0000","last_clean":"2024-09-16T01:17:37.661551+0000","last_became_active":"2024-09-16T01:17:36.308942+0000","last_became_peered":"2024-09-16T01:17:36.308942+0000","last_unstale":"2024-09-16T01:17:37.661551+0000","last_undegraded":"2024-09-16T01:17:37.661551+0000","last_fullsized":"2024-09-16T01:17:37.661551+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:39.902021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321610+0000","last_change":"2024-09-16T01:17:35.306630+0000","last_active":"2024-09-16T01:17:37.321610+0000","last_peered":"2024-09-16T01:17:37.321610+0000","last_clean":"2024-09-16T01:17:37.321610+0000","last_became_active":"2024-09-16T01:17:35.306293+0000","last_became_peered":"2024-09-16T01:17:35.306293+0000","last_unstale":"2024-09-16T01:17:37.321610+0000","last_undegraded":"2024-09-16T01:17:37.321610+0000","last_fullsized":"2024-09-16T01:17:37.321610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:55.874075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320776+0000","last_change":"2024-09-16T01:17:36.317185+0000","last_active":"2024-09-16T01:17:37.320776+0000","last_peered":"2024-09-16T01:17:37.320776+0000","last_clean":"2024-09-16T01:17:37.320776+0000","last_became_active":"2024-09-16T01:17:36.316880+0000","last_became_peered":"2024-09-16T01:17:36.316880+0000","last_unstale":"2024-09-16T01:17:37.320776+0000","last_undegraded":"2024-09-16T01:17:37.320776+0000","last_fullsized":"2024-09-16T01:17:37.320776+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:25.729188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661619+0000","last_change":"2024-09-16T01:17:35.303476+0000","last_active":"2024-09-16T01:17:37.661619+0000","last_peered":"2024-09-16T01:17:37.661619+0000","last_clean":"2024-09-16T01:17:37.661619+0000","last_became_active":"2024-09-16T01:17:35.303184+0000","last_became_peered":"2024-09-16T01:17:35.303184+0000","last_unstale":"2024-09-16T01:17:37.661619+0000","last_undegraded":"2024-09-16T01:17:37.661619+0000","last_fullsized":"2024-09-16T01:17:37.661619+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:52.820522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321632+0000","last_change":"2024-09-16T01:17:36.311615+0000","last_active":"2024-09-16T01:17:37.321632+0000","last_peered":"2024-09-16T01:17:37.321632+0000","last_clean":"2024-09-16T01:17:37.321632+0000","last_became_active":"2024-09-16T01:17:36.311315+0000","last_became_peered":"2024-09-16T01:17:36.311315+0000","last_unstale":"2024-09-16T01:17:37.321632+0000","last_undegraded":"2024-09-16T01:17:37.321632+0000","last_fullsized":"2024-09-16T01:17:37.321632+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:50.833975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661674+0000","last_change":"2024-09-16T01:17:35.311139+0000","last_active":"2024-09-16T01:17:37.661674+0000","last_peered":"2024-09-16T01:17:37.661674+0000","last_clean":"2024-09-16T01:17:37.661674+0000","last_became_active":"2024-09-16T01:17:35.310888+0000","last_became_peered":"2024-09-16T01:17:35.310888+0000","last_unstale":"2024-09-16T01:17:37.661674+0000","last_undegraded":"2024-09-16T01:17:37.661674+0000","last_fullsized":"2024-09-16T01:17:37.661674+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:33.574312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662329+0000","last_change":"2024-09-16T01:17:36.315137+0000","last_active":"2024-09-16T01:17:37.662329+0000","last_peered":"2024-09-16T01:17:37.662329+0000","last_clean":"2024-09-16T01:17:37.662329+0000","last_became_active":"2024-09-16T01:17:36.314881+0000","last_became_peered":"2024-09-16T01:17:36.314881+0000","last_unstale":"2024-09-16T01:17:37.662329+0000","last_undegraded":"2024-09-16T01:17:37.662329+0000","last_fullsized":"2024-09-16T01:17:37.662329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:00.230785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662334+0000","last_change":"2024-09-16T01:17:35.314028+0000","last_active":"2024-09-16T01:17:37.662334+0000","last_peered":"2024-09-16T01:17:37.662334+0000","last_clean":"2024-09-16T01:17:37.662334+0000","last_became_active":"2024-09-16T01:17:35.313718+0000","last_became_peered":"2024-09-16T01:17:35.313718+0000","last_unstale":"2024-09-16T01:17:37.662334+0000","last_undegraded":"2024-09-16T01:17:37.662334+0000","last_fullsized":"2024-09-16T01:17:37.662334+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:48.661057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661290+0000","last_change":"2024-09-16T01:17:36.310066+0000","last_active":"2024-09-16T01:17:37.661290+0000","last_peered":"2024-09-16T01:17:37.661290+0000","last_clean":"2024-09-16T01:17:37.661290+0000","last_became_active":"2024-09-16T01:17:36.309544+0000","last_became_peered":"2024-09-16T01:17:36.309544+0000","last_unstale":"2024-09-16T01:17:37.661290+0000","last_undegraded":"2024-09-16T01:17:37.661290+0000","last_fullsized":"2024-09-16T01:17:37.661290+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:39.486911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.313271+0000","last_change":"2024-09-16T01:17:35.311219+0000","last_active":"2024-09-16T01:17:37.313271+0000","last_peered":"2024-09-16T01:17:37.313271+0000","last_clean":"2024-09-16T01:17:37.313271+0000","last_became_active":"2024-09-16T01:17:35.310873+0000","last_became_peered":"2024-09-16T01:17:35.310873+0000","last_unstale":"2024-09-16T01:17:37.313271+0000","last_undegraded":"2024-09-16T01:17:37.313271+0000","last_fullsized":"2024-09-16T01:17:37.313271+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:21.830785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320679+0000","last_change":"2024-09-16T01:17:36.309507+0000","last_active":"2024-09-16T01:17:37.320679+0000","last_peered":"2024-09-16T01:17:37.320679+0000","last_clean":"2024-09-16T01:17:37.320679+0000","last_became_active":"2024-09-16T01:17:36.309204+0000","last_became_peered":"2024-09-16T01:17:36.309204+0000","last_unstale":"2024-09-16T01:17:37.320679+0000","last_undegraded":"2024-09-16T01:17:37.320679+0000","last_fullsized":"2024-09-16T01:17:37.320679+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:35.674463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321754+0000","last_change":"2024-09-16T01:17:35.315279+0000","last_active":"2024-09-16T01:17:37.321754+0000","last_peered":"2024-09-16T01:17:37.321754+0000","last_clean":"2024-09-16T01:17:37.321754+0000","last_became_active":"2024-09-16T01:17:35.315035+0000","last_became_peered":"2024-09-16T01:17:35.315035+0000","last_unstale":"2024-09-16T01:17:37.321754+0000","last_undegraded":"2024-09-16T01:17:37.321754+0000","last_fullsized":"2024-09-16T01:17:37.321754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:07.446431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661289+0000","last_change":"2024-09-16T01:17:36.315326+0000","last_active":"2024-09-16T01:17:37.661289+0000","last_peered":"2024-09-16T01:17:37.661289+0000","last_clean":"2024-09-16T01:17:37.661289+0000","last_became_active":"2024-09-16T01:17:36.315024+0000","last_became_peered":"2024-09-16T01:17:36.315024+0000","last_unstale":"2024-09-16T01:17:37.661289+0000","last_undegraded":"2024-09-16T01:17:37.661289+0000","last_fullsized":"2024-09-16T01:17:37.661289+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:47.509040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661892+0000","last_change":"2024-09-16T01:17:35.310967+0000","last_active":"2024-09-16T01:17:37.661892+0000","last_peered":"2024-09-16T01:17:37.661892+0000","last_clean":"2024-09-16T01:17:37.661892+0000","last_became_active":"2024-09-16T01:17:35.310672+0000","last_became_peered":"2024-09-16T01:17:35.310672+0000","last_unstale":"2024-09-16T01:17:37.661892+0000","last_undegraded":"2024-09-16T01:17:37.661892+0000","last_fullsized":"2024-09-16T01:17:37.661892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:49.827793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661924+0000","last_change":"2024-09-16T01:17:36.313990+0000","last_active":"2024-09-16T01:17:37.661924+0000","last_peered":"2024-09-16T01:17:37.661924+0000","last_clean":"2024-09-16T01:17:37.661924+0000","last_became_active":"2024-09-16T01:17:36.313715+0000","last_became_peered":"2024-09-16T01:17:36.313715+0000","last_unstale":"2024-09-16T01:17:37.661924+0000","last_undegraded":"2024-09-16T01:17:37.661924+0000","last_fullsized":"2024-09-16T01:17:37.661924+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:17.227756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661244+0000","last_change":"2024-09-16T01:17:35.312732+0000","last_active":"2024-09-16T01:17:37.661244+0000","last_peered":"2024-09-16T01:17:37.661244+0000","last_clean":"2024-09-16T01:17:37.661244+0000","last_became_active":"2024-09-16T01:17:35.312314+0000","last_became_peered":"2024-09-16T01:17:35.312314+0000","last_unstale":"2024-09-16T01:17:37.661244+0000","last_undegraded":"2024-09-16T01:17:37.661244+0000","last_fullsized":"2024-09-16T01:17:37.661244+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:49.930419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661158+0000","last_change":"2024-09-16T01:17:36.310394+0000","last_active":"2024-09-16T01:17:37.661158+0000","last_peered":"2024-09-16T01:17:37.661158+0000","last_clean":"2024-09-16T01:17:37.661158+0000","last_became_active":"2024-09-16T01:17:36.310146+0000","last_became_peered":"2024-09-16T01:17:36.310146+0000","last_unstale":"2024-09-16T01:17:37.661158+0000","last_undegraded":"2024-09-16T01:17:37.661158+0000","last_fullsized":"2024-09-16T01:17:37.661158+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:40.971734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661882+0000","last_change":"2024-09-16T01:17:35.308626+0000","last_active":"2024-09-16T01:17:37.661882+0000","last_peered":"2024-09-16T01:17:37.661882+0000","last_clean":"2024-09-16T01:17:37.661882+0000","last_became_active":"2024-09-16T01:17:35.308206+0000","last_became_peered":"2024-09-16T01:17:35.308206+0000","last_unstale":"2024-09-16T01:17:37.661882+0000","last_undegraded":"2024-09-16T01:17:37.661882+0000","last_fullsized":"2024-09-16T01:17:37.661882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:38.480729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320881+0000","last_change":"2024-09-16T01:17:36.311550+0000","last_active":"2024-09-16T01:17:37.320881+0000","last_peered":"2024-09-16T01:17:37.320881+0000","last_clean":"2024-09-16T01:17:37.320881+0000","last_became_active":"2024-09-16T01:17:36.311284+0000","last_became_peered":"2024-09-16T01:17:36.311284+0000","last_unstale":"2024-09-16T01:17:37.320881+0000","last_undegraded":"2024-09-16T01:17:37.320881+0000","last_fullsized":"2024-09-16T01:17:37.320881+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:40.971734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661763+0000","last_change":"2024-09-16T01:17:35.310867+0000","last_active":"2024-09-16T01:17:37.661763+0000","last_peered":"2024-09-16T01:17:37.661763+0000","last_clean":"2024-09-16T01:17:37.661763+0000","last_became_active":"2024-09-16T01:17:35.310537+0000","last_became_peered":"2024-09-16T01:17:35.310537+0000","last_unstale":"2024-09-16T01:17:37.661763+0000","last_undegraded":"2024-09-16T01:17:37.661763+0000","last_fullsized":"2024-09-16T01:17:37.661763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:22.533493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662243+0000","last_change":"2024-09-16T01:17:36.319521+0000","last_active":"2024-09-16T01:17:37.662243+0000","last_peered":"2024-09-16T01:17:37.662243+0000","last_clean":"2024-09-16T01:17:37.662243+0000","last_became_active":"2024-09-16T01:17:36.319143+0000","last_became_peered":"2024-09-16T01:17:36.319143+0000","last_unstale":"2024-09-16T01:17:37.662243+0000","last_undegraded":"2024-09-16T01:17:37.662243+0000","last_fullsized":"2024-09-16T01:17:37.662243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:17.227756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.660929+0000","last_change":"2024-09-16T01:17:35.310043+0000","last_active":"2024-09-16T01:17:37.660929+0000","last_peered":"2024-09-16T01:17:37.660929+0000","last_clean":"2024-09-16T01:17:37.660929+0000","last_became_active":"2024-09-16T01:17:35.309676+0000","last_became_peered":"2024-09-16T01:17:35.309676+0000","last_unstale":"2024-09-16T01:17:37.660929+0000","last_undegraded":"2024-09-16T01:17:37.660929+0000","last_fullsized":"2024-09-16T01:17:37.660929+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:41.245307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662396+0000","last_change":"2024-09-16T01:17:36.315778+0000","last_active":"2024-09-16T01:17:37.662396+0000","last_peered":"2024-09-16T01:17:37.662396+0000","last_clean":"2024-09-16T01:17:37.662396+0000","last_became_active":"2024-09-16T01:17:36.315495+0000","last_became_peered":"2024-09-16T01:17:36.315495+0000","last_unstale":"2024-09-16T01:17:37.662396+0000","last_undegraded":"2024-09-16T01:17:37.662396+0000","last_fullsized":"2024-09-16T01:17:37.662396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:00.230785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320950+0000","last_change":"2024-09-16T01:17:35.305291+0000","last_active":"2024-09-16T01:17:37.320950+0000","last_peered":"2024-09-16T01:17:37.320950+0000","last_clean":"2024-09-16T01:17:37.320950+0000","last_became_active":"2024-09-16T01:17:35.304991+0000","last_became_peered":"2024-09-16T01:17:35.304991+0000","last_unstale":"2024-09-16T01:17:37.320950+0000","last_undegraded":"2024-09-16T01:17:37.320950+0000","last_fullsized":"2024-09-16T01:17:37.320950+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:49.827793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321373+0000","last_change":"2024-09-16T01:17:36.306798+0000","last_active":"2024-09-16T01:17:37.321373+0000","last_peered":"2024-09-16T01:17:37.321373+0000","last_clean":"2024-09-16T01:17:37.321373+0000","last_became_active":"2024-09-16T01:17:36.306498+0000","last_became_peered":"2024-09-16T01:17:36.306498+0000","last_unstale":"2024-09-16T01:17:37.321373+0000","last_undegraded":"2024-09-16T01:17:37.321373+0000","last_fullsized":"2024-09-16T01:17:37.321373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:54.769436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662329+0000","last_change":"2024-09-16T01:17:35.313561+0000","last_active":"2024-09-16T01:17:37.662329+0000","last_peered":"2024-09-16T01:17:37.662329+0000","last_clean":"2024-09-16T01:17:37.662329+0000","last_became_active":"2024-09-16T01:17:35.312958+0000","last_became_peered":"2024-09-16T01:17:35.312958+0000","last_unstale":"2024-09-16T01:17:37.662329+0000","last_undegraded":"2024-09-16T01:17:37.662329+0000","last_fullsized":"2024-09-16T01:17:37.662329+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:12.719958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":226,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661152+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:17:37.661152+0000","last_peered":"2024-09-16T01:17:37.661152+0000","last_clean":"2024-09-16T01:17:37.661152+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:17:37.661152+0000","last_undegraded":"2024-09-16T01:17:37.661152+0000","last_fullsized":"2024-09-16T01:17:37.661152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":853009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":614400,"data_stored":269861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":606208,"data_stored":269209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":598016,"data_stored":263099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":622592,"data_stored":270843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":618496,"data_stored":270821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":602112,"data_stored":262677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28216,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1208320,"data_stored":859633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:17:43.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:17:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.741+0000 7f286972c640 1 Processor -- start 2024-09-16T01:17:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.741+0000 7f286972c640 1 -- start start 2024-09-16T01:17:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.741+0000 7f286972c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f286415c490 0x7f286409b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.741+0000 7f286972c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f286415cf80 0x7f28640ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.741+0000 7f286972c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28640d01c0 con 0x7f286409b980 2024-09-16T01:17:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.741+0000 7f286972c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f28640cff70 con 0x7f286415cf80 2024-09-16T01:17:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.741+0000 7f286972c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f28640d0dd0 con 0x7f286415c490 2024-09-16T01:17:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.742+0000 7f2862ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f286415c490 0x7f286409b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.742+0000 7f28637fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f286415cf80 0x7f28640ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.742+0000 7f28627fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f286409b980 0x7f286415c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:50010/0 (socket says 172.21.15.81:50010) 2024-09-16T01:17:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.742+0000 7f28627fc640 1 -- 172.21.15.81:0/218671744 learned_addr learned my addr 172.21.15.81:0/218671744 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.742+0000 7f2861ffb640 1 -- 172.21.15.81:0/218671744 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755601522 0 0) 0x7f28640d01c0 con 0x7f286409b980 2024-09-16T01:17:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.742+0000 7f2861ffb640 1 -- 172.21.15.81:0/218671744 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f284c003520 con 0x7f286409b980 2024-09-16T01:17:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.742+0000 7f28637fe640 1 -- 172.21.15.81:0/218671744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f286415c490 msgr2=0x7f286409b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.742+0000 7f28637fe640 1 --2- 172.21.15.81:0/218671744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f286415c490 0x7f286409b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.742+0000 7f28637fe640 1 -- 172.21.15.81:0/218671744 >> v1:172.21.15.102:6789/0 conn(0x7f286409b980 legacy=0x7f286415c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.742+0000 7f28637fe640 1 -- 172.21.15.81:0/218671744 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28640d04a0 con 0x7f286415cf80 2024-09-16T01:17:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.742+0000 7f2862ffd640 1 --2- 172.21.15.81:0/218671744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f286415c490 0x7f286409b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:17:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.743+0000 7f28637fe640 1 --2- 172.21.15.81:0/218671744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f286415cf80 0x7f28640ccf90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f285c009d90 tx=0x7f285c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96de71d2f08e464a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.743+0000 7f2861ffb640 1 -- 172.21.15.81:0/218671744 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c007740 con 0x7f286415cf80 2024-09-16T01:17:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.743+0000 7f2861ffb640 1 -- 172.21.15.81:0/218671744 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c0078e0 con 0x7f286415cf80 2024-09-16T01:17:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.743+0000 7f2861ffb640 1 -- 172.21.15.81:0/218671744 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c007c90 con 0x7f286415cf80 2024-09-16T01:17:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.744+0000 7f286972c640 1 -- 172.21.15.81:0/218671744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f286415cf80 msgr2=0x7f28640ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.744+0000 7f286972c640 1 --2- 172.21.15.81:0/218671744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f286415cf80 0x7f28640ccf90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f285c009d90 tx=0x7f285c02a6f0 comp rx=0 tx=0).stop 2024-09-16T01:17:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.744+0000 7f286972c640 1 -- 172.21.15.81:0/218671744 shutdown_connections 2024-09-16T01:17:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.744+0000 7f286972c640 1 --2- 172.21.15.81:0/218671744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f286415cf80 0x7f28640ccf90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.744+0000 7f286972c640 1 --2- 172.21.15.81:0/218671744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f286415c490 0x7f286409b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.744+0000 7f286972c640 1 -- 172.21.15.81:0/218671744 >> 172.21.15.81:0/218671744 conn(0x7f28640d23a0 msgr2=0x7f28640d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.744+0000 7f286972c640 1 -- 172.21.15.81:0/218671744 shutdown_connections 2024-09-16T01:17:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.744+0000 7f286972c640 1 -- 172.21.15.81:0/218671744 wait complete. 2024-09-16T01:17:43.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.745+0000 7f286972c640 1 Processor -- start 2024-09-16T01:17:43.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.745+0000 7f286972c640 1 -- start start 2024-09-16T01:17:43.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.746+0000 7f286972c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f286409b980 0x7f2864160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.746+0000 7f286972c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286415c490 0x7f2864159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.746+0000 7f286972c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f286415cf80 0x7f2864159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.746+0000 7f286972c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28640d1260 con 0x7f286415c490 2024-09-16T01:17:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.746+0000 7f286972c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f28640d0a60 con 0x7f286409b980 2024-09-16T01:17:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.746+0000 7f286972c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2864160da0 con 0x7f286415cf80 2024-09-16T01:17:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.746+0000 7f28627fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286415c490 0x7f2864159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.746+0000 7f28627fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286415c490 0x7f2864159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53736/0 (socket says 172.21.15.81:53736) 2024-09-16T01:17:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.746+0000 7f28627fc640 1 -- 172.21.15.81:0/1620013704 learned_addr learned my addr 172.21.15.81:0/1620013704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.746+0000 7f2862ffd640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f286409b980 0x7f2864160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.746+0000 7f28637fe640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f286415cf80 0x7f2864159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.747+0000 7f28627fc640 1 -- 172.21.15.81:0/1620013704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f286415cf80 msgr2=0x7f2864159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.747+0000 7f28627fc640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f286415cf80 0x7f2864159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.747+0000 7f28627fc640 1 -- 172.21.15.81:0/1620013704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f286409b980 msgr2=0x7f2864160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.747+0000 7f28627fc640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f286409b980 0x7f2864160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.747+0000 7f28627fc640 1 -- 172.21.15.81:0/1620013704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28641f31b0 con 0x7f286415c490 2024-09-16T01:17:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.747+0000 7f2862ffd640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f286409b980 0x7f2864160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.747+0000 7f28627fc640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286415c490 0x7f2864159a90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f285800c430 tx=0x7f285800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.747+0000 7f284b7fe640 1 -- 172.21.15.81:0/1620013704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2858017070 con 0x7f286415c490 2024-09-16T01:17:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.747+0000 7f284b7fe640 1 -- 172.21.15.81:0/1620013704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2858005d00 con 0x7f286415c490 2024-09-16T01:17:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.747+0000 7f286972c640 1 -- 172.21.15.81:0/1620013704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28641f3490 con 0x7f286415c490 2024-09-16T01:17:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.747+0000 7f284b7fe640 1 -- 172.21.15.81:0/1620013704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2858007310 con 0x7f286415c490 2024-09-16T01:17:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.747+0000 7f286972c640 1 -- 172.21.15.81:0/1620013704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28641f3a50 con 0x7f286415c490 2024-09-16T01:17:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.748+0000 7f286972c640 1 -- 172.21.15.81:0/1620013704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28640d01c0 con 0x7f286415c490 2024-09-16T01:17:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.749+0000 7f284b7fe640 1 -- 172.21.15.81:0/1620013704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f285801a070 con 0x7f286415c490 2024-09-16T01:17:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.749+0000 7f284b7fe640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f285006c2b0 0x7f285006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.749+0000 7f284b7fe640 1 -- 172.21.15.81:0/1620013704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f285808a970 con 0x7f286415c490 2024-09-16T01:17:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.749+0000 7f2862ffd640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f285006c2b0 0x7f285006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.749+0000 7f2862ffd640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f285006c2b0 0x7f285006e770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2854009ba0 tx=0x7f2854008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:43.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.753+0000 7f284b7fe640 1 -- 172.21.15.81:0/1620013704 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2858058fe0 con 0x7f286415c490 2024-09-16T01:17:43.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.915+0000 7f286972c640 1 -- 172.21.15.81:0/1620013704 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f28640d3190 con 0x7f285006c2b0 2024-09-16T01:17:43.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.921+0000 7f284b7fe640 1 -- 172.21.15.81:0/1620013704 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251956 (secure 0 0 0) 0x7f28640d3190 con 0x7f285006c2b0 2024-09-16T01:17:43.924 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:43.925 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:17:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.924+0000 7f286972c640 1 -- 172.21.15.81:0/1620013704 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f285006c2b0 msgr2=0x7f285006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.924+0000 7f286972c640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f285006c2b0 0x7f285006e770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2854009ba0 tx=0x7f2854008040 comp rx=0 tx=0).stop 2024-09-16T01:17:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.924+0000 7f286972c640 1 -- 172.21.15.81:0/1620013704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286415c490 msgr2=0x7f2864159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.924+0000 7f286972c640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286415c490 0x7f2864159a90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f285800c430 tx=0x7f285800c8f0 comp rx=0 tx=0).stop 2024-09-16T01:17:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.924+0000 7f286972c640 1 -- 172.21.15.81:0/1620013704 shutdown_connections 2024-09-16T01:17:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.924+0000 7f286972c640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f285006c2b0 0x7f285006e770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.924+0000 7f286972c640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f286415cf80 0x7f2864159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.924+0000 7f286972c640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f286415c490 0x7f2864159a90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.924+0000 7f286972c640 1 --2- 172.21.15.81:0/1620013704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f286409b980 0x7f2864160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.924+0000 7f286972c640 1 -- 172.21.15.81:0/1620013704 >> 172.21.15.81:0/1620013704 conn(0x7f28640d23a0 msgr2=0x7f28640d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.924+0000 7f286972c640 1 -- 172.21.15.81:0/1620013704 shutdown_connections 2024-09-16T01:17:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:43.924+0000 7f286972c640 1 -- 172.21.15.81:0/1620013704 wait complete. 2024-09-16T01:17:43.936 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-09-16T01:17:42.084901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222192,"kb_used_data":5924,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754752528,"statfs":{"total":773094113280,"available":772866588672,"internally_reserved":0,"allocated":6066176,"data_stored":3319152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.791268"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661160+0000","last_change":"2024-09-16T01:17:36.308552+0000","last_active":"2024-09-16T01:17:37.661160+0000","last_peered":"2024-09-16T01:17:37.661160+0000","last_clean":"2024-09-16T01:17:37.661160+0000","last_became_active":"2024-09-16T01:17:36.308321+0000","last_became_peered":"2024-09-16T01:17:36.308321+0000","last_unstale":"2024-09-16T01:17:37.661160+0000","last_undegraded":"2024-09-16T01:17:37.661160+0000","last_fullsized":"2024-09-16T01:17:37.661160+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:23.539675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661874+0000","last_change":"2024-09-16T01:17:36.320583+0000","last_active":"2024-09-16T01:17:37.661874+0000","last_peered":"2024-09-16T01:17:37.661874+0000","last_clean":"2024-09-16T01:17:37.661874+0000","last_became_active":"2024-09-16T01:17:36.320127+0000","last_became_peered":"2024-09-16T01:17:36.320127+0000","last_unstale":"2024-09-16T01:17:37.661874+0000","last_undegraded":"2024-09-16T01:17:37.661874+0000","last_fullsized":"2024-09-16T01:17:37.661874+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:32.674822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661457+0000","last_change":"2024-09-16T01:17:36.315876+0000","last_active":"2024-09-16T01:17:37.661457+0000","last_peered":"2024-09-16T01:17:37.661457+0000","last_clean":"2024-09-16T01:17:37.661457+0000","last_became_active":"2024-09-16T01:17:36.315641+0000","last_became_peered":"2024-09-16T01:17:36.315641+0000","last_unstale":"2024-09-16T01:17:37.661457+0000","last_undegraded":"2024-09-16T01:17:37.661457+0000","last_fullsized":"2024-09-16T01:17:37.661457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:32.692533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661738+0000","last_change":"2024-09-16T01:17:36.329350+0000","last_active":"2024-09-16T01:17:37.661738+0000","last_peered":"2024-09-16T01:17:37.661738+0000","last_clean":"2024-09-16T01:17:37.661738+0000","last_became_active":"2024-09-16T01:17:36.328973+0000","last_became_peered":"2024-09-16T01:17:36.328973+0000","last_unstale":"2024-09-16T01:17:37.661738+0000","last_undegraded":"2024-09-16T01:17:37.661738+0000","last_fullsized":"2024-09-16T01:17:37.661738+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:04.077254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661213+0000","last_change":"2024-09-16T01:17:36.313019+0000","last_active":"2024-09-16T01:17:37.661213+0000","last_peered":"2024-09-16T01:17:37.661213+0000","last_clean":"2024-09-16T01:17:37.661213+0000","last_became_active":"2024-09-16T01:17:36.312754+0000","last_became_peered":"2024-09-16T01:17:36.312754+0000","last_unstale":"2024-09-16T01:17:37.661213+0000","last_undegraded":"2024-09-16T01:17:37.661213+0000","last_fullsized":"2024-09-16T01:17:37.661213+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:50.936600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661162+0000","last_change":"2024-09-16T01:17:36.311606+0000","last_active":"2024-09-16T01:17:37.661162+0000","last_peered":"2024-09-16T01:17:37.661162+0000","last_clean":"2024-09-16T01:17:37.661162+0000","last_became_active":"2024-09-16T01:17:36.311351+0000","last_became_peered":"2024-09-16T01:17:36.311351+0000","last_unstale":"2024-09-16T01:17:37.661162+0000","last_undegraded":"2024-09-16T01:17:37.661162+0000","last_fullsized":"2024-09-16T01:17:37.661162+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:59.353648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662247+0000","last_change":"2024-09-16T01:17:36.315479+0000","last_active":"2024-09-16T01:17:37.662247+0000","last_peered":"2024-09-16T01:17:37.662247+0000","last_clean":"2024-09-16T01:17:37.662247+0000","last_became_active":"2024-09-16T01:17:36.315207+0000","last_became_peered":"2024-09-16T01:17:36.315207+0000","last_unstale":"2024-09-16T01:17:37.662247+0000","last_undegraded":"2024-09-16T01:17:37.662247+0000","last_fullsized":"2024-09-16T01:17:37.662247+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:03.209320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661173+0000","last_change":"2024-09-16T01:17:36.324191+0000","last_active":"2024-09-16T01:17:37.661173+0000","last_peered":"2024-09-16T01:17:37.661173+0000","last_clean":"2024-09-16T01:17:37.661173+0000","last_became_active":"2024-09-16T01:17:36.323915+0000","last_became_peered":"2024-09-16T01:17:36.323915+0000","last_unstale":"2024-09-16T01:17:37.661173+0000","last_undegraded":"2024-09-16T01:17:37.661173+0000","last_fullsized":"2024-09-16T01:17:37.661173+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:32.674822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662260+0000","last_change":"2024-09-16T01:17:36.323171+0000","last_active":"2024-09-16T01:17:37.662260+0000","last_peered":"2024-09-16T01:17:37.662260+0000","last_clean":"2024-09-16T01:17:37.662260+0000","last_became_active":"2024-09-16T01:17:36.322868+0000","last_became_peered":"2024-09-16T01:17:36.322868+0000","last_unstale":"2024-09-16T01:17:37.662260+0000","last_undegraded":"2024-09-16T01:17:37.662260+0000","last_fullsized":"2024-09-16T01:17:37.662260+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:03.209320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661423+0000","last_change":"2024-09-16T01:17:36.313011+0000","last_active":"2024-09-16T01:17:37.661423+0000","last_peered":"2024-09-16T01:17:37.661423+0000","last_clean":"2024-09-16T01:17:37.661423+0000","last_became_active":"2024-09-16T01:17:36.312746+0000","last_became_peered":"2024-09-16T01:17:36.312746+0000","last_unstale":"2024-09-16T01:17:37.661423+0000","last_undegraded":"2024-09-16T01:17:37.661423+0000","last_fullsized":"2024-09-16T01:17:37.661423+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:02.006993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.313486+0000","last_change":"2024-09-16T01:17:36.323377+0000","last_active":"2024-09-16T01:17:37.313486+0000","last_peered":"2024-09-16T01:17:37.313486+0000","last_clean":"2024-09-16T01:17:37.313486+0000","last_became_active":"2024-09-16T01:17:36.321215+0000","last_became_peered":"2024-09-16T01:17:36.321215+0000","last_unstale":"2024-09-16T01:17:37.313486+0000","last_undegraded":"2024-09-16T01:17:37.313486+0000","last_fullsized":"2024-09-16T01:17:37.313486+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:49:40.194542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662466+0000","last_change":"2024-09-16T01:17:36.308766+0000","last_active":"2024-09-16T01:17:37.662466+0000","last_peered":"2024-09-16T01:17:37.662466+0000","last_clean":"2024-09-16T01:17:37.662466+0000","last_became_active":"2024-09-16T01:17:36.308516+0000","last_became_peered":"2024-09-16T01:17:36.308516+0000","last_unstale":"2024-09-16T01:17:37.662466+0000","last_undegraded":"2024-09-16T01:17:37.662466+0000","last_fullsized":"2024-09-16T01:17:37.662466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:42.049285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661422+0000","last_change":"2024-09-16T01:17:36.313321+0000","last_active":"2024-09-16T01:17:37.661422+0000","last_peered":"2024-09-16T01:17:37.661422+0000","last_clean":"2024-09-16T01:17:37.661422+0000","last_became_active":"2024-09-16T01:17:36.312874+0000","last_became_peered":"2024-09-16T01:17:36.312874+0000","last_unstale":"2024-09-16T01:17:37.661422+0000","last_undegraded":"2024-09-16T01:17:37.661422+0000","last_fullsized":"2024-09-16T01:17:37.661422+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:45.994646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662020+0000","last_change":"2024-09-16T01:17:36.317618+0000","last_active":"2024-09-16T01:17:37.662020+0000","last_peered":"2024-09-16T01:17:37.662020+0000","last_clean":"2024-09-16T01:17:37.662020+0000","last_became_active":"2024-09-16T01:17:36.317346+0000","last_became_peered":"2024-09-16T01:17:36.317346+0000","last_unstale":"2024-09-16T01:17:37.662020+0000","last_undegraded":"2024-09-16T01:17:37.662020+0000","last_fullsized":"2024-09-16T01:17:37.662020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:32.674822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661377+0000","last_change":"2024-09-16T01:17:36.322354+0000","last_active":"2024-09-16T01:17:37.661377+0000","last_peered":"2024-09-16T01:17:37.661377+0000","last_clean":"2024-09-16T01:17:37.661377+0000","last_became_active":"2024-09-16T01:17:36.322029+0000","last_became_peered":"2024-09-16T01:17:36.322029+0000","last_unstale":"2024-09-16T01:17:37.661377+0000","last_undegraded":"2024-09-16T01:17:37.661377+0000","last_fullsized":"2024-09-16T01:17:37.661377+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:32.692533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.660883+0000","last_change":"2024-09-16T01:17:36.314023+0000","last_active":"2024-09-16T01:17:37.660883+0000","last_peered":"2024-09-16T01:17:37.660883+0000","last_clean":"2024-09-16T01:17:37.660883+0000","last_became_active":"2024-09-16T01:17:36.313753+0000","last_became_peered":"2024-09-16T01:17:36.313753+0000","last_unstale":"2024-09-16T01:17:37.660883+0000","last_undegraded":"2024-09-16T01:17:37.660883+0000","last_fullsized":"2024-09-16T01:17:37.660883+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:15.310099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662087+0000","last_change":"2024-09-16T01:17:36.313331+0000","last_active":"2024-09-16T01:17:37.662087+0000","last_peered":"2024-09-16T01:17:37.662087+0000","last_clean":"2024-09-16T01:17:37.662087+0000","last_became_active":"2024-09-16T01:17:36.313080+0000","last_became_peered":"2024-09-16T01:17:36.313080+0000","last_unstale":"2024-09-16T01:17:37.662087+0000","last_undegraded":"2024-09-16T01:17:37.662087+0000","last_fullsized":"2024-09-16T01:17:37.662087+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:28.079552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661939+0000","last_change":"2024-09-16T01:17:36.320920+0000","last_active":"2024-09-16T01:17:37.661939+0000","last_peered":"2024-09-16T01:17:37.661939+0000","last_clean":"2024-09-16T01:17:37.661939+0000","last_became_active":"2024-09-16T01:17:36.320482+0000","last_became_peered":"2024-09-16T01:17:36.320482+0000","last_unstale":"2024-09-16T01:17:37.661939+0000","last_undegraded":"2024-09-16T01:17:37.661939+0000","last_fullsized":"2024-09-16T01:17:37.661939+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:28.079552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661592+0000","last_change":"2024-09-16T01:17:36.312722+0000","last_active":"2024-09-16T01:17:37.661592+0000","last_peered":"2024-09-16T01:17:37.661592+0000","last_clean":"2024-09-16T01:17:37.661592+0000","last_became_active":"2024-09-16T01:17:36.312423+0000","last_became_peered":"2024-09-16T01:17:36.312423+0000","last_unstale":"2024-09-16T01:17:37.661592+0000","last_undegraded":"2024-09-16T01:17:37.661592+0000","last_fullsized":"2024-09-16T01:17:37.661592+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:18.069334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321500+0000","last_change":"2024-09-16T01:17:36.314444+0000","last_active":"2024-09-16T01:17:37.321500+0000","last_peered":"2024-09-16T01:17:37.321500+0000","last_clean":"2024-09-16T01:17:37.321500+0000","last_became_active":"2024-09-16T01:17:36.314137+0000","last_became_peered":"2024-09-16T01:17:36.314137+0000","last_unstale":"2024-09-16T01:17:37.321500+0000","last_undegraded":"2024-09-16T01:17:37.321500+0000","last_fullsized":"2024-09-16T01:17:37.321500+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:29:00.109633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321550+0000","last_change":"2024-09-16T01:17:36.312767+0000","last_active":"2024-09-16T01:17:37.321550+0000","last_peered":"2024-09-16T01:17:37.321550+0000","last_clean":"2024-09-16T01:17:37.321550+0000","last_became_active":"2024-09-16T01:17:36.312496+0000","last_became_peered":"2024-09-16T01:17:36.312496+0000","last_unstale":"2024-09-16T01:17:37.321550+0000","last_undegraded":"2024-09-16T01:17:37.321550+0000","last_fullsized":"2024-09-16T01:17:37.321550+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:15:27.761276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661573+0000","last_change":"2024-09-16T01:17:36.324241+0000","last_active":"2024-09-16T01:17:37.661573+0000","last_peered":"2024-09-16T01:17:37.661573+0000","last_clean":"2024-09-16T01:17:37.661573+0000","last_became_active":"2024-09-16T01:17:36.323961+0000","last_became_peered":"2024-09-16T01:17:36.323961+0000","last_unstale":"2024-09-16T01:17:37.661573+0000","last_undegraded":"2024-09-16T01:17:37.661573+0000","last_fullsized":"2024-09-16T01:17:37.661573+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:43.728028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.313400+0000","last_change":"2024-09-16T01:17:36.321415+0000","last_active":"2024-09-16T01:17:37.313400+0000","last_peered":"2024-09-16T01:17:37.313400+0000","last_clean":"2024-09-16T01:17:37.313400+0000","last_became_active":"2024-09-16T01:17:36.321154+0000","last_became_peered":"2024-09-16T01:17:36.321154+0000","last_unstale":"2024-09-16T01:17:37.313400+0000","last_undegraded":"2024-09-16T01:17:37.313400+0000","last_fullsized":"2024-09-16T01:17:37.313400+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:19.331674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661724+0000","last_change":"2024-09-16T01:17:36.316723+0000","last_active":"2024-09-16T01:17:37.661724+0000","last_peered":"2024-09-16T01:17:37.661724+0000","last_clean":"2024-09-16T01:17:37.661724+0000","last_became_active":"2024-09-16T01:17:36.316456+0000","last_became_peered":"2024-09-16T01:17:36.316456+0000","last_unstale":"2024-09-16T01:17:37.661724+0000","last_undegraded":"2024-09-16T01:17:37.661724+0000","last_fullsized":"2024-09-16T01:17:37.661724+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:14.136243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662229+0000","last_change":"2024-09-16T01:17:36.322956+0000","last_active":"2024-09-16T01:17:37.662229+0000","last_peered":"2024-09-16T01:17:37.662229+0000","last_clean":"2024-09-16T01:17:37.662229+0000","last_became_active":"2024-09-16T01:17:36.322671+0000","last_became_peered":"2024-09-16T01:17:36.322671+0000","last_unstale":"2024-09-16T01:17:37.662229+0000","last_undegraded":"2024-09-16T01:17:37.662229+0000","last_fullsized":"2024-09-16T01:17:37.662229+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:43.728028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661148+0000","last_change":"2024-09-16T01:17:36.323849+0000","last_active":"2024-09-16T01:17:37.661148+0000","last_peered":"2024-09-16T01:17:37.661148+0000","last_clean":"2024-09-16T01:17:37.661148+0000","last_became_active":"2024-09-16T01:17:36.323578+0000","last_became_peered":"2024-09-16T01:17:36.323578+0000","last_unstale":"2024-09-16T01:17:37.661148+0000","last_undegraded":"2024-09-16T01:17:37.661148+0000","last_fullsized":"2024-09-16T01:17:37.661148+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:39.661466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661936+0000","last_change":"2024-09-16T01:17:36.309596+0000","last_active":"2024-09-16T01:17:37.661936+0000","last_peered":"2024-09-16T01:17:37.661936+0000","last_clean":"2024-09-16T01:17:37.661936+0000","last_became_active":"2024-09-16T01:17:36.309303+0000","last_became_peered":"2024-09-16T01:17:36.309303+0000","last_unstale":"2024-09-16T01:17:37.661936+0000","last_undegraded":"2024-09-16T01:17:37.661936+0000","last_fullsized":"2024-09-16T01:17:37.661936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:35.674463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321578+0000","last_change":"2024-09-16T01:17:36.319531+0000","last_active":"2024-09-16T01:17:37.321578+0000","last_peered":"2024-09-16T01:17:37.321578+0000","last_clean":"2024-09-16T01:17:37.321578+0000","last_became_active":"2024-09-16T01:17:36.319256+0000","last_became_peered":"2024-09-16T01:17:36.319256+0000","last_unstale":"2024-09-16T01:17:37.321578+0000","last_undegraded":"2024-09-16T01:17:37.321578+0000","last_fullsized":"2024-09-16T01:17:37.321578+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:31:53.142305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661901+0000","last_change":"2024-09-16T01:17:36.314030+0000","last_active":"2024-09-16T01:17:37.661901+0000","last_peered":"2024-09-16T01:17:37.661901+0000","last_clean":"2024-09-16T01:17:37.661901+0000","last_became_active":"2024-09-16T01:17:36.313775+0000","last_became_peered":"2024-09-16T01:17:36.313775+0000","last_unstale":"2024-09-16T01:17:37.661901+0000","last_undegraded":"2024-09-16T01:17:37.661901+0000","last_fullsized":"2024-09-16T01:17:37.661901+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:39.661466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661596+0000","last_change":"2024-09-16T01:17:36.316666+0000","last_active":"2024-09-16T01:17:37.661596+0000","last_peered":"2024-09-16T01:17:37.661596+0000","last_clean":"2024-09-16T01:17:37.661596+0000","last_became_active":"2024-09-16T01:17:36.316405+0000","last_became_peered":"2024-09-16T01:17:36.316405+0000","last_unstale":"2024-09-16T01:17:37.661596+0000","last_undegraded":"2024-09-16T01:17:37.661596+0000","last_fullsized":"2024-09-16T01:17:37.661596+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:18.069334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662247+0000","last_change":"2024-09-16T01:17:36.312050+0000","last_active":"2024-09-16T01:17:37.662247+0000","last_peered":"2024-09-16T01:17:37.662247+0000","last_clean":"2024-09-16T01:17:37.662247+0000","last_became_active":"2024-09-16T01:17:36.311692+0000","last_became_peered":"2024-09-16T01:17:36.311692+0000","last_unstale":"2024-09-16T01:17:37.662247+0000","last_undegraded":"2024-09-16T01:17:37.662247+0000","last_fullsized":"2024-09-16T01:17:37.662247+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:04.502983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320662+0000","last_change":"2024-09-16T01:17:36.309730+0000","last_active":"2024-09-16T01:17:37.320662+0000","last_peered":"2024-09-16T01:17:37.320662+0000","last_clean":"2024-09-16T01:17:37.320662+0000","last_became_active":"2024-09-16T01:17:36.309236+0000","last_became_peered":"2024-09-16T01:17:36.309236+0000","last_unstale":"2024-09-16T01:17:37.320662+0000","last_undegraded":"2024-09-16T01:17:37.320662+0000","last_fullsized":"2024-09-16T01:17:37.320662+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:39.902021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661098+0000","last_change":"2024-09-16T01:17:36.319720+0000","last_active":"2024-09-16T01:17:37.661098+0000","last_peered":"2024-09-16T01:17:37.661098+0000","last_clean":"2024-09-16T01:17:37.661098+0000","last_became_active":"2024-09-16T01:17:36.319471+0000","last_became_peered":"2024-09-16T01:17:36.319471+0000","last_unstale":"2024-09-16T01:17:37.661098+0000","last_undegraded":"2024-09-16T01:17:37.661098+0000","last_fullsized":"2024-09-16T01:17:37.661098+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:40.971734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"50'4","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321673+0000","last_change":"2024-09-16T01:17:35.307519+0000","last_active":"2024-09-16T01:17:37.321673+0000","last_peered":"2024-09-16T01:17:37.321673+0000","last_clean":"2024-09-16T01:17:37.321673+0000","last_became_active":"2024-09-16T01:17:35.307224+0000","last_became_peered":"2024-09-16T01:17:35.307224+0000","last_unstale":"2024-09-16T01:17:37.321673+0000","last_undegraded":"2024-09-16T01:17:37.321673+0000","last_fullsized":"2024-09-16T01:17:37.321673+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:41.245307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320872+0000","last_change":"2024-09-16T01:17:36.310902+0000","last_active":"2024-09-16T01:17:37.320872+0000","last_peered":"2024-09-16T01:17:37.320872+0000","last_clean":"2024-09-16T01:17:37.320872+0000","last_became_active":"2024-09-16T01:17:36.310636+0000","last_became_peered":"2024-09-16T01:17:36.310636+0000","last_unstale":"2024-09-16T01:17:37.320872+0000","last_undegraded":"2024-09-16T01:17:37.320872+0000","last_fullsized":"2024-09-16T01:17:37.320872+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:15.305540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661514+0000","last_change":"2024-09-16T01:17:35.305084+0000","last_active":"2024-09-16T01:17:37.661514+0000","last_peered":"2024-09-16T01:17:37.661514+0000","last_clean":"2024-09-16T01:17:37.661514+0000","last_became_active":"2024-09-16T01:17:35.304833+0000","last_became_peered":"2024-09-16T01:17:35.304833+0000","last_unstale":"2024-09-16T01:17:37.661514+0000","last_undegraded":"2024-09-16T01:17:37.661514+0000","last_fullsized":"2024-09-16T01:17:37.661514+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:58.284242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321473+0000","last_change":"2024-09-16T01:17:36.310763+0000","last_active":"2024-09-16T01:17:37.321473+0000","last_peered":"2024-09-16T01:17:37.321473+0000","last_clean":"2024-09-16T01:17:37.321473+0000","last_became_active":"2024-09-16T01:17:36.310512+0000","last_became_peered":"2024-09-16T01:17:36.310512+0000","last_unstale":"2024-09-16T01:17:37.321473+0000","last_undegraded":"2024-09-16T01:17:37.321473+0000","last_fullsized":"2024-09-16T01:17:37.321473+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:03:31.015927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661945+0000","last_change":"2024-09-16T01:17:35.304477+0000","last_active":"2024-09-16T01:17:37.661945+0000","last_peered":"2024-09-16T01:17:37.661945+0000","last_clean":"2024-09-16T01:17:37.661945+0000","last_became_active":"2024-09-16T01:17:35.303831+0000","last_became_peered":"2024-09-16T01:17:35.303831+0000","last_unstale":"2024-09-16T01:17:37.661945+0000","last_undegraded":"2024-09-16T01:17:37.661945+0000","last_fullsized":"2024-09-16T01:17:37.661945+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:20.685445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661773+0000","last_change":"2024-09-16T01:17:36.323020+0000","last_active":"2024-09-16T01:17:37.661773+0000","last_peered":"2024-09-16T01:17:37.661773+0000","last_clean":"2024-09-16T01:17:37.661773+0000","last_became_active":"2024-09-16T01:17:36.322758+0000","last_became_peered":"2024-09-16T01:17:36.322758+0000","last_unstale":"2024-09-16T01:17:37.661773+0000","last_undegraded":"2024-09-16T01:17:37.661773+0000","last_fullsized":"2024-09-16T01:17:37.661773+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:04.502983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320993+0000","last_change":"2024-09-16T01:17:35.304669+0000","last_active":"2024-09-16T01:17:37.320993+0000","last_peered":"2024-09-16T01:17:37.320993+0000","last_clean":"2024-09-16T01:17:37.320993+0000","last_became_active":"2024-09-16T01:17:35.304226+0000","last_became_peered":"2024-09-16T01:17:35.304226+0000","last_unstale":"2024-09-16T01:17:37.320993+0000","last_undegraded":"2024-09-16T01:17:37.320993+0000","last_fullsized":"2024-09-16T01:17:37.320993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:14.303917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661257+0000","last_change":"2024-09-16T01:17:36.318037+0000","last_active":"2024-09-16T01:17:37.661257+0000","last_peered":"2024-09-16T01:17:37.661257+0000","last_clean":"2024-09-16T01:17:37.661257+0000","last_became_active":"2024-09-16T01:17:36.317731+0000","last_became_peered":"2024-09-16T01:17:36.317731+0000","last_unstale":"2024-09-16T01:17:37.661257+0000","last_undegraded":"2024-09-16T01:17:37.661257+0000","last_fullsized":"2024-09-16T01:17:37.661257+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:13.726140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662000+0000","last_change":"2024-09-16T01:17:35.314026+0000","last_active":"2024-09-16T01:17:37.662000+0000","last_peered":"2024-09-16T01:17:37.662000+0000","last_clean":"2024-09-16T01:17:37.662000+0000","last_became_active":"2024-09-16T01:17:35.313777+0000","last_became_peered":"2024-09-16T01:17:35.313777+0000","last_unstale":"2024-09-16T01:17:37.662000+0000","last_undegraded":"2024-09-16T01:17:37.662000+0000","last_fullsized":"2024-09-16T01:17:37.662000+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:20.685445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661915+0000","last_change":"2024-09-16T01:17:36.316071+0000","last_active":"2024-09-16T01:17:37.661915+0000","last_peered":"2024-09-16T01:17:37.661915+0000","last_clean":"2024-09-16T01:17:37.661915+0000","last_became_active":"2024-09-16T01:17:36.315807+0000","last_became_peered":"2024-09-16T01:17:36.315807+0000","last_unstale":"2024-09-16T01:17:37.661915+0000","last_undegraded":"2024-09-16T01:17:37.661915+0000","last_fullsized":"2024-09-16T01:17:37.661915+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:14.136243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661317+0000","last_change":"2024-09-16T01:17:35.303802+0000","last_active":"2024-09-16T01:17:37.661317+0000","last_peered":"2024-09-16T01:17:37.661317+0000","last_clean":"2024-09-16T01:17:37.661317+0000","last_became_active":"2024-09-16T01:17:35.303342+0000","last_became_peered":"2024-09-16T01:17:35.303342+0000","last_unstale":"2024-09-16T01:17:37.661317+0000","last_undegraded":"2024-09-16T01:17:37.661317+0000","last_fullsized":"2024-09-16T01:17:37.661317+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:07.446431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661423+0000","last_change":"2024-09-16T01:17:36.319166+0000","last_active":"2024-09-16T01:17:37.661423+0000","last_peered":"2024-09-16T01:17:37.661423+0000","last_clean":"2024-09-16T01:17:37.661423+0000","last_became_active":"2024-09-16T01:17:36.318918+0000","last_became_peered":"2024-09-16T01:17:36.318918+0000","last_unstale":"2024-09-16T01:17:37.661423+0000","last_undegraded":"2024-09-16T01:17:37.661423+0000","last_fullsized":"2024-09-16T01:17:37.661423+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:02.848662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321288+0000","last_change":"2024-09-16T01:17:35.307860+0000","last_active":"2024-09-16T01:17:37.321288+0000","last_peered":"2024-09-16T01:17:37.321288+0000","last_clean":"2024-09-16T01:17:37.321288+0000","last_became_active":"2024-09-16T01:17:35.307368+0000","last_became_peered":"2024-09-16T01:17:35.307368+0000","last_unstale":"2024-09-16T01:17:37.321288+0000","last_undegraded":"2024-09-16T01:17:37.321288+0000","last_fullsized":"2024-09-16T01:17:37.321288+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:24:05.666664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661873+0000","last_change":"2024-09-16T01:17:36.320522+0000","last_active":"2024-09-16T01:17:37.661873+0000","last_peered":"2024-09-16T01:17:37.661873+0000","last_clean":"2024-09-16T01:17:37.661873+0000","last_became_active":"2024-09-16T01:17:36.320254+0000","last_became_peered":"2024-09-16T01:17:36.320254+0000","last_unstale":"2024-09-16T01:17:37.661873+0000","last_undegraded":"2024-09-16T01:17:37.661873+0000","last_fullsized":"2024-09-16T01:17:37.661873+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:39.661466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661692+0000","last_change":"2024-09-16T01:17:35.313616+0000","last_active":"2024-09-16T01:17:37.661692+0000","last_peered":"2024-09-16T01:17:37.661692+0000","last_clean":"2024-09-16T01:17:37.661692+0000","last_became_active":"2024-09-16T01:17:35.313006+0000","last_became_peered":"2024-09-16T01:17:35.313006+0000","last_unstale":"2024-09-16T01:17:37.661692+0000","last_undegraded":"2024-09-16T01:17:37.661692+0000","last_fullsized":"2024-09-16T01:17:37.661692+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:17:58.284242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.660991+0000","last_change":"2024-09-16T01:17:36.311596+0000","last_active":"2024-09-16T01:17:37.660991+0000","last_peered":"2024-09-16T01:17:37.660991+0000","last_clean":"2024-09-16T01:17:37.660991+0000","last_became_active":"2024-09-16T01:17:36.311304+0000","last_became_peered":"2024-09-16T01:17:36.311304+0000","last_unstale":"2024-09-16T01:17:37.660991+0000","last_undegraded":"2024-09-16T01:17:37.660991+0000","last_fullsized":"2024-09-16T01:17:37.660991+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:05.461965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661818+0000","last_change":"2024-09-16T01:17:35.306832+0000","last_active":"2024-09-16T01:17:37.661818+0000","last_peered":"2024-09-16T01:17:37.661818+0000","last_clean":"2024-09-16T01:17:37.661818+0000","last_became_active":"2024-09-16T01:17:35.306570+0000","last_became_peered":"2024-09-16T01:17:35.306570+0000","last_unstale":"2024-09-16T01:17:37.661818+0000","last_undegraded":"2024-09-16T01:17:37.661818+0000","last_fullsized":"2024-09-16T01:17:37.661818+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:33.574312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320931+0000","last_change":"2024-09-16T01:17:36.317231+0000","last_active":"2024-09-16T01:17:37.320931+0000","last_peered":"2024-09-16T01:17:37.320931+0000","last_clean":"2024-09-16T01:17:37.320931+0000","last_became_active":"2024-09-16T01:17:36.316940+0000","last_became_peered":"2024-09-16T01:17:36.316940+0000","last_unstale":"2024-09-16T01:17:37.320931+0000","last_undegraded":"2024-09-16T01:17:37.320931+0000","last_fullsized":"2024-09-16T01:17:37.320931+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:32.692533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661186+0000","last_change":"2024-09-16T01:17:35.314381+0000","last_active":"2024-09-16T01:17:37.661186+0000","last_peered":"2024-09-16T01:17:37.661186+0000","last_clean":"2024-09-16T01:17:37.661186+0000","last_became_active":"2024-09-16T01:17:35.314136+0000","last_became_peered":"2024-09-16T01:17:35.314136+0000","last_unstale":"2024-09-16T01:17:37.661186+0000","last_undegraded":"2024-09-16T01:17:37.661186+0000","last_fullsized":"2024-09-16T01:17:37.661186+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:37.045757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662111+0000","last_change":"2024-09-16T01:17:36.317809+0000","last_active":"2024-09-16T01:17:37.662111+0000","last_peered":"2024-09-16T01:17:37.662111+0000","last_clean":"2024-09-16T01:17:37.662111+0000","last_became_active":"2024-09-16T01:17:36.317484+0000","last_became_peered":"2024-09-16T01:17:36.317484+0000","last_unstale":"2024-09-16T01:17:37.662111+0000","last_undegraded":"2024-09-16T01:17:37.662111+0000","last_fullsized":"2024-09-16T01:17:37.662111+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:26.064988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"50'3","reported_seq":17,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661797+0000","last_change":"2024-09-16T01:17:35.309175+0000","last_active":"2024-09-16T01:17:37.661797+0000","last_peered":"2024-09-16T01:17:37.661797+0000","last_clean":"2024-09-16T01:17:37.661797+0000","last_became_active":"2024-09-16T01:17:35.308597+0000","last_became_peered":"2024-09-16T01:17:35.308597+0000","last_unstale":"2024-09-16T01:17:37.661797+0000","last_undegraded":"2024-09-16T01:17:37.661797+0000","last_fullsized":"2024-09-16T01:17:37.661797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:31:52.136123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661330+0000","last_change":"2024-09-16T01:17:36.315376+0000","last_active":"2024-09-16T01:17:37.661330+0000","last_peered":"2024-09-16T01:17:37.661330+0000","last_clean":"2024-09-16T01:17:37.661330+0000","last_became_active":"2024-09-16T01:17:36.315119+0000","last_became_peered":"2024-09-16T01:17:36.315119+0000","last_unstale":"2024-09-16T01:17:37.661330+0000","last_undegraded":"2024-09-16T01:17:37.661330+0000","last_fullsized":"2024-09-16T01:17:37.661330+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:49.667239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"50'6","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662519+0000","last_change":"2024-09-16T01:17:35.309225+0000","last_active":"2024-09-16T01:17:37.662519+0000","last_peered":"2024-09-16T01:17:37.662519+0000","last_clean":"2024-09-16T01:17:37.662519+0000","last_became_active":"2024-09-16T01:17:35.308384+0000","last_became_peered":"2024-09-16T01:17:35.308384+0000","last_unstale":"2024-09-16T01:17:37.662519+0000","last_undegraded":"2024-09-16T01:17:37.662519+0000","last_fullsized":"2024-09-16T01:17:37.662519+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:46.502859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321024+0000","last_change":"2024-09-16T01:17:36.314020+0000","last_active":"2024-09-16T01:17:37.321024+0000","last_peered":"2024-09-16T01:17:37.321024+0000","last_clean":"2024-09-16T01:17:37.321024+0000","last_became_active":"2024-09-16T01:17:36.313333+0000","last_became_peered":"2024-09-16T01:17:36.313333+0000","last_unstale":"2024-09-16T01:17:37.321024+0000","last_undegraded":"2024-09-16T01:17:37.321024+0000","last_fullsized":"2024-09-16T01:17:37.321024+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:18.069334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662100+0000","last_change":"2024-09-16T01:17:35.314241+0000","last_active":"2024-09-16T01:17:37.662100+0000","last_peered":"2024-09-16T01:17:37.662100+0000","last_clean":"2024-09-16T01:17:37.662100+0000","last_became_active":"2024-09-16T01:17:35.313020+0000","last_became_peered":"2024-09-16T01:17:35.313020+0000","last_unstale":"2024-09-16T01:17:37.662100+0000","last_undegraded":"2024-09-16T01:17:37.662100+0000","last_fullsized":"2024-09-16T01:17:37.662100+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:04.455783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661727+0000","last_change":"2024-09-16T01:17:36.308846+0000","last_active":"2024-09-16T01:17:37.661727+0000","last_peered":"2024-09-16T01:17:37.661727+0000","last_clean":"2024-09-16T01:17:37.661727+0000","last_became_active":"2024-09-16T01:17:36.307989+0000","last_became_peered":"2024-09-16T01:17:36.307989+0000","last_unstale":"2024-09-16T01:17:37.661727+0000","last_undegraded":"2024-09-16T01:17:37.661727+0000","last_fullsized":"2024-09-16T01:17:37.661727+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:04.077254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321367+0000","last_change":"2024-09-16T01:17:35.315242+0000","last_active":"2024-09-16T01:17:37.321367+0000","last_peered":"2024-09-16T01:17:37.321367+0000","last_clean":"2024-09-16T01:17:37.321367+0000","last_became_active":"2024-09-16T01:17:35.314959+0000","last_became_peered":"2024-09-16T01:17:35.314959+0000","last_unstale":"2024-09-16T01:17:37.321367+0000","last_undegraded":"2024-09-16T01:17:37.321367+0000","last_fullsized":"2024-09-16T01:17:37.321367+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:37.045757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661289+0000","last_change":"2024-09-16T01:17:36.319609+0000","last_active":"2024-09-16T01:17:37.661289+0000","last_peered":"2024-09-16T01:17:37.661289+0000","last_clean":"2024-09-16T01:17:37.661289+0000","last_became_active":"2024-09-16T01:17:36.319353+0000","last_became_peered":"2024-09-16T01:17:36.319353+0000","last_unstale":"2024-09-16T01:17:37.661289+0000","last_undegraded":"2024-09-16T01:17:37.661289+0000","last_fullsized":"2024-09-16T01:17:37.661289+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:28.079552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661494+0000","last_change":"2024-09-16T01:17:35.310236+0000","last_active":"2024-09-16T01:17:37.661494+0000","last_peered":"2024-09-16T01:17:37.661494+0000","last_clean":"2024-09-16T01:17:37.661494+0000","last_became_active":"2024-09-16T01:17:35.309956+0000","last_became_peered":"2024-09-16T01:17:35.309956+0000","last_unstale":"2024-09-16T01:17:37.661494+0000","last_undegraded":"2024-09-16T01:17:37.661494+0000","last_fullsized":"2024-09-16T01:17:37.661494+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:14.303917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662194+0000","last_change":"2024-09-16T01:17:36.312714+0000","last_active":"2024-09-16T01:17:37.662194+0000","last_peered":"2024-09-16T01:17:37.662194+0000","last_clean":"2024-09-16T01:17:37.662194+0000","last_became_active":"2024-09-16T01:17:36.312455+0000","last_became_peered":"2024-09-16T01:17:36.312455+0000","last_unstale":"2024-09-16T01:17:37.662194+0000","last_undegraded":"2024-09-16T01:17:37.662194+0000","last_fullsized":"2024-09-16T01:17:37.662194+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:02.848662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"50'8","reported_seq":22,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661401+0000","last_change":"2024-09-16T01:17:35.308107+0000","last_active":"2024-09-16T01:17:37.661401+0000","last_peered":"2024-09-16T01:17:37.661401+0000","last_clean":"2024-09-16T01:17:37.661401+0000","last_became_active":"2024-09-16T01:17:35.307829+0000","last_became_peered":"2024-09-16T01:17:35.307829+0000","last_unstale":"2024-09-16T01:17:37.661401+0000","last_undegraded":"2024-09-16T01:17:37.661401+0000","last_fullsized":"2024-09-16T01:17:37.661401+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:58.347467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661307+0000","last_change":"2024-09-16T01:17:36.310830+0000","last_active":"2024-09-16T01:17:37.661307+0000","last_peered":"2024-09-16T01:17:37.661307+0000","last_clean":"2024-09-16T01:17:37.661307+0000","last_became_active":"2024-09-16T01:17:36.310550+0000","last_became_peered":"2024-09-16T01:17:36.310550+0000","last_unstale":"2024-09-16T01:17:37.661307+0000","last_undegraded":"2024-09-16T01:17:37.661307+0000","last_fullsized":"2024-09-16T01:17:37.661307+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:26.064988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662332+0000","last_change":"2024-09-16T01:17:35.316125+0000","last_active":"2024-09-16T01:17:37.662332+0000","last_peered":"2024-09-16T01:17:37.662332+0000","last_clean":"2024-09-16T01:17:37.662332+0000","last_became_active":"2024-09-16T01:17:35.315753+0000","last_became_peered":"2024-09-16T01:17:35.315753+0000","last_unstale":"2024-09-16T01:17:37.662332+0000","last_undegraded":"2024-09-16T01:17:37.662332+0000","last_fullsized":"2024-09-16T01:17:37.662332+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:53.763255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661027+0000","last_change":"2024-09-16T01:17:36.305965+0000","last_active":"2024-09-16T01:17:37.661027+0000","last_peered":"2024-09-16T01:17:37.661027+0000","last_clean":"2024-09-16T01:17:37.661027+0000","last_became_active":"2024-09-16T01:17:36.305690+0000","last_became_peered":"2024-09-16T01:17:36.305690+0000","last_unstale":"2024-09-16T01:17:37.661027+0000","last_undegraded":"2024-09-16T01:17:37.661027+0000","last_fullsized":"2024-09-16T01:17:37.661027+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:34.580493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.313389+0000","last_change":"2024-09-16T01:17:35.307265+0000","last_active":"2024-09-16T01:17:37.313389+0000","last_peered":"2024-09-16T01:17:37.313389+0000","last_clean":"2024-09-16T01:17:37.313389+0000","last_became_active":"2024-09-16T01:17:35.306986+0000","last_became_peered":"2024-09-16T01:17:35.306986+0000","last_unstale":"2024-09-16T01:17:37.313389+0000","last_undegraded":"2024-09-16T01:17:37.313389+0000","last_fullsized":"2024-09-16T01:17:37.313389+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:58:25.006284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661349+0000","last_change":"2024-09-16T01:17:36.318863+0000","last_active":"2024-09-16T01:17:37.661349+0000","last_peered":"2024-09-16T01:17:37.661349+0000","last_clean":"2024-09-16T01:17:37.661349+0000","last_became_active":"2024-09-16T01:17:36.318599+0000","last_became_peered":"2024-09-16T01:17:36.318599+0000","last_unstale":"2024-09-16T01:17:37.661349+0000","last_undegraded":"2024-09-16T01:17:37.661349+0000","last_fullsized":"2024-09-16T01:17:37.661349+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:54.769436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"50'1","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321714+0000","last_change":"2024-09-16T01:17:35.307033+0000","last_active":"2024-09-16T01:17:37.321714+0000","last_peered":"2024-09-16T01:17:37.321714+0000","last_clean":"2024-09-16T01:17:37.321714+0000","last_became_active":"2024-09-16T01:17:35.306077+0000","last_became_peered":"2024-09-16T01:17:35.306077+0000","last_unstale":"2024-09-16T01:17:37.321714+0000","last_undegraded":"2024-09-16T01:17:37.321714+0000","last_fullsized":"2024-09-16T01:17:37.321714+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:52.820522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661551+0000","last_change":"2024-09-16T01:17:36.309189+0000","last_active":"2024-09-16T01:17:37.661551+0000","last_peered":"2024-09-16T01:17:37.661551+0000","last_clean":"2024-09-16T01:17:37.661551+0000","last_became_active":"2024-09-16T01:17:36.308942+0000","last_became_peered":"2024-09-16T01:17:36.308942+0000","last_unstale":"2024-09-16T01:17:37.661551+0000","last_undegraded":"2024-09-16T01:17:37.661551+0000","last_fullsized":"2024-09-16T01:17:37.661551+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:39.902021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321610+0000","last_change":"2024-09-16T01:17:35.306630+0000","last_active":"2024-09-16T01:17:37.321610+0000","last_peered":"2024-09-16T01:17:37.321610+0000","last_clean":"2024-09-16T01:17:37.321610+0000","last_became_active":"2024-09-16T01:17:35.306293+0000","last_became_peered":"2024-09-16T01:17:35.306293+0000","last_unstale":"2024-09-16T01:17:37.321610+0000","last_undegraded":"2024-09-16T01:17:37.321610+0000","last_fullsized":"2024-09-16T01:17:37.321610+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:55.874075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320776+0000","last_change":"2024-09-16T01:17:36.317185+0000","last_active":"2024-09-16T01:17:37.320776+0000","last_peered":"2024-09-16T01:17:37.320776+0000","last_clean":"2024-09-16T01:17:37.320776+0000","last_became_active":"2024-09-16T01:17:36.316880+0000","last_became_peered":"2024-09-16T01:17:36.316880+0000","last_unstale":"2024-09-16T01:17:37.320776+0000","last_undegraded":"2024-09-16T01:17:37.320776+0000","last_fullsized":"2024-09-16T01:17:37.320776+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:25.729188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661619+0000","last_change":"2024-09-16T01:17:35.303476+0000","last_active":"2024-09-16T01:17:37.661619+0000","last_peered":"2024-09-16T01:17:37.661619+0000","last_clean":"2024-09-16T01:17:37.661619+0000","last_became_active":"2024-09-16T01:17:35.303184+0000","last_became_peered":"2024-09-16T01:17:35.303184+0000","last_unstale":"2024-09-16T01:17:37.661619+0000","last_undegraded":"2024-09-16T01:17:37.661619+0000","last_fullsized":"2024-09-16T01:17:37.661619+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:52.820522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321632+0000","last_change":"2024-09-16T01:17:36.311615+0000","last_active":"2024-09-16T01:17:37.321632+0000","last_peered":"2024-09-16T01:17:37.321632+0000","last_clean":"2024-09-16T01:17:37.321632+0000","last_became_active":"2024-09-16T01:17:36.311315+0000","last_became_peered":"2024-09-16T01:17:36.311315+0000","last_unstale":"2024-09-16T01:17:37.321632+0000","last_undegraded":"2024-09-16T01:17:37.321632+0000","last_fullsized":"2024-09-16T01:17:37.321632+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:50.833975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661674+0000","last_change":"2024-09-16T01:17:35.311139+0000","last_active":"2024-09-16T01:17:37.661674+0000","last_peered":"2024-09-16T01:17:37.661674+0000","last_clean":"2024-09-16T01:17:37.661674+0000","last_became_active":"2024-09-16T01:17:35.310888+0000","last_became_peered":"2024-09-16T01:17:35.310888+0000","last_unstale":"2024-09-16T01:17:37.661674+0000","last_undegraded":"2024-09-16T01:17:37.661674+0000","last_fullsized":"2024-09-16T01:17:37.661674+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:33.574312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662329+0000","last_change":"2024-09-16T01:17:36.315137+0000","last_active":"2024-09-16T01:17:37.662329+0000","last_peered":"2024-09-16T01:17:37.662329+0000","last_clean":"2024-09-16T01:17:37.662329+0000","last_became_active":"2024-09-16T01:17:36.314881+0000","last_became_peered":"2024-09-16T01:17:36.314881+0000","last_unstale":"2024-09-16T01:17:37.662329+0000","last_undegraded":"2024-09-16T01:17:37.662329+0000","last_fullsized":"2024-09-16T01:17:37.662329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:00.230785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662334+0000","last_change":"2024-09-16T01:17:35.314028+0000","last_active":"2024-09-16T01:17:37.662334+0000","last_peered":"2024-09-16T01:17:37.662334+0000","last_clean":"2024-09-16T01:17:37.662334+0000","last_became_active":"2024-09-16T01:17:35.313718+0000","last_became_peered":"2024-09-16T01:17:35.313718+0000","last_unstale":"2024-09-16T01:17:37.662334+0000","last_undegraded":"2024-09-16T01:17:37.662334+0000","last_fullsized":"2024-09-16T01:17:37.662334+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:48.661057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661290+0000","last_change":"2024-09-16T01:17:36.310066+0000","last_active":"2024-09-16T01:17:37.661290+0000","last_peered":"2024-09-16T01:17:37.661290+0000","last_clean":"2024-09-16T01:17:37.661290+0000","last_became_active":"2024-09-16T01:17:36.309544+0000","last_became_peered":"2024-09-16T01:17:36.309544+0000","last_unstale":"2024-09-16T01:17:37.661290+0000","last_undegraded":"2024-09-16T01:17:37.661290+0000","last_fullsized":"2024-09-16T01:17:37.661290+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:39.486911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.313271+0000","last_change":"2024-09-16T01:17:35.311219+0000","last_active":"2024-09-16T01:17:37.313271+0000","last_peered":"2024-09-16T01:17:37.313271+0000","last_clean":"2024-09-16T01:17:37.313271+0000","last_became_active":"2024-09-16T01:17:35.310873+0000","last_became_peered":"2024-09-16T01:17:35.310873+0000","last_unstale":"2024-09-16T01:17:37.313271+0000","last_undegraded":"2024-09-16T01:17:37.313271+0000","last_fullsized":"2024-09-16T01:17:37.313271+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:21.830785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320679+0000","last_change":"2024-09-16T01:17:36.309507+0000","last_active":"2024-09-16T01:17:37.320679+0000","last_peered":"2024-09-16T01:17:37.320679+0000","last_clean":"2024-09-16T01:17:37.320679+0000","last_became_active":"2024-09-16T01:17:36.309204+0000","last_became_peered":"2024-09-16T01:17:36.309204+0000","last_unstale":"2024-09-16T01:17:37.320679+0000","last_undegraded":"2024-09-16T01:17:37.320679+0000","last_fullsized":"2024-09-16T01:17:37.320679+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:35.674463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"50'2","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321754+0000","last_change":"2024-09-16T01:17:35.315279+0000","last_active":"2024-09-16T01:17:37.321754+0000","last_peered":"2024-09-16T01:17:37.321754+0000","last_clean":"2024-09-16T01:17:37.321754+0000","last_became_active":"2024-09-16T01:17:35.315035+0000","last_became_peered":"2024-09-16T01:17:35.315035+0000","last_unstale":"2024-09-16T01:17:37.321754+0000","last_undegraded":"2024-09-16T01:17:37.321754+0000","last_fullsized":"2024-09-16T01:17:37.321754+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:07.446431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661289+0000","last_change":"2024-09-16T01:17:36.315326+0000","last_active":"2024-09-16T01:17:37.661289+0000","last_peered":"2024-09-16T01:17:37.661289+0000","last_clean":"2024-09-16T01:17:37.661289+0000","last_became_active":"2024-09-16T01:17:36.315024+0000","last_became_peered":"2024-09-16T01:17:36.315024+0000","last_unstale":"2024-09-16T01:17:37.661289+0000","last_undegraded":"2024-09-16T01:17:37.661289+0000","last_fullsized":"2024-09-16T01:17:37.661289+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:15:47.509040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661892+0000","last_change":"2024-09-16T01:17:35.310967+0000","last_active":"2024-09-16T01:17:37.661892+0000","last_peered":"2024-09-16T01:17:37.661892+0000","last_clean":"2024-09-16T01:17:37.661892+0000","last_became_active":"2024-09-16T01:17:35.310672+0000","last_became_peered":"2024-09-16T01:17:35.310672+0000","last_unstale":"2024-09-16T01:17:37.661892+0000","last_undegraded":"2024-09-16T01:17:37.661892+0000","last_fullsized":"2024-09-16T01:17:37.661892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:49.827793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661924+0000","last_change":"2024-09-16T01:17:36.313990+0000","last_active":"2024-09-16T01:17:37.661924+0000","last_peered":"2024-09-16T01:17:37.661924+0000","last_clean":"2024-09-16T01:17:37.661924+0000","last_became_active":"2024-09-16T01:17:36.313715+0000","last_became_peered":"2024-09-16T01:17:36.313715+0000","last_unstale":"2024-09-16T01:17:37.661924+0000","last_undegraded":"2024-09-16T01:17:37.661924+0000","last_fullsized":"2024-09-16T01:17:37.661924+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:17.227756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661244+0000","last_change":"2024-09-16T01:17:35.312732+0000","last_active":"2024-09-16T01:17:37.661244+0000","last_peered":"2024-09-16T01:17:37.661244+0000","last_clean":"2024-09-16T01:17:37.661244+0000","last_became_active":"2024-09-16T01:17:35.312314+0000","last_became_peered":"2024-09-16T01:17:35.312314+0000","last_unstale":"2024-09-16T01:17:37.661244+0000","last_undegraded":"2024-09-16T01:17:37.661244+0000","last_fullsized":"2024-09-16T01:17:37.661244+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:49.930419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661158+0000","last_change":"2024-09-16T01:17:36.310394+0000","last_active":"2024-09-16T01:17:37.661158+0000","last_peered":"2024-09-16T01:17:37.661158+0000","last_clean":"2024-09-16T01:17:37.661158+0000","last_became_active":"2024-09-16T01:17:36.310146+0000","last_became_peered":"2024-09-16T01:17:36.310146+0000","last_unstale":"2024-09-16T01:17:37.661158+0000","last_undegraded":"2024-09-16T01:17:37.661158+0000","last_fullsized":"2024-09-16T01:17:37.661158+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:40.971734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661882+0000","last_change":"2024-09-16T01:17:35.308626+0000","last_active":"2024-09-16T01:17:37.661882+0000","last_peered":"2024-09-16T01:17:37.661882+0000","last_clean":"2024-09-16T01:17:37.661882+0000","last_became_active":"2024-09-16T01:17:35.308206+0000","last_became_peered":"2024-09-16T01:17:35.308206+0000","last_unstale":"2024-09-16T01:17:37.661882+0000","last_undegraded":"2024-09-16T01:17:37.661882+0000","last_fullsized":"2024-09-16T01:17:37.661882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:38.480729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320881+0000","last_change":"2024-09-16T01:17:36.311550+0000","last_active":"2024-09-16T01:17:37.320881+0000","last_peered":"2024-09-16T01:17:37.320881+0000","last_clean":"2024-09-16T01:17:37.320881+0000","last_became_active":"2024-09-16T01:17:36.311284+0000","last_became_peered":"2024-09-16T01:17:36.311284+0000","last_unstale":"2024-09-16T01:17:37.320881+0000","last_undegraded":"2024-09-16T01:17:37.320881+0000","last_fullsized":"2024-09-16T01:17:37.320881+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:40.971734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661763+0000","last_change":"2024-09-16T01:17:35.310867+0000","last_active":"2024-09-16T01:17:37.661763+0000","last_peered":"2024-09-16T01:17:37.661763+0000","last_clean":"2024-09-16T01:17:37.661763+0000","last_became_active":"2024-09-16T01:17:35.310537+0000","last_became_peered":"2024-09-16T01:17:35.310537+0000","last_unstale":"2024-09-16T01:17:37.661763+0000","last_undegraded":"2024-09-16T01:17:37.661763+0000","last_fullsized":"2024-09-16T01:17:37.661763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:22.533493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662243+0000","last_change":"2024-09-16T01:17:36.319521+0000","last_active":"2024-09-16T01:17:37.662243+0000","last_peered":"2024-09-16T01:17:37.662243+0000","last_clean":"2024-09-16T01:17:37.662243+0000","last_became_active":"2024-09-16T01:17:36.319143+0000","last_became_peered":"2024-09-16T01:17:36.319143+0000","last_unstale":"2024-09-16T01:17:37.662243+0000","last_undegraded":"2024-09-16T01:17:37.662243+0000","last_fullsized":"2024-09-16T01:17:37.662243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:17.227756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.660929+0000","last_change":"2024-09-16T01:17:35.310043+0000","last_active":"2024-09-16T01:17:37.660929+0000","last_peered":"2024-09-16T01:17:37.660929+0000","last_clean":"2024-09-16T01:17:37.660929+0000","last_became_active":"2024-09-16T01:17:35.309676+0000","last_became_peered":"2024-09-16T01:17:35.309676+0000","last_unstale":"2024-09-16T01:17:37.660929+0000","last_undegraded":"2024-09-16T01:17:37.660929+0000","last_fullsized":"2024-09-16T01:17:37.660929+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:41.245307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662396+0000","last_change":"2024-09-16T01:17:36.315778+0000","last_active":"2024-09-16T01:17:37.662396+0000","last_peered":"2024-09-16T01:17:37.662396+0000","last_clean":"2024-09-16T01:17:37.662396+0000","last_became_active":"2024-09-16T01:17:36.315495+0000","last_became_peered":"2024-09-16T01:17:36.315495+0000","last_unstale":"2024-09-16T01:17:37.662396+0000","last_undegraded":"2024-09-16T01:17:37.662396+0000","last_fullsized":"2024-09-16T01:17:37.662396+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:00.230785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.320950+0000","last_change":"2024-09-16T01:17:35.305291+0000","last_active":"2024-09-16T01:17:37.320950+0000","last_peered":"2024-09-16T01:17:37.320950+0000","last_clean":"2024-09-16T01:17:37.320950+0000","last_became_active":"2024-09-16T01:17:35.304991+0000","last_became_peered":"2024-09-16T01:17:35.304991+0000","last_unstale":"2024-09-16T01:17:37.320950+0000","last_undegraded":"2024-09-16T01:17:37.320950+0000","last_fullsized":"2024-09-16T01:17:37.320950+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:09:49.827793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.321373+0000","last_change":"2024-09-16T01:17:36.306798+0000","last_active":"2024-09-16T01:17:37.321373+0000","last_peered":"2024-09-16T01:17:37.321373+0000","last_clean":"2024-09-16T01:17:37.321373+0000","last_became_active":"2024-09-16T01:17:36.306498+0000","last_became_peered":"2024-09-16T01:17:36.306498+0000","last_unstale":"2024-09-16T01:17:37.321373+0000","last_undegraded":"2024-09-16T01:17:37.321373+0000","last_fullsized":"2024-09-16T01:17:37.321373+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:35.288125+0000","last_clean_scrub_stamp":"2024-09-16T01:17:35.288125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:54.769436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.662329+0000","last_change":"2024-09-16T01:17:35.313561+0000","last_active":"2024-09-16T01:17:37.662329+0000","last_peered":"2024-09-16T01:17:37.662329+0000","last_clean":"2024-09-16T01:17:37.662329+0000","last_became_active":"2024-09-16T01:17:35.312958+0000","last_became_peered":"2024-09-16T01:17:35.312958+0000","last_unstale":"2024-09-16T01:17:37.662329+0000","last_undegraded":"2024-09-16T01:17:37.662329+0000","last_fullsized":"2024-09-16T01:17:37.662329+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:34.281943+0000","last_clean_scrub_stamp":"2024-09-16T01:17:34.281943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:12.719958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":226,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-16T01:17:37.661152+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:17:37.661152+0000","last_peered":"2024-09-16T01:17:37.661152+0000","last_clean":"2024-09-16T01:17:37.661152+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:17:37.661152+0000","last_undegraded":"2024-09-16T01:17:37.661152+0000","last_fullsized":"2024-09-16T01:17:37.661152+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":853009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":614400,"data_stored":269861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":606208,"data_stored":269209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":598016,"data_stored":263099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":622592,"data_stored":270843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":618496,"data_stored":270821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":602112,"data_stored":262677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28216,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1208320,"data_stored":859633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:17:43.940 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:17:43.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T01:17:44.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.081+0000 7f1f68ad0640 1 Processor -- start 2024-09-16T01:17:44.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.081+0000 7f1f68ad0640 1 -- start start 2024-09-16T01:17:44.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.082+0000 7f1f68ad0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f6406df30 0x7f1f641694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:44.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.082+0000 7f1f68ad0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f640d0bd0 con 0x7f1f640d0510 2024-09-16T01:17:44.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.082+0000 7f1f68ad0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f640d0eb0 con 0x7f1f6409aa30 2024-09-16T01:17:44.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.082+0000 7f1f68ad0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1f640d17e0 con 0x7f1f6406df30 2024-09-16T01:17:44.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.082+0000 7f1f61d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1f640d0510 0x7f1f6415f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60204/0 (socket says 172.21.15.81:60204) 2024-09-16T01:17:44.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.082+0000 7f1f61d9b640 1 -- 172.21.15.81:0/311348148 learned_addr learned my addr 172.21.15.81:0/311348148 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:44.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.082+0000 7f1f62d9d640 1 --2- 172.21.15.81:0/311348148 >> v2:172.21.15.81:3300/0 conn(0x7f1f6406df30 0x7f1f641694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.082+0000 7f1f62d9d640 1 -- 172.21.15.81:0/311348148 >> v1:172.21.15.102:6789/0 conn(0x7f1f6409aa30 legacy=0x7f1f6409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.082+0000 7f1f62d9d640 1 -- 172.21.15.81:0/311348148 >> v1:172.21.15.81:6789/0 conn(0x7f1f640d0510 legacy=0x7f1f6415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.082+0000 7f1f6159a640 1 -- 172.21.15.81:0/311348148 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3907202575 0 0) 0x7f1f640d0bd0 con 0x7f1f640d0510 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.082+0000 7f1f62d9d640 1 -- 172.21.15.81:0/311348148 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f640d1190 con 0x7f1f6406df30 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.083+0000 7f1f62d9d640 1 --2- 172.21.15.81:0/311348148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6406df30 0x7f1f641694b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009d90 tx=0x7f1f5c02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139514b072aea242 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.083+0000 7f1f6159a640 1 -- 172.21.15.81:0/311348148 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c037070 con 0x7f1f6406df30 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.083+0000 7f1f6159a640 1 -- 172.21.15.81:0/311348148 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5c007740 con 0x7f1f6406df30 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.083+0000 7f1f6159a640 1 -- 172.21.15.81:0/311348148 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c007b10 con 0x7f1f6406df30 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.084+0000 7f1f68ad0640 1 -- 172.21.15.81:0/311348148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6406df30 msgr2=0x7f1f641694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.084+0000 7f1f68ad0640 1 --2- 172.21.15.81:0/311348148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6406df30 0x7f1f641694b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009d90 tx=0x7f1f5c02a780 comp rx=0 tx=0).stop 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.084+0000 7f1f68ad0640 1 -- 172.21.15.81:0/311348148 shutdown_connections 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.084+0000 7f1f68ad0640 1 --2- 172.21.15.81:0/311348148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6406df30 0x7f1f641694b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.084+0000 7f1f68ad0640 1 -- 172.21.15.81:0/311348148 >> 172.21.15.81:0/311348148 conn(0x7f1f640d2380 msgr2=0x7f1f640d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:44.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.084+0000 7f1f68ad0640 1 -- 172.21.15.81:0/311348148 shutdown_connections 2024-09-16T01:17:44.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.084+0000 7f1f68ad0640 1 -- 172.21.15.81:0/311348148 wait complete. 2024-09-16T01:17:44.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.085+0000 7f1f68ad0640 1 Processor -- start 2024-09-16T01:17:44.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.086+0000 7f1f68ad0640 1 -- start start 2024-09-16T01:17:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.086+0000 7f1f68ad0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6409aa30 0x7f1f640c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.086+0000 7f1f68ad0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f640d0510 0x7f1f64159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.086+0000 7f1f68ad0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f640c6ed0 0x7f1f6409f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.086+0000 7f1f68ad0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6415fa20 con 0x7f1f6409aa30 2024-09-16T01:17:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.086+0000 7f1f68ad0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f640d0980 con 0x7f1f640d0510 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.086+0000 7f1f68ad0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6415fba0 con 0x7f1f640c6ed0 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.086+0000 7f1f6259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6409aa30 0x7f1f640c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.086+0000 7f1f6259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6409aa30 0x7f1f640c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53764/0 (socket says 172.21.15.81:53764) 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.086+0000 7f1f6259c640 1 -- 172.21.15.81:0/3914681423 learned_addr learned my addr 172.21.15.81:0/3914681423 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f61d9b640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f640d0510 0x7f1f64159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f62d9d640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f640c6ed0 0x7f1f6409f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f6259c640 1 -- 172.21.15.81:0/3914681423 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f640c6ed0 msgr2=0x7f1f6409f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f6259c640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f640c6ed0 0x7f1f6409f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f6259c640 1 -- 172.21.15.81:0/3914681423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f640d0510 msgr2=0x7f1f64159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f6259c640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f640d0510 0x7f1f64159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f6259c640 1 -- 172.21.15.81:0/3914681423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f640c83b0 con 0x7f1f6409aa30 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f6259c640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6409aa30 0x7f1f640c7dc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400c450 tx=0x7f1f5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f52ffd640 1 -- 172.21.15.81:0/3914681423 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f540052d0 con 0x7f1f6409aa30 2024-09-16T01:17:44.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f52ffd640 1 -- 172.21.15.81:0/3914681423 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f54005470 con 0x7f1f6409aa30 2024-09-16T01:17:44.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f68ad0640 1 -- 172.21.15.81:0/3914681423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f640c8690 con 0x7f1f6409aa30 2024-09-16T01:17:44.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f52ffd640 1 -- 172.21.15.81:0/3914681423 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54012870 con 0x7f1f6409aa30 2024-09-16T01:17:44.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.087+0000 7f1f68ad0640 1 -- 172.21.15.81:0/3914681423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f641f4120 con 0x7f1f6409aa30 2024-09-16T01:17:44.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.088+0000 7f1f68ad0640 1 -- 172.21.15.81:0/3914681423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6409ae10 con 0x7f1f6409aa30 2024-09-16T01:17:44.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.089+0000 7f1f52ffd640 1 -- 172.21.15.81:0/3914681423 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1f54012a10 con 0x7f1f6409aa30 2024-09-16T01:17:44.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.089+0000 7f1f52ffd640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f4406c2e0 0x7f1f4406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:44.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.089+0000 7f1f61d9b640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f4406c2e0 0x7f1f4406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:44.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.089+0000 7f1f52ffd640 1 -- 172.21.15.81:0/3914681423 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f1f5408b0d0 con 0x7f1f6409aa30 2024-09-16T01:17:44.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.089+0000 7f1f61d9b640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f4406c2e0 0x7f1f4406e7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1f58007f70 tx=0x7f1f58007f00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.093+0000 7f1f52ffd640 1 -- 172.21.15.81:0/3914681423 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f54059060 con 0x7f1f6409aa30 2024-09-16T01:17:44.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.326+0000 7f1f68ad0640 1 -- 172.21.15.81:0/3914681423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1f640d3290 con 0x7f1f6409aa30 2024-09-16T01:17:44.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.328+0000 7f1f52ffd640 1 -- 172.21.15.81:0/3914681423 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f1f5405d360 con 0x7f1f6409aa30 2024-09-16T01:17:44.328 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-16T01:17:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg== 2024-09-16T01:17:44.328 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-16T01:17:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-16T01:17:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T01:17:44.329 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-16T01:17:44.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.331+0000 7f1f68ad0640 1 -- 172.21.15.81:0/3914681423 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f4406c2e0 msgr2=0x7f1f4406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:44.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.331+0000 7f1f68ad0640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f4406c2e0 0x7f1f4406e7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1f58007f70 tx=0x7f1f58007f00 comp rx=0 tx=0).stop 2024-09-16T01:17:44.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.331+0000 7f1f68ad0640 1 -- 172.21.15.81:0/3914681423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6409aa30 msgr2=0x7f1f640c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:44.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.331+0000 7f1f68ad0640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6409aa30 0x7f1f640c7dc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400c450 tx=0x7f1f5400c910 comp rx=0 tx=0).stop 2024-09-16T01:17:44.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.331+0000 7f1f68ad0640 1 -- 172.21.15.81:0/3914681423 shutdown_connections 2024-09-16T01:17:44.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.331+0000 7f1f68ad0640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f4406c2e0 0x7f1f4406e7a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.331+0000 7f1f68ad0640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f640c6ed0 0x7f1f6409f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.331+0000 7f1f68ad0640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f640d0510 0x7f1f64159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.331+0000 7f1f68ad0640 1 --2- 172.21.15.81:0/3914681423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f6409aa30 0x7f1f640c7dc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.331+0000 7f1f68ad0640 1 -- 172.21.15.81:0/3914681423 >> 172.21.15.81:0/3914681423 conn(0x7f1f640d2380 msgr2=0x7f1f640b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:44.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.331+0000 7f1f68ad0640 1 -- 172.21.15.81:0/3914681423 shutdown_connections 2024-09-16T01:17:44.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.331+0000 7f1f68ad0640 1 -- 172.21.15.81:0/3914681423 wait complete. 2024-09-16T01:17:44.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:44.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.439+0000 7f02b21b9640 1 Processor -- start 2024-09-16T01:17:44.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.439+0000 7f02b21b9640 1 -- start start 2024-09-16T01:17:44.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.440+0000 7f02b21b9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f02ac162060 0x7f02ac0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:44.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.440+0000 7f02b21b9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f02ac0b64b0 0x7f02ac0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:44.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.440+0000 7f02b21b9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02ac06d9f0 con 0x7f02ac161c80 2024-09-16T01:17:44.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.440+0000 7f02b21b9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f02ac06dcd0 con 0x7f02ac162060 2024-09-16T01:17:44.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.440+0000 7f02b21b9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f02ac06dfb0 con 0x7f02ac0b64b0 2024-09-16T01:17:44.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.440+0000 7f02aaffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f02ac162060 0x7f02ac0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:44.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.440+0000 7f02aaffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f02ac162060 0x7f02ac0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53772/0 (socket says 172.21.15.81:53772) 2024-09-16T01:17:44.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.441+0000 7f02aaffd640 1 -- 172.21.15.81:0/4083378834 learned_addr learned my addr 172.21.15.81:0/4083378834 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:44.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.441+0000 7f02aaffd640 1 -- 172.21.15.81:0/4083378834 >> v2:172.21.15.102:3300/0 conn(0x7f02ac0b64b0 msgr2=0x7f02ac0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:44.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.441+0000 7f02aaffd640 1 --2- 172.21.15.81:0/4083378834 >> v2:172.21.15.102:3300/0 conn(0x7f02ac0b64b0 0x7f02ac0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.441+0000 7f02aaffd640 1 -- 172.21.15.81:0/4083378834 >> v1:172.21.15.102:6789/0 conn(0x7f02ac161c80 legacy=0x7f02ac06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:44.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.441+0000 7f02aaffd640 1 -- 172.21.15.81:0/4083378834 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ac0d01f0 con 0x7f02ac162060 2024-09-16T01:17:44.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.441+0000 7f02aaffd640 1 --2- 172.21.15.81:0/4083378834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02ac162060 0x7f02ac0b5f70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f02ac08d750 tx=0x7f02a002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0723f37d76364e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.442+0000 7f02aa7fc640 1 -- 172.21.15.81:0/4083378834 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a0037070 con 0x7f02ac162060 2024-09-16T01:17:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.442+0000 7f02aa7fc640 1 -- 172.21.15.81:0/4083378834 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a0032440 con 0x7f02ac162060 2024-09-16T01:17:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.442+0000 7f02aa7fc640 1 -- 172.21.15.81:0/4083378834 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a0032810 con 0x7f02ac162060 2024-09-16T01:17:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.442+0000 7f02b21b9640 1 -- 172.21.15.81:0/4083378834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02ac162060 msgr2=0x7f02ac0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.442+0000 7f02b21b9640 1 --2- 172.21.15.81:0/4083378834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02ac162060 0x7f02ac0b5f70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f02ac08d750 tx=0x7f02a002a230 comp rx=0 tx=0).stop 2024-09-16T01:17:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.442+0000 7f02b21b9640 1 -- 172.21.15.81:0/4083378834 shutdown_connections 2024-09-16T01:17:44.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.442+0000 7f02b21b9640 1 --2- 172.21.15.81:0/4083378834 >> v2:172.21.15.102:3300/0 conn(0x7f02ac0b64b0 0x7f02ac0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.442+0000 7f02b21b9640 1 --2- 172.21.15.81:0/4083378834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02ac162060 0x7f02ac0b5f70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.442+0000 7f02b21b9640 1 -- 172.21.15.81:0/4083378834 >> 172.21.15.81:0/4083378834 conn(0x7f02ac0d44f0 msgr2=0x7f02ac0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:44.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.442+0000 7f02b21b9640 1 -- 172.21.15.81:0/4083378834 shutdown_connections 2024-09-16T01:17:44.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.442+0000 7f02b21b9640 1 -- 172.21.15.81:0/4083378834 wait complete. 2024-09-16T01:17:44.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.443+0000 7f02b21b9640 1 Processor -- start 2024-09-16T01:17:44.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.444+0000 7f02b21b9640 1 -- start start 2024-09-16T01:17:44.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.444+0000 7f02b21b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02ac0b64b0 0x7f02ac159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:44.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.444+0000 7f02b21b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02ac161c80 0x7f02ac0c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:44.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.444+0000 7f02b21b9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02ac162060 0x7f02ac1f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:44.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.444+0000 7f02b21b9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac0cf1e0 con 0x7f02ac0b64b0 2024-09-16T01:17:44.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.444+0000 7f02b21b9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f02ac0d2aa0 con 0x7f02ac161c80 2024-09-16T01:17:44.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.444+0000 7f02b21b9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f02ac0cf360 con 0x7f02ac162060 2024-09-16T01:17:44.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.444+0000 7f02ab7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02ac0b64b0 0x7f02ac159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:44.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.444+0000 7f02ab7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02ac0b64b0 0x7f02ac159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53774/0 (socket says 172.21.15.81:53774) 2024-09-16T01:17:44.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.444+0000 7f02ab7fe640 1 -- 172.21.15.81:0/3144144821 learned_addr learned my addr 172.21.15.81:0/3144144821 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:44.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f02aaffd640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02ac161c80 0x7f02ac0c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:44.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f02abfff640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02ac162060 0x7f02ac1f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:44.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f02ab7fe640 1 -- 172.21.15.81:0/3144144821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02ac162060 msgr2=0x7f02ac1f7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:44.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f02ab7fe640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02ac162060 0x7f02ac1f7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f02ab7fe640 1 -- 172.21.15.81:0/3144144821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02ac161c80 msgr2=0x7f02ac0c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:44.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f02ab7fe640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02ac161c80 0x7f02ac0c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f02ab7fe640 1 -- 172.21.15.81:0/3144144821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ac0b73e0 con 0x7f02ac0b64b0 2024-09-16T01:17:44.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f02abfff640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02ac162060 0x7f02ac1f7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:44.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f02aaffd640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02ac161c80 0x7f02ac0c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:44.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f02ab7fe640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02ac0b64b0 0x7f02ac159c00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c7a0 tx=0x7f029c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:44.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f0293fff640 1 -- 172.21.15.81:0/3144144821 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c017070 con 0x7f02ac0b64b0 2024-09-16T01:17:44.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f0293fff640 1 -- 172.21.15.81:0/3144144821 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029c003da0 con 0x7f02ac0b64b0 2024-09-16T01:17:44.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f02b21b9640 1 -- 172.21.15.81:0/3144144821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02ac0c9440 con 0x7f02ac0b64b0 2024-09-16T01:17:44.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f0293fff640 1 -- 172.21.15.81:0/3144144821 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c0052b0 con 0x7f02ac0b64b0 2024-09-16T01:17:44.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.445+0000 7f02b21b9640 1 -- 172.21.15.81:0/3144144821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02ac0c9a00 con 0x7f02ac0b64b0 2024-09-16T01:17:44.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.446+0000 7f02b21b9640 1 -- 172.21.15.81:0/3144144821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02ac1f8840 con 0x7f02ac0b64b0 2024-09-16T01:17:44.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.447+0000 7f0293fff640 1 -- 172.21.15.81:0/3144144821 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f029c01a070 con 0x7f02ac0b64b0 2024-09-16T01:17:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.447+0000 7f0293fff640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f029806c2b0 0x7f029806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.447+0000 7f0293fff640 1 -- 172.21.15.81:0/3144144821 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f029c08acf0 con 0x7f02ac0b64b0 2024-09-16T01:17:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.447+0000 7f02aaffd640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f029806c2b0 0x7f029806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.447+0000 7f02aaffd640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f029806c2b0 0x7f029806e770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f02a0034000 tx=0x7f02a002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:44.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.451+0000 7f0293fff640 1 -- 172.21.15.81:0/3144144821 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f029c08f070 con 0x7f02ac0b64b0 2024-09-16T01:17:44.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.650+0000 7f02b21b9640 1 -- 172.21.15.81:0/3144144821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02ac0b5f70 con 0x7f02ac0b64b0 2024-09-16T01:17:44.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.650+0000 7f0293fff640 1 -- 172.21.15.81:0/3144144821 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f029c0592d0 con 0x7f02ac0b64b0 2024-09-16T01:17:44.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:44.651 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"btime":"2024-09-16T01:17:38:311750+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3508058089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3508058089},{"type":"v1","addr":"172.21.15.102:6835","nonce":3508058089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5349,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/763632631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":763632631},{"type":"v1","addr":"172.21.15.81:6835","nonce":763632631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3139124613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3139124613},{"type":"v1","addr":"172.21.15.81:6837","nonce":3139124613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:17:35.639749+0000","modified":"2024-09-16T01:17:37.638233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/52529574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":52529574},{"type":"v1","addr":"172.21.15.102:6834","nonce":52529574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5361,"qdb_cluster":[5361]},"id":3}]} 2024-09-16T01:17:44.652 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-16T01:17:44.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.652+0000 7f02b21b9640 1 -- 172.21.15.81:0/3144144821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f029806c2b0 msgr2=0x7f029806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:44.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.652+0000 7f02b21b9640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f029806c2b0 0x7f029806e770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f02a0034000 tx=0x7f02a002e000 comp rx=0 tx=0).stop 2024-09-16T01:17:44.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.652+0000 7f02b21b9640 1 -- 172.21.15.81:0/3144144821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02ac0b64b0 msgr2=0x7f02ac159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:44.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.652+0000 7f02b21b9640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02ac0b64b0 0x7f02ac159c00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f029c00c7a0 tx=0x7f029c00cc60 comp rx=0 tx=0).stop 2024-09-16T01:17:44.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.652+0000 7f02b21b9640 1 -- 172.21.15.81:0/3144144821 shutdown_connections 2024-09-16T01:17:44.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.652+0000 7f02b21b9640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f029806c2b0 0x7f029806e770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.652+0000 7f02b21b9640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02ac162060 0x7f02ac1f7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.652+0000 7f02b21b9640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02ac161c80 0x7f02ac0c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.652+0000 7f02b21b9640 1 --2- 172.21.15.81:0/3144144821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02ac0b64b0 0x7f02ac159c00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:44.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.652+0000 7f02b21b9640 1 -- 172.21.15.81:0/3144144821 >> 172.21.15.81:0/3144144821 conn(0x7f02ac0d44f0 msgr2=0x7f02ac0b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:44.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.653+0000 7f02b21b9640 1 -- 172.21.15.81:0/3144144821 shutdown_connections 2024-09-16T01:17:44.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:44.653+0000 7f02b21b9640 1 -- 172.21.15.81:0/3144144821 wait complete. 2024-09-16T01:17:45.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:17:35.639749+0000', 'modified': '2024-09-16T01:17:37.638233+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5361}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5361': {'gid': 5361, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6834/52529574', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6832', 'nonce': 52529574}, {'type': 'v1', 'addr': '172.21.15.102:6834', 'nonce': 52529574}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5361, 'qdb_cluster': [5361]} 2024-09-16T01:17:45.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:17:45.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-16T01:17:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.168+0000 7f35c5b5f640 1 Processor -- start 2024-09-16T01:17:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.168+0000 7f35c5b5f640 1 -- start start 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.169+0000 7f35c5b5f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f35c0072940 0x7f35c0072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.169+0000 7f35c5b5f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35c00b4880 0x7f35c00b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.169+0000 7f35c5b5f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c00b3570 con 0x7f35c015ba30 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.169+0000 7f35c5b5f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f35c00732e0 con 0x7f35c00b4880 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.169+0000 7f35c5b5f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f35c00b4180 con 0x7f35c0072940 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.169+0000 7f35bf7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f35c015ba30 0x7f35c006f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60218/0 (socket says 172.21.15.81:60218) 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.169+0000 7f35bf7fe640 1 -- 172.21.15.81:0/825177818 learned_addr learned my addr 172.21.15.81:0/825177818 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.169+0000 7f35bffff640 1 --2- 172.21.15.81:0/825177818 >> v2:172.21.15.81:3300/0 conn(0x7f35c00b4880 0x7f35c00b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.170+0000 7f35beffd640 1 --2- 172.21.15.81:0/825177818 >> v2:172.21.15.102:3300/0 conn(0x7f35c0072940 0x7f35c0072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.170+0000 7f35be7fc640 1 -- 172.21.15.81:0/825177818 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3308958456 0 0) 0x7f35c00b3570 con 0x7f35c015ba30 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.170+0000 7f35be7fc640 1 -- 172.21.15.81:0/825177818 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35a8003520 con 0x7f35c015ba30 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.170+0000 7f35bffff640 1 -- 172.21.15.81:0/825177818 >> v2:172.21.15.102:3300/0 conn(0x7f35c0072940 msgr2=0x7f35c0072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.170+0000 7f35bffff640 1 --2- 172.21.15.81:0/825177818 >> v2:172.21.15.102:3300/0 conn(0x7f35c0072940 0x7f35c0072da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.170+0000 7f35bffff640 1 -- 172.21.15.81:0/825177818 >> v1:172.21.15.81:6789/0 conn(0x7f35c015ba30 legacy=0x7f35c006f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.170+0000 7f35bffff640 1 -- 172.21.15.81:0/825177818 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c00b3850 con 0x7f35c00b4880 2024-09-16T01:17:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.170+0000 7f35bffff640 1 --2- 172.21.15.81:0/825177818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c00b4880 0x7f35c00b4d10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f35c00cfff0 tx=0x7f35b802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d650e6c95a4d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.171+0000 7f35be7fc640 1 -- 172.21.15.81:0/825177818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8007740 con 0x7f35c00b4880 2024-09-16T01:17:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.171+0000 7f35be7fc640 1 -- 172.21.15.81:0/825177818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b80078e0 con 0x7f35c00b4880 2024-09-16T01:17:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.171+0000 7f35be7fc640 1 -- 172.21.15.81:0/825177818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8007cb0 con 0x7f35c00b4880 2024-09-16T01:17:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.171+0000 7f35c5b5f640 1 -- 172.21.15.81:0/825177818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c00b4880 msgr2=0x7f35c00b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.171+0000 7f35c5b5f640 1 --2- 172.21.15.81:0/825177818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c00b4880 0x7f35c00b4d10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f35c00cfff0 tx=0x7f35b802a680 comp rx=0 tx=0).stop 2024-09-16T01:17:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.171+0000 7f35c5b5f640 1 -- 172.21.15.81:0/825177818 shutdown_connections 2024-09-16T01:17:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.171+0000 7f35c5b5f640 1 --2- 172.21.15.81:0/825177818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c00b4880 0x7f35c00b4d10 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.171+0000 7f35c5b5f640 1 --2- 172.21.15.81:0/825177818 >> v2:172.21.15.102:3300/0 conn(0x7f35c0072940 0x7f35c0072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.171+0000 7f35c5b5f640 1 -- 172.21.15.81:0/825177818 >> 172.21.15.81:0/825177818 conn(0x7f35c0067d70 msgr2=0x7f35c006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.171+0000 7f35c5b5f640 1 -- 172.21.15.81:0/825177818 shutdown_connections 2024-09-16T01:17:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.171+0000 7f35c5b5f640 1 -- 172.21.15.81:0/825177818 wait complete. 2024-09-16T01:17:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.172+0000 7f35c5b5f640 1 Processor -- start 2024-09-16T01:17:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.173+0000 7f35c5b5f640 1 -- start start 2024-09-16T01:17:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.173+0000 7f35c5b5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c0072940 0x7f35c01f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.173+0000 7f35c5b5f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c00b4880 0x7f35c014bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.173+0000 7f35c5b5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c015ba30 0x7f35c014e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.173+0000 7f35c5b5f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35c006ff20 con 0x7f35c0072940 2024-09-16T01:17:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.173+0000 7f35c5b5f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f35c00b3e10 con 0x7f35c015ba30 2024-09-16T01:17:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.173+0000 7f35c5b5f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f35c00ce810 con 0x7f35c00b4880 2024-09-16T01:17:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.173+0000 7f35bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c0072940 0x7f35c01f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.173+0000 7f35bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c0072940 0x7f35c01f24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53794/0 (socket says 172.21.15.81:53794) 2024-09-16T01:17:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.173+0000 7f35bf7fe640 1 -- 172.21.15.81:0/1167560398 learned_addr learned my addr 172.21.15.81:0/1167560398 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.173+0000 7f35bffff640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c015ba30 0x7f35c014e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.173+0000 7f35beffd640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c00b4880 0x7f35c014bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.174+0000 7f35bf7fe640 1 -- 172.21.15.81:0/1167560398 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c00b4880 msgr2=0x7f35c014bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.174+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c00b4880 0x7f35c014bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.174+0000 7f35bf7fe640 1 -- 172.21.15.81:0/1167560398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c015ba30 msgr2=0x7f35c014e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.174+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c015ba30 0x7f35c014e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.174+0000 7f35bf7fe640 1 -- 172.21.15.81:0/1167560398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c01543b0 con 0x7f35c0072940 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.174+0000 7f35bffff640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c015ba30 0x7f35c014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.174+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c0072940 0x7f35c01f24e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f35b000c3c0 tx=0x7f35b000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.174+0000 7f35a7fff640 1 -- 172.21.15.81:0/1167560398 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b0017070 con 0x7f35c0072940 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.174+0000 7f35a7fff640 1 -- 172.21.15.81:0/1167560398 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b0005ce0 con 0x7f35c0072940 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.174+0000 7f35c5b5f640 1 -- 172.21.15.81:0/1167560398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c01f2a20 con 0x7f35c0072940 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.174+0000 7f35a7fff640 1 -- 172.21.15.81:0/1167560398 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b00072f0 con 0x7f35c0072940 2024-09-16T01:17:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.174+0000 7f35c5b5f640 1 -- 172.21.15.81:0/1167560398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c0154c10 con 0x7f35c0072940 2024-09-16T01:17:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.176+0000 7f35a7fff640 1 -- 172.21.15.81:0/1167560398 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f35b001a070 con 0x7f35c0072940 2024-09-16T01:17:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.176+0000 7f35a7fff640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f35ac06c2b0 0x7f35ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.176+0000 7f35a7fff640 1 -- 172.21.15.81:0/1167560398 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f35b008a8f0 con 0x7f35c0072940 2024-09-16T01:17:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.176+0000 7f35beffd640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f35ac06c2b0 0x7f35ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.177+0000 7f35beffd640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f35ac06c2b0 0x7f35ac06e770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f35c00b1ae0 tx=0x7f35b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.177+0000 7f35c89d6740 1 Processor -- start 2024-09-16T01:17:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.177+0000 7f35c89d6740 1 -- start start 2024-09-16T01:17:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35c89d6740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4fba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35c89d6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b3a80 0x5635ad4b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35c89d6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b7a50 0x5635ad4b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35c89d6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5635ad418520 con 0x5635ad4b3a80 2024-09-16T01:17:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35c89d6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5635ad3c03e0 con 0x5635ad4b7a50 2024-09-16T01:17:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35c89d6740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5635ad4144e0 con 0x5635ad4b62c0 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35beffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b3a80 0x5635ad4b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35beffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b3a80 0x5635ad4b66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53798/0 (socket says 172.21.15.81:53798) 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35beffd640 1 -- 172.21.15.81:0/2013678893 learned_addr learned my addr 172.21.15.81:0/2013678893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/2013678893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4fba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35bffff640 1 --2- 172.21.15.81:0/2013678893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b7a50 0x5635ad4b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35beffd640 1 -- 172.21.15.81:0/2013678893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 msgr2=0x5635ad4fba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35beffd640 1 --2- 172.21.15.81:0/2013678893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4fba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35beffd640 1 -- 172.21.15.81:0/2013678893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b7a50 msgr2=0x5635ad4b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35beffd640 1 --2- 172.21.15.81:0/2013678893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b7a50 0x5635ad4b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35beffd640 1 -- 172.21.15.81:0/2013678893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ad3db2f0 con 0x5635ad4b3a80 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35bffff640 1 --2- 172.21.15.81:0/2013678893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b7a50 0x5635ad4b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/2013678893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.178+0000 7f35beffd640 1 --2- 172.21.15.81:0/2013678893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b3a80 0x5635ad4b66a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f35b4011dc0 tx=0x7f35b4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6941d6251dd5291 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.179+0000 7f35a57fa640 1 -- 172.21.15.81:0/2013678893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4011df0 con 0x5635ad4b3a80 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.179+0000 7f35a57fa640 1 -- 172.21.15.81:0/2013678893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b4026070 con 0x5635ad4b3a80 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.179+0000 7f35a57fa640 1 -- 172.21.15.81:0/2013678893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4021640 con 0x5635ad4b3a80 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.179+0000 7f35c89d6740 1 -- 172.21.15.81:0/2013678893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b3a80 msgr2=0x5635ad4b66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.179+0000 7f35c89d6740 1 --2- 172.21.15.81:0/2013678893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b3a80 0x5635ad4b66a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f35b4011dc0 tx=0x7f35b4014000 comp rx=0 tx=0).stop 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.179+0000 7f35c89d6740 1 -- 172.21.15.81:0/2013678893 shutdown_connections 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.179+0000 7f35c89d6740 1 --2- 172.21.15.81:0/2013678893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b7a50 0x5635ad4b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.179+0000 7f35c89d6740 1 --2- 172.21.15.81:0/2013678893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b3a80 0x5635ad4b66a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.179+0000 7f35c89d6740 1 --2- 172.21.15.81:0/2013678893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4fba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.179+0000 7f35c89d6740 1 -- 172.21.15.81:0/2013678893 >> 172.21.15.81:0/2013678893 conn(0x5635ad4b2a80 msgr2=0x5635ad4faf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.179+0000 7f35c89d6740 1 -- 172.21.15.81:0/2013678893 shutdown_connections 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.179+0000 7f35c89d6740 1 -- 172.21.15.81:0/2013678893 wait complete. 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.180+0000 7f35c89d6740 1 -- start start 2024-09-16T01:17:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.180+0000 7f35c89d6740 1 Processor -- start 2024-09-16T01:17:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35c89d6740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4db960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35c89d6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b7a50 0x5635ad4df4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35c89d6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 0x5635ad4ff600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35c89d6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5635ad4b1f20 con 0x5635ad4e2340 2024-09-16T01:17:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35c89d6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5635ad3a1450 con 0x5635ad4b7a50 2024-09-16T01:17:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35c89d6740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5635ad4fc290 con 0x5635ad4b62c0 2024-09-16T01:17:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35c89d6740 10 client.0 _ll_register_callbacks cb 0x5635ad12aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:17:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 0x5635ad4ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 0x5635ad4ff600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53804/0 (socket says 172.21.15.81:53804) 2024-09-16T01:17:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35bffff640 1 -- 172.21.15.81:0/400612266 learned_addr learned my addr 172.21.15.81:0/400612266 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4db960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35beffd640 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b7a50 0x5635ad4df4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35bffff640 1 -- 172.21.15.81:0/400612266 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 msgr2=0x5635ad4db960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35bffff640 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4db960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35bffff640 1 -- 172.21.15.81:0/400612266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b7a50 msgr2=0x5635ad4df4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35bffff640 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b7a50 0x5635ad4df4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35bffff640 1 -- 172.21.15.81:0/400612266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ad12b2d0 con 0x5635ad4e2340 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f35bffff640 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 0x5635ad4ff600 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f35b802ac70 tx=0x7f35b8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2bcfc3c3fdd8db server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.181+0000 7f359e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f359e7fc640 1 -- 172.21.15.81:0/400612266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8009450 con 0x5635ad4e2340 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f359e7fc640 1 -- 172.21.15.81:0/400612266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f35b803c420 con 0x5635ad4e2340 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f35c89d6740 1 -- 172.21.15.81:0/400612266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35b4026070 con 0x5635ad4e2340 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f359e7fc640 1 -- 172.21.15.81:0/400612266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f35b8003990 con 0x5635ad4e2340 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f35c89d6740 10 client.5493 fetch_fsmap learned FSMap version 22 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f35c89d6740 1 -- 172.21.15.81:0/400612266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x5635ad1f56b0 con 0x5635ad4e2340 2024-09-16T01:17:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f359e7fc640 1 -- 172.21.15.81:0/400612266 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b4026070 con 0x5635ad4e2340 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f359e7fc640 1 -- 172.21.15.81:0/400612266 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f35b8044070 con 0x5635ad4e2340 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f35c89d6740 10 client.5493 fetch_fsmap finished waiting for FSMap version 22 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f35c89d6740 10 client.5493 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f35c89d6740 20 client.5493 populate_metadata read hostname 'smithi081' 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f35c89d6740 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.102:6832/52529574,v1:172.21.15.102:6834/52529574] conn(0x5635ad516550 0x5635ad518940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f35c89d6740 4 client.5493 mds_command: new command op to 5361 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f35c89d6740 1 -- 172.21.15.81:0/400612266 --> [v2:172.21.15.102:6832/52529574,v1:172.21.15.102:6834/52529574] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635ad425c50 con 0x5635ad516550 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.182+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.102:6832/52529574,v1:172.21.15.102:6834/52529574] conn(0x5635ad516550 0x5635ad518940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.183+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.102:6832/52529574,v1:172.21.15.102:6834/52529574] conn(0x5635ad516550 0x5635ad518940 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9995100c2c4f7232 server_cookie=27e37671ed5d3f2b in_seq=0 out_seq=0 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.183+0000 7f359e7fc640 10 client.5493 ms_handle_connect on v2:172.21.15.102:6832/52529574 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.183+0000 7f359e7fc640 1 -- 172.21.15.81:0/400612266 <== mds.0 v2:172.21.15.102:6832/52529574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635ad425c50 con 0x5635ad516550 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.183+0000 7f359e7fc640 10 client.5493 handle_command_reply: tid=0 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.183+0000 7f35c89d6740 1 client.5493 shutdown 2024-09-16T01:17:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.184+0000 7f35c89d6740 1 -- 172.21.15.81:0/400612266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 msgr2=0x5635ad4ff600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.184+0000 7f35c89d6740 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 0x5635ad4ff600 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f35b802ac70 tx=0x7f35b8004ab0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.184+0000 7f35c89d6740 1 -- 172.21.15.81:0/400612266 shutdown_connections 2024-09-16T01:17:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.184+0000 7f35c89d6740 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 0x5635ad4ff600 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.184+0000 7f35c89d6740 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.102:6832/52529574,v1:172.21.15.102:6834/52529574] conn(0x5635ad516550 0x5635ad518940 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.184+0000 7f35c89d6740 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b7a50 0x5635ad4df4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.184+0000 7f35c89d6740 1 --2- 172.21.15.81:0/400612266 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4db960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.184+0000 7f359e7fc640 0 client.5493 ms_handle_reset on v2:172.21.15.102:6832/52529574 2024-09-16T01:17:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.184+0000 7f35c89d6740 1 -- 172.21.15.81:0/400612266 >> 172.21.15.81:0/400612266 conn(0x5635ad4b3a80 msgr2=0x5635ad4fe310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.184+0000 7f35c89d6740 1 -- 172.21.15.81:0/400612266 shutdown_connections 2024-09-16T01:17:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.184+0000 7f35c89d6740 1 -- 172.21.15.81:0/400612266 wait complete. 2024-09-16T01:17:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.184+0000 7f35c89d6740 20 client.5493 trim_cache size 0 max 16384 2024-09-16T01:17:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.201+0000 7f35c89d6740 1 Processor -- start 2024-09-16T01:17:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.201+0000 7f35c89d6740 1 -- start start 2024-09-16T01:17:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.202+0000 7f35c89d6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b62c0 0x5635ad4fec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.202+0000 7f35c89d6740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b7a50 0x5635ad4df4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.202+0000 7f35c89d6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 0x5635ad4fb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.202+0000 7f35c89d6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35c01fdbe0 con 0x5635ad4e2340 2024-09-16T01:17:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.202+0000 7f35c89d6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f35c0150d30 con 0x5635ad4b62c0 2024-09-16T01:17:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.202+0000 7f35c89d6740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f35c01fd590 con 0x5635ad4b7a50 2024-09-16T01:17:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.202+0000 7f35bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 0x5635ad4fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.202+0000 7f35bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 0x5635ad4fb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53806/0 (socket says 172.21.15.81:53806) 2024-09-16T01:17:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.202+0000 7f35bffff640 1 -- 172.21.15.81:0/1605754796 learned_addr learned my addr 172.21.15.81:0/1605754796 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.202+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/1605754796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b62c0 0x5635ad4fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.202+0000 7f35beffd640 1 --2- 172.21.15.81:0/1605754796 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b7a50 0x5635ad4df4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.203+0000 7f35bffff640 1 -- 172.21.15.81:0/1605754796 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b7a50 msgr2=0x5635ad4df4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.203+0000 7f35bffff640 1 --2- 172.21.15.81:0/1605754796 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b7a50 0x5635ad4df4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.203+0000 7f35bffff640 1 -- 172.21.15.81:0/1605754796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b62c0 msgr2=0x5635ad4fec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.203+0000 7f35bffff640 1 --2- 172.21.15.81:0/1605754796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b62c0 0x5635ad4fec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.203+0000 7f35bffff640 1 -- 172.21.15.81:0/1605754796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635ad4b6d90 con 0x5635ad4e2340 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.203+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/1605754796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b62c0 0x5635ad4fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.203+0000 7f35bffff640 1 --2- 172.21.15.81:0/1605754796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 0x5635ad4fb050 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f35b802ac40 tx=0x7f35b803f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fa200aacb5ae16 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.203+0000 7f35a4ff9640 1 -- 172.21.15.81:0/1605754796 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8007b30 con 0x5635ad4e2340 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.203+0000 7f35a4ff9640 1 -- 172.21.15.81:0/1605754796 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b8046440 con 0x5635ad4e2340 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.203+0000 7f35a4ff9640 1 -- 172.21.15.81:0/1605754796 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8046990 con 0x5635ad4e2340 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.203+0000 7f35c89d6740 1 -- 172.21.15.81:0/1605754796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 msgr2=0x5635ad4fb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.203+0000 7f35c89d6740 1 --2- 172.21.15.81:0/1605754796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 0x5635ad4fb050 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f35b802ac40 tx=0x7f35b803f040 comp rx=0 tx=0).stop 2024-09-16T01:17:45.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.204+0000 7f35c89d6740 1 -- 172.21.15.81:0/1605754796 shutdown_connections 2024-09-16T01:17:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.204+0000 7f35c89d6740 1 --2- 172.21.15.81:0/1605754796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4e2340 0x5635ad4fb050 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.204+0000 7f35c89d6740 1 --2- 172.21.15.81:0/1605754796 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b7a50 0x5635ad4df4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.204+0000 7f35c89d6740 1 --2- 172.21.15.81:0/1605754796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4b62c0 0x5635ad4fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.204+0000 7f35c89d6740 1 -- 172.21.15.81:0/1605754796 >> 172.21.15.81:0/1605754796 conn(0x5635ad4b3a80 msgr2=0x5635ad51bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.204+0000 7f35c89d6740 1 -- 172.21.15.81:0/1605754796 shutdown_connections 2024-09-16T01:17:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.204+0000 7f35c89d6740 1 -- 172.21.15.81:0/1605754796 wait complete. 2024-09-16T01:17:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.204+0000 7f35c89d6740 1 -- start start 2024-09-16T01:17:45.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.204+0000 7f35c89d6740 1 Processor -- start 2024-09-16T01:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35c89d6740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35c89d6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b7a50 0x5635ad4d8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35c89d6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4e2340 0x5635ad4d8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35c89d6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5635ad4e28e0 con 0x5635ad4b7a50 2024-09-16T01:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35c89d6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5635ad4dfa00 con 0x5635ad4e2340 2024-09-16T01:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35c89d6740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5635ad4e3790 con 0x5635ad4b62c0 2024-09-16T01:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35c89d6740 10 client.0 _ll_register_callbacks cb 0x7f35a80036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35beffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b7a50 0x5635ad4d8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35beffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b7a50 0x5635ad4d8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53816/0 (socket says 172.21.15.81:53816) 2024-09-16T01:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35beffd640 1 -- 172.21.15.81:0/4233241350 learned_addr learned my addr 172.21.15.81:0/4233241350 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:45.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35bffff640 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4e2340 0x5635ad4d8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35beffd640 1 -- 172.21.15.81:0/4233241350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 msgr2=0x5635ad4b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35beffd640 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35beffd640 1 -- 172.21.15.81:0/4233241350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4e2340 msgr2=0x5635ad4d8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35beffd640 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4e2340 0x5635ad4d8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.205+0000 7f35beffd640 1 -- 172.21.15.81:0/4233241350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635ad518940 con 0x5635ad4b7a50 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f35beffd640 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b7a50 0x5635ad4d8240 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f35b4023040 tx=0x7f35b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef98aa66617121e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f359e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f359e7fc640 1 -- 172.21.15.81:0/4233241350 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4039060 con 0x5635ad4b7a50 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f359e7fc640 1 -- 172.21.15.81:0/4233241350 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f35b400f040 con 0x5635ad4b7a50 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f35c89d6740 1 -- 172.21.15.81:0/4233241350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35b8046440 con 0x5635ad4b7a50 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f359e7fc640 1 -- 172.21.15.81:0/4233241350 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f35b403f050 con 0x5635ad4b7a50 2024-09-16T01:17:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f35c89d6740 10 client.5499 fetch_fsmap learned FSMap version 22 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f35c89d6740 1 -- 172.21.15.81:0/4233241350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x5635ad4fa260 con 0x5635ad4b7a50 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f359e7fc640 1 -- 172.21.15.81:0/4233241350 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b8046440 con 0x5635ad4b7a50 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f359e7fc640 1 -- 172.21.15.81:0/4233241350 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f35b4042020 con 0x5635ad4b7a50 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f35c89d6740 10 client.5499 fetch_fsmap finished waiting for FSMap version 22 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f35c89d6740 10 client.5499 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f35c89d6740 20 client.5499 populate_metadata read hostname 'smithi081' 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f35c89d6740 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.102:6832/52529574,v1:172.21.15.102:6834/52529574] conn(0x5635ad57d750 0x5635ad57db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f35c89d6740 4 client.5499 mds_command: new command op to 5361 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f35c89d6740 1 -- 172.21.15.81:0/4233241350 --> [v2:172.21.15.102:6832/52529574,v1:172.21.15.102:6834/52529574] -- command(tid 0: {"prefix": "status"}) -- 0x5635ad4de790 con 0x5635ad57d750 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.206+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.102:6832/52529574,v1:172.21.15.102:6834/52529574] conn(0x5635ad57d750 0x5635ad57db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f359e7fc640 10 client.5499 ms_handle_connect on v2:172.21.15.102:6832/52529574 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35bf7fe640 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.102:6832/52529574,v1:172.21.15.102:6834/52529574] conn(0x5635ad57d750 0x5635ad57db30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee23017b3fe424f5 server_cookie=4dbd815f71fc9a72 in_seq=0 out_seq=0 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f359e7fc640 1 -- 172.21.15.81:0/4233241350 <== mds.0 v2:172.21.15.102:6832/52529574 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5635ad4de790 con 0x5635ad57d750 2024-09-16T01:17:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f359e7fc640 10 client.5499 handle_command_reply: tid=0 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35c89d6740 1 client.5499 shutdown 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35c89d6740 1 -- 172.21.15.81:0/4233241350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b7a50 msgr2=0x5635ad4d8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35c89d6740 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b7a50 0x5635ad4d8240 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f35b4023040 tx=0x7f35b40046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35c89d6740 1 -- 172.21.15.81:0/4233241350 shutdown_connections 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35c89d6740 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.102:6832/52529574,v1:172.21.15.102:6834/52529574] conn(0x5635ad57d750 0x5635ad57db30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35c89d6740 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635ad4e2340 0x5635ad4d8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35c89d6740 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5635ad4b7a50 0x5635ad4d8240 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f359e7fc640 0 client.5499 ms_handle_reset on v2:172.21.15.102:6832/52529574 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35c89d6740 1 --2- 172.21.15.81:0/4233241350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5635ad4b62c0 0x5635ad4b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35c89d6740 1 -- 172.21.15.81:0/4233241350 >> 172.21.15.81:0/4233241350 conn(0x5635ad4b3a80 msgr2=0x5635ad51bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35c89d6740 1 -- 172.21.15.81:0/4233241350 shutdown_connections 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35c89d6740 1 -- 172.21.15.81:0/4233241350 wait complete. 2024-09-16T01:17:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.207+0000 7f35c89d6740 20 client.5499 trim_cache size 0 max 16384 2024-09-16T01:17:45.215 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:17:45.215 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973", 2024-09-16T01:17:45.215 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-16T01:17:45.215 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5361, 2024-09-16T01:17:45.215 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-16T01:17:45.215 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-16T01:17:45.215 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-16T01:17:45.215 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 8.9013996039999999, 2024-09-16T01:17:45.215 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 22, 2024-09-16T01:17:45.215 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 51, 2024-09-16T01:17:45.215 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 51, 2024-09-16T01:17:45.215 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 12.975360483999999 2024-09-16T01:17:45.216 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:17:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.208+0000 7f35c5b5f640 1 -- 172.21.15.81:0/1167560398 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f35ac06c2b0 msgr2=0x7f35ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.208+0000 7f35c5b5f640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f35ac06c2b0 0x7f35ac06e770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f35c00b1ae0 tx=0x7f35b4008040 comp rx=0 tx=0).stop 2024-09-16T01:17:45.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.208+0000 7f35c5b5f640 1 -- 172.21.15.81:0/1167560398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c0072940 msgr2=0x7f35c01f24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.208+0000 7f35c5b5f640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c0072940 0x7f35c01f24e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f35b000c3c0 tx=0x7f35b000c880 comp rx=0 tx=0).stop 2024-09-16T01:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.208+0000 7f35c5b5f640 1 -- 172.21.15.81:0/1167560398 shutdown_connections 2024-09-16T01:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.208+0000 7f35c5b5f640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f35ac06c2b0 0x7f35ac06e770 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.208+0000 7f35c5b5f640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c015ba30 0x7f35c014e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.208+0000 7f35c5b5f640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c00b4880 0x7f35c014bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.208+0000 7f35c5b5f640 1 --2- 172.21.15.81:0/1167560398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c0072940 0x7f35c01f24e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.208+0000 7f35c5b5f640 1 -- 172.21.15.81:0/1167560398 >> 172.21.15.81:0/1167560398 conn(0x7f35c0067d70 msgr2=0x7f35c00b2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.208+0000 7f35c5b5f640 1 -- 172.21.15.81:0/1167560398 shutdown_connections 2024-09-16T01:17:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.208+0000 7f35c5b5f640 1 -- 172.21.15.81:0/1167560398 wait complete. 2024-09-16T01:17:45.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:17:45.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.316+0000 7fedef386640 1 Processor -- start 2024-09-16T01:17:45.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.317+0000 7fedef386640 1 -- start start 2024-09-16T01:17:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.317+0000 7fedef386640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede8161c80 0x7fede806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7fedef386640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fede80b6680 0x7fede80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7fedef386640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede806e870 con 0x7fede8162060 2024-09-16T01:17:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7fedef386640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fede806d9f0 con 0x7fede80b6680 2024-09-16T01:17:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7fedef386640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fede806dcd0 con 0x7fede8161c80 2024-09-16T01:17:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7feded923640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fede80b6680 0x7fede80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7fedec921640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fede8162060 0x7fede80b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60232/0 (socket says 172.21.15.81:60232) 2024-09-16T01:17:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7fedec921640 1 -- 172.21.15.81:0/3298752889 learned_addr learned my addr 172.21.15.81:0/3298752889 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7feded122640 1 --2- 172.21.15.81:0/3298752889 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede8161c80 0x7fede806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7feded923640 1 -- 172.21.15.81:0/3298752889 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede8161c80 msgr2=0x7fede806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:45.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7feded923640 1 --2- 172.21.15.81:0/3298752889 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede8161c80 0x7fede806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7feded923640 1 -- 172.21.15.81:0/3298752889 >> v1:172.21.15.81:6789/0 conn(0x7fede8162060 legacy=0x7fede80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7feded923640 1 -- 172.21.15.81:0/3298752889 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede806dfb0 con 0x7fede80b6680 2024-09-16T01:17:45.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.318+0000 7feddbfff640 1 -- 172.21.15.81:0/3298752889 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059690182 0 0) 0x7feddc001110 con 0x7fede8162060 2024-09-16T01:17:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.319+0000 7feded923640 1 --2- 172.21.15.81:0/3298752889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede80b6680 0x7fede80cf1e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fede0009d90 tx=0x7fede002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a451595721aed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.319+0000 7feddbfff640 1 -- 172.21.15.81:0/3298752889 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0007740 con 0x7fede80b6680 2024-09-16T01:17:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.319+0000 7feddbfff640 1 -- 172.21.15.81:0/3298752889 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede00078e0 con 0x7fede80b6680 2024-09-16T01:17:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.319+0000 7feddbfff640 1 -- 172.21.15.81:0/3298752889 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0007cb0 con 0x7fede80b6680 2024-09-16T01:17:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.319+0000 7fedef386640 1 -- 172.21.15.81:0/3298752889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede80b6680 msgr2=0x7fede80cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.319+0000 7fedef386640 1 --2- 172.21.15.81:0/3298752889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede80b6680 0x7fede80cf1e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fede0009d90 tx=0x7fede002a680 comp rx=0 tx=0).stop 2024-09-16T01:17:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.319+0000 7fedef386640 1 -- 172.21.15.81:0/3298752889 shutdown_connections 2024-09-16T01:17:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.319+0000 7fedef386640 1 --2- 172.21.15.81:0/3298752889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede80b6680 0x7fede80cf1e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.319+0000 7fedef386640 1 --2- 172.21.15.81:0/3298752889 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede8161c80 0x7fede806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.319+0000 7fedef386640 1 -- 172.21.15.81:0/3298752889 >> 172.21.15.81:0/3298752889 conn(0x7fede80d44f0 msgr2=0x7fede80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.320+0000 7fedef386640 1 -- 172.21.15.81:0/3298752889 shutdown_connections 2024-09-16T01:17:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.320+0000 7fedef386640 1 -- 172.21.15.81:0/3298752889 wait complete. 2024-09-16T01:17:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.321+0000 7fedef386640 1 Processor -- start 2024-09-16T01:17:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.321+0000 7fedef386640 1 -- start start 2024-09-16T01:17:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.321+0000 7fedef386640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fede80b6680 0x7fede81565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.321+0000 7fedef386640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede8161c80 0x7fede80c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.321+0000 7fedef386640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede8162060 0x7fede80b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.321+0000 7fedef386640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fede80b6b30 con 0x7fede8161c80 2024-09-16T01:17:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.321+0000 7fedef386640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fede80d2aa0 con 0x7fede80b6680 2024-09-16T01:17:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.321+0000 7fedef386640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fede80b6cb0 con 0x7fede8162060 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.321+0000 7fedec921640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede8161c80 0x7fede80c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.321+0000 7fedec921640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede8161c80 0x7fede80c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53830/0 (socket says 172.21.15.81:53830) 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.321+0000 7fedec921640 1 -- 172.21.15.81:0/2578186944 learned_addr learned my addr 172.21.15.81:0/2578186944 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7feded122640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fede80b6680 0x7fede81565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7feded923640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede8162060 0x7fede80b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7fedec921640 1 -- 172.21.15.81:0/2578186944 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede8162060 msgr2=0x7fede80b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7fedec921640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede8162060 0x7fede80b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7fedec921640 1 -- 172.21.15.81:0/2578186944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fede80b6680 msgr2=0x7fede81565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7fedec921640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fede80b6680 0x7fede81565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7fedec921640 1 -- 172.21.15.81:0/2578186944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede80c9dc0 con 0x7fede8161c80 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7fedec921640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede8161c80 0x7fede80c94e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feddc00c410 tx=0x7feddc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2578186944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc0074e0 con 0x7fede8161c80 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2578186944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feddc0047e0 con 0x7fede8161c80 2024-09-16T01:17:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7fedef386640 1 -- 172.21.15.81:0/2578186944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede80ca0a0 con 0x7fede8161c80 2024-09-16T01:17:45.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2578186944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc004bd0 con 0x7fede8161c80 2024-09-16T01:17:45.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.322+0000 7fedef386640 1 -- 172.21.15.81:0/2578186944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede80ca660 con 0x7fede8161c80 2024-09-16T01:17:45.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.323+0000 7fedef386640 1 -- 172.21.15.81:0/2578186944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede806e330 con 0x7fede8161c80 2024-09-16T01:17:45.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.324+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2578186944 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feddc011070 con 0x7fede8161c80 2024-09-16T01:17:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.324+0000 7fedd9ffb640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedcc06c2e0 0x7fedcc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.324+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2578186944 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7feddc08b190 con 0x7fede8161c80 2024-09-16T01:17:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.324+0000 7feded122640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedcc06c2e0 0x7fedcc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.325+0000 7feded122640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedcc06c2e0 0x7fedcc06e7a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fede4006fd0 tx=0x7fede4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.328+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2578186944 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fede806e870 con 0x7fede8161c80 2024-09-16T01:17:45.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.526+0000 7fedef386640 1 -- 172.21.15.81:0/2578186944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fede80ba470 con 0x7fede8161c80 2024-09-16T01:17:45.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.527+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2578186944 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+73 (secure 0 0 0) 0x7feddc059770 con 0x7fede8161c80 2024-09-16T01:17:45.528 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:17:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.528+0000 7fedef386640 1 -- 172.21.15.81:0/2578186944 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedcc06c2e0 msgr2=0x7fedcc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.528+0000 7fedef386640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedcc06c2e0 0x7fedcc06e7a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fede4006fd0 tx=0x7fede4008040 comp rx=0 tx=0).stop 2024-09-16T01:17:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.529+0000 7fedef386640 1 -- 172.21.15.81:0/2578186944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede8161c80 msgr2=0x7fede80c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.529+0000 7fedef386640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede8161c80 0x7fede80c94e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feddc00c410 tx=0x7feddc001e70 comp rx=0 tx=0).stop 2024-09-16T01:17:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.529+0000 7fedef386640 1 -- 172.21.15.81:0/2578186944 shutdown_connections 2024-09-16T01:17:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.529+0000 7fedef386640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedcc06c2e0 0x7fedcc06e7a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.529+0000 7fedef386640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede8162060 0x7fede80b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.529+0000 7fedef386640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede8161c80 0x7fede80c94e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.529+0000 7fedef386640 1 --2- 172.21.15.81:0/2578186944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fede80b6680 0x7fede81565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.529+0000 7fedef386640 1 -- 172.21.15.81:0/2578186944 >> 172.21.15.81:0/2578186944 conn(0x7fede80d44f0 msgr2=0x7fede80b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.529+0000 7fedef386640 1 -- 172.21.15.81:0/2578186944 shutdown_connections 2024-09-16T01:17:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45.529+0000 7fedef386640 1 -- 172.21.15.81:0/2578186944 wait complete. 2024-09-16T01:17:45.540 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:17:45.540 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:17:45.540 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:17:45.540 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:17:45.540 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:17:45.540 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:17:45.541 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:17:45.541 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:17:45.541 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:17:45.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:45.541 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:17:45.557 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:17:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:17:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:17:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:17:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:45.557 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42673sec preferred_lft 42673sec 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:45.558 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::bc22:19ff:fe0c:8fb1/64 scope link 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 86:bb:d8:38:80:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::84bb:d8ff:fe38:80af/64 scope link 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::828:dff:febd:ee39/64 scope link 2024-09-16T01:17:45.559 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:45.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:45.560 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:17:45.621 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:17:45.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:45.622 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:17:45.679 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:17:45.679 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:17:45.679 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:17:45.679 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:17:45.679 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:17:45.679 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:17:45.679 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:17:45.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:17:45.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:17:45.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:17:45.680 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:17:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:17:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:17:45.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:45.805 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:17:45.820 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:17:45.820 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:17:45.821 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:17:45.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:45.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-16T01:17:45.884 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:17:45.885 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:17:45.940 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:17:45.940 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:17:45.940 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:17:45.995 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:17:45.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:45.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:17:46.079 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:17:46.079 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:17:46.079 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:17:46.087 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:17:46.087 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:17:46.088 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:17:46.088 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:17:46.088 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:17:46.096 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:17:46.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:46.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:17:46.162 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:17:46.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:17:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:17:46.265 INFO:teuthology.orchestra.run.smithi081.stdout:client4994 2024-09-16T01:17:46.265 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:17:46.265 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:46.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:17:46.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.418+0000 7f313c64c640 1 Processor -- start 2024-09-16T01:17:46.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.418+0000 7f313c64c640 1 -- start start 2024-09-16T01:17:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f313c64c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3134072320 0x7f31340cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:46.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f313c64c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3134072de0 0x7f313406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:46.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f313c64c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3134146140 con 0x7f3134072700 2024-09-16T01:17:46.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f313c64c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f31340cd740 con 0x7f3134072de0 2024-09-16T01:17:46.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f313c64c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f31340cda20 con 0x7f3134072320 2024-09-16T01:17:46.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f313abe9640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3134072700 0x7f313406e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60240/0 (socket says 172.21.15.81:60240) 2024-09-16T01:17:46.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f313abe9640 1 -- 172.21.15.81:0/791503613 learned_addr learned my addr 172.21.15.81:0/791503613 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:46.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f313a3e8640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3134072320 0x7f31340cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:46.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f3139be7640 1 --2- 172.21.15.81:0/791503613 >> v2:172.21.15.102:3300/0 conn(0x7f3134072de0 0x7f313406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:46.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4074405364 0 0) 0x7f3134146140 con 0x7f3134072700 2024-09-16T01:17:46.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3120003520 con 0x7f3134072700 2024-09-16T01:17:46.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3825581677 0 0) 0x7f3120003520 con 0x7f3134072700 2024-09-16T01:17:46.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3134072320 msgr2=0x7f31340cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:46.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f31393e6640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3134072320 0x7f31340cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:46.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 >> v2:172.21.15.102:3300/0 conn(0x7f3134072de0 msgr2=0x7f313406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:46.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f31393e6640 1 --2- 172.21.15.81:0/791503613 >> v2:172.21.15.102:3300/0 conn(0x7f3134072de0 0x7f313406e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:46.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31340cdd00 con 0x7f3134072700 2024-09-16T01:17:46.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f312c0019f0 con 0x7f3134072700 2024-09-16T01:17:46.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 >> v1:172.21.15.81:6789/0 conn(0x7f3134072700 legacy=0x7f313406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:46.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.419+0000 7f31393e6640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31200039b0 0x7f3120003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:46.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f31393e6640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3134072320 0x7f3120004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:46.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f31393e6640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3120004d40 0x7f31200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:46.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f31340cd740 con 0x7f31200039b0 2024-09-16T01:17:46.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f31340cda20 con 0x7f3120004d40 2024-09-16T01:17:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f312000b9c0 con 0x7f3134072320 2024-09-16T01:17:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f313a3e8640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31200039b0 0x7f3120003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f3139be7640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3134072320 0x7f3120004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f313abe9640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3120004d40 0x7f31200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f313a3e8640 1 -- 172.21.15.81:0/791503613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3134072320 msgr2=0x7f3120004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f313a3e8640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3134072320 0x7f3120004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f313a3e8640 1 -- 172.21.15.81:0/791503613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3120004d40 msgr2=0x7f31200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f313a3e8640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3120004d40 0x7f31200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f313a3e8640 1 -- 172.21.15.81:0/791503613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3120003520 con 0x7f31200039b0 2024-09-16T01:17:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.420+0000 7f3139be7640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3134072320 0x7f3120004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.421+0000 7f313a3e8640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31200039b0 0x7f3120003dd0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3130009ac0 tx=0x7f3120005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7bf56f366f7b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:46.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.421+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130036070 con 0x7f31200039b0 2024-09-16T01:17:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.421+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3130031400 con 0x7f31200039b0 2024-09-16T01:17:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.421+0000 7f31393e6640 1 -- 172.21.15.81:0/791503613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130009690 con 0x7f31200039b0 2024-09-16T01:17:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.421+0000 7f313c64c640 1 -- 172.21.15.81:0/791503613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31200039b0 msgr2=0x7f3120003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.421+0000 7f313c64c640 1 --2- 172.21.15.81:0/791503613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31200039b0 0x7f3120003dd0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3130009ac0 tx=0x7f3120005830 comp rx=0 tx=0).stop 2024-09-16T01:17:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.421+0000 7f313abe9640 1 -- 172.21.15.81:0/791503613 reap_dead start 2024-09-16T01:17:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.421+0000 7f313c64c640 1 -- 172.21.15.81:0/791503613 shutdown_connections 2024-09-16T01:17:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.421+0000 7f313c64c640 1 -- 172.21.15.81:0/791503613 >> 172.21.15.81:0/791503613 conn(0x7f3134067d70 msgr2=0x7f313406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.421+0000 7f313c64c640 1 -- 172.21.15.81:0/791503613 shutdown_connections 2024-09-16T01:17:46.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.421+0000 7f313c64c640 1 -- 172.21.15.81:0/791503613 wait complete. 2024-09-16T01:17:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.423+0000 7f313c64c640 1 Processor -- start 2024-09-16T01:17:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.423+0000 7f313c64c640 1 -- start start 2024-09-16T01:17:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.423+0000 7f313c64c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31200039b0 0x7f3134150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.423+0000 7f313c64c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31340ce770 0x7f31340cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.423+0000 7f313c64c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31341f3670 0x7f31341f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:46.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.423+0000 7f313c64c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f313406ee80 con 0x7f31200039b0 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.423+0000 7f313c64c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f313406ed00 con 0x7f31341f3670 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.423+0000 7f313c64c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f313415e1f0 con 0x7f31340ce770 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.423+0000 7f313a3e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31200039b0 0x7f3134150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.423+0000 7f313a3e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31200039b0 0x7f3134150cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53848/0 (socket says 172.21.15.81:53848) 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.423+0000 7f313a3e8640 1 -- 172.21.15.81:0/3372386947 learned_addr learned my addr 172.21.15.81:0/3372386947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f3139be7640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31340ce770 0x7f31340cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f313abe9640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31341f3670 0x7f31341f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f313a3e8640 1 -- 172.21.15.81:0/3372386947 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31340ce770 msgr2=0x7f31340cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f313a3e8640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31340ce770 0x7f31340cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f313a3e8640 1 -- 172.21.15.81:0/3372386947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31341f3670 msgr2=0x7f31341f3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f313a3e8640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31341f3670 0x7f31341f3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f313a3e8640 1 -- 172.21.15.81:0/3372386947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31341511f0 con 0x7f31200039b0 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f3139be7640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31340ce770 0x7f31340cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:46.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f313abe9640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31341f3670 0x7f31341f3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f313a3e8640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31200039b0 0x7f3134150cb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3130009be0 tx=0x7f3130004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f312affd640 1 -- 172.21.15.81:0/3372386947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130040020 con 0x7f31200039b0 2024-09-16T01:17:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f312affd640 1 -- 172.21.15.81:0/3372386947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3130003940 con 0x7f31200039b0 2024-09-16T01:17:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f313c64c640 1 -- 172.21.15.81:0/3372386947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31341f43e0 con 0x7f31200039b0 2024-09-16T01:17:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f312affd640 1 -- 172.21.15.81:0/3372386947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3130036040 con 0x7f31200039b0 2024-09-16T01:17:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.424+0000 7f313c64c640 1 -- 172.21.15.81:0/3372386947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31341f49a0 con 0x7f31200039b0 2024-09-16T01:17:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.425+0000 7f313c64c640 1 -- 172.21.15.81:0/3372386947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31340cf130 con 0x7f31200039b0 2024-09-16T01:17:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.426+0000 7f312affd640 1 -- 172.21.15.81:0/3372386947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3130043020 con 0x7f31200039b0 2024-09-16T01:17:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.426+0000 7f312affd640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f311806c2b0 0x7f311806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.426+0000 7f312affd640 1 -- 172.21.15.81:0/3372386947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f31300ab740 con 0x7f31200039b0 2024-09-16T01:17:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.426+0000 7f3139be7640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f311806c2b0 0x7f311806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:46.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.427+0000 7f3139be7640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f311806c2b0 0x7f311806e770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f31340c84c0 tx=0x7f3124008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:46.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.430+0000 7f312affd640 1 -- 172.21.15.81:0/3372386947 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f313004a070 con 0x7f31200039b0 2024-09-16T01:17:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.629+0000 7f313c64c640 1 -- 172.21.15.81:0/3372386947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f31340cce60 con 0x7f31200039b0 2024-09-16T01:17:46.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.629+0000 7f312affd640 1 -- 172.21.15.81:0/3372386947 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+73 (secure 0 0 0) 0x7f3130079db0 con 0x7f31200039b0 2024-09-16T01:17:46.630 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:17:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.631+0000 7f313c64c640 1 -- 172.21.15.81:0/3372386947 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f311806c2b0 msgr2=0x7f311806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.631+0000 7f313c64c640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f311806c2b0 0x7f311806e770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f31340c84c0 tx=0x7f3124008040 comp rx=0 tx=0).stop 2024-09-16T01:17:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.631+0000 7f313c64c640 1 -- 172.21.15.81:0/3372386947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31200039b0 msgr2=0x7f3134150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.631+0000 7f313c64c640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31200039b0 0x7f3134150cb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3130009be0 tx=0x7f3130004730 comp rx=0 tx=0).stop 2024-09-16T01:17:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.631+0000 7f313c64c640 1 -- 172.21.15.81:0/3372386947 shutdown_connections 2024-09-16T01:17:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.631+0000 7f313c64c640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f311806c2b0 0x7f311806e770 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.631+0000 7f313c64c640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31341f3670 0x7f31341f3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.631+0000 7f313c64c640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f31340ce770 0x7f31340cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.631+0000 7f313c64c640 1 --2- 172.21.15.81:0/3372386947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31200039b0 0x7f3134150cb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.631+0000 7f313c64c640 1 -- 172.21.15.81:0/3372386947 >> 172.21.15.81:0/3372386947 conn(0x7f3134067d70 msgr2=0x7f3134145650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.631+0000 7f313c64c640 1 -- 172.21.15.81:0/3372386947 shutdown_connections 2024-09-16T01:17:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:46.631+0000 7f313c64c640 1 -- 172.21.15.81:0/3372386947 wait complete. 2024-09-16T01:17:46.643 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:17:46.643 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:17:46.643 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-16T01:17:46.643 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T01:17:46.643 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:17:46.643 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:17:46.643 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:17:46.643 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:17:46.643 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:17:46.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:46.644 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-16T01:17:46.663 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:17:46.663 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:17:46.663 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:17:46.663 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:46.663 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:17:46.663 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:46.663 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:17:46.663 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42673sec preferred_lft 42673sec 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:46.664 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:17:46.665 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:17:46.665 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:17:46.665 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:46.665 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::fc48:18ff:fedc:b80f/64 scope link 2024-09-16T01:17:46.665 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:46.665 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:17:46.665 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 2e:4a:65:c9:20:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:17:46.665 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::2c4a:65ff:fec9:204f/64 scope link 2024-09-16T01:17:46.665 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:46.665 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:17:46.665 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:17:46.665 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::1072:70ff:fefd:f9f1/64 scope link 2024-09-16T01:17:46.666 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:17:46.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:46.666 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:17:46.730 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:17:46.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:46.732 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-16T01:17:46.789 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-16T01:17:46.790 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:17:46.790 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:17:46.790 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:17:46.790 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:17:46.790 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:17:46.790 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:17:46.790 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:17:46.790 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:17:46.790 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:17:46.791 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:17:46.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:17:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:17:46.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:17:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:17:46.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:46.921 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:17:46.937 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T01:17:46.937 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:17:46.937 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:17:46.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:46.938 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-16T01:17:47.002 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:17:47.002 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T01:17:47.058 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:17:47.058 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:17:47.059 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:17:47.114 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:17:47.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:47.114 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:17:47.197 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:17:47.197 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:17:47.197 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:17:47.205 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:17:47.206 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:17:47.206 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:17:47.206 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:17:47.206 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:17:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:17:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:17:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:17:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:17:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:17:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:17:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:17:47.211 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:17:47.212 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T01:17:47.212 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:17:47.212 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:17:47.212 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:17:47.212 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:17:47.213 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:17:47.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:47.214 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:17:47.279 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:17:47.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:17:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:17:47.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:17:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:17:47.376 INFO:teuthology.orchestra.run.smithi102.stdout:client5517 2024-09-16T01:17:47.376 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:17:47.376 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:47.392 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:17:47.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:17:47.438 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:17:47.476 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:17:47.477 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:17:47.477 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:17:47.477 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:47.494 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:17:47.494 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:47.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:17:47.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.695+0000 7f148f913640 1 Processor -- start 2024-09-16T01:17:47.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.695+0000 7f148f913640 1 -- start start 2024-09-16T01:17:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148f913640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1488162060 0x7f14880b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148f913640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f14880b64b0 0x7f14880b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148f913640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f148806d9f0 con 0x7f1488161c80 2024-09-16T01:17:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148f913640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f148806dcd0 con 0x7f14880b64b0 2024-09-16T01:17:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148f913640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f148806dfb0 con 0x7f1488162060 2024-09-16T01:17:47.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148ceae640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1488162060 0x7f14880b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148deb0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f14880b64b0 0x7f14880b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148ceae640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1488162060 0x7f14880b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:52662/0 (socket says 172.21.15.81:52662) 2024-09-16T01:17:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148d6af640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1488161c80 0x7f148806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:50038/0 (socket says 172.21.15.81:50038) 2024-09-16T01:17:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148deb0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f14880b64b0 0x7f14880b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:39048/0 (socket says 172.21.15.81:39048) 2024-09-16T01:17:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148ceae640 1 -- 172.21.15.81:0/3193682991 learned_addr learned my addr 172.21.15.81:0/3193682991 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148deb0640 1 -- 172.21.15.81:0/3193682991 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1488162060 msgr2=0x7f14880b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148deb0640 1 --2- 172.21.15.81:0/3193682991 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1488162060 0x7f14880b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148deb0640 1 -- 172.21.15.81:0/3193682991 >> v1:172.21.15.102:6789/0 conn(0x7f1488161c80 legacy=0x7f148806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:47.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.696+0000 7f148deb0640 1 -- 172.21.15.81:0/3193682991 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14880d01f0 con 0x7f14880b64b0 2024-09-16T01:17:47.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.697+0000 7f148deb0640 1 --2- 172.21.15.81:0/3193682991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14880b64b0 0x7f14880b6960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1480009d90 tx=0x7f148002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c882b24fd70997a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.697+0000 7f147ffff640 1 -- 172.21.15.81:0/3193682991 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480007740 con 0x7f14880b64b0 2024-09-16T01:17:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.697+0000 7f147ffff640 1 -- 172.21.15.81:0/3193682991 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14800078e0 con 0x7f14880b64b0 2024-09-16T01:17:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.697+0000 7f147ffff640 1 -- 172.21.15.81:0/3193682991 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1480007cb0 con 0x7f14880b64b0 2024-09-16T01:17:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.698+0000 7f148f913640 1 -- 172.21.15.81:0/3193682991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14880b64b0 msgr2=0x7f14880b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.698+0000 7f148f913640 1 --2- 172.21.15.81:0/3193682991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14880b64b0 0x7f14880b6960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1480009d90 tx=0x7f148002a660 comp rx=0 tx=0).stop 2024-09-16T01:17:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.698+0000 7f148f913640 1 -- 172.21.15.81:0/3193682991 shutdown_connections 2024-09-16T01:17:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.698+0000 7f148f913640 1 --2- 172.21.15.81:0/3193682991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14880b64b0 0x7f14880b6960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.698+0000 7f148f913640 1 --2- 172.21.15.81:0/3193682991 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1488162060 0x7f14880b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.698+0000 7f148f913640 1 -- 172.21.15.81:0/3193682991 >> 172.21.15.81:0/3193682991 conn(0x7f14880d44f0 msgr2=0x7f14880d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.698+0000 7f148f913640 1 -- 172.21.15.81:0/3193682991 shutdown_connections 2024-09-16T01:17:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.698+0000 7f148f913640 1 -- 172.21.15.81:0/3193682991 wait complete. 2024-09-16T01:17:47.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.699+0000 7f148f913640 1 Processor -- start 2024-09-16T01:17:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.699+0000 7f148f913640 1 -- start start 2024-09-16T01:17:47.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148f913640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14880b64b0 0x7f14881f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148f913640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1488161c80 0x7f14880b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148f913640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1488162060 0x7f14880b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148f913640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14880cf1e0 con 0x7f1488161c80 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148f913640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14880d2aa0 con 0x7f1488162060 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148f913640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f14880cf360 con 0x7f14880b64b0 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148ceae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1488161c80 0x7f14880b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148d6af640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14880b64b0 0x7f14881f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148ceae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1488161c80 0x7f14880b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53854/0 (socket says 172.21.15.81:53854) 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148ceae640 1 -- 172.21.15.81:0/721744641 learned_addr learned my addr 172.21.15.81:0/721744641 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148deb0640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1488162060 0x7f14880b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148ceae640 1 -- 172.21.15.81:0/721744641 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14880b64b0 msgr2=0x7f14881f4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148ceae640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14880b64b0 0x7f14881f4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148ceae640 1 -- 172.21.15.81:0/721744641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1488162060 msgr2=0x7f14880b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148ceae640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1488162060 0x7f14880b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148ceae640 1 -- 172.21.15.81:0/721744641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14880b73e0 con 0x7f1488161c80 2024-09-16T01:17:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.700+0000 7f148d6af640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14880b64b0 0x7f14881f4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:17:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.701+0000 7f148ceae640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1488161c80 0x7f14880b21e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f147800e870 tx=0x7f147800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.701+0000 7f147dffb640 1 -- 172.21.15.81:0/721744641 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1478017070 con 0x7f1488161c80 2024-09-16T01:17:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.701+0000 7f147dffb640 1 -- 172.21.15.81:0/721744641 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147800ee60 con 0x7f1488161c80 2024-09-16T01:17:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.701+0000 7f148f913640 1 -- 172.21.15.81:0/721744641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14880b76c0 con 0x7f1488161c80 2024-09-16T01:17:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.701+0000 7f147dffb640 1 -- 172.21.15.81:0/721744641 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1478004260 con 0x7f1488161c80 2024-09-16T01:17:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.701+0000 7f148f913640 1 -- 172.21.15.81:0/721744641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14880b7c80 con 0x7f1488161c80 2024-09-16T01:17:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.702+0000 7f148f913640 1 -- 172.21.15.81:0/721744641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14880b5f70 con 0x7f1488161c80 2024-09-16T01:17:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.702+0000 7f147dffb640 1 -- 172.21.15.81:0/721744641 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f147800c940 con 0x7f1488161c80 2024-09-16T01:17:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.703+0000 7f147dffb640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f146c06c2b0 0x7f146c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.703+0000 7f147dffb640 1 -- 172.21.15.81:0/721744641 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f147808b620 con 0x7f1488161c80 2024-09-16T01:17:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.703+0000 7f148d6af640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f146c06c2b0 0x7f146c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:47.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.703+0000 7f148d6af640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f146c06c2b0 0x7f146c06e770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f148815fce0 tx=0x7f1484007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.707+0000 7f147dffb640 1 -- 172.21.15.81:0/721744641 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f14780595c0 con 0x7f1488161c80 2024-09-16T01:17:47.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.883+0000 7f148f913640 1 -- 172.21.15.81:0/721744641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f14880ba470 con 0x7f1488161c80 2024-09-16T01:17:47.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.884+0000 7f147dffb640 1 -- 172.21.15.81:0/721744641 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7f1478078020 con 0x7f1488161c80 2024-09-16T01:17:47.884 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:17:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.886+0000 7f148f913640 1 -- 172.21.15.81:0/721744641 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f146c06c2b0 msgr2=0x7f146c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.886+0000 7f148f913640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f146c06c2b0 0x7f146c06e770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f148815fce0 tx=0x7f1484007e80 comp rx=0 tx=0).stop 2024-09-16T01:17:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.886+0000 7f148f913640 1 -- 172.21.15.81:0/721744641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1488161c80 msgr2=0x7f14880b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.886+0000 7f148f913640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1488161c80 0x7f14880b21e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f147800e870 tx=0x7f147800ed30 comp rx=0 tx=0).stop 2024-09-16T01:17:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.886+0000 7f148f913640 1 -- 172.21.15.81:0/721744641 shutdown_connections 2024-09-16T01:17:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.886+0000 7f148f913640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f146c06c2b0 0x7f146c06e770 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.886+0000 7f148f913640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1488162060 0x7f14880b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.886+0000 7f148f913640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1488161c80 0x7f14880b21e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.886+0000 7f148f913640 1 --2- 172.21.15.81:0/721744641 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14880b64b0 0x7f14881f4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:47.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.886+0000 7f148f913640 1 -- 172.21.15.81:0/721744641 >> 172.21.15.81:0/721744641 conn(0x7f14880d44f0 msgr2=0x7f14880b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.886+0000 7f148f913640 1 -- 172.21.15.81:0/721744641 shutdown_connections 2024-09-16T01:17:47.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:47.886+0000 7f148f913640 1 -- 172.21.15.81:0/721744641 wait complete. 2024-09-16T01:17:47.898 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:17:47.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:47.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:17:47.926 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:17:47.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:47.927 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:17:47.982 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:17:47.982 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:17:47.982 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:47.999 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:17:48.000 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:48.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:17:48.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.155+0000 7fb910aa6640 1 Processor -- start 2024-09-16T01:17:48.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.155+0000 7fb910aa6640 1 -- start start 2024-09-16T01:17:48.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb910aa6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb90c15ba30 0x7fb90c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb910aa6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb90c0b3570 con 0x7fb90c06fd50 2024-09-16T01:17:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb910aa6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb90c0b3850 con 0x7fb90c073050 2024-09-16T01:17:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb910aa6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb90c0b4180 con 0x7fb90c15ba30 2024-09-16T01:17:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb903fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb90c06fd50 0x7fb90c072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60244/0 (socket says 172.21.15.81:60244) 2024-09-16T01:17:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb903fff640 1 -- 172.21.15.81:0/2884701520 learned_addr learned my addr 172.21.15.81:0/2884701520 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb90a59c640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb90c15ba30 0x7fb90c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 374346690 0 0) 0x7fb90c0b3570 con 0x7fb90c06fd50 2024-09-16T01:17:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8f8003520 con 0x7fb90c06fd50 2024-09-16T01:17:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3151857746 0 0) 0x7fb90c0b3850 con 0x7fb90c073050 2024-09-16T01:17:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb90c0b3570 con 0x7fb90c073050 2024-09-16T01:17:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2771726989 0 0) 0x7fb8f8003520 con 0x7fb90c06fd50 2024-09-16T01:17:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb90c15ba30 msgr2=0x7fb90c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb909d9b640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb90c15ba30 0x7fb90c06f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 >> v1:172.21.15.102:6789/0 conn(0x7fb90c073050 legacy=0x7fb90c0b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90c0b3b30 con 0x7fb90c06fd50 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fb8f4001670 con 0x7fb90c06fd50 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 >> v1:172.21.15.81:6789/0 conn(0x7fb90c06fd50 legacy=0x7fb90c072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.156+0000 7fb909d9b640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8f8003b70 0x7fb8f8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb909d9b640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f8004800 0x7fb8f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb909d9b640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f80051c0 0x7fb8f800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c0b4180 con 0x7fb8f8004800 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f800e1c0 con 0x7fb8f8003b70 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f800e3c0 con 0x7fb8f80051c0 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb90a59c640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb90c15ba30 0x7fb90c06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb903fff640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f8004800 0x7fb8f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb90ad9d640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f80051c0 0x7fb8f800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb90a59c640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8f8003b70 0x7fb8f8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb903fff640 1 -- 172.21.15.81:0/2884701520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f80051c0 msgr2=0x7fb8f800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb903fff640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f80051c0 0x7fb8f800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb903fff640 1 -- 172.21.15.81:0/2884701520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8f8003b70 msgr2=0x7fb8f8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb903fff640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8f8003b70 0x7fb8f8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.157+0000 7fb903fff640 1 -- 172.21.15.81:0/2884701520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f8003520 con 0x7fb8f8004800 2024-09-16T01:17:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.158+0000 7fb903fff640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f8004800 0x7fb8f8004c80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0ce2a0 tx=0x7fb8f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b110acf2b75bc4f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.158+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4007ce0 con 0x7fb8f8004800 2024-09-16T01:17:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.158+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f4005ad0 con 0x7fb8f8004800 2024-09-16T01:17:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.158+0000 7fb909d9b640 1 -- 172.21.15.81:0/2884701520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4007070 con 0x7fb8f8004800 2024-09-16T01:17:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.158+0000 7fb910aa6640 1 -- 172.21.15.81:0/2884701520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f8004800 msgr2=0x7fb8f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.158+0000 7fb910aa6640 1 --2- 172.21.15.81:0/2884701520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f8004800 0x7fb8f8004c80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0ce2a0 tx=0x7fb8f8005830 comp rx=0 tx=0).stop 2024-09-16T01:17:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.158+0000 7fb90ad9d640 1 -- 172.21.15.81:0/2884701520 reap_dead start 2024-09-16T01:17:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.158+0000 7fb910aa6640 1 -- 172.21.15.81:0/2884701520 shutdown_connections 2024-09-16T01:17:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.158+0000 7fb910aa6640 1 -- 172.21.15.81:0/2884701520 >> 172.21.15.81:0/2884701520 conn(0x7fb90c067d70 msgr2=0x7fb90c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.158+0000 7fb910aa6640 1 -- 172.21.15.81:0/2884701520 shutdown_connections 2024-09-16T01:17:48.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.158+0000 7fb910aa6640 1 -- 172.21.15.81:0/2884701520 wait complete. 2024-09-16T01:17:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.160+0000 7fb910aa6640 1 Processor -- start 2024-09-16T01:17:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.160+0000 7fb910aa6640 1 -- start start 2024-09-16T01:17:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb910aa6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f8004800 0x7fb90c1486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb910aa6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb90c0b1c40 0x7fb90c14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb910aa6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c14f700 0x7fb90c14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb910aa6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c0ccfe0 con 0x7fb90c14f700 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb910aa6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb90c0ce810 con 0x7fb90c0b1c40 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb910aa6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb90c0cd160 con 0x7fb8f8004800 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb90ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c14f700 0x7fb90c14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb90a59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f8004800 0x7fb90c1486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb90ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c14f700 0x7fb90c14fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53866/0 (socket says 172.21.15.81:53866) 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb90ad9d640 1 -- 172.21.15.81:0/3387820512 learned_addr learned my addr 172.21.15.81:0/3387820512 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb903fff640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb90c0b1c40 0x7fb90c14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb90ad9d640 1 -- 172.21.15.81:0/3387820512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f8004800 msgr2=0x7fb90c1486d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb90ad9d640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f8004800 0x7fb90c1486d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb90ad9d640 1 -- 172.21.15.81:0/3387820512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb90c0b1c40 msgr2=0x7fb90c14f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb90ad9d640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb90c0b1c40 0x7fb90c14f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb90ad9d640 1 -- 172.21.15.81:0/3387820512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90c149190 con 0x7fb90c14f700 2024-09-16T01:17:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb90ad9d640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c14f700 0x7fb90c14fb80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0afaf0 tx=0x7fb90400ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb902ffd640 1 -- 172.21.15.81:0/3387820512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904019070 con 0x7fb90c14f700 2024-09-16T01:17:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb902ffd640 1 -- 172.21.15.81:0/3387820512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb904006e20 con 0x7fb90c14f700 2024-09-16T01:17:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb902ffd640 1 -- 172.21.15.81:0/3387820512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904003bb0 con 0x7fb90c14f700 2024-09-16T01:17:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb910aa6640 1 -- 172.21.15.81:0/3387820512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb90c150160 con 0x7fb90c14f700 2024-09-16T01:17:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.161+0000 7fb910aa6640 1 -- 172.21.15.81:0/3387820512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb90c0ae350 con 0x7fb90c14f700 2024-09-16T01:17:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.162+0000 7fb910aa6640 1 -- 172.21.15.81:0/3387820512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb90c06f810 con 0x7fb90c14f700 2024-09-16T01:17:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.163+0000 7fb902ffd640 1 -- 172.21.15.81:0/3387820512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb90400d740 con 0x7fb90c14f700 2024-09-16T01:17:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.163+0000 7fb902ffd640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8ec06c2e0 0x7fb8ec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.163+0000 7fb902ffd640 1 -- 172.21.15.81:0/3387820512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fb90408a9e0 con 0x7fb90c14f700 2024-09-16T01:17:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.163+0000 7fb90a59c640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8ec06c2e0 0x7fb8ec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.164+0000 7fb90a59c640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8ec06c2e0 0x7fb8ec06e7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb90c06ca90 tx=0x7fb8fc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:48.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.167+0000 7fb902ffd640 1 -- 172.21.15.81:0/3387820512 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb90c149190 con 0x7fb90c14f700 2024-09-16T01:17:48.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.345+0000 7fb910aa6640 1 -- 172.21.15.81:0/3387820512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb90c0b49f0 con 0x7fb90c14f700 2024-09-16T01:17:48.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.345+0000 7fb902ffd640 1 -- 172.21.15.81:0/3387820512 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v51) ==== 80+0+0 (secure 0 0 0) 0x7fb9040588f0 con 0x7fb90c14f700 2024-09-16T01:17:48.346 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:17:48.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.347+0000 7fb910aa6640 1 -- 172.21.15.81:0/3387820512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8ec06c2e0 msgr2=0x7fb8ec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.347+0000 7fb910aa6640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8ec06c2e0 0x7fb8ec06e7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb90c06ca90 tx=0x7fb8fc009190 comp rx=0 tx=0).stop 2024-09-16T01:17:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.347+0000 7fb910aa6640 1 -- 172.21.15.81:0/3387820512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c14f700 msgr2=0x7fb90c14fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.347+0000 7fb910aa6640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c14f700 0x7fb90c14fb80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0afaf0 tx=0x7fb90400ff70 comp rx=0 tx=0).stop 2024-09-16T01:17:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.348+0000 7fb910aa6640 1 -- 172.21.15.81:0/3387820512 shutdown_connections 2024-09-16T01:17:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.348+0000 7fb910aa6640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8ec06c2e0 0x7fb8ec06e7a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.348+0000 7fb910aa6640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c14f700 0x7fb90c14fb80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.348+0000 7fb910aa6640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb90c0b1c40 0x7fb90c14f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.348+0000 7fb910aa6640 1 --2- 172.21.15.81:0/3387820512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8f8004800 0x7fb90c1486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.348+0000 7fb910aa6640 1 -- 172.21.15.81:0/3387820512 >> 172.21.15.81:0/3387820512 conn(0x7fb90c067d70 msgr2=0x7fb90c0b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.348+0000 7fb910aa6640 1 -- 172.21.15.81:0/3387820512 shutdown_connections 2024-09-16T01:17:48.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.348+0000 7fb910aa6640 1 -- 172.21.15.81:0/3387820512 wait complete. 2024-09-16T01:17:48.360 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:17:48.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:48.360 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T01:17:48.388 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:17:48.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:17:48.389 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:17:48.445 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:17:48.445 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:17:48.445 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:48.462 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:17:48.462 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:17:48.463 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:17:48.463 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:48.502 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:17:48.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:48.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.599+0000 7fd0e681e640 1 Processor -- start 2024-09-16T01:17:48.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.599+0000 7fd0e681e640 1 -- start start 2024-09-16T01:17:48.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.600+0000 7fd0e681e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd0e015fc30 0x7fd0e0071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.600+0000 7fd0e681e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd0e009b140 0x7fd0e00704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.600+0000 7fd0e681e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e009ba30 con 0x7fd0e00b17d0 2024-09-16T01:17:48.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.600+0000 7fd0e681e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e00b1590 con 0x7fd0e009b140 2024-09-16T01:17:48.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.600+0000 7fd0e681e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd0e0160ab0 con 0x7fd0e015fc30 2024-09-16T01:17:48.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.600+0000 7fd0e4dbb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd0e009b140 0x7fd0e00704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.600+0000 7fd0e4dbb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd0e009b140 0x7fd0e00704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53868/0 (socket says 172.21.15.81:53868) 2024-09-16T01:17:48.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.600+0000 7fd0e4dbb640 1 -- 172.21.15.81:0/2821870991 learned_addr learned my addr 172.21.15.81:0/2821870991 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:48.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.601+0000 7fd0dffff640 1 --2- 172.21.15.81:0/2821870991 >> v2:172.21.15.102:3300/0 conn(0x7fd0e015fc30 0x7fd0e0071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.601+0000 7fd0e4dbb640 1 -- 172.21.15.81:0/2821870991 >> v2:172.21.15.102:3300/0 conn(0x7fd0e015fc30 msgr2=0x7fd0e0071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:48.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.601+0000 7fd0e4dbb640 1 --2- 172.21.15.81:0/2821870991 >> v2:172.21.15.102:3300/0 conn(0x7fd0e015fc30 0x7fd0e0071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.601+0000 7fd0e4dbb640 1 -- 172.21.15.81:0/2821870991 >> v1:172.21.15.102:6789/0 conn(0x7fd0e00b17d0 legacy=0x7fd0e009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:48.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.601+0000 7fd0e4dbb640 1 -- 172.21.15.81:0/2821870991 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e009bcf0 con 0x7fd0e009b140 2024-09-16T01:17:48.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.601+0000 7fd0e4dbb640 1 --2- 172.21.15.81:0/2821870991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0e009b140 0x7fd0e00704f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00743f0 tx=0x7fd0d802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b5bb717b74a0cc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:48.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.602+0000 7fd0deffd640 1 -- 172.21.15.81:0/2821870991 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8036070 con 0x7fd0e009b140 2024-09-16T01:17:48.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.602+0000 7fd0deffd640 1 -- 172.21.15.81:0/2821870991 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d8031600 con 0x7fd0e009b140 2024-09-16T01:17:48.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.602+0000 7fd0deffd640 1 -- 172.21.15.81:0/2821870991 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80319d0 con 0x7fd0e009b140 2024-09-16T01:17:48.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.602+0000 7fd0e681e640 1 -- 172.21.15.81:0/2821870991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0e009b140 msgr2=0x7fd0e00704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.602+0000 7fd0e681e640 1 --2- 172.21.15.81:0/2821870991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0e009b140 0x7fd0e00704f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00743f0 tx=0x7fd0d802a660 comp rx=0 tx=0).stop 2024-09-16T01:17:48.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.602+0000 7fd0e681e640 1 -- 172.21.15.81:0/2821870991 shutdown_connections 2024-09-16T01:17:48.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.602+0000 7fd0e681e640 1 --2- 172.21.15.81:0/2821870991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0e009b140 0x7fd0e00704f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.602+0000 7fd0e681e640 1 --2- 172.21.15.81:0/2821870991 >> v2:172.21.15.102:3300/0 conn(0x7fd0e015fc30 0x7fd0e0071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.602+0000 7fd0e681e640 1 -- 172.21.15.81:0/2821870991 >> 172.21.15.81:0/2821870991 conn(0x7fd0e00d23a0 msgr2=0x7fd0e00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:48.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.602+0000 7fd0e681e640 1 -- 172.21.15.81:0/2821870991 shutdown_connections 2024-09-16T01:17:48.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.602+0000 7fd0e681e640 1 -- 172.21.15.81:0/2821870991 wait complete. 2024-09-16T01:17:48.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.603+0000 7fd0e681e640 1 Processor -- start 2024-09-16T01:17:48.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.603+0000 7fd0e681e640 1 -- start start 2024-09-16T01:17:48.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.604+0000 7fd0e681e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0e009b140 0x7fd0e00c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.604+0000 7fd0e681e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0e00b17d0 0x7fd0e00d1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.604+0000 7fd0e681e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0e015fc30 0x7fd0e01e8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.604+0000 7fd0e681e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e00b1bd0 con 0x7fd0e015fc30 2024-09-16T01:17:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.604+0000 7fd0e681e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e0160fe0 con 0x7fd0e00b17d0 2024-09-16T01:17:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.604+0000 7fd0e681e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd0e0070a30 con 0x7fd0e009b140 2024-09-16T01:17:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.604+0000 7fd0e4dbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0e015fc30 0x7fd0e01e8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.604+0000 7fd0e4dbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0e015fc30 0x7fd0e01e8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53880/0 (socket says 172.21.15.81:53880) 2024-09-16T01:17:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.604+0000 7fd0e4dbb640 1 -- 172.21.15.81:0/2845311520 learned_addr learned my addr 172.21.15.81:0/2845311520 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.604+0000 7fd0dffff640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0e009b140 0x7fd0e00c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.604+0000 7fd0df7fe640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0e00b17d0 0x7fd0e00d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0e4dbb640 1 -- 172.21.15.81:0/2845311520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0e009b140 msgr2=0x7fd0e00c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0e4dbb640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0e009b140 0x7fd0e00c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0e4dbb640 1 -- 172.21.15.81:0/2845311520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0e00b17d0 msgr2=0x7fd0e00d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0e4dbb640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0e00b17d0 0x7fd0e00d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0e4dbb640 1 -- 172.21.15.81:0/2845311520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e00c6120 con 0x7fd0e015fc30 2024-09-16T01:17:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0dffff640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0e009b140 0x7fd0e00c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0df7fe640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0e00b17d0 0x7fd0e00d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0e4dbb640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0e015fc30 0x7fd0e01e8260 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd0d802ac50 tx=0x7fd0d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0dcff9640 1 -- 172.21.15.81:0/2845311520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8036050 con 0x7fd0e015fc30 2024-09-16T01:17:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0dcff9640 1 -- 172.21.15.81:0/2845311520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d8042070 con 0x7fd0e015fc30 2024-09-16T01:17:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0dcff9640 1 -- 172.21.15.81:0/2845311520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8009510 con 0x7fd0e015fc30 2024-09-16T01:17:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0e681e640 1 -- 172.21.15.81:0/2845311520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e00c6400 con 0x7fd0e015fc30 2024-09-16T01:17:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.605+0000 7fd0e681e640 1 -- 172.21.15.81:0/2845311520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e00c69c0 con 0x7fd0e015fc30 2024-09-16T01:17:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.606+0000 7fd0e681e640 1 -- 172.21.15.81:0/2845311520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e00b5ce0 con 0x7fd0e015fc30 2024-09-16T01:17:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.607+0000 7fd0dcff9640 1 -- 172.21.15.81:0/2845311520 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd0d8007bd0 con 0x7fd0e015fc30 2024-09-16T01:17:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.607+0000 7fd0dcff9640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd0cc06c2b0 0x7fd0cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.607+0000 7fd0dcff9640 1 -- 172.21.15.81:0/2845311520 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fd0d80ac3a0 con 0x7fd0e015fc30 2024-09-16T01:17:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.607+0000 7fd0dffff640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd0cc06c2b0 0x7fd0cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.608+0000 7fd0dffff640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd0cc06c2b0 0x7fd0cc06e770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0006fd0 tx=0x7fd0d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.611+0000 7fd0dcff9640 1 -- 172.21.15.81:0/2845311520 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0e00b5ce0 con 0x7fd0e015fc30 2024-09-16T01:17:48.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.811+0000 7fd0e681e640 1 -- 172.21.15.81:0/2845311520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0e00704f0 con 0x7fd0e015fc30 2024-09-16T01:17:48.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.811+0000 7fd0dcff9640 1 -- 172.21.15.81:0/2845311520 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7fd0d803a360 con 0x7fd0e015fc30 2024-09-16T01:17:48.822 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:48.822 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"btime":"2024-09-16T01:17:38:311750+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3508058089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3508058089},{"type":"v1","addr":"172.21.15.102:6835","nonce":3508058089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5349,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/763632631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":763632631},{"type":"v1","addr":"172.21.15.81:6835","nonce":763632631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3139124613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3139124613},{"type":"v1","addr":"172.21.15.81:6837","nonce":3139124613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:17:35.639749+0000","modified":"2024-09-16T01:17:37.638233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/52529574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":52529574},{"type":"v1","addr":"172.21.15.102:6834","nonce":52529574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5361,"qdb_cluster":[5361]},"id":3}]} 2024-09-16T01:17:48.823 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-16T01:17:48.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.813+0000 7fd0e681e640 1 -- 172.21.15.81:0/2845311520 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd0cc06c2b0 msgr2=0x7fd0cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.813+0000 7fd0e681e640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd0cc06c2b0 0x7fd0cc06e770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0006fd0 tx=0x7fd0d0008040 comp rx=0 tx=0).stop 2024-09-16T01:17:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.813+0000 7fd0e681e640 1 -- 172.21.15.81:0/2845311520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0e015fc30 msgr2=0x7fd0e01e8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.813+0000 7fd0e681e640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0e015fc30 0x7fd0e01e8260 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd0d802ac50 tx=0x7fd0d8004a40 comp rx=0 tx=0).stop 2024-09-16T01:17:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.813+0000 7fd0e681e640 1 -- 172.21.15.81:0/2845311520 shutdown_connections 2024-09-16T01:17:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.813+0000 7fd0e681e640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd0cc06c2b0 0x7fd0cc06e770 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.813+0000 7fd0e681e640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0e015fc30 0x7fd0e01e8260 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.813+0000 7fd0e681e640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0e00b17d0 0x7fd0e00d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.813+0000 7fd0e681e640 1 --2- 172.21.15.81:0/2845311520 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd0e009b140 0x7fd0e00c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.813+0000 7fd0e681e640 1 -- 172.21.15.81:0/2845311520 >> 172.21.15.81:0/2845311520 conn(0x7fd0e00d23a0 msgr2=0x7fd0e00b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.813+0000 7fd0e681e640 1 -- 172.21.15.81:0/2845311520 shutdown_connections 2024-09-16T01:17:48.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.813+0000 7fd0e681e640 1 -- 172.21.15.81:0/2845311520 wait complete. 2024-09-16T01:17:48.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.922+0000 7fd156b11640 1 Processor -- start 2024-09-16T01:17:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.923+0000 7fd156b11640 1 -- start start 2024-09-16T01:17:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.923+0000 7fd156b11640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd150145bc0 0x7fd15015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.923+0000 7fd156b11640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd15006c320 0x7fd1500af950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.923+0000 7fd156b11640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1500b3570 con 0x7fd1500ae140 2024-09-16T01:17:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.923+0000 7fd156b11640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd1500b3850 con 0x7fd15006c320 2024-09-16T01:17:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.923+0000 7fd156b11640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd1500b3b30 con 0x7fd150145bc0 2024-09-16T01:17:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.923+0000 7fd1550ae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd15006c320 0x7fd1500af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.924+0000 7fd1550ae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd15006c320 0x7fd1500af950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53882/0 (socket says 172.21.15.81:53882) 2024-09-16T01:17:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.924+0000 7fd1550ae640 1 -- 172.21.15.81:0/2064460850 learned_addr learned my addr 172.21.15.81:0/2064460850 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.924+0000 7fd1548ad640 1 --2- 172.21.15.81:0/2064460850 >> v2:172.21.15.102:3300/0 conn(0x7fd150145bc0 0x7fd15015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.924+0000 7fd1550ae640 1 -- 172.21.15.81:0/2064460850 >> v2:172.21.15.102:3300/0 conn(0x7fd150145bc0 msgr2=0x7fd15015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.924+0000 7fd1550ae640 1 --2- 172.21.15.81:0/2064460850 >> v2:172.21.15.102:3300/0 conn(0x7fd150145bc0 0x7fd15015ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.924+0000 7fd1550ae640 1 -- 172.21.15.81:0/2064460850 >> v1:172.21.15.102:6789/0 conn(0x7fd1500ae140 legacy=0x7fd15006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.924+0000 7fd1550ae640 1 -- 172.21.15.81:0/2064460850 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1500b1610 con 0x7fd15006c320 2024-09-16T01:17:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.924+0000 7fd1550ae640 1 --2- 172.21.15.81:0/2064460850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15006c320 0x7fd1500af950 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd148009e50 tx=0x7fd14802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94b8c8058bf7bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.925+0000 7fd1477fe640 1 -- 172.21.15.81:0/2064460850 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd148036070 con 0x7fd15006c320 2024-09-16T01:17:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.925+0000 7fd1477fe640 1 -- 172.21.15.81:0/2064460850 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd148031600 con 0x7fd15006c320 2024-09-16T01:17:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.925+0000 7fd1477fe640 1 -- 172.21.15.81:0/2064460850 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1480319d0 con 0x7fd15006c320 2024-09-16T01:17:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.925+0000 7fd156b11640 1 -- 172.21.15.81:0/2064460850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15006c320 msgr2=0x7fd1500af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.925+0000 7fd156b11640 1 --2- 172.21.15.81:0/2064460850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15006c320 0x7fd1500af950 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd148009e50 tx=0x7fd14802a7a0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.925+0000 7fd156b11640 1 -- 172.21.15.81:0/2064460850 shutdown_connections 2024-09-16T01:17:48.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.925+0000 7fd156b11640 1 --2- 172.21.15.81:0/2064460850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15006c320 0x7fd1500af950 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.925+0000 7fd156b11640 1 --2- 172.21.15.81:0/2064460850 >> v2:172.21.15.102:3300/0 conn(0x7fd150145bc0 0x7fd15015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.925+0000 7fd156b11640 1 -- 172.21.15.81:0/2064460850 >> 172.21.15.81:0/2064460850 conn(0x7fd150073490 msgr2=0x7fd1500b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.925+0000 7fd156b11640 1 -- 172.21.15.81:0/2064460850 shutdown_connections 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.925+0000 7fd156b11640 1 -- 172.21.15.81:0/2064460850 wait complete. 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.926+0000 7fd156b11640 1 Processor -- start 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.927+0000 7fd156b11640 1 -- start start 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.927+0000 7fd156b11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15006c320 0x7fd15009e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.927+0000 7fd156b11640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1500ae140 0x7fd15015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.927+0000 7fd156b11640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd150145bc0 0x7fd15009bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.927+0000 7fd156b11640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd150145fa0 con 0x7fd15006c320 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.927+0000 7fd156b11640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd15009aa30 con 0x7fd1500ae140 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.927+0000 7fd156b11640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd15015bfa0 con 0x7fd150145bc0 2024-09-16T01:17:48.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.927+0000 7fd1548ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15006c320 0x7fd15009e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.927+0000 7fd1548ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15006c320 0x7fd15009e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53894/0 (socket says 172.21.15.81:53894) 2024-09-16T01:17:48.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd1548ad640 1 -- 172.21.15.81:0/3079588001 learned_addr learned my addr 172.21.15.81:0/3079588001 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:48.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd1550ae640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd150145bc0 0x7fd15009bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd147fff640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1500ae140 0x7fd15015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd1548ad640 1 -- 172.21.15.81:0/3079588001 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd150145bc0 msgr2=0x7fd15009bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd1548ad640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd150145bc0 0x7fd15009bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd1548ad640 1 -- 172.21.15.81:0/3079588001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1500ae140 msgr2=0x7fd15015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:48.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd1548ad640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1500ae140 0x7fd15015ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:48.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd1548ad640 1 -- 172.21.15.81:0/3079588001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15009c4b0 con 0x7fd15006c320 2024-09-16T01:17:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd1548ad640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15006c320 0x7fd15009e100 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00c820 tx=0x7fd14c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd1457fa640 1 -- 172.21.15.81:0/3079588001 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c015070 con 0x7fd15006c320 2024-09-16T01:17:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd1457fa640 1 -- 172.21.15.81:0/3079588001 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c004020 con 0x7fd15006c320 2024-09-16T01:17:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd1457fa640 1 -- 172.21.15.81:0/3079588001 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0043f0 con 0x7fd15006c320 2024-09-16T01:17:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd156b11640 1 -- 172.21.15.81:0/3079588001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15009c790 con 0x7fd15006c320 2024-09-16T01:17:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.928+0000 7fd156b11640 1 -- 172.21.15.81:0/3079588001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd15009cd50 con 0x7fd15006c320 2024-09-16T01:17:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.929+0000 7fd156b11640 1 -- 172.21.15.81:0/3079588001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd15015ca70 con 0x7fd15006c320 2024-09-16T01:17:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.930+0000 7fd1457fa640 1 -- 172.21.15.81:0/3079588001 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd14c007830 con 0x7fd15006c320 2024-09-16T01:17:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.930+0000 7fd1457fa640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd13c06c2b0 0x7fd13c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.930+0000 7fd1457fa640 1 -- 172.21.15.81:0/3079588001 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fd14c08b3f0 con 0x7fd15006c320 2024-09-16T01:17:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.930+0000 7fd147fff640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd13c06c2b0 0x7fd13c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:48.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.930+0000 7fd147fff640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd13c06c2b0 0x7fd13c06e770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd1500d1580 tx=0x7fd140009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:48.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:48.934+0000 7fd1457fa640 1 -- 172.21.15.81:0/3079588001 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd14c0599d0 con 0x7fd15006c320 2024-09-16T01:17:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.135+0000 7fd156b11640 1 -- 172.21.15.81:0/3079588001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd15015f350 con 0x7fd15006c320 2024-09-16T01:17:49.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.136+0000 7fd1457fa640 1 -- 172.21.15.81:0/3079588001 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7fd14c0592d0 con 0x7fd15006c320 2024-09-16T01:17:49.137 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:49.137 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"btime":"2024-09-16T01:17:38:311750+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3508058089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3508058089},{"type":"v1","addr":"172.21.15.102:6835","nonce":3508058089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5349,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/763632631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":763632631},{"type":"v1","addr":"172.21.15.81:6835","nonce":763632631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3139124613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3139124613},{"type":"v1","addr":"172.21.15.81:6837","nonce":3139124613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:17:35.639749+0000","modified":"2024-09-16T01:17:37.638233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/52529574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":52529574},{"type":"v1","addr":"172.21.15.102:6834","nonce":52529574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5361,"qdb_cluster":[5361]},"id":3}]} 2024-09-16T01:17:49.137 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-16T01:17:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.138+0000 7fd156b11640 1 -- 172.21.15.81:0/3079588001 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd13c06c2b0 msgr2=0x7fd13c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.138+0000 7fd156b11640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd13c06c2b0 0x7fd13c06e770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd1500d1580 tx=0x7fd140009040 comp rx=0 tx=0).stop 2024-09-16T01:17:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.138+0000 7fd156b11640 1 -- 172.21.15.81:0/3079588001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15006c320 msgr2=0x7fd15009e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.138+0000 7fd156b11640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15006c320 0x7fd15009e100 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00c820 tx=0x7fd14c00cce0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.138+0000 7fd156b11640 1 -- 172.21.15.81:0/3079588001 shutdown_connections 2024-09-16T01:17:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.138+0000 7fd156b11640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd13c06c2b0 0x7fd13c06e770 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.138+0000 7fd156b11640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd150145bc0 0x7fd15009bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.138+0000 7fd156b11640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1500ae140 0x7fd15015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.138+0000 7fd156b11640 1 --2- 172.21.15.81:0/3079588001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15006c320 0x7fd15009e100 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.138+0000 7fd156b11640 1 -- 172.21.15.81:0/3079588001 >> 172.21.15.81:0/3079588001 conn(0x7fd150073490 msgr2=0x7fd1500b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.138+0000 7fd156b11640 1 -- 172.21.15.81:0/3079588001 shutdown_connections 2024-09-16T01:17:49.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.138+0000 7fd156b11640 1 -- 172.21.15.81:0/3079588001 wait complete. 2024-09-16T01:17:49.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:17:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.247+0000 7fdd5441e640 1 Processor -- start 2024-09-16T01:17:49.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.247+0000 7fdd5441e640 1 -- start start 2024-09-16T01:17:49.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.248+0000 7fdd5441e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd4c0afd70 0x7fdd4c160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.248+0000 7fdd5441e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4c160d60 con 0x7fdd4c0ce660 2024-09-16T01:17:49.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.248+0000 7fdd5441e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4c06f5f0 con 0x7fdd4c0b5f80 2024-09-16T01:17:49.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.248+0000 7fdd5441e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4c06fdb0 con 0x7fdd4c0afd70 2024-09-16T01:17:49.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.249+0000 7fdd521ba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd4c0afd70 0x7fdd4c160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.249+0000 7fdd529bb640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdd4c0ce660 0x7fdd4c06eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60248/0 (socket says 172.21.15.81:60248) 2024-09-16T01:17:49.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.249+0000 7fdd529bb640 1 -- 172.21.15.81:0/3719371906 learned_addr learned my addr 172.21.15.81:0/3719371906 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:49.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.249+0000 7fdd521ba640 1 -- 172.21.15.81:0/3719371906 >> v1:172.21.15.102:6789/0 conn(0x7fdd4c0b5f80 legacy=0x7fdd4c06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.249+0000 7fdd521ba640 1 -- 172.21.15.81:0/3719371906 >> v1:172.21.15.81:6789/0 conn(0x7fdd4c0ce660 legacy=0x7fdd4c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.249+0000 7fdd521ba640 1 -- 172.21.15.81:0/3719371906 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c070090 con 0x7fdd4c0afd70 2024-09-16T01:17:49.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.249+0000 7fdd511b8640 1 -- 172.21.15.81:0/3719371906 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 563656663 0 0) 0x7fdd3c001490 con 0x7fdd4c0ce660 2024-09-16T01:17:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.250+0000 7fdd521ba640 1 --2- 172.21.15.81:0/3719371906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c0afd70 0x7fdd4c160820 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdd440097a0 tx=0x7fdd4402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0d1b9de4ed3cbe server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.250+0000 7fdd511b8640 1 -- 172.21.15.81:0/3719371906 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44037070 con 0x7fdd4c0afd70 2024-09-16T01:17:49.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.250+0000 7fdd511b8640 1 -- 172.21.15.81:0/3719371906 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd44032440 con 0x7fdd4c0afd70 2024-09-16T01:17:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.250+0000 7fdd511b8640 1 -- 172.21.15.81:0/3719371906 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44032810 con 0x7fdd4c0afd70 2024-09-16T01:17:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.250+0000 7fdd5441e640 1 -- 172.21.15.81:0/3719371906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c0afd70 msgr2=0x7fdd4c160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.250+0000 7fdd5441e640 1 --2- 172.21.15.81:0/3719371906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c0afd70 0x7fdd4c160820 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdd440097a0 tx=0x7fdd4402a230 comp rx=0 tx=0).stop 2024-09-16T01:17:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.250+0000 7fdd5441e640 1 -- 172.21.15.81:0/3719371906 shutdown_connections 2024-09-16T01:17:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.250+0000 7fdd5441e640 1 --2- 172.21.15.81:0/3719371906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c0afd70 0x7fdd4c160820 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.250+0000 7fdd5441e640 1 -- 172.21.15.81:0/3719371906 >> 172.21.15.81:0/3719371906 conn(0x7fdd4c06bc10 msgr2=0x7fdd4c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.250+0000 7fdd5441e640 1 -- 172.21.15.81:0/3719371906 shutdown_connections 2024-09-16T01:17:49.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.250+0000 7fdd5441e640 1 -- 172.21.15.81:0/3719371906 wait complete. 2024-09-16T01:17:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd5441e640 1 Processor -- start 2024-09-16T01:17:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd5441e640 1 -- start start 2024-09-16T01:17:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd5441e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c0afd70 0x7fdd4c15c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd5441e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd4c0b5f80 0x7fdd4c0ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd5441e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd4c0ce660 0x7fdd4c0ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd5441e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c06fa80 con 0x7fdd4c0afd70 2024-09-16T01:17:49.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd5441e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c070650 con 0x7fdd4c0b5f80 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd5441e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c0b0150 con 0x7fdd4c0ce660 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd521ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c0afd70 0x7fdd4c15c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd521ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c0afd70 0x7fdd4c15c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53916/0 (socket says 172.21.15.81:53916) 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd521ba640 1 -- 172.21.15.81:0/1276558930 learned_addr learned my addr 172.21.15.81:0/1276558930 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd519b9640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd4c0b5f80 0x7fdd4c0ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.252+0000 7fdd529bb640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd4c0ce660 0x7fdd4c0ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.253+0000 7fdd521ba640 1 -- 172.21.15.81:0/1276558930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd4c0ce660 msgr2=0x7fdd4c0ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.253+0000 7fdd521ba640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd4c0ce660 0x7fdd4c0ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.253+0000 7fdd521ba640 1 -- 172.21.15.81:0/1276558930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd4c0b5f80 msgr2=0x7fdd4c0ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.253+0000 7fdd521ba640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd4c0b5f80 0x7fdd4c0ae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.253+0000 7fdd521ba640 1 -- 172.21.15.81:0/1276558930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c14fcd0 con 0x7fdd4c0afd70 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.253+0000 7fdd519b9640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd4c0b5f80 0x7fdd4c0ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:49.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.253+0000 7fdd521ba640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c0afd70 0x7fdd4c15c2d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdd44000c00 tx=0x7fdd440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.253+0000 7fdd4affd640 1 -- 172.21.15.81:0/1276558930 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44037040 con 0x7fdd4c0afd70 2024-09-16T01:17:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.253+0000 7fdd4affd640 1 -- 172.21.15.81:0/1276558930 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd44042070 con 0x7fdd4c0afd70 2024-09-16T01:17:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.253+0000 7fdd5441e640 1 -- 172.21.15.81:0/1276558930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4c0aa500 con 0x7fdd4c0afd70 2024-09-16T01:17:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.253+0000 7fdd4affd640 1 -- 172.21.15.81:0/1276558930 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44030a70 con 0x7fdd4c0afd70 2024-09-16T01:17:49.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.253+0000 7fdd5441e640 1 -- 172.21.15.81:0/1276558930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4c0aaac0 con 0x7fdd4c0afd70 2024-09-16T01:17:49.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.254+0000 7fdd5441e640 1 -- 172.21.15.81:0/1276558930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4c0ab1f0 con 0x7fdd4c0afd70 2024-09-16T01:17:49.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.254+0000 7fdd4affd640 1 -- 172.21.15.81:0/1276558930 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdd44030c10 con 0x7fdd4c0afd70 2024-09-16T01:17:49.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.255+0000 7fdd4affd640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd3806c2b0 0x7fdd3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.255+0000 7fdd4affd640 1 -- 172.21.15.81:0/1276558930 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fdd440ac090 con 0x7fdd4c0afd70 2024-09-16T01:17:49.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.255+0000 7fdd519b9640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd3806c2b0 0x7fdd3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.255+0000 7fdd519b9640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd3806c2b0 0x7fdd3806e770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdd40007fd0 tx=0x7fdd40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:49.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.259+0000 7fdd4affd640 1 -- 172.21.15.81:0/1276558930 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd4c0ab1f0 con 0x7fdd4c0afd70 2024-09-16T01:17:49.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.428+0000 7fdd5441e640 1 -- 172.21.15.81:0/1276558930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd4c067fc0 con 0x7fdd4c0afd70 2024-09-16T01:17:49.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.429+0000 7fdd4affd640 1 -- 172.21.15.81:0/1276558930 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17002 (secure 0 0 0) 0x7fdd4c14fcd0 con 0x7fdd4c0afd70 2024-09-16T01:17:49.430 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:49.430 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":51,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:17:37.305680+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:17:34.249166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-16T01:17:34.605034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:17:49.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.431+0000 7fdd5441e640 1 -- 172.21.15.81:0/1276558930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd3806c2b0 msgr2=0x7fdd3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.431+0000 7fdd5441e640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd3806c2b0 0x7fdd3806e770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdd40007fd0 tx=0x7fdd40009040 comp rx=0 tx=0).stop 2024-09-16T01:17:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.431+0000 7fdd5441e640 1 -- 172.21.15.81:0/1276558930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c0afd70 msgr2=0x7fdd4c15c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.431+0000 7fdd5441e640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c0afd70 0x7fdd4c15c2d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdd44000c00 tx=0x7fdd440046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.431+0000 7fdd5441e640 1 -- 172.21.15.81:0/1276558930 shutdown_connections 2024-09-16T01:17:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.431+0000 7fdd5441e640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd3806c2b0 0x7fdd3806e770 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.431+0000 7fdd5441e640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd4c0ce660 0x7fdd4c0ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.431+0000 7fdd5441e640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd4c0b5f80 0x7fdd4c0ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.431+0000 7fdd5441e640 1 --2- 172.21.15.81:0/1276558930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd4c0afd70 0x7fdd4c15c2d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.431+0000 7fdd5441e640 1 -- 172.21.15.81:0/1276558930 >> 172.21.15.81:0/1276558930 conn(0x7fdd4c06bc10 msgr2=0x7fdd4c15d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.431+0000 7fdd5441e640 1 -- 172.21.15.81:0/1276558930 shutdown_connections 2024-09-16T01:17:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.431+0000 7fdd5441e640 1 -- 172.21.15.81:0/1276558930 wait complete. 2024-09-16T01:17:49.443 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:17:49.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:49.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.540+0000 7f9e90766640 1 Processor -- start 2024-09-16T01:17:49.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.540+0000 7f9e90766640 1 -- start start 2024-09-16T01:17:49.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.541+0000 7f9e90766640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9e880d30f0 0x7f9e880b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.541+0000 7f9e90766640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e880d3690 con 0x7f9e880b64c0 2024-09-16T01:17:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.541+0000 7f9e90766640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e880d3970 con 0x7f9e8815e5f0 2024-09-16T01:17:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.541+0000 7f9e90766640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9e8806d530 con 0x7f9e880d30f0 2024-09-16T01:17:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.541+0000 7f9e8ed03640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9e880b64c0 0x7f9e8806d9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60258/0 (socket says 172.21.15.81:60258) 2024-09-16T01:17:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.541+0000 7f9e8ed03640 1 -- 172.21.15.81:0/957117436 learned_addr learned my addr 172.21.15.81:0/957117436 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.541+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155619897 0 0) 0x7f9e880d3690 con 0x7f9e880b64c0 2024-09-16T01:17:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.541+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e74003520 con 0x7f9e880b64c0 2024-09-16T01:17:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.541+0000 7f9e8dd01640 1 --2- 172.21.15.81:0/957117436 >> v2:172.21.15.102:3300/0 conn(0x7f9e880d30f0 0x7f9e880b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.541+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1220784652 0 0) 0x7f9e74003520 con 0x7f9e880b64c0 2024-09-16T01:17:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.541+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 >> v2:172.21.15.102:3300/0 conn(0x7f9e880d30f0 msgr2=0x7f9e880b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.541+0000 7f9e8d500640 1 --2- 172.21.15.81:0/957117436 >> v2:172.21.15.102:3300/0 conn(0x7f9e880d30f0 0x7f9e880b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 >> v1:172.21.15.102:6789/0 conn(0x7f9e8815e5f0 legacy=0x7f9e880d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8806cee0 con 0x7f9e880b64c0 2024-09-16T01:17:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f9e800019f0 con 0x7f9e880b64c0 2024-09-16T01:17:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 >> v1:172.21.15.81:6789/0 conn(0x7f9e880b64c0 legacy=0x7f9e8806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8d500640 1 --2- 172.21.15.81:0/957117436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e74003a00 0x7f9e74003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8d500640 1 --2- 172.21.15.81:0/957117436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e74004800 0x7f9e74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8d500640 1 --2- 172.21.15.81:0/957117436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e740051c0 0x7f9e7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8806d530 con 0x7f9e740051c0 2024-09-16T01:17:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7400c0c0 con 0x7f9e74003a00 2024-09-16T01:17:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e7400c2c0 con 0x7f9e74004800 2024-09-16T01:17:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8ed03640 1 --2- 172.21.15.81:0/957117436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e740051c0 0x7f9e7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8e502640 1 --2- 172.21.15.81:0/957117436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e74003a00 0x7f9e74003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8dd01640 1 --2- 172.21.15.81:0/957117436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e74004800 0x7f9e74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8ed03640 1 -- 172.21.15.81:0/957117436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e74004800 msgr2=0x7f9e74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8ed03640 1 --2- 172.21.15.81:0/957117436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e74004800 0x7f9e74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8ed03640 1 -- 172.21.15.81:0/957117436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e74003a00 msgr2=0x7f9e74003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8ed03640 1 --2- 172.21.15.81:0/957117436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e74003a00 0x7f9e74003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.542+0000 7f9e8ed03640 1 -- 172.21.15.81:0/957117436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e74003520 con 0x7f9e740051c0 2024-09-16T01:17:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.543+0000 7f9e8ed03640 1 -- 172.21.15.81:0/957117436 reap_dead start 2024-09-16T01:17:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.543+0000 7f9e8ed03640 1 --2- 172.21.15.81:0/957117436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e740051c0 0x7f9e7400b9c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000a7b0 tx=0x7f9e74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcd2d8ae79fa620 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.543+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8000a3d0 con 0x7f9e740051c0 2024-09-16T01:17:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.543+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8002f070 con 0x7f9e740051c0 2024-09-16T01:17:49.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.543+0000 7f9e8d500640 1 -- 172.21.15.81:0/957117436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8002bc20 con 0x7f9e740051c0 2024-09-16T01:17:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.543+0000 7f9e90766640 1 -- 172.21.15.81:0/957117436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e740051c0 msgr2=0x7f9e7400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.543+0000 7f9e90766640 1 --2- 172.21.15.81:0/957117436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e740051c0 0x7f9e7400b9c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000a7b0 tx=0x7f9e74005830 comp rx=0 tx=0).stop 2024-09-16T01:17:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.543+0000 7f9e90766640 1 -- 172.21.15.81:0/957117436 shutdown_connections 2024-09-16T01:17:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.543+0000 7f9e90766640 1 --2- 172.21.15.81:0/957117436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e740051c0 0x7f9e7400b9c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.543+0000 7f9e90766640 1 -- 172.21.15.81:0/957117436 >> 172.21.15.81:0/957117436 conn(0x7f9e8808bfc0 msgr2=0x7f9e880d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.543+0000 7f9e90766640 1 -- 172.21.15.81:0/957117436 shutdown_connections 2024-09-16T01:17:49.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.543+0000 7f9e90766640 1 -- 172.21.15.81:0/957117436 wait complete. 2024-09-16T01:17:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.545+0000 7f9e90766640 1 Processor -- start 2024-09-16T01:17:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.545+0000 7f9e90766640 1 -- start start 2024-09-16T01:17:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.545+0000 7f9e90766640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e740051c0 0x7f9e8809eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.545+0000 7f9e90766640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880ca470 0x7f9e880a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.545+0000 7f9e90766640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e880ca8f0 0x7f9e8815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.545+0000 7f9e90766640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e880b5f80 con 0x7f9e880ca8f0 2024-09-16T01:17:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.545+0000 7f9e90766640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8815e9d0 con 0x7f9e740051c0 2024-09-16T01:17:49.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.545+0000 7f9e90766640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e880b6100 con 0x7f9e880ca470 2024-09-16T01:17:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.545+0000 7f9e8ed03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e880ca8f0 0x7f9e8815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.545+0000 7f9e8ed03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e880ca8f0 0x7f9e8815eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53940/0 (socket says 172.21.15.81:53940) 2024-09-16T01:17:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.545+0000 7f9e8ed03640 1 -- 172.21.15.81:0/1595889040 learned_addr learned my addr 172.21.15.81:0/1595889040 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e8dd01640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880ca470 0x7f9e880a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e8ed03640 1 -- 172.21.15.81:0/1595889040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880ca470 msgr2=0x7f9e880a13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e8e502640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e740051c0 0x7f9e8809eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e8ed03640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880ca470 0x7f9e880a13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e8ed03640 1 -- 172.21.15.81:0/1595889040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e740051c0 msgr2=0x7f9e8809eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e8ed03640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e740051c0 0x7f9e8809eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e8ed03640 1 -- 172.21.15.81:0/1595889040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8809e210 con 0x7f9e880ca8f0 2024-09-16T01:17:49.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e8e502640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e740051c0 0x7f9e8809eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e8dd01640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880ca470 0x7f9e880a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e8ed03640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e880ca8f0 0x7f9e8815eb50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9e8002b470 tx=0x7f9e8002d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e7effd640 1 -- 172.21.15.81:0/1595889040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8002bbd0 con 0x7f9e880ca8f0 2024-09-16T01:17:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e7effd640 1 -- 172.21.15.81:0/1595889040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8002bd70 con 0x7f9e880ca8f0 2024-09-16T01:17:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e90766640 1 -- 172.21.15.81:0/1595889040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8809e7a0 con 0x7f9e880ca8f0 2024-09-16T01:17:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e7effd640 1 -- 172.21.15.81:0/1595889040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e80034670 con 0x7f9e880ca8f0 2024-09-16T01:17:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.546+0000 7f9e90766640 1 -- 172.21.15.81:0/1595889040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e881616d0 con 0x7f9e880ca8f0 2024-09-16T01:17:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.547+0000 7f9e90766640 1 -- 172.21.15.81:0/1595889040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e880d4dd0 con 0x7f9e880ca8f0 2024-09-16T01:17:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.548+0000 7f9e7effd640 1 -- 172.21.15.81:0/1595889040 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9e80034810 con 0x7f9e880ca8f0 2024-09-16T01:17:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.548+0000 7f9e7effd640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e6c06c2e0 0x7f9e6c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.548+0000 7f9e7effd640 1 -- 172.21.15.81:0/1595889040 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f9e800ab420 con 0x7f9e880ca8f0 2024-09-16T01:17:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.548+0000 7f9e8e502640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e6c06c2e0 0x7f9e6c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.549+0000 7f9e8e502640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e6c06c2e0 0x7f9e6c06e7a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e840055c0 tx=0x7f9e84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:49.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.552+0000 7f9e7effd640 1 -- 172.21.15.81:0/1595889040 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e80046060 con 0x7f9e880ca8f0 2024-09-16T01:17:49.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.752+0000 7f9e90766640 1 -- 172.21.15.81:0/1595889040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e880b55a0 con 0x7f9e880ca8f0 2024-09-16T01:17:49.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.753+0000 7f9e7effd640 1 -- 172.21.15.81:0/1595889040 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7f9e80079a90 con 0x7f9e880ca8f0 2024-09-16T01:17:49.754 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:49.754 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"btime":"2024-09-16T01:17:38:311750+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3508058089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3508058089},{"type":"v1","addr":"172.21.15.102:6835","nonce":3508058089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5349,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/763632631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":763632631},{"type":"v1","addr":"172.21.15.81:6835","nonce":763632631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3139124613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3139124613},{"type":"v1","addr":"172.21.15.81:6837","nonce":3139124613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:17:35.639749+0000","modified":"2024-09-16T01:17:37.638233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/52529574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":52529574},{"type":"v1","addr":"172.21.15.102:6834","nonce":52529574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5361,"qdb_cluster":[5361]},"id":3}]} 2024-09-16T01:17:49.754 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-16T01:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.755+0000 7f9e90766640 1 -- 172.21.15.81:0/1595889040 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e6c06c2e0 msgr2=0x7f9e6c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.755+0000 7f9e90766640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e6c06c2e0 0x7f9e6c06e7a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9e840055c0 tx=0x7f9e84009040 comp rx=0 tx=0).stop 2024-09-16T01:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.755+0000 7f9e90766640 1 -- 172.21.15.81:0/1595889040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e880ca8f0 msgr2=0x7f9e8815eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.755+0000 7f9e90766640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e880ca8f0 0x7f9e8815eb50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9e8002b470 tx=0x7f9e8002d070 comp rx=0 tx=0).stop 2024-09-16T01:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.755+0000 7f9e90766640 1 -- 172.21.15.81:0/1595889040 shutdown_connections 2024-09-16T01:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.755+0000 7f9e90766640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e6c06c2e0 0x7f9e6c06e7a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.755+0000 7f9e90766640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e880ca8f0 0x7f9e8815eb50 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.755+0000 7f9e90766640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880ca470 0x7f9e880a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.755+0000 7f9e90766640 1 --2- 172.21.15.81:0/1595889040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e740051c0 0x7f9e8809eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.755+0000 7f9e90766640 1 -- 172.21.15.81:0/1595889040 >> 172.21.15.81:0/1595889040 conn(0x7f9e8808bfc0 msgr2=0x7f9e880b9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:49.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.755+0000 7f9e90766640 1 -- 172.21.15.81:0/1595889040 shutdown_connections 2024-09-16T01:17:49.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.755+0000 7f9e90766640 1 -- 172.21.15.81:0/1595889040 wait complete. 2024-09-16T01:17:49.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:49.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.865+0000 7fc357f13640 1 Processor -- start 2024-09-16T01:17:49.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.865+0000 7fc357f13640 1 -- start start 2024-09-16T01:17:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.866+0000 7fc357f13640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc35015e740 0x7fc3500d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.866+0000 7fc357f13640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3500d0780 con 0x7fc35009b690 2024-09-16T01:17:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.866+0000 7fc357f13640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3500d0a60 con 0x7fc35006dbd0 2024-09-16T01:17:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.866+0000 7fc357f13640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc35015eb20 con 0x7fc35015e740 2024-09-16T01:17:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.866+0000 7fc355caf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc35015e740 0x7fc3500d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.866+0000 7fc3554ae640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc35009b690 0x7fc35006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60262/0 (socket says 172.21.15.81:60262) 2024-09-16T01:17:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.866+0000 7fc3554ae640 1 -- 172.21.15.81:0/2575120411 learned_addr learned my addr 172.21.15.81:0/2575120411 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.866+0000 7fc355caf640 1 -- 172.21.15.81:0/2575120411 >> v1:172.21.15.102:6789/0 conn(0x7fc35006dbd0 legacy=0x7fc350070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.866+0000 7fc355caf640 1 -- 172.21.15.81:0/2575120411 >> v1:172.21.15.81:6789/0 conn(0x7fc35009b690 legacy=0x7fc35006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.866+0000 7fc355caf640 1 -- 172.21.15.81:0/2575120411 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3500d0d40 con 0x7fc35015e740 2024-09-16T01:17:49.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.866+0000 7fc354cad640 1 -- 172.21.15.81:0/2575120411 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2062834495 0 0) 0x7fc3500d0780 con 0x7fc35009b690 2024-09-16T01:17:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.867+0000 7fc355caf640 1 --2- 172.21.15.81:0/2575120411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35015e740 0x7fc3500d1540 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0097a0 tx=0x7fc34c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a909f7d0f6b44fff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.867+0000 7fc354cad640 1 -- 172.21.15.81:0/2575120411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c037070 con 0x7fc35015e740 2024-09-16T01:17:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.867+0000 7fc354cad640 1 -- 172.21.15.81:0/2575120411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34c032440 con 0x7fc35015e740 2024-09-16T01:17:49.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.867+0000 7fc354cad640 1 -- 172.21.15.81:0/2575120411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c032810 con 0x7fc35015e740 2024-09-16T01:17:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.867+0000 7fc357f13640 1 -- 172.21.15.81:0/2575120411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35015e740 msgr2=0x7fc3500d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.867+0000 7fc357f13640 1 --2- 172.21.15.81:0/2575120411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35015e740 0x7fc3500d1540 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0097a0 tx=0x7fc34c02a270 comp rx=0 tx=0).stop 2024-09-16T01:17:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.868+0000 7fc357f13640 1 -- 172.21.15.81:0/2575120411 shutdown_connections 2024-09-16T01:17:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.868+0000 7fc357f13640 1 --2- 172.21.15.81:0/2575120411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35015e740 0x7fc3500d1540 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.868+0000 7fc357f13640 1 -- 172.21.15.81:0/2575120411 >> 172.21.15.81:0/2575120411 conn(0x7fc3500d23a0 msgr2=0x7fc3500d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.868+0000 7fc357f13640 1 -- 172.21.15.81:0/2575120411 shutdown_connections 2024-09-16T01:17:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.868+0000 7fc357f13640 1 -- 172.21.15.81:0/2575120411 wait complete. 2024-09-16T01:17:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.869+0000 7fc357f13640 1 Processor -- start 2024-09-16T01:17:49.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.869+0000 7fc357f13640 1 -- start start 2024-09-16T01:17:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.869+0000 7fc357f13640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc35006dbd0 0x7fc3500caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.869+0000 7fc357f13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc35009b690 0x7fc35009c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.869+0000 7fc357f13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35015e740 0x7fc35015bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.869+0000 7fc357f13640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc35006dfe0 con 0x7fc35015e740 2024-09-16T01:17:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc357f13640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc35009bac0 con 0x7fc35009b690 2024-09-16T01:17:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc357f13640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc35006cd20 con 0x7fc35006dbd0 2024-09-16T01:17:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3564b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35015e740 0x7fc35015bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3564b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35015e740 0x7fc35015bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53948/0 (socket says 172.21.15.81:53948) 2024-09-16T01:17:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3564b0640 1 -- 172.21.15.81:0/2665222277 learned_addr learned my addr 172.21.15.81:0/2665222277 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3554ae640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc35009b690 0x7fc35009c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc355caf640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc35006dbd0 0x7fc3500caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3564b0640 1 -- 172.21.15.81:0/2665222277 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc35006dbd0 msgr2=0x7fc3500caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3564b0640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc35006dbd0 0x7fc3500caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3564b0640 1 -- 172.21.15.81:0/2665222277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc35009b690 msgr2=0x7fc35009c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3564b0640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc35009b690 0x7fc35009c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3564b0640 1 -- 172.21.15.81:0/2665222277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3500cc460 con 0x7fc35015e740 2024-09-16T01:17:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3564b0640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35015e740 0x7fc35015bf20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc34800c780 tx=0x7fc34800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3467fc640 1 -- 172.21.15.81:0/2665222277 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348004b60 con 0x7fc35015e740 2024-09-16T01:17:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3467fc640 1 -- 172.21.15.81:0/2665222277 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc348004d00 con 0x7fc35015e740 2024-09-16T01:17:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc3467fc640 1 -- 172.21.15.81:0/2665222277 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34800aa90 con 0x7fc35015e740 2024-09-16T01:17:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc357f13640 1 -- 172.21.15.81:0/2665222277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3500ca160 con 0x7fc35015e740 2024-09-16T01:17:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.870+0000 7fc357f13640 1 -- 172.21.15.81:0/2665222277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3500ca720 con 0x7fc35015e740 2024-09-16T01:17:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.871+0000 7fc357f13640 1 -- 172.21.15.81:0/2665222277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3500d0780 con 0x7fc35015e740 2024-09-16T01:17:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.872+0000 7fc3467fc640 1 -- 172.21.15.81:0/2665222277 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc34800ac30 con 0x7fc35015e740 2024-09-16T01:17:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.872+0000 7fc3467fc640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc33406c2b0 0x7fc33406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.872+0000 7fc3467fc640 1 -- 172.21.15.81:0/2665222277 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fc34808b640 con 0x7fc35015e740 2024-09-16T01:17:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.872+0000 7fc355caf640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc33406c2b0 0x7fc33406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.872+0000 7fc355caf640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc33406c2b0 0x7fc33406e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc34c034000 tx=0x7fc34c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:49.876+0000 7fc3467fc640 1 -- 172.21.15.81:0/2665222277 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc348020070 con 0x7fc35015e740 2024-09-16T01:17:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.075+0000 7fc357f13640 1 -- 172.21.15.81:0/2665222277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3500d1cb0 con 0x7fc35015e740 2024-09-16T01:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.075+0000 7fc3467fc640 1 -- 172.21.15.81:0/2665222277 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5220 (secure 0 0 0) 0x7fc348059660 con 0x7fc35015e740 2024-09-16T01:17:50.076 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:50.076 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"btime":"2024-09-16T01:17:38:311750+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3508058089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3508058089},{"type":"v1","addr":"172.21.15.102:6835","nonce":3508058089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5349,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/763632631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":763632631},{"type":"v1","addr":"172.21.15.81:6835","nonce":763632631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3139124613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3139124613},{"type":"v1","addr":"172.21.15.81:6837","nonce":3139124613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:17:35.639749+0000","modified":"2024-09-16T01:17:37.638233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/52529574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":52529574},{"type":"v1","addr":"172.21.15.102:6834","nonce":52529574}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5361,"qdb_cluster":[5361]},"id":3}]} 2024-09-16T01:17:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-16T01:17:50.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.077+0000 7fc357f13640 1 -- 172.21.15.81:0/2665222277 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc33406c2b0 msgr2=0x7fc33406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.077+0000 7fc357f13640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc33406c2b0 0x7fc33406e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc34c034000 tx=0x7fc34c02e000 comp rx=0 tx=0).stop 2024-09-16T01:17:50.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.077+0000 7fc357f13640 1 -- 172.21.15.81:0/2665222277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35015e740 msgr2=0x7fc35015bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.077+0000 7fc357f13640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35015e740 0x7fc35015bf20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc34800c780 tx=0x7fc34800cc40 comp rx=0 tx=0).stop 2024-09-16T01:17:50.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.077+0000 7fc357f13640 1 -- 172.21.15.81:0/2665222277 shutdown_connections 2024-09-16T01:17:50.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.077+0000 7fc357f13640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc33406c2b0 0x7fc33406e770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.077+0000 7fc357f13640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc35015e740 0x7fc35015bf20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.077+0000 7fc357f13640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc35009b690 0x7fc35009c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.077+0000 7fc357f13640 1 --2- 172.21.15.81:0/2665222277 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc35006dbd0 0x7fc3500caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.077+0000 7fc357f13640 1 -- 172.21.15.81:0/2665222277 >> 172.21.15.81:0/2665222277 conn(0x7fc3500d23a0 msgr2=0x7fc3500b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.077+0000 7fc357f13640 1 -- 172.21.15.81:0/2665222277 shutdown_connections 2024-09-16T01:17:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.077+0000 7fc357f13640 1 -- 172.21.15.81:0/2665222277 wait complete. 2024-09-16T01:17:50.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:17:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.185+0000 7f37cc949640 1 Processor -- start 2024-09-16T01:17:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.186+0000 7f37cc949640 1 -- start start 2024-09-16T01:17:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.186+0000 7f37cc949640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f37c815e740 0x7f37c80d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.186+0000 7f37cc949640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f37c809b690 0x7f37c806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.186+0000 7f37cc949640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c80d0780 con 0x7f37c806d4c0 2024-09-16T01:17:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.186+0000 7f37cc949640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f37c815eb20 con 0x7f37c815e740 2024-09-16T01:17:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.186+0000 7f37cc949640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f37c806d260 con 0x7f37c809b690 2024-09-16T01:17:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.187+0000 7f37c659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f37c815e740 0x7f37c80d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.187+0000 7f37c6d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f37c806d4c0 0x7f37c806d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60278/0 (socket says 172.21.15.81:60278) 2024-09-16T01:17:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.187+0000 7f37c6d9d640 1 -- 172.21.15.81:0/1243484255 learned_addr learned my addr 172.21.15.81:0/1243484255 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.187+0000 7f37c5d9b640 1 --2- 172.21.15.81:0/1243484255 >> v2:172.21.15.102:3300/0 conn(0x7f37c809b690 0x7f37c806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.187+0000 7f37c659c640 1 -- 172.21.15.81:0/1243484255 >> v2:172.21.15.102:3300/0 conn(0x7f37c809b690 msgr2=0x7f37c806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.187+0000 7f37c659c640 1 --2- 172.21.15.81:0/1243484255 >> v2:172.21.15.102:3300/0 conn(0x7f37c809b690 0x7f37c806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.187+0000 7f37c559a640 1 -- 172.21.15.81:0/1243484255 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 409361512 0 0) 0x7f37c80d0780 con 0x7f37c806d4c0 2024-09-16T01:17:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.187+0000 7f37c659c640 1 -- 172.21.15.81:0/1243484255 >> v1:172.21.15.81:6789/0 conn(0x7f37c806d4c0 legacy=0x7f37c806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.187+0000 7f37c659c640 1 -- 172.21.15.81:0/1243484255 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c80d0a60 con 0x7f37c815e740 2024-09-16T01:17:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.188+0000 7f37c659c640 1 --2- 172.21.15.81:0/1243484255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c815e740 0x7f37c80d1540 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f37c80691b0 tx=0x7f37c002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e9ec3f5f853d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.188+0000 7f37c559a640 1 -- 172.21.15.81:0/1243484255 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0007740 con 0x7f37c815e740 2024-09-16T01:17:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.188+0000 7f37c559a640 1 -- 172.21.15.81:0/1243484255 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c00078e0 con 0x7f37c815e740 2024-09-16T01:17:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.188+0000 7f37c559a640 1 -- 172.21.15.81:0/1243484255 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0007cb0 con 0x7f37c815e740 2024-09-16T01:17:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.188+0000 7f37cc949640 1 -- 172.21.15.81:0/1243484255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c815e740 msgr2=0x7f37c80d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.188+0000 7f37cc949640 1 --2- 172.21.15.81:0/1243484255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c815e740 0x7f37c80d1540 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f37c80691b0 tx=0x7f37c002a710 comp rx=0 tx=0).stop 2024-09-16T01:17:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.188+0000 7f37cc949640 1 -- 172.21.15.81:0/1243484255 shutdown_connections 2024-09-16T01:17:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.188+0000 7f37cc949640 1 --2- 172.21.15.81:0/1243484255 >> v2:172.21.15.102:3300/0 conn(0x7f37c809b690 0x7f37c806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.188+0000 7f37cc949640 1 --2- 172.21.15.81:0/1243484255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c815e740 0x7f37c80d1540 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.188+0000 7f37cc949640 1 -- 172.21.15.81:0/1243484255 >> 172.21.15.81:0/1243484255 conn(0x7f37c80d23a0 msgr2=0x7f37c80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.188+0000 7f37cc949640 1 -- 172.21.15.81:0/1243484255 shutdown_connections 2024-09-16T01:17:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.188+0000 7f37cc949640 1 -- 172.21.15.81:0/1243484255 wait complete. 2024-09-16T01:17:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.190+0000 7f37cc949640 1 Processor -- start 2024-09-16T01:17:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.190+0000 7f37cc949640 1 -- start start 2024-09-16T01:17:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.190+0000 7f37cc949640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37c806d4c0 0x7f37c80b7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.190+0000 7f37cc949640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c809b690 0x7f37c81f4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.190+0000 7f37cc949640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37c815e740 0x7f37c81f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.190+0000 7f37cc949640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37c809bac0 con 0x7f37c809b690 2024-09-16T01:17:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.190+0000 7f37cc949640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f37c80d1020 con 0x7f37c815e740 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.190+0000 7f37cc949640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f37c806dfe0 con 0x7f37c806d4c0 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37c5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c809b690 0x7f37c81f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37c5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c809b690 0x7f37c81f4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53956/0 (socket says 172.21.15.81:53956) 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37c5d9b640 1 -- 172.21.15.81:0/1262017380 learned_addr learned my addr 172.21.15.81:0/1262017380 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37c659c640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37c806d4c0 0x7f37c80b7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37c6d9d640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37c815e740 0x7f37c81f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37c5d9b640 1 -- 172.21.15.81:0/1262017380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37c806d4c0 msgr2=0x7f37c80b7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37c5d9b640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37c806d4c0 0x7f37c80b7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37c5d9b640 1 -- 172.21.15.81:0/1262017380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37c815e740 msgr2=0x7f37c81f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37c5d9b640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37c815e740 0x7f37c81f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37c5d9b640 1 -- 172.21.15.81:0/1262017380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c80b5610 con 0x7f37c809b690 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37c6d9d640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37c815e740 0x7f37c81f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37c5d9b640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c809b690 0x7f37c81f4400 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f37b000e870 tx=0x7f37b000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37beffd640 1 -- 172.21.15.81:0/1262017380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0017070 con 0x7f37c809b690 2024-09-16T01:17:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37beffd640 1 -- 172.21.15.81:0/1262017380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b000c940 con 0x7f37c809b690 2024-09-16T01:17:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37beffd640 1 -- 172.21.15.81:0/1262017380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b000cd30 con 0x7f37c809b690 2024-09-16T01:17:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37cc949640 1 -- 172.21.15.81:0/1262017380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c80b58f0 con 0x7f37c809b690 2024-09-16T01:17:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.191+0000 7f37cc949640 1 -- 172.21.15.81:0/1262017380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c80b5eb0 con 0x7f37c809b690 2024-09-16T01:17:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.192+0000 7f37cc949640 1 -- 172.21.15.81:0/1262017380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c80d0780 con 0x7f37c809b690 2024-09-16T01:17:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.193+0000 7f37beffd640 1 -- 172.21.15.81:0/1262017380 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f37b001a070 con 0x7f37c809b690 2024-09-16T01:17:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.193+0000 7f37beffd640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f37a806c2b0 0x7f37a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.193+0000 7f37beffd640 1 -- 172.21.15.81:0/1262017380 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7f37b008b7a0 con 0x7f37c809b690 2024-09-16T01:17:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.193+0000 7f37c659c640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f37a806c2b0 0x7f37a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.194+0000 7f37c659c640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f37a806c2b0 0x7f37a806e770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f37c0034000 tx=0x7f37c002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.197+0000 7f37beffd640 1 -- 172.21.15.81:0/1262017380 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37b0059e10 con 0x7f37c809b690 2024-09-16T01:17:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.366+0000 7f37cc949640 1 -- 172.21.15.81:0/1262017380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37c80d1cb0 con 0x7f37c809b690 2024-09-16T01:17:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.367+0000 7f37beffd640 1 -- 172.21.15.81:0/1262017380 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+17002 (secure 0 0 0) 0x7f37b0059710 con 0x7f37c809b690 2024-09-16T01:17:50.368 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:50.368 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":51,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:17:37.305680+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:17:34.249166+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-16T01:17:34.605034+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:17:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.369+0000 7f37cc949640 1 -- 172.21.15.81:0/1262017380 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f37a806c2b0 msgr2=0x7f37a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.369+0000 7f37cc949640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f37a806c2b0 0x7f37a806e770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f37c0034000 tx=0x7f37c002f000 comp rx=0 tx=0).stop 2024-09-16T01:17:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.369+0000 7f37cc949640 1 -- 172.21.15.81:0/1262017380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c809b690 msgr2=0x7f37c81f4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.369+0000 7f37cc949640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c809b690 0x7f37c81f4400 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f37b000e870 tx=0x7f37b000ed30 comp rx=0 tx=0).stop 2024-09-16T01:17:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.369+0000 7f37cc949640 1 -- 172.21.15.81:0/1262017380 shutdown_connections 2024-09-16T01:17:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.369+0000 7f37cc949640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f37a806c2b0 0x7f37a806e770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.369+0000 7f37cc949640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37c815e740 0x7f37c81f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.369+0000 7f37cc949640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c809b690 0x7f37c81f4400 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.369+0000 7f37cc949640 1 --2- 172.21.15.81:0/1262017380 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37c806d4c0 0x7f37c80b7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.369+0000 7f37cc949640 1 -- 172.21.15.81:0/1262017380 >> 172.21.15.81:0/1262017380 conn(0x7f37c80d23a0 msgr2=0x7f37c815d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.369+0000 7f37cc949640 1 -- 172.21.15.81:0/1262017380 shutdown_connections 2024-09-16T01:17:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.369+0000 7f37cc949640 1 -- 172.21.15.81:0/1262017380 wait complete. 2024-09-16T01:17:50.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:17:50.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.480+0000 7fd197d8d640 1 Processor -- start 2024-09-16T01:17:50.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.480+0000 7fd197d8d640 1 -- start start 2024-09-16T01:17:50.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.481+0000 7fd197d8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd190072d30 0x7fd19006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.481+0000 7fd197d8d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd19006fae0 con 0x7fd19006f700 2024-09-16T01:17:50.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.481+0000 7fd197d8d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1900cdbe0 con 0x7fd19015b300 2024-09-16T01:17:50.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.481+0000 7fd197d8d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd1900728a0 con 0x7fd190072d30 2024-09-16T01:17:50.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.481+0000 7fd195328640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd190072d30 0x7fd19006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.481+0000 7fd19632a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd19006f700 0x7fd19015b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60286/0 (socket says 172.21.15.81:60286) 2024-09-16T01:17:50.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.481+0000 7fd19632a640 1 -- 172.21.15.81:0/1884255674 learned_addr learned my addr 172.21.15.81:0/1884255674 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:50.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.481+0000 7fd195328640 1 -- 172.21.15.81:0/1884255674 >> v1:172.21.15.102:6789/0 conn(0x7fd19015b300 legacy=0x7fd1900cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.481+0000 7fd195328640 1 -- 172.21.15.81:0/1884255674 >> v1:172.21.15.81:6789/0 conn(0x7fd19006f700 legacy=0x7fd19015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.481+0000 7fd195328640 1 -- 172.21.15.81:0/1884255674 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1900cd900 con 0x7fd190072d30 2024-09-16T01:17:50.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.482+0000 7fd195328640 1 --2- 172.21.15.81:0/1884255674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd190072d30 0x7fd19006f1c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0097a0 tx=0x7fd18c02c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd40fd0b7649ddbc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:50.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.482+0000 7fd194b27640 1 -- 172.21.15.81:0/1884255674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c039070 con 0x7fd190072d30 2024-09-16T01:17:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.482+0000 7fd194b27640 1 -- 172.21.15.81:0/1884255674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd18c034640 con 0x7fd190072d30 2024-09-16T01:17:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.482+0000 7fd194b27640 1 -- 172.21.15.81:0/1884255674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c034a10 con 0x7fd190072d30 2024-09-16T01:17:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.482+0000 7fd197d8d640 1 -- 172.21.15.81:0/1884255674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd190072d30 msgr2=0x7fd19006f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.482+0000 7fd197d8d640 1 --2- 172.21.15.81:0/1884255674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd190072d30 0x7fd19006f1c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0097a0 tx=0x7fd18c02c3b0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.482+0000 7fd197d8d640 1 -- 172.21.15.81:0/1884255674 shutdown_connections 2024-09-16T01:17:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.482+0000 7fd197d8d640 1 --2- 172.21.15.81:0/1884255674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd190072d30 0x7fd19006f1c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.482+0000 7fd197d8d640 1 -- 172.21.15.81:0/1884255674 >> 172.21.15.81:0/1884255674 conn(0x7fd190067d70 msgr2=0x7fd19006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.482+0000 7fd197d8d640 1 -- 172.21.15.81:0/1884255674 shutdown_connections 2024-09-16T01:17:50.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.483+0000 7fd197d8d640 1 -- 172.21.15.81:0/1884255674 wait complete. 2024-09-16T01:17:50.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.484+0000 7fd197d8d640 1 Processor -- start 2024-09-16T01:17:50.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.484+0000 7fd197d8d640 1 -- start start 2024-09-16T01:17:50.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.484+0000 7fd197d8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd19006f700 0x7fd1900c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.484+0000 7fd197d8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd190072d30 0x7fd1901555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.484+0000 7fd197d8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19015b300 0x7fd190155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.484+0000 7fd197d8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1900cd5c0 con 0x7fd19015b300 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.484+0000 7fd197d8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd190072530 con 0x7fd19006f700 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.484+0000 7fd197d8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd1900cffe0 con 0x7fd190072d30 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.484+0000 7fd19632a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19015b300 0x7fd190155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.484+0000 7fd19632a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19015b300 0x7fd190155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53970/0 (socket says 172.21.15.81:53970) 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.484+0000 7fd19632a640 1 -- 172.21.15.81:0/3905374052 learned_addr learned my addr 172.21.15.81:0/3905374052 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd195b29640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd19006f700 0x7fd1900c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd195328640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd190072d30 0x7fd1901555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd19632a640 1 -- 172.21.15.81:0/3905374052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd190072d30 msgr2=0x7fd1901555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd19632a640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd190072d30 0x7fd1901555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd19632a640 1 -- 172.21.15.81:0/3905374052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd19006f700 msgr2=0x7fd1900c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd19632a640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd19006f700 0x7fd1900c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd19632a640 1 -- 172.21.15.81:0/3905374052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd190155b00 con 0x7fd19015b300 2024-09-16T01:17:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd19632a640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19015b300 0x7fd190155d20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd18800cab0 tx=0x7fd18800cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd1827fc640 1 -- 172.21.15.81:0/3905374052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188017070 con 0x7fd19015b300 2024-09-16T01:17:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd1827fc640 1 -- 172.21.15.81:0/3905374052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd18800ac30 con 0x7fd19015b300 2024-09-16T01:17:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd1827fc640 1 -- 172.21.15.81:0/3905374052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188012400 con 0x7fd19015b300 2024-09-16T01:17:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd197d8d640 1 -- 172.21.15.81:0/3905374052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd190150350 con 0x7fd19015b300 2024-09-16T01:17:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.485+0000 7fd197d8d640 1 -- 172.21.15.81:0/3905374052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1900c5ec0 con 0x7fd19015b300 2024-09-16T01:17:50.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.486+0000 7fd197d8d640 1 -- 172.21.15.81:0/3905374052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1901591d0 con 0x7fd19015b300 2024-09-16T01:17:50.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.487+0000 7fd1827fc640 1 -- 172.21.15.81:0/3905374052 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd18801a070 con 0x7fd19015b300 2024-09-16T01:17:50.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.487+0000 7fd1827fc640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd17406c2b0 0x7fd17406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.487+0000 7fd1827fc640 1 -- 172.21.15.81:0/3905374052 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6101+0+0 (secure 0 0 0) 0x7fd18808b160 con 0x7fd19015b300 2024-09-16T01:17:50.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.487+0000 7fd195b29640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd17406c2b0 0x7fd17406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.487+0000 7fd195b29640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd17406c2b0 0x7fd17406e770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd184001780 tx=0x7fd184009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.491+0000 7fd1827fc640 1 -- 172.21.15.81:0/3905374052 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1880590f0 con 0x7fd19015b300 2024-09-16T01:17:50.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.692+0000 7fd197d8d640 1 -- 172.21.15.81:0/3905374052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd190158930 con 0x7fd19015b300 2024-09-16T01:17:50.693 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-16T01:17:50.693+0000 7f4e951a0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.694+0000 7fd1827fc640 1 -- 172.21.15.81:0/3905374052 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) ==== 161+0+0 (secure 0 0 0) 0x7fd18805d3f0 con 0x7fd19015b300 2024-09-16T01:17:50.695 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.697+0000 7fd197d8d640 1 -- 172.21.15.81:0/3905374052 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd17406c2b0 msgr2=0x7fd17406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.697+0000 7fd197d8d640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd17406c2b0 0x7fd17406e770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd184001780 tx=0x7fd184009040 comp rx=0 tx=0).stop 2024-09-16T01:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.697+0000 7fd197d8d640 1 -- 172.21.15.81:0/3905374052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19015b300 msgr2=0x7fd190155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.697+0000 7fd197d8d640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19015b300 0x7fd190155d20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd18800cab0 tx=0x7fd18800cf70 comp rx=0 tx=0).stop 2024-09-16T01:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.697+0000 7fd197d8d640 1 -- 172.21.15.81:0/3905374052 shutdown_connections 2024-09-16T01:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.697+0000 7fd197d8d640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd17406c2b0 0x7fd17406e770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.697+0000 7fd197d8d640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19015b300 0x7fd190155d20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.697+0000 7fd197d8d640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd190072d30 0x7fd1901555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.697+0000 7fd197d8d640 1 --2- 172.21.15.81:0/3905374052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd19006f700 0x7fd1900c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.697+0000 7fd197d8d640 1 -- 172.21.15.81:0/3905374052 >> 172.21.15.81:0/3905374052 conn(0x7fd190067d70 msgr2=0x7fd1901505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.697+0000 7fd197d8d640 1 -- 172.21.15.81:0/3905374052 shutdown_connections 2024-09-16T01:17:50.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.697+0000 7fd197d8d640 1 -- 172.21.15.81:0/3905374052 wait complete. 2024-09-16T01:17:50.700 INFO:tasks.ceph.mds.b.smithi102.stderr: -2140> 2024-09-16T01:17:37.563+0000 7f0cae328640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:17:50.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:17:50.730 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:17:50.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.808+0000 7f5e551a6640 1 Processor -- start 2024-09-16T01:17:50.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.808+0000 7f5e551a6640 1 -- start start 2024-09-16T01:17:50.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e551a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5e5015c310 0x7f5e50160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e551a6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e500b4800 0x7f5e500aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e551a6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e50160e70 con 0x7f5e500d0370 2024-09-16T01:17:50.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e551a6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5e500af7a0 con 0x7f5e500b4800 2024-09-16T01:17:50.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e551a6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5e500afa80 con 0x7f5e5015c310 2024-09-16T01:17:50.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e4659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e500b4800 0x7f5e500aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e4659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e500b4800 0x7f5e500aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53986/0 (socket says 172.21.15.81:53986) 2024-09-16T01:17:50.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e4659c640 1 -- 172.21.15.81:0/1489163107 learned_addr learned my addr 172.21.15.81:0/1489163107 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:50.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e4ed9d640 1 --2- 172.21.15.81:0/1489163107 >> v2:172.21.15.102:3300/0 conn(0x7f5e5015c310 0x7f5e50160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e4659c640 1 -- 172.21.15.81:0/1489163107 >> v2:172.21.15.102:3300/0 conn(0x7f5e5015c310 msgr2=0x7f5e50160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:50.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e4659c640 1 --2- 172.21.15.81:0/1489163107 >> v2:172.21.15.102:3300/0 conn(0x7f5e5015c310 0x7f5e50160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e4659c640 1 -- 172.21.15.81:0/1489163107 >> v1:172.21.15.81:6789/0 conn(0x7f5e500d0370 legacy=0x7f5e5006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e4e59c640 1 -- 172.21.15.81:0/1489163107 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235442366 0 0) 0x7f5e50160e70 con 0x7f5e500d0370 2024-09-16T01:17:50.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.809+0000 7f5e4659c640 1 -- 172.21.15.81:0/1489163107 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e50160130 con 0x7f5e500b4800 2024-09-16T01:17:50.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.810+0000 7f5e4659c640 1 --2- 172.21.15.81:0/1489163107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e500b4800 0x7f5e500aef30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e500b2f80 tx=0x7f5e3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3cd4f9ea9542b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:50.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.810+0000 7f5e4e59c640 1 -- 172.21.15.81:0/1489163107 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38037070 con 0x7f5e500b4800 2024-09-16T01:17:50.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.810+0000 7f5e4e59c640 1 -- 172.21.15.81:0/1489163107 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e38032440 con 0x7f5e500b4800 2024-09-16T01:17:50.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.810+0000 7f5e4e59c640 1 -- 172.21.15.81:0/1489163107 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38032810 con 0x7f5e500b4800 2024-09-16T01:17:50.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.811+0000 7f5e551a6640 1 -- 172.21.15.81:0/1489163107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e500b4800 msgr2=0x7f5e500aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.811+0000 7f5e551a6640 1 --2- 172.21.15.81:0/1489163107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e500b4800 0x7f5e500aef30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e500b2f80 tx=0x7f5e3802a270 comp rx=0 tx=0).stop 2024-09-16T01:17:50.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.811+0000 7f5e551a6640 1 -- 172.21.15.81:0/1489163107 shutdown_connections 2024-09-16T01:17:50.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.811+0000 7f5e551a6640 1 --2- 172.21.15.81:0/1489163107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e500b4800 0x7f5e500aef30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.811+0000 7f5e551a6640 1 --2- 172.21.15.81:0/1489163107 >> v2:172.21.15.102:3300/0 conn(0x7f5e5015c310 0x7f5e50160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.811+0000 7f5e551a6640 1 -- 172.21.15.81:0/1489163107 >> 172.21.15.81:0/1489163107 conn(0x7f5e5006bdf0 msgr2=0x7f5e5006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:50.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.811+0000 7f5e551a6640 1 -- 172.21.15.81:0/1489163107 shutdown_connections 2024-09-16T01:17:50.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.811+0000 7f5e551a6640 1 -- 172.21.15.81:0/1489163107 wait complete. 2024-09-16T01:17:50.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.812+0000 7f5e551a6640 1 Processor -- start 2024-09-16T01:17:50.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.812+0000 7f5e551a6640 1 -- start start 2024-09-16T01:17:50.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e551a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e500b4800 0x7f5e501e63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e551a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e500d0370 0x7f5e50153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e551a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e5015c310 0x7f5e50156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e551a6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5006e620 con 0x7f5e500d0370 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e551a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5e5015c6f0 con 0x7f5e5015c310 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e551a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5e5006e7a0 con 0x7f5e500b4800 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e4659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e500d0370 0x7f5e50153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e4659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e500d0370 0x7f5e50153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53994/0 (socket says 172.21.15.81:53994) 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e4659c640 1 -- 172.21.15.81:0/4239585514 learned_addr learned my addr 172.21.15.81:0/4239585514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e4f59e640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e5015c310 0x7f5e50156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e4ed9d640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e500b4800 0x7f5e501e63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e4659c640 1 -- 172.21.15.81:0/4239585514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e500b4800 msgr2=0x7f5e501e63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e4659c640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e500b4800 0x7f5e501e63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e4659c640 1 -- 172.21.15.81:0/4239585514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e5015c310 msgr2=0x7f5e50156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e4659c640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e5015c310 0x7f5e50156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:50.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e4659c640 1 -- 172.21.15.81:0/4239585514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e50151cc0 con 0x7f5e500d0370 2024-09-16T01:17:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.813+0000 7f5e4659c640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e500d0370 0x7f5e50153ac0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5e380090b0 tx=0x7f5e380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.814+0000 7f5e47fff640 1 -- 172.21.15.81:0/4239585514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38037040 con 0x7f5e500d0370 2024-09-16T01:17:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.814+0000 7f5e47fff640 1 -- 172.21.15.81:0/4239585514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e38004030 con 0x7f5e500d0370 2024-09-16T01:17:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.814+0000 7f5e551a6640 1 -- 172.21.15.81:0/4239585514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e50151fa0 con 0x7f5e500d0370 2024-09-16T01:17:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.814+0000 7f5e47fff640 1 -- 172.21.15.81:0/4239585514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38004400 con 0x7f5e500d0370 2024-09-16T01:17:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.814+0000 7f5e551a6640 1 -- 172.21.15.81:0/4239585514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e50144bd0 con 0x7f5e500d0370 2024-09-16T01:17:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.815+0000 7f5e551a6640 1 -- 172.21.15.81:0/4239585514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e500aef30 con 0x7f5e500d0370 2024-09-16T01:17:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.815+0000 7f5e47fff640 1 -- 172.21.15.81:0/4239585514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5e3803a040 con 0x7f5e500d0370 2024-09-16T01:17:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.815+0000 7f5e47fff640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5e3006c2b0 0x7f5e3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.815+0000 7f5e47fff640 1 -- 172.21.15.81:0/4239585514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6187+0+0 (secure 0 0 0) 0x7f5e380abb00 con 0x7f5e500d0370 2024-09-16T01:17:50.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.816+0000 7f5e4ed9d640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5e3006c2b0 0x7f5e3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:50.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.816+0000 7f5e4ed9d640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5e3006c2b0 0x7f5e3006e770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009aa0 tx=0x7f5e40009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:50.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:50.820+0000 7f5e47fff640 1 -- 172.21.15.81:0/4239585514 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e38042020 con 0x7f5e500d0370 2024-09-16T01:17:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.017+0000 7f5e551a6640 1 -- 172.21.15.81:0/4239585514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5e500cfea0 con 0x7f5e500d0370 2024-09-16T01:17:51.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.695+0000 7f5e47fff640 1 -- 172.21.15.81:0/4239585514 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f5e38079b60 con 0x7f5e500d0370 2024-09-16T01:17:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.698+0000 7f5e551a6640 1 -- 172.21.15.81:0/4239585514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5e3006c2b0 msgr2=0x7f5e3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.698+0000 7f5e551a6640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5e3006c2b0 0x7f5e3006e770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009aa0 tx=0x7f5e40009190 comp rx=0 tx=0).stop 2024-09-16T01:17:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.698+0000 7f5e551a6640 1 -- 172.21.15.81:0/4239585514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e500d0370 msgr2=0x7f5e50153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.698+0000 7f5e551a6640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e500d0370 0x7f5e50153ac0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5e380090b0 tx=0x7f5e380046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.698+0000 7f5e551a6640 1 -- 172.21.15.81:0/4239585514 shutdown_connections 2024-09-16T01:17:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.698+0000 7f5e551a6640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5e3006c2b0 0x7f5e3006e770 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.698+0000 7f5e551a6640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e5015c310 0x7f5e50156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.698+0000 7f5e551a6640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e500d0370 0x7f5e50153ac0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.698+0000 7f5e551a6640 1 --2- 172.21.15.81:0/4239585514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e500b4800 0x7f5e501e63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.698+0000 7f5e551a6640 1 -- 172.21.15.81:0/4239585514 >> 172.21.15.81:0/4239585514 conn(0x7f5e5006bdf0 msgr2=0x7f5e5006def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:51.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.698+0000 7f5e551a6640 1 -- 172.21.15.81:0/4239585514 shutdown_connections 2024-09-16T01:17:51.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.698+0000 7f5e551a6640 1 -- 172.21.15.81:0/4239585514 wait complete. 2024-09-16T01:17:51.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:17:51.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.815+0000 7ffa4c8d7640 1 Processor -- start 2024-09-16T01:17:51.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.815+0000 7ffa4c8d7640 1 -- start start 2024-09-16T01:17:51.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa4c8d7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffa480af210 0x7ffa48070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:51.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa4c8d7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa4806cdc0 con 0x7ffa4815e7f0 2024-09-16T01:17:51.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa4c8d7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa4806d0a0 con 0x7ffa48070fb0 2024-09-16T01:17:51.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa4c8d7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ffa48071420 con 0x7ffa480af210 2024-09-16T01:17:51.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa4659c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffa4815e7f0 0x7ffa480b6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56568/0 (socket says 172.21.15.81:56568) 2024-09-16T01:17:51.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa4659c640 1 -- 172.21.15.81:0/4270931270 learned_addr learned my addr 172.21.15.81:0/4270931270 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:51.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa3dd9b640 1 --2- 172.21.15.81:0/4270931270 >> v2:172.21.15.102:3300/0 conn(0x7ffa480af210 0x7ffa48070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2629845459 0 0) 0x7ffa4806cdc0 con 0x7ffa4815e7f0 2024-09-16T01:17:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa34003520 con 0x7ffa4815e7f0 2024-09-16T01:17:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3449726528 0 0) 0x7ffa34003520 con 0x7ffa4815e7f0 2024-09-16T01:17:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 >> v2:172.21.15.102:3300/0 conn(0x7ffa480af210 msgr2=0x7ffa48070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa45d9b640 1 --2- 172.21.15.81:0/4270931270 >> v2:172.21.15.102:3300/0 conn(0x7ffa480af210 0x7ffa48070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 >> v1:172.21.15.102:6789/0 conn(0x7ffa48070fb0 legacy=0x7ffa4806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4806d380 con 0x7ffa4815e7f0 2024-09-16T01:17:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7ffa38001670 con 0x7ffa4815e7f0 2024-09-16T01:17:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.816+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 >> v1:172.21.15.81:6789/0 conn(0x7ffa4815e7f0 legacy=0x7ffa480b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa45d9b640 1 --2- 172.21.15.81:0/4270931270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa340039b0 0x7ffa34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa45d9b640 1 --2- 172.21.15.81:0/4270931270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa340043b0 0x7ffa34004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa45d9b640 1 --2- 172.21.15.81:0/4270931270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa34005080 0x7ffa3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffa48071420 con 0x7ffa340039b0 2024-09-16T01:17:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3400bfe0 con 0x7ffa340043b0 2024-09-16T01:17:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3400c1e0 con 0x7ffa34005080 2024-09-16T01:17:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa4659c640 1 --2- 172.21.15.81:0/4270931270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa340039b0 0x7ffa34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa3dd9b640 1 --2- 172.21.15.81:0/4270931270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa340043b0 0x7ffa34004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa46d9d640 1 --2- 172.21.15.81:0/4270931270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa34005080 0x7ffa3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa4659c640 1 -- 172.21.15.81:0/4270931270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa34005080 msgr2=0x7ffa3400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa4659c640 1 --2- 172.21.15.81:0/4270931270 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa34005080 0x7ffa3400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa4659c640 1 -- 172.21.15.81:0/4270931270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa340043b0 msgr2=0x7ffa34004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa4659c640 1 --2- 172.21.15.81:0/4270931270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa340043b0 0x7ffa34004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa4659c640 1 -- 172.21.15.81:0/4270931270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa34003520 con 0x7ffa340039b0 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa46d9d640 1 -- 172.21.15.81:0/4270931270 reap_dead start 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.817+0000 7ffa3dd9b640 1 --2- 172.21.15.81:0/4270931270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa340043b0 0x7ffa34004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.818+0000 7ffa4659c640 1 --2- 172.21.15.81:0/4270931270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa340039b0 0x7ffa34003d90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800c240 tx=0x7ffa34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b38610317f4368 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.818+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3802e070 con 0x7ffa340039b0 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.818+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa38005af0 con 0x7ffa340039b0 2024-09-16T01:17:51.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.818+0000 7ffa45d9b640 1 -- 172.21.15.81:0/4270931270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38007d30 con 0x7ffa340039b0 2024-09-16T01:17:51.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.818+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/4270931270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa340039b0 msgr2=0x7ffa34003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:51.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.818+0000 7ffa4c8d7640 1 --2- 172.21.15.81:0/4270931270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa340039b0 0x7ffa34003d90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800c240 tx=0x7ffa34005830 comp rx=0 tx=0).stop 2024-09-16T01:17:51.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.818+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/4270931270 shutdown_connections 2024-09-16T01:17:51.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.818+0000 7ffa4c8d7640 1 --2- 172.21.15.81:0/4270931270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa340039b0 0x7ffa34003d90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:51.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.818+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/4270931270 >> 172.21.15.81:0/4270931270 conn(0x7ffa480b3f30 msgr2=0x7ffa480b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:51.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.818+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/4270931270 shutdown_connections 2024-09-16T01:17:51.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.818+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/4270931270 wait complete. 2024-09-16T01:17:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.820+0000 7ffa4c8d7640 1 Processor -- start 2024-09-16T01:17:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.820+0000 7ffa4c8d7640 1 -- start start 2024-09-16T01:17:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.820+0000 7ffa4c8d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa340039b0 0x7ffa481f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.820+0000 7ffa4c8d7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4815ebd0 0x7ffa4815f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.820+0000 7ffa4c8d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa48160f50 0x7ffa481613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa4c8d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffa480b60c0 con 0x7ffa48160f50 2024-09-16T01:17:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa4c8d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffa480b5f40 con 0x7ffa340039b0 2024-09-16T01:17:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa4c8d7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffa48070a70 con 0x7ffa4815ebd0 2024-09-16T01:17:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa46d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa48160f50 0x7ffa481613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:51.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa46d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa48160f50 0x7ffa481613d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38834/0 (socket says 172.21.15.81:38834) 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa46d9d640 1 -- 172.21.15.81:0/15274240 learned_addr learned my addr 172.21.15.81:0/15274240 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa4659c640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa340039b0 0x7ffa481f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa3dd9b640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4815ebd0 0x7ffa4815f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa46d9d640 1 -- 172.21.15.81:0/15274240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4815ebd0 msgr2=0x7ffa4815f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa46d9d640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4815ebd0 0x7ffa4815f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa46d9d640 1 -- 172.21.15.81:0/15274240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa340039b0 msgr2=0x7ffa481f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa46d9d640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa340039b0 0x7ffa481f3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa46d9d640 1 -- 172.21.15.81:0/15274240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4815f650 con 0x7ffa48160f50 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa46d9d640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa48160f50 0x7ffa481613d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffa480cecc0 tx=0x7ffa4000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa3f7fe640 1 -- 172.21.15.81:0/15274240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40003970 con 0x7ffa48160f50 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa3f7fe640 1 -- 172.21.15.81:0/15274240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa40018070 con 0x7ffa48160f50 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa3f7fe640 1 -- 172.21.15.81:0/15274240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40003d70 con 0x7ffa48160f50 2024-09-16T01:17:51.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/15274240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4815f930 con 0x7ffa48160f50 2024-09-16T01:17:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.821+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/15274240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4815fef0 con 0x7ffa48160f50 2024-09-16T01:17:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.822+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/15274240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa480b6d10 con 0x7ffa48160f50 2024-09-16T01:17:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.823+0000 7ffa3f7fe640 1 -- 172.21.15.81:0/15274240 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffa400050d0 con 0x7ffa48160f50 2024-09-16T01:17:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.823+0000 7ffa3f7fe640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffa2806c2b0 0x7ffa2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.823+0000 7ffa3f7fe640 1 -- 172.21.15.81:0/15274240 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 6187+0+0 (secure 0 0 0) 0x7ffa4008b2d0 con 0x7ffa48160f50 2024-09-16T01:17:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.823+0000 7ffa4659c640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffa2806c2b0 0x7ffa2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.824+0000 7ffa4659c640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffa2806c2b0 0x7ffa2806e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa38033000 tx=0x7ffa3802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:51.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.828+0000 7ffa3f7fe640 1 -- 172.21.15.81:0/15274240 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa40059210 con 0x7ffa48160f50 2024-09-16T01:17:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:51.993+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/15274240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ffa4806ead0 con 0x7ffa48160f50 2024-09-16T01:17:52.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.701+0000 7ffa3f7fe640 1 -- 172.21.15.81:0/15274240 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) ==== 181+0+0 (secure 0 0 0) 0x7ffa4005d510 con 0x7ffa48160f50 2024-09-16T01:17:52.702 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:17:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.704+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/15274240 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffa2806c2b0 msgr2=0x7ffa2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.704+0000 7ffa4c8d7640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffa2806c2b0 0x7ffa2806e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa38033000 tx=0x7ffa3802e000 comp rx=0 tx=0).stop 2024-09-16T01:17:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.704+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/15274240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa48160f50 msgr2=0x7ffa481613d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.704+0000 7ffa4c8d7640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa48160f50 0x7ffa481613d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ffa480cecc0 tx=0x7ffa4000ec00 comp rx=0 tx=0).stop 2024-09-16T01:17:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.704+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/15274240 shutdown_connections 2024-09-16T01:17:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.704+0000 7ffa4c8d7640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffa2806c2b0 0x7ffa2806e770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.704+0000 7ffa4c8d7640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa48160f50 0x7ffa481613d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.704+0000 7ffa4c8d7640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4815ebd0 0x7ffa4815f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.704+0000 7ffa4c8d7640 1 --2- 172.21.15.81:0/15274240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa340039b0 0x7ffa481f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.704+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/15274240 >> 172.21.15.81:0/15274240 conn(0x7ffa480b3f30 msgr2=0x7ffa4806dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.704+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/15274240 shutdown_connections 2024-09-16T01:17:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.704+0000 7ffa4c8d7640 1 -- 172.21.15.81:0/15274240 wait complete. 2024-09-16T01:17:52.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:17:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.832+0000 7fac6ff5f640 1 Processor -- start 2024-09-16T01:17:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.832+0000 7fac6ff5f640 1 -- start start 2024-09-16T01:17:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ff5f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fac68145e50 0x7fac680b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ff5f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac6815d350 0x7fac6806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ff5f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac6815d8a0 con 0x7fac6806c150 2024-09-16T01:17:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ff5f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fac680b7230 con 0x7fac68145e50 2024-09-16T01:17:52.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ff5f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fac680ae420 con 0x7fac6815d350 2024-09-16T01:17:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6e4fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fac6806c150 0x7fac6815e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56584/0 (socket says 172.21.15.81:56584) 2024-09-16T01:17:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6e4fc640 1 -- 172.21.15.81:0/2878205608 learned_addr learned my addr 172.21.15.81:0/2878205608 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6d4fa640 1 --2- 172.21.15.81:0/2878205608 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac6815d350 0x7fac6806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088267675 0 0) 0x7fac6815d8a0 con 0x7fac6806c150 2024-09-16T01:17:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6dcfb640 1 --2- 172.21.15.81:0/2878205608 >> v2:172.21.15.102:3300/0 conn(0x7fac68145e50 0x7fac680b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac54003520 con 0x7fac6806c150 2024-09-16T01:17:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1136330949 0 0) 0x7fac54003520 con 0x7fac6806c150 2024-09-16T01:17:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac6815d350 msgr2=0x7fac6806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ccf9640 1 --2- 172.21.15.81:0/2878205608 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac6815d350 0x7fac6806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 >> v2:172.21.15.102:3300/0 conn(0x7fac68145e50 msgr2=0x7fac680b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:52.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ccf9640 1 --2- 172.21.15.81:0/2878205608 >> v2:172.21.15.102:3300/0 conn(0x7fac68145e50 0x7fac680b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6815dba0 con 0x7fac6806c150 2024-09-16T01:17:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fac600019f0 con 0x7fac6806c150 2024-09-16T01:17:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6dcfb640 1 --2- 172.21.15.81:0/2878205608 >> v2:172.21.15.102:3300/0 conn(0x7fac68145e50 0x7fac680b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.833+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 >> v1:172.21.15.81:6789/0 conn(0x7fac6806c150 legacy=0x7fac6815e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6ccf9640 1 --2- 172.21.15.81:0/2878205608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac540039b0 0x7fac54003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6ccf9640 1 --2- 172.21.15.81:0/2878205608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac54004800 0x7fac54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6ccf9640 1 --2- 172.21.15.81:0/2878205608 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac6815d350 0x7fac540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac680b7230 con 0x7fac54004800 2024-09-16T01:17:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fac5400b9c0 con 0x7fac540039b0 2024-09-16T01:17:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fac5400bb70 con 0x7fac6815d350 2024-09-16T01:17:52.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6d4fa640 1 --2- 172.21.15.81:0/2878205608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac54004800 0x7fac54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:52.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6e4fc640 1 --2- 172.21.15.81:0/2878205608 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac6815d350 0x7fac540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:52.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6dcfb640 1 --2- 172.21.15.81:0/2878205608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac540039b0 0x7fac54003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:52.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6d4fa640 1 -- 172.21.15.81:0/2878205608 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac6815d350 msgr2=0x7fac540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:52.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6d4fa640 1 --2- 172.21.15.81:0/2878205608 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac6815d350 0x7fac540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:52.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6d4fa640 1 -- 172.21.15.81:0/2878205608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac540039b0 msgr2=0x7fac54003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:52.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6d4fa640 1 --2- 172.21.15.81:0/2878205608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac540039b0 0x7fac54003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:52.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.834+0000 7fac6d4fa640 1 -- 172.21.15.81:0/2878205608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac54003520 con 0x7fac54004800 2024-09-16T01:17:52.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.835+0000 7fac6d4fa640 1 --2- 172.21.15.81:0/2878205608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac54004800 0x7fac54004c80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fac58009a90 tx=0x7fac54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160d0a670c180f0b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:52.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.835+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58036070 con 0x7fac54004800 2024-09-16T01:17:52.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.835+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac58031400 con 0x7fac54004800 2024-09-16T01:17:52.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.835+0000 7fac6ccf9640 1 -- 172.21.15.81:0/2878205608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac58009690 con 0x7fac54004800 2024-09-16T01:17:52.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.835+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2878205608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac54004800 msgr2=0x7fac54004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:52.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.835+0000 7fac6ff5f640 1 --2- 172.21.15.81:0/2878205608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac54004800 0x7fac54004c80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fac58009a90 tx=0x7fac54005830 comp rx=0 tx=0).stop 2024-09-16T01:17:52.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.835+0000 7fac6e4fc640 1 -- 172.21.15.81:0/2878205608 reap_dead start 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.835+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2878205608 shutdown_connections 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.835+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2878205608 >> 172.21.15.81:0/2878205608 conn(0x7fac6809aa30 msgr2=0x7fac680b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.835+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2878205608 shutdown_connections 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.835+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2878205608 wait complete. 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.836+0000 7fac6ff5f640 1 Processor -- start 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.837+0000 7fac6ff5f640 1 -- start start 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.837+0000 7fac6ff5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac54004800 0x7fac681f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.837+0000 7fac6ff5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac680d0460 0x7fac6809e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.837+0000 7fac6ff5f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac68155e60 0x7fac681562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.837+0000 7fac6ff5f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac6815e160 con 0x7fac54004800 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.837+0000 7fac6ff5f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fac6815e4d0 con 0x7fac680d0460 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.837+0000 7fac6ff5f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fac6806bc10 con 0x7fac68155e60 2024-09-16T01:17:52.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.837+0000 7fac6dcfb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac54004800 0x7fac681f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.837+0000 7fac6dcfb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac54004800 0x7fac681f5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38864/0 (socket says 172.21.15.81:38864) 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.837+0000 7fac6dcfb640 1 -- 172.21.15.81:0/2716955210 learned_addr learned my addr 172.21.15.81:0/2716955210 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.837+0000 7fac6d4fa640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac680d0460 0x7fac6809e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.837+0000 7fac6e4fc640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac68155e60 0x7fac681562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.838+0000 7fac6dcfb640 1 -- 172.21.15.81:0/2716955210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac68155e60 msgr2=0x7fac681562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.838+0000 7fac6dcfb640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac68155e60 0x7fac681562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.838+0000 7fac6dcfb640 1 -- 172.21.15.81:0/2716955210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac680d0460 msgr2=0x7fac6809e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.838+0000 7fac6dcfb640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac680d0460 0x7fac6809e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.838+0000 7fac6dcfb640 1 -- 172.21.15.81:0/2716955210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6815a410 con 0x7fac54004800 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.838+0000 7fac6d4fa640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac680d0460 0x7fac6809e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.838+0000 7fac6dcfb640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac54004800 0x7fac681f5da0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fac640115d0 tx=0x7fac64011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.838+0000 7fac5e7fc640 1 -- 172.21.15.81:0/2716955210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64019070 con 0x7fac54004800 2024-09-16T01:17:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.838+0000 7fac5e7fc640 1 -- 172.21.15.81:0/2716955210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6400f9b0 con 0x7fac54004800 2024-09-16T01:17:52.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.838+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2716955210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac680d0c90 con 0x7fac54004800 2024-09-16T01:17:52.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.838+0000 7fac5e7fc640 1 -- 172.21.15.81:0/2716955210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6400f040 con 0x7fac54004800 2024-09-16T01:17:52.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.838+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2716955210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac680d1250 con 0x7fac54004800 2024-09-16T01:17:52.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.839+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2716955210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac680b0620 con 0x7fac54004800 2024-09-16T01:17:52.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.839+0000 7fac5e7fc640 1 -- 172.21.15.81:0/2716955210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fac6401c070 con 0x7fac54004800 2024-09-16T01:17:52.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.840+0000 7fac5e7fc640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fac4c06c2b0 0x7fac4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:52.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.840+0000 7fac6d4fa640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fac4c06c2b0 0x7fac4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:52.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.840+0000 7fac5e7fc640 1 -- 172.21.15.81:0/2716955210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5749+0+0 (secure 0 0 0) 0x7fac6408b6e0 con 0x7fac54004800 2024-09-16T01:17:52.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.841+0000 7fac6d4fa640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fac4c06c2b0 0x7fac4c06e770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fac58033000 tx=0x7fac58008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:52.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:52.844+0000 7fac5e7fc640 1 -- 172.21.15.81:0/2716955210 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac6815a410 con 0x7fac54004800 2024-09-16T01:17:53.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.015+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2716955210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fac6806dec0 con 0x7fac54004800 2024-09-16T01:17:53.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.702+0000 7fac5e7fc640 1 -- 172.21.15.81:0/2716955210 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7fac640597d0 con 0x7fac54004800 2024-09-16T01:17:53.703 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-16T01:17:53.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.705+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2716955210 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fac4c06c2b0 msgr2=0x7fac4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:53.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.705+0000 7fac6ff5f640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fac4c06c2b0 0x7fac4c06e770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fac58033000 tx=0x7fac58008030 comp rx=0 tx=0).stop 2024-09-16T01:17:53.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.705+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2716955210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac54004800 msgr2=0x7fac681f5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:53.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.705+0000 7fac6ff5f640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac54004800 0x7fac681f5da0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fac640115d0 tx=0x7fac64011a90 comp rx=0 tx=0).stop 2024-09-16T01:17:53.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.705+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2716955210 shutdown_connections 2024-09-16T01:17:53.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.705+0000 7fac6ff5f640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fac4c06c2b0 0x7fac4c06e770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:53.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.705+0000 7fac6ff5f640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fac68155e60 0x7fac681562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:53.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.705+0000 7fac6ff5f640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac680d0460 0x7fac6809e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:53.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.705+0000 7fac6ff5f640 1 --2- 172.21.15.81:0/2716955210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac54004800 0x7fac681f5da0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:53.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.705+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2716955210 >> 172.21.15.81:0/2716955210 conn(0x7fac6809aa30 msgr2=0x7fac680b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:53.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.705+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2716955210 shutdown_connections 2024-09-16T01:17:53.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.705+0000 7fac6ff5f640 1 -- 172.21.15.81:0/2716955210 wait complete. 2024-09-16T01:17:53.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-16T01:17:53.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.820+0000 7f4b690c9640 1 Processor -- start 2024-09-16T01:17:53.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.820+0000 7f4b690c9640 1 -- start start 2024-09-16T01:17:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b690c9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b6415b720 0x7f4b6415bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b690c9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4b640d0370 0x7f4b640d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b690c9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b640ae4e0 con 0x7f4b64155930 2024-09-16T01:17:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b690c9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4b640d0c90 con 0x7f4b6415b720 2024-09-16T01:17:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b690c9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4b6415c1e0 con 0x7f4b640d0370 2024-09-16T01:17:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b62d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4b64155930 0x7f4b640addd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56594/0 (socket says 172.21.15.81:56594) 2024-09-16T01:17:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b62d9d640 1 -- 172.21.15.81:0/1114543370 learned_addr learned my addr 172.21.15.81:0/1114543370 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b5a59c640 1 --2- 172.21.15.81:0/1114543370 >> v2:172.21.15.81:3300/0 conn(0x7f4b6415b720 0x7f4b6415bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b6359e640 1 --2- 172.21.15.81:0/1114543370 >> v2:172.21.15.102:3300/0 conn(0x7f4b640d0370 0x7f4b640d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b5a59c640 1 -- 172.21.15.81:0/1114543370 >> v2:172.21.15.102:3300/0 conn(0x7f4b640d0370 msgr2=0x7f4b640d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:53.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b5a59c640 1 --2- 172.21.15.81:0/1114543370 >> v2:172.21.15.102:3300/0 conn(0x7f4b640d0370 0x7f4b640d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b5a59c640 1 -- 172.21.15.81:0/1114543370 >> v1:172.21.15.81:6789/0 conn(0x7f4b64155930 legacy=0x7f4b640addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b5a59c640 1 -- 172.21.15.81:0/1114543370 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6415c4c0 con 0x7f4b6415b720 2024-09-16T01:17:53.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.821+0000 7f4b6259c640 1 -- 172.21.15.81:0/1114543370 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 843591930 0 0) 0x7f4b54001110 con 0x7f4b64155930 2024-09-16T01:17:53.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.822+0000 7f4b5a59c640 1 --2- 172.21.15.81:0/1114543370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6415b720 0x7f4b6415bbb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4b640d0f30 tx=0x7f4b4c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1434bfc8d84faa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:53.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.822+0000 7f4b6259c640 1 -- 172.21.15.81:0/1114543370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c037070 con 0x7f4b6415b720 2024-09-16T01:17:53.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.822+0000 7f4b6259c640 1 -- 172.21.15.81:0/1114543370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4c032440 con 0x7f4b6415b720 2024-09-16T01:17:53.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.822+0000 7f4b6259c640 1 -- 172.21.15.81:0/1114543370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c032810 con 0x7f4b6415b720 2024-09-16T01:17:53.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.823+0000 7f4b690c9640 1 -- 172.21.15.81:0/1114543370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6415b720 msgr2=0x7f4b6415bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:53.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.823+0000 7f4b690c9640 1 --2- 172.21.15.81:0/1114543370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6415b720 0x7f4b6415bbb0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4b640d0f30 tx=0x7f4b4c02a1a0 comp rx=0 tx=0).stop 2024-09-16T01:17:53.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.823+0000 7f4b690c9640 1 -- 172.21.15.81:0/1114543370 shutdown_connections 2024-09-16T01:17:53.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.823+0000 7f4b690c9640 1 --2- 172.21.15.81:0/1114543370 >> v2:172.21.15.102:3300/0 conn(0x7f4b640d0370 0x7f4b640d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:53.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.823+0000 7f4b690c9640 1 --2- 172.21.15.81:0/1114543370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6415b720 0x7f4b6415bbb0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:53.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.823+0000 7f4b690c9640 1 -- 172.21.15.81:0/1114543370 >> 172.21.15.81:0/1114543370 conn(0x7f4b6406bdf0 msgr2=0x7f4b6406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:53.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.823+0000 7f4b690c9640 1 -- 172.21.15.81:0/1114543370 shutdown_connections 2024-09-16T01:17:53.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.823+0000 7f4b690c9640 1 -- 172.21.15.81:0/1114543370 wait complete. 2024-09-16T01:17:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.824+0000 7f4b690c9640 1 Processor -- start 2024-09-16T01:17:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.824+0000 7f4b690c9640 1 -- start start 2024-09-16T01:17:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b690c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b640d0370 0x7f4b6414ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b690c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b64155930 0x7f4b6414ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b690c9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b6415b720 0x7f4b6414c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b690c9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6406f8b0 con 0x7f4b64155930 2024-09-16T01:17:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b690c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4b640b3620 con 0x7f4b640d0370 2024-09-16T01:17:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b690c9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6406fa30 con 0x7f4b6415b720 2024-09-16T01:17:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b5a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b64155930 0x7f4b6414ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:53.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b5a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b64155930 0x7f4b6414ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38870/0 (socket says 172.21.15.81:38870) 2024-09-16T01:17:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b5a59c640 1 -- 172.21.15.81:0/4198150491 learned_addr learned my addr 172.21.15.81:0/4198150491 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b62d9d640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b640d0370 0x7f4b6414ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b6359e640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b6415b720 0x7f4b6414c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b5a59c640 1 -- 172.21.15.81:0/4198150491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b6415b720 msgr2=0x7f4b6414c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b5a59c640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b6415b720 0x7f4b6414c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b5a59c640 1 -- 172.21.15.81:0/4198150491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b640d0370 msgr2=0x7f4b6414ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b5a59c640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b640d0370 0x7f4b6414ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b5a59c640 1 -- 172.21.15.81:0/4198150491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b641f1ee0 con 0x7f4b64155930 2024-09-16T01:17:53.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b6359e640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b6415b720 0x7f4b6414c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.825+0000 7f4b5a59c640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b64155930 0x7f4b6414ec20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c000c00 tx=0x7f4b4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.826+0000 7f4b5bfff640 1 -- 172.21.15.81:0/4198150491 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c037040 con 0x7f4b64155930 2024-09-16T01:17:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.826+0000 7f4b5bfff640 1 -- 172.21.15.81:0/4198150491 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4c042070 con 0x7f4b64155930 2024-09-16T01:17:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.826+0000 7f4b690c9640 1 -- 172.21.15.81:0/4198150491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6414f320 con 0x7f4b64155930 2024-09-16T01:17:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.826+0000 7f4b5bfff640 1 -- 172.21.15.81:0/4198150491 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c030bd0 con 0x7f4b64155930 2024-09-16T01:17:53.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.826+0000 7f4b690c9640 1 -- 172.21.15.81:0/4198150491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b640cd9b0 con 0x7f4b64155930 2024-09-16T01:17:53.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.827+0000 7f4b690c9640 1 -- 172.21.15.81:0/4198150491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b640d0750 con 0x7f4b64155930 2024-09-16T01:17:53.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.827+0000 7f4b5bfff640 1 -- 172.21.15.81:0/4198150491 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4b4c047460 con 0x7f4b64155930 2024-09-16T01:17:53.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.827+0000 7f4b5bfff640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4b4406c2b0 0x7f4b4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:53.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.828+0000 7f4b5bfff640 1 -- 172.21.15.81:0/4198150491 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f4b4c0abef0 con 0x7f4b64155930 2024-09-16T01:17:53.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.828+0000 7f4b62d9d640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4b4406c2b0 0x7f4b4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:53.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.828+0000 7f4b62d9d640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4b4406c2b0 0x7f4b4406e770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4b54000f60 tx=0x7f4b54007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:53.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:53.832+0000 7f4b5bfff640 1 -- 172.21.15.81:0/4198150491 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b4c032e20 con 0x7f4b64155930 2024-09-16T01:17:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.005+0000 7f4b690c9640 1 -- 172.21.15.81:0/4198150491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f4b640ae0f0 con 0x7f4b64155930 2024-09-16T01:17:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.009+0000 7f4b5bfff640 1 -- 172.21.15.81:0/4198150491 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f4b4c07a740 con 0x7f4b64155930 2024-09-16T01:17:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.011+0000 7f4b690c9640 1 -- 172.21.15.81:0/4198150491 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4b4406c2b0 msgr2=0x7f4b4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.011+0000 7f4b690c9640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4b4406c2b0 0x7f4b4406e770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4b54000f60 tx=0x7f4b54007b50 comp rx=0 tx=0).stop 2024-09-16T01:17:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.011+0000 7f4b690c9640 1 -- 172.21.15.81:0/4198150491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b64155930 msgr2=0x7f4b6414ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.011+0000 7f4b690c9640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b64155930 0x7f4b6414ec20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c000c00 tx=0x7f4b4c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.011+0000 7f4b690c9640 1 -- 172.21.15.81:0/4198150491 shutdown_connections 2024-09-16T01:17:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.011+0000 7f4b690c9640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4b4406c2b0 0x7f4b4406e770 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.011+0000 7f4b690c9640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b6415b720 0x7f4b6414c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.011+0000 7f4b690c9640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b64155930 0x7f4b6414ec20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.011+0000 7f4b690c9640 1 --2- 172.21.15.81:0/4198150491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b640d0370 0x7f4b6414ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.011+0000 7f4b690c9640 1 -- 172.21.15.81:0/4198150491 >> 172.21.15.81:0/4198150491 conn(0x7f4b6406bdf0 msgr2=0x7f4b6406c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.011+0000 7f4b690c9640 1 -- 172.21.15.81:0/4198150491 shutdown_connections 2024-09-16T01:17:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.011+0000 7f4b690c9640 1 -- 172.21.15.81:0/4198150491 wait complete. 2024-09-16T01:17:54.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid' 2024-09-16T01:17:54.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.122+0000 7f4d06549640 1 Processor -- start 2024-09-16T01:17:54.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.122+0000 7f4d06549640 1 -- start start 2024-09-16T01:17:54.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4d06549640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d000d0be0 0x7f4d000cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:54.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4d06549640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d0015d460 0x7f4d000afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:54.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4d06549640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d000af720 con 0x7f4d00145e00 2024-09-16T01:17:54.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4d06549640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4d001461e0 con 0x7f4d000d0be0 2024-09-16T01:17:54.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4d06549640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4d000cdf90 con 0x7f4d0015d460 2024-09-16T01:17:54.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4cff7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d000d0be0 0x7f4d000cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:54.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4cff7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d000d0be0 0x7f4d000cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38882/0 (socket says 172.21.15.81:38882) 2024-09-16T01:17:54.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4cff7fe640 1 -- 172.21.15.81:0/1269363077 learned_addr learned my addr 172.21.15.81:0/1269363077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:54.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4d04ae6640 1 --2- 172.21.15.81:0/1269363077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d0015d460 0x7f4d000afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:54.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4cff7fe640 1 -- 172.21.15.81:0/1269363077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d0015d460 msgr2=0x7f4d000afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:54.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4cff7fe640 1 --2- 172.21.15.81:0/1269363077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d0015d460 0x7f4d000afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4cff7fe640 1 -- 172.21.15.81:0/1269363077 >> v1:172.21.15.102:6789/0 conn(0x7f4d00145e00 legacy=0x7f4d000d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4cff7fe640 1 -- 172.21.15.81:0/1269363077 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d000ce270 con 0x7f4d000d0be0 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.123+0000 7f4d04ae6640 1 --2- 172.21.15.81:0/1269363077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d0015d460 0x7f4d000afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.124+0000 7f4cff7fe640 1 --2- 172.21.15.81:0/1269363077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d000d0be0 0x7f4d000cd8a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4d00156fe0 tx=0x7f4cf402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f361e51f728f2564 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.124+0000 7f4cfeffd640 1 -- 172.21.15.81:0/1269363077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4037070 con 0x7f4d000d0be0 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.124+0000 7f4cfeffd640 1 -- 172.21.15.81:0/1269363077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf4032440 con 0x7f4d000d0be0 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.124+0000 7f4cfeffd640 1 -- 172.21.15.81:0/1269363077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf4032810 con 0x7f4d000d0be0 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.124+0000 7f4d06549640 1 -- 172.21.15.81:0/1269363077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d000d0be0 msgr2=0x7f4d000cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.124+0000 7f4d06549640 1 --2- 172.21.15.81:0/1269363077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d000d0be0 0x7f4d000cd8a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4d00156fe0 tx=0x7f4cf402a1e0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.124+0000 7f4d06549640 1 -- 172.21.15.81:0/1269363077 shutdown_connections 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.124+0000 7f4d06549640 1 --2- 172.21.15.81:0/1269363077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d0015d460 0x7f4d000afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.124+0000 7f4d06549640 1 --2- 172.21.15.81:0/1269363077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d000d0be0 0x7f4d000cd8a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.124+0000 7f4d06549640 1 -- 172.21.15.81:0/1269363077 >> 172.21.15.81:0/1269363077 conn(0x7f4d000b2f40 msgr2=0x7f4d000b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:54.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.125+0000 7f4d06549640 1 -- 172.21.15.81:0/1269363077 shutdown_connections 2024-09-16T01:17:54.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.125+0000 7f4d06549640 1 -- 172.21.15.81:0/1269363077 wait complete. 2024-09-16T01:17:54.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.126+0000 7f4d06549640 1 Processor -- start 2024-09-16T01:17:54.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.126+0000 7f4d06549640 1 -- start start 2024-09-16T01:17:54.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.126+0000 7f4d06549640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d000d0be0 0x7f4d00156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:54.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d06549640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d00145e00 0x7f4d00157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d06549640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d0015d460 0x7f4d001e3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d06549640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0015d8b0 con 0x7f4d0015d460 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d06549640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4d000ce830 con 0x7f4d00145e00 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d06549640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4d000cede0 con 0x7f4d000d0be0 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d04ae6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d0015d460 0x7f4d001e3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d04ae6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d0015d460 0x7f4d001e3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38898/0 (socket says 172.21.15.81:38898) 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d04ae6640 1 -- 172.21.15.81:0/1100043795 learned_addr learned my addr 172.21.15.81:0/1100043795 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4cff7fe640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d00145e00 0x7f4d00157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4cfffff640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d000d0be0 0x7f4d00156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d04ae6640 1 -- 172.21.15.81:0/1100043795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d000d0be0 msgr2=0x7f4d00156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d04ae6640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d000d0be0 0x7f4d00156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d04ae6640 1 -- 172.21.15.81:0/1100043795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d00145e00 msgr2=0x7f4d00157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:54.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d04ae6640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d00145e00 0x7f4d00157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d04ae6640 1 -- 172.21.15.81:0/1100043795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d000b49a0 con 0x7f4d0015d460 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d04ae6640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d0015d460 0x7f4d001e3660 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800cd50 tx=0x7f4cf800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4cfcff9640 1 -- 172.21.15.81:0/1100043795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800f680 con 0x7f4d0015d460 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4cfcff9640 1 -- 172.21.15.81:0/1100043795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf800f840 con 0x7f4d0015d460 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d06549640 1 -- 172.21.15.81:0/1100043795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d000b4c80 con 0x7f4d0015d460 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4cfcff9640 1 -- 172.21.15.81:0/1100043795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800fc30 con 0x7f4d0015d460 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.127+0000 7f4d06549640 1 -- 172.21.15.81:0/1100043795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d000b5240 con 0x7f4d0015d460 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.128+0000 7f4d06549640 1 -- 172.21.15.81:0/1100043795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d00068c60 con 0x7f4d0015d460 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.129+0000 7f4cfcff9640 1 -- 172.21.15.81:0/1100043795 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4cf80213f0 con 0x7f4d0015d460 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.129+0000 7f4cfcff9640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4cec06c2b0 0x7f4cec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.129+0000 7f4cfcff9640 1 -- 172.21.15.81:0/1100043795 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f4cf808bf60 con 0x7f4d0015d460 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.129+0000 7f4cfffff640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4cec06c2b0 0x7f4cec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:54.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.130+0000 7f4cfffff640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4cec06c2b0 0x7f4cec06e770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0004f60 tx=0x7f4cf0007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:54.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.133+0000 7f4cfcff9640 1 -- 172.21.15.81:0/1100043795 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d00068c60 con 0x7f4d0015d460 2024-09-16T01:17:54.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.363+0000 7f4d06549640 1 -- 172.21.15.81:0/1100043795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]} v 0) -- 0x7f4d000cd8a0 con 0x7f4d0015d460 2024-09-16T01:17:54.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.709+0000 7f4cfcff9640 1 -- 172.21.15.81:0/1100043795 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]}]=0 v133) ==== 162+0+0 (secure 0 0 0) 0x7f4cf8014030 con 0x7f4d0015d460 2024-09-16T01:17:54.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.711+0000 7f4d06549640 1 -- 172.21.15.81:0/1100043795 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4cec06c2b0 msgr2=0x7f4cec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.711+0000 7f4d06549640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4cec06c2b0 0x7f4cec06e770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0004f60 tx=0x7f4cf0007e30 comp rx=0 tx=0).stop 2024-09-16T01:17:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.711+0000 7f4d06549640 1 -- 172.21.15.81:0/1100043795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d0015d460 msgr2=0x7f4d001e3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.711+0000 7f4d06549640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d0015d460 0x7f4d001e3660 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800cd50 tx=0x7f4cf800a650 comp rx=0 tx=0).stop 2024-09-16T01:17:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.711+0000 7f4d06549640 1 -- 172.21.15.81:0/1100043795 shutdown_connections 2024-09-16T01:17:54.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.711+0000 7f4d06549640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4cec06c2b0 0x7f4cec06e770 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.711+0000 7f4d06549640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d0015d460 0x7f4d001e3660 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.711+0000 7f4d06549640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d00145e00 0x7f4d00157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.711+0000 7f4d06549640 1 --2- 172.21.15.81:0/1100043795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d000d0be0 0x7f4d00156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.711+0000 7f4d06549640 1 -- 172.21.15.81:0/1100043795 >> 172.21.15.81:0/1100043795 conn(0x7f4d000b2f40 msgr2=0x7f4d0013ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:54.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.711+0000 7f4d06549640 1 -- 172.21.15.81:0/1100043795 shutdown_connections 2024-09-16T01:17:54.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.711+0000 7f4d06549640 1 -- 172.21.15.81:0/1100043795 wait complete. 2024-09-16T01:17:54.724 INFO:tasks.cephfs_test_runner:that a client is blocklisted when its encoded session metadata exceeds the ... skipped 'Require FUSE client to inject client release failure' 2024-09-16T01:17:54.724 INFO:tasks.cephfs_test_runner:Starting test: test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-16T01:17:54.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:17:54.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.826+0000 7f9afadb9640 1 Processor -- start 2024-09-16T01:17:54.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.826+0000 7f9afadb9640 1 -- start start 2024-09-16T01:17:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.826+0000 7f9afadb9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9af4161c80 0x7f9af406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.826+0000 7f9afadb9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9af40b6680 0x7f9af40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.826+0000 7f9afadb9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9af406e870 con 0x7f9af4162060 2024-09-16T01:17:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.826+0000 7f9afadb9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9af406d9f0 con 0x7f9af4161c80 2024-09-16T01:17:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.826+0000 7f9afadb9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9af406dcd0 con 0x7f9af40b6680 2024-09-16T01:17:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.827+0000 7f9af8b55640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9af4161c80 0x7f9af406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.827+0000 7f9af3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9af4162060 0x7f9af40b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56600/0 (socket says 172.21.15.81:56600) 2024-09-16T01:17:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.827+0000 7f9af3fff640 1 -- 172.21.15.81:0/108326136 learned_addr learned my addr 172.21.15.81:0/108326136 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.827+0000 7f9af9356640 1 --2- 172.21.15.81:0/108326136 >> v2:172.21.15.102:3300/0 conn(0x7f9af40b6680 0x7f9af40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.827+0000 7f9af8b55640 1 -- 172.21.15.81:0/108326136 >> v2:172.21.15.102:3300/0 conn(0x7f9af40b6680 msgr2=0x7f9af40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.827+0000 7f9af8b55640 1 --2- 172.21.15.81:0/108326136 >> v2:172.21.15.102:3300/0 conn(0x7f9af40b6680 0x7f9af40cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.827+0000 7f9af8b55640 1 -- 172.21.15.81:0/108326136 >> v1:172.21.15.81:6789/0 conn(0x7f9af4162060 legacy=0x7f9af40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.827+0000 7f9af8b55640 1 -- 172.21.15.81:0/108326136 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af406dfb0 con 0x7f9af4161c80 2024-09-16T01:17:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.827+0000 7f9af9356640 1 --2- 172.21.15.81:0/108326136 >> v2:172.21.15.102:3300/0 conn(0x7f9af40b6680 0x7f9af40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.828+0000 7f9af8b55640 1 --2- 172.21.15.81:0/108326136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af4161c80 0x7f9af406e330 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9af408d750 tx=0x7f9ae802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15815dd3ea68f2fe server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.828+0000 7f9af37fe640 1 -- 172.21.15.81:0/108326136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8037070 con 0x7f9af4161c80 2024-09-16T01:17:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.828+0000 7f9af37fe640 1 -- 172.21.15.81:0/108326136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae8032440 con 0x7f9af4161c80 2024-09-16T01:17:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.828+0000 7f9af37fe640 1 -- 172.21.15.81:0/108326136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8032810 con 0x7f9af4161c80 2024-09-16T01:17:54.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.829+0000 7f9afadb9640 1 -- 172.21.15.81:0/108326136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af4161c80 msgr2=0x7f9af406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:54.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.829+0000 7f9afadb9640 1 --2- 172.21.15.81:0/108326136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af4161c80 0x7f9af406e330 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9af408d750 tx=0x7f9ae802a1a0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.829+0000 7f9afadb9640 1 -- 172.21.15.81:0/108326136 shutdown_connections 2024-09-16T01:17:54.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.829+0000 7f9afadb9640 1 --2- 172.21.15.81:0/108326136 >> v2:172.21.15.102:3300/0 conn(0x7f9af40b6680 0x7f9af40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.829+0000 7f9afadb9640 1 --2- 172.21.15.81:0/108326136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af4161c80 0x7f9af406e330 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.829+0000 7f9afadb9640 1 -- 172.21.15.81:0/108326136 >> 172.21.15.81:0/108326136 conn(0x7f9af40d44f0 msgr2=0x7f9af40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:54.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.829+0000 7f9afadb9640 1 -- 172.21.15.81:0/108326136 shutdown_connections 2024-09-16T01:17:54.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.829+0000 7f9afadb9640 1 -- 172.21.15.81:0/108326136 wait complete. 2024-09-16T01:17:54.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.830+0000 7f9afadb9640 1 Processor -- start 2024-09-16T01:17:54.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.830+0000 7f9afadb9640 1 -- start start 2024-09-16T01:17:54.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9afadb9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b6680 0x7f9af4159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:54.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9afadb9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9af4161c80 0x7f9af40b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:54.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9afadb9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9af4162060 0x7f9af40b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:54.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9afadb9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9af40b6b30 con 0x7f9af40b6680 2024-09-16T01:17:54.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9afadb9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9af40d2aa0 con 0x7f9af4161c80 2024-09-16T01:17:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9afadb9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9af40b6cb0 con 0x7f9af4162060 2024-09-16T01:17:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af8b55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b6680 0x7f9af4159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af8b55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b6680 0x7f9af4159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38912/0 (socket says 172.21.15.81:38912) 2024-09-16T01:17:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af8b55640 1 -- 172.21.15.81:0/2825977839 learned_addr learned my addr 172.21.15.81:0/2825977839 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af9356640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9af4162060 0x7f9af40b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af3fff640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9af4161c80 0x7f9af40b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af8b55640 1 -- 172.21.15.81:0/2825977839 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9af4162060 msgr2=0x7f9af40b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af8b55640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9af4162060 0x7f9af40b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af8b55640 1 -- 172.21.15.81:0/2825977839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9af4161c80 msgr2=0x7f9af40b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af8b55640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9af4161c80 0x7f9af40b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af8b55640 1 -- 172.21.15.81:0/2825977839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9af4159fe0 con 0x7f9af40b6680 2024-09-16T01:17:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af8b55640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b6680 0x7f9af4159aa0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000c00 tx=0x7f9ae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af17fa640 1 -- 172.21.15.81:0/2825977839 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8037040 con 0x7f9af40b6680 2024-09-16T01:17:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af17fa640 1 -- 172.21.15.81:0/2825977839 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ae8042070 con 0x7f9af40b6680 2024-09-16T01:17:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9afadb9640 1 -- 172.21.15.81:0/2825977839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9af40cc720 con 0x7f9af40b6680 2024-09-16T01:17:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9af17fa640 1 -- 172.21.15.81:0/2825977839 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8030bd0 con 0x7f9af40b6680 2024-09-16T01:17:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.831+0000 7f9afadb9640 1 -- 172.21.15.81:0/2825977839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9af40ccce0 con 0x7f9af40b6680 2024-09-16T01:17:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.833+0000 7f9afadb9640 1 -- 172.21.15.81:0/2825977839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af40cb320 con 0x7f9af40b6680 2024-09-16T01:17:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.833+0000 7f9af17fa640 1 -- 172.21.15.81:0/2825977839 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9ae8047460 con 0x7f9af40b6680 2024-09-16T01:17:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.833+0000 7f9af17fa640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9ad806c2b0 0x7f9ad806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.833+0000 7f9af17fa640 1 -- 172.21.15.81:0/2825977839 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f9ae80abe00 con 0x7f9af40b6680 2024-09-16T01:17:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.833+0000 7f9af3fff640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9ad806c2b0 0x7f9ad806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:54.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.834+0000 7f9af3fff640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9ad806c2b0 0x7f9ad806e770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9af40cfd90 tx=0x7f9ae0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:54.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:54.838+0000 7f9af17fa640 1 -- 172.21.15.81:0/2825977839 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9af40cb320 con 0x7f9af40b6680 2024-09-16T01:17:55.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.003+0000 7f9afadb9640 1 -- 172.21.15.81:0/2825977839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9af40d3ab0 con 0x7f9af40b6680 2024-09-16T01:17:55.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.004+0000 7f9af17fa640 1 -- 172.21.15.81:0/2825977839 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+13303 (secure 0 0 0) 0x7f9ae8032e20 con 0x7f9af40b6680 2024-09-16T01:17:55.005 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:55.005 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:17:53.701592+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:6834/52529574":"2024-09-17T01:17:50.693269+0000","172.21.15.102:6832/52529574":"2024-09-17T01:17:50.693269+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:17:55.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.006+0000 7f9afadb9640 1 -- 172.21.15.81:0/2825977839 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9ad806c2b0 msgr2=0x7f9ad806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.006+0000 7f9afadb9640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9ad806c2b0 0x7f9ad806e770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9af40cfd90 tx=0x7f9ae0009040 comp rx=0 tx=0).stop 2024-09-16T01:17:55.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.006+0000 7f9afadb9640 1 -- 172.21.15.81:0/2825977839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b6680 msgr2=0x7f9af4159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.006+0000 7f9afadb9640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b6680 0x7f9af4159aa0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000c00 tx=0x7f9ae80046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.006+0000 7f9afadb9640 1 -- 172.21.15.81:0/2825977839 shutdown_connections 2024-09-16T01:17:55.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.006+0000 7f9afadb9640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9ad806c2b0 0x7f9ad806e770 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.006+0000 7f9afadb9640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9af4162060 0x7f9af40b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.006+0000 7f9afadb9640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9af4161c80 0x7f9af40b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.006+0000 7f9afadb9640 1 --2- 172.21.15.81:0/2825977839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b6680 0x7f9af4159aa0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.006+0000 7f9afadb9640 1 -- 172.21.15.81:0/2825977839 >> 172.21.15.81:0/2825977839 conn(0x7f9af40d44f0 msgr2=0x7f9af40b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.006+0000 7f9afadb9640 1 -- 172.21.15.81:0/2825977839 shutdown_connections 2024-09-16T01:17:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.006+0000 7f9afadb9640 1 -- 172.21.15.81:0/2825977839 wait complete. 2024-09-16T01:17:55.018 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:15:28.088452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:17:55.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:17:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.159+0000 7f3781af8640 1 Processor -- start 2024-09-16T01:17:55.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.159+0000 7f3781af8640 1 -- start start 2024-09-16T01:17:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f3781af8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f377c159ce0 0x7f377c15d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f3781af8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f377c0b5f10 0x7f377c0b6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f3781af8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f377c15d730 con 0x7f377c06e6c0 2024-09-16T01:17:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f3781af8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f377c0b6880 con 0x7f377c0b5f10 2024-09-16T01:17:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f3781af8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f377c0700b0 con 0x7f377c159ce0 2024-09-16T01:17:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f377affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f377c0b5f10 0x7f377c0b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f377affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f377c0b5f10 0x7f377c0b6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38916/0 (socket says 172.21.15.81:38916) 2024-09-16T01:17:55.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f377bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f377c06e6c0 0x7f377c06eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56606/0 (socket says 172.21.15.81:56606) 2024-09-16T01:17:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f377affd640 1 -- 172.21.15.81:0/1791557840 learned_addr learned my addr 172.21.15.81:0/1791557840 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f377b7fe640 1 --2- 172.21.15.81:0/1791557840 >> v2:172.21.15.102:3300/0 conn(0x7f377c159ce0 0x7f377c15d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f377affd640 1 -- 172.21.15.81:0/1791557840 >> v2:172.21.15.102:3300/0 conn(0x7f377c159ce0 msgr2=0x7f377c15d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f377affd640 1 --2- 172.21.15.81:0/1791557840 >> v2:172.21.15.102:3300/0 conn(0x7f377c159ce0 0x7f377c15d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f377affd640 1 -- 172.21.15.81:0/1791557840 >> v1:172.21.15.81:6789/0 conn(0x7f377c06e6c0 legacy=0x7f377c06eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f377affd640 1 -- 172.21.15.81:0/1791557840 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377c1601b0 con 0x7f377c0b5f10 2024-09-16T01:17:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f377a7fc640 1 -- 172.21.15.81:0/1791557840 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595824152 0 0) 0x7f377c15d730 con 0x7f377c06e6c0 2024-09-16T01:17:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.160+0000 7f377b7fe640 1 --2- 172.21.15.81:0/1791557840 >> v2:172.21.15.102:3300/0 conn(0x7f377c159ce0 0x7f377c15d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.161+0000 7f377affd640 1 --2- 172.21.15.81:0/1791557840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377c0b5f10 0x7f377c0b6340 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3770009870 tx=0x7f377002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5008513be3fa8809 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.161+0000 7f377a7fc640 1 -- 172.21.15.81:0/1791557840 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3770037070 con 0x7f377c0b5f10 2024-09-16T01:17:55.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.161+0000 7f377a7fc640 1 -- 172.21.15.81:0/1791557840 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3770032440 con 0x7f377c0b5f10 2024-09-16T01:17:55.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.161+0000 7f377a7fc640 1 -- 172.21.15.81:0/1791557840 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3770032810 con 0x7f377c0b5f10 2024-09-16T01:17:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.162+0000 7f3781af8640 1 -- 172.21.15.81:0/1791557840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377c0b5f10 msgr2=0x7f377c0b6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.162+0000 7f3781af8640 1 --2- 172.21.15.81:0/1791557840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377c0b5f10 0x7f377c0b6340 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3770009870 tx=0x7f377002a180 comp rx=0 tx=0).stop 2024-09-16T01:17:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.162+0000 7f3781af8640 1 -- 172.21.15.81:0/1791557840 shutdown_connections 2024-09-16T01:17:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.162+0000 7f3781af8640 1 --2- 172.21.15.81:0/1791557840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377c0b5f10 0x7f377c0b6340 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.162+0000 7f3781af8640 1 --2- 172.21.15.81:0/1791557840 >> v2:172.21.15.102:3300/0 conn(0x7f377c159ce0 0x7f377c15d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.162+0000 7f3781af8640 1 -- 172.21.15.81:0/1791557840 >> 172.21.15.81:0/1791557840 conn(0x7f377c073590 msgr2=0x7f377c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.162+0000 7f3781af8640 1 -- 172.21.15.81:0/1791557840 shutdown_connections 2024-09-16T01:17:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.162+0000 7f3781af8640 1 -- 172.21.15.81:0/1791557840 wait complete. 2024-09-16T01:17:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.163+0000 7f3781af8640 1 Processor -- start 2024-09-16T01:17:55.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.163+0000 7f3781af8640 1 -- start start 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f3781af8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377c06e6c0 0x7f377c1f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f3781af8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f377c0b5f10 0x7f377c1f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f3781af8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f377c159ce0 0x7f377c157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f3781af8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f377c160a50 con 0x7f377c06e6c0 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f3781af8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f377c160770 con 0x7f377c0b5f10 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f3781af8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f377c15a0c0 con 0x7f377c159ce0 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f377b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377c06e6c0 0x7f377c1f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f377b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377c06e6c0 0x7f377c1f20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38926/0 (socket says 172.21.15.81:38926) 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f377b7fe640 1 -- 172.21.15.81:0/742520995 learned_addr learned my addr 172.21.15.81:0/742520995 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f377affd640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f377c0b5f10 0x7f377c1f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f377bfff640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f377c159ce0 0x7f377c157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f377b7fe640 1 -- 172.21.15.81:0/742520995 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f377c159ce0 msgr2=0x7f377c157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f377b7fe640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f377c159ce0 0x7f377c157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f377b7fe640 1 -- 172.21.15.81:0/742520995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f377c0b5f10 msgr2=0x7f377c1f5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f377b7fe640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f377c0b5f10 0x7f377c1f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f377b7fe640 1 -- 172.21.15.81:0/742520995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377c154570 con 0x7f377c06e6c0 2024-09-16T01:17:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.164+0000 7f377b7fe640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377c06e6c0 0x7f377c1f20f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f376c00c7f0 tx=0x7f376c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.165+0000 7f3763fff640 1 -- 172.21.15.81:0/742520995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c015070 con 0x7f377c06e6c0 2024-09-16T01:17:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.165+0000 7f3763fff640 1 -- 172.21.15.81:0/742520995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376c007a30 con 0x7f377c06e6c0 2024-09-16T01:17:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.165+0000 7f3781af8640 1 -- 172.21.15.81:0/742520995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377c1f5f60 con 0x7f377c06e6c0 2024-09-16T01:17:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.165+0000 7f3763fff640 1 -- 172.21.15.81:0/742520995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c007e00 con 0x7f377c06e6c0 2024-09-16T01:17:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.165+0000 7f3781af8640 1 -- 172.21.15.81:0/742520995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f377c1f5c50 con 0x7f377c06e6c0 2024-09-16T01:17:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.166+0000 7f3781af8640 1 -- 172.21.15.81:0/742520995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f377c15fda0 con 0x7f377c06e6c0 2024-09-16T01:17:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.166+0000 7f3763fff640 1 -- 172.21.15.81:0/742520995 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f376c018070 con 0x7f377c06e6c0 2024-09-16T01:17:55.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.166+0000 7f3763fff640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f376806c2b0 0x7f376806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.167+0000 7f3763fff640 1 -- 172.21.15.81:0/742520995 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f376c08b1f0 con 0x7f377c06e6c0 2024-09-16T01:17:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.167+0000 7f377affd640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f376806c2b0 0x7f376806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.167+0000 7f377affd640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f376806c2b0 0x7f376806e770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3770034000 tx=0x7f377002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:55.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.171+0000 7f3763fff640 1 -- 172.21.15.81:0/742520995 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f376c059b60 con 0x7f377c06e6c0 2024-09-16T01:17:55.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.335+0000 7f3781af8640 1 -- 172.21.15.81:0/742520995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f377c067d60 con 0x7f377c06e6c0 2024-09-16T01:17:55.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.336+0000 7f3763fff640 1 -- 172.21.15.81:0/742520995 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) ==== 93+0+10 (secure 0 0 0) 0x7f376c059460 con 0x7f377c06e6c0 2024-09-16T01:17:55.337 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-16T01:17:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.338+0000 7f3781af8640 1 -- 172.21.15.81:0/742520995 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f376806c2b0 msgr2=0x7f376806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.338+0000 7f3781af8640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f376806c2b0 0x7f376806e770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3770034000 tx=0x7f377002e000 comp rx=0 tx=0).stop 2024-09-16T01:17:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.338+0000 7f3781af8640 1 -- 172.21.15.81:0/742520995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377c06e6c0 msgr2=0x7f377c1f20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.338+0000 7f3781af8640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377c06e6c0 0x7f377c1f20f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f376c00c7f0 tx=0x7f376c00cbf0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.338+0000 7f3781af8640 1 -- 172.21.15.81:0/742520995 shutdown_connections 2024-09-16T01:17:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.338+0000 7f3781af8640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f376806c2b0 0x7f376806e770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.338+0000 7f3781af8640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f377c159ce0 0x7f377c157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.338+0000 7f3781af8640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f377c0b5f10 0x7f377c1f5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.338+0000 7f3781af8640 1 --2- 172.21.15.81:0/742520995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f377c06e6c0 0x7f377c1f20f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.338+0000 7f3781af8640 1 -- 172.21.15.81:0/742520995 >> 172.21.15.81:0/742520995 conn(0x7f377c073590 msgr2=0x7f377c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.338+0000 7f3781af8640 1 -- 172.21.15.81:0/742520995 shutdown_connections 2024-09-16T01:17:55.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.338+0000 7f3781af8640 1 -- 172.21.15.81:0/742520995 wait complete. 2024-09-16T01:17:55.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size' 2024-09-16T01:17:55.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.447+0000 7f4666de4640 1 Processor -- start 2024-09-16T01:17:55.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.447+0000 7f4666de4640 1 -- start start 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.448+0000 7f4666de4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4660162060 0x7f46600b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.448+0000 7f4666de4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466006d9f0 con 0x7f46600b64b0 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.448+0000 7f4666de4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466006dcd0 con 0x7f4660161c80 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.448+0000 7f4666de4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f466006dfb0 con 0x7f4660162060 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.448+0000 7f4665381640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f46600b64b0 0x7f46600cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56614/0 (socket says 172.21.15.81:56614) 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.448+0000 7f4665381640 1 -- 172.21.15.81:0/380789574 learned_addr learned my addr 172.21.15.81:0/380789574 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.449+0000 7f4657fff640 1 --2- 172.21.15.81:0/380789574 >> v2:172.21.15.102:3300/0 conn(0x7f4660162060 0x7f46600b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.449+0000 7f46577fe640 1 -- 172.21.15.81:0/380789574 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618917163 0 0) 0x7f466006d9f0 con 0x7f46600b64b0 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.449+0000 7f46577fe640 1 -- 172.21.15.81:0/380789574 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4648003520 con 0x7f46600b64b0 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.449+0000 7f4657fff640 1 -- 172.21.15.81:0/380789574 >> v1:172.21.15.102:6789/0 conn(0x7f4660161c80 legacy=0x7f466006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.449+0000 7f4657fff640 1 -- 172.21.15.81:0/380789574 >> v1:172.21.15.81:6789/0 conn(0x7f46600b64b0 legacy=0x7f46600cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.449+0000 7f46577fe640 1 -- 172.21.15.81:0/380789574 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2540437861 0 0) 0x7f4648003520 con 0x7f46600b64b0 2024-09-16T01:17:55.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.449+0000 7f4657fff640 1 -- 172.21.15.81:0/380789574 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46600d2890 con 0x7f4660162060 2024-09-16T01:17:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.450+0000 7f4657fff640 1 --2- 172.21.15.81:0/380789574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4660162060 0x7f46600b5f70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f46500097a0 tx=0x7f465002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a329bb93050f260c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.450+0000 7f46577fe640 1 -- 172.21.15.81:0/380789574 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4650037070 con 0x7f4660162060 2024-09-16T01:17:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.450+0000 7f46577fe640 1 -- 172.21.15.81:0/380789574 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f465002ac50 con 0x7f4660162060 2024-09-16T01:17:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.450+0000 7f46577fe640 1 -- 172.21.15.81:0/380789574 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580019f0 con 0x7f4660162060 2024-09-16T01:17:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.450+0000 7f4666de4640 1 -- 172.21.15.81:0/380789574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4660162060 msgr2=0x7f46600b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.450+0000 7f4666de4640 1 --2- 172.21.15.81:0/380789574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4660162060 0x7f46600b5f70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f46500097a0 tx=0x7f465002a1c0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.450+0000 7f4666de4640 1 -- 172.21.15.81:0/380789574 shutdown_connections 2024-09-16T01:17:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.450+0000 7f4666de4640 1 --2- 172.21.15.81:0/380789574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4660162060 0x7f46600b5f70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.450+0000 7f4666de4640 1 -- 172.21.15.81:0/380789574 >> 172.21.15.81:0/380789574 conn(0x7f46600d44f0 msgr2=0x7f46600d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.450+0000 7f4666de4640 1 -- 172.21.15.81:0/380789574 shutdown_connections 2024-09-16T01:17:55.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.450+0000 7f4666de4640 1 -- 172.21.15.81:0/380789574 wait complete. 2024-09-16T01:17:55.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.452+0000 7f4666de4640 1 Processor -- start 2024-09-16T01:17:55.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.452+0000 7f4666de4640 1 -- start start 2024-09-16T01:17:55.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.452+0000 7f4666de4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46600b64b0 0x7f46600c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.452+0000 7f4666de4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4660161c80 0x7f46600cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.452+0000 7f4666de4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4660162060 0x7f46600cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4666de4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46600b6d30 con 0x7f4660161c80 2024-09-16T01:17:55.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4666de4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f46600b6bb0 con 0x7f46600b64b0 2024-09-16T01:17:55.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4666de4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f46600cf8f0 con 0x7f4660162060 2024-09-16T01:17:55.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4657fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4660161c80 0x7f46600cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4657fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4660161c80 0x7f46600cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38942/0 (socket says 172.21.15.81:38942) 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4657fff640 1 -- 172.21.15.81:0/943004969 learned_addr learned my addr 172.21.15.81:0/943004969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4664b80640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46600b64b0 0x7f46600c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4665381640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4660162060 0x7f46600cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4657fff640 1 -- 172.21.15.81:0/943004969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4660162060 msgr2=0x7f46600cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4657fff640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4660162060 0x7f46600cfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4657fff640 1 -- 172.21.15.81:0/943004969 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46600b64b0 msgr2=0x7f46600c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4657fff640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46600b64b0 0x7f46600c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4657fff640 1 -- 172.21.15.81:0/943004969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46601456c0 con 0x7f4660161c80 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4665381640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4660162060 0x7f46600cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4657fff640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4660161c80 0x7f46600cd280 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4650035040 tx=0x7f46500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f46557fa640 1 -- 172.21.15.81:0/943004969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4650037050 con 0x7f4660161c80 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f46557fa640 1 -- 172.21.15.81:0/943004969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4650043070 con 0x7f4660161c80 2024-09-16T01:17:55.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f46557fa640 1 -- 172.21.15.81:0/943004969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4650006e10 con 0x7f4660161c80 2024-09-16T01:17:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4666de4640 1 -- 172.21.15.81:0/943004969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46600cdcb0 con 0x7f4660161c80 2024-09-16T01:17:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.453+0000 7f4666de4640 1 -- 172.21.15.81:0/943004969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46600c78e0 con 0x7f4660161c80 2024-09-16T01:17:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.454+0000 7f4666de4640 1 -- 172.21.15.81:0/943004969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f466006d9f0 con 0x7f4660161c80 2024-09-16T01:17:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.455+0000 7f46557fa640 1 -- 172.21.15.81:0/943004969 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f465003c810 con 0x7f4660161c80 2024-09-16T01:17:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.455+0000 7f46557fa640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f464c06c2b0 0x7f464c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.455+0000 7f46557fa640 1 -- 172.21.15.81:0/943004969 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f46500abc50 con 0x7f4660161c80 2024-09-16T01:17:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.455+0000 7f4664b80640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f464c06c2b0 0x7f464c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.456+0000 7f4664b80640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f464c06c2b0 0x7f464c06e770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f465c000f60 tx=0x7f465c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:55.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.459+0000 7f46557fa640 1 -- 172.21.15.81:0/943004969 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46500b1020 con 0x7f4660161c80 2024-09-16T01:17:55.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.687+0000 7f4666de4640 1 -- 172.21.15.81:0/943004969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]} v 0) -- 0x7f46600ba470 con 0x7f4660161c80 2024-09-16T01:17:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.710+0000 7f46557fa640 1 -- 172.21.15.81:0/943004969 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]}]=0 v134) ==== 153+0+0 (secure 0 0 0) 0x7f465007a650 con 0x7f4660161c80 2024-09-16T01:17:55.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.712+0000 7f4666de4640 1 -- 172.21.15.81:0/943004969 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f464c06c2b0 msgr2=0x7f464c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.712+0000 7f4666de4640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f464c06c2b0 0x7f464c06e770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f465c000f60 tx=0x7f465c009040 comp rx=0 tx=0).stop 2024-09-16T01:17:55.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.712+0000 7f4666de4640 1 -- 172.21.15.81:0/943004969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4660161c80 msgr2=0x7f46600cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.712+0000 7f4666de4640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4660161c80 0x7f46600cd280 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4650035040 tx=0x7f46500046c0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.712+0000 7f4666de4640 1 -- 172.21.15.81:0/943004969 shutdown_connections 2024-09-16T01:17:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.712+0000 7f4666de4640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f464c06c2b0 0x7f464c06e770 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.712+0000 7f4666de4640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4660162060 0x7f46600cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.712+0000 7f4666de4640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4660161c80 0x7f46600cd280 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.712+0000 7f4666de4640 1 --2- 172.21.15.81:0/943004969 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46600b64b0 0x7f46600c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.712+0000 7f4666de4640 1 -- 172.21.15.81:0/943004969 >> 172.21.15.81:0/943004969 conn(0x7f46600d44f0 msgr2=0x7f4660156480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.713+0000 7f4666de4640 1 -- 172.21.15.81:0/943004969 shutdown_connections 2024-09-16T01:17:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.713+0000 7f4666de4640 1 -- 172.21.15.81:0/943004969 wait complete. 2024-09-16T01:17:55.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T01:17:55.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.825+0000 7fec21d5f640 1 Processor -- start 2024-09-16T01:17:55.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.825+0000 7fec21d5f640 1 -- start start 2024-09-16T01:17:55.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec21d5f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec1c0b1920 0x7fec1c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec21d5f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c0ce720 con 0x7fec1c071160 2024-09-16T01:17:55.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec21d5f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1c0cea00 con 0x7fec1c09af70 2024-09-16T01:17:55.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec21d5f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fec1c0ccfe0 con 0x7fec1c0b1920 2024-09-16T01:17:55.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fec1c071160 0x7fec1c0700c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56620/0 (socket says 172.21.15.81:56620) 2024-09-16T01:17:55.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1bfff640 1 -- 172.21.15.81:0/1398555022 learned_addr learned my addr 172.21.15.81:0/1398555022 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:55.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1812918833 0 0) 0x7fec1c0ce720 con 0x7fec1c071160 2024-09-16T01:17:55.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec08003520 con 0x7fec1c071160 2024-09-16T01:17:55.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1b7fe640 1 --2- 172.21.15.81:0/1398555022 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec1c0b1920 0x7fec1c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3767907110 0 0) 0x7fec08003520 con 0x7fec1c071160 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec1c0b1920 msgr2=0x7fec1c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 --2- 172.21.15.81:0/1398555022 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec1c0b1920 0x7fec1c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 >> v1:172.21.15.102:6789/0 conn(0x7fec1c09af70 legacy=0x7fec1c0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c0cd2c0 con 0x7fec1c071160 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fec140019f0 con 0x7fec1c071160 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 >> v1:172.21.15.81:6789/0 conn(0x7fec1c071160 legacy=0x7fec1c0700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 --2- 172.21.15.81:0/1398555022 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec1c0b1920 0x7fec080039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 --2- 172.21.15.81:0/1398555022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08003f60 0x7fec08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 --2- 172.21.15.81:0/1398555022 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec08004d40 0x7fec080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c0ccfe0 con 0x7fec08003f60 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fec0800bb50 con 0x7fec08004d40 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.826+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fec0800bd50 con 0x7fec1c0b1920 2024-09-16T01:17:55.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.827+0000 7fec13fff640 1 --2- 172.21.15.81:0/1398555022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08003f60 0x7fec08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.827+0000 7fec1b7fe640 1 --2- 172.21.15.81:0/1398555022 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec1c0b1920 0x7fec080039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.827+0000 7fec1bfff640 1 --2- 172.21.15.81:0/1398555022 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec08004d40 0x7fec080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.827+0000 7fec13fff640 1 -- 172.21.15.81:0/1398555022 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec1c0b1920 msgr2=0x7fec080039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.827+0000 7fec13fff640 1 --2- 172.21.15.81:0/1398555022 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec1c0b1920 0x7fec080039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.827+0000 7fec13fff640 1 -- 172.21.15.81:0/1398555022 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec08004d40 msgr2=0x7fec080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.827+0000 7fec13fff640 1 --2- 172.21.15.81:0/1398555022 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec08004d40 0x7fec080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.827+0000 7fec13fff640 1 -- 172.21.15.81:0/1398555022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec08003520 con 0x7fec08003f60 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.827+0000 7fec13fff640 1 --2- 172.21.15.81:0/1398555022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08003f60 0x7fec08004800 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fec04001720 tx=0x7fec08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4a5c4524b7b34b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.828+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04001370 con 0x7fec08003f60 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.828+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec040052d0 con 0x7fec08003f60 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.828+0000 7fec1affd640 1 -- 172.21.15.81:0/1398555022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0402abc0 con 0x7fec08003f60 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.828+0000 7fec21d5f640 1 -- 172.21.15.81:0/1398555022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08003f60 msgr2=0x7fec08004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.828+0000 7fec21d5f640 1 --2- 172.21.15.81:0/1398555022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec08003f60 0x7fec08004800 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fec04001720 tx=0x7fec08005830 comp rx=0 tx=0).stop 2024-09-16T01:17:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.828+0000 7fec1bfff640 1 -- 172.21.15.81:0/1398555022 reap_dead start 2024-09-16T01:17:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.828+0000 7fec21d5f640 1 -- 172.21.15.81:0/1398555022 shutdown_connections 2024-09-16T01:17:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.828+0000 7fec21d5f640 1 -- 172.21.15.81:0/1398555022 >> 172.21.15.81:0/1398555022 conn(0x7fec1c0b3de0 msgr2=0x7fec1c0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.828+0000 7fec21d5f640 1 -- 172.21.15.81:0/1398555022 shutdown_connections 2024-09-16T01:17:55.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.828+0000 7fec21d5f640 1 -- 172.21.15.81:0/1398555022 wait complete. 2024-09-16T01:17:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.829+0000 7fec21d5f640 1 Processor -- start 2024-09-16T01:17:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.829+0000 7fec21d5f640 1 -- start start 2024-09-16T01:17:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec21d5f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec08003f60 0x7fec1c1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec21d5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1c0c93c0 0x7fec1c160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec21d5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec1c0b7d30 0x7fec1c0b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec21d5f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c0d01f0 con 0x7fec1c0c93c0 2024-09-16T01:17:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec21d5f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c0d0070 con 0x7fec1c0b7d30 2024-09-16T01:17:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec21d5f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fec1c0cdef0 con 0x7fec08003f60 2024-09-16T01:17:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec13fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1c0c93c0 0x7fec1c160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec13fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1c0c93c0 0x7fec1c160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38956/0 (socket says 172.21.15.81:38956) 2024-09-16T01:17:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec13fff640 1 -- 172.21.15.81:0/1525754679 learned_addr learned my addr 172.21.15.81:0/1525754679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec1b7fe640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec08003f60 0x7fec1c1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec1bfff640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec1c0b7d30 0x7fec1c0b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec13fff640 1 -- 172.21.15.81:0/1525754679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec08003f60 msgr2=0x7fec1c1601d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec13fff640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec08003f60 0x7fec1c1601d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.830+0000 7fec13fff640 1 -- 172.21.15.81:0/1525754679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec1c0b7d30 msgr2=0x7fec1c0b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.831+0000 7fec13fff640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec1c0b7d30 0x7fec1c0b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.831+0000 7fec13fff640 1 -- 172.21.15.81:0/1525754679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c0ca380 con 0x7fec1c0c93c0 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.831+0000 7fec13fff640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1c0c93c0 0x7fec1c160710 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fec04001810 tx=0x7fec04001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.831+0000 7fec18ff9640 1 -- 172.21.15.81:0/1525754679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04040020 con 0x7fec1c0c93c0 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.831+0000 7fec18ff9640 1 -- 172.21.15.81:0/1525754679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec0402be50 con 0x7fec1c0c93c0 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.831+0000 7fec18ff9640 1 -- 172.21.15.81:0/1525754679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04007a30 con 0x7fec1c0c93c0 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.831+0000 7fec21d5f640 1 -- 172.21.15.81:0/1525754679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1c0ca660 con 0x7fec1c0c93c0 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.831+0000 7fec21d5f640 1 -- 172.21.15.81:0/1525754679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec1c0cac20 con 0x7fec1c0c93c0 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.832+0000 7fec21d5f640 1 -- 172.21.15.81:0/1525754679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec1c158c30 con 0x7fec1c0c93c0 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.833+0000 7fec18ff9640 1 -- 172.21.15.81:0/1525754679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fec04043020 con 0x7fec1c0c93c0 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.833+0000 7fec18ff9640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7febfc06c2b0 0x7febfc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.833+0000 7fec1b7fe640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7febfc06c2b0 0x7febfc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.834+0000 7fec18ff9640 1 -- 172.21.15.81:0/1525754679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7fec040aaff0 con 0x7fec1c0c93c0 2024-09-16T01:17:55.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.834+0000 7fec1b7fe640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7febfc06c2b0 0x7febfc06e770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009bc0 tx=0x7fec0c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:55.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:55.838+0000 7fec18ff9640 1 -- 172.21.15.81:0/1525754679 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec1c158c30 con 0x7fec1c0c93c0 2024-09-16T01:17:56.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.002+0000 7fec21d5f640 1 -- 172.21.15.81:0/1525754679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fec1c0ce720 con 0x7fec1c0c93c0 2024-09-16T01:17:56.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.006+0000 7fec18ff9640 1 -- 172.21.15.81:0/1525754679 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fec0404a030 con 0x7fec1c0c93c0 2024-09-16T01:17:56.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.008+0000 7fec21d5f640 1 -- 172.21.15.81:0/1525754679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7febfc06c2b0 msgr2=0x7febfc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.008+0000 7fec21d5f640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7febfc06c2b0 0x7febfc06e770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009bc0 tx=0x7fec0c009190 comp rx=0 tx=0).stop 2024-09-16T01:17:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.008+0000 7fec21d5f640 1 -- 172.21.15.81:0/1525754679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1c0c93c0 msgr2=0x7fec1c160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.008+0000 7fec21d5f640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1c0c93c0 0x7fec1c160710 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fec04001810 tx=0x7fec04001120 comp rx=0 tx=0).stop 2024-09-16T01:17:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.008+0000 7fec21d5f640 1 -- 172.21.15.81:0/1525754679 shutdown_connections 2024-09-16T01:17:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.008+0000 7fec21d5f640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7febfc06c2b0 0x7febfc06e770 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.008+0000 7fec21d5f640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec1c0b7d30 0x7fec1c0b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.008+0000 7fec21d5f640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec1c0c93c0 0x7fec1c160710 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.008+0000 7fec21d5f640 1 --2- 172.21.15.81:0/1525754679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fec08003f60 0x7fec1c1601d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.008+0000 7fec21d5f640 1 -- 172.21.15.81:0/1525754679 >> 172.21.15.81:0/1525754679 conn(0x7fec1c0b3de0 msgr2=0x7fec1c0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.008+0000 7fec21d5f640 1 -- 172.21.15.81:0/1525754679 shutdown_connections 2024-09-16T01:17:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.008+0000 7fec21d5f640 1 -- 172.21.15.81:0/1525754679 wait complete. 2024-09-16T01:17:56.019 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:17:56.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:17:56.072 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:17:56.115 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:17:56.115 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:17:56.115 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:56.131 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:17:56.131 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:17:56.131 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:56.174 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:17:56.174 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:17:56.174 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:56.190 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:17:56.190 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:17:56.191 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:17:56.233 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:17:56.233 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T01:17:56.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:17:56.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.331+0000 7f6e80f0a640 1 Processor -- start 2024-09-16T01:17:56.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.331+0000 7f6e80f0a640 1 -- start start 2024-09-16T01:17:56.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e80f0a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e7c0d04a0 0x7f6e7c0d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:56.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e80f0a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6e7c0ae550 0x7f6e7c0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:56.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e80f0a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e7c06cb30 con 0x7f6e7c147360 2024-09-16T01:17:56.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e80f0a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6e7c0d0e50 con 0x7f6e7c0d04a0 2024-09-16T01:17:56.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e80f0a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6e7c06bfb0 con 0x7f6e7c0ae550 2024-09-16T01:17:56.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e73fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e7c0d04a0 0x7f6e7c0d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:56.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e73fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e7c0d04a0 0x7f6e7c0d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38960/0 (socket says 172.21.15.81:38960) 2024-09-16T01:17:56.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e73fff640 1 -- 172.21.15.81:0/549719249 learned_addr learned my addr 172.21.15.81:0/549719249 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:56.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e7ad9d640 1 --2- 172.21.15.81:0/549719249 >> v2:172.21.15.102:3300/0 conn(0x7f6e7c0ae550 0x7f6e7c0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:56.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e73fff640 1 -- 172.21.15.81:0/549719249 >> v2:172.21.15.102:3300/0 conn(0x7f6e7c0ae550 msgr2=0x7f6e7c0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:56.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e73fff640 1 --2- 172.21.15.81:0/549719249 >> v2:172.21.15.102:3300/0 conn(0x7f6e7c0ae550 0x7f6e7c0ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e73fff640 1 -- 172.21.15.81:0/549719249 >> v1:172.21.15.102:6789/0 conn(0x7f6e7c147360 legacy=0x7f6e7c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e73fff640 1 -- 172.21.15.81:0/549719249 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7c06c290 con 0x7f6e7c0d04a0 2024-09-16T01:17:56.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.332+0000 7f6e7ad9d640 1 --2- 172.21.15.81:0/549719249 >> v2:172.21.15.102:3300/0 conn(0x7f6e7c0ae550 0x7f6e7c0ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:56.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.333+0000 7f6e73fff640 1 --2- 172.21.15.81:0/549719249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c0d04a0 0x7f6e7c0d0910 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0ced30 tx=0x7f6e6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518ff6843ec46a10 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:56.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.333+0000 7f6e79d9b640 1 -- 172.21.15.81:0/549719249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e64037070 con 0x7f6e7c0d04a0 2024-09-16T01:17:56.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.333+0000 7f6e79d9b640 1 -- 172.21.15.81:0/549719249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e64032440 con 0x7f6e7c0d04a0 2024-09-16T01:17:56.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.333+0000 7f6e79d9b640 1 -- 172.21.15.81:0/549719249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e64032810 con 0x7f6e7c0d04a0 2024-09-16T01:17:56.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.334+0000 7f6e80f0a640 1 -- 172.21.15.81:0/549719249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c0d04a0 msgr2=0x7f6e7c0d0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.334+0000 7f6e80f0a640 1 --2- 172.21.15.81:0/549719249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c0d04a0 0x7f6e7c0d0910 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0ced30 tx=0x7f6e6402a1e0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.334+0000 7f6e80f0a640 1 -- 172.21.15.81:0/549719249 shutdown_connections 2024-09-16T01:17:56.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.334+0000 7f6e80f0a640 1 --2- 172.21.15.81:0/549719249 >> v2:172.21.15.102:3300/0 conn(0x7f6e7c0ae550 0x7f6e7c0ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.334+0000 7f6e80f0a640 1 --2- 172.21.15.81:0/549719249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c0d04a0 0x7f6e7c0d0910 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.334+0000 7f6e80f0a640 1 -- 172.21.15.81:0/549719249 >> 172.21.15.81:0/549719249 conn(0x7f6e7c0b2f40 msgr2=0x7f6e7c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:56.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.334+0000 7f6e80f0a640 1 -- 172.21.15.81:0/549719249 shutdown_connections 2024-09-16T01:17:56.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.334+0000 7f6e80f0a640 1 -- 172.21.15.81:0/549719249 wait complete. 2024-09-16T01:17:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.335+0000 7f6e80f0a640 1 Processor -- start 2024-09-16T01:17:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.335+0000 7f6e80f0a640 1 -- start start 2024-09-16T01:17:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e80f0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c0ae550 0x7f6e7c0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e80f0a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e7c0d04a0 0x7f6e7c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e80f0a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e7c147360 0x7f6e7c141a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e80f0a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c070fa0 con 0x7f6e7c0ae550 2024-09-16T01:17:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e80f0a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c06c850 con 0x7f6e7c147360 2024-09-16T01:17:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e80f0a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6e7c06bc10 con 0x7f6e7c0d04a0 2024-09-16T01:17:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e7a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c0ae550 0x7f6e7c0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e7a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c0ae550 0x7f6e7c0b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38966/0 (socket says 172.21.15.81:38966) 2024-09-16T01:17:56.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e7a59c640 1 -- 172.21.15.81:0/1029568273 learned_addr learned my addr 172.21.15.81:0/1029568273 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e73fff640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e7c0d04a0 0x7f6e7c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e7ad9d640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e7c147360 0x7f6e7c141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e7a59c640 1 -- 172.21.15.81:0/1029568273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e7c0d04a0 msgr2=0x7f6e7c15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e7a59c640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e7c0d04a0 0x7f6e7c15c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e7a59c640 1 -- 172.21.15.81:0/1029568273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e7c147360 msgr2=0x7f6e7c141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e7a59c640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e7c147360 0x7f6e7c141a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e7a59c640 1 -- 172.21.15.81:0/1029568273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7c15c7f0 con 0x7f6e7c0ae550 2024-09-16T01:17:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e73fff640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e7c0d04a0 0x7f6e7c15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e7a59c640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c0ae550 0x7f6e7c0b6250 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00c400 tx=0x7f6e6c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.336+0000 7f6e72ffd640 1 -- 172.21.15.81:0/1029568273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c0052d0 con 0x7f6e7c0ae550 2024-09-16T01:17:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.337+0000 7f6e72ffd640 1 -- 172.21.15.81:0/1029568273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e6c005490 con 0x7f6e7c0ae550 2024-09-16T01:17:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.337+0000 7f6e72ffd640 1 -- 172.21.15.81:0/1029568273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c007260 con 0x7f6e7c0ae550 2024-09-16T01:17:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.337+0000 7f6e80f0a640 1 -- 172.21.15.81:0/1029568273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e7c15cad0 con 0x7f6e7c0ae550 2024-09-16T01:17:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.337+0000 7f6e80f0a640 1 -- 172.21.15.81:0/1029568273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e7c15d090 con 0x7f6e7c0ae550 2024-09-16T01:17:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.338+0000 7f6e80f0a640 1 -- 172.21.15.81:0/1029568273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e7c0d0910 con 0x7f6e7c0ae550 2024-09-16T01:17:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.338+0000 7f6e72ffd640 1 -- 172.21.15.81:0/1029568273 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6e6c007400 con 0x7f6e7c0ae550 2024-09-16T01:17:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.338+0000 7f6e72ffd640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6e5c06c2b0 0x7f6e5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.339+0000 7f6e73fff640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6e5c06c2b0 0x7f6e5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.339+0000 7f6e72ffd640 1 -- 172.21.15.81:0/1029568273 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5335+0+0 (secure 0 0 0) 0x7f6e6c08a750 con 0x7f6e7c0ae550 2024-09-16T01:17:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.339+0000 7f6e73fff640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6e5c06c2b0 0x7f6e5c06e770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6e64034000 tx=0x7f6e6402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:56.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.343+0000 7f6e72ffd640 1 -- 172.21.15.81:0/1029568273 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e6c0590c0 con 0x7f6e7c0ae550 2024-09-16T01:17:56.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.541+0000 7f6e80f0a640 1 -- 172.21.15.81:0/1029568273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e7c06f3e0 con 0x7f6e7c0ae550 2024-09-16T01:17:56.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.542+0000 7f6e72ffd640 1 -- 172.21.15.81:0/1029568273 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+3911 (secure 0 0 0) 0x7f6e6c0589c0 con 0x7f6e7c0ae550 2024-09-16T01:17:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:56.543 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"btime":"2024-09-16T01:17:51:695020+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3508058089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3508058089},{"type":"v1","addr":"172.21.15.102:6835","nonce":3508058089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5036,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/203904547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":203904547},{"type":"v1","addr":"172.21.15.102:6834","nonce":203904547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5349,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/763632631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":763632631},{"type":"v1","addr":"172.21.15.81:6835","nonce":763632631}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3139124613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3139124613},{"type":"v1","addr":"172.21.15.81:6837","nonce":3139124613}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-09-16T01:17:56.543 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-09-16T01:17:56.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.544+0000 7f6e80f0a640 1 -- 172.21.15.81:0/1029568273 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6e5c06c2b0 msgr2=0x7f6e5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.544+0000 7f6e80f0a640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6e5c06c2b0 0x7f6e5c06e770 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6e64034000 tx=0x7f6e6402e000 comp rx=0 tx=0).stop 2024-09-16T01:17:56.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.544+0000 7f6e80f0a640 1 -- 172.21.15.81:0/1029568273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c0ae550 msgr2=0x7f6e7c0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.544+0000 7f6e80f0a640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c0ae550 0x7f6e7c0b6250 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00c400 tx=0x7f6e6c00c8c0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.544+0000 7f6e80f0a640 1 -- 172.21.15.81:0/1029568273 shutdown_connections 2024-09-16T01:17:56.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.544+0000 7f6e80f0a640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6e5c06c2b0 0x7f6e5c06e770 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.544+0000 7f6e80f0a640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e7c147360 0x7f6e7c141a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.544+0000 7f6e80f0a640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e7c0d04a0 0x7f6e7c15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.544+0000 7f6e80f0a640 1 --2- 172.21.15.81:0/1029568273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c0ae550 0x7f6e7c0b6250 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.544+0000 7f6e80f0a640 1 -- 172.21.15.81:0/1029568273 >> 172.21.15.81:0/1029568273 conn(0x7f6e7c0b2f40 msgr2=0x7f6e7c06f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:56.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.544+0000 7f6e80f0a640 1 -- 172.21.15.81:0/1029568273 shutdown_connections 2024-09-16T01:17:56.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.544+0000 7f6e80f0a640 1 -- 172.21.15.81:0/1029568273 wait complete. 2024-09-16T01:17:56.556 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:17:56.556 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T01:17:56.556 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:17:56.556 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:17:56.556 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:17:56.557 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T01:17:56.557 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:17:56.557 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:17:56.557 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:17:56.557 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T01:17:56.557 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:17:56.557 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:17:56.558 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:17:56.558 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T01:17:56.558 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:17:56.558 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:17:56.566 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:17:56.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:17:56.567 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:17:56.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:17:56.570 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:17:56.570 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:17:56.570 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:17:56.571 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:17:56.609 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:17:56.609 DEBUG:teuthology.parallel:result is None 2024-09-16T01:17:56.610 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:17:56.610 DEBUG:teuthology.parallel:result is None 2024-09-16T01:17:56.612 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:17:56.613 DEBUG:teuthology.parallel:result is None 2024-09-16T01:17:56.613 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:17:56.613 DEBUG:teuthology.parallel:result is None 2024-09-16T01:17:56.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T01:17:56.684 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:17:56.685 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:17:56.694 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:17:56.695 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-16T01:17:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.716+0000 7f0d8b0ac640 1 Processor -- start 2024-09-16T01:17:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.716+0000 7f0d8b0ac640 1 -- start start 2024-09-16T01:17:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.717+0000 7f0d8b0ac640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d84161c80 0x7f0d8406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.717+0000 7f0d8b0ac640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d8406e870 con 0x7f0d840b6680 2024-09-16T01:17:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.717+0000 7f0d8b0ac640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d8406d9f0 con 0x7f0d84162060 2024-09-16T01:17:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.717+0000 7f0d8b0ac640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0d8406dcd0 con 0x7f0d84161c80 2024-09-16T01:17:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.717+0000 7f0d88e48640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0d84161c80 0x7f0d8406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.717+0000 7f0d89649640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0d840b6680 0x7f0d840cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56634/0 (socket says 172.21.15.81:56634) 2024-09-16T01:17:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.717+0000 7f0d89649640 1 -- 172.21.15.81:0/2876986797 learned_addr learned my addr 172.21.15.81:0/2876986797 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.717+0000 7f0d88e48640 1 -- 172.21.15.81:0/2876986797 >> v1:172.21.15.102:6789/0 conn(0x7f0d84162060 legacy=0x7f0d840b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.717+0000 7f0d88e48640 1 -- 172.21.15.81:0/2876986797 >> v1:172.21.15.81:6789/0 conn(0x7f0d840b6680 legacy=0x7f0d840cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.717+0000 7f0d837fe640 1 -- 172.21.15.81:0/2876986797 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217211057 0 0) 0x7f0d7c001490 con 0x7f0d840b6680 2024-09-16T01:17:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.717+0000 7f0d88e48640 1 -- 172.21.15.81:0/2876986797 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8406dfb0 con 0x7f0d84161c80 2024-09-16T01:17:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.718+0000 7f0d88e48640 1 --2- 172.21.15.81:0/2876986797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84161c80 0x7f0d8406e330 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0d780097a0 tx=0x7f0d7802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db45a93f87c1dc43 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.718+0000 7f0d837fe640 1 -- 172.21.15.81:0/2876986797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78037070 con 0x7f0d84161c80 2024-09-16T01:17:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.718+0000 7f0d837fe640 1 -- 172.21.15.81:0/2876986797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d78032440 con 0x7f0d84161c80 2024-09-16T01:17:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.718+0000 7f0d837fe640 1 -- 172.21.15.81:0/2876986797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78032810 con 0x7f0d84161c80 2024-09-16T01:17:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.719+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2876986797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84161c80 msgr2=0x7f0d8406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.719+0000 7f0d8b0ac640 1 --2- 172.21.15.81:0/2876986797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84161c80 0x7f0d8406e330 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0d780097a0 tx=0x7f0d7802a230 comp rx=0 tx=0).stop 2024-09-16T01:17:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.719+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2876986797 shutdown_connections 2024-09-16T01:17:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.719+0000 7f0d8b0ac640 1 --2- 172.21.15.81:0/2876986797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84161c80 0x7f0d8406e330 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.719+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2876986797 >> 172.21.15.81:0/2876986797 conn(0x7f0d840d44f0 msgr2=0x7f0d840d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.719+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2876986797 shutdown_connections 2024-09-16T01:17:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.719+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2876986797 wait complete. 2024-09-16T01:17:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.720+0000 7f0d8b0ac640 1 Processor -- start 2024-09-16T01:17:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.720+0000 7f0d8b0ac640 1 -- start start 2024-09-16T01:17:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.721+0000 7f0d8b0ac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d840b6680 0x7f0d841f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.721+0000 7f0d8b0ac640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d84161c80 0x7f0d8409e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.721+0000 7f0d8b0ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84162060 0x7f0d8409e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.721+0000 7f0d8b0ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d840b6b30 con 0x7f0d84162060 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.721+0000 7f0d8b0ac640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0d840d2aa0 con 0x7f0d840b6680 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.721+0000 7f0d8b0ac640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0d840b6cb0 con 0x7f0d84161c80 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.721+0000 7f0d89649640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84162060 0x7f0d8409e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.721+0000 7f0d89649640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84162060 0x7f0d8409e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39008/0 (socket says 172.21.15.81:39008) 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.721+0000 7f0d89649640 1 -- 172.21.15.81:0/2404252138 learned_addr learned my addr 172.21.15.81:0/2404252138 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.721+0000 7f0d88e48640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d840b6680 0x7f0d841f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.721+0000 7f0d83fff640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d84161c80 0x7f0d8409e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.722+0000 7f0d89649640 1 -- 172.21.15.81:0/2404252138 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d84161c80 msgr2=0x7f0d8409e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.722+0000 7f0d89649640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d84161c80 0x7f0d8409e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.722+0000 7f0d89649640 1 -- 172.21.15.81:0/2404252138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d840b6680 msgr2=0x7f0d841f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.722+0000 7f0d89649640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d840b6680 0x7f0d841f5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:56.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.722+0000 7f0d89649640 1 -- 172.21.15.81:0/2404252138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d840a0e70 con 0x7f0d84162060 2024-09-16T01:17:56.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.722+0000 7f0d89649640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84162060 0x7f0d8409e720 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00c700 tx=0x7f0d7c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:56.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.725+0000 7f0d817fa640 1 -- 172.21.15.81:0/2404252138 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c018070 con 0x7f0d84162060 2024-09-16T01:17:56.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.725+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2404252138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d840a1150 con 0x7f0d84162060 2024-09-16T01:17:56.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.725+0000 7f0d817fa640 1 -- 172.21.15.81:0/2404252138 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d7c00ce10 con 0x7f0d84162060 2024-09-16T01:17:56.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.725+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2404252138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d840a1710 con 0x7f0d84162060 2024-09-16T01:17:56.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.725+0000 7f0d817fa640 1 -- 172.21.15.81:0/2404252138 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c00a840 con 0x7f0d84162060 2024-09-16T01:17:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.726+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2404252138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8406e330 con 0x7f0d84162060 2024-09-16T01:17:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.726+0000 7f0d817fa640 1 -- 172.21.15.81:0/2404252138 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0d7c01b070 con 0x7f0d84162060 2024-09-16T01:17:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.727+0000 7f0d817fa640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d6806c2b0 0x7f0d6806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:56.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.727+0000 7f0d817fa640 1 -- 172.21.15.81:0/2404252138 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5335+0+0 (secure 0 0 0) 0x7f0d7c08a8a0 con 0x7f0d84162060 2024-09-16T01:17:56.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.727+0000 7f0d88e48640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d6806c2b0 0x7f0d6806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:56.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.728+0000 7f0d88e48640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d6806c2b0 0x7f0d6806e770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0d78034000 tx=0x7f0d7802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:56.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.731+0000 7f0d817fa640 1 -- 172.21.15.81:0/2404252138 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d8406e870 con 0x7f0d84162060 2024-09-16T01:17:56.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:56.912+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2404252138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0d840ba470 con 0x7f0d84162060 2024-09-16T01:17:57.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.733+0000 7f0d817fa640 1 -- 172.21.15.81:0/2404252138 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) ==== 97+0+0 (secure 0 0 0) 0x7f0d7c058b40 con 0x7f0d84162060 2024-09-16T01:17:57.734 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-16T01:17:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.735+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2404252138 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d6806c2b0 msgr2=0x7f0d6806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.735+0000 7f0d8b0ac640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d6806c2b0 0x7f0d6806e770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0d78034000 tx=0x7f0d7802e000 comp rx=0 tx=0).stop 2024-09-16T01:17:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.735+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2404252138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84162060 msgr2=0x7f0d8409e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.735+0000 7f0d8b0ac640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84162060 0x7f0d8409e720 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00c700 tx=0x7f0d7c00cbc0 comp rx=0 tx=0).stop 2024-09-16T01:17:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.735+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2404252138 shutdown_connections 2024-09-16T01:17:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.736+0000 7f0d8b0ac640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d6806c2b0 0x7f0d6806e770 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.736+0000 7f0d8b0ac640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d84162060 0x7f0d8409e720 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.736+0000 7f0d8b0ac640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d84161c80 0x7f0d8409e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.736+0000 7f0d8b0ac640 1 --2- 172.21.15.81:0/2404252138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d840b6680 0x7f0d841f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.736+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2404252138 >> 172.21.15.81:0/2404252138 conn(0x7f0d840d44f0 msgr2=0x7f0d8406ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.736+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2404252138 shutdown_connections 2024-09-16T01:17:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.736+0000 7f0d8b0ac640 1 -- 172.21.15.81:0/2404252138 wait complete. 2024-09-16T01:17:57.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T01:17:57.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.853+0000 7f7ca9cf1640 1 Processor -- start 2024-09-16T01:17:57.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.853+0000 7f7ca9cf1640 1 -- start start 2024-09-16T01:17:57.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.854+0000 7f7ca9cf1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ca40b5f80 0x7f7ca40b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.854+0000 7f7ca9cf1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca40b68e0 con 0x7f7ca40cd650 2024-09-16T01:17:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.854+0000 7f7ca9cf1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca406fdb0 con 0x7f7ca40afd70 2024-09-16T01:17:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.854+0000 7f7ca9cf1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca4070090 con 0x7f7ca40b5f80 2024-09-16T01:17:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.854+0000 7f7ca3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7ca40cd650 0x7f7ca40cdad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56648/0 (socket says 172.21.15.81:56648) 2024-09-16T01:17:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.854+0000 7f7ca3fff640 1 -- 172.21.15.81:0/1908242386 learned_addr learned my addr 172.21.15.81:0/1908242386 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.854+0000 7f7ca2ffd640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ca40b5f80 0x7f7ca40b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.854+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824480196 0 0) 0x7f7ca40b68e0 con 0x7f7ca40cd650 2024-09-16T01:17:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.854+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c8c003520 con 0x7f7ca40cd650 2024-09-16T01:17:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3888572950 0 0) 0x7f7c8c003520 con 0x7f7ca40cd650 2024-09-16T01:17:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ca40b5f80 msgr2=0x7f7ca40b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:57.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ca40b5f80 0x7f7ca40b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 >> v1:172.21.15.102:6789/0 conn(0x7f7ca40afd70 legacy=0x7f7ca4160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca4070370 con 0x7f7ca40cd650 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f7c9c0019f0 con 0x7f7ca40cd650 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 >> v1:172.21.15.81:6789/0 conn(0x7f7ca40cd650 legacy=0x7f7ca40cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0039e0 0x7f7c8c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ca40b5f80 0x7f7c8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c004d40 0x7f7c8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca4070090 con 0x7f7c8c004d40 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c00b9f0 con 0x7f7c8c0039e0 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7c8c00bbf0 con 0x7f7ca40b5f80 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca3fff640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c004d40 0x7f7c8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca2ffd640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ca40b5f80 0x7f7c8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:57.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca37fe640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0039e0 0x7f7c8c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:57.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca3fff640 1 -- 172.21.15.81:0/1908242386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ca40b5f80 msgr2=0x7f7c8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:57.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca3fff640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ca40b5f80 0x7f7c8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:57.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca3fff640 1 -- 172.21.15.81:0/1908242386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0039e0 msgr2=0x7f7c8c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:57.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca3fff640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7c8c0039e0 0x7f7c8c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:57.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca3fff640 1 -- 172.21.15.81:0/1908242386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c003520 con 0x7f7c8c004d40 2024-09-16T01:17:57.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.855+0000 7f7ca2ffd640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ca40b5f80 0x7f7c8c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:57.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.856+0000 7f7ca3fff640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c004d40 0x7f7c8c0051c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00a7c0 tx=0x7f7c8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76dca8eb463b18be server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:57.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.856+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c00a410 con 0x7f7c8c004d40 2024-09-16T01:17:57.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.856+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c9c02f070 con 0x7f7c8c004d40 2024-09-16T01:17:57.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.856+0000 7f7ca27fc640 1 -- 172.21.15.81:0/1908242386 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c02bc00 con 0x7f7c8c004d40 2024-09-16T01:17:57.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.856+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/1908242386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c004d40 msgr2=0x7f7c8c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.856+0000 7f7ca9cf1640 1 --2- 172.21.15.81:0/1908242386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c8c004d40 0x7f7c8c0051c0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00a7c0 tx=0x7f7c8c005830 comp rx=0 tx=0).stop 2024-09-16T01:17:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.856+0000 7f7ca3fff640 1 -- 172.21.15.81:0/1908242386 reap_dead start 2024-09-16T01:17:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.857+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/1908242386 shutdown_connections 2024-09-16T01:17:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.857+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/1908242386 >> 172.21.15.81:0/1908242386 conn(0x7f7ca406bc10 msgr2=0x7f7ca406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.857+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/1908242386 shutdown_connections 2024-09-16T01:17:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.857+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/1908242386 wait complete. 2024-09-16T01:17:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.858+0000 7f7ca9cf1640 1 Processor -- start 2024-09-16T01:17:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.858+0000 7f7ca9cf1640 1 -- start start 2024-09-16T01:17:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca9cf1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c8c004d40 0x7f7ca41f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca9cf1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca4156ec0 0x7f7ca414b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:57.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca9cf1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ca41556c0 0x7f7ca4155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca9cf1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca40b0150 con 0x7f7ca4156ec0 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca9cf1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca406fa80 con 0x7f7ca41556c0 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca9cf1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca4160060 con 0x7f7c8c004d40 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca4156ec0 0x7f7ca414b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca4156ec0 0x7f7ca414b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39024/0 (socket says 172.21.15.81:39024) 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca2ffd640 1 -- 172.21.15.81:0/834379687 learned_addr learned my addr 172.21.15.81:0/834379687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca37fe640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c8c004d40 0x7f7ca41f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca3fff640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ca41556c0 0x7f7ca4155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca2ffd640 1 -- 172.21.15.81:0/834379687 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c8c004d40 msgr2=0x7f7ca41f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca2ffd640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c8c004d40 0x7f7ca41f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca2ffd640 1 -- 172.21.15.81:0/834379687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ca41556c0 msgr2=0x7f7ca4155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca2ffd640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ca41556c0 0x7f7ca4155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:57.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca2ffd640 1 -- 172.21.15.81:0/834379687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca41f6500 con 0x7f7ca4156ec0 2024-09-16T01:17:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca2ffd640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca4156ec0 0x7f7ca414b950 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7c980115e0 tx=0x7f7c98011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7c8bfff640 1 -- 172.21.15.81:0/834379687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c98004220 con 0x7f7ca4156ec0 2024-09-16T01:17:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7c8bfff640 1 -- 172.21.15.81:0/834379687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c980043c0 con 0x7f7ca4156ec0 2024-09-16T01:17:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7c8bfff640 1 -- 172.21.15.81:0/834379687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9800f910 con 0x7f7ca4156ec0 2024-09-16T01:17:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.859+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/834379687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca4157460 con 0x7f7ca4156ec0 2024-09-16T01:17:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.860+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/834379687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca4157a20 con 0x7f7ca4156ec0 2024-09-16T01:17:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.861+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/834379687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca40b63a0 con 0x7f7ca4156ec0 2024-09-16T01:17:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.861+0000 7f7c8bfff640 1 -- 172.21.15.81:0/834379687 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7c9800fab0 con 0x7f7ca4156ec0 2024-09-16T01:17:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.861+0000 7f7c8bfff640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7c9006c2e0 0x7f7c9006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.862+0000 7f7ca37fe640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7c9006c2e0 0x7f7c9006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.862+0000 7f7c8bfff640 1 -- 172.21.15.81:0/834379687 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5249+0+0 (secure 0 0 0) 0x7f7c9808b7f0 con 0x7f7ca4156ec0 2024-09-16T01:17:57.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.862+0000 7f7ca37fe640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7c9006c2e0 0x7f7c9006e7a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7c94001940 tx=0x7f7c94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:57.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:57.866+0000 7f7c8bfff640 1 -- 172.21.15.81:0/834379687 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ca41f6500 con 0x7f7ca4156ec0 2024-09-16T01:17:58.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.096+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/834379687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7ca4067fc0 con 0x7f7ca4156ec0 2024-09-16T01:17:58.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.097+0000 7f7c8bfff640 1 -- 172.21.15.81:0/834379687 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f7c98019030 con 0x7f7ca4156ec0 2024-09-16T01:17:58.098 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:58.098 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:17:58.098 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-16T01:17:58.098 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.098 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-16T01:17:58.098 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmx4OgCRAAkmpWDpuwqbDuz0taNg8bag==", 2024-09-16T01:17:58.098 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.098 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:58.098 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:17:58.098 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:17:58.098 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmSNpLFRAAzc9Sr8b65zH9VZFYvqsYpA==", 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.099 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.100 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-16T01:17:58.100 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmcCavEBAA0CuddD0zPcjqrMSOD5c6OA==", 2024-09-16T01:17:58.100 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.100 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:58.100 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:17:58.100 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:17:58.100 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.100 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.101 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-16T01:17:58.101 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmVeRcHBAANIL7HFYSc43qv7Zg0llkYQ==", 2024-09-16T01:17:58.101 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.101 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:58.101 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:17:58.101 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:17:58.101 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.101 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.101 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDhudmUtTqORAAkZKChid+qoa+0nIgpuun7g==", 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCHhudmUhtiABAA2vDoACv8RJ2KD9p1cdKClA==", 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:58.102 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCKhudmhOmRHxAAbGjJkUZLras/b6omekdz7A==", 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.103 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-16T01:17:58.104 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCNhudmA+csIRAAW1kenpimaWIak/qgG+UeXw==", 2024-09-16T01:17:58.104 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.104 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:58.104 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:58.104 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.104 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-16T01:17:58.104 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCThudmvgQBLxAAWLto5pG0iyiQPSnxldWYwg==", 2024-09-16T01:17:58.104 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.104 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCXhudmKfyiIhAALbJHvDeQtVgSCKjD1X3OYg==", 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCahudmPG/9JBAA6d/gK0K/5c9Gp4uKOLCCOw==", 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCdhudmVdY3NhAAXlOaeE0XidHVCaeQrirBAg==", 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.106 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg==", 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmMgEhKRAAUD2kJ9eOFJscZ6ATlO5PmQ==", 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmwfD5JRAAPhdVLFZD07Uy75g3zStblg==", 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.108 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudm8/qzLhAAVFRbGhXH00h2LS9ZC9rraA==", 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:17:58.109 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/hudmBWr2KRAA/hELsRHNpxj3KqJbOSY74g==", 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmRdtyBhAAMQngXCuTHg6AjACCw/SmCg==", 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmqULCAhAAMbYmGXWGiINwif20O1JG3g==", 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:17:58.111 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:17:58.112 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:17:58.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.112 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-16T01:17:58.112 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:17:58.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.099+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/834379687 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7c9006c2e0 msgr2=0x7f7c9006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.099+0000 7f7ca9cf1640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7c9006c2e0 0x7f7c9006e7a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7c94001940 tx=0x7f7c94009040 comp rx=0 tx=0).stop 2024-09-16T01:17:58.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.099+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/834379687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca4156ec0 msgr2=0x7f7ca414b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.099+0000 7f7ca9cf1640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca4156ec0 0x7f7ca414b950 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7c980115e0 tx=0x7f7c98011aa0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.099+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/834379687 shutdown_connections 2024-09-16T01:17:58.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.099+0000 7f7ca9cf1640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7c9006c2e0 0x7f7c9006e7a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.099+0000 7f7ca9cf1640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ca41556c0 0x7f7ca4155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.099+0000 7f7ca9cf1640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ca4156ec0 0x7f7ca414b950 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.099+0000 7f7ca9cf1640 1 --2- 172.21.15.81:0/834379687 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7c8c004d40 0x7f7ca41f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.099+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/834379687 >> 172.21.15.81:0/834379687 conn(0x7f7ca406bc10 msgr2=0x7f7ca40b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:58.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.099+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/834379687 shutdown_connections 2024-09-16T01:17:58.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.099+0000 7f7ca9cf1640 1 -- 172.21.15.81:0/834379687 wait complete. 2024-09-16T01:17:58.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:17:58.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.212+0000 7f023285e640 1 Processor -- start 2024-09-16T01:17:58.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.212+0000 7f023285e640 1 -- start start 2024-09-16T01:17:58.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.213+0000 7f023285e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f022c15e740 0x7f022c0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.213+0000 7f023285e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f022c09b690 0x7f022c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.213+0000 7f023285e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f022c06d4c0 0x7f022c06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.213+0000 7f023285e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f022c15eb20 con 0x7f022c09b690 2024-09-16T01:17:58.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.213+0000 7f023285e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f022c06d260 con 0x7f022c15e740 2024-09-16T01:17:58.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.213+0000 7f023285e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f022c0d0780 con 0x7f022c06d4c0 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.213+0000 7f022b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f022c09b690 0x7f022c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.213+0000 7f022b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f022c09b690 0x7f022c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39034/0 (socket says 172.21.15.81:39034) 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.213+0000 7f022b7fe640 1 -- 172.21.15.81:0/1005717065 learned_addr learned my addr 172.21.15.81:0/1005717065 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.214+0000 7f0230dfb640 1 --2- 172.21.15.81:0/1005717065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f022c06d4c0 0x7f022c06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.214+0000 7f022bfff640 1 --2- 172.21.15.81:0/1005717065 >> v2:172.21.15.102:3300/0 conn(0x7f022c15e740 0x7f022c0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.214+0000 7f022b7fe640 1 -- 172.21.15.81:0/1005717065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f022c06d4c0 msgr2=0x7f022c06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.214+0000 7f022b7fe640 1 --2- 172.21.15.81:0/1005717065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f022c06d4c0 0x7f022c06d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.214+0000 7f022b7fe640 1 -- 172.21.15.81:0/1005717065 >> v2:172.21.15.102:3300/0 conn(0x7f022c15e740 msgr2=0x7f022c0d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.214+0000 7f022b7fe640 1 --2- 172.21.15.81:0/1005717065 >> v2:172.21.15.102:3300/0 conn(0x7f022c15e740 0x7f022c0d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.214+0000 7f022b7fe640 1 -- 172.21.15.81:0/1005717065 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c0d0a60 con 0x7f022c09b690 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.214+0000 7f022bfff640 1 --2- 172.21.15.81:0/1005717065 >> v2:172.21.15.102:3300/0 conn(0x7f022c15e740 0x7f022c0d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.214+0000 7f0230dfb640 1 --2- 172.21.15.81:0/1005717065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f022c06d4c0 0x7f022c06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:58.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.214+0000 7f022b7fe640 1 --2- 172.21.15.81:0/1005717065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f022c09b690 0x7f022c06cd20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f022c074070 tx=0x7f022002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec6f748b6104483 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:58.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.214+0000 7f022affd640 1 -- 172.21.15.81:0/1005717065 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220037070 con 0x7f022c09b690 2024-09-16T01:17:58.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.215+0000 7f022affd640 1 -- 172.21.15.81:0/1005717065 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0220032440 con 0x7f022c09b690 2024-09-16T01:17:58.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.215+0000 7f022affd640 1 -- 172.21.15.81:0/1005717065 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220032810 con 0x7f022c09b690 2024-09-16T01:17:58.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.215+0000 7f023285e640 1 -- 172.21.15.81:0/1005717065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f022c09b690 msgr2=0x7f022c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.215+0000 7f023285e640 1 --2- 172.21.15.81:0/1005717065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f022c09b690 0x7f022c06cd20 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f022c074070 tx=0x7f022002a2a0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.215+0000 7f023285e640 1 -- 172.21.15.81:0/1005717065 shutdown_connections 2024-09-16T01:17:58.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.215+0000 7f023285e640 1 --2- 172.21.15.81:0/1005717065 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f022c06d4c0 0x7f022c06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.215+0000 7f023285e640 1 --2- 172.21.15.81:0/1005717065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f022c09b690 0x7f022c06cd20 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.215+0000 7f023285e640 1 --2- 172.21.15.81:0/1005717065 >> v2:172.21.15.102:3300/0 conn(0x7f022c15e740 0x7f022c0d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.215+0000 7f023285e640 1 -- 172.21.15.81:0/1005717065 >> 172.21.15.81:0/1005717065 conn(0x7f022c0d23a0 msgr2=0x7f022c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.215+0000 7f023285e640 1 -- 172.21.15.81:0/1005717065 shutdown_connections 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.215+0000 7f023285e640 1 -- 172.21.15.81:0/1005717065 wait complete. 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.216+0000 7f023285e640 1 Processor -- start 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.216+0000 7f023285e640 1 -- start start 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f023285e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f022c06d4c0 0x7f022c0cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f023285e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f022c09b690 0x7f022c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f023285e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f022c15e740 0x7f022c0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f023285e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f022c09bac0 con 0x7f022c06d4c0 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f023285e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f022c0d1020 con 0x7f022c15e740 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f023285e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f022c06de10 con 0x7f022c09b690 2024-09-16T01:17:58.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f022bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f022c06d4c0 0x7f022c0cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f022bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f022c06d4c0 0x7f022c0cc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39044/0 (socket says 172.21.15.81:39044) 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f022bfff640 1 -- 172.21.15.81:0/2916054448 learned_addr learned my addr 172.21.15.81:0/2916054448 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f022bfff640 1 -- 172.21.15.81:0/2916054448 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f022c09b690 msgr2=0x7f022c15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f022bfff640 1 --2- 172.21.15.81:0/2916054448 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f022c09b690 0x7f022c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f022bfff640 1 -- 172.21.15.81:0/2916054448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f022c15e740 msgr2=0x7f022c0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f022bfff640 1 --2- 172.21.15.81:0/2916054448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f022c15e740 0x7f022c0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.217+0000 7f022bfff640 1 -- 172.21.15.81:0/2916054448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c1f4b00 con 0x7f022c06d4c0 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.218+0000 7f022bfff640 1 --2- 172.21.15.81:0/2916054448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f022c06d4c0 0x7f022c0cc9d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f021c00c7f0 tx=0x7f021c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.218+0000 7f0228ff9640 1 -- 172.21.15.81:0/2916054448 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c015070 con 0x7f022c06d4c0 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.218+0000 7f0228ff9640 1 -- 172.21.15.81:0/2916054448 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f021c007820 con 0x7f022c06d4c0 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.218+0000 7f023285e640 1 -- 172.21.15.81:0/2916054448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022c1f8860 con 0x7f022c06d4c0 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.218+0000 7f0228ff9640 1 -- 172.21.15.81:0/2916054448 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c007bd0 con 0x7f022c06d4c0 2024-09-16T01:17:58.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.218+0000 7f023285e640 1 -- 172.21.15.81:0/2916054448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022c1f8e20 con 0x7f022c06d4c0 2024-09-16T01:17:58.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.219+0000 7f023285e640 1 -- 172.21.15.81:0/2916054448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022c06d8d0 con 0x7f022c06d4c0 2024-09-16T01:17:58.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.219+0000 7f0228ff9640 1 -- 172.21.15.81:0/2916054448 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f021c018070 con 0x7f022c06d4c0 2024-09-16T01:17:58.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.220+0000 7f0228ff9640 1 --2- 172.21.15.81:0/2916054448 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f021806c2b0 0x7f021806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.220+0000 7f0228ff9640 1 -- 172.21.15.81:0/2916054448 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5249+0+0 (secure 0 0 0) 0x7f021c08b210 con 0x7f022c06d4c0 2024-09-16T01:17:58.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.220+0000 7f022b7fe640 1 --2- 172.21.15.81:0/2916054448 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f021806c2b0 0x7f021806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.220+0000 7f022b7fe640 1 --2- 172.21.15.81:0/2916054448 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f021806c2b0 0x7f021806e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0220034000 tx=0x7f022002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:58.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.224+0000 7f0228ff9640 1 -- 172.21.15.81:0/2916054448 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f021c059bd0 con 0x7f022c06d4c0 2024-09-16T01:17:58.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.391+0000 7f023285e640 1 -- 172.21.15.81:0/2916054448 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f022c0d1cb0 con 0x7f022c06d4c0 2024-09-16T01:17:58.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.392+0000 7f0228ff9640 1 -- 172.21.15.81:0/2916054448 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) ==== 84+0+65 (secure 0 0 0) 0x7f021c0594d0 con 0x7f022c06d4c0 2024-09-16T01:17:58.392 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:17:58.393 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-16T01:17:58.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:17:58.393 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-16T01:17:58.393 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-16T01:17:58.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:17:58.393 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-16T01:17:58.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.393+0000 7f023285e640 1 -- 172.21.15.81:0/2916054448 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f021806c2b0 msgr2=0x7f021806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.393+0000 7f023285e640 1 --2- 172.21.15.81:0/2916054448 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f021806c2b0 0x7f021806e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0220034000 tx=0x7f022002c000 comp rx=0 tx=0).stop 2024-09-16T01:17:58.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.393+0000 7f023285e640 1 -- 172.21.15.81:0/2916054448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f022c06d4c0 msgr2=0x7f022c0cc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.393+0000 7f023285e640 1 --2- 172.21.15.81:0/2916054448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f022c06d4c0 0x7f022c0cc9d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f021c00c7f0 tx=0x7f021c00ccb0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.393+0000 7f023285e640 1 -- 172.21.15.81:0/2916054448 shutdown_connections 2024-09-16T01:17:58.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.393+0000 7f023285e640 1 --2- 172.21.15.81:0/2916054448 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f021806c2b0 0x7f021806e770 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.393+0000 7f023285e640 1 --2- 172.21.15.81:0/2916054448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f022c15e740 0x7f022c0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.393+0000 7f023285e640 1 --2- 172.21.15.81:0/2916054448 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f022c09b690 0x7f022c15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.393+0000 7f023285e640 1 --2- 172.21.15.81:0/2916054448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f022c06d4c0 0x7f022c0cc9d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.393+0000 7f023285e640 1 -- 172.21.15.81:0/2916054448 >> 172.21.15.81:0/2916054448 conn(0x7f022c0d23a0 msgr2=0x7f022c0b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:58.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.394+0000 7f023285e640 1 -- 172.21.15.81:0/2916054448 shutdown_connections 2024-09-16T01:17:58.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.394+0000 7f023285e640 1 -- 172.21.15.81:0/2916054448 wait complete. 2024-09-16T01:17:58.405 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:17:58.405 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:17:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.507+0000 7f8211ed0640 1 Processor -- start 2024-09-16T01:17:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.507+0000 7f8211ed0640 1 -- start start 2024-09-16T01:17:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f8211ed0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f820c0b1920 0x7f820c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f8211ed0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f820c09af70 0x7f820c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f8211ed0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f820c071160 0x7f820c0cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f8211ed0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f820c0ce720 con 0x7f820c0b1920 2024-09-16T01:17:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f8211ed0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f820c0cea00 con 0x7f820c09af70 2024-09-16T01:17:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f8211ed0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f820c0ccfe0 con 0x7f820c071160 2024-09-16T01:17:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f820b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f820c0b1920 0x7f820c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f820b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f820c0b1920 0x7f820c09aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39056/0 (socket says 172.21.15.81:39056) 2024-09-16T01:17:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f820b7fe640 1 -- 172.21.15.81:0/816951382 learned_addr learned my addr 172.21.15.81:0/816951382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f820affd640 1 --2- 172.21.15.81:0/816951382 >> v2:172.21.15.102:3300/0 conn(0x7f820c09af70 0x7f820c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f820bfff640 1 --2- 172.21.15.81:0/816951382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f820c071160 0x7f820c0cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f820b7fe640 1 -- 172.21.15.81:0/816951382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f820c071160 msgr2=0x7f820c0cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f820b7fe640 1 --2- 172.21.15.81:0/816951382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f820c071160 0x7f820c0cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f820b7fe640 1 -- 172.21.15.81:0/816951382 >> v2:172.21.15.102:3300/0 conn(0x7f820c09af70 msgr2=0x7f820c0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f820b7fe640 1 --2- 172.21.15.81:0/816951382 >> v2:172.21.15.102:3300/0 conn(0x7f820c09af70 0x7f820c0cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.508+0000 7f820b7fe640 1 -- 172.21.15.81:0/816951382 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c0cd2c0 con 0x7f820c0b1920 2024-09-16T01:17:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.509+0000 7f820b7fe640 1 --2- 172.21.15.81:0/816951382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f820c0b1920 0x7f820c09aa30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f820c073680 tx=0x7f81fc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e4079acbd20435 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.509+0000 7f820a7fc640 1 -- 172.21.15.81:0/816951382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc037070 con 0x7f820c0b1920 2024-09-16T01:17:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.509+0000 7f820a7fc640 1 -- 172.21.15.81:0/816951382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc032440 con 0x7f820c0b1920 2024-09-16T01:17:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.509+0000 7f820a7fc640 1 -- 172.21.15.81:0/816951382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc032810 con 0x7f820c0b1920 2024-09-16T01:17:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.510+0000 7f8211ed0640 1 -- 172.21.15.81:0/816951382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f820c0b1920 msgr2=0x7f820c09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.510+0000 7f8211ed0640 1 --2- 172.21.15.81:0/816951382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f820c0b1920 0x7f820c09aa30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f820c073680 tx=0x7f81fc02a140 comp rx=0 tx=0).stop 2024-09-16T01:17:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.510+0000 7f8211ed0640 1 -- 172.21.15.81:0/816951382 shutdown_connections 2024-09-16T01:17:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.510+0000 7f8211ed0640 1 --2- 172.21.15.81:0/816951382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f820c071160 0x7f820c0cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.510+0000 7f8211ed0640 1 --2- 172.21.15.81:0/816951382 >> v2:172.21.15.102:3300/0 conn(0x7f820c09af70 0x7f820c0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.510+0000 7f8211ed0640 1 --2- 172.21.15.81:0/816951382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f820c0b1920 0x7f820c09aa30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.510+0000 7f8211ed0640 1 -- 172.21.15.81:0/816951382 >> 172.21.15.81:0/816951382 conn(0x7f820c0b3de0 msgr2=0x7f820c0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.510+0000 7f8211ed0640 1 -- 172.21.15.81:0/816951382 shutdown_connections 2024-09-16T01:17:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.510+0000 7f8211ed0640 1 -- 172.21.15.81:0/816951382 wait complete. 2024-09-16T01:17:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.511+0000 7f8211ed0640 1 Processor -- start 2024-09-16T01:17:58.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.511+0000 7f8211ed0640 1 -- start start 2024-09-16T01:17:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f8211ed0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f820c071160 0x7f820c158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f8211ed0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f820c09af70 0x7f820c0b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f8211ed0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f820c0b1920 0x7f820c0b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f8211ed0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f820c0d01f0 con 0x7f820c09af70 2024-09-16T01:17:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f8211ed0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f820c0d0070 con 0x7f820c071160 2024-09-16T01:17:58.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f8211ed0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f820c0700c0 con 0x7f820c0b1920 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f820affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f820c09af70 0x7f820c0b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f820affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f820c09af70 0x7f820c0b6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39070/0 (socket says 172.21.15.81:39070) 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f820affd640 1 -- 172.21.15.81:0/3083273407 learned_addr learned my addr 172.21.15.81:0/3083273407 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f820affd640 1 -- 172.21.15.81:0/3083273407 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f820c0b1920 msgr2=0x7f820c0b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f820affd640 1 --2- 172.21.15.81:0/3083273407 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f820c0b1920 0x7f820c0b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f820affd640 1 -- 172.21.15.81:0/3083273407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f820c071160 msgr2=0x7f820c158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f820affd640 1 --2- 172.21.15.81:0/3083273407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f820c071160 0x7f820c158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f820affd640 1 -- 172.21.15.81:0/3083273407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c1588d0 con 0x7f820c09af70 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f820affd640 1 --2- 172.21.15.81:0/3083273407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f820c09af70 0x7f820c0b6f10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f820000d800 tx=0x7f820000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f81f3fff640 1 -- 172.21.15.81:0/3083273407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820000b6c0 con 0x7f820c09af70 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f81f3fff640 1 -- 172.21.15.81:0/3083273407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8200019070 con 0x7f820c09af70 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f8211ed0640 1 -- 172.21.15.81:0/3083273407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820c0b7760 con 0x7f820c09af70 2024-09-16T01:17:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f81f3fff640 1 -- 172.21.15.81:0/3083273407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820000ba80 con 0x7f820c09af70 2024-09-16T01:17:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.512+0000 7f8211ed0640 1 -- 172.21.15.81:0/3083273407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820c155b60 con 0x7f820c09af70 2024-09-16T01:17:58.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.513+0000 7f8211ed0640 1 -- 172.21.15.81:0/3083273407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f820c09aa30 con 0x7f820c09af70 2024-09-16T01:17:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.514+0000 7f81f3fff640 1 -- 172.21.15.81:0/3083273407 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f820000bc20 con 0x7f820c09af70 2024-09-16T01:17:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.514+0000 7f81f3fff640 1 --2- 172.21.15.81:0/3083273407 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f81f806c2b0 0x7f81f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.514+0000 7f81f3fff640 1 -- 172.21.15.81:0/3083273407 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5249+0+0 (secure 0 0 0) 0x7f820008b610 con 0x7f820c09af70 2024-09-16T01:17:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.514+0000 7f820b7fe640 1 --2- 172.21.15.81:0/3083273407 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f81f806c2b0 0x7f81f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.515+0000 7f820b7fe640 1 --2- 172.21.15.81:0/3083273407 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f81f806c2b0 0x7f81f806e770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f81fc034000 tx=0x7f81fc02c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.518+0000 7f81f3fff640 1 -- 172.21.15.81:0/3083273407 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8200059fd0 con 0x7f820c09af70 2024-09-16T01:17:58.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.685+0000 7f8211ed0640 1 -- 172.21.15.81:0/3083273407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f820c0b4cf0 con 0x7f820c09af70 2024-09-16T01:17:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.737+0000 7f81f3fff640 1 -- 172.21.15.81:0/3083273407 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) ==== 138+0+0 (secure 0 0 0) 0x7f82000598d0 con 0x7f820c09af70 2024-09-16T01:17:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-16T01:17:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.740+0000 7f8211ed0640 1 -- 172.21.15.81:0/3083273407 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f81f806c2b0 msgr2=0x7f81f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.740+0000 7f8211ed0640 1 --2- 172.21.15.81:0/3083273407 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f81f806c2b0 0x7f81f806e770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f81fc034000 tx=0x7f81fc02c000 comp rx=0 tx=0).stop 2024-09-16T01:17:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.740+0000 7f8211ed0640 1 -- 172.21.15.81:0/3083273407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f820c09af70 msgr2=0x7f820c0b6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.740+0000 7f8211ed0640 1 --2- 172.21.15.81:0/3083273407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f820c09af70 0x7f820c0b6f10 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f820000d800 tx=0x7f820000dcc0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.740+0000 7f8211ed0640 1 -- 172.21.15.81:0/3083273407 shutdown_connections 2024-09-16T01:17:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.740+0000 7f8211ed0640 1 --2- 172.21.15.81:0/3083273407 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f81f806c2b0 0x7f81f806e770 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.740+0000 7f8211ed0640 1 --2- 172.21.15.81:0/3083273407 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f820c0b1920 0x7f820c0b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.740+0000 7f8211ed0640 1 --2- 172.21.15.81:0/3083273407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f820c09af70 0x7f820c0b6f10 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.740+0000 7f8211ed0640 1 --2- 172.21.15.81:0/3083273407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f820c071160 0x7f820c158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.740+0000 7f8211ed0640 1 -- 172.21.15.81:0/3083273407 >> 172.21.15.81:0/3083273407 conn(0x7f820c0b3de0 msgr2=0x7f820c09b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.740+0000 7f8211ed0640 1 -- 172.21.15.81:0/3083273407 shutdown_connections 2024-09-16T01:17:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.740+0000 7f8211ed0640 1 -- 172.21.15.81:0/3083273407 wait complete. 2024-09-16T01:17:58.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:17:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.858+0000 7f3287da8640 1 Processor -- start 2024-09-16T01:17:58.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.858+0000 7f3287da8640 1 -- start start 2024-09-16T01:17:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.859+0000 7f3287da8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f328015e2e0 0x7f32800b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.859+0000 7f3287da8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3280067ae0 0x7f328015f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.859+0000 7f3287da8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f328015f8f0 con 0x7f32800adce0 2024-09-16T01:17:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.859+0000 7f3287da8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f32800aec30 con 0x7f3280067ae0 2024-09-16T01:17:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.859+0000 7f3287da8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3280067ff0 con 0x7f328015e2e0 2024-09-16T01:17:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.859+0000 7f3285343640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3280067ae0 0x7f328015f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.859+0000 7f3286345640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f32800adce0 0x7f32800ae150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56652/0 (socket says 172.21.15.81:56652) 2024-09-16T01:17:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.859+0000 7f3286345640 1 -- 172.21.15.81:0/128475689 learned_addr learned my addr 172.21.15.81:0/128475689 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:17:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.859+0000 7f3285b44640 1 --2- 172.21.15.81:0/128475689 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f328015e2e0 0x7f32800b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.860+0000 7f3285343640 1 -- 172.21.15.81:0/128475689 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f328015e2e0 msgr2=0x7f32800b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.860+0000 7f3285343640 1 --2- 172.21.15.81:0/128475689 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f328015e2e0 0x7f32800b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.860+0000 7f3285343640 1 -- 172.21.15.81:0/128475689 >> v1:172.21.15.81:6789/0 conn(0x7f32800adce0 legacy=0x7f32800ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.860+0000 7f3284b42640 1 -- 172.21.15.81:0/128475689 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937197315 0 0) 0x7f3278001490 con 0x7f32800adce0 2024-09-16T01:17:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.860+0000 7f3285343640 1 -- 172.21.15.81:0/128475689 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32800af390 con 0x7f3280067ae0 2024-09-16T01:17:58.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.860+0000 7f3285343640 1 --2- 172.21.15.81:0/128475689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280067ae0 0x7f328015f3b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f32700097a0 tx=0x7f327002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1beb1c1161536fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:58.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.860+0000 7f3284b42640 1 -- 172.21.15.81:0/128475689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270037070 con 0x7f3280067ae0 2024-09-16T01:17:58.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.860+0000 7f3284b42640 1 -- 172.21.15.81:0/128475689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3270032440 con 0x7f3280067ae0 2024-09-16T01:17:58.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.860+0000 7f3284b42640 1 -- 172.21.15.81:0/128475689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3270032810 con 0x7f3280067ae0 2024-09-16T01:17:58.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.861+0000 7f3287da8640 1 -- 172.21.15.81:0/128475689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280067ae0 msgr2=0x7f328015f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.861+0000 7f3287da8640 1 --2- 172.21.15.81:0/128475689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280067ae0 0x7f328015f3b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f32700097a0 tx=0x7f327002a180 comp rx=0 tx=0).stop 2024-09-16T01:17:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.861+0000 7f3287da8640 1 -- 172.21.15.81:0/128475689 shutdown_connections 2024-09-16T01:17:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.861+0000 7f3287da8640 1 --2- 172.21.15.81:0/128475689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3280067ae0 0x7f328015f3b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.861+0000 7f3287da8640 1 --2- 172.21.15.81:0/128475689 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f328015e2e0 0x7f32800b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.861+0000 7f3287da8640 1 -- 172.21.15.81:0/128475689 >> 172.21.15.81:0/128475689 conn(0x7f3280073590 msgr2=0x7f328006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.861+0000 7f3287da8640 1 -- 172.21.15.81:0/128475689 shutdown_connections 2024-09-16T01:17:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.861+0000 7f3287da8640 1 -- 172.21.15.81:0/128475689 wait complete. 2024-09-16T01:17:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.862+0000 7f3287da8640 1 Processor -- start 2024-09-16T01:17:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.862+0000 7f3287da8640 1 -- start start 2024-09-16T01:17:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3287da8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3280067ae0 0x7f3280144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3287da8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32800adce0 0x7f3280147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3287da8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328015e2e0 0x7f3280159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3287da8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32800afc30 con 0x7f328015e2e0 2024-09-16T01:17:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3287da8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f32800af950 con 0x7f3280067ae0 2024-09-16T01:17:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3287da8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f328015e6c0 con 0x7f32800adce0 2024-09-16T01:17:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3286345640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328015e2e0 0x7f3280159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3286345640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328015e2e0 0x7f3280159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39098/0 (socket says 172.21.15.81:39098) 2024-09-16T01:17:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3286345640 1 -- 172.21.15.81:0/3919202034 learned_addr learned my addr 172.21.15.81:0/3919202034 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3285343640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32800adce0 0x7f3280147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3285b44640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3280067ae0 0x7f3280144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3286345640 1 -- 172.21.15.81:0/3919202034 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32800adce0 msgr2=0x7f3280147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3286345640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32800adce0 0x7f3280147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3286345640 1 -- 172.21.15.81:0/3919202034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3280067ae0 msgr2=0x7f3280144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:58.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3286345640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3280067ae0 0x7f3280144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:58.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3286345640 1 -- 172.21.15.81:0/3919202034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3280145340 con 0x7f328015e2e0 2024-09-16T01:17:58.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.863+0000 7f3285343640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32800adce0 0x7f3280147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:58.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.864+0000 7f3286345640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328015e2e0 0x7f3280159a30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f327800c7f0 tx=0x7f327800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:58.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.864+0000 7f32767fc640 1 -- 172.21.15.81:0/3919202034 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3278018070 con 0x7f328015e2e0 2024-09-16T01:17:58.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.864+0000 7f32767fc640 1 -- 172.21.15.81:0/3919202034 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327800a5e0 con 0x7f328015e2e0 2024-09-16T01:17:58.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.864+0000 7f3287da8640 1 -- 172.21.15.81:0/3919202034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3280147f30 con 0x7f328015e2e0 2024-09-16T01:17:58.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.864+0000 7f32767fc640 1 -- 172.21.15.81:0/3919202034 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327800aa10 con 0x7f328015e2e0 2024-09-16T01:17:58.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.864+0000 7f3287da8640 1 -- 172.21.15.81:0/3919202034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32801484f0 con 0x7f328015e2e0 2024-09-16T01:17:58.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.865+0000 7f3287da8640 1 -- 172.21.15.81:0/3919202034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f328015f3b0 con 0x7f328015e2e0 2024-09-16T01:17:58.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.866+0000 7f32767fc640 1 -- 172.21.15.81:0/3919202034 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f327801b070 con 0x7f328015e2e0 2024-09-16T01:17:58.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.866+0000 7f32767fc640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f326406c2b0 0x7f326406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:58.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.866+0000 7f32767fc640 1 -- 172.21.15.81:0/3919202034 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5619+0+0 (secure 0 0 0) 0x7f327808ac10 con 0x7f328015e2e0 2024-09-16T01:17:58.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.866+0000 7f3285b44640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f326406c2b0 0x7f326406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:58.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.866+0000 7f3285b44640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f326406c2b0 0x7f326406e770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f327c006fd0 tx=0x7f327c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:58.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:58.870+0000 7f32767fc640 1 -- 172.21.15.81:0/3919202034 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f328015f8f0 con 0x7f328015e2e0 2024-09-16T01:17:59.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.036+0000 7f3287da8640 1 -- 172.21.15.81:0/3919202034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f328015ed40 con 0x7f328015e2e0 2024-09-16T01:17:59.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.740+0000 7f32767fc640 1 -- 172.21.15.81:0/3919202034 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) ==== 170+0+0 (secure 0 0 0) 0x7f3278059540 con 0x7f328015e2e0 2024-09-16T01:17:59.741 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-16T01:17:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.743+0000 7f3287da8640 1 -- 172.21.15.81:0/3919202034 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f326406c2b0 msgr2=0x7f326406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.743+0000 7f3287da8640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f326406c2b0 0x7f326406e770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f327c006fd0 tx=0x7f327c008040 comp rx=0 tx=0).stop 2024-09-16T01:17:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.743+0000 7f3287da8640 1 -- 172.21.15.81:0/3919202034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328015e2e0 msgr2=0x7f3280159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.743+0000 7f3287da8640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328015e2e0 0x7f3280159a30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f327800c7f0 tx=0x7f327800ccb0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.743+0000 7f3287da8640 1 -- 172.21.15.81:0/3919202034 shutdown_connections 2024-09-16T01:17:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.743+0000 7f3287da8640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f326406c2b0 0x7f326406e770 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.743+0000 7f3287da8640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328015e2e0 0x7f3280159a30 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.743+0000 7f3287da8640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32800adce0 0x7f3280147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.743+0000 7f3287da8640 1 --2- 172.21.15.81:0/3919202034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3280067ae0 0x7f3280144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.743+0000 7f3287da8640 1 -- 172.21.15.81:0/3919202034 >> 172.21.15.81:0/3919202034 conn(0x7f3280073590 msgr2=0x7f32800b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.743+0000 7f3287da8640 1 -- 172.21.15.81:0/3919202034 shutdown_connections 2024-09-16T01:17:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.743+0000 7f3287da8640 1 -- 172.21.15.81:0/3919202034 wait complete. 2024-09-16T01:17:59.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:17:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.871+0000 7f0f5172c640 1 Processor -- start 2024-09-16T01:17:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.871+0000 7f0f5172c640 1 -- start start 2024-09-16T01:17:59.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f5172c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f4c15e410 0x7f0f4c0b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:59.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f5172c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f4c06bc10 0x7f0f4c06c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:59.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f5172c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4c0ae240 con 0x7f0f4c0b40c0 2024-09-16T01:17:59.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f5172c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0f4c06c5c0 con 0x7f0f4c15e410 2024-09-16T01:17:59.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f5172c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c0ae520 con 0x7f0f4c06bc10 2024-09-16T01:17:59.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f4affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f4c15e410 0x7f0f4c0b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:59.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f4affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f4c15e410 0x7f0f4c0b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39110/0 (socket says 172.21.15.81:39110) 2024-09-16T01:17:59.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f4affd640 1 -- 172.21.15.81:0/1572876725 learned_addr learned my addr 172.21.15.81:0/1572876725 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:59.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f4b7fe640 1 --2- 172.21.15.81:0/1572876725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f4c06bc10 0x7f0f4c06c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:59.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f4affd640 1 -- 172.21.15.81:0/1572876725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f4c06bc10 msgr2=0x7f0f4c06c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:59.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f4affd640 1 --2- 172.21.15.81:0/1572876725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f4c06bc10 0x7f0f4c06c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f4affd640 1 -- 172.21.15.81:0/1572876725 >> v1:172.21.15.102:6789/0 conn(0x7f0f4c0b40c0 legacy=0x7f0f4c0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:17:59.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f4affd640 1 -- 172.21.15.81:0/1572876725 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c0ae800 con 0x7f0f4c15e410 2024-09-16T01:17:59.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.872+0000 7f0f4b7fe640 1 --2- 172.21.15.81:0/1572876725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f4c06bc10 0x7f0f4c06c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:17:59.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.873+0000 7f0f4affd640 1 --2- 172.21.15.81:0/1572876725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f4c15e410 0x7f0f4c0b5fe0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009870 tx=0x7f0f3c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f254dba9f8f347d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:59.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.873+0000 7f0f49ffb640 1 -- 172.21.15.81:0/1572876725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c037070 con 0x7f0f4c15e410 2024-09-16T01:17:59.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.873+0000 7f0f49ffb640 1 -- 172.21.15.81:0/1572876725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f3c032440 con 0x7f0f4c15e410 2024-09-16T01:17:59.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.873+0000 7f0f49ffb640 1 -- 172.21.15.81:0/1572876725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c032810 con 0x7f0f4c15e410 2024-09-16T01:17:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.874+0000 7f0f5172c640 1 -- 172.21.15.81:0/1572876725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f4c15e410 msgr2=0x7f0f4c0b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.874+0000 7f0f5172c640 1 --2- 172.21.15.81:0/1572876725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f4c15e410 0x7f0f4c0b5fe0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009870 tx=0x7f0f3c02a180 comp rx=0 tx=0).stop 2024-09-16T01:17:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.874+0000 7f0f5172c640 1 -- 172.21.15.81:0/1572876725 shutdown_connections 2024-09-16T01:17:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.874+0000 7f0f5172c640 1 --2- 172.21.15.81:0/1572876725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f4c06bc10 0x7f0f4c06c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.874+0000 7f0f5172c640 1 --2- 172.21.15.81:0/1572876725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f4c15e410 0x7f0f4c0b5fe0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.874+0000 7f0f5172c640 1 -- 172.21.15.81:0/1572876725 >> 172.21.15.81:0/1572876725 conn(0x7f0f4c09aa30 msgr2=0x7f0f4c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:17:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.874+0000 7f0f5172c640 1 -- 172.21.15.81:0/1572876725 shutdown_connections 2024-09-16T01:17:59.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.874+0000 7f0f5172c640 1 -- 172.21.15.81:0/1572876725 wait complete. 2024-09-16T01:17:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.875+0000 7f0f5172c640 1 Processor -- start 2024-09-16T01:17:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.875+0000 7f0f5172c640 1 -- start start 2024-09-16T01:17:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f5172c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f4c06bc10 0x7f0f4c14fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f5172c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f4c0b40c0 0x7f0f4c1531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f5172c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f4c15e410 0x7f0f4c15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f5172c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c15e7f0 con 0x7f0f4c15e410 2024-09-16T01:17:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f5172c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c0b4510 con 0x7f0f4c06bc10 2024-09-16T01:17:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f5172c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c15e970 con 0x7f0f4c0b40c0 2024-09-16T01:17:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f4b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f4c15e410 0x7f0f4c15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:59.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f4b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f4c15e410 0x7f0f4c15cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39124/0 (socket says 172.21.15.81:39124) 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f4b7fe640 1 -- 172.21.15.81:0/2266632547 learned_addr learned my addr 172.21.15.81:0/2266632547 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f4affd640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f4c06bc10 0x7f0f4c14fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f4a7fc640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f4c0b40c0 0x7f0f4c1531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f4b7fe640 1 -- 172.21.15.81:0/2266632547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f4c0b40c0 msgr2=0x7f0f4c1531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f4b7fe640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f4c0b40c0 0x7f0f4c1531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f4b7fe640 1 -- 172.21.15.81:0/2266632547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f4c06bc10 msgr2=0x7f0f4c14fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f4b7fe640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f4c06bc10 0x7f0f4c14fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f4b7fe640 1 -- 172.21.15.81:0/2266632547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c15bec0 con 0x7f0f4c15e410 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f4affd640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f4c06bc10 0x7f0f4c14fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.876+0000 7f0f4b7fe640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f4c15e410 0x7f0f4c15cf60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400cd50 tx=0x7f0f4400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.877+0000 7f0f337fe640 1 -- 172.21.15.81:0/2266632547 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400f680 con 0x7f0f4c15e410 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.877+0000 7f0f337fe640 1 -- 172.21.15.81:0/2266632547 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4400f840 con 0x7f0f4c15e410 2024-09-16T01:17:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.877+0000 7f0f5172c640 1 -- 172.21.15.81:0/2266632547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4c15c1a0 con 0x7f0f4c15e410 2024-09-16T01:17:59.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.877+0000 7f0f337fe640 1 -- 172.21.15.81:0/2266632547 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400fc30 con 0x7f0f4c15e410 2024-09-16T01:17:59.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.877+0000 7f0f5172c640 1 -- 172.21.15.81:0/2266632547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4c15ca40 con 0x7f0f4c15e410 2024-09-16T01:17:59.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.878+0000 7f0f5172c640 1 -- 172.21.15.81:0/2266632547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f4c15c370 con 0x7f0f4c15e410 2024-09-16T01:17:59.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.878+0000 7f0f337fe640 1 -- 172.21.15.81:0/2266632547 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0f440213f0 con 0x7f0f4c15e410 2024-09-16T01:17:59.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.879+0000 7f0f337fe640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0f3806c2b0 0x7f0f3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:17:59.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.879+0000 7f0f337fe640 1 -- 172.21.15.81:0/2266632547 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6001+0+0 (secure 0 0 0) 0x7f0f4408c5c0 con 0x7f0f4c15e410 2024-09-16T01:17:59.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.879+0000 7f0f4affd640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0f3806c2b0 0x7f0f3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:17:59.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.879+0000 7f0f4affd640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0f3806c2b0 0x7f0f3806e770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c034000 tx=0x7f0f3c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:17:59.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:17:59.883+0000 7f0f337fe640 1 -- 172.21.15.81:0/2266632547 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f44014030 con 0x7f0f4c15e410 2024-09-16T01:18:00.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.080+0000 7f0f5172c640 1 -- 172.21.15.81:0/2266632547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0f4c15cc10 con 0x7f0f4c15e410 2024-09-16T01:18:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.763+0000 7f0f337fe640 1 -- 172.21.15.81:0/2266632547 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v26) ==== 173+0+0 (secure 0 0 0) 0x7f0f4405a720 con 0x7f0f4c15e410 2024-09-16T01:18:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 9 and data pool 10 2024-09-16T01:18:00.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.772+0000 7f0f5172c640 1 -- 172.21.15.81:0/2266632547 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0f3806c2b0 msgr2=0x7f0f3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:00.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.773+0000 7f0f5172c640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0f3806c2b0 0x7f0f3806e770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c034000 tx=0x7f0f3c02e000 comp rx=0 tx=0).stop 2024-09-16T01:18:00.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.773+0000 7f0f5172c640 1 -- 172.21.15.81:0/2266632547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f4c15e410 msgr2=0x7f0f4c15cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:00.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.773+0000 7f0f5172c640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f4c15e410 0x7f0f4c15cf60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400cd50 tx=0x7f0f4400a650 comp rx=0 tx=0).stop 2024-09-16T01:18:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.775+0000 7f0f5172c640 1 -- 172.21.15.81:0/2266632547 shutdown_connections 2024-09-16T01:18:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.775+0000 7f0f5172c640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0f3806c2b0 0x7f0f3806e770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.775+0000 7f0f5172c640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f4c15e410 0x7f0f4c15cf60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.775+0000 7f0f5172c640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f4c0b40c0 0x7f0f4c1531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.775+0000 7f0f5172c640 1 --2- 172.21.15.81:0/2266632547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f4c06bc10 0x7f0f4c14fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.775+0000 7f0f5172c640 1 -- 172.21.15.81:0/2266632547 >> 172.21.15.81:0/2266632547 conn(0x7f0f4c09aa30 msgr2=0x7f0f4c1594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.776+0000 7f0f5172c640 1 -- 172.21.15.81:0/2266632547 shutdown_connections 2024-09-16T01:18:00.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.776+0000 7f0f5172c640 1 -- 172.21.15.81:0/2266632547 wait complete. 2024-09-16T01:18:00.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:18:00.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.891+0000 7ff67e1c4640 1 Processor -- start 2024-09-16T01:18:00.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.891+0000 7ff67e1c4640 1 -- start start 2024-09-16T01:18:00.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff67e1c4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff67815b300 0x7ff6780cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:00.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff67e1c4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff67806f8d0 0x7ff67815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:00.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff67e1c4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6780cdbe0 con 0x7ff6780cd3f0 2024-09-16T01:18:00.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff67e1c4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff6780728a0 con 0x7ff67815b300 2024-09-16T01:18:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff67e1c4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff6780cd900 con 0x7ff67806f8d0 2024-09-16T01:18:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff6777fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff67815b300 0x7ff6780cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff676ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff6780cd3f0 0x7ff67806f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56664/0 (socket says 172.21.15.81:56664) 2024-09-16T01:18:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff676ffd640 1 -- 172.21.15.81:0/1876042335 learned_addr learned my addr 172.21.15.81:0/1876042335 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff677fff640 1 --2- 172.21.15.81:0/1876042335 >> v2:172.21.15.102:3300/0 conn(0x7ff67806f8d0 0x7ff67815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff6777fe640 1 -- 172.21.15.81:0/1876042335 >> v2:172.21.15.102:3300/0 conn(0x7ff67806f8d0 msgr2=0x7ff67815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff6777fe640 1 --2- 172.21.15.81:0/1876042335 >> v2:172.21.15.102:3300/0 conn(0x7ff67806f8d0 0x7ff67815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:00.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff6777fe640 1 -- 172.21.15.81:0/1876042335 >> v1:172.21.15.81:6789/0 conn(0x7ff6780cd3f0 legacy=0x7ff67806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff6777fe640 1 -- 172.21.15.81:0/1876042335 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff678072250 con 0x7ff67815b300 2024-09-16T01:18:00.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.892+0000 7ff6767fc640 1 -- 172.21.15.81:0/1876042335 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4015852818 0 0) 0x7ff6780cdbe0 con 0x7ff6780cd3f0 2024-09-16T01:18:00.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.893+0000 7ff6777fe640 1 --2- 172.21.15.81:0/1876042335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67815b300 0x7ff6780cceb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff6780b38f0 tx=0x7ff66802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513e24e848dafea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.893+0000 7ff6767fc640 1 -- 172.21.15.81:0/1876042335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668037070 con 0x7ff67815b300 2024-09-16T01:18:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.893+0000 7ff6767fc640 1 -- 172.21.15.81:0/1876042335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff668032440 con 0x7ff67815b300 2024-09-16T01:18:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.893+0000 7ff6767fc640 1 -- 172.21.15.81:0/1876042335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668032810 con 0x7ff67815b300 2024-09-16T01:18:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.894+0000 7ff67e1c4640 1 -- 172.21.15.81:0/1876042335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67815b300 msgr2=0x7ff6780cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.894+0000 7ff67e1c4640 1 --2- 172.21.15.81:0/1876042335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67815b300 0x7ff6780cceb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff6780b38f0 tx=0x7ff66802a1a0 comp rx=0 tx=0).stop 2024-09-16T01:18:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.894+0000 7ff67e1c4640 1 -- 172.21.15.81:0/1876042335 shutdown_connections 2024-09-16T01:18:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.894+0000 7ff67e1c4640 1 --2- 172.21.15.81:0/1876042335 >> v2:172.21.15.102:3300/0 conn(0x7ff67806f8d0 0x7ff67815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:00.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.894+0000 7ff67e1c4640 1 --2- 172.21.15.81:0/1876042335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67815b300 0x7ff6780cceb0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.894+0000 7ff67e1c4640 1 -- 172.21.15.81:0/1876042335 >> 172.21.15.81:0/1876042335 conn(0x7ff678067d70 msgr2=0x7ff67806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.894+0000 7ff67e1c4640 1 -- 172.21.15.81:0/1876042335 shutdown_connections 2024-09-16T01:18:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.894+0000 7ff67e1c4640 1 -- 172.21.15.81:0/1876042335 wait complete. 2024-09-16T01:18:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.895+0000 7ff67e1c4640 1 Processor -- start 2024-09-16T01:18:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.895+0000 7ff67e1c4640 1 -- start start 2024-09-16T01:18:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff67e1c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67806f8d0 0x7ff6781f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff67e1c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6780cd3f0 0x7ff67814fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff67e1c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff67815b300 0x7ff6780ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff67e1c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6780d0160 con 0x7ff67806f8d0 2024-09-16T01:18:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff67e1c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff6780cffe0 con 0x7ff6780cd3f0 2024-09-16T01:18:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff67e1c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff678072d30 con 0x7ff67815b300 2024-09-16T01:18:00.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff6777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67806f8d0 0x7ff6781f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:00.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff6777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67806f8d0 0x7ff6781f5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39142/0 (socket says 172.21.15.81:39142) 2024-09-16T01:18:00.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff6777fe640 1 -- 172.21.15.81:0/3029504481 learned_addr learned my addr 172.21.15.81:0/3029504481 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:00.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff676ffd640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6780cd3f0 0x7ff67814fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:00.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff677fff640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff67815b300 0x7ff6780ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:00.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff6777fe640 1 -- 172.21.15.81:0/3029504481 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff67815b300 msgr2=0x7ff6780ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:00.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff6777fe640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff67815b300 0x7ff6780ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:00.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff6777fe640 1 -- 172.21.15.81:0/3029504481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6780cd3f0 msgr2=0x7ff67814fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:00.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff6777fe640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6780cd3f0 0x7ff67814fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:00.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff6777fe640 1 -- 172.21.15.81:0/3029504481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6781541e0 con 0x7ff67806f8d0 2024-09-16T01:18:00.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff676ffd640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6780cd3f0 0x7ff67814fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:00.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff677fff640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff67815b300 0x7ff6780ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:00.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.896+0000 7ff6777fe640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67806f8d0 0x7ff6781f5330 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff668000c00 tx=0x7ff6680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:00.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.897+0000 7ff65ffff640 1 -- 172.21.15.81:0/3029504481 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668037050 con 0x7ff67806f8d0 2024-09-16T01:18:00.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.897+0000 7ff65ffff640 1 -- 172.21.15.81:0/3029504481 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff668038040 con 0x7ff67806f8d0 2024-09-16T01:18:00.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.897+0000 7ff67e1c4640 1 -- 172.21.15.81:0/3029504481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6781544c0 con 0x7ff67806f8d0 2024-09-16T01:18:00.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.897+0000 7ff65ffff640 1 -- 172.21.15.81:0/3029504481 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff668004470 con 0x7ff67806f8d0 2024-09-16T01:18:00.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.897+0000 7ff67e1c4640 1 -- 172.21.15.81:0/3029504481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff678154a80 con 0x7ff67806f8d0 2024-09-16T01:18:00.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.898+0000 7ff67e1c4640 1 -- 172.21.15.81:0/3029504481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67815d2d0 con 0x7ff67806f8d0 2024-09-16T01:18:00.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.898+0000 7ff65ffff640 1 -- 172.21.15.81:0/3029504481 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff668030900 con 0x7ff67806f8d0 2024-09-16T01:18:00.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.898+0000 7ff65ffff640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff66406c2b0 0x7ff66406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:00.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.899+0000 7ff65ffff640 1 -- 172.21.15.81:0/3029504481 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7ff6680ac200 con 0x7ff67806f8d0 2024-09-16T01:18:00.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.899+0000 7ff676ffd640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff66406c2b0 0x7ff66406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:00.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.899+0000 7ff676ffd640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff66406c2b0 0x7ff66406e770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff678158ea0 tx=0x7ff66c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:00.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:00.903+0000 7ff65ffff640 1 -- 172.21.15.81:0/3029504481 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff66807a900 con 0x7ff67806f8d0 2024-09-16T01:18:01.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.069+0000 7ff67e1c4640 1 -- 172.21.15.81:0/3029504481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff67815e370 con 0x7ff67806f8d0 2024-09-16T01:18:01.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.070+0000 7ff65ffff640 1 -- 172.21.15.81:0/3029504481 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16957 (secure 0 0 0) 0x7ff66807a200 con 0x7ff67806f8d0 2024-09-16T01:18:01.071 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:01.071 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":62,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:00.081518+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:17:58.703890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-16T01:17:59.055322+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:18:01.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.072+0000 7ff67e1c4640 1 -- 172.21.15.81:0/3029504481 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff66406c2b0 msgr2=0x7ff66406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.072+0000 7ff67e1c4640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff66406c2b0 0x7ff66406e770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff678158ea0 tx=0x7ff66c009040 comp rx=0 tx=0).stop 2024-09-16T01:18:01.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.072+0000 7ff67e1c4640 1 -- 172.21.15.81:0/3029504481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67806f8d0 msgr2=0x7ff6781f5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.072+0000 7ff67e1c4640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67806f8d0 0x7ff6781f5330 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff668000c00 tx=0x7ff6680046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.072+0000 7ff67e1c4640 1 -- 172.21.15.81:0/3029504481 shutdown_connections 2024-09-16T01:18:01.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.072+0000 7ff67e1c4640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff66406c2b0 0x7ff66406e770 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.072+0000 7ff67e1c4640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff67815b300 0x7ff6780ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.072+0000 7ff67e1c4640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6780cd3f0 0x7ff67814fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.072+0000 7ff67e1c4640 1 --2- 172.21.15.81:0/3029504481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67806f8d0 0x7ff6781f5330 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.072+0000 7ff67e1c4640 1 -- 172.21.15.81:0/3029504481 >> 172.21.15.81:0/3029504481 conn(0x7ff678067d70 msgr2=0x7ff6780b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:01.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.072+0000 7ff67e1c4640 1 -- 172.21.15.81:0/3029504481 shutdown_connections 2024-09-16T01:18:01.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.072+0000 7ff67e1c4640 1 -- 172.21.15.81:0/3029504481 wait complete. 2024-09-16T01:18:01.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:18:01.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.181+0000 7f959baf1640 1 Processor -- start 2024-09-16T01:18:01.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.181+0000 7f959baf1640 1 -- start start 2024-09-16T01:18:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959baf1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9594072d30 0x7f959406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959baf1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f959406f700 0x7f959415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959baf1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959406fae0 con 0x7f959415b300 2024-09-16T01:18:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959baf1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f95940728a0 con 0x7f959406f700 2024-09-16T01:18:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959baf1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f95940cdbe0 con 0x7f9594072d30 2024-09-16T01:18:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959a08e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f959406f700 0x7f959415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959988d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f959415b300 0x7f95940cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53192/0 (socket says 172.21.15.81:53192) 2024-09-16T01:18:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959988d640 1 -- 172.21.15.81:0/3859873660 learned_addr learned my addr 172.21.15.81:0/3859873660 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959908c640 1 --2- 172.21.15.81:0/3859873660 >> v2:172.21.15.102:3300/0 conn(0x7f9594072d30 0x7f959406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959a08e640 1 -- 172.21.15.81:0/3859873660 >> v2:172.21.15.102:3300/0 conn(0x7f9594072d30 msgr2=0x7f959406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959a08e640 1 --2- 172.21.15.81:0/3859873660 >> v2:172.21.15.102:3300/0 conn(0x7f9594072d30 0x7f959406f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959a08e640 1 -- 172.21.15.81:0/3859873660 >> v1:172.21.15.81:6789/0 conn(0x7f959415b300 legacy=0x7f95940cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.182+0000 7f959a08e640 1 -- 172.21.15.81:0/3859873660 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95940cd900 con 0x7f959406f700 2024-09-16T01:18:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.183+0000 7f959a08e640 1 --2- 172.21.15.81:0/3859873660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f959406f700 0x7f959415b6e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f95940b57c0 tx=0x7f958c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5d98d4f646a22d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.183+0000 7f959888b640 1 -- 172.21.15.81:0/3859873660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c007740 con 0x7f959406f700 2024-09-16T01:18:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.183+0000 7f959888b640 1 -- 172.21.15.81:0/3859873660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f958c0078e0 con 0x7f959406f700 2024-09-16T01:18:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.183+0000 7f959888b640 1 -- 172.21.15.81:0/3859873660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c007cb0 con 0x7f959406f700 2024-09-16T01:18:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.184+0000 7f959baf1640 1 -- 172.21.15.81:0/3859873660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f959406f700 msgr2=0x7f959415b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.184+0000 7f959baf1640 1 --2- 172.21.15.81:0/3859873660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f959406f700 0x7f959415b6e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f95940b57c0 tx=0x7f958c02a5f0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.184+0000 7f959baf1640 1 -- 172.21.15.81:0/3859873660 shutdown_connections 2024-09-16T01:18:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.184+0000 7f959baf1640 1 --2- 172.21.15.81:0/3859873660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f959406f700 0x7f959415b6e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.184+0000 7f959baf1640 1 --2- 172.21.15.81:0/3859873660 >> v2:172.21.15.102:3300/0 conn(0x7f9594072d30 0x7f959406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.184+0000 7f959baf1640 1 -- 172.21.15.81:0/3859873660 >> 172.21.15.81:0/3859873660 conn(0x7f9594067d70 msgr2=0x7f959406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.184+0000 7f959baf1640 1 -- 172.21.15.81:0/3859873660 shutdown_connections 2024-09-16T01:18:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.184+0000 7f959baf1640 1 -- 172.21.15.81:0/3859873660 wait complete. 2024-09-16T01:18:01.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.185+0000 7f959baf1640 1 Processor -- start 2024-09-16T01:18:01.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.185+0000 7f959baf1640 1 -- start start 2024-09-16T01:18:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959baf1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f959406f700 0x7f9594157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959baf1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9594072d30 0x7f95940cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959baf1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f959415b300 0x7f959414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959baf1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f95940cd5c0 con 0x7f959415b300 2024-09-16T01:18:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959baf1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9594072530 con 0x7f959406f700 2024-09-16T01:18:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959baf1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f95940cffe0 con 0x7f9594072d30 2024-09-16T01:18:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959a08e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f959415b300 0x7f959414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959a08e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f959415b300 0x7f959414f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50170/0 (socket says 172.21.15.81:50170) 2024-09-16T01:18:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959a08e640 1 -- 172.21.15.81:0/4263209230 learned_addr learned my addr 172.21.15.81:0/4263209230 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959a08e640 1 -- 172.21.15.81:0/4263209230 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9594072d30 msgr2=0x7f95940cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959988d640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f959406f700 0x7f9594157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959908c640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9594072d30 0x7f95940cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959a08e640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9594072d30 0x7f95940cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959a08e640 1 -- 172.21.15.81:0/4263209230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f959406f700 msgr2=0x7f9594157a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959a08e640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f959406f700 0x7f9594157a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959a08e640 1 -- 172.21.15.81:0/4263209230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95941555f0 con 0x7f959415b300 2024-09-16T01:18:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959988d640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f959406f700 0x7f9594157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959908c640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9594072d30 0x7f95940cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:01.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959a08e640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f959415b300 0x7f959414f1a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f958c02abe0 tx=0x7f958c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f958a7fc640 1 -- 172.21.15.81:0/4263209230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c03f070 con 0x7f959415b300 2024-09-16T01:18:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f958a7fc640 1 -- 172.21.15.81:0/4263209230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f958c031c90 con 0x7f959415b300 2024-09-16T01:18:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f958a7fc640 1 -- 172.21.15.81:0/4263209230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f958c044680 con 0x7f959415b300 2024-09-16T01:18:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.186+0000 7f959baf1640 1 -- 172.21.15.81:0/4263209230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95941558d0 con 0x7f959415b300 2024-09-16T01:18:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.187+0000 7f959baf1640 1 -- 172.21.15.81:0/4263209230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959414f6e0 con 0x7f959415b300 2024-09-16T01:18:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.187+0000 7f959baf1640 1 -- 172.21.15.81:0/4263209230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959406c940 con 0x7f959415b300 2024-09-16T01:18:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.188+0000 7f958a7fc640 1 -- 172.21.15.81:0/4263209230 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f958c03b410 con 0x7f959415b300 2024-09-16T01:18:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.188+0000 7f958a7fc640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f957806c2b0 0x7f957806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.188+0000 7f959988d640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f957806c2b0 0x7f957806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.188+0000 7f958a7fc640 1 -- 172.21.15.81:0/4263209230 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f958c0ace20 con 0x7f959415b300 2024-09-16T01:18:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.189+0000 7f959988d640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f957806c2b0 0x7f957806e770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9590000f60 tx=0x7f9590009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.192+0000 7f958a7fc640 1 -- 172.21.15.81:0/4263209230 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f959406c940 con 0x7f959415b300 2024-09-16T01:18:01.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.361+0000 7f959baf1640 1 -- 172.21.15.81:0/4263209230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f959406f1c0 con 0x7f959415b300 2024-09-16T01:18:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.362+0000 7f958a7fc640 1 -- 172.21.15.81:0/4263209230 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+16957 (secure 0 0 0) 0x7f958c07af00 con 0x7f959415b300 2024-09-16T01:18:01.363 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:01.363 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":62,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:00.081518+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:17:58.703890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-16T01:17:59.055322+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:18:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.364+0000 7f959baf1640 1 -- 172.21.15.81:0/4263209230 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f957806c2b0 msgr2=0x7f957806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.364+0000 7f959baf1640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f957806c2b0 0x7f957806e770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9590000f60 tx=0x7f9590009040 comp rx=0 tx=0).stop 2024-09-16T01:18:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.364+0000 7f959baf1640 1 -- 172.21.15.81:0/4263209230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f959415b300 msgr2=0x7f959414f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.364+0000 7f959baf1640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f959415b300 0x7f959414f1a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f958c02abe0 tx=0x7f958c004a40 comp rx=0 tx=0).stop 2024-09-16T01:18:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.364+0000 7f959baf1640 1 -- 172.21.15.81:0/4263209230 shutdown_connections 2024-09-16T01:18:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.364+0000 7f959baf1640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f957806c2b0 0x7f957806e770 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.364+0000 7f959baf1640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f959415b300 0x7f959414f1a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.364+0000 7f959baf1640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9594072d30 0x7f95940cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.364+0000 7f959baf1640 1 --2- 172.21.15.81:0/4263209230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f959406f700 0x7f9594157a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.364+0000 7f959baf1640 1 -- 172.21.15.81:0/4263209230 >> 172.21.15.81:0/4263209230 conn(0x7f9594067d70 msgr2=0x7f95940b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.364+0000 7f959baf1640 1 -- 172.21.15.81:0/4263209230 shutdown_connections 2024-09-16T01:18:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.364+0000 7f959baf1640 1 -- 172.21.15.81:0/4263209230 wait complete. 2024-09-16T01:18:01.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:18:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.477+0000 7f007ee65640 1 Processor -- start 2024-09-16T01:18:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.477+0000 7f007ee65640 1 -- start start 2024-09-16T01:18:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.478+0000 7f007ee65640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f007809aa30 0x7f00780d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.478+0000 7f007ee65640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00780d0bd0 con 0x7f007809ae10 2024-09-16T01:18:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.478+0000 7f007ee65640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00780d0eb0 con 0x7f007806cf20 2024-09-16T01:18:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.478+0000 7f007ee65640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f00780d17e0 con 0x7f007809aa30 2024-09-16T01:18:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.478+0000 7f0077fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f007809ae10 0x7f007815f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53206/0 (socket says 172.21.15.81:53206) 2024-09-16T01:18:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.478+0000 7f0077fff640 1 -- 172.21.15.81:0/1166057190 learned_addr learned my addr 172.21.15.81:0/1166057190 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.478+0000 7f007cc01640 1 --2- 172.21.15.81:0/1166057190 >> v2:172.21.15.81:3300/0 conn(0x7f007809aa30 0x7f00780d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.479+0000 7f00777fe640 1 -- 172.21.15.81:0/1166057190 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1265819064 0 0) 0x7f00780d0bd0 con 0x7f007809ae10 2024-09-16T01:18:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.479+0000 7f00777fe640 1 -- 172.21.15.81:0/1166057190 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0060003520 con 0x7f007809ae10 2024-09-16T01:18:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.479+0000 7f007cc01640 1 -- 172.21.15.81:0/1166057190 >> v1:172.21.15.102:6789/0 conn(0x7f007806cf20 legacy=0x7f007806d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.479+0000 7f007cc01640 1 -- 172.21.15.81:0/1166057190 >> v1:172.21.15.81:6789/0 conn(0x7f007809ae10 legacy=0x7f007815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.479+0000 7f007cc01640 1 -- 172.21.15.81:0/1166057190 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00780d1190 con 0x7f007809aa30 2024-09-16T01:18:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.480+0000 7f007cc01640 1 --2- 172.21.15.81:0/1166057190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007809aa30 0x7f00780d0510 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f00680097a0 tx=0x7f006802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a006699c89e84e13 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.480+0000 7f00777fe640 1 -- 172.21.15.81:0/1166057190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068037070 con 0x7f007809aa30 2024-09-16T01:18:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.480+0000 7f00777fe640 1 -- 172.21.15.81:0/1166057190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0068032640 con 0x7f007809aa30 2024-09-16T01:18:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.480+0000 7f00777fe640 1 -- 172.21.15.81:0/1166057190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0068032a10 con 0x7f007809aa30 2024-09-16T01:18:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.480+0000 7f007ee65640 1 -- 172.21.15.81:0/1166057190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007809aa30 msgr2=0x7f00780d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.480+0000 7f007ee65640 1 --2- 172.21.15.81:0/1166057190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007809aa30 0x7f00780d0510 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f00680097a0 tx=0x7f006802a2c0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.480+0000 7f007ee65640 1 -- 172.21.15.81:0/1166057190 shutdown_connections 2024-09-16T01:18:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.480+0000 7f007ee65640 1 --2- 172.21.15.81:0/1166057190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007809aa30 0x7f00780d0510 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.480+0000 7f007ee65640 1 -- 172.21.15.81:0/1166057190 >> 172.21.15.81:0/1166057190 conn(0x7f00780d2380 msgr2=0x7f00780d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.480+0000 7f007ee65640 1 -- 172.21.15.81:0/1166057190 shutdown_connections 2024-09-16T01:18:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.480+0000 7f007ee65640 1 -- 172.21.15.81:0/1166057190 wait complete. 2024-09-16T01:18:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.482+0000 7f007ee65640 1 Processor -- start 2024-09-16T01:18:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.482+0000 7f007ee65640 1 -- start start 2024-09-16T01:18:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.482+0000 7f007ee65640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f007806cf20 0x7f007809fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.482+0000 7f007ee65640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f007809aa30 0x7f007815a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007ee65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007809ae10 0x7f007815d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007ee65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f007815fa20 con 0x7f007809ae10 2024-09-16T01:18:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007ee65640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f007809b280 con 0x7f007806cf20 2024-09-16T01:18:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007ee65640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f007815fba0 con 0x7f007809aa30 2024-09-16T01:18:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007d402640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007809ae10 0x7f007815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007d402640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007809ae10 0x7f007815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50188/0 (socket says 172.21.15.81:50188) 2024-09-16T01:18:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007d402640 1 -- 172.21.15.81:0/2511075325 learned_addr learned my addr 172.21.15.81:0/2511075325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007cc01640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f007806cf20 0x7f007809fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f0077fff640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f007809aa30 0x7f007815a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007d402640 1 -- 172.21.15.81:0/2511075325 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f007809aa30 msgr2=0x7f007815a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007d402640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f007809aa30 0x7f007815a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007d402640 1 -- 172.21.15.81:0/2511075325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f007806cf20 msgr2=0x7f007809fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007d402640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f007806cf20 0x7f007809fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007d402640 1 -- 172.21.15.81:0/2511075325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007809c4d0 con 0x7f007809ae10 2024-09-16T01:18:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f0077fff640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f007809aa30 0x7f007815a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007d402640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007809ae10 0x7f007815d020 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f007000c730 tx=0x7f007000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f00757fa640 1 -- 172.21.15.81:0/2511075325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070016020 con 0x7f007809ae10 2024-09-16T01:18:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f00757fa640 1 -- 172.21.15.81:0/2511075325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0070006d50 con 0x7f007809ae10 2024-09-16T01:18:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007ee65640 1 -- 172.21.15.81:0/2511075325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007809c7b0 con 0x7f007809ae10 2024-09-16T01:18:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f00757fa640 1 -- 172.21.15.81:0/2511075325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070003bb0 con 0x7f007809ae10 2024-09-16T01:18:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.483+0000 7f007ee65640 1 -- 172.21.15.81:0/2511075325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f007809cd70 con 0x7f007809ae10 2024-09-16T01:18:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.484+0000 7f007ee65640 1 -- 172.21.15.81:0/2511075325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00780d0510 con 0x7f007809ae10 2024-09-16T01:18:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.485+0000 7f00757fa640 1 -- 172.21.15.81:0/2511075325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f00700050d0 con 0x7f007809ae10 2024-09-16T01:18:01.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.485+0000 7f00757fa640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f006406c2e0 0x7f006406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.485+0000 7f00757fa640 1 -- 172.21.15.81:0/2511075325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6101+0+0 (secure 0 0 0) 0x7f007008b070 con 0x7f007809ae10 2024-09-16T01:18:01.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.485+0000 7f007cc01640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f006406c2e0 0x7f006406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.486+0000 7f007cc01640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f006406c2e0 0x7f006406e7a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0068034000 tx=0x7f006802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:01.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.489+0000 7f00757fa640 1 -- 172.21.15.81:0/2511075325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0070020020 con 0x7f007809ae10 2024-09-16T01:18:01.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.689+0000 7f007ee65640 1 -- 172.21.15.81:0/2511075325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0078162ef0 con 0x7f007809ae10 2024-09-16T01:18:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.834+0000 7f00757fa640 1 -- 172.21.15.81:0/2511075325 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f00700596e0 con 0x7f007809ae10 2024-09-16T01:18:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.836+0000 7f007ee65640 1 -- 172.21.15.81:0/2511075325 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f006406c2e0 msgr2=0x7f006406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.836+0000 7f007ee65640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f006406c2e0 0x7f006406e7a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0068034000 tx=0x7f006802e000 comp rx=0 tx=0).stop 2024-09-16T01:18:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.836+0000 7f007ee65640 1 -- 172.21.15.81:0/2511075325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007809ae10 msgr2=0x7f007815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.836+0000 7f007ee65640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007809ae10 0x7f007815d020 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f007000c730 tx=0x7f007000cb30 comp rx=0 tx=0).stop 2024-09-16T01:18:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.836+0000 7f007ee65640 1 -- 172.21.15.81:0/2511075325 shutdown_connections 2024-09-16T01:18:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.836+0000 7f007ee65640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f006406c2e0 0x7f006406e7a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.836+0000 7f007ee65640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007809ae10 0x7f007815d020 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.836+0000 7f007ee65640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f007809aa30 0x7f007815a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.836+0000 7f007ee65640 1 --2- 172.21.15.81:0/2511075325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f007806cf20 0x7f007809fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.837+0000 7f007ee65640 1 -- 172.21.15.81:0/2511075325 >> 172.21.15.81:0/2511075325 conn(0x7f00780d2380 msgr2=0x7f00780b6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.837+0000 7f007ee65640 1 -- 172.21.15.81:0/2511075325 shutdown_connections 2024-09-16T01:18:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.837+0000 7f007ee65640 1 -- 172.21.15.81:0/2511075325 wait complete. 2024-09-16T01:18:01.848 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T01:18:01.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:18:01.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.949+0000 7fc51a6dd640 1 Processor -- start 2024-09-16T01:18:01.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.949+0000 7fc51a6dd640 1 -- start start 2024-09-16T01:18:01.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.950+0000 7fc51a6dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc51415b570 0x7fc514071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.950+0000 7fc51a6dd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc514073b20 con 0x7fc51415b950 2024-09-16T01:18:01.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.950+0000 7fc51a6dd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc514073e00 con 0x7fc5140cd120 2024-09-16T01:18:01.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.950+0000 7fc51a6dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc5140740e0 con 0x7fc51415b570 2024-09-16T01:18:01.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.950+0000 7fc5137fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc51415b950 0x7fc5140cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53222/0 (socket says 172.21.15.81:53222) 2024-09-16T01:18:01.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.950+0000 7fc5137fe640 1 -- 172.21.15.81:0/956093113 learned_addr learned my addr 172.21.15.81:0/956093113 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:01.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.950+0000 7fc513fff640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc51415b570 0x7fc514071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.950+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4194651113 0 0) 0x7fc514073b20 con 0x7fc51415b950 2024-09-16T01:18:01.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.950+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4fc004630 con 0x7fc51415b950 2024-09-16T01:18:01.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3220136088 0 0) 0x7fc4fc004630 con 0x7fc51415b950 2024-09-16T01:18:01.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc51415b570 msgr2=0x7fc514071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:01.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc51415b570 0x7fc514071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 >> v1:172.21.15.102:6789/0 conn(0x7fc5140cd120 legacy=0x7fc51415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5140cf320 con 0x7fc51415b950 2024-09-16T01:18:01.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fc508001670 con 0x7fc51415b950 2024-09-16T01:18:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 >> v1:172.21.15.81:6789/0 conn(0x7fc51415b950 legacy=0x7fc5140cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc004af0 0x7fc4fc004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4fc0054a0 0x7fc4fc005970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc51415b570 0x7fc4fc006270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc5140740e0 con 0x7fc4fc004af0 2024-09-16T01:18:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc4fc003540 con 0x7fc4fc0054a0 2024-09-16T01:18:01.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc4fc003740 con 0x7fc51415b570 2024-09-16T01:18:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc513fff640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc004af0 0x7fc4fc004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc5137fe640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4fc0054a0 0x7fc4fc005970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc518c7a640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc51415b570 0x7fc4fc006270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc513fff640 1 -- 172.21.15.81:0/956093113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc51415b570 msgr2=0x7fc4fc006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc513fff640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc51415b570 0x7fc4fc006270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc513fff640 1 -- 172.21.15.81:0/956093113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4fc0054a0 msgr2=0x7fc4fc005970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc513fff640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4fc0054a0 0x7fc4fc005970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc513fff640 1 -- 172.21.15.81:0/956093113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4fc004630 con 0x7fc4fc004af0 2024-09-16T01:18:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.951+0000 7fc5137fe640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4fc0054a0 0x7fc4fc005970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.952+0000 7fc513fff640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc004af0 0x7fc4fc004ed0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc504009ac0 tx=0x7fc4fc006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a60812d8238a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.952+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504036070 con 0x7fc4fc004af0 2024-09-16T01:18:01.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.952+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc504031400 con 0x7fc4fc004af0 2024-09-16T01:18:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.952+0000 7fc512ffd640 1 -- 172.21.15.81:0/956093113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504009690 con 0x7fc4fc004af0 2024-09-16T01:18:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.952+0000 7fc51a6dd640 1 -- 172.21.15.81:0/956093113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc004af0 msgr2=0x7fc4fc004ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.952+0000 7fc51a6dd640 1 --2- 172.21.15.81:0/956093113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc004af0 0x7fc4fc004ed0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc504009ac0 tx=0x7fc4fc006940 comp rx=0 tx=0).stop 2024-09-16T01:18:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.952+0000 7fc518c7a640 1 -- 172.21.15.81:0/956093113 reap_dead start 2024-09-16T01:18:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.952+0000 7fc51a6dd640 1 -- 172.21.15.81:0/956093113 shutdown_connections 2024-09-16T01:18:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.952+0000 7fc51a6dd640 1 -- 172.21.15.81:0/956093113 >> 172.21.15.81:0/956093113 conn(0x7fc51406bdf0 msgr2=0x7fc51406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.952+0000 7fc51a6dd640 1 -- 172.21.15.81:0/956093113 shutdown_connections 2024-09-16T01:18:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.952+0000 7fc51a6dd640 1 -- 172.21.15.81:0/956093113 wait complete. 2024-09-16T01:18:01.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.954+0000 7fc51a6dd640 1 Processor -- start 2024-09-16T01:18:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.954+0000 7fc51a6dd640 1 -- start start 2024-09-16T01:18:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.954+0000 7fc51a6dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc004af0 0x7fc5140ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.954+0000 7fc51a6dd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc51415e960 0x7fc51414f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc51a6dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc514156f60 0x7fc5141573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc51a6dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc5140cf840 con 0x7fc4fc004af0 2024-09-16T01:18:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc51a6dd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc514072450 con 0x7fc51415e960 2024-09-16T01:18:01.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc51a6dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc5140cf9c0 con 0x7fc514156f60 2024-09-16T01:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc513fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc004af0 0x7fc5140ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc513fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc004af0 0x7fc5140ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50212/0 (socket says 172.21.15.81:50212) 2024-09-16T01:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc513fff640 1 -- 172.21.15.81:0/416909393 learned_addr learned my addr 172.21.15.81:0/416909393 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc5137fe640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc51415e960 0x7fc51414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc518c7a640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc514156f60 0x7fc5141573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc513fff640 1 -- 172.21.15.81:0/416909393 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc514156f60 msgr2=0x7fc5141573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc513fff640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc514156f60 0x7fc5141573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc513fff640 1 -- 172.21.15.81:0/416909393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc51415e960 msgr2=0x7fc51414f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc513fff640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc51415e960 0x7fc51414f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc513fff640 1 -- 172.21.15.81:0/416909393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5140adf70 con 0x7fc4fc004af0 2024-09-16T01:18:01.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc513fff640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc004af0 0x7fc5140ada30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc504009ac0 tx=0x7fc504004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc510ff9640 1 -- 172.21.15.81:0/416909393 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504040020 con 0x7fc4fc004af0 2024-09-16T01:18:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc510ff9640 1 -- 172.21.15.81:0/416909393 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc504003bc0 con 0x7fc4fc004af0 2024-09-16T01:18:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc51a6dd640 1 -- 172.21.15.81:0/416909393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5140ae210 con 0x7fc4fc004af0 2024-09-16T01:18:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc510ff9640 1 -- 172.21.15.81:0/416909393 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504036040 con 0x7fc4fc004af0 2024-09-16T01:18:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.955+0000 7fc51a6dd640 1 -- 172.21.15.81:0/416909393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5140ae7d0 con 0x7fc4fc004af0 2024-09-16T01:18:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.956+0000 7fc51a6dd640 1 -- 172.21.15.81:0/416909393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5140cd540 con 0x7fc4fc004af0 2024-09-16T01:18:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.957+0000 7fc510ff9640 1 -- 172.21.15.81:0/416909393 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc504043020 con 0x7fc4fc004af0 2024-09-16T01:18:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.957+0000 7fc510ff9640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc50006c2b0 0x7fc50006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.957+0000 7fc5137fe640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc50006c2b0 0x7fc50006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:01.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.957+0000 7fc510ff9640 1 -- 172.21.15.81:0/416909393 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fc5040ab6a0 con 0x7fc4fc004af0 2024-09-16T01:18:01.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.958+0000 7fc5137fe640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc50006c2b0 0x7fc50006e770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc5140cbac0 tx=0x7fc508009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:01.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:01.961+0000 7fc510ff9640 1 -- 172.21.15.81:0/416909393 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5140cd540 con 0x7fc4fc004af0 2024-09-16T01:18:02.014 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-16T01:18:02.013+0000 7f3be739f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:18:02.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.162+0000 7fc51a6dd640 1 -- 172.21.15.81:0/416909393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc514050050 con 0x7fc4fc004af0 2024-09-16T01:18:02.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.838+0000 7fc510ff9640 1 -- 172.21.15.81:0/416909393 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v29) ==== 122+0+0 (secure 0 0 0) 0x7fc514050050 con 0x7fc4fc004af0 2024-09-16T01:18:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.841+0000 7fc51a6dd640 1 -- 172.21.15.81:0/416909393 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc50006c2b0 msgr2=0x7fc50006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.841+0000 7fc51a6dd640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc50006c2b0 0x7fc50006e770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc5140cbac0 tx=0x7fc508009040 comp rx=0 tx=0).stop 2024-09-16T01:18:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.841+0000 7fc51a6dd640 1 -- 172.21.15.81:0/416909393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc004af0 msgr2=0x7fc5140ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.841+0000 7fc51a6dd640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc004af0 0x7fc5140ada30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc504009ac0 tx=0x7fc504004730 comp rx=0 tx=0).stop 2024-09-16T01:18:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.841+0000 7fc51a6dd640 1 -- 172.21.15.81:0/416909393 shutdown_connections 2024-09-16T01:18:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.841+0000 7fc51a6dd640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc50006c2b0 0x7fc50006e770 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.841+0000 7fc51a6dd640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc514156f60 0x7fc5141573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.841+0000 7fc51a6dd640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc51415e960 0x7fc51414f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.841+0000 7fc51a6dd640 1 --2- 172.21.15.81:0/416909393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc004af0 0x7fc5140ada30 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.841+0000 7fc51a6dd640 1 -- 172.21.15.81:0/416909393 >> 172.21.15.81:0/416909393 conn(0x7fc51406bdf0 msgr2=0x7fc51415a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.841+0000 7fc51a6dd640 1 -- 172.21.15.81:0/416909393 shutdown_connections 2024-09-16T01:18:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.841+0000 7fc51a6dd640 1 -- 172.21.15.81:0/416909393 wait complete. 2024-09-16T01:18:02.855 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:18:02.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:02.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.959+0000 7f864a186640 1 Processor -- start 2024-09-16T01:18:02.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.959+0000 7f864a186640 1 -- start start 2024-09-16T01:18:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f864a186640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8644072320 0x7f86440cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f864a186640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8644072de0 0x7f864406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f864a186640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8644072700 0x7f864406e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f864a186640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8644146140 con 0x7f8644072320 2024-09-16T01:18:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f864a186640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f86440cd740 con 0x7f8644072de0 2024-09-16T01:18:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f864a186640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f86440cda20 con 0x7f8644072700 2024-09-16T01:18:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f86437fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8644072320 0x7f86440cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:02.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f86437fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8644072320 0x7f86440cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50218/0 (socket says 172.21.15.81:50218) 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f86437fe640 1 -- 172.21.15.81:0/33199938 learned_addr learned my addr 172.21.15.81:0/33199938 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f8643fff640 1 --2- 172.21.15.81:0/33199938 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8644072700 0x7f864406e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f8642ffd640 1 --2- 172.21.15.81:0/33199938 >> v2:172.21.15.102:3300/0 conn(0x7f8644072de0 0x7f864406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f86437fe640 1 -- 172.21.15.81:0/33199938 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8644072700 msgr2=0x7f864406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f86437fe640 1 --2- 172.21.15.81:0/33199938 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8644072700 0x7f864406e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f86437fe640 1 -- 172.21.15.81:0/33199938 >> v2:172.21.15.102:3300/0 conn(0x7f8644072de0 msgr2=0x7f864406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f86437fe640 1 --2- 172.21.15.81:0/33199938 >> v2:172.21.15.102:3300/0 conn(0x7f8644072de0 0x7f864406e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f86437fe640 1 -- 172.21.15.81:0/33199938 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86440cdd00 con 0x7f8644072320 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.960+0000 7f8642ffd640 1 --2- 172.21.15.81:0/33199938 >> v2:172.21.15.102:3300/0 conn(0x7f8644072de0 0x7f864406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.961+0000 7f86437fe640 1 --2- 172.21.15.81:0/33199938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8644072320 0x7f86440cce60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f864406f8c0 tx=0x7f863402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8300618712cf3d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.961+0000 7f86427fc640 1 -- 172.21.15.81:0/33199938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634037070 con 0x7f8644072320 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.961+0000 7f86427fc640 1 -- 172.21.15.81:0/33199938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8634032440 con 0x7f8644072320 2024-09-16T01:18:02.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.961+0000 7f86427fc640 1 -- 172.21.15.81:0/33199938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8634032810 con 0x7f8644072320 2024-09-16T01:18:02.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.962+0000 7f864a186640 1 -- 172.21.15.81:0/33199938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8644072320 msgr2=0x7f86440cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:02.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.962+0000 7f864a186640 1 --2- 172.21.15.81:0/33199938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8644072320 0x7f86440cce60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f864406f8c0 tx=0x7f863402a140 comp rx=0 tx=0).stop 2024-09-16T01:18:02.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.962+0000 7f864a186640 1 -- 172.21.15.81:0/33199938 shutdown_connections 2024-09-16T01:18:02.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.962+0000 7f864a186640 1 --2- 172.21.15.81:0/33199938 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8644072700 0x7f864406e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:02.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.962+0000 7f864a186640 1 --2- 172.21.15.81:0/33199938 >> v2:172.21.15.102:3300/0 conn(0x7f8644072de0 0x7f864406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:02.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.962+0000 7f864a186640 1 --2- 172.21.15.81:0/33199938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8644072320 0x7f86440cce60 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:02.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.962+0000 7f864a186640 1 -- 172.21.15.81:0/33199938 >> 172.21.15.81:0/33199938 conn(0x7f8644067d70 msgr2=0x7f864406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:02.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.962+0000 7f864a186640 1 -- 172.21.15.81:0/33199938 shutdown_connections 2024-09-16T01:18:02.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.962+0000 7f864a186640 1 -- 172.21.15.81:0/33199938 wait complete. 2024-09-16T01:18:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.963+0000 7f864a186640 1 Processor -- start 2024-09-16T01:18:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.963+0000 7f864a186640 1 -- start start 2024-09-16T01:18:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f864a186640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8644072320 0x7f864413eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f864a186640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8644072700 0x7f8644141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f864a186640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8644072de0 0x7f8644141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f864a186640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f86440cd520 con 0x7f8644072700 2024-09-16T01:18:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f864a186640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f86440cd3a0 con 0x7f8644072320 2024-09-16T01:18:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f864a186640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f864406eb30 con 0x7f8644072de0 2024-09-16T01:18:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f8642ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8644072700 0x7f8644141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f8642ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8644072700 0x7f8644141a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50232/0 (socket says 172.21.15.81:50232) 2024-09-16T01:18:02.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f8642ffd640 1 -- 172.21.15.81:0/2825472574 learned_addr learned my addr 172.21.15.81:0/2825472574 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f86437fe640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8644072320 0x7f864413eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f8643fff640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8644072de0 0x7f8644141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f8642ffd640 1 -- 172.21.15.81:0/2825472574 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8644072de0 msgr2=0x7f8644141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f8642ffd640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8644072de0 0x7f8644141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f8642ffd640 1 -- 172.21.15.81:0/2825472574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8644072320 msgr2=0x7f864413eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f8642ffd640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8644072320 0x7f864413eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f8642ffd640 1 -- 172.21.15.81:0/2825472574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86440a9530 con 0x7f8644072700 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f8642ffd640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8644072700 0x7f8644141a60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f863800c7f0 tx=0x7f863800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f862bfff640 1 -- 172.21.15.81:0/2825472574 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638015070 con 0x7f8644072700 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f862bfff640 1 -- 172.21.15.81:0/2825472574 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8638007820 con 0x7f8644072700 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f864a186640 1 -- 172.21.15.81:0/2825472574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86440a9810 con 0x7f8644072700 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.964+0000 7f862bfff640 1 -- 172.21.15.81:0/2825472574 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638007bd0 con 0x7f8644072700 2024-09-16T01:18:02.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.965+0000 7f864a186640 1 -- 172.21.15.81:0/2825472574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86440a9dd0 con 0x7f8644072700 2024-09-16T01:18:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.966+0000 7f864a186640 1 -- 172.21.15.81:0/2825472574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86440cce60 con 0x7f8644072700 2024-09-16T01:18:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.966+0000 7f862bfff640 1 -- 172.21.15.81:0/2825472574 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8638018070 con 0x7f8644072700 2024-09-16T01:18:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.966+0000 7f862bfff640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f863006c2b0 0x7f863006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.966+0000 7f862bfff640 1 -- 172.21.15.81:0/2825472574 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f863808b5f0 con 0x7f8644072700 2024-09-16T01:18:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.966+0000 7f86437fe640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f863006c2b0 0x7f863006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:02.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.967+0000 7f86437fe640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f863006c2b0 0x7f863006e770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8634034000 tx=0x7f863402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:02.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:02.971+0000 7f862bfff640 1 -- 172.21.15.81:0/2825472574 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8638059610 con 0x7f8644072700 2024-09-16T01:18:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.170+0000 7f864a186640 1 -- 172.21.15.81:0/2825472574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86440c74f0 con 0x7f8644072700 2024-09-16T01:18:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.171+0000 7f862bfff640 1 -- 172.21.15.81:0/2825472574 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5227 (secure 0 0 0) 0x7f863805d910 con 0x7f8644072700 2024-09-16T01:18:03.172 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:03.172 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"btime":"2024-09-16T01:18:02:835480+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2000242607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2000242607},{"type":"v1","addr":"172.21.15.102:6834","nonce":2000242607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5087,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3268189429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3268189429},{"type":"v1","addr":"172.21.15.102:6835","nonce":3268189429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2730360991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2730360991},{"type":"v1","addr":"172.21.15.81:6836","nonce":2730360991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:00.081821+0000","modified":"2024-09-16T01:18:02.163419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/554158924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":554158924},{"type":"v1","addr":"172.21.15.81:6837","nonce":554158924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5667,"qdb_cluster":[5667]},"id":4}]} 2024-09-16T01:18:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-09-16T01:18:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.173+0000 7f864a186640 1 -- 172.21.15.81:0/2825472574 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f863006c2b0 msgr2=0x7f863006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.173+0000 7f864a186640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f863006c2b0 0x7f863006e770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8634034000 tx=0x7f863402e000 comp rx=0 tx=0).stop 2024-09-16T01:18:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.173+0000 7f864a186640 1 -- 172.21.15.81:0/2825472574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8644072700 msgr2=0x7f8644141a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.173+0000 7f864a186640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8644072700 0x7f8644141a60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f863800c7f0 tx=0x7f863800ccb0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.173+0000 7f864a186640 1 -- 172.21.15.81:0/2825472574 shutdown_connections 2024-09-16T01:18:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.173+0000 7f864a186640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f863006c2b0 0x7f863006e770 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.173+0000 7f864a186640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8644072de0 0x7f8644141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.173+0000 7f864a186640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8644072700 0x7f8644141a60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.173+0000 7f864a186640 1 --2- 172.21.15.81:0/2825472574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8644072320 0x7f864413eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.173+0000 7f864a186640 1 -- 172.21.15.81:0/2825472574 >> 172.21.15.81:0/2825472574 conn(0x7f8644067d70 msgr2=0x7f86440c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.173+0000 7f864a186640 1 -- 172.21.15.81:0/2825472574 shutdown_connections 2024-09-16T01:18:03.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.173+0000 7f864a186640 1 -- 172.21.15.81:0/2825472574 wait complete. 2024-09-16T01:18:03.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:18:03.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.283+0000 7fa5fe427640 1 Processor -- start 2024-09-16T01:18:03.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.283+0000 7fa5fe427640 1 -- start start 2024-09-16T01:18:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.283+0000 7fa5fe427640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa5f809b140 0x7fa5f8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.283+0000 7fa5fe427640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5f80b17d0 0x7fa5f80704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.283+0000 7fa5fe427640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f809ba30 con 0x7fa5f815fc30 2024-09-16T01:18:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.283+0000 7fa5fe427640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f80b1590 con 0x7fa5f80b17d0 2024-09-16T01:18:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.283+0000 7fa5fe427640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f8160ab0 con 0x7fa5f809b140 2024-09-16T01:18:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.284+0000 7fa5fc9c4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5f80b17d0 0x7fa5f80704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.284+0000 7fa5fc9c4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5f80b17d0 0x7fa5f80704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50246/0 (socket says 172.21.15.81:50246) 2024-09-16T01:18:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.284+0000 7fa5fc9c4640 1 -- 172.21.15.81:0/2270706392 learned_addr learned my addr 172.21.15.81:0/2270706392 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:03.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.284+0000 7fa5f77fe640 1 --2- 172.21.15.81:0/2270706392 >> v2:172.21.15.102:3300/0 conn(0x7fa5f809b140 0x7fa5f8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.284+0000 7fa5fc9c4640 1 -- 172.21.15.81:0/2270706392 >> v2:172.21.15.102:3300/0 conn(0x7fa5f809b140 msgr2=0x7fa5f8071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.284+0000 7fa5fc9c4640 1 --2- 172.21.15.81:0/2270706392 >> v2:172.21.15.102:3300/0 conn(0x7fa5f809b140 0x7fa5f8071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.284+0000 7fa5fc9c4640 1 -- 172.21.15.81:0/2270706392 >> v1:172.21.15.102:6789/0 conn(0x7fa5f815fc30 legacy=0x7fa5f809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.284+0000 7fa5fc9c4640 1 -- 172.21.15.81:0/2270706392 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f809bcf0 con 0x7fa5f80b17d0 2024-09-16T01:18:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.284+0000 7fa5f77fe640 1 --2- 172.21.15.81:0/2270706392 >> v2:172.21.15.102:3300/0 conn(0x7fa5f809b140 0x7fa5f8071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.285+0000 7fa5fc9c4640 1 --2- 172.21.15.81:0/2270706392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80b17d0 0x7fa5f80704f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa5f806cbf0 tx=0x7fa5f002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae686e5bdab0dbb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:03.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.285+0000 7fa5f6ffd640 1 -- 172.21.15.81:0/2270706392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0036070 con 0x7fa5f80b17d0 2024-09-16T01:18:03.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.285+0000 7fa5f6ffd640 1 -- 172.21.15.81:0/2270706392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f0031600 con 0x7fa5f80b17d0 2024-09-16T01:18:03.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.285+0000 7fa5f6ffd640 1 -- 172.21.15.81:0/2270706392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00319d0 con 0x7fa5f80b17d0 2024-09-16T01:18:03.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.285+0000 7fa5fe427640 1 -- 172.21.15.81:0/2270706392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80b17d0 msgr2=0x7fa5f80704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.285+0000 7fa5fe427640 1 --2- 172.21.15.81:0/2270706392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80b17d0 0x7fa5f80704f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa5f806cbf0 tx=0x7fa5f002a6a0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.285+0000 7fa5fe427640 1 -- 172.21.15.81:0/2270706392 shutdown_connections 2024-09-16T01:18:03.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.285+0000 7fa5fe427640 1 --2- 172.21.15.81:0/2270706392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f80b17d0 0x7fa5f80704f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.285+0000 7fa5fe427640 1 --2- 172.21.15.81:0/2270706392 >> v2:172.21.15.102:3300/0 conn(0x7fa5f809b140 0x7fa5f8071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.285+0000 7fa5fe427640 1 -- 172.21.15.81:0/2270706392 >> 172.21.15.81:0/2270706392 conn(0x7fa5f80d23a0 msgr2=0x7fa5f80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:03.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.285+0000 7fa5fe427640 1 -- 172.21.15.81:0/2270706392 shutdown_connections 2024-09-16T01:18:03.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.285+0000 7fa5fe427640 1 -- 172.21.15.81:0/2270706392 wait complete. 2024-09-16T01:18:03.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.286+0000 7fa5fe427640 1 Processor -- start 2024-09-16T01:18:03.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.287+0000 7fa5fe427640 1 -- start start 2024-09-16T01:18:03.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.287+0000 7fa5fe427640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f809b140 0x7fa5f80c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.287+0000 7fa5fe427640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5f80b17d0 0x7fa5f806e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.287+0000 7fa5fe427640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f815fc30 0x7fa5f80af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.287+0000 7fa5fe427640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8070a30 con 0x7fa5f809b140 2024-09-16T01:18:03.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.287+0000 7fa5fe427640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8160fe0 con 0x7fa5f815fc30 2024-09-16T01:18:03.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.287+0000 7fa5fe427640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f8070bb0 con 0x7fa5f80b17d0 2024-09-16T01:18:03.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.287+0000 7fa5f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f809b140 0x7fa5f80c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.287+0000 7fa5f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f809b140 0x7fa5f80c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50256/0 (socket says 172.21.15.81:50256) 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.287+0000 7fa5f7fff640 1 -- 172.21.15.81:0/3392067625 learned_addr learned my addr 172.21.15.81:0/3392067625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5f77fe640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5f80b17d0 0x7fa5f806e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5fc9c4640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f815fc30 0x7fa5f80af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5f7fff640 1 -- 172.21.15.81:0/3392067625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5f80b17d0 msgr2=0x7fa5f806e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5f7fff640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5f80b17d0 0x7fa5f806e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5f7fff640 1 -- 172.21.15.81:0/3392067625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f815fc30 msgr2=0x7fa5f80af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5f7fff640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f815fc30 0x7fa5f80af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5f7fff640 1 -- 172.21.15.81:0/3392067625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f806e590 con 0x7fa5f809b140 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5f77fe640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5f80b17d0 0x7fa5f806e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5f7fff640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f809b140 0x7fa5f80c5330 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c3f0 tx=0x7fa5e800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5f4ff9640 1 -- 172.21.15.81:0/3392067625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80052d0 con 0x7fa5f809b140 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5f4ff9640 1 -- 172.21.15.81:0/3392067625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e8005490 con 0x7fa5f809b140 2024-09-16T01:18:03.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5fe427640 1 -- 172.21.15.81:0/3392067625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f806cfb0 con 0x7fa5f809b140 2024-09-16T01:18:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5f4ff9640 1 -- 172.21.15.81:0/3392067625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8007260 con 0x7fa5f809b140 2024-09-16T01:18:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.288+0000 7fa5fe427640 1 -- 172.21.15.81:0/3392067625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f806d570 con 0x7fa5f809b140 2024-09-16T01:18:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.289+0000 7fa5fe427640 1 -- 172.21.15.81:0/3392067625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f8071e40 con 0x7fa5f809b140 2024-09-16T01:18:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.290+0000 7fa5f4ff9640 1 -- 172.21.15.81:0/3392067625 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa5e8007400 con 0x7fa5f809b140 2024-09-16T01:18:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.290+0000 7fa5f4ff9640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa5e406c2b0 0x7fa5e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.290+0000 7fa5f77fe640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa5e406c2b0 0x7fa5e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.290+0000 7fa5f4ff9640 1 -- 172.21.15.81:0/3392067625 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fa5e808aab0 con 0x7fa5f809b140 2024-09-16T01:18:03.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.290+0000 7fa5f77fe640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa5e406c2b0 0x7fa5e406e770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa5f81f7fd0 tx=0x7fa5ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:03.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.294+0000 7fa5f4ff9640 1 -- 172.21.15.81:0/3392067625 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5e8059090 con 0x7fa5f809b140 2024-09-16T01:18:03.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.461+0000 7fa5fe427640 1 -- 172.21.15.81:0/3392067625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa5f80b8320 con 0x7fa5f809b140 2024-09-16T01:18:03.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.462+0000 7fa5f4ff9640 1 -- 172.21.15.81:0/3392067625 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16944 (secure 0 0 0) 0x7fa5e8058990 con 0x7fa5f809b140 2024-09-16T01:18:03.463 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:03.463 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":63,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:01.761014+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:17:58.703890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-16T01:17:59.055322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:18:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.464+0000 7fa5fe427640 1 -- 172.21.15.81:0/3392067625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa5e406c2b0 msgr2=0x7fa5e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.464+0000 7fa5fe427640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa5e406c2b0 0x7fa5e406e770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa5f81f7fd0 tx=0x7fa5ec008040 comp rx=0 tx=0).stop 2024-09-16T01:18:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.464+0000 7fa5fe427640 1 -- 172.21.15.81:0/3392067625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f809b140 msgr2=0x7fa5f80c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.464+0000 7fa5fe427640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f809b140 0x7fa5f80c5330 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800c3f0 tx=0x7fa5e800c8b0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.464+0000 7fa5fe427640 1 -- 172.21.15.81:0/3392067625 shutdown_connections 2024-09-16T01:18:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.464+0000 7fa5fe427640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa5e406c2b0 0x7fa5e406e770 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.464+0000 7fa5fe427640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5f815fc30 0x7fa5f80af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.464+0000 7fa5fe427640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa5f80b17d0 0x7fa5f806e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.464+0000 7fa5fe427640 1 --2- 172.21.15.81:0/3392067625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5f809b140 0x7fa5f80c5330 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.464+0000 7fa5fe427640 1 -- 172.21.15.81:0/3392067625 >> 172.21.15.81:0/3392067625 conn(0x7fa5f80d23a0 msgr2=0x7fa5f80b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.464+0000 7fa5fe427640 1 -- 172.21.15.81:0/3392067625 shutdown_connections 2024-09-16T01:18:03.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.464+0000 7fa5fe427640 1 -- 172.21.15.81:0/3392067625 wait complete. 2024-09-16T01:18:03.476 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:18:03.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:18:03.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.574+0000 7fdbd024c640 1 Processor -- start 2024-09-16T01:18:03.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.574+0000 7fdbd024c640 1 -- start start 2024-09-16T01:18:03.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbd024c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdbc8147360 0x7fdbc8070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbd024c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdbc80d0bb0 0x7fdbc80ae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbd024c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc806cb30 con 0x7fdbc8070dd0 2024-09-16T01:18:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbd024c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fdbc806bfb0 con 0x7fdbc80d0bb0 2024-09-16T01:18:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbd024c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc806c290 con 0x7fdbc8147360 2024-09-16T01:18:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbcdfe8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdbc8147360 0x7fdbc8070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbcdfe8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdbc8147360 0x7fdbc8070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:44604/0 (socket says 172.21.15.81:44604) 2024-09-16T01:18:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbce7e9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdbc80d0bb0 0x7fdbc80ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbcdfe8640 1 -- 172.21.15.81:0/2613356695 learned_addr learned my addr 172.21.15.81:0/2613356695 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:03.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbccfe6640 1 -- 172.21.15.81:0/2613356695 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 934024857 0 0) 0x7fdbc806cb30 con 0x7fdbc8070dd0 2024-09-16T01:18:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbcdfe8640 1 -- 172.21.15.81:0/2613356695 >> v2:172.21.15.102:3300/0 conn(0x7fdbc80d0bb0 msgr2=0x7fdbc80ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbcdfe8640 1 --2- 172.21.15.81:0/2613356695 >> v2:172.21.15.102:3300/0 conn(0x7fdbc80d0bb0 0x7fdbc80ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbcdfe8640 1 -- 172.21.15.81:0/2613356695 >> v1:172.21.15.102:6789/0 conn(0x7fdbc8070dd0 legacy=0x7fdbc80d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.575+0000 7fdbcdfe8640 1 -- 172.21.15.81:0/2613356695 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc806c570 con 0x7fdbc8147360 2024-09-16T01:18:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.576+0000 7fdbcdfe8640 1 --2- 172.21.15.81:0/2613356695 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdbc8147360 0x7fdbc8070890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009870 tx=0x7fdbc402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6afd22c6f5f99883 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.576+0000 7fdbccfe6640 1 -- 172.21.15.81:0/2613356695 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4037070 con 0x7fdbc8147360 2024-09-16T01:18:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.576+0000 7fdbccfe6640 1 -- 172.21.15.81:0/2613356695 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc4032440 con 0x7fdbc8147360 2024-09-16T01:18:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.576+0000 7fdbccfe6640 1 -- 172.21.15.81:0/2613356695 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4032810 con 0x7fdbc8147360 2024-09-16T01:18:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.577+0000 7fdbd024c640 1 -- 172.21.15.81:0/2613356695 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdbc8147360 msgr2=0x7fdbc8070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.577+0000 7fdbd024c640 1 --2- 172.21.15.81:0/2613356695 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdbc8147360 0x7fdbc8070890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009870 tx=0x7fdbc402a1c0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.577+0000 7fdbd024c640 1 -- 172.21.15.81:0/2613356695 shutdown_connections 2024-09-16T01:18:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.577+0000 7fdbd024c640 1 --2- 172.21.15.81:0/2613356695 >> v2:172.21.15.102:3300/0 conn(0x7fdbc80d0bb0 0x7fdbc80ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.577+0000 7fdbd024c640 1 --2- 172.21.15.81:0/2613356695 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdbc8147360 0x7fdbc8070890 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.577+0000 7fdbd024c640 1 -- 172.21.15.81:0/2613356695 >> 172.21.15.81:0/2613356695 conn(0x7fdbc80b2f40 msgr2=0x7fdbc80b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.577+0000 7fdbd024c640 1 -- 172.21.15.81:0/2613356695 shutdown_connections 2024-09-16T01:18:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.577+0000 7fdbd024c640 1 -- 172.21.15.81:0/2613356695 wait complete. 2024-09-16T01:18:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.578+0000 7fdbd024c640 1 Processor -- start 2024-09-16T01:18:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.578+0000 7fdbd024c640 1 -- start start 2024-09-16T01:18:03.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbd024c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc8070dd0 0x7fdbc8160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbd024c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdbc80d0bb0 0x7fdbc809bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbd024c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbc8147360 0x7fdbc8140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbd024c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc806bd90 con 0x7fdbc8070dd0 2024-09-16T01:18:03.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbd024c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdbc806bc10 con 0x7fdbc8147360 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbd024c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdbc80aea90 con 0x7fdbc80d0bb0 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbcdfe8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc8070dd0 0x7fdbc8160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbcdfe8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc8070dd0 0x7fdbc8160e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50260/0 (socket says 172.21.15.81:50260) 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbcdfe8640 1 -- 172.21.15.81:0/945052868 learned_addr learned my addr 172.21.15.81:0/945052868 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbcd7e7640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdbc80d0bb0 0x7fdbc809bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbce7e9640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbc8147360 0x7fdbc8140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbcdfe8640 1 -- 172.21.15.81:0/945052868 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdbc80d0bb0 msgr2=0x7fdbc809bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbcdfe8640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdbc80d0bb0 0x7fdbc809bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbcdfe8640 1 -- 172.21.15.81:0/945052868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbc8147360 msgr2=0x7fdbc8140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbcdfe8640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbc8147360 0x7fdbc8140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbcdfe8640 1 -- 172.21.15.81:0/945052868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc81613d0 con 0x7fdbc8070dd0 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.579+0000 7fdbcdfe8640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc8070dd0 0x7fdbc8160e90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40090b0 tx=0x7fdbc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.580+0000 7fdbbe7fc640 1 -- 172.21.15.81:0/945052868 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4037040 con 0x7fdbc8070dd0 2024-09-16T01:18:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.580+0000 7fdbbe7fc640 1 -- 172.21.15.81:0/945052868 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbc4004250 con 0x7fdbc8070dd0 2024-09-16T01:18:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.580+0000 7fdbd024c640 1 -- 172.21.15.81:0/945052868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc8141140 con 0x7fdbc8070dd0 2024-09-16T01:18:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.580+0000 7fdbbe7fc640 1 -- 172.21.15.81:0/945052868 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4003610 con 0x7fdbc8070dd0 2024-09-16T01:18:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.580+0000 7fdbd024c640 1 -- 172.21.15.81:0/945052868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbc813eb20 con 0x7fdbc8070dd0 2024-09-16T01:18:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.581+0000 7fdbd024c640 1 -- 172.21.15.81:0/945052868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc813e630 con 0x7fdbc8070dd0 2024-09-16T01:18:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.581+0000 7fdbbe7fc640 1 -- 172.21.15.81:0/945052868 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdbc402ad10 con 0x7fdbc8070dd0 2024-09-16T01:18:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.582+0000 7fdbbe7fc640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdbac06c2b0 0x7fdbac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.582+0000 7fdbbe7fc640 1 -- 172.21.15.81:0/945052868 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fdbc40ac0a0 con 0x7fdbc8070dd0 2024-09-16T01:18:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.582+0000 7fdbcd7e7640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdbac06c2b0 0x7fdbac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.582+0000 7fdbcd7e7640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdbac06c2b0 0x7fdbac06e770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80b1f90 tx=0x7fdbb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.586+0000 7fdbbe7fc640 1 -- 172.21.15.81:0/945052868 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdbc407a0c0 con 0x7fdbc8070dd0 2024-09-16T01:18:03.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.749+0000 7fdbd024c640 1 -- 172.21.15.81:0/945052868 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbc80ae550 con 0x7fdbac06c2b0 2024-09-16T01:18:03.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.755+0000 7fdbbe7fc640 1 -- 172.21.15.81:0/945052868 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237267 (secure 0 0 0) 0x7fdbc80ae550 con 0x7fdbac06c2b0 2024-09-16T01:18:03.758 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:03.759 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:18:03.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.758+0000 7fdbd024c640 1 -- 172.21.15.81:0/945052868 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdbac06c2b0 msgr2=0x7fdbac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.758+0000 7fdbd024c640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdbac06c2b0 0x7fdbac06e770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80b1f90 tx=0x7fdbb8009040 comp rx=0 tx=0).stop 2024-09-16T01:18:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.758+0000 7fdbd024c640 1 -- 172.21.15.81:0/945052868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc8070dd0 msgr2=0x7fdbc8160e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.758+0000 7fdbd024c640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc8070dd0 0x7fdbc8160e90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdbc40090b0 tx=0x7fdbc40046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.758+0000 7fdbd024c640 1 -- 172.21.15.81:0/945052868 shutdown_connections 2024-09-16T01:18:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.758+0000 7fdbd024c640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdbac06c2b0 0x7fdbac06e770 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.758+0000 7fdbd024c640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdbc8147360 0x7fdbc8140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.758+0000 7fdbd024c640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdbc80d0bb0 0x7fdbc809bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.758+0000 7fdbd024c640 1 --2- 172.21.15.81:0/945052868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbc8070dd0 0x7fdbc8160e90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.758+0000 7fdbd024c640 1 -- 172.21.15.81:0/945052868 >> 172.21.15.81:0/945052868 conn(0x7fdbc80b2f40 msgr2=0x7fdbc80b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.758+0000 7fdbd024c640 1 -- 172.21.15.81:0/945052868 shutdown_connections 2024-09-16T01:18:03.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.758+0000 7fdbd024c640 1 -- 172.21.15.81:0/945052868 wait complete. 2024-09-16T01:18:03.769 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-16T01:18:02.088506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":227060,"kb_used_data":6632,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747660,"statfs":{"total":773094113280,"available":772861603840,"internally_reserved":0,"allocated":6791168,"data_stored":3662096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000730"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":239,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T01:17:56.868636+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:17:56.868636+0000","last_peered":"2024-09-16T01:17:56.868636+0000","last_clean":"2024-09-16T01:17:56.868636+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:17:56.868636+0000","last_undegraded":"2024-09-16T01:17:56.868636+0000","last_fullsized":"2024-09-16T01:17:56.868636+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1294336,"data_stored":900542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27736,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":712704,"data_stored":315693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27740,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":712704,"data_stored":315693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27724,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":700416,"data_stored":310174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":700416,"data_stored":310174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27716,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":700416,"data_stored":310174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":688128,"data_stored":304639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1282048,"data_stored":895007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:18:03.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:18:03.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.907+0000 7f1584cac640 1 Processor -- start 2024-09-16T01:18:03.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.907+0000 7f1584cac640 1 -- start start 2024-09-16T01:18:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f1584cac640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1580145e00 0x7f15800cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f1584cac640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f158015d460 0x7f15800d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f1584cac640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15800af720 con 0x7f15800d0a10 2024-09-16T01:18:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f1584cac640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f15801461e0 con 0x7f158015d460 2024-09-16T01:18:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f1584cac640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f158015d8c0 con 0x7f1580145e00 2024-09-16T01:18:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f157dd9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f158015d460 0x7f15800d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f157ed9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f15800d0a10 0x7f158006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53228/0 (socket says 172.21.15.81:53228) 2024-09-16T01:18:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f157ed9d640 1 -- 172.21.15.81:0/645378750 learned_addr learned my addr 172.21.15.81:0/645378750 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f157e59c640 1 --2- 172.21.15.81:0/645378750 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1580145e00 0x7f15800cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f157dd9b640 1 -- 172.21.15.81:0/645378750 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1580145e00 msgr2=0x7f15800cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f157dd9b640 1 --2- 172.21.15.81:0/645378750 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1580145e00 0x7f15800cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f157dd9b640 1 -- 172.21.15.81:0/645378750 >> v1:172.21.15.81:6789/0 conn(0x7f15800d0a10 legacy=0x7f158006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f157dd9b640 1 -- 172.21.15.81:0/645378750 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15800cdf90 con 0x7f158015d460 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f157d59a640 1 -- 172.21.15.81:0/645378750 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1792883481 0 0) 0x7f15800af720 con 0x7f15800d0a10 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.908+0000 7f157e59c640 1 --2- 172.21.15.81:0/645378750 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1580145e00 0x7f15800cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.909+0000 7f157dd9b640 1 --2- 172.21.15.81:0/645378750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d460 0x7f15800d04d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1580146360 tx=0x7f157002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbe8a5f99e48682 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.909+0000 7f157d59a640 1 -- 172.21.15.81:0/645378750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570037070 con 0x7f158015d460 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.909+0000 7f157d59a640 1 -- 172.21.15.81:0/645378750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1570032440 con 0x7f158015d460 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.909+0000 7f157d59a640 1 -- 172.21.15.81:0/645378750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570032810 con 0x7f158015d460 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.909+0000 7f1584cac640 1 -- 172.21.15.81:0/645378750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d460 msgr2=0x7f15800d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.909+0000 7f1584cac640 1 --2- 172.21.15.81:0/645378750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d460 0x7f15800d04d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1580146360 tx=0x7f157002a180 comp rx=0 tx=0).stop 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.910+0000 7f1584cac640 1 -- 172.21.15.81:0/645378750 shutdown_connections 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.910+0000 7f1584cac640 1 --2- 172.21.15.81:0/645378750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d460 0x7f15800d04d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.910+0000 7f1584cac640 1 --2- 172.21.15.81:0/645378750 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1580145e00 0x7f15800cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.910+0000 7f1584cac640 1 -- 172.21.15.81:0/645378750 >> 172.21.15.81:0/645378750 conn(0x7f15800b2f40 msgr2=0x7f15800b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:03.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.910+0000 7f1584cac640 1 -- 172.21.15.81:0/645378750 shutdown_connections 2024-09-16T01:18:03.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.910+0000 7f1584cac640 1 -- 172.21.15.81:0/645378750 wait complete. 2024-09-16T01:18:03.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.911+0000 7f1584cac640 1 Processor -- start 2024-09-16T01:18:03.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.911+0000 7f1584cac640 1 -- start start 2024-09-16T01:18:03.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f1584cac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15800d0a10 0x7f158013fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f1584cac640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1580145e00 0x7f158013b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f1584cac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d460 0x7f15801576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f1584cac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15800ce830 con 0x7f158015d460 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f1584cac640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f15800ce550 con 0x7f15800d0a10 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f1584cac640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f15800cede0 con 0x7f1580145e00 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f157ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d460 0x7f15801576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f157ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d460 0x7f15801576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50288/0 (socket says 172.21.15.81:50288) 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f157ed9d640 1 -- 172.21.15.81:0/1665426359 learned_addr learned my addr 172.21.15.81:0/1665426359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f157dd9b640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1580145e00 0x7f158013b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f157ed9d640 1 -- 172.21.15.81:0/1665426359 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1580145e00 msgr2=0x7f158013b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f157ed9d640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1580145e00 0x7f158013b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f157ed9d640 1 -- 172.21.15.81:0/1665426359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15800d0a10 msgr2=0x7f158013fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f157e59c640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15800d0a10 0x7f158013fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f157ed9d640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15800d0a10 0x7f158013fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f157ed9d640 1 -- 172.21.15.81:0/1665426359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1580140200 con 0x7f158015d460 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f157ed9d640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d460 0x7f15801576f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f157800caf0 tx=0x7f157800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:03.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f1576ffd640 1 -- 172.21.15.81:0/1665426359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157800aca0 con 0x7f158015d460 2024-09-16T01:18:03.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f1576ffd640 1 -- 172.21.15.81:0/1665426359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f157800ae40 con 0x7f158015d460 2024-09-16T01:18:03.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f1584cac640 1 -- 172.21.15.81:0/1665426359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15801404e0 con 0x7f158015d460 2024-09-16T01:18:03.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f1576ffd640 1 -- 172.21.15.81:0/1665426359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578012640 con 0x7f158015d460 2024-09-16T01:18:03.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.912+0000 7f1584cac640 1 -- 172.21.15.81:0/1665426359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1580140aa0 con 0x7f158015d460 2024-09-16T01:18:03.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.913+0000 7f1584cac640 1 -- 172.21.15.81:0/1665426359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15800d04d0 con 0x7f158015d460 2024-09-16T01:18:03.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.914+0000 7f1576ffd640 1 -- 172.21.15.81:0/1665426359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f15780128a0 con 0x7f158015d460 2024-09-16T01:18:03.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.914+0000 7f1576ffd640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f156006c2b0 0x7f156006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:03.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.914+0000 7f1576ffd640 1 -- 172.21.15.81:0/1665426359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f157808bcd0 con 0x7f158015d460 2024-09-16T01:18:03.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.914+0000 7f157e59c640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f156006c2b0 0x7f156006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:03.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.915+0000 7f157e59c640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f156006c2b0 0x7f156006e770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f156800d8b0 tx=0x7f1568008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:03.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:03.918+0000 7f1576ffd640 1 -- 172.21.15.81:0/1665426359 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f157805a2b0 con 0x7f158015d460 2024-09-16T01:18:04.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.080+0000 7f1584cac640 1 -- 172.21.15.81:0/1665426359 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15800cf180 con 0x7f156006c2b0 2024-09-16T01:18:04.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.086+0000 7f1576ffd640 1 -- 172.21.15.81:0/1665426359 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237267 (secure 0 0 0) 0x7f15800cf180 con 0x7f156006c2b0 2024-09-16T01:18:04.089 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:04.090 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:18:04.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.089+0000 7f1584cac640 1 -- 172.21.15.81:0/1665426359 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f156006c2b0 msgr2=0x7f156006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.089+0000 7f1584cac640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f156006c2b0 0x7f156006e770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f156800d8b0 tx=0x7f1568008040 comp rx=0 tx=0).stop 2024-09-16T01:18:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.089+0000 7f1584cac640 1 -- 172.21.15.81:0/1665426359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d460 msgr2=0x7f15801576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.089+0000 7f1584cac640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d460 0x7f15801576f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f157800caf0 tx=0x7f157800a060 comp rx=0 tx=0).stop 2024-09-16T01:18:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.089+0000 7f1584cac640 1 -- 172.21.15.81:0/1665426359 shutdown_connections 2024-09-16T01:18:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.089+0000 7f1584cac640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f156006c2b0 0x7f156006e770 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.089+0000 7f1584cac640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d460 0x7f15801576f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.089+0000 7f1584cac640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1580145e00 0x7f158013b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.089+0000 7f1584cac640 1 --2- 172.21.15.81:0/1665426359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f15800d0a10 0x7f158013fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.089+0000 7f1584cac640 1 -- 172.21.15.81:0/1665426359 >> 172.21.15.81:0/1665426359 conn(0x7f15800b2f40 msgr2=0x7f15800afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:04.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.089+0000 7f1584cac640 1 -- 172.21.15.81:0/1665426359 shutdown_connections 2024-09-16T01:18:04.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.089+0000 7f1584cac640 1 -- 172.21.15.81:0/1665426359 wait complete. 2024-09-16T01:18:04.101 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-16T01:18:02.088506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":227060,"kb_used_data":6632,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747660,"statfs":{"total":773094113280,"available":772861603840,"internally_reserved":0,"allocated":6791168,"data_stored":3662096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000730"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:59.738315+0000","last_change":"2024-09-16T01:17:59.738315+0000","last_active":"2024-09-16T01:17:59.738315+0000","last_peered":"2024-09-16T01:17:59.738315+0000","last_clean":"2024-09-16T01:17:59.738315+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:59.738315+0000","last_undegraded":"2024-09-16T01:17:59.738315+0000","last_fullsized":"2024-09-16T01:17:59.738315+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:17:58.733922+0000","last_change":"2024-09-16T01:17:58.733922+0000","last_active":"2024-09-16T01:17:58.733922+0000","last_peered":"2024-09-16T01:17:58.733922+0000","last_clean":"2024-09-16T01:17:58.733922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:17:58.733922+0000","last_undegraded":"2024-09-16T01:17:58.733922+0000","last_fullsized":"2024-09-16T01:17:58.733922+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":239,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-16T01:17:56.868636+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:17:56.868636+0000","last_peered":"2024-09-16T01:17:56.868636+0000","last_clean":"2024-09-16T01:17:56.868636+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:17:56.868636+0000","last_undegraded":"2024-09-16T01:17:56.868636+0000","last_fullsized":"2024-09-16T01:17:56.868636+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28292,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343548,"statfs":{"total":96636764160,"available":96607793152,"internally_reserved":0,"allocated":1294336,"data_stored":900542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27736,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":712704,"data_stored":315693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27740,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":712704,"data_stored":315693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27724,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":700416,"data_stored":310174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31872,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339968,"statfs":{"total":96636764160,"available":96604127232,"internally_reserved":0,"allocated":700416,"data_stored":310174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27716,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":700416,"data_stored":310174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27700,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":688128,"data_stored":304639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1282048,"data_stored":895007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:18:04.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:18:04.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.239+0000 7fc6e5c5c640 1 Processor -- start 2024-09-16T01:18:04.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.239+0000 7fc6e5c5c640 1 -- start start 2024-09-16T01:18:04.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6e5c5c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6e00d1540 0x7fc6e006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6e5c5c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6e009b690 0x7fc6e006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6e5c5c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e00d1940 con 0x7fc6e015e740 2024-09-16T01:18:04.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6e5c5c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc6e015eb20 con 0x7fc6e009b690 2024-09-16T01:18:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6e5c5c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e006d260 con 0x7fc6e00d1540 2024-09-16T01:18:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6dffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6e009b690 0x7fc6e006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6dffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6e009b690 0x7fc6e006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50298/0 (socket says 172.21.15.81:50298) 2024-09-16T01:18:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6dffff640 1 -- 172.21.15.81:0/878194888 learned_addr learned my addr 172.21.15.81:0/878194888 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6deffd640 1 --2- 172.21.15.81:0/878194888 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6e00d1540 0x7fc6e006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6dffff640 1 -- 172.21.15.81:0/878194888 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6e00d1540 msgr2=0x7fc6e006dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6dffff640 1 --2- 172.21.15.81:0/878194888 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6e00d1540 0x7fc6e006dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6dffff640 1 -- 172.21.15.81:0/878194888 >> v1:172.21.15.102:6789/0 conn(0x7fc6e015e740 legacy=0x7fc6e006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.240+0000 7fc6dffff640 1 -- 172.21.15.81:0/878194888 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e009bae0 con 0x7fc6e009b690 2024-09-16T01:18:04.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.241+0000 7fc6dffff640 1 --2- 172.21.15.81:0/878194888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6e009b690 0x7fc6e006cd20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009e80 tx=0x7fc6d802a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95f33a30cf4c593 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:04.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.241+0000 7fc6de7fc640 1 -- 172.21.15.81:0/878194888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8036070 con 0x7fc6e009b690 2024-09-16T01:18:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.241+0000 7fc6de7fc640 1 -- 172.21.15.81:0/878194888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d8031600 con 0x7fc6e009b690 2024-09-16T01:18:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.241+0000 7fc6de7fc640 1 -- 172.21.15.81:0/878194888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80319d0 con 0x7fc6e009b690 2024-09-16T01:18:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.242+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/878194888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6e009b690 msgr2=0x7fc6e006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.242+0000 7fc6e5c5c640 1 --2- 172.21.15.81:0/878194888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6e009b690 0x7fc6e006cd20 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009e80 tx=0x7fc6d802a7e0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.242+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/878194888 shutdown_connections 2024-09-16T01:18:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.242+0000 7fc6e5c5c640 1 --2- 172.21.15.81:0/878194888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6e009b690 0x7fc6e006cd20 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.242+0000 7fc6e5c5c640 1 --2- 172.21.15.81:0/878194888 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6e00d1540 0x7fc6e006dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.242+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/878194888 >> 172.21.15.81:0/878194888 conn(0x7fc6e00d23a0 msgr2=0x7fc6e00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.242+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/878194888 shutdown_connections 2024-09-16T01:18:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.242+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/878194888 wait complete. 2024-09-16T01:18:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.243+0000 7fc6e5c5c640 1 Processor -- start 2024-09-16T01:18:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.243+0000 7fc6e5c5c640 1 -- start start 2024-09-16T01:18:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6e5c5c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6e009b690 0x7fc6e00cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6e5c5c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6e00d1540 0x7fc6e01f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6e5c5c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6e015e740 0x7fc6e00cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6e5c5c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e00d0d40 con 0x7fc6e009b690 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6e5c5c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e00d0a60 con 0x7fc6e00d1540 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6e5c5c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e00d1020 con 0x7fc6e015e740 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6df7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6e009b690 0x7fc6e00cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6df7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6e009b690 0x7fc6e00cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50306/0 (socket says 172.21.15.81:50306) 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6df7fe640 1 -- 172.21.15.81:0/1066919740 learned_addr learned my addr 172.21.15.81:0/1066919740 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6deffd640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6e00d1540 0x7fc6e01f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6dffff640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6e015e740 0x7fc6e00cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6df7fe640 1 -- 172.21.15.81:0/1066919740 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6e015e740 msgr2=0x7fc6e00cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6df7fe640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6e015e740 0x7fc6e00cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6df7fe640 1 -- 172.21.15.81:0/1066919740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6e00d1540 msgr2=0x7fc6e01f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6df7fe640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6e00d1540 0x7fc6e01f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6df7fe640 1 -- 172.21.15.81:0/1066919740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e00cfc30 con 0x7fc6e009b690 2024-09-16T01:18:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6deffd640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6e00d1540 0x7fc6e01f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.244+0000 7fc6dffff640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6e015e740 0x7fc6e00cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.245+0000 7fc6df7fe640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6e009b690 0x7fc6e00cf5a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c400 tx=0x7fc6d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.245+0000 7fc6c7fff640 1 -- 172.21.15.81:0/1066919740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00052d0 con 0x7fc6e009b690 2024-09-16T01:18:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.245+0000 7fc6c7fff640 1 -- 172.21.15.81:0/1066919740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d0005490 con 0x7fc6e009b690 2024-09-16T01:18:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.245+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/1066919740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e00ca5f0 con 0x7fc6e009b690 2024-09-16T01:18:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.245+0000 7fc6c7fff640 1 -- 172.21.15.81:0/1066919740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0007260 con 0x7fc6e009b690 2024-09-16T01:18:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.245+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/1066919740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e00cab70 con 0x7fc6e009b690 2024-09-16T01:18:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.246+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/1066919740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e006cd20 con 0x7fc6e009b690 2024-09-16T01:18:04.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.246+0000 7fc6c7fff640 1 -- 172.21.15.81:0/1066919740 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc6d0007400 con 0x7fc6e009b690 2024-09-16T01:18:04.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.247+0000 7fc6c7fff640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc6cc06c2e0 0x7fc6cc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.247+0000 7fc6c7fff640 1 -- 172.21.15.81:0/1066919740 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fc6d008aa70 con 0x7fc6e009b690 2024-09-16T01:18:04.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.247+0000 7fc6deffd640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc6cc06c2e0 0x7fc6cc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.247+0000 7fc6deffd640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc6cc06c2e0 0x7fc6cc06e7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00cf530 tx=0x7fc6d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:04.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.251+0000 7fc6c7fff640 1 -- 172.21.15.81:0/1066919740 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6d00590e0 con 0x7fc6e009b690 2024-09-16T01:18:04.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.414+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/1066919740 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6e0071f90 con 0x7fc6cc06c2e0 2024-09-16T01:18:04.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.419+0000 7fc6c7fff640 1 -- 172.21.15.81:0/1066919740 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252017 (secure 0 0 0) 0x7fc6d4011a30 con 0x7fc6cc06c2e0 2024-09-16T01:18:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:04.425 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:18:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.423+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/1066919740 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc6cc06c2e0 msgr2=0x7fc6cc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.423+0000 7fc6e5c5c640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc6cc06c2e0 0x7fc6cc06e7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00cf530 tx=0x7fc6d4008040 comp rx=0 tx=0).stop 2024-09-16T01:18:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.423+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/1066919740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6e009b690 msgr2=0x7fc6e00cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.423+0000 7fc6e5c5c640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6e009b690 0x7fc6e00cf5a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c400 tx=0x7fc6d000c8c0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.423+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/1066919740 shutdown_connections 2024-09-16T01:18:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.423+0000 7fc6e5c5c640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc6cc06c2e0 0x7fc6cc06e7a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.423+0000 7fc6e5c5c640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6e015e740 0x7fc6e00cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.423+0000 7fc6e5c5c640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6e00d1540 0x7fc6e01f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.423+0000 7fc6e5c5c640 1 --2- 172.21.15.81:0/1066919740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6e009b690 0x7fc6e00cf5a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.423+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/1066919740 >> 172.21.15.81:0/1066919740 conn(0x7fc6e00d23a0 msgr2=0x7fc6e00b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.423+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/1066919740 shutdown_connections 2024-09-16T01:18:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.423+0000 7fc6e5c5c640 1 -- 172.21.15.81:0/1066919740 wait complete. 2024-09-16T01:18:04.435 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-09-16T01:18:04.088806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231744,"kb_used_data":7164,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742976,"statfs":{"total":773094113280,"available":772856807424,"internally_reserved":0,"allocated":7335936,"data_stored":3918224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.349703"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766987+0000","last_change":"2024-09-16T01:18:00.772675+0000","last_active":"2024-09-16T01:18:01.766987+0000","last_peered":"2024-09-16T01:18:01.766987+0000","last_clean":"2024-09-16T01:18:01.766987+0000","last_became_active":"2024-09-16T01:18:00.772389+0000","last_became_peered":"2024-09-16T01:18:00.772389+0000","last_unstale":"2024-09-16T01:18:01.766987+0000","last_undegraded":"2024-09-16T01:18:01.766987+0000","last_fullsized":"2024-09-16T01:18:01.766987+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:12.745139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766752+0000","last_change":"2024-09-16T01:18:00.774418+0000","last_active":"2024-09-16T01:18:01.766752+0000","last_peered":"2024-09-16T01:18:01.766752+0000","last_clean":"2024-09-16T01:18:01.766752+0000","last_became_active":"2024-09-16T01:18:00.774055+0000","last_became_peered":"2024-09-16T01:18:00.774055+0000","last_unstale":"2024-09-16T01:18:01.766752+0000","last_undegraded":"2024-09-16T01:18:01.766752+0000","last_fullsized":"2024-09-16T01:18:01.766752+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:49:24.220180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431928+0000","last_change":"2024-09-16T01:18:00.782057+0000","last_active":"2024-09-16T01:18:02.431928+0000","last_peered":"2024-09-16T01:18:02.431928+0000","last_clean":"2024-09-16T01:18:02.431928+0000","last_became_active":"2024-09-16T01:18:00.781774+0000","last_became_peered":"2024-09-16T01:18:00.781774+0000","last_unstale":"2024-09-16T01:18:02.431928+0000","last_undegraded":"2024-09-16T01:18:02.431928+0000","last_fullsized":"2024-09-16T01:18:02.431928+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.731594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432299+0000","last_change":"2024-09-16T01:18:00.773495+0000","last_active":"2024-09-16T01:18:02.432299+0000","last_peered":"2024-09-16T01:18:02.432299+0000","last_clean":"2024-09-16T01:18:02.432299+0000","last_became_active":"2024-09-16T01:18:00.772860+0000","last_became_peered":"2024-09-16T01:18:00.772860+0000","last_unstale":"2024-09-16T01:18:02.432299+0000","last_undegraded":"2024-09-16T01:18:02.432299+0000","last_fullsized":"2024-09-16T01:18:02.432299+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:13:08.178218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765384+0000","last_change":"2024-09-16T01:18:00.768714+0000","last_active":"2024-09-16T01:18:01.765384+0000","last_peered":"2024-09-16T01:18:01.765384+0000","last_clean":"2024-09-16T01:18:01.765384+0000","last_became_active":"2024-09-16T01:18:00.768439+0000","last_became_peered":"2024-09-16T01:18:00.768439+0000","last_unstale":"2024-09-16T01:18:01.765384+0000","last_undegraded":"2024-09-16T01:18:01.765384+0000","last_fullsized":"2024-09-16T01:18:01.765384+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:24.680975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431114+0000","last_change":"2024-09-16T01:18:00.779010+0000","last_active":"2024-09-16T01:18:02.431114+0000","last_peered":"2024-09-16T01:18:02.431114+0000","last_clean":"2024-09-16T01:18:02.431114+0000","last_became_active":"2024-09-16T01:18:00.778707+0000","last_became_peered":"2024-09-16T01:18:00.778707+0000","last_unstale":"2024-09-16T01:18:02.431114+0000","last_undegraded":"2024-09-16T01:18:02.431114+0000","last_fullsized":"2024-09-16T01:18:02.431114+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.731594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768523+0000","last_change":"2024-09-16T01:18:00.778542+0000","last_active":"2024-09-16T01:18:01.768523+0000","last_peered":"2024-09-16T01:18:01.768523+0000","last_clean":"2024-09-16T01:18:01.768523+0000","last_became_active":"2024-09-16T01:18:00.778259+0000","last_became_peered":"2024-09-16T01:18:00.778259+0000","last_unstale":"2024-09-16T01:18:01.768523+0000","last_undegraded":"2024-09-16T01:18:01.768523+0000","last_fullsized":"2024-09-16T01:18:01.768523+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:23.740614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765240+0000","last_change":"2024-09-16T01:18:00.779514+0000","last_active":"2024-09-16T01:18:01.765240+0000","last_peered":"2024-09-16T01:18:01.765240+0000","last_clean":"2024-09-16T01:18:01.765240+0000","last_became_active":"2024-09-16T01:18:00.779186+0000","last_became_peered":"2024-09-16T01:18:00.779186+0000","last_unstale":"2024-09-16T01:18:01.765240+0000","last_undegraded":"2024-09-16T01:18:01.765240+0000","last_fullsized":"2024-09-16T01:18:01.765240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:40.996629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432055+0000","last_change":"2024-09-16T01:18:00.779702+0000","last_active":"2024-09-16T01:18:02.432055+0000","last_peered":"2024-09-16T01:18:02.432055+0000","last_clean":"2024-09-16T01:18:02.432055+0000","last_became_active":"2024-09-16T01:18:00.779224+0000","last_became_peered":"2024-09-16T01:18:00.779224+0000","last_unstale":"2024-09-16T01:18:02.432055+0000","last_undegraded":"2024-09-16T01:18:02.432055+0000","last_fullsized":"2024-09-16T01:18:02.432055+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:39.237996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431884+0000","last_change":"2024-09-16T01:18:00.781011+0000","last_active":"2024-09-16T01:18:02.431884+0000","last_peered":"2024-09-16T01:18:02.431884+0000","last_clean":"2024-09-16T01:18:02.431884+0000","last_became_active":"2024-09-16T01:18:00.779837+0000","last_became_peered":"2024-09-16T01:18:00.779837+0000","last_unstale":"2024-09-16T01:18:02.431884+0000","last_undegraded":"2024-09-16T01:18:02.431884+0000","last_fullsized":"2024-09-16T01:18:02.431884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:14.295316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432370+0000","last_change":"2024-09-16T01:18:00.774923+0000","last_active":"2024-09-16T01:18:02.432370+0000","last_peered":"2024-09-16T01:18:02.432370+0000","last_clean":"2024-09-16T01:18:02.432370+0000","last_became_active":"2024-09-16T01:18:00.774643+0000","last_became_peered":"2024-09-16T01:18:00.774643+0000","last_unstale":"2024-09-16T01:18:02.432370+0000","last_undegraded":"2024-09-16T01:18:02.432370+0000","last_fullsized":"2024-09-16T01:18:02.432370+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:28.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765746+0000","last_change":"2024-09-16T01:18:00.779710+0000","last_active":"2024-09-16T01:18:01.765746+0000","last_peered":"2024-09-16T01:18:01.765746+0000","last_clean":"2024-09-16T01:18:01.765746+0000","last_became_active":"2024-09-16T01:18:00.779444+0000","last_became_peered":"2024-09-16T01:18:00.779444+0000","last_unstale":"2024-09-16T01:18:01.765746+0000","last_undegraded":"2024-09-16T01:18:01.765746+0000","last_fullsized":"2024-09-16T01:18:01.765746+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:19.844727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766236+0000","last_change":"2024-09-16T01:18:00.766039+0000","last_active":"2024-09-16T01:18:01.766236+0000","last_peered":"2024-09-16T01:18:01.766236+0000","last_clean":"2024-09-16T01:18:01.766236+0000","last_became_active":"2024-09-16T01:18:00.765728+0000","last_became_peered":"2024-09-16T01:18:00.765728+0000","last_unstale":"2024-09-16T01:18:01.766236+0000","last_undegraded":"2024-09-16T01:18:01.766236+0000","last_fullsized":"2024-09-16T01:18:01.766236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:22.171147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432190+0000","last_change":"2024-09-16T01:18:00.780734+0000","last_active":"2024-09-16T01:18:02.432190+0000","last_peered":"2024-09-16T01:18:02.432190+0000","last_clean":"2024-09-16T01:18:02.432190+0000","last_became_active":"2024-09-16T01:18:00.780469+0000","last_became_peered":"2024-09-16T01:18:00.780469+0000","last_unstale":"2024-09-16T01:18:02.432190+0000","last_undegraded":"2024-09-16T01:18:02.432190+0000","last_fullsized":"2024-09-16T01:18:02.432190+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:33.492734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431812+0000","last_change":"2024-09-16T01:18:00.777951+0000","last_active":"2024-09-16T01:18:02.431812+0000","last_peered":"2024-09-16T01:18:02.431812+0000","last_clean":"2024-09-16T01:18:02.431812+0000","last_became_active":"2024-09-16T01:18:00.777649+0000","last_became_peered":"2024-09-16T01:18:00.777649+0000","last_unstale":"2024-09-16T01:18:02.431812+0000","last_undegraded":"2024-09-16T01:18:02.431812+0000","last_fullsized":"2024-09-16T01:18:02.431812+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:44.791962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768555+0000","last_change":"2024-09-16T01:18:00.768878+0000","last_active":"2024-09-16T01:18:01.768555+0000","last_peered":"2024-09-16T01:18:01.768555+0000","last_clean":"2024-09-16T01:18:01.768555+0000","last_became_active":"2024-09-16T01:18:00.768639+0000","last_became_peered":"2024-09-16T01:18:00.768639+0000","last_unstale":"2024-09-16T01:18:01.768555+0000","last_undegraded":"2024-09-16T01:18:01.768555+0000","last_fullsized":"2024-09-16T01:18:01.768555+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:46.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.767117+0000","last_change":"2024-09-16T01:18:00.776126+0000","last_active":"2024-09-16T01:18:01.767117+0000","last_peered":"2024-09-16T01:18:01.767117+0000","last_clean":"2024-09-16T01:18:01.767117+0000","last_became_active":"2024-09-16T01:18:00.775848+0000","last_became_peered":"2024-09-16T01:18:00.775848+0000","last_unstale":"2024-09-16T01:18:01.767117+0000","last_undegraded":"2024-09-16T01:18:01.767117+0000","last_fullsized":"2024-09-16T01:18:01.767117+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:27.131668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432123+0000","last_change":"2024-09-16T01:18:00.774761+0000","last_active":"2024-09-16T01:18:02.432123+0000","last_peered":"2024-09-16T01:18:02.432123+0000","last_clean":"2024-09-16T01:18:02.432123+0000","last_became_active":"2024-09-16T01:18:00.774463+0000","last_became_peered":"2024-09-16T01:18:00.774463+0000","last_unstale":"2024-09-16T01:18:02.432123+0000","last_undegraded":"2024-09-16T01:18:02.432123+0000","last_fullsized":"2024-09-16T01:18:02.432123+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:50.515178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765868+0000","last_change":"2024-09-16T01:18:00.767098+0000","last_active":"2024-09-16T01:18:01.765868+0000","last_peered":"2024-09-16T01:18:01.765868+0000","last_clean":"2024-09-16T01:18:01.765868+0000","last_became_active":"2024-09-16T01:18:00.766815+0000","last_became_peered":"2024-09-16T01:18:00.766815+0000","last_unstale":"2024-09-16T01:18:01.765868+0000","last_undegraded":"2024-09-16T01:18:01.765868+0000","last_fullsized":"2024-09-16T01:18:01.765868+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:00.154636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431032+0000","last_change":"2024-09-16T01:18:00.764834+0000","last_active":"2024-09-16T01:18:02.431032+0000","last_peered":"2024-09-16T01:18:02.431032+0000","last_clean":"2024-09-16T01:18:02.431032+0000","last_became_active":"2024-09-16T01:18:00.764521+0000","last_became_peered":"2024-09-16T01:18:00.764521+0000","last_unstale":"2024-09-16T01:18:02.431032+0000","last_undegraded":"2024-09-16T01:18:02.431032+0000","last_fullsized":"2024-09-16T01:18:02.431032+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:33.492734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766245+0000","last_change":"2024-09-16T01:18:00.774033+0000","last_active":"2024-09-16T01:18:01.766245+0000","last_peered":"2024-09-16T01:18:01.766245+0000","last_clean":"2024-09-16T01:18:01.766245+0000","last_became_active":"2024-09-16T01:18:00.773716+0000","last_became_peered":"2024-09-16T01:18:00.773716+0000","last_unstale":"2024-09-16T01:18:01.766245+0000","last_undegraded":"2024-09-16T01:18:01.766245+0000","last_fullsized":"2024-09-16T01:18:01.766245+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:45.080457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430772+0000","last_change":"2024-09-16T01:18:00.777700+0000","last_active":"2024-09-16T01:18:02.430772+0000","last_peered":"2024-09-16T01:18:02.430772+0000","last_clean":"2024-09-16T01:18:02.430772+0000","last_became_active":"2024-09-16T01:18:00.777362+0000","last_became_peered":"2024-09-16T01:18:00.777362+0000","last_unstale":"2024-09-16T01:18:02.430772+0000","last_undegraded":"2024-09-16T01:18:02.430772+0000","last_fullsized":"2024-09-16T01:18:02.430772+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:58.532226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430629+0000","last_change":"2024-09-16T01:18:00.778391+0000","last_active":"2024-09-16T01:18:02.430629+0000","last_peered":"2024-09-16T01:18:02.430629+0000","last_clean":"2024-09-16T01:18:02.430629+0000","last_became_active":"2024-09-16T01:18:00.778131+0000","last_became_peered":"2024-09-16T01:18:00.778131+0000","last_unstale":"2024-09-16T01:18:02.430629+0000","last_undegraded":"2024-09-16T01:18:02.430629+0000","last_fullsized":"2024-09-16T01:18:02.430629+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:14.295316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431431+0000","last_change":"2024-09-16T01:18:00.777652+0000","last_active":"2024-09-16T01:18:02.431431+0000","last_peered":"2024-09-16T01:18:02.431431+0000","last_clean":"2024-09-16T01:18:02.431431+0000","last_became_active":"2024-09-16T01:18:00.777363+0000","last_became_peered":"2024-09-16T01:18:00.777363+0000","last_unstale":"2024-09-16T01:18:02.431431+0000","last_undegraded":"2024-09-16T01:18:02.431431+0000","last_fullsized":"2024-09-16T01:18:02.431431+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:45.080457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765129+0000","last_change":"2024-09-16T01:18:00.764457+0000","last_active":"2024-09-16T01:18:01.765129+0000","last_peered":"2024-09-16T01:18:01.765129+0000","last_clean":"2024-09-16T01:18:01.765129+0000","last_became_active":"2024-09-16T01:18:00.763420+0000","last_became_peered":"2024-09-16T01:18:00.763420+0000","last_unstale":"2024-09-16T01:18:01.765129+0000","last_undegraded":"2024-09-16T01:18:01.765129+0000","last_fullsized":"2024-09-16T01:18:01.765129+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:07.149064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765912+0000","last_change":"2024-09-16T01:18:00.766162+0000","last_active":"2024-09-16T01:18:01.765912+0000","last_peered":"2024-09-16T01:18:01.765912+0000","last_clean":"2024-09-16T01:18:01.765912+0000","last_became_active":"2024-09-16T01:18:00.765781+0000","last_became_peered":"2024-09-16T01:18:00.765781+0000","last_unstale":"2024-09-16T01:18:01.765912+0000","last_undegraded":"2024-09-16T01:18:01.765912+0000","last_fullsized":"2024-09-16T01:18:01.765912+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.379740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432477+0000","last_change":"2024-09-16T01:18:00.772732+0000","last_active":"2024-09-16T01:18:02.432477+0000","last_peered":"2024-09-16T01:18:02.432477+0000","last_clean":"2024-09-16T01:18:02.432477+0000","last_became_active":"2024-09-16T01:18:00.772460+0000","last_became_peered":"2024-09-16T01:18:00.772460+0000","last_unstale":"2024-09-16T01:18:02.432477+0000","last_undegraded":"2024-09-16T01:18:02.432477+0000","last_fullsized":"2024-09-16T01:18:02.432477+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:27.659510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766783+0000","last_change":"2024-09-16T01:18:00.774251+0000","last_active":"2024-09-16T01:18:01.766783+0000","last_peered":"2024-09-16T01:18:01.766783+0000","last_clean":"2024-09-16T01:18:01.766783+0000","last_became_active":"2024-09-16T01:18:00.774015+0000","last_became_peered":"2024-09-16T01:18:00.774015+0000","last_unstale":"2024-09-16T01:18:01.766783+0000","last_undegraded":"2024-09-16T01:18:01.766783+0000","last_fullsized":"2024-09-16T01:18:01.766783+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:46.026251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432190+0000","last_change":"2024-09-16T01:18:00.781527+0000","last_active":"2024-09-16T01:18:02.432190+0000","last_peered":"2024-09-16T01:18:02.432190+0000","last_clean":"2024-09-16T01:18:02.432190+0000","last_became_active":"2024-09-16T01:18:00.780160+0000","last_became_peered":"2024-09-16T01:18:00.780160+0000","last_unstale":"2024-09-16T01:18:02.432190+0000","last_undegraded":"2024-09-16T01:18:02.432190+0000","last_fullsized":"2024-09-16T01:18:02.432190+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:18.926573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766088+0000","last_change":"2024-09-16T01:18:00.779155+0000","last_active":"2024-09-16T01:18:01.766088+0000","last_peered":"2024-09-16T01:18:01.766088+0000","last_clean":"2024-09-16T01:18:01.766088+0000","last_became_active":"2024-09-16T01:18:00.778859+0000","last_became_peered":"2024-09-16T01:18:00.778859+0000","last_unstale":"2024-09-16T01:18:01.766088+0000","last_undegraded":"2024-09-16T01:18:01.766088+0000","last_fullsized":"2024-09-16T01:18:01.766088+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:54.303614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431451+0000","last_change":"2024-09-16T01:18:00.774691+0000","last_active":"2024-09-16T01:18:02.431451+0000","last_peered":"2024-09-16T01:18:02.431451+0000","last_clean":"2024-09-16T01:18:02.431451+0000","last_became_active":"2024-09-16T01:18:00.774413+0000","last_became_peered":"2024-09-16T01:18:00.774413+0000","last_unstale":"2024-09-16T01:18:02.431451+0000","last_undegraded":"2024-09-16T01:18:02.431451+0000","last_fullsized":"2024-09-16T01:18:02.431451+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:57.125012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430570+0000","last_change":"2024-09-16T01:18:00.769470+0000","last_active":"2024-09-16T01:18:02.430570+0000","last_peered":"2024-09-16T01:18:02.430570+0000","last_clean":"2024-09-16T01:18:02.430570+0000","last_became_active":"2024-09-16T01:18:00.768916+0000","last_became_peered":"2024-09-16T01:18:00.768916+0000","last_unstale":"2024-09-16T01:18:02.430570+0000","last_undegraded":"2024-09-16T01:18:02.430570+0000","last_fullsized":"2024-09-16T01:18:02.430570+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:44.791962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765300+0000","last_change":"2024-09-16T01:18:00.770518+0000","last_active":"2024-09-16T01:18:01.765300+0000","last_peered":"2024-09-16T01:18:01.765300+0000","last_clean":"2024-09-16T01:18:01.765300+0000","last_became_active":"2024-09-16T01:18:00.770266+0000","last_became_peered":"2024-09-16T01:18:00.770266+0000","last_unstale":"2024-09-16T01:18:01.765300+0000","last_undegraded":"2024-09-16T01:18:01.765300+0000","last_fullsized":"2024-09-16T01:18:01.765300+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:28.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"62'4","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.767209+0000","last_change":"2024-09-16T01:17:59.764560+0000","last_active":"2024-09-16T01:18:01.767209+0000","last_peered":"2024-09-16T01:18:01.767209+0000","last_clean":"2024-09-16T01:18:01.767209+0000","last_became_active":"2024-09-16T01:17:59.764242+0000","last_became_peered":"2024-09-16T01:17:59.764242+0000","last_unstale":"2024-09-16T01:18:01.767209+0000","last_undegraded":"2024-09-16T01:18:01.767209+0000","last_fullsized":"2024-09-16T01:18:01.767209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:26.294459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432514+0000","last_change":"2024-09-16T01:18:00.770036+0000","last_active":"2024-09-16T01:18:02.432514+0000","last_peered":"2024-09-16T01:18:02.432514+0000","last_clean":"2024-09-16T01:18:02.432514+0000","last_became_active":"2024-09-16T01:18:00.769797+0000","last_became_peered":"2024-09-16T01:18:00.769797+0000","last_unstale":"2024-09-16T01:18:02.432514+0000","last_undegraded":"2024-09-16T01:18:02.432514+0000","last_fullsized":"2024-09-16T01:18:02.432514+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:24.680975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431235+0000","last_change":"2024-09-16T01:17:59.761132+0000","last_active":"2024-09-16T01:18:02.431235+0000","last_peered":"2024-09-16T01:18:02.431235+0000","last_clean":"2024-09-16T01:18:02.431235+0000","last_became_active":"2024-09-16T01:17:59.760844+0000","last_became_peered":"2024-09-16T01:17:59.760844+0000","last_unstale":"2024-09-16T01:18:02.431235+0000","last_undegraded":"2024-09-16T01:18:02.431235+0000","last_fullsized":"2024-09-16T01:18:02.431235+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:48.925880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431181+0000","last_change":"2024-09-16T01:18:00.769141+0000","last_active":"2024-09-16T01:18:02.431181+0000","last_peered":"2024-09-16T01:18:02.431181+0000","last_clean":"2024-09-16T01:18:02.431181+0000","last_became_active":"2024-09-16T01:18:00.768884+0000","last_became_peered":"2024-09-16T01:18:00.768884+0000","last_unstale":"2024-09-16T01:18:02.431181+0000","last_undegraded":"2024-09-16T01:18:02.431181+0000","last_fullsized":"2024-09-16T01:18:02.431181+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:58.532226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431021+0000","last_change":"2024-09-16T01:17:59.759681+0000","last_active":"2024-09-16T01:18:02.431021+0000","last_peered":"2024-09-16T01:18:02.431021+0000","last_clean":"2024-09-16T01:18:02.431021+0000","last_became_active":"2024-09-16T01:17:59.759394+0000","last_became_peered":"2024-09-16T01:17:59.759394+0000","last_unstale":"2024-09-16T01:18:02.431021+0000","last_undegraded":"2024-09-16T01:18:02.431021+0000","last_fullsized":"2024-09-16T01:18:02.431021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:06.144671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431984+0000","last_change":"2024-09-16T01:18:00.779194+0000","last_active":"2024-09-16T01:18:02.431984+0000","last_peered":"2024-09-16T01:18:02.431984+0000","last_clean":"2024-09-16T01:18:02.431984+0000","last_became_active":"2024-09-16T01:18:00.778868+0000","last_became_peered":"2024-09-16T01:18:00.778868+0000","last_unstale":"2024-09-16T01:18:02.431984+0000","last_undegraded":"2024-09-16T01:18:02.431984+0000","last_fullsized":"2024-09-16T01:18:02.431984+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:58.532226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431109+0000","last_change":"2024-09-16T01:17:59.762664+0000","last_active":"2024-09-16T01:18:02.431109+0000","last_peered":"2024-09-16T01:18:02.431109+0000","last_clean":"2024-09-16T01:18:02.431109+0000","last_became_active":"2024-09-16T01:17:59.762395+0000","last_became_peered":"2024-09-16T01:17:59.762395+0000","last_unstale":"2024-09-16T01:18:02.431109+0000","last_undegraded":"2024-09-16T01:18:02.431109+0000","last_fullsized":"2024-09-16T01:18:02.431109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:18.840334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768641+0000","last_change":"2024-09-16T01:18:00.771019+0000","last_active":"2024-09-16T01:18:01.768641+0000","last_peered":"2024-09-16T01:18:01.768641+0000","last_clean":"2024-09-16T01:18:01.768641+0000","last_became_active":"2024-09-16T01:18:00.770724+0000","last_became_peered":"2024-09-16T01:18:00.770724+0000","last_unstale":"2024-09-16T01:18:01.768641+0000","last_undegraded":"2024-09-16T01:18:01.768641+0000","last_fullsized":"2024-09-16T01:18:01.768641+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:29.912155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430979+0000","last_change":"2024-09-16T01:17:59.761689+0000","last_active":"2024-09-16T01:18:02.430979+0000","last_peered":"2024-09-16T01:18:02.430979+0000","last_clean":"2024-09-16T01:18:02.430979+0000","last_became_active":"2024-09-16T01:17:59.761418+0000","last_became_peered":"2024-09-16T01:17:59.761418+0000","last_unstale":"2024-09-16T01:18:02.430979+0000","last_undegraded":"2024-09-16T01:18:02.430979+0000","last_fullsized":"2024-09-16T01:18:02.430979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:53.299221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766831+0000","last_change":"2024-09-16T01:18:00.776106+0000","last_active":"2024-09-16T01:18:01.766831+0000","last_peered":"2024-09-16T01:18:01.766831+0000","last_clean":"2024-09-16T01:18:01.766831+0000","last_became_active":"2024-09-16T01:18:00.775859+0000","last_became_peered":"2024-09-16T01:18:00.775859+0000","last_unstale":"2024-09-16T01:18:01.766831+0000","last_undegraded":"2024-09-16T01:18:01.766831+0000","last_fullsized":"2024-09-16T01:18:01.766831+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:22.517772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430862+0000","last_change":"2024-09-16T01:17:59.768407+0000","last_active":"2024-09-16T01:18:02.430862+0000","last_peered":"2024-09-16T01:18:02.430862+0000","last_clean":"2024-09-16T01:18:02.430862+0000","last_became_active":"2024-09-16T01:17:59.767916+0000","last_became_peered":"2024-09-16T01:17:59.767916+0000","last_unstale":"2024-09-16T01:18:02.430862+0000","last_undegraded":"2024-09-16T01:18:02.430862+0000","last_fullsized":"2024-09-16T01:18:02.430862+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:59.586198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765515+0000","last_change":"2024-09-16T01:18:00.771471+0000","last_active":"2024-09-16T01:18:01.765515+0000","last_peered":"2024-09-16T01:18:01.765515+0000","last_clean":"2024-09-16T01:18:01.765515+0000","last_became_active":"2024-09-16T01:18:00.771176+0000","last_became_peered":"2024-09-16T01:18:00.771176+0000","last_unstale":"2024-09-16T01:18:01.765515+0000","last_undegraded":"2024-09-16T01:18:01.765515+0000","last_fullsized":"2024-09-16T01:18:01.765515+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:06.499475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430625+0000","last_change":"2024-09-16T01:17:59.767229+0000","last_active":"2024-09-16T01:18:02.430625+0000","last_peered":"2024-09-16T01:18:02.430625+0000","last_clean":"2024-09-16T01:18:02.430625+0000","last_became_active":"2024-09-16T01:17:59.766939+0000","last_became_peered":"2024-09-16T01:17:59.766939+0000","last_unstale":"2024-09-16T01:18:02.430625+0000","last_undegraded":"2024-09-16T01:18:02.430625+0000","last_fullsized":"2024-09-16T01:18:02.430625+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:39.992236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430935+0000","last_change":"2024-09-16T01:18:00.769575+0000","last_active":"2024-09-16T01:18:02.430935+0000","last_peered":"2024-09-16T01:18:02.430935+0000","last_clean":"2024-09-16T01:18:02.430935+0000","last_became_active":"2024-09-16T01:18:00.769295+0000","last_became_peered":"2024-09-16T01:18:00.769295+0000","last_unstale":"2024-09-16T01:18:02.430935+0000","last_undegraded":"2024-09-16T01:18:02.430935+0000","last_fullsized":"2024-09-16T01:18:02.430935+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:39.237996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765015+0000","last_change":"2024-09-16T01:17:59.761807+0000","last_active":"2024-09-16T01:18:01.765015+0000","last_peered":"2024-09-16T01:18:01.765015+0000","last_clean":"2024-09-16T01:18:01.765015+0000","last_became_active":"2024-09-16T01:17:59.761310+0000","last_became_peered":"2024-09-16T01:17:59.761310+0000","last_unstale":"2024-09-16T01:18:01.765015+0000","last_undegraded":"2024-09-16T01:18:01.765015+0000","last_fullsized":"2024-09-16T01:18:01.765015+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:59.120260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766889+0000","last_change":"2024-09-16T01:18:00.773646+0000","last_active":"2024-09-16T01:18:01.766889+0000","last_peered":"2024-09-16T01:18:01.766889+0000","last_clean":"2024-09-16T01:18:01.766889+0000","last_became_active":"2024-09-16T01:18:00.773349+0000","last_became_peered":"2024-09-16T01:18:00.773349+0000","last_unstale":"2024-09-16T01:18:01.766889+0000","last_undegraded":"2024-09-16T01:18:01.766889+0000","last_fullsized":"2024-09-16T01:18:01.766889+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:34.926682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432333+0000","last_change":"2024-09-16T01:17:59.768831+0000","last_active":"2024-09-16T01:18:02.432333+0000","last_peered":"2024-09-16T01:18:02.432333+0000","last_clean":"2024-09-16T01:18:02.432333+0000","last_became_active":"2024-09-16T01:17:59.768392+0000","last_became_peered":"2024-09-16T01:17:59.768392+0000","last_unstale":"2024-09-16T01:18:02.432333+0000","last_undegraded":"2024-09-16T01:18:02.432333+0000","last_fullsized":"2024-09-16T01:18:02.432333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:26.127275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430659+0000","last_change":"2024-09-16T01:18:00.764032+0000","last_active":"2024-09-16T01:18:02.430659+0000","last_peered":"2024-09-16T01:18:02.430659+0000","last_clean":"2024-09-16T01:18:02.430659+0000","last_became_active":"2024-09-16T01:18:00.763749+0000","last_became_peered":"2024-09-16T01:18:00.763749+0000","last_unstale":"2024-09-16T01:18:02.430659+0000","last_undegraded":"2024-09-16T01:18:02.430659+0000","last_fullsized":"2024-09-16T01:18:02.430659+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.731594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432208+0000","last_change":"2024-09-16T01:17:59.762688+0000","last_active":"2024-09-16T01:18:02.432208+0000","last_peered":"2024-09-16T01:18:02.432208+0000","last_clean":"2024-09-16T01:18:02.432208+0000","last_became_active":"2024-09-16T01:17:59.762289+0000","last_became_peered":"2024-09-16T01:17:59.762289+0000","last_unstale":"2024-09-16T01:18:02.432208+0000","last_undegraded":"2024-09-16T01:18:02.432208+0000","last_fullsized":"2024-09-16T01:18:02.432208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:10.954838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766279+0000","last_change":"2024-09-16T01:18:00.770237+0000","last_active":"2024-09-16T01:18:01.766279+0000","last_peered":"2024-09-16T01:18:01.766279+0000","last_clean":"2024-09-16T01:18:01.766279+0000","last_became_active":"2024-09-16T01:18:00.769944+0000","last_became_peered":"2024-09-16T01:18:00.769944+0000","last_unstale":"2024-09-16T01:18:01.766279+0000","last_undegraded":"2024-09-16T01:18:01.766279+0000","last_fullsized":"2024-09-16T01:18:01.766279+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:10.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"62'3","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432127+0000","last_change":"2024-09-16T01:17:59.768974+0000","last_active":"2024-09-16T01:18:02.432127+0000","last_peered":"2024-09-16T01:18:02.432127+0000","last_clean":"2024-09-16T01:18:02.432127+0000","last_became_active":"2024-09-16T01:17:59.768504+0000","last_became_peered":"2024-09-16T01:17:59.768504+0000","last_unstale":"2024-09-16T01:18:02.432127+0000","last_undegraded":"2024-09-16T01:18:02.432127+0000","last_fullsized":"2024-09-16T01:18:02.432127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:21.513379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432475+0000","last_change":"2024-09-16T01:18:00.769802+0000","last_active":"2024-09-16T01:18:02.432475+0000","last_peered":"2024-09-16T01:18:02.432475+0000","last_clean":"2024-09-16T01:18:02.432475+0000","last_became_active":"2024-09-16T01:18:00.769545+0000","last_became_peered":"2024-09-16T01:18:00.769545+0000","last_unstale":"2024-09-16T01:18:02.432475+0000","last_undegraded":"2024-09-16T01:18:02.432475+0000","last_fullsized":"2024-09-16T01:18:02.432475+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:41.677946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"62'6","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766943+0000","last_change":"2024-09-16T01:17:59.764295+0000","last_active":"2024-09-16T01:18:01.766943+0000","last_peered":"2024-09-16T01:18:01.766943+0000","last_clean":"2024-09-16T01:18:01.766943+0000","last_became_active":"2024-09-16T01:17:59.764020+0000","last_became_peered":"2024-09-16T01:17:59.764020+0000","last_unstale":"2024-09-16T01:18:01.766943+0000","last_undegraded":"2024-09-16T01:18:01.766943+0000","last_fullsized":"2024-09-16T01:18:01.766943+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:13:07.173826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431367+0000","last_change":"2024-09-16T01:18:00.780974+0000","last_active":"2024-09-16T01:18:02.431367+0000","last_peered":"2024-09-16T01:18:02.431367+0000","last_clean":"2024-09-16T01:18:02.431367+0000","last_became_active":"2024-09-16T01:18:00.780697+0000","last_became_peered":"2024-09-16T01:18:00.780697+0000","last_unstale":"2024-09-16T01:18:02.431367+0000","last_undegraded":"2024-09-16T01:18:02.431367+0000","last_fullsized":"2024-09-16T01:18:02.431367+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:04.111656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431470+0000","last_change":"2024-09-16T01:17:59.764249+0000","last_active":"2024-09-16T01:18:02.431470+0000","last_peered":"2024-09-16T01:18:02.431470+0000","last_clean":"2024-09-16T01:18:02.431470+0000","last_became_active":"2024-09-16T01:17:59.763899+0000","last_became_peered":"2024-09-16T01:17:59.763899+0000","last_unstale":"2024-09-16T01:18:02.431470+0000","last_undegraded":"2024-09-16T01:18:02.431470+0000","last_fullsized":"2024-09-16T01:18:02.431470+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:02.181790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765427+0000","last_change":"2024-09-16T01:18:00.768933+0000","last_active":"2024-09-16T01:18:01.765427+0000","last_peered":"2024-09-16T01:18:01.765427+0000","last_clean":"2024-09-16T01:18:01.765427+0000","last_became_active":"2024-09-16T01:18:00.768676+0000","last_became_peered":"2024-09-16T01:18:00.768676+0000","last_unstale":"2024-09-16T01:18:01.765427+0000","last_undegraded":"2024-09-16T01:18:01.765427+0000","last_fullsized":"2024-09-16T01:18:01.765427+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:00.590591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766139+0000","last_change":"2024-09-16T01:17:59.759538+0000","last_active":"2024-09-16T01:18:01.766139+0000","last_peered":"2024-09-16T01:18:01.766139+0000","last_clean":"2024-09-16T01:18:01.766139+0000","last_became_active":"2024-09-16T01:17:59.759281+0000","last_became_peered":"2024-09-16T01:17:59.759281+0000","last_unstale":"2024-09-16T01:18:01.766139+0000","last_undegraded":"2024-09-16T01:18:01.766139+0000","last_fullsized":"2024-09-16T01:18:01.766139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:05.495082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765570+0000","last_change":"2024-09-16T01:18:00.769922+0000","last_active":"2024-09-16T01:18:01.765570+0000","last_peered":"2024-09-16T01:18:01.765570+0000","last_clean":"2024-09-16T01:18:01.765570+0000","last_became_active":"2024-09-16T01:18:00.769654+0000","last_became_peered":"2024-09-16T01:18:00.769654+0000","last_unstale":"2024-09-16T01:18:01.765570+0000","last_undegraded":"2024-09-16T01:18:01.765570+0000","last_fullsized":"2024-09-16T01:18:01.765570+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:42.535136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432272+0000","last_change":"2024-09-16T01:17:59.769520+0000","last_active":"2024-09-16T01:18:02.432272+0000","last_peered":"2024-09-16T01:18:02.432272+0000","last_clean":"2024-09-16T01:18:02.432272+0000","last_became_active":"2024-09-16T01:17:59.769233+0000","last_became_peered":"2024-09-16T01:17:59.769233+0000","last_unstale":"2024-09-16T01:18:02.432272+0000","last_undegraded":"2024-09-16T01:18:02.432272+0000","last_fullsized":"2024-09-16T01:18:02.432272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:45.021858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766714+0000","last_change":"2024-09-16T01:18:00.781036+0000","last_active":"2024-09-16T01:18:01.766714+0000","last_peered":"2024-09-16T01:18:01.766714+0000","last_clean":"2024-09-16T01:18:01.766714+0000","last_became_active":"2024-09-16T01:18:00.780762+0000","last_became_peered":"2024-09-16T01:18:00.780762+0000","last_unstale":"2024-09-16T01:18:01.766714+0000","last_undegraded":"2024-09-16T01:18:01.766714+0000","last_fullsized":"2024-09-16T01:18:01.766714+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:10.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"62'8","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431472+0000","last_change":"2024-09-16T01:17:59.764372+0000","last_active":"2024-09-16T01:18:02.431472+0000","last_peered":"2024-09-16T01:18:02.431472+0000","last_clean":"2024-09-16T01:18:02.431472+0000","last_became_active":"2024-09-16T01:17:59.764087+0000","last_became_peered":"2024-09-16T01:17:59.764087+0000","last_unstale":"2024-09-16T01:18:02.431472+0000","last_undegraded":"2024-09-16T01:18:02.431472+0000","last_fullsized":"2024-09-16T01:18:02.431472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:02.932709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431876+0000","last_change":"2024-09-16T01:18:00.779173+0000","last_active":"2024-09-16T01:18:02.431876+0000","last_peered":"2024-09-16T01:18:02.431876+0000","last_clean":"2024-09-16T01:18:02.431876+0000","last_became_active":"2024-09-16T01:18:00.778853+0000","last_became_peered":"2024-09-16T01:18:00.778853+0000","last_unstale":"2024-09-16T01:18:02.431876+0000","last_undegraded":"2024-09-16T01:18:02.431876+0000","last_fullsized":"2024-09-16T01:18:02.431876+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:30.611051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765299+0000","last_change":"2024-09-16T01:17:59.762903+0000","last_active":"2024-09-16T01:18:01.765299+0000","last_peered":"2024-09-16T01:18:01.765299+0000","last_clean":"2024-09-16T01:18:01.765299+0000","last_became_active":"2024-09-16T01:17:59.762607+0000","last_became_peered":"2024-09-16T01:17:59.762607+0000","last_unstale":"2024-09-16T01:18:01.765299+0000","last_undegraded":"2024-09-16T01:18:01.765299+0000","last_fullsized":"2024-09-16T01:18:01.765299+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:41.530743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766036+0000","last_change":"2024-09-16T01:18:00.767674+0000","last_active":"2024-09-16T01:18:01.766036+0000","last_peered":"2024-09-16T01:18:01.766036+0000","last_clean":"2024-09-16T01:18:01.766036+0000","last_became_active":"2024-09-16T01:18:00.767402+0000","last_became_peered":"2024-09-16T01:18:00.767402+0000","last_unstale":"2024-09-16T01:18:01.766036+0000","last_undegraded":"2024-09-16T01:18:01.766036+0000","last_fullsized":"2024-09-16T01:18:01.766036+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:41.827484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431834+0000","last_change":"2024-09-16T01:17:59.769604+0000","last_active":"2024-09-16T01:18:02.431834+0000","last_peered":"2024-09-16T01:18:02.431834+0000","last_clean":"2024-09-16T01:18:02.431834+0000","last_became_active":"2024-09-16T01:17:59.769350+0000","last_became_peered":"2024-09-16T01:17:59.769350+0000","last_unstale":"2024-09-16T01:18:02.431834+0000","last_undegraded":"2024-09-16T01:18:02.431834+0000","last_fullsized":"2024-09-16T01:18:02.431834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:11.740746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432202+0000","last_change":"2024-09-16T01:18:00.771131+0000","last_active":"2024-09-16T01:18:02.432202+0000","last_peered":"2024-09-16T01:18:02.432202+0000","last_clean":"2024-09-16T01:18:02.432202+0000","last_became_active":"2024-09-16T01:18:00.770877+0000","last_became_peered":"2024-09-16T01:18:00.770877+0000","last_unstale":"2024-09-16T01:18:02.432202+0000","last_undegraded":"2024-09-16T01:18:02.432202+0000","last_fullsized":"2024-09-16T01:18:02.432202+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:27.298852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432054+0000","last_change":"2024-09-16T01:17:59.769174+0000","last_active":"2024-09-16T01:18:02.432054+0000","last_peered":"2024-09-16T01:18:02.432054+0000","last_clean":"2024-09-16T01:18:02.432054+0000","last_became_active":"2024-09-16T01:17:59.768842+0000","last_became_peered":"2024-09-16T01:17:59.768842+0000","last_unstale":"2024-09-16T01:18:02.432054+0000","last_undegraded":"2024-09-16T01:18:02.432054+0000","last_fullsized":"2024-09-16T01:18:02.432054+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:33.922289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765182+0000","last_change":"2024-09-16T01:18:00.771305+0000","last_active":"2024-09-16T01:18:01.765182+0000","last_peered":"2024-09-16T01:18:01.765182+0000","last_clean":"2024-09-16T01:18:01.765182+0000","last_became_active":"2024-09-16T01:18:00.770973+0000","last_became_peered":"2024-09-16T01:18:00.770973+0000","last_unstale":"2024-09-16T01:18:01.765182+0000","last_undegraded":"2024-09-16T01:18:01.765182+0000","last_fullsized":"2024-09-16T01:18:01.765182+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:13:08.178218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431118+0000","last_change":"2024-09-16T01:17:59.768326+0000","last_active":"2024-09-16T01:18:02.431118+0000","last_peered":"2024-09-16T01:18:02.431118+0000","last_clean":"2024-09-16T01:18:02.431118+0000","last_became_active":"2024-09-16T01:17:59.768069+0000","last_became_peered":"2024-09-16T01:17:59.768069+0000","last_unstale":"2024-09-16T01:18:02.431118+0000","last_undegraded":"2024-09-16T01:18:02.431118+0000","last_fullsized":"2024-09-16T01:18:02.431118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:18.840334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430623+0000","last_change":"2024-09-16T01:18:00.769236+0000","last_active":"2024-09-16T01:18:02.430623+0000","last_peered":"2024-09-16T01:18:02.430623+0000","last_clean":"2024-09-16T01:18:02.430623+0000","last_became_active":"2024-09-16T01:18:00.768569+0000","last_became_peered":"2024-09-16T01:18:00.768569+0000","last_unstale":"2024-09-16T01:18:02.430623+0000","last_undegraded":"2024-09-16T01:18:02.430623+0000","last_fullsized":"2024-09-16T01:18:02.430623+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:30.611051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430681+0000","last_change":"2024-09-16T01:17:59.754405+0000","last_active":"2024-09-16T01:18:02.430681+0000","last_peered":"2024-09-16T01:18:02.430681+0000","last_clean":"2024-09-16T01:18:02.430681+0000","last_became_active":"2024-09-16T01:17:59.754132+0000","last_became_peered":"2024-09-16T01:17:59.754132+0000","last_unstale":"2024-09-16T01:18:02.430681+0000","last_undegraded":"2024-09-16T01:18:02.430681+0000","last_fullsized":"2024-09-16T01:18:02.430681+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:02.181790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765579+0000","last_change":"2024-09-16T01:18:00.763204+0000","last_active":"2024-09-16T01:18:01.765579+0000","last_peered":"2024-09-16T01:18:01.765579+0000","last_clean":"2024-09-16T01:18:01.765579+0000","last_became_active":"2024-09-16T01:18:00.762903+0000","last_became_peered":"2024-09-16T01:18:00.762903+0000","last_unstale":"2024-09-16T01:18:01.765579+0000","last_undegraded":"2024-09-16T01:18:01.765579+0000","last_fullsized":"2024-09-16T01:18:01.765579+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:49.930273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766211+0000","last_change":"2024-09-16T01:17:59.762804+0000","last_active":"2024-09-16T01:18:01.766211+0000","last_peered":"2024-09-16T01:18:01.766211+0000","last_clean":"2024-09-16T01:18:01.766211+0000","last_became_active":"2024-09-16T01:17:59.762528+0000","last_became_peered":"2024-09-16T01:17:59.762528+0000","last_unstale":"2024-09-16T01:18:01.766211+0000","last_undegraded":"2024-09-16T01:18:01.766211+0000","last_fullsized":"2024-09-16T01:18:01.766211+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:23.676582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765701+0000","last_change":"2024-09-16T01:18:00.774203+0000","last_active":"2024-09-16T01:18:01.765701+0000","last_peered":"2024-09-16T01:18:01.765701+0000","last_clean":"2024-09-16T01:18:01.765701+0000","last_became_active":"2024-09-16T01:18:00.773843+0000","last_became_peered":"2024-09-16T01:18:00.773843+0000","last_unstale":"2024-09-16T01:18:01.765701+0000","last_undegraded":"2024-09-16T01:18:01.765701+0000","last_fullsized":"2024-09-16T01:18:01.765701+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:22.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430844+0000","last_change":"2024-09-16T01:17:59.761819+0000","last_active":"2024-09-16T01:18:02.430844+0000","last_peered":"2024-09-16T01:18:02.430844+0000","last_clean":"2024-09-16T01:18:02.430844+0000","last_became_active":"2024-09-16T01:17:59.760803+0000","last_became_peered":"2024-09-16T01:17:59.760803+0000","last_unstale":"2024-09-16T01:18:02.430844+0000","last_undegraded":"2024-09-16T01:18:02.430844+0000","last_fullsized":"2024-09-16T01:18:02.430844+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:59.586198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430744+0000","last_change":"2024-09-16T01:18:00.776578+0000","last_active":"2024-09-16T01:18:02.430744+0000","last_peered":"2024-09-16T01:18:02.430744+0000","last_clean":"2024-09-16T01:18:02.430744+0000","last_became_active":"2024-09-16T01:18:00.776270+0000","last_became_peered":"2024-09-16T01:18:00.776270+0000","last_unstale":"2024-09-16T01:18:02.430744+0000","last_undegraded":"2024-09-16T01:18:02.430744+0000","last_fullsized":"2024-09-16T01:18:02.430744+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:14.295316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765500+0000","last_change":"2024-09-16T01:17:59.762059+0000","last_active":"2024-09-16T01:18:01.765500+0000","last_peered":"2024-09-16T01:18:01.765500+0000","last_clean":"2024-09-16T01:18:01.765500+0000","last_became_active":"2024-09-16T01:17:59.761769+0000","last_became_peered":"2024-09-16T01:17:59.761769+0000","last_unstale":"2024-09-16T01:18:01.765500+0000","last_undegraded":"2024-09-16T01:18:01.765500+0000","last_fullsized":"2024-09-16T01:18:01.765500+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:21.040913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768714+0000","last_change":"2024-09-16T01:18:00.773857+0000","last_active":"2024-09-16T01:18:01.768714+0000","last_peered":"2024-09-16T01:18:01.768714+0000","last_clean":"2024-09-16T01:18:01.768714+0000","last_became_active":"2024-09-16T01:18:00.773604+0000","last_became_peered":"2024-09-16T01:18:00.773604+0000","last_unstale":"2024-09-16T01:18:01.768714+0000","last_undegraded":"2024-09-16T01:18:01.768714+0000","last_fullsized":"2024-09-16T01:18:01.768714+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:38.176330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"63'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.771229+0000","last_change":"2024-09-16T01:17:59.758587+0000","last_active":"2024-09-16T01:18:01.771229+0000","last_peered":"2024-09-16T01:18:01.771229+0000","last_clean":"2024-09-16T01:18:01.771229+0000","last_became_active":"2024-09-16T01:17:59.758329+0000","last_became_peered":"2024-09-16T01:17:59.758329+0000","last_unstale":"2024-09-16T01:18:01.771229+0000","last_undegraded":"2024-09-16T01:18:01.771229+0000","last_fullsized":"2024-09-16T01:18:01.771229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.128269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766206+0000","last_change":"2024-09-16T01:18:00.771635+0000","last_active":"2024-09-16T01:18:01.766206+0000","last_peered":"2024-09-16T01:18:01.766206+0000","last_clean":"2024-09-16T01:18:01.766206+0000","last_became_active":"2024-09-16T01:18:00.771082+0000","last_became_peered":"2024-09-16T01:18:00.771082+0000","last_unstale":"2024-09-16T01:18:01.766206+0000","last_undegraded":"2024-09-16T01:18:01.766206+0000","last_fullsized":"2024-09-16T01:18:01.766206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:17.231425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431079+0000","last_change":"2024-09-16T01:17:59.758251+0000","last_active":"2024-09-16T01:18:02.431079+0000","last_peered":"2024-09-16T01:18:02.431079+0000","last_clean":"2024-09-16T01:18:02.431079+0000","last_became_active":"2024-09-16T01:17:59.757958+0000","last_became_peered":"2024-09-16T01:17:59.757958+0000","last_unstale":"2024-09-16T01:18:02.431079+0000","last_undegraded":"2024-09-16T01:18:02.431079+0000","last_fullsized":"2024-09-16T01:18:02.431079+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:39.992236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765339+0000","last_change":"2024-09-16T01:18:00.764292+0000","last_active":"2024-09-16T01:18:01.765339+0000","last_peered":"2024-09-16T01:18:01.765339+0000","last_clean":"2024-09-16T01:18:01.765339+0000","last_became_active":"2024-09-16T01:18:00.763878+0000","last_became_peered":"2024-09-16T01:18:00.763878+0000","last_unstale":"2024-09-16T01:18:01.765339+0000","last_undegraded":"2024-09-16T01:18:01.765339+0000","last_fullsized":"2024-09-16T01:18:01.765339+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:41.677946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766968+0000","last_change":"2024-09-16T01:17:59.764272+0000","last_active":"2024-09-16T01:18:01.766968+0000","last_peered":"2024-09-16T01:18:01.766968+0000","last_clean":"2024-09-16T01:18:01.766968+0000","last_became_active":"2024-09-16T01:17:59.763997+0000","last_became_peered":"2024-09-16T01:17:59.763997+0000","last_unstale":"2024-09-16T01:18:01.766968+0000","last_undegraded":"2024-09-16T01:18:01.766968+0000","last_fullsized":"2024-09-16T01:18:01.766968+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:27.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765371+0000","last_change":"2024-09-16T01:18:00.769583+0000","last_active":"2024-09-16T01:18:01.765371+0000","last_peered":"2024-09-16T01:18:01.765371+0000","last_clean":"2024-09-16T01:18:01.765371+0000","last_became_active":"2024-09-16T01:18:00.769281+0000","last_became_peered":"2024-09-16T01:18:00.769281+0000","last_unstale":"2024-09-16T01:18:01.765371+0000","last_undegraded":"2024-09-16T01:18:01.765371+0000","last_fullsized":"2024-09-16T01:18:01.765371+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:27.659510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431724+0000","last_change":"2024-09-16T01:17:59.769374+0000","last_active":"2024-09-16T01:18:02.431724+0000","last_peered":"2024-09-16T01:18:02.431724+0000","last_clean":"2024-09-16T01:18:02.431724+0000","last_became_active":"2024-09-16T01:17:59.768993+0000","last_became_peered":"2024-09-16T01:17:59.768993+0000","last_unstale":"2024-09-16T01:18:02.431724+0000","last_undegraded":"2024-09-16T01:18:02.431724+0000","last_fullsized":"2024-09-16T01:18:02.431724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:34.308627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431499+0000","last_change":"2024-09-16T01:18:00.782727+0000","last_active":"2024-09-16T01:18:02.431499+0000","last_peered":"2024-09-16T01:18:02.431499+0000","last_clean":"2024-09-16T01:18:02.431499+0000","last_became_active":"2024-09-16T01:18:00.782357+0000","last_became_peered":"2024-09-16T01:18:00.782357+0000","last_unstale":"2024-09-16T01:18:02.431499+0000","last_undegraded":"2024-09-16T01:18:02.431499+0000","last_fullsized":"2024-09-16T01:18:02.431499+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:52.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430945+0000","last_change":"2024-09-16T01:17:59.768188+0000","last_active":"2024-09-16T01:18:02.430945+0000","last_peered":"2024-09-16T01:18:02.430945+0000","last_clean":"2024-09-16T01:18:02.430945+0000","last_became_active":"2024-09-16T01:17:59.767643+0000","last_became_peered":"2024-09-16T01:17:59.767643+0000","last_unstale":"2024-09-16T01:18:02.430945+0000","last_undegraded":"2024-09-16T01:18:02.430945+0000","last_fullsized":"2024-09-16T01:18:02.430945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.375347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766669+0000","last_change":"2024-09-16T01:18:00.776734+0000","last_active":"2024-09-16T01:18:01.766669+0000","last_peered":"2024-09-16T01:18:01.766669+0000","last_clean":"2024-09-16T01:18:01.766669+0000","last_became_active":"2024-09-16T01:18:00.776482+0000","last_became_peered":"2024-09-16T01:18:00.776482+0000","last_unstale":"2024-09-16T01:18:01.766669+0000","last_undegraded":"2024-09-16T01:18:01.766669+0000","last_fullsized":"2024-09-16T01:18:01.766669+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:41.827484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430728+0000","last_change":"2024-09-16T01:17:59.767422+0000","last_active":"2024-09-16T01:18:02.430728+0000","last_peered":"2024-09-16T01:18:02.430728+0000","last_clean":"2024-09-16T01:18:02.430728+0000","last_became_active":"2024-09-16T01:17:59.767175+0000","last_became_peered":"2024-09-16T01:17:59.767175+0000","last_unstale":"2024-09-16T01:18:02.430728+0000","last_undegraded":"2024-09-16T01:18:02.430728+0000","last_fullsized":"2024-09-16T01:18:02.430728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:48.925880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768651+0000","last_change":"2024-09-16T01:18:00.768859+0000","last_active":"2024-09-16T01:18:01.768651+0000","last_peered":"2024-09-16T01:18:01.768651+0000","last_clean":"2024-09-16T01:18:01.768651+0000","last_became_active":"2024-09-16T01:18:00.768589+0000","last_became_peered":"2024-09-16T01:18:00.768589+0000","last_unstale":"2024-09-16T01:18:01.768651+0000","last_undegraded":"2024-09-16T01:18:01.768651+0000","last_fullsized":"2024-09-16T01:18:01.768651+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:15.386791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766548+0000","last_change":"2024-09-16T01:17:59.762058+0000","last_active":"2024-09-16T01:18:01.766548+0000","last_peered":"2024-09-16T01:18:01.766548+0000","last_clean":"2024-09-16T01:18:01.766548+0000","last_became_active":"2024-09-16T01:17:59.761546+0000","last_became_peered":"2024-09-16T01:17:59.761546+0000","last_unstale":"2024-09-16T01:18:01.766548+0000","last_undegraded":"2024-09-16T01:18:01.766548+0000","last_fullsized":"2024-09-16T01:18:01.766548+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:49.510785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765552+0000","last_change":"2024-09-16T01:18:00.774829+0000","last_active":"2024-09-16T01:18:01.765552+0000","last_peered":"2024-09-16T01:18:01.765552+0000","last_clean":"2024-09-16T01:18:01.765552+0000","last_became_active":"2024-09-16T01:18:00.774189+0000","last_became_peered":"2024-09-16T01:18:00.774189+0000","last_unstale":"2024-09-16T01:18:01.765552+0000","last_undegraded":"2024-09-16T01:18:01.765552+0000","last_fullsized":"2024-09-16T01:18:01.765552+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:20.132662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430495+0000","last_change":"2024-09-16T01:17:59.767019+0000","last_active":"2024-09-16T01:18:02.430495+0000","last_peered":"2024-09-16T01:18:02.430495+0000","last_clean":"2024-09-16T01:18:02.430495+0000","last_became_active":"2024-09-16T01:17:59.766757+0000","last_became_peered":"2024-09-16T01:17:59.766757+0000","last_unstale":"2024-09-16T01:18:02.430495+0000","last_undegraded":"2024-09-16T01:18:02.430495+0000","last_fullsized":"2024-09-16T01:18:02.430495+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:06.144671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":249,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432054+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:18:02.432054+0000","last_peered":"2024-09-16T01:18:02.432054+0000","last_clean":"2024-09-16T01:18:02.432054+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:18:02.432054+0000","last_undegraded":"2024-09-16T01:18:02.432054+0000","last_fullsized":"2024-09-16T01:18:02.432054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1372160,"data_stored":933564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":765952,"data_stored":342454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":765952,"data_stored":342442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":344032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":749568,"data_stored":335728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":761856,"data_stored":342420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":790528,"data_stored":344796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1355776,"data_stored":932788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:18:04.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T01:18:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.571+0000 7f4c54de8640 1 Processor -- start 2024-09-16T01:18:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.571+0000 7f4c54de8640 1 -- start start 2024-09-16T01:18:04.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c54de8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c50072320 0x7f4c500cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c54de8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4c50072de0 0x7f4c5006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c54de8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c50146140 con 0x7f4c50072700 2024-09-16T01:18:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c54de8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4c500cd740 con 0x7f4c50072de0 2024-09-16T01:18:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c54de8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4c500cda20 con 0x7f4c50072320 2024-09-16T01:18:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c4ed9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4c50072700 0x7f4c5006e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53240/0 (socket says 172.21.15.81:53240) 2024-09-16T01:18:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c4ed9d640 1 -- 172.21.15.81:0/3415682735 learned_addr learned my addr 172.21.15.81:0/3415682735 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c4e59c640 1 --2- 172.21.15.81:0/3415682735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c50072320 0x7f4c500cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c47fff640 1 --2- 172.21.15.81:0/3415682735 >> v2:172.21.15.102:3300/0 conn(0x7f4c50072de0 0x7f4c5006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c4dd9b640 1 -- 172.21.15.81:0/3415682735 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147150821 0 0) 0x7f4c50146140 con 0x7f4c50072700 2024-09-16T01:18:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c4dd9b640 1 -- 172.21.15.81:0/3415682735 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c3c003520 con 0x7f4c50072700 2024-09-16T01:18:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c4e59c640 1 -- 172.21.15.81:0/3415682735 >> v2:172.21.15.102:3300/0 conn(0x7f4c50072de0 msgr2=0x7f4c5006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c4e59c640 1 --2- 172.21.15.81:0/3415682735 >> v2:172.21.15.102:3300/0 conn(0x7f4c50072de0 0x7f4c5006e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c4e59c640 1 -- 172.21.15.81:0/3415682735 >> v1:172.21.15.81:6789/0 conn(0x7f4c50072700 legacy=0x7f4c5006e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.572+0000 7f4c4e59c640 1 -- 172.21.15.81:0/3415682735 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c500cdd00 con 0x7f4c50072320 2024-09-16T01:18:04.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.573+0000 7f4c4e59c640 1 --2- 172.21.15.81:0/3415682735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c50072320 0x7f4c500cce60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c400097a0 tx=0x7f4c4002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b694f7dd01fd8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.573+0000 7f4c4dd9b640 1 -- 172.21.15.81:0/3415682735 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40037070 con 0x7f4c50072320 2024-09-16T01:18:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.573+0000 7f4c4dd9b640 1 -- 172.21.15.81:0/3415682735 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4002ae50 con 0x7f4c50072320 2024-09-16T01:18:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.573+0000 7f4c4dd9b640 1 -- 172.21.15.81:0/3415682735 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40032640 con 0x7f4c50072320 2024-09-16T01:18:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.574+0000 7f4c54de8640 1 -- 172.21.15.81:0/3415682735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c50072320 msgr2=0x7f4c500cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.574+0000 7f4c54de8640 1 --2- 172.21.15.81:0/3415682735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c50072320 0x7f4c500cce60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c400097a0 tx=0x7f4c4002a100 comp rx=0 tx=0).stop 2024-09-16T01:18:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.574+0000 7f4c54de8640 1 -- 172.21.15.81:0/3415682735 shutdown_connections 2024-09-16T01:18:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.574+0000 7f4c54de8640 1 --2- 172.21.15.81:0/3415682735 >> v2:172.21.15.102:3300/0 conn(0x7f4c50072de0 0x7f4c5006e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.574+0000 7f4c54de8640 1 --2- 172.21.15.81:0/3415682735 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c50072320 0x7f4c500cce60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.574+0000 7f4c54de8640 1 -- 172.21.15.81:0/3415682735 >> 172.21.15.81:0/3415682735 conn(0x7f4c50067d70 msgr2=0x7f4c5006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.574+0000 7f4c54de8640 1 -- 172.21.15.81:0/3415682735 shutdown_connections 2024-09-16T01:18:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.574+0000 7f4c54de8640 1 -- 172.21.15.81:0/3415682735 wait complete. 2024-09-16T01:18:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.575+0000 7f4c54de8640 1 Processor -- start 2024-09-16T01:18:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.575+0000 7f4c54de8640 1 -- start start 2024-09-16T01:18:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c54de8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c50072320 0x7f4c50144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c54de8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c50072700 0x7f4c500af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c54de8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c50072de0 0x7f4c500afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c54de8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c500cd520 con 0x7f4c50072320 2024-09-16T01:18:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c54de8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4c500cd3a0 con 0x7f4c50072700 2024-09-16T01:18:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c54de8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4c5006ed00 con 0x7f4c50072de0 2024-09-16T01:18:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c4e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c50072320 0x7f4c50144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c4e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c50072320 0x7f4c50144160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50320/0 (socket says 172.21.15.81:50320) 2024-09-16T01:18:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c4e59c640 1 -- 172.21.15.81:0/3067515968 learned_addr learned my addr 172.21.15.81:0/3067515968 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c4ed9d640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c50072de0 0x7f4c500afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c47fff640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c50072700 0x7f4c500af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c4e59c640 1 -- 172.21.15.81:0/3067515968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c50072de0 msgr2=0x7f4c500afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c4e59c640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c50072de0 0x7f4c500afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c4e59c640 1 -- 172.21.15.81:0/3067515968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c50072700 msgr2=0x7f4c500af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c4e59c640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c50072700 0x7f4c500af9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.576+0000 7f4c4e59c640 1 -- 172.21.15.81:0/3067515968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c500aec40 con 0x7f4c50072320 2024-09-16T01:18:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.577+0000 7f4c4e59c640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c50072320 0x7f4c50144160 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4c4002a140 tx=0x7f4c400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.577+0000 7f4c46ffd640 1 -- 172.21.15.81:0/3067515968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40041070 con 0x7f4c50072320 2024-09-16T01:18:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.577+0000 7f4c46ffd640 1 -- 172.21.15.81:0/3067515968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4003c460 con 0x7f4c50072320 2024-09-16T01:18:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.577+0000 7f4c54de8640 1 -- 172.21.15.81:0/3067515968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c500aa920 con 0x7f4c50072320 2024-09-16T01:18:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.577+0000 7f4c46ffd640 1 -- 172.21.15.81:0/3067515968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40037040 con 0x7f4c50072320 2024-09-16T01:18:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.577+0000 7f4c54de8640 1 -- 172.21.15.81:0/3067515968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c500aaee0 con 0x7f4c50072320 2024-09-16T01:18:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.578+0000 7f4c54de8640 1 -- 172.21.15.81:0/3067515968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c500cce60 con 0x7f4c50072320 2024-09-16T01:18:04.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.578+0000 7f4c46ffd640 1 -- 172.21.15.81:0/3067515968 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4c40044070 con 0x7f4c50072320 2024-09-16T01:18:04.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.579+0000 7f4c46ffd640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c3006c2b0 0x7f4c3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.579+0000 7f4c46ffd640 1 -- 172.21.15.81:0/3067515968 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f4c400ab8f0 con 0x7f4c50072320 2024-09-16T01:18:04.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.579+0000 7f4c47fff640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c3006c2b0 0x7f4c3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.579+0000 7f4c47fff640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c3006c2b0 0x7f4c3006e770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4c500acf50 tx=0x7f4c38009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:04.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.583+0000 7f4c46ffd640 1 -- 172.21.15.81:0/3067515968 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c40079880 con 0x7f4c50072320 2024-09-16T01:18:04.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.810+0000 7f4c54de8640 1 -- 172.21.15.81:0/3067515968 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4c500cc290 con 0x7f4c50072320 2024-09-16T01:18:04.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.810+0000 7f4c46ffd640 1 -- 172.21.15.81:0/3067515968 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1216 (secure 0 0 0) 0x7f4c4007db80 con 0x7f4c50072320 2024-09-16T01:18:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:04.813 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":168,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":63,"num_osds":8,"num_up_osds":8,"osd_up_since":1726449328,"num_in_osds":8,"osd_in_since":1726449318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":237305856,"bytes_avail":772856807424,"bytes_total":773094113280,"write_bytes_sec":2679,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":29,"btime":"2024-09-16T01:18:02:835480+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5667}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-16T01:17:28.082318+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T01:18:04.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.813+0000 7f4c54de8640 1 -- 172.21.15.81:0/3067515968 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c3006c2b0 msgr2=0x7f4c3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.813+0000 7f4c54de8640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c3006c2b0 0x7f4c3006e770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4c500acf50 tx=0x7f4c38009190 comp rx=0 tx=0).stop 2024-09-16T01:18:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.813+0000 7f4c54de8640 1 -- 172.21.15.81:0/3067515968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c50072320 msgr2=0x7f4c50144160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.813+0000 7f4c54de8640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c50072320 0x7f4c50144160 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4c4002a140 tx=0x7f4c400046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.813+0000 7f4c54de8640 1 -- 172.21.15.81:0/3067515968 shutdown_connections 2024-09-16T01:18:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.813+0000 7f4c54de8640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c3006c2b0 0x7f4c3006e770 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.813+0000 7f4c54de8640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c50072de0 0x7f4c500afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.813+0000 7f4c54de8640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c50072700 0x7f4c500af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.813+0000 7f4c54de8640 1 --2- 172.21.15.81:0/3067515968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c50072320 0x7f4c50144160 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.813+0000 7f4c54de8640 1 -- 172.21.15.81:0/3067515968 >> 172.21.15.81:0/3067515968 conn(0x7f4c50067d70 msgr2=0x7f4c5006e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.813+0000 7f4c54de8640 1 -- 172.21.15.81:0/3067515968 shutdown_connections 2024-09-16T01:18:04.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.813+0000 7f4c54de8640 1 -- 172.21.15.81:0/3067515968 wait complete. 2024-09-16T01:18:04.825 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T01:18:04.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:18:04.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.922+0000 7f6bf8877640 1 Processor -- start 2024-09-16T01:18:04.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.923+0000 7f6bf8877640 1 -- start start 2024-09-16T01:18:04.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.923+0000 7f6bf8877640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6bf40b6680 0x7f6bf4169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.923+0000 7f6bf8877640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bf406d9f0 con 0x7f6bf4161c80 2024-09-16T01:18:04.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.923+0000 7f6bf8877640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bf406dcd0 con 0x7f6bf4162060 2024-09-16T01:18:04.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.923+0000 7f6bf8877640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf406dfb0 con 0x7f6bf40b6680 2024-09-16T01:18:04.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.923+0000 7f6bf259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6bf4161c80 0x7f6bf406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53256/0 (socket says 172.21.15.81:53256) 2024-09-16T01:18:04.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.923+0000 7f6bf259c640 1 -- 172.21.15.81:0/3285501989 learned_addr learned my addr 172.21.15.81:0/3285501989 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:04.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.924+0000 7f6bf2d9d640 1 --2- 172.21.15.81:0/3285501989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6bf40b6680 0x7f6bf4169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.924+0000 7f6bf1d9b640 1 -- 172.21.15.81:0/3285501989 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753610081 0 0) 0x7f6bf406d9f0 con 0x7f6bf4161c80 2024-09-16T01:18:04.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.924+0000 7f6bf1d9b640 1 -- 172.21.15.81:0/3285501989 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6be0003520 con 0x7f6bf4161c80 2024-09-16T01:18:04.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.924+0000 7f6bf1d9b640 1 -- 172.21.15.81:0/3285501989 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827918485 0 0) 0x7f6bf406dcd0 con 0x7f6bf4162060 2024-09-16T01:18:04.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.924+0000 7f6bf1d9b640 1 -- 172.21.15.81:0/3285501989 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bf406d9f0 con 0x7f6bf4162060 2024-09-16T01:18:04.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.924+0000 7f6bf1d9b640 1 -- 172.21.15.81:0/3285501989 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 824794798 0 0) 0x7f6be0003520 con 0x7f6bf4161c80 2024-09-16T01:18:04.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.924+0000 7f6bf2d9d640 1 -- 172.21.15.81:0/3285501989 >> v1:172.21.15.102:6789/0 conn(0x7f6bf4162060 legacy=0x7f6bf40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.924+0000 7f6bf2d9d640 1 -- 172.21.15.81:0/3285501989 >> v1:172.21.15.81:6789/0 conn(0x7f6bf4161c80 legacy=0x7f6bf406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.924+0000 7f6bf2d9d640 1 -- 172.21.15.81:0/3285501989 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf40d01f0 con 0x7f6bf40b6680 2024-09-16T01:18:04.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.925+0000 7f6bf2d9d640 1 --2- 172.21.15.81:0/3285501989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6bf40b6680 0x7f6bf4169830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009dc0 tx=0x7f6bec02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18069e1cd4d2e5ae server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:04.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.925+0000 7f6bf1d9b640 1 -- 172.21.15.81:0/3285501989 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4001670 con 0x7f6bf40b6680 2024-09-16T01:18:04.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.925+0000 7f6bf1d9b640 1 -- 172.21.15.81:0/3285501989 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bec007540 con 0x7f6bf40b6680 2024-09-16T01:18:04.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.925+0000 7f6bf1d9b640 1 -- 172.21.15.81:0/3285501989 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec007910 con 0x7f6bf40b6680 2024-09-16T01:18:04.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.925+0000 7f6bf8877640 1 -- 172.21.15.81:0/3285501989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6bf40b6680 msgr2=0x7f6bf4169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.925+0000 7f6bf8877640 1 --2- 172.21.15.81:0/3285501989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6bf40b6680 0x7f6bf4169830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009dc0 tx=0x7f6bec02a660 comp rx=0 tx=0).stop 2024-09-16T01:18:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.925+0000 7f6bf8877640 1 -- 172.21.15.81:0/3285501989 shutdown_connections 2024-09-16T01:18:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.925+0000 7f6bf8877640 1 --2- 172.21.15.81:0/3285501989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6bf40b6680 0x7f6bf4169830 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.925+0000 7f6bf8877640 1 -- 172.21.15.81:0/3285501989 >> 172.21.15.81:0/3285501989 conn(0x7f6bf40d44f0 msgr2=0x7f6bf40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.925+0000 7f6bf8877640 1 -- 172.21.15.81:0/3285501989 shutdown_connections 2024-09-16T01:18:04.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.926+0000 7f6bf8877640 1 -- 172.21.15.81:0/3285501989 wait complete. 2024-09-16T01:18:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.927+0000 7f6bf8877640 1 Processor -- start 2024-09-16T01:18:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.927+0000 7f6bf8877640 1 -- start start 2024-09-16T01:18:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf8877640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6bf40b6680 0x7f6bf414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf8877640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bf4161c80 0x7f6bf414f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf8877640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf4162060 0x7f6bf40b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf8877640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf40b6cb0 con 0x7f6bf4162060 2024-09-16T01:18:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf8877640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf40b6b30 con 0x7f6bf4161c80 2024-09-16T01:18:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf8877640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf4169d70 con 0x7f6bf40b6680 2024-09-16T01:18:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf4162060 0x7f6bf40b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf4162060 0x7f6bf40b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50326/0 (socket says 172.21.15.81:50326) 2024-09-16T01:18:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf2d9d640 1 -- 172.21.15.81:0/1415425741 learned_addr learned my addr 172.21.15.81:0/1415425741 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf259c640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6bf40b6680 0x7f6bf414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6be9d9b640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bf4161c80 0x7f6bf414f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf2d9d640 1 -- 172.21.15.81:0/1415425741 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6bf40b6680 msgr2=0x7f6bf414f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf2d9d640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6bf40b6680 0x7f6bf414f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf2d9d640 1 -- 172.21.15.81:0/1415425741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bf4161c80 msgr2=0x7f6bf414f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf2d9d640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bf4161c80 0x7f6bf414f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf2d9d640 1 -- 172.21.15.81:0/1415425741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf40c8f10 con 0x7f6bf4162060 2024-09-16T01:18:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6bf2d9d640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf4162060 0x7f6bf40b4040 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009dc0 tx=0x7f6bec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6beb7fe640 1 -- 172.21.15.81:0/1415425741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec040070 con 0x7f6bf4162060 2024-09-16T01:18:04.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.928+0000 7f6beb7fe640 1 -- 172.21.15.81:0/1415425741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bec031bc0 con 0x7f6bf4162060 2024-09-16T01:18:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.929+0000 7f6bf8877640 1 -- 172.21.15.81:0/1415425741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf40ba280 con 0x7f6bf4162060 2024-09-16T01:18:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.929+0000 7f6beb7fe640 1 -- 172.21.15.81:0/1415425741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec007e90 con 0x7f6bf4162060 2024-09-16T01:18:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.929+0000 7f6bf8877640 1 -- 172.21.15.81:0/1415425741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf40b8030 con 0x7f6bf4162060 2024-09-16T01:18:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.929+0000 7f6bf8877640 1 -- 172.21.15.81:0/1415425741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf40d0aa0 con 0x7f6bf4162060 2024-09-16T01:18:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.930+0000 7f6beb7fe640 1 -- 172.21.15.81:0/1415425741 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6bec039040 con 0x7f6bf4162060 2024-09-16T01:18:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.930+0000 7f6beb7fe640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6bd406c2b0 0x7f6bd406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.930+0000 7f6beb7fe640 1 -- 172.21.15.81:0/1415425741 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f6bec0ac8c0 con 0x7f6bf4162060 2024-09-16T01:18:04.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.930+0000 7f6bf259c640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6bd406c2b0 0x7f6bd406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.931+0000 7f6bf259c640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6bd406c2b0 0x7f6bd406e770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6be40017e0 tx=0x7f6be4001610 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:04.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:04.934+0000 7f6beb7fe640 1 -- 172.21.15.81:0/1415425741 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6bf40d0aa0 con 0x7f6bf4162060 2024-09-16T01:18:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.098+0000 7f6bf8877640 1 -- 172.21.15.81:0/1415425741 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6bf40ba450 con 0x7f6bd406c2b0 2024-09-16T01:18:05.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.104+0000 7f6beb7fe640 1 -- 172.21.15.81:0/1415425741 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252017 (secure 0 0 0) 0x7f6bf40ba450 con 0x7f6bd406c2b0 2024-09-16T01:18:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:05.112 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:18:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.108+0000 7f6bf8877640 1 -- 172.21.15.81:0/1415425741 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6bd406c2b0 msgr2=0x7f6bd406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.108+0000 7f6bf8877640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6bd406c2b0 0x7f6bd406e770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6be40017e0 tx=0x7f6be4001610 comp rx=0 tx=0).stop 2024-09-16T01:18:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.108+0000 7f6bf8877640 1 -- 172.21.15.81:0/1415425741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf4162060 msgr2=0x7f6bf40b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:05.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.108+0000 7f6bf8877640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf4162060 0x7f6bf40b4040 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009dc0 tx=0x7f6bec004a40 comp rx=0 tx=0).stop 2024-09-16T01:18:05.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.108+0000 7f6bf8877640 1 -- 172.21.15.81:0/1415425741 shutdown_connections 2024-09-16T01:18:05.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.108+0000 7f6bf8877640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6bd406c2b0 0x7f6bd406e770 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:05.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.108+0000 7f6bf8877640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bf4162060 0x7f6bf40b4040 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:05.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.108+0000 7f6bf8877640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bf4161c80 0x7f6bf414f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:05.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.108+0000 7f6bf8877640 1 --2- 172.21.15.81:0/1415425741 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6bf40b6680 0x7f6bf414f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:05.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.108+0000 7f6bf8877640 1 -- 172.21.15.81:0/1415425741 >> 172.21.15.81:0/1415425741 conn(0x7f6bf40d44f0 msgr2=0x7f6bf40b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:05.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.108+0000 7f6bf8877640 1 -- 172.21.15.81:0/1415425741 shutdown_connections 2024-09-16T01:18:05.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:05.108+0000 7f6bf8877640 1 -- 172.21.15.81:0/1415425741 wait complete. 2024-09-16T01:18:05.120 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-09-16T01:18:04.088806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231744,"kb_used_data":7164,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742976,"statfs":{"total":773094113280,"available":772856807424,"internally_reserved":0,"allocated":7335936,"data_stored":3918224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.349703"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766987+0000","last_change":"2024-09-16T01:18:00.772675+0000","last_active":"2024-09-16T01:18:01.766987+0000","last_peered":"2024-09-16T01:18:01.766987+0000","last_clean":"2024-09-16T01:18:01.766987+0000","last_became_active":"2024-09-16T01:18:00.772389+0000","last_became_peered":"2024-09-16T01:18:00.772389+0000","last_unstale":"2024-09-16T01:18:01.766987+0000","last_undegraded":"2024-09-16T01:18:01.766987+0000","last_fullsized":"2024-09-16T01:18:01.766987+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:12.745139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766752+0000","last_change":"2024-09-16T01:18:00.774418+0000","last_active":"2024-09-16T01:18:01.766752+0000","last_peered":"2024-09-16T01:18:01.766752+0000","last_clean":"2024-09-16T01:18:01.766752+0000","last_became_active":"2024-09-16T01:18:00.774055+0000","last_became_peered":"2024-09-16T01:18:00.774055+0000","last_unstale":"2024-09-16T01:18:01.766752+0000","last_undegraded":"2024-09-16T01:18:01.766752+0000","last_fullsized":"2024-09-16T01:18:01.766752+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:49:24.220180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431928+0000","last_change":"2024-09-16T01:18:00.782057+0000","last_active":"2024-09-16T01:18:02.431928+0000","last_peered":"2024-09-16T01:18:02.431928+0000","last_clean":"2024-09-16T01:18:02.431928+0000","last_became_active":"2024-09-16T01:18:00.781774+0000","last_became_peered":"2024-09-16T01:18:00.781774+0000","last_unstale":"2024-09-16T01:18:02.431928+0000","last_undegraded":"2024-09-16T01:18:02.431928+0000","last_fullsized":"2024-09-16T01:18:02.431928+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.731594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432299+0000","last_change":"2024-09-16T01:18:00.773495+0000","last_active":"2024-09-16T01:18:02.432299+0000","last_peered":"2024-09-16T01:18:02.432299+0000","last_clean":"2024-09-16T01:18:02.432299+0000","last_became_active":"2024-09-16T01:18:00.772860+0000","last_became_peered":"2024-09-16T01:18:00.772860+0000","last_unstale":"2024-09-16T01:18:02.432299+0000","last_undegraded":"2024-09-16T01:18:02.432299+0000","last_fullsized":"2024-09-16T01:18:02.432299+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:13:08.178218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765384+0000","last_change":"2024-09-16T01:18:00.768714+0000","last_active":"2024-09-16T01:18:01.765384+0000","last_peered":"2024-09-16T01:18:01.765384+0000","last_clean":"2024-09-16T01:18:01.765384+0000","last_became_active":"2024-09-16T01:18:00.768439+0000","last_became_peered":"2024-09-16T01:18:00.768439+0000","last_unstale":"2024-09-16T01:18:01.765384+0000","last_undegraded":"2024-09-16T01:18:01.765384+0000","last_fullsized":"2024-09-16T01:18:01.765384+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:24.680975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431114+0000","last_change":"2024-09-16T01:18:00.779010+0000","last_active":"2024-09-16T01:18:02.431114+0000","last_peered":"2024-09-16T01:18:02.431114+0000","last_clean":"2024-09-16T01:18:02.431114+0000","last_became_active":"2024-09-16T01:18:00.778707+0000","last_became_peered":"2024-09-16T01:18:00.778707+0000","last_unstale":"2024-09-16T01:18:02.431114+0000","last_undegraded":"2024-09-16T01:18:02.431114+0000","last_fullsized":"2024-09-16T01:18:02.431114+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.731594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768523+0000","last_change":"2024-09-16T01:18:00.778542+0000","last_active":"2024-09-16T01:18:01.768523+0000","last_peered":"2024-09-16T01:18:01.768523+0000","last_clean":"2024-09-16T01:18:01.768523+0000","last_became_active":"2024-09-16T01:18:00.778259+0000","last_became_peered":"2024-09-16T01:18:00.778259+0000","last_unstale":"2024-09-16T01:18:01.768523+0000","last_undegraded":"2024-09-16T01:18:01.768523+0000","last_fullsized":"2024-09-16T01:18:01.768523+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:23.740614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765240+0000","last_change":"2024-09-16T01:18:00.779514+0000","last_active":"2024-09-16T01:18:01.765240+0000","last_peered":"2024-09-16T01:18:01.765240+0000","last_clean":"2024-09-16T01:18:01.765240+0000","last_became_active":"2024-09-16T01:18:00.779186+0000","last_became_peered":"2024-09-16T01:18:00.779186+0000","last_unstale":"2024-09-16T01:18:01.765240+0000","last_undegraded":"2024-09-16T01:18:01.765240+0000","last_fullsized":"2024-09-16T01:18:01.765240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:40.996629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432055+0000","last_change":"2024-09-16T01:18:00.779702+0000","last_active":"2024-09-16T01:18:02.432055+0000","last_peered":"2024-09-16T01:18:02.432055+0000","last_clean":"2024-09-16T01:18:02.432055+0000","last_became_active":"2024-09-16T01:18:00.779224+0000","last_became_peered":"2024-09-16T01:18:00.779224+0000","last_unstale":"2024-09-16T01:18:02.432055+0000","last_undegraded":"2024-09-16T01:18:02.432055+0000","last_fullsized":"2024-09-16T01:18:02.432055+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:39.237996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431884+0000","last_change":"2024-09-16T01:18:00.781011+0000","last_active":"2024-09-16T01:18:02.431884+0000","last_peered":"2024-09-16T01:18:02.431884+0000","last_clean":"2024-09-16T01:18:02.431884+0000","last_became_active":"2024-09-16T01:18:00.779837+0000","last_became_peered":"2024-09-16T01:18:00.779837+0000","last_unstale":"2024-09-16T01:18:02.431884+0000","last_undegraded":"2024-09-16T01:18:02.431884+0000","last_fullsized":"2024-09-16T01:18:02.431884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:14.295316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432370+0000","last_change":"2024-09-16T01:18:00.774923+0000","last_active":"2024-09-16T01:18:02.432370+0000","last_peered":"2024-09-16T01:18:02.432370+0000","last_clean":"2024-09-16T01:18:02.432370+0000","last_became_active":"2024-09-16T01:18:00.774643+0000","last_became_peered":"2024-09-16T01:18:00.774643+0000","last_unstale":"2024-09-16T01:18:02.432370+0000","last_undegraded":"2024-09-16T01:18:02.432370+0000","last_fullsized":"2024-09-16T01:18:02.432370+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:28.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765746+0000","last_change":"2024-09-16T01:18:00.779710+0000","last_active":"2024-09-16T01:18:01.765746+0000","last_peered":"2024-09-16T01:18:01.765746+0000","last_clean":"2024-09-16T01:18:01.765746+0000","last_became_active":"2024-09-16T01:18:00.779444+0000","last_became_peered":"2024-09-16T01:18:00.779444+0000","last_unstale":"2024-09-16T01:18:01.765746+0000","last_undegraded":"2024-09-16T01:18:01.765746+0000","last_fullsized":"2024-09-16T01:18:01.765746+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:19.844727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766236+0000","last_change":"2024-09-16T01:18:00.766039+0000","last_active":"2024-09-16T01:18:01.766236+0000","last_peered":"2024-09-16T01:18:01.766236+0000","last_clean":"2024-09-16T01:18:01.766236+0000","last_became_active":"2024-09-16T01:18:00.765728+0000","last_became_peered":"2024-09-16T01:18:00.765728+0000","last_unstale":"2024-09-16T01:18:01.766236+0000","last_undegraded":"2024-09-16T01:18:01.766236+0000","last_fullsized":"2024-09-16T01:18:01.766236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:22.171147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432190+0000","last_change":"2024-09-16T01:18:00.780734+0000","last_active":"2024-09-16T01:18:02.432190+0000","last_peered":"2024-09-16T01:18:02.432190+0000","last_clean":"2024-09-16T01:18:02.432190+0000","last_became_active":"2024-09-16T01:18:00.780469+0000","last_became_peered":"2024-09-16T01:18:00.780469+0000","last_unstale":"2024-09-16T01:18:02.432190+0000","last_undegraded":"2024-09-16T01:18:02.432190+0000","last_fullsized":"2024-09-16T01:18:02.432190+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:33.492734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431812+0000","last_change":"2024-09-16T01:18:00.777951+0000","last_active":"2024-09-16T01:18:02.431812+0000","last_peered":"2024-09-16T01:18:02.431812+0000","last_clean":"2024-09-16T01:18:02.431812+0000","last_became_active":"2024-09-16T01:18:00.777649+0000","last_became_peered":"2024-09-16T01:18:00.777649+0000","last_unstale":"2024-09-16T01:18:02.431812+0000","last_undegraded":"2024-09-16T01:18:02.431812+0000","last_fullsized":"2024-09-16T01:18:02.431812+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:44.791962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768555+0000","last_change":"2024-09-16T01:18:00.768878+0000","last_active":"2024-09-16T01:18:01.768555+0000","last_peered":"2024-09-16T01:18:01.768555+0000","last_clean":"2024-09-16T01:18:01.768555+0000","last_became_active":"2024-09-16T01:18:00.768639+0000","last_became_peered":"2024-09-16T01:18:00.768639+0000","last_unstale":"2024-09-16T01:18:01.768555+0000","last_undegraded":"2024-09-16T01:18:01.768555+0000","last_fullsized":"2024-09-16T01:18:01.768555+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:46.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.767117+0000","last_change":"2024-09-16T01:18:00.776126+0000","last_active":"2024-09-16T01:18:01.767117+0000","last_peered":"2024-09-16T01:18:01.767117+0000","last_clean":"2024-09-16T01:18:01.767117+0000","last_became_active":"2024-09-16T01:18:00.775848+0000","last_became_peered":"2024-09-16T01:18:00.775848+0000","last_unstale":"2024-09-16T01:18:01.767117+0000","last_undegraded":"2024-09-16T01:18:01.767117+0000","last_fullsized":"2024-09-16T01:18:01.767117+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:27.131668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432123+0000","last_change":"2024-09-16T01:18:00.774761+0000","last_active":"2024-09-16T01:18:02.432123+0000","last_peered":"2024-09-16T01:18:02.432123+0000","last_clean":"2024-09-16T01:18:02.432123+0000","last_became_active":"2024-09-16T01:18:00.774463+0000","last_became_peered":"2024-09-16T01:18:00.774463+0000","last_unstale":"2024-09-16T01:18:02.432123+0000","last_undegraded":"2024-09-16T01:18:02.432123+0000","last_fullsized":"2024-09-16T01:18:02.432123+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:50.515178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765868+0000","last_change":"2024-09-16T01:18:00.767098+0000","last_active":"2024-09-16T01:18:01.765868+0000","last_peered":"2024-09-16T01:18:01.765868+0000","last_clean":"2024-09-16T01:18:01.765868+0000","last_became_active":"2024-09-16T01:18:00.766815+0000","last_became_peered":"2024-09-16T01:18:00.766815+0000","last_unstale":"2024-09-16T01:18:01.765868+0000","last_undegraded":"2024-09-16T01:18:01.765868+0000","last_fullsized":"2024-09-16T01:18:01.765868+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:00.154636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431032+0000","last_change":"2024-09-16T01:18:00.764834+0000","last_active":"2024-09-16T01:18:02.431032+0000","last_peered":"2024-09-16T01:18:02.431032+0000","last_clean":"2024-09-16T01:18:02.431032+0000","last_became_active":"2024-09-16T01:18:00.764521+0000","last_became_peered":"2024-09-16T01:18:00.764521+0000","last_unstale":"2024-09-16T01:18:02.431032+0000","last_undegraded":"2024-09-16T01:18:02.431032+0000","last_fullsized":"2024-09-16T01:18:02.431032+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:33.492734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766245+0000","last_change":"2024-09-16T01:18:00.774033+0000","last_active":"2024-09-16T01:18:01.766245+0000","last_peered":"2024-09-16T01:18:01.766245+0000","last_clean":"2024-09-16T01:18:01.766245+0000","last_became_active":"2024-09-16T01:18:00.773716+0000","last_became_peered":"2024-09-16T01:18:00.773716+0000","last_unstale":"2024-09-16T01:18:01.766245+0000","last_undegraded":"2024-09-16T01:18:01.766245+0000","last_fullsized":"2024-09-16T01:18:01.766245+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:45.080457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430772+0000","last_change":"2024-09-16T01:18:00.777700+0000","last_active":"2024-09-16T01:18:02.430772+0000","last_peered":"2024-09-16T01:18:02.430772+0000","last_clean":"2024-09-16T01:18:02.430772+0000","last_became_active":"2024-09-16T01:18:00.777362+0000","last_became_peered":"2024-09-16T01:18:00.777362+0000","last_unstale":"2024-09-16T01:18:02.430772+0000","last_undegraded":"2024-09-16T01:18:02.430772+0000","last_fullsized":"2024-09-16T01:18:02.430772+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:58.532226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430629+0000","last_change":"2024-09-16T01:18:00.778391+0000","last_active":"2024-09-16T01:18:02.430629+0000","last_peered":"2024-09-16T01:18:02.430629+0000","last_clean":"2024-09-16T01:18:02.430629+0000","last_became_active":"2024-09-16T01:18:00.778131+0000","last_became_peered":"2024-09-16T01:18:00.778131+0000","last_unstale":"2024-09-16T01:18:02.430629+0000","last_undegraded":"2024-09-16T01:18:02.430629+0000","last_fullsized":"2024-09-16T01:18:02.430629+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:14.295316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431431+0000","last_change":"2024-09-16T01:18:00.777652+0000","last_active":"2024-09-16T01:18:02.431431+0000","last_peered":"2024-09-16T01:18:02.431431+0000","last_clean":"2024-09-16T01:18:02.431431+0000","last_became_active":"2024-09-16T01:18:00.777363+0000","last_became_peered":"2024-09-16T01:18:00.777363+0000","last_unstale":"2024-09-16T01:18:02.431431+0000","last_undegraded":"2024-09-16T01:18:02.431431+0000","last_fullsized":"2024-09-16T01:18:02.431431+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:45.080457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765129+0000","last_change":"2024-09-16T01:18:00.764457+0000","last_active":"2024-09-16T01:18:01.765129+0000","last_peered":"2024-09-16T01:18:01.765129+0000","last_clean":"2024-09-16T01:18:01.765129+0000","last_became_active":"2024-09-16T01:18:00.763420+0000","last_became_peered":"2024-09-16T01:18:00.763420+0000","last_unstale":"2024-09-16T01:18:01.765129+0000","last_undegraded":"2024-09-16T01:18:01.765129+0000","last_fullsized":"2024-09-16T01:18:01.765129+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:07.149064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765912+0000","last_change":"2024-09-16T01:18:00.766162+0000","last_active":"2024-09-16T01:18:01.765912+0000","last_peered":"2024-09-16T01:18:01.765912+0000","last_clean":"2024-09-16T01:18:01.765912+0000","last_became_active":"2024-09-16T01:18:00.765781+0000","last_became_peered":"2024-09-16T01:18:00.765781+0000","last_unstale":"2024-09-16T01:18:01.765912+0000","last_undegraded":"2024-09-16T01:18:01.765912+0000","last_fullsized":"2024-09-16T01:18:01.765912+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.379740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432477+0000","last_change":"2024-09-16T01:18:00.772732+0000","last_active":"2024-09-16T01:18:02.432477+0000","last_peered":"2024-09-16T01:18:02.432477+0000","last_clean":"2024-09-16T01:18:02.432477+0000","last_became_active":"2024-09-16T01:18:00.772460+0000","last_became_peered":"2024-09-16T01:18:00.772460+0000","last_unstale":"2024-09-16T01:18:02.432477+0000","last_undegraded":"2024-09-16T01:18:02.432477+0000","last_fullsized":"2024-09-16T01:18:02.432477+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:27.659510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766783+0000","last_change":"2024-09-16T01:18:00.774251+0000","last_active":"2024-09-16T01:18:01.766783+0000","last_peered":"2024-09-16T01:18:01.766783+0000","last_clean":"2024-09-16T01:18:01.766783+0000","last_became_active":"2024-09-16T01:18:00.774015+0000","last_became_peered":"2024-09-16T01:18:00.774015+0000","last_unstale":"2024-09-16T01:18:01.766783+0000","last_undegraded":"2024-09-16T01:18:01.766783+0000","last_fullsized":"2024-09-16T01:18:01.766783+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:46.026251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432190+0000","last_change":"2024-09-16T01:18:00.781527+0000","last_active":"2024-09-16T01:18:02.432190+0000","last_peered":"2024-09-16T01:18:02.432190+0000","last_clean":"2024-09-16T01:18:02.432190+0000","last_became_active":"2024-09-16T01:18:00.780160+0000","last_became_peered":"2024-09-16T01:18:00.780160+0000","last_unstale":"2024-09-16T01:18:02.432190+0000","last_undegraded":"2024-09-16T01:18:02.432190+0000","last_fullsized":"2024-09-16T01:18:02.432190+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:18.926573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766088+0000","last_change":"2024-09-16T01:18:00.779155+0000","last_active":"2024-09-16T01:18:01.766088+0000","last_peered":"2024-09-16T01:18:01.766088+0000","last_clean":"2024-09-16T01:18:01.766088+0000","last_became_active":"2024-09-16T01:18:00.778859+0000","last_became_peered":"2024-09-16T01:18:00.778859+0000","last_unstale":"2024-09-16T01:18:01.766088+0000","last_undegraded":"2024-09-16T01:18:01.766088+0000","last_fullsized":"2024-09-16T01:18:01.766088+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:54.303614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431451+0000","last_change":"2024-09-16T01:18:00.774691+0000","last_active":"2024-09-16T01:18:02.431451+0000","last_peered":"2024-09-16T01:18:02.431451+0000","last_clean":"2024-09-16T01:18:02.431451+0000","last_became_active":"2024-09-16T01:18:00.774413+0000","last_became_peered":"2024-09-16T01:18:00.774413+0000","last_unstale":"2024-09-16T01:18:02.431451+0000","last_undegraded":"2024-09-16T01:18:02.431451+0000","last_fullsized":"2024-09-16T01:18:02.431451+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:57.125012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430570+0000","last_change":"2024-09-16T01:18:00.769470+0000","last_active":"2024-09-16T01:18:02.430570+0000","last_peered":"2024-09-16T01:18:02.430570+0000","last_clean":"2024-09-16T01:18:02.430570+0000","last_became_active":"2024-09-16T01:18:00.768916+0000","last_became_peered":"2024-09-16T01:18:00.768916+0000","last_unstale":"2024-09-16T01:18:02.430570+0000","last_undegraded":"2024-09-16T01:18:02.430570+0000","last_fullsized":"2024-09-16T01:18:02.430570+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:44.791962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765300+0000","last_change":"2024-09-16T01:18:00.770518+0000","last_active":"2024-09-16T01:18:01.765300+0000","last_peered":"2024-09-16T01:18:01.765300+0000","last_clean":"2024-09-16T01:18:01.765300+0000","last_became_active":"2024-09-16T01:18:00.770266+0000","last_became_peered":"2024-09-16T01:18:00.770266+0000","last_unstale":"2024-09-16T01:18:01.765300+0000","last_undegraded":"2024-09-16T01:18:01.765300+0000","last_fullsized":"2024-09-16T01:18:01.765300+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:28.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"62'4","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.767209+0000","last_change":"2024-09-16T01:17:59.764560+0000","last_active":"2024-09-16T01:18:01.767209+0000","last_peered":"2024-09-16T01:18:01.767209+0000","last_clean":"2024-09-16T01:18:01.767209+0000","last_became_active":"2024-09-16T01:17:59.764242+0000","last_became_peered":"2024-09-16T01:17:59.764242+0000","last_unstale":"2024-09-16T01:18:01.767209+0000","last_undegraded":"2024-09-16T01:18:01.767209+0000","last_fullsized":"2024-09-16T01:18:01.767209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:26.294459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432514+0000","last_change":"2024-09-16T01:18:00.770036+0000","last_active":"2024-09-16T01:18:02.432514+0000","last_peered":"2024-09-16T01:18:02.432514+0000","last_clean":"2024-09-16T01:18:02.432514+0000","last_became_active":"2024-09-16T01:18:00.769797+0000","last_became_peered":"2024-09-16T01:18:00.769797+0000","last_unstale":"2024-09-16T01:18:02.432514+0000","last_undegraded":"2024-09-16T01:18:02.432514+0000","last_fullsized":"2024-09-16T01:18:02.432514+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:24.680975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431235+0000","last_change":"2024-09-16T01:17:59.761132+0000","last_active":"2024-09-16T01:18:02.431235+0000","last_peered":"2024-09-16T01:18:02.431235+0000","last_clean":"2024-09-16T01:18:02.431235+0000","last_became_active":"2024-09-16T01:17:59.760844+0000","last_became_peered":"2024-09-16T01:17:59.760844+0000","last_unstale":"2024-09-16T01:18:02.431235+0000","last_undegraded":"2024-09-16T01:18:02.431235+0000","last_fullsized":"2024-09-16T01:18:02.431235+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:48.925880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431181+0000","last_change":"2024-09-16T01:18:00.769141+0000","last_active":"2024-09-16T01:18:02.431181+0000","last_peered":"2024-09-16T01:18:02.431181+0000","last_clean":"2024-09-16T01:18:02.431181+0000","last_became_active":"2024-09-16T01:18:00.768884+0000","last_became_peered":"2024-09-16T01:18:00.768884+0000","last_unstale":"2024-09-16T01:18:02.431181+0000","last_undegraded":"2024-09-16T01:18:02.431181+0000","last_fullsized":"2024-09-16T01:18:02.431181+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:58.532226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431021+0000","last_change":"2024-09-16T01:17:59.759681+0000","last_active":"2024-09-16T01:18:02.431021+0000","last_peered":"2024-09-16T01:18:02.431021+0000","last_clean":"2024-09-16T01:18:02.431021+0000","last_became_active":"2024-09-16T01:17:59.759394+0000","last_became_peered":"2024-09-16T01:17:59.759394+0000","last_unstale":"2024-09-16T01:18:02.431021+0000","last_undegraded":"2024-09-16T01:18:02.431021+0000","last_fullsized":"2024-09-16T01:18:02.431021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:06.144671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431984+0000","last_change":"2024-09-16T01:18:00.779194+0000","last_active":"2024-09-16T01:18:02.431984+0000","last_peered":"2024-09-16T01:18:02.431984+0000","last_clean":"2024-09-16T01:18:02.431984+0000","last_became_active":"2024-09-16T01:18:00.778868+0000","last_became_peered":"2024-09-16T01:18:00.778868+0000","last_unstale":"2024-09-16T01:18:02.431984+0000","last_undegraded":"2024-09-16T01:18:02.431984+0000","last_fullsized":"2024-09-16T01:18:02.431984+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:58.532226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431109+0000","last_change":"2024-09-16T01:17:59.762664+0000","last_active":"2024-09-16T01:18:02.431109+0000","last_peered":"2024-09-16T01:18:02.431109+0000","last_clean":"2024-09-16T01:18:02.431109+0000","last_became_active":"2024-09-16T01:17:59.762395+0000","last_became_peered":"2024-09-16T01:17:59.762395+0000","last_unstale":"2024-09-16T01:18:02.431109+0000","last_undegraded":"2024-09-16T01:18:02.431109+0000","last_fullsized":"2024-09-16T01:18:02.431109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:18.840334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768641+0000","last_change":"2024-09-16T01:18:00.771019+0000","last_active":"2024-09-16T01:18:01.768641+0000","last_peered":"2024-09-16T01:18:01.768641+0000","last_clean":"2024-09-16T01:18:01.768641+0000","last_became_active":"2024-09-16T01:18:00.770724+0000","last_became_peered":"2024-09-16T01:18:00.770724+0000","last_unstale":"2024-09-16T01:18:01.768641+0000","last_undegraded":"2024-09-16T01:18:01.768641+0000","last_fullsized":"2024-09-16T01:18:01.768641+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:29.912155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430979+0000","last_change":"2024-09-16T01:17:59.761689+0000","last_active":"2024-09-16T01:18:02.430979+0000","last_peered":"2024-09-16T01:18:02.430979+0000","last_clean":"2024-09-16T01:18:02.430979+0000","last_became_active":"2024-09-16T01:17:59.761418+0000","last_became_peered":"2024-09-16T01:17:59.761418+0000","last_unstale":"2024-09-16T01:18:02.430979+0000","last_undegraded":"2024-09-16T01:18:02.430979+0000","last_fullsized":"2024-09-16T01:18:02.430979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:53.299221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766831+0000","last_change":"2024-09-16T01:18:00.776106+0000","last_active":"2024-09-16T01:18:01.766831+0000","last_peered":"2024-09-16T01:18:01.766831+0000","last_clean":"2024-09-16T01:18:01.766831+0000","last_became_active":"2024-09-16T01:18:00.775859+0000","last_became_peered":"2024-09-16T01:18:00.775859+0000","last_unstale":"2024-09-16T01:18:01.766831+0000","last_undegraded":"2024-09-16T01:18:01.766831+0000","last_fullsized":"2024-09-16T01:18:01.766831+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:22.517772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430862+0000","last_change":"2024-09-16T01:17:59.768407+0000","last_active":"2024-09-16T01:18:02.430862+0000","last_peered":"2024-09-16T01:18:02.430862+0000","last_clean":"2024-09-16T01:18:02.430862+0000","last_became_active":"2024-09-16T01:17:59.767916+0000","last_became_peered":"2024-09-16T01:17:59.767916+0000","last_unstale":"2024-09-16T01:18:02.430862+0000","last_undegraded":"2024-09-16T01:18:02.430862+0000","last_fullsized":"2024-09-16T01:18:02.430862+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:59.586198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765515+0000","last_change":"2024-09-16T01:18:00.771471+0000","last_active":"2024-09-16T01:18:01.765515+0000","last_peered":"2024-09-16T01:18:01.765515+0000","last_clean":"2024-09-16T01:18:01.765515+0000","last_became_active":"2024-09-16T01:18:00.771176+0000","last_became_peered":"2024-09-16T01:18:00.771176+0000","last_unstale":"2024-09-16T01:18:01.765515+0000","last_undegraded":"2024-09-16T01:18:01.765515+0000","last_fullsized":"2024-09-16T01:18:01.765515+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:06.499475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430625+0000","last_change":"2024-09-16T01:17:59.767229+0000","last_active":"2024-09-16T01:18:02.430625+0000","last_peered":"2024-09-16T01:18:02.430625+0000","last_clean":"2024-09-16T01:18:02.430625+0000","last_became_active":"2024-09-16T01:17:59.766939+0000","last_became_peered":"2024-09-16T01:17:59.766939+0000","last_unstale":"2024-09-16T01:18:02.430625+0000","last_undegraded":"2024-09-16T01:18:02.430625+0000","last_fullsized":"2024-09-16T01:18:02.430625+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:39.992236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430935+0000","last_change":"2024-09-16T01:18:00.769575+0000","last_active":"2024-09-16T01:18:02.430935+0000","last_peered":"2024-09-16T01:18:02.430935+0000","last_clean":"2024-09-16T01:18:02.430935+0000","last_became_active":"2024-09-16T01:18:00.769295+0000","last_became_peered":"2024-09-16T01:18:00.769295+0000","last_unstale":"2024-09-16T01:18:02.430935+0000","last_undegraded":"2024-09-16T01:18:02.430935+0000","last_fullsized":"2024-09-16T01:18:02.430935+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:39.237996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765015+0000","last_change":"2024-09-16T01:17:59.761807+0000","last_active":"2024-09-16T01:18:01.765015+0000","last_peered":"2024-09-16T01:18:01.765015+0000","last_clean":"2024-09-16T01:18:01.765015+0000","last_became_active":"2024-09-16T01:17:59.761310+0000","last_became_peered":"2024-09-16T01:17:59.761310+0000","last_unstale":"2024-09-16T01:18:01.765015+0000","last_undegraded":"2024-09-16T01:18:01.765015+0000","last_fullsized":"2024-09-16T01:18:01.765015+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:59.120260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766889+0000","last_change":"2024-09-16T01:18:00.773646+0000","last_active":"2024-09-16T01:18:01.766889+0000","last_peered":"2024-09-16T01:18:01.766889+0000","last_clean":"2024-09-16T01:18:01.766889+0000","last_became_active":"2024-09-16T01:18:00.773349+0000","last_became_peered":"2024-09-16T01:18:00.773349+0000","last_unstale":"2024-09-16T01:18:01.766889+0000","last_undegraded":"2024-09-16T01:18:01.766889+0000","last_fullsized":"2024-09-16T01:18:01.766889+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:34.926682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432333+0000","last_change":"2024-09-16T01:17:59.768831+0000","last_active":"2024-09-16T01:18:02.432333+0000","last_peered":"2024-09-16T01:18:02.432333+0000","last_clean":"2024-09-16T01:18:02.432333+0000","last_became_active":"2024-09-16T01:17:59.768392+0000","last_became_peered":"2024-09-16T01:17:59.768392+0000","last_unstale":"2024-09-16T01:18:02.432333+0000","last_undegraded":"2024-09-16T01:18:02.432333+0000","last_fullsized":"2024-09-16T01:18:02.432333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:26.127275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430659+0000","last_change":"2024-09-16T01:18:00.764032+0000","last_active":"2024-09-16T01:18:02.430659+0000","last_peered":"2024-09-16T01:18:02.430659+0000","last_clean":"2024-09-16T01:18:02.430659+0000","last_became_active":"2024-09-16T01:18:00.763749+0000","last_became_peered":"2024-09-16T01:18:00.763749+0000","last_unstale":"2024-09-16T01:18:02.430659+0000","last_undegraded":"2024-09-16T01:18:02.430659+0000","last_fullsized":"2024-09-16T01:18:02.430659+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.731594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432208+0000","last_change":"2024-09-16T01:17:59.762688+0000","last_active":"2024-09-16T01:18:02.432208+0000","last_peered":"2024-09-16T01:18:02.432208+0000","last_clean":"2024-09-16T01:18:02.432208+0000","last_became_active":"2024-09-16T01:17:59.762289+0000","last_became_peered":"2024-09-16T01:17:59.762289+0000","last_unstale":"2024-09-16T01:18:02.432208+0000","last_undegraded":"2024-09-16T01:18:02.432208+0000","last_fullsized":"2024-09-16T01:18:02.432208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:10.954838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766279+0000","last_change":"2024-09-16T01:18:00.770237+0000","last_active":"2024-09-16T01:18:01.766279+0000","last_peered":"2024-09-16T01:18:01.766279+0000","last_clean":"2024-09-16T01:18:01.766279+0000","last_became_active":"2024-09-16T01:18:00.769944+0000","last_became_peered":"2024-09-16T01:18:00.769944+0000","last_unstale":"2024-09-16T01:18:01.766279+0000","last_undegraded":"2024-09-16T01:18:01.766279+0000","last_fullsized":"2024-09-16T01:18:01.766279+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:10.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"62'3","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432127+0000","last_change":"2024-09-16T01:17:59.768974+0000","last_active":"2024-09-16T01:18:02.432127+0000","last_peered":"2024-09-16T01:18:02.432127+0000","last_clean":"2024-09-16T01:18:02.432127+0000","last_became_active":"2024-09-16T01:17:59.768504+0000","last_became_peered":"2024-09-16T01:17:59.768504+0000","last_unstale":"2024-09-16T01:18:02.432127+0000","last_undegraded":"2024-09-16T01:18:02.432127+0000","last_fullsized":"2024-09-16T01:18:02.432127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:21.513379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432475+0000","last_change":"2024-09-16T01:18:00.769802+0000","last_active":"2024-09-16T01:18:02.432475+0000","last_peered":"2024-09-16T01:18:02.432475+0000","last_clean":"2024-09-16T01:18:02.432475+0000","last_became_active":"2024-09-16T01:18:00.769545+0000","last_became_peered":"2024-09-16T01:18:00.769545+0000","last_unstale":"2024-09-16T01:18:02.432475+0000","last_undegraded":"2024-09-16T01:18:02.432475+0000","last_fullsized":"2024-09-16T01:18:02.432475+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:41.677946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"62'6","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766943+0000","last_change":"2024-09-16T01:17:59.764295+0000","last_active":"2024-09-16T01:18:01.766943+0000","last_peered":"2024-09-16T01:18:01.766943+0000","last_clean":"2024-09-16T01:18:01.766943+0000","last_became_active":"2024-09-16T01:17:59.764020+0000","last_became_peered":"2024-09-16T01:17:59.764020+0000","last_unstale":"2024-09-16T01:18:01.766943+0000","last_undegraded":"2024-09-16T01:18:01.766943+0000","last_fullsized":"2024-09-16T01:18:01.766943+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:13:07.173826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431367+0000","last_change":"2024-09-16T01:18:00.780974+0000","last_active":"2024-09-16T01:18:02.431367+0000","last_peered":"2024-09-16T01:18:02.431367+0000","last_clean":"2024-09-16T01:18:02.431367+0000","last_became_active":"2024-09-16T01:18:00.780697+0000","last_became_peered":"2024-09-16T01:18:00.780697+0000","last_unstale":"2024-09-16T01:18:02.431367+0000","last_undegraded":"2024-09-16T01:18:02.431367+0000","last_fullsized":"2024-09-16T01:18:02.431367+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:04.111656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431470+0000","last_change":"2024-09-16T01:17:59.764249+0000","last_active":"2024-09-16T01:18:02.431470+0000","last_peered":"2024-09-16T01:18:02.431470+0000","last_clean":"2024-09-16T01:18:02.431470+0000","last_became_active":"2024-09-16T01:17:59.763899+0000","last_became_peered":"2024-09-16T01:17:59.763899+0000","last_unstale":"2024-09-16T01:18:02.431470+0000","last_undegraded":"2024-09-16T01:18:02.431470+0000","last_fullsized":"2024-09-16T01:18:02.431470+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:02.181790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765427+0000","last_change":"2024-09-16T01:18:00.768933+0000","last_active":"2024-09-16T01:18:01.765427+0000","last_peered":"2024-09-16T01:18:01.765427+0000","last_clean":"2024-09-16T01:18:01.765427+0000","last_became_active":"2024-09-16T01:18:00.768676+0000","last_became_peered":"2024-09-16T01:18:00.768676+0000","last_unstale":"2024-09-16T01:18:01.765427+0000","last_undegraded":"2024-09-16T01:18:01.765427+0000","last_fullsized":"2024-09-16T01:18:01.765427+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:00.590591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766139+0000","last_change":"2024-09-16T01:17:59.759538+0000","last_active":"2024-09-16T01:18:01.766139+0000","last_peered":"2024-09-16T01:18:01.766139+0000","last_clean":"2024-09-16T01:18:01.766139+0000","last_became_active":"2024-09-16T01:17:59.759281+0000","last_became_peered":"2024-09-16T01:17:59.759281+0000","last_unstale":"2024-09-16T01:18:01.766139+0000","last_undegraded":"2024-09-16T01:18:01.766139+0000","last_fullsized":"2024-09-16T01:18:01.766139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:05.495082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765570+0000","last_change":"2024-09-16T01:18:00.769922+0000","last_active":"2024-09-16T01:18:01.765570+0000","last_peered":"2024-09-16T01:18:01.765570+0000","last_clean":"2024-09-16T01:18:01.765570+0000","last_became_active":"2024-09-16T01:18:00.769654+0000","last_became_peered":"2024-09-16T01:18:00.769654+0000","last_unstale":"2024-09-16T01:18:01.765570+0000","last_undegraded":"2024-09-16T01:18:01.765570+0000","last_fullsized":"2024-09-16T01:18:01.765570+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:42.535136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432272+0000","last_change":"2024-09-16T01:17:59.769520+0000","last_active":"2024-09-16T01:18:02.432272+0000","last_peered":"2024-09-16T01:18:02.432272+0000","last_clean":"2024-09-16T01:18:02.432272+0000","last_became_active":"2024-09-16T01:17:59.769233+0000","last_became_peered":"2024-09-16T01:17:59.769233+0000","last_unstale":"2024-09-16T01:18:02.432272+0000","last_undegraded":"2024-09-16T01:18:02.432272+0000","last_fullsized":"2024-09-16T01:18:02.432272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:45.021858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766714+0000","last_change":"2024-09-16T01:18:00.781036+0000","last_active":"2024-09-16T01:18:01.766714+0000","last_peered":"2024-09-16T01:18:01.766714+0000","last_clean":"2024-09-16T01:18:01.766714+0000","last_became_active":"2024-09-16T01:18:00.780762+0000","last_became_peered":"2024-09-16T01:18:00.780762+0000","last_unstale":"2024-09-16T01:18:01.766714+0000","last_undegraded":"2024-09-16T01:18:01.766714+0000","last_fullsized":"2024-09-16T01:18:01.766714+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:10.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"62'8","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431472+0000","last_change":"2024-09-16T01:17:59.764372+0000","last_active":"2024-09-16T01:18:02.431472+0000","last_peered":"2024-09-16T01:18:02.431472+0000","last_clean":"2024-09-16T01:18:02.431472+0000","last_became_active":"2024-09-16T01:17:59.764087+0000","last_became_peered":"2024-09-16T01:17:59.764087+0000","last_unstale":"2024-09-16T01:18:02.431472+0000","last_undegraded":"2024-09-16T01:18:02.431472+0000","last_fullsized":"2024-09-16T01:18:02.431472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:02.932709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431876+0000","last_change":"2024-09-16T01:18:00.779173+0000","last_active":"2024-09-16T01:18:02.431876+0000","last_peered":"2024-09-16T01:18:02.431876+0000","last_clean":"2024-09-16T01:18:02.431876+0000","last_became_active":"2024-09-16T01:18:00.778853+0000","last_became_peered":"2024-09-16T01:18:00.778853+0000","last_unstale":"2024-09-16T01:18:02.431876+0000","last_undegraded":"2024-09-16T01:18:02.431876+0000","last_fullsized":"2024-09-16T01:18:02.431876+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:30.611051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765299+0000","last_change":"2024-09-16T01:17:59.762903+0000","last_active":"2024-09-16T01:18:01.765299+0000","last_peered":"2024-09-16T01:18:01.765299+0000","last_clean":"2024-09-16T01:18:01.765299+0000","last_became_active":"2024-09-16T01:17:59.762607+0000","last_became_peered":"2024-09-16T01:17:59.762607+0000","last_unstale":"2024-09-16T01:18:01.765299+0000","last_undegraded":"2024-09-16T01:18:01.765299+0000","last_fullsized":"2024-09-16T01:18:01.765299+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:41.530743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766036+0000","last_change":"2024-09-16T01:18:00.767674+0000","last_active":"2024-09-16T01:18:01.766036+0000","last_peered":"2024-09-16T01:18:01.766036+0000","last_clean":"2024-09-16T01:18:01.766036+0000","last_became_active":"2024-09-16T01:18:00.767402+0000","last_became_peered":"2024-09-16T01:18:00.767402+0000","last_unstale":"2024-09-16T01:18:01.766036+0000","last_undegraded":"2024-09-16T01:18:01.766036+0000","last_fullsized":"2024-09-16T01:18:01.766036+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:41.827484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431834+0000","last_change":"2024-09-16T01:17:59.769604+0000","last_active":"2024-09-16T01:18:02.431834+0000","last_peered":"2024-09-16T01:18:02.431834+0000","last_clean":"2024-09-16T01:18:02.431834+0000","last_became_active":"2024-09-16T01:17:59.769350+0000","last_became_peered":"2024-09-16T01:17:59.769350+0000","last_unstale":"2024-09-16T01:18:02.431834+0000","last_undegraded":"2024-09-16T01:18:02.431834+0000","last_fullsized":"2024-09-16T01:18:02.431834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:11.740746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432202+0000","last_change":"2024-09-16T01:18:00.771131+0000","last_active":"2024-09-16T01:18:02.432202+0000","last_peered":"2024-09-16T01:18:02.432202+0000","last_clean":"2024-09-16T01:18:02.432202+0000","last_became_active":"2024-09-16T01:18:00.770877+0000","last_became_peered":"2024-09-16T01:18:00.770877+0000","last_unstale":"2024-09-16T01:18:02.432202+0000","last_undegraded":"2024-09-16T01:18:02.432202+0000","last_fullsized":"2024-09-16T01:18:02.432202+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:27.298852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432054+0000","last_change":"2024-09-16T01:17:59.769174+0000","last_active":"2024-09-16T01:18:02.432054+0000","last_peered":"2024-09-16T01:18:02.432054+0000","last_clean":"2024-09-16T01:18:02.432054+0000","last_became_active":"2024-09-16T01:17:59.768842+0000","last_became_peered":"2024-09-16T01:17:59.768842+0000","last_unstale":"2024-09-16T01:18:02.432054+0000","last_undegraded":"2024-09-16T01:18:02.432054+0000","last_fullsized":"2024-09-16T01:18:02.432054+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:33.922289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765182+0000","last_change":"2024-09-16T01:18:00.771305+0000","last_active":"2024-09-16T01:18:01.765182+0000","last_peered":"2024-09-16T01:18:01.765182+0000","last_clean":"2024-09-16T01:18:01.765182+0000","last_became_active":"2024-09-16T01:18:00.770973+0000","last_became_peered":"2024-09-16T01:18:00.770973+0000","last_unstale":"2024-09-16T01:18:01.765182+0000","last_undegraded":"2024-09-16T01:18:01.765182+0000","last_fullsized":"2024-09-16T01:18:01.765182+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:13:08.178218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431118+0000","last_change":"2024-09-16T01:17:59.768326+0000","last_active":"2024-09-16T01:18:02.431118+0000","last_peered":"2024-09-16T01:18:02.431118+0000","last_clean":"2024-09-16T01:18:02.431118+0000","last_became_active":"2024-09-16T01:17:59.768069+0000","last_became_peered":"2024-09-16T01:17:59.768069+0000","last_unstale":"2024-09-16T01:18:02.431118+0000","last_undegraded":"2024-09-16T01:18:02.431118+0000","last_fullsized":"2024-09-16T01:18:02.431118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:18.840334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430623+0000","last_change":"2024-09-16T01:18:00.769236+0000","last_active":"2024-09-16T01:18:02.430623+0000","last_peered":"2024-09-16T01:18:02.430623+0000","last_clean":"2024-09-16T01:18:02.430623+0000","last_became_active":"2024-09-16T01:18:00.768569+0000","last_became_peered":"2024-09-16T01:18:00.768569+0000","last_unstale":"2024-09-16T01:18:02.430623+0000","last_undegraded":"2024-09-16T01:18:02.430623+0000","last_fullsized":"2024-09-16T01:18:02.430623+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:30.611051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430681+0000","last_change":"2024-09-16T01:17:59.754405+0000","last_active":"2024-09-16T01:18:02.430681+0000","last_peered":"2024-09-16T01:18:02.430681+0000","last_clean":"2024-09-16T01:18:02.430681+0000","last_became_active":"2024-09-16T01:17:59.754132+0000","last_became_peered":"2024-09-16T01:17:59.754132+0000","last_unstale":"2024-09-16T01:18:02.430681+0000","last_undegraded":"2024-09-16T01:18:02.430681+0000","last_fullsized":"2024-09-16T01:18:02.430681+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:02.181790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765579+0000","last_change":"2024-09-16T01:18:00.763204+0000","last_active":"2024-09-16T01:18:01.765579+0000","last_peered":"2024-09-16T01:18:01.765579+0000","last_clean":"2024-09-16T01:18:01.765579+0000","last_became_active":"2024-09-16T01:18:00.762903+0000","last_became_peered":"2024-09-16T01:18:00.762903+0000","last_unstale":"2024-09-16T01:18:01.765579+0000","last_undegraded":"2024-09-16T01:18:01.765579+0000","last_fullsized":"2024-09-16T01:18:01.765579+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:49.930273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766211+0000","last_change":"2024-09-16T01:17:59.762804+0000","last_active":"2024-09-16T01:18:01.766211+0000","last_peered":"2024-09-16T01:18:01.766211+0000","last_clean":"2024-09-16T01:18:01.766211+0000","last_became_active":"2024-09-16T01:17:59.762528+0000","last_became_peered":"2024-09-16T01:17:59.762528+0000","last_unstale":"2024-09-16T01:18:01.766211+0000","last_undegraded":"2024-09-16T01:18:01.766211+0000","last_fullsized":"2024-09-16T01:18:01.766211+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:23.676582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765701+0000","last_change":"2024-09-16T01:18:00.774203+0000","last_active":"2024-09-16T01:18:01.765701+0000","last_peered":"2024-09-16T01:18:01.765701+0000","last_clean":"2024-09-16T01:18:01.765701+0000","last_became_active":"2024-09-16T01:18:00.773843+0000","last_became_peered":"2024-09-16T01:18:00.773843+0000","last_unstale":"2024-09-16T01:18:01.765701+0000","last_undegraded":"2024-09-16T01:18:01.765701+0000","last_fullsized":"2024-09-16T01:18:01.765701+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:22.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430844+0000","last_change":"2024-09-16T01:17:59.761819+0000","last_active":"2024-09-16T01:18:02.430844+0000","last_peered":"2024-09-16T01:18:02.430844+0000","last_clean":"2024-09-16T01:18:02.430844+0000","last_became_active":"2024-09-16T01:17:59.760803+0000","last_became_peered":"2024-09-16T01:17:59.760803+0000","last_unstale":"2024-09-16T01:18:02.430844+0000","last_undegraded":"2024-09-16T01:18:02.430844+0000","last_fullsized":"2024-09-16T01:18:02.430844+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:59.586198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430744+0000","last_change":"2024-09-16T01:18:00.776578+0000","last_active":"2024-09-16T01:18:02.430744+0000","last_peered":"2024-09-16T01:18:02.430744+0000","last_clean":"2024-09-16T01:18:02.430744+0000","last_became_active":"2024-09-16T01:18:00.776270+0000","last_became_peered":"2024-09-16T01:18:00.776270+0000","last_unstale":"2024-09-16T01:18:02.430744+0000","last_undegraded":"2024-09-16T01:18:02.430744+0000","last_fullsized":"2024-09-16T01:18:02.430744+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:14.295316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765500+0000","last_change":"2024-09-16T01:17:59.762059+0000","last_active":"2024-09-16T01:18:01.765500+0000","last_peered":"2024-09-16T01:18:01.765500+0000","last_clean":"2024-09-16T01:18:01.765500+0000","last_became_active":"2024-09-16T01:17:59.761769+0000","last_became_peered":"2024-09-16T01:17:59.761769+0000","last_unstale":"2024-09-16T01:18:01.765500+0000","last_undegraded":"2024-09-16T01:18:01.765500+0000","last_fullsized":"2024-09-16T01:18:01.765500+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:21.040913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768714+0000","last_change":"2024-09-16T01:18:00.773857+0000","last_active":"2024-09-16T01:18:01.768714+0000","last_peered":"2024-09-16T01:18:01.768714+0000","last_clean":"2024-09-16T01:18:01.768714+0000","last_became_active":"2024-09-16T01:18:00.773604+0000","last_became_peered":"2024-09-16T01:18:00.773604+0000","last_unstale":"2024-09-16T01:18:01.768714+0000","last_undegraded":"2024-09-16T01:18:01.768714+0000","last_fullsized":"2024-09-16T01:18:01.768714+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:38.176330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"63'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.771229+0000","last_change":"2024-09-16T01:17:59.758587+0000","last_active":"2024-09-16T01:18:01.771229+0000","last_peered":"2024-09-16T01:18:01.771229+0000","last_clean":"2024-09-16T01:18:01.771229+0000","last_became_active":"2024-09-16T01:17:59.758329+0000","last_became_peered":"2024-09-16T01:17:59.758329+0000","last_unstale":"2024-09-16T01:18:01.771229+0000","last_undegraded":"2024-09-16T01:18:01.771229+0000","last_fullsized":"2024-09-16T01:18:01.771229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.128269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766206+0000","last_change":"2024-09-16T01:18:00.771635+0000","last_active":"2024-09-16T01:18:01.766206+0000","last_peered":"2024-09-16T01:18:01.766206+0000","last_clean":"2024-09-16T01:18:01.766206+0000","last_became_active":"2024-09-16T01:18:00.771082+0000","last_became_peered":"2024-09-16T01:18:00.771082+0000","last_unstale":"2024-09-16T01:18:01.766206+0000","last_undegraded":"2024-09-16T01:18:01.766206+0000","last_fullsized":"2024-09-16T01:18:01.766206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:17.231425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431079+0000","last_change":"2024-09-16T01:17:59.758251+0000","last_active":"2024-09-16T01:18:02.431079+0000","last_peered":"2024-09-16T01:18:02.431079+0000","last_clean":"2024-09-16T01:18:02.431079+0000","last_became_active":"2024-09-16T01:17:59.757958+0000","last_became_peered":"2024-09-16T01:17:59.757958+0000","last_unstale":"2024-09-16T01:18:02.431079+0000","last_undegraded":"2024-09-16T01:18:02.431079+0000","last_fullsized":"2024-09-16T01:18:02.431079+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:39.992236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765339+0000","last_change":"2024-09-16T01:18:00.764292+0000","last_active":"2024-09-16T01:18:01.765339+0000","last_peered":"2024-09-16T01:18:01.765339+0000","last_clean":"2024-09-16T01:18:01.765339+0000","last_became_active":"2024-09-16T01:18:00.763878+0000","last_became_peered":"2024-09-16T01:18:00.763878+0000","last_unstale":"2024-09-16T01:18:01.765339+0000","last_undegraded":"2024-09-16T01:18:01.765339+0000","last_fullsized":"2024-09-16T01:18:01.765339+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:41.677946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766968+0000","last_change":"2024-09-16T01:17:59.764272+0000","last_active":"2024-09-16T01:18:01.766968+0000","last_peered":"2024-09-16T01:18:01.766968+0000","last_clean":"2024-09-16T01:18:01.766968+0000","last_became_active":"2024-09-16T01:17:59.763997+0000","last_became_peered":"2024-09-16T01:17:59.763997+0000","last_unstale":"2024-09-16T01:18:01.766968+0000","last_undegraded":"2024-09-16T01:18:01.766968+0000","last_fullsized":"2024-09-16T01:18:01.766968+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:27.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765371+0000","last_change":"2024-09-16T01:18:00.769583+0000","last_active":"2024-09-16T01:18:01.765371+0000","last_peered":"2024-09-16T01:18:01.765371+0000","last_clean":"2024-09-16T01:18:01.765371+0000","last_became_active":"2024-09-16T01:18:00.769281+0000","last_became_peered":"2024-09-16T01:18:00.769281+0000","last_unstale":"2024-09-16T01:18:01.765371+0000","last_undegraded":"2024-09-16T01:18:01.765371+0000","last_fullsized":"2024-09-16T01:18:01.765371+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:27.659510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431724+0000","last_change":"2024-09-16T01:17:59.769374+0000","last_active":"2024-09-16T01:18:02.431724+0000","last_peered":"2024-09-16T01:18:02.431724+0000","last_clean":"2024-09-16T01:18:02.431724+0000","last_became_active":"2024-09-16T01:17:59.768993+0000","last_became_peered":"2024-09-16T01:17:59.768993+0000","last_unstale":"2024-09-16T01:18:02.431724+0000","last_undegraded":"2024-09-16T01:18:02.431724+0000","last_fullsized":"2024-09-16T01:18:02.431724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:34.308627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431499+0000","last_change":"2024-09-16T01:18:00.782727+0000","last_active":"2024-09-16T01:18:02.431499+0000","last_peered":"2024-09-16T01:18:02.431499+0000","last_clean":"2024-09-16T01:18:02.431499+0000","last_became_active":"2024-09-16T01:18:00.782357+0000","last_became_peered":"2024-09-16T01:18:00.782357+0000","last_unstale":"2024-09-16T01:18:02.431499+0000","last_undegraded":"2024-09-16T01:18:02.431499+0000","last_fullsized":"2024-09-16T01:18:02.431499+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:52.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430945+0000","last_change":"2024-09-16T01:17:59.768188+0000","last_active":"2024-09-16T01:18:02.430945+0000","last_peered":"2024-09-16T01:18:02.430945+0000","last_clean":"2024-09-16T01:18:02.430945+0000","last_became_active":"2024-09-16T01:17:59.767643+0000","last_became_peered":"2024-09-16T01:17:59.767643+0000","last_unstale":"2024-09-16T01:18:02.430945+0000","last_undegraded":"2024-09-16T01:18:02.430945+0000","last_fullsized":"2024-09-16T01:18:02.430945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.375347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766669+0000","last_change":"2024-09-16T01:18:00.776734+0000","last_active":"2024-09-16T01:18:01.766669+0000","last_peered":"2024-09-16T01:18:01.766669+0000","last_clean":"2024-09-16T01:18:01.766669+0000","last_became_active":"2024-09-16T01:18:00.776482+0000","last_became_peered":"2024-09-16T01:18:00.776482+0000","last_unstale":"2024-09-16T01:18:01.766669+0000","last_undegraded":"2024-09-16T01:18:01.766669+0000","last_fullsized":"2024-09-16T01:18:01.766669+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:41.827484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430728+0000","last_change":"2024-09-16T01:17:59.767422+0000","last_active":"2024-09-16T01:18:02.430728+0000","last_peered":"2024-09-16T01:18:02.430728+0000","last_clean":"2024-09-16T01:18:02.430728+0000","last_became_active":"2024-09-16T01:17:59.767175+0000","last_became_peered":"2024-09-16T01:17:59.767175+0000","last_unstale":"2024-09-16T01:18:02.430728+0000","last_undegraded":"2024-09-16T01:18:02.430728+0000","last_fullsized":"2024-09-16T01:18:02.430728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:48.925880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768651+0000","last_change":"2024-09-16T01:18:00.768859+0000","last_active":"2024-09-16T01:18:01.768651+0000","last_peered":"2024-09-16T01:18:01.768651+0000","last_clean":"2024-09-16T01:18:01.768651+0000","last_became_active":"2024-09-16T01:18:00.768589+0000","last_became_peered":"2024-09-16T01:18:00.768589+0000","last_unstale":"2024-09-16T01:18:01.768651+0000","last_undegraded":"2024-09-16T01:18:01.768651+0000","last_fullsized":"2024-09-16T01:18:01.768651+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:15.386791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766548+0000","last_change":"2024-09-16T01:17:59.762058+0000","last_active":"2024-09-16T01:18:01.766548+0000","last_peered":"2024-09-16T01:18:01.766548+0000","last_clean":"2024-09-16T01:18:01.766548+0000","last_became_active":"2024-09-16T01:17:59.761546+0000","last_became_peered":"2024-09-16T01:17:59.761546+0000","last_unstale":"2024-09-16T01:18:01.766548+0000","last_undegraded":"2024-09-16T01:18:01.766548+0000","last_fullsized":"2024-09-16T01:18:01.766548+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:49.510785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765552+0000","last_change":"2024-09-16T01:18:00.774829+0000","last_active":"2024-09-16T01:18:01.765552+0000","last_peered":"2024-09-16T01:18:01.765552+0000","last_clean":"2024-09-16T01:18:01.765552+0000","last_became_active":"2024-09-16T01:18:00.774189+0000","last_became_peered":"2024-09-16T01:18:00.774189+0000","last_unstale":"2024-09-16T01:18:01.765552+0000","last_undegraded":"2024-09-16T01:18:01.765552+0000","last_fullsized":"2024-09-16T01:18:01.765552+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:20.132662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430495+0000","last_change":"2024-09-16T01:17:59.767019+0000","last_active":"2024-09-16T01:18:02.430495+0000","last_peered":"2024-09-16T01:18:02.430495+0000","last_clean":"2024-09-16T01:18:02.430495+0000","last_became_active":"2024-09-16T01:17:59.766757+0000","last_became_peered":"2024-09-16T01:17:59.766757+0000","last_unstale":"2024-09-16T01:18:02.430495+0000","last_undegraded":"2024-09-16T01:18:02.430495+0000","last_fullsized":"2024-09-16T01:18:02.430495+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:06.144671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":249,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432054+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:18:02.432054+0000","last_peered":"2024-09-16T01:18:02.432054+0000","last_clean":"2024-09-16T01:18:02.432054+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:18:02.432054+0000","last_undegraded":"2024-09-16T01:18:02.432054+0000","last_fullsized":"2024-09-16T01:18:02.432054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1372160,"data_stored":933564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":765952,"data_stored":342454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":765952,"data_stored":342442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":344032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":749568,"data_stored":335728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":761856,"data_stored":342420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":790528,"data_stored":344796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1355776,"data_stored":932788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:18:08.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:18:08.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.237+0000 7f8112931640 1 Processor -- start 2024-09-16T01:18:08.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.237+0000 7f8112931640 1 -- start start 2024-09-16T01:18:08.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.237+0000 7f8112931640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f810c161c80 0x7f810c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.237+0000 7f8112931640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f810c162060 0x7f810c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.237+0000 7f8112931640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f810c0b64b0 0x7f810c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.237+0000 7f8112931640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f810c06e870 con 0x7f810c0b64b0 2024-09-16T01:18:08.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.237+0000 7f8112931640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f810c06d9f0 con 0x7f810c162060 2024-09-16T01:18:08.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.238+0000 7f8112931640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f810c06dcd0 con 0x7f810c161c80 2024-09-16T01:18:08.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.238+0000 7f8110ece640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f810c0b64b0 0x7f810c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.238+0000 7f8110ece640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f810c0b64b0 0x7f810c0b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50338/0 (socket says 172.21.15.81:50338) 2024-09-16T01:18:08.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.238+0000 7f8110ece640 1 -- 172.21.15.81:0/2128751468 learned_addr learned my addr 172.21.15.81:0/2128751468 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.238+0000 7f810b7fe640 1 --2- 172.21.15.81:0/2128751468 >> v2:172.21.15.102:3300/0 conn(0x7f810c162060 0x7f810c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.238+0000 7f810bfff640 1 --2- 172.21.15.81:0/2128751468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f810c161c80 0x7f810c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.238+0000 7f8110ece640 1 -- 172.21.15.81:0/2128751468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f810c161c80 msgr2=0x7f810c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.238+0000 7f8110ece640 1 --2- 172.21.15.81:0/2128751468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f810c161c80 0x7f810c06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.238+0000 7f8110ece640 1 -- 172.21.15.81:0/2128751468 >> v2:172.21.15.102:3300/0 conn(0x7f810c162060 msgr2=0x7f810c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.238+0000 7f8110ece640 1 --2- 172.21.15.81:0/2128751468 >> v2:172.21.15.102:3300/0 conn(0x7f810c162060 0x7f810c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.238+0000 7f8110ece640 1 -- 172.21.15.81:0/2128751468 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c06dfb0 con 0x7f810c0b64b0 2024-09-16T01:18:08.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f8110ece640 1 --2- 172.21.15.81:0/2128751468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f810c0b64b0 0x7f810c0b6960 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f810c0d0cb0 tx=0x7f810402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8875e367c59d950 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:08.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f810affd640 1 -- 172.21.15.81:0/2128751468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104036070 con 0x7f810c0b64b0 2024-09-16T01:18:08.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f810affd640 1 -- 172.21.15.81:0/2128751468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8104031600 con 0x7f810c0b64b0 2024-09-16T01:18:08.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f810affd640 1 -- 172.21.15.81:0/2128751468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81040319d0 con 0x7f810c0b64b0 2024-09-16T01:18:08.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f8112931640 1 -- 172.21.15.81:0/2128751468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f810c0b64b0 msgr2=0x7f810c0b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f8112931640 1 --2- 172.21.15.81:0/2128751468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f810c0b64b0 0x7f810c0b6960 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f810c0d0cb0 tx=0x7f810402a6a0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f8112931640 1 -- 172.21.15.81:0/2128751468 shutdown_connections 2024-09-16T01:18:08.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f8112931640 1 --2- 172.21.15.81:0/2128751468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f810c0b64b0 0x7f810c0b6960 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f8112931640 1 --2- 172.21.15.81:0/2128751468 >> v2:172.21.15.102:3300/0 conn(0x7f810c162060 0x7f810c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f8112931640 1 --2- 172.21.15.81:0/2128751468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f810c161c80 0x7f810c06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f8112931640 1 -- 172.21.15.81:0/2128751468 >> 172.21.15.81:0/2128751468 conn(0x7f810c0d44f0 msgr2=0x7f810c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f8112931640 1 -- 172.21.15.81:0/2128751468 shutdown_connections 2024-09-16T01:18:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.239+0000 7f8112931640 1 -- 172.21.15.81:0/2128751468 wait complete. 2024-09-16T01:18:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.241+0000 7f8112931640 1 Processor -- start 2024-09-16T01:18:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.241+0000 7f8112931640 1 -- start start 2024-09-16T01:18:08.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f8112931640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f810c0b64b0 0x7f810c155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f8112931640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f810c161c80 0x7f810c0b98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f8112931640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f810c162060 0x7f810c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f8112931640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f810c162500 con 0x7f810c0b64b0 2024-09-16T01:18:08.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f8112931640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f810c0d2aa0 con 0x7f810c162060 2024-09-16T01:18:08.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f8112931640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f810c162680 con 0x7f810c161c80 2024-09-16T01:18:08.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f810bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f810c0b64b0 0x7f810c155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f810bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f810c0b64b0 0x7f810c155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50354/0 (socket says 172.21.15.81:50354) 2024-09-16T01:18:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f810bfff640 1 -- 172.21.15.81:0/1158849661 learned_addr learned my addr 172.21.15.81:0/1158849661 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f810bfff640 1 -- 172.21.15.81:0/1158849661 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f810c161c80 msgr2=0x7f810c0b98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f810b7fe640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f810c161c80 0x7f810c0b98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f810bfff640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f810c161c80 0x7f810c0b98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f8110ece640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f810c162060 0x7f810c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f810bfff640 1 -- 172.21.15.81:0/1158849661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f810c162060 msgr2=0x7f810c15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f810bfff640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f810c162060 0x7f810c15eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f810bfff640 1 -- 172.21.15.81:0/1158849661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f810c0c8110 con 0x7f810c0b64b0 2024-09-16T01:18:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f810bfff640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f810c0b64b0 0x7f810c155bc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00d800 tx=0x7f80fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f8108ff9640 1 -- 172.21.15.81:0/1158849661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc018020 con 0x7f810c0b64b0 2024-09-16T01:18:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f8108ff9640 1 -- 172.21.15.81:0/1158849661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80fc0096a0 con 0x7f810c0b64b0 2024-09-16T01:18:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f8108ff9640 1 -- 172.21.15.81:0/1158849661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc009a70 con 0x7f810c0b64b0 2024-09-16T01:18:08.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.242+0000 7f8112931640 1 -- 172.21.15.81:0/1158849661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f810c0c83f0 con 0x7f810c0b64b0 2024-09-16T01:18:08.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.243+0000 7f8112931640 1 -- 172.21.15.81:0/1158849661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f810c156640 con 0x7f810c0b64b0 2024-09-16T01:18:08.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.243+0000 7f8112931640 1 -- 172.21.15.81:0/1158849661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f810c06e330 con 0x7f810c0b64b0 2024-09-16T01:18:08.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.244+0000 7f8108ff9640 1 -- 172.21.15.81:0/1158849661 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f80fc01b020 con 0x7f810c0b64b0 2024-09-16T01:18:08.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.244+0000 7f8108ff9640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f80f806c2b0 0x7f80f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.244+0000 7f8108ff9640 1 -- 172.21.15.81:0/1158849661 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f80fc08b7d0 con 0x7f810c0b64b0 2024-09-16T01:18:08.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.245+0000 7f810b7fe640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f80f806c2b0 0x7f80f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.245+0000 7f810b7fe640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f80f806c2b0 0x7f80f806e770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8100006fd0 tx=0x7f8100008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:08.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.249+0000 7f8108ff9640 1 -- 172.21.15.81:0/1158849661 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80fc022030 con 0x7f810c0b64b0 2024-09-16T01:18:08.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.411+0000 7f8112931640 1 -- 172.21.15.81:0/1158849661 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f810c0d22c0 con 0x7f80f806c2b0 2024-09-16T01:18:08.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.416+0000 7f8108ff9640 1 -- 172.21.15.81:0/1158849661 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252017 (secure 0 0 0) 0x7f810c0d22c0 con 0x7f80f806c2b0 2024-09-16T01:18:08.420 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:08.422 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:18:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.420+0000 7f8112931640 1 -- 172.21.15.81:0/1158849661 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f80f806c2b0 msgr2=0x7f80f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.420+0000 7f8112931640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f80f806c2b0 0x7f80f806e770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8100006fd0 tx=0x7f8100008040 comp rx=0 tx=0).stop 2024-09-16T01:18:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.420+0000 7f8112931640 1 -- 172.21.15.81:0/1158849661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f810c0b64b0 msgr2=0x7f810c155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.420+0000 7f8112931640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f810c0b64b0 0x7f810c155bc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00d800 tx=0x7f80fc00dcc0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.420+0000 7f8112931640 1 -- 172.21.15.81:0/1158849661 shutdown_connections 2024-09-16T01:18:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.420+0000 7f8112931640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f80f806c2b0 0x7f80f806e770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.420+0000 7f8112931640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f810c162060 0x7f810c15eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.420+0000 7f8112931640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f810c161c80 0x7f810c0b98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.420+0000 7f8112931640 1 --2- 172.21.15.81:0/1158849661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f810c0b64b0 0x7f810c155bc0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.420+0000 7f8112931640 1 -- 172.21.15.81:0/1158849661 >> 172.21.15.81:0/1158849661 conn(0x7f810c0d44f0 msgr2=0x7f810c0b4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.420+0000 7f8112931640 1 -- 172.21.15.81:0/1158849661 shutdown_connections 2024-09-16T01:18:08.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.420+0000 7f8112931640 1 -- 172.21.15.81:0/1158849661 wait complete. 2024-09-16T01:18:08.432 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-09-16T01:18:08.089725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231744,"kb_used_data":7164,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742976,"statfs":{"total":773094113280,"available":772856807424,"internally_reserved":0,"allocated":7335936,"data_stored":3918224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001617"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766987+0000","last_change":"2024-09-16T01:18:00.772675+0000","last_active":"2024-09-16T01:18:01.766987+0000","last_peered":"2024-09-16T01:18:01.766987+0000","last_clean":"2024-09-16T01:18:01.766987+0000","last_became_active":"2024-09-16T01:18:00.772389+0000","last_became_peered":"2024-09-16T01:18:00.772389+0000","last_unstale":"2024-09-16T01:18:01.766987+0000","last_undegraded":"2024-09-16T01:18:01.766987+0000","last_fullsized":"2024-09-16T01:18:01.766987+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:12.745139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766752+0000","last_change":"2024-09-16T01:18:00.774418+0000","last_active":"2024-09-16T01:18:01.766752+0000","last_peered":"2024-09-16T01:18:01.766752+0000","last_clean":"2024-09-16T01:18:01.766752+0000","last_became_active":"2024-09-16T01:18:00.774055+0000","last_became_peered":"2024-09-16T01:18:00.774055+0000","last_unstale":"2024-09-16T01:18:01.766752+0000","last_undegraded":"2024-09-16T01:18:01.766752+0000","last_fullsized":"2024-09-16T01:18:01.766752+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:49:24.220180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431928+0000","last_change":"2024-09-16T01:18:00.782057+0000","last_active":"2024-09-16T01:18:02.431928+0000","last_peered":"2024-09-16T01:18:02.431928+0000","last_clean":"2024-09-16T01:18:02.431928+0000","last_became_active":"2024-09-16T01:18:00.781774+0000","last_became_peered":"2024-09-16T01:18:00.781774+0000","last_unstale":"2024-09-16T01:18:02.431928+0000","last_undegraded":"2024-09-16T01:18:02.431928+0000","last_fullsized":"2024-09-16T01:18:02.431928+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.731594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432299+0000","last_change":"2024-09-16T01:18:00.773495+0000","last_active":"2024-09-16T01:18:02.432299+0000","last_peered":"2024-09-16T01:18:02.432299+0000","last_clean":"2024-09-16T01:18:02.432299+0000","last_became_active":"2024-09-16T01:18:00.772860+0000","last_became_peered":"2024-09-16T01:18:00.772860+0000","last_unstale":"2024-09-16T01:18:02.432299+0000","last_undegraded":"2024-09-16T01:18:02.432299+0000","last_fullsized":"2024-09-16T01:18:02.432299+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:13:08.178218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765384+0000","last_change":"2024-09-16T01:18:00.768714+0000","last_active":"2024-09-16T01:18:01.765384+0000","last_peered":"2024-09-16T01:18:01.765384+0000","last_clean":"2024-09-16T01:18:01.765384+0000","last_became_active":"2024-09-16T01:18:00.768439+0000","last_became_peered":"2024-09-16T01:18:00.768439+0000","last_unstale":"2024-09-16T01:18:01.765384+0000","last_undegraded":"2024-09-16T01:18:01.765384+0000","last_fullsized":"2024-09-16T01:18:01.765384+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:24.680975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431114+0000","last_change":"2024-09-16T01:18:00.779010+0000","last_active":"2024-09-16T01:18:02.431114+0000","last_peered":"2024-09-16T01:18:02.431114+0000","last_clean":"2024-09-16T01:18:02.431114+0000","last_became_active":"2024-09-16T01:18:00.778707+0000","last_became_peered":"2024-09-16T01:18:00.778707+0000","last_unstale":"2024-09-16T01:18:02.431114+0000","last_undegraded":"2024-09-16T01:18:02.431114+0000","last_fullsized":"2024-09-16T01:18:02.431114+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.731594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768523+0000","last_change":"2024-09-16T01:18:00.778542+0000","last_active":"2024-09-16T01:18:01.768523+0000","last_peered":"2024-09-16T01:18:01.768523+0000","last_clean":"2024-09-16T01:18:01.768523+0000","last_became_active":"2024-09-16T01:18:00.778259+0000","last_became_peered":"2024-09-16T01:18:00.778259+0000","last_unstale":"2024-09-16T01:18:01.768523+0000","last_undegraded":"2024-09-16T01:18:01.768523+0000","last_fullsized":"2024-09-16T01:18:01.768523+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:23.740614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765240+0000","last_change":"2024-09-16T01:18:00.779514+0000","last_active":"2024-09-16T01:18:01.765240+0000","last_peered":"2024-09-16T01:18:01.765240+0000","last_clean":"2024-09-16T01:18:01.765240+0000","last_became_active":"2024-09-16T01:18:00.779186+0000","last_became_peered":"2024-09-16T01:18:00.779186+0000","last_unstale":"2024-09-16T01:18:01.765240+0000","last_undegraded":"2024-09-16T01:18:01.765240+0000","last_fullsized":"2024-09-16T01:18:01.765240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:40.996629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432055+0000","last_change":"2024-09-16T01:18:00.779702+0000","last_active":"2024-09-16T01:18:02.432055+0000","last_peered":"2024-09-16T01:18:02.432055+0000","last_clean":"2024-09-16T01:18:02.432055+0000","last_became_active":"2024-09-16T01:18:00.779224+0000","last_became_peered":"2024-09-16T01:18:00.779224+0000","last_unstale":"2024-09-16T01:18:02.432055+0000","last_undegraded":"2024-09-16T01:18:02.432055+0000","last_fullsized":"2024-09-16T01:18:02.432055+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:39.237996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431884+0000","last_change":"2024-09-16T01:18:00.781011+0000","last_active":"2024-09-16T01:18:02.431884+0000","last_peered":"2024-09-16T01:18:02.431884+0000","last_clean":"2024-09-16T01:18:02.431884+0000","last_became_active":"2024-09-16T01:18:00.779837+0000","last_became_peered":"2024-09-16T01:18:00.779837+0000","last_unstale":"2024-09-16T01:18:02.431884+0000","last_undegraded":"2024-09-16T01:18:02.431884+0000","last_fullsized":"2024-09-16T01:18:02.431884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:14.295316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432370+0000","last_change":"2024-09-16T01:18:00.774923+0000","last_active":"2024-09-16T01:18:02.432370+0000","last_peered":"2024-09-16T01:18:02.432370+0000","last_clean":"2024-09-16T01:18:02.432370+0000","last_became_active":"2024-09-16T01:18:00.774643+0000","last_became_peered":"2024-09-16T01:18:00.774643+0000","last_unstale":"2024-09-16T01:18:02.432370+0000","last_undegraded":"2024-09-16T01:18:02.432370+0000","last_fullsized":"2024-09-16T01:18:02.432370+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:28.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765746+0000","last_change":"2024-09-16T01:18:00.779710+0000","last_active":"2024-09-16T01:18:01.765746+0000","last_peered":"2024-09-16T01:18:01.765746+0000","last_clean":"2024-09-16T01:18:01.765746+0000","last_became_active":"2024-09-16T01:18:00.779444+0000","last_became_peered":"2024-09-16T01:18:00.779444+0000","last_unstale":"2024-09-16T01:18:01.765746+0000","last_undegraded":"2024-09-16T01:18:01.765746+0000","last_fullsized":"2024-09-16T01:18:01.765746+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:19.844727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766236+0000","last_change":"2024-09-16T01:18:00.766039+0000","last_active":"2024-09-16T01:18:01.766236+0000","last_peered":"2024-09-16T01:18:01.766236+0000","last_clean":"2024-09-16T01:18:01.766236+0000","last_became_active":"2024-09-16T01:18:00.765728+0000","last_became_peered":"2024-09-16T01:18:00.765728+0000","last_unstale":"2024-09-16T01:18:01.766236+0000","last_undegraded":"2024-09-16T01:18:01.766236+0000","last_fullsized":"2024-09-16T01:18:01.766236+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:22.171147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432190+0000","last_change":"2024-09-16T01:18:00.780734+0000","last_active":"2024-09-16T01:18:02.432190+0000","last_peered":"2024-09-16T01:18:02.432190+0000","last_clean":"2024-09-16T01:18:02.432190+0000","last_became_active":"2024-09-16T01:18:00.780469+0000","last_became_peered":"2024-09-16T01:18:00.780469+0000","last_unstale":"2024-09-16T01:18:02.432190+0000","last_undegraded":"2024-09-16T01:18:02.432190+0000","last_fullsized":"2024-09-16T01:18:02.432190+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:33.492734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431812+0000","last_change":"2024-09-16T01:18:00.777951+0000","last_active":"2024-09-16T01:18:02.431812+0000","last_peered":"2024-09-16T01:18:02.431812+0000","last_clean":"2024-09-16T01:18:02.431812+0000","last_became_active":"2024-09-16T01:18:00.777649+0000","last_became_peered":"2024-09-16T01:18:00.777649+0000","last_unstale":"2024-09-16T01:18:02.431812+0000","last_undegraded":"2024-09-16T01:18:02.431812+0000","last_fullsized":"2024-09-16T01:18:02.431812+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:44.791962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768555+0000","last_change":"2024-09-16T01:18:00.768878+0000","last_active":"2024-09-16T01:18:01.768555+0000","last_peered":"2024-09-16T01:18:01.768555+0000","last_clean":"2024-09-16T01:18:01.768555+0000","last_became_active":"2024-09-16T01:18:00.768639+0000","last_became_peered":"2024-09-16T01:18:00.768639+0000","last_unstale":"2024-09-16T01:18:01.768555+0000","last_undegraded":"2024-09-16T01:18:01.768555+0000","last_fullsized":"2024-09-16T01:18:01.768555+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:46.141817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.767117+0000","last_change":"2024-09-16T01:18:00.776126+0000","last_active":"2024-09-16T01:18:01.767117+0000","last_peered":"2024-09-16T01:18:01.767117+0000","last_clean":"2024-09-16T01:18:01.767117+0000","last_became_active":"2024-09-16T01:18:00.775848+0000","last_became_peered":"2024-09-16T01:18:00.775848+0000","last_unstale":"2024-09-16T01:18:01.767117+0000","last_undegraded":"2024-09-16T01:18:01.767117+0000","last_fullsized":"2024-09-16T01:18:01.767117+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:27.131668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432123+0000","last_change":"2024-09-16T01:18:00.774761+0000","last_active":"2024-09-16T01:18:02.432123+0000","last_peered":"2024-09-16T01:18:02.432123+0000","last_clean":"2024-09-16T01:18:02.432123+0000","last_became_active":"2024-09-16T01:18:00.774463+0000","last_became_peered":"2024-09-16T01:18:00.774463+0000","last_unstale":"2024-09-16T01:18:02.432123+0000","last_undegraded":"2024-09-16T01:18:02.432123+0000","last_fullsized":"2024-09-16T01:18:02.432123+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:50.515178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765868+0000","last_change":"2024-09-16T01:18:00.767098+0000","last_active":"2024-09-16T01:18:01.765868+0000","last_peered":"2024-09-16T01:18:01.765868+0000","last_clean":"2024-09-16T01:18:01.765868+0000","last_became_active":"2024-09-16T01:18:00.766815+0000","last_became_peered":"2024-09-16T01:18:00.766815+0000","last_unstale":"2024-09-16T01:18:01.765868+0000","last_undegraded":"2024-09-16T01:18:01.765868+0000","last_fullsized":"2024-09-16T01:18:01.765868+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:00.154636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431032+0000","last_change":"2024-09-16T01:18:00.764834+0000","last_active":"2024-09-16T01:18:02.431032+0000","last_peered":"2024-09-16T01:18:02.431032+0000","last_clean":"2024-09-16T01:18:02.431032+0000","last_became_active":"2024-09-16T01:18:00.764521+0000","last_became_peered":"2024-09-16T01:18:00.764521+0000","last_unstale":"2024-09-16T01:18:02.431032+0000","last_undegraded":"2024-09-16T01:18:02.431032+0000","last_fullsized":"2024-09-16T01:18:02.431032+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:33.492734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766245+0000","last_change":"2024-09-16T01:18:00.774033+0000","last_active":"2024-09-16T01:18:01.766245+0000","last_peered":"2024-09-16T01:18:01.766245+0000","last_clean":"2024-09-16T01:18:01.766245+0000","last_became_active":"2024-09-16T01:18:00.773716+0000","last_became_peered":"2024-09-16T01:18:00.773716+0000","last_unstale":"2024-09-16T01:18:01.766245+0000","last_undegraded":"2024-09-16T01:18:01.766245+0000","last_fullsized":"2024-09-16T01:18:01.766245+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:45.080457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430772+0000","last_change":"2024-09-16T01:18:00.777700+0000","last_active":"2024-09-16T01:18:02.430772+0000","last_peered":"2024-09-16T01:18:02.430772+0000","last_clean":"2024-09-16T01:18:02.430772+0000","last_became_active":"2024-09-16T01:18:00.777362+0000","last_became_peered":"2024-09-16T01:18:00.777362+0000","last_unstale":"2024-09-16T01:18:02.430772+0000","last_undegraded":"2024-09-16T01:18:02.430772+0000","last_fullsized":"2024-09-16T01:18:02.430772+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:58.532226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430629+0000","last_change":"2024-09-16T01:18:00.778391+0000","last_active":"2024-09-16T01:18:02.430629+0000","last_peered":"2024-09-16T01:18:02.430629+0000","last_clean":"2024-09-16T01:18:02.430629+0000","last_became_active":"2024-09-16T01:18:00.778131+0000","last_became_peered":"2024-09-16T01:18:00.778131+0000","last_unstale":"2024-09-16T01:18:02.430629+0000","last_undegraded":"2024-09-16T01:18:02.430629+0000","last_fullsized":"2024-09-16T01:18:02.430629+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:14.295316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431431+0000","last_change":"2024-09-16T01:18:00.777652+0000","last_active":"2024-09-16T01:18:02.431431+0000","last_peered":"2024-09-16T01:18:02.431431+0000","last_clean":"2024-09-16T01:18:02.431431+0000","last_became_active":"2024-09-16T01:18:00.777363+0000","last_became_peered":"2024-09-16T01:18:00.777363+0000","last_unstale":"2024-09-16T01:18:02.431431+0000","last_undegraded":"2024-09-16T01:18:02.431431+0000","last_fullsized":"2024-09-16T01:18:02.431431+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:45.080457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765129+0000","last_change":"2024-09-16T01:18:00.764457+0000","last_active":"2024-09-16T01:18:01.765129+0000","last_peered":"2024-09-16T01:18:01.765129+0000","last_clean":"2024-09-16T01:18:01.765129+0000","last_became_active":"2024-09-16T01:18:00.763420+0000","last_became_peered":"2024-09-16T01:18:00.763420+0000","last_unstale":"2024-09-16T01:18:01.765129+0000","last_undegraded":"2024-09-16T01:18:01.765129+0000","last_fullsized":"2024-09-16T01:18:01.765129+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:07.149064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765912+0000","last_change":"2024-09-16T01:18:00.766162+0000","last_active":"2024-09-16T01:18:01.765912+0000","last_peered":"2024-09-16T01:18:01.765912+0000","last_clean":"2024-09-16T01:18:01.765912+0000","last_became_active":"2024-09-16T01:18:00.765781+0000","last_became_peered":"2024-09-16T01:18:00.765781+0000","last_unstale":"2024-09-16T01:18:01.765912+0000","last_undegraded":"2024-09-16T01:18:01.765912+0000","last_fullsized":"2024-09-16T01:18:01.765912+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.379740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432477+0000","last_change":"2024-09-16T01:18:00.772732+0000","last_active":"2024-09-16T01:18:02.432477+0000","last_peered":"2024-09-16T01:18:02.432477+0000","last_clean":"2024-09-16T01:18:02.432477+0000","last_became_active":"2024-09-16T01:18:00.772460+0000","last_became_peered":"2024-09-16T01:18:00.772460+0000","last_unstale":"2024-09-16T01:18:02.432477+0000","last_undegraded":"2024-09-16T01:18:02.432477+0000","last_fullsized":"2024-09-16T01:18:02.432477+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:27.659510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766783+0000","last_change":"2024-09-16T01:18:00.774251+0000","last_active":"2024-09-16T01:18:01.766783+0000","last_peered":"2024-09-16T01:18:01.766783+0000","last_clean":"2024-09-16T01:18:01.766783+0000","last_became_active":"2024-09-16T01:18:00.774015+0000","last_became_peered":"2024-09-16T01:18:00.774015+0000","last_unstale":"2024-09-16T01:18:01.766783+0000","last_undegraded":"2024-09-16T01:18:01.766783+0000","last_fullsized":"2024-09-16T01:18:01.766783+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:46.026251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432190+0000","last_change":"2024-09-16T01:18:00.781527+0000","last_active":"2024-09-16T01:18:02.432190+0000","last_peered":"2024-09-16T01:18:02.432190+0000","last_clean":"2024-09-16T01:18:02.432190+0000","last_became_active":"2024-09-16T01:18:00.780160+0000","last_became_peered":"2024-09-16T01:18:00.780160+0000","last_unstale":"2024-09-16T01:18:02.432190+0000","last_undegraded":"2024-09-16T01:18:02.432190+0000","last_fullsized":"2024-09-16T01:18:02.432190+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:18.926573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766088+0000","last_change":"2024-09-16T01:18:00.779155+0000","last_active":"2024-09-16T01:18:01.766088+0000","last_peered":"2024-09-16T01:18:01.766088+0000","last_clean":"2024-09-16T01:18:01.766088+0000","last_became_active":"2024-09-16T01:18:00.778859+0000","last_became_peered":"2024-09-16T01:18:00.778859+0000","last_unstale":"2024-09-16T01:18:01.766088+0000","last_undegraded":"2024-09-16T01:18:01.766088+0000","last_fullsized":"2024-09-16T01:18:01.766088+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:54.303614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431451+0000","last_change":"2024-09-16T01:18:00.774691+0000","last_active":"2024-09-16T01:18:02.431451+0000","last_peered":"2024-09-16T01:18:02.431451+0000","last_clean":"2024-09-16T01:18:02.431451+0000","last_became_active":"2024-09-16T01:18:00.774413+0000","last_became_peered":"2024-09-16T01:18:00.774413+0000","last_unstale":"2024-09-16T01:18:02.431451+0000","last_undegraded":"2024-09-16T01:18:02.431451+0000","last_fullsized":"2024-09-16T01:18:02.431451+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:57.125012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430570+0000","last_change":"2024-09-16T01:18:00.769470+0000","last_active":"2024-09-16T01:18:02.430570+0000","last_peered":"2024-09-16T01:18:02.430570+0000","last_clean":"2024-09-16T01:18:02.430570+0000","last_became_active":"2024-09-16T01:18:00.768916+0000","last_became_peered":"2024-09-16T01:18:00.768916+0000","last_unstale":"2024-09-16T01:18:02.430570+0000","last_undegraded":"2024-09-16T01:18:02.430570+0000","last_fullsized":"2024-09-16T01:18:02.430570+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:44.791962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765300+0000","last_change":"2024-09-16T01:18:00.770518+0000","last_active":"2024-09-16T01:18:01.765300+0000","last_peered":"2024-09-16T01:18:01.765300+0000","last_clean":"2024-09-16T01:18:01.765300+0000","last_became_active":"2024-09-16T01:18:00.770266+0000","last_became_peered":"2024-09-16T01:18:00.770266+0000","last_unstale":"2024-09-16T01:18:01.765300+0000","last_undegraded":"2024-09-16T01:18:01.765300+0000","last_fullsized":"2024-09-16T01:18:01.765300+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:28.953173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"62'4","reported_seq":18,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.767209+0000","last_change":"2024-09-16T01:17:59.764560+0000","last_active":"2024-09-16T01:18:01.767209+0000","last_peered":"2024-09-16T01:18:01.767209+0000","last_clean":"2024-09-16T01:18:01.767209+0000","last_became_active":"2024-09-16T01:17:59.764242+0000","last_became_peered":"2024-09-16T01:17:59.764242+0000","last_unstale":"2024-09-16T01:18:01.767209+0000","last_undegraded":"2024-09-16T01:18:01.767209+0000","last_fullsized":"2024-09-16T01:18:01.767209+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:26.294459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432514+0000","last_change":"2024-09-16T01:18:00.770036+0000","last_active":"2024-09-16T01:18:02.432514+0000","last_peered":"2024-09-16T01:18:02.432514+0000","last_clean":"2024-09-16T01:18:02.432514+0000","last_became_active":"2024-09-16T01:18:00.769797+0000","last_became_peered":"2024-09-16T01:18:00.769797+0000","last_unstale":"2024-09-16T01:18:02.432514+0000","last_undegraded":"2024-09-16T01:18:02.432514+0000","last_fullsized":"2024-09-16T01:18:02.432514+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:24.680975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431235+0000","last_change":"2024-09-16T01:17:59.761132+0000","last_active":"2024-09-16T01:18:02.431235+0000","last_peered":"2024-09-16T01:18:02.431235+0000","last_clean":"2024-09-16T01:18:02.431235+0000","last_became_active":"2024-09-16T01:17:59.760844+0000","last_became_peered":"2024-09-16T01:17:59.760844+0000","last_unstale":"2024-09-16T01:18:02.431235+0000","last_undegraded":"2024-09-16T01:18:02.431235+0000","last_fullsized":"2024-09-16T01:18:02.431235+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:48.925880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431181+0000","last_change":"2024-09-16T01:18:00.769141+0000","last_active":"2024-09-16T01:18:02.431181+0000","last_peered":"2024-09-16T01:18:02.431181+0000","last_clean":"2024-09-16T01:18:02.431181+0000","last_became_active":"2024-09-16T01:18:00.768884+0000","last_became_peered":"2024-09-16T01:18:00.768884+0000","last_unstale":"2024-09-16T01:18:02.431181+0000","last_undegraded":"2024-09-16T01:18:02.431181+0000","last_fullsized":"2024-09-16T01:18:02.431181+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:58.532226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431021+0000","last_change":"2024-09-16T01:17:59.759681+0000","last_active":"2024-09-16T01:18:02.431021+0000","last_peered":"2024-09-16T01:18:02.431021+0000","last_clean":"2024-09-16T01:18:02.431021+0000","last_became_active":"2024-09-16T01:17:59.759394+0000","last_became_peered":"2024-09-16T01:17:59.759394+0000","last_unstale":"2024-09-16T01:18:02.431021+0000","last_undegraded":"2024-09-16T01:18:02.431021+0000","last_fullsized":"2024-09-16T01:18:02.431021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:06.144671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431984+0000","last_change":"2024-09-16T01:18:00.779194+0000","last_active":"2024-09-16T01:18:02.431984+0000","last_peered":"2024-09-16T01:18:02.431984+0000","last_clean":"2024-09-16T01:18:02.431984+0000","last_became_active":"2024-09-16T01:18:00.778868+0000","last_became_peered":"2024-09-16T01:18:00.778868+0000","last_unstale":"2024-09-16T01:18:02.431984+0000","last_undegraded":"2024-09-16T01:18:02.431984+0000","last_fullsized":"2024-09-16T01:18:02.431984+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:58.532226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431109+0000","last_change":"2024-09-16T01:17:59.762664+0000","last_active":"2024-09-16T01:18:02.431109+0000","last_peered":"2024-09-16T01:18:02.431109+0000","last_clean":"2024-09-16T01:18:02.431109+0000","last_became_active":"2024-09-16T01:17:59.762395+0000","last_became_peered":"2024-09-16T01:17:59.762395+0000","last_unstale":"2024-09-16T01:18:02.431109+0000","last_undegraded":"2024-09-16T01:18:02.431109+0000","last_fullsized":"2024-09-16T01:18:02.431109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:18.840334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768641+0000","last_change":"2024-09-16T01:18:00.771019+0000","last_active":"2024-09-16T01:18:01.768641+0000","last_peered":"2024-09-16T01:18:01.768641+0000","last_clean":"2024-09-16T01:18:01.768641+0000","last_became_active":"2024-09-16T01:18:00.770724+0000","last_became_peered":"2024-09-16T01:18:00.770724+0000","last_unstale":"2024-09-16T01:18:01.768641+0000","last_undegraded":"2024-09-16T01:18:01.768641+0000","last_fullsized":"2024-09-16T01:18:01.768641+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:29.912155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430979+0000","last_change":"2024-09-16T01:17:59.761689+0000","last_active":"2024-09-16T01:18:02.430979+0000","last_peered":"2024-09-16T01:18:02.430979+0000","last_clean":"2024-09-16T01:18:02.430979+0000","last_became_active":"2024-09-16T01:17:59.761418+0000","last_became_peered":"2024-09-16T01:17:59.761418+0000","last_unstale":"2024-09-16T01:18:02.430979+0000","last_undegraded":"2024-09-16T01:18:02.430979+0000","last_fullsized":"2024-09-16T01:18:02.430979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:53.299221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766831+0000","last_change":"2024-09-16T01:18:00.776106+0000","last_active":"2024-09-16T01:18:01.766831+0000","last_peered":"2024-09-16T01:18:01.766831+0000","last_clean":"2024-09-16T01:18:01.766831+0000","last_became_active":"2024-09-16T01:18:00.775859+0000","last_became_peered":"2024-09-16T01:18:00.775859+0000","last_unstale":"2024-09-16T01:18:01.766831+0000","last_undegraded":"2024-09-16T01:18:01.766831+0000","last_fullsized":"2024-09-16T01:18:01.766831+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:22.517772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430862+0000","last_change":"2024-09-16T01:17:59.768407+0000","last_active":"2024-09-16T01:18:02.430862+0000","last_peered":"2024-09-16T01:18:02.430862+0000","last_clean":"2024-09-16T01:18:02.430862+0000","last_became_active":"2024-09-16T01:17:59.767916+0000","last_became_peered":"2024-09-16T01:17:59.767916+0000","last_unstale":"2024-09-16T01:18:02.430862+0000","last_undegraded":"2024-09-16T01:18:02.430862+0000","last_fullsized":"2024-09-16T01:18:02.430862+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:59.586198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765515+0000","last_change":"2024-09-16T01:18:00.771471+0000","last_active":"2024-09-16T01:18:01.765515+0000","last_peered":"2024-09-16T01:18:01.765515+0000","last_clean":"2024-09-16T01:18:01.765515+0000","last_became_active":"2024-09-16T01:18:00.771176+0000","last_became_peered":"2024-09-16T01:18:00.771176+0000","last_unstale":"2024-09-16T01:18:01.765515+0000","last_undegraded":"2024-09-16T01:18:01.765515+0000","last_fullsized":"2024-09-16T01:18:01.765515+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:06.499475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430625+0000","last_change":"2024-09-16T01:17:59.767229+0000","last_active":"2024-09-16T01:18:02.430625+0000","last_peered":"2024-09-16T01:18:02.430625+0000","last_clean":"2024-09-16T01:18:02.430625+0000","last_became_active":"2024-09-16T01:17:59.766939+0000","last_became_peered":"2024-09-16T01:17:59.766939+0000","last_unstale":"2024-09-16T01:18:02.430625+0000","last_undegraded":"2024-09-16T01:18:02.430625+0000","last_fullsized":"2024-09-16T01:18:02.430625+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:39.992236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430935+0000","last_change":"2024-09-16T01:18:00.769575+0000","last_active":"2024-09-16T01:18:02.430935+0000","last_peered":"2024-09-16T01:18:02.430935+0000","last_clean":"2024-09-16T01:18:02.430935+0000","last_became_active":"2024-09-16T01:18:00.769295+0000","last_became_peered":"2024-09-16T01:18:00.769295+0000","last_unstale":"2024-09-16T01:18:02.430935+0000","last_undegraded":"2024-09-16T01:18:02.430935+0000","last_fullsized":"2024-09-16T01:18:02.430935+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:39.237996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765015+0000","last_change":"2024-09-16T01:17:59.761807+0000","last_active":"2024-09-16T01:18:01.765015+0000","last_peered":"2024-09-16T01:18:01.765015+0000","last_clean":"2024-09-16T01:18:01.765015+0000","last_became_active":"2024-09-16T01:17:59.761310+0000","last_became_peered":"2024-09-16T01:17:59.761310+0000","last_unstale":"2024-09-16T01:18:01.765015+0000","last_undegraded":"2024-09-16T01:18:01.765015+0000","last_fullsized":"2024-09-16T01:18:01.765015+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:59.120260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766889+0000","last_change":"2024-09-16T01:18:00.773646+0000","last_active":"2024-09-16T01:18:01.766889+0000","last_peered":"2024-09-16T01:18:01.766889+0000","last_clean":"2024-09-16T01:18:01.766889+0000","last_became_active":"2024-09-16T01:18:00.773349+0000","last_became_peered":"2024-09-16T01:18:00.773349+0000","last_unstale":"2024-09-16T01:18:01.766889+0000","last_undegraded":"2024-09-16T01:18:01.766889+0000","last_fullsized":"2024-09-16T01:18:01.766889+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:34.926682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432333+0000","last_change":"2024-09-16T01:17:59.768831+0000","last_active":"2024-09-16T01:18:02.432333+0000","last_peered":"2024-09-16T01:18:02.432333+0000","last_clean":"2024-09-16T01:18:02.432333+0000","last_became_active":"2024-09-16T01:17:59.768392+0000","last_became_peered":"2024-09-16T01:17:59.768392+0000","last_unstale":"2024-09-16T01:18:02.432333+0000","last_undegraded":"2024-09-16T01:18:02.432333+0000","last_fullsized":"2024-09-16T01:18:02.432333+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:26.127275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430659+0000","last_change":"2024-09-16T01:18:00.764032+0000","last_active":"2024-09-16T01:18:02.430659+0000","last_peered":"2024-09-16T01:18:02.430659+0000","last_clean":"2024-09-16T01:18:02.430659+0000","last_became_active":"2024-09-16T01:18:00.763749+0000","last_became_peered":"2024-09-16T01:18:00.763749+0000","last_unstale":"2024-09-16T01:18:02.430659+0000","last_undegraded":"2024-09-16T01:18:02.430659+0000","last_fullsized":"2024-09-16T01:18:02.430659+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.731594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432208+0000","last_change":"2024-09-16T01:17:59.762688+0000","last_active":"2024-09-16T01:18:02.432208+0000","last_peered":"2024-09-16T01:18:02.432208+0000","last_clean":"2024-09-16T01:18:02.432208+0000","last_became_active":"2024-09-16T01:17:59.762289+0000","last_became_peered":"2024-09-16T01:17:59.762289+0000","last_unstale":"2024-09-16T01:18:02.432208+0000","last_undegraded":"2024-09-16T01:18:02.432208+0000","last_fullsized":"2024-09-16T01:18:02.432208+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:10.954838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766279+0000","last_change":"2024-09-16T01:18:00.770237+0000","last_active":"2024-09-16T01:18:01.766279+0000","last_peered":"2024-09-16T01:18:01.766279+0000","last_clean":"2024-09-16T01:18:01.766279+0000","last_became_active":"2024-09-16T01:18:00.769944+0000","last_became_peered":"2024-09-16T01:18:00.769944+0000","last_unstale":"2024-09-16T01:18:01.766279+0000","last_undegraded":"2024-09-16T01:18:01.766279+0000","last_fullsized":"2024-09-16T01:18:01.766279+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:10.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"62'3","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432127+0000","last_change":"2024-09-16T01:17:59.768974+0000","last_active":"2024-09-16T01:18:02.432127+0000","last_peered":"2024-09-16T01:18:02.432127+0000","last_clean":"2024-09-16T01:18:02.432127+0000","last_became_active":"2024-09-16T01:17:59.768504+0000","last_became_peered":"2024-09-16T01:17:59.768504+0000","last_unstale":"2024-09-16T01:18:02.432127+0000","last_undegraded":"2024-09-16T01:18:02.432127+0000","last_fullsized":"2024-09-16T01:18:02.432127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:21.513379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432475+0000","last_change":"2024-09-16T01:18:00.769802+0000","last_active":"2024-09-16T01:18:02.432475+0000","last_peered":"2024-09-16T01:18:02.432475+0000","last_clean":"2024-09-16T01:18:02.432475+0000","last_became_active":"2024-09-16T01:18:00.769545+0000","last_became_peered":"2024-09-16T01:18:00.769545+0000","last_unstale":"2024-09-16T01:18:02.432475+0000","last_undegraded":"2024-09-16T01:18:02.432475+0000","last_fullsized":"2024-09-16T01:18:02.432475+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:41.677946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"62'6","reported_seq":20,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766943+0000","last_change":"2024-09-16T01:17:59.764295+0000","last_active":"2024-09-16T01:18:01.766943+0000","last_peered":"2024-09-16T01:18:01.766943+0000","last_clean":"2024-09-16T01:18:01.766943+0000","last_became_active":"2024-09-16T01:17:59.764020+0000","last_became_peered":"2024-09-16T01:17:59.764020+0000","last_unstale":"2024-09-16T01:18:01.766943+0000","last_undegraded":"2024-09-16T01:18:01.766943+0000","last_fullsized":"2024-09-16T01:18:01.766943+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:13:07.173826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431367+0000","last_change":"2024-09-16T01:18:00.780974+0000","last_active":"2024-09-16T01:18:02.431367+0000","last_peered":"2024-09-16T01:18:02.431367+0000","last_clean":"2024-09-16T01:18:02.431367+0000","last_became_active":"2024-09-16T01:18:00.780697+0000","last_became_peered":"2024-09-16T01:18:00.780697+0000","last_unstale":"2024-09-16T01:18:02.431367+0000","last_undegraded":"2024-09-16T01:18:02.431367+0000","last_fullsized":"2024-09-16T01:18:02.431367+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:04.111656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431470+0000","last_change":"2024-09-16T01:17:59.764249+0000","last_active":"2024-09-16T01:18:02.431470+0000","last_peered":"2024-09-16T01:18:02.431470+0000","last_clean":"2024-09-16T01:18:02.431470+0000","last_became_active":"2024-09-16T01:17:59.763899+0000","last_became_peered":"2024-09-16T01:17:59.763899+0000","last_unstale":"2024-09-16T01:18:02.431470+0000","last_undegraded":"2024-09-16T01:18:02.431470+0000","last_fullsized":"2024-09-16T01:18:02.431470+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:02.181790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765427+0000","last_change":"2024-09-16T01:18:00.768933+0000","last_active":"2024-09-16T01:18:01.765427+0000","last_peered":"2024-09-16T01:18:01.765427+0000","last_clean":"2024-09-16T01:18:01.765427+0000","last_became_active":"2024-09-16T01:18:00.768676+0000","last_became_peered":"2024-09-16T01:18:00.768676+0000","last_unstale":"2024-09-16T01:18:01.765427+0000","last_undegraded":"2024-09-16T01:18:01.765427+0000","last_fullsized":"2024-09-16T01:18:01.765427+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:00.590591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766139+0000","last_change":"2024-09-16T01:17:59.759538+0000","last_active":"2024-09-16T01:18:01.766139+0000","last_peered":"2024-09-16T01:18:01.766139+0000","last_clean":"2024-09-16T01:18:01.766139+0000","last_became_active":"2024-09-16T01:17:59.759281+0000","last_became_peered":"2024-09-16T01:17:59.759281+0000","last_unstale":"2024-09-16T01:18:01.766139+0000","last_undegraded":"2024-09-16T01:18:01.766139+0000","last_fullsized":"2024-09-16T01:18:01.766139+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:05.495082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765570+0000","last_change":"2024-09-16T01:18:00.769922+0000","last_active":"2024-09-16T01:18:01.765570+0000","last_peered":"2024-09-16T01:18:01.765570+0000","last_clean":"2024-09-16T01:18:01.765570+0000","last_became_active":"2024-09-16T01:18:00.769654+0000","last_became_peered":"2024-09-16T01:18:00.769654+0000","last_unstale":"2024-09-16T01:18:01.765570+0000","last_undegraded":"2024-09-16T01:18:01.765570+0000","last_fullsized":"2024-09-16T01:18:01.765570+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:42.535136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432272+0000","last_change":"2024-09-16T01:17:59.769520+0000","last_active":"2024-09-16T01:18:02.432272+0000","last_peered":"2024-09-16T01:18:02.432272+0000","last_clean":"2024-09-16T01:18:02.432272+0000","last_became_active":"2024-09-16T01:17:59.769233+0000","last_became_peered":"2024-09-16T01:17:59.769233+0000","last_unstale":"2024-09-16T01:18:02.432272+0000","last_undegraded":"2024-09-16T01:18:02.432272+0000","last_fullsized":"2024-09-16T01:18:02.432272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:45.021858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766714+0000","last_change":"2024-09-16T01:18:00.781036+0000","last_active":"2024-09-16T01:18:01.766714+0000","last_peered":"2024-09-16T01:18:01.766714+0000","last_clean":"2024-09-16T01:18:01.766714+0000","last_became_active":"2024-09-16T01:18:00.780762+0000","last_became_peered":"2024-09-16T01:18:00.780762+0000","last_unstale":"2024-09-16T01:18:01.766714+0000","last_undegraded":"2024-09-16T01:18:01.766714+0000","last_fullsized":"2024-09-16T01:18:01.766714+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:10.296876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"62'8","reported_seq":22,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431472+0000","last_change":"2024-09-16T01:17:59.764372+0000","last_active":"2024-09-16T01:18:02.431472+0000","last_peered":"2024-09-16T01:18:02.431472+0000","last_clean":"2024-09-16T01:18:02.431472+0000","last_became_active":"2024-09-16T01:17:59.764087+0000","last_became_peered":"2024-09-16T01:17:59.764087+0000","last_unstale":"2024-09-16T01:18:02.431472+0000","last_undegraded":"2024-09-16T01:18:02.431472+0000","last_fullsized":"2024-09-16T01:18:02.431472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:02.932709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431876+0000","last_change":"2024-09-16T01:18:00.779173+0000","last_active":"2024-09-16T01:18:02.431876+0000","last_peered":"2024-09-16T01:18:02.431876+0000","last_clean":"2024-09-16T01:18:02.431876+0000","last_became_active":"2024-09-16T01:18:00.778853+0000","last_became_peered":"2024-09-16T01:18:00.778853+0000","last_unstale":"2024-09-16T01:18:02.431876+0000","last_undegraded":"2024-09-16T01:18:02.431876+0000","last_fullsized":"2024-09-16T01:18:02.431876+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:30.611051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765299+0000","last_change":"2024-09-16T01:17:59.762903+0000","last_active":"2024-09-16T01:18:01.765299+0000","last_peered":"2024-09-16T01:18:01.765299+0000","last_clean":"2024-09-16T01:18:01.765299+0000","last_became_active":"2024-09-16T01:17:59.762607+0000","last_became_peered":"2024-09-16T01:17:59.762607+0000","last_unstale":"2024-09-16T01:18:01.765299+0000","last_undegraded":"2024-09-16T01:18:01.765299+0000","last_fullsized":"2024-09-16T01:18:01.765299+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:41.530743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766036+0000","last_change":"2024-09-16T01:18:00.767674+0000","last_active":"2024-09-16T01:18:01.766036+0000","last_peered":"2024-09-16T01:18:01.766036+0000","last_clean":"2024-09-16T01:18:01.766036+0000","last_became_active":"2024-09-16T01:18:00.767402+0000","last_became_peered":"2024-09-16T01:18:00.767402+0000","last_unstale":"2024-09-16T01:18:01.766036+0000","last_undegraded":"2024-09-16T01:18:01.766036+0000","last_fullsized":"2024-09-16T01:18:01.766036+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:41.827484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431834+0000","last_change":"2024-09-16T01:17:59.769604+0000","last_active":"2024-09-16T01:18:02.431834+0000","last_peered":"2024-09-16T01:18:02.431834+0000","last_clean":"2024-09-16T01:18:02.431834+0000","last_became_active":"2024-09-16T01:17:59.769350+0000","last_became_peered":"2024-09-16T01:17:59.769350+0000","last_unstale":"2024-09-16T01:18:02.431834+0000","last_undegraded":"2024-09-16T01:18:02.431834+0000","last_fullsized":"2024-09-16T01:18:02.431834+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:11.740746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432202+0000","last_change":"2024-09-16T01:18:00.771131+0000","last_active":"2024-09-16T01:18:02.432202+0000","last_peered":"2024-09-16T01:18:02.432202+0000","last_clean":"2024-09-16T01:18:02.432202+0000","last_became_active":"2024-09-16T01:18:00.770877+0000","last_became_peered":"2024-09-16T01:18:00.770877+0000","last_unstale":"2024-09-16T01:18:02.432202+0000","last_undegraded":"2024-09-16T01:18:02.432202+0000","last_fullsized":"2024-09-16T01:18:02.432202+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:27.298852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"62'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432054+0000","last_change":"2024-09-16T01:17:59.769174+0000","last_active":"2024-09-16T01:18:02.432054+0000","last_peered":"2024-09-16T01:18:02.432054+0000","last_clean":"2024-09-16T01:18:02.432054+0000","last_became_active":"2024-09-16T01:17:59.768842+0000","last_became_peered":"2024-09-16T01:17:59.768842+0000","last_unstale":"2024-09-16T01:18:02.432054+0000","last_undegraded":"2024-09-16T01:18:02.432054+0000","last_fullsized":"2024-09-16T01:18:02.432054+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:33.922289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765182+0000","last_change":"2024-09-16T01:18:00.771305+0000","last_active":"2024-09-16T01:18:01.765182+0000","last_peered":"2024-09-16T01:18:01.765182+0000","last_clean":"2024-09-16T01:18:01.765182+0000","last_became_active":"2024-09-16T01:18:00.770973+0000","last_became_peered":"2024-09-16T01:18:00.770973+0000","last_unstale":"2024-09-16T01:18:01.765182+0000","last_undegraded":"2024-09-16T01:18:01.765182+0000","last_fullsized":"2024-09-16T01:18:01.765182+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:13:08.178218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431118+0000","last_change":"2024-09-16T01:17:59.768326+0000","last_active":"2024-09-16T01:18:02.431118+0000","last_peered":"2024-09-16T01:18:02.431118+0000","last_clean":"2024-09-16T01:18:02.431118+0000","last_became_active":"2024-09-16T01:17:59.768069+0000","last_became_peered":"2024-09-16T01:17:59.768069+0000","last_unstale":"2024-09-16T01:18:02.431118+0000","last_undegraded":"2024-09-16T01:18:02.431118+0000","last_fullsized":"2024-09-16T01:18:02.431118+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:18.840334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430623+0000","last_change":"2024-09-16T01:18:00.769236+0000","last_active":"2024-09-16T01:18:02.430623+0000","last_peered":"2024-09-16T01:18:02.430623+0000","last_clean":"2024-09-16T01:18:02.430623+0000","last_became_active":"2024-09-16T01:18:00.768569+0000","last_became_peered":"2024-09-16T01:18:00.768569+0000","last_unstale":"2024-09-16T01:18:02.430623+0000","last_undegraded":"2024-09-16T01:18:02.430623+0000","last_fullsized":"2024-09-16T01:18:02.430623+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:30.611051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430681+0000","last_change":"2024-09-16T01:17:59.754405+0000","last_active":"2024-09-16T01:18:02.430681+0000","last_peered":"2024-09-16T01:18:02.430681+0000","last_clean":"2024-09-16T01:18:02.430681+0000","last_became_active":"2024-09-16T01:17:59.754132+0000","last_became_peered":"2024-09-16T01:17:59.754132+0000","last_unstale":"2024-09-16T01:18:02.430681+0000","last_undegraded":"2024-09-16T01:18:02.430681+0000","last_fullsized":"2024-09-16T01:18:02.430681+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:02.181790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765579+0000","last_change":"2024-09-16T01:18:00.763204+0000","last_active":"2024-09-16T01:18:01.765579+0000","last_peered":"2024-09-16T01:18:01.765579+0000","last_clean":"2024-09-16T01:18:01.765579+0000","last_became_active":"2024-09-16T01:18:00.762903+0000","last_became_peered":"2024-09-16T01:18:00.762903+0000","last_unstale":"2024-09-16T01:18:01.765579+0000","last_undegraded":"2024-09-16T01:18:01.765579+0000","last_fullsized":"2024-09-16T01:18:01.765579+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:49.930273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766211+0000","last_change":"2024-09-16T01:17:59.762804+0000","last_active":"2024-09-16T01:18:01.766211+0000","last_peered":"2024-09-16T01:18:01.766211+0000","last_clean":"2024-09-16T01:18:01.766211+0000","last_became_active":"2024-09-16T01:17:59.762528+0000","last_became_peered":"2024-09-16T01:17:59.762528+0000","last_unstale":"2024-09-16T01:18:01.766211+0000","last_undegraded":"2024-09-16T01:18:01.766211+0000","last_fullsized":"2024-09-16T01:18:01.766211+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:23.676582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765701+0000","last_change":"2024-09-16T01:18:00.774203+0000","last_active":"2024-09-16T01:18:01.765701+0000","last_peered":"2024-09-16T01:18:01.765701+0000","last_clean":"2024-09-16T01:18:01.765701+0000","last_became_active":"2024-09-16T01:18:00.773843+0000","last_became_peered":"2024-09-16T01:18:00.773843+0000","last_unstale":"2024-09-16T01:18:01.765701+0000","last_undegraded":"2024-09-16T01:18:01.765701+0000","last_fullsized":"2024-09-16T01:18:01.765701+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:22.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430844+0000","last_change":"2024-09-16T01:17:59.761819+0000","last_active":"2024-09-16T01:18:02.430844+0000","last_peered":"2024-09-16T01:18:02.430844+0000","last_clean":"2024-09-16T01:18:02.430844+0000","last_became_active":"2024-09-16T01:17:59.760803+0000","last_became_peered":"2024-09-16T01:17:59.760803+0000","last_unstale":"2024-09-16T01:18:02.430844+0000","last_undegraded":"2024-09-16T01:18:02.430844+0000","last_fullsized":"2024-09-16T01:18:02.430844+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:59.586198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430744+0000","last_change":"2024-09-16T01:18:00.776578+0000","last_active":"2024-09-16T01:18:02.430744+0000","last_peered":"2024-09-16T01:18:02.430744+0000","last_clean":"2024-09-16T01:18:02.430744+0000","last_became_active":"2024-09-16T01:18:00.776270+0000","last_became_peered":"2024-09-16T01:18:00.776270+0000","last_unstale":"2024-09-16T01:18:02.430744+0000","last_undegraded":"2024-09-16T01:18:02.430744+0000","last_fullsized":"2024-09-16T01:18:02.430744+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:14.295316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"62'2","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765500+0000","last_change":"2024-09-16T01:17:59.762059+0000","last_active":"2024-09-16T01:18:01.765500+0000","last_peered":"2024-09-16T01:18:01.765500+0000","last_clean":"2024-09-16T01:18:01.765500+0000","last_became_active":"2024-09-16T01:17:59.761769+0000","last_became_peered":"2024-09-16T01:17:59.761769+0000","last_unstale":"2024-09-16T01:18:01.765500+0000","last_undegraded":"2024-09-16T01:18:01.765500+0000","last_fullsized":"2024-09-16T01:18:01.765500+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:21.040913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768714+0000","last_change":"2024-09-16T01:18:00.773857+0000","last_active":"2024-09-16T01:18:01.768714+0000","last_peered":"2024-09-16T01:18:01.768714+0000","last_clean":"2024-09-16T01:18:01.768714+0000","last_became_active":"2024-09-16T01:18:00.773604+0000","last_became_peered":"2024-09-16T01:18:00.773604+0000","last_unstale":"2024-09-16T01:18:01.768714+0000","last_undegraded":"2024-09-16T01:18:01.768714+0000","last_fullsized":"2024-09-16T01:18:01.768714+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:38.176330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"63'1","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.771229+0000","last_change":"2024-09-16T01:17:59.758587+0000","last_active":"2024-09-16T01:18:01.771229+0000","last_peered":"2024-09-16T01:18:01.771229+0000","last_clean":"2024-09-16T01:18:01.771229+0000","last_became_active":"2024-09-16T01:17:59.758329+0000","last_became_peered":"2024-09-16T01:17:59.758329+0000","last_unstale":"2024-09-16T01:18:01.771229+0000","last_undegraded":"2024-09-16T01:18:01.771229+0000","last_fullsized":"2024-09-16T01:18:01.771229+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.128269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766206+0000","last_change":"2024-09-16T01:18:00.771635+0000","last_active":"2024-09-16T01:18:01.766206+0000","last_peered":"2024-09-16T01:18:01.766206+0000","last_clean":"2024-09-16T01:18:01.766206+0000","last_became_active":"2024-09-16T01:18:00.771082+0000","last_became_peered":"2024-09-16T01:18:00.771082+0000","last_unstale":"2024-09-16T01:18:01.766206+0000","last_undegraded":"2024-09-16T01:18:01.766206+0000","last_fullsized":"2024-09-16T01:18:01.766206+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:17.231425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431079+0000","last_change":"2024-09-16T01:17:59.758251+0000","last_active":"2024-09-16T01:18:02.431079+0000","last_peered":"2024-09-16T01:18:02.431079+0000","last_clean":"2024-09-16T01:18:02.431079+0000","last_became_active":"2024-09-16T01:17:59.757958+0000","last_became_peered":"2024-09-16T01:17:59.757958+0000","last_unstale":"2024-09-16T01:18:02.431079+0000","last_undegraded":"2024-09-16T01:18:02.431079+0000","last_fullsized":"2024-09-16T01:18:02.431079+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:39.992236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765339+0000","last_change":"2024-09-16T01:18:00.764292+0000","last_active":"2024-09-16T01:18:01.765339+0000","last_peered":"2024-09-16T01:18:01.765339+0000","last_clean":"2024-09-16T01:18:01.765339+0000","last_became_active":"2024-09-16T01:18:00.763878+0000","last_became_peered":"2024-09-16T01:18:00.763878+0000","last_unstale":"2024-09-16T01:18:01.765339+0000","last_undegraded":"2024-09-16T01:18:01.765339+0000","last_fullsized":"2024-09-16T01:18:01.765339+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:41.677946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766968+0000","last_change":"2024-09-16T01:17:59.764272+0000","last_active":"2024-09-16T01:18:01.766968+0000","last_peered":"2024-09-16T01:18:01.766968+0000","last_clean":"2024-09-16T01:18:01.766968+0000","last_became_active":"2024-09-16T01:17:59.763997+0000","last_became_peered":"2024-09-16T01:17:59.763997+0000","last_unstale":"2024-09-16T01:18:01.766968+0000","last_undegraded":"2024-09-16T01:18:01.766968+0000","last_fullsized":"2024-09-16T01:18:01.766968+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:27.948780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765371+0000","last_change":"2024-09-16T01:18:00.769583+0000","last_active":"2024-09-16T01:18:01.765371+0000","last_peered":"2024-09-16T01:18:01.765371+0000","last_clean":"2024-09-16T01:18:01.765371+0000","last_became_active":"2024-09-16T01:18:00.769281+0000","last_became_peered":"2024-09-16T01:18:00.769281+0000","last_unstale":"2024-09-16T01:18:01.765371+0000","last_undegraded":"2024-09-16T01:18:01.765371+0000","last_fullsized":"2024-09-16T01:18:01.765371+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:27.659510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431724+0000","last_change":"2024-09-16T01:17:59.769374+0000","last_active":"2024-09-16T01:18:02.431724+0000","last_peered":"2024-09-16T01:18:02.431724+0000","last_clean":"2024-09-16T01:18:02.431724+0000","last_became_active":"2024-09-16T01:17:59.768993+0000","last_became_peered":"2024-09-16T01:17:59.768993+0000","last_unstale":"2024-09-16T01:18:02.431724+0000","last_undegraded":"2024-09-16T01:18:02.431724+0000","last_fullsized":"2024-09-16T01:18:02.431724+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:34.308627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.431499+0000","last_change":"2024-09-16T01:18:00.782727+0000","last_active":"2024-09-16T01:18:02.431499+0000","last_peered":"2024-09-16T01:18:02.431499+0000","last_clean":"2024-09-16T01:18:02.431499+0000","last_became_active":"2024-09-16T01:18:00.782357+0000","last_became_peered":"2024-09-16T01:18:00.782357+0000","last_unstale":"2024-09-16T01:18:02.431499+0000","last_undegraded":"2024-09-16T01:18:02.431499+0000","last_fullsized":"2024-09-16T01:18:02.431499+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:52.529743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430945+0000","last_change":"2024-09-16T01:17:59.768188+0000","last_active":"2024-09-16T01:18:02.430945+0000","last_peered":"2024-09-16T01:18:02.430945+0000","last_clean":"2024-09-16T01:18:02.430945+0000","last_became_active":"2024-09-16T01:17:59.767643+0000","last_became_peered":"2024-09-16T01:17:59.767643+0000","last_unstale":"2024-09-16T01:18:02.430945+0000","last_undegraded":"2024-09-16T01:18:02.430945+0000","last_fullsized":"2024-09-16T01:18:02.430945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:28.375347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766669+0000","last_change":"2024-09-16T01:18:00.776734+0000","last_active":"2024-09-16T01:18:01.766669+0000","last_peered":"2024-09-16T01:18:01.766669+0000","last_clean":"2024-09-16T01:18:01.766669+0000","last_became_active":"2024-09-16T01:18:00.776482+0000","last_became_peered":"2024-09-16T01:18:00.776482+0000","last_unstale":"2024-09-16T01:18:01.766669+0000","last_undegraded":"2024-09-16T01:18:01.766669+0000","last_fullsized":"2024-09-16T01:18:01.766669+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:41.827484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430728+0000","last_change":"2024-09-16T01:17:59.767422+0000","last_active":"2024-09-16T01:18:02.430728+0000","last_peered":"2024-09-16T01:18:02.430728+0000","last_clean":"2024-09-16T01:18:02.430728+0000","last_became_active":"2024-09-16T01:17:59.767175+0000","last_became_peered":"2024-09-16T01:17:59.767175+0000","last_unstale":"2024-09-16T01:18:02.430728+0000","last_undegraded":"2024-09-16T01:18:02.430728+0000","last_fullsized":"2024-09-16T01:18:02.430728+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:48.925880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.768651+0000","last_change":"2024-09-16T01:18:00.768859+0000","last_active":"2024-09-16T01:18:01.768651+0000","last_peered":"2024-09-16T01:18:01.768651+0000","last_clean":"2024-09-16T01:18:01.768651+0000","last_became_active":"2024-09-16T01:18:00.768589+0000","last_became_peered":"2024-09-16T01:18:00.768589+0000","last_unstale":"2024-09-16T01:18:01.768651+0000","last_undegraded":"2024-09-16T01:18:01.768651+0000","last_fullsized":"2024-09-16T01:18:01.768651+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:15.386791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.766548+0000","last_change":"2024-09-16T01:17:59.762058+0000","last_active":"2024-09-16T01:18:01.766548+0000","last_peered":"2024-09-16T01:18:01.766548+0000","last_clean":"2024-09-16T01:18:01.766548+0000","last_became_active":"2024-09-16T01:17:59.761546+0000","last_became_peered":"2024-09-16T01:17:59.761546+0000","last_unstale":"2024-09-16T01:18:01.766548+0000","last_undegraded":"2024-09-16T01:18:01.766548+0000","last_fullsized":"2024-09-16T01:18:01.766548+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:49.510785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:01.765552+0000","last_change":"2024-09-16T01:18:00.774829+0000","last_active":"2024-09-16T01:18:01.765552+0000","last_peered":"2024-09-16T01:18:01.765552+0000","last_clean":"2024-09-16T01:18:01.765552+0000","last_became_active":"2024-09-16T01:18:00.774189+0000","last_became_peered":"2024-09-16T01:18:00.774189+0000","last_unstale":"2024-09-16T01:18:01.765552+0000","last_undegraded":"2024-09-16T01:18:01.765552+0000","last_fullsized":"2024-09-16T01:18:01.765552+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:59.738315+0000","last_clean_scrub_stamp":"2024-09-16T01:17:59.738315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:20.132662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.430495+0000","last_change":"2024-09-16T01:17:59.767019+0000","last_active":"2024-09-16T01:18:02.430495+0000","last_peered":"2024-09-16T01:18:02.430495+0000","last_clean":"2024-09-16T01:18:02.430495+0000","last_became_active":"2024-09-16T01:17:59.766757+0000","last_became_peered":"2024-09-16T01:17:59.766757+0000","last_unstale":"2024-09-16T01:18:02.430495+0000","last_undegraded":"2024-09-16T01:18:02.430495+0000","last_fullsized":"2024-09-16T01:18:02.430495+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:17:58.733922+0000","last_clean_scrub_stamp":"2024-09-16T01:17:58.733922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:03:06.144671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":249,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-09-16T01:18:02.432054+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:18:02.432054+0000","last_peered":"2024-09-16T01:18:02.432054+0000","last_clean":"2024-09-16T01:18:02.432054+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:18:02.432054+0000","last_undegraded":"2024-09-16T01:18:02.432054+0000","last_fullsized":"2024-09-16T01:18:02.432054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1372160,"data_stored":933564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":765952,"data_stored":342454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":765952,"data_stored":342442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":774144,"data_stored":344032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":749568,"data_stored":335728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":761856,"data_stored":342420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":790528,"data_stored":344796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28352,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343488,"statfs":{"total":96636764160,"available":96607731712,"internally_reserved":0,"allocated":1355776,"data_stored":932788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:18:08.436 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:18:08.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T01:18:08.537 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:18:08.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:18:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.579+0000 7f5abaf6f640 1 Processor -- start 2024-09-16T01:18:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.579+0000 7f5abaf6f640 1 -- start start 2024-09-16T01:18:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.580+0000 7f5abaf6f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ab406fe90 0x7f5ab415f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.580+0000 7f5abaf6f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ab40ae480 0x7f5ab4154c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.580+0000 7f5abaf6f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab40af800 con 0x7f5ab4070270 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.580+0000 7f5abaf6f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5ab40b0410 con 0x7f5ab406fe90 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.580+0000 7f5abaf6f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5ab40afae0 con 0x7f5ab40ae480 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.580+0000 7f5ab8d0b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ab406fe90 0x7f5ab415f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.580+0000 7f5ab8d0b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ab406fe90 0x7f5ab415f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50360/0 (socket says 172.21.15.81:50360) 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.580+0000 7f5ab8d0b640 1 -- 172.21.15.81:0/2790458865 learned_addr learned my addr 172.21.15.81:0/2790458865 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.581+0000 7f5ab950c640 1 --2- 172.21.15.81:0/2790458865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ab40ae480 0x7f5ab4154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.581+0000 7f5ab8d0b640 1 -- 172.21.15.81:0/2790458865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ab40ae480 msgr2=0x7f5ab4154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.581+0000 7f5ab8d0b640 1 --2- 172.21.15.81:0/2790458865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ab40ae480 0x7f5ab4154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.581+0000 7f5ab8d0b640 1 -- 172.21.15.81:0/2790458865 >> v1:172.21.15.102:6789/0 conn(0x7f5ab4070270 legacy=0x7f5ab40add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.581+0000 7f5ab8d0b640 1 -- 172.21.15.81:0/2790458865 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab40afdc0 con 0x7f5ab406fe90 2024-09-16T01:18:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.581+0000 7f5ab950c640 1 --2- 172.21.15.81:0/2790458865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ab40ae480 0x7f5ab4154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.581+0000 7f5ab8d0b640 1 --2- 172.21.15.81:0/2790458865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab406fe90 0x7f5ab415f560 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009870 tx=0x7f5ab002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0d52b2a32ce4bd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.582+0000 7f5aab7fe640 1 -- 172.21.15.81:0/2790458865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0037070 con 0x7f5ab406fe90 2024-09-16T01:18:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.582+0000 7f5aab7fe640 1 -- 172.21.15.81:0/2790458865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab0032440 con 0x7f5ab406fe90 2024-09-16T01:18:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.582+0000 7f5aab7fe640 1 -- 172.21.15.81:0/2790458865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0032810 con 0x7f5ab406fe90 2024-09-16T01:18:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.582+0000 7f5abaf6f640 1 -- 172.21.15.81:0/2790458865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab406fe90 msgr2=0x7f5ab415f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.582+0000 7f5abaf6f640 1 --2- 172.21.15.81:0/2790458865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab406fe90 0x7f5ab415f560 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009870 tx=0x7f5ab002a1c0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.582+0000 7f5abaf6f640 1 -- 172.21.15.81:0/2790458865 shutdown_connections 2024-09-16T01:18:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.582+0000 7f5abaf6f640 1 --2- 172.21.15.81:0/2790458865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ab40ae480 0x7f5ab4154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.582+0000 7f5abaf6f640 1 --2- 172.21.15.81:0/2790458865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab406fe90 0x7f5ab415f560 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.582+0000 7f5abaf6f640 1 -- 172.21.15.81:0/2790458865 >> 172.21.15.81:0/2790458865 conn(0x7f5ab4073590 msgr2=0x7f5ab406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.582+0000 7f5abaf6f640 1 -- 172.21.15.81:0/2790458865 shutdown_connections 2024-09-16T01:18:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.582+0000 7f5abaf6f640 1 -- 172.21.15.81:0/2790458865 wait complete. 2024-09-16T01:18:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.583+0000 7f5abaf6f640 1 Processor -- start 2024-09-16T01:18:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.583+0000 7f5abaf6f640 1 -- start start 2024-09-16T01:18:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.584+0000 7f5abaf6f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ab406fe90 0x7f5ab4150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.584+0000 7f5abaf6f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab4070270 0x7f5ab40cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.584+0000 7f5abaf6f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ab40ae480 0x7f5ab40cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.584+0000 7f5abaf6f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab40ae9f0 con 0x7f5ab4070270 2024-09-16T01:18:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.584+0000 7f5abaf6f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab40af490 con 0x7f5ab40ae480 2024-09-16T01:18:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.584+0000 7f5abaf6f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5ab40aeb70 con 0x7f5ab406fe90 2024-09-16T01:18:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.584+0000 7f5aabfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab4070270 0x7f5ab40cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.584+0000 7f5aabfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab4070270 0x7f5ab40cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50366/0 (socket says 172.21.15.81:50366) 2024-09-16T01:18:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.584+0000 7f5aabfff640 1 -- 172.21.15.81:0/3334640080 learned_addr learned my addr 172.21.15.81:0/3334640080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.584+0000 7f5ab950c640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ab40ae480 0x7f5ab40cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.584+0000 7f5ab8d0b640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ab406fe90 0x7f5ab4150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.585+0000 7f5aabfff640 1 -- 172.21.15.81:0/3334640080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ab406fe90 msgr2=0x7f5ab4150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.585+0000 7f5aabfff640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ab406fe90 0x7f5ab4150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.585+0000 7f5aabfff640 1 -- 172.21.15.81:0/3334640080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ab40ae480 msgr2=0x7f5ab40cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.585+0000 7f5aabfff640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ab40ae480 0x7f5ab40cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.585+0000 7f5aabfff640 1 -- 172.21.15.81:0/3334640080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab40ce150 con 0x7f5ab4070270 2024-09-16T01:18:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.585+0000 7f5aabfff640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab4070270 0x7f5ab40cf200 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400c400 tx=0x7f5aa400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.585+0000 7f5aa97fa640 1 -- 172.21.15.81:0/3334640080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40052d0 con 0x7f5ab4070270 2024-09-16T01:18:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.585+0000 7f5aa97fa640 1 -- 172.21.15.81:0/3334640080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa4005490 con 0x7f5ab4070270 2024-09-16T01:18:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.585+0000 7f5aa97fa640 1 -- 172.21.15.81:0/3334640080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4007260 con 0x7f5ab4070270 2024-09-16T01:18:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.585+0000 7f5abaf6f640 1 -- 172.21.15.81:0/3334640080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab40ce430 con 0x7f5ab4070270 2024-09-16T01:18:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.585+0000 7f5abaf6f640 1 -- 172.21.15.81:0/3334640080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab4158040 con 0x7f5ab4070270 2024-09-16T01:18:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.586+0000 7f5abaf6f640 1 -- 172.21.15.81:0/3334640080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab40ce600 con 0x7f5ab4070270 2024-09-16T01:18:08.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.587+0000 7f5aa97fa640 1 -- 172.21.15.81:0/3334640080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5aa4007400 con 0x7f5ab4070270 2024-09-16T01:18:08.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.587+0000 7f5aa97fa640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5aa006c2b0 0x7f5aa006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.587+0000 7f5aa97fa640 1 -- 172.21.15.81:0/3334640080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f5aa408a9c0 con 0x7f5ab4070270 2024-09-16T01:18:08.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.587+0000 7f5ab8d0b640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5aa006c2b0 0x7f5aa006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.587+0000 7f5ab8d0b640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5aa006c2b0 0x7f5aa006e770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0034000 tx=0x7f5ab002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:08.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.591+0000 7f5aa97fa640 1 -- 172.21.15.81:0/3334640080 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5aa408ce20 con 0x7f5ab4070270 2024-09-16T01:18:08.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.826+0000 7f5abaf6f640 1 -- 172.21.15.81:0/3334640080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5ab415f560 con 0x7f5ab4070270 2024-09-16T01:18:08.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.828+0000 7f5aa97fa640 1 -- 172.21.15.81:0/3334640080 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f5aa40589e0 con 0x7f5ab4070270 2024-09-16T01:18:08.829 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-16T01:18:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg== 2024-09-16T01:18:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-16T01:18:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-16T01:18:08.830 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T01:18:08.830 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-16T01:18:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.830+0000 7f5abaf6f640 1 -- 172.21.15.81:0/3334640080 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5aa006c2b0 msgr2=0x7f5aa006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.830+0000 7f5abaf6f640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5aa006c2b0 0x7f5aa006e770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0034000 tx=0x7f5ab002e000 comp rx=0 tx=0).stop 2024-09-16T01:18:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.830+0000 7f5abaf6f640 1 -- 172.21.15.81:0/3334640080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab4070270 msgr2=0x7f5ab40cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.830+0000 7f5abaf6f640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab4070270 0x7f5ab40cf200 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400c400 tx=0x7f5aa400c8c0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.830+0000 7f5abaf6f640 1 -- 172.21.15.81:0/3334640080 shutdown_connections 2024-09-16T01:18:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.830+0000 7f5abaf6f640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5aa006c2b0 0x7f5aa006e770 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.830+0000 7f5abaf6f640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ab40ae480 0x7f5ab40cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.830+0000 7f5abaf6f640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab4070270 0x7f5ab40cf200 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.830+0000 7f5abaf6f640 1 --2- 172.21.15.81:0/3334640080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ab406fe90 0x7f5ab4150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.830+0000 7f5abaf6f640 1 -- 172.21.15.81:0/3334640080 >> 172.21.15.81:0/3334640080 conn(0x7f5ab4073590 msgr2=0x7f5ab406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.830+0000 7f5abaf6f640 1 -- 172.21.15.81:0/3334640080 shutdown_connections 2024-09-16T01:18:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.830+0000 7f5abaf6f640 1 -- 172.21.15.81:0/3334640080 wait complete. 2024-09-16T01:18:08.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.978+0000 7f080412a640 1 Processor -- start 2024-09-16T01:18:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.978+0000 7f080412a640 1 -- start start 2024-09-16T01:18:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.979+0000 7f080412a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07fc0af560 0x7f07fc1691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.979+0000 7f080412a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07fc06cb30 con 0x7f07fc0d04a0 2024-09-16T01:18:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.979+0000 7f080412a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07fc06bfb0 con 0x7f07fc147360 2024-09-16T01:18:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.979+0000 7f080412a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f07fc06c290 con 0x7f07fc0af560 2024-09-16T01:18:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.979+0000 7f08026c7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07fc0af560 0x7f07fc1691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.979+0000 7f08016c5640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f07fc0d04a0 0x7f07fc0d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53264/0 (socket says 172.21.15.81:53264) 2024-09-16T01:18:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.979+0000 7f08026c7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f07fc0af560 0x7f07fc1691e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50370/0 (socket says 172.21.15.81:50370) 2024-09-16T01:18:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.979+0000 7f08016c5640 1 -- 172.21.15.81:0/2156787991 learned_addr learned my addr 172.21.15.81:0/2156787991 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.980+0000 7f08026c7640 1 -- 172.21.15.81:0/2156787991 >> v1:172.21.15.102:6789/0 conn(0x7f07fc147360 legacy=0x7f07fc070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.980+0000 7f08026c7640 1 -- 172.21.15.81:0/2156787991 >> v1:172.21.15.81:6789/0 conn(0x7f07fc0d04a0 legacy=0x7f07fc0d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.980+0000 7f08026c7640 1 -- 172.21.15.81:0/2156787991 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc06c570 con 0x7f07fc0af560 2024-09-16T01:18:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.980+0000 7f08026c7640 1 --2- 172.21.15.81:0/2156787991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc0af560 0x7f07fc1691e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009d90 tx=0x7f07f402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ffede07cb6fa6a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.980+0000 7f0800ec4640 1 -- 172.21.15.81:0/2156787991 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4031600 con 0x7f07fc0af560 2024-09-16T01:18:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.980+0000 7f0800ec4640 1 -- 172.21.15.81:0/2156787991 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f40317a0 con 0x7f07fc0af560 2024-09-16T01:18:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.980+0000 7f0800ec4640 1 -- 172.21.15.81:0/2156787991 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4031b70 con 0x7f07fc0af560 2024-09-16T01:18:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.981+0000 7f080412a640 1 -- 172.21.15.81:0/2156787991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc0af560 msgr2=0x7f07fc1691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.981+0000 7f080412a640 1 --2- 172.21.15.81:0/2156787991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc0af560 0x7f07fc1691e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009d90 tx=0x7f07f402a610 comp rx=0 tx=0).stop 2024-09-16T01:18:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.981+0000 7f080412a640 1 -- 172.21.15.81:0/2156787991 shutdown_connections 2024-09-16T01:18:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.981+0000 7f080412a640 1 --2- 172.21.15.81:0/2156787991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc0af560 0x7f07fc1691e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.981+0000 7f080412a640 1 -- 172.21.15.81:0/2156787991 >> 172.21.15.81:0/2156787991 conn(0x7f07fc0b2f40 msgr2=0x7f07fc0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.981+0000 7f080412a640 1 -- 172.21.15.81:0/2156787991 shutdown_connections 2024-09-16T01:18:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.981+0000 7f080412a640 1 -- 172.21.15.81:0/2156787991 wait complete. 2024-09-16T01:18:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.982+0000 7f080412a640 1 Processor -- start 2024-09-16T01:18:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.982+0000 7f080412a640 1 -- start start 2024-09-16T01:18:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f080412a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07fc0af560 0x7f07fc141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f080412a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07fc0d04a0 0x7f07fc0b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f080412a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc147360 0x7f07fc1f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f080412a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc06bc10 con 0x7f07fc147360 2024-09-16T01:18:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f080412a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f07fc070fa0 con 0x7f07fc0d04a0 2024-09-16T01:18:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f080412a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f07fc06bd90 con 0x7f07fc0af560 2024-09-16T01:18:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f08026c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc147360 0x7f07fc1f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f08026c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc147360 0x7f07fc1f47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50380/0 (socket says 172.21.15.81:50380) 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f08026c7640 1 -- 172.21.15.81:0/574363654 learned_addr learned my addr 172.21.15.81:0/574363654 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f08016c5640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07fc0d04a0 0x7f07fc0b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f0801ec6640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07fc0af560 0x7f07fc141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f08026c7640 1 -- 172.21.15.81:0/574363654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07fc0af560 msgr2=0x7f07fc141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f08026c7640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07fc0af560 0x7f07fc141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f08026c7640 1 -- 172.21.15.81:0/574363654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07fc0d04a0 msgr2=0x7f07fc0b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f08026c7640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07fc0d04a0 0x7f07fc0b68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f08026c7640 1 -- 172.21.15.81:0/574363654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07fc0b5840 con 0x7f07fc147360 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f0801ec6640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07fc0af560 0x7f07fc141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.983+0000 7f08026c7640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc147360 0x7f07fc1f47a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009d90 tx=0x7f07f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.984+0000 7f07f27fc640 1 -- 172.21.15.81:0/574363654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4040070 con 0x7f07fc147360 2024-09-16T01:18:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.984+0000 7f07f27fc640 1 -- 172.21.15.81:0/574363654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07f4030b60 con 0x7f07fc147360 2024-09-16T01:18:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.984+0000 7f080412a640 1 -- 172.21.15.81:0/574363654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07fc0b5b20 con 0x7f07fc147360 2024-09-16T01:18:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.984+0000 7f07f27fc640 1 -- 172.21.15.81:0/574363654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f403c420 con 0x7f07fc147360 2024-09-16T01:18:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.984+0000 7f080412a640 1 -- 172.21.15.81:0/574363654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07fc0b60e0 con 0x7f07fc147360 2024-09-16T01:18:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.985+0000 7f080412a640 1 -- 172.21.15.81:0/574363654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07fc0d0910 con 0x7f07fc147360 2024-09-16T01:18:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.985+0000 7f07f27fc640 1 -- 172.21.15.81:0/574363654 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f07f4039040 con 0x7f07fc147360 2024-09-16T01:18:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.985+0000 7f07f27fc640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f07e006c2b0 0x7f07e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.986+0000 7f0801ec6640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f07e006c2b0 0x7f07e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.986+0000 7f07f27fc640 1 -- 172.21.15.81:0/574363654 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f07f40ac9b0 con 0x7f07fc147360 2024-09-16T01:18:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.986+0000 7f0801ec6640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f07e006c2b0 0x7f07e006e770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0b3d10 tx=0x7f07f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:08.990+0000 7f07f27fc640 1 -- 172.21.15.81:0/574363654 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f07f407aa90 con 0x7f07fc147360 2024-09-16T01:18:09.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.190+0000 7f080412a640 1 -- 172.21.15.81:0/574363654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07fc0b06f0 con 0x7f07fc147360 2024-09-16T01:18:09.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.190+0000 7f07f27fc640 1 -- 172.21.15.81:0/574363654 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5227 (secure 0 0 0) 0x7f07f407ed90 con 0x7f07fc147360 2024-09-16T01:18:09.193 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:09.193 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"btime":"2024-09-16T01:18:02:835480+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2000242607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2000242607},{"type":"v1","addr":"172.21.15.102:6834","nonce":2000242607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5087,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3268189429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3268189429},{"type":"v1","addr":"172.21.15.102:6835","nonce":3268189429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2730360991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2730360991},{"type":"v1","addr":"172.21.15.81:6836","nonce":2730360991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:00.081821+0000","modified":"2024-09-16T01:18:02.163419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/554158924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":554158924},{"type":"v1","addr":"172.21.15.81:6837","nonce":554158924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5667,"qdb_cluster":[5667]},"id":4}]} 2024-09-16T01:18:09.195 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-09-16T01:18:09.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.192+0000 7f080412a640 1 -- 172.21.15.81:0/574363654 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f07e006c2b0 msgr2=0x7f07e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.192+0000 7f080412a640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f07e006c2b0 0x7f07e006e770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0b3d10 tx=0x7f07f8008040 comp rx=0 tx=0).stop 2024-09-16T01:18:09.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.192+0000 7f080412a640 1 -- 172.21.15.81:0/574363654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc147360 msgr2=0x7f07fc1f47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.192+0000 7f080412a640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc147360 0x7f07fc1f47a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009d90 tx=0x7f07f4004a40 comp rx=0 tx=0).stop 2024-09-16T01:18:09.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.192+0000 7f080412a640 1 -- 172.21.15.81:0/574363654 shutdown_connections 2024-09-16T01:18:09.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.192+0000 7f080412a640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f07e006c2b0 0x7f07e006e770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.192+0000 7f080412a640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07fc147360 0x7f07fc1f47a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.192+0000 7f080412a640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f07fc0d04a0 0x7f07fc0b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.192+0000 7f080412a640 1 --2- 172.21.15.81:0/574363654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07fc0af560 0x7f07fc141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.192+0000 7f080412a640 1 -- 172.21.15.81:0/574363654 >> 172.21.15.81:0/574363654 conn(0x7f07fc0b2f40 msgr2=0x7f07fc1465e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:09.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.192+0000 7f080412a640 1 -- 172.21.15.81:0/574363654 shutdown_connections 2024-09-16T01:18:09.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.192+0000 7f080412a640 1 -- 172.21.15.81:0/574363654 wait complete. 2024-09-16T01:18:09.609 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:18:00.081821+0000', 'modified': '2024-09-16T01:18:02.163419+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5667}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5667': {'gid': 5667, 'name': 'a', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/554158924', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 554158924}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 554158924}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5667, 'qdb_cluster': [5667]} 2024-09-16T01:18:09.609 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:18:09.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-16T01:18:09.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.712+0000 7f3d01d4b640 1 Processor -- start 2024-09-16T01:18:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.712+0000 7f3d01d4b640 1 -- start start 2024-09-16T01:18:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3d01d4b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3cfc15b6b0 0x7f3cfc0b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3d01d4b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3cfc0b3670 0x7f3cfc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3d01d4b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cfc0b54f0 con 0x7f3cfc09b3c0 2024-09-16T01:18:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3d01d4b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3cfc0b5ab0 con 0x7f3cfc0b3670 2024-09-16T01:18:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3d01d4b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3cfc0b57d0 con 0x7f3cfc15b6b0 2024-09-16T01:18:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3cfb7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3cfc15b6b0 0x7f3cfc0b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3cfbfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3cfc0b3670 0x7f3cfc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3cfb7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3cfc15b6b0 0x7f3cfc0b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:44730/0 (socket says 172.21.15.81:44730) 2024-09-16T01:18:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3cfbfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3cfc0b3670 0x7f3cfc0b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:58130/0 (socket says 172.21.15.81:58130) 2024-09-16T01:18:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3cfb7fe640 1 -- 172.21.15.81:0/721320528 learned_addr learned my addr 172.21.15.81:0/721320528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3cfbfff640 1 -- 172.21.15.81:0/721320528 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3cfc15b6b0 msgr2=0x7f3cfc0b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/721320528 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3cfc15b6b0 0x7f3cfc0b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3cfbfff640 1 -- 172.21.15.81:0/721320528 >> v1:172.21.15.102:6789/0 conn(0x7f3cfc09b3c0 legacy=0x7f3cfc15df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.713+0000 7f3cfbfff640 1 -- 172.21.15.81:0/721320528 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc15d760 con 0x7f3cfc0b3670 2024-09-16T01:18:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.714+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/721320528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cfc0b3670 0x7f3cfc0b4dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009d90 tx=0x7f3cf402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=736acc5683711323 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.714+0000 7f3cfa7fc640 1 -- 172.21.15.81:0/721320528 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4007740 con 0x7f3cfc0b3670 2024-09-16T01:18:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.714+0000 7f3cfa7fc640 1 -- 172.21.15.81:0/721320528 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf40078e0 con 0x7f3cfc0b3670 2024-09-16T01:18:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.714+0000 7f3cfa7fc640 1 -- 172.21.15.81:0/721320528 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4007cb0 con 0x7f3cfc0b3670 2024-09-16T01:18:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.715+0000 7f3d01d4b640 1 -- 172.21.15.81:0/721320528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cfc0b3670 msgr2=0x7f3cfc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.715+0000 7f3d01d4b640 1 --2- 172.21.15.81:0/721320528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cfc0b3670 0x7f3cfc0b4dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009d90 tx=0x7f3cf402a660 comp rx=0 tx=0).stop 2024-09-16T01:18:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.715+0000 7f3d01d4b640 1 -- 172.21.15.81:0/721320528 shutdown_connections 2024-09-16T01:18:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.715+0000 7f3d01d4b640 1 --2- 172.21.15.81:0/721320528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cfc0b3670 0x7f3cfc0b4dd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.715+0000 7f3d01d4b640 1 --2- 172.21.15.81:0/721320528 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3cfc15b6b0 0x7f3cfc0b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.715+0000 7f3d01d4b640 1 -- 172.21.15.81:0/721320528 >> 172.21.15.81:0/721320528 conn(0x7f3cfc073490 msgr2=0x7f3cfc0b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.715+0000 7f3d01d4b640 1 -- 172.21.15.81:0/721320528 shutdown_connections 2024-09-16T01:18:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.715+0000 7f3d01d4b640 1 -- 172.21.15.81:0/721320528 wait complete. 2024-09-16T01:18:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.716+0000 7f3d01d4b640 1 Processor -- start 2024-09-16T01:18:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.716+0000 7f3d01d4b640 1 -- start start 2024-09-16T01:18:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3d01d4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cfc09b3c0 0x7f3cfc09e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3d01d4b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3cfc0b3670 0x7f3cfc14f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3d01d4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc15b6b0 0x7f3cfc157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3d01d4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc0b2d40 con 0x7f3cfc15b6b0 2024-09-16T01:18:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3d01d4b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc0b2bc0 con 0x7f3cfc09b3c0 2024-09-16T01:18:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3d01d4b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3cfc09aa30 con 0x7f3cfc0b3670 2024-09-16T01:18:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc15b6b0 0x7f3cfc157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc15b6b0 0x7f3cfc157f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50382/0 (socket says 172.21.15.81:50382) 2024-09-16T01:18:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3cfbfff640 1 -- 172.21.15.81:0/984578353 learned_addr learned my addr 172.21.15.81:0/984578353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3cfb7fe640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cfc09b3c0 0x7f3cfc09e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3cfaffd640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3cfc0b3670 0x7f3cfc14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3cfbfff640 1 -- 172.21.15.81:0/984578353 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3cfc0b3670 msgr2=0x7f3cfc14f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3cfc0b3670 0x7f3cfc14f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3cfbfff640 1 -- 172.21.15.81:0/984578353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cfc09b3c0 msgr2=0x7f3cfc09e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cfc09b3c0 0x7f3cfc09e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3cfbfff640 1 -- 172.21.15.81:0/984578353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc14fea0 con 0x7f3cfc15b6b0 2024-09-16T01:18:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.717+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc15b6b0 0x7f3cfc157f90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009eb0 tx=0x7f3cf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.718+0000 7f3cf3fff640 1 -- 172.21.15.81:0/984578353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4040070 con 0x7f3cfc15b6b0 2024-09-16T01:18:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.718+0000 7f3cf3fff640 1 -- 172.21.15.81:0/984578353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf4031c60 con 0x7f3cfc15b6b0 2024-09-16T01:18:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.718+0000 7f3d01d4b640 1 -- 172.21.15.81:0/984578353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cfc09e610 con 0x7f3cfc15b6b0 2024-09-16T01:18:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.718+0000 7f3cf3fff640 1 -- 172.21.15.81:0/984578353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4009450 con 0x7f3cfc15b6b0 2024-09-16T01:18:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.718+0000 7f3d01d4b640 1 -- 172.21.15.81:0/984578353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cfc09d640 con 0x7f3cfc15b6b0 2024-09-16T01:18:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.719+0000 7f3cf3fff640 1 -- 172.21.15.81:0/984578353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3cf4039040 con 0x7f3cfc15b6b0 2024-09-16T01:18:09.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.720+0000 7f3cf3fff640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3cdc06c2e0 0x7f3cdc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.720+0000 7f3cf3fff640 1 -- 172.21.15.81:0/984578353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f3cf40acae0 con 0x7f3cfc15b6b0 2024-09-16T01:18:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.720+0000 7f3cfb7fe640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3cdc06c2e0 0x7f3cdc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.720+0000 7f3cfb7fe640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3cdc06c2e0 0x7f3cdc06e7a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009ac0 tx=0x7f3cec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.721+0000 7f3d04bc1740 1 Processor -- start 2024-09-16T01:18:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.721+0000 7f3d04bc1740 1 -- start start 2024-09-16T01:18:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3d04bc1740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f02c0 0x55c2e7835a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3d04bc1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77eda80 0x55c2e77f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3d04bc1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 0x55c2e77ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3d04bc1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c2e7752520 con 0x55c2e77f1a50 2024-09-16T01:18:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3d04bc1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c2e76fa3e0 con 0x55c2e77eda80 2024-09-16T01:18:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3d04bc1740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55c2e774e4e0 con 0x55c2e77f02c0 2024-09-16T01:18:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 0x55c2e77ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 0x55c2e77ea8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50398/0 (socket says 172.21.15.81:50398) 2024-09-16T01:18:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3cfbfff640 1 -- 172.21.15.81:0/99522230 learned_addr learned my addr 172.21.15.81:0/99522230 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3cfbfff640 1 -- 172.21.15.81:0/99522230 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f02c0 msgr2=0x55c2e7835a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/99522230 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f02c0 0x55c2e7835a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3cfbfff640 1 -- 172.21.15.81:0/99522230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77eda80 msgr2=0x55c2e77f06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/99522230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77eda80 0x55c2e77f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3cfbfff640 1 -- 172.21.15.81:0/99522230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e77152f0 con 0x55c2e77f1a50 2024-09-16T01:18:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/99522230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 0x55c2e77ea8b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4076e20 tx=0x7f3cf404b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d59daf33704a71e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3cf17fa640 1 -- 172.21.15.81:0/99522230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf407ed70 con 0x55c2e77f1a50 2024-09-16T01:18:09.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3cf17fa640 1 -- 172.21.15.81:0/99522230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf408ee50 con 0x55c2e77f1a50 2024-09-16T01:18:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.722+0000 7f3cf17fa640 1 -- 172.21.15.81:0/99522230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40835a0 con 0x55c2e77f1a50 2024-09-16T01:18:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.723+0000 7f3d04bc1740 1 -- 172.21.15.81:0/99522230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 msgr2=0x55c2e77ea8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.723+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/99522230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 0x55c2e77ea8b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4076e20 tx=0x7f3cf404b340 comp rx=0 tx=0).stop 2024-09-16T01:18:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.723+0000 7f3d04bc1740 1 -- 172.21.15.81:0/99522230 shutdown_connections 2024-09-16T01:18:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.723+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/99522230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 0x55c2e77ea8b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.723+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/99522230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77eda80 0x55c2e77f06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.723+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/99522230 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f02c0 0x55c2e7835a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.723+0000 7f3d04bc1740 1 -- 172.21.15.81:0/99522230 >> 172.21.15.81:0/99522230 conn(0x55c2e77eca80 msgr2=0x55c2e7834f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.723+0000 7f3d04bc1740 1 -- 172.21.15.81:0/99522230 shutdown_connections 2024-09-16T01:18:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.723+0000 7f3d04bc1740 1 -- 172.21.15.81:0/99522230 wait complete. 2024-09-16T01:18:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.724+0000 7f3d04bc1740 1 -- start start 2024-09-16T01:18:09.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.724+0000 7f3d04bc1740 1 Processor -- start 2024-09-16T01:18:09.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.724+0000 7f3d04bc1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f02c0 0x55c2e7848400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.724+0000 7f3d04bc1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 0x55c2e77e97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.724+0000 7f3d04bc1740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e780eb70 0x55c2e780e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.724+0000 7f3d04bc1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c2e76fa3e0 con 0x55c2e77f1a50 2024-09-16T01:18:09.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.724+0000 7f3d04bc1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c2e76db450 con 0x55c2e77f02c0 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.724+0000 7f3d04bc1740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55c2e7752520 con 0x55c2e780eb70 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.724+0000 7f3d04bc1740 10 client.0 _ll_register_callbacks cb 0x55c2e7464ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.724+0000 7f3cfaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 0x55c2e77e97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cfaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 0x55c2e77e97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50412/0 (socket says 172.21.15.81:50412) 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cfaffd640 1 -- 172.21.15.81:0/4051639346 learned_addr learned my addr 172.21.15.81:0/4051639346 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cfaffd640 1 -- 172.21.15.81:0/4051639346 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e780eb70 msgr2=0x55c2e780e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cfb7fe640 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f02c0 0x55c2e7848400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e780eb70 0x55c2e780e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cfaffd640 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e780eb70 0x55c2e780e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cfaffd640 1 -- 172.21.15.81:0/4051639346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f02c0 msgr2=0x55c2e7848400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cfaffd640 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f02c0 0x55c2e7848400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cfaffd640 1 -- 172.21.15.81:0/4051639346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e74652d0 con 0x55c2e77f1a50 2024-09-16T01:18:09.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cfb7fe640 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f02c0 0x55c2e7848400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cfaffd640 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 0x55c2e77e97d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4001ca0 tx=0x7f3ce400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c5368a3dee44b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cda7fc640 1 -- 172.21.15.81:0/4051639346 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4019060 con 0x55c2e77f1a50 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cda7fc640 1 -- 172.21.15.81:0/4051639346 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f3ce40050d0 con 0x55c2e77f1a50 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3d04bc1740 1 -- 172.21.15.81:0/4051639346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cf408ee50 con 0x55c2e77f1a50 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cda7fc640 1 -- 172.21.15.81:0/4051639346 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3ce401f050 con 0x55c2e77f1a50 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3d04bc1740 10 client.5826 fetch_fsmap learned FSMap version 29 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3d04bc1740 1 -- 172.21.15.81:0/4051639346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55c2e752f6b0 con 0x55c2e77f1a50 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cda7fc640 1 -- 172.21.15.81:0/4051639346 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf408ee50 con 0x55c2e77f1a50 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3cda7fc640 1 -- 172.21.15.81:0/4051639346 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f3ce4022020 con 0x55c2e77f1a50 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3d04bc1740 10 client.5826 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3d04bc1740 10 client.5826 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3d04bc1740 20 client.5826 populate_metadata read hostname 'smithi081' 2024-09-16T01:18:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.81:6834/554158924,v1:172.21.15.81:6837/554158924] conn(0x55c2e780f9a0 0x55c2e780fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.725+0000 7f3d04bc1740 4 client.5826 mds_command: new command op to 5667 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.726+0000 7f3d04bc1740 1 -- 172.21.15.81:0/4051639346 --> [v2:172.21.15.81:6834/554158924,v1:172.21.15.81:6837/554158924] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2e775fc50 con 0x55c2e780f9a0 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.726+0000 7f3cfb7fe640 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.81:6834/554158924,v1:172.21.15.81:6837/554158924] conn(0x55c2e780f9a0 0x55c2e780fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.726+0000 7f3cda7fc640 10 client.5826 ms_handle_connect on v2:172.21.15.81:6834/554158924 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.726+0000 7f3cfb7fe640 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.81:6834/554158924,v1:172.21.15.81:6837/554158924] conn(0x55c2e780f9a0 0x55c2e780fd80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b028509e8ceb2b33 server_cookie=33147eb8c0c6042c in_seq=0 out_seq=0 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3cda7fc640 1 -- 172.21.15.81:0/4051639346 <== mds.0 v2:172.21.15.81:6834/554158924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2e775fc50 con 0x55c2e780f9a0 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3cda7fc640 10 client.5826 handle_command_reply: tid=0 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3d04bc1740 1 client.5826 shutdown 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3d04bc1740 1 -- 172.21.15.81:0/4051639346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 msgr2=0x55c2e77e97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 0x55c2e77e97d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4001ca0 tx=0x7f3ce400e530 comp rx=0 tx=0).stop 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3d04bc1740 1 -- 172.21.15.81:0/4051639346 shutdown_connections 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.81:6834/554158924,v1:172.21.15.81:6837/554158924] conn(0x55c2e780f9a0 0x55c2e780fd80 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e780eb70 0x55c2e780e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e77f1a50 0x55c2e77e97d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/4051639346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f02c0 0x55c2e7848400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3cda7fc640 0 client.5826 ms_handle_reset on v2:172.21.15.81:6834/554158924 2024-09-16T01:18:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3d04bc1740 1 -- 172.21.15.81:0/4051639346 >> 172.21.15.81:0/4051639346 conn(0x55c2e77eda80 msgr2=0x55c2e7836110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3d04bc1740 1 -- 172.21.15.81:0/4051639346 shutdown_connections 2024-09-16T01:18:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3d04bc1740 1 -- 172.21.15.81:0/4051639346 wait complete. 2024-09-16T01:18:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.727+0000 7f3d04bc1740 20 client.5826 trim_cache size 0 max 16384 2024-09-16T01:18:09.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.745+0000 7f3d04bc1740 1 Processor -- start 2024-09-16T01:18:09.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.745+0000 7f3d04bc1740 1 -- start start 2024-09-16T01:18:09.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3d04bc1740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f02c0 0x55c2e7847de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3d04bc1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f1a50 0x55c2e77eb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3d04bc1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 0x55c2e781a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3d04bc1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc200230 con 0x55c2e780eb70 2024-09-16T01:18:09.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3d04bc1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc167e10 con 0x55c2e77f1a50 2024-09-16T01:18:09.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3d04bc1740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3cfc168460 con 0x55c2e77f02c0 2024-09-16T01:18:09.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 0x55c2e781a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 0x55c2e781a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50424/0 (socket says 172.21.15.81:50424) 2024-09-16T01:18:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3cfbfff640 1 -- 172.21.15.81:0/875230876 learned_addr learned my addr 172.21.15.81:0/875230876 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3cfbfff640 1 -- 172.21.15.81:0/875230876 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f02c0 msgr2=0x55c2e7847de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/875230876 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f02c0 0x55c2e7847de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3cfbfff640 1 -- 172.21.15.81:0/875230876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f1a50 msgr2=0x55c2e77eb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/875230876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f1a50 0x55c2e77eb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3cfbfff640 1 -- 172.21.15.81:0/875230876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e7835a10 con 0x55c2e780eb70 2024-09-16T01:18:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/875230876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 0x55c2e781a0f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4076e20 tx=0x7f3cf407c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1367dba1c1948bb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3cf0ff9640 1 -- 172.21.15.81:0/875230876 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf408fe60 con 0x55c2e780eb70 2024-09-16T01:18:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3cf0ff9640 1 -- 172.21.15.81:0/875230876 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf407ed70 con 0x55c2e780eb70 2024-09-16T01:18:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.746+0000 7f3cf0ff9640 1 -- 172.21.15.81:0/875230876 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4078cc0 con 0x55c2e780eb70 2024-09-16T01:18:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.747+0000 7f3d04bc1740 1 -- 172.21.15.81:0/875230876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 msgr2=0x55c2e781a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.747+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/875230876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 0x55c2e781a0f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4076e20 tx=0x7f3cf407c000 comp rx=0 tx=0).stop 2024-09-16T01:18:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.747+0000 7f3d04bc1740 1 -- 172.21.15.81:0/875230876 shutdown_connections 2024-09-16T01:18:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.747+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/875230876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 0x55c2e781a0f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.747+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/875230876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f1a50 0x55c2e77eb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.747+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/875230876 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f02c0 0x55c2e7847de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.747+0000 7f3d04bc1740 1 -- 172.21.15.81:0/875230876 >> 172.21.15.81:0/875230876 conn(0x55c2e77eda80 msgr2=0x55c2e77ee020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.747+0000 7f3d04bc1740 1 -- 172.21.15.81:0/875230876 shutdown_connections 2024-09-16T01:18:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.747+0000 7f3d04bc1740 1 -- 172.21.15.81:0/875230876 wait complete. 2024-09-16T01:18:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.747+0000 7f3d04bc1740 1 -- start start 2024-09-16T01:18:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.748+0000 7f3d04bc1740 1 Processor -- start 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.748+0000 7f3d04bc1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f02c0 0x55c2e7816a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.748+0000 7f3d04bc1740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f1a50 0x55c2e78b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.748+0000 7f3d04bc1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 0x55c2e7834620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.748+0000 7f3d04bc1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55c2e7811690 con 0x55c2e780eb70 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.748+0000 7f3d04bc1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c2e77e9e10 con 0x55c2e77f02c0 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.748+0000 7f3d04bc1740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55c2e77ee9d0 con 0x55c2e77f1a50 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.748+0000 7f3d04bc1740 10 client.0 _ll_register_callbacks cb 0x7f3ce4007d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.748+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 0x55c2e7834620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.748+0000 7f3cfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 0x55c2e7834620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50438/0 (socket says 172.21.15.81:50438) 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.748+0000 7f3cfbfff640 1 -- 172.21.15.81:0/1596359099 learned_addr learned my addr 172.21.15.81:0/1596359099 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cfb7fe640 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f02c0 0x55c2e7816a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cfaffd640 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f1a50 0x55c2e78b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cfbfff640 1 -- 172.21.15.81:0/1596359099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f1a50 msgr2=0x55c2e78b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f1a50 0x55c2e78b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cfbfff640 1 -- 172.21.15.81:0/1596359099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f02c0 msgr2=0x55c2e7816a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f02c0 0x55c2e7816a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cfbfff640 1 -- 172.21.15.81:0/1596359099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e7835170 con 0x55c2e780eb70 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cfaffd640 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f1a50 0x55c2e78b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cfbfff640 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 0x55c2e7834620 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009e80 tx=0x7f3cf4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae77161f5edb2a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cda7fc640 1 -- 172.21.15.81:0/1596359099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4077030 con 0x55c2e780eb70 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cda7fc640 1 -- 172.21.15.81:0/1596359099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f3cf4081070 con 0x55c2e780eb70 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3d04bc1740 1 -- 172.21.15.81:0/1596359099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cf407ed70 con 0x55c2e780eb70 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cda7fc640 1 -- 172.21.15.81:0/1596359099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3cf40771d0 con 0x55c2e780eb70 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3d04bc1740 10 client.5832 fetch_fsmap learned FSMap version 29 2024-09-16T01:18:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3d04bc1740 1 -- 172.21.15.81:0/1596359099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55c2e78b3160 con 0x55c2e780eb70 2024-09-16T01:18:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cda7fc640 1 -- 172.21.15.81:0/1596359099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf407ed70 con 0x55c2e780eb70 2024-09-16T01:18:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3cda7fc640 1 -- 172.21.15.81:0/1596359099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f3cf4083110 con 0x55c2e780eb70 2024-09-16T01:18:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3d04bc1740 10 client.5832 fetch_fsmap finished waiting for FSMap version 29 2024-09-16T01:18:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3d04bc1740 10 client.5832 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:18:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3d04bc1740 20 client.5832 populate_metadata read hostname 'smithi081' 2024-09-16T01:18:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.81:6834/554158924,v1:172.21.15.81:6837/554158924] conn(0x55c2e781a5e0 0x55c2e77ede60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3d04bc1740 4 client.5832 mds_command: new command op to 5667 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:18:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.749+0000 7f3d04bc1740 1 -- 172.21.15.81:0/1596359099 --> [v2:172.21.15.81:6834/554158924,v1:172.21.15.81:6837/554158924] -- command(tid 0: {"prefix": "status"}) -- 0x55c2e7818e90 con 0x55c2e781a5e0 2024-09-16T01:18:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3cfb7fe640 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.81:6834/554158924,v1:172.21.15.81:6837/554158924] conn(0x55c2e781a5e0 0x55c2e77ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3cda7fc640 10 client.5832 ms_handle_connect on v2:172.21.15.81:6834/554158924 2024-09-16T01:18:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3cfb7fe640 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.81:6834/554158924,v1:172.21.15.81:6837/554158924] conn(0x55c2e781a5e0 0x55c2e77ede60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=819e0bb957b15ef9 server_cookie=4f130efa9c2ddb9e in_seq=0 out_seq=0 2024-09-16T01:18:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3cda7fc640 1 -- 172.21.15.81:0/1596359099 <== mds.0 v2:172.21.15.81:6834/554158924 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c2e7818e90 con 0x55c2e781a5e0 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3cda7fc640 10 client.5832 handle_command_reply: tid=0 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3d04bc1740 1 client.5832 shutdown 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3d04bc1740 1 -- 172.21.15.81:0/1596359099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 msgr2=0x55c2e7834620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 0x55c2e7834620 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009e80 tx=0x7f3cf4009750 comp rx=0 tx=0).stop 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3d04bc1740 1 -- 172.21.15.81:0/1596359099 shutdown_connections 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.81:6834/554158924,v1:172.21.15.81:6837/554158924] conn(0x55c2e781a5e0 0x55c2e77ede60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2e780eb70 0x55c2e7834620 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c2e77f1a50 0x55c2e78b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3cda7fc640 0 client.5832 ms_handle_reset on v2:172.21.15.81:6834/554158924 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3d04bc1740 1 --2- 172.21.15.81:0/1596359099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2e77f02c0 0x55c2e7816a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3d04bc1740 1 -- 172.21.15.81:0/1596359099 >> 172.21.15.81:0/1596359099 conn(0x55c2e77eda80 msgr2=0x55c2e7847de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3d04bc1740 1 -- 172.21.15.81:0/1596359099 shutdown_connections 2024-09-16T01:18:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3d04bc1740 1 -- 172.21.15.81:0/1596359099 wait complete. 2024-09-16T01:18:09.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.750+0000 7f3d04bc1740 20 client.5832 trim_cache size 0 max 16384 2024-09-16T01:18:09.759 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:18:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973", 2024-09-16T01:18:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-16T01:18:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5667, 2024-09-16T01:18:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-16T01:18:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-16T01:18:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-16T01:18:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 8.9899421099999994, 2024-09-16T01:18:09.759 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 29, 2024-09-16T01:18:09.760 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 63, 2024-09-16T01:18:09.760 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 63, 2024-09-16T01:18:09.760 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.065790208999999 2024-09-16T01:18:09.760 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:18:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.751+0000 7f3d01d4b640 1 -- 172.21.15.81:0/984578353 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3cdc06c2e0 msgr2=0x7f3cdc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.751+0000 7f3d01d4b640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3cdc06c2e0 0x7f3cdc06e7a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009ac0 tx=0x7f3cec008040 comp rx=0 tx=0).stop 2024-09-16T01:18:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.751+0000 7f3d01d4b640 1 -- 172.21.15.81:0/984578353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc15b6b0 msgr2=0x7f3cfc157f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.751+0000 7f3d01d4b640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc15b6b0 0x7f3cfc157f90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009eb0 tx=0x7f3cf4004a40 comp rx=0 tx=0).stop 2024-09-16T01:18:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.751+0000 7f3d01d4b640 1 -- 172.21.15.81:0/984578353 shutdown_connections 2024-09-16T01:18:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.751+0000 7f3d01d4b640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3cdc06c2e0 0x7f3cdc06e7a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.751+0000 7f3d01d4b640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cfc15b6b0 0x7f3cfc157f90 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.751+0000 7f3d01d4b640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3cfc0b3670 0x7f3cfc14f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.751+0000 7f3d01d4b640 1 --2- 172.21.15.81:0/984578353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3cfc09b3c0 0x7f3cfc09e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.751+0000 7f3d01d4b640 1 -- 172.21.15.81:0/984578353 >> 172.21.15.81:0/984578353 conn(0x7f3cfc073490 msgr2=0x7f3cfc152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.751+0000 7f3d01d4b640 1 -- 172.21.15.81:0/984578353 shutdown_connections 2024-09-16T01:18:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.751+0000 7f3d01d4b640 1 -- 172.21.15.81:0/984578353 wait complete. 2024-09-16T01:18:09.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:18:09.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.859+0000 7fa45a99f640 1 Processor -- start 2024-09-16T01:18:09.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.859+0000 7fa45a99f640 1 -- start start 2024-09-16T01:18:09.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa45a99f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa454072de0 0x7fa45415d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa45a99f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa454072700 0x7fa45415d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa45a99f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa454146140 con 0x7fa454072320 2024-09-16T01:18:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa45a99f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa4540cd740 con 0x7fa454072de0 2024-09-16T01:18:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa45a99f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa4540cda20 con 0x7fa454072700 2024-09-16T01:18:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa4537fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa454072de0 0x7fa45415d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa453fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa454072320 0x7fa4540cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53276/0 (socket says 172.21.15.81:53276) 2024-09-16T01:18:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa453fff640 1 -- 172.21.15.81:0/1174832772 learned_addr learned my addr 172.21.15.81:0/1174832772 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa458f3c640 1 --2- 172.21.15.81:0/1174832772 >> v2:172.21.15.102:3300/0 conn(0x7fa454072700 0x7fa45415d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa4537fe640 1 -- 172.21.15.81:0/1174832772 >> v2:172.21.15.102:3300/0 conn(0x7fa454072700 msgr2=0x7fa45415d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa4537fe640 1 --2- 172.21.15.81:0/1174832772 >> v2:172.21.15.102:3300/0 conn(0x7fa454072700 0x7fa45415d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa4537fe640 1 -- 172.21.15.81:0/1174832772 >> v1:172.21.15.81:6789/0 conn(0x7fa454072320 legacy=0x7fa4540cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.860+0000 7fa4537fe640 1 -- 172.21.15.81:0/1174832772 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4540cdd00 con 0x7fa454072de0 2024-09-16T01:18:09.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.861+0000 7fa4537fe640 1 --2- 172.21.15.81:0/1174832772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454072de0 0x7fa45415d1e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa4540cfce0 tx=0x7fa43c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18c05d8797b43fc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:09.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.861+0000 7fa452ffd640 1 -- 172.21.15.81:0/1174832772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c037070 con 0x7fa454072de0 2024-09-16T01:18:09.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.861+0000 7fa452ffd640 1 -- 172.21.15.81:0/1174832772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa43c032440 con 0x7fa454072de0 2024-09-16T01:18:09.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.861+0000 7fa452ffd640 1 -- 172.21.15.81:0/1174832772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c02ae60 con 0x7fa454072de0 2024-09-16T01:18:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.862+0000 7fa45a99f640 1 -- 172.21.15.81:0/1174832772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454072de0 msgr2=0x7fa45415d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.862+0000 7fa45a99f640 1 --2- 172.21.15.81:0/1174832772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454072de0 0x7fa45415d1e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa4540cfce0 tx=0x7fa43c02a110 comp rx=0 tx=0).stop 2024-09-16T01:18:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.862+0000 7fa45a99f640 1 -- 172.21.15.81:0/1174832772 shutdown_connections 2024-09-16T01:18:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.862+0000 7fa45a99f640 1 --2- 172.21.15.81:0/1174832772 >> v2:172.21.15.102:3300/0 conn(0x7fa454072700 0x7fa45415d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.862+0000 7fa45a99f640 1 --2- 172.21.15.81:0/1174832772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454072de0 0x7fa45415d1e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.862+0000 7fa45a99f640 1 -- 172.21.15.81:0/1174832772 >> 172.21.15.81:0/1174832772 conn(0x7fa454067d70 msgr2=0x7fa45406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.862+0000 7fa45a99f640 1 -- 172.21.15.81:0/1174832772 shutdown_connections 2024-09-16T01:18:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.862+0000 7fa45a99f640 1 -- 172.21.15.81:0/1174832772 wait complete. 2024-09-16T01:18:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.863+0000 7fa45a99f640 1 Processor -- start 2024-09-16T01:18:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.863+0000 7fa45a99f640 1 -- start start 2024-09-16T01:18:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa45a99f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454072320 0x7fa4540cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa45a99f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa454072700 0x7fa4541f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa45a99f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa454072de0 0x7fa4540cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa45a99f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa45415dde0 con 0x7fa454072320 2024-09-16T01:18:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa45a99f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa45415dc60 con 0x7fa454072700 2024-09-16T01:18:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa45a99f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa45415df60 con 0x7fa454072de0 2024-09-16T01:18:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa453fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454072320 0x7fa4540cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa453fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454072320 0x7fa4540cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50450/0 (socket says 172.21.15.81:50450) 2024-09-16T01:18:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa453fff640 1 -- 172.21.15.81:0/3501150422 learned_addr learned my addr 172.21.15.81:0/3501150422 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa453fff640 1 -- 172.21.15.81:0/3501150422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa454072de0 msgr2=0x7fa4540cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa453fff640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa454072de0 0x7fa4540cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa453fff640 1 -- 172.21.15.81:0/3501150422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa454072700 msgr2=0x7fa4541f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa4537fe640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa454072700 0x7fa4541f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa453fff640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa454072700 0x7fa4541f3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa453fff640 1 -- 172.21.15.81:0/3501150422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4540cc490 con 0x7fa454072320 2024-09-16T01:18:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa453fff640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454072320 0x7fa4540cbf50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c400 tx=0x7fa44400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa450ff9640 1 -- 172.21.15.81:0/3501150422 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444017070 con 0x7fa454072320 2024-09-16T01:18:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa450ff9640 1 -- 172.21.15.81:0/3501150422 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa444005ce0 con 0x7fa454072320 2024-09-16T01:18:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa450ff9640 1 -- 172.21.15.81:0/3501150422 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4440072f0 con 0x7fa454072320 2024-09-16T01:18:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.864+0000 7fa45a99f640 1 -- 172.21.15.81:0/3501150422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa454134720 con 0x7fa454072320 2024-09-16T01:18:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.865+0000 7fa45a99f640 1 -- 172.21.15.81:0/3501150422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa454134fc0 con 0x7fa454072320 2024-09-16T01:18:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.865+0000 7fa45a99f640 1 -- 172.21.15.81:0/3501150422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa45415e320 con 0x7fa454072320 2024-09-16T01:18:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.866+0000 7fa450ff9640 1 -- 172.21.15.81:0/3501150422 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa44401a070 con 0x7fa454072320 2024-09-16T01:18:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.866+0000 7fa450ff9640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa43406c2b0 0x7fa43406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.867+0000 7fa450ff9640 1 -- 172.21.15.81:0/3501150422 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fa44408a9f0 con 0x7fa454072320 2024-09-16T01:18:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.867+0000 7fa4537fe640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa43406c2b0 0x7fa43406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.867+0000 7fa4537fe640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa43406c2b0 0x7fa43406e770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa43c034000 tx=0x7fa43c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:09.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:09.871+0000 7fa450ff9640 1 -- 172.21.15.81:0/3501150422 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa444058fd0 con 0x7fa454072320 2024-09-16T01:18:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.070+0000 7fa45a99f640 1 -- 172.21.15.81:0/3501150422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa4540b35d0 con 0x7fa454072320 2024-09-16T01:18:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.071+0000 7fa450ff9640 1 -- 172.21.15.81:0/3501150422 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+73 (secure 0 0 0) 0x7fa44408a020 con 0x7fa454072320 2024-09-16T01:18:10.073 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:18:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.073+0000 7fa45a99f640 1 -- 172.21.15.81:0/3501150422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa43406c2b0 msgr2=0x7fa43406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.073+0000 7fa45a99f640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa43406c2b0 0x7fa43406e770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa43c034000 tx=0x7fa43c02e000 comp rx=0 tx=0).stop 2024-09-16T01:18:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.073+0000 7fa45a99f640 1 -- 172.21.15.81:0/3501150422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454072320 msgr2=0x7fa4540cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.073+0000 7fa45a99f640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454072320 0x7fa4540cbf50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa44400c400 tx=0x7fa44400c8c0 comp rx=0 tx=0).stop 2024-09-16T01:18:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.073+0000 7fa45a99f640 1 -- 172.21.15.81:0/3501150422 shutdown_connections 2024-09-16T01:18:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.073+0000 7fa45a99f640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa43406c2b0 0x7fa43406e770 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.073+0000 7fa45a99f640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa454072de0 0x7fa4540cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.073+0000 7fa45a99f640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa454072700 0x7fa4541f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.073+0000 7fa45a99f640 1 --2- 172.21.15.81:0/3501150422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454072320 0x7fa4540cbf50 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.073+0000 7fa45a99f640 1 -- 172.21.15.81:0/3501150422 >> 172.21.15.81:0/3501150422 conn(0x7fa454067d70 msgr2=0x7fa4540b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.073+0000 7fa45a99f640 1 -- 172.21.15.81:0/3501150422 shutdown_connections 2024-09-16T01:18:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.073+0000 7fa45a99f640 1 -- 172.21.15.81:0/3501150422 wait complete. 2024-09-16T01:18:10.085 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:18:10.086 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:18:10.087 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:18:10.087 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:18:10.087 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:18:10.087 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:18:10.087 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:18:10.087 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:18:10.087 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:18:10.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:10.088 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:18:10.104 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:18:10.104 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:18:10.104 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:18:10.105 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:10.105 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:18:10.105 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:10.105 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:18:10.105 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:10.105 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:18:10.105 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:18:10.105 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:10.106 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:18:10.106 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:18:10.106 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:10.106 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:18:10.106 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:10.106 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:18:10.106 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42648sec preferred_lft 42648sec 2024-09-16T01:18:10.106 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:18:10.106 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:10.106 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:18:10.106 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:10.107 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:18:10.107 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:10.107 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::bc22:19ff:fe0c:8fb1/64 scope link 2024-09-16T01:18:10.107 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:10.107 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:18:10.107 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 86:bb:d8:38:80:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:18:10.107 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::84bb:d8ff:fe38:80af/64 scope link 2024-09-16T01:18:10.107 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:10.107 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:18:10.107 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:18:10.107 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::828:dff:febd:ee39/64 scope link 2024-09-16T01:18:10.107 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:10.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:10.108 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:18:10.168 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:18:10.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:10.170 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:18:10.226 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:18:10.227 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:18:10.227 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:18:10.227 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:18:10.227 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:18:10.227 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:18:10.227 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:18:10.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:18:10.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:18:10.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:18:10.228 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:18:10.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:18:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:18:10.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:10.352 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:18:10.367 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:18:10.367 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:18:10.368 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:18:10.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:10.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-16T01:18:10.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:18:10.433 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:18:10.488 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:18:10.489 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:18:10.489 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:18:10.543 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:18:10.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:10.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:18:10.627 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:18:10.627 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:18:10.627 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:18:10.636 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:18:10.636 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:18:10.636 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:18:10.636 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:18:10.636 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:18:10.641 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:18:10.641 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:18:10.641 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:18:10.641 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:18:10.641 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:18:10.642 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:18:10.642 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:18:10.642 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:18:10.642 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:18:10.642 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:18:10.643 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:18:10.643 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:18:10.643 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:18:10.644 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:18:10.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:10.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:18:10.710 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:18:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:18:10.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:18:10.810 INFO:teuthology.orchestra.run.smithi081.stdout:client5168 2024-09-16T01:18:10.810 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:10.810 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:10.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:18:10.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.964+0000 7fb8ccbb7640 1 Processor -- start 2024-09-16T01:18:10.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.964+0000 7fb8ccbb7640 1 -- start start 2024-09-16T01:18:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.965+0000 7fb8ccbb7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb8c80d0cf0 0x7fb8c81690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.965+0000 7fb8ccbb7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8c80d12c0 con 0x7fb8c8071750 2024-09-16T01:18:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.965+0000 7fb8ccbb7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8c80d15a0 con 0x7fb8c809aca0 2024-09-16T01:18:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.965+0000 7fb8ccbb7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb8c806d040 con 0x7fb8c80d0cf0 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.965+0000 7fb8c5d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb8c8071750 0x7fb8c80d05e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53282/0 (socket says 172.21.15.81:53282) 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.965+0000 7fb8c5d9b640 1 -- 172.21.15.81:0/2611775070 learned_addr learned my addr 172.21.15.81:0/2611775070 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c6d9d640 1 --2- 172.21.15.81:0/2611775070 >> v2:172.21.15.102:3300/0 conn(0x7fb8c80d0cf0 0x7fb8c81690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1973314127 0 0) 0x7fb8c80d12c0 con 0x7fb8c8071750 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8b4003520 con 0x7fb8c8071750 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2985197018 0 0) 0x7fb8b4003520 con 0x7fb8c8071750 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 >> v2:172.21.15.102:3300/0 conn(0x7fb8c80d0cf0 msgr2=0x7fb8c81690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 --2- 172.21.15.81:0/2611775070 >> v2:172.21.15.102:3300/0 conn(0x7fb8c80d0cf0 0x7fb8c81690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 >> v1:172.21.15.102:6789/0 conn(0x7fb8c809aca0 legacy=0x7fb8c809b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c80d1880 con 0x7fb8c8071750 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fb8b0001670 con 0x7fb8c8071750 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 >> v1:172.21.15.81:6789/0 conn(0x7fb8c8071750 legacy=0x7fb8c80d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 --2- 172.21.15.81:0/2611775070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b40039b0 0x7fb8b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 --2- 172.21.15.81:0/2611775070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b4004800 0x7fb8b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 --2- 172.21.15.81:0/2611775070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b40051c0 0x7fb8b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c806d040 con 0x7fb8b40051c0 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b400c060 con 0x7fb8b4004800 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b400c260 con 0x7fb8b40039b0 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c6d9d640 1 --2- 172.21.15.81:0/2611775070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b40051c0 0x7fb8b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c5d9b640 1 --2- 172.21.15.81:0/2611775070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b4004800 0x7fb8b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c659c640 1 --2- 172.21.15.81:0/2611775070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b40039b0 0x7fb8b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c6d9d640 1 -- 172.21.15.81:0/2611775070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b40039b0 msgr2=0x7fb8b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c6d9d640 1 --2- 172.21.15.81:0/2611775070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b40039b0 0x7fb8b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c6d9d640 1 -- 172.21.15.81:0/2611775070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b4004800 msgr2=0x7fb8b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c6d9d640 1 --2- 172.21.15.81:0/2611775070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b4004800 0x7fb8b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.966+0000 7fb8c6d9d640 1 -- 172.21.15.81:0/2611775070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b4003520 con 0x7fb8b40051c0 2024-09-16T01:18:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.967+0000 7fb8c6d9d640 1 -- 172.21.15.81:0/2611775070 reap_dead start 2024-09-16T01:18:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.967+0000 7fb8c6d9d640 1 --2- 172.21.15.81:0/2611775070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b40051c0 0x7fb8b400b9c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009ac0 tx=0x7fb8b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff2a67d275a3174 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.967+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0009690 con 0x7fb8b40051c0 2024-09-16T01:18:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.967+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c0004020 con 0x7fb8b40051c0 2024-09-16T01:18:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.967+0000 7fb8c559a640 1 -- 172.21.15.81:0/2611775070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00043d0 con 0x7fb8b40051c0 2024-09-16T01:18:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.968+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/2611775070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b40051c0 msgr2=0x7fb8b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.968+0000 7fb8ccbb7640 1 --2- 172.21.15.81:0/2611775070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b40051c0 0x7fb8b400b9c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009ac0 tx=0x7fb8b4005830 comp rx=0 tx=0).stop 2024-09-16T01:18:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.968+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/2611775070 shutdown_connections 2024-09-16T01:18:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.968+0000 7fb8ccbb7640 1 --2- 172.21.15.81:0/2611775070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b40051c0 0x7fb8b400b9c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.968+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/2611775070 >> 172.21.15.81:0/2611775070 conn(0x7fb8c80d23a0 msgr2=0x7fb8c80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.968+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/2611775070 shutdown_connections 2024-09-16T01:18:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.968+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/2611775070 wait complete. 2024-09-16T01:18:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.969+0000 7fb8ccbb7640 1 Processor -- start 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.969+0000 7fb8ccbb7640 1 -- start start 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8ccbb7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b40051c0 0x7fb8c8159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8ccbb7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c80c9d60 0x7fb8c8157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8ccbb7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c80ca2b0 0x7fb8c80ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8ccbb7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c80d05e0 con 0x7fb8c80c9d60 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8ccbb7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c8070220 con 0x7fb8c80ca2b0 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8ccbb7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb8c80d0760 con 0x7fb8b40051c0 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8c5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c80c9d60 0x7fb8c8157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8c659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b40051c0 0x7fb8c8159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8c5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c80c9d60 0x7fb8c8157f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50466/0 (socket says 172.21.15.81:50466) 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8c5d9b640 1 -- 172.21.15.81:0/3198673 learned_addr learned my addr 172.21.15.81:0/3198673 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8c6d9d640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c80ca2b0 0x7fb8c80ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8c5d9b640 1 -- 172.21.15.81:0/3198673 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b40051c0 msgr2=0x7fb8c8159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8c5d9b640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b40051c0 0x7fb8c8159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8c5d9b640 1 -- 172.21.15.81:0/3198673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c80ca2b0 msgr2=0x7fb8c80ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.970+0000 7fb8c5d9b640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c80ca2b0 0x7fb8c80ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.971+0000 7fb8c5d9b640 1 -- 172.21.15.81:0/3198673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c8159eb0 con 0x7fb8c80c9d60 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.971+0000 7fb8c5d9b640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c80c9d60 0x7fb8c8157f70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00072c0 tx=0x7fb8b0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.971+0000 7fb8beffd640 1 -- 172.21.15.81:0/3198673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0001660 con 0x7fb8c80c9d60 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.971+0000 7fb8beffd640 1 -- 172.21.15.81:0/3198673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8b0018070 con 0x7fb8c80c9d60 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.971+0000 7fb8beffd640 1 -- 172.21.15.81:0/3198673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000fb80 con 0x7fb8c80c9d60 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.971+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/3198673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c815a150 con 0x7fb8c80c9d60 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.971+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/3198673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c815a710 con 0x7fb8c80c9d60 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.972+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/3198673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8c809b080 con 0x7fb8c80c9d60 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.972+0000 7fb8beffd640 1 -- 172.21.15.81:0/3198673 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb8b000fd20 con 0x7fb8c80c9d60 2024-09-16T01:18:10.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.973+0000 7fb8beffd640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8a806c480 0x7fb8a806e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.973+0000 7fb8beffd640 1 -- 172.21.15.81:0/3198673 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fb8b008b480 con 0x7fb8c80c9d60 2024-09-16T01:18:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.973+0000 7fb8c659c640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8a806c480 0x7fb8a806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.973+0000 7fb8c659c640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8a806c480 0x7fb8a806e940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8000f80 tx=0x7fb8b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:10.977+0000 7fb8beffd640 1 -- 172.21.15.81:0/3198673 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8b0059410 con 0x7fb8c80c9d60 2024-09-16T01:18:11.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.179+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/3198673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb8c815b800 con 0x7fb8c80c9d60 2024-09-16T01:18:11.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.179+0000 7fb8beffd640 1 -- 172.21.15.81:0/3198673 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+73 (secure 0 0 0) 0x7fb8b005d710 con 0x7fb8c80c9d60 2024-09-16T01:18:11.181 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:18:11.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.181+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/3198673 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8a806c480 msgr2=0x7fb8a806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:11.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.181+0000 7fb8ccbb7640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8a806c480 0x7fb8a806e940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8000f80 tx=0x7fb8b8009040 comp rx=0 tx=0).stop 2024-09-16T01:18:11.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.181+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/3198673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c80c9d60 msgr2=0x7fb8c8157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:11.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.181+0000 7fb8ccbb7640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c80c9d60 0x7fb8c8157f70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00072c0 tx=0x7fb8b0007780 comp rx=0 tx=0).stop 2024-09-16T01:18:11.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.181+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/3198673 shutdown_connections 2024-09-16T01:18:11.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.181+0000 7fb8ccbb7640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8a806c480 0x7fb8a806e940 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:11.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.181+0000 7fb8ccbb7640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c80ca2b0 0x7fb8c80ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:11.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.181+0000 7fb8ccbb7640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c80c9d60 0x7fb8c8157f70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:11.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.181+0000 7fb8ccbb7640 1 --2- 172.21.15.81:0/3198673 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b40051c0 0x7fb8c8159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:11.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.181+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/3198673 >> 172.21.15.81:0/3198673 conn(0x7fb8c80d23a0 msgr2=0x7fb8c815abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:11.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.181+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/3198673 shutdown_connections 2024-09-16T01:18:11.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:11.181+0000 7fb8ccbb7640 1 -- 172.21.15.81:0/3198673 wait complete. 2024-09-16T01:18:11.194 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:18:11.194 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:18:11.194 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-16T01:18:11.194 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T01:18:11.194 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:18:11.194 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:18:11.194 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:18:11.194 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:18:11.194 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:18:11.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:11.194 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-16T01:18:11.213 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:18:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:18:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:18:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:18:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:11.214 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:18:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-16T01:18:11.214 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:18:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:11.214 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-16T01:18:11.214 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42649sec preferred_lft 42649sec 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::fc48:18ff:fedc:b80f/64 scope link 2024-09-16T01:18:11.215 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:11.216 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:18:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 2e:4a:65:c9:20:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:18:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::2c4a:65ff:fec9:204f/64 scope link 2024-09-16T01:18:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:11.216 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:18:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:18:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::1072:70ff:fefd:f9f1/64 scope link 2024-09-16T01:18:11.216 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:11.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:11.217 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:18:11.282 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:18:11.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:11.285 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-16T01:18:11.344 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-16T01:18:11.344 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:18:11.344 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:18:11.345 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:18:11.345 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:18:11.345 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:18:11.345 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:18:11.345 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:18:11.345 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:18:11.345 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:18:11.345 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:18:11.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:18:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:18:11.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:18:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:18:11.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:11.488 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:18:11.506 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T01:18:11.506 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:18:11.507 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:18:11.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:11.507 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-16T01:18:11.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:18:11.577 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T01:18:11.636 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:18:11.636 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:18:11.636 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:18:11.694 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:18:11.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:11.695 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:18:11.786 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:18:11.786 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:18:11.786 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:18:11.797 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:18:11.797 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:18:11.797 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:18:11.797 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:18:11.797 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:18:11.802 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:18:11.802 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:18:11.802 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:18:11.803 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:18:11.803 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:18:11.803 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:18:11.803 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:18:11.803 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:18:11.803 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T01:18:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:18:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:18:11.803 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:18:11.804 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:18:11.806 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:18:11.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:11.806 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:18:11.834 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:18:11.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:18:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:18:11.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:18:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:18:11.935 INFO:teuthology.orchestra.run.smithi102.stdout:client5437 2024-09-16T01:18:11.935 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:18:11.935 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:11.951 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:18:11.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:18:12.000 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:18:12.042 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:18:12.043 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:18:12.043 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:12.043 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:12.060 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:12.061 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:12.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:18:12.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.256+0000 7f7617f86640 1 Processor -- start 2024-09-16T01:18:12.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.256+0000 7f7617f86640 1 -- start start 2024-09-16T01:18:12.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.257+0000 7f7617f86640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f761015fc30 0x7f7610071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.257+0000 7f7617f86640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f76100b17d0 0x7f761009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.257+0000 7f7617f86640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f761009af70 0x7f76100d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.257+0000 7f7617f86640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f76100b1590 con 0x7f761015fc30 2024-09-16T01:18:12.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.257+0000 7f7617f86640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7610160ab0 con 0x7f76100b17d0 2024-09-16T01:18:12.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.257+0000 7f7617f86640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7610160fe0 con 0x7f761009af70 2024-09-16T01:18:12.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.257+0000 7f7615d22640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f761015fc30 0x7f7610071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:12.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.257+0000 7f7615d22640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f761015fc30 0x7f7610071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56822/0 (socket says 172.21.15.81:56822) 2024-09-16T01:18:12.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.257+0000 7f7615d22640 1 -- 172.21.15.81:0/2809632102 learned_addr learned my addr 172.21.15.81:0/2809632102 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:12.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.258+0000 7f7615d22640 1 -- 172.21.15.81:0/2809632102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f761009af70 msgr2=0x7f76100d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:12.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.258+0000 7f7615d22640 1 --2- 172.21.15.81:0/2809632102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f761009af70 0x7f76100d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.258+0000 7f7615d22640 1 -- 172.21.15.81:0/2809632102 >> v2:172.21.15.102:3300/0 conn(0x7f76100b17d0 msgr2=0x7f761009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:12.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.258+0000 7f7615d22640 1 --2- 172.21.15.81:0/2809632102 >> v2:172.21.15.102:3300/0 conn(0x7f76100b17d0 0x7f761009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.258+0000 7f7615d22640 1 -- 172.21.15.81:0/2809632102 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761009ba30 con 0x7f761015fc30 2024-09-16T01:18:12.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.258+0000 7f7615d22640 1 --2- 172.21.15.81:0/2809632102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f761015fc30 0x7f7610071e40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f761006cbf0 tx=0x7f760002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d475bae428ae1c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:12.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.259+0000 7f7614d20640 1 -- 172.21.15.81:0/2809632102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7600036070 con 0x7f761015fc30 2024-09-16T01:18:12.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.259+0000 7f7614d20640 1 -- 172.21.15.81:0/2809632102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7600031600 con 0x7f761015fc30 2024-09-16T01:18:12.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.259+0000 7f7614d20640 1 -- 172.21.15.81:0/2809632102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76000319d0 con 0x7f761015fc30 2024-09-16T01:18:12.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.259+0000 7f7617f86640 1 -- 172.21.15.81:0/2809632102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f761015fc30 msgr2=0x7f7610071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:12.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.259+0000 7f7617f86640 1 --2- 172.21.15.81:0/2809632102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f761015fc30 0x7f7610071e40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f761006cbf0 tx=0x7f760002a610 comp rx=0 tx=0).stop 2024-09-16T01:18:12.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.259+0000 7f7617f86640 1 -- 172.21.15.81:0/2809632102 shutdown_connections 2024-09-16T01:18:12.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.259+0000 7f7617f86640 1 --2- 172.21.15.81:0/2809632102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f761009af70 0x7f76100d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.259+0000 7f7617f86640 1 --2- 172.21.15.81:0/2809632102 >> v2:172.21.15.102:3300/0 conn(0x7f76100b17d0 0x7f761009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.259+0000 7f7617f86640 1 --2- 172.21.15.81:0/2809632102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f761015fc30 0x7f7610071e40 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.259+0000 7f7617f86640 1 -- 172.21.15.81:0/2809632102 >> 172.21.15.81:0/2809632102 conn(0x7f76100d23a0 msgr2=0x7f76100d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:12.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.259+0000 7f7617f86640 1 -- 172.21.15.81:0/2809632102 shutdown_connections 2024-09-16T01:18:12.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.259+0000 7f7617f86640 1 -- 172.21.15.81:0/2809632102 wait complete. 2024-09-16T01:18:12.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.260+0000 7f7617f86640 1 Processor -- start 2024-09-16T01:18:12.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.260+0000 7f7617f86640 1 -- start start 2024-09-16T01:18:12.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.261+0000 7f7617f86640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f761009af70 0x7f76100c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.261+0000 7f7617f86640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76100b17d0 0x7f7610153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.261+0000 7f7617f86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f761015fc30 0x7f76100b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.261+0000 7f7617f86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7610160d00 con 0x7f761015fc30 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.261+0000 7f7617f86640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f76100b1bd0 con 0x7f761009af70 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.261+0000 7f7617f86640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f76100d0850 con 0x7f76100b17d0 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.261+0000 7f7616523640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f761015fc30 0x7f76100b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.261+0000 7f7615521640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76100b17d0 0x7f7610153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.261+0000 7f7616523640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f761015fc30 0x7f76100b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56832/0 (socket says 172.21.15.81:56832) 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.261+0000 7f7616523640 1 -- 172.21.15.81:0/889922589 learned_addr learned my addr 172.21.15.81:0/889922589 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.261+0000 7f7615d22640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f761009af70 0x7f76100c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.262+0000 7f7616523640 1 -- 172.21.15.81:0/889922589 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76100b17d0 msgr2=0x7f7610153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.262+0000 7f7616523640 1 --2- 172.21.15.81:0/889922589 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76100b17d0 0x7f7610153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.262+0000 7f7616523640 1 -- 172.21.15.81:0/889922589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f761009af70 msgr2=0x7f76100c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.262+0000 7f7616523640 1 --2- 172.21.15.81:0/889922589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f761009af70 0x7f76100c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.262+0000 7f7616523640 1 -- 172.21.15.81:0/889922589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76101f6080 con 0x7f761015fc30 2024-09-16T01:18:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.262+0000 7f7616523640 1 --2- 172.21.15.81:0/889922589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f761015fc30 0x7f76100b0190 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7608009fd0 tx=0x7f760800b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.262+0000 7f760e7fc640 1 -- 172.21.15.81:0/889922589 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608015020 con 0x7f761015fc30 2024-09-16T01:18:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.262+0000 7f760e7fc640 1 -- 172.21.15.81:0/889922589 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7608011830 con 0x7f761015fc30 2024-09-16T01:18:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.262+0000 7f760e7fc640 1 -- 172.21.15.81:0/889922589 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7608011c00 con 0x7f761015fc30 2024-09-16T01:18:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.262+0000 7f7617f86640 1 -- 172.21.15.81:0/889922589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76101f6360 con 0x7f761015fc30 2024-09-16T01:18:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.262+0000 7f7617f86640 1 -- 172.21.15.81:0/889922589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76101f6920 con 0x7f761015fc30 2024-09-16T01:18:12.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.263+0000 7f7617f86640 1 -- 172.21.15.81:0/889922589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f761009aa30 con 0x7f761015fc30 2024-09-16T01:18:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.263+0000 7f760e7fc640 1 -- 172.21.15.81:0/889922589 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7608018020 con 0x7f761015fc30 2024-09-16T01:18:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.264+0000 7f760e7fc640 1 --2- 172.21.15.81:0/889922589 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f75fc06c2b0 0x7f75fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.264+0000 7f7615d22640 1 --2- 172.21.15.81:0/889922589 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f75fc06c2b0 0x7f75fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.264+0000 7f760e7fc640 1 -- 172.21.15.81:0/889922589 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f760808b0f0 con 0x7f761015fc30 2024-09-16T01:18:12.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.264+0000 7f7615d22640 1 --2- 172.21.15.81:0/889922589 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f75fc06c2b0 0x7f75fc06e770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7600033000 tx=0x7f7600009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.268+0000 7f760e7fc640 1 -- 172.21.15.81:0/889922589 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f760801f030 con 0x7f761015fc30 2024-09-16T01:18:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.444+0000 7f7617f86640 1 -- 172.21.15.81:0/889922589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f76100d0630 con 0x7f761015fc30 2024-09-16T01:18:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.444+0000 7f760e7fc640 1 -- 172.21.15.81:0/889922589 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v63) ==== 80+0+0 (secure 0 0 0) 0x7f7608059760 con 0x7f761015fc30 2024-09-16T01:18:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:18:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.446+0000 7f7617f86640 1 -- 172.21.15.81:0/889922589 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f75fc06c2b0 msgr2=0x7f75fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.446+0000 7f7617f86640 1 --2- 172.21.15.81:0/889922589 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f75fc06c2b0 0x7f75fc06e770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7600033000 tx=0x7f7600009000 comp rx=0 tx=0).stop 2024-09-16T01:18:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.446+0000 7f7617f86640 1 -- 172.21.15.81:0/889922589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f761015fc30 msgr2=0x7f76100b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.446+0000 7f7617f86640 1 --2- 172.21.15.81:0/889922589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f761015fc30 0x7f76100b0190 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7608009fd0 tx=0x7f760800b820 comp rx=0 tx=0).stop 2024-09-16T01:18:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.446+0000 7f7617f86640 1 -- 172.21.15.81:0/889922589 shutdown_connections 2024-09-16T01:18:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.446+0000 7f7617f86640 1 --2- 172.21.15.81:0/889922589 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f75fc06c2b0 0x7f75fc06e770 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.446+0000 7f7617f86640 1 --2- 172.21.15.81:0/889922589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f761015fc30 0x7f76100b0190 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.446+0000 7f7617f86640 1 --2- 172.21.15.81:0/889922589 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76100b17d0 0x7f7610153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.446+0000 7f7617f86640 1 --2- 172.21.15.81:0/889922589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f761009af70 0x7f76100c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.446+0000 7f7617f86640 1 -- 172.21.15.81:0/889922589 >> 172.21.15.81:0/889922589 conn(0x7f76100d23a0 msgr2=0x7f76100cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.446+0000 7f7617f86640 1 -- 172.21.15.81:0/889922589 shutdown_connections 2024-09-16T01:18:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.446+0000 7f7617f86640 1 -- 172.21.15.81:0/889922589 wait complete. 2024-09-16T01:18:12.459 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:18:12.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:12.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:18:12.487 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:18:12.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:12.488 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:18:12.543 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:18:12.543 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:18:12.543 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:12.562 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:18:12.562 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:12.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:18:12.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.719+0000 7f0c3a5fd640 1 Processor -- start 2024-09-16T01:18:12.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.719+0000 7f0c3a5fd640 1 -- start start 2024-09-16T01:18:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.719+0000 7f0c3a5fd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0c34161c80 0x7f0c3406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.719+0000 7f0c3a5fd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c34162060 0x7f0c340b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.719+0000 7f0c3a5fd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c3406e870 con 0x7f0c340b64b0 2024-09-16T01:18:12.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.719+0000 7f0c3a5fd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0c3406d9f0 con 0x7f0c34162060 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.719+0000 7f0c3a5fd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0c3406dcd0 con 0x7f0c34161c80 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.719+0000 7f0c337fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c34162060 0x7f0c340b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.720+0000 7f0c38b9a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0c340b64b0 0x7f0c34162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38750/0 (socket says 172.21.15.81:38750) 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.720+0000 7f0c38b9a640 1 -- 172.21.15.81:0/3282349265 learned_addr learned my addr 172.21.15.81:0/3282349265 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.720+0000 7f0c33fff640 1 --2- 172.21.15.81:0/3282349265 >> v2:172.21.15.102:3300/0 conn(0x7f0c34161c80 0x7f0c3406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.720+0000 7f0c337fe640 1 -- 172.21.15.81:0/3282349265 >> v2:172.21.15.102:3300/0 conn(0x7f0c34161c80 msgr2=0x7f0c3406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.720+0000 7f0c337fe640 1 --2- 172.21.15.81:0/3282349265 >> v2:172.21.15.102:3300/0 conn(0x7f0c34161c80 0x7f0c3406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.720+0000 7f0c337fe640 1 -- 172.21.15.81:0/3282349265 >> v1:172.21.15.81:6789/0 conn(0x7f0c340b64b0 legacy=0x7f0c34162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.720+0000 7f0c337fe640 1 -- 172.21.15.81:0/3282349265 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3406dfb0 con 0x7f0c34162060 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.720+0000 7f0c32ffd640 1 -- 172.21.15.81:0/3282349265 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797096300 0 0) 0x7f0c2c001490 con 0x7f0c340b64b0 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.720+0000 7f0c33fff640 1 --2- 172.21.15.81:0/3282349265 >> v2:172.21.15.102:3300/0 conn(0x7f0c34161c80 0x7f0c3406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.721+0000 7f0c337fe640 1 --2- 172.21.15.81:0/3282349265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c34162060 0x7f0c340b5f70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0c3408d7a0 tx=0x7f0c2802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702f96d8c7f6aff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:12.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.721+0000 7f0c32ffd640 1 -- 172.21.15.81:0/3282349265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c28037070 con 0x7f0c34162060 2024-09-16T01:18:12.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.721+0000 7f0c32ffd640 1 -- 172.21.15.81:0/3282349265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c28032440 con 0x7f0c34162060 2024-09-16T01:18:12.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.721+0000 7f0c32ffd640 1 -- 172.21.15.81:0/3282349265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c28032810 con 0x7f0c34162060 2024-09-16T01:18:12.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.721+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/3282349265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c34162060 msgr2=0x7f0c340b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:12.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.721+0000 7f0c3a5fd640 1 --2- 172.21.15.81:0/3282349265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c34162060 0x7f0c340b5f70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0c3408d7a0 tx=0x7f0c2802a1a0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.721+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/3282349265 shutdown_connections 2024-09-16T01:18:12.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.721+0000 7f0c3a5fd640 1 --2- 172.21.15.81:0/3282349265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c34162060 0x7f0c340b5f70 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.721+0000 7f0c3a5fd640 1 --2- 172.21.15.81:0/3282349265 >> v2:172.21.15.102:3300/0 conn(0x7f0c34161c80 0x7f0c3406e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.721+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/3282349265 >> 172.21.15.81:0/3282349265 conn(0x7f0c340d44f0 msgr2=0x7f0c340d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.721+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/3282349265 shutdown_connections 2024-09-16T01:18:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.721+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/3282349265 wait complete. 2024-09-16T01:18:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.722+0000 7f0c3a5fd640 1 Processor -- start 2024-09-16T01:18:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.723+0000 7f0c3a5fd640 1 -- start start 2024-09-16T01:18:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.723+0000 7f0c3a5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c340b64b0 0x7f0c340cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.723+0000 7f0c3a5fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c34161c80 0x7f0c34155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.723+0000 7f0c3a5fd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c34162060 0x7f0c340b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.723+0000 7f0c3a5fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c340d2a10 con 0x7f0c340b64b0 2024-09-16T01:18:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.723+0000 7f0c3a5fd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0c340d2890 con 0x7f0c34161c80 2024-09-16T01:18:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.723+0000 7f0c3a5fd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0c340b6960 con 0x7f0c34162060 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.723+0000 7f0c33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c340b64b0 0x7f0c340cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.723+0000 7f0c33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c340b64b0 0x7f0c340cac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56838/0 (socket says 172.21.15.81:56838) 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.723+0000 7f0c33fff640 1 -- 172.21.15.81:0/1154513906 learned_addr learned my addr 172.21.15.81:0/1154513906 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c38b9a640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c34162060 0x7f0c340b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c337fe640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c34161c80 0x7f0c34155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c33fff640 1 -- 172.21.15.81:0/1154513906 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c34162060 msgr2=0x7f0c340b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c33fff640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c34162060 0x7f0c340b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c33fff640 1 -- 172.21.15.81:0/1154513906 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c34161c80 msgr2=0x7f0c34155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c33fff640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c34161c80 0x7f0c34155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c33fff640 1 -- 172.21.15.81:0/1154513906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c340b8130 con 0x7f0c340b64b0 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c337fe640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c34161c80 0x7f0c34155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c33fff640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c340b64b0 0x7f0c340cac80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400c7f0 tx=0x7f0c2400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:12.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c30ff9640 1 -- 172.21.15.81:0/1154513906 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24015070 con 0x7f0c340b64b0 2024-09-16T01:18:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c30ff9640 1 -- 172.21.15.81:0/1154513906 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c24007a30 con 0x7f0c340b64b0 2024-09-16T01:18:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/1154513906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c340b8ba0 con 0x7f0c340b64b0 2024-09-16T01:18:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c30ff9640 1 -- 172.21.15.81:0/1154513906 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24007e00 con 0x7f0c340b64b0 2024-09-16T01:18:12.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.724+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/1154513906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c34155f50 con 0x7f0c340b64b0 2024-09-16T01:18:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.725+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/1154513906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c340ba470 con 0x7f0c340b64b0 2024-09-16T01:18:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.726+0000 7f0c30ff9640 1 -- 172.21.15.81:0/1154513906 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0c24018070 con 0x7f0c340b64b0 2024-09-16T01:18:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.726+0000 7f0c30ff9640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c2006c2b0 0x7f0c2006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.726+0000 7f0c30ff9640 1 -- 172.21.15.81:0/1154513906 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f0c2408b520 con 0x7f0c340b64b0 2024-09-16T01:18:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.726+0000 7f0c337fe640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c2006c2b0 0x7f0c2006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:12.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.726+0000 7f0c337fe640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c2006c2b0 0x7f0c2006e770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0c28034000 tx=0x7f0c2802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:12.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.730+0000 7f0c30ff9640 1 -- 172.21.15.81:0/1154513906 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c24059b90 con 0x7f0c340b64b0 2024-09-16T01:18:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.910+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/1154513906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0c34160570 con 0x7f0c340b64b0 2024-09-16T01:18:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.910+0000 7f0c30ff9640 1 -- 172.21.15.81:0/1154513906 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v63) ==== 80+0+0 (secure 0 0 0) 0x7f0c24059490 con 0x7f0c340b64b0 2024-09-16T01:18:12.912 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:18:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.912+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/1154513906 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c2006c2b0 msgr2=0x7f0c2006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.912+0000 7f0c3a5fd640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c2006c2b0 0x7f0c2006e770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0c28034000 tx=0x7f0c2802e000 comp rx=0 tx=0).stop 2024-09-16T01:18:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.912+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/1154513906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c340b64b0 msgr2=0x7f0c340cac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.912+0000 7f0c3a5fd640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c340b64b0 0x7f0c340cac80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400c7f0 tx=0x7f0c2400cbf0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.912+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/1154513906 shutdown_connections 2024-09-16T01:18:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.912+0000 7f0c3a5fd640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c2006c2b0 0x7f0c2006e770 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.912+0000 7f0c3a5fd640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c34162060 0x7f0c340b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.912+0000 7f0c3a5fd640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c34161c80 0x7f0c34155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.912+0000 7f0c3a5fd640 1 --2- 172.21.15.81:0/1154513906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c340b64b0 0x7f0c340cac80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:12.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.912+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/1154513906 >> 172.21.15.81:0/1154513906 conn(0x7f0c340d44f0 msgr2=0x7f0c340b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:12.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.912+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/1154513906 shutdown_connections 2024-09-16T01:18:12.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:12.912+0000 7f0c3a5fd640 1 -- 172.21.15.81:0/1154513906 wait complete. 2024-09-16T01:18:12.925 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:18:12.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:12.926 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T01:18:12.959 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:18:12.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:12.959 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:18:13.018 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:18:13.018 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:13.018 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:13.034 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:18:13.034 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:18:13.034 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:18:13.034 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:13.076 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:18:13.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:13.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.173+0000 7f909359e640 1 Processor -- start 2024-09-16T01:18:13.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.173+0000 7f909359e640 1 -- start start 2024-09-16T01:18:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.174+0000 7f909359e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f909415e660 0x7f909406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.174+0000 7f909359e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90940d1f90 0x7f90940cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.174+0000 7f909359e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90940cf000 con 0x7f90940d0dd0 2024-09-16T01:18:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.174+0000 7f909359e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f90940b37d0 con 0x7f909415e660 2024-09-16T01:18:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.174+0000 7f909359e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f90940cf330 con 0x7f90940d1f90 2024-09-16T01:18:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.174+0000 7f9091d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f909415e660 0x7f909406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.174+0000 7f9091d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f909415e660 0x7f909406ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56846/0 (socket says 172.21.15.81:56846) 2024-09-16T01:18:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.175+0000 7f9091d9b640 1 -- 172.21.15.81:0/3493782573 learned_addr learned my addr 172.21.15.81:0/3493782573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.175+0000 7f9092d9d640 1 --2- 172.21.15.81:0/3493782573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90940d1f90 0x7f90940cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.175+0000 7f9091d9b640 1 -- 172.21.15.81:0/3493782573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90940d1f90 msgr2=0x7f90940cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:13.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.175+0000 7f9091d9b640 1 --2- 172.21.15.81:0/3493782573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90940d1f90 0x7f90940cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.175+0000 7f9091d9b640 1 -- 172.21.15.81:0/3493782573 >> v1:172.21.15.102:6789/0 conn(0x7f90940d0dd0 legacy=0x7f90940d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.175+0000 7f9091d9b640 1 -- 172.21.15.81:0/3493782573 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90940d29a0 con 0x7f909415e660 2024-09-16T01:18:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.175+0000 7f9091d9b640 1 --2- 172.21.15.81:0/3493782573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909415e660 0x7f909406ccd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9088009870 tx=0x7f908802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2ee1a2c106736a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.176+0000 7f909159a640 1 -- 172.21.15.81:0/3493782573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088037070 con 0x7f909415e660 2024-09-16T01:18:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.176+0000 7f909159a640 1 -- 172.21.15.81:0/3493782573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9088032440 con 0x7f909415e660 2024-09-16T01:18:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.176+0000 7f909159a640 1 -- 172.21.15.81:0/3493782573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088032810 con 0x7f909415e660 2024-09-16T01:18:13.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.176+0000 7f909359e640 1 -- 172.21.15.81:0/3493782573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909415e660 msgr2=0x7f909406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.176+0000 7f909359e640 1 --2- 172.21.15.81:0/3493782573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909415e660 0x7f909406ccd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9088009870 tx=0x7f908802a250 comp rx=0 tx=0).stop 2024-09-16T01:18:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.176+0000 7f909359e640 1 -- 172.21.15.81:0/3493782573 shutdown_connections 2024-09-16T01:18:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.176+0000 7f909359e640 1 --2- 172.21.15.81:0/3493782573 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90940d1f90 0x7f90940cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.176+0000 7f909359e640 1 --2- 172.21.15.81:0/3493782573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909415e660 0x7f909406ccd0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.176+0000 7f909359e640 1 -- 172.21.15.81:0/3493782573 >> 172.21.15.81:0/3493782573 conn(0x7f909408bfc0 msgr2=0x7f90940d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.176+0000 7f909359e640 1 -- 172.21.15.81:0/3493782573 shutdown_connections 2024-09-16T01:18:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.176+0000 7f909359e640 1 -- 172.21.15.81:0/3493782573 wait complete. 2024-09-16T01:18:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.178+0000 7f909359e640 1 Processor -- start 2024-09-16T01:18:13.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.178+0000 7f909359e640 1 -- start start 2024-09-16T01:18:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.178+0000 7f909359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90940d0dd0 0x7f9094157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.178+0000 7f909359e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90940d1f90 0x7f90940b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.178+0000 7f909359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909415e660 0x7f90940b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.178+0000 7f909359e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90940d3220 con 0x7f909415e660 2024-09-16T01:18:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.178+0000 7f909359e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f90940d2f40 con 0x7f90940d0dd0 2024-09-16T01:18:13.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.178+0000 7f909359e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f90940d33a0 con 0x7f90940d1f90 2024-09-16T01:18:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9092d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909415e660 0x7f90940b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9092d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909415e660 0x7f90940b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56862/0 (socket says 172.21.15.81:56862) 2024-09-16T01:18:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9092d9d640 1 -- 172.21.15.81:0/1010296495 learned_addr learned my addr 172.21.15.81:0/1010296495 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f909259c640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90940d0dd0 0x7f9094157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9091d9b640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90940d1f90 0x7f90940b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9092d9d640 1 -- 172.21.15.81:0/1010296495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90940d1f90 msgr2=0x7f90940b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9092d9d640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90940d1f90 0x7f90940b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9092d9d640 1 -- 172.21.15.81:0/1010296495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90940d0dd0 msgr2=0x7f9094157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9092d9d640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90940d0dd0 0x7f9094157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9092d9d640 1 -- 172.21.15.81:0/1010296495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9094160c50 con 0x7f909415e660 2024-09-16T01:18:13.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9092d9d640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909415e660 0x7f90940b6360 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f908c007e40 tx=0x7f908c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9082ffd640 1 -- 172.21.15.81:0/1010296495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c014620 con 0x7f909415e660 2024-09-16T01:18:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9082ffd640 1 -- 172.21.15.81:0/1010296495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908c019070 con 0x7f909415e660 2024-09-16T01:18:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f9082ffd640 1 -- 172.21.15.81:0/1010296495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c014a20 con 0x7f909415e660 2024-09-16T01:18:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f909359e640 1 -- 172.21.15.81:0/1010296495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9094160f30 con 0x7f909415e660 2024-09-16T01:18:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.179+0000 7f909359e640 1 -- 172.21.15.81:0/1010296495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90941614f0 con 0x7f909415e660 2024-09-16T01:18:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.180+0000 7f909359e640 1 -- 172.21.15.81:0/1010296495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90940d2440 con 0x7f909415e660 2024-09-16T01:18:13.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.181+0000 7f9082ffd640 1 -- 172.21.15.81:0/1010296495 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f908c014bc0 con 0x7f909415e660 2024-09-16T01:18:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.181+0000 7f9082ffd640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f907406c2b0 0x7f907406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.181+0000 7f9082ffd640 1 -- 172.21.15.81:0/1010296495 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f908c08bd80 con 0x7f909415e660 2024-09-16T01:18:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.181+0000 7f909259c640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f907406c2b0 0x7f907406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.181+0000 7f909259c640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f907406c2b0 0x7f907406e770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9084001780 tx=0x7f9084009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:13.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.185+0000 7f9082ffd640 1 -- 172.21.15.81:0/1010296495 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f908c059d10 con 0x7f909415e660 2024-09-16T01:18:13.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.385+0000 7f909359e640 1 -- 172.21.15.81:0/1010296495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90940d1b20 con 0x7f909415e660 2024-09-16T01:18:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.385+0000 7f9082ffd640 1 -- 172.21.15.81:0/1010296495 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5227 (secure 0 0 0) 0x7f908c05e010 con 0x7f909415e660 2024-09-16T01:18:13.387 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:13.387 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"btime":"2024-09-16T01:18:02:835480+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2000242607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2000242607},{"type":"v1","addr":"172.21.15.102:6834","nonce":2000242607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5087,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3268189429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3268189429},{"type":"v1","addr":"172.21.15.102:6835","nonce":3268189429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2730360991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2730360991},{"type":"v1","addr":"172.21.15.81:6836","nonce":2730360991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:00.081821+0000","modified":"2024-09-16T01:18:02.163419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/554158924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":554158924},{"type":"v1","addr":"172.21.15.81:6837","nonce":554158924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5667,"qdb_cluster":[5667]},"id":4}]} 2024-09-16T01:18:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-09-16T01:18:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.387+0000 7f909359e640 1 -- 172.21.15.81:0/1010296495 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f907406c2b0 msgr2=0x7f907406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.387+0000 7f909359e640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f907406c2b0 0x7f907406e770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9084001780 tx=0x7f9084009040 comp rx=0 tx=0).stop 2024-09-16T01:18:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.387+0000 7f909359e640 1 -- 172.21.15.81:0/1010296495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909415e660 msgr2=0x7f90940b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.387+0000 7f909359e640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909415e660 0x7f90940b6360 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f908c007e40 tx=0x7f908c00e4b0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.387+0000 7f909359e640 1 -- 172.21.15.81:0/1010296495 shutdown_connections 2024-09-16T01:18:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.387+0000 7f909359e640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f907406c2b0 0x7f907406e770 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.387+0000 7f909359e640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909415e660 0x7f90940b6360 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.387+0000 7f909359e640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90940d1f90 0x7f90940b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.387+0000 7f909359e640 1 --2- 172.21.15.81:0/1010296495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90940d0dd0 0x7f9094157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.387+0000 7f909359e640 1 -- 172.21.15.81:0/1010296495 >> 172.21.15.81:0/1010296495 conn(0x7f909408bfc0 msgr2=0x7f90940b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.387+0000 7f909359e640 1 -- 172.21.15.81:0/1010296495 shutdown_connections 2024-09-16T01:18:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.387+0000 7f909359e640 1 -- 172.21.15.81:0/1010296495 wait complete. 2024-09-16T01:18:13.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:13.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.497+0000 7f600556d640 1 Processor -- start 2024-09-16T01:18:13.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.497+0000 7f600556d640 1 -- start start 2024-09-16T01:18:13.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f600556d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f600015e5d0 0x7f60000d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f600556d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f600009b140 0x7f6000168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f600556d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600006cec0 con 0x7f600006df60 2024-09-16T01:18:13.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f600556d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f600006dad0 con 0x7f600015e5d0 2024-09-16T01:18:13.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f600556d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f600006d1a0 con 0x7f600009b140 2024-09-16T01:18:13.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f5ffeffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f600015e5d0 0x7f60000d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f5ff67fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f600006df60 0x7f600009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38762/0 (socket says 172.21.15.81:38762) 2024-09-16T01:18:13.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f5ff67fc640 1 -- 172.21.15.81:0/2792748371 learned_addr learned my addr 172.21.15.81:0/2792748371 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:13.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f5fff7fe640 1 --2- 172.21.15.81:0/2792748371 >> v2:172.21.15.102:3300/0 conn(0x7f600009b140 0x7f6000168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f5ffeffd640 1 -- 172.21.15.81:0/2792748371 >> v2:172.21.15.102:3300/0 conn(0x7f600009b140 msgr2=0x7f6000168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:13.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f5ffeffd640 1 --2- 172.21.15.81:0/2792748371 >> v2:172.21.15.102:3300/0 conn(0x7f600009b140 0x7f6000168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f5ffeffd640 1 -- 172.21.15.81:0/2792748371 >> v1:172.21.15.81:6789/0 conn(0x7f600006df60 legacy=0x7f600009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.498+0000 7f5ffe7fc640 1 -- 172.21.15.81:0/2792748371 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2084537696 0 0) 0x7f600006cec0 con 0x7f600006df60 2024-09-16T01:18:13.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.499+0000 7f5ffeffd640 1 -- 172.21.15.81:0/2792748371 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600006d480 con 0x7f600015e5d0 2024-09-16T01:18:13.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.499+0000 7f5fff7fe640 1 --2- 172.21.15.81:0/2792748371 >> v2:172.21.15.102:3300/0 conn(0x7f600009b140 0x7f6000168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:13.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.499+0000 7f5ffeffd640 1 --2- 172.21.15.81:0/2792748371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600015e5d0 0x7f60000d10f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00097a0 tx=0x7f5ff002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee24f61e40a44515 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:13.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.499+0000 7f5ffe7fc640 1 -- 172.21.15.81:0/2792748371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0037070 con 0x7f600015e5d0 2024-09-16T01:18:13.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.499+0000 7f5ffe7fc640 1 -- 172.21.15.81:0/2792748371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff0032440 con 0x7f600015e5d0 2024-09-16T01:18:13.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.499+0000 7f5ffe7fc640 1 -- 172.21.15.81:0/2792748371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0032810 con 0x7f600015e5d0 2024-09-16T01:18:13.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.500+0000 7f600556d640 1 -- 172.21.15.81:0/2792748371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600015e5d0 msgr2=0x7f60000d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.500+0000 7f600556d640 1 --2- 172.21.15.81:0/2792748371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600015e5d0 0x7f60000d10f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00097a0 tx=0x7f5ff002a270 comp rx=0 tx=0).stop 2024-09-16T01:18:13.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.500+0000 7f600556d640 1 -- 172.21.15.81:0/2792748371 shutdown_connections 2024-09-16T01:18:13.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.500+0000 7f600556d640 1 --2- 172.21.15.81:0/2792748371 >> v2:172.21.15.102:3300/0 conn(0x7f600009b140 0x7f6000168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.500+0000 7f600556d640 1 --2- 172.21.15.81:0/2792748371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600015e5d0 0x7f60000d10f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.500+0000 7f600556d640 1 -- 172.21.15.81:0/2792748371 >> 172.21.15.81:0/2792748371 conn(0x7f60000d23a0 msgr2=0x7f60000d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:13.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.500+0000 7f600556d640 1 -- 172.21.15.81:0/2792748371 shutdown_connections 2024-09-16T01:18:13.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.500+0000 7f600556d640 1 -- 172.21.15.81:0/2792748371 wait complete. 2024-09-16T01:18:13.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.501+0000 7f600556d640 1 Processor -- start 2024-09-16T01:18:13.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.501+0000 7f600556d640 1 -- start start 2024-09-16T01:18:13.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f600556d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f600006df60 0x7f60001ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f600556d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600009b140 0x7f60001538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f600556d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f600015e5d0 0x7f60000b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f600556d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f600015eb30 con 0x7f600009b140 2024-09-16T01:18:13.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f600556d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f600015e9b0 con 0x7f600006df60 2024-09-16T01:18:13.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f600556d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f60000d1630 con 0x7f600015e5d0 2024-09-16T01:18:13.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f5ff67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600009b140 0x7f60001538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f5ff67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600009b140 0x7f60001538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56882/0 (socket says 172.21.15.81:56882) 2024-09-16T01:18:13.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f5ff67fc640 1 -- 172.21.15.81:0/789094261 learned_addr learned my addr 172.21.15.81:0/789094261 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:13.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f5ffeffd640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f600006df60 0x7f60001ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f5fff7fe640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f600015e5d0 0x7f60000b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f5ff67fc640 1 -- 172.21.15.81:0/789094261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f600015e5d0 msgr2=0x7f60000b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f5ff67fc640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f600015e5d0 0x7f60000b71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f5ff67fc640 1 -- 172.21.15.81:0/789094261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f600006df60 msgr2=0x7f60001ea8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f5ff67fc640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f600006df60 0x7f60001ea8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f5ff67fc640 1 -- 172.21.15.81:0/789094261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60001e89f0 con 0x7f600009b140 2024-09-16T01:18:13.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.502+0000 7f5fff7fe640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f600015e5d0 0x7f60000b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:13.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.503+0000 7f5ff67fc640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600009b140 0x7f60001538e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800c4d0 tx=0x7f5fe800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:13.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.503+0000 7f5ff7fff640 1 -- 172.21.15.81:0/789094261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8018070 con 0x7f600009b140 2024-09-16T01:18:13.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.503+0000 7f5ff7fff640 1 -- 172.21.15.81:0/789094261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe8007500 con 0x7f600009b140 2024-09-16T01:18:13.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.503+0000 7f5ff7fff640 1 -- 172.21.15.81:0/789094261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8004a20 con 0x7f600009b140 2024-09-16T01:18:13.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.503+0000 7f600556d640 1 -- 172.21.15.81:0/789094261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60001eae20 con 0x7f600009b140 2024-09-16T01:18:13.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.503+0000 7f600556d640 1 -- 172.21.15.81:0/789094261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60000b66e0 con 0x7f600009b140 2024-09-16T01:18:13.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.504+0000 7f600556d640 1 -- 172.21.15.81:0/789094261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60000d10f0 con 0x7f600009b140 2024-09-16T01:18:13.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.504+0000 7f5ff7fff640 1 -- 172.21.15.81:0/789094261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5fe801b070 con 0x7f600009b140 2024-09-16T01:18:13.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.505+0000 7f5ff7fff640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5fe006c2b0 0x7f5fe006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.505+0000 7f5ff7fff640 1 -- 172.21.15.81:0/789094261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f5fe808a860 con 0x7f600009b140 2024-09-16T01:18:13.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.505+0000 7f5ffeffd640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5fe006c2b0 0x7f5fe006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.505+0000 7f5ffeffd640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5fe006c2b0 0x7f5fe006e770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0034000 tx=0x7f5ff002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:13.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.509+0000 7f5ff7fff640 1 -- 172.21.15.81:0/789094261 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5fe80587f0 con 0x7f600009b140 2024-09-16T01:18:13.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.708+0000 7f600556d640 1 -- 172.21.15.81:0/789094261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60001630b0 con 0x7f600009b140 2024-09-16T01:18:13.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.709+0000 7f5ff7fff640 1 -- 172.21.15.81:0/789094261 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5227 (secure 0 0 0) 0x7f5fe805caf0 con 0x7f600009b140 2024-09-16T01:18:13.711 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:13.711 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"btime":"2024-09-16T01:18:02:835480+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2000242607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2000242607},{"type":"v1","addr":"172.21.15.102:6834","nonce":2000242607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5087,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3268189429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3268189429},{"type":"v1","addr":"172.21.15.102:6835","nonce":3268189429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2730360991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2730360991},{"type":"v1","addr":"172.21.15.81:6836","nonce":2730360991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:00.081821+0000","modified":"2024-09-16T01:18:02.163419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/554158924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":554158924},{"type":"v1","addr":"172.21.15.81:6837","nonce":554158924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5667,"qdb_cluster":[5667]},"id":4}]} 2024-09-16T01:18:13.711 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-09-16T01:18:13.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.711+0000 7f600556d640 1 -- 172.21.15.81:0/789094261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5fe006c2b0 msgr2=0x7f5fe006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.711+0000 7f600556d640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5fe006c2b0 0x7f5fe006e770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5ff0034000 tx=0x7f5ff002e000 comp rx=0 tx=0).stop 2024-09-16T01:18:13.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.711+0000 7f600556d640 1 -- 172.21.15.81:0/789094261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600009b140 msgr2=0x7f60001538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.711+0000 7f600556d640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600009b140 0x7f60001538e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5fe800c4d0 tx=0x7f5fe800c990 comp rx=0 tx=0).stop 2024-09-16T01:18:13.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.711+0000 7f600556d640 1 -- 172.21.15.81:0/789094261 shutdown_connections 2024-09-16T01:18:13.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.711+0000 7f600556d640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5fe006c2b0 0x7f5fe006e770 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.711+0000 7f600556d640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f600015e5d0 0x7f60000b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.711+0000 7f600556d640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600009b140 0x7f60001538e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.711+0000 7f600556d640 1 --2- 172.21.15.81:0/789094261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f600006df60 0x7f60001ea8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.711+0000 7f600556d640 1 -- 172.21.15.81:0/789094261 >> 172.21.15.81:0/789094261 conn(0x7f60000d23a0 msgr2=0x7f60000b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:13.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.711+0000 7f600556d640 1 -- 172.21.15.81:0/789094261 shutdown_connections 2024-09-16T01:18:13.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.711+0000 7f600556d640 1 -- 172.21.15.81:0/789094261 wait complete. 2024-09-16T01:18:13.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:18:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.820+0000 7fb6dfe82640 1 Processor -- start 2024-09-16T01:18:13.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.821+0000 7fb6dfe82640 1 -- start start 2024-09-16T01:18:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.821+0000 7fb6dfe82640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6d815e710 0x7fb6d80d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.821+0000 7fb6dfe82640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb6d80cfb60 0x7fb6d80cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.821+0000 7fb6dfe82640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d80d2170 con 0x7fb6d80b6010 2024-09-16T01:18:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.821+0000 7fb6dfe82640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d80d2d20 con 0x7fb6d815e710 2024-09-16T01:18:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.821+0000 7fb6dfe82640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d80d04b0 con 0x7fb6d80cfb60 2024-09-16T01:18:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.822+0000 7fb6ddc1e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6d815e710 0x7fb6d80d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.822+0000 7fb6de41f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb6d80b6010 0x7fb6d806ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38768/0 (socket says 172.21.15.81:38768) 2024-09-16T01:18:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.822+0000 7fb6de41f640 1 -- 172.21.15.81:0/653506348 learned_addr learned my addr 172.21.15.81:0/653506348 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:13.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.822+0000 7fb6dd41d640 1 --2- 172.21.15.81:0/653506348 >> v2:172.21.15.102:3300/0 conn(0x7fb6d80cfb60 0x7fb6d80cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.822+0000 7fb6ddc1e640 1 -- 172.21.15.81:0/653506348 >> v2:172.21.15.102:3300/0 conn(0x7fb6d80cfb60 msgr2=0x7fb6d80cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.822+0000 7fb6ddc1e640 1 --2- 172.21.15.81:0/653506348 >> v2:172.21.15.102:3300/0 conn(0x7fb6d80cfb60 0x7fb6d80cff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.822+0000 7fb6ddc1e640 1 -- 172.21.15.81:0/653506348 >> v1:172.21.15.81:6789/0 conn(0x7fb6d80b6010 legacy=0x7fb6d806ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.822+0000 7fb6ddc1e640 1 -- 172.21.15.81:0/653506348 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d80d2410 con 0x7fb6d815e710 2024-09-16T01:18:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.822+0000 7fb6dcc1c640 1 -- 172.21.15.81:0/653506348 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1831587832 0 0) 0x7fb6d80d2170 con 0x7fb6d80b6010 2024-09-16T01:18:13.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.822+0000 7fb6dd41d640 1 --2- 172.21.15.81:0/653506348 >> v2:172.21.15.102:3300/0 conn(0x7fb6d80cfb60 0x7fb6d80cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.823+0000 7fb6ddc1e640 1 --2- 172.21.15.81:0/653506348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d815e710 0x7fb6d80d31b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80a2470 tx=0x7fb6cc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab5e20a0b403b01 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.823+0000 7fb6dcc1c640 1 -- 172.21.15.81:0/653506348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc037070 con 0x7fb6d815e710 2024-09-16T01:18:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.823+0000 7fb6dcc1c640 1 -- 172.21.15.81:0/653506348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6cc032440 con 0x7fb6d815e710 2024-09-16T01:18:13.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.823+0000 7fb6dcc1c640 1 -- 172.21.15.81:0/653506348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc032810 con 0x7fb6d815e710 2024-09-16T01:18:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.823+0000 7fb6dfe82640 1 -- 172.21.15.81:0/653506348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d815e710 msgr2=0x7fb6d80d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.823+0000 7fb6dfe82640 1 --2- 172.21.15.81:0/653506348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d815e710 0x7fb6d80d31b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80a2470 tx=0x7fb6cc02a1a0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.823+0000 7fb6dfe82640 1 -- 172.21.15.81:0/653506348 shutdown_connections 2024-09-16T01:18:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.823+0000 7fb6dfe82640 1 --2- 172.21.15.81:0/653506348 >> v2:172.21.15.102:3300/0 conn(0x7fb6d80cfb60 0x7fb6d80cff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.823+0000 7fb6dfe82640 1 --2- 172.21.15.81:0/653506348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d815e710 0x7fb6d80d31b0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.823+0000 7fb6dfe82640 1 -- 172.21.15.81:0/653506348 >> 172.21.15.81:0/653506348 conn(0x7fb6d808bfc0 msgr2=0x7fb6d80d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.823+0000 7fb6dfe82640 1 -- 172.21.15.81:0/653506348 shutdown_connections 2024-09-16T01:18:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.823+0000 7fb6dfe82640 1 -- 172.21.15.81:0/653506348 wait complete. 2024-09-16T01:18:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.825+0000 7fb6dfe82640 1 Processor -- start 2024-09-16T01:18:13.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.825+0000 7fb6dfe82640 1 -- start start 2024-09-16T01:18:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.825+0000 7fb6dfe82640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d80b6010 0x7fb6d815c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.825+0000 7fb6dfe82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d80cfb60 0x7fb6d81f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.825+0000 7fb6dfe82640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6d815e710 0x7fb6d80b93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.825+0000 7fb6dfe82640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d80d29b0 con 0x7fb6d80cfb60 2024-09-16T01:18:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.825+0000 7fb6dfe82640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d80d26d0 con 0x7fb6d80b6010 2024-09-16T01:18:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.825+0000 7fb6dfe82640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d80b64a0 con 0x7fb6d815e710 2024-09-16T01:18:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.825+0000 7fb6dd41d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d80cfb60 0x7fb6d81f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.825+0000 7fb6dd41d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d80cfb60 0x7fb6d81f8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56894/0 (socket says 172.21.15.81:56894) 2024-09-16T01:18:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.825+0000 7fb6dd41d640 1 -- 172.21.15.81:0/2321400387 learned_addr learned my addr 172.21.15.81:0/2321400387 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6de41f640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6d815e710 0x7fb6d80b93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6ddc1e640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d80b6010 0x7fb6d815c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6dd41d640 1 -- 172.21.15.81:0/2321400387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6d815e710 msgr2=0x7fb6d80b93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6dd41d640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6d815e710 0x7fb6d80b93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6dd41d640 1 -- 172.21.15.81:0/2321400387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d80b6010 msgr2=0x7fb6d815c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:13.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6dd41d640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d80b6010 0x7fb6d815c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:13.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6dd41d640 1 -- 172.21.15.81:0/2321400387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d80ce130 con 0x7fb6d80cfb60 2024-09-16T01:18:13.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6ddc1e640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d80b6010 0x7fb6d815c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:13.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6de41f640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6d815e710 0x7fb6d80b93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:13.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6dd41d640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d80cfb60 0x7fb6d81f8260 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400e840 tx=0x7fb6d400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:13.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6ca7fc640 1 -- 172.21.15.81:0/2321400387 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d400f040 con 0x7fb6d80cfb60 2024-09-16T01:18:13.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6ca7fc640 1 -- 172.21.15.81:0/2321400387 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d4004030 con 0x7fb6d80cfb60 2024-09-16T01:18:13.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6dfe82640 1 -- 172.21.15.81:0/2321400387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d80ce410 con 0x7fb6d80cfb60 2024-09-16T01:18:13.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6ca7fc640 1 -- 172.21.15.81:0/2321400387 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4004420 con 0x7fb6d80cfb60 2024-09-16T01:18:13.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.826+0000 7fb6dfe82640 1 -- 172.21.15.81:0/2321400387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d809f8a0 con 0x7fb6d80cfb60 2024-09-16T01:18:13.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.827+0000 7fb6dfe82640 1 -- 172.21.15.81:0/2321400387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d80b6830 con 0x7fb6d80cfb60 2024-09-16T01:18:13.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.827+0000 7fb6ca7fc640 1 -- 172.21.15.81:0/2321400387 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb6d4005990 con 0x7fb6d80cfb60 2024-09-16T01:18:13.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.828+0000 7fb6ca7fc640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6bc06c2b0 0x7fb6bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:13.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.828+0000 7fb6ca7fc640 1 -- 172.21.15.81:0/2321400387 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7fb6d408b650 con 0x7fb6d80cfb60 2024-09-16T01:18:13.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.828+0000 7fb6ddc1e640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6bc06c2b0 0x7fb6bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:13.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.828+0000 7fb6ddc1e640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6bc06c2b0 0x7fb6bc06e770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc034000 tx=0x7fb6cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:13.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.832+0000 7fb6ca7fc640 1 -- 172.21.15.81:0/2321400387 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6d4020020 con 0x7fb6d80cfb60 2024-09-16T01:18:14.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:13.999+0000 7fb6dfe82640 1 -- 172.21.15.81:0/2321400387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6d80b6cf0 con 0x7fb6d80cfb60 2024-09-16T01:18:14.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.000+0000 7fb6ca7fc640 1 -- 172.21.15.81:0/2321400387 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16944 (secure 0 0 0) 0x7fb6d4017030 con 0x7fb6d80cfb60 2024-09-16T01:18:14.002 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:14.002 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":63,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:01.761014+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:17:58.703890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-16T01:17:59.055322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:18:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.003+0000 7fb6dfe82640 1 -- 172.21.15.81:0/2321400387 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6bc06c2b0 msgr2=0x7fb6bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.003+0000 7fb6dfe82640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6bc06c2b0 0x7fb6bc06e770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc034000 tx=0x7fb6cc02e000 comp rx=0 tx=0).stop 2024-09-16T01:18:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.003+0000 7fb6dfe82640 1 -- 172.21.15.81:0/2321400387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d80cfb60 msgr2=0x7fb6d81f8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.003+0000 7fb6dfe82640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d80cfb60 0x7fb6d81f8260 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400e840 tx=0x7fb6d400ed00 comp rx=0 tx=0).stop 2024-09-16T01:18:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.003+0000 7fb6dfe82640 1 -- 172.21.15.81:0/2321400387 shutdown_connections 2024-09-16T01:18:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.003+0000 7fb6dfe82640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6bc06c2b0 0x7fb6bc06e770 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.003+0000 7fb6dfe82640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6d815e710 0x7fb6d80b93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.003+0000 7fb6dfe82640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d80cfb60 0x7fb6d81f8260 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.003+0000 7fb6dfe82640 1 --2- 172.21.15.81:0/2321400387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d80b6010 0x7fb6d815c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.003+0000 7fb6dfe82640 1 -- 172.21.15.81:0/2321400387 >> 172.21.15.81:0/2321400387 conn(0x7fb6d808bfc0 msgr2=0x7fb6d80b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.003+0000 7fb6dfe82640 1 -- 172.21.15.81:0/2321400387 shutdown_connections 2024-09-16T01:18:14.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.003+0000 7fb6dfe82640 1 -- 172.21.15.81:0/2321400387 wait complete. 2024-09-16T01:18:14.016 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:18:14.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.113+0000 7f17668c9640 1 Processor -- start 2024-09-16T01:18:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.113+0000 7f17668c9640 1 -- start start 2024-09-16T01:18:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.114+0000 7f17668c9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f176009b140 0x7f1760169570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.114+0000 7f17668c9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f176006cec0 con 0x7f176006df60 2024-09-16T01:18:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.114+0000 7f17668c9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f176006d1a0 con 0x7f176015e5d0 2024-09-16T01:18:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.114+0000 7f17668c9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f176006dad0 con 0x7f176009b140 2024-09-16T01:18:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.114+0000 7f175f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f176006df60 0x7f176009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38778/0 (socket says 172.21.15.81:38778) 2024-09-16T01:18:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.114+0000 7f175f7fe640 1 -- 172.21.15.81:0/3500112965 learned_addr learned my addr 172.21.15.81:0/3500112965 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 554074544 0 0) 0x7f176006cec0 con 0x7f176006df60 2024-09-16T01:18:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f1764e66640 1 --2- 172.21.15.81:0/3500112965 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f176009b140 0x7f1760169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1748003520 con 0x7f176006df60 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1485074339 0 0) 0x7f1748003520 con 0x7f176006df60 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f176009b140 msgr2=0x7f1760169570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 --2- 172.21.15.81:0/3500112965 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f176009b140 0x7f1760169570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 >> v1:172.21.15.102:6789/0 conn(0x7f176015e5d0 legacy=0x7f17600d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176006d480 con 0x7f176006df60 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f1754001670 con 0x7f176006df60 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 >> v1:172.21.15.81:6789/0 conn(0x7f176006df60 legacy=0x7f176009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 --2- 172.21.15.81:0/3500112965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17480039e0 0x7f1748003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 --2- 172.21.15.81:0/3500112965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1748004800 0x7f1748004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 --2- 172.21.15.81:0/3500112965 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f176009b140 0x7f17480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f176006dad0 con 0x7f1748004800 2024-09-16T01:18:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f174800bb30 con 0x7f17480039e0 2024-09-16T01:18:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f174800bd30 con 0x7f176009b140 2024-09-16T01:18:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175f7fe640 1 --2- 172.21.15.81:0/3500112965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1748004800 0x7f1748004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175ffff640 1 --2- 172.21.15.81:0/3500112965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17480039e0 0x7f1748003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f1764e66640 1 --2- 172.21.15.81:0/3500112965 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f176009b140 0x7f17480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175f7fe640 1 -- 172.21.15.81:0/3500112965 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f176009b140 msgr2=0x7f17480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175f7fe640 1 --2- 172.21.15.81:0/3500112965 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f176009b140 0x7f17480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175f7fe640 1 -- 172.21.15.81:0/3500112965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17480039e0 msgr2=0x7f1748003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175f7fe640 1 --2- 172.21.15.81:0/3500112965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17480039e0 0x7f1748003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.115+0000 7f175f7fe640 1 -- 172.21.15.81:0/3500112965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1748003520 con 0x7f1748004800 2024-09-16T01:18:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.116+0000 7f175f7fe640 1 --2- 172.21.15.81:0/3500112965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1748004800 0x7f1748004c80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1754001050 tx=0x7f1748005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d571669cba953a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.116+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1754007d30 con 0x7f1748004800 2024-09-16T01:18:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.116+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1754005af0 con 0x7f1748004800 2024-09-16T01:18:14.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.116+0000 7f175effd640 1 -- 172.21.15.81:0/3500112965 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1754007070 con 0x7f1748004800 2024-09-16T01:18:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.117+0000 7f17668c9640 1 -- 172.21.15.81:0/3500112965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1748004800 msgr2=0x7f1748004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.117+0000 7f17668c9640 1 --2- 172.21.15.81:0/3500112965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1748004800 0x7f1748004c80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1754001050 tx=0x7f1748005830 comp rx=0 tx=0).stop 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.117+0000 7f1764e66640 1 -- 172.21.15.81:0/3500112965 reap_dead start 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.117+0000 7f17668c9640 1 -- 172.21.15.81:0/3500112965 shutdown_connections 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.117+0000 7f17668c9640 1 -- 172.21.15.81:0/3500112965 >> 172.21.15.81:0/3500112965 conn(0x7f17600d23a0 msgr2=0x7f17600d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.117+0000 7f17668c9640 1 -- 172.21.15.81:0/3500112965 shutdown_connections 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.117+0000 7f17668c9640 1 -- 172.21.15.81:0/3500112965 wait complete. 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.118+0000 7f17668c9640 1 Processor -- start 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.118+0000 7f17668c9640 1 -- start start 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f17668c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1748004800 0x7f1760152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f17668c9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17600b0ce0 0x7f17600b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f17668c9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17600b6aa0 0x7f17600b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f17668c9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17600d1980 con 0x7f17600b6aa0 2024-09-16T01:18:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f17668c9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f17600d1800 con 0x7f1748004800 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f17668c9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f176015e9b0 con 0x7f17600b0ce0 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f1764e66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17600b6aa0 0x7f17600b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f1764e66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17600b6aa0 0x7f17600b6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56920/0 (socket says 172.21.15.81:56920) 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f1764e66640 1 -- 172.21.15.81:0/3069704027 learned_addr learned my addr 172.21.15.81:0/3069704027 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f175f7fe640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17600b0ce0 0x7f17600b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f175ffff640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1748004800 0x7f1760152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f1764e66640 1 -- 172.21.15.81:0/3069704027 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17600b0ce0 msgr2=0x7f17600b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f1764e66640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17600b0ce0 0x7f17600b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f1764e66640 1 -- 172.21.15.81:0/3069704027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1748004800 msgr2=0x7f1760152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f1764e66640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1748004800 0x7f1760152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f1764e66640 1 -- 172.21.15.81:0/3069704027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17600b63a0 con 0x7f17600b6aa0 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.119+0000 7f1764e66640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17600b6aa0 0x7f17600b6f20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f176006cbf0 tx=0x7f175800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.120+0000 7f175cff9640 1 -- 172.21.15.81:0/3069704027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1758015430 con 0x7f17600b6aa0 2024-09-16T01:18:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.120+0000 7f175cff9640 1 -- 172.21.15.81:0/3069704027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17580155f0 con 0x7f17600b6aa0 2024-09-16T01:18:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.120+0000 7f17668c9640 1 -- 172.21.15.81:0/3069704027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17600b5300 con 0x7f17600b6aa0 2024-09-16T01:18:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.120+0000 7f175cff9640 1 -- 172.21.15.81:0/3069704027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17580159e0 con 0x7f17600b6aa0 2024-09-16T01:18:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.120+0000 7f17668c9640 1 -- 172.21.15.81:0/3069704027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17600b58c0 con 0x7f17600b6aa0 2024-09-16T01:18:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.121+0000 7f17668c9640 1 -- 172.21.15.81:0/3069704027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17600b1680 con 0x7f17600b6aa0 2024-09-16T01:18:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.121+0000 7f175cff9640 1 -- 172.21.15.81:0/3069704027 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1758015b80 con 0x7f17600b6aa0 2024-09-16T01:18:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.122+0000 7f175cff9640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f174c06c2e0 0x7f174c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.122+0000 7f175cff9640 1 -- 172.21.15.81:0/3069704027 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f175808c220 con 0x7f17600b6aa0 2024-09-16T01:18:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.122+0000 7f175ffff640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f174c06c2e0 0x7f174c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.122+0000 7f175ffff640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f174c06c2e0 0x7f174c06e7a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1750001760 tx=0x7f1750009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.126+0000 7f175cff9640 1 -- 172.21.15.81:0/3069704027 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1758019030 con 0x7f17600b6aa0 2024-09-16T01:18:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.324+0000 7f17668c9640 1 -- 172.21.15.81:0/3069704027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17600d2dc0 con 0x7f17600b6aa0 2024-09-16T01:18:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.325+0000 7f175cff9640 1 -- 172.21.15.81:0/3069704027 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5227 (secure 0 0 0) 0x7f1758010040 con 0x7f17600b6aa0 2024-09-16T01:18:14.327 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:14.327 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"btime":"2024-09-16T01:18:02:835480+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2000242607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2000242607},{"type":"v1","addr":"172.21.15.102:6834","nonce":2000242607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5087,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3268189429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3268189429},{"type":"v1","addr":"172.21.15.102:6835","nonce":3268189429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2730360991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2730360991},{"type":"v1","addr":"172.21.15.81:6836","nonce":2730360991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:00.081821+0000","modified":"2024-09-16T01:18:02.163419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/554158924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":554158924},{"type":"v1","addr":"172.21.15.81:6837","nonce":554158924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5667,"qdb_cluster":[5667]},"id":4}]} 2024-09-16T01:18:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-09-16T01:18:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.327+0000 7f17668c9640 1 -- 172.21.15.81:0/3069704027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f174c06c2e0 msgr2=0x7f174c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.327+0000 7f17668c9640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f174c06c2e0 0x7f174c06e7a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1750001760 tx=0x7f1750009040 comp rx=0 tx=0).stop 2024-09-16T01:18:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.327+0000 7f17668c9640 1 -- 172.21.15.81:0/3069704027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17600b6aa0 msgr2=0x7f17600b6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.327+0000 7f17668c9640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17600b6aa0 0x7f17600b6f20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f176006cbf0 tx=0x7f175800f580 comp rx=0 tx=0).stop 2024-09-16T01:18:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.327+0000 7f17668c9640 1 -- 172.21.15.81:0/3069704027 shutdown_connections 2024-09-16T01:18:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.327+0000 7f17668c9640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f174c06c2e0 0x7f174c06e7a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.327+0000 7f17668c9640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17600b6aa0 0x7f17600b6f20 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.327+0000 7f17668c9640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17600b0ce0 0x7f17600b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.327+0000 7f17668c9640 1 --2- 172.21.15.81:0/3069704027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1748004800 0x7f1760152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.327+0000 7f17668c9640 1 -- 172.21.15.81:0/3069704027 >> 172.21.15.81:0/3069704027 conn(0x7f17600d23a0 msgr2=0x7f1760070180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.327+0000 7f17668c9640 1 -- 172.21.15.81:0/3069704027 shutdown_connections 2024-09-16T01:18:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.327+0000 7f17668c9640 1 -- 172.21.15.81:0/3069704027 wait complete. 2024-09-16T01:18:14.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.436+0000 7f7a57a65640 1 Processor -- start 2024-09-16T01:18:14.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.437+0000 7f7a57a65640 1 -- start start 2024-09-16T01:18:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.437+0000 7f7a57a65640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7a5009aca0 0x7f7a5009b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.437+0000 7f7a57a65640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a500d12c0 con 0x7f7a5009b5c0 2024-09-16T01:18:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.437+0000 7f7a57a65640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a500d15a0 con 0x7f7a50071750 2024-09-16T01:18:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.437+0000 7f7a57a65640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7a5006d040 con 0x7f7a5009aca0 2024-09-16T01:18:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.438+0000 7f7a55000640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7a5009b5c0 0x7f7a500d05e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38794/0 (socket says 172.21.15.81:38794) 2024-09-16T01:18:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.438+0000 7f7a55000640 1 -- 172.21.15.81:0/1515587470 learned_addr learned my addr 172.21.15.81:0/1515587470 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.438+0000 7f7a55801640 1 --2- 172.21.15.81:0/1515587470 >> v2:172.21.15.81:3300/0 conn(0x7f7a5009aca0 0x7f7a5009b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.438+0000 7f7a4ffff640 1 -- 172.21.15.81:0/1515587470 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29080748 0 0) 0x7f7a500d12c0 con 0x7f7a5009b5c0 2024-09-16T01:18:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.438+0000 7f7a4ffff640 1 -- 172.21.15.81:0/1515587470 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a38003520 con 0x7f7a5009b5c0 2024-09-16T01:18:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.438+0000 7f7a55801640 1 -- 172.21.15.81:0/1515587470 >> v1:172.21.15.102:6789/0 conn(0x7f7a50071750 legacy=0x7f7a501680c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.438+0000 7f7a55801640 1 -- 172.21.15.81:0/1515587470 >> v1:172.21.15.81:6789/0 conn(0x7f7a5009b5c0 legacy=0x7f7a500d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.438+0000 7f7a4ffff640 1 -- 172.21.15.81:0/1515587470 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2075189356 0 0) 0x7f7a500d15a0 con 0x7f7a50071750 2024-09-16T01:18:14.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.438+0000 7f7a55801640 1 -- 172.21.15.81:0/1515587470 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a500d1880 con 0x7f7a5009aca0 2024-09-16T01:18:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.439+0000 7f7a55801640 1 --2- 172.21.15.81:0/1515587470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5009aca0 0x7f7a5009b080 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009d90 tx=0x7f7a4002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a61ce8f4cfa97b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.439+0000 7f7a4ffff640 1 -- 172.21.15.81:0/1515587470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40007740 con 0x7f7a5009aca0 2024-09-16T01:18:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.439+0000 7f7a4ffff640 1 -- 172.21.15.81:0/1515587470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a400078e0 con 0x7f7a5009aca0 2024-09-16T01:18:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.439+0000 7f7a4ffff640 1 -- 172.21.15.81:0/1515587470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40007cb0 con 0x7f7a5009aca0 2024-09-16T01:18:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.440+0000 7f7a57a65640 1 -- 172.21.15.81:0/1515587470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5009aca0 msgr2=0x7f7a5009b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.440+0000 7f7a57a65640 1 --2- 172.21.15.81:0/1515587470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5009aca0 0x7f7a5009b080 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009d90 tx=0x7f7a4002a6f0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.440+0000 7f7a57a65640 1 -- 172.21.15.81:0/1515587470 shutdown_connections 2024-09-16T01:18:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.440+0000 7f7a57a65640 1 --2- 172.21.15.81:0/1515587470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5009aca0 0x7f7a5009b080 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.440+0000 7f7a57a65640 1 -- 172.21.15.81:0/1515587470 >> 172.21.15.81:0/1515587470 conn(0x7f7a500d23a0 msgr2=0x7f7a500d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.440+0000 7f7a57a65640 1 -- 172.21.15.81:0/1515587470 shutdown_connections 2024-09-16T01:18:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.440+0000 7f7a57a65640 1 -- 172.21.15.81:0/1515587470 wait complete. 2024-09-16T01:18:14.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.441+0000 7f7a57a65640 1 Processor -- start 2024-09-16T01:18:14.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.441+0000 7f7a57a65640 1 -- start start 2024-09-16T01:18:14.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a57a65640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a50071750 0x7f7a500ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a57a65640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a5009aca0 0x7f7a500cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a57a65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5009b5c0 0x7f7a500cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a57a65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7a500d0cf0 con 0x7f7a5009b5c0 2024-09-16T01:18:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a57a65640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7a50070220 con 0x7f7a50071750 2024-09-16T01:18:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a57a65640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7a500d0e70 con 0x7f7a5009aca0 2024-09-16T01:18:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a56002640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5009b5c0 0x7f7a500cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a56002640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5009b5c0 0x7f7a500cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56942/0 (socket says 172.21.15.81:56942) 2024-09-16T01:18:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a56002640 1 -- 172.21.15.81:0/2304023639 learned_addr learned my addr 172.21.15.81:0/2304023639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a56002640 1 -- 172.21.15.81:0/2304023639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a5009aca0 msgr2=0x7f7a500cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a56002640 1 --2- 172.21.15.81:0/2304023639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a5009aca0 0x7f7a500cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a56002640 1 -- 172.21.15.81:0/2304023639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a50071750 msgr2=0x7f7a500ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a56002640 1 --2- 172.21.15.81:0/2304023639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a50071750 0x7f7a500ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a56002640 1 -- 172.21.15.81:0/2304023639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a50159b50 con 0x7f7a5009b5c0 2024-09-16T01:18:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a56002640 1 --2- 172.21.15.81:0/2304023639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5009b5c0 0x7f7a500cdf60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c410 tx=0x7f7a4800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a4dffb640 1 -- 172.21.15.81:0/2304023639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48017070 con 0x7f7a5009b5c0 2024-09-16T01:18:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a4dffb640 1 -- 172.21.15.81:0/2304023639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a480035f0 con 0x7f7a5009b5c0 2024-09-16T01:18:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a57a65640 1 -- 172.21.15.81:0/2304023639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a500c5f70 con 0x7f7a5009b5c0 2024-09-16T01:18:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.442+0000 7f7a4dffb640 1 -- 172.21.15.81:0/2304023639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480039e0 con 0x7f7a5009b5c0 2024-09-16T01:18:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.443+0000 7f7a57a65640 1 -- 172.21.15.81:0/2304023639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a500c6530 con 0x7f7a5009b5c0 2024-09-16T01:18:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.444+0000 7f7a57a65640 1 -- 172.21.15.81:0/2304023639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a5009b080 con 0x7f7a5009b5c0 2024-09-16T01:18:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.444+0000 7f7a4dffb640 1 -- 172.21.15.81:0/2304023639 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7a4801a070 con 0x7f7a5009b5c0 2024-09-16T01:18:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.445+0000 7f7a4dffb640 1 --2- 172.21.15.81:0/2304023639 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7a3c06c2b0 0x7f7a3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.445+0000 7f7a4dffb640 1 -- 172.21.15.81:0/2304023639 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f7a4808a940 con 0x7f7a5009b5c0 2024-09-16T01:18:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.445+0000 7f7a55801640 1 --2- 172.21.15.81:0/2304023639 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7a3c06c2b0 0x7f7a3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.445+0000 7f7a55801640 1 --2- 172.21.15.81:0/2304023639 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7a3c06c2b0 0x7f7a3c06e770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7a40034000 tx=0x7f7a4002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.449+0000 7f7a4dffb640 1 -- 172.21.15.81:0/2304023639 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a50159b50 con 0x7f7a5009b5c0 2024-09-16T01:18:14.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.648+0000 7f7a57a65640 1 -- 172.21.15.81:0/2304023639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a500b1150 con 0x7f7a5009b5c0 2024-09-16T01:18:14.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.649+0000 7f7a4dffb640 1 -- 172.21.15.81:0/2304023639 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5227 (secure 0 0 0) 0x7f7a48058f50 con 0x7f7a5009b5c0 2024-09-16T01:18:14.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:14.651 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":29,"btime":"2024-09-16T01:18:02:835480+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2000242607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2000242607},{"type":"v1","addr":"172.21.15.102:6834","nonce":2000242607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5087,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3268189429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3268189429},{"type":"v1","addr":"172.21.15.102:6835","nonce":3268189429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2730360991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2730360991},{"type":"v1","addr":"172.21.15.81:6836","nonce":2730360991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:00.081821+0000","modified":"2024-09-16T01:18:02.163419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5667},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5667":{"gid":5667,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/554158924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":554158924},{"type":"v1","addr":"172.21.15.81:6837","nonce":554158924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5667,"qdb_cluster":[5667]},"id":4}]} 2024-09-16T01:18:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 29 2024-09-16T01:18:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.651+0000 7f7a57a65640 1 -- 172.21.15.81:0/2304023639 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7a3c06c2b0 msgr2=0x7f7a3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.651+0000 7f7a57a65640 1 --2- 172.21.15.81:0/2304023639 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7a3c06c2b0 0x7f7a3c06e770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7a40034000 tx=0x7f7a4002e000 comp rx=0 tx=0).stop 2024-09-16T01:18:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.651+0000 7f7a57a65640 1 -- 172.21.15.81:0/2304023639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5009b5c0 msgr2=0x7f7a500cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.651+0000 7f7a57a65640 1 --2- 172.21.15.81:0/2304023639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5009b5c0 0x7f7a500cdf60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800c410 tx=0x7f7a4800c8d0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.651+0000 7f7a57a65640 1 -- 172.21.15.81:0/2304023639 shutdown_connections 2024-09-16T01:18:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.651+0000 7f7a57a65640 1 --2- 172.21.15.81:0/2304023639 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7a3c06c2b0 0x7f7a3c06e770 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.651+0000 7f7a57a65640 1 --2- 172.21.15.81:0/2304023639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a5009b5c0 0x7f7a500cdf60 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.651+0000 7f7a57a65640 1 --2- 172.21.15.81:0/2304023639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a5009aca0 0x7f7a500cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.651+0000 7f7a57a65640 1 --2- 172.21.15.81:0/2304023639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7a50071750 0x7f7a500ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.651+0000 7f7a57a65640 1 -- 172.21.15.81:0/2304023639 >> 172.21.15.81:0/2304023639 conn(0x7f7a500d23a0 msgr2=0x7f7a5015a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.651+0000 7f7a57a65640 1 -- 172.21.15.81:0/2304023639 shutdown_connections 2024-09-16T01:18:14.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.651+0000 7f7a57a65640 1 -- 172.21.15.81:0/2304023639 wait complete. 2024-09-16T01:18:14.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:18:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.760+0000 7f4e22731640 1 Processor -- start 2024-09-16T01:18:14.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.760+0000 7f4e22731640 1 -- start start 2024-09-16T01:18:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.761+0000 7f4e22731640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e1c0b69d0 0x7f4e1c162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.761+0000 7f4e22731640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e1c15eb60 con 0x7f4e1c0b0180 2024-09-16T01:18:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.761+0000 7f4e22731640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e1c15ee40 con 0x7f4e1c0af280 2024-09-16T01:18:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.761+0000 7f4e22731640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4e1c0b6db0 con 0x7f4e1c0b69d0 2024-09-16T01:18:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.761+0000 7f4e1bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4e1c0b69d0 0x7f4e1c162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.761+0000 7f4e20cce640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4e1c0b0180 0x7f4e1c154d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38798/0 (socket says 172.21.15.81:38798) 2024-09-16T01:18:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.761+0000 7f4e20cce640 1 -- 172.21.15.81:0/2626448507 learned_addr learned my addr 172.21.15.81:0/2626448507 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.761+0000 7f4e1bfff640 1 -- 172.21.15.81:0/2626448507 >> v1:172.21.15.102:6789/0 conn(0x7f4e1c0af280 legacy=0x7f4e1c0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.761+0000 7f4e1bfff640 1 -- 172.21.15.81:0/2626448507 >> v1:172.21.15.81:6789/0 conn(0x7f4e1c0b0180 legacy=0x7f4e1c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.761+0000 7f4e1affd640 1 -- 172.21.15.81:0/2626448507 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290408036 0 0) 0x7f4e1c15eb60 con 0x7f4e1c0b0180 2024-09-16T01:18:14.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.761+0000 7f4e1bfff640 1 -- 172.21.15.81:0/2626448507 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1c15f120 con 0x7f4e1c0b69d0 2024-09-16T01:18:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.762+0000 7f4e1bfff640 1 --2- 172.21.15.81:0/2626448507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c0b69d0 0x7f4e1c162a50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0b6f30 tx=0x7f4e0c02a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9bdec8741062ff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.762+0000 7f4e1affd640 1 -- 172.21.15.81:0/2626448507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c037070 con 0x7f4e1c0b69d0 2024-09-16T01:18:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.762+0000 7f4e1affd640 1 -- 172.21.15.81:0/2626448507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0c02adb0 con 0x7f4e1c0b69d0 2024-09-16T01:18:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.762+0000 7f4e1affd640 1 -- 172.21.15.81:0/2626448507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c032660 con 0x7f4e1c0b69d0 2024-09-16T01:18:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.763+0000 7f4e22731640 1 -- 172.21.15.81:0/2626448507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c0b69d0 msgr2=0x7f4e1c162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.763+0000 7f4e22731640 1 --2- 172.21.15.81:0/2626448507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c0b69d0 0x7f4e1c162a50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0b6f30 tx=0x7f4e0c02a0a0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.763+0000 7f4e22731640 1 -- 172.21.15.81:0/2626448507 shutdown_connections 2024-09-16T01:18:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.763+0000 7f4e22731640 1 --2- 172.21.15.81:0/2626448507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c0b69d0 0x7f4e1c162a50 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.763+0000 7f4e22731640 1 -- 172.21.15.81:0/2626448507 >> 172.21.15.81:0/2626448507 conn(0x7f4e1c06bc10 msgr2=0x7f4e1c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.763+0000 7f4e22731640 1 -- 172.21.15.81:0/2626448507 shutdown_connections 2024-09-16T01:18:14.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.763+0000 7f4e22731640 1 -- 172.21.15.81:0/2626448507 wait complete. 2024-09-16T01:18:14.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.764+0000 7f4e22731640 1 Processor -- start 2024-09-16T01:18:14.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.764+0000 7f4e22731640 1 -- start start 2024-09-16T01:18:14.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e22731640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c0af280 0x7f4e1c1460b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e22731640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e1c0b0180 0x7f4e1c157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e22731640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e1c0b69d0 0x7f4e1c157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e22731640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c06f870 con 0x7f4e1c0af280 2024-09-16T01:18:14.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e22731640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1c0af710 con 0x7f4e1c0b0180 2024-09-16T01:18:14.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e22731640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1c06f9f0 con 0x7f4e1c0b69d0 2024-09-16T01:18:14.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e1bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c0af280 0x7f4e1c1460b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e1bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c0af280 0x7f4e1c1460b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56966/0 (socket says 172.21.15.81:56966) 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e1bfff640 1 -- 172.21.15.81:0/725801583 learned_addr learned my addr 172.21.15.81:0/725801583 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e20cce640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e1c0b69d0 0x7f4e1c157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e1b7fe640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e1c0b0180 0x7f4e1c157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e1bfff640 1 -- 172.21.15.81:0/725801583 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e1c0b69d0 msgr2=0x7f4e1c157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e1bfff640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e1c0b69d0 0x7f4e1c157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e1bfff640 1 -- 172.21.15.81:0/725801583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e1c0b0180 msgr2=0x7f4e1c157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e1bfff640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e1c0b0180 0x7f4e1c157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e1bfff640 1 -- 172.21.15.81:0/725801583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1c1465f0 con 0x7f4e1c0af280 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e1bfff640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c0af280 0x7f4e1c1460b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c035040 tx=0x7f4e0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e18ff9640 1 -- 172.21.15.81:0/725801583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c037040 con 0x7f4e1c0af280 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e18ff9640 1 -- 172.21.15.81:0/725801583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e0c004030 con 0x7f4e1c0af280 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e22731640 1 -- 172.21.15.81:0/725801583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e1c0cfe20 con 0x7f4e1c0af280 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e18ff9640 1 -- 172.21.15.81:0/725801583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c004420 con 0x7f4e1c0af280 2024-09-16T01:18:14.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.765+0000 7f4e22731640 1 -- 172.21.15.81:0/725801583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e1c159120 con 0x7f4e1c0af280 2024-09-16T01:18:14.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.766+0000 7f4e22731640 1 -- 172.21.15.81:0/725801583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e1c162a50 con 0x7f4e1c0af280 2024-09-16T01:18:14.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.767+0000 7f4e18ff9640 1 -- 172.21.15.81:0/725801583 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4e0c03d650 con 0x7f4e1c0af280 2024-09-16T01:18:14.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.767+0000 7f4e18ff9640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e0806c2e0 0x7f4e0806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:14.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.767+0000 7f4e18ff9640 1 -- 172.21.15.81:0/725801583 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f4e0c0abea0 con 0x7f4e1c0af280 2024-09-16T01:18:14.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.767+0000 7f4e1b7fe640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e0806c2e0 0x7f4e0806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:14.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.768+0000 7f4e1b7fe640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e0806c2e0 0x7f4e0806e7a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4e10006fd0 tx=0x7f4e10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:14.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.772+0000 7f4e18ff9640 1 -- 172.21.15.81:0/725801583 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e0c042020 con 0x7f4e1c0af280 2024-09-16T01:18:14.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.938+0000 7f4e22731640 1 -- 172.21.15.81:0/725801583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e1c15dfe0 con 0x7f4e1c0af280 2024-09-16T01:18:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.939+0000 7f4e18ff9640 1 -- 172.21.15.81:0/725801583 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+16944 (secure 0 0 0) 0x7f4e0c07a480 con 0x7f4e1c0af280 2024-09-16T01:18:14.941 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:14.941 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":63,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:01.761014+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:17:58.703890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-16T01:17:59.055322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:18:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.941+0000 7f4e22731640 1 -- 172.21.15.81:0/725801583 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e0806c2e0 msgr2=0x7f4e0806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.941+0000 7f4e22731640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e0806c2e0 0x7f4e0806e7a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4e10006fd0 tx=0x7f4e10008040 comp rx=0 tx=0).stop 2024-09-16T01:18:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.941+0000 7f4e22731640 1 -- 172.21.15.81:0/725801583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c0af280 msgr2=0x7f4e1c1460b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.941+0000 7f4e22731640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c0af280 0x7f4e1c1460b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c035040 tx=0x7f4e0c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.941+0000 7f4e22731640 1 -- 172.21.15.81:0/725801583 shutdown_connections 2024-09-16T01:18:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.941+0000 7f4e22731640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e0806c2e0 0x7f4e0806e7a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.941+0000 7f4e22731640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e1c0b69d0 0x7f4e1c157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.941+0000 7f4e22731640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e1c0b0180 0x7f4e1c157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.941+0000 7f4e22731640 1 --2- 172.21.15.81:0/725801583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1c0af280 0x7f4e1c1460b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.941+0000 7f4e22731640 1 -- 172.21.15.81:0/725801583 >> 172.21.15.81:0/725801583 conn(0x7f4e1c06bc10 msgr2=0x7f4e1c0afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.941+0000 7f4e22731640 1 -- 172.21.15.81:0/725801583 shutdown_connections 2024-09-16T01:18:14.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:14.941+0000 7f4e22731640 1 -- 172.21.15.81:0/725801583 wait complete. 2024-09-16T01:18:14.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:18:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.051+0000 7f7814de4640 1 Processor -- start 2024-09-16T01:18:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.051+0000 7f7814de4640 1 -- start start 2024-09-16T01:18:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f7814de4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f781015ba30 0x7f781006f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f7814de4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f781006fd50 0x7f7810072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f7814de4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78100b3570 con 0x7f7810072e80 2024-09-16T01:18:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f7814de4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f78100732f0 con 0x7f781006fd50 2024-09-16T01:18:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f7814de4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f78100b4180 con 0x7f781015ba30 2024-09-16T01:18:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f780dd9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f781006fd50 0x7f7810072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f780ed9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7810072e80 0x7f781006e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38814/0 (socket says 172.21.15.81:38814) 2024-09-16T01:18:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f780ed9d640 1 -- 172.21.15.81:0/2467652099 learned_addr learned my addr 172.21.15.81:0/2467652099 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f780e59c640 1 --2- 172.21.15.81:0/2467652099 >> v2:172.21.15.102:3300/0 conn(0x7f781015ba30 0x7f781006f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f780dd9b640 1 -- 172.21.15.81:0/2467652099 >> v2:172.21.15.102:3300/0 conn(0x7f781015ba30 msgr2=0x7f781006f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f780dd9b640 1 --2- 172.21.15.81:0/2467652099 >> v2:172.21.15.102:3300/0 conn(0x7f781015ba30 0x7f781006f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f780dd9b640 1 -- 172.21.15.81:0/2467652099 >> v1:172.21.15.81:6789/0 conn(0x7f7810072e80 legacy=0x7f781006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f780d59a640 1 -- 172.21.15.81:0/2467652099 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496894247 0 0) 0x7f78100b3570 con 0x7f7810072e80 2024-09-16T01:18:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.052+0000 7f780dd9b640 1 -- 172.21.15.81:0/2467652099 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78100b3850 con 0x7f781006fd50 2024-09-16T01:18:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.053+0000 7f780e59c640 1 --2- 172.21.15.81:0/2467652099 >> v2:172.21.15.102:3300/0 conn(0x7f781015ba30 0x7f781006f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.053+0000 7f780dd9b640 1 --2- 172.21.15.81:0/2467652099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f781006fd50 0x7f7810072940 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f781006ca90 tx=0x7f780402c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5869ad25a3b8f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.053+0000 7f780d59a640 1 -- 172.21.15.81:0/2467652099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7804032770 con 0x7f781006fd50 2024-09-16T01:18:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.053+0000 7f780d59a640 1 -- 172.21.15.81:0/2467652099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7804038070 con 0x7f781006fd50 2024-09-16T01:18:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.053+0000 7f780d59a640 1 -- 172.21.15.81:0/2467652099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7804032b30 con 0x7f781006fd50 2024-09-16T01:18:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.054+0000 7f7814de4640 1 -- 172.21.15.81:0/2467652099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f781006fd50 msgr2=0x7f7810072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.054+0000 7f7814de4640 1 --2- 172.21.15.81:0/2467652099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f781006fd50 0x7f7810072940 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f781006ca90 tx=0x7f780402c870 comp rx=0 tx=0).stop 2024-09-16T01:18:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.054+0000 7f7814de4640 1 -- 172.21.15.81:0/2467652099 shutdown_connections 2024-09-16T01:18:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.054+0000 7f7814de4640 1 --2- 172.21.15.81:0/2467652099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f781006fd50 0x7f7810072940 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.054+0000 7f7814de4640 1 --2- 172.21.15.81:0/2467652099 >> v2:172.21.15.102:3300/0 conn(0x7f781015ba30 0x7f781006f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.054+0000 7f7814de4640 1 -- 172.21.15.81:0/2467652099 >> 172.21.15.81:0/2467652099 conn(0x7f7810067d70 msgr2=0x7f781006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.054+0000 7f7814de4640 1 -- 172.21.15.81:0/2467652099 shutdown_connections 2024-09-16T01:18:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.054+0000 7f7814de4640 1 -- 172.21.15.81:0/2467652099 wait complete. 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.055+0000 7f7814de4640 1 Processor -- start 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.055+0000 7f7814de4640 1 -- start start 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.056+0000 7f7814de4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f781006fd50 0x7f7810154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.056+0000 7f7814de4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7810072e80 0x7f7810151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.056+0000 7f7814de4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f781015ba30 0x7f78101f0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.056+0000 7f7814de4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78100ce810 con 0x7f7810072e80 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.056+0000 7f7814de4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f78100b3e10 con 0x7f781015ba30 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.056+0000 7f7814de4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f78100b5890 con 0x7f781006fd50 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.056+0000 7f780dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7810072e80 0x7f7810151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.056+0000 7f780dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7810072e80 0x7f7810151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56980/0 (socket says 172.21.15.81:56980) 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.056+0000 7f780dd9b640 1 -- 172.21.15.81:0/172376364 learned_addr learned my addr 172.21.15.81:0/172376364 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.056+0000 7f780e59c640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f781006fd50 0x7f7810154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.056+0000 7f780ed9d640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f781015ba30 0x7f78101f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.057+0000 7f780dd9b640 1 -- 172.21.15.81:0/172376364 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f781006fd50 msgr2=0x7f7810154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.057+0000 7f780dd9b640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f781006fd50 0x7f7810154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.057+0000 7f780dd9b640 1 -- 172.21.15.81:0/172376364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f781015ba30 msgr2=0x7f78101f0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.057+0000 7f780dd9b640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f781015ba30 0x7f78101f0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.057+0000 7f780dd9b640 1 -- 172.21.15.81:0/172376364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78101550b0 con 0x7f7810072e80 2024-09-16T01:18:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.057+0000 7f780ed9d640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f781015ba30 0x7f78101f0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.057+0000 7f780dd9b640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7810072e80 0x7f7810151e00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f780400bb30 tx=0x7f78040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.057+0000 7f77feffd640 1 -- 172.21.15.81:0/172376364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780404a070 con 0x7f7810072e80 2024-09-16T01:18:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.057+0000 7f77feffd640 1 -- 172.21.15.81:0/172376364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7804032e50 con 0x7f7810072e80 2024-09-16T01:18:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.057+0000 7f77feffd640 1 -- 172.21.15.81:0/172376364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7804033850 con 0x7f7810072e80 2024-09-16T01:18:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.057+0000 7f7814de4640 1 -- 172.21.15.81:0/172376364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7810155390 con 0x7f7810072e80 2024-09-16T01:18:15.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.057+0000 7f7814de4640 1 -- 172.21.15.81:0/172376364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7810155c40 con 0x7f7810072e80 2024-09-16T01:18:15.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.058+0000 7f7814de4640 1 -- 172.21.15.81:0/172376364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78100ccfe0 con 0x7f7810072e80 2024-09-16T01:18:15.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.058+0000 7f77feffd640 1 -- 172.21.15.81:0/172376364 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f780404d070 con 0x7f7810072e80 2024-09-16T01:18:15.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.059+0000 7f77feffd640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f77f006c2b0 0x7f77f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:15.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.059+0000 7f77feffd640 1 -- 172.21.15.81:0/172376364 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6101+0+0 (secure 0 0 0) 0x7f78040add20 con 0x7f7810072e80 2024-09-16T01:18:15.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.059+0000 7f780e59c640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f77f006c2b0 0x7f77f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:15.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.059+0000 7f780e59c640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f77f006c2b0 0x7f77f006e770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f781015df50 tx=0x7f7808009870 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:15.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.063+0000 7f77feffd640 1 -- 172.21.15.81:0/172376364 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f780407bcb0 con 0x7f7810072e80 2024-09-16T01:18:15.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.262+0000 7f7814de4640 1 -- 172.21.15.81:0/172376364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f78100b2f80 con 0x7f7810072e80 2024-09-16T01:18:15.264 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-16T01:18:15.263+0000 7f4e951a0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:18:15.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.264+0000 7f77feffd640 1 -- 172.21.15.81:0/172376364 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) ==== 161+0+0 (secure 0 0 0) 0x7f780407ffb0 con 0x7f7810072e80 2024-09-16T01:18:15.266 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:18:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.267+0000 7f7814de4640 1 -- 172.21.15.81:0/172376364 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f77f006c2b0 msgr2=0x7f77f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.267+0000 7f7814de4640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f77f006c2b0 0x7f77f006e770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f781015df50 tx=0x7f7808009870 comp rx=0 tx=0).stop 2024-09-16T01:18:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.267+0000 7f7814de4640 1 -- 172.21.15.81:0/172376364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7810072e80 msgr2=0x7f7810151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.267+0000 7f7814de4640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7810072e80 0x7f7810151e00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f780400bb30 tx=0x7f78040046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.267+0000 7f7814de4640 1 -- 172.21.15.81:0/172376364 shutdown_connections 2024-09-16T01:18:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.267+0000 7f7814de4640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f77f006c2b0 0x7f77f006e770 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.267+0000 7f7814de4640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f781015ba30 0x7f78101f0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.267+0000 7f7814de4640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7810072e80 0x7f7810151e00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.267+0000 7f7814de4640 1 --2- 172.21.15.81:0/172376364 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f781006fd50 0x7f7810154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.267+0000 7f7814de4640 1 -- 172.21.15.81:0/172376364 >> 172.21.15.81:0/172376364 conn(0x7f7810067d70 msgr2=0x7f781006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.267+0000 7f7814de4640 1 -- 172.21.15.81:0/172376364 shutdown_connections 2024-09-16T01:18:15.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.267+0000 7f7814de4640 1 -- 172.21.15.81:0/172376364 wait complete. 2024-09-16T01:18:15.270 INFO:tasks.ceph.mds.a.smithi081.stderr: -2127> 2024-09-16T01:18:02.013+0000 7f3be739f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:18:15.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:18:15.297 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:18:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.378+0000 7fb5cba5e640 1 Processor -- start 2024-09-16T01:18:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.378+0000 7fb5cba5e640 1 -- start start 2024-09-16T01:18:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.379+0000 7fb5cba5e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb5c415e5d0 0x7fb5c40cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.379+0000 7fb5cba5e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb5c40d4df0 0x7fb5c41621b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.379+0000 7fb5cba5e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c40b11f0 con 0x7fb5c41626f0 2024-09-16T01:18:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.379+0000 7fb5cba5e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c4162b60 con 0x7fb5c40d4df0 2024-09-16T01:18:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.379+0000 7fb5cba5e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c40d0100 con 0x7fb5c415e5d0 2024-09-16T01:18:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.379+0000 7fb5c8ff9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb5c40d4df0 0x7fb5c41621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.379+0000 7fb5c9ffb640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb5c41626f0 0x7fb5c40d2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38830/0 (socket says 172.21.15.81:38830) 2024-09-16T01:18:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.379+0000 7fb5c9ffb640 1 -- 172.21.15.81:0/2248709240 learned_addr learned my addr 172.21.15.81:0/2248709240 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.380+0000 7fb5c97fa640 1 --2- 172.21.15.81:0/2248709240 >> v2:172.21.15.102:3300/0 conn(0x7fb5c415e5d0 0x7fb5c40cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.380+0000 7fb5c8ff9640 1 -- 172.21.15.81:0/2248709240 >> v2:172.21.15.102:3300/0 conn(0x7fb5c415e5d0 msgr2=0x7fb5c40cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.380+0000 7fb5c8ff9640 1 --2- 172.21.15.81:0/2248709240 >> v2:172.21.15.102:3300/0 conn(0x7fb5c415e5d0 0x7fb5c40cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.380+0000 7fb5c8ff9640 1 -- 172.21.15.81:0/2248709240 >> v1:172.21.15.81:6789/0 conn(0x7fb5c41626f0 legacy=0x7fb5c40d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.380+0000 7fb5c3fff640 1 -- 172.21.15.81:0/2248709240 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1905705929 0 0) 0x7fb5c40b11f0 con 0x7fb5c41626f0 2024-09-16T01:18:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.380+0000 7fb5c8ff9640 1 -- 172.21.15.81:0/2248709240 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c40cfb40 con 0x7fb5c40d4df0 2024-09-16T01:18:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.380+0000 7fb5c8ff9640 1 --2- 172.21.15.81:0/2248709240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c40d4df0 0x7fb5c41621b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb5c408ed50 tx=0x7fb5b802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f689f80bddd3a67e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.381+0000 7fb5c3fff640 1 -- 172.21.15.81:0/2248709240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8037070 con 0x7fb5c40d4df0 2024-09-16T01:18:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.381+0000 7fb5c3fff640 1 -- 172.21.15.81:0/2248709240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b8032440 con 0x7fb5c40d4df0 2024-09-16T01:18:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.381+0000 7fb5c3fff640 1 -- 172.21.15.81:0/2248709240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b802ae60 con 0x7fb5c40d4df0 2024-09-16T01:18:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.381+0000 7fb5cba5e640 1 -- 172.21.15.81:0/2248709240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c40d4df0 msgr2=0x7fb5c41621b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.381+0000 7fb5cba5e640 1 --2- 172.21.15.81:0/2248709240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c40d4df0 0x7fb5c41621b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb5c408ed50 tx=0x7fb5b802a110 comp rx=0 tx=0).stop 2024-09-16T01:18:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.381+0000 7fb5cba5e640 1 -- 172.21.15.81:0/2248709240 shutdown_connections 2024-09-16T01:18:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.381+0000 7fb5cba5e640 1 --2- 172.21.15.81:0/2248709240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c40d4df0 0x7fb5c41621b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.381+0000 7fb5cba5e640 1 --2- 172.21.15.81:0/2248709240 >> v2:172.21.15.102:3300/0 conn(0x7fb5c415e5d0 0x7fb5c40cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.381+0000 7fb5cba5e640 1 -- 172.21.15.81:0/2248709240 >> 172.21.15.81:0/2248709240 conn(0x7fb5c408bfc0 msgr2=0x7fb5c40d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.381+0000 7fb5cba5e640 1 -- 172.21.15.81:0/2248709240 shutdown_connections 2024-09-16T01:18:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.381+0000 7fb5cba5e640 1 -- 172.21.15.81:0/2248709240 wait complete. 2024-09-16T01:18:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.382+0000 7fb5cba5e640 1 Processor -- start 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.383+0000 7fb5cba5e640 1 -- start start 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.383+0000 7fb5cba5e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c40d4df0 0x7fb5c40b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.383+0000 7fb5cba5e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c415e5d0 0x7fb5c40b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.383+0000 7fb5cba5e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c41626f0 0x7fb5c40b8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.383+0000 7fb5cba5e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c415e9b0 con 0x7fb5c415e5d0 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.383+0000 7fb5cba5e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c40b1490 con 0x7fb5c41626f0 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.383+0000 7fb5cba5e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c415eb30 con 0x7fb5c40d4df0 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.383+0000 7fb5c8ff9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c415e5d0 0x7fb5c40b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.383+0000 7fb5c8ff9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c415e5d0 0x7fb5c40b7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57016/0 (socket says 172.21.15.81:57016) 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.383+0000 7fb5c8ff9640 1 -- 172.21.15.81:0/600256838 learned_addr learned my addr 172.21.15.81:0/600256838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.383+0000 7fb5c97fa640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c40d4df0 0x7fb5c40b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.383+0000 7fb5c9ffb640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c41626f0 0x7fb5c40b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.384+0000 7fb5c8ff9640 1 -- 172.21.15.81:0/600256838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c40d4df0 msgr2=0x7fb5c40b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.384+0000 7fb5c8ff9640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c40d4df0 0x7fb5c40b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.384+0000 7fb5c8ff9640 1 -- 172.21.15.81:0/600256838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c41626f0 msgr2=0x7fb5c40b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.384+0000 7fb5c8ff9640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c41626f0 0x7fb5c40b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.384+0000 7fb5c8ff9640 1 -- 172.21.15.81:0/600256838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c40b56b0 con 0x7fb5c415e5d0 2024-09-16T01:18:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.384+0000 7fb5c9ffb640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c41626f0 0x7fb5c40b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.384+0000 7fb5c8ff9640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c415e5d0 0x7fb5c40b7fc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8000c00 tx=0x7fb5b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.384+0000 7fb5c1ffb640 1 -- 172.21.15.81:0/600256838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8037040 con 0x7fb5c415e5d0 2024-09-16T01:18:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.384+0000 7fb5c1ffb640 1 -- 172.21.15.81:0/600256838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b8042070 con 0x7fb5c415e5d0 2024-09-16T01:18:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.384+0000 7fb5c1ffb640 1 -- 172.21.15.81:0/600256838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8030960 con 0x7fb5c415e5d0 2024-09-16T01:18:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.384+0000 7fb5cba5e640 1 -- 172.21.15.81:0/600256838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c40b5990 con 0x7fb5c415e5d0 2024-09-16T01:18:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.384+0000 7fb5cba5e640 1 -- 172.21.15.81:0/600256838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c40b7cc0 con 0x7fb5c415e5d0 2024-09-16T01:18:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.385+0000 7fb5cba5e640 1 -- 172.21.15.81:0/600256838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c40d5290 con 0x7fb5c415e5d0 2024-09-16T01:18:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.386+0000 7fb5c1ffb640 1 -- 172.21.15.81:0/600256838 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb5b8030b00 con 0x7fb5c415e5d0 2024-09-16T01:18:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.386+0000 7fb5c1ffb640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5b006c2b0 0x7fb5b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.386+0000 7fb5c1ffb640 1 -- 172.21.15.81:0/600256838 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6187+0+0 (secure 0 0 0) 0x7fb5b80abe30 con 0x7fb5c415e5d0 2024-09-16T01:18:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.386+0000 7fb5c97fa640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5b006c2b0 0x7fb5b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.387+0000 7fb5c97fa640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5b006c2b0 0x7fb5b006e770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40113e0 tx=0x7fb5b400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.390+0000 7fb5c1ffb640 1 -- 172.21.15.81:0/600256838 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5b807a450 con 0x7fb5c415e5d0 2024-09-16T01:18:15.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:15.589+0000 7fb5cba5e640 1 -- 172.21.15.81:0/600256838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb5c40b2b10 con 0x7fb5c415e5d0 2024-09-16T01:18:16.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.266+0000 7fb5c1ffb640 1 -- 172.21.15.81:0/600256838 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7fb5b8079d50 con 0x7fb5c415e5d0 2024-09-16T01:18:16.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.269+0000 7fb5cba5e640 1 -- 172.21.15.81:0/600256838 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5b006c2b0 msgr2=0x7fb5b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:16.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.269+0000 7fb5cba5e640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5b006c2b0 0x7fb5b006e770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb5b40113e0 tx=0x7fb5b400b040 comp rx=0 tx=0).stop 2024-09-16T01:18:16.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.269+0000 7fb5cba5e640 1 -- 172.21.15.81:0/600256838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c415e5d0 msgr2=0x7fb5c40b7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:16.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.269+0000 7fb5cba5e640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c415e5d0 0x7fb5c40b7fc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8000c00 tx=0x7fb5b80046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:16.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.269+0000 7fb5cba5e640 1 -- 172.21.15.81:0/600256838 shutdown_connections 2024-09-16T01:18:16.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.269+0000 7fb5cba5e640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5b006c2b0 0x7fb5b006e770 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:16.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.269+0000 7fb5cba5e640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c41626f0 0x7fb5c40b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:16.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.269+0000 7fb5cba5e640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c415e5d0 0x7fb5c40b7fc0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:16.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.269+0000 7fb5cba5e640 1 --2- 172.21.15.81:0/600256838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c40d4df0 0x7fb5c40b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:16.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.269+0000 7fb5cba5e640 1 -- 172.21.15.81:0/600256838 >> 172.21.15.81:0/600256838 conn(0x7fb5c408bfc0 msgr2=0x7fb5c415cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:16.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.269+0000 7fb5cba5e640 1 -- 172.21.15.81:0/600256838 shutdown_connections 2024-09-16T01:18:16.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.269+0000 7fb5cba5e640 1 -- 172.21.15.81:0/600256838 wait complete. 2024-09-16T01:18:16.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:18:16.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.428+0000 7fb35ef4b640 1 Processor -- start 2024-09-16T01:18:16.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.428+0000 7fb35ef4b640 1 -- start start 2024-09-16T01:18:16.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb35ef4b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb35815e7f0 0x7fb3580b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:16.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb35ef4b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb358071180 0x7fb35806de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:16.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb35ef4b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb35806cdc0 con 0x7fb3580af210 2024-09-16T01:18:16.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb35ef4b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb35806d0a0 con 0x7fb35815e7f0 2024-09-16T01:18:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb35ef4b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb35806d380 con 0x7fb358071180 2024-09-16T01:18:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb35cce7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb35815e7f0 0x7fb3580b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb357fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb3580af210 0x7fb358070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38832/0 (socket says 172.21.15.81:38832) 2024-09-16T01:18:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb357fff640 1 -- 172.21.15.81:0/3981442215 learned_addr learned my addr 172.21.15.81:0/3981442215 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb35d4e8640 1 --2- 172.21.15.81:0/3981442215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb358071180 0x7fb35806de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb35cce7640 1 -- 172.21.15.81:0/3981442215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb358071180 msgr2=0x7fb35806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb35cce7640 1 --2- 172.21.15.81:0/3981442215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb358071180 0x7fb35806de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb35cce7640 1 -- 172.21.15.81:0/3981442215 >> v1:172.21.15.81:6789/0 conn(0x7fb3580af210 legacy=0x7fb358070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.430+0000 7fb35cce7640 1 -- 172.21.15.81:0/3981442215 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35806d660 con 0x7fb35815e7f0 2024-09-16T01:18:16.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.429+0000 7fb3577fe640 1 -- 172.21.15.81:0/3981442215 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547461991 0 0) 0x7fb35806cdc0 con 0x7fb3580af210 2024-09-16T01:18:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.430+0000 7fb35cce7640 1 --2- 172.21.15.81:0/3981442215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35815e7f0 0x7fb3580b6d10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb3480097a0 tx=0x7fb34802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf36edf5c1ddc2f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.430+0000 7fb3577fe640 1 -- 172.21.15.81:0/3981442215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348037070 con 0x7fb35815e7f0 2024-09-16T01:18:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.430+0000 7fb3577fe640 1 -- 172.21.15.81:0/3981442215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb348032440 con 0x7fb35815e7f0 2024-09-16T01:18:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.430+0000 7fb3577fe640 1 -- 172.21.15.81:0/3981442215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348032810 con 0x7fb35815e7f0 2024-09-16T01:18:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.431+0000 7fb35ef4b640 1 -- 172.21.15.81:0/3981442215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35815e7f0 msgr2=0x7fb3580b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.431+0000 7fb35ef4b640 1 --2- 172.21.15.81:0/3981442215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35815e7f0 0x7fb3580b6d10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb3480097a0 tx=0x7fb34802a180 comp rx=0 tx=0).stop 2024-09-16T01:18:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.431+0000 7fb35ef4b640 1 -- 172.21.15.81:0/3981442215 shutdown_connections 2024-09-16T01:18:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.431+0000 7fb35ef4b640 1 --2- 172.21.15.81:0/3981442215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb358071180 0x7fb35806de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.431+0000 7fb35ef4b640 1 --2- 172.21.15.81:0/3981442215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35815e7f0 0x7fb3580b6d10 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.431+0000 7fb35ef4b640 1 -- 172.21.15.81:0/3981442215 >> 172.21.15.81:0/3981442215 conn(0x7fb3580b3f30 msgr2=0x7fb3580b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:16.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.431+0000 7fb35ef4b640 1 -- 172.21.15.81:0/3981442215 shutdown_connections 2024-09-16T01:18:16.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.431+0000 7fb35ef4b640 1 -- 172.21.15.81:0/3981442215 wait complete. 2024-09-16T01:18:16.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.432+0000 7fb35ef4b640 1 Processor -- start 2024-09-16T01:18:16.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.432+0000 7fb35ef4b640 1 -- start start 2024-09-16T01:18:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.433+0000 7fb35ef4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358071180 0x7fb358151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.433+0000 7fb35ef4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3580af210 0x7fb358160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.433+0000 7fb35ef4b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb35815e7f0 0x7fb358161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.433+0000 7fb35ef4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3580b73d0 con 0x7fb358071180 2024-09-16T01:18:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.433+0000 7fb35ef4b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb3580b7250 con 0x7fb3580af210 2024-09-16T01:18:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.433+0000 7fb35ef4b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb3580b7550 con 0x7fb35815e7f0 2024-09-16T01:18:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.433+0000 7fb35cce7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358071180 0x7fb358151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.433+0000 7fb35cce7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358071180 0x7fb358151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57036/0 (socket says 172.21.15.81:57036) 2024-09-16T01:18:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.433+0000 7fb35cce7640 1 -- 172.21.15.81:0/2743328953 learned_addr learned my addr 172.21.15.81:0/2743328953 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb35d4e8640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb35815e7f0 0x7fb358161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb357fff640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3580af210 0x7fb358160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb35cce7640 1 -- 172.21.15.81:0/2743328953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb35815e7f0 msgr2=0x7fb358161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb35cce7640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb35815e7f0 0x7fb358161460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb35cce7640 1 -- 172.21.15.81:0/2743328953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3580af210 msgr2=0x7fb358160f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb35cce7640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3580af210 0x7fb358160f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb35cce7640 1 -- 172.21.15.81:0/2743328953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb358151b40 con 0x7fb358071180 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb35d4e8640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb35815e7f0 0x7fb358161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb357fff640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3580af210 0x7fb358160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb35cce7640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358071180 0x7fb358151600 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb348000c00 tx=0x7fb3480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb3557fa640 1 -- 172.21.15.81:0/2743328953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348041070 con 0x7fb358071180 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb3557fa640 1 -- 172.21.15.81:0/2743328953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb34803c930 con 0x7fb358071180 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb35ef4b640 1 -- 172.21.15.81:0/2743328953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3580cd6c0 con 0x7fb358071180 2024-09-16T01:18:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb3557fa640 1 -- 172.21.15.81:0/2743328953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348037040 con 0x7fb358071180 2024-09-16T01:18:16.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.434+0000 7fb35ef4b640 1 -- 172.21.15.81:0/2743328953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb35815eeb0 con 0x7fb358071180 2024-09-16T01:18:16.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.435+0000 7fb35ef4b640 1 -- 172.21.15.81:0/2743328953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3580b6d10 con 0x7fb358071180 2024-09-16T01:18:16.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.435+0000 7fb3557fa640 1 -- 172.21.15.81:0/2743328953 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb348044070 con 0x7fb358071180 2024-09-16T01:18:16.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.436+0000 7fb3557fa640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb34406c2b0 0x7fb34406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:16.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.436+0000 7fb357fff640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb34406c2b0 0x7fb34406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:16.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.436+0000 7fb3557fa640 1 -- 172.21.15.81:0/2743328953 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6187+0+0 (secure 0 0 0) 0x7fb3480ac330 con 0x7fb358071180 2024-09-16T01:18:16.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.436+0000 7fb357fff640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb34406c2b0 0x7fb34406e770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb3580afd20 tx=0x7fb34c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:16.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.440+0000 7fb3557fa640 1 -- 172.21.15.81:0/2743328953 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb358151b40 con 0x7fb358071180 2024-09-16T01:18:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:16.607+0000 7fb35ef4b640 1 -- 172.21.15.81:0/2743328953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb3580b0e90 con 0x7fb358071180 2024-09-16T01:18:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.267+0000 7fb3557fa640 1 -- 172.21.15.81:0/2743328953 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v65) ==== 181+0+0 (secure 0 0 0) 0x7fb34807a9e0 con 0x7fb358071180 2024-09-16T01:18:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:18:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.270+0000 7fb35ef4b640 1 -- 172.21.15.81:0/2743328953 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb34406c2b0 msgr2=0x7fb34406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.270+0000 7fb35ef4b640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb34406c2b0 0x7fb34406e770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb3580afd20 tx=0x7fb34c009040 comp rx=0 tx=0).stop 2024-09-16T01:18:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.270+0000 7fb35ef4b640 1 -- 172.21.15.81:0/2743328953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358071180 msgr2=0x7fb358151600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.270+0000 7fb35ef4b640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358071180 0x7fb358151600 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb348000c00 tx=0x7fb3480046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.270+0000 7fb35ef4b640 1 -- 172.21.15.81:0/2743328953 shutdown_connections 2024-09-16T01:18:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.270+0000 7fb35ef4b640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb34406c2b0 0x7fb34406e770 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.270+0000 7fb35ef4b640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb35815e7f0 0x7fb358161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.270+0000 7fb35ef4b640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb3580af210 0x7fb358160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.270+0000 7fb35ef4b640 1 --2- 172.21.15.81:0/2743328953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358071180 0x7fb358151600 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.270+0000 7fb35ef4b640 1 -- 172.21.15.81:0/2743328953 >> 172.21.15.81:0/2743328953 conn(0x7fb3580b3f30 msgr2=0x7fb3580b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.270+0000 7fb35ef4b640 1 -- 172.21.15.81:0/2743328953 shutdown_connections 2024-09-16T01:18:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.270+0000 7fb35ef4b640 1 -- 172.21.15.81:0/2743328953 wait complete. 2024-09-16T01:18:17.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:18:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.385+0000 7f03c3b2c640 1 Processor -- start 2024-09-16T01:18:17.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.386+0000 7f03c3b2c640 1 -- start start 2024-09-16T01:18:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.386+0000 7f03c3b2c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f03bc0b63a0 0x7f03bc0b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.386+0000 7f03c3b2c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc0b1d00 con 0x7f03bc0b1870 2024-09-16T01:18:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.386+0000 7f03c3b2c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc0b5840 con 0x7f03bc15c160 2024-09-16T01:18:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.386+0000 7f03c3b2c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f03bc0b1670 con 0x7f03bc0b63a0 2024-09-16T01:18:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c20c9640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f03bc0b1870 0x7f03bc0afba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38846/0 (socket says 172.21.15.81:38846) 2024-09-16T01:18:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c20c9640 1 -- 172.21.15.81:0/3488012093 learned_addr learned my addr 172.21.15.81:0/3488012093 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 552496254 0 0) 0x7f03bc0b1d00 con 0x7f03bc0b1870 2024-09-16T01:18:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03a4003520 con 0x7f03bc0b1870 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c10c7640 1 --2- 172.21.15.81:0/3488012093 >> v2:172.21.15.102:3300/0 conn(0x7f03bc0b63a0 0x7f03bc0b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 473568164 0 0) 0x7f03a4003520 con 0x7f03bc0b1870 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 >> v2:172.21.15.102:3300/0 conn(0x7f03bc0b63a0 msgr2=0x7f03bc0b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 --2- 172.21.15.81:0/3488012093 >> v2:172.21.15.102:3300/0 conn(0x7f03bc0b63a0 0x7f03bc0b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 >> v1:172.21.15.102:6789/0 conn(0x7f03bc15c160 legacy=0x7f03bc0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03bc09b690 con 0x7f03bc0b1870 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f03b4001670 con 0x7f03bc0b1870 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 >> v1:172.21.15.81:6789/0 conn(0x7f03bc0b1870 legacy=0x7f03bc0afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 --2- 172.21.15.81:0/3488012093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 0x7f03a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 --2- 172.21.15.81:0/3488012093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03a4004800 0x7f03a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 --2- 172.21.15.81:0/3488012093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03a40051c0 0x7f03a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f03a400c0e0 con 0x7f03a40039b0 2024-09-16T01:18:17.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03a400c290 con 0x7f03a4004800 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f03a400c490 con 0x7f03a40051c0 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c18c8640 1 --2- 172.21.15.81:0/3488012093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 0x7f03a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c10c7640 1 --2- 172.21.15.81:0/3488012093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03a4004800 0x7f03a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c20c9640 1 --2- 172.21.15.81:0/3488012093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03a40051c0 0x7f03a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c18c8640 1 -- 172.21.15.81:0/3488012093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03a40051c0 msgr2=0x7f03a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.387+0000 7f03c18c8640 1 --2- 172.21.15.81:0/3488012093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03a40051c0 0x7f03a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.388+0000 7f03c18c8640 1 -- 172.21.15.81:0/3488012093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03a4004800 msgr2=0x7f03a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.388+0000 7f03c18c8640 1 --2- 172.21.15.81:0/3488012093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03a4004800 0x7f03a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.388+0000 7f03c18c8640 1 -- 172.21.15.81:0/3488012093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a4003520 con 0x7f03a40039b0 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.388+0000 7f03c20c9640 1 -- 172.21.15.81:0/3488012093 reap_dead start 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.388+0000 7f03c10c7640 1 --2- 172.21.15.81:0/3488012093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03a4004800 0x7f03a4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.388+0000 7f03c18c8640 1 --2- 172.21.15.81:0/3488012093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 0x7f03a4003dd0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f03ac001e50 tx=0x7f03a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac24f8a0adee894 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.388+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac001a70 con 0x7f03a40039b0 2024-09-16T01:18:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.388+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ac003970 con 0x7f03a40039b0 2024-09-16T01:18:17.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.388+0000 7f03c08c6640 1 -- 172.21.15.81:0/3488012093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac003d60 con 0x7f03a40039b0 2024-09-16T01:18:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.389+0000 7f03c3b2c640 1 -- 172.21.15.81:0/3488012093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 msgr2=0x7f03a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.389+0000 7f03c3b2c640 1 --2- 172.21.15.81:0/3488012093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 0x7f03a4003dd0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f03ac001e50 tx=0x7f03a4005830 comp rx=0 tx=0).stop 2024-09-16T01:18:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.389+0000 7f03c3b2c640 1 -- 172.21.15.81:0/3488012093 shutdown_connections 2024-09-16T01:18:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.389+0000 7f03c3b2c640 1 --2- 172.21.15.81:0/3488012093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 0x7f03a4003dd0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.389+0000 7f03c3b2c640 1 -- 172.21.15.81:0/3488012093 >> 172.21.15.81:0/3488012093 conn(0x7f03bc0b3f60 msgr2=0x7f03bc0b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.389+0000 7f03c3b2c640 1 -- 172.21.15.81:0/3488012093 shutdown_connections 2024-09-16T01:18:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.389+0000 7f03c3b2c640 1 -- 172.21.15.81:0/3488012093 wait complete. 2024-09-16T01:18:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.390+0000 7f03c3b2c640 1 Processor -- start 2024-09-16T01:18:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.390+0000 7f03c3b2c640 1 -- start start 2024-09-16T01:18:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c3b2c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 0x7f03bc1f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c3b2c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03bc09fd20 0x7f03bc153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c3b2c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03bc15e040 0x7f03bc0b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c3b2c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc09bc50 con 0x7f03a40039b0 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c3b2c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc09b440 con 0x7f03bc09fd20 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c3b2c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f03bc15c540 con 0x7f03bc15e040 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c18c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 0x7f03bc1f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c18c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 0x7f03bc1f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57064/0 (socket says 172.21.15.81:57064) 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c18c8640 1 -- 172.21.15.81:0/2281057020 learned_addr learned my addr 172.21.15.81:0/2281057020 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c20c9640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03bc15e040 0x7f03bc0b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c10c7640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03bc09fd20 0x7f03bc153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c18c8640 1 -- 172.21.15.81:0/2281057020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03bc15e040 msgr2=0x7f03bc0b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c18c8640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03bc15e040 0x7f03bc0b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c18c8640 1 -- 172.21.15.81:0/2281057020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03bc09fd20 msgr2=0x7f03bc153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:17.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c18c8640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03bc09fd20 0x7f03bc153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c18c8640 1 -- 172.21.15.81:0/2281057020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03bc0a0500 con 0x7f03a40039b0 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.391+0000 7f03c18c8640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 0x7f03bc1f5f00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f03ac000f80 tx=0x7f03ac0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.392+0000 7f03ba7fc640 1 -- 172.21.15.81:0/2281057020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac03f030 con 0x7f03a40039b0 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.392+0000 7f03ba7fc640 1 -- 172.21.15.81:0/2281057020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ac0050d0 con 0x7f03a40039b0 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.392+0000 7f03c3b2c640 1 -- 172.21.15.81:0/2281057020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03bc09d820 con 0x7f03a40039b0 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.392+0000 7f03ba7fc640 1 -- 172.21.15.81:0/2281057020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac037040 con 0x7f03a40039b0 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.392+0000 7f03c3b2c640 1 -- 172.21.15.81:0/2281057020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03bc09dde0 con 0x7f03a40039b0 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.392+0000 7f03c3b2c640 1 -- 172.21.15.81:0/2281057020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03bc0b5260 con 0x7f03a40039b0 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.393+0000 7f03ba7fc640 1 -- 172.21.15.81:0/2281057020 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f03ac042070 con 0x7f03a40039b0 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.394+0000 7f03ba7fc640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f03a806c2e0 0x7f03a806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.394+0000 7f03c10c7640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f03a806c2e0 0x7f03a806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.394+0000 7f03ba7fc640 1 -- 172.21.15.81:0/2281057020 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5749+0+0 (secure 0 0 0) 0x7f03ac0aae00 con 0x7f03a40039b0 2024-09-16T01:18:17.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.394+0000 7f03c10c7640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f03a806c2e0 0x7f03a806e7a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0a07a0 tx=0x7f03b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:17.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.398+0000 7f03ba7fc640 1 -- 172.21.15.81:0/2281057020 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03ac049070 con 0x7f03a40039b0 2024-09-16T01:18:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:17.569+0000 7f03c3b2c640 1 -- 172.21.15.81:0/2281057020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f03bc15ae40 con 0x7f03a40039b0 2024-09-16T01:18:18.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.268+0000 7f03ba7fc640 1 -- 172.21.15.81:0/2281057020 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v66) ==== 169+0+0 (secure 0 0 0) 0x7f03ac079540 con 0x7f03a40039b0 2024-09-16T01:18:18.270 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-16T01:18:18.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.272+0000 7f03c3b2c640 1 -- 172.21.15.81:0/2281057020 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f03a806c2e0 msgr2=0x7f03a806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:18.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.272+0000 7f03c3b2c640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f03a806c2e0 0x7f03a806e7a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f03bc0a07a0 tx=0x7f03b0008040 comp rx=0 tx=0).stop 2024-09-16T01:18:18.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.272+0000 7f03c3b2c640 1 -- 172.21.15.81:0/2281057020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 msgr2=0x7f03bc1f5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:18.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.272+0000 7f03c3b2c640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 0x7f03bc1f5f00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f03ac000f80 tx=0x7f03ac0014a0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.272+0000 7f03c3b2c640 1 -- 172.21.15.81:0/2281057020 shutdown_connections 2024-09-16T01:18:18.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.273+0000 7f03c3b2c640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f03a806c2e0 0x7f03a806e7a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.273+0000 7f03c3b2c640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03bc15e040 0x7f03bc0b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.273+0000 7f03c3b2c640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03bc09fd20 0x7f03bc153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.273+0000 7f03c3b2c640 1 --2- 172.21.15.81:0/2281057020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03a40039b0 0x7f03bc1f5f00 secure :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f03ac000f80 tx=0x7f03ac0014a0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.273+0000 7f03c3b2c640 1 -- 172.21.15.81:0/2281057020 >> 172.21.15.81:0/2281057020 conn(0x7f03bc0b3f60 msgr2=0x7f03bc159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:18.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.273+0000 7f03c3b2c640 1 -- 172.21.15.81:0/2281057020 shutdown_connections 2024-09-16T01:18:18.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.273+0000 7f03c3b2c640 1 -- 172.21.15.81:0/2281057020 wait complete. 2024-09-16T01:18:18.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-16T01:18:18.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.393+0000 7ff5d9d4b640 1 Processor -- start 2024-09-16T01:18:18.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.393+0000 7ff5d9d4b640 1 -- start start 2024-09-16T01:18:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.394+0000 7ff5d9d4b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5d415b720 0x7ff5d415bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.394+0000 7ff5d9d4b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d40ae4e0 con 0x7ff5d40d0370 2024-09-16T01:18:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.394+0000 7ff5d9d4b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d415c1e0 con 0x7ff5d4155930 2024-09-16T01:18:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.394+0000 7ff5d9d4b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d415c4c0 con 0x7ff5d415b720 2024-09-16T01:18:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.394+0000 7ff5d2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5d415b720 0x7ff5d415bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.394+0000 7ff5d3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff5d40d0370 0x7ff5d40d0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38860/0 (socket says 172.21.15.81:38860) 2024-09-16T01:18:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.394+0000 7ff5d3fff640 1 -- 172.21.15.81:0/3839413200 learned_addr learned my addr 172.21.15.81:0/3839413200 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.394+0000 7ff5d27fc640 1 -- 172.21.15.81:0/3839413200 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230817319 0 0) 0x7ff5cc001490 con 0x7ff5d40d0370 2024-09-16T01:18:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.394+0000 7ff5d27fc640 1 -- 172.21.15.81:0/3839413200 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5bc003520 con 0x7ff5d40d0370 2024-09-16T01:18:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.394+0000 7ff5d2ffd640 1 -- 172.21.15.81:0/3839413200 >> v1:172.21.15.102:6789/0 conn(0x7ff5d4155930 legacy=0x7ff5d40addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.394+0000 7ff5d2ffd640 1 -- 172.21.15.81:0/3839413200 >> v1:172.21.15.81:6789/0 conn(0x7ff5d40d0370 legacy=0x7ff5d40d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.394+0000 7ff5d2ffd640 1 -- 172.21.15.81:0/3839413200 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d40b3340 con 0x7ff5d415b720 2024-09-16T01:18:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.395+0000 7ff5d2ffd640 1 --2- 172.21.15.81:0/3839413200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d415b720 0x7ff5d415bbb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80097a0 tx=0x7ff5c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcec661314944b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.395+0000 7ff5d27fc640 1 -- 172.21.15.81:0/3839413200 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8037070 con 0x7ff5d415b720 2024-09-16T01:18:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.395+0000 7ff5d27fc640 1 -- 172.21.15.81:0/3839413200 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c8032440 con 0x7ff5d415b720 2024-09-16T01:18:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.395+0000 7ff5d27fc640 1 -- 172.21.15.81:0/3839413200 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8032810 con 0x7ff5d415b720 2024-09-16T01:18:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.396+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/3839413200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d415b720 msgr2=0x7ff5d415bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.396+0000 7ff5d9d4b640 1 --2- 172.21.15.81:0/3839413200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d415b720 0x7ff5d415bbb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80097a0 tx=0x7ff5c802a1e0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.396+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/3839413200 shutdown_connections 2024-09-16T01:18:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.396+0000 7ff5d9d4b640 1 --2- 172.21.15.81:0/3839413200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d415b720 0x7ff5d415bbb0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.396+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/3839413200 >> 172.21.15.81:0/3839413200 conn(0x7ff5d406bdf0 msgr2=0x7ff5d406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.396+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/3839413200 shutdown_connections 2024-09-16T01:18:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.396+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/3839413200 wait complete. 2024-09-16T01:18:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.397+0000 7ff5d9d4b640 1 Processor -- start 2024-09-16T01:18:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.397+0000 7ff5d9d4b640 1 -- start start 2024-09-16T01:18:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d9d4b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5d40d0370 0x7ff5d41511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d9d4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d4155930 0x7ff5d4150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d9d4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5d415b720 0x7ff5d406def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d9d4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d406fa30 con 0x7ff5d4155930 2024-09-16T01:18:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d9d4b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d406f8b0 con 0x7ff5d415b720 2024-09-16T01:18:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d9d4b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d40b3b40 con 0x7ff5d40d0370 2024-09-16T01:18:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d4155930 0x7ff5d4150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d4155930 0x7ff5d4150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57080/0 (socket says 172.21.15.81:57080) 2024-09-16T01:18:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d2ffd640 1 -- 172.21.15.81:0/1485594227 learned_addr learned my addr 172.21.15.81:0/1485594227 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d37fe640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5d40d0370 0x7ff5d41511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d3fff640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5d415b720 0x7ff5d406def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d2ffd640 1 -- 172.21.15.81:0/1485594227 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5d40d0370 msgr2=0x7ff5d41511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d2ffd640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5d40d0370 0x7ff5d41511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d2ffd640 1 -- 172.21.15.81:0/1485594227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5d415b720 msgr2=0x7ff5d406def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d2ffd640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5d415b720 0x7ff5d406def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.398+0000 7ff5d2ffd640 1 -- 172.21.15.81:0/1485594227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d4150f90 con 0x7ff5d4155930 2024-09-16T01:18:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.399+0000 7ff5d2ffd640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d4155930 0x7ff5d4150a50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80098c0 tx=0x7ff5c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.399+0000 7ff5bbfff640 1 -- 172.21.15.81:0/1485594227 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8037040 con 0x7ff5d4155930 2024-09-16T01:18:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.399+0000 7ff5bbfff640 1 -- 172.21.15.81:0/1485594227 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c8042070 con 0x7ff5d4155930 2024-09-16T01:18:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.399+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/1485594227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d41f55c0 con 0x7ff5d4155930 2024-09-16T01:18:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.399+0000 7ff5bbfff640 1 -- 172.21.15.81:0/1485594227 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8030940 con 0x7ff5d4155930 2024-09-16T01:18:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.399+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/1485594227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d41f5b80 con 0x7ff5d4155930 2024-09-16T01:18:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.400+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/1485594227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d415bbb0 con 0x7ff5d4155930 2024-09-16T01:18:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.400+0000 7ff5bbfff640 1 -- 172.21.15.81:0/1485594227 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff5c8030ae0 con 0x7ff5d4155930 2024-09-16T01:18:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.401+0000 7ff5bbfff640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5c006c2b0 0x7ff5c006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.401+0000 7ff5bbfff640 1 -- 172.21.15.81:0/1485594227 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7ff5c80abb80 con 0x7ff5d4155930 2024-09-16T01:18:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.401+0000 7ff5d37fe640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5c006c2b0 0x7ff5c006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.401+0000 7ff5d37fe640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5c006c2b0 0x7ff5c006e770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4004ea0 tx=0x7ff5c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.405+0000 7ff5bbfff640 1 -- 172.21.15.81:0/1485594227 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5c8045360 con 0x7ff5d4155930 2024-09-16T01:18:18.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.571+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/1485594227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ff5d41f6240 con 0x7ff5d4155930 2024-09-16T01:18:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.574+0000 7ff5bbfff640 1 -- 172.21.15.81:0/1485594227 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7ff5c807a460 con 0x7ff5d4155930 2024-09-16T01:18:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.576+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/1485594227 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5c006c2b0 msgr2=0x7ff5c006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.576+0000 7ff5d9d4b640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5c006c2b0 0x7ff5c006e770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4004ea0 tx=0x7ff5c4009040 comp rx=0 tx=0).stop 2024-09-16T01:18:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.577+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/1485594227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d4155930 msgr2=0x7ff5d4150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.577+0000 7ff5d9d4b640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d4155930 0x7ff5d4150a50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80098c0 tx=0x7ff5c80046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.577+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/1485594227 shutdown_connections 2024-09-16T01:18:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.577+0000 7ff5d9d4b640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5c006c2b0 0x7ff5c006e770 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.577+0000 7ff5d9d4b640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5d415b720 0x7ff5d406def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.577+0000 7ff5d9d4b640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d4155930 0x7ff5d4150a50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.577+0000 7ff5d9d4b640 1 --2- 172.21.15.81:0/1485594227 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5d40d0370 0x7ff5d41511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.577+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/1485594227 >> 172.21.15.81:0/1485594227 conn(0x7ff5d406bdf0 msgr2=0x7ff5d40addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.577+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/1485594227 shutdown_connections 2024-09-16T01:18:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.577+0000 7ff5d9d4b640 1 -- 172.21.15.81:0/1485594227 wait complete. 2024-09-16T01:18:18.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size' 2024-09-16T01:18:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.686+0000 7ffad60f1640 1 Processor -- start 2024-09-16T01:18:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.686+0000 7ffad60f1640 1 -- start start 2024-09-16T01:18:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffad60f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffad00d0380 0x7ffad0070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffad60f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffad006f0f0 0x7ffad0161ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffad60f1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffad00b5130 con 0x7ffad0162530 2024-09-16T01:18:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffad60f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ffad006f5f0 con 0x7ffad006f0f0 2024-09-16T01:18:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffad60f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffad006f8d0 con 0x7ffad00d0380 2024-09-16T01:18:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffac7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffad006f0f0 0x7ffad0161ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffac7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffad006f0f0 0x7ffad0161ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57092/0 (socket says 172.21.15.81:57092) 2024-09-16T01:18:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffac7fff640 1 -- 172.21.15.81:0/598334625 learned_addr learned my addr 172.21.15.81:0/598334625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffac7fff640 1 -- 172.21.15.81:0/598334625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffad00d0380 msgr2=0x7ffad0070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffacf7fe640 1 --2- 172.21.15.81:0/598334625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffad00d0380 0x7ffad0070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffac7fff640 1 --2- 172.21.15.81:0/598334625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffad00d0380 0x7ffad0070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffac7fff640 1 -- 172.21.15.81:0/598334625 >> v1:172.21.15.102:6789/0 conn(0x7ffad0162530 legacy=0x7ffad0143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffac7fff640 1 -- 172.21.15.81:0/598334625 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad006fbb0 con 0x7ffad006f0f0 2024-09-16T01:18:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.687+0000 7ffacf7fe640 1 --2- 172.21.15.81:0/598334625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffad00d0380 0x7ffad0070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.688+0000 7ffac7fff640 1 --2- 172.21.15.81:0/598334625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad006f0f0 0x7ffad0161ff0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009870 tx=0x7ffab802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feaf5c4b5aef27b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.688+0000 7ffaceffd640 1 -- 172.21.15.81:0/598334625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8037070 con 0x7ffad006f0f0 2024-09-16T01:18:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.688+0000 7ffaceffd640 1 -- 172.21.15.81:0/598334625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab8032440 con 0x7ffad006f0f0 2024-09-16T01:18:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.688+0000 7ffaceffd640 1 -- 172.21.15.81:0/598334625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8032810 con 0x7ffad006f0f0 2024-09-16T01:18:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.688+0000 7ffad60f1640 1 -- 172.21.15.81:0/598334625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad006f0f0 msgr2=0x7ffad0161ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.688+0000 7ffad60f1640 1 --2- 172.21.15.81:0/598334625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad006f0f0 0x7ffad0161ff0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009870 tx=0x7ffab802a180 comp rx=0 tx=0).stop 2024-09-16T01:18:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.689+0000 7ffad60f1640 1 -- 172.21.15.81:0/598334625 shutdown_connections 2024-09-16T01:18:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.689+0000 7ffad60f1640 1 --2- 172.21.15.81:0/598334625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad006f0f0 0x7ffad0161ff0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.689+0000 7ffad60f1640 1 --2- 172.21.15.81:0/598334625 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffad00d0380 0x7ffad0070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.689+0000 7ffad60f1640 1 -- 172.21.15.81:0/598334625 >> 172.21.15.81:0/598334625 conn(0x7ffad006bc10 msgr2=0x7ffad006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.689+0000 7ffad60f1640 1 -- 172.21.15.81:0/598334625 shutdown_connections 2024-09-16T01:18:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.689+0000 7ffad60f1640 1 -- 172.21.15.81:0/598334625 wait complete. 2024-09-16T01:18:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.690+0000 7ffad60f1640 1 Processor -- start 2024-09-16T01:18:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.690+0000 7ffad60f1640 1 -- start start 2024-09-16T01:18:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.690+0000 7ffad60f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffad006f0f0 0x7ffad015ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.690+0000 7ffad60f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad00d0380 0x7ffad0143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.690+0000 7ffad60f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffad0162530 0x7ffad0152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.690+0000 7ffad60f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffad00d0760 con 0x7ffad00d0380 2024-09-16T01:18:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.690+0000 7ffad60f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffad0147ea0 con 0x7ffad0162530 2024-09-16T01:18:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.690+0000 7ffad60f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffad00d08e0 con 0x7ffad006f0f0 2024-09-16T01:18:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffac7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad00d0380 0x7ffad0143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffac7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad00d0380 0x7ffad0143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57106/0 (socket says 172.21.15.81:57106) 2024-09-16T01:18:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffac7fff640 1 -- 172.21.15.81:0/1748764929 learned_addr learned my addr 172.21.15.81:0/1748764929 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffacf7fe640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffad006f0f0 0x7ffad015ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffacffff640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffad0162530 0x7ffad0152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffac7fff640 1 -- 172.21.15.81:0/1748764929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffad006f0f0 msgr2=0x7ffad015ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffac7fff640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffad006f0f0 0x7ffad015ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffac7fff640 1 -- 172.21.15.81:0/1748764929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffad0162530 msgr2=0x7ffad0152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffac7fff640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffad0162530 0x7ffad0152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffac7fff640 1 -- 172.21.15.81:0/1748764929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad015ef00 con 0x7ffad00d0380 2024-09-16T01:18:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffac7fff640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad00d0380 0x7ffad0143be0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ffab8000c00 tx=0x7ffab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffaccff9640 1 -- 172.21.15.81:0/1748764929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8037040 con 0x7ffad00d0380 2024-09-16T01:18:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffaccff9640 1 -- 172.21.15.81:0/1748764929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab8042070 con 0x7ffad00d0380 2024-09-16T01:18:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffad60f1640 1 -- 172.21.15.81:0/1748764929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad015f1e0 con 0x7ffad00d0380 2024-09-16T01:18:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffaccff9640 1 -- 172.21.15.81:0/1748764929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab8030bb0 con 0x7ffad00d0380 2024-09-16T01:18:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.691+0000 7ffad60f1640 1 -- 172.21.15.81:0/1748764929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad015f7a0 con 0x7ffad00d0380 2024-09-16T01:18:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.692+0000 7ffad60f1640 1 -- 172.21.15.81:0/1748764929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad0161ff0 con 0x7ffad00d0380 2024-09-16T01:18:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.693+0000 7ffaccff9640 1 -- 172.21.15.81:0/1748764929 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffab8047460 con 0x7ffad00d0380 2024-09-16T01:18:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.693+0000 7ffaccff9640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffab006c2b0 0x7ffab006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.693+0000 7ffaccff9640 1 -- 172.21.15.81:0/1748764929 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7ffab80abeb0 con 0x7ffad00d0380 2024-09-16T01:18:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.693+0000 7ffacf7fe640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffab006c2b0 0x7ffab006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.694+0000 7ffacf7fe640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffab006c2b0 0x7ffab006e770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffac000ab60 tx=0x7ffac0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.697+0000 7ffaccff9640 1 -- 172.21.15.81:0/1748764929 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffab807a790 con 0x7ffad00d0380 2024-09-16T01:18:18.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:18.931+0000 7ffad60f1640 1 -- 172.21.15.81:0/1748764929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]} v 0) -- 0x7ffad00b04f0 con 0x7ffad00d0380 2024-09-16T01:18:19.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.270+0000 7ffaccff9640 1 -- 172.21.15.81:0/1748764929 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]}]=0 v156) ==== 150+0+0 (secure 0 0 0) 0x7ffab807a090 con 0x7ffad00d0380 2024-09-16T01:18:19.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.272+0000 7ffad60f1640 1 -- 172.21.15.81:0/1748764929 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffab006c2b0 msgr2=0x7ffab006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.272+0000 7ffad60f1640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffab006c2b0 0x7ffab006e770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ffac000ab60 tx=0x7ffac0008040 comp rx=0 tx=0).stop 2024-09-16T01:18:19.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.272+0000 7ffad60f1640 1 -- 172.21.15.81:0/1748764929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad00d0380 msgr2=0x7ffad0143be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.272+0000 7ffad60f1640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad00d0380 0x7ffad0143be0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ffab8000c00 tx=0x7ffab80046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.272+0000 7ffad60f1640 1 -- 172.21.15.81:0/1748764929 shutdown_connections 2024-09-16T01:18:19.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.272+0000 7ffad60f1640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffab006c2b0 0x7ffab006e770 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.272+0000 7ffad60f1640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffad0162530 0x7ffad0152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.272+0000 7ffad60f1640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffad00d0380 0x7ffad0143be0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.272+0000 7ffad60f1640 1 --2- 172.21.15.81:0/1748764929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffad006f0f0 0x7ffad015ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.272+0000 7ffad60f1640 1 -- 172.21.15.81:0/1748764929 >> 172.21.15.81:0/1748764929 conn(0x7ffad006bc10 msgr2=0x7ffad015e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:19.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.272+0000 7ffad60f1640 1 -- 172.21.15.81:0/1748764929 shutdown_connections 2024-09-16T01:18:19.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.272+0000 7ffad60f1640 1 -- 172.21.15.81:0/1748764929 wait complete. 2024-09-16T01:18:19.286 INFO:tasks.cephfs_test_runner:test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits) ... skipped 'Require FUSE client to inject client release failure' 2024-09-16T01:18:19.286 INFO:tasks.cephfs_test_runner:Starting test: test_client_max_caps (tasks.cephfs.test_client_limits.TestClientLimits) That the MDS will not let a client sit above mds_max_caps_per_client caps. 2024-09-16T01:18:19.286 INFO:tasks.cephfs_test_runner:test_client_max_caps (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-16T01:18:19.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:18:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.383+0000 7efda7c8d640 1 Processor -- start 2024-09-16T01:18:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.383+0000 7efda7c8d640 1 -- start start 2024-09-16T01:18:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.384+0000 7efda7c8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efda0161c80 0x7efda006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.384+0000 7efda7c8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda0162060 0x7efda00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.384+0000 7efda7c8d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efda00b64b0 0x7efda00b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.384+0000 7efda7c8d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7efda006e870 con 0x7efda0161c80 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.384+0000 7efda7c8d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efda006d9f0 con 0x7efda00b64b0 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.384+0000 7efda7c8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efda006dcd0 con 0x7efda0162060 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.384+0000 7efda5a29640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efda0161c80 0x7efda006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.384+0000 7efda5a29640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efda0161c80 0x7efda006e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57120/0 (socket says 172.21.15.81:57120) 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.384+0000 7efda5a29640 1 -- 172.21.15.81:0/2760423078 learned_addr learned my addr 172.21.15.81:0/2760423078 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.385+0000 7efda5228640 1 --2- 172.21.15.81:0/2760423078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda0162060 0x7efda00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.385+0000 7efda622a640 1 --2- 172.21.15.81:0/2760423078 >> v2:172.21.15.102:3300/0 conn(0x7efda00b64b0 0x7efda00b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.385+0000 7efda5a29640 1 -- 172.21.15.81:0/2760423078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda0162060 msgr2=0x7efda00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.385+0000 7efda5a29640 1 --2- 172.21.15.81:0/2760423078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda0162060 0x7efda00b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.385+0000 7efda5a29640 1 -- 172.21.15.81:0/2760423078 >> v2:172.21.15.102:3300/0 conn(0x7efda00b64b0 msgr2=0x7efda00b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.385+0000 7efda5a29640 1 --2- 172.21.15.81:0/2760423078 >> v2:172.21.15.102:3300/0 conn(0x7efda00b64b0 0x7efda00b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.385+0000 7efda5a29640 1 -- 172.21.15.81:0/2760423078 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda006dfb0 con 0x7efda0161c80 2024-09-16T01:18:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.385+0000 7efda5a29640 1 --2- 172.21.15.81:0/2760423078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda0161c80 0x7efda006e330 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7efda00687b0 tx=0x7efd9002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d53bb2cd2fc81be server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.386+0000 7efda4a27640 1 -- 172.21.15.81:0/2760423078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90036070 con 0x7efda0161c80 2024-09-16T01:18:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.386+0000 7efda4a27640 1 -- 172.21.15.81:0/2760423078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd90031600 con 0x7efda0161c80 2024-09-16T01:18:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.386+0000 7efda4a27640 1 -- 172.21.15.81:0/2760423078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd900319d0 con 0x7efda0161c80 2024-09-16T01:18:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.386+0000 7efda7c8d640 1 -- 172.21.15.81:0/2760423078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda0161c80 msgr2=0x7efda006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.386+0000 7efda7c8d640 1 --2- 172.21.15.81:0/2760423078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda0161c80 0x7efda006e330 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7efda00687b0 tx=0x7efd9002a6a0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.386+0000 7efda7c8d640 1 -- 172.21.15.81:0/2760423078 shutdown_connections 2024-09-16T01:18:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.386+0000 7efda7c8d640 1 --2- 172.21.15.81:0/2760423078 >> v2:172.21.15.102:3300/0 conn(0x7efda00b64b0 0x7efda00b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.386+0000 7efda7c8d640 1 --2- 172.21.15.81:0/2760423078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda0162060 0x7efda00b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.386+0000 7efda7c8d640 1 --2- 172.21.15.81:0/2760423078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda0161c80 0x7efda006e330 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.386+0000 7efda7c8d640 1 -- 172.21.15.81:0/2760423078 >> 172.21.15.81:0/2760423078 conn(0x7efda00d44f0 msgr2=0x7efda00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.386+0000 7efda7c8d640 1 -- 172.21.15.81:0/2760423078 shutdown_connections 2024-09-16T01:18:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.386+0000 7efda7c8d640 1 -- 172.21.15.81:0/2760423078 wait complete. 2024-09-16T01:18:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.387+0000 7efda7c8d640 1 Processor -- start 2024-09-16T01:18:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.387+0000 7efda7c8d640 1 -- start start 2024-09-16T01:18:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda7c8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b64b0 0x7efda00ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda7c8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda0161c80 0x7efda0156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda7c8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efda0162060 0x7efda00c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda7c8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efda0162500 con 0x7efda00b64b0 2024-09-16T01:18:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda7c8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efda00d2aa0 con 0x7efda0162060 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda7c8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efda0162680 con 0x7efda0161c80 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda5a29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b64b0 0x7efda00ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda5a29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b64b0 0x7efda00ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57128/0 (socket says 172.21.15.81:57128) 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda5a29640 1 -- 172.21.15.81:0/883520313 learned_addr learned my addr 172.21.15.81:0/883520313 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda5228640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda0161c80 0x7efda0156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda622a640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efda0162060 0x7efda00c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda5a29640 1 -- 172.21.15.81:0/883520313 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda0161c80 msgr2=0x7efda0156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda5a29640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda0161c80 0x7efda0156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda5a29640 1 -- 172.21.15.81:0/883520313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efda0162060 msgr2=0x7efda00c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda5a29640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efda0162060 0x7efda00c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.388+0000 7efda5a29640 1 -- 172.21.15.81:0/883520313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda00c9720 con 0x7efda00b64b0 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.389+0000 7efda5a29640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b64b0 0x7efda00ca7c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7efd90034040 tx=0x7efd90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.389+0000 7efd9e7fc640 1 -- 172.21.15.81:0/883520313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90036050 con 0x7efda00b64b0 2024-09-16T01:18:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.389+0000 7efd9e7fc640 1 -- 172.21.15.81:0/883520313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd90042070 con 0x7efda00b64b0 2024-09-16T01:18:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.389+0000 7efda7c8d640 1 -- 172.21.15.81:0/883520313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda00c9a00 con 0x7efda00b64b0 2024-09-16T01:18:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.389+0000 7efd9e7fc640 1 -- 172.21.15.81:0/883520313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90009510 con 0x7efda00b64b0 2024-09-16T01:18:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.389+0000 7efda7c8d640 1 -- 172.21.15.81:0/883520313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda00c9fc0 con 0x7efda00b64b0 2024-09-16T01:18:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.390+0000 7efda7c8d640 1 -- 172.21.15.81:0/883520313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda006e330 con 0x7efda00b64b0 2024-09-16T01:18:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.390+0000 7efd9e7fc640 1 -- 172.21.15.81:0/883520313 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efd90007c50 con 0x7efda00b64b0 2024-09-16T01:18:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.390+0000 7efd9e7fc640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8c06c2b0 0x7efd8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.391+0000 7efd9e7fc640 1 -- 172.21.15.81:0/883520313 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7efd900ac2b0 con 0x7efda00b64b0 2024-09-16T01:18:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.391+0000 7efda5228640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8c06c2b0 0x7efd8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.391+0000 7efda5228640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8c06c2b0 0x7efd8c06e770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efd94006fd0 tx=0x7efd94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.395+0000 7efd9e7fc640 1 -- 172.21.15.81:0/883520313 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd9007a490 con 0x7efda00b64b0 2024-09-16T01:18:19.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.564+0000 7efda7c8d640 1 -- 172.21.15.81:0/883520313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efda00ba470 con 0x7efda00b64b0 2024-09-16T01:18:19.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.565+0000 7efd9e7fc640 1 -- 172.21.15.81:0/883520313 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+13304 (secure 0 0 0) 0x7efd9007e790 con 0x7efda00b64b0 2024-09-16T01:18:19.567 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:19.567 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:18.268625+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/554158924":"2024-09-17T01:18:15.264466+0000","172.21.15.81:6834/554158924":"2024-09-17T01:18:15.264466+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:18:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.567+0000 7efda7c8d640 1 -- 172.21.15.81:0/883520313 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8c06c2b0 msgr2=0x7efd8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.567+0000 7efda7c8d640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8c06c2b0 0x7efd8c06e770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efd94006fd0 tx=0x7efd94008040 comp rx=0 tx=0).stop 2024-09-16T01:18:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.567+0000 7efda7c8d640 1 -- 172.21.15.81:0/883520313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b64b0 msgr2=0x7efda00ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.567+0000 7efda7c8d640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b64b0 0x7efda00ca7c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7efd90034040 tx=0x7efd90004a40 comp rx=0 tx=0).stop 2024-09-16T01:18:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.567+0000 7efda7c8d640 1 -- 172.21.15.81:0/883520313 shutdown_connections 2024-09-16T01:18:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.567+0000 7efda7c8d640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8c06c2b0 0x7efd8c06e770 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.567+0000 7efda7c8d640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efda0162060 0x7efda00c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.567+0000 7efda7c8d640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda0161c80 0x7efda0156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.567+0000 7efda7c8d640 1 --2- 172.21.15.81:0/883520313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b64b0 0x7efda00ca7c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.567+0000 7efda7c8d640 1 -- 172.21.15.81:0/883520313 >> 172.21.15.81:0/883520313 conn(0x7efda00d44f0 msgr2=0x7efda00b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.567+0000 7efda7c8d640 1 -- 172.21.15.81:0/883520313 shutdown_connections 2024-09-16T01:18:19.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.567+0000 7efda7c8d640 1 -- 172.21.15.81:0/883520313 wait complete. 2024-09-16T01:18:19.580 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:15:28.088452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:18:19.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:18:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.680+0000 7fe19ed23640 1 Processor -- start 2024-09-16T01:18:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.680+0000 7fe19ed23640 1 -- start start 2024-09-16T01:18:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.681+0000 7fe19ed23640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1980cf330 0x7fe198169070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.681+0000 7fe19ed23640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19806e820 con 0x7fe198161a20 2024-09-16T01:18:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.681+0000 7fe19ed23640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1980cf980 con 0x7fe1980d15f0 2024-09-16T01:18:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.681+0000 7fe19ed23640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe1980cf760 con 0x7fe1980cf330 2024-09-16T01:18:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.681+0000 7fe19d2c0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe1980cf330 0x7fe198169070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.681+0000 7fe19cabf640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe198161a20 0x7fe1980d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38870/0 (socket says 172.21.15.81:38870) 2024-09-16T01:18:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.681+0000 7fe19cabf640 1 -- 172.21.15.81:0/3252458374 learned_addr learned my addr 172.21.15.81:0/3252458374 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.682+0000 7fe19d2c0640 1 -- 172.21.15.81:0/3252458374 >> v1:172.21.15.102:6789/0 conn(0x7fe1980d15f0 legacy=0x7fe1980cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.682+0000 7fe19d2c0640 1 -- 172.21.15.81:0/3252458374 >> v1:172.21.15.81:6789/0 conn(0x7fe198161a20 legacy=0x7fe1980d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.682+0000 7fe1977fe640 1 -- 172.21.15.81:0/3252458374 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1570931412 0 0) 0x7fe19806e820 con 0x7fe198161a20 2024-09-16T01:18:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.682+0000 7fe19d2c0640 1 -- 172.21.15.81:0/3252458374 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19806d050 con 0x7fe1980cf330 2024-09-16T01:18:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.682+0000 7fe19d2c0640 1 --2- 172.21.15.81:0/3252458374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1980cf330 0x7fe198169070 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe190009d90 tx=0x7fe19002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0f0d4586264df server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.682+0000 7fe1977fe640 1 -- 172.21.15.81:0/3252458374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190007740 con 0x7fe1980cf330 2024-09-16T01:18:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.682+0000 7fe1977fe640 1 -- 172.21.15.81:0/3252458374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1900078e0 con 0x7fe1980cf330 2024-09-16T01:18:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.682+0000 7fe1977fe640 1 -- 172.21.15.81:0/3252458374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190007cb0 con 0x7fe1980cf330 2024-09-16T01:18:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.683+0000 7fe19ed23640 1 -- 172.21.15.81:0/3252458374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1980cf330 msgr2=0x7fe198169070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.683+0000 7fe19ed23640 1 --2- 172.21.15.81:0/3252458374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1980cf330 0x7fe198169070 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe190009d90 tx=0x7fe19002a6a0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.683+0000 7fe19ed23640 1 -- 172.21.15.81:0/3252458374 shutdown_connections 2024-09-16T01:18:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.683+0000 7fe19ed23640 1 --2- 172.21.15.81:0/3252458374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1980cf330 0x7fe198169070 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.683+0000 7fe19ed23640 1 -- 172.21.15.81:0/3252458374 >> 172.21.15.81:0/3252458374 conn(0x7fe19809d850 msgr2=0x7fe19808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.683+0000 7fe19ed23640 1 -- 172.21.15.81:0/3252458374 shutdown_connections 2024-09-16T01:18:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.683+0000 7fe19ed23640 1 -- 172.21.15.81:0/3252458374 wait complete. 2024-09-16T01:18:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.684+0000 7fe19ed23640 1 Processor -- start 2024-09-16T01:18:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.684+0000 7fe19ed23640 1 -- start start 2024-09-16T01:18:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.685+0000 7fe19ed23640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1980cf330 0x7fe1980b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.685+0000 7fe19ed23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1980d15f0 0x7fe19815a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.685+0000 7fe19ed23640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe198161a20 0x7fe19815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.685+0000 7fe19ed23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe1980cff00 con 0x7fe1980d15f0 2024-09-16T01:18:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.685+0000 7fe19ed23640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe198161e00 con 0x7fe1980cf330 2024-09-16T01:18:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.685+0000 7fe19ed23640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe19806d2f0 con 0x7fe198161a20 2024-09-16T01:18:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.685+0000 7fe197fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1980d15f0 0x7fe19815a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.685+0000 7fe197fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1980d15f0 0x7fe19815a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57142/0 (socket says 172.21.15.81:57142) 2024-09-16T01:18:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.685+0000 7fe197fff640 1 -- 172.21.15.81:0/693565549 learned_addr learned my addr 172.21.15.81:0/693565549 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.685+0000 7fe19cabf640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1980cf330 0x7fe1980b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.686+0000 7fe19d2c0640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe198161a20 0x7fe19815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.686+0000 7fe197fff640 1 -- 172.21.15.81:0/693565549 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe198161a20 msgr2=0x7fe19815ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.686+0000 7fe197fff640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe198161a20 0x7fe19815ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.686+0000 7fe197fff640 1 -- 172.21.15.81:0/693565549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1980cf330 msgr2=0x7fe1980b7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.686+0000 7fe197fff640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1980cf330 0x7fe1980b7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.686+0000 7fe197fff640 1 -- 172.21.15.81:0/693565549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1980b87b0 con 0x7fe1980d15f0 2024-09-16T01:18:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.686+0000 7fe197fff640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1980d15f0 0x7fe19815a840 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c430 tx=0x7fe18c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.686+0000 7fe1957fa640 1 -- 172.21.15.81:0/693565549 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c011790 con 0x7fe1980d15f0 2024-09-16T01:18:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.686+0000 7fe1957fa640 1 -- 172.21.15.81:0/693565549 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c017070 con 0x7fe1980d15f0 2024-09-16T01:18:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.686+0000 7fe19ed23640 1 -- 172.21.15.81:0/693565549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1980b8a90 con 0x7fe1980d15f0 2024-09-16T01:18:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.686+0000 7fe1957fa640 1 -- 172.21.15.81:0/693565549 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c011bb0 con 0x7fe1980d15f0 2024-09-16T01:18:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.686+0000 7fe19ed23640 1 -- 172.21.15.81:0/693565549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1980b9f60 con 0x7fe1980d15f0 2024-09-16T01:18:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.687+0000 7fe19ed23640 1 -- 172.21.15.81:0/693565549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1980b1040 con 0x7fe1980d15f0 2024-09-16T01:18:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.687+0000 7fe1957fa640 1 -- 172.21.15.81:0/693565549 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe18c01c460 con 0x7fe1980d15f0 2024-09-16T01:18:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.688+0000 7fe1957fa640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe18406c2b0 0x7fe18406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.688+0000 7fe19cabf640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe18406c2b0 0x7fe18406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.688+0000 7fe1957fa640 1 -- 172.21.15.81:0/693565549 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7fe18c08b1c0 con 0x7fe1980d15f0 2024-09-16T01:18:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.688+0000 7fe19cabf640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe18406c2b0 0x7fe18406e770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe188000f60 tx=0x7fe188007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.692+0000 7fe1957fa640 1 -- 172.21.15.81:0/693565549 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe18c059aa0 con 0x7fe1980d15f0 2024-09-16T01:18:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.858+0000 7fe19ed23640 1 -- 172.21.15.81:0/693565549 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe198160c80 con 0x7fe1980d15f0 2024-09-16T01:18:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.858+0000 7fe1957fa640 1 -- 172.21.15.81:0/693565549 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) ==== 93+0+10 (secure 0 0 0) 0x7fe18c0593a0 con 0x7fe1980d15f0 2024-09-16T01:18:19.861 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-16T01:18:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.860+0000 7fe19ed23640 1 -- 172.21.15.81:0/693565549 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe18406c2b0 msgr2=0x7fe18406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.860+0000 7fe19ed23640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe18406c2b0 0x7fe18406e770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe188000f60 tx=0x7fe188007c00 comp rx=0 tx=0).stop 2024-09-16T01:18:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.860+0000 7fe19ed23640 1 -- 172.21.15.81:0/693565549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1980d15f0 msgr2=0x7fe19815a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.860+0000 7fe19ed23640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1980d15f0 0x7fe19815a840 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00c430 tx=0x7fe18c00c8f0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.860+0000 7fe19ed23640 1 -- 172.21.15.81:0/693565549 shutdown_connections 2024-09-16T01:18:19.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.860+0000 7fe19ed23640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe18406c2b0 0x7fe18406e770 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.860+0000 7fe19ed23640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe198161a20 0x7fe19815ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.860+0000 7fe19ed23640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1980d15f0 0x7fe19815a840 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.860+0000 7fe19ed23640 1 --2- 172.21.15.81:0/693565549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1980cf330 0x7fe1980b7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.860+0000 7fe19ed23640 1 -- 172.21.15.81:0/693565549 >> 172.21.15.81:0/693565549 conn(0x7fe19809d850 msgr2=0x7fe19815df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:19.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.860+0000 7fe19ed23640 1 -- 172.21.15.81:0/693565549 shutdown_connections 2024-09-16T01:18:19.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.860+0000 7fe19ed23640 1 -- 172.21.15.81:0/693565549 wait complete. 2024-09-16T01:18:19.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps' 2024-09-16T01:18:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.970+0000 7f325a78d640 1 Processor -- start 2024-09-16T01:18:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.971+0000 7f325a78d640 1 -- start start 2024-09-16T01:18:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.971+0000 7f325a78d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f325409b140 0x7f3254071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.971+0000 7f325a78d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325409ba30 con 0x7f325415fc30 2024-09-16T01:18:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.971+0000 7f325a78d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f325409bcf0 con 0x7f32540b17d0 2024-09-16T01:18:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.971+0000 7f325a78d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f32540b1590 con 0x7f325409b140 2024-09-16T01:18:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.971+0000 7f3253fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f325415fc30 0x7f325409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38886/0 (socket says 172.21.15.81:38886) 2024-09-16T01:18:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.971+0000 7f3253fff640 1 -- 172.21.15.81:0/3676944588 learned_addr learned my addr 172.21.15.81:0/3676944588 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f32537fe640 1 --2- 172.21.15.81:0/3676944588 >> v2:172.21.15.102:3300/0 conn(0x7f325409b140 0x7f3254071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134394072 0 0) 0x7f325409ba30 con 0x7f325415fc30 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f323c003520 con 0x7f325415fc30 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2824058249 0 0) 0x7f323c003520 con 0x7f325415fc30 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 >> v2:172.21.15.102:3300/0 conn(0x7f325409b140 msgr2=0x7f3254071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 --2- 172.21.15.81:0/3676944588 >> v2:172.21.15.102:3300/0 conn(0x7f325409b140 0x7f3254071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 >> v1:172.21.15.102:6789/0 conn(0x7f32540b17d0 legacy=0x7f32540704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3254160d00 con 0x7f325415fc30 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f3244001670 con 0x7f325415fc30 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 >> v1:172.21.15.81:6789/0 conn(0x7f325415fc30 legacy=0x7f325409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 --2- 172.21.15.81:0/3676944588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 0x7f323c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 --2- 172.21.15.81:0/3676944588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f323c004800 0x7f323c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 --2- 172.21.15.81:0/3676944588 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f323c0051c0 0x7f323c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32540b1590 con 0x7f323c0039b0 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f323c00c160 con 0x7f323c004800 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f323c00c360 con 0x7f323c0051c0 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3253fff640 1 --2- 172.21.15.81:0/3676944588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 0x7f323c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f32537fe640 1 --2- 172.21.15.81:0/3676944588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f323c004800 0x7f323c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3258d2a640 1 --2- 172.21.15.81:0/3676944588 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f323c0051c0 0x7f323c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3253fff640 1 -- 172.21.15.81:0/3676944588 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f323c0051c0 msgr2=0x7f323c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3253fff640 1 --2- 172.21.15.81:0/3676944588 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f323c0051c0 0x7f323c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3253fff640 1 -- 172.21.15.81:0/3676944588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f323c004800 msgr2=0x7f323c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3253fff640 1 --2- 172.21.15.81:0/3676944588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f323c004800 0x7f323c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3253fff640 1 -- 172.21.15.81:0/3676944588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c003520 con 0x7f323c0039b0 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.972+0000 7f3258d2a640 1 -- 172.21.15.81:0/3676944588 reap_dead start 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.973+0000 7f3253fff640 1 --2- 172.21.15.81:0/3676944588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 0x7f323c003dd0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f324400c240 tx=0x7f323c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6b7fc96f7a7e4e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.973+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244007d10 con 0x7f323c0039b0 2024-09-16T01:18:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.973+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3244005ad0 con 0x7f323c0039b0 2024-09-16T01:18:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.973+0000 7f3252ffd640 1 -- 172.21.15.81:0/3676944588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244007070 con 0x7f323c0039b0 2024-09-16T01:18:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.974+0000 7f325a78d640 1 -- 172.21.15.81:0/3676944588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 msgr2=0x7f323c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.974+0000 7f325a78d640 1 --2- 172.21.15.81:0/3676944588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 0x7f323c003dd0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f324400c240 tx=0x7f323c005830 comp rx=0 tx=0).stop 2024-09-16T01:18:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.974+0000 7f325a78d640 1 -- 172.21.15.81:0/3676944588 shutdown_connections 2024-09-16T01:18:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.974+0000 7f325a78d640 1 --2- 172.21.15.81:0/3676944588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 0x7f323c003dd0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.974+0000 7f325a78d640 1 -- 172.21.15.81:0/3676944588 >> 172.21.15.81:0/3676944588 conn(0x7f32540d23a0 msgr2=0x7f32540d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.974+0000 7f325a78d640 1 -- 172.21.15.81:0/3676944588 shutdown_connections 2024-09-16T01:18:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.974+0000 7f325a78d640 1 -- 172.21.15.81:0/3676944588 wait complete. 2024-09-16T01:18:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.975+0000 7f325a78d640 1 Processor -- start 2024-09-16T01:18:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.975+0000 7f325a78d640 1 -- start start 2024-09-16T01:18:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f325a78d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 0x7f32540cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f325a78d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32540c9470 0x7f3254155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f325a78d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32540c8a20 0x7f32540cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f325a78d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32540721d0 con 0x7f323c0039b0 2024-09-16T01:18:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f325a78d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3254072050 con 0x7f32540c9470 2024-09-16T01:18:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f325a78d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3254160ab0 con 0x7f32540c8a20 2024-09-16T01:18:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f3253fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 0x7f32540cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f3253fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 0x7f32540cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57150/0 (socket says 172.21.15.81:57150) 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f3253fff640 1 -- 172.21.15.81:0/3383128071 learned_addr learned my addr 172.21.15.81:0/3383128071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f32537fe640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32540c9470 0x7f3254155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f3258d2a640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32540c8a20 0x7f32540cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f3253fff640 1 -- 172.21.15.81:0/3383128071 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32540c8a20 msgr2=0x7f32540cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f3253fff640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32540c8a20 0x7f32540cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f3253fff640 1 -- 172.21.15.81:0/3383128071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32540c9470 msgr2=0x7f3254155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f3253fff640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32540c9470 0x7f3254155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.976+0000 7f3253fff640 1 -- 172.21.15.81:0/3383128071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32540c98f0 con 0x7f323c0039b0 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.977+0000 7f3253fff640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 0x7f32540cc610 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3244034040 tx=0x7f325409bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.977+0000 7f3250ff9640 1 -- 172.21.15.81:0/3383128071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244041070 con 0x7f323c0039b0 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.977+0000 7f3250ff9640 1 -- 172.21.15.81:0/3383128071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3244000ed0 con 0x7f323c0039b0 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.977+0000 7f325a78d640 1 -- 172.21.15.81:0/3383128071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32540b6630 con 0x7f323c0039b0 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.977+0000 7f3250ff9640 1 -- 172.21.15.81:0/3383128071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244007d10 con 0x7f323c0039b0 2024-09-16T01:18:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.977+0000 7f325a78d640 1 -- 172.21.15.81:0/3383128071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32540b6bf0 con 0x7f323c0039b0 2024-09-16T01:18:19.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.978+0000 7f325a78d640 1 -- 172.21.15.81:0/3383128071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3254068ea0 con 0x7f323c0039b0 2024-09-16T01:18:19.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.978+0000 7f3250ff9640 1 -- 172.21.15.81:0/3383128071 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3244044070 con 0x7f323c0039b0 2024-09-16T01:18:19.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.979+0000 7f3250ff9640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f324006c2e0 0x7f324006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:19.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.979+0000 7f3250ff9640 1 -- 172.21.15.81:0/3383128071 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f32440ab570 con 0x7f323c0039b0 2024-09-16T01:18:19.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.979+0000 7f32537fe640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f324006c2e0 0x7f324006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:19.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.979+0000 7f32537fe640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f324006c2e0 0x7f324006e7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f32540c6660 tx=0x7f3248009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:19.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:19.983+0000 7f3250ff9640 1 -- 172.21.15.81:0/3383128071 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f324404b070 con 0x7f323c0039b0 2024-09-16T01:18:20.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.216+0000 7f325a78d640 1 -- 172.21.15.81:0/3383128071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]} v 0) -- 0x7f32540b8320 con 0x7f323c0039b0 2024-09-16T01:18:20.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.274+0000 7f3250ff9640 1 -- 172.21.15.81:0/3383128071 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]}]=0 v157) ==== 151+0+0 (secure 0 0 0) 0x7f32540c98f0 con 0x7f323c0039b0 2024-09-16T01:18:20.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.276+0000 7f325a78d640 1 -- 172.21.15.81:0/3383128071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f324006c2e0 msgr2=0x7f324006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:20.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.276+0000 7f325a78d640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f324006c2e0 0x7f324006e7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f32540c6660 tx=0x7f3248009190 comp rx=0 tx=0).stop 2024-09-16T01:18:20.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.276+0000 7f325a78d640 1 -- 172.21.15.81:0/3383128071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 msgr2=0x7f32540cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:20.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.276+0000 7f325a78d640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 0x7f32540cc610 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3244034040 tx=0x7f325409bec0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.276+0000 7f325a78d640 1 -- 172.21.15.81:0/3383128071 shutdown_connections 2024-09-16T01:18:20.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.276+0000 7f325a78d640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f324006c2e0 0x7f324006e7a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.276+0000 7f325a78d640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32540c8a20 0x7f32540cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.276+0000 7f325a78d640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32540c9470 0x7f3254155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.276+0000 7f325a78d640 1 --2- 172.21.15.81:0/3383128071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f323c0039b0 0x7f32540cc610 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.276+0000 7f325a78d640 1 -- 172.21.15.81:0/3383128071 >> 172.21.15.81:0/3383128071 conn(0x7f32540d23a0 msgr2=0x7f32540afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:20.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.276+0000 7f325a78d640 1 -- 172.21.15.81:0/3383128071 shutdown_connections 2024-09-16T01:18:20.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.276+0000 7f325a78d640 1 -- 172.21.15.81:0/3383128071 wait complete. 2024-09-16T01:18:20.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T01:18:20.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.389+0000 7f8ab5ce6640 1 Processor -- start 2024-09-16T01:18:20.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.389+0000 7f8ab5ce6640 1 -- start start 2024-09-16T01:18:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.389+0000 7f8ab5ce6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ab006d740 0x7f8ab00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.389+0000 7f8ab5ce6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab015ff70 con 0x7f8ab0162340 2024-09-16T01:18:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.390+0000 7f8ab5ce6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ab00d4d10 con 0x7f8ab0162e30 2024-09-16T01:18:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.390+0000 7f8ab5ce6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8ab006de90 con 0x7f8ab006d740 2024-09-16T01:18:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.390+0000 7f8aaffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ab006d740 0x7f8ab00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.390+0000 7f8aaf7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8ab0162340 0x7f8ab0162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38892/0 (socket says 172.21.15.81:38892) 2024-09-16T01:18:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.390+0000 7f8aaf7fe640 1 -- 172.21.15.81:0/4263876001 learned_addr learned my addr 172.21.15.81:0/4263876001 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.390+0000 7f8aaffff640 1 -- 172.21.15.81:0/4263876001 >> v1:172.21.15.102:6789/0 conn(0x7f8ab0162e30 legacy=0x7f8ab00d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.390+0000 7f8aaffff640 1 -- 172.21.15.81:0/4263876001 >> v1:172.21.15.81:6789/0 conn(0x7f8ab0162340 legacy=0x7f8ab0162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.390+0000 7f8aaffff640 1 -- 172.21.15.81:0/4263876001 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab00d4ff0 con 0x7f8ab006d740 2024-09-16T01:18:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.390+0000 7f8aae7fc640 1 -- 172.21.15.81:0/4263876001 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848727267 0 0) 0x7f8ab015ff70 con 0x7f8ab0162340 2024-09-16T01:18:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.391+0000 7f8aaffff640 1 --2- 172.21.15.81:0/4263876001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ab006d740 0x7f8ab00cf280 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009d90 tx=0x7f8aa802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f959e9a816925478 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.391+0000 7f8aae7fc640 1 -- 172.21.15.81:0/4263876001 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8031600 con 0x7f8ab006d740 2024-09-16T01:18:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.391+0000 7f8aae7fc640 1 -- 172.21.15.81:0/4263876001 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa80317a0 con 0x7f8ab006d740 2024-09-16T01:18:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.391+0000 7f8aae7fc640 1 -- 172.21.15.81:0/4263876001 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8031b70 con 0x7f8ab006d740 2024-09-16T01:18:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.391+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/4263876001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ab006d740 msgr2=0x7f8ab00cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.391+0000 7f8ab5ce6640 1 --2- 172.21.15.81:0/4263876001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ab006d740 0x7f8ab00cf280 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009d90 tx=0x7f8aa802a610 comp rx=0 tx=0).stop 2024-09-16T01:18:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.391+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/4263876001 shutdown_connections 2024-09-16T01:18:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.391+0000 7f8ab5ce6640 1 --2- 172.21.15.81:0/4263876001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ab006d740 0x7f8ab00cf280 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.391+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/4263876001 >> 172.21.15.81:0/4263876001 conn(0x7f8ab008bfc0 msgr2=0x7f8ab00d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.391+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/4263876001 shutdown_connections 2024-09-16T01:18:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.391+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/4263876001 wait complete. 2024-09-16T01:18:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.392+0000 7f8ab5ce6640 1 Processor -- start 2024-09-16T01:18:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.393+0000 7f8ab5ce6640 1 -- start start 2024-09-16T01:18:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.393+0000 7f8ab5ce6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ab006d740 0x7f8ab015c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.393+0000 7f8ab5ce6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ab0162340 0x7f8ab01e8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.393+0000 7f8ab5ce6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ab0162e30 0x7f8ab00c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.393+0000 7f8ab5ce6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab0163270 con 0x7f8ab0162e30 2024-09-16T01:18:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.393+0000 7f8ab5ce6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab00cf7c0 con 0x7f8ab006d740 2024-09-16T01:18:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.393+0000 7f8ab5ce6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8ab006dbb0 con 0x7f8ab0162340 2024-09-16T01:18:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.393+0000 7f8aaffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ab0162e30 0x7f8ab00c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8aaffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ab0162e30 0x7f8ab00c9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57160/0 (socket says 172.21.15.81:57160) 2024-09-16T01:18:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8aaffff640 1 -- 172.21.15.81:0/3104380173 learned_addr learned my addr 172.21.15.81:0/3104380173 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8aaeffd640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ab0162340 0x7f8ab01e8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8aaf7fe640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ab006d740 0x7f8ab015c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8aaffff640 1 -- 172.21.15.81:0/3104380173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ab0162340 msgr2=0x7f8ab01e8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8aaffff640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ab0162340 0x7f8ab01e8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8aaffff640 1 -- 172.21.15.81:0/3104380173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ab006d740 msgr2=0x7f8ab015c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8aaffff640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ab006d740 0x7f8ab015c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8aaffff640 1 -- 172.21.15.81:0/3104380173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab00cd740 con 0x7f8ab0162e30 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8aaeffd640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ab0162340 0x7f8ab01e8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8aaf7fe640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ab006d740 0x7f8ab015c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8aaffff640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ab0162e30 0x7f8ab00c9050 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009eb0 tx=0x7f8aa8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8a97fff640 1 -- 172.21.15.81:0/3104380173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8040070 con 0x7f8ab0162e30 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8a97fff640 1 -- 172.21.15.81:0/3104380173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa8030b60 con 0x7f8ab0162e30 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/3104380173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab00cda20 con 0x7f8ab0162e30 2024-09-16T01:18:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8a97fff640 1 -- 172.21.15.81:0/3104380173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8045460 con 0x7f8ab0162e30 2024-09-16T01:18:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.394+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/3104380173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab00cdfe0 con 0x7f8ab0162e30 2024-09-16T01:18:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.395+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/3104380173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab00d52d0 con 0x7f8ab0162e30 2024-09-16T01:18:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.396+0000 7f8a97fff640 1 -- 172.21.15.81:0/3104380173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8aa8039040 con 0x7f8ab0162e30 2024-09-16T01:18:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.396+0000 7f8a97fff640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8a9c06c2e0 0x7f8a9c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.396+0000 7f8a97fff640 1 -- 172.21.15.81:0/3104380173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f8aa80acb20 con 0x7f8ab0162e30 2024-09-16T01:18:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.396+0000 7f8aaf7fe640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8a9c06c2e0 0x7f8a9c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.396+0000 7f8aaf7fe640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8a9c06c2e0 0x7f8a9c06e7a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0000f60 tx=0x7f8aa0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:20.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.400+0000 7f8a97fff640 1 -- 172.21.15.81:0/3104380173 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8aa807b670 con 0x7f8ab0162e30 2024-09-16T01:18:20.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.566+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/3104380173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8ab008e640 con 0x7f8ab0162e30 2024-09-16T01:18:20.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.569+0000 7f8a97fff640 1 -- 172.21.15.81:0/3104380173 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f8aa807af70 con 0x7f8ab0162e30 2024-09-16T01:18:20.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.571+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/3104380173 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8a9c06c2e0 msgr2=0x7f8a9c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:20.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.571+0000 7f8ab5ce6640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8a9c06c2e0 0x7f8a9c06e7a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0000f60 tx=0x7f8aa0009040 comp rx=0 tx=0).stop 2024-09-16T01:18:20.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.571+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/3104380173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ab0162e30 msgr2=0x7f8ab00c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:20.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.571+0000 7f8ab5ce6640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ab0162e30 0x7f8ab00c9050 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009eb0 tx=0x7f8aa8004a40 comp rx=0 tx=0).stop 2024-09-16T01:18:20.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.571+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/3104380173 shutdown_connections 2024-09-16T01:18:20.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.571+0000 7f8ab5ce6640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8a9c06c2e0 0x7f8a9c06e7a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.571+0000 7f8ab5ce6640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ab0162e30 0x7f8ab00c9050 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.571+0000 7f8ab5ce6640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8ab0162340 0x7f8ab01e8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.571+0000 7f8ab5ce6640 1 --2- 172.21.15.81:0/3104380173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ab006d740 0x7f8ab015c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.572+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/3104380173 >> 172.21.15.81:0/3104380173 conn(0x7f8ab008bfc0 msgr2=0x7f8ab0162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:20.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.572+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/3104380173 shutdown_connections 2024-09-16T01:18:20.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.572+0000 7f8ab5ce6640 1 -- 172.21.15.81:0/3104380173 wait complete. 2024-09-16T01:18:20.584 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:18:20.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:18:20.620 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:18:20.662 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:18:20.663 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:20.663 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:20.679 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:18:20.679 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:18:20.679 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:20.722 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:18:20.722 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:20.722 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:20.738 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:18:20.739 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:18:20.739 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:20.780 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:18:20.780 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T01:18:20.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.877+0000 7f4f30523640 1 Processor -- start 2024-09-16T01:18:20.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.877+0000 7f4f30523640 1 -- start start 2024-09-16T01:18:20.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.878+0000 7f4f30523640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f2809b140 0x7f4f28071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:20.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.878+0000 7f4f30523640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f2809ba30 con 0x7f4f2815fc30 2024-09-16T01:18:20.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.878+0000 7f4f30523640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f2809bcf0 con 0x7f4f280b17d0 2024-09-16T01:18:20.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.878+0000 7f4f30523640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4f280b1590 con 0x7f4f2809b140 2024-09-16T01:18:20.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.878+0000 7f4f2dabe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f2809b140 0x7f4f28071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:20.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.879+0000 7f4f2e2bf640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4f2815fc30 0x7f4f2809aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38894/0 (socket says 172.21.15.81:38894) 2024-09-16T01:18:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.879+0000 7f4f2e2bf640 1 -- 172.21.15.81:0/3291537298 learned_addr learned my addr 172.21.15.81:0/3291537298 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.879+0000 7f4f2dabe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f2809b140 0x7f4f28071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57164/0 (socket says 172.21.15.81:57164) 2024-09-16T01:18:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.879+0000 7f4f2dabe640 1 -- 172.21.15.81:0/3291537298 >> v1:172.21.15.102:6789/0 conn(0x7f4f280b17d0 legacy=0x7f4f280704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.879+0000 7f4f2dabe640 1 -- 172.21.15.81:0/3291537298 >> v1:172.21.15.81:6789/0 conn(0x7f4f2815fc30 legacy=0x7f4f2809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.879+0000 7f4f2dabe640 1 -- 172.21.15.81:0/3291537298 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f28160d00 con 0x7f4f2809b140 2024-09-16T01:18:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.879+0000 7f4f2d2bd640 1 -- 172.21.15.81:0/3291537298 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2817651930 0 0) 0x7f4f2809ba30 con 0x7f4f2815fc30 2024-09-16T01:18:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.880+0000 7f4f2dabe640 1 --2- 172.21.15.81:0/3291537298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f2809b140 0x7f4f28071e40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0097a0 tx=0x7f4f1c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6fcb0ca33a408 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.880+0000 7f4f2d2bd640 1 -- 172.21.15.81:0/3291537298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c037070 con 0x7f4f2809b140 2024-09-16T01:18:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.880+0000 7f4f2d2bd640 1 -- 172.21.15.81:0/3291537298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f1c02ae50 con 0x7f4f2809b140 2024-09-16T01:18:20.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.880+0000 7f4f2d2bd640 1 -- 172.21.15.81:0/3291537298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c032660 con 0x7f4f2809b140 2024-09-16T01:18:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.880+0000 7f4f30523640 1 -- 172.21.15.81:0/3291537298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f2809b140 msgr2=0x7f4f28071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.880+0000 7f4f30523640 1 --2- 172.21.15.81:0/3291537298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f2809b140 0x7f4f28071e40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0097a0 tx=0x7f4f1c02a140 comp rx=0 tx=0).stop 2024-09-16T01:18:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.880+0000 7f4f30523640 1 -- 172.21.15.81:0/3291537298 shutdown_connections 2024-09-16T01:18:20.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.880+0000 7f4f30523640 1 --2- 172.21.15.81:0/3291537298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f2809b140 0x7f4f28071e40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.880+0000 7f4f30523640 1 -- 172.21.15.81:0/3291537298 >> 172.21.15.81:0/3291537298 conn(0x7f4f280d23a0 msgr2=0x7f4f280d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:20.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.880+0000 7f4f30523640 1 -- 172.21.15.81:0/3291537298 shutdown_connections 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.880+0000 7f4f30523640 1 -- 172.21.15.81:0/3291537298 wait complete. 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.881+0000 7f4f30523640 1 Processor -- start 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.881+0000 7f4f30523640 1 -- start start 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.882+0000 7f4f30523640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f2809b140 0x7f4f281539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.882+0000 7f4f30523640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280b17d0 0x7f4f281f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.882+0000 7f4f30523640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f2815fc30 0x7f4f281f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.882+0000 7f4f30523640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28070fd0 con 0x7f4f2809b140 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.882+0000 7f4f30523640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4f28070e50 con 0x7f4f2815fc30 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.882+0000 7f4f30523640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4f28071150 con 0x7f4f280b17d0 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.882+0000 7f4f2e2bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f2809b140 0x7f4f281539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.882+0000 7f4f2e2bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f2809b140 0x7f4f281539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57174/0 (socket says 172.21.15.81:57174) 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.882+0000 7f4f2e2bf640 1 -- 172.21.15.81:0/655934144 learned_addr learned my addr 172.21.15.81:0/655934144 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.882+0000 7f4f2dabe640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280b17d0 0x7f4f281f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.883+0000 7f4f2e2bf640 1 -- 172.21.15.81:0/655934144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280b17d0 msgr2=0x7f4f281f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.883+0000 7f4f2e2bf640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280b17d0 0x7f4f281f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.883+0000 7f4f2e2bf640 1 -- 172.21.15.81:0/655934144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f2815fc30 msgr2=0x7f4f281f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.883+0000 7f4f2eac0640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f2815fc30 0x7f4f281f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.883+0000 7f4f2e2bf640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f2815fc30 0x7f4f281f6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.883+0000 7f4f2e2bf640 1 -- 172.21.15.81:0/655934144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f280d05f0 con 0x7f4f2809b140 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.883+0000 7f4f2e2bf640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f2809b140 0x7f4f281539e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c430 tx=0x7f4f2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.883+0000 7f4f1affd640 1 -- 172.21.15.81:0/655934144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f240074e0 con 0x7f4f2809b140 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.883+0000 7f4f1affd640 1 -- 172.21.15.81:0/655934144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f240047e0 con 0x7f4f2809b140 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.883+0000 7f4f30523640 1 -- 172.21.15.81:0/655934144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f28153f20 con 0x7f4f2809b140 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.883+0000 7f4f1affd640 1 -- 172.21.15.81:0/655934144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f24004bd0 con 0x7f4f2809b140 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.883+0000 7f4f30523640 1 -- 172.21.15.81:0/655934144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f280d0030 con 0x7f4f2809b140 2024-09-16T01:18:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.884+0000 7f4f30523640 1 -- 172.21.15.81:0/655934144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f28068ea0 con 0x7f4f2809b140 2024-09-16T01:18:20.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.884+0000 7f4f1affd640 1 -- 172.21.15.81:0/655934144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4f24011070 con 0x7f4f2809b140 2024-09-16T01:18:20.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.885+0000 7f4f1affd640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4f0c06c2b0 0x7f4f0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:20.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.885+0000 7f4f1affd640 1 -- 172.21.15.81:0/655934144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7f4f2408aef0 con 0x7f4f2809b140 2024-09-16T01:18:20.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.885+0000 7f4f2dabe640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4f0c06c2b0 0x7f4f0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:20.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.885+0000 7f4f2dabe640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4f0c06c2b0 0x7f4f0c06e770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c034000 tx=0x7f4f1c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:20.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:20.889+0000 7f4f1affd640 1 -- 172.21.15.81:0/655934144 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f28153f20 con 0x7f4f2809b140 2024-09-16T01:18:21.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.087+0000 7f4f30523640 1 -- 172.21.15.81:0/655934144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f2809abb0 con 0x7f4f2809b140 2024-09-16T01:18:21.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.087+0000 7f4f1affd640 1 -- 172.21.15.81:0/655934144 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+3917 (secure 0 0 0) 0x7f4f280d05f0 con 0x7f4f2809b140 2024-09-16T01:18:21.090 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:21.090 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":31,"btime":"2024-09-16T01:18:16:266011+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5084,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2000242607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2000242607},{"type":"v1","addr":"172.21.15.102:6834","nonce":2000242607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5087,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3268189429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3268189429},{"type":"v1","addr":"172.21.15.102:6835","nonce":3268189429}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2730360991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2730360991},{"type":"v1","addr":"172.21.15.81:6836","nonce":2730360991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5928,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3374239836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3374239836},{"type":"v1","addr":"172.21.15.81:6837","nonce":3374239836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[]} 2024-09-16T01:18:21.090 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 31 2024-09-16T01:18:21.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.089+0000 7f4f30523640 1 -- 172.21.15.81:0/655934144 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4f0c06c2b0 msgr2=0x7f4f0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.089+0000 7f4f30523640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4f0c06c2b0 0x7f4f0c06e770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c034000 tx=0x7f4f1c02e000 comp rx=0 tx=0).stop 2024-09-16T01:18:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.089+0000 7f4f30523640 1 -- 172.21.15.81:0/655934144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f2809b140 msgr2=0x7f4f281539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.089+0000 7f4f30523640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f2809b140 0x7f4f281539e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4f2400c430 tx=0x7f4f2400c8f0 comp rx=0 tx=0).stop 2024-09-16T01:18:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.089+0000 7f4f30523640 1 -- 172.21.15.81:0/655934144 shutdown_connections 2024-09-16T01:18:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.089+0000 7f4f30523640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4f0c06c2b0 0x7f4f0c06e770 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.089+0000 7f4f30523640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f2815fc30 0x7f4f281f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.089+0000 7f4f30523640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f280b17d0 0x7f4f281f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.089+0000 7f4f30523640 1 --2- 172.21.15.81:0/655934144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f2809b140 0x7f4f281539e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.089+0000 7f4f30523640 1 -- 172.21.15.81:0/655934144 >> 172.21.15.81:0/655934144 conn(0x7f4f280d23a0 msgr2=0x7f4f280b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:21.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.089+0000 7f4f30523640 1 -- 172.21.15.81:0/655934144 shutdown_connections 2024-09-16T01:18:21.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.089+0000 7f4f30523640 1 -- 172.21.15.81:0/655934144 wait complete. 2024-09-16T01:18:21.102 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:18:21.102 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T01:18:21.103 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:18:21.103 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:18:21.103 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:18:21.103 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T01:18:21.103 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:18:21.103 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:18:21.104 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:18:21.104 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T01:18:21.104 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:18:21.104 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:18:21.104 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:18:21.104 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T01:18:21.104 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:18:21.105 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:18:21.113 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:18:21.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:18:21.114 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:18:21.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:18:21.119 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:18:21.119 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:18:21.120 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:18:21.120 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:18:21.157 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:18:21.157 DEBUG:teuthology.parallel:result is None 2024-09-16T01:18:21.159 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:18:21.159 DEBUG:teuthology.parallel:result is None 2024-09-16T01:18:21.164 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:18:21.164 DEBUG:teuthology.parallel:result is None 2024-09-16T01:18:21.165 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:18:21.165 DEBUG:teuthology.parallel:result is None 2024-09-16T01:18:21.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T01:18:21.230 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:18:21.231 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:18:21.245 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:18:21.245 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-16T01:18:21.246 INFO:tasks.ceph.mds.d.smithi102.stderr:2024-09-16T01:18:21.245+0000 7f1322cdd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-16T01:18:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.268+0000 7ff3f9f2c640 1 Processor -- start 2024-09-16T01:18:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.268+0000 7ff3f9f2c640 1 -- start start 2024-09-16T01:18:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.268+0000 7ff3f9f2c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff3f4162060 0x7ff3f40b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.268+0000 7ff3f9f2c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3f40b64b0 0x7ff3f40b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.268+0000 7ff3f9f2c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f406d9f0 con 0x7ff3f4161c80 2024-09-16T01:18:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.268+0000 7ff3f9f2c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f406dcd0 con 0x7ff3f40b64b0 2024-09-16T01:18:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.268+0000 7ff3f9f2c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f406dfb0 con 0x7ff3f4162060 2024-09-16T01:18:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.269+0000 7ff3f3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3f40b64b0 0x7ff3f40b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.269+0000 7ff3f3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3f40b64b0 0x7ff3f40b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42688/0 (socket says 172.21.15.81:42688) 2024-09-16T01:18:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.269+0000 7ff3f3fff640 1 -- 172.21.15.81:0/2619660094 learned_addr learned my addr 172.21.15.81:0/2619660094 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.269+0000 7ff3f2ffd640 1 --2- 172.21.15.81:0/2619660094 >> v2:172.21.15.102:3300/0 conn(0x7ff3f4162060 0x7ff3f40b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.269+0000 7ff3f3fff640 1 -- 172.21.15.81:0/2619660094 >> v2:172.21.15.102:3300/0 conn(0x7ff3f4162060 msgr2=0x7ff3f40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.269+0000 7ff3f3fff640 1 --2- 172.21.15.81:0/2619660094 >> v2:172.21.15.102:3300/0 conn(0x7ff3f4162060 0x7ff3f40b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.269+0000 7ff3f3fff640 1 -- 172.21.15.81:0/2619660094 >> v1:172.21.15.102:6789/0 conn(0x7ff3f4161c80 legacy=0x7ff3f406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.269+0000 7ff3f3fff640 1 -- 172.21.15.81:0/2619660094 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f40d01f0 con 0x7ff3f40b64b0 2024-09-16T01:18:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.270+0000 7ff3f3fff640 1 --2- 172.21.15.81:0/2619660094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3f40b64b0 0x7ff3f40b6960 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff3f408e830 tx=0x7ff3ec02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53970f9a76a7ee80 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.270+0000 7ff3f27fc640 1 -- 172.21.15.81:0/2619660094 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec036070 con 0x7ff3f40b64b0 2024-09-16T01:18:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.270+0000 7ff3f27fc640 1 -- 172.21.15.81:0/2619660094 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ec031600 con 0x7ff3f40b64b0 2024-09-16T01:18:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.270+0000 7ff3f27fc640 1 -- 172.21.15.81:0/2619660094 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec0319d0 con 0x7ff3f40b64b0 2024-09-16T01:18:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.270+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/2619660094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3f40b64b0 msgr2=0x7ff3f40b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.270+0000 7ff3f9f2c640 1 --2- 172.21.15.81:0/2619660094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3f40b64b0 0x7ff3f40b6960 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff3f408e830 tx=0x7ff3ec02a730 comp rx=0 tx=0).stop 2024-09-16T01:18:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.270+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/2619660094 shutdown_connections 2024-09-16T01:18:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.270+0000 7ff3f9f2c640 1 --2- 172.21.15.81:0/2619660094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3f40b64b0 0x7ff3f40b6960 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.270+0000 7ff3f9f2c640 1 --2- 172.21.15.81:0/2619660094 >> v2:172.21.15.102:3300/0 conn(0x7ff3f4162060 0x7ff3f40b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.270+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/2619660094 >> 172.21.15.81:0/2619660094 conn(0x7ff3f40d44f0 msgr2=0x7ff3f40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.270+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/2619660094 shutdown_connections 2024-09-16T01:18:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.270+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/2619660094 wait complete. 2024-09-16T01:18:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.272+0000 7ff3f9f2c640 1 Processor -- start 2024-09-16T01:18:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.272+0000 7ff3f9f2c640 1 -- start start 2024-09-16T01:18:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.272+0000 7ff3f9f2c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3f40b64b0 0x7ff3f40b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.272+0000 7ff3f9f2c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3f4161c80 0x7ff3f415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f9f2c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3f4162060 0x7ff3f415ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f9f2c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f40cf1e0 con 0x7ff3f40b64b0 2024-09-16T01:18:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f9f2c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f40d2aa0 con 0x7ff3f4161c80 2024-09-16T01:18:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f9f2c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f40cf360 con 0x7ff3f4162060 2024-09-16T01:18:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3f40b64b0 0x7ff3f40b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3f40b64b0 0x7ff3f40b7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42702/0 (socket says 172.21.15.81:42702) 2024-09-16T01:18:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f37fe640 1 -- 172.21.15.81:0/121724721 learned_addr learned my addr 172.21.15.81:0/121724721 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f37fe640 1 -- 172.21.15.81:0/121724721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3f4162060 msgr2=0x7ff3f415ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f37fe640 1 --2- 172.21.15.81:0/121724721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3f4162060 0x7ff3f415ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f37fe640 1 -- 172.21.15.81:0/121724721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3f4161c80 msgr2=0x7ff3f415ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f37fe640 1 --2- 172.21.15.81:0/121724721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3f4161c80 0x7ff3f415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f37fe640 1 -- 172.21.15.81:0/121724721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f40b87a0 con 0x7ff3f40b64b0 2024-09-16T01:18:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f37fe640 1 --2- 172.21.15.81:0/121724721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3f40b64b0 0x7ff3f40b7d50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400c400 tx=0x7ff3e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3ebfff640 1 -- 172.21.15.81:0/121724721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e40052d0 con 0x7ff3f40b64b0 2024-09-16T01:18:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3ebfff640 1 -- 172.21.15.81:0/121724721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e4005490 con 0x7ff3f40b64b0 2024-09-16T01:18:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/121724721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f40b8a80 con 0x7ff3f40b64b0 2024-09-16T01:18:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3ebfff640 1 -- 172.21.15.81:0/121724721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4007260 con 0x7ff3f40b64b0 2024-09-16T01:18:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.273+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/121724721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f40b9040 con 0x7ff3f40b64b0 2024-09-16T01:18:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.274+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/121724721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f40b5f70 con 0x7ff3f40b64b0 2024-09-16T01:18:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.275+0000 7ff3ebfff640 1 -- 172.21.15.81:0/121724721 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff3e4007400 con 0x7ff3f40b64b0 2024-09-16T01:18:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.275+0000 7ff3ebfff640 1 --2- 172.21.15.81:0/121724721 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff3d406c2b0 0x7ff3d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.275+0000 7ff3ebfff640 1 -- 172.21.15.81:0/121724721 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5335+0+0 (secure 0 0 0) 0x7ff3e408a7c0 con 0x7ff3f40b64b0 2024-09-16T01:18:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.275+0000 7ff3f2ffd640 1 --2- 172.21.15.81:0/121724721 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff3d406c2b0 0x7ff3d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.276+0000 7ff3f2ffd640 1 --2- 172.21.15.81:0/121724721 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff3d406c2b0 0x7ff3d406e770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc006a90 tx=0x7ff3dc006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:21.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.285+0000 7ff3ebfff640 1 -- 172.21.15.81:0/121724721 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3e4059130 con 0x7ff3f40b64b0 2024-09-16T01:18:21.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:21.466+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/121724721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff3f40ba470 con 0x7ff3f40b64b0 2024-09-16T01:18:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.303+0000 7ff3ebfff640 1 -- 172.21.15.81:0/121724721 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v71) ==== 97+0+0 (secure 0 0 0) 0x7ff3e4058a30 con 0x7ff3f40b64b0 2024-09-16T01:18:22.305 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-16T01:18:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.306+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/121724721 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff3d406c2b0 msgr2=0x7ff3d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.306+0000 7ff3f9f2c640 1 --2- 172.21.15.81:0/121724721 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff3d406c2b0 0x7ff3d406e770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc006a90 tx=0x7ff3dc006a20 comp rx=0 tx=0).stop 2024-09-16T01:18:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.306+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/121724721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3f40b64b0 msgr2=0x7ff3f40b7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.306+0000 7ff3f9f2c640 1 --2- 172.21.15.81:0/121724721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3f40b64b0 0x7ff3f40b7d50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400c400 tx=0x7ff3e400c8c0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.306+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/121724721 shutdown_connections 2024-09-16T01:18:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.306+0000 7ff3f9f2c640 1 --2- 172.21.15.81:0/121724721 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff3d406c2b0 0x7ff3d406e770 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.306+0000 7ff3f9f2c640 1 --2- 172.21.15.81:0/121724721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3f4162060 0x7ff3f415ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.306+0000 7ff3f9f2c640 1 --2- 172.21.15.81:0/121724721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3f4161c80 0x7ff3f415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.306+0000 7ff3f9f2c640 1 --2- 172.21.15.81:0/121724721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3f40b64b0 0x7ff3f40b7d50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.306+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/121724721 >> 172.21.15.81:0/121724721 conn(0x7ff3f40d44f0 msgr2=0x7ff3f40d3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.306+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/121724721 shutdown_connections 2024-09-16T01:18:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.306+0000 7ff3f9f2c640 1 -- 172.21.15.81:0/121724721 wait complete. 2024-09-16T01:18:22.322 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T01:18:22.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.425+0000 7fea64800640 1 Processor -- start 2024-09-16T01:18:22.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.425+0000 7fea64800640 1 -- start start 2024-09-16T01:18:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea64800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fea600d4180 0x7fea600d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea64800640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea600d4aa0 con 0x7fea600cf440 2024-09-16T01:18:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea64800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea600d2c20 con 0x7fea6015e6a0 2024-09-16T01:18:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea64800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fea600cefb0 con 0x7fea600d4180 2024-09-16T01:18:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea5f59e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fea600cf440 0x7fea600cf870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54452/0 (socket says 172.21.15.81:54452) 2024-09-16T01:18:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea5f59e640 1 -- 172.21.15.81:0/3487604274 learned_addr learned my addr 172.21.15.81:0/3487604274 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 844570295 0 0) 0x7fea600d4aa0 con 0x7fea600cf440 2024-09-16T01:18:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea4c003520 con 0x7fea600cf440 2024-09-16T01:18:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea5ed9d640 1 --2- 172.21.15.81:0/3487604274 >> v2:172.21.15.102:3300/0 conn(0x7fea600d4180 0x7fea600d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1125233631 0 0) 0x7fea4c003520 con 0x7fea600cf440 2024-09-16T01:18:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 >> v2:172.21.15.102:3300/0 conn(0x7fea600d4180 msgr2=0x7fea600d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea5e59c640 1 --2- 172.21.15.81:0/3487604274 >> v2:172.21.15.102:3300/0 conn(0x7fea600d4180 0x7fea600d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 >> v1:172.21.15.102:6789/0 conn(0x7fea6015e6a0 legacy=0x7fea6006d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6006e390 con 0x7fea600cf440 2024-09-16T01:18:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fea580019f0 con 0x7fea600cf440 2024-09-16T01:18:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.426+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 >> v1:172.21.15.81:6789/0 conn(0x7fea600cf440 legacy=0x7fea600cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5e59c640 1 --2- 172.21.15.81:0/3487604274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea4c0039b0 0x7fea4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5e59c640 1 --2- 172.21.15.81:0/3487604274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4c004800 0x7fea4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5e59c640 1 --2- 172.21.15.81:0/3487604274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c0052e0 0x7fea4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea600cefb0 con 0x7fea4c0052e0 2024-09-16T01:18:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fea4c00c1b0 con 0x7fea4c004800 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fea4c00c3b0 con 0x7fea4c0039b0 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5f59e640 1 --2- 172.21.15.81:0/3487604274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c0052e0 0x7fea4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5659c640 1 --2- 172.21.15.81:0/3487604274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4c004800 0x7fea4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5ed9d640 1 --2- 172.21.15.81:0/3487604274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea4c0039b0 0x7fea4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5f59e640 1 -- 172.21.15.81:0/3487604274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea4c0039b0 msgr2=0x7fea4c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5f59e640 1 --2- 172.21.15.81:0/3487604274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea4c0039b0 0x7fea4c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5f59e640 1 -- 172.21.15.81:0/3487604274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4c004800 msgr2=0x7fea4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5f59e640 1 --2- 172.21.15.81:0/3487604274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4c004800 0x7fea4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.427+0000 7fea5f59e640 1 -- 172.21.15.81:0/3487604274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4c003520 con 0x7fea4c0052e0 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.428+0000 7fea5f59e640 1 -- 172.21.15.81:0/3487604274 reap_dead start 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.428+0000 7fea5f59e640 1 --2- 172.21.15.81:0/3487604274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c0052e0 0x7fea4c00b9c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fea5800a830 tx=0x7fea4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514449e56f8f688 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.428+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5800a480 con 0x7fea4c0052e0 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.428+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea5802f070 con 0x7fea4c0052e0 2024-09-16T01:18:22.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.428+0000 7fea5e59c640 1 -- 172.21.15.81:0/3487604274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5802bc90 con 0x7fea4c0052e0 2024-09-16T01:18:22.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.428+0000 7fea64800640 1 -- 172.21.15.81:0/3487604274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c0052e0 msgr2=0x7fea4c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.428+0000 7fea64800640 1 --2- 172.21.15.81:0/3487604274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c0052e0 0x7fea4c00b9c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fea5800a830 tx=0x7fea4c005830 comp rx=0 tx=0).stop 2024-09-16T01:18:22.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.428+0000 7fea64800640 1 -- 172.21.15.81:0/3487604274 shutdown_connections 2024-09-16T01:18:22.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.428+0000 7fea64800640 1 --2- 172.21.15.81:0/3487604274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c0052e0 0x7fea4c00b9c0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.428+0000 7fea64800640 1 -- 172.21.15.81:0/3487604274 >> 172.21.15.81:0/3487604274 conn(0x7fea6009d6f0 msgr2=0x7fea6008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:22.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.428+0000 7fea64800640 1 -- 172.21.15.81:0/3487604274 shutdown_connections 2024-09-16T01:18:22.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.428+0000 7fea64800640 1 -- 172.21.15.81:0/3487604274 wait complete. 2024-09-16T01:18:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.430+0000 7fea64800640 1 Processor -- start 2024-09-16T01:18:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.430+0000 7fea64800640 1 -- start start 2024-09-16T01:18:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea64800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4c0052e0 0x7fea601edfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea64800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea600b9c50 0x7fea601f4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea64800640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea600d1100 0x7fea600d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea64800640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea600cebd0 con 0x7fea600d1100 2024-09-16T01:18:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea64800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fea6006e950 con 0x7fea4c0052e0 2024-09-16T01:18:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea64800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fea600d4560 con 0x7fea600b9c50 2024-09-16T01:18:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea5f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea600d1100 0x7fea600d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea5f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea600d1100 0x7fea600d15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42720/0 (socket says 172.21.15.81:42720) 2024-09-16T01:18:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea5f59e640 1 -- 172.21.15.81:0/3887944224 learned_addr learned my addr 172.21.15.81:0/3887944224 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea5ed9d640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4c0052e0 0x7fea601edfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea5659c640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea600b9c50 0x7fea601f4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea5f59e640 1 -- 172.21.15.81:0/3887944224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea600b9c50 msgr2=0x7fea601f4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea5f59e640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea600b9c50 0x7fea601f4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea5f59e640 1 -- 172.21.15.81:0/3887944224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4c0052e0 msgr2=0x7fea601edfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea5f59e640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4c0052e0 0x7fea601edfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea5f59e640 1 -- 172.21.15.81:0/3887944224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea601ee500 con 0x7fea600d1100 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea5f59e640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea600d1100 0x7fea600d15b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fea5800a830 tx=0x7fea600cef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea57fff640 1 -- 172.21.15.81:0/3887944224 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5800a480 con 0x7fea600d1100 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea57fff640 1 -- 172.21.15.81:0/3887944224 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea580019e0 con 0x7fea600d1100 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea64800640 1 -- 172.21.15.81:0/3887944224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea601f51d0 con 0x7fea600d1100 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.431+0000 7fea57fff640 1 -- 172.21.15.81:0/3887944224 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5802bb00 con 0x7fea600d1100 2024-09-16T01:18:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.432+0000 7fea64800640 1 -- 172.21.15.81:0/3887944224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea601f4bb0 con 0x7fea600d1100 2024-09-16T01:18:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.432+0000 7fea64800640 1 -- 172.21.15.81:0/3887944224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea600d48f0 con 0x7fea600d1100 2024-09-16T01:18:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.433+0000 7fea57fff640 1 -- 172.21.15.81:0/3887944224 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fea5802bca0 con 0x7fea600d1100 2024-09-16T01:18:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.433+0000 7fea57fff640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fea4006c2e0 0x7fea4006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.434+0000 7fea57fff640 1 -- 172.21.15.81:0/3887944224 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7fea580aaca0 con 0x7fea600d1100 2024-09-16T01:18:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.434+0000 7fea5ed9d640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fea4006c2e0 0x7fea4006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.434+0000 7fea5ed9d640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fea4006c2e0 0x7fea4006e7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fea600b5d40 tx=0x7fea50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.438+0000 7fea57fff640 1 -- 172.21.15.81:0/3887944224 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea58046060 con 0x7fea600d1100 2024-09-16T01:18:22.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.669+0000 7fea64800640 1 -- 172.21.15.81:0/3887944224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fea600b3bf0 con 0x7fea600d1100 2024-09-16T01:18:22.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.670+0000 7fea57fff640 1 -- 172.21.15.81:0/3887944224 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fea58079010 con 0x7fea600d1100 2024-09-16T01:18:22.672 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:22.672 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:18:22.672 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-16T01:18:22.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.672 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-16T01:18:22.672 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmx4OgCRAAkmpWDpuwqbDuz0taNg8bag==", 2024-09-16T01:18:22.672 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:22.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:18:22.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmSNpLFRAAzc9Sr8b65zH9VZFYvqsYpA==", 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.674 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-16T01:18:22.674 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmcCavEBAA0CuddD0zPcjqrMSOD5c6OA==", 2024-09-16T01:18:22.674 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:22.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:18:22.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:18:22.674 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmVeRcHBAANIL7HFYSc43qv7Zg0llkYQ==", 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDhudmUtTqORAAkZKChid+qoa+0nIgpuun7g==", 2024-09-16T01:18:22.675 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCHhudmUhtiABAA2vDoACv8RJ2KD9p1cdKClA==", 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCKhudmhOmRHxAAbGjJkUZLras/b6omekdz7A==", 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCNhudmA+csIRAAW1kenpimaWIak/qgG+UeXw==", 2024-09-16T01:18:22.677 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCThudmvgQBLxAAWLto5pG0iyiQPSnxldWYwg==", 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCXhudmKfyiIhAALbJHvDeQtVgSCKjD1X3OYg==", 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-16T01:18:22.679 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCahudmPG/9JBAA6d/gK0K/5c9Gp4uKOLCCOw==", 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCdhudmVdY3NhAAXlOaeE0XidHVCaeQrirBAg==", 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg==", 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-16T01:18:22.681 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmMgEhKRAAUD2kJ9eOFJscZ6ATlO5PmQ==", 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmwfD5JRAAPhdVLFZD07Uy75g3zStblg==", 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:18:22.682 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudm8/qzLhAAVFRbGhXH00h2LS9ZC9rraA==", 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/hudmBWr2KRAA/hELsRHNpxj3KqJbOSY74g==", 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmRdtyBhAAMQngXCuTHg6AjACCw/SmCg==", 2024-09-16T01:18:22.684 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmqULCAhAAMbYmGXWGiINwif20O1JG3g==", 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:22.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.686 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-16T01:18:22.686 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:18:22.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.672+0000 7fea64800640 1 -- 172.21.15.81:0/3887944224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fea4006c2e0 msgr2=0x7fea4006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.672+0000 7fea64800640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fea4006c2e0 0x7fea4006e7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fea600b5d40 tx=0x7fea50008040 comp rx=0 tx=0).stop 2024-09-16T01:18:22.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.672+0000 7fea64800640 1 -- 172.21.15.81:0/3887944224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea600d1100 msgr2=0x7fea600d15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.672+0000 7fea64800640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea600d1100 0x7fea600d15b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fea5800a830 tx=0x7fea600cef20 comp rx=0 tx=0).stop 2024-09-16T01:18:22.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.672+0000 7fea64800640 1 -- 172.21.15.81:0/3887944224 shutdown_connections 2024-09-16T01:18:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.672+0000 7fea64800640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fea4006c2e0 0x7fea4006e7a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.672+0000 7fea64800640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea600d1100 0x7fea600d15b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.672+0000 7fea64800640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea600b9c50 0x7fea601f4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.672+0000 7fea64800640 1 --2- 172.21.15.81:0/3887944224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea4c0052e0 0x7fea601edfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.672+0000 7fea64800640 1 -- 172.21.15.81:0/3887944224 >> 172.21.15.81:0/3887944224 conn(0x7fea6009d6f0 msgr2=0x7fea6006ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.672+0000 7fea64800640 1 -- 172.21.15.81:0/3887944224 shutdown_connections 2024-09-16T01:18:22.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.672+0000 7fea64800640 1 -- 172.21.15.81:0/3887944224 wait complete. 2024-09-16T01:18:22.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:18:22.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.785+0000 7f1737759640 1 Processor -- start 2024-09-16T01:18:22.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.785+0000 7f1737759640 1 -- start start 2024-09-16T01:18:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.786+0000 7f1737759640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f173015e740 0x7f17300d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.786+0000 7f1737759640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f173009b690 0x7f173006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.786+0000 7f1737759640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f173006e000 con 0x7f173006d4c0 2024-09-16T01:18:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.786+0000 7f1737759640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f173015eb20 con 0x7f173015e740 2024-09-16T01:18:22.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.786+0000 7f1737759640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f173006d260 con 0x7f173009b690 2024-09-16T01:18:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.786+0000 7f17354f5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f173015e740 0x7f17300d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.786+0000 7f17354f5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f173015e740 0x7f17300d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42726/0 (socket says 172.21.15.81:42726) 2024-09-16T01:18:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.786+0000 7f17354f5640 1 -- 172.21.15.81:0/4074065687 learned_addr learned my addr 172.21.15.81:0/4074065687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.786+0000 7f1734cf4640 1 --2- 172.21.15.81:0/4074065687 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f173009b690 0x7f173006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.787+0000 7f17354f5640 1 -- 172.21.15.81:0/4074065687 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f173009b690 msgr2=0x7f173006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.787+0000 7f17354f5640 1 --2- 172.21.15.81:0/4074065687 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f173009b690 0x7f173006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.787+0000 7f17354f5640 1 -- 172.21.15.81:0/4074065687 >> v1:172.21.15.102:6789/0 conn(0x7f173006d4c0 legacy=0x7f173006d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:22.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.787+0000 7f17354f5640 1 -- 172.21.15.81:0/4074065687 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17300d0780 con 0x7f173015e740 2024-09-16T01:18:22.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.787+0000 7f17354f5640 1 --2- 172.21.15.81:0/4074065687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173015e740 0x7f17300d1540 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f172c009870 tx=0x7f172c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f70f5d3e47ae05 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.787+0000 7f1727fff640 1 -- 172.21.15.81:0/4074065687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c037070 con 0x7f173015e740 2024-09-16T01:18:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.787+0000 7f1727fff640 1 -- 172.21.15.81:0/4074065687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172c032440 con 0x7f173015e740 2024-09-16T01:18:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.787+0000 7f1727fff640 1 -- 172.21.15.81:0/4074065687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c032810 con 0x7f173015e740 2024-09-16T01:18:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.788+0000 7f1737759640 1 -- 172.21.15.81:0/4074065687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173015e740 msgr2=0x7f17300d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.788+0000 7f1737759640 1 --2- 172.21.15.81:0/4074065687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173015e740 0x7f17300d1540 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f172c009870 tx=0x7f172c02a2a0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.788+0000 7f1737759640 1 -- 172.21.15.81:0/4074065687 shutdown_connections 2024-09-16T01:18:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.788+0000 7f1737759640 1 --2- 172.21.15.81:0/4074065687 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f173009b690 0x7f173006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.788+0000 7f1737759640 1 --2- 172.21.15.81:0/4074065687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173015e740 0x7f17300d1540 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.788+0000 7f1737759640 1 -- 172.21.15.81:0/4074065687 >> 172.21.15.81:0/4074065687 conn(0x7f17300d23a0 msgr2=0x7f17300d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.788+0000 7f1737759640 1 -- 172.21.15.81:0/4074065687 shutdown_connections 2024-09-16T01:18:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.788+0000 7f1737759640 1 -- 172.21.15.81:0/4074065687 wait complete. 2024-09-16T01:18:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.789+0000 7f1737759640 1 Processor -- start 2024-09-16T01:18:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.789+0000 7f1737759640 1 -- start start 2024-09-16T01:18:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1737759640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f173006d4c0 0x7f17300cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1737759640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f173009b690 0x7f173009fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1737759640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173015e740 0x7f173009d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1737759640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17300d1020 con 0x7f173015e740 2024-09-16T01:18:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1737759640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f17300d0d40 con 0x7f173006d4c0 2024-09-16T01:18:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1737759640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f173009ba90 con 0x7f173009b690 2024-09-16T01:18:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1735cf6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173015e740 0x7f173009d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1735cf6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173015e740 0x7f173009d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42734/0 (socket says 172.21.15.81:42734) 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1735cf6640 1 -- 172.21.15.81:0/52660211 learned_addr learned my addr 172.21.15.81:0/52660211 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f17354f5640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f173006d4c0 0x7f17300cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1734cf4640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f173009b690 0x7f173009fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1735cf6640 1 -- 172.21.15.81:0/52660211 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f173009b690 msgr2=0x7f173009fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1735cf6640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f173009b690 0x7f173009fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1735cf6640 1 -- 172.21.15.81:0/52660211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f173006d4c0 msgr2=0x7f17300cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1735cf6640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f173006d4c0 0x7f17300cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1735cf6640 1 -- 172.21.15.81:0/52660211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173009c460 con 0x7f173015e740 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1735cf6640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173015e740 0x7f173009d9f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f172800b970 tx=0x7f172800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.790+0000 7f1725ffb640 1 -- 172.21.15.81:0/52660211 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728019070 con 0x7f173015e740 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.791+0000 7f1725ffb640 1 -- 172.21.15.81:0/52660211 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f172800cb40 con 0x7f173015e740 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.791+0000 7f1737759640 1 -- 172.21.15.81:0/52660211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173009c740 con 0x7f173015e740 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.791+0000 7f1725ffb640 1 -- 172.21.15.81:0/52660211 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728014440 con 0x7f173015e740 2024-09-16T01:18:22.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.791+0000 7f1737759640 1 -- 172.21.15.81:0/52660211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173009cd00 con 0x7f173015e740 2024-09-16T01:18:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.792+0000 7f1737759640 1 -- 172.21.15.81:0/52660211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173006cd20 con 0x7f173015e740 2024-09-16T01:18:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.792+0000 7f1725ffb640 1 -- 172.21.15.81:0/52660211 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f172801c070 con 0x7f173015e740 2024-09-16T01:18:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.792+0000 7f1725ffb640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f171406c2b0 0x7f171406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.792+0000 7f1725ffb640 1 -- 172.21.15.81:0/52660211 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f172808ae90 con 0x7f173015e740 2024-09-16T01:18:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.792+0000 7f17354f5640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f171406c2b0 0x7f171406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.793+0000 7f17354f5640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f171406c2b0 0x7f171406e770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f172c034000 tx=0x7f172c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:22.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.797+0000 7f1725ffb640 1 -- 172.21.15.81:0/52660211 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1728059170 con 0x7f173015e740 2024-09-16T01:18:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.964+0000 7f1737759640 1 -- 172.21.15.81:0/52660211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f17300d1cb0 con 0x7f173015e740 2024-09-16T01:18:22.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.964+0000 7f1725ffb640 1 -- 172.21.15.81:0/52660211 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7f172805d470 con 0x7f173015e740 2024-09-16T01:18:22.966 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:22.966 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-16T01:18:22.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:22.967 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-16T01:18:22.967 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-16T01:18:22.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:22.967 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-16T01:18:22.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.966+0000 7f1737759640 1 -- 172.21.15.81:0/52660211 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f171406c2b0 msgr2=0x7f171406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.966+0000 7f1737759640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f171406c2b0 0x7f171406e770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f172c034000 tx=0x7f172c02e000 comp rx=0 tx=0).stop 2024-09-16T01:18:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.966+0000 7f1737759640 1 -- 172.21.15.81:0/52660211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173015e740 msgr2=0x7f173009d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.966+0000 7f1737759640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173015e740 0x7f173009d9f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f172800b970 tx=0x7f172800be30 comp rx=0 tx=0).stop 2024-09-16T01:18:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.966+0000 7f1737759640 1 -- 172.21.15.81:0/52660211 shutdown_connections 2024-09-16T01:18:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.966+0000 7f1737759640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f171406c2b0 0x7f171406e770 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.966+0000 7f1737759640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173015e740 0x7f173009d9f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.966+0000 7f1737759640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f173009b690 0x7f173009fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.966+0000 7f1737759640 1 --2- 172.21.15.81:0/52660211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f173006d4c0 0x7f17300cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.966+0000 7f1737759640 1 -- 172.21.15.81:0/52660211 >> 172.21.15.81:0/52660211 conn(0x7f17300d23a0 msgr2=0x7f17300d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.966+0000 7f1737759640 1 -- 172.21.15.81:0/52660211 shutdown_connections 2024-09-16T01:18:22.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:22.967+0000 7f1737759640 1 -- 172.21.15.81:0/52660211 wait complete. 2024-09-16T01:18:22.979 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:18:22.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:18:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.080+0000 7f4bd7b31640 1 Processor -- start 2024-09-16T01:18:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.080+0000 7f4bd7b31640 1 -- start start 2024-09-16T01:18:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.081+0000 7f4bd7b31640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4bd0159f90 0x7f4bd006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.081+0000 7f4bd7b31640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4bd0160560 0x7f4bd00cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.081+0000 7f4bd7b31640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd00b3d10 con 0x7f4bd006ff10 2024-09-16T01:18:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.081+0000 7f4bd7b31640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd00b4db0 con 0x7f4bd0160560 2024-09-16T01:18:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.081+0000 7f4bd7b31640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd00b3ff0 con 0x7f4bd0159f90 2024-09-16T01:18:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.081+0000 7f4bd60ce640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4bd0160560 0x7f4bd00cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.081+0000 7f4bd60ce640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4bd0160560 0x7f4bd00cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42738/0 (socket says 172.21.15.81:42738) 2024-09-16T01:18:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.081+0000 7f4bd60ce640 1 -- 172.21.15.81:0/4028521527 learned_addr learned my addr 172.21.15.81:0/4028521527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.081+0000 7f4bd60ce640 1 -- 172.21.15.81:0/4028521527 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4bd0159f90 msgr2=0x7f4bd006f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.081+0000 7f4bd60ce640 1 --2- 172.21.15.81:0/4028521527 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4bd0159f90 0x7f4bd006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.081+0000 7f4bd60ce640 1 -- 172.21.15.81:0/4028521527 >> v1:172.21.15.102:6789/0 conn(0x7f4bd006ff10 legacy=0x7f4bd015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.081+0000 7f4bd60ce640 1 -- 172.21.15.81:0/4028521527 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd00b42d0 con 0x7f4bd0160560 2024-09-16T01:18:23.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.082+0000 7f4bd60ce640 1 --2- 172.21.15.81:0/4028521527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd0160560 0x7f4bd00cdfd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009e80 tx=0x7f4bc802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49911f80873e020 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:23.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.082+0000 7f4bd48cb640 1 -- 172.21.15.81:0/4028521527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8036070 con 0x7f4bd0160560 2024-09-16T01:18:23.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.082+0000 7f4bd48cb640 1 -- 172.21.15.81:0/4028521527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bc8031600 con 0x7f4bd0160560 2024-09-16T01:18:23.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.082+0000 7f4bd48cb640 1 -- 172.21.15.81:0/4028521527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80319d0 con 0x7f4bd0160560 2024-09-16T01:18:23.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.083+0000 7f4bd7b31640 1 -- 172.21.15.81:0/4028521527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd0160560 msgr2=0x7f4bd00cdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:23.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.083+0000 7f4bd7b31640 1 --2- 172.21.15.81:0/4028521527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd0160560 0x7f4bd00cdfd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009e80 tx=0x7f4bc802a660 comp rx=0 tx=0).stop 2024-09-16T01:18:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.083+0000 7f4bd7b31640 1 -- 172.21.15.81:0/4028521527 shutdown_connections 2024-09-16T01:18:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.083+0000 7f4bd7b31640 1 --2- 172.21.15.81:0/4028521527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd0160560 0x7f4bd00cdfd0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.083+0000 7f4bd7b31640 1 --2- 172.21.15.81:0/4028521527 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4bd0159f90 0x7f4bd006f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.083+0000 7f4bd7b31640 1 -- 172.21.15.81:0/4028521527 >> 172.21.15.81:0/4028521527 conn(0x7f4bd006bdf0 msgr2=0x7f4bd006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.083+0000 7f4bd7b31640 1 -- 172.21.15.81:0/4028521527 shutdown_connections 2024-09-16T01:18:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.083+0000 7f4bd7b31640 1 -- 172.21.15.81:0/4028521527 wait complete. 2024-09-16T01:18:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.084+0000 7f4bd7b31640 1 Processor -- start 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.084+0000 7f4bd7b31640 1 -- start start 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd7b31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd006ff10 0x7f4bd0157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd7b31640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4bd0159f90 0x7f4bd01521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd7b31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd0160560 0x7f4bd0155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd7b31640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd00b3ab0 con 0x7f4bd006ff10 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd7b31640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd00b3930 con 0x7f4bd0160560 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd7b31640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd00ce510 con 0x7f4bd0159f90 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd58cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd006ff10 0x7f4bd0157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd58cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd006ff10 0x7f4bd0157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42748/0 (socket says 172.21.15.81:42748) 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd58cd640 1 -- 172.21.15.81:0/764592151 learned_addr learned my addr 172.21.15.81:0/764592151 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd60ce640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd0160560 0x7f4bd0155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd50cc640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4bd0159f90 0x7f4bd01521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd58cd640 1 -- 172.21.15.81:0/764592151 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4bd0159f90 msgr2=0x7f4bd01521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd58cd640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4bd0159f90 0x7f4bd01521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd58cd640 1 -- 172.21.15.81:0/764592151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd0160560 msgr2=0x7f4bd0155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd58cd640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd0160560 0x7f4bd0155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd58cd640 1 -- 172.21.15.81:0/764592151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd0157ba0 con 0x7f4bd006ff10 2024-09-16T01:18:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bd58cd640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd006ff10 0x7f4bd0157550 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00b4a0 tx=0x7f4bcc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.085+0000 7f4bc67fc640 1 -- 172.21.15.81:0/764592151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc014070 con 0x7f4bd006ff10 2024-09-16T01:18:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.086+0000 7f4bc67fc640 1 -- 172.21.15.81:0/764592151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bcc010610 con 0x7f4bd006ff10 2024-09-16T01:18:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.086+0000 7f4bd7b31640 1 -- 172.21.15.81:0/764592151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd0157e80 con 0x7f4bd006ff10 2024-09-16T01:18:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.086+0000 7f4bc67fc640 1 -- 172.21.15.81:0/764592151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc010a00 con 0x7f4bd006ff10 2024-09-16T01:18:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.086+0000 7f4bd7b31640 1 -- 172.21.15.81:0/764592151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd0158440 con 0x7f4bd006ff10 2024-09-16T01:18:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.087+0000 7f4bd7b31640 1 -- 172.21.15.81:0/764592151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd0158930 con 0x7f4bd006ff10 2024-09-16T01:18:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.087+0000 7f4bc67fc640 1 -- 172.21.15.81:0/764592151 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4bcc017070 con 0x7f4bd006ff10 2024-09-16T01:18:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.087+0000 7f4bc67fc640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4bb406c2b0 0x7f4bb406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.088+0000 7f4bc67fc640 1 -- 172.21.15.81:0/764592151 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5249+0+0 (secure 0 0 0) 0x7f4bcc08ac60 con 0x7f4bd006ff10 2024-09-16T01:18:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.088+0000 7f4bd50cc640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4bb406c2b0 0x7f4bb406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.088+0000 7f4bd50cc640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4bb406c2b0 0x7f4bb406e770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00cf340 tx=0x7f4bc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.092+0000 7f4bc67fc640 1 -- 172.21.15.81:0/764592151 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bcc059620 con 0x7f4bd006ff10 2024-09-16T01:18:23.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.258+0000 7f4bd7b31640 1 -- 172.21.15.81:0/764592151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4bd00ce990 con 0x7f4bd006ff10 2024-09-16T01:18:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.572+0000 7f4bc67fc640 1 -- 172.21.15.81:0/764592151 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f4bcc058f20 con 0x7f4bd006ff10 2024-09-16T01:18:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-16T01:18:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.574+0000 7f4bd7b31640 1 -- 172.21.15.81:0/764592151 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4bb406c2b0 msgr2=0x7f4bb406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.574+0000 7f4bd7b31640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4bb406c2b0 0x7f4bb406e770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00cf340 tx=0x7f4bc0009040 comp rx=0 tx=0).stop 2024-09-16T01:18:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.574+0000 7f4bd7b31640 1 -- 172.21.15.81:0/764592151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd006ff10 msgr2=0x7f4bd0157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.574+0000 7f4bd7b31640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd006ff10 0x7f4bd0157550 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00b4a0 tx=0x7f4bcc00b960 comp rx=0 tx=0).stop 2024-09-16T01:18:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.574+0000 7f4bd7b31640 1 -- 172.21.15.81:0/764592151 shutdown_connections 2024-09-16T01:18:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.574+0000 7f4bd7b31640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4bb406c2b0 0x7f4bb406e770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.574+0000 7f4bd7b31640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd0160560 0x7f4bd0155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.574+0000 7f4bd7b31640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4bd0159f90 0x7f4bd01521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.574+0000 7f4bd7b31640 1 --2- 172.21.15.81:0/764592151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bd006ff10 0x7f4bd0157550 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.574+0000 7f4bd7b31640 1 -- 172.21.15.81:0/764592151 >> 172.21.15.81:0/764592151 conn(0x7f4bd006bdf0 msgr2=0x7f4bd015ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.574+0000 7f4bd7b31640 1 -- 172.21.15.81:0/764592151 shutdown_connections 2024-09-16T01:18:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.574+0000 7f4bd7b31640 1 -- 172.21.15.81:0/764592151 wait complete. 2024-09-16T01:18:23.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:18:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.695+0000 7fe256728640 1 Processor -- start 2024-09-16T01:18:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.695+0000 7fe256728640 1 -- start start 2024-09-16T01:18:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe256728640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe25015b570 0x7fe250071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe256728640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe2500cd120 0x7fe25015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe256728640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe250073b20 con 0x7fe25015b950 2024-09-16T01:18:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe256728640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe2500740e0 con 0x7fe25015b570 2024-09-16T01:18:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe256728640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe250073e00 con 0x7fe2500cd120 2024-09-16T01:18:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe24ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe25015b570 0x7fe250071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe247fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe25015b950 0x7fe2500cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54460/0 (socket says 172.21.15.81:54460) 2024-09-16T01:18:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe247fff640 1 -- 172.21.15.81:0/4005945274 learned_addr learned my addr 172.21.15.81:0/4005945274 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe254cc5640 1 --2- 172.21.15.81:0/4005945274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe2500cd120 0x7fe25015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe24ffff640 1 -- 172.21.15.81:0/4005945274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe2500cd120 msgr2=0x7fe25015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe24ffff640 1 --2- 172.21.15.81:0/4005945274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe2500cd120 0x7fe25015e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe24ffff640 1 -- 172.21.15.81:0/4005945274 >> v1:172.21.15.81:6789/0 conn(0x7fe25015b950 legacy=0x7fe2500cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe24ffff640 1 -- 172.21.15.81:0/4005945274 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2500cf320 con 0x7fe25015b570 2024-09-16T01:18:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.696+0000 7fe24f7fe640 1 -- 172.21.15.81:0/4005945274 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173800334 0 0) 0x7fe250073b20 con 0x7fe25015b950 2024-09-16T01:18:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.697+0000 7fe24ffff640 1 --2- 172.21.15.81:0/4005945274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25015b570 0x7fe250071e40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe24000a940 tx=0x7fe24002b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b20cab0bf686bb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.697+0000 7fe24f7fe640 1 -- 172.21.15.81:0/4005945274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24000b040 con 0x7fe25015b570 2024-09-16T01:18:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.697+0000 7fe24f7fe640 1 -- 172.21.15.81:0/4005945274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe240030710 con 0x7fe25015b570 2024-09-16T01:18:23.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.697+0000 7fe24f7fe640 1 -- 172.21.15.81:0/4005945274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240030ae0 con 0x7fe25015b570 2024-09-16T01:18:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.698+0000 7fe256728640 1 -- 172.21.15.81:0/4005945274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25015b570 msgr2=0x7fe250071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.698+0000 7fe256728640 1 --2- 172.21.15.81:0/4005945274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25015b570 0x7fe250071e40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe24000a940 tx=0x7fe24002b4c0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.698+0000 7fe256728640 1 -- 172.21.15.81:0/4005945274 shutdown_connections 2024-09-16T01:18:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.698+0000 7fe256728640 1 --2- 172.21.15.81:0/4005945274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe2500cd120 0x7fe25015e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.698+0000 7fe256728640 1 --2- 172.21.15.81:0/4005945274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25015b570 0x7fe250071e40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.698+0000 7fe256728640 1 -- 172.21.15.81:0/4005945274 >> 172.21.15.81:0/4005945274 conn(0x7fe25006bdf0 msgr2=0x7fe25006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.698+0000 7fe256728640 1 -- 172.21.15.81:0/4005945274 shutdown_connections 2024-09-16T01:18:23.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.698+0000 7fe256728640 1 -- 172.21.15.81:0/4005945274 wait complete. 2024-09-16T01:18:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.699+0000 7fe256728640 1 Processor -- start 2024-09-16T01:18:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.699+0000 7fe256728640 1 -- start start 2024-09-16T01:18:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe256728640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2500cd120 0x7fe2500b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe256728640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe25015b570 0x7fe2501f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe256728640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25015b950 0x7fe2501f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe256728640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2500cf840 con 0x7fe25015b950 2024-09-16T01:18:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe256728640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe250072450 con 0x7fe2500cd120 2024-09-16T01:18:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe256728640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe2500cf9c0 con 0x7fe25015b570 2024-09-16T01:18:23.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe254cc5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25015b950 0x7fe2501f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe254cc5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25015b950 0x7fe2501f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42764/0 (socket says 172.21.15.81:42764) 2024-09-16T01:18:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe254cc5640 1 -- 172.21.15.81:0/2935085113 learned_addr learned my addr 172.21.15.81:0/2935085113 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe24ffff640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2500cd120 0x7fe2500b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe247fff640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe25015b570 0x7fe2501f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe254cc5640 1 -- 172.21.15.81:0/2935085113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe25015b570 msgr2=0x7fe2501f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe254cc5640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe25015b570 0x7fe2501f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe254cc5640 1 -- 172.21.15.81:0/2935085113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2500cd120 msgr2=0x7fe2500b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe254cc5640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2500cd120 0x7fe2500b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe254cc5640 1 -- 172.21.15.81:0/2935085113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25009d7d0 con 0x7fe25015b950 2024-09-16T01:18:23.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe24ffff640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2500cd120 0x7fe2500b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe247fff640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe25015b570 0x7fe2501f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.700+0000 7fe254cc5640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25015b950 0x7fe2501f5cc0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe248007d40 tx=0x7fe24800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.701+0000 7fe24d7fa640 1 -- 172.21.15.81:0/2935085113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248014420 con 0x7fe25015b950 2024-09-16T01:18:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.701+0000 7fe24d7fa640 1 -- 172.21.15.81:0/2935085113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe248019070 con 0x7fe25015b950 2024-09-16T01:18:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.701+0000 7fe256728640 1 -- 172.21.15.81:0/2935085113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe250149600 con 0x7fe25015b950 2024-09-16T01:18:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.701+0000 7fe24d7fa640 1 -- 172.21.15.81:0/2935085113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248014820 con 0x7fe25015b950 2024-09-16T01:18:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.701+0000 7fe256728640 1 -- 172.21.15.81:0/2935085113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe250146f90 con 0x7fe25015b950 2024-09-16T01:18:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.702+0000 7fe256728640 1 -- 172.21.15.81:0/2935085113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe250071e40 con 0x7fe25015b950 2024-09-16T01:18:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.702+0000 7fe24d7fa640 1 -- 172.21.15.81:0/2935085113 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe2480149c0 con 0x7fe25015b950 2024-09-16T01:18:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.702+0000 7fe24d7fa640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe23006c2b0 0x7fe23006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.703+0000 7fe24d7fa640 1 -- 172.21.15.81:0/2935085113 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5619+0+0 (secure 0 0 0) 0x7fe24808bb50 con 0x7fe25015b950 2024-09-16T01:18:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.703+0000 7fe24ffff640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe23006c2b0 0x7fe23006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.703+0000 7fe24ffff640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe23006c2b0 0x7fe23006e770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe240035000 tx=0x7fe24000c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.707+0000 7fe24d7fa640 1 -- 172.21.15.81:0/2935085113 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe24805a3a0 con 0x7fe25015b950 2024-09-16T01:18:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:23.876+0000 7fe256728640 1 -- 172.21.15.81:0/2935085113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe250147160 con 0x7fe25015b950 2024-09-16T01:18:24.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.577+0000 7fe24d7fa640 1 -- 172.21.15.81:0/2935085113 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7fe248059ca0 con 0x7fe25015b950 2024-09-16T01:18:24.579 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-16T01:18:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.579+0000 7fe256728640 1 -- 172.21.15.81:0/2935085113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe23006c2b0 msgr2=0x7fe23006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:24.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.579+0000 7fe256728640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe23006c2b0 0x7fe23006e770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe240035000 tx=0x7fe24000c040 comp rx=0 tx=0).stop 2024-09-16T01:18:24.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.579+0000 7fe256728640 1 -- 172.21.15.81:0/2935085113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25015b950 msgr2=0x7fe2501f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:24.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.579+0000 7fe256728640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25015b950 0x7fe2501f5cc0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe248007d40 tx=0x7fe24800e4b0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.579+0000 7fe256728640 1 -- 172.21.15.81:0/2935085113 shutdown_connections 2024-09-16T01:18:24.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.579+0000 7fe256728640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe23006c2b0 0x7fe23006e770 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.579+0000 7fe256728640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe25015b950 0x7fe2501f5cc0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.579+0000 7fe256728640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe25015b570 0x7fe2501f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.579+0000 7fe256728640 1 --2- 172.21.15.81:0/2935085113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2500cd120 0x7fe2500b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.579+0000 7fe256728640 1 -- 172.21.15.81:0/2935085113 >> 172.21.15.81:0/2935085113 conn(0x7fe25006bdf0 msgr2=0x7fe25014a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:24.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.579+0000 7fe256728640 1 -- 172.21.15.81:0/2935085113 shutdown_connections 2024-09-16T01:18:24.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.579+0000 7fe256728640 1 -- 172.21.15.81:0/2935085113 wait complete. 2024-09-16T01:18:24.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:18:24.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.704+0000 7fe3e2f86640 1 Processor -- start 2024-09-16T01:18:24.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.705+0000 7fe3e2f86640 1 -- start start 2024-09-16T01:18:24.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.705+0000 7fe3e2f86640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe3dc161ac0 0x7fe3dc0b2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:24.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.705+0000 7fe3e2f86640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3dc0b43b0 0x7fe3dc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:24.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.705+0000 7fe3e2f86640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3dc15eff0 con 0x7fe3dc06c150 2024-09-16T01:18:24.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.705+0000 7fe3e2f86640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe3dc06c5a0 con 0x7fe3dc161ac0 2024-09-16T01:18:24.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.705+0000 7fe3e2f86640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe3dc15f920 con 0x7fe3dc0b43b0 2024-09-16T01:18:24.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.706+0000 7fe3e0d22640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe3dc161ac0 0x7fe3dc0b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:24.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.706+0000 7fe3dbfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3dc0b43b0 0x7fe3dc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:24.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.706+0000 7fe3e1523640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe3dc06c150 0x7fe3dc162290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:46286/0 (socket says 172.21.15.81:46286) 2024-09-16T01:18:24.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.706+0000 7fe3e1523640 1 -- 172.21.15.81:0/2682581932 learned_addr learned my addr 172.21.15.81:0/2682581932 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.706+0000 7fe3e0d22640 1 -- 172.21.15.81:0/2682581932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3dc0b43b0 msgr2=0x7fe3dc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.706+0000 7fe3e0d22640 1 --2- 172.21.15.81:0/2682581932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3dc0b43b0 0x7fe3dc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.706+0000 7fe3e0d22640 1 -- 172.21.15.81:0/2682581932 >> v1:172.21.15.102:6789/0 conn(0x7fe3dc06c150 legacy=0x7fe3dc162290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.706+0000 7fe3e0d22640 1 -- 172.21.15.81:0/2682581932 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3dc15f2d0 con 0x7fe3dc161ac0 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.706+0000 7fe3dbfff640 1 --2- 172.21.15.81:0/2682581932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3dc0b43b0 0x7fe3dc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.707+0000 7fe3e0d22640 1 --2- 172.21.15.81:0/2682581932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3dc161ac0 0x7fe3dc0b2650 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0097a0 tx=0x7fe3cc02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b7bbcd763678cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.707+0000 7fe3db7fe640 1 -- 172.21.15.81:0/2682581932 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc037070 con 0x7fe3dc161ac0 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.707+0000 7fe3db7fe640 1 -- 172.21.15.81:0/2682581932 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc02ae50 con 0x7fe3dc161ac0 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.707+0000 7fe3db7fe640 1 -- 172.21.15.81:0/2682581932 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc032660 con 0x7fe3dc161ac0 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.708+0000 7fe3e2f86640 1 -- 172.21.15.81:0/2682581932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3dc161ac0 msgr2=0x7fe3dc0b2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.708+0000 7fe3e2f86640 1 --2- 172.21.15.81:0/2682581932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3dc161ac0 0x7fe3dc0b2650 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc0097a0 tx=0x7fe3cc02a100 comp rx=0 tx=0).stop 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.708+0000 7fe3e2f86640 1 -- 172.21.15.81:0/2682581932 shutdown_connections 2024-09-16T01:18:24.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.708+0000 7fe3e2f86640 1 --2- 172.21.15.81:0/2682581932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3dc0b43b0 0x7fe3dc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.708+0000 7fe3e2f86640 1 --2- 172.21.15.81:0/2682581932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3dc161ac0 0x7fe3dc0b2650 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.708+0000 7fe3e2f86640 1 -- 172.21.15.81:0/2682581932 >> 172.21.15.81:0/2682581932 conn(0x7fe3dc09aa30 msgr2=0x7fe3dc0b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.708+0000 7fe3e2f86640 1 -- 172.21.15.81:0/2682581932 shutdown_connections 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.708+0000 7fe3e2f86640 1 -- 172.21.15.81:0/2682581932 wait complete. 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.709+0000 7fe3e2f86640 1 Processor -- start 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.709+0000 7fe3e2f86640 1 -- start start 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e2f86640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3dc06c150 0x7fe3dc0d1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e2f86640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3dc0b43b0 0x7fe3dc09ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e2f86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3dc161ac0 0x7fe3dc1f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e2f86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc161ea0 con 0x7fe3dc161ac0 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e2f86640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe3dc15ece0 con 0x7fe3dc0b43b0 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e2f86640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe3dc162020 con 0x7fe3dc06c150 2024-09-16T01:18:24.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e1523640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3dc161ac0 0x7fe3dc1f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e1523640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3dc161ac0 0x7fe3dc1f76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42778/0 (socket says 172.21.15.81:42778) 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e1523640 1 -- 172.21.15.81:0/4243794590 learned_addr learned my addr 172.21.15.81:0/4243794590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3dbfff640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3dc0b43b0 0x7fe3dc09ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e0d22640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3dc06c150 0x7fe3dc0d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e1523640 1 -- 172.21.15.81:0/4243794590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3dc06c150 msgr2=0x7fe3dc0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e1523640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3dc06c150 0x7fe3dc0d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e1523640 1 -- 172.21.15.81:0/4243794590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3dc0b43b0 msgr2=0x7fe3dc09ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e1523640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3dc0b43b0 0x7fe3dc09ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e1523640 1 -- 172.21.15.81:0/4243794590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3dc146210 con 0x7fe3dc161ac0 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3e1523640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3dc161ac0 0x7fe3dc1f76c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400c420 tx=0x7fe3d400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3d97fa640 1 -- 172.21.15.81:0/4243794590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4017070 con 0x7fe3dc161ac0 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3d97fa640 1 -- 172.21.15.81:0/4243794590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d4005ce0 con 0x7fe3dc161ac0 2024-09-16T01:18:24.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.710+0000 7fe3d97fa640 1 -- 172.21.15.81:0/4243794590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40072d0 con 0x7fe3dc161ac0 2024-09-16T01:18:24.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.711+0000 7fe3e2f86640 1 -- 172.21.15.81:0/4243794590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3dc145450 con 0x7fe3dc161ac0 2024-09-16T01:18:24.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.711+0000 7fe3e2f86640 1 -- 172.21.15.81:0/4243794590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3dc145a10 con 0x7fe3dc161ac0 2024-09-16T01:18:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.712+0000 7fe3e2f86640 1 -- 172.21.15.81:0/4243794590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3dc06bc10 con 0x7fe3dc161ac0 2024-09-16T01:18:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.712+0000 7fe3d97fa640 1 -- 172.21.15.81:0/4243794590 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe3d401a070 con 0x7fe3dc161ac0 2024-09-16T01:18:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.712+0000 7fe3d97fa640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe3c806c2b0 0x7fe3c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.713+0000 7fe3e0d22640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe3c806c2b0 0x7fe3c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.713+0000 7fe3d97fa640 1 -- 172.21.15.81:0/4243794590 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6001+0+0 (secure 0 0 0) 0x7fe3d408a700 con 0x7fe3dc161ac0 2024-09-16T01:18:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.713+0000 7fe3e0d22640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe3c806c2b0 0x7fe3c806e770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc034000 tx=0x7fe3cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:24.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.717+0000 7fe3d97fa640 1 -- 172.21.15.81:0/4243794590 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe3d4058780 con 0x7fe3dc161ac0 2024-09-16T01:18:24.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:24.922+0000 7fe3e2f86640 1 -- 172.21.15.81:0/4243794590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe3dc0b29e0 con 0x7fe3dc161ac0 2024-09-16T01:18:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.580+0000 7fe3d97fa640 1 -- 172.21.15.81:0/4243794590 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v33) ==== 174+0+0 (secure 0 0 0) 0x7fe3d405ca80 con 0x7fe3dc161ac0 2024-09-16T01:18:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 11 and data pool 12 2024-09-16T01:18:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.582+0000 7fe3e2f86640 1 -- 172.21.15.81:0/4243794590 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe3c806c2b0 msgr2=0x7fe3c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.582+0000 7fe3e2f86640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe3c806c2b0 0x7fe3c806e770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc034000 tx=0x7fe3cc02e000 comp rx=0 tx=0).stop 2024-09-16T01:18:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.582+0000 7fe3e2f86640 1 -- 172.21.15.81:0/4243794590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3dc161ac0 msgr2=0x7fe3dc1f76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.582+0000 7fe3e2f86640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3dc161ac0 0x7fe3dc1f76c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400c420 tx=0x7fe3d400c8e0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.582+0000 7fe3e2f86640 1 -- 172.21.15.81:0/4243794590 shutdown_connections 2024-09-16T01:18:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.582+0000 7fe3e2f86640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe3c806c2b0 0x7fe3c806e770 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.582+0000 7fe3e2f86640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3dc161ac0 0x7fe3dc1f76c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.582+0000 7fe3e2f86640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe3dc0b43b0 0x7fe3dc09ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.582+0000 7fe3e2f86640 1 --2- 172.21.15.81:0/4243794590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3dc06c150 0x7fe3dc0d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.582+0000 7fe3e2f86640 1 -- 172.21.15.81:0/4243794590 >> 172.21.15.81:0/4243794590 conn(0x7fe3dc09aa30 msgr2=0x7fe3dc147270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.582+0000 7fe3e2f86640 1 -- 172.21.15.81:0/4243794590 shutdown_connections 2024-09-16T01:18:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.582+0000 7fe3e2f86640 1 -- 172.21.15.81:0/4243794590 wait complete. 2024-09-16T01:18:25.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:18:25.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.709+0000 7f5205d86640 1 Processor -- start 2024-09-16T01:18:25.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.709+0000 7f5205d86640 1 -- start start 2024-09-16T01:18:25.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.710+0000 7f5205d86640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f52000b6680 0x7f5200169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:25.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.710+0000 7f5205d86640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f520006d9f0 con 0x7f5200162060 2024-09-16T01:18:25.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.710+0000 7f5205d86640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f520006dcd0 con 0x7f5200161c80 2024-09-16T01:18:25.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.710+0000 7f5205d86640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f520006dfb0 con 0x7f52000b6680 2024-09-16T01:18:25.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.710+0000 7f51feffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5200162060 0x7f52000b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54462/0 (socket says 172.21.15.81:54462) 2024-09-16T01:18:25.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.710+0000 7f51feffd640 1 -- 172.21.15.81:0/3306821819 learned_addr learned my addr 172.21.15.81:0/3306821819 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:25.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.710+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836904968 0 0) 0x7f520006d9f0 con 0x7f5200162060 2024-09-16T01:18:25.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.710+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e8003520 con 0x7f5200162060 2024-09-16T01:18:25.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.710+0000 7f51fffff640 1 --2- 172.21.15.81:0/3306821819 >> v2:172.21.15.102:3300/0 conn(0x7f52000b6680 0x7f5200169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:25.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3475402213 0 0) 0x7f51e8003520 con 0x7f5200162060 2024-09-16T01:18:25.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 >> v2:172.21.15.102:3300/0 conn(0x7f52000b6680 msgr2=0x7f5200169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:25.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 --2- 172.21.15.81:0/3306821819 >> v2:172.21.15.102:3300/0 conn(0x7f52000b6680 0x7f5200169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 >> v1:172.21.15.102:6789/0 conn(0x7f5200161c80 legacy=0x7f520006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:25.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52000d01f0 con 0x7f5200162060 2024-09-16T01:18:25.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f51f4001670 con 0x7f5200162060 2024-09-16T01:18:25.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 >> v1:172.21.15.81:6789/0 conn(0x7f5200162060 legacy=0x7f52000b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:25.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 --2- 172.21.15.81:0/3306821819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e8003a00 0x7f51e8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:25.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 --2- 172.21.15.81:0/3306821819 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f51e8004800 0x7f51e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:25.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 --2- 172.21.15.81:0/3306821819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51e80051c0 0x7f51e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:25.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f520006dfb0 con 0x7f51e80051c0 2024-09-16T01:18:25.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f51e800c0c0 con 0x7f51e8003a00 2024-09-16T01:18:25.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f51e800c2c0 con 0x7f51e8004800 2024-09-16T01:18:25.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fffff640 1 --2- 172.21.15.81:0/3306821819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51e80051c0 0x7f51e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:25.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51ff7fe640 1 --2- 172.21.15.81:0/3306821819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e8003a00 0x7f51e8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:25.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51feffd640 1 --2- 172.21.15.81:0/3306821819 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f51e8004800 0x7f51e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:25.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fffff640 1 -- 172.21.15.81:0/3306821819 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f51e8004800 msgr2=0x7f51e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:25.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fffff640 1 --2- 172.21.15.81:0/3306821819 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f51e8004800 0x7f51e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fffff640 1 -- 172.21.15.81:0/3306821819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e8003a00 msgr2=0x7f51e8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:25.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fffff640 1 --2- 172.21.15.81:0/3306821819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e8003a00 0x7f51e8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.711+0000 7f51fffff640 1 -- 172.21.15.81:0/3306821819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e8003520 con 0x7f51e80051c0 2024-09-16T01:18:25.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.712+0000 7f51fffff640 1 -- 172.21.15.81:0/3306821819 reap_dead start 2024-09-16T01:18:25.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.712+0000 7f51fffff640 1 --2- 172.21.15.81:0/3306821819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51e80051c0 0x7f51e800b9c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009fc0 tx=0x7f51e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f249dacf54553925 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:25.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.712+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f8035020 con 0x7f51e80051c0 2024-09-16T01:18:25.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.712+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f8003bd0 con 0x7f51e80051c0 2024-09-16T01:18:25.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.712+0000 7f51fe7fc640 1 -- 172.21.15.81:0/3306821819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f8009c10 con 0x7f51e80051c0 2024-09-16T01:18:25.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.712+0000 7f5205d86640 1 -- 172.21.15.81:0/3306821819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51e80051c0 msgr2=0x7f51e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:25.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.712+0000 7f5205d86640 1 --2- 172.21.15.81:0/3306821819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51e80051c0 0x7f51e800b9c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009fc0 tx=0x7f51e8005830 comp rx=0 tx=0).stop 2024-09-16T01:18:25.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.712+0000 7f5205d86640 1 -- 172.21.15.81:0/3306821819 shutdown_connections 2024-09-16T01:18:25.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.712+0000 7f5205d86640 1 --2- 172.21.15.81:0/3306821819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51e80051c0 0x7f51e800b9c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.712+0000 7f5205d86640 1 -- 172.21.15.81:0/3306821819 >> 172.21.15.81:0/3306821819 conn(0x7f52000d44f0 msgr2=0x7f52000d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:25.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.713+0000 7f5205d86640 1 -- 172.21.15.81:0/3306821819 shutdown_connections 2024-09-16T01:18:25.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.713+0000 7f5205d86640 1 -- 172.21.15.81:0/3306821819 wait complete. 2024-09-16T01:18:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.714+0000 7f5205d86640 1 Processor -- start 2024-09-16T01:18:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.714+0000 7f5205d86640 1 -- start start 2024-09-16T01:18:25.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.714+0000 7f5205d86640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e80051c0 0x7f52000b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f5205d86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52001f3800 0x7f52001f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f5205d86640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f520009e1e0 0x7f520009e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f5205d86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52000b6b30 con 0x7f52001f3800 2024-09-16T01:18:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f5205d86640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f52000d2aa0 con 0x7f51e80051c0 2024-09-16T01:18:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f5205d86640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f52000b6cb0 con 0x7f520009e1e0 2024-09-16T01:18:25.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51feffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52001f3800 0x7f52001f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:25.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51feffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52001f3800 0x7f52001f3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42794/0 (socket says 172.21.15.81:42794) 2024-09-16T01:18:25.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51feffd640 1 -- 172.21.15.81:0/1546714117 learned_addr learned my addr 172.21.15.81:0/1546714117 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:25.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51fffff640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f520009e1e0 0x7f520009e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:25.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51ff7fe640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e80051c0 0x7f52000b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:25.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51feffd640 1 -- 172.21.15.81:0/1546714117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f520009e1e0 msgr2=0x7f520009e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:25.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51feffd640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f520009e1e0 0x7f520009e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51feffd640 1 -- 172.21.15.81:0/1546714117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e80051c0 msgr2=0x7f52000b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:25.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51feffd640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e80051c0 0x7f52000b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51feffd640 1 -- 172.21.15.81:0/1546714117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52001f41a0 con 0x7f52001f3800 2024-09-16T01:18:25.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51feffd640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52001f3800 0x7f52001f3c60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f51f40072c0 tx=0x7f51f4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51e7fff640 1 -- 172.21.15.81:0/1546714117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f401a070 con 0x7f52001f3800 2024-09-16T01:18:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51e7fff640 1 -- 172.21.15.81:0/1546714117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51f4001610 con 0x7f52001f3800 2024-09-16T01:18:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f5205d86640 1 -- 172.21.15.81:0/1546714117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52001518a0 con 0x7f52001f3800 2024-09-16T01:18:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f51e7fff640 1 -- 172.21.15.81:0/1546714117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51f400fba0 con 0x7f52001f3800 2024-09-16T01:18:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.715+0000 7f5205d86640 1 -- 172.21.15.81:0/1546714117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5200151e60 con 0x7f52001f3800 2024-09-16T01:18:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.716+0000 7f5205d86640 1 -- 172.21.15.81:0/1546714117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52000b5f70 con 0x7f52001f3800 2024-09-16T01:18:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.717+0000 7f51e7fff640 1 -- 172.21.15.81:0/1546714117 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f51f401d070 con 0x7f52001f3800 2024-09-16T01:18:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.717+0000 7f51e7fff640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f51ec06c2e0 0x7f51ec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.717+0000 7f51e7fff640 1 -- 172.21.15.81:0/1546714117 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f51f408ae30 con 0x7f52001f3800 2024-09-16T01:18:25.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.717+0000 7f51ff7fe640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f51ec06c2e0 0x7f51ec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:25.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.718+0000 7f51ff7fe640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f51ec06c2e0 0x7f51ec06e7a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f51f0000c00 tx=0x7f51f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:25.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.722+0000 7f51e7fff640 1 -- 172.21.15.81:0/1546714117 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51f4059410 con 0x7f52001f3800 2024-09-16T01:18:25.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.889+0000 7f5205d86640 1 -- 172.21.15.81:0/1546714117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52000d3a30 con 0x7f52001f3800 2024-09-16T01:18:25.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.890+0000 7f51e7fff640 1 -- 172.21.15.81:0/1546714117 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+17018 (secure 0 0 0) 0x7f51f4058d10 con 0x7f52001f3800 2024-09-16T01:18:25.892 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:25.893 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":74,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:24.924744+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:18:23.278642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-16T01:18:23.895482+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:18:25.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.892+0000 7f5205d86640 1 -- 172.21.15.81:0/1546714117 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f51ec06c2e0 msgr2=0x7f51ec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:25.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.892+0000 7f5205d86640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f51ec06c2e0 0x7f51ec06e7a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f51f0000c00 tx=0x7f51f0009040 comp rx=0 tx=0).stop 2024-09-16T01:18:25.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.892+0000 7f5205d86640 1 -- 172.21.15.81:0/1546714117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52001f3800 msgr2=0x7f52001f3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:25.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.892+0000 7f5205d86640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52001f3800 0x7f52001f3c60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f51f40072c0 tx=0x7f51f4007780 comp rx=0 tx=0).stop 2024-09-16T01:18:25.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.892+0000 7f5205d86640 1 -- 172.21.15.81:0/1546714117 shutdown_connections 2024-09-16T01:18:25.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.892+0000 7f5205d86640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f51ec06c2e0 0x7f51ec06e7a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.892+0000 7f5205d86640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f520009e1e0 0x7f520009e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.892+0000 7f5205d86640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52001f3800 0x7f52001f3c60 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.892+0000 7f5205d86640 1 --2- 172.21.15.81:0/1546714117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51e80051c0 0x7f52000b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:25.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.892+0000 7f5205d86640 1 -- 172.21.15.81:0/1546714117 >> 172.21.15.81:0/1546714117 conn(0x7f52000d44f0 msgr2=0x7f52000b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:25.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.893+0000 7f5205d86640 1 -- 172.21.15.81:0/1546714117 shutdown_connections 2024-09-16T01:18:25.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:25.893+0000 7f5205d86640 1 -- 172.21.15.81:0/1546714117 wait complete. 2024-09-16T01:18:25.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:18:26.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.002+0000 7f19e923c640 1 Processor -- start 2024-09-16T01:18:26.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.002+0000 7f19e923c640 1 -- start start 2024-09-16T01:18:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.002+0000 7f19e923c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f19e415e740 0x7f19e40d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.002+0000 7f19e923c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19e406dbd0 0x7f19e406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.002+0000 7f19e923c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19e406e000 con 0x7f19e409b690 2024-09-16T01:18:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.002+0000 7f19e923c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f19e415eb20 con 0x7f19e415e740 2024-09-16T01:18:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.002+0000 7f19e923c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f19e406d260 con 0x7f19e406dbd0 2024-09-16T01:18:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f19e409b690 0x7f19e406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54474/0 (socket says 172.21.15.81:54474) 2024-09-16T01:18:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e259c640 1 -- 172.21.15.81:0/2882532500 learned_addr learned my addr 172.21.15.81:0/2882532500 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e2d9d640 1 --2- 172.21.15.81:0/2882532500 >> v2:172.21.15.102:3300/0 conn(0x7f19e415e740 0x7f19e40d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e359e640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19e406dbd0 0x7f19e406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2656712320 0 0) 0x7f19e406e000 con 0x7f19e409b690 2024-09-16T01:18:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19d0003520 con 0x7f19e409b690 2024-09-16T01:18:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3514721659 0 0) 0x7f19d0003520 con 0x7f19e409b690 2024-09-16T01:18:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19e406dbd0 msgr2=0x7f19e406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19e406dbd0 0x7f19e406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 >> v2:172.21.15.102:3300/0 conn(0x7f19e415e740 msgr2=0x7f19e40d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 --2- 172.21.15.81:0/2882532500 >> v2:172.21.15.102:3300/0 conn(0x7f19e415e740 0x7f19e40d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e40d0780 con 0x7f19e409b690 2024-09-16T01:18:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f19d4001670 con 0x7f19e409b690 2024-09-16T01:18:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 >> v1:172.21.15.81:6789/0 conn(0x7f19e409b690 legacy=0x7f19e406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d00039b0 0x7f19d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19e406dbd0 0x7f19d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19d0004d40 0x7f19d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19e415eb20 con 0x7f19d0004d40 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f19e406d260 con 0x7f19d00039b0 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f19d000b9c0 con 0x7f19e406dbd0 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e359e640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19d0004d40 0x7f19d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e2d9d640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d00039b0 0x7f19d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.003+0000 7f19e259c640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19e406dbd0 0x7f19d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.004+0000 7f19e359e640 1 -- 172.21.15.81:0/2882532500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19e406dbd0 msgr2=0x7f19d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.004+0000 7f19e359e640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19e406dbd0 0x7f19d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.004+0000 7f19e359e640 1 -- 172.21.15.81:0/2882532500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d00039b0 msgr2=0x7f19d0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.004+0000 7f19e359e640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d00039b0 0x7f19d0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.004+0000 7f19e359e640 1 -- 172.21.15.81:0/2882532500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d0003520 con 0x7f19d0004d40 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.004+0000 7f19e259c640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19e406dbd0 0x7f19d0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.004+0000 7f19e359e640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19d0004d40 0x7f19d00051c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009fc0 tx=0x7f19d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4e576f51685f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.004+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc009c10 con 0x7f19d0004d40 2024-09-16T01:18:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.004+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19dc036070 con 0x7f19d0004d40 2024-09-16T01:18:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.004+0000 7f19e1d9b640 1 -- 172.21.15.81:0/2882532500 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc031880 con 0x7f19d0004d40 2024-09-16T01:18:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.005+0000 7f19e923c640 1 -- 172.21.15.81:0/2882532500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19d0004d40 msgr2=0x7f19d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.005+0000 7f19e923c640 1 --2- 172.21.15.81:0/2882532500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19d0004d40 0x7f19d00051c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f19dc009fc0 tx=0x7f19d0005830 comp rx=0 tx=0).stop 2024-09-16T01:18:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.005+0000 7f19e359e640 1 -- 172.21.15.81:0/2882532500 reap_dead start 2024-09-16T01:18:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.005+0000 7f19e923c640 1 -- 172.21.15.81:0/2882532500 shutdown_connections 2024-09-16T01:18:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.005+0000 7f19e923c640 1 -- 172.21.15.81:0/2882532500 >> 172.21.15.81:0/2882532500 conn(0x7f19e40d23a0 msgr2=0x7f19e40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.005+0000 7f19e923c640 1 -- 172.21.15.81:0/2882532500 shutdown_connections 2024-09-16T01:18:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.005+0000 7f19e923c640 1 -- 172.21.15.81:0/2882532500 wait complete. 2024-09-16T01:18:26.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.006+0000 7f19e923c640 1 Processor -- start 2024-09-16T01:18:26.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.007+0000 7f19e923c640 1 -- start start 2024-09-16T01:18:26.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.007+0000 7f19e923c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19d0004d40 0x7f19e41f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.007+0000 7f19e923c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19e41f84b0 0x7f19e415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.007+0000 7f19e923c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19e415b4e0 0x7f19e40b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.007+0000 7f19e923c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19e40d1020 con 0x7f19e415b4e0 2024-09-16T01:18:26.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.007+0000 7f19e923c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f19e40d0d40 con 0x7f19e41f84b0 2024-09-16T01:18:26.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.007+0000 7f19e923c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f19e409bac0 con 0x7f19d0004d40 2024-09-16T01:18:26.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.007+0000 7f19e359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19e415b4e0 0x7f19e40b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.007+0000 7f19e359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19e415b4e0 0x7f19e40b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42816/0 (socket says 172.21.15.81:42816) 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.007+0000 7f19e359e640 1 -- 172.21.15.81:0/141894521 learned_addr learned my addr 172.21.15.81:0/141894521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.007+0000 7f19e259c640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19e41f84b0 0x7f19e415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.007+0000 7f19e2d9d640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19d0004d40 0x7f19e41f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19e359e640 1 -- 172.21.15.81:0/141894521 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19d0004d40 msgr2=0x7f19e41f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19e359e640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19d0004d40 0x7f19e41f7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19e359e640 1 -- 172.21.15.81:0/141894521 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19e41f84b0 msgr2=0x7f19e415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19e359e640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19e41f84b0 0x7f19e415afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19e359e640 1 -- 172.21.15.81:0/141894521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e41f4230 con 0x7f19e415b4e0 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19e259c640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19e41f84b0 0x7f19e415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19e2d9d640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19d0004d40 0x7f19e41f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19e359e640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19e415b4e0 0x7f19e40b24a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f19dc033040 tx=0x7f19dc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:26.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19db7fe640 1 -- 172.21.15.81:0/141894521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc009c10 con 0x7f19e415b4e0 2024-09-16T01:18:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19db7fe640 1 -- 172.21.15.81:0/141894521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19dc031dd0 con 0x7f19e415b4e0 2024-09-16T01:18:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19e923c640 1 -- 172.21.15.81:0/141894521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e41f44f0 con 0x7f19e415b4e0 2024-09-16T01:18:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19db7fe640 1 -- 172.21.15.81:0/141894521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc003bd0 con 0x7f19e415b4e0 2024-09-16T01:18:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.008+0000 7f19e923c640 1 -- 172.21.15.81:0/141894521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e41f4ab0 con 0x7f19e415b4e0 2024-09-16T01:18:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.009+0000 7f19e923c640 1 -- 172.21.15.81:0/141894521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e41f5170 con 0x7f19e415b4e0 2024-09-16T01:18:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.010+0000 7f19db7fe640 1 -- 172.21.15.81:0/141894521 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f19dc005d10 con 0x7f19e415b4e0 2024-09-16T01:18:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.010+0000 7f19db7fe640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f19c406c2b0 0x7f19c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.010+0000 7f19db7fe640 1 -- 172.21.15.81:0/141894521 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f19dc0accb0 con 0x7f19e415b4e0 2024-09-16T01:18:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.010+0000 7f19e2d9d640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f19c406c2b0 0x7f19c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.010+0000 7f19e2d9d640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f19c406c2b0 0x7f19c406e770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009bc0 tx=0x7f19cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:26.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.014+0000 7f19db7fe640 1 -- 172.21.15.81:0/141894521 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19e41f5170 con 0x7f19e415b4e0 2024-09-16T01:18:26.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.184+0000 7f19e923c640 1 -- 172.21.15.81:0/141894521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f19e406cd20 con 0x7f19e415b4e0 2024-09-16T01:18:26.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.185+0000 7f19db7fe640 1 -- 172.21.15.81:0/141894521 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+17018 (secure 0 0 0) 0x7f19dc04a060 con 0x7f19e415b4e0 2024-09-16T01:18:26.187 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:26.187 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":74,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:24.924744+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:18:23.278642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-16T01:18:23.895482+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:18:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.187+0000 7f19e923c640 1 -- 172.21.15.81:0/141894521 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f19c406c2b0 msgr2=0x7f19c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.187+0000 7f19e923c640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f19c406c2b0 0x7f19c406e770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009bc0 tx=0x7f19cc008040 comp rx=0 tx=0).stop 2024-09-16T01:18:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.187+0000 7f19e923c640 1 -- 172.21.15.81:0/141894521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19e415b4e0 msgr2=0x7f19e40b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.187+0000 7f19e923c640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19e415b4e0 0x7f19e40b24a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f19dc033040 tx=0x7f19dc009750 comp rx=0 tx=0).stop 2024-09-16T01:18:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.187+0000 7f19e923c640 1 -- 172.21.15.81:0/141894521 shutdown_connections 2024-09-16T01:18:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.187+0000 7f19e923c640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f19c406c2b0 0x7f19c406e770 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.187+0000 7f19e923c640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19e415b4e0 0x7f19e40b24a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.187+0000 7f19e923c640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19e41f84b0 0x7f19e415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.187+0000 7f19e923c640 1 --2- 172.21.15.81:0/141894521 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19d0004d40 0x7f19e41f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.187+0000 7f19e923c640 1 -- 172.21.15.81:0/141894521 >> 172.21.15.81:0/141894521 conn(0x7f19e40d23a0 msgr2=0x7f19e40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.187+0000 7f19e923c640 1 -- 172.21.15.81:0/141894521 shutdown_connections 2024-09-16T01:18:26.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.187+0000 7f19e923c640 1 -- 172.21.15.81:0/141894521 wait complete. 2024-09-16T01:18:26.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:18:26.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.299+0000 7f97a80a5640 1 Processor -- start 2024-09-16T01:18:26.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.300+0000 7f97a80a5640 1 -- start start 2024-09-16T01:18:26.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.300+0000 7f97a80a5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f97a0158ec0 0x7f97a015c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.300+0000 7f97a80a5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97a015ca50 0x7f97a01594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.300+0000 7f97a80a5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97a015c850 con 0x7f97a00b4d50 2024-09-16T01:18:26.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.300+0000 7f97a80a5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f97a01592a0 con 0x7f97a015ca50 2024-09-16T01:18:26.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.300+0000 7f97a80a5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f97a015d010 con 0x7f97a0158ec0 2024-09-16T01:18:26.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.301+0000 7f97a5640640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97a015ca50 0x7f97a01594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.301+0000 7f97a5640640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97a015ca50 0x7f97a01594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42830/0 (socket says 172.21.15.81:42830) 2024-09-16T01:18:26.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.301+0000 7f97a5640640 1 -- 172.21.15.81:0/3283085277 learned_addr learned my addr 172.21.15.81:0/3283085277 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:26.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.301+0000 7f97a5e41640 1 --2- 172.21.15.81:0/3283085277 >> v2:172.21.15.102:3300/0 conn(0x7f97a0158ec0 0x7f97a015c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.301+0000 7f97a5640640 1 -- 172.21.15.81:0/3283085277 >> v2:172.21.15.102:3300/0 conn(0x7f97a0158ec0 msgr2=0x7f97a015c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.301+0000 7f97a5640640 1 --2- 172.21.15.81:0/3283085277 >> v2:172.21.15.102:3300/0 conn(0x7f97a0158ec0 0x7f97a015c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.301+0000 7f97a5640640 1 -- 172.21.15.81:0/3283085277 >> v1:172.21.15.102:6789/0 conn(0x7f97a00b4d50 legacy=0x7f97a00b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.301+0000 7f97a5640640 1 -- 172.21.15.81:0/3283085277 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a015d2f0 con 0x7f97a015ca50 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.301+0000 7f97a5640640 1 --2- 172.21.15.81:0/3283085277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a015ca50 0x7f97a01594d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f97a00688a0 tx=0x7f979002c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d900775ff755326 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.302+0000 7f97a4e3f640 1 -- 172.21.15.81:0/3283085277 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97900325a0 con 0x7f97a015ca50 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.302+0000 7f97a4e3f640 1 -- 172.21.15.81:0/3283085277 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9790038070 con 0x7f97a015ca50 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.302+0000 7f97a4e3f640 1 -- 172.21.15.81:0/3283085277 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9790032960 con 0x7f97a015ca50 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.302+0000 7f97a80a5640 1 -- 172.21.15.81:0/3283085277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a015ca50 msgr2=0x7f97a01594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.302+0000 7f97a80a5640 1 --2- 172.21.15.81:0/3283085277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a015ca50 0x7f97a01594d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f97a00688a0 tx=0x7f979002c8e0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.302+0000 7f97a80a5640 1 -- 172.21.15.81:0/3283085277 shutdown_connections 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.302+0000 7f97a80a5640 1 --2- 172.21.15.81:0/3283085277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a015ca50 0x7f97a01594d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.302+0000 7f97a80a5640 1 --2- 172.21.15.81:0/3283085277 >> v2:172.21.15.102:3300/0 conn(0x7f97a0158ec0 0x7f97a015c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.302+0000 7f97a80a5640 1 -- 172.21.15.81:0/3283085277 >> 172.21.15.81:0/3283085277 conn(0x7f97a009aa30 msgr2=0x7f97a00b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:26.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.302+0000 7f97a80a5640 1 -- 172.21.15.81:0/3283085277 shutdown_connections 2024-09-16T01:18:26.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.302+0000 7f97a80a5640 1 -- 172.21.15.81:0/3283085277 wait complete. 2024-09-16T01:18:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.303+0000 7f97a80a5640 1 Processor -- start 2024-09-16T01:18:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.304+0000 7f97a80a5640 1 -- start start 2024-09-16T01:18:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.304+0000 7f97a80a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a00b4d50 0x7f97a013fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.304+0000 7f97a80a5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97a0158ec0 0x7f97a00d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.304+0000 7f97a80a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a015ca50 0x7f97a00cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.304+0000 7f97a80a5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97a015db90 con 0x7f97a015ca50 2024-09-16T01:18:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.304+0000 7f97a80a5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97a015d8b0 con 0x7f97a00b4d50 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.304+0000 7f97a80a5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f97a0159a10 con 0x7f97a0158ec0 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.304+0000 7f97a6642640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a015ca50 0x7f97a00cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.304+0000 7f97a6642640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a015ca50 0x7f97a00cf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42846/0 (socket says 172.21.15.81:42846) 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.304+0000 7f97a6642640 1 -- 172.21.15.81:0/2597803180 learned_addr learned my addr 172.21.15.81:0/2597803180 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.304+0000 7f97a5e41640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a00b4d50 0x7f97a013fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.304+0000 7f97a5640640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97a0158ec0 0x7f97a00d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.305+0000 7f97a6642640 1 -- 172.21.15.81:0/2597803180 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97a0158ec0 msgr2=0x7f97a00d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.305+0000 7f97a6642640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97a0158ec0 0x7f97a00d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.305+0000 7f97a6642640 1 -- 172.21.15.81:0/2597803180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a00b4d50 msgr2=0x7f97a013fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.305+0000 7f97a6642640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a00b4d50 0x7f97a013fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.305+0000 7f97a6642640 1 -- 172.21.15.81:0/2597803180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a0140250 con 0x7f97a015ca50 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.305+0000 7f97a6642640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a015ca50 0x7f97a00cf6d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f979800c780 tx=0x7f979800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.305+0000 7f97967fc640 1 -- 172.21.15.81:0/2597803180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798004b60 con 0x7f97a015ca50 2024-09-16T01:18:26.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.305+0000 7f97967fc640 1 -- 172.21.15.81:0/2597803180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9798004d00 con 0x7f97a015ca50 2024-09-16T01:18:26.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.305+0000 7f97967fc640 1 -- 172.21.15.81:0/2597803180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979800aa90 con 0x7f97a015ca50 2024-09-16T01:18:26.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.305+0000 7f97a80a5640 1 -- 172.21.15.81:0/2597803180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a0156e80 con 0x7f97a015ca50 2024-09-16T01:18:26.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.305+0000 7f97a80a5640 1 -- 172.21.15.81:0/2597803180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a00d0500 con 0x7f97a015ca50 2024-09-16T01:18:26.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.306+0000 7f97a80a5640 1 -- 172.21.15.81:0/2597803180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97a015c310 con 0x7f97a015ca50 2024-09-16T01:18:26.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.307+0000 7f97967fc640 1 -- 172.21.15.81:0/2597803180 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f979800ac30 con 0x7f97a015ca50 2024-09-16T01:18:26.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.307+0000 7f97967fc640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f978406c2b0 0x7f978406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.307+0000 7f97a5e41640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f978406c2b0 0x7f978406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.307+0000 7f97967fc640 1 -- 172.21.15.81:0/2597803180 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6101+0+0 (secure 0 0 0) 0x7f979808b6d0 con 0x7f97a015ca50 2024-09-16T01:18:26.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.307+0000 7f97a5e41640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f978406c2b0 0x7f978406e770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f979c006fd0 tx=0x7f979c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:26.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.311+0000 7f97967fc640 1 -- 172.21.15.81:0/2597803180 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9798020070 con 0x7f97a015ca50 2024-09-16T01:18:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.511+0000 7f97a80a5640 1 -- 172.21.15.81:0/2597803180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f97a015a7f0 con 0x7f97a015ca50 2024-09-16T01:18:26.577 INFO:tasks.ceph.mds.b.smithi102.stderr:2024-09-16T01:18:26.576+0000 7f1935c35640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:18:26.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.840+0000 7f97967fc640 1 -- 172.21.15.81:0/2597803180 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) ==== 118+0+0 (secure 0 0 0) 0x7f9798059660 con 0x7f97a015ca50 2024-09-16T01:18:26.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.842+0000 7f97a80a5640 1 -- 172.21.15.81:0/2597803180 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f978406c2b0 msgr2=0x7f978406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.842+0000 7f97a80a5640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f978406c2b0 0x7f978406e770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f979c006fd0 tx=0x7f979c008040 comp rx=0 tx=0).stop 2024-09-16T01:18:26.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.842+0000 7f97a80a5640 1 -- 172.21.15.81:0/2597803180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a015ca50 msgr2=0x7f97a00cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.842+0000 7f97a80a5640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a015ca50 0x7f97a00cf6d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f979800c780 tx=0x7f979800cc40 comp rx=0 tx=0).stop 2024-09-16T01:18:26.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.842+0000 7f97a80a5640 1 -- 172.21.15.81:0/2597803180 shutdown_connections 2024-09-16T01:18:26.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.842+0000 7f97a80a5640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f978406c2b0 0x7f978406e770 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.842+0000 7f97a80a5640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a015ca50 0x7f97a00cf6d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.842+0000 7f97a80a5640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f97a0158ec0 0x7f97a00d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.842+0000 7f97a80a5640 1 --2- 172.21.15.81:0/2597803180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f97a00b4d50 0x7f97a013fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.842+0000 7f97a80a5640 1 -- 172.21.15.81:0/2597803180 >> 172.21.15.81:0/2597803180 conn(0x7f97a009aa30 msgr2=0x7f97a015e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:26.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.842+0000 7f97a80a5640 1 -- 172.21.15.81:0/2597803180 shutdown_connections 2024-09-16T01:18:26.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.842+0000 7f97a80a5640 1 -- 172.21.15.81:0/2597803180 wait complete. 2024-09-16T01:18:26.855 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T01:18:26.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:18:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.955+0000 7f994328d640 1 Processor -- start 2024-09-16T01:18:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.955+0000 7f994328d640 1 -- start start 2024-09-16T01:18:26.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.956+0000 7f994328d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f993c0ae3f0 0x7f993c0b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.956+0000 7f994328d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f993c067ff0 con 0x7f993c067ae0 2024-09-16T01:18:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.956+0000 7f994328d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f993c0af390 con 0x7f993c15e2e0 2024-09-16T01:18:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.956+0000 7f994328d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f993c0aec30 con 0x7f993c0ae3f0 2024-09-16T01:18:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.956+0000 7f9940828640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f993c067ae0 0x7f993c0adce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54480/0 (socket says 172.21.15.81:54480) 2024-09-16T01:18:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.956+0000 7f9940828640 1 -- 172.21.15.81:0/1757866055 learned_addr learned my addr 172.21.15.81:0/1757866055 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.956+0000 7f994182a640 1 --2- 172.21.15.81:0/1757866055 >> v2:172.21.15.102:3300/0 conn(0x7f993c0ae3f0 0x7f993c0b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.956+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686623551 0 0) 0x7f993c067ff0 con 0x7f993c067ae0 2024-09-16T01:18:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.956+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9928003520 con 0x7f993c067ae0 2024-09-16T01:18:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4236483590 0 0) 0x7f9928003520 con 0x7f993c067ae0 2024-09-16T01:18:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 >> v2:172.21.15.102:3300/0 conn(0x7f993c0ae3f0 msgr2=0x7f993c0b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 --2- 172.21.15.81:0/1757866055 >> v2:172.21.15.102:3300/0 conn(0x7f993c0ae3f0 0x7f993c0b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 >> v1:172.21.15.102:6789/0 conn(0x7f993c15e2e0 legacy=0x7f993c15f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993c0af670 con 0x7f993c067ae0 2024-09-16T01:18:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f992c001670 con 0x7f993c067ae0 2024-09-16T01:18:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 >> v1:172.21.15.81:6789/0 conn(0x7f993c067ae0 legacy=0x7f993c0adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 --2- 172.21.15.81:0/1757866055 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99280039b0 0x7f9928003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 --2- 172.21.15.81:0/1757866055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9928004800 0x7f9928004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 --2- 172.21.15.81:0/1757866055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 0x7f992800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f992800c030 con 0x7f99280051c0 2024-09-16T01:18:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f992800c1e0 con 0x7f9928004800 2024-09-16T01:18:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f992800c3e0 con 0x7f99280039b0 2024-09-16T01:18:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f994182a640 1 --2- 172.21.15.81:0/1757866055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 0x7f992800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9941029640 1 --2- 172.21.15.81:0/1757866055 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99280039b0 0x7f9928003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f9940828640 1 --2- 172.21.15.81:0/1757866055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9928004800 0x7f9928004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f994182a640 1 -- 172.21.15.81:0/1757866055 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99280039b0 msgr2=0x7f9928003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:26.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f994182a640 1 --2- 172.21.15.81:0/1757866055 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99280039b0 0x7f9928003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f994182a640 1 -- 172.21.15.81:0/1757866055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9928004800 msgr2=0x7f9928004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:26.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f994182a640 1 --2- 172.21.15.81:0/1757866055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9928004800 0x7f9928004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.957+0000 7f994182a640 1 -- 172.21.15.81:0/1757866055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9928003520 con 0x7f99280051c0 2024-09-16T01:18:26.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.958+0000 7f994182a640 1 -- 172.21.15.81:0/1757866055 reap_dead start 2024-09-16T01:18:26.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.958+0000 7f994182a640 1 --2- 172.21.15.81:0/1757866055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 0x7f992800b9c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9934009fc0 tx=0x7f9928005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b42d5453475ab36 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:26.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.958+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934035020 con 0x7f99280051c0 2024-09-16T01:18:26.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.958+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9934003bd0 con 0x7f99280051c0 2024-09-16T01:18:26.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.958+0000 7f9933fff640 1 -- 172.21.15.81:0/1757866055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9934009c10 con 0x7f99280051c0 2024-09-16T01:18:26.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.958+0000 7f994328d640 1 -- 172.21.15.81:0/1757866055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 msgr2=0x7f992800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.958+0000 7f994328d640 1 --2- 172.21.15.81:0/1757866055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 0x7f992800b9c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9934009fc0 tx=0x7f9928005830 comp rx=0 tx=0).stop 2024-09-16T01:18:26.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.958+0000 7f994328d640 1 -- 172.21.15.81:0/1757866055 shutdown_connections 2024-09-16T01:18:26.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.958+0000 7f994328d640 1 --2- 172.21.15.81:0/1757866055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 0x7f992800b9c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.958+0000 7f994328d640 1 -- 172.21.15.81:0/1757866055 >> 172.21.15.81:0/1757866055 conn(0x7f993c073590 msgr2=0x7f993c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:26.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.958+0000 7f994328d640 1 -- 172.21.15.81:0/1757866055 shutdown_connections 2024-09-16T01:18:26.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.958+0000 7f994328d640 1 -- 172.21.15.81:0/1757866055 wait complete. 2024-09-16T01:18:26.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.960+0000 7f994328d640 1 Processor -- start 2024-09-16T01:18:26.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.960+0000 7f994328d640 1 -- start start 2024-09-16T01:18:26.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.960+0000 7f994328d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 0x7f993c0cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.960+0000 7f994328d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f993c0cb410 0x7f993c0cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.960+0000 7f994328d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993c0c5e30 0x7f993c0c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.960+0000 7f994328d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f993c15e6c0 con 0x7f99280051c0 2024-09-16T01:18:26.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.960+0000 7f994328d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f993c0afc30 con 0x7f993c0c5e30 2024-09-16T01:18:26.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.960+0000 7f994328d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f993c0b0150 con 0x7f993c0cb410 2024-09-16T01:18:26.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.960+0000 7f9941029640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 0x7f993c0cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.960+0000 7f9941029640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 0x7f993c0cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42870/0 (socket says 172.21.15.81:42870) 2024-09-16T01:18:26.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.960+0000 7f9941029640 1 -- 172.21.15.81:0/568388682 learned_addr learned my addr 172.21.15.81:0/568388682 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f994182a640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993c0c5e30 0x7f993c0c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f9940828640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f993c0cb410 0x7f993c0cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f9941029640 1 -- 172.21.15.81:0/568388682 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f993c0cb410 msgr2=0x7f993c0cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f9941029640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f993c0cb410 0x7f993c0cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f9941029640 1 -- 172.21.15.81:0/568388682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993c0c5e30 msgr2=0x7f993c0c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f9941029640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993c0c5e30 0x7f993c0c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f9941029640 1 -- 172.21.15.81:0/568388682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993c0c6b80 con 0x7f99280051c0 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f9941029640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 0x7f993c0cfcd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f993800e480 tx=0x7f993800e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f9931ffb640 1 -- 172.21.15.81:0/568388682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99380052e0 con 0x7f99280051c0 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f9931ffb640 1 -- 172.21.15.81:0/568388682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9938018070 con 0x7f99280051c0 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f9931ffb640 1 -- 172.21.15.81:0/568388682 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938003830 con 0x7f99280051c0 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f994328d640 1 -- 172.21.15.81:0/568388682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993c0c6e60 con 0x7f99280051c0 2024-09-16T01:18:26.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.961+0000 7f994328d640 1 -- 172.21.15.81:0/568388682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f993c0c7420 con 0x7f99280051c0 2024-09-16T01:18:26.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.962+0000 7f994328d640 1 -- 172.21.15.81:0/568388682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f993c0adce0 con 0x7f99280051c0 2024-09-16T01:18:26.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.962+0000 7f9931ffb640 1 -- 172.21.15.81:0/568388682 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f99380039d0 con 0x7f99280051c0 2024-09-16T01:18:26.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.963+0000 7f9931ffb640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f992006c2b0 0x7f992006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:26.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.963+0000 7f9940828640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f992006c2b0 0x7f992006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:26.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.963+0000 7f9931ffb640 1 -- 172.21.15.81:0/568388682 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f993808b1e0 con 0x7f99280051c0 2024-09-16T01:18:26.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.963+0000 7f9940828640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f992006c2b0 0x7f992006e770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f992c001050 tx=0x7f992c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:26.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:26.967+0000 7f9931ffb640 1 -- 172.21.15.81:0/568388682 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9938059850 con 0x7f99280051c0 2024-09-16T01:18:27.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.169+0000 7f994328d640 1 -- 172.21.15.81:0/568388682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f993c06f4e0 con 0x7f99280051c0 2024-09-16T01:18:27.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.841+0000 7f9931ffb640 1 -- 172.21.15.81:0/568388682 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f9938059150 con 0x7f99280051c0 2024-09-16T01:18:27.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.844+0000 7f994328d640 1 -- 172.21.15.81:0/568388682 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f992006c2b0 msgr2=0x7f992006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:27.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.844+0000 7f994328d640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f992006c2b0 0x7f992006e770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f992c001050 tx=0x7f992c009040 comp rx=0 tx=0).stop 2024-09-16T01:18:27.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.844+0000 7f994328d640 1 -- 172.21.15.81:0/568388682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 msgr2=0x7f993c0cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:27.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.844+0000 7f994328d640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 0x7f993c0cfcd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f993800e480 tx=0x7f993800e940 comp rx=0 tx=0).stop 2024-09-16T01:18:27.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.844+0000 7f994328d640 1 -- 172.21.15.81:0/568388682 shutdown_connections 2024-09-16T01:18:27.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.844+0000 7f994328d640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f992006c2b0 0x7f992006e770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:27.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.844+0000 7f994328d640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f993c0c5e30 0x7f993c0c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:27.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.844+0000 7f994328d640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f993c0cb410 0x7f993c0cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:27.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.844+0000 7f994328d640 1 --2- 172.21.15.81:0/568388682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99280051c0 0x7f993c0cfcd0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:27.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.844+0000 7f994328d640 1 -- 172.21.15.81:0/568388682 >> 172.21.15.81:0/568388682 conn(0x7f993c073590 msgr2=0x7f993c06e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:27.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.844+0000 7f994328d640 1 -- 172.21.15.81:0/568388682 shutdown_connections 2024-09-16T01:18:27.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.844+0000 7f994328d640 1 -- 172.21.15.81:0/568388682 wait complete. 2024-09-16T01:18:27.858 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:18:27.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:27.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.958+0000 7fd594d31640 1 Processor -- start 2024-09-16T01:18:27.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.958+0000 7fd594d31640 1 -- start start 2024-09-16T01:18:27.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd594d31640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd59015e5d0 0x7fd5900d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:27.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd594d31640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd59006df60 0x7fd59009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:27.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd594d31640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5900d1630 0x7fd59009af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:27.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd594d31640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd59006dad0 con 0x7fd5900d1630 2024-09-16T01:18:27.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd594d31640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd59006cec0 con 0x7fd59006df60 2024-09-16T01:18:27.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd594d31640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd59006d1a0 con 0x7fd59015e5d0 2024-09-16T01:18:27.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd58ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5900d1630 0x7fd59009af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:27.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd58ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5900d1630 0x7fd59009af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42872/0 (socket says 172.21.15.81:42872) 2024-09-16T01:18:27.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd58ed9d640 1 -- 172.21.15.81:0/456922599 learned_addr learned my addr 172.21.15.81:0/456922599 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:27.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd58e59c640 1 --2- 172.21.15.81:0/456922599 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd59015e5d0 0x7fd5900d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:27.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd58dd9b640 1 --2- 172.21.15.81:0/456922599 >> v2:172.21.15.102:3300/0 conn(0x7fd59006df60 0x7fd59009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:27.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd58ed9d640 1 -- 172.21.15.81:0/456922599 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd59015e5d0 msgr2=0x7fd5900d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:27.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd58ed9d640 1 --2- 172.21.15.81:0/456922599 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd59015e5d0 0x7fd5900d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:27.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd58ed9d640 1 -- 172.21.15.81:0/456922599 >> v2:172.21.15.102:3300/0 conn(0x7fd59006df60 msgr2=0x7fd59009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:27.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd58ed9d640 1 --2- 172.21.15.81:0/456922599 >> v2:172.21.15.102:3300/0 conn(0x7fd59006df60 0x7fd59009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:27.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd58ed9d640 1 -- 172.21.15.81:0/456922599 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59006d480 con 0x7fd5900d1630 2024-09-16T01:18:27.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.959+0000 7fd58dd9b640 1 --2- 172.21.15.81:0/456922599 >> v2:172.21.15.102:3300/0 conn(0x7fd59006df60 0x7fd59009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.960+0000 7fd58ed9d640 1 --2- 172.21.15.81:0/456922599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5900d1630 0x7fd59009af70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd590073d00 tx=0x7fd58802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9abdd513e1199 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.960+0000 7fd58d59a640 1 -- 172.21.15.81:0/456922599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588036070 con 0x7fd5900d1630 2024-09-16T01:18:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.960+0000 7fd58d59a640 1 -- 172.21.15.81:0/456922599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd588031600 con 0x7fd5900d1630 2024-09-16T01:18:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.960+0000 7fd58d59a640 1 -- 172.21.15.81:0/456922599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5880319d0 con 0x7fd5900d1630 2024-09-16T01:18:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.961+0000 7fd594d31640 1 -- 172.21.15.81:0/456922599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5900d1630 msgr2=0x7fd59009af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.961+0000 7fd594d31640 1 --2- 172.21.15.81:0/456922599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5900d1630 0x7fd59009af70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd590073d00 tx=0x7fd58802a730 comp rx=0 tx=0).stop 2024-09-16T01:18:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.961+0000 7fd594d31640 1 -- 172.21.15.81:0/456922599 shutdown_connections 2024-09-16T01:18:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.961+0000 7fd594d31640 1 --2- 172.21.15.81:0/456922599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5900d1630 0x7fd59009af70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.961+0000 7fd594d31640 1 --2- 172.21.15.81:0/456922599 >> v2:172.21.15.102:3300/0 conn(0x7fd59006df60 0x7fd59009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.961+0000 7fd594d31640 1 --2- 172.21.15.81:0/456922599 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd59015e5d0 0x7fd5900d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:27.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.961+0000 7fd594d31640 1 -- 172.21.15.81:0/456922599 >> 172.21.15.81:0/456922599 conn(0x7fd5900d23a0 msgr2=0x7fd5900d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:27.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.961+0000 7fd594d31640 1 -- 172.21.15.81:0/456922599 shutdown_connections 2024-09-16T01:18:27.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.961+0000 7fd594d31640 1 -- 172.21.15.81:0/456922599 wait complete. 2024-09-16T01:18:27.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.962+0000 7fd594d31640 1 Processor -- start 2024-09-16T01:18:27.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.962+0000 7fd594d31640 1 -- start start 2024-09-16T01:18:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd594d31640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd59006df60 0x7fd590161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd594d31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5900d1630 0x7fd590152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd594d31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd59015e5d0 0x7fd59015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd594d31640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd59015eb30 con 0x7fd5900d1630 2024-09-16T01:18:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd594d31640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd59015e9b0 con 0x7fd59015e5d0 2024-09-16T01:18:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd594d31640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd590162230 con 0x7fd59006df60 2024-09-16T01:18:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd58dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5900d1630 0x7fd590152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd58dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5900d1630 0x7fd590152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42876/0 (socket says 172.21.15.81:42876) 2024-09-16T01:18:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd58dd9b640 1 -- 172.21.15.81:0/2318281066 learned_addr learned my addr 172.21.15.81:0/2318281066 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd58ed9d640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd59015e5d0 0x7fd59015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd58e59c640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd59006df60 0x7fd590161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd58dd9b640 1 -- 172.21.15.81:0/2318281066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd59006df60 msgr2=0x7fd590161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd58dd9b640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd59006df60 0x7fd590161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd58dd9b640 1 -- 172.21.15.81:0/2318281066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd59015e5d0 msgr2=0x7fd59015f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd58dd9b640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd59015e5d0 0x7fd59015f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.963+0000 7fd58dd9b640 1 -- 172.21.15.81:0/2318281066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd590153a50 con 0x7fd5900d1630 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.964+0000 7fd58dd9b640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5900d1630 0x7fd590152af0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c820 tx=0x7fd58400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.964+0000 7fd57effd640 1 -- 172.21.15.81:0/2318281066 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584004230 con 0x7fd5900d1630 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.964+0000 7fd57effd640 1 -- 172.21.15.81:0/2318281066 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5840043f0 con 0x7fd5900d1630 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.964+0000 7fd594d31640 1 -- 172.21.15.81:0/2318281066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd59015f5f0 con 0x7fd5900d1630 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.964+0000 7fd57effd640 1 -- 172.21.15.81:0/2318281066 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584007a70 con 0x7fd5900d1630 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.964+0000 7fd594d31640 1 -- 172.21.15.81:0/2318281066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5900b55e0 con 0x7fd5900d1630 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.965+0000 7fd594d31640 1 -- 172.21.15.81:0/2318281066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5900b5f80 con 0x7fd5900d1630 2024-09-16T01:18:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.965+0000 7fd57effd640 1 -- 172.21.15.81:0/2318281066 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd584007c10 con 0x7fd5900d1630 2024-09-16T01:18:27.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.966+0000 7fd57effd640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd57006c2b0 0x7fd57006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:27.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.966+0000 7fd57effd640 1 -- 172.21.15.81:0/2318281066 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd58408b540 con 0x7fd5900d1630 2024-09-16T01:18:27.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.966+0000 7fd58e59c640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd57006c2b0 0x7fd57006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:27.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.966+0000 7fd58e59c640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd57006c2b0 0x7fd57006e770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd5900b6f60 tx=0x7fd580008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:27.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:27.970+0000 7fd57effd640 1 -- 172.21.15.81:0/2318281066 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5900b5f80 con 0x7fd5900d1630 2024-09-16T01:18:28.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.172+0000 7fd594d31640 1 -- 172.21.15.81:0/2318281066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5900d10f0 con 0x7fd5900d1630 2024-09-16T01:18:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.172+0000 7fd57effd640 1 -- 172.21.15.81:0/2318281066 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5222 (secure 0 0 0) 0x7fd584015020 con 0x7fd5900d1630 2024-09-16T01:18:28.174 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:28.174 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"btime":"2024-09-16T01:18:27:841583+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4005145731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":4005145731},{"type":"v1","addr":"172.21.15.102:6835","nonce":4005145731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/40318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":40318124},{"type":"v1","addr":"172.21.15.81:6835","nonce":40318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/700844751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":700844751},{"type":"v1","addr":"172.21.15.81:6837","nonce":700844751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:24.925061+0000","modified":"2024-09-16T01:18:27.171098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6027},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6027":{"gid":6027,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/3012591174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3012591174},{"type":"v1","addr":"172.21.15.102:6834","nonce":3012591174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6027,"qdb_cluster":[6027]},"id":5}]} 2024-09-16T01:18:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-09-16T01:18:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.174+0000 7fd594d31640 1 -- 172.21.15.81:0/2318281066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd57006c2b0 msgr2=0x7fd57006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.174+0000 7fd594d31640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd57006c2b0 0x7fd57006e770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd5900b6f60 tx=0x7fd580008040 comp rx=0 tx=0).stop 2024-09-16T01:18:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.174+0000 7fd594d31640 1 -- 172.21.15.81:0/2318281066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5900d1630 msgr2=0x7fd590152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.174+0000 7fd594d31640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5900d1630 0x7fd590152af0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c820 tx=0x7fd58400cce0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.174+0000 7fd594d31640 1 -- 172.21.15.81:0/2318281066 shutdown_connections 2024-09-16T01:18:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.174+0000 7fd594d31640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd57006c2b0 0x7fd57006e770 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.174+0000 7fd594d31640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd59015e5d0 0x7fd59015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.174+0000 7fd594d31640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5900d1630 0x7fd590152af0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.174+0000 7fd594d31640 1 --2- 172.21.15.81:0/2318281066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd59006df60 0x7fd590161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.174+0000 7fd594d31640 1 -- 172.21.15.81:0/2318281066 >> 172.21.15.81:0/2318281066 conn(0x7fd5900d23a0 msgr2=0x7fd59015cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.175+0000 7fd594d31640 1 -- 172.21.15.81:0/2318281066 shutdown_connections 2024-09-16T01:18:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.175+0000 7fd594d31640 1 -- 172.21.15.81:0/2318281066 wait complete. 2024-09-16T01:18:28.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:18:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.286+0000 7f396565a640 1 Processor -- start 2024-09-16T01:18:28.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.286+0000 7f396565a640 1 -- start start 2024-09-16T01:18:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f396565a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3960161c80 0x7f396006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f396565a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3960162060 0x7f39600b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f396565a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f39600b64b0 0x7f39600b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f396565a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f396006e870 con 0x7f39600b64b0 2024-09-16T01:18:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f396565a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f396006d9f0 con 0x7f3960162060 2024-09-16T01:18:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f396565a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f396006dcd0 con 0x7f3960161c80 2024-09-16T01:18:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f395f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f39600b64b0 0x7f39600b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f395f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f39600b64b0 0x7f39600b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42892/0 (socket says 172.21.15.81:42892) 2024-09-16T01:18:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f395f7fe640 1 -- 172.21.15.81:0/1525804457 learned_addr learned my addr 172.21.15.81:0/1525804457 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f39567fc640 1 --2- 172.21.15.81:0/1525804457 >> v2:172.21.15.102:3300/0 conn(0x7f3960162060 0x7f39600b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f395f7fe640 1 -- 172.21.15.81:0/1525804457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3960161c80 msgr2=0x7f396006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f395effd640 1 --2- 172.21.15.81:0/1525804457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3960161c80 0x7f396006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f395f7fe640 1 --2- 172.21.15.81:0/1525804457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3960161c80 0x7f396006e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f395f7fe640 1 -- 172.21.15.81:0/1525804457 >> v2:172.21.15.102:3300/0 conn(0x7f3960162060 msgr2=0x7f39600b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f395f7fe640 1 --2- 172.21.15.81:0/1525804457 >> v2:172.21.15.102:3300/0 conn(0x7f3960162060 0x7f39600b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f395f7fe640 1 -- 172.21.15.81:0/1525804457 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396006dfb0 con 0x7f39600b64b0 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.287+0000 7f39567fc640 1 --2- 172.21.15.81:0/1525804457 >> v2:172.21.15.102:3300/0 conn(0x7f3960162060 0x7f39600b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.288+0000 7f395f7fe640 1 --2- 172.21.15.81:0/1525804457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39600b64b0 0x7f39600b6960 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f39600d0cb0 tx=0x7f395802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce268898cf0d2b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.288+0000 7f395e7fc640 1 -- 172.21.15.81:0/1525804457 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958036070 con 0x7f39600b64b0 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.288+0000 7f395e7fc640 1 -- 172.21.15.81:0/1525804457 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3958031600 con 0x7f39600b64b0 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.288+0000 7f395e7fc640 1 -- 172.21.15.81:0/1525804457 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39580319d0 con 0x7f39600b64b0 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.289+0000 7f396565a640 1 -- 172.21.15.81:0/1525804457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39600b64b0 msgr2=0x7f39600b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.289+0000 7f396565a640 1 --2- 172.21.15.81:0/1525804457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39600b64b0 0x7f39600b6960 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f39600d0cb0 tx=0x7f395802a6a0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.289+0000 7f396565a640 1 -- 172.21.15.81:0/1525804457 shutdown_connections 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.289+0000 7f396565a640 1 --2- 172.21.15.81:0/1525804457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39600b64b0 0x7f39600b6960 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.289+0000 7f396565a640 1 --2- 172.21.15.81:0/1525804457 >> v2:172.21.15.102:3300/0 conn(0x7f3960162060 0x7f39600b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.289+0000 7f396565a640 1 --2- 172.21.15.81:0/1525804457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3960161c80 0x7f396006e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.289+0000 7f396565a640 1 -- 172.21.15.81:0/1525804457 >> 172.21.15.81:0/1525804457 conn(0x7f39600d44f0 msgr2=0x7f39600d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:28.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.289+0000 7f396565a640 1 -- 172.21.15.81:0/1525804457 shutdown_connections 2024-09-16T01:18:28.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.289+0000 7f396565a640 1 -- 172.21.15.81:0/1525804457 wait complete. 2024-09-16T01:18:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.290+0000 7f396565a640 1 Processor -- start 2024-09-16T01:18:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.290+0000 7f396565a640 1 -- start start 2024-09-16T01:18:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f396565a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39600b64b0 0x7f3960155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f396565a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3960161c80 0x7f39600cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f396565a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3960162060 0x7f39600b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f396565a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3960162500 con 0x7f39600b64b0 2024-09-16T01:18:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f396565a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f39600d2aa0 con 0x7f3960161c80 2024-09-16T01:18:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f396565a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3960162680 con 0x7f3960162060 2024-09-16T01:18:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f395effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39600b64b0 0x7f3960155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f395effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39600b64b0 0x7f3960155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42908/0 (socket says 172.21.15.81:42908) 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f395effd640 1 -- 172.21.15.81:0/2300570801 learned_addr learned my addr 172.21.15.81:0/2300570801 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f39567fc640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3960161c80 0x7f39600cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f395f7fe640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3960162060 0x7f39600b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f395effd640 1 -- 172.21.15.81:0/2300570801 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3960162060 msgr2=0x7f39600b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f395effd640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3960162060 0x7f39600b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f395effd640 1 -- 172.21.15.81:0/2300570801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3960161c80 msgr2=0x7f39600cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f395effd640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3960161c80 0x7f39600cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f395effd640 1 -- 172.21.15.81:0/2300570801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39600cadf0 con 0x7f39600b64b0 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f39567fc640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3960161c80 0x7f39600cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.291+0000 7f395effd640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39600b64b0 0x7f3960155b30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f395000c820 tx=0x7f395000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.292+0000 7f3957fff640 1 -- 172.21.15.81:0/2300570801 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3950015070 con 0x7f39600b64b0 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.292+0000 7f3957fff640 1 -- 172.21.15.81:0/2300570801 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3950004220 con 0x7f39600b64b0 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.292+0000 7f396565a640 1 -- 172.21.15.81:0/2300570801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39600b85a0 con 0x7f39600b64b0 2024-09-16T01:18:28.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.292+0000 7f3957fff640 1 -- 172.21.15.81:0/2300570801 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395000ce10 con 0x7f39600b64b0 2024-09-16T01:18:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.292+0000 7f396565a640 1 -- 172.21.15.81:0/2300570801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39600cbb00 con 0x7f39600b64b0 2024-09-16T01:18:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.293+0000 7f396565a640 1 -- 172.21.15.81:0/2300570801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396006e330 con 0x7f39600b64b0 2024-09-16T01:18:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.293+0000 7f3957fff640 1 -- 172.21.15.81:0/2300570801 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3950007830 con 0x7f39600b64b0 2024-09-16T01:18:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.293+0000 7f3957fff640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f394006c2b0 0x7f394006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.293+0000 7f3957fff640 1 -- 172.21.15.81:0/2300570801 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f395008b4b0 con 0x7f39600b64b0 2024-09-16T01:18:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.294+0000 7f39567fc640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f394006c2b0 0x7f394006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.294+0000 7f39567fc640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f394006c2b0 0x7f394006e770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f39600b82e0 tx=0x7f3948008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.298+0000 7f3957fff640 1 -- 172.21.15.81:0/2300570801 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3950059a00 con 0x7f39600b64b0 2024-09-16T01:18:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.465+0000 7f396565a640 1 -- 172.21.15.81:0/2300570801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39600d22c0 con 0x7f39600b64b0 2024-09-16T01:18:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.466+0000 7f3957fff640 1 -- 172.21.15.81:0/2300570801 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17005 (secure 0 0 0) 0x7f3950088280 con 0x7f39600b64b0 2024-09-16T01:18:28.468 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:28.468 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:26.588265+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:18:23.278642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-16T01:18:23.895482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:18:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.468+0000 7f396565a640 1 -- 172.21.15.81:0/2300570801 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f394006c2b0 msgr2=0x7f394006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.468+0000 7f396565a640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f394006c2b0 0x7f394006e770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f39600b82e0 tx=0x7f3948008040 comp rx=0 tx=0).stop 2024-09-16T01:18:28.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.468+0000 7f396565a640 1 -- 172.21.15.81:0/2300570801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39600b64b0 msgr2=0x7f3960155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.468+0000 7f396565a640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39600b64b0 0x7f3960155b30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f395000c820 tx=0x7f395000cce0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.468+0000 7f396565a640 1 -- 172.21.15.81:0/2300570801 shutdown_connections 2024-09-16T01:18:28.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.468+0000 7f396565a640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f394006c2b0 0x7f394006e770 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.468+0000 7f396565a640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3960162060 0x7f39600b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.468+0000 7f396565a640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3960161c80 0x7f39600cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.468+0000 7f396565a640 1 --2- 172.21.15.81:0/2300570801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39600b64b0 0x7f3960155b30 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.468+0000 7f396565a640 1 -- 172.21.15.81:0/2300570801 >> 172.21.15.81:0/2300570801 conn(0x7f39600d44f0 msgr2=0x7f396006ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:28.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.468+0000 7f396565a640 1 -- 172.21.15.81:0/2300570801 shutdown_connections 2024-09-16T01:18:28.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.469+0000 7f396565a640 1 -- 172.21.15.81:0/2300570801 wait complete. 2024-09-16T01:18:28.482 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:18:28.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:18:28.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.578+0000 7fadfc0dd640 1 Processor -- start 2024-09-16T01:18:28.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.578+0000 7fadfc0dd640 1 -- start start 2024-09-16T01:18:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.579+0000 7fadfc0dd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fadf415e5f0 0x7fadf40d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.579+0000 7fadfc0dd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fadf40b6690 0x7fadf406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.579+0000 7fadfc0dd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf40d3690 con 0x7fadf40d30f0 2024-09-16T01:18:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.579+0000 7fadfc0dd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fadf406d530 con 0x7fadf415e5f0 2024-09-16T01:18:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.579+0000 7fadfc0dd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fadf40d3970 con 0x7fadf40b6690 2024-09-16T01:18:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.579+0000 7fadf9e79640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fadf415e5f0 0x7fadf40d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.579+0000 7fadf9678640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fadf40d30f0 0x7fadf40b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54488/0 (socket says 172.21.15.81:54488) 2024-09-16T01:18:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.579+0000 7fadf9e79640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fadf415e5f0 0x7fadf40d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42912/0 (socket says 172.21.15.81:42912) 2024-09-16T01:18:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.579+0000 7fadf9678640 1 -- 172.21.15.81:0/2492071717 learned_addr learned my addr 172.21.15.81:0/2492071717 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.580+0000 7fadfa67a640 1 --2- 172.21.15.81:0/2492071717 >> v2:172.21.15.102:3300/0 conn(0x7fadf40b6690 0x7fadf406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.580+0000 7fadf9e79640 1 -- 172.21.15.81:0/2492071717 >> v2:172.21.15.102:3300/0 conn(0x7fadf40b6690 msgr2=0x7fadf406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.580+0000 7fadf9e79640 1 --2- 172.21.15.81:0/2492071717 >> v2:172.21.15.102:3300/0 conn(0x7fadf40b6690 0x7fadf406d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.580+0000 7fadf9e79640 1 -- 172.21.15.81:0/2492071717 >> v1:172.21.15.81:6789/0 conn(0x7fadf40d30f0 legacy=0x7fadf40b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.580+0000 7fadf9e79640 1 -- 172.21.15.81:0/2492071717 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf406cee0 con 0x7fadf415e5f0 2024-09-16T01:18:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.580+0000 7fadf9e79640 1 --2- 172.21.15.81:0/2492071717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf415e5f0 0x7fadf40d4dd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fadf00097a0 tx=0x7fadf002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2bee2b09959840 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.580+0000 7fadf8e77640 1 -- 172.21.15.81:0/2492071717 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0037070 con 0x7fadf415e5f0 2024-09-16T01:18:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.581+0000 7fadf8e77640 1 -- 172.21.15.81:0/2492071717 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf0032440 con 0x7fadf415e5f0 2024-09-16T01:18:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.581+0000 7fadf8e77640 1 -- 172.21.15.81:0/2492071717 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0032810 con 0x7fadf415e5f0 2024-09-16T01:18:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.581+0000 7fadfc0dd640 1 -- 172.21.15.81:0/2492071717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf415e5f0 msgr2=0x7fadf40d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.581+0000 7fadfc0dd640 1 --2- 172.21.15.81:0/2492071717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf415e5f0 0x7fadf40d4dd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fadf00097a0 tx=0x7fadf002a1e0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.581+0000 7fadfc0dd640 1 -- 172.21.15.81:0/2492071717 shutdown_connections 2024-09-16T01:18:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.581+0000 7fadfc0dd640 1 --2- 172.21.15.81:0/2492071717 >> v2:172.21.15.102:3300/0 conn(0x7fadf40b6690 0x7fadf406d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.581+0000 7fadfc0dd640 1 --2- 172.21.15.81:0/2492071717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf415e5f0 0x7fadf40d4dd0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.581+0000 7fadfc0dd640 1 -- 172.21.15.81:0/2492071717 >> 172.21.15.81:0/2492071717 conn(0x7fadf408bfc0 msgr2=0x7fadf40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:28.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.581+0000 7fadfc0dd640 1 -- 172.21.15.81:0/2492071717 shutdown_connections 2024-09-16T01:18:28.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.581+0000 7fadfc0dd640 1 -- 172.21.15.81:0/2492071717 wait complete. 2024-09-16T01:18:28.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.582+0000 7fadfc0dd640 1 Processor -- start 2024-09-16T01:18:28.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.582+0000 7fadfc0dd640 1 -- start start 2024-09-16T01:18:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadfc0dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf40b6690 0x7fadf4157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadfc0dd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf40d30f0 0x7fadf40b7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadfc0dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fadf415e5f0 0x7fadf40c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadfc0dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fadf40d5310 con 0x7fadf40b6690 2024-09-16T01:18:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadfc0dd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fadf415e9d0 con 0x7fadf40d30f0 2024-09-16T01:18:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadfc0dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fadf406df00 con 0x7fadf415e5f0 2024-09-16T01:18:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadf9e79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf40b6690 0x7fadf4157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadf9e79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf40b6690 0x7fadf4157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42924/0 (socket says 172.21.15.81:42924) 2024-09-16T01:18:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadf9e79640 1 -- 172.21.15.81:0/741431876 learned_addr learned my addr 172.21.15.81:0/741431876 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadf9678640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf40d30f0 0x7fadf40b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadfa67a640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fadf415e5f0 0x7fadf40c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadf9e79640 1 -- 172.21.15.81:0/741431876 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fadf415e5f0 msgr2=0x7fadf40c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadf9e79640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fadf415e5f0 0x7fadf40c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadf9e79640 1 -- 172.21.15.81:0/741431876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf40d30f0 msgr2=0x7fadf40b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadf9e79640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf40d30f0 0x7fadf40b7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.583+0000 7fadf9e79640 1 -- 172.21.15.81:0/741431876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf40c8030 con 0x7fadf40b6690 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.584+0000 7fadf9e79640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf40b6690 0x7fadf4157f20 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fadf00098c0 tx=0x7fadf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.584+0000 7fadea7fc640 1 -- 172.21.15.81:0/741431876 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0037040 con 0x7fadf40b6690 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.584+0000 7fadea7fc640 1 -- 172.21.15.81:0/741431876 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf0030770 con 0x7fadf40b6690 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.584+0000 7fadea7fc640 1 -- 172.21.15.81:0/741431876 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0030b40 con 0x7fadf40b6690 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.584+0000 7fadfc0dd640 1 -- 172.21.15.81:0/741431876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf40c8310 con 0x7fadf40b6690 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.584+0000 7fadfc0dd640 1 -- 172.21.15.81:0/741431876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf40c88d0 con 0x7fadf40b6690 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.585+0000 7fadfc0dd640 1 -- 172.21.15.81:0/741431876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf406d9c0 con 0x7fadf40b6690 2024-09-16T01:18:28.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.585+0000 7fadea7fc640 1 -- 172.21.15.81:0/741431876 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fadf0044020 con 0x7fadf40b6690 2024-09-16T01:18:28.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.586+0000 7fadea7fc640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fadd806c2e0 0x7fadd806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.586+0000 7fadea7fc640 1 -- 172.21.15.81:0/741431876 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fadf00aba80 con 0x7fadf40b6690 2024-09-16T01:18:28.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.586+0000 7fadf9678640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fadd806c2e0 0x7fadd806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.586+0000 7fadf9678640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fadd806c2e0 0x7fadd806e7a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fadf41f88a0 tx=0x7fade4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:28.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.590+0000 7fadea7fc640 1 -- 172.21.15.81:0/741431876 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fadf0032e20 con 0x7fadf40b6690 2024-09-16T01:18:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.752+0000 7fadfc0dd640 1 -- 172.21.15.81:0/741431876 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fadf415d7c0 con 0x7fadd806c2e0 2024-09-16T01:18:28.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.757+0000 7fadea7fc640 1 -- 172.21.15.81:0/741431876 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241096 (secure 0 0 0) 0x7fadf415d7c0 con 0x7fadd806c2e0 2024-09-16T01:18:28.761 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:28.762 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:18:28.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.760+0000 7fadfc0dd640 1 -- 172.21.15.81:0/741431876 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fadd806c2e0 msgr2=0x7fadd806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.760+0000 7fadfc0dd640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fadd806c2e0 0x7fadd806e7a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fadf41f88a0 tx=0x7fade4009040 comp rx=0 tx=0).stop 2024-09-16T01:18:28.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.761+0000 7fadfc0dd640 1 -- 172.21.15.81:0/741431876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf40b6690 msgr2=0x7fadf4157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.761+0000 7fadfc0dd640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf40b6690 0x7fadf4157f20 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fadf00098c0 tx=0x7fadf00046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.761+0000 7fadfc0dd640 1 -- 172.21.15.81:0/741431876 shutdown_connections 2024-09-16T01:18:28.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.761+0000 7fadfc0dd640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fadd806c2e0 0x7fadd806e7a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.761+0000 7fadfc0dd640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fadf415e5f0 0x7fadf40c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.761+0000 7fadfc0dd640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf40d30f0 0x7fadf40b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.761+0000 7fadfc0dd640 1 --2- 172.21.15.81:0/741431876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadf40b6690 0x7fadf4157f20 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.761+0000 7fadfc0dd640 1 -- 172.21.15.81:0/741431876 >> 172.21.15.81:0/741431876 conn(0x7fadf408bfc0 msgr2=0x7fadf40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:28.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.761+0000 7fadfc0dd640 1 -- 172.21.15.81:0/741431876 shutdown_connections 2024-09-16T01:18:28.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.761+0000 7fadfc0dd640 1 -- 172.21.15.81:0/741431876 wait complete. 2024-09-16T01:18:28.773 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-16T01:18:28.094195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":52,"acting":52,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":236788,"kb_used_data":8024,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754737932,"statfs":{"total":773094113280,"available":772851642368,"internally_reserved":0,"allocated":8216576,"data_stored":4334512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.519882"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974453+0000","last_change":"2024-09-16T01:18:25.608017+0000","last_active":"2024-09-16T01:18:26.974453+0000","last_peered":"2024-09-16T01:18:26.974453+0000","last_clean":"2024-09-16T01:18:26.974453+0000","last_became_active":"2024-09-16T01:18:25.607710+0000","last_became_peered":"2024-09-16T01:18:25.607710+0000","last_unstale":"2024-09-16T01:18:26.974453+0000","last_undegraded":"2024-09-16T01:18:26.974453+0000","last_fullsized":"2024-09-16T01:18:26.974453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:20.143941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974611+0000","last_change":"2024-09-16T01:18:25.612158+0000","last_active":"2024-09-16T01:18:26.974611+0000","last_peered":"2024-09-16T01:18:26.974611+0000","last_clean":"2024-09-16T01:18:26.974611+0000","last_became_active":"2024-09-16T01:18:25.609379+0000","last_became_peered":"2024-09-16T01:18:25.609379+0000","last_unstale":"2024-09-16T01:18:26.974611+0000","last_undegraded":"2024-09-16T01:18:26.974611+0000","last_fullsized":"2024-09-16T01:18:26.974611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:08.660319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974186+0000","last_change":"2024-09-16T01:18:25.608998+0000","last_active":"2024-09-16T01:18:26.974186+0000","last_peered":"2024-09-16T01:18:26.974186+0000","last_clean":"2024-09-16T01:18:26.974186+0000","last_became_active":"2024-09-16T01:18:25.608751+0000","last_became_peered":"2024-09-16T01:18:25.608751+0000","last_unstale":"2024-09-16T01:18:26.974186+0000","last_undegraded":"2024-09-16T01:18:26.974186+0000","last_fullsized":"2024-09-16T01:18:26.974186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:54.295314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974815+0000","last_change":"2024-09-16T01:18:25.606723+0000","last_active":"2024-09-16T01:18:26.974815+0000","last_peered":"2024-09-16T01:18:26.974815+0000","last_clean":"2024-09-16T01:18:26.974815+0000","last_became_active":"2024-09-16T01:18:25.606440+0000","last_became_peered":"2024-09-16T01:18:25.606440+0000","last_unstale":"2024-09-16T01:18:26.974815+0000","last_undegraded":"2024-09-16T01:18:26.974815+0000","last_fullsized":"2024-09-16T01:18:26.974815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:17.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974072+0000","last_change":"2024-09-16T01:18:25.603289+0000","last_active":"2024-09-16T01:18:26.974072+0000","last_peered":"2024-09-16T01:18:26.974072+0000","last_clean":"2024-09-16T01:18:26.974072+0000","last_became_active":"2024-09-16T01:18:25.603016+0000","last_became_peered":"2024-09-16T01:18:25.603016+0000","last_unstale":"2024-09-16T01:18:26.974072+0000","last_undegraded":"2024-09-16T01:18:26.974072+0000","last_fullsized":"2024-09-16T01:18:26.974072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:20.635284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974489+0000","last_change":"2024-09-16T01:18:25.602001+0000","last_active":"2024-09-16T01:18:26.974489+0000","last_peered":"2024-09-16T01:18:26.974489+0000","last_clean":"2024-09-16T01:18:26.974489+0000","last_became_active":"2024-09-16T01:18:25.600073+0000","last_became_peered":"2024-09-16T01:18:25.600073+0000","last_unstale":"2024-09-16T01:18:26.974489+0000","last_undegraded":"2024-09-16T01:18:26.974489+0000","last_fullsized":"2024-09-16T01:18:26.974489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:33.088152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973961+0000","last_change":"2024-09-16T01:18:25.605434+0000","last_active":"2024-09-16T01:18:26.973961+0000","last_peered":"2024-09-16T01:18:26.973961+0000","last_clean":"2024-09-16T01:18:26.973961+0000","last_became_active":"2024-09-16T01:18:25.605160+0000","last_became_peered":"2024-09-16T01:18:25.605160+0000","last_unstale":"2024-09-16T01:18:26.973961+0000","last_undegraded":"2024-09-16T01:18:26.973961+0000","last_fullsized":"2024-09-16T01:18:26.973961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:13.433784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974044+0000","last_change":"2024-09-16T01:18:25.606154+0000","last_active":"2024-09-16T01:18:26.974044+0000","last_peered":"2024-09-16T01:18:26.974044+0000","last_clean":"2024-09-16T01:18:26.974044+0000","last_became_active":"2024-09-16T01:18:25.605912+0000","last_became_peered":"2024-09-16T01:18:25.605912+0000","last_unstale":"2024-09-16T01:18:26.974044+0000","last_undegraded":"2024-09-16T01:18:26.974044+0000","last_fullsized":"2024-09-16T01:18:26.974044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:50.328132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973629+0000","last_change":"2024-09-16T01:18:25.597227+0000","last_active":"2024-09-16T01:18:26.973629+0000","last_peered":"2024-09-16T01:18:26.973629+0000","last_clean":"2024-09-16T01:18:26.973629+0000","last_became_active":"2024-09-16T01:18:25.596964+0000","last_became_peered":"2024-09-16T01:18:25.596964+0000","last_unstale":"2024-09-16T01:18:26.973629+0000","last_undegraded":"2024-09-16T01:18:26.973629+0000","last_fullsized":"2024-09-16T01:18:26.973629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:43.762133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974140+0000","last_change":"2024-09-16T01:18:25.599804+0000","last_active":"2024-09-16T01:18:26.974140+0000","last_peered":"2024-09-16T01:18:26.974140+0000","last_clean":"2024-09-16T01:18:26.974140+0000","last_became_active":"2024-09-16T01:18:25.599536+0000","last_became_peered":"2024-09-16T01:18:25.599536+0000","last_unstale":"2024-09-16T01:18:26.974140+0000","last_undegraded":"2024-09-16T01:18:26.974140+0000","last_fullsized":"2024-09-16T01:18:26.974140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:44.178474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974965+0000","last_change":"2024-09-16T01:18:25.600340+0000","last_active":"2024-09-16T01:18:26.974965+0000","last_peered":"2024-09-16T01:18:26.974965+0000","last_clean":"2024-09-16T01:18:26.974965+0000","last_became_active":"2024-09-16T01:18:25.600069+0000","last_became_peered":"2024-09-16T01:18:25.600069+0000","last_unstale":"2024-09-16T01:18:26.974965+0000","last_undegraded":"2024-09-16T01:18:26.974965+0000","last_fullsized":"2024-09-16T01:18:26.974965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:10.289186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974194+0000","last_change":"2024-09-16T01:18:25.608265+0000","last_active":"2024-09-16T01:18:26.974194+0000","last_peered":"2024-09-16T01:18:26.974194+0000","last_clean":"2024-09-16T01:18:26.974194+0000","last_became_active":"2024-09-16T01:18:25.607995+0000","last_became_peered":"2024-09-16T01:18:25.607995+0000","last_unstale":"2024-09-16T01:18:26.974194+0000","last_undegraded":"2024-09-16T01:18:26.974194+0000","last_fullsized":"2024-09-16T01:18:26.974194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:52.933445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974319+0000","last_change":"2024-09-16T01:18:25.608398+0000","last_active":"2024-09-16T01:18:26.974319+0000","last_peered":"2024-09-16T01:18:26.974319+0000","last_clean":"2024-09-16T01:18:26.974319+0000","last_became_active":"2024-09-16T01:18:25.608140+0000","last_became_peered":"2024-09-16T01:18:25.608140+0000","last_unstale":"2024-09-16T01:18:26.974319+0000","last_undegraded":"2024-09-16T01:18:26.974319+0000","last_fullsized":"2024-09-16T01:18:26.974319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:13.483572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975069+0000","last_change":"2024-09-16T01:18:24.592977+0000","last_active":"2024-09-16T01:18:26.975069+0000","last_peered":"2024-09-16T01:18:26.975069+0000","last_clean":"2024-09-16T01:18:26.975069+0000","last_became_active":"2024-09-16T01:18:24.592516+0000","last_became_peered":"2024-09-16T01:18:24.592516+0000","last_unstale":"2024-09-16T01:18:26.975069+0000","last_undegraded":"2024-09-16T01:18:26.975069+0000","last_fullsized":"2024-09-16T01:18:26.975069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:42.846668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974490+0000","last_change":"2024-09-16T01:18:25.598938+0000","last_active":"2024-09-16T01:18:26.974490+0000","last_peered":"2024-09-16T01:18:26.974490+0000","last_clean":"2024-09-16T01:18:26.974490+0000","last_became_active":"2024-09-16T01:18:25.598668+0000","last_became_peered":"2024-09-16T01:18:25.598668+0000","last_unstale":"2024-09-16T01:18:26.974490+0000","last_undegraded":"2024-09-16T01:18:26.974490+0000","last_fullsized":"2024-09-16T01:18:26.974490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:19.615579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973711+0000","last_change":"2024-09-16T01:18:25.612150+0000","last_active":"2024-09-16T01:18:26.973711+0000","last_peered":"2024-09-16T01:18:26.973711+0000","last_clean":"2024-09-16T01:18:26.973711+0000","last_became_active":"2024-09-16T01:18:25.611609+0000","last_became_peered":"2024-09-16T01:18:25.611609+0000","last_unstale":"2024-09-16T01:18:26.973711+0000","last_undegraded":"2024-09-16T01:18:26.973711+0000","last_fullsized":"2024-09-16T01:18:26.973711+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:46.870356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974583+0000","last_change":"2024-09-16T01:18:24.586756+0000","last_active":"2024-09-16T01:18:26.974583+0000","last_peered":"2024-09-16T01:18:26.974583+0000","last_clean":"2024-09-16T01:18:26.974583+0000","last_became_active":"2024-09-16T01:18:24.586480+0000","last_became_peered":"2024-09-16T01:18:24.586480+0000","last_unstale":"2024-09-16T01:18:26.974583+0000","last_undegraded":"2024-09-16T01:18:26.974583+0000","last_fullsized":"2024-09-16T01:18:26.974583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:20.364637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973808+0000","last_change":"2024-09-16T01:18:24.601156+0000","last_active":"2024-09-16T01:18:26.973808+0000","last_peered":"2024-09-16T01:18:26.973808+0000","last_clean":"2024-09-16T01:18:26.973808+0000","last_became_active":"2024-09-16T01:18:24.600860+0000","last_became_peered":"2024-09-16T01:18:24.600860+0000","last_unstale":"2024-09-16T01:18:26.973808+0000","last_undegraded":"2024-09-16T01:18:26.973808+0000","last_fullsized":"2024-09-16T01:18:26.973808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:46.004709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974324+0000","last_change":"2024-09-16T01:18:25.601946+0000","last_active":"2024-09-16T01:18:26.974324+0000","last_peered":"2024-09-16T01:18:26.974324+0000","last_clean":"2024-09-16T01:18:26.974324+0000","last_became_active":"2024-09-16T01:18:25.601693+0000","last_became_peered":"2024-09-16T01:18:25.601693+0000","last_unstale":"2024-09-16T01:18:26.974324+0000","last_undegraded":"2024-09-16T01:18:26.974324+0000","last_fullsized":"2024-09-16T01:18:26.974324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:15.229927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974599+0000","last_change":"2024-09-16T01:18:25.604022+0000","last_active":"2024-09-16T01:18:26.974599+0000","last_peered":"2024-09-16T01:18:26.974599+0000","last_clean":"2024-09-16T01:18:26.974599+0000","last_became_active":"2024-09-16T01:18:25.603759+0000","last_became_peered":"2024-09-16T01:18:25.603759+0000","last_unstale":"2024-09-16T01:18:26.974599+0000","last_undegraded":"2024-09-16T01:18:26.974599+0000","last_fullsized":"2024-09-16T01:18:26.974599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:26.763892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974652+0000","last_change":"2024-09-16T01:18:24.603407+0000","last_active":"2024-09-16T01:18:26.974652+0000","last_peered":"2024-09-16T01:18:26.974652+0000","last_clean":"2024-09-16T01:18:26.974652+0000","last_became_active":"2024-09-16T01:18:24.603125+0000","last_became_peered":"2024-09-16T01:18:24.603125+0000","last_unstale":"2024-09-16T01:18:26.974652+0000","last_undegraded":"2024-09-16T01:18:26.974652+0000","last_fullsized":"2024-09-16T01:18:26.974652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:27.252288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974213+0000","last_change":"2024-09-16T01:18:25.599150+0000","last_active":"2024-09-16T01:18:26.974213+0000","last_peered":"2024-09-16T01:18:26.974213+0000","last_clean":"2024-09-16T01:18:26.974213+0000","last_became_active":"2024-09-16T01:18:25.598275+0000","last_became_peered":"2024-09-16T01:18:25.598275+0000","last_unstale":"2024-09-16T01:18:26.974213+0000","last_undegraded":"2024-09-16T01:18:26.974213+0000","last_fullsized":"2024-09-16T01:18:26.974213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:24.082531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974213+0000","last_change":"2024-09-16T01:18:25.612050+0000","last_active":"2024-09-16T01:18:26.974213+0000","last_peered":"2024-09-16T01:18:26.974213+0000","last_clean":"2024-09-16T01:18:26.974213+0000","last_became_active":"2024-09-16T01:18:25.611734+0000","last_became_peered":"2024-09-16T01:18:25.611734+0000","last_unstale":"2024-09-16T01:18:26.974213+0000","last_undegraded":"2024-09-16T01:18:26.974213+0000","last_fullsized":"2024-09-16T01:18:26.974213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:28.959546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974422+0000","last_change":"2024-09-16T01:18:25.600774+0000","last_active":"2024-09-16T01:18:26.974422+0000","last_peered":"2024-09-16T01:18:26.974422+0000","last_clean":"2024-09-16T01:18:26.974422+0000","last_became_active":"2024-09-16T01:18:25.600496+0000","last_became_peered":"2024-09-16T01:18:25.600496+0000","last_unstale":"2024-09-16T01:18:26.974422+0000","last_undegraded":"2024-09-16T01:18:26.974422+0000","last_fullsized":"2024-09-16T01:18:26.974422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:31.193825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974235+0000","last_change":"2024-09-16T01:18:24.596421+0000","last_active":"2024-09-16T01:18:26.974235+0000","last_peered":"2024-09-16T01:18:26.974235+0000","last_clean":"2024-09-16T01:18:26.974235+0000","last_became_active":"2024-09-16T01:18:24.596188+0000","last_became_peered":"2024-09-16T01:18:24.596188+0000","last_unstale":"2024-09-16T01:18:26.974235+0000","last_undegraded":"2024-09-16T01:18:26.974235+0000","last_fullsized":"2024-09-16T01:18:26.974235+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:41.064986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":263,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T01:18:22.665385+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:18:22.665385+0000","last_peered":"2024-09-16T01:18:22.665385+0000","last_clean":"2024-09-16T01:18:22.665385+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:18:22.665385+0000","last_undegraded":"2024-09-16T01:18:22.665385+0000","last_fullsized":"2024-09-16T01:18:22.665385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":10,"acting":10,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1449984,"data_stored":973753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27892,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":868352,"data_stored":388904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27892,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":868352,"data_stored":388904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27884,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":868352,"data_stored":388904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32032,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":856064,"data_stored":383385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27884,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":868352,"data_stored":388904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":925696,"data_stored":415751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1511424,"data_stored":1006007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:18:28.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:18:28.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.910+0000 7f89368e6640 1 Processor -- start 2024-09-16T01:18:28.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.910+0000 7f89368e6640 1 -- start start 2024-09-16T01:18:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.911+0000 7f89368e6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8930161c80 0x7f893006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.911+0000 7f89368e6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8930162060 0x7f89300b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.911+0000 7f89368e6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f893006e870 con 0x7f89300b64b0 2024-09-16T01:18:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.911+0000 7f89368e6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f893006d9f0 con 0x7f8930162060 2024-09-16T01:18:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.911+0000 7f89368e6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f893006dcd0 con 0x7f8930161c80 2024-09-16T01:18:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.911+0000 7f892f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8930162060 0x7f89300b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.911+0000 7f892f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8930162060 0x7f89300b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42938/0 (socket says 172.21.15.81:42938) 2024-09-16T01:18:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.911+0000 7f892f7fe640 1 -- 172.21.15.81:0/2212641547 learned_addr learned my addr 172.21.15.81:0/2212641547 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.911+0000 7f892ffff640 1 --2- 172.21.15.81:0/2212641547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8930161c80 0x7f893006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.911+0000 7f892f7fe640 1 -- 172.21.15.81:0/2212641547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8930161c80 msgr2=0x7f893006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.911+0000 7f892f7fe640 1 --2- 172.21.15.81:0/2212641547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8930161c80 0x7f893006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.912+0000 7f892f7fe640 1 -- 172.21.15.81:0/2212641547 >> v1:172.21.15.102:6789/0 conn(0x7f89300b64b0 legacy=0x7f8930162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.912+0000 7f892f7fe640 1 -- 172.21.15.81:0/2212641547 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893006dfb0 con 0x7f8930162060 2024-09-16T01:18:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.912+0000 7f892f7fe640 1 --2- 172.21.15.81:0/2212641547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930162060 0x7f89300b5f70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8924009870 tx=0x7f892402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379a73e49bf429e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.912+0000 7f892effd640 1 -- 172.21.15.81:0/2212641547 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924037070 con 0x7f8930162060 2024-09-16T01:18:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.912+0000 7f892effd640 1 -- 172.21.15.81:0/2212641547 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8924032440 con 0x7f8930162060 2024-09-16T01:18:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.912+0000 7f892effd640 1 -- 172.21.15.81:0/2212641547 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924032810 con 0x7f8930162060 2024-09-16T01:18:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.913+0000 7f89368e6640 1 -- 172.21.15.81:0/2212641547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930162060 msgr2=0x7f89300b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.913+0000 7f89368e6640 1 --2- 172.21.15.81:0/2212641547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930162060 0x7f89300b5f70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8924009870 tx=0x7f892402a270 comp rx=0 tx=0).stop 2024-09-16T01:18:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.913+0000 7f89368e6640 1 -- 172.21.15.81:0/2212641547 shutdown_connections 2024-09-16T01:18:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.913+0000 7f89368e6640 1 --2- 172.21.15.81:0/2212641547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8930162060 0x7f89300b5f70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.913+0000 7f89368e6640 1 --2- 172.21.15.81:0/2212641547 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8930161c80 0x7f893006e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.913+0000 7f89368e6640 1 -- 172.21.15.81:0/2212641547 >> 172.21.15.81:0/2212641547 conn(0x7f89300d44f0 msgr2=0x7f89300d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.913+0000 7f89368e6640 1 -- 172.21.15.81:0/2212641547 shutdown_connections 2024-09-16T01:18:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.913+0000 7f89368e6640 1 -- 172.21.15.81:0/2212641547 wait complete. 2024-09-16T01:18:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.914+0000 7f89368e6640 1 Processor -- start 2024-09-16T01:18:28.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.914+0000 7f89368e6640 1 -- start start 2024-09-16T01:18:28.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f89368e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89300b64b0 0x7f8930155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f89368e6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8930161c80 0x7f89300cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f89368e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8930162060 0x7f89300b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f89368e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89300d2a10 con 0x7f89300b64b0 2024-09-16T01:18:28.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f89368e6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f89300d2890 con 0x7f8930162060 2024-09-16T01:18:28.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f89368e6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f89300b6960 con 0x7f8930161c80 2024-09-16T01:18:28.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f892ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89300b64b0 0x7f8930155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f892ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89300b64b0 0x7f8930155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42954/0 (socket says 172.21.15.81:42954) 2024-09-16T01:18:28.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f892ffff640 1 -- 172.21.15.81:0/2978709766 learned_addr learned my addr 172.21.15.81:0/2978709766 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:28.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f892f7fe640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8930161c80 0x7f89300cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f8934e83640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8930162060 0x7f89300b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f892ffff640 1 -- 172.21.15.81:0/2978709766 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8930161c80 msgr2=0x7f89300cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f892ffff640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8930161c80 0x7f89300cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f892ffff640 1 -- 172.21.15.81:0/2978709766 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8930162060 msgr2=0x7f89300b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f892ffff640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8930162060 0x7f89300b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.915+0000 7f892ffff640 1 -- 172.21.15.81:0/2978709766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89300ccd30 con 0x7f89300b64b0 2024-09-16T01:18:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.916+0000 7f892ffff640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89300b64b0 0x7f8930155e80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f892000d800 tx=0x7f892000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.916+0000 7f892cff9640 1 -- 172.21.15.81:0/2978709766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892000b6c0 con 0x7f89300b64b0 2024-09-16T01:18:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.916+0000 7f892cff9640 1 -- 172.21.15.81:0/2978709766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8920019070 con 0x7f89300b64b0 2024-09-16T01:18:28.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.916+0000 7f89368e6640 1 -- 172.21.15.81:0/2978709766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89300cd010 con 0x7f89300b64b0 2024-09-16T01:18:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.916+0000 7f892cff9640 1 -- 172.21.15.81:0/2978709766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892000ba80 con 0x7f89300b64b0 2024-09-16T01:18:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.916+0000 7f89368e6640 1 -- 172.21.15.81:0/2978709766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89300cd5d0 con 0x7f89300b64b0 2024-09-16T01:18:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.917+0000 7f89368e6640 1 -- 172.21.15.81:0/2978709766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f893006e330 con 0x7f89300b64b0 2024-09-16T01:18:28.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.917+0000 7f892cff9640 1 -- 172.21.15.81:0/2978709766 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f892000bc20 con 0x7f89300b64b0 2024-09-16T01:18:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.917+0000 7f892cff9640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f891c06c2b0 0x7f891c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.918+0000 7f892cff9640 1 -- 172.21.15.81:0/2978709766 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f892008ba90 con 0x7f89300b64b0 2024-09-16T01:18:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.918+0000 7f892f7fe640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f891c06c2b0 0x7f891c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:28.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.918+0000 7f892f7fe640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f891c06c2b0 0x7f891c06e770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8924034000 tx=0x7f892402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:28.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:28.922+0000 7f892cff9640 1 -- 172.21.15.81:0/2978709766 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f892001c360 con 0x7f89300b64b0 2024-09-16T01:18:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.086+0000 7f89368e6640 1 -- 172.21.15.81:0/2978709766 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89300ba470 con 0x7f891c06c2b0 2024-09-16T01:18:29.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.092+0000 7f892cff9640 1 -- 172.21.15.81:0/2978709766 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241096 (secure 0 0 0) 0x7f89300ba470 con 0x7f891c06c2b0 2024-09-16T01:18:29.096 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:29.097 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:18:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.095+0000 7f89368e6640 1 -- 172.21.15.81:0/2978709766 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f891c06c2b0 msgr2=0x7f891c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.095+0000 7f89368e6640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f891c06c2b0 0x7f891c06e770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8924034000 tx=0x7f892402e000 comp rx=0 tx=0).stop 2024-09-16T01:18:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.096+0000 7f89368e6640 1 -- 172.21.15.81:0/2978709766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89300b64b0 msgr2=0x7f8930155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.096+0000 7f89368e6640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89300b64b0 0x7f8930155e80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f892000d800 tx=0x7f892000dcc0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.096+0000 7f89368e6640 1 -- 172.21.15.81:0/2978709766 shutdown_connections 2024-09-16T01:18:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.096+0000 7f89368e6640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f891c06c2b0 0x7f891c06e770 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.096+0000 7f89368e6640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8930162060 0x7f89300b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.096+0000 7f89368e6640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8930161c80 0x7f89300cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.096+0000 7f89368e6640 1 --2- 172.21.15.81:0/2978709766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89300b64b0 0x7f8930155e80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.096+0000 7f89368e6640 1 -- 172.21.15.81:0/2978709766 >> 172.21.15.81:0/2978709766 conn(0x7f89300d44f0 msgr2=0x7f893006ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.096+0000 7f89368e6640 1 -- 172.21.15.81:0/2978709766 shutdown_connections 2024-09-16T01:18:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.096+0000 7f89368e6640 1 -- 172.21.15.81:0/2978709766 wait complete. 2024-09-16T01:18:29.108 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-16T01:18:28.094195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":52,"acting":52,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":236788,"kb_used_data":8024,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754737932,"statfs":{"total":773094113280,"available":772851642368,"internally_reserved":0,"allocated":8216576,"data_stored":4334512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.519882"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974453+0000","last_change":"2024-09-16T01:18:25.608017+0000","last_active":"2024-09-16T01:18:26.974453+0000","last_peered":"2024-09-16T01:18:26.974453+0000","last_clean":"2024-09-16T01:18:26.974453+0000","last_became_active":"2024-09-16T01:18:25.607710+0000","last_became_peered":"2024-09-16T01:18:25.607710+0000","last_unstale":"2024-09-16T01:18:26.974453+0000","last_undegraded":"2024-09-16T01:18:26.974453+0000","last_fullsized":"2024-09-16T01:18:26.974453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:20.143941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974611+0000","last_change":"2024-09-16T01:18:25.612158+0000","last_active":"2024-09-16T01:18:26.974611+0000","last_peered":"2024-09-16T01:18:26.974611+0000","last_clean":"2024-09-16T01:18:26.974611+0000","last_became_active":"2024-09-16T01:18:25.609379+0000","last_became_peered":"2024-09-16T01:18:25.609379+0000","last_unstale":"2024-09-16T01:18:26.974611+0000","last_undegraded":"2024-09-16T01:18:26.974611+0000","last_fullsized":"2024-09-16T01:18:26.974611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:08.660319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974186+0000","last_change":"2024-09-16T01:18:25.608998+0000","last_active":"2024-09-16T01:18:26.974186+0000","last_peered":"2024-09-16T01:18:26.974186+0000","last_clean":"2024-09-16T01:18:26.974186+0000","last_became_active":"2024-09-16T01:18:25.608751+0000","last_became_peered":"2024-09-16T01:18:25.608751+0000","last_unstale":"2024-09-16T01:18:26.974186+0000","last_undegraded":"2024-09-16T01:18:26.974186+0000","last_fullsized":"2024-09-16T01:18:26.974186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:54.295314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974815+0000","last_change":"2024-09-16T01:18:25.606723+0000","last_active":"2024-09-16T01:18:26.974815+0000","last_peered":"2024-09-16T01:18:26.974815+0000","last_clean":"2024-09-16T01:18:26.974815+0000","last_became_active":"2024-09-16T01:18:25.606440+0000","last_became_peered":"2024-09-16T01:18:25.606440+0000","last_unstale":"2024-09-16T01:18:26.974815+0000","last_undegraded":"2024-09-16T01:18:26.974815+0000","last_fullsized":"2024-09-16T01:18:26.974815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:17.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974072+0000","last_change":"2024-09-16T01:18:25.603289+0000","last_active":"2024-09-16T01:18:26.974072+0000","last_peered":"2024-09-16T01:18:26.974072+0000","last_clean":"2024-09-16T01:18:26.974072+0000","last_became_active":"2024-09-16T01:18:25.603016+0000","last_became_peered":"2024-09-16T01:18:25.603016+0000","last_unstale":"2024-09-16T01:18:26.974072+0000","last_undegraded":"2024-09-16T01:18:26.974072+0000","last_fullsized":"2024-09-16T01:18:26.974072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:20.635284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974489+0000","last_change":"2024-09-16T01:18:25.602001+0000","last_active":"2024-09-16T01:18:26.974489+0000","last_peered":"2024-09-16T01:18:26.974489+0000","last_clean":"2024-09-16T01:18:26.974489+0000","last_became_active":"2024-09-16T01:18:25.600073+0000","last_became_peered":"2024-09-16T01:18:25.600073+0000","last_unstale":"2024-09-16T01:18:26.974489+0000","last_undegraded":"2024-09-16T01:18:26.974489+0000","last_fullsized":"2024-09-16T01:18:26.974489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:33.088152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973961+0000","last_change":"2024-09-16T01:18:25.605434+0000","last_active":"2024-09-16T01:18:26.973961+0000","last_peered":"2024-09-16T01:18:26.973961+0000","last_clean":"2024-09-16T01:18:26.973961+0000","last_became_active":"2024-09-16T01:18:25.605160+0000","last_became_peered":"2024-09-16T01:18:25.605160+0000","last_unstale":"2024-09-16T01:18:26.973961+0000","last_undegraded":"2024-09-16T01:18:26.973961+0000","last_fullsized":"2024-09-16T01:18:26.973961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:13.433784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974044+0000","last_change":"2024-09-16T01:18:25.606154+0000","last_active":"2024-09-16T01:18:26.974044+0000","last_peered":"2024-09-16T01:18:26.974044+0000","last_clean":"2024-09-16T01:18:26.974044+0000","last_became_active":"2024-09-16T01:18:25.605912+0000","last_became_peered":"2024-09-16T01:18:25.605912+0000","last_unstale":"2024-09-16T01:18:26.974044+0000","last_undegraded":"2024-09-16T01:18:26.974044+0000","last_fullsized":"2024-09-16T01:18:26.974044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:50.328132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973629+0000","last_change":"2024-09-16T01:18:25.597227+0000","last_active":"2024-09-16T01:18:26.973629+0000","last_peered":"2024-09-16T01:18:26.973629+0000","last_clean":"2024-09-16T01:18:26.973629+0000","last_became_active":"2024-09-16T01:18:25.596964+0000","last_became_peered":"2024-09-16T01:18:25.596964+0000","last_unstale":"2024-09-16T01:18:26.973629+0000","last_undegraded":"2024-09-16T01:18:26.973629+0000","last_fullsized":"2024-09-16T01:18:26.973629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:43.762133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974140+0000","last_change":"2024-09-16T01:18:25.599804+0000","last_active":"2024-09-16T01:18:26.974140+0000","last_peered":"2024-09-16T01:18:26.974140+0000","last_clean":"2024-09-16T01:18:26.974140+0000","last_became_active":"2024-09-16T01:18:25.599536+0000","last_became_peered":"2024-09-16T01:18:25.599536+0000","last_unstale":"2024-09-16T01:18:26.974140+0000","last_undegraded":"2024-09-16T01:18:26.974140+0000","last_fullsized":"2024-09-16T01:18:26.974140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:44.178474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974965+0000","last_change":"2024-09-16T01:18:25.600340+0000","last_active":"2024-09-16T01:18:26.974965+0000","last_peered":"2024-09-16T01:18:26.974965+0000","last_clean":"2024-09-16T01:18:26.974965+0000","last_became_active":"2024-09-16T01:18:25.600069+0000","last_became_peered":"2024-09-16T01:18:25.600069+0000","last_unstale":"2024-09-16T01:18:26.974965+0000","last_undegraded":"2024-09-16T01:18:26.974965+0000","last_fullsized":"2024-09-16T01:18:26.974965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:10.289186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974194+0000","last_change":"2024-09-16T01:18:25.608265+0000","last_active":"2024-09-16T01:18:26.974194+0000","last_peered":"2024-09-16T01:18:26.974194+0000","last_clean":"2024-09-16T01:18:26.974194+0000","last_became_active":"2024-09-16T01:18:25.607995+0000","last_became_peered":"2024-09-16T01:18:25.607995+0000","last_unstale":"2024-09-16T01:18:26.974194+0000","last_undegraded":"2024-09-16T01:18:26.974194+0000","last_fullsized":"2024-09-16T01:18:26.974194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:52.933445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974319+0000","last_change":"2024-09-16T01:18:25.608398+0000","last_active":"2024-09-16T01:18:26.974319+0000","last_peered":"2024-09-16T01:18:26.974319+0000","last_clean":"2024-09-16T01:18:26.974319+0000","last_became_active":"2024-09-16T01:18:25.608140+0000","last_became_peered":"2024-09-16T01:18:25.608140+0000","last_unstale":"2024-09-16T01:18:26.974319+0000","last_undegraded":"2024-09-16T01:18:26.974319+0000","last_fullsized":"2024-09-16T01:18:26.974319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:13.483572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975069+0000","last_change":"2024-09-16T01:18:24.592977+0000","last_active":"2024-09-16T01:18:26.975069+0000","last_peered":"2024-09-16T01:18:26.975069+0000","last_clean":"2024-09-16T01:18:26.975069+0000","last_became_active":"2024-09-16T01:18:24.592516+0000","last_became_peered":"2024-09-16T01:18:24.592516+0000","last_unstale":"2024-09-16T01:18:26.975069+0000","last_undegraded":"2024-09-16T01:18:26.975069+0000","last_fullsized":"2024-09-16T01:18:26.975069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:42.846668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974490+0000","last_change":"2024-09-16T01:18:25.598938+0000","last_active":"2024-09-16T01:18:26.974490+0000","last_peered":"2024-09-16T01:18:26.974490+0000","last_clean":"2024-09-16T01:18:26.974490+0000","last_became_active":"2024-09-16T01:18:25.598668+0000","last_became_peered":"2024-09-16T01:18:25.598668+0000","last_unstale":"2024-09-16T01:18:26.974490+0000","last_undegraded":"2024-09-16T01:18:26.974490+0000","last_fullsized":"2024-09-16T01:18:26.974490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:19.615579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973711+0000","last_change":"2024-09-16T01:18:25.612150+0000","last_active":"2024-09-16T01:18:26.973711+0000","last_peered":"2024-09-16T01:18:26.973711+0000","last_clean":"2024-09-16T01:18:26.973711+0000","last_became_active":"2024-09-16T01:18:25.611609+0000","last_became_peered":"2024-09-16T01:18:25.611609+0000","last_unstale":"2024-09-16T01:18:26.973711+0000","last_undegraded":"2024-09-16T01:18:26.973711+0000","last_fullsized":"2024-09-16T01:18:26.973711+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:46.870356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974583+0000","last_change":"2024-09-16T01:18:24.586756+0000","last_active":"2024-09-16T01:18:26.974583+0000","last_peered":"2024-09-16T01:18:26.974583+0000","last_clean":"2024-09-16T01:18:26.974583+0000","last_became_active":"2024-09-16T01:18:24.586480+0000","last_became_peered":"2024-09-16T01:18:24.586480+0000","last_unstale":"2024-09-16T01:18:26.974583+0000","last_undegraded":"2024-09-16T01:18:26.974583+0000","last_fullsized":"2024-09-16T01:18:26.974583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:20.364637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973808+0000","last_change":"2024-09-16T01:18:24.601156+0000","last_active":"2024-09-16T01:18:26.973808+0000","last_peered":"2024-09-16T01:18:26.973808+0000","last_clean":"2024-09-16T01:18:26.973808+0000","last_became_active":"2024-09-16T01:18:24.600860+0000","last_became_peered":"2024-09-16T01:18:24.600860+0000","last_unstale":"2024-09-16T01:18:26.973808+0000","last_undegraded":"2024-09-16T01:18:26.973808+0000","last_fullsized":"2024-09-16T01:18:26.973808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:46.004709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974324+0000","last_change":"2024-09-16T01:18:25.601946+0000","last_active":"2024-09-16T01:18:26.974324+0000","last_peered":"2024-09-16T01:18:26.974324+0000","last_clean":"2024-09-16T01:18:26.974324+0000","last_became_active":"2024-09-16T01:18:25.601693+0000","last_became_peered":"2024-09-16T01:18:25.601693+0000","last_unstale":"2024-09-16T01:18:26.974324+0000","last_undegraded":"2024-09-16T01:18:26.974324+0000","last_fullsized":"2024-09-16T01:18:26.974324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:15.229927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974599+0000","last_change":"2024-09-16T01:18:25.604022+0000","last_active":"2024-09-16T01:18:26.974599+0000","last_peered":"2024-09-16T01:18:26.974599+0000","last_clean":"2024-09-16T01:18:26.974599+0000","last_became_active":"2024-09-16T01:18:25.603759+0000","last_became_peered":"2024-09-16T01:18:25.603759+0000","last_unstale":"2024-09-16T01:18:26.974599+0000","last_undegraded":"2024-09-16T01:18:26.974599+0000","last_fullsized":"2024-09-16T01:18:26.974599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:26.763892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974652+0000","last_change":"2024-09-16T01:18:24.603407+0000","last_active":"2024-09-16T01:18:26.974652+0000","last_peered":"2024-09-16T01:18:26.974652+0000","last_clean":"2024-09-16T01:18:26.974652+0000","last_became_active":"2024-09-16T01:18:24.603125+0000","last_became_peered":"2024-09-16T01:18:24.603125+0000","last_unstale":"2024-09-16T01:18:26.974652+0000","last_undegraded":"2024-09-16T01:18:26.974652+0000","last_fullsized":"2024-09-16T01:18:26.974652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:27.252288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974213+0000","last_change":"2024-09-16T01:18:25.599150+0000","last_active":"2024-09-16T01:18:26.974213+0000","last_peered":"2024-09-16T01:18:26.974213+0000","last_clean":"2024-09-16T01:18:26.974213+0000","last_became_active":"2024-09-16T01:18:25.598275+0000","last_became_peered":"2024-09-16T01:18:25.598275+0000","last_unstale":"2024-09-16T01:18:26.974213+0000","last_undegraded":"2024-09-16T01:18:26.974213+0000","last_fullsized":"2024-09-16T01:18:26.974213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:24.082531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974213+0000","last_change":"2024-09-16T01:18:25.612050+0000","last_active":"2024-09-16T01:18:26.974213+0000","last_peered":"2024-09-16T01:18:26.974213+0000","last_clean":"2024-09-16T01:18:26.974213+0000","last_became_active":"2024-09-16T01:18:25.611734+0000","last_became_peered":"2024-09-16T01:18:25.611734+0000","last_unstale":"2024-09-16T01:18:26.974213+0000","last_undegraded":"2024-09-16T01:18:26.974213+0000","last_fullsized":"2024-09-16T01:18:26.974213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:28.959546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974422+0000","last_change":"2024-09-16T01:18:25.600774+0000","last_active":"2024-09-16T01:18:26.974422+0000","last_peered":"2024-09-16T01:18:26.974422+0000","last_clean":"2024-09-16T01:18:26.974422+0000","last_became_active":"2024-09-16T01:18:25.600496+0000","last_became_peered":"2024-09-16T01:18:25.600496+0000","last_unstale":"2024-09-16T01:18:26.974422+0000","last_undegraded":"2024-09-16T01:18:26.974422+0000","last_fullsized":"2024-09-16T01:18:26.974422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:31.193825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974235+0000","last_change":"2024-09-16T01:18:24.596421+0000","last_active":"2024-09-16T01:18:26.974235+0000","last_peered":"2024-09-16T01:18:26.974235+0000","last_clean":"2024-09-16T01:18:26.974235+0000","last_became_active":"2024-09-16T01:18:24.596188+0000","last_became_peered":"2024-09-16T01:18:24.596188+0000","last_unstale":"2024-09-16T01:18:26.974235+0000","last_undegraded":"2024-09-16T01:18:26.974235+0000","last_fullsized":"2024-09-16T01:18:26.974235+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:41.064986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":263,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T01:18:22.665385+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:18:22.665385+0000","last_peered":"2024-09-16T01:18:22.665385+0000","last_clean":"2024-09-16T01:18:22.665385+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:18:22.665385+0000","last_undegraded":"2024-09-16T01:18:22.665385+0000","last_fullsized":"2024-09-16T01:18:22.665385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":10,"acting":10,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1449984,"data_stored":973753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27892,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":868352,"data_stored":388904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27892,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":868352,"data_stored":388904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27884,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":868352,"data_stored":388904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32032,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":856064,"data_stored":383385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27884,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":868352,"data_stored":388904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":925696,"data_stored":415751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1511424,"data_stored":1006007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:18:29.111 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:18:29.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.245+0000 7fc6948f1640 1 Processor -- start 2024-09-16T01:18:29.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.245+0000 7fc6948f1640 1 -- start start 2024-09-16T01:18:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.246+0000 7fc6948f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc690145bc0 0x7fc69015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.246+0000 7fc6948f1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc69006c320 0x7fc6900af950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.246+0000 7fc6948f1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6900b3570 con 0x7fc6900ae140 2024-09-16T01:18:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.246+0000 7fc6948f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc6900b3850 con 0x7fc690145bc0 2024-09-16T01:18:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.246+0000 7fc6948f1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc6900b3b30 con 0x7fc69006c320 2024-09-16T01:18:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.247+0000 7fc68e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc690145bc0 0x7fc69015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.247+0000 7fc68e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc690145bc0 0x7fc69015ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42964/0 (socket says 172.21.15.81:42964) 2024-09-16T01:18:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.247+0000 7fc68e59c640 1 -- 172.21.15.81:0/1488502492 learned_addr learned my addr 172.21.15.81:0/1488502492 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.247+0000 7fc68ed9d640 1 --2- 172.21.15.81:0/1488502492 >> v2:172.21.15.102:3300/0 conn(0x7fc69006c320 0x7fc6900af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.247+0000 7fc68e59c640 1 -- 172.21.15.81:0/1488502492 >> v2:172.21.15.102:3300/0 conn(0x7fc69006c320 msgr2=0x7fc6900af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.247+0000 7fc68e59c640 1 --2- 172.21.15.81:0/1488502492 >> v2:172.21.15.102:3300/0 conn(0x7fc69006c320 0x7fc6900af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.247+0000 7fc68e59c640 1 -- 172.21.15.81:0/1488502492 >> v1:172.21.15.102:6789/0 conn(0x7fc6900ae140 legacy=0x7fc69006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.247+0000 7fc68e59c640 1 -- 172.21.15.81:0/1488502492 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6900b1610 con 0x7fc690145bc0 2024-09-16T01:18:29.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.247+0000 7fc68ed9d640 1 --2- 172.21.15.81:0/1488502492 >> v2:172.21.15.102:3300/0 conn(0x7fc69006c320 0x7fc6900af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:29.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.248+0000 7fc68e59c640 1 --2- 172.21.15.81:0/1488502492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc690145bc0 0x7fc69015ca70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc688009e50 tx=0x7fc68802a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651af521853cb023 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:29.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.248+0000 7fc68d59a640 1 -- 172.21.15.81:0/1488502492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc688033610 con 0x7fc690145bc0 2024-09-16T01:18:29.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.248+0000 7fc68d59a640 1 -- 172.21.15.81:0/1488502492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc68802f070 con 0x7fc690145bc0 2024-09-16T01:18:29.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.248+0000 7fc68d59a640 1 -- 172.21.15.81:0/1488502492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6880339d0 con 0x7fc690145bc0 2024-09-16T01:18:29.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.248+0000 7fc6948f1640 1 -- 172.21.15.81:0/1488502492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc690145bc0 msgr2=0x7fc69015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.248+0000 7fc6948f1640 1 --2- 172.21.15.81:0/1488502492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc690145bc0 0x7fc69015ca70 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc688009e50 tx=0x7fc68802a810 comp rx=0 tx=0).stop 2024-09-16T01:18:29.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.248+0000 7fc6948f1640 1 -- 172.21.15.81:0/1488502492 shutdown_connections 2024-09-16T01:18:29.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.248+0000 7fc6948f1640 1 --2- 172.21.15.81:0/1488502492 >> v2:172.21.15.102:3300/0 conn(0x7fc69006c320 0x7fc6900af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.248+0000 7fc6948f1640 1 --2- 172.21.15.81:0/1488502492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc690145bc0 0x7fc69015ca70 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.248+0000 7fc6948f1640 1 -- 172.21.15.81:0/1488502492 >> 172.21.15.81:0/1488502492 conn(0x7fc690073490 msgr2=0x7fc6900b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:29.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.248+0000 7fc6948f1640 1 -- 172.21.15.81:0/1488502492 shutdown_connections 2024-09-16T01:18:29.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.248+0000 7fc6948f1640 1 -- 172.21.15.81:0/1488502492 wait complete. 2024-09-16T01:18:29.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.250+0000 7fc6948f1640 1 Processor -- start 2024-09-16T01:18:29.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.250+0000 7fc6948f1640 1 -- start start 2024-09-16T01:18:29.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.250+0000 7fc6948f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc69006c320 0x7fc6901f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.250+0000 7fc6948f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6900ae140 0x7fc690141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.250+0000 7fc6948f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc690145bc0 0x7fc69009d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.250+0000 7fc6948f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc690145fa0 con 0x7fc690145bc0 2024-09-16T01:18:29.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.250+0000 7fc6948f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc69009aa30 con 0x7fc69006c320 2024-09-16T01:18:29.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.250+0000 7fc6948f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc6901f2fc0 con 0x7fc6900ae140 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc68ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc690145bc0 0x7fc69009d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc68ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc690145bc0 0x7fc69009d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42976/0 (socket says 172.21.15.81:42976) 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc68ed9d640 1 -- 172.21.15.81:0/1073133329 learned_addr learned my addr 172.21.15.81:0/1073133329 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc68e59c640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc69006c320 0x7fc6901f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc68dd9b640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6900ae140 0x7fc690141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc68ed9d640 1 -- 172.21.15.81:0/1073133329 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6900ae140 msgr2=0x7fc690141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc68ed9d640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6900ae140 0x7fc690141b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc68ed9d640 1 -- 172.21.15.81:0/1073133329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc69006c320 msgr2=0x7fc6901f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc68ed9d640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc69006c320 0x7fc6901f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc68ed9d640 1 -- 172.21.15.81:0/1073133329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6901420c0 con 0x7fc690145bc0 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc68dd9b640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6900ae140 0x7fc690141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc68ed9d640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc690145bc0 0x7fc69009d8b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc68000e7e0 tx=0x7fc68000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:29.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc686ffd640 1 -- 172.21.15.81:0/1073133329 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680017020 con 0x7fc690145bc0 2024-09-16T01:18:29.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc686ffd640 1 -- 172.21.15.81:0/1073133329 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc680004030 con 0x7fc690145bc0 2024-09-16T01:18:29.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc6948f1640 1 -- 172.21.15.81:0/1073133329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6900c99a0 con 0x7fc690145bc0 2024-09-16T01:18:29.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc686ffd640 1 -- 172.21.15.81:0/1073133329 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68000f040 con 0x7fc690145bc0 2024-09-16T01:18:29.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.251+0000 7fc6948f1640 1 -- 172.21.15.81:0/1073133329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6900c9f60 con 0x7fc690145bc0 2024-09-16T01:18:29.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.252+0000 7fc6948f1640 1 -- 172.21.15.81:0/1073133329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc69015ca70 con 0x7fc690145bc0 2024-09-16T01:18:29.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.253+0000 7fc686ffd640 1 -- 172.21.15.81:0/1073133329 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc68001a020 con 0x7fc690145bc0 2024-09-16T01:18:29.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.253+0000 7fc686ffd640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc67006c2b0 0x7fc67006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.253+0000 7fc686ffd640 1 -- 172.21.15.81:0/1073133329 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fc68008b190 con 0x7fc690145bc0 2024-09-16T01:18:29.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.253+0000 7fc68e59c640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc67006c2b0 0x7fc67006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.254+0000 7fc68e59c640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc67006c2b0 0x7fc67006e770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc688034000 tx=0x7fc688009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:29.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.257+0000 7fc686ffd640 1 -- 172.21.15.81:0/1073133329 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc680021020 con 0x7fc690145bc0 2024-09-16T01:18:29.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.419+0000 7fc6948f1640 1 -- 172.21.15.81:0/1073133329 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc69006ca20 con 0x7fc67006c2b0 2024-09-16T01:18:29.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.424+0000 7fc686ffd640 1 -- 172.21.15.81:0/1073133329 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241096 (secure 0 0 0) 0x7fc69006ca20 con 0x7fc67006c2b0 2024-09-16T01:18:29.429 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:29.430 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:18:29.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.427+0000 7fc6948f1640 1 -- 172.21.15.81:0/1073133329 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc67006c2b0 msgr2=0x7fc67006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.427+0000 7fc6948f1640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc67006c2b0 0x7fc67006e770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc688034000 tx=0x7fc688009000 comp rx=0 tx=0).stop 2024-09-16T01:18:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.427+0000 7fc6948f1640 1 -- 172.21.15.81:0/1073133329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc690145bc0 msgr2=0x7fc69009d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.427+0000 7fc6948f1640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc690145bc0 0x7fc69009d8b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc68000e7e0 tx=0x7fc68000eca0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.427+0000 7fc6948f1640 1 -- 172.21.15.81:0/1073133329 shutdown_connections 2024-09-16T01:18:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.427+0000 7fc6948f1640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc67006c2b0 0x7fc67006e770 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.427+0000 7fc6948f1640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc690145bc0 0x7fc69009d8b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.427+0000 7fc6948f1640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6900ae140 0x7fc690141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.427+0000 7fc6948f1640 1 --2- 172.21.15.81:0/1073133329 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc69006c320 0x7fc6901f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.427+0000 7fc6948f1640 1 -- 172.21.15.81:0/1073133329 >> 172.21.15.81:0/1073133329 conn(0x7fc690073490 msgr2=0x7fc69015d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.427+0000 7fc6948f1640 1 -- 172.21.15.81:0/1073133329 shutdown_connections 2024-09-16T01:18:29.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.427+0000 7fc6948f1640 1 -- 172.21.15.81:0/1073133329 wait complete. 2024-09-16T01:18:29.440 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-09-16T01:18:28.094195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":52,"acting":52,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":236788,"kb_used_data":8024,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754737932,"statfs":{"total":773094113280,"available":772851642368,"internally_reserved":0,"allocated":8216576,"data_stored":4334512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.519882"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974453+0000","last_change":"2024-09-16T01:18:25.608017+0000","last_active":"2024-09-16T01:18:26.974453+0000","last_peered":"2024-09-16T01:18:26.974453+0000","last_clean":"2024-09-16T01:18:26.974453+0000","last_became_active":"2024-09-16T01:18:25.607710+0000","last_became_peered":"2024-09-16T01:18:25.607710+0000","last_unstale":"2024-09-16T01:18:26.974453+0000","last_undegraded":"2024-09-16T01:18:26.974453+0000","last_fullsized":"2024-09-16T01:18:26.974453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:20.143941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974611+0000","last_change":"2024-09-16T01:18:25.612158+0000","last_active":"2024-09-16T01:18:26.974611+0000","last_peered":"2024-09-16T01:18:26.974611+0000","last_clean":"2024-09-16T01:18:26.974611+0000","last_became_active":"2024-09-16T01:18:25.609379+0000","last_became_peered":"2024-09-16T01:18:25.609379+0000","last_unstale":"2024-09-16T01:18:26.974611+0000","last_undegraded":"2024-09-16T01:18:26.974611+0000","last_fullsized":"2024-09-16T01:18:26.974611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:08.660319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974186+0000","last_change":"2024-09-16T01:18:25.608998+0000","last_active":"2024-09-16T01:18:26.974186+0000","last_peered":"2024-09-16T01:18:26.974186+0000","last_clean":"2024-09-16T01:18:26.974186+0000","last_became_active":"2024-09-16T01:18:25.608751+0000","last_became_peered":"2024-09-16T01:18:25.608751+0000","last_unstale":"2024-09-16T01:18:26.974186+0000","last_undegraded":"2024-09-16T01:18:26.974186+0000","last_fullsized":"2024-09-16T01:18:26.974186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:54.295314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974815+0000","last_change":"2024-09-16T01:18:25.606723+0000","last_active":"2024-09-16T01:18:26.974815+0000","last_peered":"2024-09-16T01:18:26.974815+0000","last_clean":"2024-09-16T01:18:26.974815+0000","last_became_active":"2024-09-16T01:18:25.606440+0000","last_became_peered":"2024-09-16T01:18:25.606440+0000","last_unstale":"2024-09-16T01:18:26.974815+0000","last_undegraded":"2024-09-16T01:18:26.974815+0000","last_fullsized":"2024-09-16T01:18:26.974815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:17.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974072+0000","last_change":"2024-09-16T01:18:25.603289+0000","last_active":"2024-09-16T01:18:26.974072+0000","last_peered":"2024-09-16T01:18:26.974072+0000","last_clean":"2024-09-16T01:18:26.974072+0000","last_became_active":"2024-09-16T01:18:25.603016+0000","last_became_peered":"2024-09-16T01:18:25.603016+0000","last_unstale":"2024-09-16T01:18:26.974072+0000","last_undegraded":"2024-09-16T01:18:26.974072+0000","last_fullsized":"2024-09-16T01:18:26.974072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:20.635284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974489+0000","last_change":"2024-09-16T01:18:25.602001+0000","last_active":"2024-09-16T01:18:26.974489+0000","last_peered":"2024-09-16T01:18:26.974489+0000","last_clean":"2024-09-16T01:18:26.974489+0000","last_became_active":"2024-09-16T01:18:25.600073+0000","last_became_peered":"2024-09-16T01:18:25.600073+0000","last_unstale":"2024-09-16T01:18:26.974489+0000","last_undegraded":"2024-09-16T01:18:26.974489+0000","last_fullsized":"2024-09-16T01:18:26.974489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:33.088152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973961+0000","last_change":"2024-09-16T01:18:25.605434+0000","last_active":"2024-09-16T01:18:26.973961+0000","last_peered":"2024-09-16T01:18:26.973961+0000","last_clean":"2024-09-16T01:18:26.973961+0000","last_became_active":"2024-09-16T01:18:25.605160+0000","last_became_peered":"2024-09-16T01:18:25.605160+0000","last_unstale":"2024-09-16T01:18:26.973961+0000","last_undegraded":"2024-09-16T01:18:26.973961+0000","last_fullsized":"2024-09-16T01:18:26.973961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:13.433784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974044+0000","last_change":"2024-09-16T01:18:25.606154+0000","last_active":"2024-09-16T01:18:26.974044+0000","last_peered":"2024-09-16T01:18:26.974044+0000","last_clean":"2024-09-16T01:18:26.974044+0000","last_became_active":"2024-09-16T01:18:25.605912+0000","last_became_peered":"2024-09-16T01:18:25.605912+0000","last_unstale":"2024-09-16T01:18:26.974044+0000","last_undegraded":"2024-09-16T01:18:26.974044+0000","last_fullsized":"2024-09-16T01:18:26.974044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:50.328132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973629+0000","last_change":"2024-09-16T01:18:25.597227+0000","last_active":"2024-09-16T01:18:26.973629+0000","last_peered":"2024-09-16T01:18:26.973629+0000","last_clean":"2024-09-16T01:18:26.973629+0000","last_became_active":"2024-09-16T01:18:25.596964+0000","last_became_peered":"2024-09-16T01:18:25.596964+0000","last_unstale":"2024-09-16T01:18:26.973629+0000","last_undegraded":"2024-09-16T01:18:26.973629+0000","last_fullsized":"2024-09-16T01:18:26.973629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:43.762133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974140+0000","last_change":"2024-09-16T01:18:25.599804+0000","last_active":"2024-09-16T01:18:26.974140+0000","last_peered":"2024-09-16T01:18:26.974140+0000","last_clean":"2024-09-16T01:18:26.974140+0000","last_became_active":"2024-09-16T01:18:25.599536+0000","last_became_peered":"2024-09-16T01:18:25.599536+0000","last_unstale":"2024-09-16T01:18:26.974140+0000","last_undegraded":"2024-09-16T01:18:26.974140+0000","last_fullsized":"2024-09-16T01:18:26.974140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:44.178474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974965+0000","last_change":"2024-09-16T01:18:25.600340+0000","last_active":"2024-09-16T01:18:26.974965+0000","last_peered":"2024-09-16T01:18:26.974965+0000","last_clean":"2024-09-16T01:18:26.974965+0000","last_became_active":"2024-09-16T01:18:25.600069+0000","last_became_peered":"2024-09-16T01:18:25.600069+0000","last_unstale":"2024-09-16T01:18:26.974965+0000","last_undegraded":"2024-09-16T01:18:26.974965+0000","last_fullsized":"2024-09-16T01:18:26.974965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:10.289186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974194+0000","last_change":"2024-09-16T01:18:25.608265+0000","last_active":"2024-09-16T01:18:26.974194+0000","last_peered":"2024-09-16T01:18:26.974194+0000","last_clean":"2024-09-16T01:18:26.974194+0000","last_became_active":"2024-09-16T01:18:25.607995+0000","last_became_peered":"2024-09-16T01:18:25.607995+0000","last_unstale":"2024-09-16T01:18:26.974194+0000","last_undegraded":"2024-09-16T01:18:26.974194+0000","last_fullsized":"2024-09-16T01:18:26.974194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:52.933445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974319+0000","last_change":"2024-09-16T01:18:25.608398+0000","last_active":"2024-09-16T01:18:26.974319+0000","last_peered":"2024-09-16T01:18:26.974319+0000","last_clean":"2024-09-16T01:18:26.974319+0000","last_became_active":"2024-09-16T01:18:25.608140+0000","last_became_peered":"2024-09-16T01:18:25.608140+0000","last_unstale":"2024-09-16T01:18:26.974319+0000","last_undegraded":"2024-09-16T01:18:26.974319+0000","last_fullsized":"2024-09-16T01:18:26.974319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:13.483572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975069+0000","last_change":"2024-09-16T01:18:24.592977+0000","last_active":"2024-09-16T01:18:26.975069+0000","last_peered":"2024-09-16T01:18:26.975069+0000","last_clean":"2024-09-16T01:18:26.975069+0000","last_became_active":"2024-09-16T01:18:24.592516+0000","last_became_peered":"2024-09-16T01:18:24.592516+0000","last_unstale":"2024-09-16T01:18:26.975069+0000","last_undegraded":"2024-09-16T01:18:26.975069+0000","last_fullsized":"2024-09-16T01:18:26.975069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:42.846668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974490+0000","last_change":"2024-09-16T01:18:25.598938+0000","last_active":"2024-09-16T01:18:26.974490+0000","last_peered":"2024-09-16T01:18:26.974490+0000","last_clean":"2024-09-16T01:18:26.974490+0000","last_became_active":"2024-09-16T01:18:25.598668+0000","last_became_peered":"2024-09-16T01:18:25.598668+0000","last_unstale":"2024-09-16T01:18:26.974490+0000","last_undegraded":"2024-09-16T01:18:26.974490+0000","last_fullsized":"2024-09-16T01:18:26.974490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:19.615579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973711+0000","last_change":"2024-09-16T01:18:25.612150+0000","last_active":"2024-09-16T01:18:26.973711+0000","last_peered":"2024-09-16T01:18:26.973711+0000","last_clean":"2024-09-16T01:18:26.973711+0000","last_became_active":"2024-09-16T01:18:25.611609+0000","last_became_peered":"2024-09-16T01:18:25.611609+0000","last_unstale":"2024-09-16T01:18:26.973711+0000","last_undegraded":"2024-09-16T01:18:26.973711+0000","last_fullsized":"2024-09-16T01:18:26.973711+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:46.870356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974583+0000","last_change":"2024-09-16T01:18:24.586756+0000","last_active":"2024-09-16T01:18:26.974583+0000","last_peered":"2024-09-16T01:18:26.974583+0000","last_clean":"2024-09-16T01:18:26.974583+0000","last_became_active":"2024-09-16T01:18:24.586480+0000","last_became_peered":"2024-09-16T01:18:24.586480+0000","last_unstale":"2024-09-16T01:18:26.974583+0000","last_undegraded":"2024-09-16T01:18:26.974583+0000","last_fullsized":"2024-09-16T01:18:26.974583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:20.364637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973808+0000","last_change":"2024-09-16T01:18:24.601156+0000","last_active":"2024-09-16T01:18:26.973808+0000","last_peered":"2024-09-16T01:18:26.973808+0000","last_clean":"2024-09-16T01:18:26.973808+0000","last_became_active":"2024-09-16T01:18:24.600860+0000","last_became_peered":"2024-09-16T01:18:24.600860+0000","last_unstale":"2024-09-16T01:18:26.973808+0000","last_undegraded":"2024-09-16T01:18:26.973808+0000","last_fullsized":"2024-09-16T01:18:26.973808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:46.004709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974324+0000","last_change":"2024-09-16T01:18:25.601946+0000","last_active":"2024-09-16T01:18:26.974324+0000","last_peered":"2024-09-16T01:18:26.974324+0000","last_clean":"2024-09-16T01:18:26.974324+0000","last_became_active":"2024-09-16T01:18:25.601693+0000","last_became_peered":"2024-09-16T01:18:25.601693+0000","last_unstale":"2024-09-16T01:18:26.974324+0000","last_undegraded":"2024-09-16T01:18:26.974324+0000","last_fullsized":"2024-09-16T01:18:26.974324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:15.229927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974599+0000","last_change":"2024-09-16T01:18:25.604022+0000","last_active":"2024-09-16T01:18:26.974599+0000","last_peered":"2024-09-16T01:18:26.974599+0000","last_clean":"2024-09-16T01:18:26.974599+0000","last_became_active":"2024-09-16T01:18:25.603759+0000","last_became_peered":"2024-09-16T01:18:25.603759+0000","last_unstale":"2024-09-16T01:18:26.974599+0000","last_undegraded":"2024-09-16T01:18:26.974599+0000","last_fullsized":"2024-09-16T01:18:26.974599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:26.763892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974652+0000","last_change":"2024-09-16T01:18:24.603407+0000","last_active":"2024-09-16T01:18:26.974652+0000","last_peered":"2024-09-16T01:18:26.974652+0000","last_clean":"2024-09-16T01:18:26.974652+0000","last_became_active":"2024-09-16T01:18:24.603125+0000","last_became_peered":"2024-09-16T01:18:24.603125+0000","last_unstale":"2024-09-16T01:18:26.974652+0000","last_undegraded":"2024-09-16T01:18:26.974652+0000","last_fullsized":"2024-09-16T01:18:26.974652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:27.252288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974213+0000","last_change":"2024-09-16T01:18:25.599150+0000","last_active":"2024-09-16T01:18:26.974213+0000","last_peered":"2024-09-16T01:18:26.974213+0000","last_clean":"2024-09-16T01:18:26.974213+0000","last_became_active":"2024-09-16T01:18:25.598275+0000","last_became_peered":"2024-09-16T01:18:25.598275+0000","last_unstale":"2024-09-16T01:18:26.974213+0000","last_undegraded":"2024-09-16T01:18:26.974213+0000","last_fullsized":"2024-09-16T01:18:26.974213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:24.082531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974213+0000","last_change":"2024-09-16T01:18:25.612050+0000","last_active":"2024-09-16T01:18:26.974213+0000","last_peered":"2024-09-16T01:18:26.974213+0000","last_clean":"2024-09-16T01:18:26.974213+0000","last_became_active":"2024-09-16T01:18:25.611734+0000","last_became_peered":"2024-09-16T01:18:25.611734+0000","last_unstale":"2024-09-16T01:18:26.974213+0000","last_undegraded":"2024-09-16T01:18:26.974213+0000","last_fullsized":"2024-09-16T01:18:26.974213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:28.959546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974422+0000","last_change":"2024-09-16T01:18:25.600774+0000","last_active":"2024-09-16T01:18:26.974422+0000","last_peered":"2024-09-16T01:18:26.974422+0000","last_clean":"2024-09-16T01:18:26.974422+0000","last_became_active":"2024-09-16T01:18:25.600496+0000","last_became_peered":"2024-09-16T01:18:25.600496+0000","last_unstale":"2024-09-16T01:18:26.974422+0000","last_undegraded":"2024-09-16T01:18:26.974422+0000","last_fullsized":"2024-09-16T01:18:26.974422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:31.193825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974235+0000","last_change":"2024-09-16T01:18:24.596421+0000","last_active":"2024-09-16T01:18:26.974235+0000","last_peered":"2024-09-16T01:18:26.974235+0000","last_clean":"2024-09-16T01:18:26.974235+0000","last_became_active":"2024-09-16T01:18:24.596188+0000","last_became_peered":"2024-09-16T01:18:24.596188+0000","last_unstale":"2024-09-16T01:18:26.974235+0000","last_undegraded":"2024-09-16T01:18:26.974235+0000","last_fullsized":"2024-09-16T01:18:26.974235+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:41.064986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:24.573874+0000","last_change":"2024-09-16T01:18:24.573874+0000","last_active":"2024-09-16T01:18:24.573874+0000","last_peered":"2024-09-16T01:18:24.573874+0000","last_clean":"2024-09-16T01:18:24.573874+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:24.573874+0000","last_undegraded":"2024-09-16T01:18:24.573874+0000","last_fullsized":"2024-09-16T01:18:24.573874+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:23.571876+0000","last_change":"2024-09-16T01:18:23.571876+0000","last_active":"2024-09-16T01:18:23.571876+0000","last_peered":"2024-09-16T01:18:23.571876+0000","last_clean":"2024-09-16T01:18:23.571876+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:23.571876+0000","last_undegraded":"2024-09-16T01:18:23.571876+0000","last_fullsized":"2024-09-16T01:18:23.571876+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":263,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-16T01:18:22.665385+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:18:22.665385+0000","last_peered":"2024-09-16T01:18:22.665385+0000","last_clean":"2024-09-16T01:18:22.665385+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:18:22.665385+0000","last_undegraded":"2024-09-16T01:18:22.665385+0000","last_fullsized":"2024-09-16T01:18:22.665385+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":2},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":10,"acting":10,"num_store_stats":2},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1449984,"data_stored":973753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27892,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":868352,"data_stored":388904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27892,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":868352,"data_stored":388904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27884,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":868352,"data_stored":388904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32032,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":856064,"data_stored":383385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27884,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":868352,"data_stored":388904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":925696,"data_stored":415751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1511424,"data_stored":1006007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:18:29.444 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3f is not active+clean 2024-09-16T01:18:29.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.444 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3c is not active+clean 2024-09-16T01:18:29.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.444 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3b is not active+clean 2024-09-16T01:18:29.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.445 INFO:tasks.ceph.ceph_manager.ceph:PG 12.3a is not active+clean 2024-09-16T01:18:29.445 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.445 INFO:tasks.ceph.ceph_manager.ceph:PG 12.39 is not active+clean 2024-09-16T01:18:29.445 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.445 INFO:tasks.ceph.ceph_manager.ceph:PG 12.38 is not active+clean 2024-09-16T01:18:29.445 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.445 INFO:tasks.ceph.ceph_manager.ceph:PG 12.37 is not active+clean 2024-09-16T01:18:29.445 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.445 INFO:tasks.ceph.ceph_manager.ceph:PG 12.36 is not active+clean 2024-09-16T01:18:29.445 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.445 INFO:tasks.ceph.ceph_manager.ceph:PG 12.34 is not active+clean 2024-09-16T01:18:29.446 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.446 INFO:tasks.ceph.ceph_manager.ceph:PG 12.33 is not active+clean 2024-09-16T01:18:29.446 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.446 INFO:tasks.ceph.ceph_manager.ceph:PG 12.32 is not active+clean 2024-09-16T01:18:29.446 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.446 INFO:tasks.ceph.ceph_manager.ceph:PG 12.30 is not active+clean 2024-09-16T01:18:29.446 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.447 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2f is not active+clean 2024-09-16T01:18:29.447 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.447 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2d is not active+clean 2024-09-16T01:18:29.447 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.447 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2c is not active+clean 2024-09-16T01:18:29.447 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.448 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2b is not active+clean 2024-09-16T01:18:29.448 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.448 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2a is not active+clean 2024-09-16T01:18:29.448 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.448 INFO:tasks.ceph.ceph_manager.ceph:PG 12.29 is not active+clean 2024-09-16T01:18:29.449 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.449 INFO:tasks.ceph.ceph_manager.ceph:PG 12.26 is not active+clean 2024-09-16T01:18:29.449 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.449 INFO:tasks.ceph.ceph_manager.ceph:PG 12.25 is not active+clean 2024-09-16T01:18:29.449 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.450 INFO:tasks.ceph.ceph_manager.ceph:PG 12.24 is not active+clean 2024-09-16T01:18:29.450 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.450 INFO:tasks.ceph.ceph_manager.ceph:PG 12.22 is not active+clean 2024-09-16T01:18:29.450 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.451 INFO:tasks.ceph.ceph_manager.ceph:PG 12.20 is not active+clean 2024-09-16T01:18:29.451 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.451 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1f is not active+clean 2024-09-16T01:18:29.451 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.451 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-09-16T01:18:29.451 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.451 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1a is not active+clean 2024-09-16T01:18:29.451 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.452 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1d is not active+clean 2024-09-16T01:18:29.452 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.452 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1b is not active+clean 2024-09-16T01:18:29.452 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.453 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1c is not active+clean 2024-09-16T01:18:29.453 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.454 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1b is not active+clean 2024-09-16T01:18:29.454 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.454 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-09-16T01:18:29.454 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.454 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1e is not active+clean 2024-09-16T01:18:29.454 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.454 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1f is not active+clean 2024-09-16T01:18:29.454 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.454 INFO:tasks.ceph.ceph_manager.ceph:PG 11.18 is not active+clean 2024-09-16T01:18:29.454 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.455 INFO:tasks.ceph.ceph_manager.ceph:PG 11.17 is not active+clean 2024-09-16T01:18:29.455 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.455 INFO:tasks.ceph.ceph_manager.ceph:PG 12.11 is not active+clean 2024-09-16T01:18:29.455 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.455 INFO:tasks.ceph.ceph_manager.ceph:PG 11.16 is not active+clean 2024-09-16T01:18:29.455 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.455 INFO:tasks.ceph.ceph_manager.ceph:PG 12.12 is not active+clean 2024-09-16T01:18:29.455 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.455 INFO:tasks.ceph.ceph_manager.ceph:PG 11.15 is not active+clean 2024-09-16T01:18:29.455 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.455 INFO:tasks.ceph.ceph_manager.ceph:PG 11.14 is not active+clean 2024-09-16T01:18:29.455 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.456 INFO:tasks.ceph.ceph_manager.ceph:PG 12.14 is not active+clean 2024-09-16T01:18:29.456 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.456 INFO:tasks.ceph.ceph_manager.ceph:PG 11.13 is not active+clean 2024-09-16T01:18:29.456 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.456 INFO:tasks.ceph.ceph_manager.ceph:PG 12.15 is not active+clean 2024-09-16T01:18:29.456 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.456 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-09-16T01:18:29.456 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.456 INFO:tasks.ceph.ceph_manager.ceph:PG 12.16 is not active+clean 2024-09-16T01:18:29.456 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.457 INFO:tasks.ceph.ceph_manager.ceph:PG 11.11 is not active+clean 2024-09-16T01:18:29.457 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.457 INFO:tasks.ceph.ceph_manager.ceph:PG 12.17 is not active+clean 2024-09-16T01:18:29.457 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.457 INFO:tasks.ceph.ceph_manager.ceph:PG 12.8 is not active+clean 2024-09-16T01:18:29.457 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.457 INFO:tasks.ceph.ceph_manager.ceph:PG 11.f is not active+clean 2024-09-16T01:18:29.457 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.457 INFO:tasks.ceph.ceph_manager.ceph:PG 12.9 is not active+clean 2024-09-16T01:18:29.458 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.458 INFO:tasks.ceph.ceph_manager.ceph:PG 11.e is not active+clean 2024-09-16T01:18:29.458 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.458 INFO:tasks.ceph.ceph_manager.ceph:PG 12.a is not active+clean 2024-09-16T01:18:29.458 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.458 INFO:tasks.ceph.ceph_manager.ceph:PG 11.d is not active+clean 2024-09-16T01:18:29.458 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.458 INFO:tasks.ceph.ceph_manager.ceph:PG 12.b is not active+clean 2024-09-16T01:18:29.458 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.458 INFO:tasks.ceph.ceph_manager.ceph:PG 11.b is not active+clean 2024-09-16T01:18:29.458 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.459 INFO:tasks.ceph.ceph_manager.ceph:PG 11.9 is not active+clean 2024-09-16T01:18:29.459 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.459 INFO:tasks.ceph.ceph_manager.ceph:PG 12.f is not active+clean 2024-09-16T01:18:29.459 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.459 INFO:tasks.ceph.ceph_manager.ceph:PG 11.8 is not active+clean 2024-09-16T01:18:29.459 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.459 INFO:tasks.ceph.ceph_manager.ceph:PG 12.0 is not active+clean 2024-09-16T01:18:29.459 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.459 INFO:tasks.ceph.ceph_manager.ceph:PG 11.7 is not active+clean 2024-09-16T01:18:29.459 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.459 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1 is not active+clean 2024-09-16T01:18:29.460 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.460 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2 is not active+clean 2024-09-16T01:18:29.460 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.460 INFO:tasks.ceph.ceph_manager.ceph:PG 11.5 is not active+clean 2024-09-16T01:18:29.460 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.460 INFO:tasks.ceph.ceph_manager.ceph:PG 11.4 is not active+clean 2024-09-16T01:18:29.460 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.460 INFO:tasks.ceph.ceph_manager.ceph:PG 12.4 is not active+clean 2024-09-16T01:18:29.460 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.460 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3 is not active+clean 2024-09-16T01:18:29.460 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.461 INFO:tasks.ceph.ceph_manager.ceph:PG 12.5 is not active+clean 2024-09-16T01:18:29.461 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.461 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2 is not active+clean 2024-09-16T01:18:29.461 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.461 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1 is not active+clean 2024-09-16T01:18:29.461 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.461 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-09-16T01:18:29.461 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:24.573874+0000', 'last_change': '2024-09-16T01:18:24.573874+0000', 'last_active': '2024-09-16T01:18:24.573874+0000', 'last_peered': '2024-09-16T01:18:24.573874+0000', 'last_clean': '2024-09-16T01:18:24.573874+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:24.573874+0000', 'last_undegraded': '2024-09-16T01:18:24.573874+0000', 'last_fullsized': '2024-09-16T01:18:24.573874+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:24.573874+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.461 INFO:tasks.ceph.ceph_manager.ceph:PG 11.a is not active+clean 2024-09-16T01:18:29.461 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:18:23.571876+0000', 'last_change': '2024-09-16T01:18:23.571876+0000', 'last_active': '2024-09-16T01:18:23.571876+0000', 'last_peered': '2024-09-16T01:18:23.571876+0000', 'last_clean': '2024-09-16T01:18:23.571876+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:18:23.571876+0000', 'last_undegraded': '2024-09-16T01:18:23.571876+0000', 'last_fullsized': '2024-09-16T01:18:23.571876+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'last_clean_scrub_stamp': '2024-09-16T01:18:23.571876+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:18:29.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T01:18:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.577+0000 7f855121e640 1 Processor -- start 2024-09-16T01:18:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.577+0000 7f855121e640 1 -- start start 2024-09-16T01:18:29.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.577+0000 7f855121e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f854c147360 0x7f854c070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.577+0000 7f855121e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f854c070dd0 0x7f854c0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.577+0000 7f855121e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f854c0d09e0 0x7f854c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.577+0000 7f855121e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f854c06cb30 con 0x7f854c070dd0 2024-09-16T01:18:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.577+0000 7f855121e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f854c0d0e50 con 0x7f854c147360 2024-09-16T01:18:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.577+0000 7f855121e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f854c06bfb0 con 0x7f854c0d09e0 2024-09-16T01:18:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.578+0000 7f854a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f854c070dd0 0x7f854c0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.578+0000 7f854a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f854c070dd0 0x7f854c0d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42992/0 (socket says 172.21.15.81:42992) 2024-09-16T01:18:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.578+0000 7f854a59c640 1 -- 172.21.15.81:0/1013565066 learned_addr learned my addr 172.21.15.81:0/1013565066 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.578+0000 7f854ad9d640 1 --2- 172.21.15.81:0/1013565066 >> v2:172.21.15.102:3300/0 conn(0x7f854c147360 0x7f854c070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.578+0000 7f854b59e640 1 --2- 172.21.15.81:0/1013565066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f854c0d09e0 0x7f854c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.578+0000 7f854a59c640 1 -- 172.21.15.81:0/1013565066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f854c0d09e0 msgr2=0x7f854c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.578+0000 7f854a59c640 1 --2- 172.21.15.81:0/1013565066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f854c0d09e0 0x7f854c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.578+0000 7f854a59c640 1 -- 172.21.15.81:0/1013565066 >> v2:172.21.15.102:3300/0 conn(0x7f854c147360 msgr2=0x7f854c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.578+0000 7f854a59c640 1 --2- 172.21.15.81:0/1013565066 >> v2:172.21.15.102:3300/0 conn(0x7f854c147360 0x7f854c070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.578+0000 7f854a59c640 1 -- 172.21.15.81:0/1013565066 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c06c290 con 0x7f854c070dd0 2024-09-16T01:18:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f854a59c640 1 --2- 172.21.15.81:0/1013565066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854c070dd0 0x7f854c0d04a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f854c1483f0 tx=0x7f853402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f930d9ef07a81dd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f8549d9b640 1 -- 172.21.15.81:0/1013565066 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534037070 con 0x7f854c070dd0 2024-09-16T01:18:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f8549d9b640 1 -- 172.21.15.81:0/1013565066 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8534032440 con 0x7f854c070dd0 2024-09-16T01:18:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f8549d9b640 1 -- 172.21.15.81:0/1013565066 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8534032810 con 0x7f854c070dd0 2024-09-16T01:18:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f855121e640 1 -- 172.21.15.81:0/1013565066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854c070dd0 msgr2=0x7f854c0d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f855121e640 1 --2- 172.21.15.81:0/1013565066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854c070dd0 0x7f854c0d04a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f854c1483f0 tx=0x7f853402a140 comp rx=0 tx=0).stop 2024-09-16T01:18:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f855121e640 1 -- 172.21.15.81:0/1013565066 shutdown_connections 2024-09-16T01:18:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f855121e640 1 --2- 172.21.15.81:0/1013565066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f854c0d09e0 0x7f854c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f855121e640 1 --2- 172.21.15.81:0/1013565066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854c070dd0 0x7f854c0d04a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f855121e640 1 --2- 172.21.15.81:0/1013565066 >> v2:172.21.15.102:3300/0 conn(0x7f854c147360 0x7f854c070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f855121e640 1 -- 172.21.15.81:0/1013565066 >> 172.21.15.81:0/1013565066 conn(0x7f854c0b2f40 msgr2=0x7f854c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f855121e640 1 -- 172.21.15.81:0/1013565066 shutdown_connections 2024-09-16T01:18:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.579+0000 7f855121e640 1 -- 172.21.15.81:0/1013565066 wait complete. 2024-09-16T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.581+0000 7f855121e640 1 Processor -- start 2024-09-16T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.581+0000 7f855121e640 1 -- start start 2024-09-16T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.581+0000 7f855121e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854c070dd0 0x7f854c158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.581+0000 7f855121e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f854c0d09e0 0x7f854c15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.581+0000 7f855121e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f854c147360 0x7f854c158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.581+0000 7f855121e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f854c06bc10 con 0x7f854c070dd0 2024-09-16T01:18:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.581+0000 7f855121e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f854c06c850 con 0x7f854c147360 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.581+0000 7f855121e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f854c06bd90 con 0x7f854c0d09e0 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f854ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854c070dd0 0x7f854c158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f854ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854c070dd0 0x7f854c158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43004/0 (socket says 172.21.15.81:43004) 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f854ad9d640 1 -- 172.21.15.81:0/1485117330 learned_addr learned my addr 172.21.15.81:0/1485117330 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f854b59e640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f854c147360 0x7f854c158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f854a59c640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f854c0d09e0 0x7f854c15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f854ad9d640 1 -- 172.21.15.81:0/1485117330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f854c0d09e0 msgr2=0x7f854c15ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f854ad9d640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f854c0d09e0 0x7f854c15ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f854ad9d640 1 -- 172.21.15.81:0/1485117330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f854c147360 msgr2=0x7f854c158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f854ad9d640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f854c147360 0x7f854c158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f854ad9d640 1 -- 172.21.15.81:0/1485117330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c1f7d70 con 0x7f854c070dd0 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f854ad9d640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854c070dd0 0x7f854c158ba0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8544009db0 tx=0x7f854400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f85437fe640 1 -- 172.21.15.81:0/1485117330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544018020 con 0x7f854c070dd0 2024-09-16T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f85437fe640 1 -- 172.21.15.81:0/1485117330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8544014480 con 0x7f854c070dd0 2024-09-16T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f85437fe640 1 -- 172.21.15.81:0/1485117330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8544014850 con 0x7f854c070dd0 2024-09-16T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f855121e640 1 -- 172.21.15.81:0/1485117330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854c1f8050 con 0x7f854c070dd0 2024-09-16T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.582+0000 7f855121e640 1 -- 172.21.15.81:0/1485117330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854c1f8610 con 0x7f854c070dd0 2024-09-16T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.583+0000 7f855121e640 1 -- 172.21.15.81:0/1485117330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854c0d04a0 con 0x7f854c070dd0 2024-09-16T01:18:29.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.584+0000 7f85437fe640 1 -- 172.21.15.81:0/1485117330 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8544005d10 con 0x7f854c070dd0 2024-09-16T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.584+0000 7f85437fe640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f852c06c2b0 0x7f852c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.584+0000 7f854a59c640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f852c06c2b0 0x7f852c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.584+0000 7f85437fe640 1 -- 172.21.15.81:0/1485117330 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f854408bf00 con 0x7f854c070dd0 2024-09-16T01:18:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.585+0000 7f854a59c640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f852c06c2b0 0x7f852c06e770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8534034000 tx=0x7f853402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:29.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.589+0000 7f85437fe640 1 -- 172.21.15.81:0/1485117330 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8544022070 con 0x7f854c070dd0 2024-09-16T01:18:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.820+0000 7f855121e640 1 -- 172.21.15.81:0/1485117330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f854c0b0930 con 0x7f854c070dd0 2024-09-16T01:18:29.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.820+0000 7f85437fe640 1 -- 172.21.15.81:0/1485117330 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1546 (secure 0 0 0) 0x7f8544010040 con 0x7f854c070dd0 2024-09-16T01:18:29.822 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:29.822 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":193,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":75,"num_osds":8,"num_up_osds":8,"osd_up_since":1726449328,"num_in_osds":8,"osd_in_since":1726449318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":71},{"state_name":"active+clean","count":26}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590368,"bytes_used":242470912,"bytes_avail":772851642368,"bytes_total":773094113280,"unknown_pgs_ratio":0.73195874691009521,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":36,"btime":"2024-09-16T01:18:27:841583+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":6027}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-16T01:18:16.091880+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T01:18:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.822+0000 7f855121e640 1 -- 172.21.15.81:0/1485117330 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f852c06c2b0 msgr2=0x7f852c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.822+0000 7f855121e640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f852c06c2b0 0x7f852c06e770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8534034000 tx=0x7f853402e000 comp rx=0 tx=0).stop 2024-09-16T01:18:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.822+0000 7f855121e640 1 -- 172.21.15.81:0/1485117330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854c070dd0 msgr2=0x7f854c158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.822+0000 7f855121e640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854c070dd0 0x7f854c158ba0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f8544009db0 tx=0x7f854400c490 comp rx=0 tx=0).stop 2024-09-16T01:18:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.822+0000 7f855121e640 1 -- 172.21.15.81:0/1485117330 shutdown_connections 2024-09-16T01:18:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.822+0000 7f855121e640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f852c06c2b0 0x7f852c06e770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.822+0000 7f855121e640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f854c147360 0x7f854c158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.822+0000 7f855121e640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f854c0d09e0 0x7f854c15ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.822+0000 7f855121e640 1 --2- 172.21.15.81:0/1485117330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f854c070dd0 0x7f854c158ba0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.822+0000 7f855121e640 1 -- 172.21.15.81:0/1485117330 >> 172.21.15.81:0/1485117330 conn(0x7f854c0b2f40 msgr2=0x7f854c144d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.823+0000 7f855121e640 1 -- 172.21.15.81:0/1485117330 shutdown_connections 2024-09-16T01:18:29.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.823+0000 7f855121e640 1 -- 172.21.15.81:0/1485117330 wait complete. 2024-09-16T01:18:29.835 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T01:18:29.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:18:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.932+0000 7fbb546ed640 1 Processor -- start 2024-09-16T01:18:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.932+0000 7fbb546ed640 1 -- start start 2024-09-16T01:18:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb546ed640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbb4c145e00 0x7fbb4c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb546ed640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbb4c0d0be0 0x7fbb4c0afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb546ed640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb4c0af720 con 0x7fbb4c15d460 2024-09-16T01:18:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb546ed640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fbb4c1461e0 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb546ed640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbb4c15d8f0 con 0x7fbb4c145e00 2024-09-16T01:18:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb52c8a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbb4c0d0be0 0x7fbb4c0afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb51c88640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbb4c15d460 0x7fbb4c0d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54498/0 (socket says 172.21.15.81:54498) 2024-09-16T01:18:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb51c88640 1 -- 172.21.15.81:0/4265071218 learned_addr learned my addr 172.21.15.81:0/4265071218 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb52489640 1 --2- 172.21.15.81:0/4265071218 >> v2:172.21.15.102:3300/0 conn(0x7fbb4c145e00 0x7fbb4c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb52c8a640 1 -- 172.21.15.81:0/4265071218 >> v2:172.21.15.102:3300/0 conn(0x7fbb4c145e00 msgr2=0x7fbb4c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb52c8a640 1 --2- 172.21.15.81:0/4265071218 >> v2:172.21.15.102:3300/0 conn(0x7fbb4c145e00 0x7fbb4c0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb52c8a640 1 -- 172.21.15.81:0/4265071218 >> v1:172.21.15.81:6789/0 conn(0x7fbb4c15d460 legacy=0x7fbb4c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb52c8a640 1 -- 172.21.15.81:0/4265071218 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c0cdf90 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.933+0000 7fbb51487640 1 -- 172.21.15.81:0/4265071218 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1260664732 0 0) 0x7fbb4c0af720 con 0x7fbb4c15d460 2024-09-16T01:18:29.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.934+0000 7fbb52c8a640 1 --2- 172.21.15.81:0/4265071218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb4c0d0be0 0x7fbb4c0afc00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0cecd0 tx=0x7fbb4402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3577cfd9c7d587 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:29.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.934+0000 7fbb51487640 1 -- 172.21.15.81:0/4265071218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44007740 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.934+0000 7fbb51487640 1 -- 172.21.15.81:0/4265071218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb440078e0 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.934+0000 7fbb51487640 1 -- 172.21.15.81:0/4265071218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44007cb0 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.934+0000 7fbb546ed640 1 -- 172.21.15.81:0/4265071218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb4c0d0be0 msgr2=0x7fbb4c0afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.934+0000 7fbb546ed640 1 --2- 172.21.15.81:0/4265071218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb4c0d0be0 0x7fbb4c0afc00 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0cecd0 tx=0x7fbb4402a680 comp rx=0 tx=0).stop 2024-09-16T01:18:29.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.934+0000 7fbb546ed640 1 -- 172.21.15.81:0/4265071218 shutdown_connections 2024-09-16T01:18:29.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.934+0000 7fbb546ed640 1 --2- 172.21.15.81:0/4265071218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb4c0d0be0 0x7fbb4c0afc00 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.934+0000 7fbb546ed640 1 --2- 172.21.15.81:0/4265071218 >> v2:172.21.15.102:3300/0 conn(0x7fbb4c145e00 0x7fbb4c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.934+0000 7fbb546ed640 1 -- 172.21.15.81:0/4265071218 >> 172.21.15.81:0/4265071218 conn(0x7fbb4c0b2f40 msgr2=0x7fbb4c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:29.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.935+0000 7fbb546ed640 1 -- 172.21.15.81:0/4265071218 shutdown_connections 2024-09-16T01:18:29.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.935+0000 7fbb546ed640 1 -- 172.21.15.81:0/4265071218 wait complete. 2024-09-16T01:18:29.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.936+0000 7fbb546ed640 1 Processor -- start 2024-09-16T01:18:29.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.936+0000 7fbb546ed640 1 -- start start 2024-09-16T01:18:29.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.936+0000 7fbb546ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb4c0d0be0 0x7fbb4c141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.936+0000 7fbb546ed640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb4c145e00 0x7fbb4c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.936+0000 7fbb546ed640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb4c15d460 0x7fbb4c1e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.936+0000 7fbb546ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c0ce830 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.936+0000 7fbb546ed640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c0ce550 con 0x7fbb4c15d460 2024-09-16T01:18:29.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.936+0000 7fbb546ed640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbb4c0cede0 con 0x7fbb4c145e00 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.936+0000 7fbb52489640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb4c0d0be0 0x7fbb4c141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb52489640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb4c0d0be0 0x7fbb4c141870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43016/0 (socket says 172.21.15.81:43016) 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb52489640 1 -- 172.21.15.81:0/2833768172 learned_addr learned my addr 172.21.15.81:0/2833768172 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb51c88640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb4c145e00 0x7fbb4c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb52c8a640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb4c15d460 0x7fbb4c1e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb52489640 1 -- 172.21.15.81:0/2833768172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb4c145e00 msgr2=0x7fbb4c0b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb52489640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb4c145e00 0x7fbb4c0b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb52489640 1 -- 172.21.15.81:0/2833768172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb4c15d460 msgr2=0x7fbb4c1e7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb52489640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb4c15d460 0x7fbb4c1e7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb52489640 1 -- 172.21.15.81:0/2833768172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c1f56c0 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb51c88640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb4c145e00 0x7fbb4c0b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb52489640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb4c0d0be0 0x7fbb4c141870 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800d800 tx=0x7fbb4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb3effd640 1 -- 172.21.15.81:0/2833768172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4800b6c0 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb3effd640 1 -- 172.21.15.81:0/2833768172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb48019070 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb3effd640 1 -- 172.21.15.81:0/2833768172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4800ba80 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb546ed640 1 -- 172.21.15.81:0/2833768172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4c1f59a0 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.937+0000 7fbb546ed640 1 -- 172.21.15.81:0/2833768172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb4c1f5f60 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.938+0000 7fbb546ed640 1 -- 172.21.15.81:0/2833768172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb4c0cd8a0 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.939+0000 7fbb3effd640 1 -- 172.21.15.81:0/2833768172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbb4800bc20 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.939+0000 7fbb3effd640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbb3006c2e0 0x7fbb3006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:29.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.939+0000 7fbb3effd640 1 -- 172.21.15.81:0/2833768172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fbb4808b900 con 0x7fbb4c0d0be0 2024-09-16T01:18:29.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.939+0000 7fbb51c88640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbb3006c2e0 0x7fbb3006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:29.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.939+0000 7fbb51c88640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbb3006c2e0 0x7fbb3006e7a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0cd870 tx=0x7fbb40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:29.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:29.943+0000 7fbb3effd640 1 -- 172.21.15.81:0/2833768172 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb48059f70 con 0x7fbb4c0d0be0 2024-09-16T01:18:30.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.109+0000 7fbb546ed640 1 -- 172.21.15.81:0/2833768172 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb4c141db0 con 0x7fbb3006c2e0 2024-09-16T01:18:30.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.115+0000 7fbb3effd640 1 -- 172.21.15.81:0/2833768172 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252072 (secure 0 0 0) 0x7fbb40001380 con 0x7fbb3006c2e0 2024-09-16T01:18:30.119 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:30.120 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:18:30.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.117+0000 7fbb546ed640 1 -- 172.21.15.81:0/2833768172 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbb3006c2e0 msgr2=0x7fbb3006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:30.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.117+0000 7fbb546ed640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbb3006c2e0 0x7fbb3006e7a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0cd870 tx=0x7fbb40009040 comp rx=0 tx=0).stop 2024-09-16T01:18:30.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.117+0000 7fbb546ed640 1 -- 172.21.15.81:0/2833768172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb4c0d0be0 msgr2=0x7fbb4c141870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:30.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.117+0000 7fbb546ed640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb4c0d0be0 0x7fbb4c141870 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbb4800d800 tx=0x7fbb4800dcc0 comp rx=0 tx=0).stop 2024-09-16T01:18:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.117+0000 7fbb546ed640 1 -- 172.21.15.81:0/2833768172 shutdown_connections 2024-09-16T01:18:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.117+0000 7fbb546ed640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbb3006c2e0 0x7fbb3006e7a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.117+0000 7fbb546ed640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb4c15d460 0x7fbb4c1e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.117+0000 7fbb546ed640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbb4c145e00 0x7fbb4c0b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.117+0000 7fbb546ed640 1 --2- 172.21.15.81:0/2833768172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb4c0d0be0 0x7fbb4c141870 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.117+0000 7fbb546ed640 1 -- 172.21.15.81:0/2833768172 >> 172.21.15.81:0/2833768172 conn(0x7fbb4c0b2f40 msgr2=0x7fbb4c0afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.118+0000 7fbb546ed640 1 -- 172.21.15.81:0/2833768172 shutdown_connections 2024-09-16T01:18:30.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:30.118+0000 7fbb546ed640 1 -- 172.21.15.81:0/2833768172 wait complete. 2024-09-16T01:18:30.130 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-16T01:18:30.094569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241272,"kb_used_data":8392,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754733448,"statfs":{"total":773094113280,"available":772847050752,"internally_reserved":0,"allocated":8593408,"data_stored":4510668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001146"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598588+0000","last_change":"2024-09-16T01:18:25.603313+0000","last_active":"2024-09-16T01:18:26.598588+0000","last_peered":"2024-09-16T01:18:26.598588+0000","last_clean":"2024-09-16T01:18:26.598588+0000","last_became_active":"2024-09-16T01:18:25.603022+0000","last_became_peered":"2024-09-16T01:18:25.603022+0000","last_unstale":"2024-09-16T01:18:26.598588+0000","last_undegraded":"2024-09-16T01:18:26.598588+0000","last_fullsized":"2024-09-16T01:18:26.598588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:19.615579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974453+0000","last_change":"2024-09-16T01:18:25.608017+0000","last_active":"2024-09-16T01:18:26.974453+0000","last_peered":"2024-09-16T01:18:26.974453+0000","last_clean":"2024-09-16T01:18:26.974453+0000","last_became_active":"2024-09-16T01:18:25.607710+0000","last_became_peered":"2024-09-16T01:18:25.607710+0000","last_unstale":"2024-09-16T01:18:26.974453+0000","last_undegraded":"2024-09-16T01:18:26.974453+0000","last_fullsized":"2024-09-16T01:18:26.974453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:20.143941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974611+0000","last_change":"2024-09-16T01:18:25.612158+0000","last_active":"2024-09-16T01:18:26.974611+0000","last_peered":"2024-09-16T01:18:26.974611+0000","last_clean":"2024-09-16T01:18:26.974611+0000","last_became_active":"2024-09-16T01:18:25.609379+0000","last_became_peered":"2024-09-16T01:18:25.609379+0000","last_unstale":"2024-09-16T01:18:26.974611+0000","last_undegraded":"2024-09-16T01:18:26.974611+0000","last_fullsized":"2024-09-16T01:18:26.974611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:08.660319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597832+0000","last_change":"2024-09-16T01:18:25.601554+0000","last_active":"2024-09-16T01:18:26.597832+0000","last_peered":"2024-09-16T01:18:26.597832+0000","last_clean":"2024-09-16T01:18:26.597832+0000","last_became_active":"2024-09-16T01:18:25.601058+0000","last_became_peered":"2024-09-16T01:18:25.601058+0000","last_unstale":"2024-09-16T01:18:26.597832+0000","last_undegraded":"2024-09-16T01:18:26.597832+0000","last_fullsized":"2024-09-16T01:18:26.597832+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:00.681664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595763+0000","last_change":"2024-09-16T01:18:25.604753+0000","last_active":"2024-09-16T01:18:26.595763+0000","last_peered":"2024-09-16T01:18:26.595763+0000","last_clean":"2024-09-16T01:18:26.595763+0000","last_became_active":"2024-09-16T01:18:25.604479+0000","last_became_peered":"2024-09-16T01:18:25.604479+0000","last_unstale":"2024-09-16T01:18:26.595763+0000","last_undegraded":"2024-09-16T01:18:26.595763+0000","last_fullsized":"2024-09-16T01:18:26.595763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:49.516535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974316+0000","last_change":"2024-09-16T01:18:25.610378+0000","last_active":"2024-09-16T01:18:26.974316+0000","last_peered":"2024-09-16T01:18:26.974316+0000","last_clean":"2024-09-16T01:18:26.974316+0000","last_became_active":"2024-09-16T01:18:25.609971+0000","last_became_peered":"2024-09-16T01:18:25.609971+0000","last_unstale":"2024-09-16T01:18:26.974316+0000","last_undegraded":"2024-09-16T01:18:26.974316+0000","last_fullsized":"2024-09-16T01:18:26.974316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:55.501383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974598+0000","last_change":"2024-09-16T01:18:25.606680+0000","last_active":"2024-09-16T01:18:26.974598+0000","last_peered":"2024-09-16T01:18:26.974598+0000","last_clean":"2024-09-16T01:18:26.974598+0000","last_became_active":"2024-09-16T01:18:25.606384+0000","last_became_peered":"2024-09-16T01:18:25.606384+0000","last_unstale":"2024-09-16T01:18:26.974598+0000","last_undegraded":"2024-09-16T01:18:26.974598+0000","last_fullsized":"2024-09-16T01:18:26.974598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:46.870356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595507+0000","last_change":"2024-09-16T01:18:25.605429+0000","last_active":"2024-09-16T01:18:26.595507+0000","last_peered":"2024-09-16T01:18:26.595507+0000","last_clean":"2024-09-16T01:18:26.595507+0000","last_became_active":"2024-09-16T01:18:25.605161+0000","last_became_peered":"2024-09-16T01:18:25.605161+0000","last_unstale":"2024-09-16T01:18:26.595507+0000","last_undegraded":"2024-09-16T01:18:26.595507+0000","last_fullsized":"2024-09-16T01:18:26.595507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:53.788733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974442+0000","last_change":"2024-09-16T01:18:25.605780+0000","last_active":"2024-09-16T01:18:26.974442+0000","last_peered":"2024-09-16T01:18:26.974442+0000","last_clean":"2024-09-16T01:18:26.974442+0000","last_became_active":"2024-09-16T01:18:25.605509+0000","last_became_peered":"2024-09-16T01:18:25.605509+0000","last_unstale":"2024-09-16T01:18:26.974442+0000","last_undegraded":"2024-09-16T01:18:26.974442+0000","last_fullsized":"2024-09-16T01:18:26.974442+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:09.627521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598318+0000","last_change":"2024-09-16T01:18:25.590617+0000","last_active":"2024-09-16T01:18:26.598318+0000","last_peered":"2024-09-16T01:18:26.598318+0000","last_clean":"2024-09-16T01:18:26.598318+0000","last_became_active":"2024-09-16T01:18:25.590296+0000","last_became_peered":"2024-09-16T01:18:25.590296+0000","last_unstale":"2024-09-16T01:18:26.598318+0000","last_undegraded":"2024-09-16T01:18:26.598318+0000","last_fullsized":"2024-09-16T01:18:26.598318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:02.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974186+0000","last_change":"2024-09-16T01:18:25.608998+0000","last_active":"2024-09-16T01:18:26.974186+0000","last_peered":"2024-09-16T01:18:26.974186+0000","last_clean":"2024-09-16T01:18:26.974186+0000","last_became_active":"2024-09-16T01:18:25.608751+0000","last_became_peered":"2024-09-16T01:18:25.608751+0000","last_unstale":"2024-09-16T01:18:26.974186+0000","last_undegraded":"2024-09-16T01:18:26.974186+0000","last_fullsized":"2024-09-16T01:18:26.974186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:54.295314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597917+0000","last_change":"2024-09-16T01:18:25.595310+0000","last_active":"2024-09-16T01:18:26.597917+0000","last_peered":"2024-09-16T01:18:26.597917+0000","last_clean":"2024-09-16T01:18:26.597917+0000","last_became_active":"2024-09-16T01:18:25.595020+0000","last_became_peered":"2024-09-16T01:18:25.595020+0000","last_unstale":"2024-09-16T01:18:26.597917+0000","last_undegraded":"2024-09-16T01:18:26.597917+0000","last_fullsized":"2024-09-16T01:18:26.597917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:32.554429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595727+0000","last_change":"2024-09-16T01:18:25.606694+0000","last_active":"2024-09-16T01:18:26.595727+0000","last_peered":"2024-09-16T01:18:26.595727+0000","last_clean":"2024-09-16T01:18:26.595727+0000","last_became_active":"2024-09-16T01:18:25.606409+0000","last_became_peered":"2024-09-16T01:18:25.606409+0000","last_unstale":"2024-09-16T01:18:26.595727+0000","last_undegraded":"2024-09-16T01:18:26.595727+0000","last_fullsized":"2024-09-16T01:18:26.595727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:52.495069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974643+0000","last_change":"2024-09-16T01:18:25.610612+0000","last_active":"2024-09-16T01:18:26.974643+0000","last_peered":"2024-09-16T01:18:26.974643+0000","last_clean":"2024-09-16T01:18:26.974643+0000","last_became_active":"2024-09-16T01:18:25.609798+0000","last_became_peered":"2024-09-16T01:18:25.609798+0000","last_unstale":"2024-09-16T01:18:26.974643+0000","last_undegraded":"2024-09-16T01:18:26.974643+0000","last_fullsized":"2024-09-16T01:18:26.974643+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:54.295314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974815+0000","last_change":"2024-09-16T01:18:25.606723+0000","last_active":"2024-09-16T01:18:26.974815+0000","last_peered":"2024-09-16T01:18:26.974815+0000","last_clean":"2024-09-16T01:18:26.974815+0000","last_became_active":"2024-09-16T01:18:25.606440+0000","last_became_peered":"2024-09-16T01:18:25.606440+0000","last_unstale":"2024-09-16T01:18:26.974815+0000","last_undegraded":"2024-09-16T01:18:26.974815+0000","last_fullsized":"2024-09-16T01:18:26.974815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:17.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597796+0000","last_change":"2024-09-16T01:18:25.599993+0000","last_active":"2024-09-16T01:18:26.597796+0000","last_peered":"2024-09-16T01:18:26.597796+0000","last_clean":"2024-09-16T01:18:26.597796+0000","last_became_active":"2024-09-16T01:18:25.599727+0000","last_became_peered":"2024-09-16T01:18:25.599727+0000","last_unstale":"2024-09-16T01:18:26.597796+0000","last_undegraded":"2024-09-16T01:18:26.597796+0000","last_fullsized":"2024-09-16T01:18:26.597796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:24.082531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595978+0000","last_change":"2024-09-16T01:18:25.611397+0000","last_active":"2024-09-16T01:18:26.595978+0000","last_peered":"2024-09-16T01:18:26.595978+0000","last_clean":"2024-09-16T01:18:26.595978+0000","last_became_active":"2024-09-16T01:18:25.610949+0000","last_became_peered":"2024-09-16T01:18:25.610949+0000","last_unstale":"2024-09-16T01:18:26.595978+0000","last_undegraded":"2024-09-16T01:18:26.595978+0000","last_fullsized":"2024-09-16T01:18:26.595978+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:46.880865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974072+0000","last_change":"2024-09-16T01:18:25.603289+0000","last_active":"2024-09-16T01:18:26.974072+0000","last_peered":"2024-09-16T01:18:26.974072+0000","last_clean":"2024-09-16T01:18:26.974072+0000","last_became_active":"2024-09-16T01:18:25.603016+0000","last_became_peered":"2024-09-16T01:18:25.603016+0000","last_unstale":"2024-09-16T01:18:26.974072+0000","last_undegraded":"2024-09-16T01:18:26.974072+0000","last_fullsized":"2024-09-16T01:18:26.974072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:20.635284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974341+0000","last_change":"2024-09-16T01:18:25.614425+0000","last_active":"2024-09-16T01:18:26.974341+0000","last_peered":"2024-09-16T01:18:26.974341+0000","last_clean":"2024-09-16T01:18:26.974341+0000","last_became_active":"2024-09-16T01:18:25.614158+0000","last_became_peered":"2024-09-16T01:18:25.614158+0000","last_unstale":"2024-09-16T01:18:26.974341+0000","last_undegraded":"2024-09-16T01:18:26.974341+0000","last_fullsized":"2024-09-16T01:18:26.974341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:13.433784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595823+0000","last_change":"2024-09-16T01:18:25.603484+0000","last_active":"2024-09-16T01:18:26.595823+0000","last_peered":"2024-09-16T01:18:26.595823+0000","last_clean":"2024-09-16T01:18:26.595823+0000","last_became_active":"2024-09-16T01:18:25.603134+0000","last_became_peered":"2024-09-16T01:18:25.603134+0000","last_unstale":"2024-09-16T01:18:26.595823+0000","last_undegraded":"2024-09-16T01:18:26.595823+0000","last_fullsized":"2024-09-16T01:18:26.595823+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:44.968221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974353+0000","last_change":"2024-09-16T01:18:25.602078+0000","last_active":"2024-09-16T01:18:26.974353+0000","last_peered":"2024-09-16T01:18:26.974353+0000","last_clean":"2024-09-16T01:18:26.974353+0000","last_became_active":"2024-09-16T01:18:25.601577+0000","last_became_peered":"2024-09-16T01:18:25.601577+0000","last_unstale":"2024-09-16T01:18:26.974353+0000","last_undegraded":"2024-09-16T01:18:26.974353+0000","last_fullsized":"2024-09-16T01:18:26.974353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:42.066984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595833+0000","last_change":"2024-09-16T01:18:25.606932+0000","last_active":"2024-09-16T01:18:26.595833+0000","last_peered":"2024-09-16T01:18:26.595833+0000","last_clean":"2024-09-16T01:18:26.595833+0000","last_became_active":"2024-09-16T01:18:25.606695+0000","last_became_peered":"2024-09-16T01:18:25.606695+0000","last_unstale":"2024-09-16T01:18:26.595833+0000","last_undegraded":"2024-09-16T01:18:26.595833+0000","last_fullsized":"2024-09-16T01:18:26.595833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:07.370695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974076+0000","last_change":"2024-09-16T01:18:25.599991+0000","last_active":"2024-09-16T01:18:26.974076+0000","last_peered":"2024-09-16T01:18:26.974076+0000","last_clean":"2024-09-16T01:18:26.974076+0000","last_became_active":"2024-09-16T01:18:25.599713+0000","last_became_peered":"2024-09-16T01:18:25.599713+0000","last_unstale":"2024-09-16T01:18:26.974076+0000","last_undegraded":"2024-09-16T01:18:26.974076+0000","last_fullsized":"2024-09-16T01:18:26.974076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:19.139173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974489+0000","last_change":"2024-09-16T01:18:25.602001+0000","last_active":"2024-09-16T01:18:26.974489+0000","last_peered":"2024-09-16T01:18:26.974489+0000","last_clean":"2024-09-16T01:18:26.974489+0000","last_became_active":"2024-09-16T01:18:25.600073+0000","last_became_peered":"2024-09-16T01:18:25.600073+0000","last_unstale":"2024-09-16T01:18:26.974489+0000","last_undegraded":"2024-09-16T01:18:26.974489+0000","last_fullsized":"2024-09-16T01:18:26.974489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:33.088152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973961+0000","last_change":"2024-09-16T01:18:25.605434+0000","last_active":"2024-09-16T01:18:26.973961+0000","last_peered":"2024-09-16T01:18:26.973961+0000","last_clean":"2024-09-16T01:18:26.973961+0000","last_became_active":"2024-09-16T01:18:25.605160+0000","last_became_peered":"2024-09-16T01:18:25.605160+0000","last_unstale":"2024-09-16T01:18:26.973961+0000","last_undegraded":"2024-09-16T01:18:26.973961+0000","last_fullsized":"2024-09-16T01:18:26.973961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:13.433784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598110+0000","last_change":"2024-09-16T01:18:25.596116+0000","last_active":"2024-09-16T01:18:26.598110+0000","last_peered":"2024-09-16T01:18:26.598110+0000","last_clean":"2024-09-16T01:18:26.598110+0000","last_became_active":"2024-09-16T01:18:25.595854+0000","last_became_peered":"2024-09-16T01:18:25.595854+0000","last_unstale":"2024-09-16T01:18:26.598110+0000","last_undegraded":"2024-09-16T01:18:26.598110+0000","last_fullsized":"2024-09-16T01:18:26.598110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:20.788097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598091+0000","last_change":"2024-09-16T01:18:25.601784+0000","last_active":"2024-09-16T01:18:26.598091+0000","last_peered":"2024-09-16T01:18:26.598091+0000","last_clean":"2024-09-16T01:18:26.598091+0000","last_became_active":"2024-09-16T01:18:25.601501+0000","last_became_peered":"2024-09-16T01:18:25.601501+0000","last_unstale":"2024-09-16T01:18:26.598091+0000","last_undegraded":"2024-09-16T01:18:26.598091+0000","last_fullsized":"2024-09-16T01:18:26.598091+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:15.229927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595787+0000","last_change":"2024-09-16T01:18:25.603174+0000","last_active":"2024-09-16T01:18:26.595787+0000","last_peered":"2024-09-16T01:18:26.595787+0000","last_clean":"2024-09-16T01:18:26.595787+0000","last_became_active":"2024-09-16T01:18:25.602361+0000","last_became_peered":"2024-09-16T01:18:25.602361+0000","last_unstale":"2024-09-16T01:18:26.595787+0000","last_undegraded":"2024-09-16T01:18:26.595787+0000","last_fullsized":"2024-09-16T01:18:26.595787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:31.335035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974044+0000","last_change":"2024-09-16T01:18:25.606154+0000","last_active":"2024-09-16T01:18:26.974044+0000","last_peered":"2024-09-16T01:18:26.974044+0000","last_clean":"2024-09-16T01:18:26.974044+0000","last_became_active":"2024-09-16T01:18:25.605912+0000","last_became_peered":"2024-09-16T01:18:25.605912+0000","last_unstale":"2024-09-16T01:18:26.974044+0000","last_undegraded":"2024-09-16T01:18:26.974044+0000","last_fullsized":"2024-09-16T01:18:26.974044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:50.328132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598462+0000","last_change":"2024-09-16T01:18:25.603581+0000","last_active":"2024-09-16T01:18:26.598462+0000","last_peered":"2024-09-16T01:18:26.598462+0000","last_clean":"2024-09-16T01:18:26.598462+0000","last_became_active":"2024-09-16T01:18:25.603301+0000","last_became_peered":"2024-09-16T01:18:25.603301+0000","last_unstale":"2024-09-16T01:18:26.598462+0000","last_undegraded":"2024-09-16T01:18:26.598462+0000","last_fullsized":"2024-09-16T01:18:26.598462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:33.088152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973629+0000","last_change":"2024-09-16T01:18:25.597227+0000","last_active":"2024-09-16T01:18:26.973629+0000","last_peered":"2024-09-16T01:18:26.973629+0000","last_clean":"2024-09-16T01:18:26.973629+0000","last_became_active":"2024-09-16T01:18:25.596964+0000","last_became_peered":"2024-09-16T01:18:25.596964+0000","last_unstale":"2024-09-16T01:18:26.973629+0000","last_undegraded":"2024-09-16T01:18:26.973629+0000","last_fullsized":"2024-09-16T01:18:26.973629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:43.762133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597912+0000","last_change":"2024-09-16T01:18:25.603424+0000","last_active":"2024-09-16T01:18:26.597912+0000","last_peered":"2024-09-16T01:18:26.597912+0000","last_clean":"2024-09-16T01:18:26.597912+0000","last_became_active":"2024-09-16T01:18:25.603010+0000","last_became_peered":"2024-09-16T01:18:25.603010+0000","last_unstale":"2024-09-16T01:18:26.597912+0000","last_undegraded":"2024-09-16T01:18:26.597912+0000","last_fullsized":"2024-09-16T01:18:26.597912+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:13.483572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974140+0000","last_change":"2024-09-16T01:18:25.599804+0000","last_active":"2024-09-16T01:18:26.974140+0000","last_peered":"2024-09-16T01:18:26.974140+0000","last_clean":"2024-09-16T01:18:26.974140+0000","last_became_active":"2024-09-16T01:18:25.599536+0000","last_became_peered":"2024-09-16T01:18:25.599536+0000","last_unstale":"2024-09-16T01:18:26.974140+0000","last_undegraded":"2024-09-16T01:18:26.974140+0000","last_fullsized":"2024-09-16T01:18:26.974140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:44.178474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.596027+0000","last_change":"2024-09-16T01:18:24.602351+0000","last_active":"2024-09-16T01:18:26.596027+0000","last_peered":"2024-09-16T01:18:26.596027+0000","last_clean":"2024-09-16T01:18:26.596027+0000","last_became_active":"2024-09-16T01:18:24.602067+0000","last_became_peered":"2024-09-16T01:18:24.602067+0000","last_unstale":"2024-09-16T01:18:26.596027+0000","last_undegraded":"2024-09-16T01:18:26.596027+0000","last_fullsized":"2024-09-16T01:18:26.596027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:06.353086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974965+0000","last_change":"2024-09-16T01:18:25.600340+0000","last_active":"2024-09-16T01:18:26.974965+0000","last_peered":"2024-09-16T01:18:26.974965+0000","last_clean":"2024-09-16T01:18:26.974965+0000","last_became_active":"2024-09-16T01:18:25.600069+0000","last_became_peered":"2024-09-16T01:18:25.600069+0000","last_unstale":"2024-09-16T01:18:26.974965+0000","last_undegraded":"2024-09-16T01:18:26.974965+0000","last_fullsized":"2024-09-16T01:18:26.974965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:10.289186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597968+0000","last_change":"2024-09-16T01:18:24.599871+0000","last_active":"2024-09-16T01:18:26.597968+0000","last_peered":"2024-09-16T01:18:26.597968+0000","last_clean":"2024-09-16T01:18:26.597968+0000","last_became_active":"2024-09-16T01:18:24.599549+0000","last_became_peered":"2024-09-16T01:18:24.599549+0000","last_unstale":"2024-09-16T01:18:26.597968+0000","last_undegraded":"2024-09-16T01:18:26.597968+0000","last_fullsized":"2024-09-16T01:18:26.597968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:31.552431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974565+0000","last_change":"2024-09-16T01:18:25.604815+0000","last_active":"2024-09-16T01:18:26.974565+0000","last_peered":"2024-09-16T01:18:26.974565+0000","last_clean":"2024-09-16T01:18:26.974565+0000","last_became_active":"2024-09-16T01:18:25.604557+0000","last_became_peered":"2024-09-16T01:18:25.604557+0000","last_unstale":"2024-09-16T01:18:26.974565+0000","last_undegraded":"2024-09-16T01:18:26.974565+0000","last_fullsized":"2024-09-16T01:18:26.974565+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:55.446610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598186+0000","last_change":"2024-09-16T01:18:24.600723+0000","last_active":"2024-09-16T01:18:26.598186+0000","last_peered":"2024-09-16T01:18:26.598186+0000","last_clean":"2024-09-16T01:18:26.598186+0000","last_became_active":"2024-09-16T01:18:24.600402+0000","last_became_peered":"2024-09-16T01:18:24.600402+0000","last_unstale":"2024-09-16T01:18:26.598186+0000","last_undegraded":"2024-09-16T01:18:26.598186+0000","last_fullsized":"2024-09-16T01:18:26.598186+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:01.193856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974443+0000","last_change":"2024-09-16T01:18:25.601846+0000","last_active":"2024-09-16T01:18:26.974443+0000","last_peered":"2024-09-16T01:18:26.974443+0000","last_clean":"2024-09-16T01:18:26.974443+0000","last_became_active":"2024-09-16T01:18:25.601234+0000","last_became_peered":"2024-09-16T01:18:25.601234+0000","last_unstale":"2024-09-16T01:18:26.974443+0000","last_undegraded":"2024-09-16T01:18:26.974443+0000","last_fullsized":"2024-09-16T01:18:26.974443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:09.916017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974890+0000","last_change":"2024-09-16T01:18:24.597244+0000","last_active":"2024-09-16T01:18:26.974890+0000","last_peered":"2024-09-16T01:18:26.974890+0000","last_clean":"2024-09-16T01:18:26.974890+0000","last_became_active":"2024-09-16T01:18:24.596942+0000","last_became_peered":"2024-09-16T01:18:24.596942+0000","last_unstale":"2024-09-16T01:18:26.974890+0000","last_undegraded":"2024-09-16T01:18:26.974890+0000","last_fullsized":"2024-09-16T01:18:26.974890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:53.213301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974194+0000","last_change":"2024-09-16T01:18:25.608265+0000","last_active":"2024-09-16T01:18:26.974194+0000","last_peered":"2024-09-16T01:18:26.974194+0000","last_clean":"2024-09-16T01:18:26.974194+0000","last_became_active":"2024-09-16T01:18:25.607995+0000","last_became_peered":"2024-09-16T01:18:25.607995+0000","last_unstale":"2024-09-16T01:18:26.974194+0000","last_undegraded":"2024-09-16T01:18:26.974194+0000","last_fullsized":"2024-09-16T01:18:26.974194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:52.933445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974464+0000","last_change":"2024-09-16T01:18:24.597339+0000","last_active":"2024-09-16T01:18:26.974464+0000","last_peered":"2024-09-16T01:18:26.974464+0000","last_clean":"2024-09-16T01:18:26.974464+0000","last_became_active":"2024-09-16T01:18:24.597038+0000","last_became_peered":"2024-09-16T01:18:24.597038+0000","last_unstale":"2024-09-16T01:18:26.974464+0000","last_undegraded":"2024-09-16T01:18:26.974464+0000","last_fullsized":"2024-09-16T01:18:26.974464+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:50.965230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974319+0000","last_change":"2024-09-16T01:18:25.608398+0000","last_active":"2024-09-16T01:18:26.974319+0000","last_peered":"2024-09-16T01:18:26.974319+0000","last_clean":"2024-09-16T01:18:26.974319+0000","last_became_active":"2024-09-16T01:18:25.608140+0000","last_became_peered":"2024-09-16T01:18:25.608140+0000","last_unstale":"2024-09-16T01:18:26.974319+0000","last_undegraded":"2024-09-16T01:18:26.974319+0000","last_fullsized":"2024-09-16T01:18:26.974319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:13.483572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597627+0000","last_change":"2024-09-16T01:18:24.587456+0000","last_active":"2024-09-16T01:18:26.597627+0000","last_peered":"2024-09-16T01:18:26.597627+0000","last_clean":"2024-09-16T01:18:26.597627+0000","last_became_active":"2024-09-16T01:18:24.587103+0000","last_became_peered":"2024-09-16T01:18:24.587103+0000","last_unstale":"2024-09-16T01:18:26.597627+0000","last_undegraded":"2024-09-16T01:18:26.597627+0000","last_fullsized":"2024-09-16T01:18:26.597627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:27.957548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974404+0000","last_change":"2024-09-16T01:18:25.606897+0000","last_active":"2024-09-16T01:18:26.974404+0000","last_peered":"2024-09-16T01:18:26.974404+0000","last_clean":"2024-09-16T01:18:26.974404+0000","last_became_active":"2024-09-16T01:18:25.606595+0000","last_became_peered":"2024-09-16T01:18:25.606595+0000","last_unstale":"2024-09-16T01:18:26.974404+0000","last_undegraded":"2024-09-16T01:18:26.974404+0000","last_fullsized":"2024-09-16T01:18:26.974404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:47.006707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975069+0000","last_change":"2024-09-16T01:18:24.592977+0000","last_active":"2024-09-16T01:18:26.975069+0000","last_peered":"2024-09-16T01:18:26.975069+0000","last_clean":"2024-09-16T01:18:26.975069+0000","last_became_active":"2024-09-16T01:18:24.592516+0000","last_became_peered":"2024-09-16T01:18:24.592516+0000","last_unstale":"2024-09-16T01:18:26.975069+0000","last_undegraded":"2024-09-16T01:18:26.975069+0000","last_fullsized":"2024-09-16T01:18:26.975069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:42.846668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974892+0000","last_change":"2024-09-16T01:18:25.609247+0000","last_active":"2024-09-16T01:18:26.974892+0000","last_peered":"2024-09-16T01:18:26.974892+0000","last_clean":"2024-09-16T01:18:26.974892+0000","last_became_active":"2024-09-16T01:18:25.608915+0000","last_became_peered":"2024-09-16T01:18:25.608915+0000","last_unstale":"2024-09-16T01:18:26.974892+0000","last_undegraded":"2024-09-16T01:18:26.974892+0000","last_fullsized":"2024-09-16T01:18:26.974892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:44.178474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595502+0000","last_change":"2024-09-16T01:18:24.599229+0000","last_active":"2024-09-16T01:18:26.595502+0000","last_peered":"2024-09-16T01:18:26.595502+0000","last_clean":"2024-09-16T01:18:26.595502+0000","last_became_active":"2024-09-16T01:18:24.598594+0000","last_became_peered":"2024-09-16T01:18:24.598594+0000","last_unstale":"2024-09-16T01:18:26.595502+0000","last_undegraded":"2024-09-16T01:18:26.595502+0000","last_fullsized":"2024-09-16T01:18:26.595502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:50.290745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974490+0000","last_change":"2024-09-16T01:18:25.598938+0000","last_active":"2024-09-16T01:18:26.974490+0000","last_peered":"2024-09-16T01:18:26.974490+0000","last_clean":"2024-09-16T01:18:26.974490+0000","last_became_active":"2024-09-16T01:18:25.598668+0000","last_became_peered":"2024-09-16T01:18:25.598668+0000","last_unstale":"2024-09-16T01:18:26.974490+0000","last_undegraded":"2024-09-16T01:18:26.974490+0000","last_fullsized":"2024-09-16T01:18:26.974490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:19.615579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598542+0000","last_change":"2024-09-16T01:18:24.599860+0000","last_active":"2024-09-16T01:18:26.598542+0000","last_peered":"2024-09-16T01:18:26.598542+0000","last_clean":"2024-09-16T01:18:26.598542+0000","last_became_active":"2024-09-16T01:18:24.599558+0000","last_became_peered":"2024-09-16T01:18:24.599558+0000","last_unstale":"2024-09-16T01:18:26.598542+0000","last_undegraded":"2024-09-16T01:18:26.598542+0000","last_fullsized":"2024-09-16T01:18:26.598542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:17:37.279209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597702+0000","last_change":"2024-09-16T01:18:25.601977+0000","last_active":"2024-09-16T01:18:26.597702+0000","last_peered":"2024-09-16T01:18:26.597702+0000","last_clean":"2024-09-16T01:18:26.597702+0000","last_became_active":"2024-09-16T01:18:25.600968+0000","last_became_peered":"2024-09-16T01:18:25.600968+0000","last_unstale":"2024-09-16T01:18:26.597702+0000","last_undegraded":"2024-09-16T01:18:26.597702+0000","last_fullsized":"2024-09-16T01:18:26.597702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:28.777384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598215+0000","last_change":"2024-09-16T01:18:24.597231+0000","last_active":"2024-09-16T01:18:26.598215+0000","last_peered":"2024-09-16T01:18:26.598215+0000","last_clean":"2024-09-16T01:18:26.598215+0000","last_became_active":"2024-09-16T01:18:24.597002+0000","last_became_peered":"2024-09-16T01:18:24.597002+0000","last_unstale":"2024-09-16T01:18:26.598215+0000","last_undegraded":"2024-09-16T01:18:26.598215+0000","last_fullsized":"2024-09-16T01:18:26.598215+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:14.245484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974463+0000","last_change":"2024-09-16T01:18:25.610174+0000","last_active":"2024-09-16T01:18:26.974463+0000","last_peered":"2024-09-16T01:18:26.974463+0000","last_clean":"2024-09-16T01:18:26.974463+0000","last_became_active":"2024-09-16T01:18:25.609464+0000","last_became_peered":"2024-09-16T01:18:25.609464+0000","last_unstale":"2024-09-16T01:18:26.974463+0000","last_undegraded":"2024-09-16T01:18:26.974463+0000","last_fullsized":"2024-09-16T01:18:26.974463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:50.328132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595974+0000","last_change":"2024-09-16T01:18:24.599283+0000","last_active":"2024-09-16T01:18:26.595974+0000","last_peered":"2024-09-16T01:18:26.595974+0000","last_clean":"2024-09-16T01:18:26.595974+0000","last_became_active":"2024-09-16T01:18:24.598801+0000","last_became_peered":"2024-09-16T01:18:24.598801+0000","last_unstale":"2024-09-16T01:18:26.595974+0000","last_undegraded":"2024-09-16T01:18:26.595974+0000","last_fullsized":"2024-09-16T01:18:26.595974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:23.958215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973711+0000","last_change":"2024-09-16T01:18:25.612150+0000","last_active":"2024-09-16T01:18:26.973711+0000","last_peered":"2024-09-16T01:18:26.973711+0000","last_clean":"2024-09-16T01:18:26.973711+0000","last_became_active":"2024-09-16T01:18:25.611609+0000","last_became_peered":"2024-09-16T01:18:25.611609+0000","last_unstale":"2024-09-16T01:18:26.973711+0000","last_undegraded":"2024-09-16T01:18:26.973711+0000","last_fullsized":"2024-09-16T01:18:26.973711+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:46.870356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975019+0000","last_change":"2024-09-16T01:18:24.592177+0000","last_active":"2024-09-16T01:18:26.975019+0000","last_peered":"2024-09-16T01:18:26.975019+0000","last_clean":"2024-09-16T01:18:26.975019+0000","last_became_active":"2024-09-16T01:18:24.591862+0000","last_became_peered":"2024-09-16T01:18:24.591862+0000","last_unstale":"2024-09-16T01:18:26.975019+0000","last_undegraded":"2024-09-16T01:18:26.975019+0000","last_fullsized":"2024-09-16T01:18:26.975019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:18.137175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598017+0000","last_change":"2024-09-16T01:18:25.602737+0000","last_active":"2024-09-16T01:18:26.598017+0000","last_peered":"2024-09-16T01:18:26.598017+0000","last_clean":"2024-09-16T01:18:26.598017+0000","last_became_active":"2024-09-16T01:18:25.602437+0000","last_became_peered":"2024-09-16T01:18:25.602437+0000","last_unstale":"2024-09-16T01:18:26.598017+0000","last_undegraded":"2024-09-16T01:18:26.598017+0000","last_fullsized":"2024-09-16T01:18:26.598017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:43:18.969342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597660+0000","last_change":"2024-09-16T01:18:24.589884+0000","last_active":"2024-09-16T01:18:26.597660+0000","last_peered":"2024-09-16T01:18:26.597660+0000","last_clean":"2024-09-16T01:18:26.597660+0000","last_became_active":"2024-09-16T01:18:24.589673+0000","last_became_peered":"2024-09-16T01:18:24.589673+0000","last_unstale":"2024-09-16T01:18:26.597660+0000","last_undegraded":"2024-09-16T01:18:26.597660+0000","last_fullsized":"2024-09-16T01:18:26.597660+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:30.191827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974569+0000","last_change":"2024-09-16T01:18:25.601970+0000","last_active":"2024-09-16T01:18:26.974569+0000","last_peered":"2024-09-16T01:18:26.974569+0000","last_clean":"2024-09-16T01:18:26.974569+0000","last_became_active":"2024-09-16T01:18:25.601691+0000","last_became_peered":"2024-09-16T01:18:25.601691+0000","last_unstale":"2024-09-16T01:18:26.974569+0000","last_undegraded":"2024-09-16T01:18:26.974569+0000","last_fullsized":"2024-09-16T01:18:26.974569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:58.328293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598459+0000","last_change":"2024-09-16T01:18:24.601834+0000","last_active":"2024-09-16T01:18:26.598459+0000","last_peered":"2024-09-16T01:18:26.598459+0000","last_clean":"2024-09-16T01:18:26.598459+0000","last_became_active":"2024-09-16T01:18:24.601580+0000","last_became_peered":"2024-09-16T01:18:24.601580+0000","last_unstale":"2024-09-16T01:18:26.598459+0000","last_undegraded":"2024-09-16T01:18:26.598459+0000","last_fullsized":"2024-09-16T01:18:26.598459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:19.786099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975034+0000","last_change":"2024-09-16T01:18:25.598302+0000","last_active":"2024-09-16T01:18:26.975034+0000","last_peered":"2024-09-16T01:18:26.975034+0000","last_clean":"2024-09-16T01:18:26.975034+0000","last_became_active":"2024-09-16T01:18:25.597991+0000","last_became_peered":"2024-09-16T01:18:25.597991+0000","last_unstale":"2024-09-16T01:18:26.975034+0000","last_undegraded":"2024-09-16T01:18:26.975034+0000","last_fullsized":"2024-09-16T01:18:26.975034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:08.660319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595551+0000","last_change":"2024-09-16T01:18:24.602826+0000","last_active":"2024-09-16T01:18:26.595551+0000","last_peered":"2024-09-16T01:18:26.595551+0000","last_clean":"2024-09-16T01:18:26.595551+0000","last_became_active":"2024-09-16T01:18:24.602589+0000","last_became_peered":"2024-09-16T01:18:24.602589+0000","last_unstale":"2024-09-16T01:18:26.595551+0000","last_undegraded":"2024-09-16T01:18:26.595551+0000","last_fullsized":"2024-09-16T01:18:26.595551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:03.589292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975013+0000","last_change":"2024-09-16T01:18:25.603705+0000","last_active":"2024-09-16T01:18:26.975013+0000","last_peered":"2024-09-16T01:18:26.975013+0000","last_clean":"2024-09-16T01:18:26.975013+0000","last_became_active":"2024-09-16T01:18:25.602231+0000","last_became_peered":"2024-09-16T01:18:25.602231+0000","last_unstale":"2024-09-16T01:18:26.975013+0000","last_undegraded":"2024-09-16T01:18:26.975013+0000","last_fullsized":"2024-09-16T01:18:26.975013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:31.193825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974583+0000","last_change":"2024-09-16T01:18:24.586756+0000","last_active":"2024-09-16T01:18:26.974583+0000","last_peered":"2024-09-16T01:18:26.974583+0000","last_clean":"2024-09-16T01:18:26.974583+0000","last_became_active":"2024-09-16T01:18:24.586480+0000","last_became_peered":"2024-09-16T01:18:24.586480+0000","last_unstale":"2024-09-16T01:18:26.974583+0000","last_undegraded":"2024-09-16T01:18:26.974583+0000","last_fullsized":"2024-09-16T01:18:26.974583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:20.364637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973462+0000","last_change":"2024-09-16T01:18:25.600293+0000","last_active":"2024-09-16T01:18:26.973462+0000","last_peered":"2024-09-16T01:18:26.973462+0000","last_clean":"2024-09-16T01:18:26.973462+0000","last_became_active":"2024-09-16T01:18:25.600028+0000","last_became_peered":"2024-09-16T01:18:25.600028+0000","last_unstale":"2024-09-16T01:18:26.973462+0000","last_undegraded":"2024-09-16T01:18:26.973462+0000","last_fullsized":"2024-09-16T01:18:26.973462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:58.876763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598693+0000","last_change":"2024-09-16T01:18:24.599203+0000","last_active":"2024-09-16T01:18:26.598693+0000","last_peered":"2024-09-16T01:18:26.598693+0000","last_clean":"2024-09-16T01:18:26.598693+0000","last_became_active":"2024-09-16T01:18:24.598901+0000","last_became_peered":"2024-09-16T01:18:24.598901+0000","last_unstale":"2024-09-16T01:18:26.598693+0000","last_undegraded":"2024-09-16T01:18:26.598693+0000","last_fullsized":"2024-09-16T01:18:26.598693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:23.626669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595500+0000","last_change":"2024-09-16T01:18:25.609425+0000","last_active":"2024-09-16T01:18:26.595500+0000","last_peered":"2024-09-16T01:18:26.595500+0000","last_clean":"2024-09-16T01:18:26.595500+0000","last_became_active":"2024-09-16T01:18:25.609068+0000","last_became_peered":"2024-09-16T01:18:25.609068+0000","last_unstale":"2024-09-16T01:18:26.595500+0000","last_undegraded":"2024-09-16T01:18:26.595500+0000","last_fullsized":"2024-09-16T01:18:26.595500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:13:33.013778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974695+0000","last_change":"2024-09-16T01:18:24.595779+0000","last_active":"2024-09-16T01:18:26.974695+0000","last_peered":"2024-09-16T01:18:26.974695+0000","last_clean":"2024-09-16T01:18:26.974695+0000","last_became_active":"2024-09-16T01:18:24.595488+0000","last_became_peered":"2024-09-16T01:18:24.595488+0000","last_unstale":"2024-09-16T01:18:26.974695+0000","last_undegraded":"2024-09-16T01:18:26.974695+0000","last_fullsized":"2024-09-16T01:18:26.974695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:36.578701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595596+0000","last_change":"2024-09-16T01:18:25.610931+0000","last_active":"2024-09-16T01:18:26.595596+0000","last_peered":"2024-09-16T01:18:26.595596+0000","last_clean":"2024-09-16T01:18:26.595596+0000","last_became_active":"2024-09-16T01:18:25.610673+0000","last_became_peered":"2024-09-16T01:18:25.610673+0000","last_unstale":"2024-09-16T01:18:26.595596+0000","last_undegraded":"2024-09-16T01:18:26.595596+0000","last_fullsized":"2024-09-16T01:18:26.595596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:06.513506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.596045+0000","last_change":"2024-09-16T01:18:24.599513+0000","last_active":"2024-09-16T01:18:26.596045+0000","last_peered":"2024-09-16T01:18:26.596045+0000","last_clean":"2024-09-16T01:18:26.596045+0000","last_became_active":"2024-09-16T01:18:24.598736+0000","last_became_peered":"2024-09-16T01:18:24.598736+0000","last_unstale":"2024-09-16T01:18:26.596045+0000","last_undegraded":"2024-09-16T01:18:26.596045+0000","last_fullsized":"2024-09-16T01:18:26.596045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:14.012940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974299+0000","last_change":"2024-09-16T01:18:25.614538+0000","last_active":"2024-09-16T01:18:26.974299+0000","last_peered":"2024-09-16T01:18:26.974299+0000","last_clean":"2024-09-16T01:18:26.974299+0000","last_became_active":"2024-09-16T01:18:25.614253+0000","last_became_peered":"2024-09-16T01:18:25.614253+0000","last_unstale":"2024-09-16T01:18:26.974299+0000","last_undegraded":"2024-09-16T01:18:26.974299+0000","last_fullsized":"2024-09-16T01:18:26.974299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:23.334834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973808+0000","last_change":"2024-09-16T01:18:24.601156+0000","last_active":"2024-09-16T01:18:26.973808+0000","last_peered":"2024-09-16T01:18:26.973808+0000","last_clean":"2024-09-16T01:18:26.973808+0000","last_became_active":"2024-09-16T01:18:24.600860+0000","last_became_peered":"2024-09-16T01:18:24.600860+0000","last_unstale":"2024-09-16T01:18:26.973808+0000","last_undegraded":"2024-09-16T01:18:26.973808+0000","last_fullsized":"2024-09-16T01:18:26.973808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:46.004709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974324+0000","last_change":"2024-09-16T01:18:25.601946+0000","last_active":"2024-09-16T01:18:26.974324+0000","last_peered":"2024-09-16T01:18:26.974324+0000","last_clean":"2024-09-16T01:18:26.974324+0000","last_became_active":"2024-09-16T01:18:25.601693+0000","last_became_peered":"2024-09-16T01:18:25.601693+0000","last_unstale":"2024-09-16T01:18:26.974324+0000","last_undegraded":"2024-09-16T01:18:26.974324+0000","last_fullsized":"2024-09-16T01:18:26.974324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:15.229927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973705+0000","last_change":"2024-09-16T01:18:24.594968+0000","last_active":"2024-09-16T01:18:26.973705+0000","last_peered":"2024-09-16T01:18:26.973705+0000","last_clean":"2024-09-16T01:18:26.973705+0000","last_became_active":"2024-09-16T01:18:24.594708+0000","last_became_peered":"2024-09-16T01:18:24.594708+0000","last_unstale":"2024-09-16T01:18:26.973705+0000","last_undegraded":"2024-09-16T01:18:26.973705+0000","last_fullsized":"2024-09-16T01:18:26.973705+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:59.679666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974599+0000","last_change":"2024-09-16T01:18:25.604022+0000","last_active":"2024-09-16T01:18:26.974599+0000","last_peered":"2024-09-16T01:18:26.974599+0000","last_clean":"2024-09-16T01:18:26.974599+0000","last_became_active":"2024-09-16T01:18:25.603759+0000","last_became_peered":"2024-09-16T01:18:25.603759+0000","last_unstale":"2024-09-16T01:18:26.974599+0000","last_undegraded":"2024-09-16T01:18:26.974599+0000","last_fullsized":"2024-09-16T01:18:26.974599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:26.763892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973500+0000","last_change":"2024-09-16T01:18:24.593858+0000","last_active":"2024-09-16T01:18:26.973500+0000","last_peered":"2024-09-16T01:18:26.973500+0000","last_clean":"2024-09-16T01:18:26.973500+0000","last_became_active":"2024-09-16T01:18:24.593598+0000","last_became_peered":"2024-09-16T01:18:24.593598+0000","last_unstale":"2024-09-16T01:18:26.973500+0000","last_undegraded":"2024-09-16T01:18:26.973500+0000","last_fullsized":"2024-09-16T01:18:26.973500+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:27.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975031+0000","last_change":"2024-09-16T01:18:25.593166+0000","last_active":"2024-09-16T01:18:26.975031+0000","last_peered":"2024-09-16T01:18:26.975031+0000","last_clean":"2024-09-16T01:18:26.975031+0000","last_became_active":"2024-09-16T01:18:25.592350+0000","last_became_peered":"2024-09-16T01:18:25.592350+0000","last_unstale":"2024-09-16T01:18:26.975031+0000","last_undegraded":"2024-09-16T01:18:26.975031+0000","last_fullsized":"2024-09-16T01:18:26.975031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:15.247482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973631+0000","last_change":"2024-09-16T01:18:24.593964+0000","last_active":"2024-09-16T01:18:26.973631+0000","last_peered":"2024-09-16T01:18:26.973631+0000","last_clean":"2024-09-16T01:18:26.973631+0000","last_became_active":"2024-09-16T01:18:24.592686+0000","last_became_peered":"2024-09-16T01:18:24.592686+0000","last_unstale":"2024-09-16T01:18:26.973631+0000","last_undegraded":"2024-09-16T01:18:26.973631+0000","last_fullsized":"2024-09-16T01:18:26.973631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:30.700156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974667+0000","last_change":"2024-09-16T01:18:25.606646+0000","last_active":"2024-09-16T01:18:26.974667+0000","last_peered":"2024-09-16T01:18:26.974667+0000","last_clean":"2024-09-16T01:18:26.974667+0000","last_became_active":"2024-09-16T01:18:25.606379+0000","last_became_peered":"2024-09-16T01:18:25.606379+0000","last_unstale":"2024-09-16T01:18:26.974667+0000","last_undegraded":"2024-09-16T01:18:26.974667+0000","last_fullsized":"2024-09-16T01:18:26.974667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:39.130875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598730+0000","last_change":"2024-09-16T01:18:24.595804+0000","last_active":"2024-09-16T01:18:26.598730+0000","last_peered":"2024-09-16T01:18:26.598730+0000","last_clean":"2024-09-16T01:18:26.598730+0000","last_became_active":"2024-09-16T01:18:24.595529+0000","last_became_peered":"2024-09-16T01:18:24.595529+0000","last_unstale":"2024-09-16T01:18:26.598730+0000","last_undegraded":"2024-09-16T01:18:26.598730+0000","last_fullsized":"2024-09-16T01:18:26.598730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:07.658321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974710+0000","last_change":"2024-09-16T01:18:25.600812+0000","last_active":"2024-09-16T01:18:26.974710+0000","last_peered":"2024-09-16T01:18:26.974710+0000","last_clean":"2024-09-16T01:18:26.974710+0000","last_became_active":"2024-09-16T01:18:25.598756+0000","last_became_peered":"2024-09-16T01:18:25.598756+0000","last_unstale":"2024-09-16T01:18:26.974710+0000","last_undegraded":"2024-09-16T01:18:26.974710+0000","last_fullsized":"2024-09-16T01:18:26.974710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:20.635284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974652+0000","last_change":"2024-09-16T01:18:24.603407+0000","last_active":"2024-09-16T01:18:26.974652+0000","last_peered":"2024-09-16T01:18:26.974652+0000","last_clean":"2024-09-16T01:18:26.974652+0000","last_became_active":"2024-09-16T01:18:24.603125+0000","last_became_peered":"2024-09-16T01:18:24.603125+0000","last_unstale":"2024-09-16T01:18:26.974652+0000","last_undegraded":"2024-09-16T01:18:26.974652+0000","last_fullsized":"2024-09-16T01:18:26.974652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:27.252288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974717+0000","last_change":"2024-09-16T01:18:25.604633+0000","last_active":"2024-09-16T01:18:26.974717+0000","last_peered":"2024-09-16T01:18:26.974717+0000","last_clean":"2024-09-16T01:18:26.974717+0000","last_became_active":"2024-09-16T01:18:25.604232+0000","last_became_peered":"2024-09-16T01:18:25.604232+0000","last_unstale":"2024-09-16T01:18:26.974717+0000","last_undegraded":"2024-09-16T01:18:26.974717+0000","last_fullsized":"2024-09-16T01:18:26.974717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:51.567153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598452+0000","last_change":"2024-09-16T01:18:24.599669+0000","last_active":"2024-09-16T01:18:26.598452+0000","last_peered":"2024-09-16T01:18:26.598452+0000","last_clean":"2024-09-16T01:18:26.598452+0000","last_became_active":"2024-09-16T01:18:24.599290+0000","last_became_peered":"2024-09-16T01:18:24.599290+0000","last_unstale":"2024-09-16T01:18:26.598452+0000","last_undegraded":"2024-09-16T01:18:26.598452+0000","last_fullsized":"2024-09-16T01:18:26.598452+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:12.532623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974213+0000","last_change":"2024-09-16T01:18:25.599150+0000","last_active":"2024-09-16T01:18:26.974213+0000","last_peered":"2024-09-16T01:18:26.974213+0000","last_clean":"2024-09-16T01:18:26.974213+0000","last_became_active":"2024-09-16T01:18:25.598275+0000","last_became_peered":"2024-09-16T01:18:25.598275+0000","last_unstale":"2024-09-16T01:18:26.974213+0000","last_undegraded":"2024-09-16T01:18:26.974213+0000","last_fullsized":"2024-09-16T01:18:26.974213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:24.082531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598086+0000","last_change":"2024-09-16T01:18:24.599566+0000","last_active":"2024-09-16T01:18:26.598086+0000","last_peered":"2024-09-16T01:18:26.598086+0000","last_clean":"2024-09-16T01:18:26.598086+0000","last_became_active":"2024-09-16T01:18:24.599283+0000","last_became_peered":"2024-09-16T01:18:24.599283+0000","last_unstale":"2024-09-16T01:18:26.598086+0000","last_undegraded":"2024-09-16T01:18:26.598086+0000","last_fullsized":"2024-09-16T01:18:26.598086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:43:17.967344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974891+0000","last_change":"2024-09-16T01:18:25.604359+0000","last_active":"2024-09-16T01:18:26.974891+0000","last_peered":"2024-09-16T01:18:26.974891+0000","last_clean":"2024-09-16T01:18:26.974891+0000","last_became_active":"2024-09-16T01:18:25.602588+0000","last_became_peered":"2024-09-16T01:18:25.602588+0000","last_unstale":"2024-09-16T01:18:26.974891+0000","last_undegraded":"2024-09-16T01:18:26.974891+0000","last_fullsized":"2024-09-16T01:18:26.974891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:28.959546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974328+0000","last_change":"2024-09-16T01:18:24.597370+0000","last_active":"2024-09-16T01:18:26.974328+0000","last_peered":"2024-09-16T01:18:26.974328+0000","last_clean":"2024-09-16T01:18:26.974328+0000","last_became_active":"2024-09-16T01:18:24.597049+0000","last_became_peered":"2024-09-16T01:18:24.597049+0000","last_unstale":"2024-09-16T01:18:26.974328+0000","last_undegraded":"2024-09-16T01:18:26.974328+0000","last_fullsized":"2024-09-16T01:18:26.974328+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:13.763834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974595+0000","last_change":"2024-09-16T01:18:25.609193+0000","last_active":"2024-09-16T01:18:26.974595+0000","last_peered":"2024-09-16T01:18:26.974595+0000","last_clean":"2024-09-16T01:18:26.974595+0000","last_became_active":"2024-09-16T01:18:25.608878+0000","last_became_peered":"2024-09-16T01:18:25.608878+0000","last_unstale":"2024-09-16T01:18:26.974595+0000","last_undegraded":"2024-09-16T01:18:26.974595+0000","last_fullsized":"2024-09-16T01:18:26.974595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:43.762133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595857+0000","last_change":"2024-09-16T01:18:24.602604+0000","last_active":"2024-09-16T01:18:26.595857+0000","last_peered":"2024-09-16T01:18:26.595857+0000","last_clean":"2024-09-16T01:18:26.595857+0000","last_became_active":"2024-09-16T01:18:24.602327+0000","last_became_peered":"2024-09-16T01:18:24.602327+0000","last_unstale":"2024-09-16T01:18:26.595857+0000","last_undegraded":"2024-09-16T01:18:26.595857+0000","last_fullsized":"2024-09-16T01:18:26.595857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:28.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974213+0000","last_change":"2024-09-16T01:18:25.612050+0000","last_active":"2024-09-16T01:18:26.974213+0000","last_peered":"2024-09-16T01:18:26.974213+0000","last_clean":"2024-09-16T01:18:26.974213+0000","last_became_active":"2024-09-16T01:18:25.611734+0000","last_became_peered":"2024-09-16T01:18:25.611734+0000","last_unstale":"2024-09-16T01:18:26.974213+0000","last_undegraded":"2024-09-16T01:18:26.974213+0000","last_fullsized":"2024-09-16T01:18:26.974213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:28.959546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974689+0000","last_change":"2024-09-16T01:18:24.589958+0000","last_active":"2024-09-16T01:18:26.974689+0000","last_peered":"2024-09-16T01:18:26.974689+0000","last_clean":"2024-09-16T01:18:26.974689+0000","last_became_active":"2024-09-16T01:18:24.589714+0000","last_became_peered":"2024-09-16T01:18:24.589714+0000","last_unstale":"2024-09-16T01:18:26.974689+0000","last_undegraded":"2024-09-16T01:18:26.974689+0000","last_fullsized":"2024-09-16T01:18:26.974689+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:43.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974422+0000","last_change":"2024-09-16T01:18:25.600774+0000","last_active":"2024-09-16T01:18:26.974422+0000","last_peered":"2024-09-16T01:18:26.974422+0000","last_clean":"2024-09-16T01:18:26.974422+0000","last_became_active":"2024-09-16T01:18:25.600496+0000","last_became_peered":"2024-09-16T01:18:25.600496+0000","last_unstale":"2024-09-16T01:18:26.974422+0000","last_undegraded":"2024-09-16T01:18:26.974422+0000","last_fullsized":"2024-09-16T01:18:26.974422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:31.193825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974235+0000","last_change":"2024-09-16T01:18:24.596421+0000","last_active":"2024-09-16T01:18:26.974235+0000","last_peered":"2024-09-16T01:18:26.974235+0000","last_clean":"2024-09-16T01:18:26.974235+0000","last_became_active":"2024-09-16T01:18:24.596188+0000","last_became_peered":"2024-09-16T01:18:24.596188+0000","last_unstale":"2024-09-16T01:18:26.974235+0000","last_undegraded":"2024-09-16T01:18:26.974235+0000","last_fullsized":"2024-09-16T01:18:26.974235+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:41.064986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598320+0000","last_change":"2024-09-16T01:18:25.602377+0000","last_active":"2024-09-16T01:18:26.598320+0000","last_peered":"2024-09-16T01:18:26.598320+0000","last_clean":"2024-09-16T01:18:26.598320+0000","last_became_active":"2024-09-16T01:18:25.602114+0000","last_became_peered":"2024-09-16T01:18:25.602114+0000","last_unstale":"2024-09-16T01:18:26.598320+0000","last_undegraded":"2024-09-16T01:18:26.598320+0000","last_fullsized":"2024-09-16T01:18:26.598320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:20.143941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974681+0000","last_change":"2024-09-16T01:18:24.593849+0000","last_active":"2024-09-16T01:18:26.974681+0000","last_peered":"2024-09-16T01:18:26.974681+0000","last_clean":"2024-09-16T01:18:26.974681+0000","last_became_active":"2024-09-16T01:18:24.593553+0000","last_became_peered":"2024-09-16T01:18:24.593553+0000","last_unstale":"2024-09-16T01:18:26.974681+0000","last_undegraded":"2024-09-16T01:18:26.974681+0000","last_fullsized":"2024-09-16T01:18:26.974681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:31.552431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":271,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597866+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:18:26.597866+0000","last_peered":"2024-09-16T01:18:26.597866+0000","last_clean":"2024-09-16T01:18:26.597866+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:18:26.597866+0000","last_undegraded":"2024-09-16T01:18:26.597866+0000","last_fullsized":"2024-09-16T01:18:26.597866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32676,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1515520,"data_stored":1006029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":929792,"data_stored":417251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":415673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":937984,"data_stored":417355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":921600,"data_stored":416221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":416381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":925696,"data_stored":415751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1511424,"data_stored":1006007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:18:33.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:18:33.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.244+0000 7f2e66680640 1 Processor -- start 2024-09-16T01:18:33.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.244+0000 7f2e66680640 1 -- start start 2024-09-16T01:18:33.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e66680640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2e6015e740 0x7f2e600d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e66680640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e6006dbd0 0x7f2e6006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e66680640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e600d0780 con 0x7f2e6009b690 2024-09-16T01:18:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e66680640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6015eb20 con 0x7f2e6006dbd0 2024-09-16T01:18:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e66680640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6006d260 con 0x7f2e6015e740 2024-09-16T01:18:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e64c1d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e6006dbd0 0x7f2e6006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e5f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2e6009b690 0x7f2e6006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52030/0 (socket says 172.21.15.81:52030) 2024-09-16T01:18:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e5f7fe640 1 -- 172.21.15.81:0/2630192256 learned_addr learned my addr 172.21.15.81:0/2630192256 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e5ffff640 1 --2- 172.21.15.81:0/2630192256 >> v2:172.21.15.102:3300/0 conn(0x7f2e6015e740 0x7f2e600d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e64c1d640 1 -- 172.21.15.81:0/2630192256 >> v2:172.21.15.102:3300/0 conn(0x7f2e6015e740 msgr2=0x7f2e600d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e64c1d640 1 --2- 172.21.15.81:0/2630192256 >> v2:172.21.15.102:3300/0 conn(0x7f2e6015e740 0x7f2e600d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e64c1d640 1 -- 172.21.15.81:0/2630192256 >> v1:172.21.15.81:6789/0 conn(0x7f2e6009b690 legacy=0x7f2e6006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e64c1d640 1 -- 172.21.15.81:0/2630192256 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e600d0a60 con 0x7f2e6006dbd0 2024-09-16T01:18:33.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.245+0000 7f2e5effd640 1 -- 172.21.15.81:0/2630192256 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3963669940 0 0) 0x7f2e600d0780 con 0x7f2e6009b690 2024-09-16T01:18:33.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.246+0000 7f2e64c1d640 1 --2- 172.21.15.81:0/2630192256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e6006dbd0 0x7f2e6006cd20 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2e60074070 tx=0x7f2e5802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4b2ce7e5b77acd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:33.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.246+0000 7f2e5effd640 1 -- 172.21.15.81:0/2630192256 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58007740 con 0x7f2e6006dbd0 2024-09-16T01:18:33.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.246+0000 7f2e5effd640 1 -- 172.21.15.81:0/2630192256 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e580078e0 con 0x7f2e6006dbd0 2024-09-16T01:18:33.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.246+0000 7f2e5effd640 1 -- 172.21.15.81:0/2630192256 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58007cb0 con 0x7f2e6006dbd0 2024-09-16T01:18:33.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.247+0000 7f2e66680640 1 -- 172.21.15.81:0/2630192256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e6006dbd0 msgr2=0x7f2e6006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.247+0000 7f2e66680640 1 --2- 172.21.15.81:0/2630192256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e6006dbd0 0x7f2e6006cd20 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2e60074070 tx=0x7f2e5802a710 comp rx=0 tx=0).stop 2024-09-16T01:18:33.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.247+0000 7f2e66680640 1 -- 172.21.15.81:0/2630192256 shutdown_connections 2024-09-16T01:18:33.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.247+0000 7f2e66680640 1 --2- 172.21.15.81:0/2630192256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e6006dbd0 0x7f2e6006cd20 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.247+0000 7f2e66680640 1 --2- 172.21.15.81:0/2630192256 >> v2:172.21.15.102:3300/0 conn(0x7f2e6015e740 0x7f2e600d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.247+0000 7f2e66680640 1 -- 172.21.15.81:0/2630192256 >> 172.21.15.81:0/2630192256 conn(0x7f2e600d23a0 msgr2=0x7f2e600d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:33.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.247+0000 7f2e66680640 1 -- 172.21.15.81:0/2630192256 shutdown_connections 2024-09-16T01:18:33.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.247+0000 7f2e66680640 1 -- 172.21.15.81:0/2630192256 wait complete. 2024-09-16T01:18:33.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.248+0000 7f2e66680640 1 Processor -- start 2024-09-16T01:18:33.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.248+0000 7f2e66680640 1 -- start start 2024-09-16T01:18:33.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.249+0000 7f2e66680640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e6006dbd0 0x7f2e60155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.249+0000 7f2e66680640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e6009b690 0x7f2e600b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.249+0000 7f2e66680640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6015e740 0x7f2e6015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.249+0000 7f2e66680640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6009bac0 con 0x7f2e6006dbd0 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.249+0000 7f2e66680640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2e600d1020 con 0x7f2e6015e740 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.249+0000 7f2e66680640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6006dfe0 con 0x7f2e6009b690 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.249+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e6006dbd0 0x7f2e60155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.249+0000 7f2e5ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e6006dbd0 0x7f2e60155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36662/0 (socket says 172.21.15.81:36662) 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.249+0000 7f2e5ffff640 1 -- 172.21.15.81:0/1477103852 learned_addr learned my addr 172.21.15.81:0/1477103852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.249+0000 7f2e5f7fe640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e6009b690 0x7f2e600b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e64c1d640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6015e740 0x7f2e6015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e5ffff640 1 -- 172.21.15.81:0/1477103852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e6009b690 msgr2=0x7f2e600b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e5ffff640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e6009b690 0x7f2e600b6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e5ffff640 1 -- 172.21.15.81:0/1477103852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6015e740 msgr2=0x7f2e6015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e5ffff640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6015e740 0x7f2e6015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e5ffff640 1 -- 172.21.15.81:0/1477103852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e601f7820 con 0x7f2e6006dbd0 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e5f7fe640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e6009b690 0x7f2e600b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e64c1d640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6015e740 0x7f2e6015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e5ffff640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e6006dbd0 0x7f2e60155a00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000d830 tx=0x7f2e5000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e5cff9640 1 -- 172.21.15.81:0/1477103852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5000b6c0 con 0x7f2e6006dbd0 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e5cff9640 1 -- 172.21.15.81:0/1477103852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e50019070 con 0x7f2e6006dbd0 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e66680640 1 -- 172.21.15.81:0/1477103852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e601f7b00 con 0x7f2e6006dbd0 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e5cff9640 1 -- 172.21.15.81:0/1477103852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5000bac0 con 0x7f2e6006dbd0 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.250+0000 7f2e66680640 1 -- 172.21.15.81:0/1477103852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e601f80c0 con 0x7f2e6006dbd0 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.251+0000 7f2e66680640 1 -- 172.21.15.81:0/1477103852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e600d0780 con 0x7f2e6006dbd0 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.251+0000 7f2e5cff9640 1 -- 172.21.15.81:0/1477103852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2e5001e460 con 0x7f2e6006dbd0 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.252+0000 7f2e5cff9640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e4c06c2e0 0x7f2e4c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.252+0000 7f2e5cff9640 1 -- 172.21.15.81:0/1477103852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f2e5008bcb0 con 0x7f2e6006dbd0 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.252+0000 7f2e5f7fe640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e4c06c2e0 0x7f2e4c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.252+0000 7f2e5f7fe640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e4c06c2e0 0x7f2e4c06e7a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2e6015b240 tx=0x7f2e54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:33.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.256+0000 7f2e5cff9640 1 -- 172.21.15.81:0/1477103852 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e5005a290 con 0x7f2e6006dbd0 2024-09-16T01:18:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.418+0000 7f2e66680640 1 -- 172.21.15.81:0/1477103852 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e600d1cb0 con 0x7f2e4c06c2e0 2024-09-16T01:18:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.424+0000 7f2e5cff9640 1 -- 172.21.15.81:0/1477103852 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252072 (secure 0 0 0) 0x7f2e600d1cb0 con 0x7f2e4c06c2e0 2024-09-16T01:18:33.427 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:33.428 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:18:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.427+0000 7f2e66680640 1 -- 172.21.15.81:0/1477103852 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e4c06c2e0 msgr2=0x7f2e4c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.427+0000 7f2e66680640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e4c06c2e0 0x7f2e4c06e7a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2e6015b240 tx=0x7f2e54009040 comp rx=0 tx=0).stop 2024-09-16T01:18:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.427+0000 7f2e66680640 1 -- 172.21.15.81:0/1477103852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e6006dbd0 msgr2=0x7f2e60155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.427+0000 7f2e66680640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e6006dbd0 0x7f2e60155a00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2e5000d830 tx=0x7f2e5000dcf0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.427+0000 7f2e66680640 1 -- 172.21.15.81:0/1477103852 shutdown_connections 2024-09-16T01:18:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.427+0000 7f2e66680640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2e4c06c2e0 0x7f2e4c06e7a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.427+0000 7f2e66680640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6015e740 0x7f2e6015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.427+0000 7f2e66680640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e6009b690 0x7f2e600b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.427+0000 7f2e66680640 1 --2- 172.21.15.81:0/1477103852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e6006dbd0 0x7f2e60155a00 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.427+0000 7f2e66680640 1 -- 172.21.15.81:0/1477103852 >> 172.21.15.81:0/1477103852 conn(0x7f2e600d23a0 msgr2=0x7f2e600b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.427+0000 7f2e66680640 1 -- 172.21.15.81:0/1477103852 shutdown_connections 2024-09-16T01:18:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.427+0000 7f2e66680640 1 -- 172.21.15.81:0/1477103852 wait complete. 2024-09-16T01:18:33.439 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-16T01:18:32.095009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241272,"kb_used_data":8392,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754733448,"statfs":{"total":773094113280,"available":772847050752,"internally_reserved":0,"allocated":8593408,"data_stored":4510668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.515865"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598588+0000","last_change":"2024-09-16T01:18:25.603313+0000","last_active":"2024-09-16T01:18:26.598588+0000","last_peered":"2024-09-16T01:18:26.598588+0000","last_clean":"2024-09-16T01:18:26.598588+0000","last_became_active":"2024-09-16T01:18:25.603022+0000","last_became_peered":"2024-09-16T01:18:25.603022+0000","last_unstale":"2024-09-16T01:18:26.598588+0000","last_undegraded":"2024-09-16T01:18:26.598588+0000","last_fullsized":"2024-09-16T01:18:26.598588+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:19.615579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974453+0000","last_change":"2024-09-16T01:18:25.608017+0000","last_active":"2024-09-16T01:18:26.974453+0000","last_peered":"2024-09-16T01:18:26.974453+0000","last_clean":"2024-09-16T01:18:26.974453+0000","last_became_active":"2024-09-16T01:18:25.607710+0000","last_became_peered":"2024-09-16T01:18:25.607710+0000","last_unstale":"2024-09-16T01:18:26.974453+0000","last_undegraded":"2024-09-16T01:18:26.974453+0000","last_fullsized":"2024-09-16T01:18:26.974453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:20.143941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974611+0000","last_change":"2024-09-16T01:18:25.612158+0000","last_active":"2024-09-16T01:18:26.974611+0000","last_peered":"2024-09-16T01:18:26.974611+0000","last_clean":"2024-09-16T01:18:26.974611+0000","last_became_active":"2024-09-16T01:18:25.609379+0000","last_became_peered":"2024-09-16T01:18:25.609379+0000","last_unstale":"2024-09-16T01:18:26.974611+0000","last_undegraded":"2024-09-16T01:18:26.974611+0000","last_fullsized":"2024-09-16T01:18:26.974611+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:08.660319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597832+0000","last_change":"2024-09-16T01:18:25.601554+0000","last_active":"2024-09-16T01:18:26.597832+0000","last_peered":"2024-09-16T01:18:26.597832+0000","last_clean":"2024-09-16T01:18:26.597832+0000","last_became_active":"2024-09-16T01:18:25.601058+0000","last_became_peered":"2024-09-16T01:18:25.601058+0000","last_unstale":"2024-09-16T01:18:26.597832+0000","last_undegraded":"2024-09-16T01:18:26.597832+0000","last_fullsized":"2024-09-16T01:18:26.597832+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:00.681664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595763+0000","last_change":"2024-09-16T01:18:25.604753+0000","last_active":"2024-09-16T01:18:26.595763+0000","last_peered":"2024-09-16T01:18:26.595763+0000","last_clean":"2024-09-16T01:18:26.595763+0000","last_became_active":"2024-09-16T01:18:25.604479+0000","last_became_peered":"2024-09-16T01:18:25.604479+0000","last_unstale":"2024-09-16T01:18:26.595763+0000","last_undegraded":"2024-09-16T01:18:26.595763+0000","last_fullsized":"2024-09-16T01:18:26.595763+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:49.516535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974316+0000","last_change":"2024-09-16T01:18:25.610378+0000","last_active":"2024-09-16T01:18:26.974316+0000","last_peered":"2024-09-16T01:18:26.974316+0000","last_clean":"2024-09-16T01:18:26.974316+0000","last_became_active":"2024-09-16T01:18:25.609971+0000","last_became_peered":"2024-09-16T01:18:25.609971+0000","last_unstale":"2024-09-16T01:18:26.974316+0000","last_undegraded":"2024-09-16T01:18:26.974316+0000","last_fullsized":"2024-09-16T01:18:26.974316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:50:55.501383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974598+0000","last_change":"2024-09-16T01:18:25.606680+0000","last_active":"2024-09-16T01:18:26.974598+0000","last_peered":"2024-09-16T01:18:26.974598+0000","last_clean":"2024-09-16T01:18:26.974598+0000","last_became_active":"2024-09-16T01:18:25.606384+0000","last_became_peered":"2024-09-16T01:18:25.606384+0000","last_unstale":"2024-09-16T01:18:26.974598+0000","last_undegraded":"2024-09-16T01:18:26.974598+0000","last_fullsized":"2024-09-16T01:18:26.974598+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:46.870356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595507+0000","last_change":"2024-09-16T01:18:25.605429+0000","last_active":"2024-09-16T01:18:26.595507+0000","last_peered":"2024-09-16T01:18:26.595507+0000","last_clean":"2024-09-16T01:18:26.595507+0000","last_became_active":"2024-09-16T01:18:25.605161+0000","last_became_peered":"2024-09-16T01:18:25.605161+0000","last_unstale":"2024-09-16T01:18:26.595507+0000","last_undegraded":"2024-09-16T01:18:26.595507+0000","last_fullsized":"2024-09-16T01:18:26.595507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:53.788733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974442+0000","last_change":"2024-09-16T01:18:25.605780+0000","last_active":"2024-09-16T01:18:26.974442+0000","last_peered":"2024-09-16T01:18:26.974442+0000","last_clean":"2024-09-16T01:18:26.974442+0000","last_became_active":"2024-09-16T01:18:25.605509+0000","last_became_peered":"2024-09-16T01:18:25.605509+0000","last_unstale":"2024-09-16T01:18:26.974442+0000","last_undegraded":"2024-09-16T01:18:26.974442+0000","last_fullsized":"2024-09-16T01:18:26.974442+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:09.627521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598318+0000","last_change":"2024-09-16T01:18:25.590617+0000","last_active":"2024-09-16T01:18:26.598318+0000","last_peered":"2024-09-16T01:18:26.598318+0000","last_clean":"2024-09-16T01:18:26.598318+0000","last_became_active":"2024-09-16T01:18:25.590296+0000","last_became_peered":"2024-09-16T01:18:25.590296+0000","last_unstale":"2024-09-16T01:18:26.598318+0000","last_undegraded":"2024-09-16T01:18:26.598318+0000","last_fullsized":"2024-09-16T01:18:26.598318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:02.195854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974186+0000","last_change":"2024-09-16T01:18:25.608998+0000","last_active":"2024-09-16T01:18:26.974186+0000","last_peered":"2024-09-16T01:18:26.974186+0000","last_clean":"2024-09-16T01:18:26.974186+0000","last_became_active":"2024-09-16T01:18:25.608751+0000","last_became_peered":"2024-09-16T01:18:25.608751+0000","last_unstale":"2024-09-16T01:18:26.974186+0000","last_undegraded":"2024-09-16T01:18:26.974186+0000","last_fullsized":"2024-09-16T01:18:26.974186+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:54.295314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597917+0000","last_change":"2024-09-16T01:18:25.595310+0000","last_active":"2024-09-16T01:18:26.597917+0000","last_peered":"2024-09-16T01:18:26.597917+0000","last_clean":"2024-09-16T01:18:26.597917+0000","last_became_active":"2024-09-16T01:18:25.595020+0000","last_became_peered":"2024-09-16T01:18:25.595020+0000","last_unstale":"2024-09-16T01:18:26.597917+0000","last_undegraded":"2024-09-16T01:18:26.597917+0000","last_fullsized":"2024-09-16T01:18:26.597917+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:32.554429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595727+0000","last_change":"2024-09-16T01:18:25.606694+0000","last_active":"2024-09-16T01:18:26.595727+0000","last_peered":"2024-09-16T01:18:26.595727+0000","last_clean":"2024-09-16T01:18:26.595727+0000","last_became_active":"2024-09-16T01:18:25.606409+0000","last_became_peered":"2024-09-16T01:18:25.606409+0000","last_unstale":"2024-09-16T01:18:26.595727+0000","last_undegraded":"2024-09-16T01:18:26.595727+0000","last_fullsized":"2024-09-16T01:18:26.595727+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:52.495069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974643+0000","last_change":"2024-09-16T01:18:25.610612+0000","last_active":"2024-09-16T01:18:26.974643+0000","last_peered":"2024-09-16T01:18:26.974643+0000","last_clean":"2024-09-16T01:18:26.974643+0000","last_became_active":"2024-09-16T01:18:25.609798+0000","last_became_peered":"2024-09-16T01:18:25.609798+0000","last_unstale":"2024-09-16T01:18:26.974643+0000","last_undegraded":"2024-09-16T01:18:26.974643+0000","last_fullsized":"2024-09-16T01:18:26.974643+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:54.295314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974815+0000","last_change":"2024-09-16T01:18:25.606723+0000","last_active":"2024-09-16T01:18:26.974815+0000","last_peered":"2024-09-16T01:18:26.974815+0000","last_clean":"2024-09-16T01:18:26.974815+0000","last_became_active":"2024-09-16T01:18:25.606440+0000","last_became_peered":"2024-09-16T01:18:25.606440+0000","last_unstale":"2024-09-16T01:18:26.974815+0000","last_undegraded":"2024-09-16T01:18:26.974815+0000","last_fullsized":"2024-09-16T01:18:26.974815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:17.174576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597796+0000","last_change":"2024-09-16T01:18:25.599993+0000","last_active":"2024-09-16T01:18:26.597796+0000","last_peered":"2024-09-16T01:18:26.597796+0000","last_clean":"2024-09-16T01:18:26.597796+0000","last_became_active":"2024-09-16T01:18:25.599727+0000","last_became_peered":"2024-09-16T01:18:25.599727+0000","last_unstale":"2024-09-16T01:18:26.597796+0000","last_undegraded":"2024-09-16T01:18:26.597796+0000","last_fullsized":"2024-09-16T01:18:26.597796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:24.082531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595978+0000","last_change":"2024-09-16T01:18:25.611397+0000","last_active":"2024-09-16T01:18:26.595978+0000","last_peered":"2024-09-16T01:18:26.595978+0000","last_clean":"2024-09-16T01:18:26.595978+0000","last_became_active":"2024-09-16T01:18:25.610949+0000","last_became_peered":"2024-09-16T01:18:25.610949+0000","last_unstale":"2024-09-16T01:18:26.595978+0000","last_undegraded":"2024-09-16T01:18:26.595978+0000","last_fullsized":"2024-09-16T01:18:26.595978+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:46.880865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974072+0000","last_change":"2024-09-16T01:18:25.603289+0000","last_active":"2024-09-16T01:18:26.974072+0000","last_peered":"2024-09-16T01:18:26.974072+0000","last_clean":"2024-09-16T01:18:26.974072+0000","last_became_active":"2024-09-16T01:18:25.603016+0000","last_became_peered":"2024-09-16T01:18:25.603016+0000","last_unstale":"2024-09-16T01:18:26.974072+0000","last_undegraded":"2024-09-16T01:18:26.974072+0000","last_fullsized":"2024-09-16T01:18:26.974072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:20.635284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974341+0000","last_change":"2024-09-16T01:18:25.614425+0000","last_active":"2024-09-16T01:18:26.974341+0000","last_peered":"2024-09-16T01:18:26.974341+0000","last_clean":"2024-09-16T01:18:26.974341+0000","last_became_active":"2024-09-16T01:18:25.614158+0000","last_became_peered":"2024-09-16T01:18:25.614158+0000","last_unstale":"2024-09-16T01:18:26.974341+0000","last_undegraded":"2024-09-16T01:18:26.974341+0000","last_fullsized":"2024-09-16T01:18:26.974341+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:13.433784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595823+0000","last_change":"2024-09-16T01:18:25.603484+0000","last_active":"2024-09-16T01:18:26.595823+0000","last_peered":"2024-09-16T01:18:26.595823+0000","last_clean":"2024-09-16T01:18:26.595823+0000","last_became_active":"2024-09-16T01:18:25.603134+0000","last_became_peered":"2024-09-16T01:18:25.603134+0000","last_unstale":"2024-09-16T01:18:26.595823+0000","last_undegraded":"2024-09-16T01:18:26.595823+0000","last_fullsized":"2024-09-16T01:18:26.595823+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:44.968221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974353+0000","last_change":"2024-09-16T01:18:25.602078+0000","last_active":"2024-09-16T01:18:26.974353+0000","last_peered":"2024-09-16T01:18:26.974353+0000","last_clean":"2024-09-16T01:18:26.974353+0000","last_became_active":"2024-09-16T01:18:25.601577+0000","last_became_peered":"2024-09-16T01:18:25.601577+0000","last_unstale":"2024-09-16T01:18:26.974353+0000","last_undegraded":"2024-09-16T01:18:26.974353+0000","last_fullsized":"2024-09-16T01:18:26.974353+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:42.066984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595833+0000","last_change":"2024-09-16T01:18:25.606932+0000","last_active":"2024-09-16T01:18:26.595833+0000","last_peered":"2024-09-16T01:18:26.595833+0000","last_clean":"2024-09-16T01:18:26.595833+0000","last_became_active":"2024-09-16T01:18:25.606695+0000","last_became_peered":"2024-09-16T01:18:25.606695+0000","last_unstale":"2024-09-16T01:18:26.595833+0000","last_undegraded":"2024-09-16T01:18:26.595833+0000","last_fullsized":"2024-09-16T01:18:26.595833+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:07.370695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974076+0000","last_change":"2024-09-16T01:18:25.599991+0000","last_active":"2024-09-16T01:18:26.974076+0000","last_peered":"2024-09-16T01:18:26.974076+0000","last_clean":"2024-09-16T01:18:26.974076+0000","last_became_active":"2024-09-16T01:18:25.599713+0000","last_became_peered":"2024-09-16T01:18:25.599713+0000","last_unstale":"2024-09-16T01:18:26.974076+0000","last_undegraded":"2024-09-16T01:18:26.974076+0000","last_fullsized":"2024-09-16T01:18:26.974076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:19.139173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974489+0000","last_change":"2024-09-16T01:18:25.602001+0000","last_active":"2024-09-16T01:18:26.974489+0000","last_peered":"2024-09-16T01:18:26.974489+0000","last_clean":"2024-09-16T01:18:26.974489+0000","last_became_active":"2024-09-16T01:18:25.600073+0000","last_became_peered":"2024-09-16T01:18:25.600073+0000","last_unstale":"2024-09-16T01:18:26.974489+0000","last_undegraded":"2024-09-16T01:18:26.974489+0000","last_fullsized":"2024-09-16T01:18:26.974489+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:33.088152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973961+0000","last_change":"2024-09-16T01:18:25.605434+0000","last_active":"2024-09-16T01:18:26.973961+0000","last_peered":"2024-09-16T01:18:26.973961+0000","last_clean":"2024-09-16T01:18:26.973961+0000","last_became_active":"2024-09-16T01:18:25.605160+0000","last_became_peered":"2024-09-16T01:18:25.605160+0000","last_unstale":"2024-09-16T01:18:26.973961+0000","last_undegraded":"2024-09-16T01:18:26.973961+0000","last_fullsized":"2024-09-16T01:18:26.973961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:13.433784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598110+0000","last_change":"2024-09-16T01:18:25.596116+0000","last_active":"2024-09-16T01:18:26.598110+0000","last_peered":"2024-09-16T01:18:26.598110+0000","last_clean":"2024-09-16T01:18:26.598110+0000","last_became_active":"2024-09-16T01:18:25.595854+0000","last_became_peered":"2024-09-16T01:18:25.595854+0000","last_unstale":"2024-09-16T01:18:26.598110+0000","last_undegraded":"2024-09-16T01:18:26.598110+0000","last_fullsized":"2024-09-16T01:18:26.598110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:20.788097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598091+0000","last_change":"2024-09-16T01:18:25.601784+0000","last_active":"2024-09-16T01:18:26.598091+0000","last_peered":"2024-09-16T01:18:26.598091+0000","last_clean":"2024-09-16T01:18:26.598091+0000","last_became_active":"2024-09-16T01:18:25.601501+0000","last_became_peered":"2024-09-16T01:18:25.601501+0000","last_unstale":"2024-09-16T01:18:26.598091+0000","last_undegraded":"2024-09-16T01:18:26.598091+0000","last_fullsized":"2024-09-16T01:18:26.598091+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:15.229927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595787+0000","last_change":"2024-09-16T01:18:25.603174+0000","last_active":"2024-09-16T01:18:26.595787+0000","last_peered":"2024-09-16T01:18:26.595787+0000","last_clean":"2024-09-16T01:18:26.595787+0000","last_became_active":"2024-09-16T01:18:25.602361+0000","last_became_peered":"2024-09-16T01:18:25.602361+0000","last_unstale":"2024-09-16T01:18:26.595787+0000","last_undegraded":"2024-09-16T01:18:26.595787+0000","last_fullsized":"2024-09-16T01:18:26.595787+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:31.335035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974044+0000","last_change":"2024-09-16T01:18:25.606154+0000","last_active":"2024-09-16T01:18:26.974044+0000","last_peered":"2024-09-16T01:18:26.974044+0000","last_clean":"2024-09-16T01:18:26.974044+0000","last_became_active":"2024-09-16T01:18:25.605912+0000","last_became_peered":"2024-09-16T01:18:25.605912+0000","last_unstale":"2024-09-16T01:18:26.974044+0000","last_undegraded":"2024-09-16T01:18:26.974044+0000","last_fullsized":"2024-09-16T01:18:26.974044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:50.328132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598462+0000","last_change":"2024-09-16T01:18:25.603581+0000","last_active":"2024-09-16T01:18:26.598462+0000","last_peered":"2024-09-16T01:18:26.598462+0000","last_clean":"2024-09-16T01:18:26.598462+0000","last_became_active":"2024-09-16T01:18:25.603301+0000","last_became_peered":"2024-09-16T01:18:25.603301+0000","last_unstale":"2024-09-16T01:18:26.598462+0000","last_undegraded":"2024-09-16T01:18:26.598462+0000","last_fullsized":"2024-09-16T01:18:26.598462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:33.088152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973629+0000","last_change":"2024-09-16T01:18:25.597227+0000","last_active":"2024-09-16T01:18:26.973629+0000","last_peered":"2024-09-16T01:18:26.973629+0000","last_clean":"2024-09-16T01:18:26.973629+0000","last_became_active":"2024-09-16T01:18:25.596964+0000","last_became_peered":"2024-09-16T01:18:25.596964+0000","last_unstale":"2024-09-16T01:18:26.973629+0000","last_undegraded":"2024-09-16T01:18:26.973629+0000","last_fullsized":"2024-09-16T01:18:26.973629+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:43.762133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597912+0000","last_change":"2024-09-16T01:18:25.603424+0000","last_active":"2024-09-16T01:18:26.597912+0000","last_peered":"2024-09-16T01:18:26.597912+0000","last_clean":"2024-09-16T01:18:26.597912+0000","last_became_active":"2024-09-16T01:18:25.603010+0000","last_became_peered":"2024-09-16T01:18:25.603010+0000","last_unstale":"2024-09-16T01:18:26.597912+0000","last_undegraded":"2024-09-16T01:18:26.597912+0000","last_fullsized":"2024-09-16T01:18:26.597912+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:13.483572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974140+0000","last_change":"2024-09-16T01:18:25.599804+0000","last_active":"2024-09-16T01:18:26.974140+0000","last_peered":"2024-09-16T01:18:26.974140+0000","last_clean":"2024-09-16T01:18:26.974140+0000","last_became_active":"2024-09-16T01:18:25.599536+0000","last_became_peered":"2024-09-16T01:18:25.599536+0000","last_unstale":"2024-09-16T01:18:26.974140+0000","last_undegraded":"2024-09-16T01:18:26.974140+0000","last_fullsized":"2024-09-16T01:18:26.974140+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:44.178474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.596027+0000","last_change":"2024-09-16T01:18:24.602351+0000","last_active":"2024-09-16T01:18:26.596027+0000","last_peered":"2024-09-16T01:18:26.596027+0000","last_clean":"2024-09-16T01:18:26.596027+0000","last_became_active":"2024-09-16T01:18:24.602067+0000","last_became_peered":"2024-09-16T01:18:24.602067+0000","last_unstale":"2024-09-16T01:18:26.596027+0000","last_undegraded":"2024-09-16T01:18:26.596027+0000","last_fullsized":"2024-09-16T01:18:26.596027+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:06.353086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974965+0000","last_change":"2024-09-16T01:18:25.600340+0000","last_active":"2024-09-16T01:18:26.974965+0000","last_peered":"2024-09-16T01:18:26.974965+0000","last_clean":"2024-09-16T01:18:26.974965+0000","last_became_active":"2024-09-16T01:18:25.600069+0000","last_became_peered":"2024-09-16T01:18:25.600069+0000","last_unstale":"2024-09-16T01:18:26.974965+0000","last_undegraded":"2024-09-16T01:18:26.974965+0000","last_fullsized":"2024-09-16T01:18:26.974965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:10.289186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597968+0000","last_change":"2024-09-16T01:18:24.599871+0000","last_active":"2024-09-16T01:18:26.597968+0000","last_peered":"2024-09-16T01:18:26.597968+0000","last_clean":"2024-09-16T01:18:26.597968+0000","last_became_active":"2024-09-16T01:18:24.599549+0000","last_became_peered":"2024-09-16T01:18:24.599549+0000","last_unstale":"2024-09-16T01:18:26.597968+0000","last_undegraded":"2024-09-16T01:18:26.597968+0000","last_fullsized":"2024-09-16T01:18:26.597968+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:31.552431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974565+0000","last_change":"2024-09-16T01:18:25.604815+0000","last_active":"2024-09-16T01:18:26.974565+0000","last_peered":"2024-09-16T01:18:26.974565+0000","last_clean":"2024-09-16T01:18:26.974565+0000","last_became_active":"2024-09-16T01:18:25.604557+0000","last_became_peered":"2024-09-16T01:18:25.604557+0000","last_unstale":"2024-09-16T01:18:26.974565+0000","last_undegraded":"2024-09-16T01:18:26.974565+0000","last_fullsized":"2024-09-16T01:18:26.974565+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:57:55.446610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598186+0000","last_change":"2024-09-16T01:18:24.600723+0000","last_active":"2024-09-16T01:18:26.598186+0000","last_peered":"2024-09-16T01:18:26.598186+0000","last_clean":"2024-09-16T01:18:26.598186+0000","last_became_active":"2024-09-16T01:18:24.600402+0000","last_became_peered":"2024-09-16T01:18:24.600402+0000","last_unstale":"2024-09-16T01:18:26.598186+0000","last_undegraded":"2024-09-16T01:18:26.598186+0000","last_fullsized":"2024-09-16T01:18:26.598186+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:01.193856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974443+0000","last_change":"2024-09-16T01:18:25.601846+0000","last_active":"2024-09-16T01:18:26.974443+0000","last_peered":"2024-09-16T01:18:26.974443+0000","last_clean":"2024-09-16T01:18:26.974443+0000","last_became_active":"2024-09-16T01:18:25.601234+0000","last_became_peered":"2024-09-16T01:18:25.601234+0000","last_unstale":"2024-09-16T01:18:26.974443+0000","last_undegraded":"2024-09-16T01:18:26.974443+0000","last_fullsized":"2024-09-16T01:18:26.974443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:09.916017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974890+0000","last_change":"2024-09-16T01:18:24.597244+0000","last_active":"2024-09-16T01:18:26.974890+0000","last_peered":"2024-09-16T01:18:26.974890+0000","last_clean":"2024-09-16T01:18:26.974890+0000","last_became_active":"2024-09-16T01:18:24.596942+0000","last_became_peered":"2024-09-16T01:18:24.596942+0000","last_unstale":"2024-09-16T01:18:26.974890+0000","last_undegraded":"2024-09-16T01:18:26.974890+0000","last_fullsized":"2024-09-16T01:18:26.974890+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:53.213301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974194+0000","last_change":"2024-09-16T01:18:25.608265+0000","last_active":"2024-09-16T01:18:26.974194+0000","last_peered":"2024-09-16T01:18:26.974194+0000","last_clean":"2024-09-16T01:18:26.974194+0000","last_became_active":"2024-09-16T01:18:25.607995+0000","last_became_peered":"2024-09-16T01:18:25.607995+0000","last_unstale":"2024-09-16T01:18:26.974194+0000","last_undegraded":"2024-09-16T01:18:26.974194+0000","last_fullsized":"2024-09-16T01:18:26.974194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:52.933445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974464+0000","last_change":"2024-09-16T01:18:24.597339+0000","last_active":"2024-09-16T01:18:26.974464+0000","last_peered":"2024-09-16T01:18:26.974464+0000","last_clean":"2024-09-16T01:18:26.974464+0000","last_became_active":"2024-09-16T01:18:24.597038+0000","last_became_peered":"2024-09-16T01:18:24.597038+0000","last_unstale":"2024-09-16T01:18:26.974464+0000","last_undegraded":"2024-09-16T01:18:26.974464+0000","last_fullsized":"2024-09-16T01:18:26.974464+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:50.965230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974319+0000","last_change":"2024-09-16T01:18:25.608398+0000","last_active":"2024-09-16T01:18:26.974319+0000","last_peered":"2024-09-16T01:18:26.974319+0000","last_clean":"2024-09-16T01:18:26.974319+0000","last_became_active":"2024-09-16T01:18:25.608140+0000","last_became_peered":"2024-09-16T01:18:25.608140+0000","last_unstale":"2024-09-16T01:18:26.974319+0000","last_undegraded":"2024-09-16T01:18:26.974319+0000","last_fullsized":"2024-09-16T01:18:26.974319+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:13.483572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597627+0000","last_change":"2024-09-16T01:18:24.587456+0000","last_active":"2024-09-16T01:18:26.597627+0000","last_peered":"2024-09-16T01:18:26.597627+0000","last_clean":"2024-09-16T01:18:26.597627+0000","last_became_active":"2024-09-16T01:18:24.587103+0000","last_became_peered":"2024-09-16T01:18:24.587103+0000","last_unstale":"2024-09-16T01:18:26.597627+0000","last_undegraded":"2024-09-16T01:18:26.597627+0000","last_fullsized":"2024-09-16T01:18:26.597627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:27.957548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974404+0000","last_change":"2024-09-16T01:18:25.606897+0000","last_active":"2024-09-16T01:18:26.974404+0000","last_peered":"2024-09-16T01:18:26.974404+0000","last_clean":"2024-09-16T01:18:26.974404+0000","last_became_active":"2024-09-16T01:18:25.606595+0000","last_became_peered":"2024-09-16T01:18:25.606595+0000","last_unstale":"2024-09-16T01:18:26.974404+0000","last_undegraded":"2024-09-16T01:18:26.974404+0000","last_fullsized":"2024-09-16T01:18:26.974404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:47.006707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975069+0000","last_change":"2024-09-16T01:18:24.592977+0000","last_active":"2024-09-16T01:18:26.975069+0000","last_peered":"2024-09-16T01:18:26.975069+0000","last_clean":"2024-09-16T01:18:26.975069+0000","last_became_active":"2024-09-16T01:18:24.592516+0000","last_became_peered":"2024-09-16T01:18:24.592516+0000","last_unstale":"2024-09-16T01:18:26.975069+0000","last_undegraded":"2024-09-16T01:18:26.975069+0000","last_fullsized":"2024-09-16T01:18:26.975069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:42.846668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974892+0000","last_change":"2024-09-16T01:18:25.609247+0000","last_active":"2024-09-16T01:18:26.974892+0000","last_peered":"2024-09-16T01:18:26.974892+0000","last_clean":"2024-09-16T01:18:26.974892+0000","last_became_active":"2024-09-16T01:18:25.608915+0000","last_became_peered":"2024-09-16T01:18:25.608915+0000","last_unstale":"2024-09-16T01:18:26.974892+0000","last_undegraded":"2024-09-16T01:18:26.974892+0000","last_fullsized":"2024-09-16T01:18:26.974892+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:44.178474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595502+0000","last_change":"2024-09-16T01:18:24.599229+0000","last_active":"2024-09-16T01:18:26.595502+0000","last_peered":"2024-09-16T01:18:26.595502+0000","last_clean":"2024-09-16T01:18:26.595502+0000","last_became_active":"2024-09-16T01:18:24.598594+0000","last_became_peered":"2024-09-16T01:18:24.598594+0000","last_unstale":"2024-09-16T01:18:26.595502+0000","last_undegraded":"2024-09-16T01:18:26.595502+0000","last_fullsized":"2024-09-16T01:18:26.595502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:50.290745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974490+0000","last_change":"2024-09-16T01:18:25.598938+0000","last_active":"2024-09-16T01:18:26.974490+0000","last_peered":"2024-09-16T01:18:26.974490+0000","last_clean":"2024-09-16T01:18:26.974490+0000","last_became_active":"2024-09-16T01:18:25.598668+0000","last_became_peered":"2024-09-16T01:18:25.598668+0000","last_unstale":"2024-09-16T01:18:26.974490+0000","last_undegraded":"2024-09-16T01:18:26.974490+0000","last_fullsized":"2024-09-16T01:18:26.974490+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:19.615579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598542+0000","last_change":"2024-09-16T01:18:24.599860+0000","last_active":"2024-09-16T01:18:26.598542+0000","last_peered":"2024-09-16T01:18:26.598542+0000","last_clean":"2024-09-16T01:18:26.598542+0000","last_became_active":"2024-09-16T01:18:24.599558+0000","last_became_peered":"2024-09-16T01:18:24.599558+0000","last_unstale":"2024-09-16T01:18:26.598542+0000","last_undegraded":"2024-09-16T01:18:26.598542+0000","last_fullsized":"2024-09-16T01:18:26.598542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:17:37.279209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597702+0000","last_change":"2024-09-16T01:18:25.601977+0000","last_active":"2024-09-16T01:18:26.597702+0000","last_peered":"2024-09-16T01:18:26.597702+0000","last_clean":"2024-09-16T01:18:26.597702+0000","last_became_active":"2024-09-16T01:18:25.600968+0000","last_became_peered":"2024-09-16T01:18:25.600968+0000","last_unstale":"2024-09-16T01:18:26.597702+0000","last_undegraded":"2024-09-16T01:18:26.597702+0000","last_fullsized":"2024-09-16T01:18:26.597702+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:28.777384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598215+0000","last_change":"2024-09-16T01:18:24.597231+0000","last_active":"2024-09-16T01:18:26.598215+0000","last_peered":"2024-09-16T01:18:26.598215+0000","last_clean":"2024-09-16T01:18:26.598215+0000","last_became_active":"2024-09-16T01:18:24.597002+0000","last_became_peered":"2024-09-16T01:18:24.597002+0000","last_unstale":"2024-09-16T01:18:26.598215+0000","last_undegraded":"2024-09-16T01:18:26.598215+0000","last_fullsized":"2024-09-16T01:18:26.598215+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:14.245484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974463+0000","last_change":"2024-09-16T01:18:25.610174+0000","last_active":"2024-09-16T01:18:26.974463+0000","last_peered":"2024-09-16T01:18:26.974463+0000","last_clean":"2024-09-16T01:18:26.974463+0000","last_became_active":"2024-09-16T01:18:25.609464+0000","last_became_peered":"2024-09-16T01:18:25.609464+0000","last_unstale":"2024-09-16T01:18:26.974463+0000","last_undegraded":"2024-09-16T01:18:26.974463+0000","last_fullsized":"2024-09-16T01:18:26.974463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:50.328132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595974+0000","last_change":"2024-09-16T01:18:24.599283+0000","last_active":"2024-09-16T01:18:26.595974+0000","last_peered":"2024-09-16T01:18:26.595974+0000","last_clean":"2024-09-16T01:18:26.595974+0000","last_became_active":"2024-09-16T01:18:24.598801+0000","last_became_peered":"2024-09-16T01:18:24.598801+0000","last_unstale":"2024-09-16T01:18:26.595974+0000","last_undegraded":"2024-09-16T01:18:26.595974+0000","last_fullsized":"2024-09-16T01:18:26.595974+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:23.958215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973711+0000","last_change":"2024-09-16T01:18:25.612150+0000","last_active":"2024-09-16T01:18:26.973711+0000","last_peered":"2024-09-16T01:18:26.973711+0000","last_clean":"2024-09-16T01:18:26.973711+0000","last_became_active":"2024-09-16T01:18:25.611609+0000","last_became_peered":"2024-09-16T01:18:25.611609+0000","last_unstale":"2024-09-16T01:18:26.973711+0000","last_undegraded":"2024-09-16T01:18:26.973711+0000","last_fullsized":"2024-09-16T01:18:26.973711+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:46.870356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975019+0000","last_change":"2024-09-16T01:18:24.592177+0000","last_active":"2024-09-16T01:18:26.975019+0000","last_peered":"2024-09-16T01:18:26.975019+0000","last_clean":"2024-09-16T01:18:26.975019+0000","last_became_active":"2024-09-16T01:18:24.591862+0000","last_became_peered":"2024-09-16T01:18:24.591862+0000","last_unstale":"2024-09-16T01:18:26.975019+0000","last_undegraded":"2024-09-16T01:18:26.975019+0000","last_fullsized":"2024-09-16T01:18:26.975019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:18.137175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598017+0000","last_change":"2024-09-16T01:18:25.602737+0000","last_active":"2024-09-16T01:18:26.598017+0000","last_peered":"2024-09-16T01:18:26.598017+0000","last_clean":"2024-09-16T01:18:26.598017+0000","last_became_active":"2024-09-16T01:18:25.602437+0000","last_became_peered":"2024-09-16T01:18:25.602437+0000","last_unstale":"2024-09-16T01:18:26.598017+0000","last_undegraded":"2024-09-16T01:18:26.598017+0000","last_fullsized":"2024-09-16T01:18:26.598017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:43:18.969342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597660+0000","last_change":"2024-09-16T01:18:24.589884+0000","last_active":"2024-09-16T01:18:26.597660+0000","last_peered":"2024-09-16T01:18:26.597660+0000","last_clean":"2024-09-16T01:18:26.597660+0000","last_became_active":"2024-09-16T01:18:24.589673+0000","last_became_peered":"2024-09-16T01:18:24.589673+0000","last_unstale":"2024-09-16T01:18:26.597660+0000","last_undegraded":"2024-09-16T01:18:26.597660+0000","last_fullsized":"2024-09-16T01:18:26.597660+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:30.191827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974569+0000","last_change":"2024-09-16T01:18:25.601970+0000","last_active":"2024-09-16T01:18:26.974569+0000","last_peered":"2024-09-16T01:18:26.974569+0000","last_clean":"2024-09-16T01:18:26.974569+0000","last_became_active":"2024-09-16T01:18:25.601691+0000","last_became_peered":"2024-09-16T01:18:25.601691+0000","last_unstale":"2024-09-16T01:18:26.974569+0000","last_undegraded":"2024-09-16T01:18:26.974569+0000","last_fullsized":"2024-09-16T01:18:26.974569+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:58.328293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598459+0000","last_change":"2024-09-16T01:18:24.601834+0000","last_active":"2024-09-16T01:18:26.598459+0000","last_peered":"2024-09-16T01:18:26.598459+0000","last_clean":"2024-09-16T01:18:26.598459+0000","last_became_active":"2024-09-16T01:18:24.601580+0000","last_became_peered":"2024-09-16T01:18:24.601580+0000","last_unstale":"2024-09-16T01:18:26.598459+0000","last_undegraded":"2024-09-16T01:18:26.598459+0000","last_fullsized":"2024-09-16T01:18:26.598459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:19.786099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975034+0000","last_change":"2024-09-16T01:18:25.598302+0000","last_active":"2024-09-16T01:18:26.975034+0000","last_peered":"2024-09-16T01:18:26.975034+0000","last_clean":"2024-09-16T01:18:26.975034+0000","last_became_active":"2024-09-16T01:18:25.597991+0000","last_became_peered":"2024-09-16T01:18:25.597991+0000","last_unstale":"2024-09-16T01:18:26.975034+0000","last_undegraded":"2024-09-16T01:18:26.975034+0000","last_fullsized":"2024-09-16T01:18:26.975034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:08.660319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595551+0000","last_change":"2024-09-16T01:18:24.602826+0000","last_active":"2024-09-16T01:18:26.595551+0000","last_peered":"2024-09-16T01:18:26.595551+0000","last_clean":"2024-09-16T01:18:26.595551+0000","last_became_active":"2024-09-16T01:18:24.602589+0000","last_became_peered":"2024-09-16T01:18:24.602589+0000","last_unstale":"2024-09-16T01:18:26.595551+0000","last_undegraded":"2024-09-16T01:18:26.595551+0000","last_fullsized":"2024-09-16T01:18:26.595551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:26:03.589292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975013+0000","last_change":"2024-09-16T01:18:25.603705+0000","last_active":"2024-09-16T01:18:26.975013+0000","last_peered":"2024-09-16T01:18:26.975013+0000","last_clean":"2024-09-16T01:18:26.975013+0000","last_became_active":"2024-09-16T01:18:25.602231+0000","last_became_peered":"2024-09-16T01:18:25.602231+0000","last_unstale":"2024-09-16T01:18:26.975013+0000","last_undegraded":"2024-09-16T01:18:26.975013+0000","last_fullsized":"2024-09-16T01:18:26.975013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:31.193825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974583+0000","last_change":"2024-09-16T01:18:24.586756+0000","last_active":"2024-09-16T01:18:26.974583+0000","last_peered":"2024-09-16T01:18:26.974583+0000","last_clean":"2024-09-16T01:18:26.974583+0000","last_became_active":"2024-09-16T01:18:24.586480+0000","last_became_peered":"2024-09-16T01:18:24.586480+0000","last_unstale":"2024-09-16T01:18:26.974583+0000","last_undegraded":"2024-09-16T01:18:26.974583+0000","last_fullsized":"2024-09-16T01:18:26.974583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:20.364637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973462+0000","last_change":"2024-09-16T01:18:25.600293+0000","last_active":"2024-09-16T01:18:26.973462+0000","last_peered":"2024-09-16T01:18:26.973462+0000","last_clean":"2024-09-16T01:18:26.973462+0000","last_became_active":"2024-09-16T01:18:25.600028+0000","last_became_peered":"2024-09-16T01:18:25.600028+0000","last_unstale":"2024-09-16T01:18:26.973462+0000","last_undegraded":"2024-09-16T01:18:26.973462+0000","last_fullsized":"2024-09-16T01:18:26.973462+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:58.876763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598693+0000","last_change":"2024-09-16T01:18:24.599203+0000","last_active":"2024-09-16T01:18:26.598693+0000","last_peered":"2024-09-16T01:18:26.598693+0000","last_clean":"2024-09-16T01:18:26.598693+0000","last_became_active":"2024-09-16T01:18:24.598901+0000","last_became_peered":"2024-09-16T01:18:24.598901+0000","last_unstale":"2024-09-16T01:18:26.598693+0000","last_undegraded":"2024-09-16T01:18:26.598693+0000","last_fullsized":"2024-09-16T01:18:26.598693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:23.626669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595500+0000","last_change":"2024-09-16T01:18:25.609425+0000","last_active":"2024-09-16T01:18:26.595500+0000","last_peered":"2024-09-16T01:18:26.595500+0000","last_clean":"2024-09-16T01:18:26.595500+0000","last_became_active":"2024-09-16T01:18:25.609068+0000","last_became_peered":"2024-09-16T01:18:25.609068+0000","last_unstale":"2024-09-16T01:18:26.595500+0000","last_undegraded":"2024-09-16T01:18:26.595500+0000","last_fullsized":"2024-09-16T01:18:26.595500+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:13:33.013778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974695+0000","last_change":"2024-09-16T01:18:24.595779+0000","last_active":"2024-09-16T01:18:26.974695+0000","last_peered":"2024-09-16T01:18:26.974695+0000","last_clean":"2024-09-16T01:18:26.974695+0000","last_became_active":"2024-09-16T01:18:24.595488+0000","last_became_peered":"2024-09-16T01:18:24.595488+0000","last_unstale":"2024-09-16T01:18:26.974695+0000","last_undegraded":"2024-09-16T01:18:26.974695+0000","last_fullsized":"2024-09-16T01:18:26.974695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:36.578701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595596+0000","last_change":"2024-09-16T01:18:25.610931+0000","last_active":"2024-09-16T01:18:26.595596+0000","last_peered":"2024-09-16T01:18:26.595596+0000","last_clean":"2024-09-16T01:18:26.595596+0000","last_became_active":"2024-09-16T01:18:25.610673+0000","last_became_peered":"2024-09-16T01:18:25.610673+0000","last_unstale":"2024-09-16T01:18:26.595596+0000","last_undegraded":"2024-09-16T01:18:26.595596+0000","last_fullsized":"2024-09-16T01:18:26.595596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:06.513506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.596045+0000","last_change":"2024-09-16T01:18:24.599513+0000","last_active":"2024-09-16T01:18:26.596045+0000","last_peered":"2024-09-16T01:18:26.596045+0000","last_clean":"2024-09-16T01:18:26.596045+0000","last_became_active":"2024-09-16T01:18:24.598736+0000","last_became_peered":"2024-09-16T01:18:24.598736+0000","last_unstale":"2024-09-16T01:18:26.596045+0000","last_undegraded":"2024-09-16T01:18:26.596045+0000","last_fullsized":"2024-09-16T01:18:26.596045+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:14.012940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974299+0000","last_change":"2024-09-16T01:18:25.614538+0000","last_active":"2024-09-16T01:18:26.974299+0000","last_peered":"2024-09-16T01:18:26.974299+0000","last_clean":"2024-09-16T01:18:26.974299+0000","last_became_active":"2024-09-16T01:18:25.614253+0000","last_became_peered":"2024-09-16T01:18:25.614253+0000","last_unstale":"2024-09-16T01:18:26.974299+0000","last_undegraded":"2024-09-16T01:18:26.974299+0000","last_fullsized":"2024-09-16T01:18:26.974299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:23.334834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973808+0000","last_change":"2024-09-16T01:18:24.601156+0000","last_active":"2024-09-16T01:18:26.973808+0000","last_peered":"2024-09-16T01:18:26.973808+0000","last_clean":"2024-09-16T01:18:26.973808+0000","last_became_active":"2024-09-16T01:18:24.600860+0000","last_became_peered":"2024-09-16T01:18:24.600860+0000","last_unstale":"2024-09-16T01:18:26.973808+0000","last_undegraded":"2024-09-16T01:18:26.973808+0000","last_fullsized":"2024-09-16T01:18:26.973808+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:46.004709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974324+0000","last_change":"2024-09-16T01:18:25.601946+0000","last_active":"2024-09-16T01:18:26.974324+0000","last_peered":"2024-09-16T01:18:26.974324+0000","last_clean":"2024-09-16T01:18:26.974324+0000","last_became_active":"2024-09-16T01:18:25.601693+0000","last_became_peered":"2024-09-16T01:18:25.601693+0000","last_unstale":"2024-09-16T01:18:26.974324+0000","last_undegraded":"2024-09-16T01:18:26.974324+0000","last_fullsized":"2024-09-16T01:18:26.974324+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:15.229927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973705+0000","last_change":"2024-09-16T01:18:24.594968+0000","last_active":"2024-09-16T01:18:26.973705+0000","last_peered":"2024-09-16T01:18:26.973705+0000","last_clean":"2024-09-16T01:18:26.973705+0000","last_became_active":"2024-09-16T01:18:24.594708+0000","last_became_peered":"2024-09-16T01:18:24.594708+0000","last_unstale":"2024-09-16T01:18:26.973705+0000","last_undegraded":"2024-09-16T01:18:26.973705+0000","last_fullsized":"2024-09-16T01:18:26.973705+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:59.679666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974599+0000","last_change":"2024-09-16T01:18:25.604022+0000","last_active":"2024-09-16T01:18:26.974599+0000","last_peered":"2024-09-16T01:18:26.974599+0000","last_clean":"2024-09-16T01:18:26.974599+0000","last_became_active":"2024-09-16T01:18:25.603759+0000","last_became_peered":"2024-09-16T01:18:25.603759+0000","last_unstale":"2024-09-16T01:18:26.974599+0000","last_undegraded":"2024-09-16T01:18:26.974599+0000","last_fullsized":"2024-09-16T01:18:26.974599+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:59:26.763892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973500+0000","last_change":"2024-09-16T01:18:24.593858+0000","last_active":"2024-09-16T01:18:26.973500+0000","last_peered":"2024-09-16T01:18:26.973500+0000","last_clean":"2024-09-16T01:18:26.973500+0000","last_became_active":"2024-09-16T01:18:24.593598+0000","last_became_peered":"2024-09-16T01:18:24.593598+0000","last_unstale":"2024-09-16T01:18:26.973500+0000","last_undegraded":"2024-09-16T01:18:26.973500+0000","last_fullsized":"2024-09-16T01:18:26.973500+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:27.775386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.975031+0000","last_change":"2024-09-16T01:18:25.593166+0000","last_active":"2024-09-16T01:18:26.975031+0000","last_peered":"2024-09-16T01:18:26.975031+0000","last_clean":"2024-09-16T01:18:26.975031+0000","last_became_active":"2024-09-16T01:18:25.592350+0000","last_became_peered":"2024-09-16T01:18:25.592350+0000","last_unstale":"2024-09-16T01:18:26.975031+0000","last_undegraded":"2024-09-16T01:18:26.975031+0000","last_fullsized":"2024-09-16T01:18:26.975031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:15.247482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.973631+0000","last_change":"2024-09-16T01:18:24.593964+0000","last_active":"2024-09-16T01:18:26.973631+0000","last_peered":"2024-09-16T01:18:26.973631+0000","last_clean":"2024-09-16T01:18:26.973631+0000","last_became_active":"2024-09-16T01:18:24.592686+0000","last_became_peered":"2024-09-16T01:18:24.592686+0000","last_unstale":"2024-09-16T01:18:26.973631+0000","last_undegraded":"2024-09-16T01:18:26.973631+0000","last_fullsized":"2024-09-16T01:18:26.973631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:30.700156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974667+0000","last_change":"2024-09-16T01:18:25.606646+0000","last_active":"2024-09-16T01:18:26.974667+0000","last_peered":"2024-09-16T01:18:26.974667+0000","last_clean":"2024-09-16T01:18:26.974667+0000","last_became_active":"2024-09-16T01:18:25.606379+0000","last_became_peered":"2024-09-16T01:18:25.606379+0000","last_unstale":"2024-09-16T01:18:26.974667+0000","last_undegraded":"2024-09-16T01:18:26.974667+0000","last_fullsized":"2024-09-16T01:18:26.974667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:39.130875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598730+0000","last_change":"2024-09-16T01:18:24.595804+0000","last_active":"2024-09-16T01:18:26.598730+0000","last_peered":"2024-09-16T01:18:26.598730+0000","last_clean":"2024-09-16T01:18:26.598730+0000","last_became_active":"2024-09-16T01:18:24.595529+0000","last_became_peered":"2024-09-16T01:18:24.595529+0000","last_unstale":"2024-09-16T01:18:26.598730+0000","last_undegraded":"2024-09-16T01:18:26.598730+0000","last_fullsized":"2024-09-16T01:18:26.598730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:07.658321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974710+0000","last_change":"2024-09-16T01:18:25.600812+0000","last_active":"2024-09-16T01:18:26.974710+0000","last_peered":"2024-09-16T01:18:26.974710+0000","last_clean":"2024-09-16T01:18:26.974710+0000","last_became_active":"2024-09-16T01:18:25.598756+0000","last_became_peered":"2024-09-16T01:18:25.598756+0000","last_unstale":"2024-09-16T01:18:26.974710+0000","last_undegraded":"2024-09-16T01:18:26.974710+0000","last_fullsized":"2024-09-16T01:18:26.974710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:20.635284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"74'1","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974652+0000","last_change":"2024-09-16T01:18:24.603407+0000","last_active":"2024-09-16T01:18:26.974652+0000","last_peered":"2024-09-16T01:18:26.974652+0000","last_clean":"2024-09-16T01:18:26.974652+0000","last_became_active":"2024-09-16T01:18:24.603125+0000","last_became_peered":"2024-09-16T01:18:24.603125+0000","last_unstale":"2024-09-16T01:18:26.974652+0000","last_undegraded":"2024-09-16T01:18:26.974652+0000","last_fullsized":"2024-09-16T01:18:26.974652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:27.252288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974717+0000","last_change":"2024-09-16T01:18:25.604633+0000","last_active":"2024-09-16T01:18:26.974717+0000","last_peered":"2024-09-16T01:18:26.974717+0000","last_clean":"2024-09-16T01:18:26.974717+0000","last_became_active":"2024-09-16T01:18:25.604232+0000","last_became_peered":"2024-09-16T01:18:25.604232+0000","last_unstale":"2024-09-16T01:18:26.974717+0000","last_undegraded":"2024-09-16T01:18:26.974717+0000","last_fullsized":"2024-09-16T01:18:26.974717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:51.567153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598452+0000","last_change":"2024-09-16T01:18:24.599669+0000","last_active":"2024-09-16T01:18:26.598452+0000","last_peered":"2024-09-16T01:18:26.598452+0000","last_clean":"2024-09-16T01:18:26.598452+0000","last_became_active":"2024-09-16T01:18:24.599290+0000","last_became_peered":"2024-09-16T01:18:24.599290+0000","last_unstale":"2024-09-16T01:18:26.598452+0000","last_undegraded":"2024-09-16T01:18:26.598452+0000","last_fullsized":"2024-09-16T01:18:26.598452+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:12.532623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974213+0000","last_change":"2024-09-16T01:18:25.599150+0000","last_active":"2024-09-16T01:18:26.974213+0000","last_peered":"2024-09-16T01:18:26.974213+0000","last_clean":"2024-09-16T01:18:26.974213+0000","last_became_active":"2024-09-16T01:18:25.598275+0000","last_became_peered":"2024-09-16T01:18:25.598275+0000","last_unstale":"2024-09-16T01:18:26.974213+0000","last_undegraded":"2024-09-16T01:18:26.974213+0000","last_fullsized":"2024-09-16T01:18:26.974213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:24.082531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598086+0000","last_change":"2024-09-16T01:18:24.599566+0000","last_active":"2024-09-16T01:18:26.598086+0000","last_peered":"2024-09-16T01:18:26.598086+0000","last_clean":"2024-09-16T01:18:26.598086+0000","last_became_active":"2024-09-16T01:18:24.599283+0000","last_became_peered":"2024-09-16T01:18:24.599283+0000","last_unstale":"2024-09-16T01:18:26.598086+0000","last_undegraded":"2024-09-16T01:18:26.598086+0000","last_fullsized":"2024-09-16T01:18:26.598086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:43:17.967344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974891+0000","last_change":"2024-09-16T01:18:25.604359+0000","last_active":"2024-09-16T01:18:26.974891+0000","last_peered":"2024-09-16T01:18:26.974891+0000","last_clean":"2024-09-16T01:18:26.974891+0000","last_became_active":"2024-09-16T01:18:25.602588+0000","last_became_peered":"2024-09-16T01:18:25.602588+0000","last_unstale":"2024-09-16T01:18:26.974891+0000","last_undegraded":"2024-09-16T01:18:26.974891+0000","last_fullsized":"2024-09-16T01:18:26.974891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:28.959546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974328+0000","last_change":"2024-09-16T01:18:24.597370+0000","last_active":"2024-09-16T01:18:26.974328+0000","last_peered":"2024-09-16T01:18:26.974328+0000","last_clean":"2024-09-16T01:18:26.974328+0000","last_became_active":"2024-09-16T01:18:24.597049+0000","last_became_peered":"2024-09-16T01:18:24.597049+0000","last_unstale":"2024-09-16T01:18:26.974328+0000","last_undegraded":"2024-09-16T01:18:26.974328+0000","last_fullsized":"2024-09-16T01:18:26.974328+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:13.763834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974595+0000","last_change":"2024-09-16T01:18:25.609193+0000","last_active":"2024-09-16T01:18:26.974595+0000","last_peered":"2024-09-16T01:18:26.974595+0000","last_clean":"2024-09-16T01:18:26.974595+0000","last_became_active":"2024-09-16T01:18:25.608878+0000","last_became_peered":"2024-09-16T01:18:25.608878+0000","last_unstale":"2024-09-16T01:18:26.974595+0000","last_undegraded":"2024-09-16T01:18:26.974595+0000","last_fullsized":"2024-09-16T01:18:26.974595+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:43.762133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.595857+0000","last_change":"2024-09-16T01:18:24.602604+0000","last_active":"2024-09-16T01:18:26.595857+0000","last_peered":"2024-09-16T01:18:26.595857+0000","last_clean":"2024-09-16T01:18:26.595857+0000","last_became_active":"2024-09-16T01:18:24.602327+0000","last_became_peered":"2024-09-16T01:18:24.602327+0000","last_unstale":"2024-09-16T01:18:26.595857+0000","last_undegraded":"2024-09-16T01:18:26.595857+0000","last_fullsized":"2024-09-16T01:18:26.595857+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:28.185773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974213+0000","last_change":"2024-09-16T01:18:25.612050+0000","last_active":"2024-09-16T01:18:26.974213+0000","last_peered":"2024-09-16T01:18:26.974213+0000","last_clean":"2024-09-16T01:18:26.974213+0000","last_became_active":"2024-09-16T01:18:25.611734+0000","last_became_peered":"2024-09-16T01:18:25.611734+0000","last_unstale":"2024-09-16T01:18:26.974213+0000","last_undegraded":"2024-09-16T01:18:26.974213+0000","last_fullsized":"2024-09-16T01:18:26.974213+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:28.959546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974689+0000","last_change":"2024-09-16T01:18:24.589958+0000","last_active":"2024-09-16T01:18:26.974689+0000","last_peered":"2024-09-16T01:18:26.974689+0000","last_clean":"2024-09-16T01:18:26.974689+0000","last_became_active":"2024-09-16T01:18:24.589714+0000","last_became_peered":"2024-09-16T01:18:24.589714+0000","last_unstale":"2024-09-16T01:18:26.974689+0000","last_undegraded":"2024-09-16T01:18:26.974689+0000","last_fullsized":"2024-09-16T01:18:26.974689+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:43.678289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974422+0000","last_change":"2024-09-16T01:18:25.600774+0000","last_active":"2024-09-16T01:18:26.974422+0000","last_peered":"2024-09-16T01:18:26.974422+0000","last_clean":"2024-09-16T01:18:26.974422+0000","last_became_active":"2024-09-16T01:18:25.600496+0000","last_became_peered":"2024-09-16T01:18:25.600496+0000","last_unstale":"2024-09-16T01:18:26.974422+0000","last_undegraded":"2024-09-16T01:18:26.974422+0000","last_fullsized":"2024-09-16T01:18:26.974422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:31.193825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974235+0000","last_change":"2024-09-16T01:18:24.596421+0000","last_active":"2024-09-16T01:18:26.974235+0000","last_peered":"2024-09-16T01:18:26.974235+0000","last_clean":"2024-09-16T01:18:26.974235+0000","last_became_active":"2024-09-16T01:18:24.596188+0000","last_became_peered":"2024-09-16T01:18:24.596188+0000","last_unstale":"2024-09-16T01:18:26.974235+0000","last_undegraded":"2024-09-16T01:18:26.974235+0000","last_fullsized":"2024-09-16T01:18:26.974235+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:41.064986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.598320+0000","last_change":"2024-09-16T01:18:25.602377+0000","last_active":"2024-09-16T01:18:26.598320+0000","last_peered":"2024-09-16T01:18:26.598320+0000","last_clean":"2024-09-16T01:18:26.598320+0000","last_became_active":"2024-09-16T01:18:25.602114+0000","last_became_peered":"2024-09-16T01:18:25.602114+0000","last_unstale":"2024-09-16T01:18:26.598320+0000","last_undegraded":"2024-09-16T01:18:26.598320+0000","last_fullsized":"2024-09-16T01:18:26.598320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:24.573874+0000","last_clean_scrub_stamp":"2024-09-16T01:18:24.573874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:20.143941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.974681+0000","last_change":"2024-09-16T01:18:24.593849+0000","last_active":"2024-09-16T01:18:26.974681+0000","last_peered":"2024-09-16T01:18:26.974681+0000","last_clean":"2024-09-16T01:18:26.974681+0000","last_became_active":"2024-09-16T01:18:24.593553+0000","last_became_peered":"2024-09-16T01:18:24.593553+0000","last_unstale":"2024-09-16T01:18:26.974681+0000","last_undegraded":"2024-09-16T01:18:26.974681+0000","last_fullsized":"2024-09-16T01:18:26.974681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:23.571876+0000","last_clean_scrub_stamp":"2024-09-16T01:18:23.571876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:31.552431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":271,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-16T01:18:26.597866+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:18:26.597866+0000","last_peered":"2024-09-16T01:18:26.597866+0000","last_clean":"2024-09-16T01:18:26.597866+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:18:26.597866+0000","last_undegraded":"2024-09-16T01:18:26.597866+0000","last_fullsized":"2024-09-16T01:18:26.597866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32676,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1515520,"data_stored":1006029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":929792,"data_stored":417251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":415673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":937984,"data_stored":417355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":921600,"data_stored":416221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":929792,"data_stored":416381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":925696,"data_stored":415751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1511424,"data_stored":1006007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:18:33.443 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:18:33.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T01:18:33.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.583+0000 7ff0b07d8640 1 Processor -- start 2024-09-16T01:18:33.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.583+0000 7ff0b07d8640 1 -- start start 2024-09-16T01:18:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.584+0000 7ff0b07d8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0a8071180 0x7ff0a8169200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.584+0000 7ff0b07d8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a806cdc0 con 0x7ff0a815e7f0 2024-09-16T01:18:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.584+0000 7ff0b07d8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0a806d0a0 con 0x7ff0a80af210 2024-09-16T01:18:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.584+0000 7ff0b07d8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a806d380 con 0x7ff0a8071180 2024-09-16T01:18:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.584+0000 7ff0aed75640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0a8071180 0x7ff0a8169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.584+0000 7ff0ae574640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff0a815e7f0 0x7ff0a80b6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52036/0 (socket says 172.21.15.81:52036) 2024-09-16T01:18:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.584+0000 7ff0ae574640 1 -- 172.21.15.81:0/1822564194 learned_addr learned my addr 172.21.15.81:0/1822564194 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.584+0000 7ff0aed75640 1 -- 172.21.15.81:0/1822564194 >> v1:172.21.15.102:6789/0 conn(0x7ff0a80af210 legacy=0x7ff0a8070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.584+0000 7ff0aed75640 1 -- 172.21.15.81:0/1822564194 >> v1:172.21.15.81:6789/0 conn(0x7ff0a815e7f0 legacy=0x7ff0a80b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.584+0000 7ff0aed75640 1 -- 172.21.15.81:0/1822564194 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a806d660 con 0x7ff0a8071180 2024-09-16T01:18:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.585+0000 7ff0aed75640 1 --2- 172.21.15.81:0/1822564194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a8071180 0x7ff0a8169200 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009d90 tx=0x7ff0a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4438b75ebeab37 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.585+0000 7ff0ad572640 1 -- 172.21.15.81:0/1822564194 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0007740 con 0x7ff0a8071180 2024-09-16T01:18:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.585+0000 7ff0ad572640 1 -- 172.21.15.81:0/1822564194 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a00078e0 con 0x7ff0a8071180 2024-09-16T01:18:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.585+0000 7ff0ad572640 1 -- 172.21.15.81:0/1822564194 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0007cb0 con 0x7ff0a8071180 2024-09-16T01:18:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.586+0000 7ff0b07d8640 1 -- 172.21.15.81:0/1822564194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a8071180 msgr2=0x7ff0a8169200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.586+0000 7ff0b07d8640 1 --2- 172.21.15.81:0/1822564194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a8071180 0x7ff0a8169200 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009d90 tx=0x7ff0a002a6a0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.586+0000 7ff0b07d8640 1 -- 172.21.15.81:0/1822564194 shutdown_connections 2024-09-16T01:18:33.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.586+0000 7ff0b07d8640 1 --2- 172.21.15.81:0/1822564194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a8071180 0x7ff0a8169200 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.586+0000 7ff0b07d8640 1 -- 172.21.15.81:0/1822564194 >> 172.21.15.81:0/1822564194 conn(0x7ff0a80b3f30 msgr2=0x7ff0a80b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.586+0000 7ff0b07d8640 1 -- 172.21.15.81:0/1822564194 shutdown_connections 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.586+0000 7ff0b07d8640 1 -- 172.21.15.81:0/1822564194 wait complete. 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.587+0000 7ff0b07d8640 1 Processor -- start 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.587+0000 7ff0b07d8640 1 -- start start 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0b07d8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0a8071180 0x7ff0a814ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0b07d8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff0a80af210 0x7ff0a81601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0b07d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a815e7f0 0x7ff0a815d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0b07d8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a80b60c0 con 0x7ff0a815e7f0 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0b07d8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a80b5f40 con 0x7ff0a8071180 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0b07d8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a8169740 con 0x7ff0a80af210 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0aed75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a815e7f0 0x7ff0a815d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0aed75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a815e7f0 0x7ff0a815d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36688/0 (socket says 172.21.15.81:36688) 2024-09-16T01:18:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0aed75640 1 -- 172.21.15.81:0/2589074697 learned_addr learned my addr 172.21.15.81:0/2589074697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0aed75640 1 -- 172.21.15.81:0/2589074697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff0a80af210 msgr2=0x7ff0a81601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0aed75640 1 --2- 172.21.15.81:0/2589074697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff0a80af210 0x7ff0a81601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0aed75640 1 -- 172.21.15.81:0/2589074697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0a8071180 msgr2=0x7ff0a814ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0aed75640 1 --2- 172.21.15.81:0/2589074697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0a8071180 0x7ff0a814ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0aed75640 1 -- 172.21.15.81:0/2589074697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a8160c20 con 0x7ff0a815e7f0 2024-09-16T01:18:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0aed75640 1 --2- 172.21.15.81:0/2589074697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a815e7f0 0x7ff0a815d340 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009d90 tx=0x7ff0a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff09effd640 1 -- 172.21.15.81:0/2589074697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0040070 con 0x7ff0a815e7f0 2024-09-16T01:18:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff09effd640 1 -- 172.21.15.81:0/2589074697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a0031c90 con 0x7ff0a815e7f0 2024-09-16T01:18:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0b07d8640 1 -- 172.21.15.81:0/2589074697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a8160f00 con 0x7ff0a815e7f0 2024-09-16T01:18:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff09effd640 1 -- 172.21.15.81:0/2589074697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a003c640 con 0x7ff0a815e7f0 2024-09-16T01:18:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.588+0000 7ff0b07d8640 1 -- 172.21.15.81:0/2589074697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a81614c0 con 0x7ff0a815e7f0 2024-09-16T01:18:33.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.589+0000 7ff0b07d8640 1 -- 172.21.15.81:0/2589074697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a80ce7c0 con 0x7ff0a815e7f0 2024-09-16T01:18:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.590+0000 7ff09effd640 1 -- 172.21.15.81:0/2589074697 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff0a0039040 con 0x7ff0a815e7f0 2024-09-16T01:18:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.590+0000 7ff09effd640 1 --2- 172.21.15.81:0/2589074697 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff08c06c2b0 0x7ff08c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.590+0000 7ff09effd640 1 -- 172.21.15.81:0/2589074697 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7ff0a00acbb0 con 0x7ff0a815e7f0 2024-09-16T01:18:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.590+0000 7ff0ae574640 1 --2- 172.21.15.81:0/2589074697 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff08c06c2b0 0x7ff08c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.591+0000 7ff0ae574640 1 --2- 172.21.15.81:0/2589074697 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff08c06c2b0 0x7ff08c06e770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4000f60 tx=0x7ff0a4007a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:33.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.595+0000 7ff09effd640 1 -- 172.21.15.81:0/2589074697 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0a80ce7c0 con 0x7ff0a815e7f0 2024-09-16T01:18:33.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.826+0000 7ff0b07d8640 1 -- 172.21.15.81:0/2589074697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7ff0a8070a70 con 0x7ff0a815e7f0 2024-09-16T01:18:33.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.828+0000 7ff09effd640 1 -- 172.21.15.81:0/2589074697 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7ff0a007b250 con 0x7ff0a815e7f0 2024-09-16T01:18:33.829 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-16T01:18:33.829 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg== 2024-09-16T01:18:33.829 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-16T01:18:33.829 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-16T01:18:33.829 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T01:18:33.829 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-16T01:18:33.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.830+0000 7ff0b07d8640 1 -- 172.21.15.81:0/2589074697 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff08c06c2b0 msgr2=0x7ff08c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.830+0000 7ff0b07d8640 1 --2- 172.21.15.81:0/2589074697 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff08c06c2b0 0x7ff08c06e770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4000f60 tx=0x7ff0a4007a80 comp rx=0 tx=0).stop 2024-09-16T01:18:33.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.830+0000 7ff0b07d8640 1 -- 172.21.15.81:0/2589074697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a815e7f0 msgr2=0x7ff0a815d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.830+0000 7ff0b07d8640 1 --2- 172.21.15.81:0/2589074697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a815e7f0 0x7ff0a815d340 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0009d90 tx=0x7ff0a0004a40 comp rx=0 tx=0).stop 2024-09-16T01:18:33.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.830+0000 7ff0b07d8640 1 -- 172.21.15.81:0/2589074697 shutdown_connections 2024-09-16T01:18:33.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.830+0000 7ff0b07d8640 1 --2- 172.21.15.81:0/2589074697 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff08c06c2b0 0x7ff08c06e770 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.830+0000 7ff0b07d8640 1 --2- 172.21.15.81:0/2589074697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0a815e7f0 0x7ff0a815d340 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.830+0000 7ff0b07d8640 1 --2- 172.21.15.81:0/2589074697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff0a80af210 0x7ff0a81601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.830+0000 7ff0b07d8640 1 --2- 172.21.15.81:0/2589074697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0a8071180 0x7ff0a814ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.830+0000 7ff0b07d8640 1 -- 172.21.15.81:0/2589074697 >> 172.21.15.81:0/2589074697 conn(0x7ff0a80b3f30 msgr2=0x7ff0a80b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:33.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.830+0000 7ff0b07d8640 1 -- 172.21.15.81:0/2589074697 shutdown_connections 2024-09-16T01:18:33.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.830+0000 7ff0b07d8640 1 -- 172.21.15.81:0/2589074697 wait complete. 2024-09-16T01:18:33.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:33.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.939+0000 7f565e8a6640 1 Processor -- start 2024-09-16T01:18:33.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.939+0000 7f565e8a6640 1 -- start start 2024-09-16T01:18:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.940+0000 7f565e8a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f565815e740 0x7f56580d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.940+0000 7f565e8a6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f565806dbd0 0x7f565806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.940+0000 7f565e8a6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56580d0780 con 0x7f565809b690 2024-09-16T01:18:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.940+0000 7f565e8a6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f565815eb20 con 0x7f565806dbd0 2024-09-16T01:18:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.940+0000 7f565e8a6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f565806d260 con 0x7f565815e740 2024-09-16T01:18:33.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.940+0000 7f565ce43640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f565806dbd0 0x7f565806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.940+0000 7f565ce43640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f565806dbd0 0x7f565806cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36700/0 (socket says 172.21.15.81:36700) 2024-09-16T01:18:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.940+0000 7f565ce43640 1 -- 172.21.15.81:0/700806441 learned_addr learned my addr 172.21.15.81:0/700806441 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.941+0000 7f565ce43640 1 -- 172.21.15.81:0/700806441 >> v2:172.21.15.102:3300/0 conn(0x7f565815e740 msgr2=0x7f56580d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.941+0000 7f565ce43640 1 --2- 172.21.15.81:0/700806441 >> v2:172.21.15.102:3300/0 conn(0x7f565815e740 0x7f56580d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.941+0000 7f565ce43640 1 -- 172.21.15.81:0/700806441 >> v1:172.21.15.102:6789/0 conn(0x7f565809b690 legacy=0x7f565806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.941+0000 7f565ce43640 1 -- 172.21.15.81:0/700806441 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56580d0a60 con 0x7f565806dbd0 2024-09-16T01:18:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.941+0000 7f565ce43640 1 --2- 172.21.15.81:0/700806441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565806dbd0 0x7f565806cd20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5658074070 tx=0x7f565002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16a3c2d25832f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.941+0000 7f5656ffd640 1 -- 172.21.15.81:0/700806441 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5650036070 con 0x7f565806dbd0 2024-09-16T01:18:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.942+0000 7f5656ffd640 1 -- 172.21.15.81:0/700806441 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5650031600 con 0x7f565806dbd0 2024-09-16T01:18:33.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.942+0000 7f5656ffd640 1 -- 172.21.15.81:0/700806441 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56500319d0 con 0x7f565806dbd0 2024-09-16T01:18:33.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.942+0000 7f565e8a6640 1 -- 172.21.15.81:0/700806441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565806dbd0 msgr2=0x7f565806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.942+0000 7f565e8a6640 1 --2- 172.21.15.81:0/700806441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565806dbd0 0x7f565806cd20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5658074070 tx=0x7f565002a780 comp rx=0 tx=0).stop 2024-09-16T01:18:33.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.942+0000 7f565e8a6640 1 -- 172.21.15.81:0/700806441 shutdown_connections 2024-09-16T01:18:33.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.942+0000 7f565e8a6640 1 --2- 172.21.15.81:0/700806441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565806dbd0 0x7f565806cd20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.942+0000 7f565e8a6640 1 --2- 172.21.15.81:0/700806441 >> v2:172.21.15.102:3300/0 conn(0x7f565815e740 0x7f56580d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.942+0000 7f565e8a6640 1 -- 172.21.15.81:0/700806441 >> 172.21.15.81:0/700806441 conn(0x7f56580d23a0 msgr2=0x7f56580d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:33.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.942+0000 7f565e8a6640 1 -- 172.21.15.81:0/700806441 shutdown_connections 2024-09-16T01:18:33.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.942+0000 7f565e8a6640 1 -- 172.21.15.81:0/700806441 wait complete. 2024-09-16T01:18:33.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.943+0000 7f565e8a6640 1 Processor -- start 2024-09-16T01:18:33.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.943+0000 7f565e8a6640 1 -- start start 2024-09-16T01:18:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.944+0000 7f565e8a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565806dbd0 0x7f56581f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.944+0000 7f565e8a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f565809b690 0x7f56580c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.944+0000 7f565e8a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f565815e740 0x7f56581f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.944+0000 7f565e8a6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f565809bac0 con 0x7f565806dbd0 2024-09-16T01:18:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.944+0000 7f565e8a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f56580d1020 con 0x7f565815e740 2024-09-16T01:18:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.944+0000 7f565e8a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f565806dfe0 con 0x7f565809b690 2024-09-16T01:18:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.944+0000 7f5657fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565806dbd0 0x7f56581f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.944+0000 7f5657fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565806dbd0 0x7f56581f4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36714/0 (socket says 172.21.15.81:36714) 2024-09-16T01:18:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.944+0000 7f5657fff640 1 -- 172.21.15.81:0/2441579171 learned_addr learned my addr 172.21.15.81:0/2441579171 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.944+0000 7f565ce43640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f565815e740 0x7f56581f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.944+0000 7f56577fe640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f565809b690 0x7f56580c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f5657fff640 1 -- 172.21.15.81:0/2441579171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f565809b690 msgr2=0x7f56580c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f5657fff640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f565809b690 0x7f56580c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f5657fff640 1 -- 172.21.15.81:0/2441579171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f565815e740 msgr2=0x7f56581f8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f5657fff640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f565815e740 0x7f56581f8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f5657fff640 1 -- 172.21.15.81:0/2441579171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56580cbe50 con 0x7f565806dbd0 2024-09-16T01:18:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f56577fe640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f565809b690 0x7f56580c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:33.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f565ce43640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f565815e740 0x7f56581f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f5657fff640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565806dbd0 0x7f56581f4570 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f564800b4a0 tx=0x7f564800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f5654ff9640 1 -- 172.21.15.81:0/2441579171 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648014070 con 0x7f565806dbd0 2024-09-16T01:18:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f5654ff9640 1 -- 172.21.15.81:0/2441579171 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5648010610 con 0x7f565806dbd0 2024-09-16T01:18:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f5654ff9640 1 -- 172.21.15.81:0/2441579171 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648010a00 con 0x7f565806dbd0 2024-09-16T01:18:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f565e8a6640 1 -- 172.21.15.81:0/2441579171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56580cc130 con 0x7f565806dbd0 2024-09-16T01:18:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.945+0000 7f565e8a6640 1 -- 172.21.15.81:0/2441579171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56580c99b0 con 0x7f565806dbd0 2024-09-16T01:18:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.946+0000 7f565e8a6640 1 -- 172.21.15.81:0/2441579171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f565806cd20 con 0x7f565806dbd0 2024-09-16T01:18:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.946+0000 7f5654ff9640 1 -- 172.21.15.81:0/2441579171 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5648017070 con 0x7f565806dbd0 2024-09-16T01:18:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.947+0000 7f5654ff9640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f564406c2e0 0x7f564406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.947+0000 7f5654ff9640 1 -- 172.21.15.81:0/2441579171 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f564808af20 con 0x7f565806dbd0 2024-09-16T01:18:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.947+0000 7f56577fe640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f564406c2e0 0x7f564406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.947+0000 7f56577fe640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f564406c2e0 0x7f564406e7a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f56581f7fb0 tx=0x7f564c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:33.951+0000 7f5654ff9640 1 -- 172.21.15.81:0/2441579171 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5648059590 con 0x7f565806dbd0 2024-09-16T01:18:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.152+0000 7f565e8a6640 1 -- 172.21.15.81:0/2441579171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56580d1cb0 con 0x7f565806dbd0 2024-09-16T01:18:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.152+0000 7f5654ff9640 1 -- 172.21.15.81:0/2441579171 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5222 (secure 0 0 0) 0x7f5648058e90 con 0x7f565806dbd0 2024-09-16T01:18:34.153 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:34.153 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"btime":"2024-09-16T01:18:27:841583+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4005145731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":4005145731},{"type":"v1","addr":"172.21.15.102:6835","nonce":4005145731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/40318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":40318124},{"type":"v1","addr":"172.21.15.81:6835","nonce":40318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/700844751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":700844751},{"type":"v1","addr":"172.21.15.81:6837","nonce":700844751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:24.925061+0000","modified":"2024-09-16T01:18:27.171098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6027},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6027":{"gid":6027,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/3012591174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3012591174},{"type":"v1","addr":"172.21.15.102:6834","nonce":3012591174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6027,"qdb_cluster":[6027]},"id":5}]} 2024-09-16T01:18:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-09-16T01:18:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.154+0000 7f565e8a6640 1 -- 172.21.15.81:0/2441579171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f564406c2e0 msgr2=0x7f564406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.154+0000 7f565e8a6640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f564406c2e0 0x7f564406e7a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f56581f7fb0 tx=0x7f564c009040 comp rx=0 tx=0).stop 2024-09-16T01:18:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.154+0000 7f565e8a6640 1 -- 172.21.15.81:0/2441579171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565806dbd0 msgr2=0x7f56581f4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.154+0000 7f565e8a6640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565806dbd0 0x7f56581f4570 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f564800b4a0 tx=0x7f564800b960 comp rx=0 tx=0).stop 2024-09-16T01:18:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.154+0000 7f565e8a6640 1 -- 172.21.15.81:0/2441579171 shutdown_connections 2024-09-16T01:18:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.154+0000 7f565e8a6640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f564406c2e0 0x7f564406e7a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.154+0000 7f565e8a6640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f565815e740 0x7f56581f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.154+0000 7f565e8a6640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f565809b690 0x7f56580c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.154+0000 7f565e8a6640 1 --2- 172.21.15.81:0/2441579171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f565806dbd0 0x7f56581f4570 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.154+0000 7f565e8a6640 1 -- 172.21.15.81:0/2441579171 >> 172.21.15.81:0/2441579171 conn(0x7f56580d23a0 msgr2=0x7f5658070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.154+0000 7f565e8a6640 1 -- 172.21.15.81:0/2441579171 shutdown_connections 2024-09-16T01:18:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.154+0000 7f565e8a6640 1 -- 172.21.15.81:0/2441579171 wait complete. 2024-09-16T01:18:34.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:18:24.925061+0000', 'modified': '2024-09-16T01:18:27.171098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6027}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6027': {'gid': 6027, 'name': 'b', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6834/3012591174', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6832', 'nonce': 3012591174}, {'type': 'v1', 'addr': '172.21.15.102:6834', 'nonce': 3012591174}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6027, 'qdb_cluster': [6027]} 2024-09-16T01:18:34.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:18:34.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-16T01:18:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.669+0000 7fd6c3713640 1 Processor -- start 2024-09-16T01:18:34.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.669+0000 7fd6c3713640 1 -- start start 2024-09-16T01:18:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.670+0000 7fd6c3713640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6bc147360 0x7fd6bc070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.670+0000 7fd6c3713640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6bc06cb30 con 0x7fd6bc0d0bb0 2024-09-16T01:18:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.670+0000 7fd6c3713640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6bc06bfb0 con 0x7fd6bc070dd0 2024-09-16T01:18:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.670+0000 7fd6c3713640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd6bc06c290 con 0x7fd6bc147360 2024-09-16T01:18:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.670+0000 7fd6c14af640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6bc147360 0x7fd6bc070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.670+0000 7fd6c1cb0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd6bc0d0bb0 0x7fd6bc0ae550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52052/0 (socket says 172.21.15.81:52052) 2024-09-16T01:18:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.670+0000 7fd6c1cb0640 1 -- 172.21.15.81:0/2271174678 learned_addr learned my addr 172.21.15.81:0/2271174678 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.670+0000 7fd6c14af640 1 -- 172.21.15.81:0/2271174678 >> v1:172.21.15.102:6789/0 conn(0x7fd6bc070dd0 legacy=0x7fd6bc0d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.671+0000 7fd6c14af640 1 -- 172.21.15.81:0/2271174678 >> v1:172.21.15.81:6789/0 conn(0x7fd6bc0d0bb0 legacy=0x7fd6bc0ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.671+0000 7fd6b3fff640 1 -- 172.21.15.81:0/2271174678 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3808683391 0 0) 0x7fd6bc06cb30 con 0x7fd6bc0d0bb0 2024-09-16T01:18:34.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.671+0000 7fd6c14af640 1 -- 172.21.15.81:0/2271174678 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6bc06c570 con 0x7fd6bc147360 2024-09-16T01:18:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.671+0000 7fd6c14af640 1 --2- 172.21.15.81:0/2271174678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6bc147360 0x7fd6bc070890 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80097a0 tx=0x7fd6b802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f98eaba0251bbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.671+0000 7fd6b3fff640 1 -- 172.21.15.81:0/2271174678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8037070 con 0x7fd6bc147360 2024-09-16T01:18:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.671+0000 7fd6b3fff640 1 -- 172.21.15.81:0/2271174678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b802adc0 con 0x7fd6bc147360 2024-09-16T01:18:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.671+0000 7fd6b3fff640 1 -- 172.21.15.81:0/2271174678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8032660 con 0x7fd6bc147360 2024-09-16T01:18:34.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.672+0000 7fd6c3713640 1 -- 172.21.15.81:0/2271174678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6bc147360 msgr2=0x7fd6bc070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.672+0000 7fd6c3713640 1 --2- 172.21.15.81:0/2271174678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6bc147360 0x7fd6bc070890 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80097a0 tx=0x7fd6b802a0b0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.672+0000 7fd6c3713640 1 -- 172.21.15.81:0/2271174678 shutdown_connections 2024-09-16T01:18:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.672+0000 7fd6c3713640 1 --2- 172.21.15.81:0/2271174678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6bc147360 0x7fd6bc070890 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.672+0000 7fd6c3713640 1 -- 172.21.15.81:0/2271174678 >> 172.21.15.81:0/2271174678 conn(0x7fd6bc0b2f40 msgr2=0x7fd6bc0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.672+0000 7fd6c3713640 1 -- 172.21.15.81:0/2271174678 shutdown_connections 2024-09-16T01:18:34.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.672+0000 7fd6c3713640 1 -- 172.21.15.81:0/2271174678 wait complete. 2024-09-16T01:18:34.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.673+0000 7fd6c3713640 1 Processor -- start 2024-09-16T01:18:34.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.673+0000 7fd6c3713640 1 -- start start 2024-09-16T01:18:34.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c3713640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6bc070dd0 0x7fd6bc13e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c3713640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd6bc0d0bb0 0x7fd6bc158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c3713640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6bc147360 0x7fd6bc140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c3713640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc06bd90 con 0x7fd6bc070dd0 2024-09-16T01:18:34.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c3713640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc06bc10 con 0x7fd6bc147360 2024-09-16T01:18:34.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c3713640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd6bc0aec60 con 0x7fd6bc0d0bb0 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c14af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6bc070dd0 0x7fd6bc13e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c14af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6bc070dd0 0x7fd6bc13e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36726/0 (socket says 172.21.15.81:36726) 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c14af640 1 -- 172.21.15.81:0/3860657863 learned_addr learned my addr 172.21.15.81:0/3860657863 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c14af640 1 -- 172.21.15.81:0/3860657863 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd6bc0d0bb0 msgr2=0x7fd6bc158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c14af640 1 --2- 172.21.15.81:0/3860657863 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd6bc0d0bb0 0x7fd6bc158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c14af640 1 -- 172.21.15.81:0/3860657863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6bc147360 msgr2=0x7fd6bc140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c14af640 1 --2- 172.21.15.81:0/3860657863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6bc147360 0x7fd6bc140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c14af640 1 -- 172.21.15.81:0/3860657863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6bc140de0 con 0x7fd6bc070dd0 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.674+0000 7fd6c14af640 1 --2- 172.21.15.81:0/3860657863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6bc070dd0 0x7fd6bc13e060 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80097a0 tx=0x7fd6b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.675+0000 7fd6b1ffb640 1 -- 172.21.15.81:0/3860657863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8041070 con 0x7fd6bc070dd0 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.675+0000 7fd6b1ffb640 1 -- 172.21.15.81:0/3860657863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b803c670 con 0x7fd6bc070dd0 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.675+0000 7fd6c3713640 1 -- 172.21.15.81:0/3860657863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6bc1410c0 con 0x7fd6bc070dd0 2024-09-16T01:18:34.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.675+0000 7fd6b1ffb640 1 -- 172.21.15.81:0/3860657863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8037040 con 0x7fd6bc070dd0 2024-09-16T01:18:34.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.675+0000 7fd6c3713640 1 -- 172.21.15.81:0/3860657863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6bc158b50 con 0x7fd6bc070dd0 2024-09-16T01:18:34.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.676+0000 7fd6b1ffb640 1 -- 172.21.15.81:0/3860657863 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd6b8044070 con 0x7fd6bc070dd0 2024-09-16T01:18:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.677+0000 7fd6b1ffb640 1 --2- 172.21.15.81:0/3860657863 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd6a006c2b0 0x7fd6a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.677+0000 7fd6b1ffb640 1 -- 172.21.15.81:0/3860657863 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd6b80abd80 con 0x7fd6bc070dd0 2024-09-16T01:18:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.677+0000 7fd6c0cae640 1 --2- 172.21.15.81:0/3860657863 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd6a006c2b0 0x7fd6a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.677+0000 7fd6c0cae640 1 --2- 172.21.15.81:0/3860657863 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd6a006c2b0 0x7fd6a006e770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0758b0 tx=0x7fd6ac007990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.678+0000 7fd6c64a3740 1 Processor -- start 2024-09-16T01:18:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.678+0000 7fd6c64a3740 1 -- start start 2024-09-16T01:18:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.678+0000 7fd6c64a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbe2c0 0x55a3fdd03a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.678+0000 7fd6c64a3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcbba80 0x55a3fdcbe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.678+0000 7fd6c64a3740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbfa50 0x55a3fdcb88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.678+0000 7fd6c64a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a3fdc20520 con 0x55a3fdcbe2c0 2024-09-16T01:18:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.678+0000 7fd6c64a3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a3fdbc83e0 con 0x55a3fdcbba80 2024-09-16T01:18:34.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.678+0000 7fd6c64a3740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55a3fdc1c4e0 con 0x55a3fdcbfa50 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.678+0000 7fd6c14af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbe2c0 0x55a3fdd03a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.678+0000 7fd6c14af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbe2c0 0x55a3fdd03a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36742/0 (socket says 172.21.15.81:36742) 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.678+0000 7fd6c14af640 1 -- 172.21.15.81:0/1946246740 learned_addr learned my addr 172.21.15.81:0/1946246740 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.678+0000 7fd6c0cae640 1 --2- 172.21.15.81:0/1946246740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcbba80 0x55a3fdcbe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6c1cb0640 1 --2- 172.21.15.81:0/1946246740 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbfa50 0x55a3fdcb88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6c14af640 1 -- 172.21.15.81:0/1946246740 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbfa50 msgr2=0x55a3fdcb88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6c14af640 1 --2- 172.21.15.81:0/1946246740 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbfa50 0x55a3fdcb88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6c14af640 1 -- 172.21.15.81:0/1946246740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcbba80 msgr2=0x55a3fdcbe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6c14af640 1 --2- 172.21.15.81:0/1946246740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcbba80 0x55a3fdcbe6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6c14af640 1 -- 172.21.15.81:0/1946246740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3fdbe32f0 con 0x55a3fdcbe2c0 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6c0cae640 1 --2- 172.21.15.81:0/1946246740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcbba80 0x55a3fdcbe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6c14af640 1 --2- 172.21.15.81:0/1946246740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbe2c0 0x55a3fdd03a60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80aa060 tx=0x7fd6b807a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3ef8734159de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:34.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6a6ffd640 1 -- 172.21.15.81:0/1946246740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b804b070 con 0x55a3fdcbe2c0 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6a6ffd640 1 -- 172.21.15.81:0/1946246740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b807e010 con 0x55a3fdcbe2c0 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6a6ffd640 1 -- 172.21.15.81:0/1946246740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8082840 con 0x55a3fdcbe2c0 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1946246740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbe2c0 msgr2=0x55a3fdd03a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.679+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/1946246740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbe2c0 0x55a3fdd03a60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80aa060 tx=0x7fd6b807a360 comp rx=0 tx=0).stop 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.680+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1946246740 shutdown_connections 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.680+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/1946246740 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbfa50 0x55a3fdcb88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.680+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/1946246740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcbba80 0x55a3fdcbe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.680+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/1946246740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbe2c0 0x55a3fdd03a60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.680+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1946246740 >> 172.21.15.81:0/1946246740 conn(0x55a3fdcbaa80 msgr2=0x55a3fdd02f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.680+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1946246740 shutdown_connections 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.680+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1946246740 wait complete. 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.680+0000 7fd6c64a3740 1 -- start start 2024-09-16T01:18:34.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.680+0000 7fd6c64a3740 1 Processor -- start 2024-09-16T01:18:34.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c64a3740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 0x55a3fdcde870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c64a3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcbfa50 0x55a3fdcdc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c64a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcdd630 0x55a3fdce7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c64a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a3fdc20520 con 0x55a3fdcdd630 2024-09-16T01:18:34.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c64a3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a3fdba9450 con 0x55a3fdcbfa50 2024-09-16T01:18:34.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c64a3740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55a3fdcb9f20 con 0x55a3fdcbe2c0 2024-09-16T01:18:34.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c64a3740 10 client.0 _ll_register_callbacks cb 0x55a3fd932ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c1cb0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcdd630 0x55a3fdce7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c1cb0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcdd630 0x55a3fdce7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36748/0 (socket says 172.21.15.81:36748) 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c1cb0640 1 -- 172.21.15.81:0/1009872557 learned_addr learned my addr 172.21.15.81:0/1009872557 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c0cae640 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcbfa50 0x55a3fdcdc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c14af640 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 0x55a3fdcde870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c1cb0640 1 -- 172.21.15.81:0/1009872557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 msgr2=0x55a3fdcde870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c1cb0640 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 0x55a3fdcde870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c1cb0640 1 -- 172.21.15.81:0/1009872557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcbfa50 msgr2=0x55a3fdcdc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c1cb0640 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcbfa50 0x55a3fdcdc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.681+0000 7fd6c1cb0640 1 -- 172.21.15.81:0/1009872557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3fd9332d0 con 0x55a3fdcdd630 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd69bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd6c1cb0640 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcdd630 0x55a3fdce7390 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4007b60 tx=0x7fd6b4001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a2fe46813df4cf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:34.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd69bfff640 1 -- 172.21.15.81:0/1009872557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4019060 con 0x55a3fdcdd630 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd69bfff640 1 -- 172.21.15.81:0/1009872557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd6b4004d70 con 0x55a3fdcdd630 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1009872557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6b807e010 con 0x55a3fdcdd630 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd69bfff640 1 -- 172.21.15.81:0/1009872557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd6b4005030 con 0x55a3fdcdd630 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd6c64a3740 10 client.6177 fetch_fsmap learned FSMap version 36 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1009872557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55a3fd9fd6b0 con 0x55a3fdcdd630 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd69bfff640 1 -- 172.21.15.81:0/1009872557 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6b807e010 con 0x55a3fdcdd630 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd69bfff640 1 -- 172.21.15.81:0/1009872557 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7fd6b40051d0 con 0x55a3fdcdd630 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd6c64a3740 10 client.6177 fetch_fsmap finished waiting for FSMap version 36 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd6c64a3740 10 client.6177 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd6c64a3740 20 client.6177 populate_metadata read hostname 'smithi081' 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.102:6832/3012591174,v1:172.21.15.102:6834/3012591174] conn(0x55a3fdce78d0 0x55a3fdcb78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd6c64a3740 4 client.6177 mds_command: new command op to 6027 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.682+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1009872557 --> [v2:172.21.15.102:6832/3012591174,v1:172.21.15.102:6834/3012591174] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3fdc2dc50 con 0x55a3fdce78d0 2024-09-16T01:18:34.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.683+0000 7fd6c14af640 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.102:6832/3012591174,v1:172.21.15.102:6834/3012591174] conn(0x55a3fdce78d0 0x55a3fdcb78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.683+0000 7fd69bfff640 10 client.6177 ms_handle_connect on v2:172.21.15.102:6832/3012591174 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.683+0000 7fd6c14af640 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.102:6832/3012591174,v1:172.21.15.102:6834/3012591174] conn(0x55a3fdce78d0 0x55a3fdcb78c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31e769b257fb9b96 server_cookie=3572e8484014f895 in_seq=0 out_seq=0 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd69bfff640 1 -- 172.21.15.81:0/1009872557 <== mds.0 v2:172.21.15.102:6832/3012591174 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3fdc2dc50 con 0x55a3fdce78d0 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd69bfff640 10 client.6177 handle_command_reply: tid=0 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd6c64a3740 1 client.6177 shutdown 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1009872557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcdd630 msgr2=0x55a3fdce7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcdd630 0x55a3fdce7390 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4007b60 tx=0x7fd6b4001ac0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1009872557 shutdown_connections 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.102:6832/3012591174,v1:172.21.15.102:6834/3012591174] conn(0x55a3fdce78d0 0x55a3fdcb78c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcdd630 0x55a3fdce7390 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcbfa50 0x55a3fdcdc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/1009872557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 0x55a3fdcde870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1009872557 >> 172.21.15.81:0/1009872557 conn(0x55a3fdcbba80 msgr2=0x55a3fdd02580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:34.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd69bfff640 0 client.6177 ms_handle_reset on v2:172.21.15.102:6832/3012591174 2024-09-16T01:18:34.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1009872557 shutdown_connections 2024-09-16T01:18:34.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd6c64a3740 1 -- 172.21.15.81:0/1009872557 wait complete. 2024-09-16T01:18:34.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.684+0000 7fd6c64a3740 20 client.6177 trim_cache size 0 max 16384 2024-09-16T01:18:34.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.702+0000 7fd6c64a3740 1 Processor -- start 2024-09-16T01:18:34.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.702+0000 7fd6c64a3740 1 -- start start 2024-09-16T01:18:34.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.702+0000 7fd6c64a3740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 0x55a3fdce71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.702+0000 7fd6c64a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 0x55a3fdce7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.702+0000 7fd6c64a3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcdd630 0x55a3fdd26940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.702+0000 7fd6c64a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc200220 con 0x55a3fdcbfa50 2024-09-16T01:18:34.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.702+0000 7fd6c64a3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc13c4e0 con 0x55a3fdcdd630 2024-09-16T01:18:34.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.702+0000 7fd6c64a3740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd6bc1ffc00 con 0x55a3fdcbe2c0 2024-09-16T01:18:34.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.702+0000 7fd6c0cae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 0x55a3fdce7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.702+0000 7fd6c0cae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 0x55a3fdce7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36750/0 (socket says 172.21.15.81:36750) 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.702+0000 7fd6c0cae640 1 -- 172.21.15.81:0/3261318572 learned_addr learned my addr 172.21.15.81:0/3261318572 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.703+0000 7fd6c1cb0640 1 --2- 172.21.15.81:0/3261318572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcdd630 0x55a3fdd26940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.703+0000 7fd6c0cae640 1 -- 172.21.15.81:0/3261318572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 msgr2=0x55a3fdce71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.703+0000 7fd6c14af640 1 --2- 172.21.15.81:0/3261318572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 0x55a3fdce71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.703+0000 7fd6c0cae640 1 --2- 172.21.15.81:0/3261318572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 0x55a3fdce71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.703+0000 7fd6c0cae640 1 -- 172.21.15.81:0/3261318572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcdd630 msgr2=0x55a3fdd26940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.703+0000 7fd6c0cae640 1 --2- 172.21.15.81:0/3261318572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcdd630 0x55a3fdd26940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.703+0000 7fd6c0cae640 1 -- 172.21.15.81:0/3261318572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3fdce5dc0 con 0x55a3fdcbfa50 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.703+0000 7fd6c1cb0640 1 --2- 172.21.15.81:0/3261318572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcdd630 0x55a3fdd26940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.703+0000 7fd6c0cae640 1 --2- 172.21.15.81:0/3261318572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 0x55a3fdce7720 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0036d0 tx=0x7fd6ac010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1b2e91dcb1f5cd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.703+0000 7fd6a67fc640 1 -- 172.21.15.81:0/3261318572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac014640 con 0x55a3fdcbfa50 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.703+0000 7fd6a67fc640 1 -- 172.21.15.81:0/3261318572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6ac0147e0 con 0x55a3fdcbfa50 2024-09-16T01:18:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.703+0000 7fd6a67fc640 1 -- 172.21.15.81:0/3261318572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac014bd0 con 0x55a3fdcbfa50 2024-09-16T01:18:34.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.704+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3261318572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 msgr2=0x55a3fdce7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.704+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/3261318572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 0x55a3fdce7720 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0036d0 tx=0x7fd6ac010000 comp rx=0 tx=0).stop 2024-09-16T01:18:34.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.704+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3261318572 shutdown_connections 2024-09-16T01:18:34.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.704+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/3261318572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcdd630 0x55a3fdd26940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.704+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/3261318572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 0x55a3fdce7720 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.704+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/3261318572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 0x55a3fdce71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.704+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3261318572 >> 172.21.15.81:0/3261318572 conn(0x55a3fdcbba80 msgr2=0x55a3fdcdc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:34.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.704+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3261318572 shutdown_connections 2024-09-16T01:18:34.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.704+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3261318572 wait complete. 2024-09-16T01:18:34.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.704+0000 7fd6c64a3740 1 -- start start 2024-09-16T01:18:34.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.704+0000 7fd6c64a3740 1 Processor -- start 2024-09-16T01:18:34.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c64a3740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 0x55a3fdd6a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c64a3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 0x55a3fdcdf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c64a3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcdd630 0x55a3fdcdfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c64a3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a3fdcb9720 con 0x55a3fdcbfa50 2024-09-16T01:18:34.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c64a3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a3fdcdd050 con 0x55a3fdcdd630 2024-09-16T01:18:34.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c64a3740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55a3fdcbc820 con 0x55a3fdcbe2c0 2024-09-16T01:18:34.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c64a3740 10 client.0 _ll_register_callbacks cb 0x7fd6b4005bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:18:34.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c0cae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 0x55a3fdcdf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c0cae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 0x55a3fdcdf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36756/0 (socket says 172.21.15.81:36756) 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c0cae640 1 -- 172.21.15.81:0/3957970714 learned_addr learned my addr 172.21.15.81:0/3957970714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c1cb0640 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcdd630 0x55a3fdcdfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c14af640 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 0x55a3fdd6a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c0cae640 1 -- 172.21.15.81:0/3957970714 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 msgr2=0x55a3fdd6a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c0cae640 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 0x55a3fdd6a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c0cae640 1 -- 172.21.15.81:0/3957970714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcdd630 msgr2=0x55a3fdcdfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c0cae640 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcdd630 0x55a3fdcdfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.705+0000 7fd6c0cae640 1 -- 172.21.15.81:0/3957970714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3fdce2a30 con 0x55a3fdcbfa50 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd6c0cae640 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 0x55a3fdcdf550 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac015000 tx=0x7fd6ac001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfe8c03593ba879 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd69bfff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd69bfff640 1 -- 172.21.15.81:0/3957970714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac031060 con 0x55a3fdcbfa50 2024-09-16T01:18:34.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd69bfff640 1 -- 172.21.15.81:0/3957970714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd6ac0069a0 con 0x55a3fdcbfa50 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3957970714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6ac0147e0 con 0x55a3fdcbfa50 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd69bfff640 1 -- 172.21.15.81:0/3957970714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd6ac014640 con 0x55a3fdcbfa50 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd6c64a3740 10 client.6183 fetch_fsmap learned FSMap version 36 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3957970714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55a3fdd81aa0 con 0x55a3fdcbfa50 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd69bfff640 1 -- 172.21.15.81:0/3957970714 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6ac0147e0 con 0x55a3fdcbfa50 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd69bfff640 1 -- 172.21.15.81:0/3957970714 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 36) ==== 3502+0+0 (secure 0 0 0) 0x7fd6ac03a080 con 0x55a3fdcbfa50 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd6c64a3740 10 client.6183 fetch_fsmap finished waiting for FSMap version 36 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd6c64a3740 10 client.6183 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd6c64a3740 20 client.6183 populate_metadata read hostname 'smithi081' 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.102:6832/3012591174,v1:172.21.15.102:6834/3012591174] conn(0x55a3fdcffaf0 0x55a3fdce2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd6c64a3740 4 client.6183 mds_command: new command op to 6027 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3957970714 --> [v2:172.21.15.102:6832/3012591174,v1:172.21.15.102:6834/3012591174] -- command(tid 0: {"prefix": "status"}) -- 0x55a3fdc27fa0 con 0x55a3fdcffaf0 2024-09-16T01:18:34.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.706+0000 7fd6c14af640 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.102:6832/3012591174,v1:172.21.15.102:6834/3012591174] conn(0x55a3fdcffaf0 0x55a3fdce2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd69bfff640 10 client.6183 ms_handle_connect on v2:172.21.15.102:6832/3012591174 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c14af640 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.102:6832/3012591174,v1:172.21.15.102:6834/3012591174] conn(0x55a3fdcffaf0 0x55a3fdce2ee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d32deaa58a5ebfa server_cookie=8765a8f5a8dacde4 in_seq=0 out_seq=0 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd69bfff640 1 -- 172.21.15.81:0/3957970714 <== mds.0 v2:172.21.15.102:6832/3012591174 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55a3fdc27fa0 con 0x55a3fdcffaf0 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd69bfff640 10 client.6183 handle_command_reply: tid=0 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c64a3740 1 client.6183 shutdown 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3957970714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 msgr2=0x55a3fdcdf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 0x55a3fdcdf550 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac015000 tx=0x7fd6ac001090 comp rx=0 tx=0).stop 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3957970714 shutdown_connections 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a3fdcdd630 0x55a3fdcdfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.102:6832/3012591174,v1:172.21.15.102:6834/3012591174] conn(0x55a3fdcffaf0 0x55a3fdce2ee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3fdcbfa50 0x55a3fdcdf550 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd69bfff640 0 client.6183 ms_handle_reset on v2:172.21.15.102:6832/3012591174 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c64a3740 1 --2- 172.21.15.81:0/3957970714 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55a3fdcbe2c0 0x55a3fdd6a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3957970714 >> 172.21.15.81:0/3957970714 conn(0x55a3fdcbba80 msgr2=0x55a3fdd00fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:34.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3957970714 shutdown_connections 2024-09-16T01:18:34.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c64a3740 1 -- 172.21.15.81:0/3957970714 wait complete. 2024-09-16T01:18:34.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.707+0000 7fd6c64a3740 20 client.6183 trim_cache size 0 max 16384 2024-09-16T01:18:34.715 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:18:34.715 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973", 2024-09-16T01:18:34.715 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-16T01:18:34.715 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6027, 2024-09-16T01:18:34.716 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-16T01:18:34.716 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-16T01:18:34.716 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-16T01:18:34.716 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 9.1259193770000007, 2024-09-16T01:18:34.716 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 36, 2024-09-16T01:18:34.716 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 75, 2024-09-16T01:18:34.716 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 75, 2024-09-16T01:18:34.716 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.461013203 2024-09-16T01:18:34.716 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:18:34.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.708+0000 7fd6c3713640 1 -- 172.21.15.81:0/3860657863 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd6a006c2b0 msgr2=0x7fd6a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.708+0000 7fd6c3713640 1 --2- 172.21.15.81:0/3860657863 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd6a006c2b0 0x7fd6a006e770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0758b0 tx=0x7fd6ac007990 comp rx=0 tx=0).stop 2024-09-16T01:18:34.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.708+0000 7fd6c3713640 1 -- 172.21.15.81:0/3860657863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6bc070dd0 msgr2=0x7fd6bc13e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.708+0000 7fd6c3713640 1 --2- 172.21.15.81:0/3860657863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6bc070dd0 0x7fd6bc13e060 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80097a0 tx=0x7fd6b80046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.708+0000 7fd6c3713640 1 -- 172.21.15.81:0/3860657863 shutdown_connections 2024-09-16T01:18:34.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.708+0000 7fd6c3713640 1 --2- 172.21.15.81:0/3860657863 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd6a006c2b0 0x7fd6a006e770 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.708+0000 7fd6c3713640 1 --2- 172.21.15.81:0/3860657863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd6bc147360 0x7fd6bc140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.708+0000 7fd6c3713640 1 --2- 172.21.15.81:0/3860657863 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd6bc0d0bb0 0x7fd6bc158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.708+0000 7fd6c3713640 1 --2- 172.21.15.81:0/3860657863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6bc070dd0 0x7fd6bc13e060 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.708+0000 7fd6c3713640 1 -- 172.21.15.81:0/3860657863 >> 172.21.15.81:0/3860657863 conn(0x7fd6bc0b2f40 msgr2=0x7fd6bc06f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:34.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.708+0000 7fd6c3713640 1 -- 172.21.15.81:0/3860657863 shutdown_connections 2024-09-16T01:18:34.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.708+0000 7fd6c3713640 1 -- 172.21.15.81:0/3860657863 wait complete. 2024-09-16T01:18:34.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:18:34.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.817+0000 7fd30d2a5640 1 Processor -- start 2024-09-16T01:18:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.817+0000 7fd30d2a5640 1 -- start start 2024-09-16T01:18:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd30d2a5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd308161c80 0x7fd30806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd30d2a5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30806e870 con 0x7fd3080b6680 2024-09-16T01:18:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd30d2a5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30806d9f0 con 0x7fd308162060 2024-09-16T01:18:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd30d2a5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd30806dcd0 con 0x7fd308161c80 2024-09-16T01:18:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd3077fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd3080b6680 0x7fd3080cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52062/0 (socket says 172.21.15.81:52062) 2024-09-16T01:18:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd3077fe640 1 -- 172.21.15.81:0/143202310 learned_addr learned my addr 172.21.15.81:0/143202310 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd306ffd640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd308161c80 0x7fd30806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325467903 0 0) 0x7fd300001490 con 0x7fd3080b6680 2024-09-16T01:18:34.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2f0003520 con 0x7fd3080b6680 2024-09-16T01:18:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2696113044 0 0) 0x7fd2f0003520 con 0x7fd3080b6680 2024-09-16T01:18:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd308161c80 msgr2=0x7fd30806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd308161c80 0x7fd30806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 >> v1:172.21.15.102:6789/0 conn(0x7fd308162060 legacy=0x7fd3080b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30806dfb0 con 0x7fd3080b6680 2024-09-16T01:18:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fd300001bc0 con 0x7fd3080b6680 2024-09-16T01:18:34.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 >> v1:172.21.15.81:6789/0 conn(0x7fd3080b6680 legacy=0x7fd3080cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd308161c80 0x7fd2f00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0003f20 0x7fd2f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2f0004d40 0x7fd2f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd30806dcd0 con 0x7fd2f0003f20 2024-09-16T01:18:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f000ba20 con 0x7fd2f0004d40 2024-09-16T01:18:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f000bc20 con 0x7fd308161c80 2024-09-16T01:18:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.818+0000 7fd3067fc640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0003f20 0x7fd2f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.819+0000 7fd306ffd640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd308161c80 0x7fd2f00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.819+0000 7fd3077fe640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2f0004d40 0x7fd2f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.819+0000 7fd3067fc640 1 -- 172.21.15.81:0/143202310 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd308161c80 msgr2=0x7fd2f00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.819+0000 7fd3067fc640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd308161c80 0x7fd2f00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.819+0000 7fd3067fc640 1 -- 172.21.15.81:0/143202310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2f0004d40 msgr2=0x7fd2f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.819+0000 7fd3067fc640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2f0004d40 0x7fd2f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.819+0000 7fd3067fc640 1 -- 172.21.15.81:0/143202310 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f0003520 con 0x7fd2f0003f20 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.819+0000 7fd306ffd640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd308161c80 0x7fd2f00039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.819+0000 7fd3067fc640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0003f20 0x7fd2f0004800 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd30808e830 tx=0x7fd2f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6f5b1b27d18473 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.820+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc037070 con 0x7fd2f0003f20 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.820+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2fc02aaa0 con 0x7fd2f0003f20 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.820+0000 7fd305ffb640 1 -- 172.21.15.81:0/143202310 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc001450 con 0x7fd2f0003f20 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.820+0000 7fd30d2a5640 1 -- 172.21.15.81:0/143202310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0003f20 msgr2=0x7fd2f0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.820+0000 7fd30d2a5640 1 --2- 172.21.15.81:0/143202310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2f0003f20 0x7fd2f0004800 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd30808e830 tx=0x7fd2f0005830 comp rx=0 tx=0).stop 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.820+0000 7fd3077fe640 1 -- 172.21.15.81:0/143202310 reap_dead start 2024-09-16T01:18:34.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.820+0000 7fd30d2a5640 1 -- 172.21.15.81:0/143202310 shutdown_connections 2024-09-16T01:18:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.820+0000 7fd30d2a5640 1 -- 172.21.15.81:0/143202310 >> 172.21.15.81:0/143202310 conn(0x7fd3080d44f0 msgr2=0x7fd3080d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.820+0000 7fd30d2a5640 1 -- 172.21.15.81:0/143202310 shutdown_connections 2024-09-16T01:18:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.820+0000 7fd30d2a5640 1 -- 172.21.15.81:0/143202310 wait complete. 2024-09-16T01:18:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.821+0000 7fd30d2a5640 1 Processor -- start 2024-09-16T01:18:34.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.821+0000 7fd30d2a5640 1 -- start start 2024-09-16T01:18:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.822+0000 7fd30d2a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2f0003f20 0x7fd3081f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.822+0000 7fd30d2a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3081f3e80 0x7fd3080cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.822+0000 7fd30d2a5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3080b8f10 0x7fd3080d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.822+0000 7fd30d2a5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3080b6b30 con 0x7fd3081f3e80 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.822+0000 7fd30d2a5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd3080d2aa0 con 0x7fd2f0003f20 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.822+0000 7fd30d2a5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd3080b6cb0 con 0x7fd3080b8f10 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.822+0000 7fd3067fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3081f3e80 0x7fd3080cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.822+0000 7fd3067fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3081f3e80 0x7fd3080cdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36778/0 (socket says 172.21.15.81:36778) 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.822+0000 7fd3067fc640 1 -- 172.21.15.81:0/1688298244 learned_addr learned my addr 172.21.15.81:0/1688298244 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.822+0000 7fd3077fe640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3080b8f10 0x7fd3080d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.822+0000 7fd306ffd640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2f0003f20 0x7fd3081f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.823+0000 7fd3067fc640 1 -- 172.21.15.81:0/1688298244 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3080b8f10 msgr2=0x7fd3080d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.823+0000 7fd3067fc640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3080b8f10 0x7fd3080d2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.823+0000 7fd3067fc640 1 -- 172.21.15.81:0/1688298244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2f0003f20 msgr2=0x7fd3081f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.823+0000 7fd3067fc640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2f0003f20 0x7fd3081f4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.823+0000 7fd3067fc640 1 -- 172.21.15.81:0/1688298244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3080ce220 con 0x7fd3081f3e80 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.823+0000 7fd306ffd640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2f0003f20 0x7fd3081f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.823+0000 7fd3067fc640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3081f3e80 0x7fd3080cdad0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc001850 tx=0x7fd2fc001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.823+0000 7fd2ef7fe640 1 -- 172.21.15.81:0/1688298244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc037040 con 0x7fd3081f3e80 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.823+0000 7fd2ef7fe640 1 -- 172.21.15.81:0/1688298244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2fc042070 con 0x7fd3081f3e80 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.823+0000 7fd30d2a5640 1 -- 172.21.15.81:0/1688298244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3080b8430 con 0x7fd3081f3e80 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.823+0000 7fd2ef7fe640 1 -- 172.21.15.81:0/1688298244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc001450 con 0x7fd3081f3e80 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.823+0000 7fd30d2a5640 1 -- 172.21.15.81:0/1688298244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3080b89f0 con 0x7fd3081f3e80 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.824+0000 7fd30d2a5640 1 -- 172.21.15.81:0/1688298244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd30806e330 con 0x7fd3081f3e80 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.824+0000 7fd2ef7fe640 1 -- 172.21.15.81:0/1688298244 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd2fc007040 con 0x7fd3081f3e80 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.825+0000 7fd2ef7fe640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd2f406c2e0 0x7fd2f406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.825+0000 7fd306ffd640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd2f406c2e0 0x7fd2f406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.825+0000 7fd2ef7fe640 1 -- 172.21.15.81:0/1688298244 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd2fc0ab7c0 con 0x7fd3081f3e80 2024-09-16T01:18:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.825+0000 7fd306ffd640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd2f406c2e0 0x7fd2f406e7a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd3080ba410 tx=0x7fd2f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:34.829+0000 7fd2ef7fe640 1 -- 172.21.15.81:0/1688298244 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2fc079ec0 con 0x7fd3081f3e80 2024-09-16T01:18:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.034+0000 7fd30d2a5640 1 -- 172.21.15.81:0/1688298244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd3080ba470 con 0x7fd3081f3e80 2024-09-16T01:18:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.034+0000 7fd2ef7fe640 1 -- 172.21.15.81:0/1688298244 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7fd2fc0797c0 con 0x7fd3081f3e80 2024-09-16T01:18:35.035 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:18:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.037+0000 7fd30d2a5640 1 -- 172.21.15.81:0/1688298244 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd2f406c2e0 msgr2=0x7fd2f406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.037+0000 7fd30d2a5640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd2f406c2e0 0x7fd2f406e7a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd3080ba410 tx=0x7fd2f8008040 comp rx=0 tx=0).stop 2024-09-16T01:18:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.037+0000 7fd30d2a5640 1 -- 172.21.15.81:0/1688298244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3081f3e80 msgr2=0x7fd3080cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.037+0000 7fd30d2a5640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3081f3e80 0x7fd3080cdad0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc001850 tx=0x7fd2fc001230 comp rx=0 tx=0).stop 2024-09-16T01:18:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.037+0000 7fd30d2a5640 1 -- 172.21.15.81:0/1688298244 shutdown_connections 2024-09-16T01:18:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.037+0000 7fd30d2a5640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd2f406c2e0 0x7fd2f406e7a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.037+0000 7fd30d2a5640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3080b8f10 0x7fd3080d2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.037+0000 7fd30d2a5640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3081f3e80 0x7fd3080cdad0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.037+0000 7fd30d2a5640 1 --2- 172.21.15.81:0/1688298244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2f0003f20 0x7fd3081f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.037+0000 7fd30d2a5640 1 -- 172.21.15.81:0/1688298244 >> 172.21.15.81:0/1688298244 conn(0x7fd3080d44f0 msgr2=0x7fd3080b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.037+0000 7fd30d2a5640 1 -- 172.21.15.81:0/1688298244 shutdown_connections 2024-09-16T01:18:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.037+0000 7fd30d2a5640 1 -- 172.21.15.81:0/1688298244 wait complete. 2024-09-16T01:18:35.049 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:18:35.049 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:18:35.049 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:18:35.049 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:18:35.049 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:18:35.049 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:18:35.049 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:18:35.049 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:18:35.049 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:18:35.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:35.050 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:18:35.066 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:18:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:18:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:18:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:18:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:35.066 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:18:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:18:35.066 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:18:35.066 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42623sec preferred_lft 42623sec 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:18:35.067 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::bc22:19ff:fe0c:8fb1/64 scope link 2024-09-16T01:18:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:35.068 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:18:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 86:bb:d8:38:80:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:18:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::84bb:d8ff:fe38:80af/64 scope link 2024-09-16T01:18:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:35.068 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:18:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:18:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::828:dff:febd:ee39/64 scope link 2024-09-16T01:18:35.068 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:35.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:35.069 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:18:35.130 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:18:35.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:35.131 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:18:35.188 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:18:35.189 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:18:35.189 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:18:35.189 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:18:35.189 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:18:35.189 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:18:35.189 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:18:35.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:18:35.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:18:35.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:18:35.190 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:18:35.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:18:35.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:18:35.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:35.314 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:18:35.330 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:18:35.330 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:18:35.330 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:18:35.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:35.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-16T01:18:35.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:18:35.395 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:18:35.451 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:18:35.451 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:18:35.451 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:18:35.506 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:18:35.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:35.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:18:35.589 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:18:35.590 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:18:35.590 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:18:35.598 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:18:35.598 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:18:35.598 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:18:35.599 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:18:35.599 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:18:35.604 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:18:35.604 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:18:35.604 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:18:35.604 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:18:35.605 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:18:35.605 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:18:35.605 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:18:35.605 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:18:35.605 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:18:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:18:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:18:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:18:35.605 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:18:35.607 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:18:35.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:35.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:18:35.679 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:18:35.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:18:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:18:35.780 INFO:teuthology.orchestra.run.smithi081.stdout:client5659 2024-09-16T01:18:35.781 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:35.781 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:35.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:18:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.940+0000 7fd730731640 1 Processor -- start 2024-09-16T01:18:35.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.940+0000 7fd730731640 1 -- start start 2024-09-16T01:18:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd730731640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd728072d30 0x7fd72806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd730731640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd72806f700 0x7fd72815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd730731640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7280cdbe0 con 0x7fd72815b300 2024-09-16T01:18:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd730731640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd72806fb50 con 0x7fd72806f700 2024-09-16T01:18:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd730731640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd7280728a0 con 0x7fd728072d30 2024-09-16T01:18:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd72ecce640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd72806f700 0x7fd72815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd72e4cd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd72815b300 0x7fd7280cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52074/0 (socket says 172.21.15.81:52074) 2024-09-16T01:18:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd72e4cd640 1 -- 172.21.15.81:0/3670772045 learned_addr learned my addr 172.21.15.81:0/3670772045 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd72dccc640 1 --2- 172.21.15.81:0/3670772045 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd728072d30 0x7fd72806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd72ecce640 1 -- 172.21.15.81:0/3670772045 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd728072d30 msgr2=0x7fd72806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd72ecce640 1 --2- 172.21.15.81:0/3670772045 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd728072d30 0x7fd72806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd72ecce640 1 -- 172.21.15.81:0/3670772045 >> v1:172.21.15.81:6789/0 conn(0x7fd72815b300 legacy=0x7fd7280cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.941+0000 7fd72ecce640 1 -- 172.21.15.81:0/3670772045 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7280cd900 con 0x7fd72806f700 2024-09-16T01:18:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.942+0000 7fd72ecce640 1 --2- 172.21.15.81:0/3670772045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd72806f700 0x7fd72815b6e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd720009d90 tx=0x7fd72002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e2b67b02ec7643 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.942+0000 7fd72d4cb640 1 -- 172.21.15.81:0/3670772045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720007740 con 0x7fd72806f700 2024-09-16T01:18:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.942+0000 7fd72d4cb640 1 -- 172.21.15.81:0/3670772045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7200078e0 con 0x7fd72806f700 2024-09-16T01:18:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.942+0000 7fd72d4cb640 1 -- 172.21.15.81:0/3670772045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720007cb0 con 0x7fd72806f700 2024-09-16T01:18:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.943+0000 7fd730731640 1 -- 172.21.15.81:0/3670772045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd72806f700 msgr2=0x7fd72815b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.943+0000 7fd730731640 1 --2- 172.21.15.81:0/3670772045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd72806f700 0x7fd72815b6e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd720009d90 tx=0x7fd72002a660 comp rx=0 tx=0).stop 2024-09-16T01:18:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.943+0000 7fd730731640 1 -- 172.21.15.81:0/3670772045 shutdown_connections 2024-09-16T01:18:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.943+0000 7fd730731640 1 --2- 172.21.15.81:0/3670772045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd72806f700 0x7fd72815b6e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.943+0000 7fd730731640 1 --2- 172.21.15.81:0/3670772045 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd728072d30 0x7fd72806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.943+0000 7fd730731640 1 -- 172.21.15.81:0/3670772045 >> 172.21.15.81:0/3670772045 conn(0x7fd728067d70 msgr2=0x7fd72806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.943+0000 7fd730731640 1 -- 172.21.15.81:0/3670772045 shutdown_connections 2024-09-16T01:18:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.943+0000 7fd730731640 1 -- 172.21.15.81:0/3670772045 wait complete. 2024-09-16T01:18:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.944+0000 7fd730731640 1 Processor -- start 2024-09-16T01:18:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.944+0000 7fd730731640 1 -- start start 2024-09-16T01:18:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd730731640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd72806f700 0x7fd728165de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd730731640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd728072d30 0x7fd72815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd730731640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd72815b300 0x7fd72814a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd730731640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7280cd5c0 con 0x7fd72806f700 2024-09-16T01:18:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd730731640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd728072530 con 0x7fd72815b300 2024-09-16T01:18:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd730731640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd7280cffe0 con 0x7fd728072d30 2024-09-16T01:18:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd72e4cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd72806f700 0x7fd728165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd72e4cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd72806f700 0x7fd728165de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36802/0 (socket says 172.21.15.81:36802) 2024-09-16T01:18:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd72e4cd640 1 -- 172.21.15.81:0/1836309528 learned_addr learned my addr 172.21.15.81:0/1836309528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd72ecce640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd72815b300 0x7fd72814a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd72dccc640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd728072d30 0x7fd72815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd72e4cd640 1 -- 172.21.15.81:0/1836309528 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd728072d30 msgr2=0x7fd72815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd72e4cd640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd728072d30 0x7fd72815a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd72e4cd640 1 -- 172.21.15.81:0/1836309528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd72815b300 msgr2=0x7fd72814a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd72e4cd640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd72815b300 0x7fd72814a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd72e4cd640 1 -- 172.21.15.81:0/1836309528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72815ab10 con 0x7fd72806f700 2024-09-16T01:18:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd72ecce640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd72815b300 0x7fd72814a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd72e4cd640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd72806f700 0x7fd728165de0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd72400c3c0 tx=0x7fd72400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd71effd640 1 -- 172.21.15.81:0/1836309528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724017070 con 0x7fd72806f700 2024-09-16T01:18:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd71effd640 1 -- 172.21.15.81:0/1836309528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd724005ce0 con 0x7fd72806f700 2024-09-16T01:18:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd730731640 1 -- 172.21.15.81:0/1836309528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7281663c0 con 0x7fd72806f700 2024-09-16T01:18:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd71effd640 1 -- 172.21.15.81:0/1836309528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7240072f0 con 0x7fd72806f700 2024-09-16T01:18:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.945+0000 7fd730731640 1 -- 172.21.15.81:0/1836309528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd728166980 con 0x7fd72806f700 2024-09-16T01:18:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.946+0000 7fd730731640 1 -- 172.21.15.81:0/1836309528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd72806e7d0 con 0x7fd72806f700 2024-09-16T01:18:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.947+0000 7fd71effd640 1 -- 172.21.15.81:0/1836309528 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd72401a070 con 0x7fd72806f700 2024-09-16T01:18:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.947+0000 7fd71effd640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd70c06c2b0 0x7fd70c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.948+0000 7fd72dccc640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd70c06c2b0 0x7fd70c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.948+0000 7fd71effd640 1 -- 172.21.15.81:0/1836309528 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fd72408a8d0 con 0x7fd72806f700 2024-09-16T01:18:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.948+0000 7fd72dccc640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd70c06c2b0 0x7fd70c06e770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd7280af630 tx=0x7fd718008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:35.952+0000 7fd71effd640 1 -- 172.21.15.81:0/1836309528 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd724058f40 con 0x7fd72806f700 2024-09-16T01:18:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.154+0000 7fd730731640 1 -- 172.21.15.81:0/1836309528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd72806d090 con 0x7fd72806f700 2024-09-16T01:18:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.154+0000 7fd71effd640 1 -- 172.21.15.81:0/1836309528 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) ==== 53+0+73 (secure 0 0 0) 0x7fd724058840 con 0x7fd72806f700 2024-09-16T01:18:36.155 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:18:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.156+0000 7fd730731640 1 -- 172.21.15.81:0/1836309528 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd70c06c2b0 msgr2=0x7fd70c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.156+0000 7fd730731640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd70c06c2b0 0x7fd70c06e770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd7280af630 tx=0x7fd718008040 comp rx=0 tx=0).stop 2024-09-16T01:18:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.156+0000 7fd730731640 1 -- 172.21.15.81:0/1836309528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd72806f700 msgr2=0x7fd728165de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:36.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.156+0000 7fd730731640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd72806f700 0x7fd728165de0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd72400c3c0 tx=0x7fd72400c880 comp rx=0 tx=0).stop 2024-09-16T01:18:36.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.156+0000 7fd730731640 1 -- 172.21.15.81:0/1836309528 shutdown_connections 2024-09-16T01:18:36.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.156+0000 7fd730731640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd70c06c2b0 0x7fd70c06e770 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:36.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.156+0000 7fd730731640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd72815b300 0x7fd72814a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:36.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.156+0000 7fd730731640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd728072d30 0x7fd72815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:36.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.156+0000 7fd730731640 1 --2- 172.21.15.81:0/1836309528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd72806f700 0x7fd728165de0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:36.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.156+0000 7fd730731640 1 -- 172.21.15.81:0/1836309528 >> 172.21.15.81:0/1836309528 conn(0x7fd728067d70 msgr2=0x7fd72806efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:36.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.156+0000 7fd730731640 1 -- 172.21.15.81:0/1836309528 shutdown_connections 2024-09-16T01:18:36.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:36.156+0000 7fd730731640 1 -- 172.21.15.81:0/1836309528 wait complete. 2024-09-16T01:18:36.167 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:18:36.168 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:18:36.168 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-16T01:18:36.168 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T01:18:36.168 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:18:36.168 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:18:36.168 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:18:36.168 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:18:36.168 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:18:36.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:36.169 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-16T01:18:36.188 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:18:36.189 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:18:36.189 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:18:36.189 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:36.189 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:18:36.189 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:36.189 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:18:36.189 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:36.189 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-16T01:18:36.194 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:18:36.194 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:36.194 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-16T01:18:36.194 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:18:36.194 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:36.194 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:18:36.194 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:36.194 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:18:36.194 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42624sec preferred_lft 42624sec 2024-09-16T01:18:36.194 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-16T01:18:36.195 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:36.195 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:18:36.195 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:18:36.195 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:18:36.195 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:36.195 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::fc48:18ff:fedc:b80f/64 scope link 2024-09-16T01:18:36.195 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:36.195 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:18:36.195 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 2e:4a:65:c9:20:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:18:36.196 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::2c4a:65ff:fec9:204f/64 scope link 2024-09-16T01:18:36.196 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:36.196 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:18:36.196 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:18:36.196 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::1072:70ff:fefd:f9f1/64 scope link 2024-09-16T01:18:36.196 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:18:36.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:36.196 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:18:36.258 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:18:36.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:36.260 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-16T01:18:36.320 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-16T01:18:36.320 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:18:36.320 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:18:36.320 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:18:36.320 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:18:36.320 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:18:36.321 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:18:36.321 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:18:36.321 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:18:36.321 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:18:36.321 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:18:36.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:18:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:18:36.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:18:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:18:36.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:36.465 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:18:36.483 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T01:18:36.483 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:18:36.483 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:18:36.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:36.483 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-16T01:18:36.551 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:18:36.551 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T01:18:36.608 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:18:36.608 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:18:36.608 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:18:36.664 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:18:36.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:36.665 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:18:36.751 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:18:36.751 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:18:36.751 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:18:36.760 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:18:36.760 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:18:36.760 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:18:36.760 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:18:36.760 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:18:36.764 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:18:36.764 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:18:36.764 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:18:36.764 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:18:36.765 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:18:36.765 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:18:36.765 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:18:36.765 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:18:36.765 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T01:18:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:18:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:18:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:18:36.765 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:18:36.767 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:18:36.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:36.767 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:18:36.792 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:18:36.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:18:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:18:36.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:18:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:18:36.891 INFO:teuthology.orchestra.run.smithi102.stdout:client5665 2024-09-16T01:18:36.891 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:18:36.891 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:36.908 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-16T01:18:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.016+0000 7f2f3a0dd640 1 Processor -- start 2024-09-16T01:18:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.016+0000 7f2f3a0dd640 1 -- start start 2024-09-16T01:18:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f3a0dd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f341519f0 0x7f2f340726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f3a0dd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2f34072be0 0x7f2f340b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f3a0dd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f340b4800 con 0x7f2f340b3fd0 2024-09-16T01:18:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f3a0dd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2f34073020 con 0x7f2f341519f0 2024-09-16T01:18:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f3a0dd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2f340b4ae0 con 0x7f2f34072be0 2024-09-16T01:18:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f337fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f341519f0 0x7f2f340726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f33fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2f340b3fd0 0x7f2f3415e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52078/0 (socket says 172.21.15.81:52078) 2024-09-16T01:18:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f33fff640 1 -- 172.21.15.81:0/2635881520 learned_addr learned my addr 172.21.15.81:0/2635881520 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f32ffd640 1 --2- 172.21.15.81:0/2635881520 >> v2:172.21.15.102:3300/0 conn(0x7f2f34072be0 0x7f2f340b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f337fe640 1 -- 172.21.15.81:0/2635881520 >> v2:172.21.15.102:3300/0 conn(0x7f2f34072be0 msgr2=0x7f2f340b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f337fe640 1 --2- 172.21.15.81:0/2635881520 >> v2:172.21.15.102:3300/0 conn(0x7f2f34072be0 0x7f2f340b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f337fe640 1 -- 172.21.15.81:0/2635881520 >> v1:172.21.15.81:6789/0 conn(0x7f2f340b3fd0 legacy=0x7f2f3415e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f337fe640 1 -- 172.21.15.81:0/2635881520 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f340b4dc0 con 0x7f2f341519f0 2024-09-16T01:18:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.017+0000 7f2f32ffd640 1 --2- 172.21.15.81:0/2635881520 >> v2:172.21.15.102:3300/0 conn(0x7f2f34072be0 0x7f2f340b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.018+0000 7f2f337fe640 1 --2- 172.21.15.81:0/2635881520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f341519f0 0x7f2f340726a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2f340d0010 tx=0x7f2f2402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323c6619edb58858 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.018+0000 7f2f327fc640 1 -- 172.21.15.81:0/2635881520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24037070 con 0x7f2f341519f0 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.018+0000 7f2f327fc640 1 -- 172.21.15.81:0/2635881520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f24032440 con 0x7f2f341519f0 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.018+0000 7f2f327fc640 1 -- 172.21.15.81:0/2635881520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2402ae60 con 0x7f2f341519f0 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.019+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/2635881520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f341519f0 msgr2=0x7f2f340726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.019+0000 7f2f3a0dd640 1 --2- 172.21.15.81:0/2635881520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f341519f0 0x7f2f340726a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2f340d0010 tx=0x7f2f2402a110 comp rx=0 tx=0).stop 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.019+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/2635881520 shutdown_connections 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.019+0000 7f2f3a0dd640 1 --2- 172.21.15.81:0/2635881520 >> v2:172.21.15.102:3300/0 conn(0x7f2f34072be0 0x7f2f340b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.019+0000 7f2f3a0dd640 1 --2- 172.21.15.81:0/2635881520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f341519f0 0x7f2f340726a0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.019+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/2635881520 >> 172.21.15.81:0/2635881520 conn(0x7f2f3406bdf0 msgr2=0x7f2f3406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.019+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/2635881520 shutdown_connections 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.019+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/2635881520 wait complete. 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.020+0000 7f2f3a0dd640 1 Processor -- start 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.020+0000 7f2f3a0dd640 1 -- start start 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f3a0dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f34072be0 0x7f2f3414c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f3a0dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b3fd0 0x7f2f34166c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f3a0dd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f341519f0 0x7f2f340cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f3a0dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f340b4400 con 0x7f2f340b3fd0 2024-09-16T01:18:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f3a0dd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2f34151dd0 con 0x7f2f341519f0 2024-09-16T01:18:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f3a0dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2f340b4580 con 0x7f2f34072be0 2024-09-16T01:18:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f32ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b3fd0 0x7f2f34166c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f32ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b3fd0 0x7f2f34166c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36822/0 (socket says 172.21.15.81:36822) 2024-09-16T01:18:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f32ffd640 1 -- 172.21.15.81:0/3980262352 learned_addr learned my addr 172.21.15.81:0/3980262352 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f33fff640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f341519f0 0x7f2f340cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f337fe640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f34072be0 0x7f2f3414c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f32ffd640 1 -- 172.21.15.81:0/3980262352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f34072be0 msgr2=0x7f2f3414c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f32ffd640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f34072be0 0x7f2f3414c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f32ffd640 1 -- 172.21.15.81:0/3980262352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f341519f0 msgr2=0x7f2f340cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f32ffd640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f341519f0 0x7f2f340cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f32ffd640 1 -- 172.21.15.81:0/3980262352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f340ccba0 con 0x7f2f340b3fd0 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f337fe640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f34072be0 0x7f2f3414c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f33fff640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f341519f0 0x7f2f340cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.021+0000 7f2f32ffd640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b3fd0 0x7f2f34166c00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c7f0 tx=0x7f2f2800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.022+0000 7f2f1bfff640 1 -- 172.21.15.81:0/3980262352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28015070 con 0x7f2f340b3fd0 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.022+0000 7f2f1bfff640 1 -- 172.21.15.81:0/3980262352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f28007a30 con 0x7f2f340b3fd0 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.022+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/3980262352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f34167430 con 0x7f2f340b3fd0 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.022+0000 7f2f1bfff640 1 -- 172.21.15.81:0/3980262352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28007e00 con 0x7f2f340b3fd0 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.022+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/3980262352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f340cd120 con 0x7f2f340b3fd0 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.023+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/3980262352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f340b3a90 con 0x7f2f340b3fd0 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.023+0000 7f2f1bfff640 1 -- 172.21.15.81:0/3980262352 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2f28018070 con 0x7f2f340b3fd0 2024-09-16T01:18:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.024+0000 7f2f1bfff640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2f2006c2b0 0x7f2f2006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.024+0000 7f2f1bfff640 1 -- 172.21.15.81:0/3980262352 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f2f2808b580 con 0x7f2f340b3fd0 2024-09-16T01:18:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.024+0000 7f2f337fe640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2f2006c2b0 0x7f2f2006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.024+0000 7f2f337fe640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2f2006c2b0 0x7f2f2006e770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f24034000 tx=0x7f2f2402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.028+0000 7f2f1bfff640 1 -- 172.21.15.81:0/3980262352 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f28059b60 con 0x7f2f340b3fd0 2024-09-16T01:18:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.194+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/3980262352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7f2f3415f390 con 0x7f2f340b3fd0 2024-09-16T01:18:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.194+0000 7f2f1bfff640 1 -- 172.21.15.81:0/3980262352 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v20) ==== 106+0+4 (secure 0 0 0) 0x7f2f28059460 con 0x7f2f340b3fd0 2024-09-16T01:18:37.195 INFO:teuthology.orchestra.run.smithi081.stdout:100 2024-09-16T01:18:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.196+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/3980262352 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2f2006c2b0 msgr2=0x7f2f2006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.196+0000 7f2f3a0dd640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2f2006c2b0 0x7f2f2006e770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f24034000 tx=0x7f2f2402e000 comp rx=0 tx=0).stop 2024-09-16T01:18:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.196+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/3980262352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b3fd0 msgr2=0x7f2f34166c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.196+0000 7f2f3a0dd640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b3fd0 0x7f2f34166c00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c7f0 tx=0x7f2f2800cbf0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.196+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/3980262352 shutdown_connections 2024-09-16T01:18:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.196+0000 7f2f3a0dd640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2f2006c2b0 0x7f2f2006e770 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.196+0000 7f2f3a0dd640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f341519f0 0x7f2f340cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.196+0000 7f2f3a0dd640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b3fd0 0x7f2f34166c00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.196+0000 7f2f3a0dd640 1 --2- 172.21.15.81:0/3980262352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f34072be0 0x7f2f3414c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.196+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/3980262352 >> 172.21.15.81:0/3980262352 conn(0x7f2f3406bdf0 msgr2=0x7f2f34071e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.197+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/3980262352 shutdown_connections 2024-09-16T01:18:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.197+0000 7f2f3a0dd640 1 -- 172.21.15.81:0/3980262352 wait complete. 2024-09-16T01:18:37.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_max_caps_per_client 200 2024-09-16T01:18:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.314+0000 7fee271a6640 1 Processor -- start 2024-09-16T01:18:37.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.315+0000 7fee271a6640 1 -- start start 2024-09-16T01:18:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.315+0000 7fee271a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee201621f0 0x7fee2015fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.315+0000 7fee271a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fee200d0b90 0x7fee20070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.315+0000 7fee271a6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee200d1040 con 0x7fee201625d0 2024-09-16T01:18:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.315+0000 7fee271a6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fee200702f0 con 0x7fee200d0b90 2024-09-16T01:18:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.315+0000 7fee271a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fee200d1320 con 0x7fee201621f0 2024-09-16T01:18:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.316+0000 7fee24f42640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee201621f0 0x7fee2015fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.316+0000 7fee25743640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fee200d0b90 0x7fee20070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.316+0000 7fee24f42640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee201621f0 0x7fee2015fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:54594/0 (socket says 172.21.15.81:54594) 2024-09-16T01:18:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.316+0000 7fee24f42640 1 -- 172.21.15.81:0/793865722 learned_addr learned my addr 172.21.15.81:0/793865722 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.316+0000 7fee24f42640 1 -- 172.21.15.81:0/793865722 >> v2:172.21.15.102:3300/0 conn(0x7fee200d0b90 msgr2=0x7fee20070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.316+0000 7fee24f42640 1 --2- 172.21.15.81:0/793865722 >> v2:172.21.15.102:3300/0 conn(0x7fee200d0b90 0x7fee20070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.316+0000 7fee24f42640 1 -- 172.21.15.81:0/793865722 >> v1:172.21.15.102:6789/0 conn(0x7fee201625d0 legacy=0x7fee200d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.316+0000 7fee24f42640 1 -- 172.21.15.81:0/793865722 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee200d1600 con 0x7fee201621f0 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.316+0000 7fee25743640 1 --2- 172.21.15.81:0/793865722 >> v2:172.21.15.102:3300/0 conn(0x7fee200d0b90 0x7fee20070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.317+0000 7fee24f42640 1 --2- 172.21.15.81:0/793865722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee201621f0 0x7fee2015fff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee10009870 tx=0x7fee1002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d752684b6d287 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.317+0000 7fee1f7fe640 1 -- 172.21.15.81:0/793865722 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10037070 con 0x7fee201621f0 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.317+0000 7fee1f7fe640 1 -- 172.21.15.81:0/793865722 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1002ae50 con 0x7fee201621f0 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.317+0000 7fee1f7fe640 1 -- 172.21.15.81:0/793865722 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10032860 con 0x7fee201621f0 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.317+0000 7fee271a6640 1 -- 172.21.15.81:0/793865722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee201621f0 msgr2=0x7fee2015fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.317+0000 7fee271a6640 1 --2- 172.21.15.81:0/793865722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee201621f0 0x7fee2015fff0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee10009870 tx=0x7fee1002a300 comp rx=0 tx=0).stop 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.318+0000 7fee271a6640 1 -- 172.21.15.81:0/793865722 shutdown_connections 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.318+0000 7fee271a6640 1 --2- 172.21.15.81:0/793865722 >> v2:172.21.15.102:3300/0 conn(0x7fee200d0b90 0x7fee20070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.318+0000 7fee271a6640 1 --2- 172.21.15.81:0/793865722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee201621f0 0x7fee2015fff0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.318+0000 7fee271a6640 1 -- 172.21.15.81:0/793865722 >> 172.21.15.81:0/793865722 conn(0x7fee200b3de0 msgr2=0x7fee200b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:37.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.318+0000 7fee271a6640 1 -- 172.21.15.81:0/793865722 shutdown_connections 2024-09-16T01:18:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.318+0000 7fee271a6640 1 -- 172.21.15.81:0/793865722 wait complete. 2024-09-16T01:18:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.319+0000 7fee271a6640 1 Processor -- start 2024-09-16T01:18:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.319+0000 7fee271a6640 1 -- start start 2024-09-16T01:18:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee271a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee200d0b90 0x7fee2015be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee271a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee201621f0 0x7fee200b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee271a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee201625d0 0x7fee2015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee271a6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee20162a10 con 0x7fee200d0b90 2024-09-16T01:18:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee271a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fee2015f960 con 0x7fee201621f0 2024-09-16T01:18:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee271a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fee2015c360 con 0x7fee201625d0 2024-09-16T01:18:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee24f42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee200d0b90 0x7fee2015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee24f42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee200d0b90 0x7fee2015be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36836/0 (socket says 172.21.15.81:36836) 2024-09-16T01:18:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee24f42640 1 -- 172.21.15.81:0/301060100 learned_addr learned my addr 172.21.15.81:0/301060100 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee1ffff640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee201621f0 0x7fee200b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee25743640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee201625d0 0x7fee2015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee24f42640 1 -- 172.21.15.81:0/301060100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee201625d0 msgr2=0x7fee2015a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee24f42640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee201625d0 0x7fee2015a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee24f42640 1 -- 172.21.15.81:0/301060100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee201621f0 msgr2=0x7fee200b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee24f42640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee201621f0 0x7fee200b78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee24f42640 1 -- 172.21.15.81:0/301060100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee200b5bf0 con 0x7fee200d0b90 2024-09-16T01:18:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee24f42640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee200d0b90 0x7fee2015be20 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fee10000c00 tx=0x7fee100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee1d7fa640 1 -- 172.21.15.81:0/301060100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10041070 con 0x7fee200d0b90 2024-09-16T01:18:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee1d7fa640 1 -- 172.21.15.81:0/301060100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1003c660 con 0x7fee200d0b90 2024-09-16T01:18:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee271a6640 1 -- 172.21.15.81:0/301060100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee200b5ed0 con 0x7fee200d0b90 2024-09-16T01:18:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee1d7fa640 1 -- 172.21.15.81:0/301060100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10037040 con 0x7fee200d0b90 2024-09-16T01:18:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.320+0000 7fee271a6640 1 -- 172.21.15.81:0/301060100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee200b58a0 con 0x7fee200d0b90 2024-09-16T01:18:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.321+0000 7fee271a6640 1 -- 172.21.15.81:0/301060100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee2015fff0 con 0x7fee200d0b90 2024-09-16T01:18:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.322+0000 7fee1d7fa640 1 -- 172.21.15.81:0/301060100 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fee10044070 con 0x7fee200d0b90 2024-09-16T01:18:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.322+0000 7fee1d7fa640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fee0c06c2e0 0x7fee0c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.322+0000 7fee1d7fa640 1 -- 172.21.15.81:0/301060100 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fee100abd30 con 0x7fee200d0b90 2024-09-16T01:18:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.322+0000 7fee1ffff640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fee0c06c2e0 0x7fee0c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.323+0000 7fee1ffff640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fee0c06c2e0 0x7fee0c06e7a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee201f8130 tx=0x7fee14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.326+0000 7fee1d7fa640 1 -- 172.21.15.81:0/301060100 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee1007a310 con 0x7fee200d0b90 2024-09-16T01:18:37.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.494+0000 7fee271a6640 1 -- 172.21.15.81:0/301060100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_max_caps_per_client}] v 0) -- 0x7fee200b4cf0 con 0x7fee200d0b90 2024-09-16T01:18:37.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.497+0000 7fee1d7fa640 1 -- 172.21.15.81:0/301060100 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_max_caps_per_client}]=0 v21)=0 v21) ==== 123+0+0 (secure 0 0 0) 0x7fee10079c10 con 0x7fee200d0b90 2024-09-16T01:18:37.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.499+0000 7fee271a6640 1 -- 172.21.15.81:0/301060100 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fee0c06c2e0 msgr2=0x7fee0c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:37.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.499+0000 7fee271a6640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fee0c06c2e0 0x7fee0c06e7a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee201f8130 tx=0x7fee14009040 comp rx=0 tx=0).stop 2024-09-16T01:18:37.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.499+0000 7fee271a6640 1 -- 172.21.15.81:0/301060100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee200d0b90 msgr2=0x7fee2015be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:37.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.499+0000 7fee271a6640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee200d0b90 0x7fee2015be20 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fee10000c00 tx=0x7fee100046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.499+0000 7fee271a6640 1 -- 172.21.15.81:0/301060100 shutdown_connections 2024-09-16T01:18:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.499+0000 7fee271a6640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fee0c06c2e0 0x7fee0c06e7a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.499+0000 7fee271a6640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee201625d0 0x7fee2015a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.499+0000 7fee271a6640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee201621f0 0x7fee200b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.499+0000 7fee271a6640 1 --2- 172.21.15.81:0/301060100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee200d0b90 0x7fee2015be20 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.499+0000 7fee271a6640 1 -- 172.21.15.81:0/301060100 >> 172.21.15.81:0/301060100 conn(0x7fee200b3de0 msgr2=0x7fee2009b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.499+0000 7fee271a6640 1 -- 172.21.15.81:0/301060100 shutdown_connections 2024-09-16T01:18:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:37.499+0000 7fee271a6640 1 -- 172.21.15.81:0/301060100 wait complete. 2024-09-16T01:18:37.511 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:37.511 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:37.527 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-16T01:18:37.527 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-16T01:18:37.527 DEBUG:teuthology.orchestra.run.smithi081:> import uuid 2024-09-16T01:18:37.527 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:18:37.527 DEBUG:teuthology.orchestra.run.smithi081:> n = 600 2024-09-16T01:18:37.527 DEBUG:teuthology.orchestra.run.smithi081:> create_hard_links = False 2024-09-16T01:18:37.527 DEBUG:teuthology.orchestra.run.smithi081:> if 0 > 0: 2024-09-16T01:18:37.527 DEBUG:teuthology.orchestra.run.smithi081:> create_hard_links = True 2024-09-16T01:18:37.527 DEBUG:teuthology.orchestra.run.smithi081:> path = "/home/ubuntu/cephtest/mnt.0/foo/" 2024-09-16T01:18:37.527 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:18:37.527 DEBUG:teuthology.orchestra.run.smithi081:> dpath = os.path.dirname(path) 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> fnameprefix = os.path.basename(path) 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> os.makedirs(dpath, exist_ok=True) 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> for i in range(n): 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> with open(fpath, '"'"'w'"'"') as f: 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> f.write(f"{i}") 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> if True: 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> f.flush() 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(f.fileno()) 2024-09-16T01:18:37.528 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:18:37.529 DEBUG:teuthology.orchestra.run.smithi081:> os.unlink(fpath) 2024-09-16T01:18:37.529 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:18:37.529 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(dirfd) 2024-09-16T01:18:37.529 DEBUG:teuthology.orchestra.run.smithi081:> if create_hard_links: 2024-09-16T01:18:37.529 DEBUG:teuthology.orchestra.run.smithi081:> for j in range(0): 2024-09-16T01:18:37.529 DEBUG:teuthology.orchestra.run.smithi081:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-16T01:18:37.529 DEBUG:teuthology.orchestra.run.smithi081:> if False: 2024-09-16T01:18:37.529 DEBUG:teuthology.orchestra.run.smithi081:> os.fsync(dirfd) 2024-09-16T01:18:37.529 DEBUG:teuthology.orchestra.run.smithi081:> finally: 2024-09-16T01:18:37.529 DEBUG:teuthology.orchestra.run.smithi081:> os.close(dirfd) 2024-09-16T01:18:37.529 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-16T01:18:38.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:18:38.671 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:18:40.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:18:40.229 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:40.229 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:40.245 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:18:40.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:18:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:18:40.341 INFO:teuthology.orchestra.run.smithi081.stdout:client5659 2024-09-16T01:18:40.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:40.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.440+0000 7fc2c1b8d640 1 Processor -- start 2024-09-16T01:18:40.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.440+0000 7fc2c1b8d640 1 -- start start 2024-09-16T01:18:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.441+0000 7fc2c1b8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2bc15ba30 0x7fc2bc06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.441+0000 7fc2c1b8d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2bc0b3570 con 0x7fc2bc06fd50 2024-09-16T01:18:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.441+0000 7fc2c1b8d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2bc0b3850 con 0x7fc2bc073050 2024-09-16T01:18:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.441+0000 7fc2c1b8d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc2bc0b4180 con 0x7fc2bc15ba30 2024-09-16T01:18:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.441+0000 7fc2bb7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2bc15ba30 0x7fc2bc06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.441+0000 7fc2baffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc2bc06fd50 0x7fc2bc072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52086/0 (socket says 172.21.15.81:52086) 2024-09-16T01:18:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.441+0000 7fc2baffd640 1 -- 172.21.15.81:0/289792662 learned_addr learned my addr 172.21.15.81:0/289792662 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.441+0000 7fc2bb7fe640 1 -- 172.21.15.81:0/289792662 >> v1:172.21.15.102:6789/0 conn(0x7fc2bc073050 legacy=0x7fc2bc0b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:40.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.441+0000 7fc2bb7fe640 1 -- 172.21.15.81:0/289792662 >> v1:172.21.15.81:6789/0 conn(0x7fc2bc06fd50 legacy=0x7fc2bc072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:40.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.441+0000 7fc2bb7fe640 1 -- 172.21.15.81:0/289792662 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2bc0b3b30 con 0x7fc2bc15ba30 2024-09-16T01:18:40.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.442+0000 7fc2bb7fe640 1 --2- 172.21.15.81:0/289792662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2bc15ba30 0x7fc2bc06f810 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0b4300 tx=0x7fc2ac02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28954dd721fe3213 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:40.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.442+0000 7fc2ba7fc640 1 -- 172.21.15.81:0/289792662 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac037070 con 0x7fc2bc15ba30 2024-09-16T01:18:40.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.442+0000 7fc2ba7fc640 1 -- 172.21.15.81:0/289792662 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ac032440 con 0x7fc2bc15ba30 2024-09-16T01:18:40.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.442+0000 7fc2ba7fc640 1 -- 172.21.15.81:0/289792662 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac032810 con 0x7fc2bc15ba30 2024-09-16T01:18:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.443+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/289792662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2bc15ba30 msgr2=0x7fc2bc06f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.443+0000 7fc2c1b8d640 1 --2- 172.21.15.81:0/289792662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2bc15ba30 0x7fc2bc06f810 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0b4300 tx=0x7fc2ac02a210 comp rx=0 tx=0).stop 2024-09-16T01:18:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.443+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/289792662 shutdown_connections 2024-09-16T01:18:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.443+0000 7fc2c1b8d640 1 --2- 172.21.15.81:0/289792662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2bc15ba30 0x7fc2bc06f810 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.443+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/289792662 >> 172.21.15.81:0/289792662 conn(0x7fc2bc067d70 msgr2=0x7fc2bc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.443+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/289792662 shutdown_connections 2024-09-16T01:18:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.443+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/289792662 wait complete. 2024-09-16T01:18:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.444+0000 7fc2c1b8d640 1 Processor -- start 2024-09-16T01:18:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.444+0000 7fc2c1b8d640 1 -- start start 2024-09-16T01:18:40.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2c1b8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2bc06fd50 0x7fc2bc13c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:40.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2c1b8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2bc073050 0x7fc2bc146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:40.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2c1b8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2bc15ba30 0x7fc2bc144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:40.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2c1b8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc0ccfe0 con 0x7fc2bc06fd50 2024-09-16T01:18:40.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2c1b8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc0ce810 con 0x7fc2bc15ba30 2024-09-16T01:18:40.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2c1b8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc2bc0cd160 con 0x7fc2bc073050 2024-09-16T01:18:40.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2bb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2bc06fd50 0x7fc2bc13c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2bb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2bc06fd50 0x7fc2bc13c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36850/0 (socket says 172.21.15.81:36850) 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2bb7fe640 1 -- 172.21.15.81:0/3215464182 learned_addr learned my addr 172.21.15.81:0/3215464182 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2bbfff640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2bc15ba30 0x7fc2bc144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2baffd640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2bc073050 0x7fc2bc146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2bb7fe640 1 -- 172.21.15.81:0/3215464182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2bc073050 msgr2=0x7fc2bc146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2bb7fe640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2bc073050 0x7fc2bc146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2bb7fe640 1 -- 172.21.15.81:0/3215464182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2bc15ba30 msgr2=0x7fc2bc144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2bb7fe640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2bc15ba30 0x7fc2bc144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2bb7fe640 1 -- 172.21.15.81:0/3215464182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2bc144820 con 0x7fc2bc06fd50 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2bb7fe640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2bc06fd50 0x7fc2bc13c880 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009890 tx=0x7fc2ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2a3fff640 1 -- 172.21.15.81:0/3215464182 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac037040 con 0x7fc2bc06fd50 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2a3fff640 1 -- 172.21.15.81:0/3215464182 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ac042070 con 0x7fc2bc06fd50 2024-09-16T01:18:40.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.445+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/3215464182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2bc14f080 con 0x7fc2bc06fd50 2024-09-16T01:18:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.446+0000 7fc2a3fff640 1 -- 172.21.15.81:0/3215464182 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac030bd0 con 0x7fc2bc06fd50 2024-09-16T01:18:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.446+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/3215464182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2bc13cdc0 con 0x7fc2bc06fd50 2024-09-16T01:18:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.446+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/3215464182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2bc06f810 con 0x7fc2bc06fd50 2024-09-16T01:18:40.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.447+0000 7fc2a3fff640 1 -- 172.21.15.81:0/3215464182 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc2ac047460 con 0x7fc2bc06fd50 2024-09-16T01:18:40.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.447+0000 7fc2a3fff640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc2a806c2b0 0x7fc2a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:40.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.448+0000 7fc2a3fff640 1 -- 172.21.15.81:0/3215464182 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fc2ac0ac160 con 0x7fc2bc06fd50 2024-09-16T01:18:40.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.448+0000 7fc2baffd640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc2a806c2b0 0x7fc2a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:40.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.448+0000 7fc2baffd640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc2a806c2b0 0x7fc2a806e770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc14cd70 tx=0x7fc2b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:40.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.452+0000 7fc2a3fff640 1 -- 172.21.15.81:0/3215464182 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2ac032e20 con 0x7fc2bc06fd50 2024-09-16T01:18:40.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.654+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/3215464182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2bc14dc00 con 0x7fc2bc06fd50 2024-09-16T01:18:40.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.655+0000 7fc2a3fff640 1 -- 172.21.15.81:0/3215464182 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5222 (secure 0 0 0) 0x7fc2ac07a740 con 0x7fc2bc06fd50 2024-09-16T01:18:40.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:40.656 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"btime":"2024-09-16T01:18:27:841583+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4005145731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":4005145731},{"type":"v1","addr":"172.21.15.102:6835","nonce":4005145731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/40318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":40318124},{"type":"v1","addr":"172.21.15.81:6835","nonce":40318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/700844751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":700844751},{"type":"v1","addr":"172.21.15.81:6837","nonce":700844751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:24.925061+0000","modified":"2024-09-16T01:18:27.171098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6027},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6027":{"gid":6027,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/3012591174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3012591174},{"type":"v1","addr":"172.21.15.102:6834","nonce":3012591174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6027,"qdb_cluster":[6027]},"id":5}]} 2024-09-16T01:18:40.657 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-09-16T01:18:40.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.657+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/3215464182 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc2a806c2b0 msgr2=0x7fc2a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:40.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.657+0000 7fc2c1b8d640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc2a806c2b0 0x7fc2a806e770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc14cd70 tx=0x7fc2b0009040 comp rx=0 tx=0).stop 2024-09-16T01:18:40.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.657+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/3215464182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2bc06fd50 msgr2=0x7fc2bc13c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:40.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.657+0000 7fc2c1b8d640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2bc06fd50 0x7fc2bc13c880 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009890 tx=0x7fc2ac0046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:40.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.657+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/3215464182 shutdown_connections 2024-09-16T01:18:40.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.657+0000 7fc2c1b8d640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc2a806c2b0 0x7fc2a806e770 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:40.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.657+0000 7fc2c1b8d640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2bc15ba30 0x7fc2bc144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:40.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.657+0000 7fc2c1b8d640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2bc073050 0x7fc2bc146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.657+0000 7fc2c1b8d640 1 --2- 172.21.15.81:0/3215464182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2bc06fd50 0x7fc2bc13c880 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.657+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/3215464182 >> 172.21.15.81:0/3215464182 conn(0x7fc2bc067d70 msgr2=0x7fc2bc150e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.657+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/3215464182 shutdown_connections 2024-09-16T01:18:40.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:40.657+0000 7fc2c1b8d640 1 -- 172.21.15.81:0/3215464182 wait complete. 2024-09-16T01:18:40.670 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-16T01:18:40.787 INFO:teuthology.orchestra.run.smithi102.stdout:[{"id":5665,"entity":{"name":{"type":"client","num":5665},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":1726248191}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":4.0159158240000004,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9763048085528605,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5665 v1:192.168.0.1:0/1726248191","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi102","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":5659,"entity":{"name":{"type":"client","num":5659},"addr":{"type":"v1","addr":"172.21.15.81:0","nonce":2770830415}},"state":"open","num_leases":1,"num_caps":602,"request_load_avg":616,"uptime":5.1768914879999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":962.20216216061101,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":706.62834676058105,"halflife":1.5},"recall_caps_throttle2o":{"value":461.89660123166561,"halflife":0.5},"session_cache_liveness":{"value":1199.9007994529798,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":630,"last_trim_completed_flushes_tid":601,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.5659 v1:172.21.15.81:0/2770830415","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000044d","length":903}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi081","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-16T01:18:40.787 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi102", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 1726248191, "type": "v1" }, "name": { "num": 5665, "type": "client" } }, "id": 5665, "inst": "client.5665 v1:192.168.0.1:0/1726248191", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9763048085528605 }, "state": "open", "uptime": 4.015915824 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi081", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 2770830415, "type": "v1" }, "name": { "num": 5659, "type": "client" } }, "id": 5659, "inst": "client.5659 v1:172.21.15.81:0/2770830415", "last_trim_completed_flushes_tid": 601, "last_trim_completed_requests_tid": 630, "num_caps": 602, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 903, "start": "0x1000000044d" } ], "recall_caps": { "halflife": 60, "value": 962.202162160611 }, "recall_caps_throttle": { "halflife": 1.5, "value": 706.628346760581 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 461.8966012316656 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 616, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1199.9007994529798 }, "state": "open", "uptime": 5.176891488 } ] 2024-09-16T01:18:40.788 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-16T01:18:45.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:45.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.901+0000 7f3a530f1640 1 Processor -- start 2024-09-16T01:18:45.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.901+0000 7f3a530f1640 1 -- start start 2024-09-16T01:18:45.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.902+0000 7f3a530f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a4c145e00 0x7f3a4c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:45.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.902+0000 7f3a530f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3a4c15d460 0x7f3a4c0d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:45.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.902+0000 7f3a530f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a4c0af720 con 0x7f3a4c0d0a10 2024-09-16T01:18:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.902+0000 7f3a530f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3a4c1461e0 con 0x7f3a4c15d460 2024-09-16T01:18:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.902+0000 7f3a530f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4c15d8c0 con 0x7f3a4c145e00 2024-09-16T01:18:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.902+0000 7f3a4bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3a4c15d460 0x7f3a4c0d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.902+0000 7f3a5168e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3a4c0d0a10 0x7f3a4c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56750/0 (socket says 172.21.15.81:56750) 2024-09-16T01:18:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.902+0000 7f3a5168e640 1 -- 172.21.15.81:0/3765456093 learned_addr learned my addr 172.21.15.81:0/3765456093 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.902+0000 7f3a50e8d640 1 --2- 172.21.15.81:0/3765456093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a4c145e00 0x7f3a4c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.902+0000 7f3a4bfff640 1 -- 172.21.15.81:0/3765456093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a4c145e00 msgr2=0x7f3a4c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.903+0000 7f3a4bfff640 1 --2- 172.21.15.81:0/3765456093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a4c145e00 0x7f3a4c0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:45.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.903+0000 7f3a4bfff640 1 -- 172.21.15.81:0/3765456093 >> v1:172.21.15.81:6789/0 conn(0x7f3a4c0d0a10 legacy=0x7f3a4c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.903+0000 7f3a4b7fe640 1 -- 172.21.15.81:0/3765456093 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723595236 0 0) 0x7f3a4c0af720 con 0x7f3a4c0d0a10 2024-09-16T01:18:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.903+0000 7f3a4bfff640 1 -- 172.21.15.81:0/3765456093 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4c0cdf90 con 0x7f3a4c15d460 2024-09-16T01:18:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.903+0000 7f3a50e8d640 1 --2- 172.21.15.81:0/3765456093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a4c145e00 0x7f3a4c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.903+0000 7f3a4bfff640 1 --2- 172.21.15.81:0/3765456093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c15d460 0x7f3a4c0d04d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c146360 tx=0x7f3a4002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96a9192414f294b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.903+0000 7f3a4b7fe640 1 -- 172.21.15.81:0/3765456093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40037070 con 0x7f3a4c15d460 2024-09-16T01:18:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.903+0000 7f3a4b7fe640 1 -- 172.21.15.81:0/3765456093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a40032440 con 0x7f3a4c15d460 2024-09-16T01:18:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.903+0000 7f3a4b7fe640 1 -- 172.21.15.81:0/3765456093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a40032810 con 0x7f3a4c15d460 2024-09-16T01:18:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.904+0000 7f3a530f1640 1 -- 172.21.15.81:0/3765456093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c15d460 msgr2=0x7f3a4c0d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.904+0000 7f3a530f1640 1 --2- 172.21.15.81:0/3765456093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c15d460 0x7f3a4c0d04d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c146360 tx=0x7f3a4002a180 comp rx=0 tx=0).stop 2024-09-16T01:18:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.904+0000 7f3a530f1640 1 -- 172.21.15.81:0/3765456093 shutdown_connections 2024-09-16T01:18:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.904+0000 7f3a530f1640 1 --2- 172.21.15.81:0/3765456093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c15d460 0x7f3a4c0d04d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.904+0000 7f3a530f1640 1 --2- 172.21.15.81:0/3765456093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a4c145e00 0x7f3a4c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.904+0000 7f3a530f1640 1 -- 172.21.15.81:0/3765456093 >> 172.21.15.81:0/3765456093 conn(0x7f3a4c0b2f40 msgr2=0x7f3a4c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.904+0000 7f3a530f1640 1 -- 172.21.15.81:0/3765456093 shutdown_connections 2024-09-16T01:18:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.904+0000 7f3a530f1640 1 -- 172.21.15.81:0/3765456093 wait complete. 2024-09-16T01:18:45.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.905+0000 7f3a530f1640 1 Processor -- start 2024-09-16T01:18:45.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.905+0000 7f3a530f1640 1 -- start start 2024-09-16T01:18:45.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.906+0000 7f3a530f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a4c0d0a10 0x7f3a4c159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:45.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.906+0000 7f3a530f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a4c145e00 0x7f3a4c140c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:45.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.906+0000 7f3a530f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c15d460 0x7f3a4c1411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:45.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.906+0000 7f3a530f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c0ce830 con 0x7f3a4c15d460 2024-09-16T01:18:45.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.906+0000 7f3a530f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3a4c0ce550 con 0x7f3a4c145e00 2024-09-16T01:18:45.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.906+0000 7f3a530f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3a4c0cede0 con 0x7f3a4c0d0a10 2024-09-16T01:18:45.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.906+0000 7f3a5168e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c15d460 0x7f3a4c1411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:45.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.906+0000 7f3a5168e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c15d460 0x7f3a4c1411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53220/0 (socket says 172.21.15.81:53220) 2024-09-16T01:18:45.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.906+0000 7f3a5168e640 1 -- 172.21.15.81:0/2304848566 learned_addr learned my addr 172.21.15.81:0/2304848566 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a50e8d640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a4c0d0a10 0x7f3a4c159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a5168e640 1 -- 172.21.15.81:0/2304848566 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a4c0d0a10 msgr2=0x7f3a4c159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a4bfff640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a4c145e00 0x7f3a4c140c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a5168e640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a4c0d0a10 0x7f3a4c159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a5168e640 1 -- 172.21.15.81:0/2304848566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a4c145e00 msgr2=0x7f3a4c140c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a5168e640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a4c145e00 0x7f3a4c140c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a5168e640 1 -- 172.21.15.81:0/2304848566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a4c1417c0 con 0x7f3a4c15d460 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a50e8d640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a4c0d0a10 0x7f3a4c159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a5168e640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c15d460 0x7f3a4c1411a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400caf0 tx=0x7f3a4400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a497fa640 1 -- 172.21.15.81:0/2304848566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400aca0 con 0x7f3a4c15d460 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a497fa640 1 -- 172.21.15.81:0/2304848566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4400ae40 con 0x7f3a4c15d460 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a497fa640 1 -- 172.21.15.81:0/2304848566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a44012620 con 0x7f3a4c15d460 2024-09-16T01:18:45.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a530f1640 1 -- 172.21.15.81:0/2304848566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a4c141aa0 con 0x7f3a4c15d460 2024-09-16T01:18:45.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.907+0000 7f3a530f1640 1 -- 172.21.15.81:0/2304848566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a4c142060 con 0x7f3a4c15d460 2024-09-16T01:18:45.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.908+0000 7f3a530f1640 1 -- 172.21.15.81:0/2304848566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a4c067e20 con 0x7f3a4c15d460 2024-09-16T01:18:45.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.908+0000 7f3a497fa640 1 -- 172.21.15.81:0/2304848566 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3a44012880 con 0x7f3a4c15d460 2024-09-16T01:18:45.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.909+0000 7f3a497fa640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a3806c2b0 0x7f3a3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:45.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.909+0000 7f3a497fa640 1 -- 172.21.15.81:0/2304848566 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f3a4408bca0 con 0x7f3a4c15d460 2024-09-16T01:18:45.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.909+0000 7f3a50e8d640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a3806c2b0 0x7f3a3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:45.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.909+0000 7f3a50e8d640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a3806c2b0 0x7f3a3806e770 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c006fd0 tx=0x7f3a3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:45.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:45.913+0000 7f3a497fa640 1 -- 172.21.15.81:0/2304848566 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a4c067e20 con 0x7f3a4c15d460 2024-09-16T01:18:46.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.114+0000 7f3a530f1640 1 -- 172.21.15.81:0/2304848566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a4c0cf200 con 0x7f3a4c15d460 2024-09-16T01:18:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.114+0000 7f3a497fa640 1 -- 172.21.15.81:0/2304848566 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5222 (secure 0 0 0) 0x7f3a4405a270 con 0x7f3a4c15d460 2024-09-16T01:18:46.115 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:46.115 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"btime":"2024-09-16T01:18:27:841583+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4005145731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":4005145731},{"type":"v1","addr":"172.21.15.102:6835","nonce":4005145731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/40318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":40318124},{"type":"v1","addr":"172.21.15.81:6835","nonce":40318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/700844751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":700844751},{"type":"v1","addr":"172.21.15.81:6837","nonce":700844751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:24.925061+0000","modified":"2024-09-16T01:18:27.171098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6027},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6027":{"gid":6027,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/3012591174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3012591174},{"type":"v1","addr":"172.21.15.102:6834","nonce":3012591174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6027,"qdb_cluster":[6027]},"id":5}]} 2024-09-16T01:18:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-09-16T01:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.116+0000 7f3a530f1640 1 -- 172.21.15.81:0/2304848566 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a3806c2b0 msgr2=0x7f3a3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.116+0000 7f3a530f1640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a3806c2b0 0x7f3a3806e770 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c006fd0 tx=0x7f3a3c008040 comp rx=0 tx=0).stop 2024-09-16T01:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.116+0000 7f3a530f1640 1 -- 172.21.15.81:0/2304848566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c15d460 msgr2=0x7f3a4c1411a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.116+0000 7f3a530f1640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c15d460 0x7f3a4c1411a0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400caf0 tx=0x7f3a4400a060 comp rx=0 tx=0).stop 2024-09-16T01:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.116+0000 7f3a530f1640 1 -- 172.21.15.81:0/2304848566 shutdown_connections 2024-09-16T01:18:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.116+0000 7f3a530f1640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a3806c2b0 0x7f3a3806e770 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.116+0000 7f3a530f1640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4c15d460 0x7f3a4c1411a0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.116+0000 7f3a530f1640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a4c145e00 0x7f3a4c140c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.116+0000 7f3a530f1640 1 --2- 172.21.15.81:0/2304848566 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a4c0d0a10 0x7f3a4c159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.116+0000 7f3a530f1640 1 -- 172.21.15.81:0/2304848566 >> 172.21.15.81:0/2304848566 conn(0x7f3a4c0b2f40 msgr2=0x7f3a4c0afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.116+0000 7f3a530f1640 1 -- 172.21.15.81:0/2304848566 shutdown_connections 2024-09-16T01:18:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.116+0000 7f3a530f1640 1 -- 172.21.15.81:0/2304848566 wait complete. 2024-09-16T01:18:46.129 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-16T01:18:46.258 INFO:teuthology.orchestra.run.smithi102.stdout:[{"id":5665,"entity":{"name":{"type":"client","num":5665},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":1726248191}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":9.4848011929999991,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9389333979310459,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5665 v1:192.168.0.1:0/1726248191","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi102","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":5659,"entity":{"name":{"type":"client","num":5659},"addr":{"type":"v1","addr":"172.21.15.81:0","nonce":2770830415}},"state":"open","num_leases":1,"num_caps":153,"request_load_avg":578,"uptime":10.645776857,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":2187.366013983999,"halflife":60},"release_caps":{"value":438.38465865092189,"halflife":60},"recall_caps_throttle":{"value":487.4061365471153,"halflife":1.5},"recall_caps_throttle2o":{"value":45.647044183645328,"halflife":0.5},"session_cache_liveness":{"value":1184.8344711142488,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":630,"last_trim_completed_flushes_tid":601,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.5659 v1:172.21.15.81:0/2770830415","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000044d","length":903}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi081","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-16T01:18:46.258 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi102", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 1726248191, "type": "v1" }, "name": { "num": 5665, "type": "client" } }, "id": 5665, "inst": "client.5665 v1:192.168.0.1:0/1726248191", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.938933397931046 }, "state": "open", "uptime": 9.484801193 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi081", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 2770830415, "type": "v1" }, "name": { "num": 5659, "type": "client" } }, "id": 5659, "inst": "client.5659 v1:172.21.15.81:0/2770830415", "last_trim_completed_flushes_tid": 601, "last_trim_completed_requests_tid": 630, "num_caps": 153, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 903, "start": "0x1000000044d" } ], "recall_caps": { "halflife": 60, "value": 2187.366013983999 }, "recall_caps_throttle": { "halflife": 1.5, "value": 487.4061365471153 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 45.64704418364533 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 438.3846586509219 }, "request_load_avg": 578, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1184.8344711142488 }, "state": "open", "uptime": 10.645776857 } ] 2024-09-16T01:18:46.258 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-16T01:18:46.259 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:18:46.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:18:46.302 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:18:46.341 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:18:46.341 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:18:46.341 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:46.341 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:46.358 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:46.358 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:46.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:18:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.553+0000 7fb34a542640 1 Processor -- start 2024-09-16T01:18:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.553+0000 7fb34a542640 1 -- start start 2024-09-16T01:18:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.553+0000 7fb34a542640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb34409aa30 0x7fb3440b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.553+0000 7fb34a542640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb3440b3760 0x7fb34409ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.553+0000 7fb34a542640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34409b350 con 0x7fb34406cd20 2024-09-16T01:18:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.553+0000 7fb34a542640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb3440d0670 con 0x7fb34409aa30 2024-09-16T01:18:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.553+0000 7fb34a542640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb3440b2790 con 0x7fb3440b3760 2024-09-16T01:18:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.554+0000 7fb343fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb34409aa30 0x7fb3440b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.554+0000 7fb348adf640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb34406cd20 0x7fb3440d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56752/0 (socket says 172.21.15.81:56752) 2024-09-16T01:18:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.554+0000 7fb348adf640 1 -- 172.21.15.81:0/862204250 learned_addr learned my addr 172.21.15.81:0/862204250 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.554+0000 7fb3437fe640 1 --2- 172.21.15.81:0/862204250 >> v2:172.21.15.102:3300/0 conn(0x7fb3440b3760 0x7fb34409ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:46.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.554+0000 7fb343fff640 1 -- 172.21.15.81:0/862204250 >> v2:172.21.15.102:3300/0 conn(0x7fb3440b3760 msgr2=0x7fb34409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:46.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.554+0000 7fb343fff640 1 --2- 172.21.15.81:0/862204250 >> v2:172.21.15.102:3300/0 conn(0x7fb3440b3760 0x7fb34409ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.554+0000 7fb343fff640 1 -- 172.21.15.81:0/862204250 >> v1:172.21.15.81:6789/0 conn(0x7fb34406cd20 legacy=0x7fb3440d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:46.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.554+0000 7fb342ffd640 1 -- 172.21.15.81:0/862204250 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640184805 0 0) 0x7fb34409b350 con 0x7fb34406cd20 2024-09-16T01:18:46.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.554+0000 7fb343fff640 1 -- 172.21.15.81:0/862204250 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3440b2a70 con 0x7fb34409aa30 2024-09-16T01:18:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.555+0000 7fb343fff640 1 --2- 172.21.15.81:0/862204250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34409aa30 0x7fb3440b3030 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb3440730f0 tx=0x7fb33402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915be8bd0cac5e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.555+0000 7fb342ffd640 1 -- 172.21.15.81:0/862204250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334037070 con 0x7fb34409aa30 2024-09-16T01:18:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.555+0000 7fb342ffd640 1 -- 172.21.15.81:0/862204250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb334032440 con 0x7fb34409aa30 2024-09-16T01:18:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.555+0000 7fb342ffd640 1 -- 172.21.15.81:0/862204250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33402ae60 con 0x7fb34409aa30 2024-09-16T01:18:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.555+0000 7fb34a542640 1 -- 172.21.15.81:0/862204250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34409aa30 msgr2=0x7fb3440b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.555+0000 7fb34a542640 1 --2- 172.21.15.81:0/862204250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34409aa30 0x7fb3440b3030 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb3440730f0 tx=0x7fb33402a110 comp rx=0 tx=0).stop 2024-09-16T01:18:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.555+0000 7fb34a542640 1 -- 172.21.15.81:0/862204250 shutdown_connections 2024-09-16T01:18:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.555+0000 7fb34a542640 1 --2- 172.21.15.81:0/862204250 >> v2:172.21.15.102:3300/0 conn(0x7fb3440b3760 0x7fb34409ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.555+0000 7fb34a542640 1 --2- 172.21.15.81:0/862204250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34409aa30 0x7fb3440b3030 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.555+0000 7fb34a542640 1 -- 172.21.15.81:0/862204250 >> 172.21.15.81:0/862204250 conn(0x7fb3440d23a0 msgr2=0x7fb3440d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.555+0000 7fb34a542640 1 -- 172.21.15.81:0/862204250 shutdown_connections 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.555+0000 7fb34a542640 1 -- 172.21.15.81:0/862204250 wait complete. 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.556+0000 7fb34a542640 1 Processor -- start 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.557+0000 7fb34a542640 1 -- start start 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.557+0000 7fb34a542640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb34406cd20 0x7fb344158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.557+0000 7fb34a542640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34409aa30 0x7fb34409dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.557+0000 7fb34a542640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb3440b3760 0x7fb3440c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.557+0000 7fb34a542640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb34415fca0 con 0x7fb34409aa30 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.557+0000 7fb34a542640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb3440d08a0 con 0x7fb34406cd20 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.557+0000 7fb34a542640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb34415fe20 con 0x7fb3440b3760 2024-09-16T01:18:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.557+0000 7fb3437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34409aa30 0x7fb34409dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.557+0000 7fb3437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34409aa30 0x7fb34409dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53244/0 (socket says 172.21.15.81:53244) 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.557+0000 7fb3437fe640 1 -- 172.21.15.81:0/1782281990 learned_addr learned my addr 172.21.15.81:0/1782281990 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb343fff640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb34406cd20 0x7fb344158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb348adf640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb3440b3760 0x7fb3440c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb3437fe640 1 -- 172.21.15.81:0/1782281990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb3440b3760 msgr2=0x7fb3440c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb3437fe640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb3440b3760 0x7fb3440c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb3437fe640 1 -- 172.21.15.81:0/1782281990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb34406cd20 msgr2=0x7fb344158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb3437fe640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb34406cd20 0x7fb344158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb3437fe640 1 -- 172.21.15.81:0/1782281990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3440c7490 con 0x7fb34409aa30 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb348adf640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb3440b3760 0x7fb3440c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb3437fe640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34409aa30 0x7fb34409dd00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb33800d830 tx=0x7fb33800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb340ff9640 1 -- 172.21.15.81:0/1782281990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33800b6c0 con 0x7fb34409aa30 2024-09-16T01:18:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb340ff9640 1 -- 172.21.15.81:0/1782281990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb338019070 con 0x7fb34409aa30 2024-09-16T01:18:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb34a542640 1 -- 172.21.15.81:0/1782281990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3440c7770 con 0x7fb34409aa30 2024-09-16T01:18:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb340ff9640 1 -- 172.21.15.81:0/1782281990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33800ba80 con 0x7fb34409aa30 2024-09-16T01:18:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.558+0000 7fb34a542640 1 -- 172.21.15.81:0/1782281990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb34409c750 con 0x7fb34409aa30 2024-09-16T01:18:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.559+0000 7fb34a542640 1 -- 172.21.15.81:0/1782281990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3440d1fe0 con 0x7fb34409aa30 2024-09-16T01:18:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.559+0000 7fb340ff9640 1 -- 172.21.15.81:0/1782281990 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb33801e460 con 0x7fb34409aa30 2024-09-16T01:18:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.560+0000 7fb340ff9640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb33006c2b0 0x7fb33006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.560+0000 7fb340ff9640 1 -- 172.21.15.81:0/1782281990 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fb33808bbe0 con 0x7fb34409aa30 2024-09-16T01:18:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.560+0000 7fb343fff640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb33006c2b0 0x7fb33006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.560+0000 7fb343fff640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb33006c2b0 0x7fb33006e770 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb334034000 tx=0x7fb33402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:46.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.564+0000 7fb340ff9640 1 -- 172.21.15.81:0/1782281990 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb33805a1c0 con 0x7fb34409aa30 2024-09-16T01:18:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.741+0000 7fb34a542640 1 -- 172.21.15.81:0/1782281990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb3440b3cb0 con 0x7fb34409aa30 2024-09-16T01:18:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.741+0000 7fb340ff9640 1 -- 172.21.15.81:0/1782281990 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7fb338059ac0 con 0x7fb34409aa30 2024-09-16T01:18:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:18:46.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.743+0000 7fb34a542640 1 -- 172.21.15.81:0/1782281990 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb33006c2b0 msgr2=0x7fb33006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.743+0000 7fb34a542640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb33006c2b0 0x7fb33006e770 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb334034000 tx=0x7fb33402e000 comp rx=0 tx=0).stop 2024-09-16T01:18:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.743+0000 7fb34a542640 1 -- 172.21.15.81:0/1782281990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34409aa30 msgr2=0x7fb34409dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.743+0000 7fb34a542640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34409aa30 0x7fb34409dd00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb33800d830 tx=0x7fb33800dcf0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.743+0000 7fb34a542640 1 -- 172.21.15.81:0/1782281990 shutdown_connections 2024-09-16T01:18:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.743+0000 7fb34a542640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb33006c2b0 0x7fb33006e770 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.743+0000 7fb34a542640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb3440b3760 0x7fb3440c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.743+0000 7fb34a542640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34409aa30 0x7fb34409dd00 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.743+0000 7fb34a542640 1 --2- 172.21.15.81:0/1782281990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb34406cd20 0x7fb344158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.743+0000 7fb34a542640 1 -- 172.21.15.81:0/1782281990 >> 172.21.15.81:0/1782281990 conn(0x7fb3440d23a0 msgr2=0x7fb3440af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.744+0000 7fb34a542640 1 -- 172.21.15.81:0/1782281990 shutdown_connections 2024-09-16T01:18:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:46.744+0000 7fb34a542640 1 -- 172.21.15.81:0/1782281990 wait complete. 2024-09-16T01:18:46.755 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:18:46.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:46.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:18:46.859 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:18:46.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:46.860 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:18:46.875 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:18:46.875 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:18:46.875 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:46.892 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:18:46.893 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:46.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:18:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.049+0000 7feda6e82640 1 Processor -- start 2024-09-16T01:18:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.049+0000 7feda6e82640 1 -- start start 2024-09-16T01:18:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.050+0000 7feda6e82640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feda00d1540 0x7feda006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.050+0000 7feda6e82640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda00d1970 con 0x7feda015e740 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.050+0000 7feda6e82640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda00d0780 con 0x7feda009b690 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.050+0000 7feda6e82640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7feda015eb20 con 0x7feda00d1540 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.050+0000 7feda4c1e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feda015e740 0x7feda006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56766/0 (socket says 172.21.15.81:56766) 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.050+0000 7feda4c1e640 1 -- 172.21.15.81:0/2034644067 learned_addr learned my addr 172.21.15.81:0/2034644067 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414458574 0 0) 0x7feda00d1970 con 0x7feda015e740 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed8c003520 con 0x7feda015e740 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9ffff640 1 --2- 172.21.15.81:0/2034644067 >> v2:172.21.15.102:3300/0 conn(0x7feda00d1540 0x7feda006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1362411693 0 0) 0x7fed8c003520 con 0x7feda015e740 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 >> v2:172.21.15.102:3300/0 conn(0x7feda00d1540 msgr2=0x7feda006dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 --2- 172.21.15.81:0/2034644067 >> v2:172.21.15.102:3300/0 conn(0x7feda00d1540 0x7feda006dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 >> v1:172.21.15.102:6789/0 conn(0x7feda009b690 legacy=0x7feda0070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda00d0a60 con 0x7feda015e740 2024-09-16T01:18:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fed900019f0 con 0x7feda015e740 2024-09-16T01:18:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 >> v1:172.21.15.81:6789/0 conn(0x7feda015e740 legacy=0x7feda006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 --2- 172.21.15.81:0/2034644067 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed8c0039b0 0x7fed8c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 --2- 172.21.15.81:0/2034644067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed8c004800 0x7fed8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 --2- 172.21.15.81:0/2034644067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 0x7fed8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feda015eb20 con 0x7fed8c0051c0 2024-09-16T01:18:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fed8c00c0d0 con 0x7fed8c004800 2024-09-16T01:18:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fed8c00c2d0 con 0x7fed8c0039b0 2024-09-16T01:18:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7feda541f640 1 --2- 172.21.15.81:0/2034644067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 0x7fed8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7fed9ffff640 1 --2- 172.21.15.81:0/2034644067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed8c004800 0x7fed8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7feda4c1e640 1 --2- 172.21.15.81:0/2034644067 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed8c0039b0 0x7fed8c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7feda541f640 1 -- 172.21.15.81:0/2034644067 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed8c0039b0 msgr2=0x7fed8c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:47.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7feda541f640 1 --2- 172.21.15.81:0/2034644067 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed8c0039b0 0x7fed8c003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7feda541f640 1 -- 172.21.15.81:0/2034644067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed8c004800 msgr2=0x7fed8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:47.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7feda541f640 1 --2- 172.21.15.81:0/2034644067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed8c004800 0x7fed8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.051+0000 7feda541f640 1 -- 172.21.15.81:0/2034644067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8c003520 con 0x7fed8c0051c0 2024-09-16T01:18:47.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.052+0000 7feda541f640 1 -- 172.21.15.81:0/2034644067 reap_dead start 2024-09-16T01:18:47.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.052+0000 7feda541f640 1 --2- 172.21.15.81:0/2034644067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 0x7fed8c00b9c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fed98003db0 tx=0x7fed8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f83dab6950e1f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:47.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.052+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98003980 con 0x7fed8c0051c0 2024-09-16T01:18:47.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.052+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed98007240 con 0x7fed8c0051c0 2024-09-16T01:18:47.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.052+0000 7fed9f7fe640 1 -- 172.21.15.81:0/2034644067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98007630 con 0x7fed8c0051c0 2024-09-16T01:18:47.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.053+0000 7feda6e82640 1 -- 172.21.15.81:0/2034644067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 msgr2=0x7fed8c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.053+0000 7feda6e82640 1 --2- 172.21.15.81:0/2034644067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 0x7fed8c00b9c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fed98003db0 tx=0x7fed8c005830 comp rx=0 tx=0).stop 2024-09-16T01:18:47.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.053+0000 7feda6e82640 1 -- 172.21.15.81:0/2034644067 shutdown_connections 2024-09-16T01:18:47.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.053+0000 7feda6e82640 1 --2- 172.21.15.81:0/2034644067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 0x7fed8c00b9c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.053+0000 7feda6e82640 1 -- 172.21.15.81:0/2034644067 >> 172.21.15.81:0/2034644067 conn(0x7feda00d23a0 msgr2=0x7feda00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:47.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.053+0000 7feda6e82640 1 -- 172.21.15.81:0/2034644067 shutdown_connections 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.053+0000 7feda6e82640 1 -- 172.21.15.81:0/2034644067 wait complete. 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.054+0000 7feda6e82640 1 Processor -- start 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.054+0000 7feda6e82640 1 -- start start 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda6e82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 0x7feda01515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda6e82640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda00c9470 0x7feda00c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda6e82640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feda00c76f0 0x7feda00c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda6e82640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feda009baa0 con 0x7fed8c0051c0 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda6e82640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feda00d1020 con 0x7feda00c9470 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda6e82640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feda006cd20 con 0x7feda00c76f0 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda4c1e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 0x7feda01515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda4c1e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 0x7feda01515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53274/0 (socket says 172.21.15.81:53274) 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda4c1e640 1 -- 172.21.15.81:0/3191352320 learned_addr learned my addr 172.21.15.81:0/3191352320 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:47.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7fed9ffff640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda00c9470 0x7feda00c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda541f640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feda00c76f0 0x7feda00c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda4c1e640 1 -- 172.21.15.81:0/3191352320 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feda00c76f0 msgr2=0x7feda00c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda4c1e640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feda00c76f0 0x7feda00c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda4c1e640 1 -- 172.21.15.81:0/3191352320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda00c9470 msgr2=0x7feda00c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda4c1e640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda00c9470 0x7feda00c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda4c1e640 1 -- 172.21.15.81:0/3191352320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda00c9ea0 con 0x7fed8c0051c0 2024-09-16T01:18:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda4c1e640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 0x7feda01515c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fed900079a0 tx=0x7fed9000a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7fed9d7fa640 1 -- 172.21.15.81:0/3191352320 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90017020 con 0x7fed8c0051c0 2024-09-16T01:18:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7fed9d7fa640 1 -- 172.21.15.81:0/3191352320 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed90007a90 con 0x7fed8c0051c0 2024-09-16T01:18:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7fed9d7fa640 1 -- 172.21.15.81:0/3191352320 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90013630 con 0x7fed8c0051c0 2024-09-16T01:18:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.055+0000 7feda6e82640 1 -- 172.21.15.81:0/3191352320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda00ca180 con 0x7fed8c0051c0 2024-09-16T01:18:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.056+0000 7feda6e82640 1 -- 172.21.15.81:0/3191352320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda00ca740 con 0x7fed8c0051c0 2024-09-16T01:18:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.056+0000 7feda6e82640 1 -- 172.21.15.81:0/3191352320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda00d0780 con 0x7fed8c0051c0 2024-09-16T01:18:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.057+0000 7fed9d7fa640 1 -- 172.21.15.81:0/3191352320 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fed9001a020 con 0x7fed8c0051c0 2024-09-16T01:18:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.058+0000 7fed9d7fa640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed8006c2b0 0x7fed8006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.058+0000 7fed9ffff640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed8006c2b0 0x7fed8006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.058+0000 7fed9d7fa640 1 -- 172.21.15.81:0/3191352320 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fed9008c2a0 con 0x7fed8c0051c0 2024-09-16T01:18:47.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.058+0000 7fed9ffff640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed8006c2b0 0x7fed8006e770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feda01f7920 tx=0x7fed88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:47.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.062+0000 7fed9d7fa640 1 -- 172.21.15.81:0/3191352320 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed90021020 con 0x7fed8c0051c0 2024-09-16T01:18:47.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.238+0000 7feda6e82640 1 -- 172.21.15.81:0/3191352320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feda00b8320 con 0x7fed8c0051c0 2024-09-16T01:18:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.238+0000 7fed9d7fa640 1 -- 172.21.15.81:0/3191352320 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v75) ==== 80+0+0 (secure 0 0 0) 0x7fed9005a7f0 con 0x7fed8c0051c0 2024-09-16T01:18:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:18:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.240+0000 7feda6e82640 1 -- 172.21.15.81:0/3191352320 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed8006c2b0 msgr2=0x7fed8006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.240+0000 7feda6e82640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed8006c2b0 0x7fed8006e770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feda01f7920 tx=0x7fed88008040 comp rx=0 tx=0).stop 2024-09-16T01:18:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.240+0000 7feda6e82640 1 -- 172.21.15.81:0/3191352320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 msgr2=0x7feda01515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.240+0000 7feda6e82640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 0x7feda01515c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fed900079a0 tx=0x7fed9000a750 comp rx=0 tx=0).stop 2024-09-16T01:18:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.240+0000 7feda6e82640 1 -- 172.21.15.81:0/3191352320 shutdown_connections 2024-09-16T01:18:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.240+0000 7feda6e82640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed8006c2b0 0x7fed8006e770 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.240+0000 7feda6e82640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feda00c76f0 0x7feda00c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.240+0000 7feda6e82640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feda00c9470 0x7feda00c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.240+0000 7feda6e82640 1 --2- 172.21.15.81:0/3191352320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c0051c0 0x7feda01515c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.240+0000 7feda6e82640 1 -- 172.21.15.81:0/3191352320 >> 172.21.15.81:0/3191352320 conn(0x7feda00d23a0 msgr2=0x7feda00b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.240+0000 7feda6e82640 1 -- 172.21.15.81:0/3191352320 shutdown_connections 2024-09-16T01:18:47.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.240+0000 7feda6e82640 1 -- 172.21.15.81:0/3191352320 wait complete. 2024-09-16T01:18:47.252 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:18:47.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:47.252 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T01:18:47.281 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:18:47.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:18:47.281 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:18:47.338 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:18:47.338 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:47.338 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:47.354 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:18:47.354 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:18:47.355 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:18:47.355 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:47.394 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:18:47.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:47.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.492+0000 7f74e6986640 1 Processor -- start 2024-09-16T01:18:47.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.493+0000 7f74e6986640 1 -- start start 2024-09-16T01:18:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.493+0000 7f74e6986640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74e0072940 0x7f74e0072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.493+0000 7f74e6986640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e00b3570 con 0x7f74e00b4880 2024-09-16T01:18:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.493+0000 7f74e6986640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e00b3850 con 0x7f74e015ba30 2024-09-16T01:18:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.493+0000 7f74e6986640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f74e00732e0 con 0x7f74e0072940 2024-09-16T01:18:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.493+0000 7f74df7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74e0072940 0x7f74e0072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.493+0000 7f74e4f23640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f74e00b4880 0x7f74e00b4d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56778/0 (socket says 172.21.15.81:56778) 2024-09-16T01:18:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.494+0000 7f74e4f23640 1 -- 172.21.15.81:0/3755874966 learned_addr learned my addr 172.21.15.81:0/3755874966 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:47.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.494+0000 7f74df7fe640 1 -- 172.21.15.81:0/3755874966 >> v1:172.21.15.102:6789/0 conn(0x7f74e015ba30 legacy=0x7f74e006f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:47.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.494+0000 7f74df7fe640 1 -- 172.21.15.81:0/3755874966 >> v1:172.21.15.81:6789/0 conn(0x7f74e00b4880 legacy=0x7f74e00b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.494+0000 7f74df7fe640 1 -- 172.21.15.81:0/3755874966 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e00b3b30 con 0x7f74e0072940 2024-09-16T01:18:47.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.494+0000 7f74df7fe640 1 --2- 172.21.15.81:0/3755874966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e0072940 0x7f74e0072da0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f74d40097a0 tx=0x7f74d402a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651e589dc21fe5fe server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.495+0000 7f74deffd640 1 -- 172.21.15.81:0/3755874966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4037070 con 0x7f74e0072940 2024-09-16T01:18:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.495+0000 7f74deffd640 1 -- 172.21.15.81:0/3755874966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d402ad60 con 0x7f74e0072940 2024-09-16T01:18:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.495+0000 7f74deffd640 1 -- 172.21.15.81:0/3755874966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4032660 con 0x7f74e0072940 2024-09-16T01:18:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.495+0000 7f74e6986640 1 -- 172.21.15.81:0/3755874966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e0072940 msgr2=0x7f74e0072da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.495+0000 7f74e6986640 1 --2- 172.21.15.81:0/3755874966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e0072940 0x7f74e0072da0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f74d40097a0 tx=0x7f74d402a0d0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.495+0000 7f74e6986640 1 -- 172.21.15.81:0/3755874966 shutdown_connections 2024-09-16T01:18:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.495+0000 7f74e6986640 1 --2- 172.21.15.81:0/3755874966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e0072940 0x7f74e0072da0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.495+0000 7f74e6986640 1 -- 172.21.15.81:0/3755874966 >> 172.21.15.81:0/3755874966 conn(0x7f74e0067d70 msgr2=0x7f74e006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.495+0000 7f74e6986640 1 -- 172.21.15.81:0/3755874966 shutdown_connections 2024-09-16T01:18:47.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.495+0000 7f74e6986640 1 -- 172.21.15.81:0/3755874966 wait complete. 2024-09-16T01:18:47.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.496+0000 7f74e6986640 1 Processor -- start 2024-09-16T01:18:47.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.497+0000 7f74e6986640 1 -- start start 2024-09-16T01:18:47.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.497+0000 7f74e6986640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e0072940 0x7f74e0142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.497+0000 7f74e6986640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e00b4880 0x7f74e0147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.497+0000 7f74e6986640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74e015ba30 0x7f74e0148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.497+0000 7f74e6986640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f74e006ff20 con 0x7f74e00b4880 2024-09-16T01:18:47.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.497+0000 7f74e6986640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f74e00b4180 con 0x7f74e0072940 2024-09-16T01:18:47.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.497+0000 7f74e6986640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f74e00ce810 con 0x7f74e015ba30 2024-09-16T01:18:47.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.497+0000 7f74df7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e00b4880 0x7f74e0147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.497+0000 7f74df7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e00b4880 0x7f74e0147af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53296/0 (socket says 172.21.15.81:53296) 2024-09-16T01:18:47.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.497+0000 7f74df7fe640 1 -- 172.21.15.81:0/3691533656 learned_addr learned my addr 172.21.15.81:0/3691533656 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:47.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74dffff640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e0072940 0x7f74e0142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74e4f23640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74e015ba30 0x7f74e0148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74df7fe640 1 -- 172.21.15.81:0/3691533656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74e015ba30 msgr2=0x7f74e0148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74df7fe640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74e015ba30 0x7f74e0148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74df7fe640 1 -- 172.21.15.81:0/3691533656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e0072940 msgr2=0x7f74e0142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74df7fe640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e0072940 0x7f74e0142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74df7fe640 1 -- 172.21.15.81:0/3691533656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e014de80 con 0x7f74e00b4880 2024-09-16T01:18:47.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74df7fe640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e00b4880 0x7f74e0147af0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f74d40097a0 tx=0x7f74d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:47.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74dcff9640 1 -- 172.21.15.81:0/3691533656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4037040 con 0x7f74e00b4880 2024-09-16T01:18:47.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74dcff9640 1 -- 172.21.15.81:0/3691533656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d4004030 con 0x7f74e00b4880 2024-09-16T01:18:47.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74e6986640 1 -- 172.21.15.81:0/3691533656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e01492c0 con 0x7f74e00b4880 2024-09-16T01:18:47.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74dcff9640 1 -- 172.21.15.81:0/3691533656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4004420 con 0x7f74e00b4880 2024-09-16T01:18:47.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.498+0000 7f74e6986640 1 -- 172.21.15.81:0/3691533656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e0149880 con 0x7f74e00b4880 2024-09-16T01:18:47.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.499+0000 7f74e6986640 1 -- 172.21.15.81:0/3691533656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e015df30 con 0x7f74e00b4880 2024-09-16T01:18:47.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.500+0000 7f74dcff9640 1 -- 172.21.15.81:0/3691533656 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f74d403a070 con 0x7f74e00b4880 2024-09-16T01:18:47.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.500+0000 7f74dcff9640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74cc06c2b0 0x7f74cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.500+0000 7f74dcff9640 1 -- 172.21.15.81:0/3691533656 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f74d40aba10 con 0x7f74e00b4880 2024-09-16T01:18:47.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.500+0000 7f74dffff640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74cc06c2b0 0x7f74cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.500+0000 7f74dffff640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74cc06c2b0 0x7f74cc06e770 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f74d0006fd0 tx=0x7f74d0009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:47.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.504+0000 7f74dcff9640 1 -- 172.21.15.81:0/3691533656 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74e015df30 con 0x7f74e00b4880 2024-09-16T01:18:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.705+0000 7f74e6986640 1 -- 172.21.15.81:0/3691533656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74e0159380 con 0x7f74e00b4880 2024-09-16T01:18:47.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.705+0000 7f74dcff9640 1 -- 172.21.15.81:0/3691533656 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5222 (secure 0 0 0) 0x7f74d4041020 con 0x7f74e00b4880 2024-09-16T01:18:47.707 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:47.707 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"btime":"2024-09-16T01:18:27:841583+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4005145731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":4005145731},{"type":"v1","addr":"172.21.15.102:6835","nonce":4005145731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/40318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":40318124},{"type":"v1","addr":"172.21.15.81:6835","nonce":40318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/700844751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":700844751},{"type":"v1","addr":"172.21.15.81:6837","nonce":700844751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:24.925061+0000","modified":"2024-09-16T01:18:27.171098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6027},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6027":{"gid":6027,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/3012591174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3012591174},{"type":"v1","addr":"172.21.15.102:6834","nonce":3012591174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6027,"qdb_cluster":[6027]},"id":5}]} 2024-09-16T01:18:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-09-16T01:18:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.708+0000 7f74e6986640 1 -- 172.21.15.81:0/3691533656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74cc06c2b0 msgr2=0x7f74cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.708+0000 7f74e6986640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74cc06c2b0 0x7f74cc06e770 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f74d0006fd0 tx=0x7f74d0009060 comp rx=0 tx=0).stop 2024-09-16T01:18:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.708+0000 7f74e6986640 1 -- 172.21.15.81:0/3691533656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e00b4880 msgr2=0x7f74e0147af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.708+0000 7f74e6986640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e00b4880 0x7f74e0147af0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f74d40097a0 tx=0x7f74d40046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.708+0000 7f74e6986640 1 -- 172.21.15.81:0/3691533656 shutdown_connections 2024-09-16T01:18:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.708+0000 7f74e6986640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f74cc06c2b0 0x7f74cc06e770 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.708+0000 7f74e6986640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74e015ba30 0x7f74e0148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.708+0000 7f74e6986640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74e00b4880 0x7f74e0147af0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.708+0000 7f74e6986640 1 --2- 172.21.15.81:0/3691533656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f74e0072940 0x7f74e0142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.708+0000 7f74e6986640 1 -- 172.21.15.81:0/3691533656 >> 172.21.15.81:0/3691533656 conn(0x7f74e0067d70 msgr2=0x7f74e014e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.708+0000 7f74e6986640 1 -- 172.21.15.81:0/3691533656 shutdown_connections 2024-09-16T01:18:47.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.708+0000 7f74e6986640 1 -- 172.21.15.81:0/3691533656 wait complete. 2024-09-16T01:18:47.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:47.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.818+0000 7f2e0e9d6640 1 Processor -- start 2024-09-16T01:18:47.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.818+0000 7f2e0e9d6640 1 -- start start 2024-09-16T01:18:47.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e0e9d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e080d1540 0x7f2e0806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e0e9d6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2e0809b690 0x7f2e0806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e0e9d6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e080d1940 con 0x7f2e0815e740 2024-09-16T01:18:47.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e0e9d6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0815eb20 con 0x7f2e0809b690 2024-09-16T01:18:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e0e9d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0806d260 con 0x7f2e080d1540 2024-09-16T01:18:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e07fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2e0815e740 0x7f2e0806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56784/0 (socket says 172.21.15.81:56784) 2024-09-16T01:18:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e07fff640 1 -- 172.21.15.81:0/1116170780 learned_addr learned my addr 172.21.15.81:0/1116170780 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e0cf73640 1 --2- 172.21.15.81:0/1116170780 >> v2:172.21.15.102:3300/0 conn(0x7f2e0809b690 0x7f2e0806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e077fe640 1 --2- 172.21.15.81:0/1116170780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e080d1540 0x7f2e0806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e06ffd640 1 -- 172.21.15.81:0/1116170780 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 528010725 0 0) 0x7f2e080d1940 con 0x7f2e0815e740 2024-09-16T01:18:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e06ffd640 1 -- 172.21.15.81:0/1116170780 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2df0003520 con 0x7f2e0815e740 2024-09-16T01:18:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e0cf73640 1 -- 172.21.15.81:0/1116170780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e080d1540 msgr2=0x7f2e0806dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e0cf73640 1 --2- 172.21.15.81:0/1116170780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e080d1540 0x7f2e0806dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e06ffd640 1 -- 172.21.15.81:0/1116170780 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2699513458 0 0) 0x7f2df0003520 con 0x7f2e0815e740 2024-09-16T01:18:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e0cf73640 1 -- 172.21.15.81:0/1116170780 >> v1:172.21.15.81:6789/0 conn(0x7f2e0815e740 legacy=0x7f2e0806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.819+0000 7f2e0cf73640 1 -- 172.21.15.81:0/1116170780 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0809bae0 con 0x7f2e0809b690 2024-09-16T01:18:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.820+0000 7f2e0cf73640 1 --2- 172.21.15.81:0/1116170780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e0809b690 0x7f2e0806cd20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009dc0 tx=0x7f2e0002a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebb4887384064fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.820+0000 7f2e06ffd640 1 -- 172.21.15.81:0/1116170780 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc001670 con 0x7f2e0809b690 2024-09-16T01:18:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.820+0000 7f2e06ffd640 1 -- 172.21.15.81:0/1116170780 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e00007540 con 0x7f2e0809b690 2024-09-16T01:18:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.820+0000 7f2e06ffd640 1 -- 172.21.15.81:0/1116170780 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e000076f0 con 0x7f2e0809b690 2024-09-16T01:18:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.821+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/1116170780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e0809b690 msgr2=0x7f2e0806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.821+0000 7f2e0e9d6640 1 --2- 172.21.15.81:0/1116170780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e0809b690 0x7f2e0806cd20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009dc0 tx=0x7f2e0002a6a0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.821+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/1116170780 shutdown_connections 2024-09-16T01:18:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.821+0000 7f2e0e9d6640 1 --2- 172.21.15.81:0/1116170780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e0809b690 0x7f2e0806cd20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.821+0000 7f2e0e9d6640 1 --2- 172.21.15.81:0/1116170780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e080d1540 0x7f2e0806dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.821+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/1116170780 >> 172.21.15.81:0/1116170780 conn(0x7f2e080d23a0 msgr2=0x7f2e080d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.821+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/1116170780 shutdown_connections 2024-09-16T01:18:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.821+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/1116170780 wait complete. 2024-09-16T01:18:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.822+0000 7f2e0e9d6640 1 Processor -- start 2024-09-16T01:18:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.822+0000 7f2e0e9d6640 1 -- start start 2024-09-16T01:18:47.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0e9d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e0809b690 0x7f2e080cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0e9d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e080d1540 0x7f2e0815c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0e9d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0815e740 0x7f2e0815cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0e9d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e080d0d40 con 0x7f2e0815e740 2024-09-16T01:18:47.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0e9d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2e080d0a60 con 0x7f2e080d1540 2024-09-16T01:18:47.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0e9d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2e080d1020 con 0x7f2e0809b690 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0cf73640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0815e740 0x7f2e0815cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0cf73640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0815e740 0x7f2e0815cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53298/0 (socket says 172.21.15.81:53298) 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0cf73640 1 -- 172.21.15.81:0/2460760634 learned_addr learned my addr 172.21.15.81:0/2460760634 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e077fe640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e080d1540 0x7f2e0815c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e07fff640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e0809b690 0x7f2e080cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0cf73640 1 -- 172.21.15.81:0/2460760634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e0809b690 msgr2=0x7f2e080cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0cf73640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e0809b690 0x7f2e080cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0cf73640 1 -- 172.21.15.81:0/2460760634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e080d1540 msgr2=0x7f2e0815c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0cf73640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e080d1540 0x7f2e0815c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0cf73640 1 -- 172.21.15.81:0/2460760634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e080ca2d0 con 0x7f2e0815e740 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e07fff640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e0809b690 0x7f2e080cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e0cf73640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0815e740 0x7f2e0815cc70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2e0002ac90 tx=0x7f2e00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.823+0000 7f2e04ff9640 1 -- 172.21.15.81:0/2460760634 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0003f070 con 0x7f2e0815e740 2024-09-16T01:18:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.824+0000 7f2e04ff9640 1 -- 172.21.15.81:0/2460760634 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e00003b90 con 0x7f2e0815e740 2024-09-16T01:18:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.824+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/2460760634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e08157f40 con 0x7f2e0815e740 2024-09-16T01:18:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.824+0000 7f2e04ff9640 1 -- 172.21.15.81:0/2460760634 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00007e70 con 0x7f2e0815e740 2024-09-16T01:18:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.824+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/2460760634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e080c97f0 con 0x7f2e0815e740 2024-09-16T01:18:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.824+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/2460760634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e0806cd20 con 0x7f2e0815e740 2024-09-16T01:18:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.825+0000 7f2e04ff9640 1 -- 172.21.15.81:0/2460760634 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2e0003b620 con 0x7f2e0815e740 2024-09-16T01:18:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.825+0000 7f2e04ff9640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2df406c2b0 0x7f2df406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.826+0000 7f2e04ff9640 1 -- 172.21.15.81:0/2460760634 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f2e000ac550 con 0x7f2e0815e740 2024-09-16T01:18:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.826+0000 7f2e07fff640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2df406c2b0 0x7f2df406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.826+0000 7f2e07fff640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2df406c2b0 0x7f2df406e770 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc005880 tx=0x7f2dfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:47.830+0000 7f2e04ff9640 1 -- 172.21.15.81:0/2460760634 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e0007abc0 con 0x7f2e0815e740 2024-09-16T01:18:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.029+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/2460760634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e080d1cb0 con 0x7f2e0815e740 2024-09-16T01:18:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.029+0000 7f2e04ff9640 1 -- 172.21.15.81:0/2460760634 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5222 (secure 0 0 0) 0x7f2e0007a4c0 con 0x7f2e0815e740 2024-09-16T01:18:48.032 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:48.033 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"btime":"2024-09-16T01:18:27:841583+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4005145731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":4005145731},{"type":"v1","addr":"172.21.15.102:6835","nonce":4005145731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/40318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":40318124},{"type":"v1","addr":"172.21.15.81:6835","nonce":40318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/700844751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":700844751},{"type":"v1","addr":"172.21.15.81:6837","nonce":700844751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:24.925061+0000","modified":"2024-09-16T01:18:27.171098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6027},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6027":{"gid":6027,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/3012591174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3012591174},{"type":"v1","addr":"172.21.15.102:6834","nonce":3012591174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6027,"qdb_cluster":[6027]},"id":5}]} 2024-09-16T01:18:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-09-16T01:18:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.031+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/2460760634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2df406c2b0 msgr2=0x7f2df406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.031+0000 7f2e0e9d6640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2df406c2b0 0x7f2df406e770 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc005880 tx=0x7f2dfc009040 comp rx=0 tx=0).stop 2024-09-16T01:18:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.031+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/2460760634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0815e740 msgr2=0x7f2e0815cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.031+0000 7f2e0e9d6640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0815e740 0x7f2e0815cc70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f2e0002ac90 tx=0x7f2e00004a40 comp rx=0 tx=0).stop 2024-09-16T01:18:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.031+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/2460760634 shutdown_connections 2024-09-16T01:18:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.031+0000 7f2e0e9d6640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2df406c2b0 0x7f2df406e770 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.031+0000 7f2e0e9d6640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e0815e740 0x7f2e0815cc70 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.031+0000 7f2e0e9d6640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e080d1540 0x7f2e0815c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.031+0000 7f2e0e9d6640 1 --2- 172.21.15.81:0/2460760634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2e0809b690 0x7f2e080cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.031+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/2460760634 >> 172.21.15.81:0/2460760634 conn(0x7f2e080d23a0 msgr2=0x7f2e080b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.031+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/2460760634 shutdown_connections 2024-09-16T01:18:48.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.031+0000 7f2e0e9d6640 1 -- 172.21.15.81:0/2460760634 wait complete. 2024-09-16T01:18:48.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:18:48.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.143+0000 7f7bd2966640 1 Processor -- start 2024-09-16T01:18:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.143+0000 7f7bd2966640 1 -- start start 2024-09-16T01:18:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bd2966640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bcc0b69d0 0x7f7bcc162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bd2966640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bcc0af280 0x7f7bcc0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bd2966640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7bcc0affb0 0x7f7bcc154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bd2966640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7bcc0b6db0 con 0x7f7bcc0b69d0 2024-09-16T01:18:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bd2966640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7bcc15eb60 con 0x7f7bcc0affb0 2024-09-16T01:18:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bd2966640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7bcc15ee40 con 0x7f7bcc0af280 2024-09-16T01:18:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bcbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bcc0b69d0 0x7f7bcc162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bcbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bcc0b69d0 0x7f7bcc162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53304/0 (socket says 172.21.15.81:53304) 2024-09-16T01:18:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bcbfff640 1 -- 172.21.15.81:0/3367700701 learned_addr learned my addr 172.21.15.81:0/3367700701 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bd0f03640 1 --2- 172.21.15.81:0/3367700701 >> v2:172.21.15.102:3300/0 conn(0x7f7bcc0affb0 0x7f7bcc154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bcb7fe640 1 --2- 172.21.15.81:0/3367700701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bcc0af280 0x7f7bcc0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bcbfff640 1 -- 172.21.15.81:0/3367700701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bcc0af280 msgr2=0x7f7bcc0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bcbfff640 1 --2- 172.21.15.81:0/3367700701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bcc0af280 0x7f7bcc0afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bcbfff640 1 -- 172.21.15.81:0/3367700701 >> v2:172.21.15.102:3300/0 conn(0x7f7bcc0affb0 msgr2=0x7f7bcc154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bcbfff640 1 --2- 172.21.15.81:0/3367700701 >> v2:172.21.15.102:3300/0 conn(0x7f7bcc0affb0 0x7f7bcc154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bcbfff640 1 -- 172.21.15.81:0/3367700701 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc15f120 con 0x7f7bcc0b69d0 2024-09-16T01:18:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bd0f03640 1 --2- 172.21.15.81:0/3367700701 >> v2:172.21.15.102:3300/0 conn(0x7f7bcc0affb0 0x7f7bcc154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.144+0000 7f7bcb7fe640 1 --2- 172.21.15.81:0/3367700701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bcc0af280 0x7f7bcc0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.145+0000 7f7bcbfff640 1 --2- 172.21.15.81:0/3367700701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bcc0b69d0 0x7f7bcc162a50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009870 tx=0x7f7bbc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899e59a0cfa56299 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.145+0000 7f7bcaffd640 1 -- 172.21.15.81:0/3367700701 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc037070 con 0x7f7bcc0b69d0 2024-09-16T01:18:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.145+0000 7f7bcaffd640 1 -- 172.21.15.81:0/3367700701 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bbc02ae10 con 0x7f7bcc0b69d0 2024-09-16T01:18:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.145+0000 7f7bcaffd640 1 -- 172.21.15.81:0/3367700701 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc032660 con 0x7f7bcc0b69d0 2024-09-16T01:18:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.146+0000 7f7bd2966640 1 -- 172.21.15.81:0/3367700701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bcc0b69d0 msgr2=0x7f7bcc162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.146+0000 7f7bd2966640 1 --2- 172.21.15.81:0/3367700701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bcc0b69d0 0x7f7bcc162a50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009870 tx=0x7f7bbc02a100 comp rx=0 tx=0).stop 2024-09-16T01:18:48.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.146+0000 7f7bd2966640 1 -- 172.21.15.81:0/3367700701 shutdown_connections 2024-09-16T01:18:48.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.146+0000 7f7bd2966640 1 --2- 172.21.15.81:0/3367700701 >> v2:172.21.15.102:3300/0 conn(0x7f7bcc0affb0 0x7f7bcc154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.146+0000 7f7bd2966640 1 --2- 172.21.15.81:0/3367700701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bcc0af280 0x7f7bcc0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.146+0000 7f7bd2966640 1 --2- 172.21.15.81:0/3367700701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bcc0b69d0 0x7f7bcc162a50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.146+0000 7f7bd2966640 1 -- 172.21.15.81:0/3367700701 >> 172.21.15.81:0/3367700701 conn(0x7f7bcc06bc10 msgr2=0x7f7bcc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:48.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.146+0000 7f7bd2966640 1 -- 172.21.15.81:0/3367700701 shutdown_connections 2024-09-16T01:18:48.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.146+0000 7f7bd2966640 1 -- 172.21.15.81:0/3367700701 wait complete. 2024-09-16T01:18:48.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.147+0000 7f7bd2966640 1 Processor -- start 2024-09-16T01:18:48.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.147+0000 7f7bd2966640 1 -- start start 2024-09-16T01:18:48.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bd2966640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bcc0af280 0x7f7bcc0cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bd2966640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bcc0affb0 0x7f7bcc149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bd2966640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bcc0b69d0 0x7f7bcc0cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bd2966640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc155240 con 0x7f7bcc0affb0 2024-09-16T01:18:48.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bd2966640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc0af6e0 con 0x7f7bcc0af280 2024-09-16T01:18:48.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bd2966640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7bcc1553c0 con 0x7f7bcc0b69d0 2024-09-16T01:18:48.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bcb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bcc0affb0 0x7f7bcc149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bcb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bcc0affb0 0x7f7bcc149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53314/0 (socket says 172.21.15.81:53314) 2024-09-16T01:18:48.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bcb7fe640 1 -- 172.21.15.81:0/1411046552 learned_addr learned my addr 172.21.15.81:0/1411046552 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:48.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bcbfff640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bcc0af280 0x7f7bcc0cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bd0f03640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bcc0b69d0 0x7f7bcc0cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bcb7fe640 1 -- 172.21.15.81:0/1411046552 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bcc0b69d0 msgr2=0x7f7bcc0cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bcb7fe640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bcc0b69d0 0x7f7bcc0cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bcb7fe640 1 -- 172.21.15.81:0/1411046552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bcc0af280 msgr2=0x7f7bcc0cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bcb7fe640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bcc0af280 0x7f7bcc0cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bcb7fe640 1 -- 172.21.15.81:0/1411046552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc149a70 con 0x7f7bcc0affb0 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bcb7fe640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bcc0affb0 0x7f7bcc149530 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000c7c0 tx=0x7f7bc000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bc8ff9640 1 -- 172.21.15.81:0/1411046552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0015070 con 0x7f7bcc0affb0 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.148+0000 7f7bc8ff9640 1 -- 172.21.15.81:0/1411046552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc0007a30 con 0x7f7bcc0affb0 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.149+0000 7f7bd2966640 1 -- 172.21.15.81:0/1411046552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bcc0cd6f0 con 0x7f7bcc0affb0 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.149+0000 7f7bc8ff9640 1 -- 172.21.15.81:0/1411046552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0007e00 con 0x7f7bcc0affb0 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.149+0000 7f7bd2966640 1 -- 172.21.15.81:0/1411046552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bcc0cf6d0 con 0x7f7bcc0affb0 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.149+0000 7f7bd2966640 1 -- 172.21.15.81:0/1411046552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bcc154f60 con 0x7f7bcc0affb0 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.150+0000 7f7bc8ff9640 1 -- 172.21.15.81:0/1411046552 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7bc0018070 con 0x7f7bcc0affb0 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.150+0000 7f7bc8ff9640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7bb806c2b0 0x7f7bb806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.150+0000 7f7bc8ff9640 1 -- 172.21.15.81:0/1411046552 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f7bc008b470 con 0x7f7bcc0affb0 2024-09-16T01:18:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.150+0000 7f7bcbfff640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7bb806c2b0 0x7f7bb806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.151+0000 7f7bcbfff640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7bb806c2b0 0x7f7bb806e770 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc034000 tx=0x7f7bbc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.155+0000 7f7bc8ff9640 1 -- 172.21.15.81:0/1411046552 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7bcc149a70 con 0x7f7bcc0affb0 2024-09-16T01:18:48.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.324+0000 7f7bd2966640 1 -- 172.21.15.81:0/1411046552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bcc161f80 con 0x7f7bcc0affb0 2024-09-16T01:18:48.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.325+0000 7f7bc8ff9640 1 -- 172.21.15.81:0/1411046552 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17005 (secure 0 0 0) 0x7f7bc0059400 con 0x7f7bcc0affb0 2024-09-16T01:18:48.326 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:48.326 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:26.588265+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:18:23.278642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-16T01:18:23.895482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:18:48.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.327+0000 7f7bd2966640 1 -- 172.21.15.81:0/1411046552 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7bb806c2b0 msgr2=0x7f7bb806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.327+0000 7f7bd2966640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7bb806c2b0 0x7f7bb806e770 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc034000 tx=0x7f7bbc02e000 comp rx=0 tx=0).stop 2024-09-16T01:18:48.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.327+0000 7f7bd2966640 1 -- 172.21.15.81:0/1411046552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bcc0affb0 msgr2=0x7f7bcc149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.327+0000 7f7bd2966640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bcc0affb0 0x7f7bcc149530 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000c7c0 tx=0x7f7bc000cc80 comp rx=0 tx=0).stop 2024-09-16T01:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.327+0000 7f7bd2966640 1 -- 172.21.15.81:0/1411046552 shutdown_connections 2024-09-16T01:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.327+0000 7f7bd2966640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7bb806c2b0 0x7f7bb806e770 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.327+0000 7f7bd2966640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7bcc0b69d0 0x7f7bcc0cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.327+0000 7f7bd2966640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bcc0affb0 0x7f7bcc149530 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.327+0000 7f7bd2966640 1 --2- 172.21.15.81:0/1411046552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bcc0af280 0x7f7bcc0cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.327+0000 7f7bd2966640 1 -- 172.21.15.81:0/1411046552 >> 172.21.15.81:0/1411046552 conn(0x7f7bcc06bc10 msgr2=0x7f7bcc0b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.327+0000 7f7bd2966640 1 -- 172.21.15.81:0/1411046552 shutdown_connections 2024-09-16T01:18:48.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.327+0000 7f7bd2966640 1 -- 172.21.15.81:0/1411046552 wait complete. 2024-09-16T01:18:48.339 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:18:48.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.437+0000 7f2c75752640 1 Processor -- start 2024-09-16T01:18:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.437+0000 7f2c75752640 1 -- start start 2024-09-16T01:18:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.437+0000 7f2c75752640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c70162060 0x7f2c700b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.437+0000 7f2c75752640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c7006d9f0 con 0x7f2c700b64b0 2024-09-16T01:18:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.437+0000 7f2c75752640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c7006dcd0 con 0x7f2c70161c80 2024-09-16T01:18:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.437+0000 7f2c75752640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2c7006dfb0 con 0x7f2c70162060 2024-09-16T01:18:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.438+0000 7f2c6e7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c70162060 0x7f2c700b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.438+0000 7f2c6f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2c700b64b0 0x7f2c700cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56798/0 (socket says 172.21.15.81:56798) 2024-09-16T01:18:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.438+0000 7f2c6f7fe640 1 -- 172.21.15.81:0/1960145219 learned_addr learned my addr 172.21.15.81:0/1960145219 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.438+0000 7f2c6e7fc640 1 -- 172.21.15.81:0/1960145219 >> v1:172.21.15.102:6789/0 conn(0x7f2c70161c80 legacy=0x7f2c7006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.438+0000 7f2c6e7fc640 1 -- 172.21.15.81:0/1960145219 >> v1:172.21.15.81:6789/0 conn(0x7f2c700b64b0 legacy=0x7f2c700cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.438+0000 7f2c6dffb640 1 -- 172.21.15.81:0/1960145219 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103746249 0 0) 0x7f2c7006d9f0 con 0x7f2c700b64b0 2024-09-16T01:18:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.438+0000 7f2c6e7fc640 1 -- 172.21.15.81:0/1960145219 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c700d2890 con 0x7f2c70162060 2024-09-16T01:18:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.439+0000 7f2c6e7fc640 1 --2- 172.21.15.81:0/1960145219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c70162060 0x7f2c700b5f70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2c600097a0 tx=0x7f2c6002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfdfa39a8760bfe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.439+0000 7f2c6dffb640 1 -- 172.21.15.81:0/1960145219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60037070 con 0x7f2c70162060 2024-09-16T01:18:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.439+0000 7f2c6dffb640 1 -- 172.21.15.81:0/1960145219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c60032440 con 0x7f2c70162060 2024-09-16T01:18:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.439+0000 7f2c6dffb640 1 -- 172.21.15.81:0/1960145219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60032810 con 0x7f2c70162060 2024-09-16T01:18:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.439+0000 7f2c75752640 1 -- 172.21.15.81:0/1960145219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c70162060 msgr2=0x7f2c700b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.439+0000 7f2c75752640 1 --2- 172.21.15.81:0/1960145219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c70162060 0x7f2c700b5f70 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f2c600097a0 tx=0x7f2c6002a230 comp rx=0 tx=0).stop 2024-09-16T01:18:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.439+0000 7f2c75752640 1 -- 172.21.15.81:0/1960145219 shutdown_connections 2024-09-16T01:18:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.439+0000 7f2c75752640 1 --2- 172.21.15.81:0/1960145219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c70162060 0x7f2c700b5f70 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.439+0000 7f2c75752640 1 -- 172.21.15.81:0/1960145219 >> 172.21.15.81:0/1960145219 conn(0x7f2c700d44f0 msgr2=0x7f2c700d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.439+0000 7f2c75752640 1 -- 172.21.15.81:0/1960145219 shutdown_connections 2024-09-16T01:18:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.439+0000 7f2c75752640 1 -- 172.21.15.81:0/1960145219 wait complete. 2024-09-16T01:18:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.441+0000 7f2c75752640 1 Processor -- start 2024-09-16T01:18:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.441+0000 7f2c75752640 1 -- start start 2024-09-16T01:18:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.441+0000 7f2c75752640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c700b64b0 0x7f2c70152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.441+0000 7f2c75752640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c70161c80 0x7f2c700b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.441+0000 7f2c75752640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c70162060 0x7f2c700b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.441+0000 7f2c75752640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c700b6d30 con 0x7f2c70162060 2024-09-16T01:18:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.441+0000 7f2c75752640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c700b6bb0 con 0x7f2c700b64b0 2024-09-16T01:18:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.441+0000 7f2c75752640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2c700cf8f0 con 0x7f2c70161c80 2024-09-16T01:18:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.441+0000 7f2c6f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c70162060 0x7f2c700b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c6f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c70162060 0x7f2c700b8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53320/0 (socket says 172.21.15.81:53320) 2024-09-16T01:18:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c6f7fe640 1 -- 172.21.15.81:0/1994324649 learned_addr learned my addr 172.21.15.81:0/1994324649 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c6effd640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c700b64b0 0x7f2c70152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c6e7fc640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c70161c80 0x7f2c700b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c6f7fe640 1 -- 172.21.15.81:0/1994324649 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c70161c80 msgr2=0x7f2c700b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c6f7fe640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c70161c80 0x7f2c700b7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c6f7fe640 1 -- 172.21.15.81:0/1994324649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c700b64b0 msgr2=0x7f2c70152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c6f7fe640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c700b64b0 0x7f2c70152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c6f7fe640 1 -- 172.21.15.81:0/1994324649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c70153400 con 0x7f2c70162060 2024-09-16T01:18:48.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c6effd640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c700b64b0 0x7f2c70152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:48.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c6f7fe640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c70162060 0x7f2c700b8170 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c7a0 tx=0x7f2c6800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:48.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c677fe640 1 -- 172.21.15.81:0/1994324649 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68018070 con 0x7f2c70162060 2024-09-16T01:18:48.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c677fe640 1 -- 172.21.15.81:0/1994324649 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c6800a640 con 0x7f2c70162060 2024-09-16T01:18:48.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c75752640 1 -- 172.21.15.81:0/1994324649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c7015f390 con 0x7f2c70162060 2024-09-16T01:18:48.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c677fe640 1 -- 172.21.15.81:0/1994324649 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800aab0 con 0x7f2c70162060 2024-09-16T01:18:48.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.442+0000 7f2c75752640 1 -- 172.21.15.81:0/1994324649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c700c8ef0 con 0x7f2c70162060 2024-09-16T01:18:48.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.443+0000 7f2c75752640 1 -- 172.21.15.81:0/1994324649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c7006d9f0 con 0x7f2c70162060 2024-09-16T01:18:48.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.444+0000 7f2c677fe640 1 -- 172.21.15.81:0/1994324649 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2c6801b070 con 0x7f2c70162060 2024-09-16T01:18:48.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.444+0000 7f2c677fe640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c5006c2b0 0x7f2c5006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.444+0000 7f2c6effd640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c5006c2b0 0x7f2c5006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.444+0000 7f2c677fe640 1 -- 172.21.15.81:0/1994324649 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f2c6808ac10 con 0x7f2c70162060 2024-09-16T01:18:48.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.445+0000 7f2c6effd640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c5006c2b0 0x7f2c5006e770 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2c58007fd0 tx=0x7f2c58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:48.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.449+0000 7f2c677fe640 1 -- 172.21.15.81:0/1994324649 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c680591f0 con 0x7f2c70162060 2024-09-16T01:18:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.651+0000 7f2c75752640 1 -- 172.21.15.81:0/1994324649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c70160080 con 0x7f2c70162060 2024-09-16T01:18:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.652+0000 7f2c677fe640 1 -- 172.21.15.81:0/1994324649 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5222 (secure 0 0 0) 0x7f2c68059e20 con 0x7f2c70162060 2024-09-16T01:18:48.653 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:48.653 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"btime":"2024-09-16T01:18:27:841583+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4005145731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":4005145731},{"type":"v1","addr":"172.21.15.102:6835","nonce":4005145731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/40318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":40318124},{"type":"v1","addr":"172.21.15.81:6835","nonce":40318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/700844751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":700844751},{"type":"v1","addr":"172.21.15.81:6837","nonce":700844751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:24.925061+0000","modified":"2024-09-16T01:18:27.171098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6027},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6027":{"gid":6027,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/3012591174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3012591174},{"type":"v1","addr":"172.21.15.102:6834","nonce":3012591174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6027,"qdb_cluster":[6027]},"id":5}]} 2024-09-16T01:18:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-09-16T01:18:48.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.654+0000 7f2c75752640 1 -- 172.21.15.81:0/1994324649 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c5006c2b0 msgr2=0x7f2c5006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.654+0000 7f2c75752640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c5006c2b0 0x7f2c5006e770 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2c58007fd0 tx=0x7f2c58009040 comp rx=0 tx=0).stop 2024-09-16T01:18:48.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.654+0000 7f2c75752640 1 -- 172.21.15.81:0/1994324649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c70162060 msgr2=0x7f2c700b8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.654+0000 7f2c75752640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c70162060 0x7f2c700b8170 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c7a0 tx=0x7f2c6800cc60 comp rx=0 tx=0).stop 2024-09-16T01:18:48.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.654+0000 7f2c75752640 1 -- 172.21.15.81:0/1994324649 shutdown_connections 2024-09-16T01:18:48.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.654+0000 7f2c75752640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c5006c2b0 0x7f2c5006e770 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.654+0000 7f2c75752640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c70162060 0x7f2c700b8170 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.654+0000 7f2c75752640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c70161c80 0x7f2c700b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.654+0000 7f2c75752640 1 --2- 172.21.15.81:0/1994324649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c700b64b0 0x7f2c70152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.654+0000 7f2c75752640 1 -- 172.21.15.81:0/1994324649 >> 172.21.15.81:0/1994324649 conn(0x7f2c700d44f0 msgr2=0x7f2c700b58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:48.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.654+0000 7f2c75752640 1 -- 172.21.15.81:0/1994324649 shutdown_connections 2024-09-16T01:18:48.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.654+0000 7f2c75752640 1 -- 172.21.15.81:0/1994324649 wait complete. 2024-09-16T01:18:48.669 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.765+0000 7f2cb84f1640 1 Processor -- start 2024-09-16T01:18:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.765+0000 7f2cb84f1640 1 -- start start 2024-09-16T01:18:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.766+0000 7f2cb84f1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2cb00d4fd0 0x7f2cb006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.766+0000 7f2cb84f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb00d2700 con 0x7f2cb015e760 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.766+0000 7f2cb84f1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb00cedb0 con 0x7f2cb00cfcc0 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.766+0000 7f2cb84f1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb00cf090 con 0x7f2cb00d4fd0 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.766+0000 7f2cb628d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2cb015e760 0x7f2cb00cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56806/0 (socket says 172.21.15.81:56806) 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.766+0000 7f2cb628d640 1 -- 172.21.15.81:0/4174843812 learned_addr learned my addr 172.21.15.81:0/4174843812 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb6a8e640 1 --2- 172.21.15.81:0/4174843812 >> v2:172.21.15.102:3300/0 conn(0x7f2cb00d4fd0 0x7f2cb006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802889296 0 0) 0x7f2ca8001110 con 0x7f2cb015e760 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c98003520 con 0x7f2cb015e760 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1015484169 0 0) 0x7f2c98003520 con 0x7f2cb015e760 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 >> v2:172.21.15.102:3300/0 conn(0x7f2cb00d4fd0 msgr2=0x7f2cb006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 --2- 172.21.15.81:0/4174843812 >> v2:172.21.15.102:3300/0 conn(0x7f2cb00d4fd0 0x7f2cb006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 >> v1:172.21.15.102:6789/0 conn(0x7f2cb00cfcc0 legacy=0x7f2cb00d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb00b3c80 con 0x7f2cb015e760 2024-09-16T01:18:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f2ca8001840 con 0x7f2cb015e760 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 >> v1:172.21.15.81:6789/0 conn(0x7f2cb015e760 legacy=0x7f2cb00cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 --2- 172.21.15.81:0/4174843812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c980039b0 0x7f2c98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 --2- 172.21.15.81:0/4174843812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c98004800 0x7f2c98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 --2- 172.21.15.81:0/4174843812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c980051c0 0x7f2c9800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb00cf090 con 0x7f2c98004800 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9800c060 con 0x7f2c980039b0 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9800c260 con 0x7f2c980051c0 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb5a8c640 1 --2- 172.21.15.81:0/4174843812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c98004800 0x7f2c98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb628d640 1 --2- 172.21.15.81:0/4174843812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c980039b0 0x7f2c98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb6a8e640 1 --2- 172.21.15.81:0/4174843812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c980051c0 0x7f2c9800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb5a8c640 1 -- 172.21.15.81:0/4174843812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c980051c0 msgr2=0x7f2c9800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb5a8c640 1 --2- 172.21.15.81:0/4174843812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c980051c0 0x7f2c9800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb5a8c640 1 -- 172.21.15.81:0/4174843812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c980039b0 msgr2=0x7f2c98003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb5a8c640 1 --2- 172.21.15.81:0/4174843812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c980039b0 0x7f2c98003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb5a8c640 1 -- 172.21.15.81:0/4174843812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c98003520 con 0x7f2c98004800 2024-09-16T01:18:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.767+0000 7f2cb6a8e640 1 -- 172.21.15.81:0/4174843812 reap_dead start 2024-09-16T01:18:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.768+0000 7f2cb5a8c640 1 --2- 172.21.15.81:0/4174843812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c98004800 0x7f2c98004c80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4001770 tx=0x7f2c98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b6a854c8f1e996 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.768+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca40013c0 con 0x7f2c98004800 2024-09-16T01:18:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.768+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca40052d0 con 0x7f2c98004800 2024-09-16T01:18:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.768+0000 7f2cb528b640 1 -- 172.21.15.81:0/4174843812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca402a8a0 con 0x7f2c98004800 2024-09-16T01:18:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.769+0000 7f2cb84f1640 1 -- 172.21.15.81:0/4174843812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c98004800 msgr2=0x7f2c98004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.769+0000 7f2cb84f1640 1 --2- 172.21.15.81:0/4174843812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c98004800 0x7f2c98004c80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4001770 tx=0x7f2c98005830 comp rx=0 tx=0).stop 2024-09-16T01:18:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.769+0000 7f2cb84f1640 1 -- 172.21.15.81:0/4174843812 shutdown_connections 2024-09-16T01:18:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.769+0000 7f2cb84f1640 1 --2- 172.21.15.81:0/4174843812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c98004800 0x7f2c98004c80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.769+0000 7f2cb84f1640 1 -- 172.21.15.81:0/4174843812 >> 172.21.15.81:0/4174843812 conn(0x7f2cb008bfc0 msgr2=0x7f2cb00d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.769+0000 7f2cb84f1640 1 -- 172.21.15.81:0/4174843812 shutdown_connections 2024-09-16T01:18:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.769+0000 7f2cb84f1640 1 -- 172.21.15.81:0/4174843812 wait complete. 2024-09-16T01:18:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.770+0000 7f2cb84f1640 1 Processor -- start 2024-09-16T01:18:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.770+0000 7f2cb84f1640 1 -- start start 2024-09-16T01:18:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb84f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c98004800 0x7f2cb00cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb84f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2cb015eb40 0x7f2cb006d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb84f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb015efc0 0x7f2cb00ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb84f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb006cdd0 con 0x7f2cb015efc0 2024-09-16T01:18:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb84f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb00b3860 con 0x7f2c98004800 2024-09-16T01:18:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb84f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb006cf50 con 0x7f2cb015eb40 2024-09-16T01:18:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb6a8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb015efc0 0x7f2cb00ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb6a8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb015efc0 0x7f2cb00ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53336/0 (socket says 172.21.15.81:53336) 2024-09-16T01:18:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb6a8e640 1 -- 172.21.15.81:0/3511904892 learned_addr learned my addr 172.21.15.81:0/3511904892 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb628d640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c98004800 0x7f2cb00cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb5a8c640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2cb015eb40 0x7f2cb006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb6a8e640 1 -- 172.21.15.81:0/3511904892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2cb015eb40 msgr2=0x7f2cb006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb6a8e640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2cb015eb40 0x7f2cb006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb6a8e640 1 -- 172.21.15.81:0/3511904892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c98004800 msgr2=0x7f2cb00cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb6a8e640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c98004800 0x7f2cb00cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb6a8e640 1 -- 172.21.15.81:0/3511904892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb00c9350 con 0x7f2cb015efc0 2024-09-16T01:18:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb5a8c640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2cb015eb40 0x7f2cb006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb6a8e640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb015efc0 0x7f2cb00ca3f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00ba600 tx=0x7f2ca00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2caeffd640 1 -- 172.21.15.81:0/3511904892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0011e10 con 0x7f2cb015efc0 2024-09-16T01:18:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2caeffd640 1 -- 172.21.15.81:0/3511904892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca001b070 con 0x7f2cb015efc0 2024-09-16T01:18:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.771+0000 7f2cb84f1640 1 -- 172.21.15.81:0/3511904892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb00c9630 con 0x7f2cb015efc0 2024-09-16T01:18:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.772+0000 7f2caeffd640 1 -- 172.21.15.81:0/3511904892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0003990 con 0x7f2cb015efc0 2024-09-16T01:18:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.772+0000 7f2cb84f1640 1 -- 172.21.15.81:0/3511904892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb00c9ed0 con 0x7f2cb015efc0 2024-09-16T01:18:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.772+0000 7f2cb84f1640 1 -- 172.21.15.81:0/3511904892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb00c9a20 con 0x7f2cb015efc0 2024-09-16T01:18:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.773+0000 7f2caeffd640 1 -- 172.21.15.81:0/3511904892 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2ca0003b50 con 0x7f2cb015efc0 2024-09-16T01:18:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.773+0000 7f2caeffd640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c9c06c2e0 0x7f2c9c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.774+0000 7f2caeffd640 1 -- 172.21.15.81:0/3511904892 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f2ca008bd90 con 0x7f2cb015efc0 2024-09-16T01:18:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.774+0000 7f2cb628d640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c9c06c2e0 0x7f2c9c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.774+0000 7f2cb628d640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c9c06c2e0 0x7f2c9c06e7a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00c8f20 tx=0x7f2ca8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.778+0000 7f2caeffd640 1 -- 172.21.15.81:0/3511904892 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ca005a370 con 0x7f2cb015efc0 2024-09-16T01:18:48.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.978+0000 7f2cb84f1640 1 -- 172.21.15.81:0/3511904892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cb00b6d20 con 0x7f2cb015efc0 2024-09-16T01:18:48.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.978+0000 7f2caeffd640 1 -- 172.21.15.81:0/3511904892 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+5222 (secure 0 0 0) 0x7f2ca0060070 con 0x7f2cb015efc0 2024-09-16T01:18:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:48.980 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":36,"btime":"2024-09-16T01:18:27:841583+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4005145731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":4005145731},{"type":"v1","addr":"172.21.15.102:6835","nonce":4005145731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/40318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":40318124},{"type":"v1","addr":"172.21.15.81:6835","nonce":40318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/700844751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":700844751},{"type":"v1","addr":"172.21.15.81:6837","nonce":700844751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:24.925061+0000","modified":"2024-09-16T01:18:27.171098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6027},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6027":{"gid":6027,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6834/3012591174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3012591174},{"type":"v1","addr":"172.21.15.102:6834","nonce":3012591174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6027,"qdb_cluster":[6027]},"id":5}]} 2024-09-16T01:18:48.980 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 36 2024-09-16T01:18:48.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.980+0000 7f2cb84f1640 1 -- 172.21.15.81:0/3511904892 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c9c06c2e0 msgr2=0x7f2c9c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.980+0000 7f2cb84f1640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c9c06c2e0 0x7f2c9c06e7a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00c8f20 tx=0x7f2ca8009040 comp rx=0 tx=0).stop 2024-09-16T01:18:48.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.980+0000 7f2cb84f1640 1 -- 172.21.15.81:0/3511904892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb015efc0 msgr2=0x7f2cb00ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:48.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.980+0000 7f2cb84f1640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb015efc0 0x7f2cb00ca3f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2cb00ba600 tx=0x7f2ca00115a0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.980+0000 7f2cb84f1640 1 -- 172.21.15.81:0/3511904892 shutdown_connections 2024-09-16T01:18:48.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.980+0000 7f2cb84f1640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c9c06c2e0 0x7f2c9c06e7a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.980+0000 7f2cb84f1640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb015efc0 0x7f2cb00ca3f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.980+0000 7f2cb84f1640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2cb015eb40 0x7f2cb006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.980+0000 7f2cb84f1640 1 --2- 172.21.15.81:0/3511904892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c98004800 0x7f2cb00cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:48.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.980+0000 7f2cb84f1640 1 -- 172.21.15.81:0/3511904892 >> 172.21.15.81:0/3511904892 conn(0x7f2cb008bfc0 msgr2=0x7f2cb00b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:48.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.980+0000 7f2cb84f1640 1 -- 172.21.15.81:0/3511904892 shutdown_connections 2024-09-16T01:18:48.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:48.980+0000 7f2cb84f1640 1 -- 172.21.15.81:0/3511904892 wait complete. 2024-09-16T01:18:48.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:18:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.089+0000 7fe97d7d6640 1 Processor -- start 2024-09-16T01:18:49.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.089+0000 7fe97d7d6640 1 -- start start 2024-09-16T01:18:49.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe97d7d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe978161c80 0x7fe97806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe97d7d6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9780b6680 0x7fe9780cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe97d7d6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe97806e870 con 0x7fe978162060 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe97d7d6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe97806d9f0 con 0x7fe9780b6680 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe97d7d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe97806dcd0 con 0x7fe978161c80 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe9777fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9780b6680 0x7fe9780cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe9777fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9780b6680 0x7fe9780cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53340/0 (socket says 172.21.15.81:53340) 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe9777fe640 1 -- 172.21.15.81:0/3058761969 learned_addr learned my addr 172.21.15.81:0/3058761969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe976ffd640 1 --2- 172.21.15.81:0/3058761969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe978161c80 0x7fe97806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe9777fe640 1 -- 172.21.15.81:0/3058761969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe978161c80 msgr2=0x7fe97806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe9777fe640 1 --2- 172.21.15.81:0/3058761969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe978161c80 0x7fe97806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe9777fe640 1 -- 172.21.15.81:0/3058761969 >> v1:172.21.15.102:6789/0 conn(0x7fe978162060 legacy=0x7fe9780b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.090+0000 7fe9777fe640 1 -- 172.21.15.81:0/3058761969 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97806dfb0 con 0x7fe9780b6680 2024-09-16T01:18:49.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.091+0000 7fe9777fe640 1 --2- 172.21.15.81:0/3058761969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9780b6680 0x7fe9780cf1e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe970009e50 tx=0x7fe97002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8633fba76509beb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.091+0000 7fe975ffb640 1 -- 172.21.15.81:0/3058761969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970036070 con 0x7fe9780b6680 2024-09-16T01:18:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.091+0000 7fe975ffb640 1 -- 172.21.15.81:0/3058761969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe970031600 con 0x7fe9780b6680 2024-09-16T01:18:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.091+0000 7fe975ffb640 1 -- 172.21.15.81:0/3058761969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9700319d0 con 0x7fe9780b6680 2024-09-16T01:18:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.092+0000 7fe97d7d6640 1 -- 172.21.15.81:0/3058761969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9780b6680 msgr2=0x7fe9780cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.092+0000 7fe97d7d6640 1 --2- 172.21.15.81:0/3058761969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9780b6680 0x7fe9780cf1e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe970009e50 tx=0x7fe97002a710 comp rx=0 tx=0).stop 2024-09-16T01:18:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.092+0000 7fe97d7d6640 1 -- 172.21.15.81:0/3058761969 shutdown_connections 2024-09-16T01:18:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.092+0000 7fe97d7d6640 1 --2- 172.21.15.81:0/3058761969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9780b6680 0x7fe9780cf1e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.092+0000 7fe97d7d6640 1 --2- 172.21.15.81:0/3058761969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe978161c80 0x7fe97806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.092+0000 7fe97d7d6640 1 -- 172.21.15.81:0/3058761969 >> 172.21.15.81:0/3058761969 conn(0x7fe9780d44f0 msgr2=0x7fe9780d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.092+0000 7fe97d7d6640 1 -- 172.21.15.81:0/3058761969 shutdown_connections 2024-09-16T01:18:49.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.092+0000 7fe97d7d6640 1 -- 172.21.15.81:0/3058761969 wait complete. 2024-09-16T01:18:49.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.093+0000 7fe97d7d6640 1 Processor -- start 2024-09-16T01:18:49.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.093+0000 7fe97d7d6640 1 -- start start 2024-09-16T01:18:49.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe97d7d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9780b6680 0x7fe9780b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe97d7d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe978161c80 0x7fe9781563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe97d7d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe978162060 0x7fe9780b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe97d7d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9780b6b30 con 0x7fe9780b6680 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe97d7d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe9780d2aa0 con 0x7fe978161c80 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe97d7d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe9780b6cb0 con 0x7fe978162060 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe976ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9780b6680 0x7fe9780b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe976ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9780b6680 0x7fe9780b7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53352/0 (socket says 172.21.15.81:53352) 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe976ffd640 1 -- 172.21.15.81:0/79232204 learned_addr learned my addr 172.21.15.81:0/79232204 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe9767fc640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe978161c80 0x7fe9781563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe9777fe640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe978162060 0x7fe9780b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe976ffd640 1 -- 172.21.15.81:0/79232204 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe978162060 msgr2=0x7fe9780b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe976ffd640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe978162060 0x7fe9780b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe976ffd640 1 -- 172.21.15.81:0/79232204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe978161c80 msgr2=0x7fe9781563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe976ffd640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe978161c80 0x7fe9781563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe976ffd640 1 -- 172.21.15.81:0/79232204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9780b7920 con 0x7fe9780b6680 2024-09-16T01:18:49.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.094+0000 7fe976ffd640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9780b6680 0x7fe9780b7340 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe96800d620 tx=0x7fe96800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:49.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.095+0000 7fe95f7fe640 1 -- 172.21.15.81:0/79232204 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96800b620 con 0x7fe9780b6680 2024-09-16T01:18:49.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.095+0000 7fe95f7fe640 1 -- 172.21.15.81:0/79232204 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe968019070 con 0x7fe9780b6680 2024-09-16T01:18:49.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.095+0000 7fe97d7d6640 1 -- 172.21.15.81:0/79232204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9780b7c00 con 0x7fe9780b6680 2024-09-16T01:18:49.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.095+0000 7fe95f7fe640 1 -- 172.21.15.81:0/79232204 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96800ba00 con 0x7fe9780b6680 2024-09-16T01:18:49.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.095+0000 7fe97d7d6640 1 -- 172.21.15.81:0/79232204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97815a4a0 con 0x7fe9780b6680 2024-09-16T01:18:49.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.096+0000 7fe97d7d6640 1 -- 172.21.15.81:0/79232204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9780ba470 con 0x7fe9780b6680 2024-09-16T01:18:49.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.096+0000 7fe95f7fe640 1 -- 172.21.15.81:0/79232204 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe96800bba0 con 0x7fe9780b6680 2024-09-16T01:18:49.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.096+0000 7fe95f7fe640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe96406c2b0 0x7fe96406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.097+0000 7fe95f7fe640 1 -- 172.21.15.81:0/79232204 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7fe96808b990 con 0x7fe9780b6680 2024-09-16T01:18:49.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.097+0000 7fe9767fc640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe96406c2b0 0x7fe96406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.097+0000 7fe9767fc640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe96406c2b0 0x7fe96406e770 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe9780b5f50 tx=0x7fe96c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:49.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.101+0000 7fe95f7fe640 1 -- 172.21.15.81:0/79232204 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe96805a000 con 0x7fe9780b6680 2024-09-16T01:18:49.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.267+0000 7fe97d7d6640 1 -- 172.21.15.81:0/79232204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9780b5f80 con 0x7fe9780b6680 2024-09-16T01:18:49.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.268+0000 7fe95f7fe640 1 -- 172.21.15.81:0/79232204 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+17005 (secure 0 0 0) 0x7fe968059900 con 0x7fe9780b6680 2024-09-16T01:18:49.269 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:49.269 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:26.588265+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:18:23.278642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-16T01:18:23.895482+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:18:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.270+0000 7fe97d7d6640 1 -- 172.21.15.81:0/79232204 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe96406c2b0 msgr2=0x7fe96406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.270+0000 7fe97d7d6640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe96406c2b0 0x7fe96406e770 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe9780b5f50 tx=0x7fe96c009040 comp rx=0 tx=0).stop 2024-09-16T01:18:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.270+0000 7fe97d7d6640 1 -- 172.21.15.81:0/79232204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9780b6680 msgr2=0x7fe9780b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.270+0000 7fe97d7d6640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9780b6680 0x7fe9780b7340 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe96800d620 tx=0x7fe96800dae0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.270+0000 7fe97d7d6640 1 -- 172.21.15.81:0/79232204 shutdown_connections 2024-09-16T01:18:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.270+0000 7fe97d7d6640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe96406c2b0 0x7fe96406e770 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.270+0000 7fe97d7d6640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe978162060 0x7fe9780b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.270+0000 7fe97d7d6640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe978161c80 0x7fe9781563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.270+0000 7fe97d7d6640 1 --2- 172.21.15.81:0/79232204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9780b6680 0x7fe9780b7340 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.270+0000 7fe97d7d6640 1 -- 172.21.15.81:0/79232204 >> 172.21.15.81:0/79232204 conn(0x7fe9780d44f0 msgr2=0x7fe9780cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.270+0000 7fe97d7d6640 1 -- 172.21.15.81:0/79232204 shutdown_connections 2024-09-16T01:18:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.270+0000 7fe97d7d6640 1 -- 172.21.15.81:0/79232204 wait complete. 2024-09-16T01:18:49.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:18:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.381+0000 7f65af82c640 1 Processor -- start 2024-09-16T01:18:49.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.381+0000 7f65af82c640 1 -- start start 2024-09-16T01:18:49.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.382+0000 7f65af82c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8145bc0 0x7f65a815ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.382+0000 7f65af82c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a80b3570 con 0x7f65a806c320 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.382+0000 7f65af82c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65a80b3850 con 0x7f65a80ae140 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.382+0000 7f65af82c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f65a80b3b30 con 0x7f65a8145bc0 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.382+0000 7f65addc9640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f65a806c320 0x7f65a80af950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56814/0 (socket says 172.21.15.81:56814) 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.382+0000 7f65addc9640 1 -- 172.21.15.81:0/876748464 learned_addr learned my addr 172.21.15.81:0/876748464 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.382+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2591962262 0 0) 0x7f65a80b3570 con 0x7f65a806c320 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f65ad5c8640 1 --2- 172.21.15.81:0/876748464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8145bc0 0x7f65a815ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6594003520 con 0x7f65a806c320 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3111794345 0 0) 0x7f6594003520 con 0x7f65a806c320 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8145bc0 msgr2=0x7f65a815ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 --2- 172.21.15.81:0/876748464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8145bc0 0x7f65a815ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 >> v1:172.21.15.102:6789/0 conn(0x7f65a80ae140 legacy=0x7f65a806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a80b1610 con 0x7f65a806c320 2024-09-16T01:18:49.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f65a0001670 con 0x7f65a806c320 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 >> v1:172.21.15.81:6789/0 conn(0x7f65a806c320 legacy=0x7f65a80af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 --2- 172.21.15.81:0/876748464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8145bc0 0x7f65940039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 --2- 172.21.15.81:0/876748464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6594003f20 0x7f6594004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 --2- 172.21.15.81:0/876748464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004d40 0x7f65940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65a80b3b30 con 0x7f6594004d40 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f659400ba20 con 0x7f6594003f20 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f659400bc20 con 0x7f65a8145bc0 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f65ad5c8640 1 --2- 172.21.15.81:0/876748464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8145bc0 0x7f65940039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f65addc9640 1 --2- 172.21.15.81:0/876748464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004d40 0x7f65940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f65acdc7640 1 --2- 172.21.15.81:0/876748464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6594003f20 0x7f6594004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f65addc9640 1 -- 172.21.15.81:0/876748464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8145bc0 msgr2=0x7f65940039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f65addc9640 1 --2- 172.21.15.81:0/876748464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a8145bc0 0x7f65940039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f65addc9640 1 -- 172.21.15.81:0/876748464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6594003f20 msgr2=0x7f6594004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:49.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f65addc9640 1 --2- 172.21.15.81:0/876748464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6594003f20 0x7f6594004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.383+0000 7f65addc9640 1 -- 172.21.15.81:0/876748464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6594003520 con 0x7f6594004d40 2024-09-16T01:18:49.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.384+0000 7f65addc9640 1 --2- 172.21.15.81:0/876748464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004d40 0x7f65940051c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f65a000c240 tx=0x7f6594005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581a6b537c90219b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:49.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.384+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0007d30 con 0x7f6594004d40 2024-09-16T01:18:49.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.384+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a0005af0 con 0x7f6594004d40 2024-09-16T01:18:49.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.384+0000 7f659ffff640 1 -- 172.21.15.81:0/876748464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0007070 con 0x7f6594004d40 2024-09-16T01:18:49.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.385+0000 7f65af82c640 1 -- 172.21.15.81:0/876748464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004d40 msgr2=0x7f65940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.385+0000 7f65af82c640 1 --2- 172.21.15.81:0/876748464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6594004d40 0x7f65940051c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f65a000c240 tx=0x7f6594005830 comp rx=0 tx=0).stop 2024-09-16T01:18:49.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.385+0000 7f65addc9640 1 -- 172.21.15.81:0/876748464 reap_dead start 2024-09-16T01:18:49.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.385+0000 7f65af82c640 1 -- 172.21.15.81:0/876748464 shutdown_connections 2024-09-16T01:18:49.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.385+0000 7f65af82c640 1 -- 172.21.15.81:0/876748464 >> 172.21.15.81:0/876748464 conn(0x7f65a8073490 msgr2=0x7f65a80b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:49.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.385+0000 7f65af82c640 1 -- 172.21.15.81:0/876748464 shutdown_connections 2024-09-16T01:18:49.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.385+0000 7f65af82c640 1 -- 172.21.15.81:0/876748464 wait complete. 2024-09-16T01:18:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.386+0000 7f65af82c640 1 Processor -- start 2024-09-16T01:18:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.386+0000 7f65af82c640 1 -- start start 2024-09-16T01:18:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65af82c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65a8143070 0x7f65a80cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65af82c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8143450 0x7f65a80ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65af82c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a80cb980 0x7f65a80caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65af82c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65a8145fa0 con 0x7f65a8143450 2024-09-16T01:18:49.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65af82c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f65a809aa30 con 0x7f65a8143070 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65af82c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f65a80b5560 con 0x7f65a80cb980 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65acdc7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8143450 0x7f65a80ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65acdc7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8143450 0x7f65a80ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53372/0 (socket says 172.21.15.81:53372) 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65acdc7640 1 -- 172.21.15.81:0/99312495 learned_addr learned my addr 172.21.15.81:0/99312495 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65ad5c8640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65a8143070 0x7f65a80cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65addc9640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a80cb980 0x7f65a80caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65acdc7640 1 -- 172.21.15.81:0/99312495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a80cb980 msgr2=0x7f65a80caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65acdc7640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a80cb980 0x7f65a80caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65acdc7640 1 -- 172.21.15.81:0/99312495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65a8143070 msgr2=0x7f65a80cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65acdc7640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65a8143070 0x7f65a80cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65acdc7640 1 -- 172.21.15.81:0/99312495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a80b5840 con 0x7f65a8143450 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65addc9640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a80cb980 0x7f65a80caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:49.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f65acdc7640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8143450 0x7f65a80ca4e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f659800f7c0 tx=0x7f659800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.387+0000 7f659dffb640 1 -- 172.21.15.81:0/99312495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65980052e0 con 0x7f65a8143450 2024-09-16T01:18:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.388+0000 7f659dffb640 1 -- 172.21.15.81:0/99312495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6598018070 con 0x7f65a8143450 2024-09-16T01:18:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.388+0000 7f65af82c640 1 -- 172.21.15.81:0/99312495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a80b5b20 con 0x7f65a8143450 2024-09-16T01:18:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.388+0000 7f659dffb640 1 -- 172.21.15.81:0/99312495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659800d910 con 0x7f65a8143450 2024-09-16T01:18:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.388+0000 7f65af82c640 1 -- 172.21.15.81:0/99312495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a80b51c0 con 0x7f65a8143450 2024-09-16T01:18:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.389+0000 7f65af82c640 1 -- 172.21.15.81:0/99312495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a815ca70 con 0x7f65a8143450 2024-09-16T01:18:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.389+0000 7f659dffb640 1 -- 172.21.15.81:0/99312495 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f659800dab0 con 0x7f65a8143450 2024-09-16T01:18:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.389+0000 7f659dffb640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f658c06c2b0 0x7f658c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.389+0000 7f659dffb640 1 -- 172.21.15.81:0/99312495 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 6101+0+0 (secure 0 0 0) 0x7f659808b540 con 0x7f65a8143450 2024-09-16T01:18:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.390+0000 7f65ad5c8640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f658c06c2b0 0x7f658c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.390+0000 7f65ad5c8640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f658c06c2b0 0x7f658c06e770 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f65a4007520 tx=0x7f65a400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:49.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.394+0000 7f659dffb640 1 -- 172.21.15.81:0/99312495 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f659801a310 con 0x7f65a8143450 2024-09-16T01:18:49.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.595+0000 7f65af82c640 1 -- 172.21.15.81:0/99312495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f65a80b25b0 con 0x7f65a8143450 2024-09-16T01:18:49.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-16T01:18:49.596+0000 7f4e951a0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:18:49.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.597+0000 7f659dffb640 1 -- 172.21.15.81:0/99312495 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v37) ==== 161+0+0 (secure 0 0 0) 0x7f6598059b20 con 0x7f65a8143450 2024-09-16T01:18:49.598 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:18:49.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.601+0000 7f65af82c640 1 -- 172.21.15.81:0/99312495 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f658c06c2b0 msgr2=0x7f658c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.601+0000 7f65af82c640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f658c06c2b0 0x7f658c06e770 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f65a4007520 tx=0x7f65a400b040 comp rx=0 tx=0).stop 2024-09-16T01:18:49.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.601+0000 7f65af82c640 1 -- 172.21.15.81:0/99312495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8143450 msgr2=0x7f65a80ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.601+0000 7f65af82c640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8143450 0x7f65a80ca4e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f659800f7c0 tx=0x7f659800fc80 comp rx=0 tx=0).stop 2024-09-16T01:18:49.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.601+0000 7f65af82c640 1 -- 172.21.15.81:0/99312495 shutdown_connections 2024-09-16T01:18:49.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.601+0000 7f65af82c640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f658c06c2b0 0x7f658c06e770 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.601+0000 7f65af82c640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f65a80cb980 0x7f65a80caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.601+0000 7f65af82c640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8143450 0x7f65a80ca4e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.601+0000 7f65af82c640 1 --2- 172.21.15.81:0/99312495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f65a8143070 0x7f65a80cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.601+0000 7f65af82c640 1 -- 172.21.15.81:0/99312495 >> 172.21.15.81:0/99312495 conn(0x7f65a8073490 msgr2=0x7f65a8070650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:49.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.601+0000 7f65af82c640 1 -- 172.21.15.81:0/99312495 shutdown_connections 2024-09-16T01:18:49.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.601+0000 7f65af82c640 1 -- 172.21.15.81:0/99312495 wait complete. 2024-09-16T01:18:49.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:18:49.643 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:18:49.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.712+0000 7f84e644c640 1 Processor -- start 2024-09-16T01:18:49.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.712+0000 7f84e644c640 1 -- start start 2024-09-16T01:18:49.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.713+0000 7f84e644c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f84e006c320 0x7f84e009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.713+0000 7f84e644c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84e00b3670 0x7f84e00b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.713+0000 7f84e644c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e00b3b20 con 0x7f84e015f910 2024-09-16T01:18:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.713+0000 7f84e644c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f84e00b0d40 con 0x7f84e006c320 2024-09-16T01:18:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.713+0000 7f84e644c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f84e015fcf0 con 0x7f84e00b3670 2024-09-16T01:18:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.713+0000 7f84df7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f84e006c320 0x7f84e009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.713+0000 7f84df7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f84e006c320 0x7f84e009aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53376/0 (socket says 172.21.15.81:53376) 2024-09-16T01:18:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.713+0000 7f84df7fe640 1 -- 172.21.15.81:0/710043445 learned_addr learned my addr 172.21.15.81:0/710043445 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.713+0000 7f84e49e9640 1 --2- 172.21.15.81:0/710043445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84e00b3670 0x7f84e00b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.714+0000 7f84df7fe640 1 -- 172.21.15.81:0/710043445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84e00b3670 msgr2=0x7f84e00b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.714+0000 7f84df7fe640 1 --2- 172.21.15.81:0/710043445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84e00b3670 0x7f84e00b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.714+0000 7f84df7fe640 1 -- 172.21.15.81:0/710043445 >> v1:172.21.15.102:6789/0 conn(0x7f84e015f910 legacy=0x7f84e006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.714+0000 7f84df7fe640 1 -- 172.21.15.81:0/710043445 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e00b60c0 con 0x7f84e006c320 2024-09-16T01:18:49.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.714+0000 7f84df7fe640 1 --2- 172.21.15.81:0/710043445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84e006c320 0x7f84e009aa30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f84d40098a0 tx=0x7f84d402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7753f0c072a26d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.714+0000 7f84deffd640 1 -- 172.21.15.81:0/710043445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4037070 con 0x7f84e006c320 2024-09-16T01:18:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.715+0000 7f84deffd640 1 -- 172.21.15.81:0/710043445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d4032440 con 0x7f84e006c320 2024-09-16T01:18:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.715+0000 7f84deffd640 1 -- 172.21.15.81:0/710043445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4032810 con 0x7f84e006c320 2024-09-16T01:18:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.715+0000 7f84e644c640 1 -- 172.21.15.81:0/710043445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84e006c320 msgr2=0x7f84e009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.715+0000 7f84e644c640 1 --2- 172.21.15.81:0/710043445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84e006c320 0x7f84e009aa30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f84d40098a0 tx=0x7f84d402a200 comp rx=0 tx=0).stop 2024-09-16T01:18:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.715+0000 7f84e644c640 1 -- 172.21.15.81:0/710043445 shutdown_connections 2024-09-16T01:18:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.715+0000 7f84e644c640 1 --2- 172.21.15.81:0/710043445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84e00b3670 0x7f84e00b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.715+0000 7f84e644c640 1 --2- 172.21.15.81:0/710043445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84e006c320 0x7f84e009aa30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.715+0000 7f84e644c640 1 -- 172.21.15.81:0/710043445 >> 172.21.15.81:0/710043445 conn(0x7f84e0073490 msgr2=0x7f84e00b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.715+0000 7f84e644c640 1 -- 172.21.15.81:0/710043445 shutdown_connections 2024-09-16T01:18:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.715+0000 7f84e644c640 1 -- 172.21.15.81:0/710043445 wait complete. 2024-09-16T01:18:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.716+0000 7f84e644c640 1 Processor -- start 2024-09-16T01:18:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.717+0000 7f84e644c640 1 -- start start 2024-09-16T01:18:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.717+0000 7f84e644c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84e006c320 0x7f84e01f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.717+0000 7f84e644c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84e00b3670 0x7f84e014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.717+0000 7f84e644c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84e015f910 0x7f84e0152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.717+0000 7f84e644c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f84e00b0820 con 0x7f84e006c320 2024-09-16T01:18:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.717+0000 7f84e644c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f84e00b6680 con 0x7f84e00b3670 2024-09-16T01:18:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.717+0000 7f84e644c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f84e00b0510 con 0x7f84e015f910 2024-09-16T01:18:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.717+0000 7f84dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84e006c320 0x7f84e01f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.717+0000 7f84dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84e006c320 0x7f84e01f35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53392/0 (socket says 172.21.15.81:53392) 2024-09-16T01:18:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.717+0000 7f84dffff640 1 -- 172.21.15.81:0/2644085932 learned_addr learned my addr 172.21.15.81:0/2644085932 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.717+0000 7f84e49e9640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84e015f910 0x7f84e0152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.717+0000 7f84df7fe640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84e00b3670 0x7f84e014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.718+0000 7f84dffff640 1 -- 172.21.15.81:0/2644085932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84e015f910 msgr2=0x7f84e0152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.718+0000 7f84dffff640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84e015f910 0x7f84e0152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.718+0000 7f84dffff640 1 -- 172.21.15.81:0/2644085932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84e00b3670 msgr2=0x7f84e014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.718+0000 7f84dffff640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84e00b3670 0x7f84e014ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.718+0000 7f84dffff640 1 -- 172.21.15.81:0/2644085932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e01f3ae0 con 0x7f84e006c320 2024-09-16T01:18:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.718+0000 7f84dffff640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84e006c320 0x7f84e01f35a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f84d000c430 tx=0x7f84d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.718+0000 7f84dcff9640 1 -- 172.21.15.81:0/2644085932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0017070 con 0x7f84e006c320 2024-09-16T01:18:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.718+0000 7f84dcff9640 1 -- 172.21.15.81:0/2644085932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d00052d0 con 0x7f84e006c320 2024-09-16T01:18:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.718+0000 7f84e644c640 1 -- 172.21.15.81:0/2644085932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e01552f0 con 0x7f84e006c320 2024-09-16T01:18:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.718+0000 7f84dcff9640 1 -- 172.21.15.81:0/2644085932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d0003850 con 0x7f84e006c320 2024-09-16T01:18:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.718+0000 7f84e644c640 1 -- 172.21.15.81:0/2644085932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e01558b0 con 0x7f84e006c320 2024-09-16T01:18:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.719+0000 7f84e644c640 1 -- 172.21.15.81:0/2644085932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e009aa30 con 0x7f84e006c320 2024-09-16T01:18:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.719+0000 7f84dcff9640 1 -- 172.21.15.81:0/2644085932 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f84d001a070 con 0x7f84e006c320 2024-09-16T01:18:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.720+0000 7f84dcff9640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f84cc06c2b0 0x7f84cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.720+0000 7f84dcff9640 1 -- 172.21.15.81:0/2644085932 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f84d008a930 con 0x7f84e006c320 2024-09-16T01:18:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.720+0000 7f84df7fe640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f84cc06c2b0 0x7f84cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.720+0000 7f84df7fe640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f84cc06c2b0 0x7f84cc06e770 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f84d4034000 tx=0x7f84d402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.724+0000 7f84dcff9640 1 -- 172.21.15.81:0/2644085932 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84d0058870 con 0x7f84e006c320 2024-09-16T01:18:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:49.926+0000 7f84e644c640 1 -- 172.21.15.81:0/2644085932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f84e009f5b0 con 0x7f84e006c320 2024-09-16T01:18:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.599+0000 7f84dcff9640 1 -- 172.21.15.81:0/2644085932 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7f84d005cb70 con 0x7f84e006c320 2024-09-16T01:18:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.602+0000 7f84e644c640 1 -- 172.21.15.81:0/2644085932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f84cc06c2b0 msgr2=0x7f84cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.602+0000 7f84e644c640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f84cc06c2b0 0x7f84cc06e770 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f84d4034000 tx=0x7f84d402e000 comp rx=0 tx=0).stop 2024-09-16T01:18:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.602+0000 7f84e644c640 1 -- 172.21.15.81:0/2644085932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84e006c320 msgr2=0x7f84e01f35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.602+0000 7f84e644c640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84e006c320 0x7f84e01f35a0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f84d000c430 tx=0x7f84d000c8f0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.602+0000 7f84e644c640 1 -- 172.21.15.81:0/2644085932 shutdown_connections 2024-09-16T01:18:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.602+0000 7f84e644c640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f84cc06c2b0 0x7f84cc06e770 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.602+0000 7f84e644c640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f84e015f910 0x7f84e0152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.602+0000 7f84e644c640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84e00b3670 0x7f84e014ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.602+0000 7f84e644c640 1 --2- 172.21.15.81:0/2644085932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84e006c320 0x7f84e01f35a0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.602+0000 7f84e644c640 1 -- 172.21.15.81:0/2644085932 >> 172.21.15.81:0/2644085932 conn(0x7f84e0073490 msgr2=0x7f84e006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.602+0000 7f84e644c640 1 -- 172.21.15.81:0/2644085932 shutdown_connections 2024-09-16T01:18:50.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.602+0000 7f84e644c640 1 -- 172.21.15.81:0/2644085932 wait complete. 2024-09-16T01:18:50.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:18:50.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.720+0000 7f46ea480640 1 Processor -- start 2024-09-16T01:18:50.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.720+0000 7f46ea480640 1 -- start start 2024-09-16T01:18:50.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46ea480640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f46e415c490 0x7f46e409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:50.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46ea480640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e4072180 con 0x7f46e4071100 2024-09-16T01:18:50.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46ea480640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e415c870 con 0x7f46e409af70 2024-09-16T01:18:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46ea480640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f46e409b3b0 con 0x7f46e415c490 2024-09-16T01:18:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46e8a1d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f46e4071100 0x7f46e40b0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56818/0 (socket says 172.21.15.81:56818) 2024-09-16T01:18:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46e8a1d640 1 -- 172.21.15.81:0/2804708975 learned_addr learned my addr 172.21.15.81:0/2804708975 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1988854891 0 0) 0x7f46e4072180 con 0x7f46e4071100 2024-09-16T01:18:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46cc003520 con 0x7f46e4071100 2024-09-16T01:18:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46e3fff640 1 --2- 172.21.15.81:0/2804708975 >> v2:172.21.15.102:3300/0 conn(0x7f46e415c490 0x7f46e409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 56523773 0 0) 0x7f46cc003520 con 0x7f46e4071100 2024-09-16T01:18:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 >> v2:172.21.15.102:3300/0 conn(0x7f46e415c490 msgr2=0x7f46e409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46e2ffd640 1 --2- 172.21.15.81:0/2804708975 >> v2:172.21.15.102:3300/0 conn(0x7f46e415c490 0x7f46e409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 >> v1:172.21.15.102:6789/0 conn(0x7f46e409af70 legacy=0x7f46e40b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e4071bc0 con 0x7f46e4071100 2024-09-16T01:18:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.721+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f46dc0019f0 con 0x7f46e4071100 2024-09-16T01:18:50.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 >> v1:172.21.15.81:6789/0 conn(0x7f46e4071100 legacy=0x7f46e40b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:50.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e2ffd640 1 --2- 172.21.15.81:0/2804708975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46cc0039b0 0x7f46cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:50.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e2ffd640 1 --2- 172.21.15.81:0/2804708975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 0x7f46cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:50.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e2ffd640 1 --2- 172.21.15.81:0/2804708975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46cc0051c0 0x7f46cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:50.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46e409b3b0 con 0x7f46cc004800 2024-09-16T01:18:50.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc00c110 con 0x7f46cc0039b0 2024-09-16T01:18:50.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f46cc00c310 con 0x7f46cc0051c0 2024-09-16T01:18:50.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e37fe640 1 --2- 172.21.15.81:0/2804708975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 0x7f46cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:50.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e3fff640 1 --2- 172.21.15.81:0/2804708975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46cc0039b0 0x7f46cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:50.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e8a1d640 1 --2- 172.21.15.81:0/2804708975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46cc0051c0 0x7f46cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e37fe640 1 -- 172.21.15.81:0/2804708975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46cc0051c0 msgr2=0x7f46cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e37fe640 1 --2- 172.21.15.81:0/2804708975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46cc0051c0 0x7f46cc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e37fe640 1 -- 172.21.15.81:0/2804708975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46cc0039b0 msgr2=0x7f46cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e37fe640 1 --2- 172.21.15.81:0/2804708975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46cc0039b0 0x7f46cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e37fe640 1 -- 172.21.15.81:0/2804708975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46cc003520 con 0x7f46cc004800 2024-09-16T01:18:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e8a1d640 1 --2- 172.21.15.81:0/2804708975 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46cc0051c0 0x7f46cc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.722+0000 7f46e8a1d640 1 -- 172.21.15.81:0/2804708975 reap_dead start 2024-09-16T01:18:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.723+0000 7f46e37fe640 1 --2- 172.21.15.81:0/2804708975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 0x7f46cc004c80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f46d8001750 tx=0x7f46cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ece35660cf05b63 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.723+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d8001370 con 0x7f46cc004800 2024-09-16T01:18:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.723+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d80052d0 con 0x7f46cc004800 2024-09-16T01:18:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.723+0000 7f46e2ffd640 1 -- 172.21.15.81:0/2804708975 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d802abc0 con 0x7f46cc004800 2024-09-16T01:18:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.723+0000 7f46ea480640 1 -- 172.21.15.81:0/2804708975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 msgr2=0x7f46cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:50.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.723+0000 7f46ea480640 1 --2- 172.21.15.81:0/2804708975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 0x7f46cc004c80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f46d8001750 tx=0x7f46cc005830 comp rx=0 tx=0).stop 2024-09-16T01:18:50.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.723+0000 7f46ea480640 1 -- 172.21.15.81:0/2804708975 shutdown_connections 2024-09-16T01:18:50.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.723+0000 7f46ea480640 1 --2- 172.21.15.81:0/2804708975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 0x7f46cc004c80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.723+0000 7f46ea480640 1 -- 172.21.15.81:0/2804708975 >> 172.21.15.81:0/2804708975 conn(0x7f46e40b3f30 msgr2=0x7f46e40b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:50.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.723+0000 7f46ea480640 1 -- 172.21.15.81:0/2804708975 shutdown_connections 2024-09-16T01:18:50.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.723+0000 7f46ea480640 1 -- 172.21.15.81:0/2804708975 wait complete. 2024-09-16T01:18:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.725+0000 7f46ea480640 1 Processor -- start 2024-09-16T01:18:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.725+0000 7f46ea480640 1 -- start start 2024-09-16T01:18:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.725+0000 7f46ea480640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 0x7f46e4156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46ea480640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e4158500 0x7f46e4138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46ea480640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e41531a0 0x7f46e4150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46ea480640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46e40affa0 con 0x7f46cc004800 2024-09-16T01:18:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46ea480640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f46e40afcc0 con 0x7f46e41531a0 2024-09-16T01:18:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46ea480640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f46e409b8f0 con 0x7f46e4158500 2024-09-16T01:18:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 0x7f46e4156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 0x7f46e4156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53412/0 (socket says 172.21.15.81:53412) 2024-09-16T01:18:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e3fff640 1 -- 172.21.15.81:0/300007513 learned_addr learned my addr 172.21.15.81:0/300007513 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e37fe640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e4158500 0x7f46e4138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e8a1d640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e41531a0 0x7f46e4150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e3fff640 1 -- 172.21.15.81:0/300007513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e4158500 msgr2=0x7f46e4138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e3fff640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e4158500 0x7f46e4138970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e3fff640 1 -- 172.21.15.81:0/300007513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e41531a0 msgr2=0x7f46e4150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e3fff640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e41531a0 0x7f46e4150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e3fff640 1 -- 172.21.15.81:0/300007513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e4157460 con 0x7f46cc004800 2024-09-16T01:18:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e3fff640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 0x7f46e4156e80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f46d400b820 tx=0x7f46d400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e0ff9640 1 -- 172.21.15.81:0/300007513 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4018070 con 0x7f46cc004800 2024-09-16T01:18:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e0ff9640 1 -- 172.21.15.81:0/300007513 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d400be10 con 0x7f46cc004800 2024-09-16T01:18:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46e0ff9640 1 -- 172.21.15.81:0/300007513 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4010c00 con 0x7f46cc004800 2024-09-16T01:18:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46ea480640 1 -- 172.21.15.81:0/300007513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e4157740 con 0x7f46cc004800 2024-09-16T01:18:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.726+0000 7f46ea480640 1 -- 172.21.15.81:0/300007513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e4157d00 con 0x7f46cc004800 2024-09-16T01:18:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.727+0000 7f46ea480640 1 -- 172.21.15.81:0/300007513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e409aa30 con 0x7f46cc004800 2024-09-16T01:18:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.728+0000 7f46e0ff9640 1 -- 172.21.15.81:0/300007513 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f46d401b070 con 0x7f46cc004800 2024-09-16T01:18:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.728+0000 7f46e0ff9640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46d006c2b0 0x7f46d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.728+0000 7f46e0ff9640 1 -- 172.21.15.81:0/300007513 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6187+0+0 (secure 0 0 0) 0x7f46d408bb80 con 0x7f46cc004800 2024-09-16T01:18:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.728+0000 7f46e37fe640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46d006c2b0 0x7f46d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.729+0000 7f46e37fe640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46d006c2b0 0x7f46d006e770 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f46d8032000 tx=0x7f46d802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.732+0000 7f46e0ff9640 1 -- 172.21.15.81:0/300007513 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46d405a080 con 0x7f46cc004800 2024-09-16T01:18:50.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:50.900+0000 7f46ea480640 1 -- 172.21.15.81:0/300007513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f46e40b6a00 con 0x7f46cc004800 2024-09-16T01:18:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.600+0000 7f46e0ff9640 1 -- 172.21.15.81:0/300007513 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) ==== 181+0+0 (secure 0 0 0) 0x7f46d4059980 con 0x7f46cc004800 2024-09-16T01:18:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:18:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.603+0000 7f46ea480640 1 -- 172.21.15.81:0/300007513 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46d006c2b0 msgr2=0x7f46d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.603+0000 7f46ea480640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46d006c2b0 0x7f46d006e770 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f46d8032000 tx=0x7f46d802e000 comp rx=0 tx=0).stop 2024-09-16T01:18:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.603+0000 7f46ea480640 1 -- 172.21.15.81:0/300007513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 msgr2=0x7f46e4156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.603+0000 7f46ea480640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 0x7f46e4156e80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f46d400b820 tx=0x7f46d400bce0 comp rx=0 tx=0).stop 2024-09-16T01:18:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.603+0000 7f46ea480640 1 -- 172.21.15.81:0/300007513 shutdown_connections 2024-09-16T01:18:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.603+0000 7f46ea480640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46d006c2b0 0x7f46d006e770 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.603+0000 7f46ea480640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e41531a0 0x7f46e4150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.603+0000 7f46ea480640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e4158500 0x7f46e4138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:51.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.603+0000 7f46ea480640 1 --2- 172.21.15.81:0/300007513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46cc004800 0x7f46e4156e80 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.603+0000 7f46ea480640 1 -- 172.21.15.81:0/300007513 >> 172.21.15.81:0/300007513 conn(0x7f46e40b3f30 msgr2=0x7f46e40b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.603+0000 7f46ea480640 1 -- 172.21.15.81:0/300007513 shutdown_connections 2024-09-16T01:18:51.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.603+0000 7f46ea480640 1 -- 172.21.15.81:0/300007513 wait complete. 2024-09-16T01:18:51.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:18:51.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.726+0000 7f95d09fd640 1 Processor -- start 2024-09-16T01:18:51.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.726+0000 7f95d09fd640 1 -- start start 2024-09-16T01:18:51.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.727+0000 7f95d09fd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95cc15b570 0x7f95cc071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.727+0000 7f95d09fd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95cc0cd120 0x7f95cc15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.727+0000 7f95d09fd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95cc073b20 con 0x7f95cc15b950 2024-09-16T01:18:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.727+0000 7f95d09fd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f95cc0740e0 con 0x7f95cc15b570 2024-09-16T01:18:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.727+0000 7f95d09fd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc073e00 con 0x7f95cc0cd120 2024-09-16T01:18:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.727+0000 7f95ca59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95cc15b570 0x7f95cc071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.727+0000 7f95ca59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95cc15b570 0x7f95cc071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45790/0 (socket says 172.21.15.81:45790) 2024-09-16T01:18:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.727+0000 7f95ca59c640 1 -- 172.21.15.81:0/3907249281 learned_addr learned my addr 172.21.15.81:0/3907249281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.727+0000 7f95ca59c640 1 -- 172.21.15.81:0/3907249281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95cc0cd120 msgr2=0x7f95cc15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.727+0000 7f95ca59c640 1 --2- 172.21.15.81:0/3907249281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95cc0cd120 0x7f95cc15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.727+0000 7f95ca59c640 1 -- 172.21.15.81:0/3907249281 >> v1:172.21.15.102:6789/0 conn(0x7f95cc15b950 legacy=0x7f95cc0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.727+0000 7f95ca59c640 1 -- 172.21.15.81:0/3907249281 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc0cf320 con 0x7f95cc15b570 2024-09-16T01:18:51.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.728+0000 7f95ca59c640 1 --2- 172.21.15.81:0/3907249281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95cc15b570 0x7f95cc071e40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009870 tx=0x7f95bc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3b60fe37cf1149 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:51.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.728+0000 7f95c9d9b640 1 -- 172.21.15.81:0/3907249281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc037070 con 0x7f95cc15b570 2024-09-16T01:18:51.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.728+0000 7f95c9d9b640 1 -- 172.21.15.81:0/3907249281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95bc032440 con 0x7f95cc15b570 2024-09-16T01:18:51.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.728+0000 7f95c9d9b640 1 -- 172.21.15.81:0/3907249281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc032810 con 0x7f95cc15b570 2024-09-16T01:18:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.728+0000 7f95d09fd640 1 -- 172.21.15.81:0/3907249281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95cc15b570 msgr2=0x7f95cc071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.728+0000 7f95d09fd640 1 --2- 172.21.15.81:0/3907249281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95cc15b570 0x7f95cc071e40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009870 tx=0x7f95bc02a1a0 comp rx=0 tx=0).stop 2024-09-16T01:18:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.728+0000 7f95d09fd640 1 -- 172.21.15.81:0/3907249281 shutdown_connections 2024-09-16T01:18:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.728+0000 7f95d09fd640 1 --2- 172.21.15.81:0/3907249281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95cc0cd120 0x7f95cc15e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.728+0000 7f95d09fd640 1 --2- 172.21.15.81:0/3907249281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95cc15b570 0x7f95cc071e40 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.729+0000 7f95d09fd640 1 -- 172.21.15.81:0/3907249281 >> 172.21.15.81:0/3907249281 conn(0x7f95cc06bdf0 msgr2=0x7f95cc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.729+0000 7f95d09fd640 1 -- 172.21.15.81:0/3907249281 shutdown_connections 2024-09-16T01:18:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.729+0000 7f95d09fd640 1 -- 172.21.15.81:0/3907249281 wait complete. 2024-09-16T01:18:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.730+0000 7f95d09fd640 1 Processor -- start 2024-09-16T01:18:51.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.730+0000 7f95d09fd640 1 -- start start 2024-09-16T01:18:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95d09fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95cc0cd120 0x7f95cc09d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95d09fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95cc15b570 0x7f95cc142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95d09fd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95cc15b950 0x7f95cc14e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95d09fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc0cf840 con 0x7f95cc0cd120 2024-09-16T01:18:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95d09fd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc072450 con 0x7f95cc15b570 2024-09-16T01:18:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95d09fd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc0cf9c0 con 0x7f95cc15b950 2024-09-16T01:18:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95ca59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95cc0cd120 0x7f95cc09d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:51.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95ca59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95cc0cd120 0x7f95cc09d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45800/0 (socket says 172.21.15.81:45800) 2024-09-16T01:18:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95ca59c640 1 -- 172.21.15.81:0/3959735719 learned_addr learned my addr 172.21.15.81:0/3959735719 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95ca59c640 1 -- 172.21.15.81:0/3959735719 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95cc15b950 msgr2=0x7f95cc14e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95c1d9b640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95cc15b570 0x7f95cc142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95cad9d640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95cc15b950 0x7f95cc14e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95ca59c640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95cc15b950 0x7f95cc14e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95ca59c640 1 -- 172.21.15.81:0/3959735719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95cc15b570 msgr2=0x7f95cc142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95ca59c640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95cc15b570 0x7f95cc142cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95ca59c640 1 -- 172.21.15.81:0/3959735719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc140400 con 0x7f95cc0cd120 2024-09-16T01:18:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95ca59c640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95cc0cd120 0x7f95cc09d9b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f95bc000c00 tx=0x7f95bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.731+0000 7f95c37fe640 1 -- 172.21.15.81:0/3959735719 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc041070 con 0x7f95cc0cd120 2024-09-16T01:18:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.732+0000 7f95c37fe640 1 -- 172.21.15.81:0/3959735719 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95bc03c870 con 0x7f95cc0cd120 2024-09-16T01:18:51.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.732+0000 7f95c37fe640 1 -- 172.21.15.81:0/3959735719 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc037040 con 0x7f95cc0cd120 2024-09-16T01:18:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.732+0000 7f95d09fd640 1 -- 172.21.15.81:0/3959735719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95cc1406e0 con 0x7f95cc0cd120 2024-09-16T01:18:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.732+0000 7f95d09fd640 1 -- 172.21.15.81:0/3959735719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95cc14ea40 con 0x7f95cc0cd120 2024-09-16T01:18:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.733+0000 7f95d09fd640 1 -- 172.21.15.81:0/3959735719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95cc071e40 con 0x7f95cc0cd120 2024-09-16T01:18:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.733+0000 7f95c37fe640 1 -- 172.21.15.81:0/3959735719 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f95bc044070 con 0x7f95cc0cd120 2024-09-16T01:18:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.733+0000 7f95c37fe640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f95ac06c2b0 0x7f95ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.733+0000 7f95c37fe640 1 -- 172.21.15.81:0/3959735719 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5749+0+0 (secure 0 0 0) 0x7f95bc0ac130 con 0x7f95cc0cd120 2024-09-16T01:18:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.733+0000 7f95c1d9b640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f95ac06c2b0 0x7f95ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:51.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.734+0000 7f95c1d9b640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f95ac06c2b0 0x7f95ac06e770 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f95cc09def0 tx=0x7f95b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:51.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.738+0000 7f95c37fe640 1 -- 172.21.15.81:0/3959735719 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95bc07aa20 con 0x7f95cc0cd120 2024-09-16T01:18:51.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:51.904+0000 7f95d09fd640 1 -- 172.21.15.81:0/3959735719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f95cc06ddc0 con 0x7f95cc0cd120 2024-09-16T01:18:52.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.602+0000 7f95c37fe640 1 -- 172.21.15.81:0/3959735719 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) ==== 169+0+0 (secure 0 0 0) 0x7f95bc07a320 con 0x7f95cc0cd120 2024-09-16T01:18:52.603 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-16T01:18:52.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.608+0000 7f95d09fd640 1 -- 172.21.15.81:0/3959735719 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f95ac06c2b0 msgr2=0x7f95ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:52.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.608+0000 7f95d09fd640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f95ac06c2b0 0x7f95ac06e770 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f95cc09def0 tx=0x7f95b4008040 comp rx=0 tx=0).stop 2024-09-16T01:18:52.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.608+0000 7f95d09fd640 1 -- 172.21.15.81:0/3959735719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95cc0cd120 msgr2=0x7f95cc09d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:52.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.608+0000 7f95d09fd640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95cc0cd120 0x7f95cc09d9b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f95bc000c00 tx=0x7f95bc0046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.608+0000 7f95d09fd640 1 -- 172.21.15.81:0/3959735719 shutdown_connections 2024-09-16T01:18:52.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.608+0000 7f95d09fd640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f95ac06c2b0 0x7f95ac06e770 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.608+0000 7f95d09fd640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95cc15b950 0x7f95cc14e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.608+0000 7f95d09fd640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95cc15b570 0x7f95cc142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.608+0000 7f95d09fd640 1 --2- 172.21.15.81:0/3959735719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95cc0cd120 0x7f95cc09d9b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.608+0000 7f95d09fd640 1 -- 172.21.15.81:0/3959735719 >> 172.21.15.81:0/3959735719 conn(0x7f95cc06bdf0 msgr2=0x7f95cc15d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:52.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.608+0000 7f95d09fd640 1 -- 172.21.15.81:0/3959735719 shutdown_connections 2024-09-16T01:18:52.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.608+0000 7f95d09fd640 1 -- 172.21.15.81:0/3959735719 wait complete. 2024-09-16T01:18:52.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-16T01:18:52.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.724+0000 7fe8e88ba640 1 Processor -- start 2024-09-16T01:18:52.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.724+0000 7fe8e88ba640 1 -- start start 2024-09-16T01:18:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8e88ba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8e40b4800 0x7fe8e40aef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8e88ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e40d0370 0x7fe8e40d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8e88ba640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e40af7a0 con 0x7fe8e415c310 2024-09-16T01:18:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8e88ba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe8e40afa80 con 0x7fe8e40b4800 2024-09-16T01:18:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8e88ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e4160130 con 0x7fe8e40d0370 2024-09-16T01:18:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8dbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8e40b4800 0x7fe8e40aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8e259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe8e415c310 0x7fe8e4160930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48906/0 (socket says 172.21.15.81:48906) 2024-09-16T01:18:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8e259c640 1 -- 172.21.15.81:0/1657136836 learned_addr learned my addr 172.21.15.81:0/1657136836 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8dbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8e40b4800 0x7fe8e40aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45814/0 (socket says 172.21.15.81:45814) 2024-09-16T01:18:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8dbfff640 1 -- 172.21.15.81:0/1657136836 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e40d0370 msgr2=0x7fe8e40d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8dbfff640 1 --2- 172.21.15.81:0/1657136836 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e40d0370 0x7fe8e40d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8dbfff640 1 -- 172.21.15.81:0/1657136836 >> v1:172.21.15.81:6789/0 conn(0x7fe8e415c310 legacy=0x7fe8e4160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.725+0000 7fe8dbfff640 1 -- 172.21.15.81:0/1657136836 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e40af470 con 0x7fe8e40b4800 2024-09-16T01:18:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.726+0000 7fe8dbfff640 1 --2- 172.21.15.81:0/1657136836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e40b4800 0x7fe8e40aef30 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0097a0 tx=0x7fe8cc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f325c69ca0e6b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.726+0000 7fe8e1d9b640 1 -- 172.21.15.81:0/1657136836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc037070 con 0x7fe8e40b4800 2024-09-16T01:18:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.726+0000 7fe8e1d9b640 1 -- 172.21.15.81:0/1657136836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8cc032440 con 0x7fe8e40b4800 2024-09-16T01:18:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.726+0000 7fe8e1d9b640 1 -- 172.21.15.81:0/1657136836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc032810 con 0x7fe8e40b4800 2024-09-16T01:18:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.726+0000 7fe8e88ba640 1 -- 172.21.15.81:0/1657136836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e40b4800 msgr2=0x7fe8e40aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.726+0000 7fe8e88ba640 1 --2- 172.21.15.81:0/1657136836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e40b4800 0x7fe8e40aef30 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc0097a0 tx=0x7fe8cc02a180 comp rx=0 tx=0).stop 2024-09-16T01:18:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.727+0000 7fe8e88ba640 1 -- 172.21.15.81:0/1657136836 shutdown_connections 2024-09-16T01:18:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.727+0000 7fe8e88ba640 1 --2- 172.21.15.81:0/1657136836 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e40d0370 0x7fe8e40d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.727+0000 7fe8e88ba640 1 --2- 172.21.15.81:0/1657136836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e40b4800 0x7fe8e40aef30 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.727+0000 7fe8e88ba640 1 -- 172.21.15.81:0/1657136836 >> 172.21.15.81:0/1657136836 conn(0x7fe8e406bdf0 msgr2=0x7fe8e406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.727+0000 7fe8e88ba640 1 -- 172.21.15.81:0/1657136836 shutdown_connections 2024-09-16T01:18:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.727+0000 7fe8e88ba640 1 -- 172.21.15.81:0/1657136836 wait complete. 2024-09-16T01:18:52.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.728+0000 7fe8e88ba640 1 Processor -- start 2024-09-16T01:18:52.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.728+0000 7fe8e88ba640 1 -- start start 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e88ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e40b4800 0x7fe8e41f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e88ba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e40d0370 0x7fe8e4158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e88ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e415c310 0x7fe8e409dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e88ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e406e090 con 0x7fe8e40b4800 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e88ba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e406df10 con 0x7fe8e40d0370 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e88ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e406e210 con 0x7fe8e415c310 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e40b4800 0x7fe8e41f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e40b4800 0x7fe8e41f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45818/0 (socket says 172.21.15.81:45818) 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e259c640 1 -- 172.21.15.81:0/2333434338 learned_addr learned my addr 172.21.15.81:0/2333434338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e259c640 1 -- 172.21.15.81:0/2333434338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e415c310 msgr2=0x7fe8e409dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e259c640 1 --2- 172.21.15.81:0/2333434338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e415c310 0x7fe8e409dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e259c640 1 -- 172.21.15.81:0/2333434338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e40d0370 msgr2=0x7fe8e4158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e259c640 1 --2- 172.21.15.81:0/2333434338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e40d0370 0x7fe8e4158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e259c640 1 -- 172.21.15.81:0/2333434338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e41f6040 con 0x7fe8e40b4800 2024-09-16T01:18:52.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e259c640 1 --2- 172.21.15.81:0/2333434338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e40b4800 0x7fe8e41f5a60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400c3c0 tx=0x7fe8d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:52.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8daffd640 1 -- 172.21.15.81:0/2333434338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4017070 con 0x7fe8e40b4800 2024-09-16T01:18:52.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8daffd640 1 -- 172.21.15.81:0/2333434338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d4005ce0 con 0x7fe8e40b4800 2024-09-16T01:18:52.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e88ba640 1 -- 172.21.15.81:0/2333434338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e41f6320 con 0x7fe8e40b4800 2024-09-16T01:18:52.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8daffd640 1 -- 172.21.15.81:0/2333434338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d40072f0 con 0x7fe8e40b4800 2024-09-16T01:18:52.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.729+0000 7fe8e88ba640 1 -- 172.21.15.81:0/2333434338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e41f68e0 con 0x7fe8e40b4800 2024-09-16T01:18:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.730+0000 7fe8e88ba640 1 -- 172.21.15.81:0/2333434338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e40aef30 con 0x7fe8e40b4800 2024-09-16T01:18:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.731+0000 7fe8daffd640 1 -- 172.21.15.81:0/2333434338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe8d401a070 con 0x7fe8e40b4800 2024-09-16T01:18:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.731+0000 7fe8daffd640 1 --2- 172.21.15.81:0/2333434338 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe8c406c2b0 0x7fe8c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.731+0000 7fe8daffd640 1 -- 172.21.15.81:0/2333434338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7fe8d408a5e0 con 0x7fe8e40b4800 2024-09-16T01:18:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.731+0000 7fe8dbfff640 1 --2- 172.21.15.81:0/2333434338 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe8c406c2b0 0x7fe8c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.732+0000 7fe8dbfff640 1 --2- 172.21.15.81:0/2333434338 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe8c406c2b0 0x7fe8c406e770 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc034000 tx=0x7fe8cc02c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.736+0000 7fe8daffd640 1 -- 172.21.15.81:0/2333434338 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8d4058f50 con 0x7fe8e40b4800 2024-09-16T01:18:52.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.902+0000 7fe8e88ba640 1 -- 172.21.15.81:0/2333434338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe8e40cf9c0 con 0x7fe8e40b4800 2024-09-16T01:18:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.905+0000 7fe8daffd640 1 -- 172.21.15.81:0/2333434338 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v22) ==== 104+0+0 (secure 0 0 0) 0x7fe8d4058850 con 0x7fe8e40b4800 2024-09-16T01:18:52.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.907+0000 7fe8e88ba640 1 -- 172.21.15.81:0/2333434338 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe8c406c2b0 msgr2=0x7fe8c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:52.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.907+0000 7fe8e88ba640 1 --2- 172.21.15.81:0/2333434338 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe8c406c2b0 0x7fe8c406e770 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc034000 tx=0x7fe8cc02c000 comp rx=0 tx=0).stop 2024-09-16T01:18:52.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.907+0000 7fe8e88ba640 1 -- 172.21.15.81:0/2333434338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e40b4800 msgr2=0x7fe8e41f5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:52.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.907+0000 7fe8e88ba640 1 --2- 172.21.15.81:0/2333434338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e40b4800 0x7fe8e41f5a60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400c3c0 tx=0x7fe8d400c880 comp rx=0 tx=0).stop 2024-09-16T01:18:52.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.907+0000 7fe8e88ba640 1 -- 172.21.15.81:0/2333434338 shutdown_connections 2024-09-16T01:18:52.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.907+0000 7fe8e88ba640 1 --2- 172.21.15.81:0/2333434338 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe8c406c2b0 0x7fe8c406e770 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.907+0000 7fe8e88ba640 1 --2- 172.21.15.81:0/2333434338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8e415c310 0x7fe8e409dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.907+0000 7fe8e88ba640 1 --2- 172.21.15.81:0/2333434338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8e40d0370 0x7fe8e4158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.907+0000 7fe8e88ba640 1 --2- 172.21.15.81:0/2333434338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8e40b4800 0x7fe8e41f5a60 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:52.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.907+0000 7fe8e88ba640 1 -- 172.21.15.81:0/2333434338 >> 172.21.15.81:0/2333434338 conn(0x7fe8e406bdf0 msgr2=0x7fe8e415cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:52.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.907+0000 7fe8e88ba640 1 -- 172.21.15.81:0/2333434338 shutdown_connections 2024-09-16T01:18:52.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:52.907+0000 7fe8e88ba640 1 -- 172.21.15.81:0/2333434338 wait complete. 2024-09-16T01:18:52.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_max_caps_per_client 2024-09-16T01:18:53.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.019+0000 7ff4a641e640 1 Processor -- start 2024-09-16T01:18:53.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.019+0000 7ff4a641e640 1 -- start start 2024-09-16T01:18:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.019+0000 7ff4a641e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff4a0145f20 0x7ff4a00d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.020+0000 7ff4a641e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4a00b2b30 0x7ff4a00b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.020+0000 7ff4a641e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a00afa60 con 0x7ff4a00d1480 2024-09-16T01:18:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.020+0000 7ff4a641e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a00d1a40 con 0x7ff4a00b2b30 2024-09-16T01:18:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.020+0000 7ff4a641e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a00d1d20 con 0x7ff4a0145f20 2024-09-16T01:18:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.020+0000 7ff4a49bb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4a00b2b30 0x7ff4a00b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.020+0000 7ff4a49bb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4a00b2b30 0x7ff4a00b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45834/0 (socket says 172.21.15.81:45834) 2024-09-16T01:18:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.020+0000 7ff4a49bb640 1 -- 172.21.15.81:0/2290829502 learned_addr learned my addr 172.21.15.81:0/2290829502 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.020+0000 7ff4a49bb640 1 -- 172.21.15.81:0/2290829502 >> v2:172.21.15.102:3300/0 conn(0x7ff4a0145f20 msgr2=0x7ff4a00d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.020+0000 7ff4a49bb640 1 --2- 172.21.15.81:0/2290829502 >> v2:172.21.15.102:3300/0 conn(0x7ff4a0145f20 0x7ff4a00d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.020+0000 7ff4a49bb640 1 -- 172.21.15.81:0/2290829502 >> v1:172.21.15.102:6789/0 conn(0x7ff4a00d1480 legacy=0x7ff4a00b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:53.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.020+0000 7ff4a49bb640 1 -- 172.21.15.81:0/2290829502 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a00afcd0 con 0x7ff4a00b2b30 2024-09-16T01:18:53.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.021+0000 7ff4a49bb640 1 --2- 172.21.15.81:0/2290829502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a00b2b30 0x7ff4a00b01f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0074050 tx=0x7ff49802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66ee650dbec7cad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:53.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.021+0000 7ff49f7fe640 1 -- 172.21.15.81:0/2290829502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498036070 con 0x7ff4a00b2b30 2024-09-16T01:18:53.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.021+0000 7ff49f7fe640 1 -- 172.21.15.81:0/2290829502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff498031600 con 0x7ff4a00b2b30 2024-09-16T01:18:53.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.021+0000 7ff49f7fe640 1 -- 172.21.15.81:0/2290829502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4980319d0 con 0x7ff4a00b2b30 2024-09-16T01:18:53.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.021+0000 7ff4a641e640 1 -- 172.21.15.81:0/2290829502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a00b2b30 msgr2=0x7ff4a00b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.021+0000 7ff4a641e640 1 --2- 172.21.15.81:0/2290829502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a00b2b30 0x7ff4a00b01f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0074050 tx=0x7ff49802a660 comp rx=0 tx=0).stop 2024-09-16T01:18:53.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.021+0000 7ff4a641e640 1 -- 172.21.15.81:0/2290829502 shutdown_connections 2024-09-16T01:18:53.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.021+0000 7ff4a641e640 1 --2- 172.21.15.81:0/2290829502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a00b2b30 0x7ff4a00b01f0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.021+0000 7ff4a641e640 1 --2- 172.21.15.81:0/2290829502 >> v2:172.21.15.102:3300/0 conn(0x7ff4a0145f20 0x7ff4a00d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.021+0000 7ff4a641e640 1 -- 172.21.15.81:0/2290829502 >> 172.21.15.81:0/2290829502 conn(0x7ff4a009aa30 msgr2=0x7ff4a00b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:53.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.021+0000 7ff4a641e640 1 -- 172.21.15.81:0/2290829502 shutdown_connections 2024-09-16T01:18:53.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.021+0000 7ff4a641e640 1 -- 172.21.15.81:0/2290829502 wait complete. 2024-09-16T01:18:53.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.023+0000 7ff4a641e640 1 Processor -- start 2024-09-16T01:18:53.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.023+0000 7ff4a641e640 1 -- start start 2024-09-16T01:18:53.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.023+0000 7ff4a641e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a00b2b30 0x7ff4a00cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.023+0000 7ff4a641e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a00d1480 0x7ff4a00cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.023+0000 7ff4a641e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a0145f20 0x7ff4a01f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.023+0000 7ff4a641e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a006bf60 con 0x7ff4a0145f20 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.023+0000 7ff4a641e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a006bde0 con 0x7ff4a00b2b30 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.023+0000 7ff4a641e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a00b0730 con 0x7ff4a00d1480 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.023+0000 7ff4a49bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a0145f20 0x7ff4a01f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.023+0000 7ff4a49bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a0145f20 0x7ff4a01f4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45840/0 (socket says 172.21.15.81:45840) 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.023+0000 7ff4a49bb640 1 -- 172.21.15.81:0/851572399 learned_addr learned my addr 172.21.15.81:0/851572399 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff497fff640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a00d1480 0x7ff4a00cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff49ffff640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a00b2b30 0x7ff4a00cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff4a49bb640 1 -- 172.21.15.81:0/851572399 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a00d1480 msgr2=0x7ff4a00cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff4a49bb640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a00d1480 0x7ff4a00cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff4a49bb640 1 -- 172.21.15.81:0/851572399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a00b2b30 msgr2=0x7ff4a00cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff4a49bb640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a00b2b30 0x7ff4a00cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff4a49bb640 1 -- 172.21.15.81:0/851572399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a00ca6f0 con 0x7ff4a0145f20 2024-09-16T01:18:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff4a49bb640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a0145f20 0x7ff4a01f4590 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff498034040 tx=0x7ff498004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff49d7fa640 1 -- 172.21.15.81:0/851572399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498041020 con 0x7ff4a0145f20 2024-09-16T01:18:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff49d7fa640 1 -- 172.21.15.81:0/851572399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4980077a0 con 0x7ff4a0145f20 2024-09-16T01:18:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff4a641e640 1 -- 172.21.15.81:0/851572399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a00ca9d0 con 0x7ff4a0145f20 2024-09-16T01:18:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff49d7fa640 1 -- 172.21.15.81:0/851572399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff498036040 con 0x7ff4a0145f20 2024-09-16T01:18:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.024+0000 7ff4a641e640 1 -- 172.21.15.81:0/851572399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a00cc690 con 0x7ff4a0145f20 2024-09-16T01:18:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.025+0000 7ff4a641e640 1 -- 172.21.15.81:0/851572399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a00b01f0 con 0x7ff4a0145f20 2024-09-16T01:18:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.026+0000 7ff49d7fa640 1 -- 172.21.15.81:0/851572399 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff498044020 con 0x7ff4a0145f20 2024-09-16T01:18:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.026+0000 7ff49d7fa640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff48006c2e0 0x7ff48006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.026+0000 7ff49ffff640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff48006c2e0 0x7ff48006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.026+0000 7ff49d7fa640 1 -- 172.21.15.81:0/851572399 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7ff4980ac1b0 con 0x7ff4a0145f20 2024-09-16T01:18:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.026+0000 7ff49ffff640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff48006c2e0 0x7ff48006e7a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff49000b810 tx=0x7ff490008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.030+0000 7ff49d7fa640 1 -- 172.21.15.81:0/851572399 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff49804b030 con 0x7ff4a0145f20 2024-09-16T01:18:53.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.204+0000 7ff4a641e640 1 -- 172.21.15.81:0/851572399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"} v 0) -- 0x7ff4a0070a60 con 0x7ff4a0145f20 2024-09-16T01:18:53.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.207+0000 7ff49d7fa640 1 -- 172.21.15.81:0/851572399 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"}]=0 v23) ==== 106+0+0 (secure 0 0 0) 0x7ff49807aa90 con 0x7ff4a0145f20 2024-09-16T01:18:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.209+0000 7ff4a641e640 1 -- 172.21.15.81:0/851572399 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff48006c2e0 msgr2=0x7ff48006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.209+0000 7ff4a641e640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff48006c2e0 0x7ff48006e7a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff49000b810 tx=0x7ff490008040 comp rx=0 tx=0).stop 2024-09-16T01:18:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.209+0000 7ff4a641e640 1 -- 172.21.15.81:0/851572399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a0145f20 msgr2=0x7ff4a01f4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.209+0000 7ff4a641e640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a0145f20 0x7ff4a01f4590 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff498034040 tx=0x7ff498004a40 comp rx=0 tx=0).stop 2024-09-16T01:18:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.209+0000 7ff4a641e640 1 -- 172.21.15.81:0/851572399 shutdown_connections 2024-09-16T01:18:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.209+0000 7ff4a641e640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff48006c2e0 0x7ff48006e7a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.209+0000 7ff4a641e640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4a0145f20 0x7ff4a01f4590 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.209+0000 7ff4a641e640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a00d1480 0x7ff4a00cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.209+0000 7ff4a641e640 1 --2- 172.21.15.81:0/851572399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a00b2b30 0x7ff4a00cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.209+0000 7ff4a641e640 1 -- 172.21.15.81:0/851572399 >> 172.21.15.81:0/851572399 conn(0x7ff4a009aa30 msgr2=0x7ff4a0143510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.210+0000 7ff4a641e640 1 -- 172.21.15.81:0/851572399 shutdown_connections 2024-09-16T01:18:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.210+0000 7ff4a641e640 1 -- 172.21.15.81:0/851572399 wait complete. 2024-09-16T01:18:53.221 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps' 2024-09-16T01:18:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.318+0000 7f643fcd0640 1 Processor -- start 2024-09-16T01:18:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.318+0000 7f643fcd0640 1 -- start start 2024-09-16T01:18:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.319+0000 7f643fcd0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6438162060 0x7f64380b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.319+0000 7f643fcd0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f643806d9f0 con 0x7f64380b64b0 2024-09-16T01:18:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.319+0000 7f643fcd0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f643806dcd0 con 0x7f6438161c80 2024-09-16T01:18:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.319+0000 7f643fcd0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f643806dfb0 con 0x7f6438162060 2024-09-16T01:18:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.319+0000 7f643e26d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f64380b64b0 0x7f64380cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48908/0 (socket says 172.21.15.81:48908) 2024-09-16T01:18:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.319+0000 7f643e26d640 1 -- 172.21.15.81:0/400318054 learned_addr learned my addr 172.21.15.81:0/400318054 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.319+0000 7f643d26b640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6438162060 0x7f64380b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.319+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969504227 0 0) 0x7f643806d9f0 con 0x7f64380b64b0 2024-09-16T01:18:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6424003520 con 0x7f64380b64b0 2024-09-16T01:18:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102152924 0 0) 0x7f643806dcd0 con 0x7f6438161c80 2024-09-16T01:18:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f643806d9f0 con 0x7f6438161c80 2024-09-16T01:18:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1909138100 0 0) 0x7f6424003520 con 0x7f64380b64b0 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6438162060 msgr2=0x7f64380b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6438162060 0x7f64380b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 >> v1:172.21.15.102:6789/0 conn(0x7f6438161c80 legacy=0x7f643806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64380d2890 con 0x7f64380b64b0 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f64300019f0 con 0x7f64380b64b0 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 >> v1:172.21.15.81:6789/0 conn(0x7f64380b64b0 legacy=0x7f64380cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6424003b70 0x7f6424003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424004800 0x7f6424004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64240051c0 0x7f642400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f643806dfb0 con 0x7f6424004800 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f642400bfb0 con 0x7f64240051c0 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f642400c1b0 con 0x7f6424003b70 2024-09-16T01:18:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643d26b640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6438162060 0x7f64380b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643d26b640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424004800 0x7f6424004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643da6c640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6424003b70 0x7f6424003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643e26d640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64240051c0 0x7f642400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643d26b640 1 -- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6424003b70 msgr2=0x7f6424003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643d26b640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6424003b70 0x7f6424003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643d26b640 1 -- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64240051c0 msgr2=0x7f642400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643d26b640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64240051c0 0x7f642400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643d26b640 1 -- 172.21.15.81:0/400318054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6424003520 con 0x7f6424004800 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.320+0000 7f643e26d640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f64240051c0 0x7f642400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.321+0000 7f643d26b640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424004800 0x7f6424004c80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f643808e1d0 tx=0x7f6424005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4673b7db1489852b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.321+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428036070 con 0x7f6424004800 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.321+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6428004030 con 0x7f6424004800 2024-09-16T01:18:53.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.321+0000 7f643ca6a640 1 -- 172.21.15.81:0/400318054 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280097f0 con 0x7f6424004800 2024-09-16T01:18:53.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.322+0000 7f643fcd0640 1 -- 172.21.15.81:0/400318054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424004800 msgr2=0x7f6424004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.322+0000 7f643fcd0640 1 --2- 172.21.15.81:0/400318054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424004800 0x7f6424004c80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f643808e1d0 tx=0x7f6424005830 comp rx=0 tx=0).stop 2024-09-16T01:18:53.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.322+0000 7f643e26d640 1 -- 172.21.15.81:0/400318054 reap_dead start 2024-09-16T01:18:53.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.322+0000 7f643fcd0640 1 -- 172.21.15.81:0/400318054 shutdown_connections 2024-09-16T01:18:53.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.322+0000 7f643fcd0640 1 -- 172.21.15.81:0/400318054 >> 172.21.15.81:0/400318054 conn(0x7f64380d44f0 msgr2=0x7f64380d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:53.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.322+0000 7f643fcd0640 1 -- 172.21.15.81:0/400318054 shutdown_connections 2024-09-16T01:18:53.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.322+0000 7f643fcd0640 1 -- 172.21.15.81:0/400318054 wait complete. 2024-09-16T01:18:53.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.323+0000 7f643fcd0640 1 Processor -- start 2024-09-16T01:18:53.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.323+0000 7f643fcd0640 1 -- start start 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643fcd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424004800 0x7f64380ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643fcd0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6438153fe0 0x7f64380c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643fcd0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64380ca500 0x7f64380c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643fcd0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f64380b6300 con 0x7f6424004800 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643fcd0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f64380b6180 con 0x7f6438153fe0 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643fcd0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f64380ca980 con 0x7f64380ca500 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643da6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424004800 0x7f64380ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643da6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424004800 0x7f64380ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45864/0 (socket says 172.21.15.81:45864) 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643da6c640 1 -- 172.21.15.81:0/2899724680 learned_addr learned my addr 172.21.15.81:0/2899724680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643da6c640 1 -- 172.21.15.81:0/2899724680 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64380ca500 msgr2=0x7f64380c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643da6c640 1 --2- 172.21.15.81:0/2899724680 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64380ca500 0x7f64380c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643da6c640 1 -- 172.21.15.81:0/2899724680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6438153fe0 msgr2=0x7f64380c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643da6c640 1 --2- 172.21.15.81:0/2899724680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6438153fe0 0x7f64380c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643da6c640 1 -- 172.21.15.81:0/2899724680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64380b9c70 con 0x7f6424004800 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643da6c640 1 --2- 172.21.15.81:0/2899724680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424004800 0x7f64380ce030 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f643400f7a0 tx=0x7f643400fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f642e7fc640 1 -- 172.21.15.81:0/2899724680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643400fe50 con 0x7f6424004800 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f642e7fc640 1 -- 172.21.15.81:0/2899724680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6434018070 con 0x7f6424004800 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643fcd0640 1 -- 172.21.15.81:0/2899724680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64380b9f50 con 0x7f6424004800 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f642e7fc640 1 -- 172.21.15.81:0/2899724680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643400d730 con 0x7f6424004800 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.324+0000 7f643fcd0640 1 -- 172.21.15.81:0/2899724680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64380cd830 con 0x7f6424004800 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.325+0000 7f643fcd0640 1 -- 172.21.15.81:0/2899724680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64380b6960 con 0x7f6424004800 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.326+0000 7f642e7fc640 1 -- 172.21.15.81:0/2899724680 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f643400d8d0 con 0x7f6424004800 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.326+0000 7f642e7fc640 1 --2- 172.21.15.81:0/2899724680 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f641c06c2b0 0x7f641c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.327+0000 7f643d26b640 1 --2- 172.21.15.81:0/2899724680 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f641c06c2b0 0x7f641c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.327+0000 7f642e7fc640 1 -- 172.21.15.81:0/2899724680 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f643408b280 con 0x7f6424004800 2024-09-16T01:18:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.327+0000 7f643d26b640 1 --2- 172.21.15.81:0/2899724680 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f641c06c2b0 0x7f641c06e770 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6428033000 tx=0x7f642802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:53.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.331+0000 7f642e7fc640 1 -- 172.21.15.81:0/2899724680 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6434059b60 con 0x7f6424004800 2024-09-16T01:18:53.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.564+0000 7f643fcd0640 1 -- 172.21.15.81:0/2899724680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]} v 0) -- 0x7f64380ba470 con 0x7f6424004800 2024-09-16T01:18:53.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.604+0000 7f642e7fc640 1 -- 172.21.15.81:0/2899724680 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]}]=0 v185) ==== 148+0+0 (secure 0 0 0) 0x7f6434059460 con 0x7f6424004800 2024-09-16T01:18:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.606+0000 7f643fcd0640 1 -- 172.21.15.81:0/2899724680 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f641c06c2b0 msgr2=0x7f641c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.606+0000 7f643fcd0640 1 --2- 172.21.15.81:0/2899724680 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f641c06c2b0 0x7f641c06e770 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6428033000 tx=0x7f642802e000 comp rx=0 tx=0).stop 2024-09-16T01:18:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.606+0000 7f643fcd0640 1 -- 172.21.15.81:0/2899724680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424004800 msgr2=0x7f64380ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.606+0000 7f643fcd0640 1 --2- 172.21.15.81:0/2899724680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424004800 0x7f64380ce030 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f643400f7a0 tx=0x7f643400fc60 comp rx=0 tx=0).stop 2024-09-16T01:18:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.606+0000 7f643fcd0640 1 -- 172.21.15.81:0/2899724680 shutdown_connections 2024-09-16T01:18:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.606+0000 7f643fcd0640 1 --2- 172.21.15.81:0/2899724680 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f641c06c2b0 0x7f641c06e770 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.606+0000 7f643fcd0640 1 --2- 172.21.15.81:0/2899724680 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f64380ca500 0x7f64380c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.606+0000 7f643fcd0640 1 --2- 172.21.15.81:0/2899724680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6438153fe0 0x7f64380c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.606+0000 7f643fcd0640 1 --2- 172.21.15.81:0/2899724680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6424004800 0x7f64380ce030 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.606+0000 7f643fcd0640 1 -- 172.21.15.81:0/2899724680 >> 172.21.15.81:0/2899724680 conn(0x7f64380d44f0 msgr2=0x7f64380b4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.606+0000 7f643fcd0640 1 -- 172.21.15.81:0/2899724680 shutdown_connections 2024-09-16T01:18:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.606+0000 7f643fcd0640 1 -- 172.21.15.81:0/2899724680 wait complete. 2024-09-16T01:18:53.617 INFO:tasks.cephfs_test_runner:That the MDS will not let a client sit above mds_max_caps_per_client caps. ... ok 2024-09-16T01:18:53.618 INFO:tasks.cephfs_test_runner:Starting test: test_client_min_caps_working_set (tasks.cephfs.test_client_limits.TestClientLimits) When a client has inodes pinned in its cache (open files), that the MDS 2024-09-16T01:18:53.618 INFO:tasks.cephfs_test_runner:test_client_min_caps_working_set (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-16T01:18:53.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:18:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.715+0000 7f69b96f1640 1 Processor -- start 2024-09-16T01:18:53.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.715+0000 7f69b96f1640 1 -- start start 2024-09-16T01:18:53.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.716+0000 7f69b96f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69b40af560 0x7f69b41691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.716+0000 7f69b96f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b406cb30 con 0x7f69b4147360 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.716+0000 7f69b96f1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b406bfb0 con 0x7f69b40d04a0 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.716+0000 7f69b96f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f69b406c290 con 0x7f69b40af560 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.716+0000 7f69b2ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f69b4147360 0x7f69b4070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48916/0 (socket says 172.21.15.81:48916) 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.716+0000 7f69b2ffd640 1 -- 172.21.15.81:0/809998169 learned_addr learned my addr 172.21.15.81:0/809998169 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.716+0000 7f69b37fe640 1 --2- 172.21.15.81:0/809998169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69b40af560 0x7f69b41691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.716+0000 7f69b27fc640 1 -- 172.21.15.81:0/809998169 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077027666 0 0) 0x7f69b406cb30 con 0x7f69b4147360 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.716+0000 7f69b27fc640 1 -- 172.21.15.81:0/809998169 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69a0003520 con 0x7f69b4147360 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.717+0000 7f69b27fc640 1 -- 172.21.15.81:0/809998169 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380023496 0 0) 0x7f69b406bfb0 con 0x7f69b40d04a0 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.717+0000 7f69b27fc640 1 -- 172.21.15.81:0/809998169 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69b406cb30 con 0x7f69b40d04a0 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.717+0000 7f69b37fe640 1 -- 172.21.15.81:0/809998169 >> v1:172.21.15.102:6789/0 conn(0x7f69b40d04a0 legacy=0x7f69b40d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.717+0000 7f69b27fc640 1 -- 172.21.15.81:0/809998169 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3705980308 0 0) 0x7f69a0003520 con 0x7f69b4147360 2024-09-16T01:18:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.717+0000 7f69b37fe640 1 -- 172.21.15.81:0/809998169 >> v1:172.21.15.81:6789/0 conn(0x7f69b4147360 legacy=0x7f69b4070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.717+0000 7f69b37fe640 1 -- 172.21.15.81:0/809998169 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b406c570 con 0x7f69b40af560 2024-09-16T01:18:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.717+0000 7f69b37fe640 1 --2- 172.21.15.81:0/809998169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69b40af560 0x7f69b41691e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69ac009dc0 tx=0x7f69ac02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6718ab6fecdd905f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.718+0000 7f69b27fc640 1 -- 172.21.15.81:0/809998169 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a4001670 con 0x7f69b40af560 2024-09-16T01:18:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.718+0000 7f69b27fc640 1 -- 172.21.15.81:0/809998169 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ac007540 con 0x7f69b40af560 2024-09-16T01:18:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.718+0000 7f69b27fc640 1 -- 172.21.15.81:0/809998169 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac007910 con 0x7f69b40af560 2024-09-16T01:18:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.718+0000 7f69b96f1640 1 -- 172.21.15.81:0/809998169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69b40af560 msgr2=0x7f69b41691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.718+0000 7f69b96f1640 1 --2- 172.21.15.81:0/809998169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69b40af560 0x7f69b41691e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f69ac009dc0 tx=0x7f69ac02a5d0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.718+0000 7f69b96f1640 1 -- 172.21.15.81:0/809998169 shutdown_connections 2024-09-16T01:18:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.718+0000 7f69b96f1640 1 --2- 172.21.15.81:0/809998169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69b40af560 0x7f69b41691e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.718+0000 7f69b96f1640 1 -- 172.21.15.81:0/809998169 >> 172.21.15.81:0/809998169 conn(0x7f69b40b2f40 msgr2=0x7f69b40b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.718+0000 7f69b96f1640 1 -- 172.21.15.81:0/809998169 shutdown_connections 2024-09-16T01:18:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.718+0000 7f69b96f1640 1 -- 172.21.15.81:0/809998169 wait complete. 2024-09-16T01:18:53.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.719+0000 7f69b96f1640 1 Processor -- start 2024-09-16T01:18:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.720+0000 7f69b96f1640 1 -- start start 2024-09-16T01:18:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.720+0000 7f69b96f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69b40af560 0x7f69b40ce130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.720+0000 7f69b96f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69b40d04a0 0x7f69b4145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.720+0000 7f69b96f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69b4147360 0x7f69b409d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.720+0000 7f69b96f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69b406bc10 con 0x7f69b40d04a0 2024-09-16T01:18:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.720+0000 7f69b96f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4070fa0 con 0x7f69b40af560 2024-09-16T01:18:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.720+0000 7f69b96f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f69b406bd90 con 0x7f69b4147360 2024-09-16T01:18:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.720+0000 7f69aa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69b40d04a0 0x7f69b4145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.720+0000 7f69aa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69b40d04a0 0x7f69b4145140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45878/0 (socket says 172.21.15.81:45878) 2024-09-16T01:18:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.720+0000 7f69aa7fc640 1 -- 172.21.15.81:0/1999307371 learned_addr learned my addr 172.21.15.81:0/1999307371 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69b2ffd640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69b40af560 0x7f69b40ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69b37fe640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69b4147360 0x7f69b409d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69aa7fc640 1 -- 172.21.15.81:0/1999307371 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69b4147360 msgr2=0x7f69b409d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69aa7fc640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69b4147360 0x7f69b409d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69aa7fc640 1 -- 172.21.15.81:0/1999307371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69b40af560 msgr2=0x7f69b40ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69aa7fc640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69b40af560 0x7f69b40ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69aa7fc640 1 -- 172.21.15.81:0/1999307371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b409b930 con 0x7f69b40d04a0 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69b2ffd640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69b40af560 0x7f69b40ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69aa7fc640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69b40d04a0 0x7f69b4145140 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f699c00c490 tx=0x7f699c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69abfff640 1 -- 172.21.15.81:0/1999307371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c0052d0 con 0x7f69b40d04a0 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69abfff640 1 -- 172.21.15.81:0/1999307371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699c005470 con 0x7f69b40d04a0 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69abfff640 1 -- 172.21.15.81:0/1999307371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c012850 con 0x7f69b40d04a0 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69b96f1640 1 -- 172.21.15.81:0/1999307371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b409bc10 con 0x7f69b40d04a0 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.721+0000 7f69b96f1640 1 -- 172.21.15.81:0/1999307371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b409c1d0 con 0x7f69b40d04a0 2024-09-16T01:18:53.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.722+0000 7f69b96f1640 1 -- 172.21.15.81:0/1999307371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b40d0910 con 0x7f69b40d04a0 2024-09-16T01:18:53.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.722+0000 7f69abfff640 1 -- 172.21.15.81:0/1999307371 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f699c0129f0 con 0x7f69b40d04a0 2024-09-16T01:18:53.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.723+0000 7f69abfff640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f699406c2b0 0x7f699406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:53.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.723+0000 7f69abfff640 1 -- 172.21.15.81:0/1999307371 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f699c08afa0 con 0x7f69b40d04a0 2024-09-16T01:18:53.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.723+0000 7f69b2ffd640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f699406c2b0 0x7f699406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:53.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.723+0000 7f69b2ffd640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f699406c2b0 0x7f699406e770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f69a40011e0 tx=0x7f69a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:53.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.727+0000 7f69abfff640 1 -- 172.21.15.81:0/1999307371 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f699c059870 con 0x7f69b40d04a0 2024-09-16T01:18:53.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.891+0000 7f69b96f1640 1 -- 172.21.15.81:0/1999307371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69b409b5e0 con 0x7f69b40d04a0 2024-09-16T01:18:53.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.892+0000 7f69abfff640 1 -- 172.21.15.81:0/1999307371 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+13308 (secure 0 0 0) 0x7f699c059170 con 0x7f69b40d04a0 2024-09-16T01:18:53.893 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:53.894 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":78,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:52.601254+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:6834/3012591174":"2024-09-17T01:18:49.596729+0000","172.21.15.102:6832/3012591174":"2024-09-17T01:18:49.596729+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:18:53.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.894+0000 7f69b96f1640 1 -- 172.21.15.81:0/1999307371 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f699406c2b0 msgr2=0x7f699406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.894+0000 7f69b96f1640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f699406c2b0 0x7f699406e770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f69a40011e0 tx=0x7f69a4009040 comp rx=0 tx=0).stop 2024-09-16T01:18:53.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.894+0000 7f69b96f1640 1 -- 172.21.15.81:0/1999307371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69b40d04a0 msgr2=0x7f69b4145140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:53.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.894+0000 7f69b96f1640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69b40d04a0 0x7f69b4145140 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f699c00c490 tx=0x7f699c00c950 comp rx=0 tx=0).stop 2024-09-16T01:18:53.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.894+0000 7f69b96f1640 1 -- 172.21.15.81:0/1999307371 shutdown_connections 2024-09-16T01:18:53.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.894+0000 7f69b96f1640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f699406c2b0 0x7f699406e770 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.894+0000 7f69b96f1640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f69b4147360 0x7f69b409d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.894+0000 7f69b96f1640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69b40d04a0 0x7f69b4145140 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.894+0000 7f69b96f1640 1 --2- 172.21.15.81:0/1999307371 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f69b40af560 0x7f69b40ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:53.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.894+0000 7f69b96f1640 1 -- 172.21.15.81:0/1999307371 >> 172.21.15.81:0/1999307371 conn(0x7f69b40b2f40 msgr2=0x7f69b406f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:53.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.894+0000 7f69b96f1640 1 -- 172.21.15.81:0/1999307371 shutdown_connections 2024-09-16T01:18:53.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:53.894+0000 7f69b96f1640 1 -- 172.21.15.81:0/1999307371 wait complete. 2024-09-16T01:18:53.906 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:15:28.088452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:18:53.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:18:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.005+0000 7f1747aa6640 1 Processor -- start 2024-09-16T01:18:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.005+0000 7f1747aa6640 1 -- start start 2024-09-16T01:18:54.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.006+0000 7f1747aa6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1740159ce0 0x7f174015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.006+0000 7f1747aa6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f174015ecf0 0x7f17400b6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.006+0000 7f1747aa6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f174015d730 con 0x7f17400b5f10 2024-09-16T01:18:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.006+0000 7f1747aa6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f17400b6880 con 0x7f1740159ce0 2024-09-16T01:18:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.006+0000 7f1747aa6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f17400700b0 con 0x7f174015ecf0 2024-09-16T01:18:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.006+0000 7f1745041640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f17400b5f10 0x7f174006e6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48932/0 (socket says 172.21.15.81:48932) 2024-09-16T01:18:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.006+0000 7f1745041640 1 -- 172.21.15.81:0/363211908 learned_addr learned my addr 172.21.15.81:0/363211908 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.006+0000 7f1745842640 1 --2- 172.21.15.81:0/363211908 >> v2:172.21.15.102:3300/0 conn(0x7f1740159ce0 0x7f174015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.006+0000 7f1746043640 1 --2- 172.21.15.81:0/363211908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f174015ecf0 0x7f17400b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.006+0000 7f1744840640 1 -- 172.21.15.81:0/363211908 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1495803383 0 0) 0x7f174015d730 con 0x7f17400b5f10 2024-09-16T01:18:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.006+0000 7f1744840640 1 -- 172.21.15.81:0/363211908 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f172c003520 con 0x7f17400b5f10 2024-09-16T01:18:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.007+0000 7f1744840640 1 -- 172.21.15.81:0/363211908 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3432926177 0 0) 0x7f172c003520 con 0x7f17400b5f10 2024-09-16T01:18:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.007+0000 7f1745842640 1 -- 172.21.15.81:0/363211908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f174015ecf0 msgr2=0x7f17400b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.007+0000 7f1745842640 1 --2- 172.21.15.81:0/363211908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f174015ecf0 0x7f17400b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.007+0000 7f1745842640 1 -- 172.21.15.81:0/363211908 >> v1:172.21.15.81:6789/0 conn(0x7f17400b5f10 legacy=0x7f174006e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.007+0000 7f1745842640 1 -- 172.21.15.81:0/363211908 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17401601b0 con 0x7f1740159ce0 2024-09-16T01:18:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.007+0000 7f1746043640 1 --2- 172.21.15.81:0/363211908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f174015ecf0 0x7f17400b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:18:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.007+0000 7f1745842640 1 --2- 172.21.15.81:0/363211908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1740159ce0 0x7f174015d1f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f173c0097d0 tx=0x7f173c02a030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e65a0148a4b036e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.008+0000 7f1744840640 1 -- 172.21.15.81:0/363211908 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c037070 con 0x7f1740159ce0 2024-09-16T01:18:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.008+0000 7f1744840640 1 -- 172.21.15.81:0/363211908 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f173c02aac0 con 0x7f1740159ce0 2024-09-16T01:18:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.008+0000 7f1744840640 1 -- 172.21.15.81:0/363211908 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730001670 con 0x7f1740159ce0 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.008+0000 7f1747aa6640 1 -- 172.21.15.81:0/363211908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1740159ce0 msgr2=0x7f174015d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.008+0000 7f1747aa6640 1 --2- 172.21.15.81:0/363211908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1740159ce0 0x7f174015d1f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f173c0097d0 tx=0x7f173c02a030 comp rx=0 tx=0).stop 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.008+0000 7f1747aa6640 1 -- 172.21.15.81:0/363211908 shutdown_connections 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.008+0000 7f1747aa6640 1 --2- 172.21.15.81:0/363211908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f174015ecf0 0x7f17400b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.008+0000 7f1747aa6640 1 --2- 172.21.15.81:0/363211908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1740159ce0 0x7f174015d1f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.008+0000 7f1747aa6640 1 -- 172.21.15.81:0/363211908 >> 172.21.15.81:0/363211908 conn(0x7f1740073590 msgr2=0x7f174006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.008+0000 7f1747aa6640 1 -- 172.21.15.81:0/363211908 shutdown_connections 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.008+0000 7f1747aa6640 1 -- 172.21.15.81:0/363211908 wait complete. 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.009+0000 7f1747aa6640 1 Processor -- start 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.009+0000 7f1747aa6640 1 -- start start 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1747aa6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17400b5f10 0x7f1740154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1747aa6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1740159ce0 0x7f174015c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1747aa6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f174015ecf0 0x7f174015cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1747aa6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1740160a50 con 0x7f1740159ce0 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1747aa6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1740160770 con 0x7f174015ecf0 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1747aa6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f174015a0c0 con 0x7f17400b5f10 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1745041640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1740159ce0 0x7f174015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1745041640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1740159ce0 0x7f174015c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45894/0 (socket says 172.21.15.81:45894) 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1745041640 1 -- 172.21.15.81:0/2486284886 learned_addr learned my addr 172.21.15.81:0/2486284886 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1745842640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17400b5f10 0x7f1740154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1746043640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f174015ecf0 0x7f174015cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1745041640 1 -- 172.21.15.81:0/2486284886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17400b5f10 msgr2=0x7f1740154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1745041640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17400b5f10 0x7f1740154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.010+0000 7f1745041640 1 -- 172.21.15.81:0/2486284886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f174015ecf0 msgr2=0x7f174015cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.011+0000 7f1745041640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f174015ecf0 0x7f174015cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.011+0000 7f1745041640 1 -- 172.21.15.81:0/2486284886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1740154cb0 con 0x7f1740159ce0 2024-09-16T01:18:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.011+0000 7f1745041640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1740159ce0 0x7f174015c800 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f173000c520 tx=0x7f173000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.011+0000 7f17367fc640 1 -- 172.21.15.81:0/2486284886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730017070 con 0x7f1740159ce0 2024-09-16T01:18:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.011+0000 7f17367fc640 1 -- 172.21.15.81:0/2486284886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1730005ce0 con 0x7f1740159ce0 2024-09-16T01:18:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.011+0000 7f17367fc640 1 -- 172.21.15.81:0/2486284886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730007270 con 0x7f1740159ce0 2024-09-16T01:18:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.011+0000 7f1747aa6640 1 -- 172.21.15.81:0/2486284886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17401584e0 con 0x7f1740159ce0 2024-09-16T01:18:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.011+0000 7f1747aa6640 1 -- 172.21.15.81:0/2486284886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1740158aa0 con 0x7f1740159ce0 2024-09-16T01:18:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.012+0000 7f1747aa6640 1 -- 172.21.15.81:0/2486284886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174015fda0 con 0x7f1740159ce0 2024-09-16T01:18:54.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.012+0000 7f17367fc640 1 -- 172.21.15.81:0/2486284886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f173001a070 con 0x7f1740159ce0 2024-09-16T01:18:54.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.013+0000 7f17367fc640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f172406c2b0 0x7f172406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.013+0000 7f17367fc640 1 -- 172.21.15.81:0/2486284886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f173008a4e0 con 0x7f1740159ce0 2024-09-16T01:18:54.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.013+0000 7f1745842640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f172406c2b0 0x7f172406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.013+0000 7f1745842640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f172406c2b0 0x7f172406e770 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f173c034000 tx=0x7f173c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:54.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.017+0000 7f17367fc640 1 -- 172.21.15.81:0/2486284886 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1730058770 con 0x7f1740159ce0 2024-09-16T01:18:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.186+0000 7f1747aa6640 1 -- 172.21.15.81:0/2486284886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1740067d40 con 0x7f1740159ce0 2024-09-16T01:18:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.186+0000 7f17367fc640 1 -- 172.21.15.81:0/2486284886 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f173005ca70 con 0x7f1740159ce0 2024-09-16T01:18:54.188 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-16T01:18:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.188+0000 7f1747aa6640 1 -- 172.21.15.81:0/2486284886 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f172406c2b0 msgr2=0x7f172406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.188+0000 7f1747aa6640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f172406c2b0 0x7f172406e770 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f173c034000 tx=0x7f173c02e000 comp rx=0 tx=0).stop 2024-09-16T01:18:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.188+0000 7f1747aa6640 1 -- 172.21.15.81:0/2486284886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1740159ce0 msgr2=0x7f174015c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.188+0000 7f1747aa6640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1740159ce0 0x7f174015c800 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f173000c520 tx=0x7f173000c920 comp rx=0 tx=0).stop 2024-09-16T01:18:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.188+0000 7f1747aa6640 1 -- 172.21.15.81:0/2486284886 shutdown_connections 2024-09-16T01:18:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.188+0000 7f1747aa6640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f172406c2b0 0x7f172406e770 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.188+0000 7f1747aa6640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f174015ecf0 0x7f174015cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.188+0000 7f1747aa6640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1740159ce0 0x7f174015c800 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.188+0000 7f1747aa6640 1 --2- 172.21.15.81:0/2486284886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f17400b5f10 0x7f1740154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.188+0000 7f1747aa6640 1 -- 172.21.15.81:0/2486284886 >> 172.21.15.81:0/2486284886 conn(0x7f1740073590 msgr2=0x7f17400b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.188+0000 7f1747aa6640 1 -- 172.21.15.81:0/2486284886 shutdown_connections 2024-09-16T01:18:54.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.188+0000 7f1747aa6640 1 -- 172.21.15.81:0/2486284886 wait complete. 2024-09-16T01:18:54.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set' 2024-09-16T01:18:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.299+0000 7f2a456dd640 1 Processor -- start 2024-09-16T01:18:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.299+0000 7f2a456dd640 1 -- start start 2024-09-16T01:18:54.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.300+0000 7f2a456dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a4015b340 0x7f2a4009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.300+0000 7f2a456dd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a400b43f0 0x7f2a400b4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.300+0000 7f2a456dd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2a400b4e80 0x7f2a4015de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.300+0000 7f2a456dd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2a400b5bd0 con 0x7f2a400b43f0 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.300+0000 7f2a456dd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2a400b3830 con 0x7f2a400b4e80 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.300+0000 7f2a456dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2a400b5610 con 0x7f2a4015b340 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.300+0000 7f2a3e7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a400b43f0 0x7f2a400b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.300+0000 7f2a3e7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a400b43f0 0x7f2a400b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45906/0 (socket says 172.21.15.81:45906) 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.300+0000 7f2a3e7fc640 1 -- 172.21.15.81:0/460644074 learned_addr learned my addr 172.21.15.81:0/460644074 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.301+0000 7f2a3effd640 1 --2- 172.21.15.81:0/460644074 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a4015b340 0x7f2a4009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.301+0000 7f2a3f7fe640 1 --2- 172.21.15.81:0/460644074 >> v2:172.21.15.102:3300/0 conn(0x7f2a400b4e80 0x7f2a4015de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.301+0000 7f2a3e7fc640 1 -- 172.21.15.81:0/460644074 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a4015b340 msgr2=0x7f2a4009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.301+0000 7f2a3e7fc640 1 --2- 172.21.15.81:0/460644074 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a4015b340 0x7f2a4009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.301+0000 7f2a3e7fc640 1 -- 172.21.15.81:0/460644074 >> v2:172.21.15.102:3300/0 conn(0x7f2a400b4e80 msgr2=0x7f2a4015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.301+0000 7f2a3e7fc640 1 --2- 172.21.15.81:0/460644074 >> v2:172.21.15.102:3300/0 conn(0x7f2a400b4e80 0x7f2a4015de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.301+0000 7f2a3e7fc640 1 -- 172.21.15.81:0/460644074 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a400b58f0 con 0x7f2a400b43f0 2024-09-16T01:18:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.301+0000 7f2a3f7fe640 1 --2- 172.21.15.81:0/460644074 >> v2:172.21.15.102:3300/0 conn(0x7f2a400b4e80 0x7f2a4015de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.301+0000 7f2a3e7fc640 1 --2- 172.21.15.81:0/460644074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b43f0 0x7f2a400b4940 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2a400d1190 tx=0x7f2a3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18a940a3bd2edd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.302+0000 7f2a3dffb640 1 -- 172.21.15.81:0/460644074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34037070 con 0x7f2a400b43f0 2024-09-16T01:18:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.302+0000 7f2a3dffb640 1 -- 172.21.15.81:0/460644074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a34032440 con 0x7f2a400b43f0 2024-09-16T01:18:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.302+0000 7f2a3dffb640 1 -- 172.21.15.81:0/460644074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34032810 con 0x7f2a400b43f0 2024-09-16T01:18:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.302+0000 7f2a456dd640 1 -- 172.21.15.81:0/460644074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b43f0 msgr2=0x7f2a400b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.302+0000 7f2a456dd640 1 --2- 172.21.15.81:0/460644074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b43f0 0x7f2a400b4940 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f2a400d1190 tx=0x7f2a3402a270 comp rx=0 tx=0).stop 2024-09-16T01:18:54.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.302+0000 7f2a456dd640 1 -- 172.21.15.81:0/460644074 shutdown_connections 2024-09-16T01:18:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.302+0000 7f2a456dd640 1 --2- 172.21.15.81:0/460644074 >> v2:172.21.15.102:3300/0 conn(0x7f2a400b4e80 0x7f2a4015de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.302+0000 7f2a456dd640 1 --2- 172.21.15.81:0/460644074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b43f0 0x7f2a400b4940 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.302+0000 7f2a456dd640 1 --2- 172.21.15.81:0/460644074 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a4015b340 0x7f2a4009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.302+0000 7f2a456dd640 1 -- 172.21.15.81:0/460644074 >> 172.21.15.81:0/460644074 conn(0x7f2a40073490 msgr2=0x7f2a400b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.302+0000 7f2a456dd640 1 -- 172.21.15.81:0/460644074 shutdown_connections 2024-09-16T01:18:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.302+0000 7f2a456dd640 1 -- 172.21.15.81:0/460644074 wait complete. 2024-09-16T01:18:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a456dd640 1 Processor -- start 2024-09-16T01:18:54.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a456dd640 1 -- start start 2024-09-16T01:18:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a456dd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a400b43f0 0x7f2a40148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a456dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b4e80 0x7f2a4015a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a456dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a4015b340 0x7f2a4015a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a456dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2a400b5330 con 0x7f2a400b4e80 2024-09-16T01:18:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a456dd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4015d8f0 con 0x7f2a400b43f0 2024-09-16T01:18:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a456dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2a400cdb30 con 0x7f2a4015b340 2024-09-16T01:18:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a3e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b4e80 0x7f2a4015a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a3e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b4e80 0x7f2a4015a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45918/0 (socket says 172.21.15.81:45918) 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a3e7fc640 1 -- 172.21.15.81:0/898444447 learned_addr learned my addr 172.21.15.81:0/898444447 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a3f7fe640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a4015b340 0x7f2a4015a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.304+0000 7f2a3effd640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a400b43f0 0x7f2a40148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.305+0000 7f2a3e7fc640 1 -- 172.21.15.81:0/898444447 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a4015b340 msgr2=0x7f2a4015a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.305+0000 7f2a3e7fc640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a4015b340 0x7f2a4015a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.305+0000 7f2a3e7fc640 1 -- 172.21.15.81:0/898444447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a400b43f0 msgr2=0x7f2a40148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.305+0000 7f2a3e7fc640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a400b43f0 0x7f2a40148ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.305+0000 7f2a3e7fc640 1 -- 172.21.15.81:0/898444447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a401f01b0 con 0x7f2a400b4e80 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.305+0000 7f2a3e7fc640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b4e80 0x7f2a4015a0f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2a34000c00 tx=0x7f2a340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.305+0000 7f2a277fe640 1 -- 172.21.15.81:0/898444447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34037040 con 0x7f2a400b4e80 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.305+0000 7f2a277fe640 1 -- 172.21.15.81:0/898444447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a34042070 con 0x7f2a400b4e80 2024-09-16T01:18:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.305+0000 7f2a277fe640 1 -- 172.21.15.81:0/898444447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34030880 con 0x7f2a400b4e80 2024-09-16T01:18:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.305+0000 7f2a456dd640 1 -- 172.21.15.81:0/898444447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a401f0490 con 0x7f2a400b4e80 2024-09-16T01:18:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.305+0000 7f2a456dd640 1 -- 172.21.15.81:0/898444447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a401f0a50 con 0x7f2a400b4e80 2024-09-16T01:18:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.306+0000 7f2a456dd640 1 -- 172.21.15.81:0/898444447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a400b4940 con 0x7f2a400b4e80 2024-09-16T01:18:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.306+0000 7f2a277fe640 1 -- 172.21.15.81:0/898444447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2a34030a20 con 0x7f2a400b4e80 2024-09-16T01:18:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.307+0000 7f2a277fe640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2a2c06c2e0 0x7f2a2c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.307+0000 7f2a277fe640 1 -- 172.21.15.81:0/898444447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f2a340ab8c0 con 0x7f2a400b4e80 2024-09-16T01:18:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.307+0000 7f2a3effd640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2a2c06c2e0 0x7f2a2c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.307+0000 7f2a3effd640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2a2c06c2e0 0x7f2a2c06e7a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2a40156e70 tx=0x7f2a3000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.311+0000 7f2a277fe640 1 -- 172.21.15.81:0/898444447 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a34079be0 con 0x7f2a400b4e80 2024-09-16T01:18:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.552+0000 7f2a456dd640 1 -- 172.21.15.81:0/898444447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]} v 0) -- 0x7f2a40070720 con 0x7f2a400b4e80 2024-09-16T01:18:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.608+0000 7f2a277fe640 1 -- 172.21.15.81:0/898444447 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]}]=0 v186) ==== 163+0+0 (secure 0 0 0) 0x7f2a3407dee0 con 0x7f2a400b4e80 2024-09-16T01:18:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.611+0000 7f2a456dd640 1 -- 172.21.15.81:0/898444447 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2a2c06c2e0 msgr2=0x7f2a2c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.611+0000 7f2a456dd640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2a2c06c2e0 0x7f2a2c06e7a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2a40156e70 tx=0x7f2a3000b040 comp rx=0 tx=0).stop 2024-09-16T01:18:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.611+0000 7f2a456dd640 1 -- 172.21.15.81:0/898444447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b4e80 msgr2=0x7f2a4015a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.611+0000 7f2a456dd640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b4e80 0x7f2a4015a0f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2a34000c00 tx=0x7f2a340046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.611+0000 7f2a456dd640 1 -- 172.21.15.81:0/898444447 shutdown_connections 2024-09-16T01:18:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.611+0000 7f2a456dd640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2a2c06c2e0 0x7f2a2c06e7a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.611+0000 7f2a456dd640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2a4015b340 0x7f2a4015a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.611+0000 7f2a456dd640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b4e80 0x7f2a4015a0f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.611+0000 7f2a456dd640 1 --2- 172.21.15.81:0/898444447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2a400b43f0 0x7f2a40148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.611+0000 7f2a456dd640 1 -- 172.21.15.81:0/898444447 >> 172.21.15.81:0/898444447 conn(0x7f2a40073490 msgr2=0x7f2a40157820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.611+0000 7f2a456dd640 1 -- 172.21.15.81:0/898444447 shutdown_connections 2024-09-16T01:18:54.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.611+0000 7f2a456dd640 1 -- 172.21.15.81:0/898444447 wait complete. 2024-09-16T01:18:54.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T01:18:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.721+0000 7f0ccc427640 1 Processor -- start 2024-09-16T01:18:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.721+0000 7f0ccc427640 1 -- start start 2024-09-16T01:18:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.722+0000 7f0ccc427640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cc4158ec0 0x7f0cc415c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.722+0000 7f0ccc427640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc40b4d50 0x7f0cc40b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.722+0000 7f0ccc427640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc415c850 con 0x7f0cc415ca50 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.722+0000 7f0ccc427640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc40b56e0 con 0x7f0cc4158ec0 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.722+0000 7f0ccc427640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc41592a0 con 0x7f0cc40b4d50 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.723+0000 7f0cca1c3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cc4158ec0 0x7f0cc415c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.723+0000 7f0cc99c2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0cc415ca50 0x7f0cc41594d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48938/0 (socket says 172.21.15.81:48938) 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.723+0000 7f0cca1c3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cc4158ec0 0x7f0cc415c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45932/0 (socket says 172.21.15.81:45932) 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.723+0000 7f0cc99c2640 1 -- 172.21.15.81:0/1194061219 learned_addr learned my addr 172.21.15.81:0/1194061219 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.723+0000 7f0cca9c4640 1 --2- 172.21.15.81:0/1194061219 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc40b4d50 0x7f0cc40b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.723+0000 7f0cca1c3640 1 -- 172.21.15.81:0/1194061219 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc40b4d50 msgr2=0x7f0cc40b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.723+0000 7f0cca1c3640 1 --2- 172.21.15.81:0/1194061219 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc40b4d50 0x7f0cc40b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.723+0000 7f0cca1c3640 1 -- 172.21.15.81:0/1194061219 >> v1:172.21.15.81:6789/0 conn(0x7f0cc415ca50 legacy=0x7f0cc41594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.723+0000 7f0cca1c3640 1 -- 172.21.15.81:0/1194061219 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc415d010 con 0x7f0cc4158ec0 2024-09-16T01:18:54.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.724+0000 7f0cca1c3640 1 --2- 172.21.15.81:0/1194061219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc4158ec0 0x7f0cc415c310 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40097a0 tx=0x7f0cb402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a015b2fc60df623d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:54.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.724+0000 7f0cc91c1640 1 -- 172.21.15.81:0/1194061219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4037070 con 0x7f0cc4158ec0 2024-09-16T01:18:54.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.724+0000 7f0cc91c1640 1 -- 172.21.15.81:0/1194061219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb4032440 con 0x7f0cc4158ec0 2024-09-16T01:18:54.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.724+0000 7f0cc91c1640 1 -- 172.21.15.81:0/1194061219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4032810 con 0x7f0cc4158ec0 2024-09-16T01:18:54.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.724+0000 7f0ccc427640 1 -- 172.21.15.81:0/1194061219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc4158ec0 msgr2=0x7f0cc415c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.724+0000 7f0ccc427640 1 --2- 172.21.15.81:0/1194061219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc4158ec0 0x7f0cc415c310 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40097a0 tx=0x7f0cb402a180 comp rx=0 tx=0).stop 2024-09-16T01:18:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.724+0000 7f0ccc427640 1 -- 172.21.15.81:0/1194061219 shutdown_connections 2024-09-16T01:18:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.724+0000 7f0ccc427640 1 --2- 172.21.15.81:0/1194061219 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc40b4d50 0x7f0cc40b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.724+0000 7f0ccc427640 1 --2- 172.21.15.81:0/1194061219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc4158ec0 0x7f0cc415c310 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.724+0000 7f0ccc427640 1 -- 172.21.15.81:0/1194061219 >> 172.21.15.81:0/1194061219 conn(0x7f0cc409aa30 msgr2=0x7f0cc40b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.724+0000 7f0ccc427640 1 -- 172.21.15.81:0/1194061219 shutdown_connections 2024-09-16T01:18:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.724+0000 7f0ccc427640 1 -- 172.21.15.81:0/1194061219 wait complete. 2024-09-16T01:18:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.726+0000 7f0ccc427640 1 Processor -- start 2024-09-16T01:18:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.726+0000 7f0ccc427640 1 -- start start 2024-09-16T01:18:54.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.726+0000 7f0ccc427640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc40b4d50 0x7f0cc4144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.726+0000 7f0ccc427640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc4158ec0 0x7f0cc41544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.726+0000 7f0ccc427640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc415ca50 0x7f0cc4154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.726+0000 7f0ccc427640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc415d8b0 con 0x7f0cc415ca50 2024-09-16T01:18:54.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.726+0000 7f0ccc427640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc415d5d0 con 0x7f0cc40b4d50 2024-09-16T01:18:54.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.726+0000 7f0ccc427640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc415db90 con 0x7f0cc4158ec0 2024-09-16T01:18:54.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.726+0000 7f0cca9c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc415ca50 0x7f0cc4154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.726+0000 7f0cca9c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc415ca50 0x7f0cc4154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45938/0 (socket says 172.21.15.81:45938) 2024-09-16T01:18:54.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.726+0000 7f0cca9c4640 1 -- 172.21.15.81:0/1126601332 learned_addr learned my addr 172.21.15.81:0/1126601332 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:54.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.727+0000 7f0cca9c4640 1 -- 172.21.15.81:0/1126601332 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc4158ec0 msgr2=0x7f0cc41544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.727+0000 7f0cca9c4640 1 --2- 172.21.15.81:0/1126601332 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc4158ec0 0x7f0cc41544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.727+0000 7f0cca9c4640 1 -- 172.21.15.81:0/1126601332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc40b4d50 msgr2=0x7f0cc4144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.727+0000 7f0cca9c4640 1 --2- 172.21.15.81:0/1126601332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc40b4d50 0x7f0cc4144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.727+0000 7f0cca9c4640 1 -- 172.21.15.81:0/1126601332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc4152e60 con 0x7f0cc415ca50 2024-09-16T01:18:54.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.727+0000 7f0cca9c4640 1 --2- 172.21.15.81:0/1126601332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc415ca50 0x7f0cc4154a20 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc007e90 tx=0x7f0cbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:54.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.727+0000 7f0cc2ffd640 1 -- 172.21.15.81:0/1126601332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc014420 con 0x7f0cc415ca50 2024-09-16T01:18:54.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.727+0000 7f0cc2ffd640 1 -- 172.21.15.81:0/1126601332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc019070 con 0x7f0cc415ca50 2024-09-16T01:18:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.727+0000 7f0ccc427640 1 -- 172.21.15.81:0/1126601332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc4155360 con 0x7f0cc415ca50 2024-09-16T01:18:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.727+0000 7f0cc2ffd640 1 -- 172.21.15.81:0/1126601332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc014800 con 0x7f0cc415ca50 2024-09-16T01:18:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.727+0000 7f0ccc427640 1 -- 172.21.15.81:0/1126601332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc4145090 con 0x7f0cc415ca50 2024-09-16T01:18:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.728+0000 7f0ccc427640 1 -- 172.21.15.81:0/1126601332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc40b51a0 con 0x7f0cc415ca50 2024-09-16T01:18:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.728+0000 7f0cc2ffd640 1 -- 172.21.15.81:0/1126601332 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0cbc0149a0 con 0x7f0cc415ca50 2024-09-16T01:18:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.729+0000 7f0cc2ffd640 1 --2- 172.21.15.81:0/1126601332 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0cb006c2b0 0x7f0cb006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.729+0000 7f0cc2ffd640 1 -- 172.21.15.81:0/1126601332 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f0cbc08bb10 con 0x7f0cc415ca50 2024-09-16T01:18:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.729+0000 7f0cca1c3640 1 --2- 172.21.15.81:0/1126601332 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0cb006c2b0 0x7f0cb006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:54.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.729+0000 7f0cca1c3640 1 --2- 172.21.15.81:0/1126601332 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0cb006c2b0 0x7f0cb006e770 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4034000 tx=0x7f0cb402c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:54.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.733+0000 7f0cc2ffd640 1 -- 172.21.15.81:0/1126601332 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0cbc05a3f0 con 0x7f0cc415ca50 2024-09-16T01:18:54.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.897+0000 7f0ccc427640 1 -- 172.21.15.81:0/1126601332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0cc406c6c0 con 0x7f0cc415ca50 2024-09-16T01:18:54.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.900+0000 7f0cc2ffd640 1 -- 172.21.15.81:0/1126601332 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f0cbc059cf0 con 0x7f0cc415ca50 2024-09-16T01:18:54.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.902+0000 7f0ccc427640 1 -- 172.21.15.81:0/1126601332 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0cb006c2b0 msgr2=0x7f0cb006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.902+0000 7f0ccc427640 1 --2- 172.21.15.81:0/1126601332 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0cb006c2b0 0x7f0cb006e770 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4034000 tx=0x7f0cb402c000 comp rx=0 tx=0).stop 2024-09-16T01:18:54.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.902+0000 7f0ccc427640 1 -- 172.21.15.81:0/1126601332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc415ca50 msgr2=0x7f0cc4154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:54.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.902+0000 7f0ccc427640 1 --2- 172.21.15.81:0/1126601332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc415ca50 0x7f0cc4154a20 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc007e90 tx=0x7f0cbc00e4b0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.902+0000 7f0ccc427640 1 -- 172.21.15.81:0/1126601332 shutdown_connections 2024-09-16T01:18:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.902+0000 7f0ccc427640 1 --2- 172.21.15.81:0/1126601332 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0cb006c2b0 0x7f0cb006e770 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.902+0000 7f0ccc427640 1 --2- 172.21.15.81:0/1126601332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc415ca50 0x7f0cc4154a20 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.902+0000 7f0ccc427640 1 --2- 172.21.15.81:0/1126601332 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc4158ec0 0x7f0cc41544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.902+0000 7f0ccc427640 1 --2- 172.21.15.81:0/1126601332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc40b4d50 0x7f0cc4144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.902+0000 7f0ccc427640 1 -- 172.21.15.81:0/1126601332 >> 172.21.15.81:0/1126601332 conn(0x7f0cc409aa30 msgr2=0x7f0cc40d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.903+0000 7f0ccc427640 1 -- 172.21.15.81:0/1126601332 shutdown_connections 2024-09-16T01:18:54.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:54.903+0000 7f0ccc427640 1 -- 172.21.15.81:0/1126601332 wait complete. 2024-09-16T01:18:54.915 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:18:54.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:18:54.961 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:18:55.012 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:18:55.012 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:55.012 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:55.028 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:18:55.028 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:18:55.028 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:55.046 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:18:55.046 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:18:55.047 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:55.084 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:18:55.084 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:18:55.084 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:18:55.104 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:18:55.104 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T01:18:55.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:18:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.221+0000 7f1c21e9b640 1 Processor -- start 2024-09-16T01:18:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.221+0000 7f1c21e9b640 1 -- start start 2024-09-16T01:18:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c21e9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c1c15b170 0x7f1c1c0d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c21e9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c1c06f8e0 0x7f1c1c06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c21e9b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c1c15f1d0 con 0x7f1c1c0b3c70 2024-09-16T01:18:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c21e9b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1c1c070260 con 0x7f1c1c15b170 2024-09-16T01:18:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c21e9b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1c1c0d0960 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c1b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c1c15b170 0x7f1c1c0d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c1bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1c1c0b3c70 0x7f1c1c0b4100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48954/0 (socket says 172.21.15.81:48954) 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c1bfff640 1 -- 172.21.15.81:0/330657330 learned_addr learned my addr 172.21.15.81:0/330657330 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c1affd640 1 --2- 172.21.15.81:0/330657330 >> v2:172.21.15.102:3300/0 conn(0x7f1c1c06f8e0 0x7f1c1c06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c1b7fe640 1 -- 172.21.15.81:0/330657330 >> v2:172.21.15.102:3300/0 conn(0x7f1c1c06f8e0 msgr2=0x7f1c1c06fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c1b7fe640 1 --2- 172.21.15.81:0/330657330 >> v2:172.21.15.102:3300/0 conn(0x7f1c1c06f8e0 0x7f1c1c06fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c1b7fe640 1 -- 172.21.15.81:0/330657330 >> v1:172.21.15.81:6789/0 conn(0x7f1c1c0b3c70 legacy=0x7f1c1c0b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.222+0000 7f1c1b7fe640 1 -- 172.21.15.81:0/330657330 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1c15f4b0 con 0x7f1c1c15b170 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.223+0000 7f1c1b7fe640 1 --2- 172.21.15.81:0/330657330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c1c15b170 0x7f1c1c0d0420 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0b4d30 tx=0x7f1c0c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28696a1f9ff3524 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.223+0000 7f1c1a7fc640 1 -- 172.21.15.81:0/330657330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c037070 con 0x7f1c1c15b170 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.223+0000 7f1c1a7fc640 1 -- 172.21.15.81:0/330657330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0c032440 con 0x7f1c1c15b170 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.223+0000 7f1c1a7fc640 1 -- 172.21.15.81:0/330657330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c032810 con 0x7f1c1c15b170 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.223+0000 7f1c21e9b640 1 -- 172.21.15.81:0/330657330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c1c15b170 msgr2=0x7f1c1c0d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.223+0000 7f1c21e9b640 1 --2- 172.21.15.81:0/330657330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c1c15b170 0x7f1c1c0d0420 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0b4d30 tx=0x7f1c0c02a1a0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.223+0000 7f1c21e9b640 1 -- 172.21.15.81:0/330657330 shutdown_connections 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.223+0000 7f1c21e9b640 1 --2- 172.21.15.81:0/330657330 >> v2:172.21.15.102:3300/0 conn(0x7f1c1c06f8e0 0x7f1c1c06fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.223+0000 7f1c21e9b640 1 --2- 172.21.15.81:0/330657330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c1c15b170 0x7f1c1c0d0420 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.224+0000 7f1c21e9b640 1 -- 172.21.15.81:0/330657330 >> 172.21.15.81:0/330657330 conn(0x7f1c1c06bc10 msgr2=0x7f1c1c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.224+0000 7f1c21e9b640 1 -- 172.21.15.81:0/330657330 shutdown_connections 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.224+0000 7f1c21e9b640 1 -- 172.21.15.81:0/330657330 wait complete. 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.225+0000 7f1c21e9b640 1 Processor -- start 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.225+0000 7f1c21e9b640 1 -- start start 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c21e9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c1c06f8e0 0x7f1c1c14c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c21e9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c1c0b3c70 0x7f1c1c14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c21e9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c1c15b170 0x7f1c1c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c21e9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c070de0 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c21e9b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c15fa70 con 0x7f1c1c15b170 2024-09-16T01:18:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c21e9b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1c1c15b550 con 0x7f1c1c0b3c70 2024-09-16T01:18:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c1c06f8e0 0x7f1c1c14c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c1c06f8e0 0x7f1c1c14c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45958/0 (socket says 172.21.15.81:45958) 2024-09-16T01:18:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1b7fe640 1 -- 172.21.15.81:0/3772596556 learned_addr learned my addr 172.21.15.81:0/3772596556 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1bfff640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c1c15b170 0x7f1c1c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1b7fe640 1 -- 172.21.15.81:0/3772596556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c1c0b3c70 msgr2=0x7f1c1c14fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1affd640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c1c0b3c70 0x7f1c1c14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1b7fe640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c1c0b3c70 0x7f1c1c14fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1b7fe640 1 -- 172.21.15.81:0/3772596556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c1c15b170 msgr2=0x7f1c1c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:55.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1b7fe640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c1c15b170 0x7f1c1c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1b7fe640 1 -- 172.21.15.81:0/3772596556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1c15e0c0 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1bfff640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c1c15b170 0x7f1c1c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1affd640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c1c0b3c70 0x7f1c1c14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c1b7fe640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c1c06f8e0 0x7f1c1c14c5f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009890 tx=0x7f1c0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c03fff640 1 -- 172.21.15.81:0/3772596556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c037040 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c03fff640 1 -- 172.21.15.81:0/3772596556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0c042070 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c03fff640 1 -- 172.21.15.81:0/3772596556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c030bd0 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c21e9b640 1 -- 172.21.15.81:0/3772596556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c1c15e3a0 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.226+0000 7f1c21e9b640 1 -- 172.21.15.81:0/3772596556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c1c15dd70 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.227+0000 7f1c21e9b640 1 -- 172.21.15.81:0/3772596556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c1c15ed60 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.228+0000 7f1c03fff640 1 -- 172.21.15.81:0/3772596556 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1c0c047460 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.228+0000 7f1c03fff640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c0806c2b0 0x7f1c0806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.228+0000 7f1c03fff640 1 -- 172.21.15.81:0/3772596556 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5335+0+0 (secure 0 0 0) 0x7f1c0c0abe70 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.228+0000 7f1c1affd640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c0806c2b0 0x7f1c0806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.229+0000 7f1c1affd640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c0806c2b0 0x7f1c0806e770 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c156060 tx=0x7f1c10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.233+0000 7f1c03fff640 1 -- 172.21.15.81:0/3772596556 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c0c032e20 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.431+0000 7f1c21e9b640 1 -- 172.21.15.81:0/3772596556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c1c0b6d40 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.432+0000 7f1c03fff640 1 -- 172.21.15.81:0/3772596556 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+3908 (secure 0 0 0) 0x7f1c0c07a7e0 con 0x7f1c1c06f8e0 2024-09-16T01:18:55.435 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:55.435 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":38,"btime":"2024-09-16T01:18:50:598416+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/4005145731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":4005145731},{"type":"v1","addr":"172.21.15.102:6835","nonce":4005145731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5731,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3273830754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3273830754},{"type":"v1","addr":"172.21.15.102:6834","nonce":3273830754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/40318124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":40318124},{"type":"v1","addr":"172.21.15.81:6835","nonce":40318124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":6021,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/700844751","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":700844751},{"type":"v1","addr":"172.21.15.81:6837","nonce":700844751}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[]} 2024-09-16T01:18:55.436 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 38 2024-09-16T01:18:55.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.434+0000 7f1c21e9b640 1 -- 172.21.15.81:0/3772596556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c0806c2b0 msgr2=0x7f1c0806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.434+0000 7f1c21e9b640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c0806c2b0 0x7f1c0806e770 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c156060 tx=0x7f1c10008040 comp rx=0 tx=0).stop 2024-09-16T01:18:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.434+0000 7f1c21e9b640 1 -- 172.21.15.81:0/3772596556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c1c06f8e0 msgr2=0x7f1c1c14c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.434+0000 7f1c21e9b640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c1c06f8e0 0x7f1c1c14c5f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009890 tx=0x7f1c0c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.434+0000 7f1c21e9b640 1 -- 172.21.15.81:0/3772596556 shutdown_connections 2024-09-16T01:18:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.434+0000 7f1c21e9b640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c0806c2b0 0x7f1c0806e770 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.434+0000 7f1c21e9b640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c1c15b170 0x7f1c1c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.434+0000 7f1c21e9b640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c1c0b3c70 0x7f1c1c14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.434+0000 7f1c21e9b640 1 --2- 172.21.15.81:0/3772596556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c1c06f8e0 0x7f1c1c14c5f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.434+0000 7f1c21e9b640 1 -- 172.21.15.81:0/3772596556 >> 172.21.15.81:0/3772596556 conn(0x7f1c1c06bc10 msgr2=0x7f1c1c156820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.434+0000 7f1c21e9b640 1 -- 172.21.15.81:0/3772596556 shutdown_connections 2024-09-16T01:18:55.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.434+0000 7f1c21e9b640 1 -- 172.21.15.81:0/3772596556 wait complete. 2024-09-16T01:18:55.447 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:18:55.448 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T01:18:55.448 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:18:55.448 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:18:55.448 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:18:55.448 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T01:18:55.448 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:18:55.448 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:18:55.449 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:18:55.449 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T01:18:55.449 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:18:55.449 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:18:55.449 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:18:55.449 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T01:18:55.449 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:18:55.449 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:18:55.458 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:18:55.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:18:55.459 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:18:55.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:18:55.461 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:18:55.461 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:18:55.462 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:18:55.462 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:18:55.501 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:18:55.501 DEBUG:teuthology.parallel:result is None 2024-09-16T01:18:55.502 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:18:55.502 DEBUG:teuthology.parallel:result is None 2024-09-16T01:18:55.504 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:18:55.505 DEBUG:teuthology.parallel:result is None 2024-09-16T01:18:55.505 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:18:55.505 DEBUG:teuthology.parallel:result is None 2024-09-16T01:18:55.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T01:18:55.577 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:18:55.577 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:18:55.588 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-16T01:18:55.588 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:18:55.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.607+0000 7f7be7fa1640 1 Processor -- start 2024-09-16T01:18:55.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.607+0000 7f7be7fa1640 1 -- start start 2024-09-16T01:18:55.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.608+0000 7f7be7fa1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7be00b0700 0x7f7be00b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.608+0000 7f7be7fa1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7be00b47a0 0x7f7be006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.608+0000 7f7be7fa1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be009ac80 con 0x7f7be015e750 2024-09-16T01:18:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.608+0000 7f7be7fa1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7be015eb30 con 0x7f7be00b47a0 2024-09-16T01:18:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.608+0000 7f7be7fa1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7be009aa30 con 0x7f7be00b0700 2024-09-16T01:18:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.608+0000 7f7be5d3d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7be015e750 0x7f7be00ae240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48986/0 (socket says 172.21.15.81:48986) 2024-09-16T01:18:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.608+0000 7f7be5d3d640 1 -- 172.21.15.81:0/1949465639 learned_addr learned my addr 172.21.15.81:0/1949465639 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.608+0000 7f7be653e640 1 --2- 172.21.15.81:0/1949465639 >> v2:172.21.15.102:3300/0 conn(0x7f7be00b47a0 0x7f7be006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.608+0000 7f7be553c640 1 --2- 172.21.15.81:0/1949465639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7be00b0700 0x7f7be00b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.609+0000 7f7be4d3b640 1 -- 172.21.15.81:0/1949465639 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028692186 0 0) 0x7f7be009ac80 con 0x7f7be015e750 2024-09-16T01:18:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.609+0000 7f7be4d3b640 1 -- 172.21.15.81:0/1949465639 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bcc003520 con 0x7f7be015e750 2024-09-16T01:18:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.609+0000 7f7be553c640 1 -- 172.21.15.81:0/1949465639 >> v2:172.21.15.102:3300/0 conn(0x7f7be00b47a0 msgr2=0x7f7be006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.609+0000 7f7be553c640 1 --2- 172.21.15.81:0/1949465639 >> v2:172.21.15.102:3300/0 conn(0x7f7be00b47a0 0x7f7be006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.609+0000 7f7be553c640 1 -- 172.21.15.81:0/1949465639 >> v1:172.21.15.81:6789/0 conn(0x7f7be015e750 legacy=0x7f7be00ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:55.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.609+0000 7f7be553c640 1 -- 172.21.15.81:0/1949465639 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be00b2990 con 0x7f7be00b0700 2024-09-16T01:18:55.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.609+0000 7f7be653e640 1 --2- 172.21.15.81:0/1949465639 >> v2:172.21.15.102:3300/0 conn(0x7f7be00b47a0 0x7f7be006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:18:55.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.610+0000 7f7be553c640 1 --2- 172.21.15.81:0/1949465639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7be00b0700 0x7f7be00b4260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00097a0 tx=0x7f7bd002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f5a9f856febe9e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:55.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.612+0000 7f7be4d3b640 1 -- 172.21.15.81:0/1949465639 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0037070 con 0x7f7be00b0700 2024-09-16T01:18:55.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.612+0000 7f7be4d3b640 1 -- 172.21.15.81:0/1949465639 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd002ae50 con 0x7f7be00b0700 2024-09-16T01:18:55.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.612+0000 7f7be4d3b640 1 -- 172.21.15.81:0/1949465639 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0032660 con 0x7f7be00b0700 2024-09-16T01:18:55.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.613+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1949465639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7be00b0700 msgr2=0x7f7be00b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:55.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.613+0000 7f7be7fa1640 1 --2- 172.21.15.81:0/1949465639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7be00b0700 0x7f7be00b4260 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00097a0 tx=0x7f7bd002a100 comp rx=0 tx=0).stop 2024-09-16T01:18:55.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.613+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1949465639 shutdown_connections 2024-09-16T01:18:55.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.613+0000 7f7be7fa1640 1 --2- 172.21.15.81:0/1949465639 >> v2:172.21.15.102:3300/0 conn(0x7f7be00b47a0 0x7f7be006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.613+0000 7f7be7fa1640 1 --2- 172.21.15.81:0/1949465639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7be00b0700 0x7f7be00b4260 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.613+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1949465639 >> 172.21.15.81:0/1949465639 conn(0x7f7be0073490 msgr2=0x7f7be00b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:55.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.613+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1949465639 shutdown_connections 2024-09-16T01:18:55.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.613+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1949465639 wait complete. 2024-09-16T01:18:55.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.614+0000 7f7be7fa1640 1 Processor -- start 2024-09-16T01:18:55.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.614+0000 7f7be7fa1640 1 -- start start 2024-09-16T01:18:55.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be7fa1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7be00b0700 0x7f7be01ee7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:55.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be7fa1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7be00b47a0 0x7f7be0158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:55.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be7fa1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be015e750 0x7f7be009d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:55.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be7fa1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7be00b60e0 con 0x7f7be015e750 2024-09-16T01:18:55.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be7fa1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7be00b5f60 con 0x7f7be00b0700 2024-09-16T01:18:55.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be7fa1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7be00b6580 con 0x7f7be00b47a0 2024-09-16T01:18:55.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be653e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be015e750 0x7f7be009d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:55.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be653e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be015e750 0x7f7be009d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45992/0 (socket says 172.21.15.81:45992) 2024-09-16T01:18:55.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be653e640 1 -- 172.21.15.81:0/1993875468 learned_addr learned my addr 172.21.15.81:0/1993875468 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:55.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be553c640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7be00b47a0 0x7f7be0158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:55.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be5d3d640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7be00b0700 0x7f7be01ee7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be653e640 1 -- 172.21.15.81:0/1993875468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7be00b47a0 msgr2=0x7f7be0158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be653e640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7be00b47a0 0x7f7be0158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be653e640 1 -- 172.21.15.81:0/1993875468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7be00b0700 msgr2=0x7f7be01ee7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be653e640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7be00b0700 0x7f7be01ee7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.615+0000 7f7be653e640 1 -- 172.21.15.81:0/1993875468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be01ed740 con 0x7f7be015e750 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.616+0000 7f7be653e640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be015e750 0x7f7be009d0d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009f00 tx=0x7f7bd800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.616+0000 7f7bd67fc640 1 -- 172.21.15.81:0/1993875468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8018030 con 0x7f7be015e750 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.616+0000 7f7bd67fc640 1 -- 172.21.15.81:0/1993875468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd800ce50 con 0x7f7be015e750 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.616+0000 7f7bd67fc640 1 -- 172.21.15.81:0/1993875468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8003bb0 con 0x7f7be015e750 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.616+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1993875468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be01eda20 con 0x7f7be015e750 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.616+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1993875468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be01edfe0 con 0x7f7be015e750 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.617+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1993875468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be00b4260 con 0x7f7be015e750 2024-09-16T01:18:55.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.617+0000 7f7bd67fc640 1 -- 172.21.15.81:0/1993875468 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7bd801b070 con 0x7f7be015e750 2024-09-16T01:18:55.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.618+0000 7f7bd67fc640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7bc406c2e0 0x7f7bc406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:55.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.618+0000 7f7bd67fc640 1 -- 172.21.15.81:0/1993875468 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5335+0+0 (secure 0 0 0) 0x7f7bd808bbf0 con 0x7f7be015e750 2024-09-16T01:18:55.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.618+0000 7f7be5d3d640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7bc406c2e0 0x7f7bc406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:55.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.618+0000 7f7be5d3d640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7bc406c2e0 0x7f7bc406e7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc005880 tx=0x7f7bdc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:55.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.622+0000 7f7bd67fc640 1 -- 172.21.15.81:0/1993875468 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7bd8010040 con 0x7f7be015e750 2024-09-16T01:18:55.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:55.800+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1993875468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7be00b3900 con 0x7f7be015e750 2024-09-16T01:18:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.631+0000 7f7bd67fc640 1 -- 172.21.15.81:0/1993875468 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v83) ==== 97+0+0 (secure 0 0 0) 0x7f7bd8059e80 con 0x7f7be015e750 2024-09-16T01:18:56.633 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-16T01:18:56.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.634+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1993875468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7bc406c2e0 msgr2=0x7f7bc406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:56.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.634+0000 7f7be7fa1640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7bc406c2e0 0x7f7bc406e7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc005880 tx=0x7f7bdc009040 comp rx=0 tx=0).stop 2024-09-16T01:18:56.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.634+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1993875468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be015e750 msgr2=0x7f7be009d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:56.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.634+0000 7f7be7fa1640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be015e750 0x7f7be009d0d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009f00 tx=0x7f7bd800c490 comp rx=0 tx=0).stop 2024-09-16T01:18:56.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.634+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1993875468 shutdown_connections 2024-09-16T01:18:56.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.634+0000 7f7be7fa1640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7bc406c2e0 0x7f7bc406e7a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:56.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.634+0000 7f7be7fa1640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7be015e750 0x7f7be009d0d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.634+0000 7f7be7fa1640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7be00b47a0 0x7f7be0158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.634+0000 7f7be7fa1640 1 --2- 172.21.15.81:0/1993875468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7be00b0700 0x7f7be01ee7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.634+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1993875468 >> 172.21.15.81:0/1993875468 conn(0x7f7be0073490 msgr2=0x7f7be00b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.634+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1993875468 shutdown_connections 2024-09-16T01:18:56.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.634+0000 7f7be7fa1640 1 -- 172.21.15.81:0/1993875468 wait complete. 2024-09-16T01:18:56.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T01:18:56.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.746+0000 7fa83559a640 1 Processor -- start 2024-09-16T01:18:56.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.746+0000 7fa83559a640 1 -- start start 2024-09-16T01:18:56.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.747+0000 7fa83559a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8300b3760 0x7fa8300b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.747+0000 7fa83559a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa83006cd20 0x7fa830162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.747+0000 7fa83559a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8300b2790 con 0x7fa83009aa30 2024-09-16T01:18:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.747+0000 7fa83559a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa8300d0670 con 0x7fa83006cd20 2024-09-16T01:18:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.747+0000 7fa83559a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa8300b2a70 con 0x7fa8300b3760 2024-09-16T01:18:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.747+0000 7fa82effd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa83009aa30 0x7fa83009ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48990/0 (socket says 172.21.15.81:48990) 2024-09-16T01:18:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.747+0000 7fa82effd640 1 -- 172.21.15.81:0/341064169 learned_addr learned my addr 172.21.15.81:0/341064169 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938180838 0 0) 0x7fa8300b2790 con 0x7fa83009aa30 2024-09-16T01:18:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa818003520 con 0x7fa83009aa30 2024-09-16T01:18:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82e7fc640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8300b3760 0x7fa8300b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/341064169 >> v2:172.21.15.102:3300/0 conn(0x7fa83006cd20 0x7fa830162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1886258703 0 0) 0x7fa818003520 con 0x7fa83009aa30 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8300b3760 msgr2=0x7fa8300b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8300b3760 0x7fa8300b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 >> v2:172.21.15.102:3300/0 conn(0x7fa83006cd20 msgr2=0x7fa830162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 --2- 172.21.15.81:0/341064169 >> v2:172.21.15.102:3300/0 conn(0x7fa83006cd20 0x7fa830162340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8300b2d50 con 0x7fa83009aa30 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fa820001670 con 0x7fa83009aa30 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 >> v1:172.21.15.81:6789/0 conn(0x7fa83009aa30 legacy=0x7fa83009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8180039b0 0x7fa818003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8300b3760 0x7fa818004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa818004d40 0x7fa8180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8300b2a70 con 0x7fa818004d40 2024-09-16T01:18:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa81800b9c0 con 0x7fa8180039b0 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa81800bb70 con 0x7fa8300b3760 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa818004d40 0x7fa8180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82effd640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8180039b0 0x7fa818003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82e7fc640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8300b3760 0x7fa818004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82f7fe640 1 -- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8300b3760 msgr2=0x7fa818004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8300b3760 0x7fa818004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82f7fe640 1 -- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8180039b0 msgr2=0x7fa818003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8180039b0 0x7fa818003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82f7fe640 1 -- 172.21.15.81:0/341064169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa818003520 con 0x7fa818004d40 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82effd640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8180039b0 0x7fa818003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.748+0000 7fa82e7fc640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8300b3760 0x7fa818004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.749+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa818004d40 0x7fa8180051c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa828009f90 tx=0x7fa818005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac8f8fc9583159 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:56.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.749+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828009c10 con 0x7fa818004d40 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.749+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa828036070 con 0x7fa818004d40 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.749+0000 7fa82dffb640 1 -- 172.21.15.81:0/341064169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828031840 con 0x7fa818004d40 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.750+0000 7fa83559a640 1 -- 172.21.15.81:0/341064169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa818004d40 msgr2=0x7fa8180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.750+0000 7fa83559a640 1 --2- 172.21.15.81:0/341064169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa818004d40 0x7fa8180051c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa828009f90 tx=0x7fa818005830 comp rx=0 tx=0).stop 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.750+0000 7fa82f7fe640 1 -- 172.21.15.81:0/341064169 reap_dead start 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.750+0000 7fa83559a640 1 -- 172.21.15.81:0/341064169 shutdown_connections 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.750+0000 7fa83559a640 1 -- 172.21.15.81:0/341064169 >> 172.21.15.81:0/341064169 conn(0x7fa8300d23a0 msgr2=0x7fa8300d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.750+0000 7fa83559a640 1 -- 172.21.15.81:0/341064169 shutdown_connections 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.750+0000 7fa83559a640 1 -- 172.21.15.81:0/341064169 wait complete. 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.751+0000 7fa83559a640 1 Processor -- start 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.751+0000 7fa83559a640 1 -- start start 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa83559a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa830153e40 0x7fa830152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa83559a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83015f050 0x7fa8301526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa83559a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa830152bf0 0x7fa8301f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa83559a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa83015fe20 con 0x7fa83015f050 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa83559a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa83015fca0 con 0x7fa830153e40 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa83559a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa8300d1fe0 con 0x7fa830152bf0 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa82e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83015f050 0x7fa8301526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa82e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83015f050 0x7fa8301526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46006/0 (socket says 172.21.15.81:46006) 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa82e7fc640 1 -- 172.21.15.81:0/2136247417 learned_addr learned my addr 172.21.15.81:0/2136247417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa82effd640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa830153e40 0x7fa830152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa82e7fc640 1 -- 172.21.15.81:0/2136247417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa830152bf0 msgr2=0x7fa8301f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa82f7fe640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa830152bf0 0x7fa8301f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa82e7fc640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa830152bf0 0x7fa8301f7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa82e7fc640 1 -- 172.21.15.81:0/2136247417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa830153e40 msgr2=0x7fa830152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa82e7fc640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa830153e40 0x7fa830152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa82e7fc640 1 -- 172.21.15.81:0/2136247417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa830154350 con 0x7fa83015f050 2024-09-16T01:18:56.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa82effd640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa830153e40 0x7fa830152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:18:56.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa82e7fc640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83015f050 0x7fa8301526b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa824011640 tx=0x7fa824011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:56.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa8177fe640 1 -- 172.21.15.81:0/2136247417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824015870 con 0x7fa83015f050 2024-09-16T01:18:56.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa8177fe640 1 -- 172.21.15.81:0/2136247417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa824015a10 con 0x7fa83015f050 2024-09-16T01:18:56.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa8177fe640 1 -- 172.21.15.81:0/2136247417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824015dc0 con 0x7fa83015f050 2024-09-16T01:18:56.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.752+0000 7fa83559a640 1 -- 172.21.15.81:0/2136247417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8301545c0 con 0x7fa83015f050 2024-09-16T01:18:56.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.753+0000 7fa83559a640 1 -- 172.21.15.81:0/2136247417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8301630b0 con 0x7fa83015f050 2024-09-16T01:18:56.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.754+0000 7fa83559a640 1 -- 172.21.15.81:0/2136247417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8300b3030 con 0x7fa83015f050 2024-09-16T01:18:56.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.754+0000 7fa8177fe640 1 -- 172.21.15.81:0/2136247417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa82400f450 con 0x7fa83015f050 2024-09-16T01:18:56.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.755+0000 7fa8177fe640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa81c06c2e0 0x7fa81c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:56.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.755+0000 7fa82effd640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa81c06c2e0 0x7fa81c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:56.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.755+0000 7fa8177fe640 1 -- 172.21.15.81:0/2136247417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7fa82408ba70 con 0x7fa83015f050 2024-09-16T01:18:56.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.755+0000 7fa82effd640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa81c06c2e0 0x7fa81c06e7a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa820000fb0 tx=0x7fa820005e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:56.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.759+0000 7fa8177fe640 1 -- 172.21.15.81:0/2136247417 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa824019030 con 0x7fa83015f050 2024-09-16T01:18:56.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.989+0000 7fa83559a640 1 -- 172.21.15.81:0/2136247417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa83015f4c0 con 0x7fa83015f050 2024-09-16T01:18:56.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.989+0000 7fa8177fe640 1 -- 172.21.15.81:0/2136247417 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7fa82405a430 con 0x7fa83015f050 2024-09-16T01:18:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:56.991 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:18:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-16T01:18:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-16T01:18:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmx4OgCRAAkmpWDpuwqbDuz0taNg8bag==", 2024-09-16T01:18:56.991 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:18:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:18:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-16T01:18:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmSNpLFRAAzc9Sr8b65zH9VZFYvqsYpA==", 2024-09-16T01:18:56.992 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmcCavEBAA0CuddD0zPcjqrMSOD5c6OA==", 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:18:56.993 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:18:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-16T01:18:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmVeRcHBAANIL7HFYSc43qv7Zg0llkYQ==", 2024-09-16T01:18:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:18:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:18:56.994 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-16T01:18:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDhudmUtTqORAAkZKChid+qoa+0nIgpuun7g==", 2024-09-16T01:18:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:56.995 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-16T01:18:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCHhudmUhtiABAA2vDoACv8RJ2KD9p1cdKClA==", 2024-09-16T01:18:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:56.996 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-16T01:18:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCKhudmhOmRHxAAbGjJkUZLras/b6omekdz7A==", 2024-09-16T01:18:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:56.997 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-16T01:18:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCNhudmA+csIRAAW1kenpimaWIak/qgG+UeXw==", 2024-09-16T01:18:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:56.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-16T01:18:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCThudmvgQBLxAAWLto5pG0iyiQPSnxldWYwg==", 2024-09-16T01:18:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:56.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-16T01:18:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCXhudmKfyiIhAALbJHvDeQtVgSCKjD1X3OYg==", 2024-09-16T01:18:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-16T01:18:57.000 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCahudmPG/9JBAA6d/gK0K/5c9Gp4uKOLCCOw==", 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCdhudmVdY3NhAAXlOaeE0XidHVCaeQrirBAg==", 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:57.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg==", 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmMgEhKRAAUD2kJ9eOFJscZ6ATlO5PmQ==", 2024-09-16T01:18:57.002 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:18:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:18:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:18:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-16T01:18:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmwfD5JRAAPhdVLFZD07Uy75g3zStblg==", 2024-09-16T01:18:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:57.003 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:18:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:18:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:18:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-16T01:18:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudm8/qzLhAAVFRbGhXH00h2LS9ZC9rraA==", 2024-09-16T01:18:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:18:57.004 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/hudmBWr2KRAA/hELsRHNpxj3KqJbOSY74g==", 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:57.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmRdtyBhAAMQngXCuTHg6AjACCw/SmCg==", 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmqULCAhAAMbYmGXWGiINwif20O1JG3g==", 2024-09-16T01:18:57.006 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:18:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:18:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:18:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:18:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:57.007 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-16T01:18:57.007 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:18:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.991+0000 7fa83559a640 1 -- 172.21.15.81:0/2136247417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa81c06c2e0 msgr2=0x7fa81c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.991+0000 7fa83559a640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa81c06c2e0 0x7fa81c06e7a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa820000fb0 tx=0x7fa820005e20 comp rx=0 tx=0).stop 2024-09-16T01:18:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.991+0000 7fa83559a640 1 -- 172.21.15.81:0/2136247417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83015f050 msgr2=0x7fa8301526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.991+0000 7fa83559a640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83015f050 0x7fa8301526b0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa824011640 tx=0x7fa824011b00 comp rx=0 tx=0).stop 2024-09-16T01:18:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.991+0000 7fa83559a640 1 -- 172.21.15.81:0/2136247417 shutdown_connections 2024-09-16T01:18:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.991+0000 7fa83559a640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa81c06c2e0 0x7fa81c06e7a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.991+0000 7fa83559a640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa830152bf0 0x7fa8301f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.991+0000 7fa83559a640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83015f050 0x7fa8301526b0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.991+0000 7fa83559a640 1 --2- 172.21.15.81:0/2136247417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa830153e40 0x7fa830152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.991+0000 7fa83559a640 1 -- 172.21.15.81:0/2136247417 >> 172.21.15.81:0/2136247417 conn(0x7fa8300d23a0 msgr2=0x7fa8300b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:57.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.991+0000 7fa83559a640 1 -- 172.21.15.81:0/2136247417 shutdown_connections 2024-09-16T01:18:57.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:56.991+0000 7fa83559a640 1 -- 172.21.15.81:0/2136247417 wait complete. 2024-09-16T01:18:57.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:18:57.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.106+0000 7fd638511640 1 Processor -- start 2024-09-16T01:18:57.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.106+0000 7fd638511640 1 -- start start 2024-09-16T01:18:57.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.107+0000 7fd638511640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd63015c490 0x7fd63009b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.107+0000 7fd638511640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6300d01c0 con 0x7fd63015cf80 2024-09-16T01:18:57.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.107+0000 7fd638511640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6300d04a0 con 0x7fd63009b980 2024-09-16T01:18:57.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.107+0000 7fd638511640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd6300cff70 con 0x7fd63015c490 2024-09-16T01:18:57.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.107+0000 7fd6362ad640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd63015c490 0x7fd63009b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.107+0000 7fd636aae640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd63015cf80 0x7fd6300ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48992/0 (socket says 172.21.15.81:48992) 2024-09-16T01:18:57.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.107+0000 7fd636aae640 1 -- 172.21.15.81:0/3045045598 learned_addr learned my addr 172.21.15.81:0/3045045598 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:57.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.108+0000 7fd6362ad640 1 -- 172.21.15.81:0/3045045598 >> v1:172.21.15.102:6789/0 conn(0x7fd63009b980 legacy=0x7fd63015c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.108+0000 7fd6362ad640 1 -- 172.21.15.81:0/3045045598 >> v1:172.21.15.81:6789/0 conn(0x7fd63015cf80 legacy=0x7fd6300ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.108+0000 7fd6362ad640 1 -- 172.21.15.81:0/3045045598 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6300d0780 con 0x7fd63015c490 2024-09-16T01:18:57.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.108+0000 7fd6352ab640 1 -- 172.21.15.81:0/3045045598 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405183756 0 0) 0x7fd6300d01c0 con 0x7fd63015cf80 2024-09-16T01:18:57.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.108+0000 7fd6362ad640 1 --2- 172.21.15.81:0/3045045598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63015c490 0x7fd63009b440 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0097a0 tx=0x7fd62c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ac148a2041431d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:57.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.108+0000 7fd6352ab640 1 -- 172.21.15.81:0/3045045598 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c037070 con 0x7fd63015c490 2024-09-16T01:18:57.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.108+0000 7fd6352ab640 1 -- 172.21.15.81:0/3045045598 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd62c032640 con 0x7fd63015c490 2024-09-16T01:18:57.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.108+0000 7fd6352ab640 1 -- 172.21.15.81:0/3045045598 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62c032a10 con 0x7fd63015c490 2024-09-16T01:18:57.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.109+0000 7fd638511640 1 -- 172.21.15.81:0/3045045598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63015c490 msgr2=0x7fd63009b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.109+0000 7fd638511640 1 --2- 172.21.15.81:0/3045045598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63015c490 0x7fd63009b440 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd62c0097a0 tx=0x7fd62c02a2c0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.109+0000 7fd638511640 1 -- 172.21.15.81:0/3045045598 shutdown_connections 2024-09-16T01:18:57.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.109+0000 7fd638511640 1 --2- 172.21.15.81:0/3045045598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63015c490 0x7fd63009b440 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.109+0000 7fd638511640 1 -- 172.21.15.81:0/3045045598 >> 172.21.15.81:0/3045045598 conn(0x7fd6300d23a0 msgr2=0x7fd6300d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:57.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.109+0000 7fd638511640 1 -- 172.21.15.81:0/3045045598 shutdown_connections 2024-09-16T01:18:57.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.109+0000 7fd638511640 1 -- 172.21.15.81:0/3045045598 wait complete. 2024-09-16T01:18:57.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.110+0000 7fd638511640 1 Processor -- start 2024-09-16T01:18:57.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.110+0000 7fd638511640 1 -- start start 2024-09-16T01:18:57.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd638511640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd63009b980 0x7fd6301e6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd638511640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63015c490 0x7fd6300b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd638511640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd63015cf80 0x7fd6300c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd638511640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd6300d1260 con 0x7fd63015c490 2024-09-16T01:18:57.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd638511640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd6300d0dd0 con 0x7fd63015cf80 2024-09-16T01:18:57.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd638511640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd6300c9470 con 0x7fd63009b980 2024-09-16T01:18:57.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd635aac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63015c490 0x7fd6300b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd635aac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63015c490 0x7fd6300b76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46032/0 (socket says 172.21.15.81:46032) 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd635aac640 1 -- 172.21.15.81:0/2093823019 learned_addr learned my addr 172.21.15.81:0/2093823019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd6362ad640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd63009b980 0x7fd6301e6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd636aae640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd63015cf80 0x7fd6300c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd635aac640 1 -- 172.21.15.81:0/2093823019 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd63009b980 msgr2=0x7fd6301e6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd635aac640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd63009b980 0x7fd6301e6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd635aac640 1 -- 172.21.15.81:0/2093823019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd63015cf80 msgr2=0x7fd6300c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd635aac640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd63015cf80 0x7fd6300c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd635aac640 1 -- 172.21.15.81:0/2093823019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6301e7060 con 0x7fd63015c490 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.111+0000 7fd6362ad640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd63009b980 0x7fd6301e6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.112+0000 7fd635aac640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63015c490 0x7fd6300b76e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd62000c450 tx=0x7fd62000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.112+0000 7fd626ffd640 1 -- 172.21.15.81:0/2093823019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200052d0 con 0x7fd63015c490 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.112+0000 7fd626ffd640 1 -- 172.21.15.81:0/2093823019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd620005470 con 0x7fd63015c490 2024-09-16T01:18:57.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.112+0000 7fd638511640 1 -- 172.21.15.81:0/2093823019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6301e7340 con 0x7fd63015c490 2024-09-16T01:18:57.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.112+0000 7fd626ffd640 1 -- 172.21.15.81:0/2093823019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620012870 con 0x7fd63015c490 2024-09-16T01:18:57.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.112+0000 7fd638511640 1 -- 172.21.15.81:0/2093823019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6301e7900 con 0x7fd63015c490 2024-09-16T01:18:57.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.113+0000 7fd638511640 1 -- 172.21.15.81:0/2093823019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6300d01c0 con 0x7fd63015c490 2024-09-16T01:18:57.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.113+0000 7fd626ffd640 1 -- 172.21.15.81:0/2093823019 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd620012a10 con 0x7fd63015c490 2024-09-16T01:18:57.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.114+0000 7fd626ffd640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd61406c2b0 0x7fd61406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.114+0000 7fd626ffd640 1 -- 172.21.15.81:0/2093823019 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7fd62008add0 con 0x7fd63015c490 2024-09-16T01:18:57.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.114+0000 7fd6362ad640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd61406c2b0 0x7fd61406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.114+0000 7fd6362ad640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd61406c2b0 0x7fd61406e770 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd62c034000 tx=0x7fd62c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:57.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.118+0000 7fd626ffd640 1 -- 172.21.15.81:0/2093823019 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd620059700 con 0x7fd63015c490 2024-09-16T01:18:57.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.286+0000 7fd638511640 1 -- 172.21.15.81:0/2093823019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd6300d3190 con 0x7fd63015c490 2024-09-16T01:18:57.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.287+0000 7fd626ffd640 1 -- 172.21.15.81:0/2093823019 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) ==== 84+0+65 (secure 0 0 0) 0x7fd620059000 con 0x7fd63015c490 2024-09-16T01:18:57.288 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:18:57.289 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-16T01:18:57.289 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:18:57.289 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-16T01:18:57.289 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-16T01:18:57.289 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:18:57.289 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-16T01:18:57.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.288+0000 7fd638511640 1 -- 172.21.15.81:0/2093823019 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd61406c2b0 msgr2=0x7fd61406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.288+0000 7fd638511640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd61406c2b0 0x7fd61406e770 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd62c034000 tx=0x7fd62c02e000 comp rx=0 tx=0).stop 2024-09-16T01:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.288+0000 7fd638511640 1 -- 172.21.15.81:0/2093823019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63015c490 msgr2=0x7fd6300b76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.288+0000 7fd638511640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63015c490 0x7fd6300b76e0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fd62000c450 tx=0x7fd62000c910 comp rx=0 tx=0).stop 2024-09-16T01:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.289+0000 7fd638511640 1 -- 172.21.15.81:0/2093823019 shutdown_connections 2024-09-16T01:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.289+0000 7fd638511640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd61406c2b0 0x7fd61406e770 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.289+0000 7fd638511640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd63015cf80 0x7fd6300c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.289+0000 7fd638511640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd63015c490 0x7fd6300b76e0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.289+0000 7fd638511640 1 --2- 172.21.15.81:0/2093823019 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd63009b980 0x7fd6301e6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.289+0000 7fd638511640 1 -- 172.21.15.81:0/2093823019 >> 172.21.15.81:0/2093823019 conn(0x7fd6300d23a0 msgr2=0x7fd630071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.289+0000 7fd638511640 1 -- 172.21.15.81:0/2093823019 shutdown_connections 2024-09-16T01:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.289+0000 7fd638511640 1 -- 172.21.15.81:0/2093823019 wait complete. 2024-09-16T01:18:57.301 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:18:57.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:18:57.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.401+0000 7f8fc4453640 1 Processor -- start 2024-09-16T01:18:57.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.401+0000 7f8fc4453640 1 -- start start 2024-09-16T01:18:57.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.402+0000 7f8fc4453640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8fbc0cf790 0x7f8fbc0cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.402+0000 7f8fc4453640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fbc0b30e0 con 0x7f8fbc0ce060 2024-09-16T01:18:57.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.402+0000 7f8fc4453640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fbc0b33c0 con 0x7f8fbc156740 2024-09-16T01:18:57.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.402+0000 7f8fc4453640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8fbc0d0140 con 0x7f8fbc0cf790 2024-09-16T01:18:57.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc29f0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8fbc0ce060 0x7f8fbc0ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49000/0 (socket says 172.21.15.81:49000) 2024-09-16T01:18:57.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc29f0640 1 -- 172.21.15.81:0/1404143327 learned_addr learned my addr 172.21.15.81:0/1404143327 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:18:57.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc19ee640 1 --2- 172.21.15.81:0/1404143327 >> v2:172.21.15.102:3300/0 conn(0x7f8fbc0cf790 0x7f8fbc0cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647733515 0 0) 0x7f8fbc0b30e0 con 0x7f8fbc0ce060 2024-09-16T01:18:57.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fa8003520 con 0x7f8fbc0ce060 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101269749 0 0) 0x7f8fbc0b33c0 con 0x7f8fbc156740 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fbc0b30e0 con 0x7f8fbc156740 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3346744931 0 0) 0x7f8fa8003520 con 0x7f8fbc0ce060 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 >> v2:172.21.15.102:3300/0 conn(0x7f8fbc0cf790 msgr2=0x7f8fbc0cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 --2- 172.21.15.81:0/1404143327 >> v2:172.21.15.102:3300/0 conn(0x7f8fbc0cf790 0x7f8fbc0cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 >> v1:172.21.15.102:6789/0 conn(0x7f8fbc156740 legacy=0x7f8fbc0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc0b36a0 con 0x7f8fbc0ce060 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f8fb40019f0 con 0x7f8fbc0ce060 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 >> v1:172.21.15.81:6789/0 conn(0x7f8fbc0ce060 legacy=0x7f8fbc0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 --2- 172.21.15.81:0/1404143327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa8003b40 0x7f8fa8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 --2- 172.21.15.81:0/1404143327 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fa8004800 0x7f8fa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 --2- 172.21.15.81:0/1404143327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80051c0 0x7f8fa800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc0d0140 con 0x7f8fa80051c0 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa800c040 con 0x7f8fa8003b40 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa800c240 con 0x7f8fa8004800 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc29f0640 1 --2- 172.21.15.81:0/1404143327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80051c0 0x7f8fa800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc21ef640 1 --2- 172.21.15.81:0/1404143327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa8003b40 0x7f8fa8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc19ee640 1 --2- 172.21.15.81:0/1404143327 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fa8004800 0x7f8fa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc29f0640 1 -- 172.21.15.81:0/1404143327 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fa8004800 msgr2=0x7f8fa8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc29f0640 1 --2- 172.21.15.81:0/1404143327 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fa8004800 0x7f8fa8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc29f0640 1 -- 172.21.15.81:0/1404143327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa8003b40 msgr2=0x7f8fa8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.403+0000 7f8fc29f0640 1 --2- 172.21.15.81:0/1404143327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fa8003b40 0x7f8fa8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.404+0000 7f8fc29f0640 1 -- 172.21.15.81:0/1404143327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa8003520 con 0x7f8fa80051c0 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.404+0000 7f8fc29f0640 1 -- 172.21.15.81:0/1404143327 reap_dead start 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.404+0000 7f8fc29f0640 1 --2- 172.21.15.81:0/1404143327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80051c0 0x7f8fa800b9c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400a7c0 tx=0x7f8fa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdf83c0f7093151 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:57.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.404+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb400a410 con 0x7f8fa80051c0 2024-09-16T01:18:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.404+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb402f070 con 0x7f8fa80051c0 2024-09-16T01:18:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.404+0000 7f8fc11ed640 1 -- 172.21.15.81:0/1404143327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb402bc20 con 0x7f8fa80051c0 2024-09-16T01:18:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.405+0000 7f8fc4453640 1 -- 172.21.15.81:0/1404143327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80051c0 msgr2=0x7f8fa800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.405+0000 7f8fc4453640 1 --2- 172.21.15.81:0/1404143327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80051c0 0x7f8fa800b9c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400a7c0 tx=0x7f8fa8005830 comp rx=0 tx=0).stop 2024-09-16T01:18:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.405+0000 7f8fc4453640 1 -- 172.21.15.81:0/1404143327 shutdown_connections 2024-09-16T01:18:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.405+0000 7f8fc4453640 1 --2- 172.21.15.81:0/1404143327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fa80051c0 0x7f8fa800b9c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.405+0000 7f8fc4453640 1 -- 172.21.15.81:0/1404143327 >> 172.21.15.81:0/1404143327 conn(0x7f8fbc06bdf0 msgr2=0x7f8fbc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.405+0000 7f8fc4453640 1 -- 172.21.15.81:0/1404143327 shutdown_connections 2024-09-16T01:18:57.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.405+0000 7f8fc4453640 1 -- 172.21.15.81:0/1404143327 wait complete. 2024-09-16T01:18:57.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.406+0000 7f8fc4453640 1 Processor -- start 2024-09-16T01:18:57.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.406+0000 7f8fc4453640 1 -- start start 2024-09-16T01:18:57.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc4453640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fa80051c0 0x7f8fbc15d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc4453640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc14b0d0 0x7f8fbc09cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc4453640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fbc09d000 0x7f8fbc15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc4453640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc0b3c60 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc4453640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8fbc06edc0 con 0x7f8fbc09d000 2024-09-16T01:18:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc4453640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8fbc0d0890 con 0x7f8fa80051c0 2024-09-16T01:18:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc19ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc14b0d0 0x7f8fbc09cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc19ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc14b0d0 0x7f8fbc09cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46060/0 (socket says 172.21.15.81:46060) 2024-09-16T01:18:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc19ee640 1 -- 172.21.15.81:0/1587043963 learned_addr learned my addr 172.21.15.81:0/1587043963 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc21ef640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fa80051c0 0x7f8fbc15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc29f0640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fbc09d000 0x7f8fbc15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc19ee640 1 -- 172.21.15.81:0/1587043963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fa80051c0 msgr2=0x7f8fbc15d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc19ee640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fa80051c0 0x7f8fbc15d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc19ee640 1 -- 172.21.15.81:0/1587043963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fbc09d000 msgr2=0x7f8fbc15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc19ee640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fbc09d000 0x7f8fbc15dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc19ee640 1 -- 172.21.15.81:0/1587043963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fbc160300 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.407+0000 7f8fc19ee640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc14b0d0 0x7f8fbc09cac0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0115a0 tx=0x7f8fac011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.408+0000 7f8fb2ffd640 1 -- 172.21.15.81:0/1587043963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac015930 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.408+0000 7f8fb2ffd640 1 -- 172.21.15.81:0/1587043963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fac015ad0 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.408+0000 7f8fb2ffd640 1 -- 172.21.15.81:0/1587043963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fac00f480 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.408+0000 7f8fc4453640 1 -- 172.21.15.81:0/1587043963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fbc1f2940 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.408+0000 7f8fc4453640 1 -- 172.21.15.81:0/1587043963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fbc15c940 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.409+0000 7f8fc4453640 1 -- 172.21.15.81:0/1587043963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fbc156b20 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.409+0000 7f8fb2ffd640 1 -- 172.21.15.81:0/1587043963 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8fac005990 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.409+0000 7f8fb2ffd640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8fa006c2b0 0x7f8fa006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.410+0000 7f8fb2ffd640 1 -- 172.21.15.81:0/1587043963 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5249+0+0 (secure 0 0 0) 0x7f8fac08bfa0 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.410+0000 7f8fc21ef640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8fa006c2b0 0x7f8fa006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:57.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.410+0000 7f8fc21ef640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8fa006c2b0 0x7f8fa006e770 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8000c00 tx=0x7f8fb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:57.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.414+0000 7f8fb2ffd640 1 -- 172.21.15.81:0/1587043963 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8fac022060 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.581+0000 7f8fc4453640 1 -- 172.21.15.81:0/1587043963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8fbc09d3e0 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.907+0000 7f8fb2ffd640 1 -- 172.21.15.81:0/1587043963 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) ==== 138+0+0 (secure 0 0 0) 0x7f8fac019030 con 0x7f8fbc14b0d0 2024-09-16T01:18:57.909 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-16T01:18:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.909+0000 7f8fc4453640 1 -- 172.21.15.81:0/1587043963 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8fa006c2b0 msgr2=0x7f8fa006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.909+0000 7f8fc4453640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8fa006c2b0 0x7f8fa006e770 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8000c00 tx=0x7f8fb8009040 comp rx=0 tx=0).stop 2024-09-16T01:18:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.909+0000 7f8fc4453640 1 -- 172.21.15.81:0/1587043963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc14b0d0 msgr2=0x7f8fbc09cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.909+0000 7f8fc4453640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc14b0d0 0x7f8fbc09cac0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8fac0115a0 tx=0x7f8fac011a60 comp rx=0 tx=0).stop 2024-09-16T01:18:57.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.910+0000 7f8fc4453640 1 -- 172.21.15.81:0/1587043963 shutdown_connections 2024-09-16T01:18:57.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.910+0000 7f8fc4453640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8fa006c2b0 0x7f8fa006e770 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.910+0000 7f8fc4453640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fbc09d000 0x7f8fbc15dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.910+0000 7f8fc4453640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc14b0d0 0x7f8fbc09cac0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.910+0000 7f8fc4453640 1 --2- 172.21.15.81:0/1587043963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fa80051c0 0x7f8fbc15d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:57.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.910+0000 7f8fc4453640 1 -- 172.21.15.81:0/1587043963 >> 172.21.15.81:0/1587043963 conn(0x7f8fbc06bdf0 msgr2=0x7f8fbc14b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:57.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.910+0000 7f8fc4453640 1 -- 172.21.15.81:0/1587043963 shutdown_connections 2024-09-16T01:18:57.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:57.910+0000 7f8fc4453640 1 -- 172.21.15.81:0/1587043963 wait complete. 2024-09-16T01:18:57.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:18:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.029+0000 7f9cee0b7640 1 Processor -- start 2024-09-16T01:18:58.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.029+0000 7f9cee0b7640 1 -- start start 2024-09-16T01:18:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9cee0b7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ce815e2e0 0x7f9ce80b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9cee0b7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ce80adce0 0x7f9ce80ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9cee0b7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce80ae690 con 0x7f9ce8067ae0 2024-09-16T01:18:58.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9cee0b7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce80aec30 con 0x7f9ce80adce0 2024-09-16T01:18:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9cee0b7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce8067ff0 con 0x7f9ce815e2e0 2024-09-16T01:18:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9ce77fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ce815e2e0 0x7f9ce80b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9ce7fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ce80adce0 0x7f9ce80ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9ce7fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9ce80adce0 0x7f9ce80ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:54150/0 (socket says 172.21.15.81:54150) 2024-09-16T01:18:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9ce6ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f9ce8067ae0 0x7f9ce815f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:45978/0 (socket says 172.21.15.81:45978) 2024-09-16T01:18:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9ce7fff640 1 -- 172.21.15.81:0/4038796394 learned_addr learned my addr 172.21.15.81:0/4038796394 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9ce67fc640 1 -- 172.21.15.81:0/4038796394 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 836513407 0 0) 0x7f9ce80ae690 con 0x7f9ce8067ae0 2024-09-16T01:18:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9ce67fc640 1 -- 172.21.15.81:0/4038796394 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cd4003520 con 0x7f9ce8067ae0 2024-09-16T01:18:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9ce77fe640 1 -- 172.21.15.81:0/4038796394 >> v2:172.21.15.102:3300/0 conn(0x7f9ce80adce0 msgr2=0x7f9ce80ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9ce77fe640 1 --2- 172.21.15.81:0/4038796394 >> v2:172.21.15.102:3300/0 conn(0x7f9ce80adce0 0x7f9ce80ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:58.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9ce77fe640 1 -- 172.21.15.81:0/4038796394 >> v1:172.21.15.102:6789/0 conn(0x7f9ce8067ae0 legacy=0x7f9ce815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9ce77fe640 1 -- 172.21.15.81:0/4038796394 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce80af390 con 0x7f9ce815e2e0 2024-09-16T01:18:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.030+0000 7f9ce7fff640 1 --2- 172.21.15.81:0/4038796394 >> v2:172.21.15.102:3300/0 conn(0x7f9ce80adce0 0x7f9ce80ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:18:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.031+0000 7f9ce77fe640 1 --2- 172.21.15.81:0/4038796394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ce815e2e0 0x7f9ce80b0150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80097a0 tx=0x7f9cd802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a10170bc4a010f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.031+0000 7f9ce67fc640 1 -- 172.21.15.81:0/4038796394 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8037070 con 0x7f9ce815e2e0 2024-09-16T01:18:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.031+0000 7f9ce67fc640 1 -- 172.21.15.81:0/4038796394 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd8032440 con 0x7f9ce815e2e0 2024-09-16T01:18:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.031+0000 7f9ce67fc640 1 -- 172.21.15.81:0/4038796394 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8032810 con 0x7f9ce815e2e0 2024-09-16T01:18:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.032+0000 7f9cee0b7640 1 -- 172.21.15.81:0/4038796394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ce815e2e0 msgr2=0x7f9ce80b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.032+0000 7f9cee0b7640 1 --2- 172.21.15.81:0/4038796394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ce815e2e0 0x7f9ce80b0150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80097a0 tx=0x7f9cd802a180 comp rx=0 tx=0).stop 2024-09-16T01:18:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.032+0000 7f9cee0b7640 1 -- 172.21.15.81:0/4038796394 shutdown_connections 2024-09-16T01:18:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.032+0000 7f9cee0b7640 1 --2- 172.21.15.81:0/4038796394 >> v2:172.21.15.102:3300/0 conn(0x7f9ce80adce0 0x7f9ce80ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.032+0000 7f9cee0b7640 1 --2- 172.21.15.81:0/4038796394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ce815e2e0 0x7f9ce80b0150 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.032+0000 7f9cee0b7640 1 -- 172.21.15.81:0/4038796394 >> 172.21.15.81:0/4038796394 conn(0x7f9ce8073590 msgr2=0x7f9ce806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.032+0000 7f9cee0b7640 1 -- 172.21.15.81:0/4038796394 shutdown_connections 2024-09-16T01:18:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.032+0000 7f9cee0b7640 1 -- 172.21.15.81:0/4038796394 wait complete. 2024-09-16T01:18:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.033+0000 7f9cee0b7640 1 Processor -- start 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.033+0000 7f9cee0b7640 1 -- start start 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9cee0b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ce8067ae0 0x7f9ce80c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9cee0b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce80adce0 0x7f9ce80ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9cee0b7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ce815e2e0 0x7f9ce81f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9cee0b7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce80afc30 con 0x7f9ce8067ae0 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9cee0b7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce80af950 con 0x7f9ce80adce0 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9cee0b7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce815e6c0 con 0x7f9ce815e2e0 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9ce77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ce8067ae0 0x7f9ce80c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9ce77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ce8067ae0 0x7f9ce80c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46062/0 (socket says 172.21.15.81:46062) 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9ce77fe640 1 -- 172.21.15.81:0/551580795 learned_addr learned my addr 172.21.15.81:0/551580795 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9ce6ffd640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce80adce0 0x7f9ce80ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9ce7fff640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ce815e2e0 0x7f9ce81f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9ce77fe640 1 -- 172.21.15.81:0/551580795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ce815e2e0 msgr2=0x7f9ce81f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9ce77fe640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ce815e2e0 0x7f9ce81f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9ce77fe640 1 -- 172.21.15.81:0/551580795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce80adce0 msgr2=0x7f9ce80ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9ce77fe640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce80adce0 0x7f9ce80ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.034+0000 7f9ce77fe640 1 -- 172.21.15.81:0/551580795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce80cf8e0 con 0x7f9ce8067ae0 2024-09-16T01:18:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.035+0000 7f9ce77fe640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ce8067ae0 0x7f9ce80c5de0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8035040 tx=0x7f9cd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.035+0000 7f9cdffff640 1 -- 172.21.15.81:0/551580795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8041030 con 0x7f9ce8067ae0 2024-09-16T01:18:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.035+0000 7f9cdffff640 1 -- 172.21.15.81:0/551580795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd803d4e0 con 0x7f9ce8067ae0 2024-09-16T01:18:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.035+0000 7f9cee0b7640 1 -- 172.21.15.81:0/551580795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce80cfbc0 con 0x7f9ce8067ae0 2024-09-16T01:18:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.035+0000 7f9cdffff640 1 -- 172.21.15.81:0/551580795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8037040 con 0x7f9ce8067ae0 2024-09-16T01:18:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.035+0000 7f9cee0b7640 1 -- 172.21.15.81:0/551580795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce8148f50 con 0x7f9ce8067ae0 2024-09-16T01:18:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.036+0000 7f9cee0b7640 1 -- 172.21.15.81:0/551580795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce80b0150 con 0x7f9ce8067ae0 2024-09-16T01:18:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.037+0000 7f9cdffff640 1 -- 172.21.15.81:0/551580795 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9cd8044070 con 0x7f9ce8067ae0 2024-09-16T01:18:58.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.037+0000 7f9cdffff640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9cc806c2b0 0x7f9cc806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:58.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.037+0000 7f9cdffff640 1 -- 172.21.15.81:0/551580795 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5619+0+0 (secure 0 0 0) 0x7f9cd80ab8b0 con 0x7f9ce8067ae0 2024-09-16T01:18:58.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.037+0000 7f9ce6ffd640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9cc806c2b0 0x7f9cc806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:58.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.037+0000 7f9ce6ffd640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9cc806c2b0 0x7f9cc806e770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80d0630 tx=0x7f9cd0007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:58.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.042+0000 7f9cdffff640 1 -- 172.21.15.81:0/551580795 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9cd8079a30 con 0x7f9ce8067ae0 2024-09-16T01:18:58.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.209+0000 7f9cee0b7640 1 -- 172.21.15.81:0/551580795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9ce80aeff0 con 0x7f9ce8067ae0 2024-09-16T01:18:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.913+0000 7f9cdffff640 1 -- 172.21.15.81:0/551580795 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) ==== 170+0+0 (secure 0 0 0) 0x7f9cd807dd30 con 0x7f9ce8067ae0 2024-09-16T01:18:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-16T01:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.916+0000 7f9cee0b7640 1 -- 172.21.15.81:0/551580795 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9cc806c2b0 msgr2=0x7f9cc806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.916+0000 7f9cee0b7640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9cc806c2b0 0x7f9cc806e770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9ce80d0630 tx=0x7f9cd0007cf0 comp rx=0 tx=0).stop 2024-09-16T01:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.916+0000 7f9cee0b7640 1 -- 172.21.15.81:0/551580795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ce8067ae0 msgr2=0x7f9ce80c5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.916+0000 7f9cee0b7640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ce8067ae0 0x7f9ce80c5de0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8035040 tx=0x7f9cd80046c0 comp rx=0 tx=0).stop 2024-09-16T01:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.916+0000 7f9cee0b7640 1 -- 172.21.15.81:0/551580795 shutdown_connections 2024-09-16T01:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.916+0000 7f9cee0b7640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9cc806c2b0 0x7f9cc806e770 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.916+0000 7f9cee0b7640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ce815e2e0 0x7f9ce81f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.916+0000 7f9cee0b7640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ce80adce0 0x7f9ce80ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.916+0000 7f9cee0b7640 1 --2- 172.21.15.81:0/551580795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ce8067ae0 0x7f9ce80c5de0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.916+0000 7f9cee0b7640 1 -- 172.21.15.81:0/551580795 >> 172.21.15.81:0/551580795 conn(0x7f9ce8073590 msgr2=0x7f9ce806e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.916+0000 7f9cee0b7640 1 -- 172.21.15.81:0/551580795 shutdown_connections 2024-09-16T01:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:58.917+0000 7f9cee0b7640 1 -- 172.21.15.81:0/551580795 wait complete. 2024-09-16T01:18:58.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:18:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.047+0000 7f90ae1e8640 1 Processor -- start 2024-09-16T01:18:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.047+0000 7f90ae1e8640 1 -- start start 2024-09-16T01:18:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90ae1e8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f90a8067ae0 0x7f90a80b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90ae1e8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90a80adce0 0x7f90a80ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90ae1e8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90a80ae690 con 0x7f90a815e2e0 2024-09-16T01:18:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90ae1e8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f90a80aec30 con 0x7f90a80adce0 2024-09-16T01:18:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90ae1e8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f90a8067ff0 con 0x7f90a8067ae0 2024-09-16T01:18:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90a7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90a80adce0 0x7f90a80ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90a7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90a80adce0 0x7f90a80ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46066/0 (socket says 172.21.15.81:46066) 2024-09-16T01:18:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90a7fff640 1 -- 172.21.15.81:0/1638484437 learned_addr learned my addr 172.21.15.81:0/1638484437 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90a7fff640 1 -- 172.21.15.81:0/1638484437 >> v2:172.21.15.102:3300/0 conn(0x7f90a8067ae0 msgr2=0x7f90a80b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90a6ffd640 1 --2- 172.21.15.81:0/1638484437 >> v2:172.21.15.102:3300/0 conn(0x7f90a8067ae0 0x7f90a80b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90a7fff640 1 --2- 172.21.15.81:0/1638484437 >> v2:172.21.15.102:3300/0 conn(0x7f90a8067ae0 0x7f90a80b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90a7fff640 1 -- 172.21.15.81:0/1638484437 >> v1:172.21.15.102:6789/0 conn(0x7f90a815e2e0 legacy=0x7f90a815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:18:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.048+0000 7f90a7fff640 1 -- 172.21.15.81:0/1638484437 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a80af390 con 0x7f90a80adce0 2024-09-16T01:18:59.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.049+0000 7f90a7fff640 1 --2- 172.21.15.81:0/1638484437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a80adce0 0x7f90a80ae150 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f90a80b0690 tx=0x7f90a002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49bf62ddc0eb3ec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:59.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.049+0000 7f90a67fc640 1 -- 172.21.15.81:0/1638484437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0036070 con 0x7f90a80adce0 2024-09-16T01:18:59.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.049+0000 7f90a67fc640 1 -- 172.21.15.81:0/1638484437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a0031600 con 0x7f90a80adce0 2024-09-16T01:18:59.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.049+0000 7f90a67fc640 1 -- 172.21.15.81:0/1638484437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a00319d0 con 0x7f90a80adce0 2024-09-16T01:18:59.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.050+0000 7f90ae1e8640 1 -- 172.21.15.81:0/1638484437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a80adce0 msgr2=0x7f90a80ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.050+0000 7f90ae1e8640 1 --2- 172.21.15.81:0/1638484437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a80adce0 0x7f90a80ae150 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f90a80b0690 tx=0x7f90a002a6f0 comp rx=0 tx=0).stop 2024-09-16T01:18:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.050+0000 7f90ae1e8640 1 -- 172.21.15.81:0/1638484437 shutdown_connections 2024-09-16T01:18:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.050+0000 7f90ae1e8640 1 --2- 172.21.15.81:0/1638484437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a80adce0 0x7f90a80ae150 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.050+0000 7f90ae1e8640 1 --2- 172.21.15.81:0/1638484437 >> v2:172.21.15.102:3300/0 conn(0x7f90a8067ae0 0x7f90a80b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.050+0000 7f90ae1e8640 1 -- 172.21.15.81:0/1638484437 >> 172.21.15.81:0/1638484437 conn(0x7f90a8073590 msgr2=0x7f90a806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.050+0000 7f90ae1e8640 1 -- 172.21.15.81:0/1638484437 shutdown_connections 2024-09-16T01:18:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.050+0000 7f90ae1e8640 1 -- 172.21.15.81:0/1638484437 wait complete. 2024-09-16T01:18:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.051+0000 7f90ae1e8640 1 Processor -- start 2024-09-16T01:18:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.051+0000 7f90ae1e8640 1 -- start start 2024-09-16T01:18:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90ae1e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a8067ae0 0x7f90a81f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90ae1e8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90a80adce0 0x7f90a8149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:59.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90ae1e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90a815e2e0 0x7f90a8161410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90ae1e8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90a80afc30 con 0x7f90a8067ae0 2024-09-16T01:18:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90ae1e8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f90a80af950 con 0x7f90a815e2e0 2024-09-16T01:18:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90ae1e8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f90a815e6c0 con 0x7f90a80adce0 2024-09-16T01:18:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a8067ae0 0x7f90a81f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a8067ae0 0x7f90a81f42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46074/0 (socket says 172.21.15.81:46074) 2024-09-16T01:18:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90a77fe640 1 -- 172.21.15.81:0/853196742 learned_addr learned my addr 172.21.15.81:0/853196742 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:18:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90a7fff640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90a815e2e0 0x7f90a8161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90a6ffd640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90a80adce0 0x7f90a8149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90a77fe640 1 -- 172.21.15.81:0/853196742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90a80adce0 msgr2=0x7f90a8149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90a77fe640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90a80adce0 0x7f90a8149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90a77fe640 1 -- 172.21.15.81:0/853196742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90a815e2e0 msgr2=0x7f90a8161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:59.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90a77fe640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90a815e2e0 0x7f90a8161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90a77fe640 1 -- 172.21.15.81:0/853196742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a80ce950 con 0x7f90a8067ae0 2024-09-16T01:18:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.052+0000 7f90a6ffd640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90a80adce0 0x7f90a8149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:18:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.053+0000 7f90a77fe640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a8067ae0 0x7f90a81f42f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f909800b3f0 tx=0x7f909800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.053+0000 7f908ffff640 1 -- 172.21.15.81:0/853196742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098015020 con 0x7f90a8067ae0 2024-09-16T01:18:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.053+0000 7f908ffff640 1 -- 172.21.15.81:0/853196742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9098011830 con 0x7f90a8067ae0 2024-09-16T01:18:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.053+0000 7f908ffff640 1 -- 172.21.15.81:0/853196742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098011c20 con 0x7f90a8067ae0 2024-09-16T01:18:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.053+0000 7f90ae1e8640 1 -- 172.21.15.81:0/853196742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a80cec30 con 0x7f90a8067ae0 2024-09-16T01:18:59.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.053+0000 7f90ae1e8640 1 -- 172.21.15.81:0/853196742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a8161950 con 0x7f90a8067ae0 2024-09-16T01:18:59.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.054+0000 7f90ae1e8640 1 -- 172.21.15.81:0/853196742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a80b0150 con 0x7f90a8067ae0 2024-09-16T01:18:59.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.054+0000 7f908ffff640 1 -- 172.21.15.81:0/853196742 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9098018020 con 0x7f90a8067ae0 2024-09-16T01:18:59.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.055+0000 7f908ffff640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f909406c2b0 0x7f909406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:18:59.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.055+0000 7f908ffff640 1 -- 172.21.15.81:0/853196742 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6001+0+0 (secure 0 0 0) 0x7f909808b0b0 con 0x7f90a8067ae0 2024-09-16T01:18:59.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.055+0000 7f90a6ffd640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f909406c2b0 0x7f909406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:18:59.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.055+0000 7f90a6ffd640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f909406c2b0 0x7f909406e770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f90a815eb50 tx=0x7f909c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:18:59.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.059+0000 7f908ffff640 1 -- 172.21.15.81:0/853196742 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f909801f030 con 0x7f90a8067ae0 2024-09-16T01:18:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.259+0000 7f90ae1e8640 1 -- 172.21.15.81:0/853196742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f90a815d4e0 con 0x7f90a8067ae0 2024-09-16T01:18:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.925+0000 7f908ffff640 1 -- 172.21.15.81:0/853196742 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v40) ==== 174+0+0 (secure 0 0 0) 0x7f9098059780 con 0x7f90a8067ae0 2024-09-16T01:18:59.929 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 13 and data pool 14 2024-09-16T01:18:59.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.931+0000 7f90ae1e8640 1 -- 172.21.15.81:0/853196742 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f909406c2b0 msgr2=0x7f909406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:59.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.931+0000 7f90ae1e8640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f909406c2b0 0x7f909406e770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f90a815eb50 tx=0x7f909c008040 comp rx=0 tx=0).stop 2024-09-16T01:18:59.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.931+0000 7f90ae1e8640 1 -- 172.21.15.81:0/853196742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a8067ae0 msgr2=0x7f90a81f42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:18:59.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.931+0000 7f90ae1e8640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a8067ae0 0x7f90a81f42f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f909800b3f0 tx=0x7f909800b8b0 comp rx=0 tx=0).stop 2024-09-16T01:18:59.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.937+0000 7f90ae1e8640 1 -- 172.21.15.81:0/853196742 shutdown_connections 2024-09-16T01:18:59.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.937+0000 7f90ae1e8640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f909406c2b0 0x7f909406e770 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:59.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.937+0000 7f90ae1e8640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90a815e2e0 0x7f90a8161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:59.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.937+0000 7f90ae1e8640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90a80adce0 0x7f90a8149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:59.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.937+0000 7f90ae1e8640 1 --2- 172.21.15.81:0/853196742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90a8067ae0 0x7f90a81f42f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:18:59.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.937+0000 7f90ae1e8640 1 -- 172.21.15.81:0/853196742 >> 172.21.15.81:0/853196742 conn(0x7f90a8073590 msgr2=0x7f90a815c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:18:59.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.940+0000 7f90ae1e8640 1 -- 172.21.15.81:0/853196742 shutdown_connections 2024-09-16T01:18:59.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:18:59.940+0000 7f90ae1e8640 1 -- 172.21.15.81:0/853196742 wait complete. 2024-09-16T01:18:59.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:19:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.055+0000 7fbbc79bd640 1 Processor -- start 2024-09-16T01:19:00.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.055+0000 7fbbc79bd640 1 -- start start 2024-09-16T01:19:00.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.056+0000 7fbbc79bd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc015e740 0x7fbbc00d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.056+0000 7fbbc79bd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc006e040 con 0x7fbbc009b690 2024-09-16T01:19:00.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.056+0000 7fbbc79bd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc00d0780 con 0x7fbbc006dbd0 2024-09-16T01:19:00.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.056+0000 7fbbc79bd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc015eb20 con 0x7fbbc015e740 2024-09-16T01:19:00.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.056+0000 7fbbc4f58640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbbc009b690 0x7fbbc006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49012/0 (socket says 172.21.15.81:49012) 2024-09-16T01:19:00.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.056+0000 7fbbc4f58640 1 -- 172.21.15.81:0/59992648 learned_addr learned my addr 172.21.15.81:0/59992648 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:00.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.056+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3874260994 0 0) 0x7fbbc006e040 con 0x7fbbc009b690 2024-09-16T01:19:00.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.056+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbac003520 con 0x7fbbc009b690 2024-09-16T01:19:00.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.056+0000 7fbbc5759640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc015e740 0x7fbbc00d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2466432697 0 0) 0x7fbbac003520 con 0x7fbbc009b690 2024-09-16T01:19:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc015e740 msgr2=0x7fbbc00d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc015e740 0x7fbbc00d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 >> v1:172.21.15.102:6789/0 conn(0x7fbbc006dbd0 legacy=0x7fbbc0070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc00d0a60 con 0x7fbbc009b690 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fbbb0001670 con 0x7fbbc009b690 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbc5759640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc015e740 0x7fbbc00d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 >> v1:172.21.15.81:6789/0 conn(0x7fbbc009b690 legacy=0x7fbbc006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc015e740 0x7fbbac0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac003fd0 0x7fbbac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbac004d40 0x7fbbac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc015eb20 con 0x7fbbac003fd0 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac00bbb0 con 0x7fbbac004d40 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac00bdb0 con 0x7fbbc015e740 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbc4f58640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac003fd0 0x7fbbac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbc5759640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc015e740 0x7fbbac0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbc5f5a640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbac004d40 0x7fbbac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbc4f58640 1 -- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc015e740 msgr2=0x7fbbac0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbc4f58640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc015e740 0x7fbbac0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbc4f58640 1 -- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbac004d40 msgr2=0x7fbbac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbc4f58640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbac004d40 0x7fbbac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbc4f58640 1 -- 172.21.15.81:0/59992648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac003520 con 0x7fbbac003fd0 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.057+0000 7fbbc5759640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc015e740 0x7fbbac0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.058+0000 7fbbc4f58640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac003fd0 0x7fbbac004800 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00c5ea0 tx=0x7fbbac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6478007c72f188ca server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.058+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0007d30 con 0x7fbbac003fd0 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.058+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb0005af0 con 0x7fbbac003fd0 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.058+0000 7fbbb7fff640 1 -- 172.21.15.81:0/59992648 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0007070 con 0x7fbbac003fd0 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.058+0000 7fbbc79bd640 1 -- 172.21.15.81:0/59992648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac003fd0 msgr2=0x7fbbac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.058+0000 7fbbc79bd640 1 --2- 172.21.15.81:0/59992648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbac003fd0 0x7fbbac004800 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00c5ea0 tx=0x7fbbac005830 comp rx=0 tx=0).stop 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.058+0000 7fbbc5f5a640 1 -- 172.21.15.81:0/59992648 reap_dead start 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.059+0000 7fbbc79bd640 1 -- 172.21.15.81:0/59992648 shutdown_connections 2024-09-16T01:19:00.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.059+0000 7fbbc79bd640 1 -- 172.21.15.81:0/59992648 >> 172.21.15.81:0/59992648 conn(0x7fbbc00d23a0 msgr2=0x7fbbc00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:00.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.059+0000 7fbbc79bd640 1 -- 172.21.15.81:0/59992648 shutdown_connections 2024-09-16T01:19:00.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.059+0000 7fbbc79bd640 1 -- 172.21.15.81:0/59992648 wait complete. 2024-09-16T01:19:00.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.060+0000 7fbbc79bd640 1 Processor -- start 2024-09-16T01:19:00.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.060+0000 7fbbc79bd640 1 -- start start 2024-09-16T01:19:00.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.060+0000 7fbbc79bd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbac003fd0 0x7fbbc015d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.060+0000 7fbbc79bd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc00cbdd0 0x7fbbc00b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc79bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc00cc210 0x7fbbc00b7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc79bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc009ba90 con 0x7fbbc00cc210 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc79bd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc00d1020 con 0x7fbbac003fd0 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc79bd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc00d1540 con 0x7fbbc00cbdd0 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc5f5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc00cc210 0x7fbbc00b7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc5f5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc00cc210 0x7fbbc00b7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46080/0 (socket says 172.21.15.81:46080) 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc5f5a640 1 -- 172.21.15.81:0/589411739 learned_addr learned my addr 172.21.15.81:0/589411739 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc4f58640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc00cbdd0 0x7fbbc00b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc5759640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbac003fd0 0x7fbbc015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc5f5a640 1 -- 172.21.15.81:0/589411739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc00cbdd0 msgr2=0x7fbbc00b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc5f5a640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc00cbdd0 0x7fbbc00b73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc5f5a640 1 -- 172.21.15.81:0/589411739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbac003fd0 msgr2=0x7fbbc015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc5f5a640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbac003fd0 0x7fbbc015d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc5f5a640 1 -- 172.21.15.81:0/589411739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc015db10 con 0x7fbbc00cc210 2024-09-16T01:19:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc5f5a640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc00cc210 0x7fbbc00b7900 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbbc006cba0 tx=0x7fbbb800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbb5ffb640 1 -- 172.21.15.81:0/589411739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8003970 con 0x7fbbc00cc210 2024-09-16T01:19:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbb5ffb640 1 -- 172.21.15.81:0/589411739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb8018070 con 0x7fbbc00cc210 2024-09-16T01:19:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbb5ffb640 1 -- 172.21.15.81:0/589411739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8003d50 con 0x7fbbc00cc210 2024-09-16T01:19:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.061+0000 7fbbc79bd640 1 -- 172.21.15.81:0/589411739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc00cb440 con 0x7fbbc00cc210 2024-09-16T01:19:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.062+0000 7fbbc79bd640 1 -- 172.21.15.81:0/589411739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc009c3f0 con 0x7fbbc00cc210 2024-09-16T01:19:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.062+0000 7fbbc79bd640 1 -- 172.21.15.81:0/589411739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc00d18b0 con 0x7fbbc00cc210 2024-09-16T01:19:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.063+0000 7fbbb5ffb640 1 -- 172.21.15.81:0/589411739 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbbb80050d0 con 0x7fbbc00cc210 2024-09-16T01:19:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.063+0000 7fbbb5ffb640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbba406c2e0 0x7fbba406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.063+0000 7fbbb5ffb640 1 -- 172.21.15.81:0/589411739 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7fbbb808b090 con 0x7fbbc00cc210 2024-09-16T01:19:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.063+0000 7fbbc5759640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbba406c2e0 0x7fbba406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.064+0000 7fbbc5759640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbba406c2e0 0x7fbba406e7a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc006fd0 tx=0x7fbbbc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:00.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.067+0000 7fbbb5ffb640 1 -- 172.21.15.81:0/589411739 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbbb8059020 con 0x7fbbc00cc210 2024-09-16T01:19:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.233+0000 7fbbc79bd640 1 -- 172.21.15.81:0/589411739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbc00d1cb0 con 0x7fbbc00cc210 2024-09-16T01:19:00.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.234+0000 7fbbb5ffb640 1 -- 172.21.15.81:0/589411739 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16958 (secure 0 0 0) 0x7fbbb805d320 con 0x7fbbc00cc210 2024-09-16T01:19:00.236 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:00.237 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":86,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:59.261484+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:18:57.600304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-16T01:18:58.228275+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:19:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.236+0000 7fbbc79bd640 1 -- 172.21.15.81:0/589411739 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbba406c2e0 msgr2=0x7fbba406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.236+0000 7fbbc79bd640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbba406c2e0 0x7fbba406e7a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc006fd0 tx=0x7fbbbc008040 comp rx=0 tx=0).stop 2024-09-16T01:19:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.236+0000 7fbbc79bd640 1 -- 172.21.15.81:0/589411739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc00cc210 msgr2=0x7fbbc00b7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.236+0000 7fbbc79bd640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc00cc210 0x7fbbc00b7900 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbbc006cba0 tx=0x7fbbb800eb90 comp rx=0 tx=0).stop 2024-09-16T01:19:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.236+0000 7fbbc79bd640 1 -- 172.21.15.81:0/589411739 shutdown_connections 2024-09-16T01:19:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.236+0000 7fbbc79bd640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbba406c2e0 0x7fbba406e7a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.236+0000 7fbbc79bd640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbc00cc210 0x7fbbc00b7900 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.236+0000 7fbbc79bd640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbbc00cbdd0 0x7fbbc00b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.236+0000 7fbbc79bd640 1 --2- 172.21.15.81:0/589411739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbbac003fd0 0x7fbbc015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.236+0000 7fbbc79bd640 1 -- 172.21.15.81:0/589411739 >> 172.21.15.81:0/589411739 conn(0x7fbbc00d23a0 msgr2=0x7fbbc00b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.236+0000 7fbbc79bd640 1 -- 172.21.15.81:0/589411739 shutdown_connections 2024-09-16T01:19:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.236+0000 7fbbc79bd640 1 -- 172.21.15.81:0/589411739 wait complete. 2024-09-16T01:19:00.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:19:00.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.345+0000 7ff5ea4e4640 1 Processor -- start 2024-09-16T01:19:00.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.345+0000 7ff5ea4e4640 1 -- start start 2024-09-16T01:19:00.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5ea4e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5e415e740 0x7ff5e40d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5ea4e4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff5e409b690 0x7ff5e406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5ea4e4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5e40d0780 con 0x7ff5e406d4c0 2024-09-16T01:19:00.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5ea4e4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e415eb20 con 0x7ff5e415e740 2024-09-16T01:19:00.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5ea4e4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff5e406d260 con 0x7ff5e409b690 2024-09-16T01:19:00.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5e3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5e415e740 0x7ff5e40d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5e3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5e415e740 0x7ff5e40d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46084/0 (socket says 172.21.15.81:46084) 2024-09-16T01:19:00.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5e3fff640 1 -- 172.21.15.81:0/3815977984 learned_addr learned my addr 172.21.15.81:0/3815977984 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:00.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5e37fe640 1 --2- 172.21.15.81:0/3815977984 >> v2:172.21.15.102:3300/0 conn(0x7ff5e409b690 0x7ff5e406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5e3fff640 1 -- 172.21.15.81:0/3815977984 >> v2:172.21.15.102:3300/0 conn(0x7ff5e409b690 msgr2=0x7ff5e406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:00.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5e3fff640 1 --2- 172.21.15.81:0/3815977984 >> v2:172.21.15.102:3300/0 conn(0x7ff5e409b690 0x7ff5e406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5e3fff640 1 -- 172.21.15.81:0/3815977984 >> v1:172.21.15.102:6789/0 conn(0x7ff5e406d4c0 legacy=0x7ff5e406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.346+0000 7ff5e3fff640 1 -- 172.21.15.81:0/3815977984 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e40d0a60 con 0x7ff5e415e740 2024-09-16T01:19:00.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.347+0000 7ff5e3fff640 1 --2- 172.21.15.81:0/3815977984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e415e740 0x7ff5e40d1540 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40691b0 tx=0x7ff5d402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9dc4360b035dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:00.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.347+0000 7ff5e2ffd640 1 -- 172.21.15.81:0/3815977984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4037070 con 0x7ff5e415e740 2024-09-16T01:19:00.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.347+0000 7ff5e2ffd640 1 -- 172.21.15.81:0/3815977984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d402ae50 con 0x7ff5e415e740 2024-09-16T01:19:00.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.347+0000 7ff5e2ffd640 1 -- 172.21.15.81:0/3815977984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4032860 con 0x7ff5e415e740 2024-09-16T01:19:00.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.348+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/3815977984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e415e740 msgr2=0x7ff5e40d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.348+0000 7ff5ea4e4640 1 --2- 172.21.15.81:0/3815977984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e415e740 0x7ff5e40d1540 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff5e40691b0 tx=0x7ff5d402a300 comp rx=0 tx=0).stop 2024-09-16T01:19:00.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.348+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/3815977984 shutdown_connections 2024-09-16T01:19:00.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.348+0000 7ff5ea4e4640 1 --2- 172.21.15.81:0/3815977984 >> v2:172.21.15.102:3300/0 conn(0x7ff5e409b690 0x7ff5e406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.348+0000 7ff5ea4e4640 1 --2- 172.21.15.81:0/3815977984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e415e740 0x7ff5e40d1540 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.348+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/3815977984 >> 172.21.15.81:0/3815977984 conn(0x7ff5e40d23a0 msgr2=0x7ff5e40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:00.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.348+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/3815977984 shutdown_connections 2024-09-16T01:19:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.348+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/3815977984 wait complete. 2024-09-16T01:19:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.349+0000 7ff5ea4e4640 1 Processor -- start 2024-09-16T01:19:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.349+0000 7ff5ea4e4640 1 -- start start 2024-09-16T01:19:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5ea4e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e406d4c0 0x7ff5e40b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5ea4e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5e409b690 0x7ff5e40cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5ea4e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5e415e740 0x7ff5e40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5ea4e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e409bac0 con 0x7ff5e406d4c0 2024-09-16T01:19:00.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5ea4e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e40d1020 con 0x7ff5e409b690 2024-09-16T01:19:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5ea4e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff5e406dfe0 con 0x7ff5e415e740 2024-09-16T01:19:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e406d4c0 0x7ff5e40b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e406d4c0 0x7ff5e40b5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46094/0 (socket says 172.21.15.81:46094) 2024-09-16T01:19:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5e3fff640 1 -- 172.21.15.81:0/2790012861 learned_addr learned my addr 172.21.15.81:0/2790012861 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5e8a81640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5e415e740 0x7ff5e40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5e37fe640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5e409b690 0x7ff5e40cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5e3fff640 1 -- 172.21.15.81:0/2790012861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5e415e740 msgr2=0x7ff5e40cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5e3fff640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5e415e740 0x7ff5e40cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5e3fff640 1 -- 172.21.15.81:0/2790012861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5e409b690 msgr2=0x7ff5e40cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5e3fff640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5e409b690 0x7ff5e40cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5e3fff640 1 -- 172.21.15.81:0/2790012861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e40cba70 con 0x7ff5e406d4c0 2024-09-16T01:19:00.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.350+0000 7ff5e3fff640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e406d4c0 0x7ff5e40b5c00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4000c00 tx=0x7ff5d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:00.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.351+0000 7ff5e0ff9640 1 -- 172.21.15.81:0/2790012861 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4041020 con 0x7ff5e406d4c0 2024-09-16T01:19:00.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.351+0000 7ff5e0ff9640 1 -- 172.21.15.81:0/2790012861 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d403c890 con 0x7ff5e406d4c0 2024-09-16T01:19:00.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.351+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/2790012861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e40b7990 con 0x7ff5e406d4c0 2024-09-16T01:19:00.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.351+0000 7ff5e0ff9640 1 -- 172.21.15.81:0/2790012861 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4037040 con 0x7ff5e406d4c0 2024-09-16T01:19:00.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.351+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/2790012861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e40b7f50 con 0x7ff5e406d4c0 2024-09-16T01:19:00.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.352+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/2790012861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e406cd20 con 0x7ff5e406d4c0 2024-09-16T01:19:00.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.352+0000 7ff5e0ff9640 1 -- 172.21.15.81:0/2790012861 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff5d4044020 con 0x7ff5e406d4c0 2024-09-16T01:19:00.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.352+0000 7ff5e0ff9640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5d006c2e0 0x7ff5d006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.353+0000 7ff5e0ff9640 1 -- 172.21.15.81:0/2790012861 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7ff5d40abf30 con 0x7ff5e406d4c0 2024-09-16T01:19:00.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.353+0000 7ff5e37fe640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5d006c2e0 0x7ff5d006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.353+0000 7ff5e37fe640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5d006c2e0 0x7ff5d006e7a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff5e41f7ba0 tx=0x7ff5d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:00.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.357+0000 7ff5e0ff9640 1 -- 172.21.15.81:0/2790012861 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5d404b030 con 0x7ff5e406d4c0 2024-09-16T01:19:00.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.524+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/2790012861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5e415cae0 con 0x7ff5e406d4c0 2024-09-16T01:19:00.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.525+0000 7ff5e0ff9640 1 -- 172.21.15.81:0/2790012861 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+16958 (secure 0 0 0) 0x7ff5d407a480 con 0x7ff5e406d4c0 2024-09-16T01:19:00.527 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:00.528 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":86,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:18:59.261484+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:18:57.600304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-16T01:18:58.228275+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:19:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.528+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/2790012861 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5d006c2e0 msgr2=0x7ff5d006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.528+0000 7ff5ea4e4640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5d006c2e0 0x7ff5d006e7a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff5e41f7ba0 tx=0x7ff5d8008040 comp rx=0 tx=0).stop 2024-09-16T01:19:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.528+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/2790012861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e406d4c0 msgr2=0x7ff5e40b5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.528+0000 7ff5ea4e4640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e406d4c0 0x7ff5e40b5c00 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4000c00 tx=0x7ff5d40046c0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.528+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/2790012861 shutdown_connections 2024-09-16T01:19:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.528+0000 7ff5ea4e4640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5d006c2e0 0x7ff5d006e7a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.528+0000 7ff5ea4e4640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5e415e740 0x7ff5e40cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.528+0000 7ff5ea4e4640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5e409b690 0x7ff5e40cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.528+0000 7ff5ea4e4640 1 --2- 172.21.15.81:0/2790012861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5e406d4c0 0x7ff5e40b5c00 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.528+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/2790012861 >> 172.21.15.81:0/2790012861 conn(0x7ff5e40d23a0 msgr2=0x7ff5e40ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.528+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/2790012861 shutdown_connections 2024-09-16T01:19:00.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.528+0000 7ff5ea4e4640 1 -- 172.21.15.81:0/2790012861 wait complete. 2024-09-16T01:19:00.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:19:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.640+0000 7f9e0840e640 1 Processor -- start 2024-09-16T01:19:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.640+0000 7f9e0840e640 1 -- start start 2024-09-16T01:19:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.641+0000 7f9e0840e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9e00162340 0x7f9e0006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.641+0000 7f9e0840e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e000cf280 0x7f9e00162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.641+0000 7f9e0840e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e00162c60 0x7f9e000d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.641+0000 7f9e0840e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9e0006de90 con 0x7f9e00162c60 2024-09-16T01:19:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.641+0000 7f9e0840e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9e0015ff70 con 0x7f9e00162340 2024-09-16T01:19:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.641+0000 7f9e0840e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e000d4d10 con 0x7f9e000cf280 2024-09-16T01:19:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.642+0000 7f9e069ab640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e00162c60 0x7f9e000d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.642+0000 7f9e069ab640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e00162c60 0x7f9e000d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46110/0 (socket says 172.21.15.81:46110) 2024-09-16T01:19:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.642+0000 7f9e069ab640 1 -- 172.21.15.81:0/596554807 learned_addr learned my addr 172.21.15.81:0/596554807 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:00.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.642+0000 7f9e061aa640 1 --2- 172.21.15.81:0/596554807 >> v2:172.21.15.102:3300/0 conn(0x7f9e00162340 0x7f9e0006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.642+0000 7f9e059a9640 1 --2- 172.21.15.81:0/596554807 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e000cf280 0x7f9e00162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.642+0000 7f9e069ab640 1 -- 172.21.15.81:0/596554807 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e000cf280 msgr2=0x7f9e00162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.642+0000 7f9e069ab640 1 --2- 172.21.15.81:0/596554807 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e000cf280 0x7f9e00162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.642+0000 7f9e069ab640 1 -- 172.21.15.81:0/596554807 >> v2:172.21.15.102:3300/0 conn(0x7f9e00162340 msgr2=0x7f9e0006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.642+0000 7f9e069ab640 1 --2- 172.21.15.81:0/596554807 >> v2:172.21.15.102:3300/0 conn(0x7f9e00162340 0x7f9e0006d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.642+0000 7f9e069ab640 1 -- 172.21.15.81:0/596554807 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e000d4ff0 con 0x7f9e00162c60 2024-09-16T01:19:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.642+0000 7f9e061aa640 1 --2- 172.21.15.81:0/596554807 >> v2:172.21.15.102:3300/0 conn(0x7f9e00162340 0x7f9e0006d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e069ab640 1 --2- 172.21.15.81:0/596554807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e00162c60 0x7f9e000d2990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9e0008e4c0 tx=0x7f9df802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367350273f5a1d12 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e051a8640 1 -- 172.21.15.81:0/596554807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8036070 con 0x7f9e00162c60 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e051a8640 1 -- 172.21.15.81:0/596554807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df8031600 con 0x7f9e00162c60 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e051a8640 1 -- 172.21.15.81:0/596554807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df80319d0 con 0x7f9e00162c60 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e0840e640 1 -- 172.21.15.81:0/596554807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e00162c60 msgr2=0x7f9e000d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e0840e640 1 --2- 172.21.15.81:0/596554807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e00162c60 0x7f9e000d2990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9e0008e4c0 tx=0x7f9df802a610 comp rx=0 tx=0).stop 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e0840e640 1 -- 172.21.15.81:0/596554807 shutdown_connections 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e0840e640 1 --2- 172.21.15.81:0/596554807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e00162c60 0x7f9e000d2990 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e0840e640 1 --2- 172.21.15.81:0/596554807 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e000cf280 0x7f9e00162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e0840e640 1 --2- 172.21.15.81:0/596554807 >> v2:172.21.15.102:3300/0 conn(0x7f9e00162340 0x7f9e0006d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e0840e640 1 -- 172.21.15.81:0/596554807 >> 172.21.15.81:0/596554807 conn(0x7f9e0008bfc0 msgr2=0x7f9e000d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e0840e640 1 -- 172.21.15.81:0/596554807 shutdown_connections 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.643+0000 7f9e0840e640 1 -- 172.21.15.81:0/596554807 wait complete. 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.645+0000 7f9e0840e640 1 Processor -- start 2024-09-16T01:19:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.645+0000 7f9e0840e640 1 -- start start 2024-09-16T01:19:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.645+0000 7f9e0840e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e000cf280 0x7f9e00155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.645+0000 7f9e0840e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e00162340 0x7f9e000cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.645+0000 7f9e0840e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e00162c60 0x7f9e000cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.645+0000 7f9e0840e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e000cf6c0 con 0x7f9e00162c60 2024-09-16T01:19:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.645+0000 7f9e0840e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e000d52d0 con 0x7f9e00162340 2024-09-16T01:19:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.645+0000 7f9e0840e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e001630f0 con 0x7f9e000cf280 2024-09-16T01:19:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.645+0000 7f9e069ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e00162c60 0x7f9e000cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.645+0000 7f9e069ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e00162c60 0x7f9e000cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46122/0 (socket says 172.21.15.81:46122) 2024-09-16T01:19:00.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.645+0000 7f9e069ab640 1 -- 172.21.15.81:0/1275986771 learned_addr learned my addr 172.21.15.81:0/1275986771 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9e059a9640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e00162340 0x7f9e000cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9e061aa640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e000cf280 0x7f9e00155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9e069ab640 1 -- 172.21.15.81:0/1275986771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e000cf280 msgr2=0x7f9e00155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9e069ab640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e000cf280 0x7f9e00155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9e069ab640 1 -- 172.21.15.81:0/1275986771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e00162340 msgr2=0x7f9e000cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9e069ab640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e00162340 0x7f9e000cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9e069ab640 1 -- 172.21.15.81:0/1275986771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e000cc620 con 0x7f9e00162c60 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9e069ab640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e00162c60 0x7f9e000cbae0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009f40 tx=0x7f9df8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9df6ffd640 1 -- 172.21.15.81:0/1275986771 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8041020 con 0x7f9e00162c60 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9df6ffd640 1 -- 172.21.15.81:0/1275986771 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df80077a0 con 0x7f9e00162c60 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9e0840e640 1 -- 172.21.15.81:0/1275986771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e000cc900 con 0x7f9e00162c60 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9df6ffd640 1 -- 172.21.15.81:0/1275986771 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8036040 con 0x7f9e00162c60 2024-09-16T01:19:00.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.646+0000 7f9e0840e640 1 -- 172.21.15.81:0/1275986771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e00156d50 con 0x7f9e00162c60 2024-09-16T01:19:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.647+0000 7f9e0840e640 1 -- 172.21.15.81:0/1275986771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e00156f50 con 0x7f9e00162c60 2024-09-16T01:19:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.648+0000 7f9df6ffd640 1 -- 172.21.15.81:0/1275986771 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9df8044020 con 0x7f9e00162c60 2024-09-16T01:19:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.648+0000 7f9df6ffd640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9de406c2b0 0x7f9de406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.648+0000 7f9df6ffd640 1 -- 172.21.15.81:0/1275986771 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6101+0+0 (secure 0 0 0) 0x7f9df80ac2e0 con 0x7f9e00162c60 2024-09-16T01:19:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.648+0000 7f9e061aa640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9de406c2b0 0x7f9de406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:00.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.648+0000 7f9e061aa640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9de406c2b0 0x7f9de406e770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00b840 tx=0x7f9dfc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:00.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.652+0000 7f9df6ffd640 1 -- 172.21.15.81:0/1275986771 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e00156f50 con 0x7f9e00162c60 2024-09-16T01:19:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:00.852+0000 7f9e0840e640 1 -- 172.21.15.81:0/1275986771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9e00162720 con 0x7f9e00162c60 2024-09-16T01:19:00.907 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-16T01:19:00.906+0000 7f3837a5c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:19:01.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.841+0000 7f9df6ffd640 1 -- 172.21.15.81:0/1275986771 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) ==== 118+0+0 (secure 0 0 0) 0x7f9df804b030 con 0x7f9e00162c60 2024-09-16T01:19:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.844+0000 7f9e0840e640 1 -- 172.21.15.81:0/1275986771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9de406c2b0 msgr2=0x7f9de406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.844+0000 7f9e0840e640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9de406c2b0 0x7f9de406e770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc00b840 tx=0x7f9dfc008040 comp rx=0 tx=0).stop 2024-09-16T01:19:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.844+0000 7f9e0840e640 1 -- 172.21.15.81:0/1275986771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e00162c60 msgr2=0x7f9e000cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.844+0000 7f9e0840e640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e00162c60 0x7f9e000cbae0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009f40 tx=0x7f9df8004a40 comp rx=0 tx=0).stop 2024-09-16T01:19:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.844+0000 7f9e0840e640 1 -- 172.21.15.81:0/1275986771 shutdown_connections 2024-09-16T01:19:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.844+0000 7f9e0840e640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9de406c2b0 0x7f9de406e770 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.844+0000 7f9e0840e640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e00162c60 0x7f9e000cbae0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.844+0000 7f9e0840e640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e00162340 0x7f9e000cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.844+0000 7f9e0840e640 1 --2- 172.21.15.81:0/1275986771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e000cf280 0x7f9e00155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.844+0000 7f9e0840e640 1 -- 172.21.15.81:0/1275986771 >> 172.21.15.81:0/1275986771 conn(0x7f9e0008bfc0 msgr2=0x7f9e000d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.844+0000 7f9e0840e640 1 -- 172.21.15.81:0/1275986771 shutdown_connections 2024-09-16T01:19:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.844+0000 7f9e0840e640 1 -- 172.21.15.81:0/1275986771 wait complete. 2024-09-16T01:19:01.859 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T01:19:01.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:19:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.966+0000 7f0ea522c640 1 Processor -- start 2024-09-16T01:19:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.966+0000 7f0ea522c640 1 -- start start 2024-09-16T01:19:01.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.967+0000 7f0ea522c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0ea0159f90 0x7f0ea006f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:01.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.967+0000 7f0ea522c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea00b3d10 con 0x7f0ea0160560 2024-09-16T01:19:01.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.967+0000 7f0ea522c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea00b3ff0 con 0x7f0ea006ff10 2024-09-16T01:19:01.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.967+0000 7f0ea522c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea00b4db0 con 0x7f0ea0159f90 2024-09-16T01:19:01.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.967+0000 7f0e9f59e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0ea0160560 0x7f0ea00cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49538/0 (socket says 172.21.15.81:49538) 2024-09-16T01:19:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.967+0000 7f0e9f59e640 1 -- 172.21.15.81:0/2053419232 learned_addr learned my addr 172.21.15.81:0/2053419232 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.967+0000 7f0e9ed9d640 1 --2- 172.21.15.81:0/2053419232 >> v2:172.21.15.102:3300/0 conn(0x7f0ea0159f90 0x7f0ea006f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.967+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3398974377 0 0) 0x7f0ea00b3d10 con 0x7f0ea0160560 2024-09-16T01:19:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.967+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e8c003520 con 0x7f0ea0160560 2024-09-16T01:19:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3256480080 0 0) 0x7f0e8c003520 con 0x7f0ea0160560 2024-09-16T01:19:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 >> v2:172.21.15.102:3300/0 conn(0x7f0ea0159f90 msgr2=0x7f0ea006f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 --2- 172.21.15.81:0/2053419232 >> v2:172.21.15.102:3300/0 conn(0x7f0ea0159f90 0x7f0ea006f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 >> v1:172.21.15.102:6789/0 conn(0x7f0ea006ff10 legacy=0x7f0ea015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea00b42d0 con 0x7f0ea0160560 2024-09-16T01:19:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f0e980019f0 con 0x7f0ea0160560 2024-09-16T01:19:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9ed9d640 1 --2- 172.21.15.81:0/2053419232 >> v2:172.21.15.102:3300/0 conn(0x7f0ea0159f90 0x7f0ea006f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:19:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 >> v1:172.21.15.81:6789/0 conn(0x7f0ea0160560 legacy=0x7f0ea00cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 --2- 172.21.15.81:0/2053419232 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e8c0039b0 0x7f0e8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 --2- 172.21.15.81:0/2053419232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8c004800 0x7f0e8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:01.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 --2- 172.21.15.81:0/2053419232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e8c0051c0 0x7f0e8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:01.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00b4db0 con 0x7f0e8c004800 2024-09-16T01:19:01.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0e8c00c160 con 0x7f0e8c0051c0 2024-09-16T01:19:01.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0e8c00c360 con 0x7f0e8c0039b0 2024-09-16T01:19:01.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9659c640 1 --2- 172.21.15.81:0/2053419232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8c004800 0x7f0e8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:01.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9f59e640 1 --2- 172.21.15.81:0/2053419232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e8c0051c0 0x7f0e8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:01.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9ed9d640 1 --2- 172.21.15.81:0/2053419232 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e8c0039b0 0x7f0e8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:01.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9659c640 1 -- 172.21.15.81:0/2053419232 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e8c0039b0 msgr2=0x7f0e8c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:01.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9659c640 1 --2- 172.21.15.81:0/2053419232 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e8c0039b0 0x7f0e8c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:01.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9659c640 1 -- 172.21.15.81:0/2053419232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e8c0051c0 msgr2=0x7f0e8c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:01.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9659c640 1 --2- 172.21.15.81:0/2053419232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e8c0051c0 0x7f0e8c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:01.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9659c640 1 -- 172.21.15.81:0/2053419232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e8c003520 con 0x7f0e8c004800 2024-09-16T01:19:01.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.968+0000 7f0e9f59e640 1 -- 172.21.15.81:0/2053419232 reap_dead start 2024-09-16T01:19:01.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.969+0000 7f0e9659c640 1 --2- 172.21.15.81:0/2053419232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8c004800 0x7f0e8c004c80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0e88001750 tx=0x7f0e8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb6ba89224aa30 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:01.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.969+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88001370 con 0x7f0e8c004800 2024-09-16T01:19:01.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.969+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e880052d0 con 0x7f0e8c004800 2024-09-16T01:19:01.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.969+0000 7f0e9e59c640 1 -- 172.21.15.81:0/2053419232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8802abc0 con 0x7f0e8c004800 2024-09-16T01:19:01.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.969+0000 7f0ea522c640 1 -- 172.21.15.81:0/2053419232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8c004800 msgr2=0x7f0e8c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:01.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.969+0000 7f0ea522c640 1 --2- 172.21.15.81:0/2053419232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8c004800 0x7f0e8c004c80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0e88001750 tx=0x7f0e8c005830 comp rx=0 tx=0).stop 2024-09-16T01:19:01.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.969+0000 7f0ea522c640 1 -- 172.21.15.81:0/2053419232 shutdown_connections 2024-09-16T01:19:01.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.969+0000 7f0ea522c640 1 --2- 172.21.15.81:0/2053419232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8c004800 0x7f0e8c004c80 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:01.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.969+0000 7f0ea522c640 1 -- 172.21.15.81:0/2053419232 >> 172.21.15.81:0/2053419232 conn(0x7f0ea006bdf0 msgr2=0x7f0ea006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:01.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.969+0000 7f0ea522c640 1 -- 172.21.15.81:0/2053419232 shutdown_connections 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.969+0000 7f0ea522c640 1 -- 172.21.15.81:0/2053419232 wait complete. 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.971+0000 7f0ea522c640 1 Processor -- start 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.971+0000 7f0ea522c640 1 -- start start 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0ea522c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e8c004800 0x7f0ea0152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0ea522c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea015a640 0x7f0ea01f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0ea522c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ea015aa40 0x7f0ea01f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0ea522c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00b3ab0 con 0x7f0ea015a640 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0ea522c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00b3930 con 0x7f0e8c004800 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0ea522c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea006f9d0 con 0x7f0ea015aa40 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e9659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea015a640 0x7f0ea01f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e9659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea015a640 0x7f0ea01f5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53830/0 (socket says 172.21.15.81:53830) 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e9659c640 1 -- 172.21.15.81:0/1901869597 learned_addr learned my addr 172.21.15.81:0/1901869597 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e9ed9d640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e8c004800 0x7f0ea0152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e9f59e640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ea015aa40 0x7f0ea01f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e9659c640 1 -- 172.21.15.81:0/1901869597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ea015aa40 msgr2=0x7f0ea01f6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e9659c640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ea015aa40 0x7f0ea01f6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e9659c640 1 -- 172.21.15.81:0/1901869597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e8c004800 msgr2=0x7f0ea0152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e9659c640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e8c004800 0x7f0ea0152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e9659c640 1 -- 172.21.15.81:0/1901869597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea0152a60 con 0x7f0ea015a640 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e9659c640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea015a640 0x7f0ea01f5bd0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0e88000c00 tx=0x7f0e88001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e97fff640 1 -- 172.21.15.81:0/1901869597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8803f030 con 0x7f0ea015a640 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e97fff640 1 -- 172.21.15.81:0/1901869597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88005480 con 0x7f0ea015a640 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0ea522c640 1 -- 172.21.15.81:0/1901869597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea00afec0 con 0x7f0ea015a640 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.972+0000 7f0e97fff640 1 -- 172.21.15.81:0/1901869597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88037040 con 0x7f0ea015a640 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.973+0000 7f0ea522c640 1 -- 172.21.15.81:0/1901869597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea00b0480 con 0x7f0ea015a640 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.973+0000 7f0ea522c640 1 -- 172.21.15.81:0/1901869597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea00707e0 con 0x7f0ea015a640 2024-09-16T01:19:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.974+0000 7f0e97fff640 1 -- 172.21.15.81:0/1901869597 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0e88042070 con 0x7f0ea015a640 2024-09-16T01:19:01.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.974+0000 7f0e97fff640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0e8006c2e0 0x7f0e8006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:01.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.975+0000 7f0e9ed9d640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0e8006c2e0 0x7f0e8006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:01.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.975+0000 7f0e97fff640 1 -- 172.21.15.81:0/1901869597 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f0e880aab40 con 0x7f0ea015a640 2024-09-16T01:19:01.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.975+0000 7f0e9ed9d640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0e8006c2e0 0x7f0e8006e7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009ce0 tx=0x7f0e90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:01.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:01.979+0000 7f0e97fff640 1 -- 172.21.15.81:0/1901869597 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ea00707e0 con 0x7f0ea015a640 2024-09-16T01:19:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.180+0000 7f0ea522c640 1 -- 172.21.15.81:0/1901869597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0ea015fe50 con 0x7f0ea015a640 2024-09-16T01:19:02.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.924+0000 7f0e97fff640 1 -- 172.21.15.81:0/1901869597 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) ==== 122+0+0 (secure 0 0 0) 0x7f0e88049070 con 0x7f0ea015a640 2024-09-16T01:19:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.927+0000 7f0ea522c640 1 -- 172.21.15.81:0/1901869597 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0e8006c2e0 msgr2=0x7f0e8006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.927+0000 7f0ea522c640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0e8006c2e0 0x7f0e8006e7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009ce0 tx=0x7f0e90008040 comp rx=0 tx=0).stop 2024-09-16T01:19:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.927+0000 7f0ea522c640 1 -- 172.21.15.81:0/1901869597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea015a640 msgr2=0x7f0ea01f5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.927+0000 7f0ea522c640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea015a640 0x7f0ea01f5bd0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f0e88000c00 tx=0x7f0e88001120 comp rx=0 tx=0).stop 2024-09-16T01:19:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.927+0000 7f0ea522c640 1 -- 172.21.15.81:0/1901869597 shutdown_connections 2024-09-16T01:19:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.927+0000 7f0ea522c640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0e8006c2e0 0x7f0e8006e7a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:02.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.927+0000 7f0ea522c640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ea015aa40 0x7f0ea01f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:02.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.927+0000 7f0ea522c640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea015a640 0x7f0ea01f5bd0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:02.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.927+0000 7f0ea522c640 1 --2- 172.21.15.81:0/1901869597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e8c004800 0x7f0ea0152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:02.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.927+0000 7f0ea522c640 1 -- 172.21.15.81:0/1901869597 >> 172.21.15.81:0/1901869597 conn(0x7f0ea006bdf0 msgr2=0x7f0ea015f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:02.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.927+0000 7f0ea522c640 1 -- 172.21.15.81:0/1901869597 shutdown_connections 2024-09-16T01:19:02.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:02.927+0000 7f0ea522c640 1 -- 172.21.15.81:0/1901869597 wait complete. 2024-09-16T01:19:02.942 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:19:02.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:19:03.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.043+0000 7f50fb9f6640 1 Processor -- start 2024-09-16T01:19:03.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.043+0000 7f50fb9f6640 1 -- start start 2024-09-16T01:19:03.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.044+0000 7f50fb9f6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f50f415e740 0x7f50f40d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.044+0000 7f50fb9f6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f50f409b690 0x7f50f406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.044+0000 7f50fb9f6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50f406d4c0 0x7f50f406d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.044+0000 7f50fb9f6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f50f415eb20 con 0x7f50f415e740 2024-09-16T01:19:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.044+0000 7f50fb9f6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f50f406d260 con 0x7f50f409b690 2024-09-16T01:19:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.044+0000 7f50fb9f6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f50f40d0780 con 0x7f50f406d4c0 2024-09-16T01:19:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.044+0000 7f50f9792640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f50f415e740 0x7f50f40d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.044+0000 7f50f9792640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f50f415e740 0x7f50f40d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53844/0 (socket says 172.21.15.81:53844) 2024-09-16T01:19:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.044+0000 7f50f9792640 1 -- 172.21.15.81:0/2358197043 learned_addr learned my addr 172.21.15.81:0/2358197043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.044+0000 7f50f8f91640 1 --2- 172.21.15.81:0/2358197043 >> v2:172.21.15.102:3300/0 conn(0x7f50f409b690 0x7f50f406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.044+0000 7f50f9f93640 1 --2- 172.21.15.81:0/2358197043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50f406d4c0 0x7f50f406d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.045+0000 7f50f9792640 1 -- 172.21.15.81:0/2358197043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50f406d4c0 msgr2=0x7f50f406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.045+0000 7f50f9792640 1 --2- 172.21.15.81:0/2358197043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50f406d4c0 0x7f50f406d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.045+0000 7f50f9792640 1 -- 172.21.15.81:0/2358197043 >> v2:172.21.15.102:3300/0 conn(0x7f50f409b690 msgr2=0x7f50f406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:03.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.045+0000 7f50f9792640 1 --2- 172.21.15.81:0/2358197043 >> v2:172.21.15.102:3300/0 conn(0x7f50f409b690 0x7f50f406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.045+0000 7f50f9792640 1 -- 172.21.15.81:0/2358197043 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f40d0a60 con 0x7f50f415e740 2024-09-16T01:19:03.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.045+0000 7f50f8f91640 1 --2- 172.21.15.81:0/2358197043 >> v2:172.21.15.102:3300/0 conn(0x7f50f409b690 0x7f50f406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:03.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.045+0000 7f50f9f93640 1 --2- 172.21.15.81:0/2358197043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50f406d4c0 0x7f50f406d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.045+0000 7f50f9792640 1 --2- 172.21.15.81:0/2358197043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f415e740 0x7f50f40d1540 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f50f40691b0 tx=0x7f50f002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d3c29b93ce9f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.045+0000 7f50ebfff640 1 -- 172.21.15.81:0/2358197043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0037070 con 0x7f50f415e740 2024-09-16T01:19:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.045+0000 7f50ebfff640 1 -- 172.21.15.81:0/2358197043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f0032440 con 0x7f50f415e740 2024-09-16T01:19:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.045+0000 7f50ebfff640 1 -- 172.21.15.81:0/2358197043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0032810 con 0x7f50f415e740 2024-09-16T01:19:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.046+0000 7f50fb9f6640 1 -- 172.21.15.81:0/2358197043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f415e740 msgr2=0x7f50f40d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.046+0000 7f50fb9f6640 1 --2- 172.21.15.81:0/2358197043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f415e740 0x7f50f40d1540 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f50f40691b0 tx=0x7f50f002a2a0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.046+0000 7f50fb9f6640 1 -- 172.21.15.81:0/2358197043 shutdown_connections 2024-09-16T01:19:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.046+0000 7f50fb9f6640 1 --2- 172.21.15.81:0/2358197043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50f406d4c0 0x7f50f406d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.046+0000 7f50fb9f6640 1 --2- 172.21.15.81:0/2358197043 >> v2:172.21.15.102:3300/0 conn(0x7f50f409b690 0x7f50f406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.046+0000 7f50fb9f6640 1 --2- 172.21.15.81:0/2358197043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f415e740 0x7f50f40d1540 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.046+0000 7f50fb9f6640 1 -- 172.21.15.81:0/2358197043 >> 172.21.15.81:0/2358197043 conn(0x7f50f40d23a0 msgr2=0x7f50f40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.046+0000 7f50fb9f6640 1 -- 172.21.15.81:0/2358197043 shutdown_connections 2024-09-16T01:19:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.046+0000 7f50fb9f6640 1 -- 172.21.15.81:0/2358197043 wait complete. 2024-09-16T01:19:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.047+0000 7f50fb9f6640 1 Processor -- start 2024-09-16T01:19:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.047+0000 7f50fb9f6640 1 -- start start 2024-09-16T01:19:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50fb9f6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50f406d4c0 0x7f50f415da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50fb9f6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50f409b690 0x7f50f40af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50fb9f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f415e740 0x7f50f40afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50fb9f6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f50f409bac0 con 0x7f50f415e740 2024-09-16T01:19:03.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50fb9f6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f50f40d1020 con 0x7f50f406d4c0 2024-09-16T01:19:03.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50fb9f6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f50f406de10 con 0x7f50f409b690 2024-09-16T01:19:03.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50f9f93640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f415e740 0x7f50f40afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50f9f93640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f415e740 0x7f50f40afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53854/0 (socket says 172.21.15.81:53854) 2024-09-16T01:19:03.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50f9f93640 1 -- 172.21.15.81:0/4218042257 learned_addr learned my addr 172.21.15.81:0/4218042257 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:03.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50f9792640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50f406d4c0 0x7f50f415da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50f8f91640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50f409b690 0x7f50f40af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50f9f93640 1 -- 172.21.15.81:0/4218042257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50f409b690 msgr2=0x7f50f40af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50f9f93640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50f409b690 0x7f50f40af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50f9f93640 1 -- 172.21.15.81:0/4218042257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50f406d4c0 msgr2=0x7f50f415da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50f9f93640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50f406d4c0 0x7f50f415da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50f9f93640 1 -- 172.21.15.81:0/4218042257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f41e8100 con 0x7f50f415e740 2024-09-16T01:19:03.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50f8f91640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50f409b690 0x7f50f40af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:03.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.048+0000 7f50f9f93640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f415e740 0x7f50f40afbd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f50ec007f20 tx=0x7f50ec00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:03.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.049+0000 7f50e9ffb640 1 -- 172.21.15.81:0/4218042257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec01a070 con 0x7f50f415e740 2024-09-16T01:19:03.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.049+0000 7f50e9ffb640 1 -- 172.21.15.81:0/4218042257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50ec003b90 con 0x7f50f415e740 2024-09-16T01:19:03.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.049+0000 7f50fb9f6640 1 -- 172.21.15.81:0/4218042257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f41e83e0 con 0x7f50f415e740 2024-09-16T01:19:03.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.049+0000 7f50e9ffb640 1 -- 172.21.15.81:0/4218042257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec004030 con 0x7f50f415e740 2024-09-16T01:19:03.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.049+0000 7f50fb9f6640 1 -- 172.21.15.81:0/4218042257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f41e89a0 con 0x7f50f415e740 2024-09-16T01:19:03.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.050+0000 7f50fb9f6640 1 -- 172.21.15.81:0/4218042257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f406d8d0 con 0x7f50f415e740 2024-09-16T01:19:03.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.050+0000 7f50e9ffb640 1 -- 172.21.15.81:0/4218042257 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f50ec01d070 con 0x7f50f415e740 2024-09-16T01:19:03.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.051+0000 7f50e9ffb640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f50d806c2b0 0x7f50d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.051+0000 7f50e9ffb640 1 -- 172.21.15.81:0/4218042257 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f50ec08b8b0 con 0x7f50f415e740 2024-09-16T01:19:03.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.051+0000 7f50f9792640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f50d806c2b0 0x7f50d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.051+0000 7f50f9792640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f50d806c2b0 0x7f50d806e770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f50f0034000 tx=0x7f50f002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:03.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.055+0000 7f50e9ffb640 1 -- 172.21.15.81:0/4218042257 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50ec010070 con 0x7f50f415e740 2024-09-16T01:19:03.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.256+0000 7f50fb9f6640 1 -- 172.21.15.81:0/4218042257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50f40b8320 con 0x7f50f415e740 2024-09-16T01:19:03.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.256+0000 7f50e9ffb640 1 -- 172.21.15.81:0/4218042257 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5228 (secure 0 0 0) 0x7f50ec059840 con 0x7f50f415e740 2024-09-16T01:19:03.258 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:03.258 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":43,"btime":"2024-09-16T01:19:02:921518+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3998032766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3998032766},{"type":"v1","addr":"172.21.15.102:6835","nonce":3998032766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5794,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/978156526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":978156526},{"type":"v1","addr":"172.21.15.102:6834","nonce":978156526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6384,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1184176189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1184176189},{"type":"v1","addr":"172.21.15.81:6836","nonce":1184176189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:59.261790+0000","modified":"2024-09-16T01:19:02.182262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2778062051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2778062051},{"type":"v1","addr":"172.21.15.81:6837","nonce":2778062051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-16T01:19:03.259 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 43 2024-09-16T01:19:03.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.258+0000 7f50fb9f6640 1 -- 172.21.15.81:0/4218042257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f50d806c2b0 msgr2=0x7f50d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.258+0000 7f50fb9f6640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f50d806c2b0 0x7f50d806e770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f50f0034000 tx=0x7f50f002e000 comp rx=0 tx=0).stop 2024-09-16T01:19:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.258+0000 7f50fb9f6640 1 -- 172.21.15.81:0/4218042257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f415e740 msgr2=0x7f50f40afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.258+0000 7f50fb9f6640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f415e740 0x7f50f40afbd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f50ec007f20 tx=0x7f50ec00d560 comp rx=0 tx=0).stop 2024-09-16T01:19:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.258+0000 7f50fb9f6640 1 -- 172.21.15.81:0/4218042257 shutdown_connections 2024-09-16T01:19:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.258+0000 7f50fb9f6640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f50d806c2b0 0x7f50d806e770 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.258+0000 7f50fb9f6640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f415e740 0x7f50f40afbd0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.258+0000 7f50fb9f6640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f50f409b690 0x7f50f40af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.258+0000 7f50fb9f6640 1 --2- 172.21.15.81:0/4218042257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f50f406d4c0 0x7f50f415da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.258+0000 7f50fb9f6640 1 -- 172.21.15.81:0/4218042257 >> 172.21.15.81:0/4218042257 conn(0x7f50f40d23a0 msgr2=0x7f50f40cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.258+0000 7f50fb9f6640 1 -- 172.21.15.81:0/4218042257 shutdown_connections 2024-09-16T01:19:03.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.258+0000 7f50fb9f6640 1 -- 172.21.15.81:0/4218042257 wait complete. 2024-09-16T01:19:03.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:19:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.369+0000 7f72c7a1e640 1 Processor -- start 2024-09-16T01:19:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.369+0000 7f72c7a1e640 1 -- start start 2024-09-16T01:19:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.370+0000 7f72c7a1e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72c015b300 0x7f72c00cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.370+0000 7f72c7a1e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c00cdbe0 con 0x7f72c006f8d0 2024-09-16T01:19:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.370+0000 7f72c7a1e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c00cd900 con 0x7f72c00cd3f0 2024-09-16T01:19:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.370+0000 7f72c7a1e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f72c00728a0 con 0x7f72c015b300 2024-09-16T01:19:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.370+0000 7f72c57ba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72c015b300 0x7f72c00cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.370+0000 7f72c5fbb640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f72c006f8d0 0x7f72c015b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49540/0 (socket says 172.21.15.81:49540) 2024-09-16T01:19:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.370+0000 7f72c5fbb640 1 -- 172.21.15.81:0/3238047543 learned_addr learned my addr 172.21.15.81:0/3238047543 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.370+0000 7f72c57ba640 1 -- 172.21.15.81:0/3238047543 >> v1:172.21.15.102:6789/0 conn(0x7f72c00cd3f0 legacy=0x7f72c006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.370+0000 7f72c57ba640 1 -- 172.21.15.81:0/3238047543 >> v1:172.21.15.81:6789/0 conn(0x7f72c006f8d0 legacy=0x7f72c015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.370+0000 7f72c57ba640 1 -- 172.21.15.81:0/3238047543 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c0072250 con 0x7f72c015b300 2024-09-16T01:19:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.370+0000 7f72b7fff640 1 -- 172.21.15.81:0/3238047543 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2320427743 0 0) 0x7f72c00cdbe0 con 0x7f72c006f8d0 2024-09-16T01:19:03.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.371+0000 7f72c57ba640 1 --2- 172.21.15.81:0/3238047543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c015b300 0x7f72c00cceb0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0097a0 tx=0x7f72bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b359053468fbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.371+0000 7f72b7fff640 1 -- 172.21.15.81:0/3238047543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc037070 con 0x7f72c015b300 2024-09-16T01:19:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.371+0000 7f72b7fff640 1 -- 172.21.15.81:0/3238047543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc032440 con 0x7f72c015b300 2024-09-16T01:19:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.371+0000 7f72b7fff640 1 -- 172.21.15.81:0/3238047543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc032810 con 0x7f72c015b300 2024-09-16T01:19:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.371+0000 7f72c7a1e640 1 -- 172.21.15.81:0/3238047543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c015b300 msgr2=0x7f72c00cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.371+0000 7f72c7a1e640 1 --2- 172.21.15.81:0/3238047543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c015b300 0x7f72c00cceb0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0097a0 tx=0x7f72bc02a1e0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.371+0000 7f72c7a1e640 1 -- 172.21.15.81:0/3238047543 shutdown_connections 2024-09-16T01:19:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.372+0000 7f72c7a1e640 1 --2- 172.21.15.81:0/3238047543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c015b300 0x7f72c00cceb0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.372+0000 7f72c7a1e640 1 -- 172.21.15.81:0/3238047543 >> 172.21.15.81:0/3238047543 conn(0x7f72c0067d70 msgr2=0x7f72c006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.372+0000 7f72c7a1e640 1 -- 172.21.15.81:0/3238047543 shutdown_connections 2024-09-16T01:19:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.372+0000 7f72c7a1e640 1 -- 172.21.15.81:0/3238047543 wait complete. 2024-09-16T01:19:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.373+0000 7f72c7a1e640 1 Processor -- start 2024-09-16T01:19:03.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.373+0000 7f72c7a1e640 1 -- start start 2024-09-16T01:19:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.373+0000 7f72c7a1e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72c006f8d0 0x7f72c0151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.373+0000 7f72c7a1e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cd3f0 0x7f72c0153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.373+0000 7f72c7a1e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c015b300 0x7f72c014fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.373+0000 7f72c7a1e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72c00d0160 con 0x7f72c00cd3f0 2024-09-16T01:19:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.373+0000 7f72c7a1e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72c00cffe0 con 0x7f72c015b300 2024-09-16T01:19:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.373+0000 7f72c7a1e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f72c0072d30 con 0x7f72c006f8d0 2024-09-16T01:19:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72c4fb9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cd3f0 0x7f72c0153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72c4fb9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cd3f0 0x7f72c0153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53872/0 (socket says 172.21.15.81:53872) 2024-09-16T01:19:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72c4fb9640 1 -- 172.21.15.81:0/1362859480 learned_addr learned my addr 172.21.15.81:0/1362859480 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72c4fb9640 1 -- 172.21.15.81:0/1362859480 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72c006f8d0 msgr2=0x7f72c0151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72c4fb9640 1 --2- 172.21.15.81:0/1362859480 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72c006f8d0 0x7f72c0151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72c4fb9640 1 -- 172.21.15.81:0/1362859480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c015b300 msgr2=0x7f72c014fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72c4fb9640 1 --2- 172.21.15.81:0/1362859480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c015b300 0x7f72c014fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72c4fb9640 1 -- 172.21.15.81:0/1362859480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c0150c00 con 0x7f72c00cd3f0 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72c4fb9640 1 --2- 172.21.15.81:0/1362859480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cd3f0 0x7f72c0153470 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f72b000c440 tx=0x7f72b000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72b5ffb640 1 -- 172.21.15.81:0/1362859480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0017070 con 0x7f72c00cd3f0 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72b5ffb640 1 -- 172.21.15.81:0/1362859480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b00035f0 con 0x7f72c00cd3f0 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72b5ffb640 1 -- 172.21.15.81:0/1362859480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b00039e0 con 0x7f72c00cd3f0 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72c7a1e640 1 -- 172.21.15.81:0/1362859480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c0150ee0 con 0x7f72c00cd3f0 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.374+0000 7f72c7a1e640 1 -- 172.21.15.81:0/1362859480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c00adc00 con 0x7f72c00cd3f0 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.375+0000 7f72c7a1e640 1 -- 172.21.15.81:0/1362859480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c006e390 con 0x7f72c00cd3f0 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.376+0000 7f72b5ffb640 1 -- 172.21.15.81:0/1362859480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f72b001a070 con 0x7f72c00cd3f0 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.376+0000 7f72b5ffb640 1 --2- 172.21.15.81:0/1362859480 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72a406c2e0 0x7f72a406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.376+0000 7f72b5ffb640 1 -- 172.21.15.81:0/1362859480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f72b008a920 con 0x7f72c00cd3f0 2024-09-16T01:19:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.376+0000 7f72c57ba640 1 --2- 172.21.15.81:0/1362859480 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72a406c2e0 0x7f72a406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.376+0000 7f72c57ba640 1 --2- 172.21.15.81:0/1362859480 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72a406c2e0 0x7f72a406e7a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f72bc034000 tx=0x7f72bc02c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:03.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.380+0000 7f72b5ffb640 1 -- 172.21.15.81:0/1362859480 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72b0058f00 con 0x7f72c00cd3f0 2024-09-16T01:19:03.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.548+0000 7f72c7a1e640 1 -- 172.21.15.81:0/1362859480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72c006e0b0 con 0x7f72c00cd3f0 2024-09-16T01:19:03.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.549+0000 7f72b5ffb640 1 -- 172.21.15.81:0/1362859480 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+16945 (secure 0 0 0) 0x7f72b00010c0 con 0x7f72c00cd3f0 2024-09-16T01:19:03.551 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:03.551 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":87,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:19:00.923905+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:18:57.600304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-16T01:18:58.228275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:19:03.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.551+0000 7f72c7a1e640 1 -- 172.21.15.81:0/1362859480 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72a406c2e0 msgr2=0x7f72a406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.551+0000 7f72c7a1e640 1 --2- 172.21.15.81:0/1362859480 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72a406c2e0 0x7f72a406e7a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f72bc034000 tx=0x7f72bc02c000 comp rx=0 tx=0).stop 2024-09-16T01:19:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.551+0000 7f72c7a1e640 1 -- 172.21.15.81:0/1362859480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cd3f0 msgr2=0x7f72c0153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.551+0000 7f72c7a1e640 1 --2- 172.21.15.81:0/1362859480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cd3f0 0x7f72c0153470 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f72b000c440 tx=0x7f72b000c900 comp rx=0 tx=0).stop 2024-09-16T01:19:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.551+0000 7f72c7a1e640 1 -- 172.21.15.81:0/1362859480 shutdown_connections 2024-09-16T01:19:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.551+0000 7f72c7a1e640 1 --2- 172.21.15.81:0/1362859480 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72a406c2e0 0x7f72a406e7a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.551+0000 7f72c7a1e640 1 --2- 172.21.15.81:0/1362859480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72c015b300 0x7f72c014fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.551+0000 7f72c7a1e640 1 --2- 172.21.15.81:0/1362859480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cd3f0 0x7f72c0153470 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.551+0000 7f72c7a1e640 1 --2- 172.21.15.81:0/1362859480 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72c006f8d0 0x7f72c0151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.551+0000 7f72c7a1e640 1 -- 172.21.15.81:0/1362859480 >> 172.21.15.81:0/1362859480 conn(0x7f72c0067d70 msgr2=0x7f72c006e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.552+0000 7f72c7a1e640 1 -- 172.21.15.81:0/1362859480 shutdown_connections 2024-09-16T01:19:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.552+0000 7f72c7a1e640 1 -- 172.21.15.81:0/1362859480 wait complete. 2024-09-16T01:19:03.564 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:19:03.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:19:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.661+0000 7ff603f5b640 1 Processor -- start 2024-09-16T01:19:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.661+0000 7ff603f5b640 1 -- start start 2024-09-16T01:19:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.662+0000 7ff603f5b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5fc0d06e0 0x7ff5fc0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.662+0000 7ff603f5b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5fc09b510 0x7ff5fc09b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.662+0000 7ff603f5b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc0d00a0 con 0x7ff5fc15d3e0 2024-09-16T01:19:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.662+0000 7ff603f5b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff5fc09b080 con 0x7ff5fc0d06e0 2024-09-16T01:19:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.662+0000 7ff603f5b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff5fc0d0380 con 0x7ff5fc09b510 2024-09-16T01:19:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.662+0000 7ff601cf7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5fc0d06e0 0x7ff5fc0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.662+0000 7ff601cf7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5fc0d06e0 0x7ff5fc0ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53888/0 (socket says 172.21.15.81:53888) 2024-09-16T01:19:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.662+0000 7ff601cf7640 1 -- 172.21.15.81:0/3166158946 learned_addr learned my addr 172.21.15.81:0/3166158946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.663+0000 7ff6024f8640 1 --2- 172.21.15.81:0/3166158946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5fc09b510 0x7ff5fc09b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.663+0000 7ff601cf7640 1 -- 172.21.15.81:0/3166158946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5fc09b510 msgr2=0x7ff5fc09b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.663+0000 7ff601cf7640 1 --2- 172.21.15.81:0/3166158946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5fc09b510 0x7ff5fc09b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.663+0000 7ff601cf7640 1 -- 172.21.15.81:0/3166158946 >> v1:172.21.15.102:6789/0 conn(0x7ff5fc15d3e0 legacy=0x7ff5fc0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.663+0000 7ff601cf7640 1 -- 172.21.15.81:0/3166158946 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc09aa30 con 0x7ff5fc0d06e0 2024-09-16T01:19:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.663+0000 7ff601cf7640 1 --2- 172.21.15.81:0/3166158946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5fc0d06e0 0x7ff5fc0ce8b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009e50 tx=0x7ff5ec02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc9b20ae86b7423 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.663+0000 7ff600cf5640 1 -- 172.21.15.81:0/3166158946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec036070 con 0x7ff5fc0d06e0 2024-09-16T01:19:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.664+0000 7ff600cf5640 1 -- 172.21.15.81:0/3166158946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec031600 con 0x7ff5fc0d06e0 2024-09-16T01:19:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.664+0000 7ff600cf5640 1 -- 172.21.15.81:0/3166158946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0319d0 con 0x7ff5fc0d06e0 2024-09-16T01:19:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.664+0000 7ff603f5b640 1 -- 172.21.15.81:0/3166158946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5fc0d06e0 msgr2=0x7ff5fc0ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.664+0000 7ff603f5b640 1 --2- 172.21.15.81:0/3166158946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5fc0d06e0 0x7ff5fc0ce8b0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009e50 tx=0x7ff5ec02a710 comp rx=0 tx=0).stop 2024-09-16T01:19:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.664+0000 7ff603f5b640 1 -- 172.21.15.81:0/3166158946 shutdown_connections 2024-09-16T01:19:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.664+0000 7ff603f5b640 1 --2- 172.21.15.81:0/3166158946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5fc09b510 0x7ff5fc09b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.664+0000 7ff603f5b640 1 --2- 172.21.15.81:0/3166158946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5fc0d06e0 0x7ff5fc0ce8b0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.664+0000 7ff603f5b640 1 -- 172.21.15.81:0/3166158946 >> 172.21.15.81:0/3166158946 conn(0x7ff5fc0d23a0 msgr2=0x7ff5fc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.664+0000 7ff603f5b640 1 -- 172.21.15.81:0/3166158946 shutdown_connections 2024-09-16T01:19:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.664+0000 7ff603f5b640 1 -- 172.21.15.81:0/3166158946 wait complete. 2024-09-16T01:19:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.665+0000 7ff603f5b640 1 Processor -- start 2024-09-16T01:19:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.665+0000 7ff603f5b640 1 -- start start 2024-09-16T01:19:03.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff603f5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5fc09b510 0x7ff5fc159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff603f5b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5fc0d06e0 0x7ff5fc159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff603f5b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5fc15d3e0 0x7ff5fc0cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff603f5b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc15c740 con 0x7ff5fc09b510 2024-09-16T01:19:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff603f5b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc15d800 con 0x7ff5fc15d3e0 2024-09-16T01:19:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff603f5b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff5fc0ccf90 con 0x7ff5fc0d06e0 2024-09-16T01:19:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff601cf7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5fc09b510 0x7ff5fc159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff601cf7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5fc09b510 0x7ff5fc159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53896/0 (socket says 172.21.15.81:53896) 2024-09-16T01:19:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff601cf7640 1 -- 172.21.15.81:0/3201029512 learned_addr learned my addr 172.21.15.81:0/3201029512 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff6024f8640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5fc15d3e0 0x7ff5fc0cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff6014f6640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5fc0d06e0 0x7ff5fc159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff601cf7640 1 -- 172.21.15.81:0/3201029512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5fc0d06e0 msgr2=0x7ff5fc159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff601cf7640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5fc0d06e0 0x7ff5fc159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff601cf7640 1 -- 172.21.15.81:0/3201029512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5fc15d3e0 msgr2=0x7ff5fc0cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff601cf7640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5fc15d3e0 0x7ff5fc0cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff601cf7640 1 -- 172.21.15.81:0/3201029512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc0ca5e0 con 0x7ff5fc09b510 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.666+0000 7ff6014f6640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5fc0d06e0 0x7ff5fc159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.667+0000 7ff601cf7640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5fc09b510 0x7ff5fc159800 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec034040 tx=0x7ff5ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.667+0000 7ff5fa7fc640 1 -- 172.21.15.81:0/3201029512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec036050 con 0x7ff5fc09b510 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.667+0000 7ff5fa7fc640 1 -- 172.21.15.81:0/3201029512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ec042070 con 0x7ff5fc09b510 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.667+0000 7ff603f5b640 1 -- 172.21.15.81:0/3201029512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5fc0ca8c0 con 0x7ff5fc09b510 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.667+0000 7ff5fa7fc640 1 -- 172.21.15.81:0/3201029512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec009510 con 0x7ff5fc09b510 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.667+0000 7ff603f5b640 1 -- 172.21.15.81:0/3201029512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5fc0cae80 con 0x7ff5fc09b510 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.668+0000 7ff603f5b640 1 -- 172.21.15.81:0/3201029512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5fc09b9c0 con 0x7ff5fc09b510 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.668+0000 7ff5fa7fc640 1 -- 172.21.15.81:0/3201029512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff5ec007c30 con 0x7ff5fc09b510 2024-09-16T01:19:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.669+0000 7ff5fa7fc640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5e806c2b0 0x7ff5e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.669+0000 7ff5fa7fc640 1 -- 172.21.15.81:0/3201029512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7ff5ec0ac450 con 0x7ff5fc09b510 2024-09-16T01:19:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.669+0000 7ff6014f6640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5e806c2b0 0x7ff5e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.669+0000 7ff6014f6640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5e806c2b0 0x7ff5e806e770 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc15aa10 tx=0x7ff5f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:03.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.673+0000 7ff5fa7fc640 1 -- 172.21.15.81:0/3201029512 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5ec07aa30 con 0x7ff5fc09b510 2024-09-16T01:19:03.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.835+0000 7ff603f5b640 1 -- 172.21.15.81:0/3201029512 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5fc0d31d0 con 0x7ff5e806c2b0 2024-09-16T01:19:03.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.840+0000 7ff5fa7fc640 1 -- 172.21.15.81:0/3201029512 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240195 (secure 0 0 0) 0x7ff5fc0d31d0 con 0x7ff5e806c2b0 2024-09-16T01:19:03.845 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:03.846 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:19:03.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.843+0000 7ff603f5b640 1 -- 172.21.15.81:0/3201029512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5e806c2b0 msgr2=0x7ff5e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.843+0000 7ff603f5b640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5e806c2b0 0x7ff5e806e770 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc15aa10 tx=0x7ff5f0009040 comp rx=0 tx=0).stop 2024-09-16T01:19:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.844+0000 7ff603f5b640 1 -- 172.21.15.81:0/3201029512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5fc09b510 msgr2=0x7ff5fc159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.844+0000 7ff603f5b640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5fc09b510 0x7ff5fc159800 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec034040 tx=0x7ff5ec004a40 comp rx=0 tx=0).stop 2024-09-16T01:19:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.844+0000 7ff603f5b640 1 -- 172.21.15.81:0/3201029512 shutdown_connections 2024-09-16T01:19:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.844+0000 7ff603f5b640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff5e806c2b0 0x7ff5e806e770 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.844+0000 7ff603f5b640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff5fc15d3e0 0x7ff5fc0cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.844+0000 7ff603f5b640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5fc0d06e0 0x7ff5fc159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.844+0000 7ff603f5b640 1 --2- 172.21.15.81:0/3201029512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5fc09b510 0x7ff5fc159800 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.844+0000 7ff603f5b640 1 -- 172.21.15.81:0/3201029512 >> 172.21.15.81:0/3201029512 conn(0x7ff5fc0d23a0 msgr2=0x7ff5fc0d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.844+0000 7ff603f5b640 1 -- 172.21.15.81:0/3201029512 shutdown_connections 2024-09-16T01:19:03.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.844+0000 7ff603f5b640 1 -- 172.21.15.81:0/3201029512 wait complete. 2024-09-16T01:19:03.856 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2024-09-16T01:19:02.100964+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258656,"kb_used_data":9124,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716064,"statfs":{"total":773094113280,"available":772829249536,"internally_reserved":0,"allocated":9342976,"data_stored":4861163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.191553"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.914903+0000","last_change":"2024-09-16T01:18:57.914903+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.914903+0000","last_undegraded":"2024-09-16T01:18:57.914903+0000","last_fullsized":"2024-09-16T01:18:57.914903+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.921102+0000","last_change":"2024-09-16T01:18:57.921102+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.921102+0000","last_undegraded":"2024-09-16T01:18:57.921102+0000","last_fullsized":"2024-09-16T01:18:57.921102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.920463+0000","last_change":"2024-09-16T01:18:57.920463+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.920463+0000","last_undegraded":"2024-09-16T01:18:57.920463+0000","last_fullsized":"2024-09-16T01:18:57.920463+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.916001+0000","last_change":"2024-09-16T01:18:57.916001+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.916001+0000","last_undegraded":"2024-09-16T01:18:57.916001+0000","last_fullsized":"2024-09-16T01:18:57.916001+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.920420+0000","last_change":"2024-09-16T01:18:57.920420+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.920420+0000","last_undegraded":"2024-09-16T01:18:57.920420+0000","last_fullsized":"2024-09-16T01:18:57.920420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.913393+0000","last_change":"2024-09-16T01:18:57.913393+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.913393+0000","last_undegraded":"2024-09-16T01:18:57.913393+0000","last_fullsized":"2024-09-16T01:18:57.913393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.917615+0000","last_change":"2024-09-16T01:18:57.917615+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.917615+0000","last_undegraded":"2024-09-16T01:18:57.917615+0000","last_fullsized":"2024-09-16T01:18:57.917615+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.920393+0000","last_change":"2024-09-16T01:18:57.920393+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.920393+0000","last_undegraded":"2024-09-16T01:18:57.920393+0000","last_fullsized":"2024-09-16T01:18:57.920393+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.914351+0000","last_change":"2024-09-16T01:18:57.914351+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.914351+0000","last_undegraded":"2024-09-16T01:18:57.914351+0000","last_fullsized":"2024-09-16T01:18:57.914351+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.917598+0000","last_change":"2024-09-16T01:18:57.917598+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.917598+0000","last_undegraded":"2024-09-16T01:18:57.917598+0000","last_fullsized":"2024-09-16T01:18:57.917598+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.922154+0000","last_change":"2024-09-16T01:18:57.922154+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.922154+0000","last_undegraded":"2024-09-16T01:18:57.922154+0000","last_fullsized":"2024-09-16T01:18:57.922154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.917698+0000","last_change":"2024-09-16T01:18:57.917698+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.917698+0000","last_undegraded":"2024-09-16T01:18:57.917698+0000","last_fullsized":"2024-09-16T01:18:57.917698+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.920542+0000","last_change":"2024-09-16T01:18:57.920542+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.920542+0000","last_undegraded":"2024-09-16T01:18:57.920542+0000","last_fullsized":"2024-09-16T01:18:57.920542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.917678+0000","last_change":"2024-09-16T01:18:57.917678+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.917678+0000","last_undegraded":"2024-09-16T01:18:57.917678+0000","last_fullsized":"2024-09-16T01:18:57.917678+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.913319+0000","last_change":"2024-09-16T01:18:57.913319+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.913319+0000","last_undegraded":"2024-09-16T01:18:57.913319+0000","last_fullsized":"2024-09-16T01:18:57.913319+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.913305+0000","last_change":"2024-09-16T01:18:57.913305+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.913305+0000","last_undegraded":"2024-09-16T01:18:57.913305+0000","last_fullsized":"2024-09-16T01:18:57.913305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.914327+0000","last_change":"2024-09-16T01:18:57.914327+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.914327+0000","last_undegraded":"2024-09-16T01:18:57.914327+0000","last_fullsized":"2024-09-16T01:18:57.914327+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.920566+0000","last_change":"2024-09-16T01:18:57.920566+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.920566+0000","last_undegraded":"2024-09-16T01:18:57.920566+0000","last_fullsized":"2024-09-16T01:18:57.920566+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.921478+0000","last_change":"2024-09-16T01:18:57.921478+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.921478+0000","last_undegraded":"2024-09-16T01:18:57.921478+0000","last_fullsized":"2024-09-16T01:18:57.921478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.914829+0000","last_change":"2024-09-16T01:18:57.914829+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.914829+0000","last_undegraded":"2024-09-16T01:18:57.914829+0000","last_fullsized":"2024-09-16T01:18:57.914829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.912037+0000","last_change":"2024-09-16T01:18:57.912037+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.912037+0000","last_undegraded":"2024-09-16T01:18:57.912037+0000","last_fullsized":"2024-09-16T01:18:57.912037+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.915154+0000","last_change":"2024-09-16T01:18:57.915154+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.915154+0000","last_undegraded":"2024-09-16T01:18:57.915154+0000","last_fullsized":"2024-09-16T01:18:57.915154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.912076+0000","last_change":"2024-09-16T01:18:57.912076+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.912076+0000","last_undegraded":"2024-09-16T01:18:57.912076+0000","last_fullsized":"2024-09-16T01:18:57.912076+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.921035+0000","last_change":"2024-09-16T01:18:57.921035+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.921035+0000","last_undegraded":"2024-09-16T01:18:57.921035+0000","last_fullsized":"2024-09-16T01:18:57.921035+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.920601+0000","last_change":"2024-09-16T01:18:57.920601+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.920601+0000","last_undegraded":"2024-09-16T01:18:57.920601+0000","last_fullsized":"2024-09-16T01:18:57.920601+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.920422+0000","last_change":"2024-09-16T01:18:57.920422+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.920422+0000","last_undegraded":"2024-09-16T01:18:57.920422+0000","last_fullsized":"2024-09-16T01:18:57.920422+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.914527+0000","last_change":"2024-09-16T01:18:57.914527+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.914527+0000","last_undegraded":"2024-09-16T01:18:57.914527+0000","last_fullsized":"2024-09-16T01:18:57.914527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.917691+0000","last_change":"2024-09-16T01:18:57.917691+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.917691+0000","last_undegraded":"2024-09-16T01:18:57.917691+0000","last_fullsized":"2024-09-16T01:18:57.917691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.914447+0000","last_change":"2024-09-16T01:18:57.914447+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.914447+0000","last_undegraded":"2024-09-16T01:18:57.914447+0000","last_fullsized":"2024-09-16T01:18:57.914447+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.914318+0000","last_change":"2024-09-16T01:18:57.914318+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.914318+0000","last_undegraded":"2024-09-16T01:18:57.914318+0000","last_fullsized":"2024-09-16T01:18:57.914318+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.920904+0000","last_change":"2024-09-16T01:18:57.920904+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.920904+0000","last_undegraded":"2024-09-16T01:18:57.920904+0000","last_fullsized":"2024-09-16T01:18:57.920904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:18:58.909218+0000","last_change":"2024-09-16T01:18:58.909218+0000","last_active":"2024-09-16T01:18:58.909218+0000","last_peered":"2024-09-16T01:18:58.909218+0000","last_clean":"2024-09-16T01:18:58.909218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:58.909218+0000","last_undegraded":"2024-09-16T01:18:58.909218+0000","last_fullsized":"2024-09-16T01:18:58.909218+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-09-16T01:18:57.913450+0000","last_change":"2024-09-16T01:18:57.913450+0000","last_active":"2024-09-16T01:18:57.905059+0000","last_peered":"2024-09-16T01:18:57.905059+0000","last_clean":"2024-09-16T01:18:57.905059+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:18:57.913450+0000","last_undegraded":"2024-09-16T01:18:57.913450+0000","last_fullsized":"2024-09-16T01:18:57.913450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":285,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-16T01:18:57.921522+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:18:57.921522+0000","last_peered":"2024-09-16T01:18:57.921522+0000","last_clean":"2024-09-16T01:18:57.921522+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:18:57.921522+0000","last_undegraded":"2024-09-16T01:18:57.921522+0000","last_fullsized":"2024-09-16T01:18:57.921522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1617920,"data_stored":1052491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1011712,"data_stored":456604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":462123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1011712,"data_stored":456604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":462123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1011712,"data_stored":456604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":462123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1617920,"data_stored":1052491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:19:03.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:19:03.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.994+0000 7f0fdb48c640 1 Processor -- start 2024-09-16T01:19:03.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.994+0000 7f0fdb48c640 1 -- start start 2024-09-16T01:19:03.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.995+0000 7f0fdb48c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fd40d30f0 0x7f0fd40b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.995+0000 7f0fdb48c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0fd40b64c0 0x7f0fd406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:03.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.995+0000 7f0fdb48c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fd40d3690 con 0x7f0fd415e5f0 2024-09-16T01:19:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.995+0000 7f0fdb48c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0fd406d530 con 0x7f0fd40b64c0 2024-09-16T01:19:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.995+0000 7f0fdb48c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0fd40d3970 con 0x7f0fd40d30f0 2024-09-16T01:19:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.995+0000 7f0fd9a29640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0fd40b64c0 0x7f0fd406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.995+0000 7f0fd9228640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0fd415e5f0 0x7f0fd40d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49548/0 (socket says 172.21.15.81:49548) 2024-09-16T01:19:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.995+0000 7f0fd9228640 1 -- 172.21.15.81:0/2761584129 learned_addr learned my addr 172.21.15.81:0/2761584129 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.995+0000 7f0fd9a29640 1 --2- 172.21.15.81:0/2761584129 >> v2:172.21.15.81:3300/0 conn(0x7f0fd40b64c0 0x7f0fd406d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53906/0 (socket says 172.21.15.81:53906) 2024-09-16T01:19:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.995+0000 7f0fd8a27640 1 --2- 172.21.15.81:0/2761584129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fd40d30f0 0x7f0fd40b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.996+0000 7f0fd9a29640 1 -- 172.21.15.81:0/2761584129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fd40d30f0 msgr2=0x7f0fd40b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.996+0000 7f0fd9a29640 1 --2- 172.21.15.81:0/2761584129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fd40d30f0 0x7f0fd40b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.996+0000 7f0fd9a29640 1 -- 172.21.15.81:0/2761584129 >> v1:172.21.15.81:6789/0 conn(0x7f0fd415e5f0 legacy=0x7f0fd40d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.996+0000 7f0fd3fff640 1 -- 172.21.15.81:0/2761584129 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085083237 0 0) 0x7f0fd40d3690 con 0x7f0fd415e5f0 2024-09-16T01:19:03.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.996+0000 7f0fd9a29640 1 -- 172.21.15.81:0/2761584129 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd406cee0 con 0x7f0fd40b64c0 2024-09-16T01:19:03.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.996+0000 7f0fd8a27640 1 --2- 172.21.15.81:0/2761584129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fd40d30f0 0x7f0fd40b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:04.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.996+0000 7f0fd9a29640 1 --2- 172.21.15.81:0/2761584129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fd40b64c0 0x7f0fd406d9c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0097a0 tx=0x7f0fcc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c677533a6e3e91 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:04.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.996+0000 7f0fd3fff640 1 -- 172.21.15.81:0/2761584129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc037070 con 0x7f0fd40b64c0 2024-09-16T01:19:04.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.996+0000 7f0fd3fff640 1 -- 172.21.15.81:0/2761584129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fcc032440 con 0x7f0fd40b64c0 2024-09-16T01:19:04.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.996+0000 7f0fd3fff640 1 -- 172.21.15.81:0/2761584129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc032810 con 0x7f0fd40b64c0 2024-09-16T01:19:04.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.997+0000 7f0fdb48c640 1 -- 172.21.15.81:0/2761584129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fd40b64c0 msgr2=0x7f0fd406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.997+0000 7f0fdb48c640 1 --2- 172.21.15.81:0/2761584129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fd40b64c0 0x7f0fd406d9c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0097a0 tx=0x7f0fcc02a180 comp rx=0 tx=0).stop 2024-09-16T01:19:04.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.997+0000 7f0fdb48c640 1 -- 172.21.15.81:0/2761584129 shutdown_connections 2024-09-16T01:19:04.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.997+0000 7f0fdb48c640 1 --2- 172.21.15.81:0/2761584129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fd40b64c0 0x7f0fd406d9c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.997+0000 7f0fdb48c640 1 --2- 172.21.15.81:0/2761584129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fd40d30f0 0x7f0fd40b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.997+0000 7f0fdb48c640 1 -- 172.21.15.81:0/2761584129 >> 172.21.15.81:0/2761584129 conn(0x7f0fd408bfc0 msgr2=0x7f0fd40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:04.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.997+0000 7f0fdb48c640 1 -- 172.21.15.81:0/2761584129 shutdown_connections 2024-09-16T01:19:04.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.997+0000 7f0fdb48c640 1 -- 172.21.15.81:0/2761584129 wait complete. 2024-09-16T01:19:04.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.998+0000 7f0fdb48c640 1 Processor -- start 2024-09-16T01:19:04.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.998+0000 7f0fdb48c640 1 -- start start 2024-09-16T01:19:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fdb48c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fd40b64c0 0x7f0fd40b8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fdb48c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fd40d30f0 0x7f0fd40b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fdb48c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd415e5f0 0x7f0fd40b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fdb48c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd406df00 con 0x7f0fd40b64c0 2024-09-16T01:19:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fdb48c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd415e9d0 con 0x7f0fd415e5f0 2024-09-16T01:19:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fdb48c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0fd406e080 con 0x7f0fd40d30f0 2024-09-16T01:19:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fd9228640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fd40b64c0 0x7f0fd40b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fd9228640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fd40b64c0 0x7f0fd40b8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53912/0 (socket says 172.21.15.81:53912) 2024-09-16T01:19:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fd9228640 1 -- 172.21.15.81:0/488886190 learned_addr learned my addr 172.21.15.81:0/488886190 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fd8a27640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fd40d30f0 0x7f0fd40b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fd9a29640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd415e5f0 0x7f0fd40b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fd9228640 1 -- 172.21.15.81:0/488886190 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fd40d30f0 msgr2=0x7f0fd40b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fd9228640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fd40d30f0 0x7f0fd40b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fd9228640 1 -- 172.21.15.81:0/488886190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd415e5f0 msgr2=0x7f0fd40b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fd9228640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd415e5f0 0x7f0fd40b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fd9228640 1 -- 172.21.15.81:0/488886190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd4160410 con 0x7f0fd40b64c0 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fd9a29640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd415e5f0 0x7f0fd40b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:03.999+0000 7f0fd9228640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fd40b64c0 0x7f0fd40b8430 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c7c0 tx=0x7f0fc400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.000+0000 7f0fd1ffb640 1 -- 172.21.15.81:0/488886190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4018070 con 0x7f0fd40b64c0 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.000+0000 7f0fd1ffb640 1 -- 172.21.15.81:0/488886190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc400a640 con 0x7f0fd40b64c0 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.000+0000 7f0fdb48c640 1 -- 172.21.15.81:0/488886190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd41606f0 con 0x7f0fd40b64c0 2024-09-16T01:19:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.000+0000 7f0fd1ffb640 1 -- 172.21.15.81:0/488886190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400aa30 con 0x7f0fd40b64c0 2024-09-16T01:19:04.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.000+0000 7f0fdb48c640 1 -- 172.21.15.81:0/488886190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd4160cb0 con 0x7f0fd40b64c0 2024-09-16T01:19:04.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.001+0000 7f0fdb48c640 1 -- 172.21.15.81:0/488886190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd40d3690 con 0x7f0fd40b64c0 2024-09-16T01:19:04.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.001+0000 7f0fd1ffb640 1 -- 172.21.15.81:0/488886190 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0fc401b070 con 0x7f0fd40b64c0 2024-09-16T01:19:04.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.002+0000 7f0fd1ffb640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0fc006c2e0 0x7f0fc006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.002+0000 7f0fd1ffb640 1 -- 172.21.15.81:0/488886190 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f0fc408ab60 con 0x7f0fd40b64c0 2024-09-16T01:19:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.002+0000 7f0fd8a27640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0fc006c2e0 0x7f0fc006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.002+0000 7f0fd8a27640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0fc006c2e0 0x7f0fc006e7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0fd41f71e0 tx=0x7f0fc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:04.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.006+0000 7f0fd1ffb640 1 -- 172.21.15.81:0/488886190 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0fc40591d0 con 0x7f0fd40b64c0 2024-09-16T01:19:04.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.172+0000 7f0fdb48c640 1 -- 172.21.15.81:0/488886190 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0fd40ba2b0 con 0x7f0fc006c2e0 2024-09-16T01:19:04.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.177+0000 7f0fd1ffb640 1 -- 172.21.15.81:0/488886190 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252072 (secure 0 0 0) 0x7f0fd40ba2b0 con 0x7f0fc006c2e0 2024-09-16T01:19:04.182 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:04.183 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:19:04.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.180+0000 7f0fdb48c640 1 -- 172.21.15.81:0/488886190 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0fc006c2e0 msgr2=0x7f0fc006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.180+0000 7f0fdb48c640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0fc006c2e0 0x7f0fc006e7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0fd41f71e0 tx=0x7f0fc8008040 comp rx=0 tx=0).stop 2024-09-16T01:19:04.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.180+0000 7f0fdb48c640 1 -- 172.21.15.81:0/488886190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fd40b64c0 msgr2=0x7f0fd40b8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.180+0000 7f0fdb48c640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fd40b64c0 0x7f0fd40b8430 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c7c0 tx=0x7f0fc400cc80 comp rx=0 tx=0).stop 2024-09-16T01:19:04.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.181+0000 7f0fdb48c640 1 -- 172.21.15.81:0/488886190 shutdown_connections 2024-09-16T01:19:04.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.181+0000 7f0fdb48c640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0fc006c2e0 0x7f0fc006e7a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.181+0000 7f0fdb48c640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fd415e5f0 0x7f0fd40b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.181+0000 7f0fdb48c640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fd40d30f0 0x7f0fd40b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.181+0000 7f0fdb48c640 1 --2- 172.21.15.81:0/488886190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fd40b64c0 0x7f0fd40b8430 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.181+0000 7f0fdb48c640 1 -- 172.21.15.81:0/488886190 >> 172.21.15.81:0/488886190 conn(0x7f0fd408bfc0 msgr2=0x7f0fd40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.181+0000 7f0fdb48c640 1 -- 172.21.15.81:0/488886190 shutdown_connections 2024-09-16T01:19:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.181+0000 7f0fdb48c640 1 -- 172.21.15.81:0/488886190 wait complete. 2024-09-16T01:19:04.193 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-09-16T01:19:04.101244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259144,"kb_used_data":9608,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715576,"statfs":{"total":773094113280,"available":772828749824,"internally_reserved":0,"allocated":9838592,"data_stored":5096420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000930"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238659+0000","last_change":"2024-09-16T01:18:59.942361+0000","last_active":"2024-09-16T01:19:01.238659+0000","last_peered":"2024-09-16T01:19:01.238659+0000","last_clean":"2024-09-16T01:19:01.238659+0000","last_became_active":"2024-09-16T01:18:59.942056+0000","last_became_peered":"2024-09-16T01:18:59.942056+0000","last_unstale":"2024-09-16T01:19:01.238659+0000","last_undegraded":"2024-09-16T01:19:01.238659+0000","last_fullsized":"2024-09-16T01:19:01.238659+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:12.018056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933737+0000","last_change":"2024-09-16T01:18:59.937244+0000","last_active":"2024-09-16T01:19:00.933737+0000","last_peered":"2024-09-16T01:19:00.933737+0000","last_clean":"2024-09-16T01:19:00.933737+0000","last_became_active":"2024-09-16T01:18:59.936994+0000","last_became_peered":"2024-09-16T01:18:59.936994+0000","last_unstale":"2024-09-16T01:19:00.933737+0000","last_undegraded":"2024-09-16T01:19:00.933737+0000","last_fullsized":"2024-09-16T01:19:00.933737+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:37.956199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238277+0000","last_change":"2024-09-16T01:18:59.941066+0000","last_active":"2024-09-16T01:19:01.238277+0000","last_peered":"2024-09-16T01:19:01.238277+0000","last_clean":"2024-09-16T01:19:01.238277+0000","last_became_active":"2024-09-16T01:18:59.940821+0000","last_became_peered":"2024-09-16T01:18:59.940821+0000","last_unstale":"2024-09-16T01:19:01.238277+0000","last_undegraded":"2024-09-16T01:19:01.238277+0000","last_fullsized":"2024-09-16T01:19:01.238277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:41.090527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237472+0000","last_change":"2024-09-16T01:18:59.931274+0000","last_active":"2024-09-16T01:19:01.237472+0000","last_peered":"2024-09-16T01:19:01.237472+0000","last_clean":"2024-09-16T01:19:01.237472+0000","last_became_active":"2024-09-16T01:18:59.931025+0000","last_became_peered":"2024-09-16T01:18:59.931025+0000","last_unstale":"2024-09-16T01:19:01.237472+0000","last_undegraded":"2024-09-16T01:19:01.237472+0000","last_fullsized":"2024-09-16T01:19:01.237472+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:51.509920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.172839+0000","last_change":"2024-09-16T01:18:59.931207+0000","last_active":"2024-09-16T01:19:01.172839+0000","last_peered":"2024-09-16T01:19:01.172839+0000","last_clean":"2024-09-16T01:19:01.172839+0000","last_became_active":"2024-09-16T01:18:59.930929+0000","last_became_peered":"2024-09-16T01:18:59.930929+0000","last_unstale":"2024-09-16T01:19:01.172839+0000","last_undegraded":"2024-09-16T01:19:01.172839+0000","last_fullsized":"2024-09-16T01:19:01.172839+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:44.624530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237350+0000","last_change":"2024-09-16T01:18:59.943952+0000","last_active":"2024-09-16T01:19:01.237350+0000","last_peered":"2024-09-16T01:19:01.237350+0000","last_clean":"2024-09-16T01:19:01.237350+0000","last_became_active":"2024-09-16T01:18:59.943672+0000","last_became_peered":"2024-09-16T01:18:59.943672+0000","last_unstale":"2024-09-16T01:19:01.237350+0000","last_undegraded":"2024-09-16T01:19:01.237350+0000","last_fullsized":"2024-09-16T01:19:01.237350+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:43.639685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933368+0000","last_change":"2024-09-16T01:18:59.936039+0000","last_active":"2024-09-16T01:19:00.933368+0000","last_peered":"2024-09-16T01:19:00.933368+0000","last_clean":"2024-09-16T01:19:00.933368+0000","last_became_active":"2024-09-16T01:18:59.935754+0000","last_became_peered":"2024-09-16T01:18:59.935754+0000","last_unstale":"2024-09-16T01:19:00.933368+0000","last_undegraded":"2024-09-16T01:19:00.933368+0000","last_fullsized":"2024-09-16T01:19:00.933368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:11.257452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237379+0000","last_change":"2024-09-16T01:18:59.936033+0000","last_active":"2024-09-16T01:19:01.237379+0000","last_peered":"2024-09-16T01:19:01.237379+0000","last_clean":"2024-09-16T01:19:01.237379+0000","last_became_active":"2024-09-16T01:18:59.935795+0000","last_became_peered":"2024-09-16T01:18:59.935795+0000","last_unstale":"2024-09-16T01:19:01.237379+0000","last_undegraded":"2024-09-16T01:19:01.237379+0000","last_fullsized":"2024-09-16T01:19:01.237379+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:01.099236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.173149+0000","last_change":"2024-09-16T01:18:59.930898+0000","last_active":"2024-09-16T01:19:01.173149+0000","last_peered":"2024-09-16T01:19:01.173149+0000","last_clean":"2024-09-16T01:19:01.173149+0000","last_became_active":"2024-09-16T01:18:59.930620+0000","last_became_peered":"2024-09-16T01:18:59.930620+0000","last_unstale":"2024-09-16T01:19:01.173149+0000","last_undegraded":"2024-09-16T01:19:01.173149+0000","last_fullsized":"2024-09-16T01:19:01.173149+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:05.634207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.935227+0000","last_change":"2024-09-16T01:18:59.945023+0000","last_active":"2024-09-16T01:19:00.935227+0000","last_peered":"2024-09-16T01:19:00.935227+0000","last_clean":"2024-09-16T01:19:00.935227+0000","last_became_active":"2024-09-16T01:18:59.944700+0000","last_became_peered":"2024-09-16T01:18:59.944700+0000","last_unstale":"2024-09-16T01:19:00.935227+0000","last_undegraded":"2024-09-16T01:19:00.935227+0000","last_fullsized":"2024-09-16T01:19:00.935227+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:57.703130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.173137+0000","last_change":"2024-09-16T01:18:59.934756+0000","last_active":"2024-09-16T01:19:01.173137+0000","last_peered":"2024-09-16T01:19:01.173137+0000","last_clean":"2024-09-16T01:19:01.173137+0000","last_became_active":"2024-09-16T01:18:59.933667+0000","last_became_peered":"2024-09-16T01:18:59.933667+0000","last_unstale":"2024-09-16T01:19:01.173137+0000","last_undegraded":"2024-09-16T01:19:01.173137+0000","last_fullsized":"2024-09-16T01:19:01.173137+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:27.291384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.934917+0000","last_change":"2024-09-16T01:18:59.938583+0000","last_active":"2024-09-16T01:19:00.934917+0000","last_peered":"2024-09-16T01:19:00.934917+0000","last_clean":"2024-09-16T01:19:00.934917+0000","last_became_active":"2024-09-16T01:18:59.938287+0000","last_became_peered":"2024-09-16T01:18:59.938287+0000","last_unstale":"2024-09-16T01:19:00.934917+0000","last_undegraded":"2024-09-16T01:19:00.934917+0000","last_fullsized":"2024-09-16T01:19:00.934917+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:58:29.781955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237841+0000","last_change":"2024-09-16T01:18:59.935513+0000","last_active":"2024-09-16T01:19:01.237841+0000","last_peered":"2024-09-16T01:19:01.237841+0000","last_clean":"2024-09-16T01:19:01.237841+0000","last_became_active":"2024-09-16T01:18:59.935269+0000","last_became_peered":"2024-09-16T01:18:59.935269+0000","last_unstale":"2024-09-16T01:19:01.237841+0000","last_undegraded":"2024-09-16T01:19:01.237841+0000","last_fullsized":"2024-09-16T01:19:01.237841+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:27.291384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.172643+0000","last_change":"2024-09-16T01:18:59.933939+0000","last_active":"2024-09-16T01:19:01.172643+0000","last_peered":"2024-09-16T01:19:01.172643+0000","last_clean":"2024-09-16T01:19:01.172643+0000","last_became_active":"2024-09-16T01:18:59.933554+0000","last_became_peered":"2024-09-16T01:18:59.933554+0000","last_unstale":"2024-09-16T01:19:01.172643+0000","last_undegraded":"2024-09-16T01:19:01.172643+0000","last_fullsized":"2024-09-16T01:19:01.172643+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:53.950923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237525+0000","last_change":"2024-09-16T01:18:59.936978+0000","last_active":"2024-09-16T01:19:01.237525+0000","last_peered":"2024-09-16T01:19:01.237525+0000","last_clean":"2024-09-16T01:19:01.237525+0000","last_became_active":"2024-09-16T01:18:59.936712+0000","last_became_peered":"2024-09-16T01:18:59.936712+0000","last_unstale":"2024-09-16T01:19:01.237525+0000","last_undegraded":"2024-09-16T01:19:01.237525+0000","last_fullsized":"2024-09-16T01:19:01.237525+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:30.498623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237338+0000","last_change":"2024-09-16T01:18:59.940792+0000","last_active":"2024-09-16T01:19:01.237338+0000","last_peered":"2024-09-16T01:19:01.237338+0000","last_clean":"2024-09-16T01:19:01.237338+0000","last_became_active":"2024-09-16T01:18:59.939097+0000","last_became_peered":"2024-09-16T01:18:59.939097+0000","last_unstale":"2024-09-16T01:19:01.237338+0000","last_undegraded":"2024-09-16T01:19:01.237338+0000","last_fullsized":"2024-09-16T01:19:01.237338+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:45.036874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238031+0000","last_change":"2024-09-16T01:18:59.940208+0000","last_active":"2024-09-16T01:19:01.238031+0000","last_peered":"2024-09-16T01:19:01.238031+0000","last_clean":"2024-09-16T01:19:01.238031+0000","last_became_active":"2024-09-16T01:18:59.939963+0000","last_became_peered":"2024-09-16T01:18:59.939963+0000","last_unstale":"2024-09-16T01:19:01.238031+0000","last_undegraded":"2024-09-16T01:19:01.238031+0000","last_fullsized":"2024-09-16T01:19:01.238031+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:10.337326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238040+0000","last_change":"2024-09-16T01:18:59.937917+0000","last_active":"2024-09-16T01:19:01.238040+0000","last_peered":"2024-09-16T01:19:01.238040+0000","last_clean":"2024-09-16T01:19:01.238040+0000","last_became_active":"2024-09-16T01:18:59.937666+0000","last_became_peered":"2024-09-16T01:18:59.937666+0000","last_unstale":"2024-09-16T01:19:01.238040+0000","last_undegraded":"2024-09-16T01:19:01.238040+0000","last_fullsized":"2024-09-16T01:19:01.238040+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:14.851108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.173177+0000","last_change":"2024-09-16T01:18:59.933365+0000","last_active":"2024-09-16T01:19:01.173177+0000","last_peered":"2024-09-16T01:19:01.173177+0000","last_clean":"2024-09-16T01:19:01.173177+0000","last_became_active":"2024-09-16T01:18:59.933089+0000","last_became_peered":"2024-09-16T01:18:59.933089+0000","last_unstale":"2024-09-16T01:19:01.173177+0000","last_undegraded":"2024-09-16T01:19:01.173177+0000","last_fullsized":"2024-09-16T01:19:01.173177+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:55.433241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237620+0000","last_change":"2024-09-16T01:18:59.939876+0000","last_active":"2024-09-16T01:19:01.237620+0000","last_peered":"2024-09-16T01:19:01.237620+0000","last_clean":"2024-09-16T01:19:01.237620+0000","last_became_active":"2024-09-16T01:18:59.939230+0000","last_became_peered":"2024-09-16T01:18:59.939230+0000","last_unstale":"2024-09-16T01:19:01.237620+0000","last_undegraded":"2024-09-16T01:19:01.237620+0000","last_fullsized":"2024-09-16T01:19:01.237620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:10.784711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.172745+0000","last_change":"2024-09-16T01:18:59.936029+0000","last_active":"2024-09-16T01:19:01.172745+0000","last_peered":"2024-09-16T01:19:01.172745+0000","last_clean":"2024-09-16T01:19:01.172745+0000","last_became_active":"2024-09-16T01:18:59.935756+0000","last_became_peered":"2024-09-16T01:18:59.935756+0000","last_unstale":"2024-09-16T01:19:01.172745+0000","last_undegraded":"2024-09-16T01:19:01.172745+0000","last_fullsized":"2024-09-16T01:19:01.172745+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:51.509920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.172678+0000","last_change":"2024-09-16T01:18:59.934309+0000","last_active":"2024-09-16T01:19:01.172678+0000","last_peered":"2024-09-16T01:19:01.172678+0000","last_clean":"2024-09-16T01:19:01.172678+0000","last_became_active":"2024-09-16T01:18:59.933997+0000","last_became_peered":"2024-09-16T01:18:59.933997+0000","last_unstale":"2024-09-16T01:19:01.172678+0000","last_undegraded":"2024-09-16T01:19:01.172678+0000","last_fullsized":"2024-09-16T01:19:01.172678+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:01.099236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237959+0000","last_change":"2024-09-16T01:18:59.932785+0000","last_active":"2024-09-16T01:19:01.237959+0000","last_peered":"2024-09-16T01:19:01.237959+0000","last_clean":"2024-09-16T01:19:01.237959+0000","last_became_active":"2024-09-16T01:18:59.932379+0000","last_became_peered":"2024-09-16T01:18:59.932379+0000","last_unstale":"2024-09-16T01:19:01.237959+0000","last_undegraded":"2024-09-16T01:19:01.237959+0000","last_fullsized":"2024-09-16T01:19:01.237959+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:01.099236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238569+0000","last_change":"2024-09-16T01:18:59.938466+0000","last_active":"2024-09-16T01:19:01.238569+0000","last_peered":"2024-09-16T01:19:01.238569+0000","last_clean":"2024-09-16T01:19:01.238569+0000","last_became_active":"2024-09-16T01:18:59.938202+0000","last_became_peered":"2024-09-16T01:18:59.938202+0000","last_unstale":"2024-09-16T01:19:01.238569+0000","last_undegraded":"2024-09-16T01:19:01.238569+0000","last_fullsized":"2024-09-16T01:19:01.238569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:50.424491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933277+0000","last_change":"2024-09-16T01:18:59.926413+0000","last_active":"2024-09-16T01:19:00.933277+0000","last_peered":"2024-09-16T01:19:00.933277+0000","last_clean":"2024-09-16T01:19:00.933277+0000","last_became_active":"2024-09-16T01:18:59.926086+0000","last_became_peered":"2024-09-16T01:18:59.926086+0000","last_unstale":"2024-09-16T01:19:00.933277+0000","last_undegraded":"2024-09-16T01:19:00.933277+0000","last_fullsized":"2024-09-16T01:19:00.933277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:41.741997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.173070+0000","last_change":"2024-09-16T01:18:59.934348+0000","last_active":"2024-09-16T01:19:01.173070+0000","last_peered":"2024-09-16T01:19:01.173070+0000","last_clean":"2024-09-16T01:19:01.173070+0000","last_became_active":"2024-09-16T01:18:59.934050+0000","last_became_peered":"2024-09-16T01:18:59.934050+0000","last_unstale":"2024-09-16T01:19:01.173070+0000","last_undegraded":"2024-09-16T01:19:01.173070+0000","last_fullsized":"2024-09-16T01:19:01.173070+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:48.304942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.935157+0000","last_change":"2024-09-16T01:18:59.935624+0000","last_active":"2024-09-16T01:19:00.935157+0000","last_peered":"2024-09-16T01:19:00.935157+0000","last_clean":"2024-09-16T01:19:00.935157+0000","last_became_active":"2024-09-16T01:18:59.935219+0000","last_became_peered":"2024-09-16T01:18:59.935219+0000","last_unstale":"2024-09-16T01:19:00.935157+0000","last_undegraded":"2024-09-16T01:19:00.935157+0000","last_fullsized":"2024-09-16T01:19:00.935157+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:25.902497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238219+0000","last_change":"2024-09-16T01:18:59.938898+0000","last_active":"2024-09-16T01:19:01.238219+0000","last_peered":"2024-09-16T01:19:01.238219+0000","last_clean":"2024-09-16T01:19:01.238219+0000","last_became_active":"2024-09-16T01:18:59.938627+0000","last_became_peered":"2024-09-16T01:18:59.938627+0000","last_unstale":"2024-09-16T01:19:01.238219+0000","last_undegraded":"2024-09-16T01:19:01.238219+0000","last_fullsized":"2024-09-16T01:19:01.238219+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:31.494894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.934029+0000","last_change":"2024-09-16T01:18:59.931599+0000","last_active":"2024-09-16T01:19:00.934029+0000","last_peered":"2024-09-16T01:19:00.934029+0000","last_clean":"2024-09-16T01:19:00.934029+0000","last_became_active":"2024-09-16T01:18:59.931308+0000","last_became_peered":"2024-09-16T01:18:59.931308+0000","last_unstale":"2024-09-16T01:19:00.934029+0000","last_undegraded":"2024-09-16T01:19:00.934029+0000","last_fullsized":"2024-09-16T01:19:00.934029+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:13.447449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.172865+0000","last_change":"2024-09-16T01:18:59.931562+0000","last_active":"2024-09-16T01:19:01.172865+0000","last_peered":"2024-09-16T01:19:01.172865+0000","last_clean":"2024-09-16T01:19:01.172865+0000","last_became_active":"2024-09-16T01:18:59.931296+0000","last_became_peered":"2024-09-16T01:18:59.931296+0000","last_unstale":"2024-09-16T01:19:01.172865+0000","last_undegraded":"2024-09-16T01:19:01.172865+0000","last_fullsized":"2024-09-16T01:19:01.172865+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:30.498623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933068+0000","last_change":"2024-09-16T01:18:59.943754+0000","last_active":"2024-09-16T01:19:00.933068+0000","last_peered":"2024-09-16T01:19:00.933068+0000","last_clean":"2024-09-16T01:19:00.933068+0000","last_became_active":"2024-09-16T01:18:59.943453+0000","last_became_peered":"2024-09-16T01:18:59.943453+0000","last_unstale":"2024-09-16T01:19:00.933068+0000","last_undegraded":"2024-09-16T01:19:00.933068+0000","last_fullsized":"2024-09-16T01:19:00.933068+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:31.494894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237496+0000","last_change":"2024-09-16T01:18:59.937293+0000","last_active":"2024-09-16T01:19:01.237496+0000","last_peered":"2024-09-16T01:19:01.237496+0000","last_clean":"2024-09-16T01:19:01.237496+0000","last_became_active":"2024-09-16T01:18:59.936782+0000","last_became_peered":"2024-09-16T01:18:59.936782+0000","last_unstale":"2024-09-16T01:19:01.237496+0000","last_undegraded":"2024-09-16T01:19:01.237496+0000","last_fullsized":"2024-09-16T01:19:01.237496+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:13.419040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237475+0000","last_change":"2024-09-16T01:18:59.937124+0000","last_active":"2024-09-16T01:19:01.237475+0000","last_peered":"2024-09-16T01:19:01.237475+0000","last_clean":"2024-09-16T01:19:01.237475+0000","last_became_active":"2024-09-16T01:18:59.934947+0000","last_became_peered":"2024-09-16T01:18:59.934947+0000","last_unstale":"2024-09-16T01:19:01.237475+0000","last_undegraded":"2024-09-16T01:19:01.237475+0000","last_fullsized":"2024-09-16T01:19:01.237475+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:27.182249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238195+0000","last_change":"2024-09-16T01:18:58.927153+0000","last_active":"2024-09-16T01:19:01.238195+0000","last_peered":"2024-09-16T01:19:01.238195+0000","last_clean":"2024-09-16T01:19:01.238195+0000","last_became_active":"2024-09-16T01:18:58.926876+0000","last_became_peered":"2024-09-16T01:18:58.926876+0000","last_unstale":"2024-09-16T01:19:01.238195+0000","last_undegraded":"2024-09-16T01:19:01.238195+0000","last_fullsized":"2024-09-16T01:19:01.238195+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:46.764969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237549+0000","last_change":"2024-09-16T01:18:59.933617+0000","last_active":"2024-09-16T01:19:01.237549+0000","last_peered":"2024-09-16T01:19:01.237549+0000","last_clean":"2024-09-16T01:19:01.237549+0000","last_became_active":"2024-09-16T01:18:59.933363+0000","last_became_peered":"2024-09-16T01:18:59.933363+0000","last_unstale":"2024-09-16T01:19:01.237549+0000","last_undegraded":"2024-09-16T01:19:01.237549+0000","last_fullsized":"2024-09-16T01:19:01.237549+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:23.706252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.173118+0000","last_change":"2024-09-16T01:18:58.931491+0000","last_active":"2024-09-16T01:19:01.173118+0000","last_peered":"2024-09-16T01:19:01.173118+0000","last_clean":"2024-09-16T01:19:01.173118+0000","last_became_active":"2024-09-16T01:18:58.931034+0000","last_became_peered":"2024-09-16T01:18:58.931034+0000","last_unstale":"2024-09-16T01:19:01.173118+0000","last_undegraded":"2024-09-16T01:19:01.173118+0000","last_fullsized":"2024-09-16T01:19:01.173118+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:43:52.300527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933277+0000","last_change":"2024-09-16T01:18:59.932574+0000","last_active":"2024-09-16T01:19:00.933277+0000","last_peered":"2024-09-16T01:19:00.933277+0000","last_clean":"2024-09-16T01:19:00.933277+0000","last_became_active":"2024-09-16T01:18:59.932297+0000","last_became_peered":"2024-09-16T01:18:59.932297+0000","last_unstale":"2024-09-16T01:19:00.933277+0000","last_undegraded":"2024-09-16T01:19:00.933277+0000","last_fullsized":"2024-09-16T01:19:00.933277+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.029490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933607+0000","last_change":"2024-09-16T01:18:58.936817+0000","last_active":"2024-09-16T01:19:00.933607+0000","last_peered":"2024-09-16T01:19:00.933607+0000","last_clean":"2024-09-16T01:19:00.933607+0000","last_became_active":"2024-09-16T01:18:58.936602+0000","last_became_peered":"2024-09-16T01:18:58.936602+0000","last_unstale":"2024-09-16T01:19:00.933607+0000","last_undegraded":"2024-09-16T01:19:00.933607+0000","last_fullsized":"2024-09-16T01:19:00.933607+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:48.149837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238050+0000","last_change":"2024-09-16T01:18:59.928322+0000","last_active":"2024-09-16T01:19:01.238050+0000","last_peered":"2024-09-16T01:19:01.238050+0000","last_clean":"2024-09-16T01:19:01.238050+0000","last_became_active":"2024-09-16T01:18:59.928048+0000","last_became_peered":"2024-09-16T01:18:59.928048+0000","last_unstale":"2024-09-16T01:19:01.238050+0000","last_undegraded":"2024-09-16T01:19:01.238050+0000","last_fullsized":"2024-09-16T01:19:01.238050+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:12:28.927708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238103+0000","last_change":"2024-09-16T01:18:58.932019+0000","last_active":"2024-09-16T01:19:01.238103+0000","last_peered":"2024-09-16T01:19:01.238103+0000","last_clean":"2024-09-16T01:19:01.238103+0000","last_became_active":"2024-09-16T01:18:58.931650+0000","last_became_peered":"2024-09-16T01:18:58.931650+0000","last_unstale":"2024-09-16T01:19:01.238103+0000","last_undegraded":"2024-09-16T01:19:01.238103+0000","last_fullsized":"2024-09-16T01:19:01.238103+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:27.626499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237517+0000","last_change":"2024-09-16T01:18:59.938284+0000","last_active":"2024-09-16T01:19:01.237517+0000","last_peered":"2024-09-16T01:19:01.237517+0000","last_clean":"2024-09-16T01:19:01.237517+0000","last_became_active":"2024-09-16T01:18:59.937853+0000","last_became_peered":"2024-09-16T01:18:59.937853+0000","last_unstale":"2024-09-16T01:19:01.237517+0000","last_undegraded":"2024-09-16T01:19:01.237517+0000","last_fullsized":"2024-09-16T01:19:01.237517+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:44.624530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.172919+0000","last_change":"2024-09-16T01:18:58.934817+0000","last_active":"2024-09-16T01:19:01.172919+0000","last_peered":"2024-09-16T01:19:01.172919+0000","last_clean":"2024-09-16T01:19:01.172919+0000","last_became_active":"2024-09-16T01:18:58.934544+0000","last_became_peered":"2024-09-16T01:18:58.934544+0000","last_unstale":"2024-09-16T01:19:01.172919+0000","last_undegraded":"2024-09-16T01:19:01.172919+0000","last_fullsized":"2024-09-16T01:19:01.172919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:27:35.527039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238000+0000","last_change":"2024-09-16T01:18:59.929862+0000","last_active":"2024-09-16T01:19:01.238000+0000","last_peered":"2024-09-16T01:19:01.238000+0000","last_clean":"2024-09-16T01:19:01.238000+0000","last_became_active":"2024-09-16T01:18:59.929459+0000","last_became_peered":"2024-09-16T01:18:59.929459+0000","last_unstale":"2024-09-16T01:19:01.238000+0000","last_undegraded":"2024-09-16T01:19:01.238000+0000","last_fullsized":"2024-09-16T01:19:01.238000+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:51.509920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238347+0000","last_change":"2024-09-16T01:18:58.936673+0000","last_active":"2024-09-16T01:19:01.238347+0000","last_peered":"2024-09-16T01:19:01.238347+0000","last_clean":"2024-09-16T01:19:01.238347+0000","last_became_active":"2024-09-16T01:18:58.935824+0000","last_became_peered":"2024-09-16T01:18:58.935824+0000","last_unstale":"2024-09-16T01:19:01.238347+0000","last_undegraded":"2024-09-16T01:19:01.238347+0000","last_fullsized":"2024-09-16T01:19:01.238347+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:28.832567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237528+0000","last_change":"2024-09-16T01:18:59.933390+0000","last_active":"2024-09-16T01:19:01.237528+0000","last_peered":"2024-09-16T01:19:01.237528+0000","last_clean":"2024-09-16T01:19:01.237528+0000","last_became_active":"2024-09-16T01:18:59.933114+0000","last_became_peered":"2024-09-16T01:18:59.933114+0000","last_unstale":"2024-09-16T01:19:01.237528+0000","last_undegraded":"2024-09-16T01:19:01.237528+0000","last_fullsized":"2024-09-16T01:19:01.237528+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:50.364654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238524+0000","last_change":"2024-09-16T01:18:58.929799+0000","last_active":"2024-09-16T01:19:01.238524+0000","last_peered":"2024-09-16T01:19:01.238524+0000","last_clean":"2024-09-16T01:19:01.238524+0000","last_became_active":"2024-09-16T01:18:58.929530+0000","last_became_peered":"2024-09-16T01:18:58.929530+0000","last_unstale":"2024-09-16T01:19:01.238524+0000","last_undegraded":"2024-09-16T01:19:01.238524+0000","last_fullsized":"2024-09-16T01:19:01.238524+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:04.630048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237987+0000","last_change":"2024-09-16T01:18:59.943105+0000","last_active":"2024-09-16T01:19:01.237987+0000","last_peered":"2024-09-16T01:19:01.237987+0000","last_clean":"2024-09-16T01:19:01.237987+0000","last_became_active":"2024-09-16T01:18:59.942867+0000","last_became_peered":"2024-09-16T01:18:59.942867+0000","last_unstale":"2024-09-16T01:19:01.237987+0000","last_undegraded":"2024-09-16T01:19:01.237987+0000","last_fullsized":"2024-09-16T01:19:01.237987+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:11:05.634207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.934099+0000","last_change":"2024-09-16T01:18:58.931589+0000","last_active":"2024-09-16T01:19:00.934099+0000","last_peered":"2024-09-16T01:19:00.934099+0000","last_clean":"2024-09-16T01:19:00.934099+0000","last_became_active":"2024-09-16T01:18:58.931258+0000","last_became_peered":"2024-09-16T01:18:58.931258+0000","last_unstale":"2024-09-16T01:19:00.934099+0000","last_undegraded":"2024-09-16T01:19:00.934099+0000","last_fullsized":"2024-09-16T01:19:00.934099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:37.009727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.173032+0000","last_change":"2024-09-16T01:18:59.938561+0000","last_active":"2024-09-16T01:19:01.173032+0000","last_peered":"2024-09-16T01:19:01.173032+0000","last_clean":"2024-09-16T01:19:01.173032+0000","last_became_active":"2024-09-16T01:18:59.938292+0000","last_became_peered":"2024-09-16T01:18:59.938292+0000","last_unstale":"2024-09-16T01:19:01.173032+0000","last_undegraded":"2024-09-16T01:19:01.173032+0000","last_fullsized":"2024-09-16T01:19:01.173032+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:10.784711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933329+0000","last_change":"2024-09-16T01:18:58.934989+0000","last_active":"2024-09-16T01:19:00.933329+0000","last_peered":"2024-09-16T01:19:00.933329+0000","last_clean":"2024-09-16T01:19:00.933329+0000","last_became_active":"2024-09-16T01:18:58.934740+0000","last_became_peered":"2024-09-16T01:18:58.934740+0000","last_unstale":"2024-09-16T01:19:00.933329+0000","last_undegraded":"2024-09-16T01:19:00.933329+0000","last_fullsized":"2024-09-16T01:19:00.933329+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:00:00.095077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933549+0000","last_change":"2024-09-16T01:18:59.940789+0000","last_active":"2024-09-16T01:19:00.933549+0000","last_peered":"2024-09-16T01:19:00.933549+0000","last_clean":"2024-09-16T01:19:00.933549+0000","last_became_active":"2024-09-16T01:18:59.940487+0000","last_became_peered":"2024-09-16T01:18:59.940487+0000","last_unstale":"2024-09-16T01:19:00.933549+0000","last_undegraded":"2024-09-16T01:19:00.933549+0000","last_fullsized":"2024-09-16T01:19:00.933549+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:39.163471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238303+0000","last_change":"2024-09-16T01:18:58.936005+0000","last_active":"2024-09-16T01:19:01.238303+0000","last_peered":"2024-09-16T01:19:01.238303+0000","last_clean":"2024-09-16T01:19:01.238303+0000","last_became_active":"2024-09-16T01:18:58.935646+0000","last_became_peered":"2024-09-16T01:18:58.935646+0000","last_unstale":"2024-09-16T01:19:01.238303+0000","last_undegraded":"2024-09-16T01:19:01.238303+0000","last_fullsized":"2024-09-16T01:19:01.238303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:54.429082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238176+0000","last_change":"2024-09-16T01:18:59.942486+0000","last_active":"2024-09-16T01:19:01.238176+0000","last_peered":"2024-09-16T01:19:01.238176+0000","last_clean":"2024-09-16T01:19:01.238176+0000","last_became_active":"2024-09-16T01:18:59.942233+0000","last_became_peered":"2024-09-16T01:18:59.942233+0000","last_unstale":"2024-09-16T01:19:01.238176+0000","last_undegraded":"2024-09-16T01:19:01.238176+0000","last_fullsized":"2024-09-16T01:19:01.238176+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:51.663511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.173237+0000","last_change":"2024-09-16T01:18:58.933530+0000","last_active":"2024-09-16T01:19:01.173237+0000","last_peered":"2024-09-16T01:19:01.173237+0000","last_clean":"2024-09-16T01:19:01.173237+0000","last_became_active":"2024-09-16T01:18:58.933139+0000","last_became_peered":"2024-09-16T01:18:58.933139+0000","last_unstale":"2024-09-16T01:19:01.173237+0000","last_undegraded":"2024-09-16T01:19:01.173237+0000","last_fullsized":"2024-09-16T01:19:01.173237+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:02.108569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238204+0000","last_change":"2024-09-16T01:18:59.943531+0000","last_active":"2024-09-16T01:19:01.238204+0000","last_peered":"2024-09-16T01:19:01.238204+0000","last_clean":"2024-09-16T01:19:01.238204+0000","last_became_active":"2024-09-16T01:18:59.943241+0000","last_became_peered":"2024-09-16T01:18:59.943241+0000","last_unstale":"2024-09-16T01:19:01.238204+0000","last_undegraded":"2024-09-16T01:19:01.238204+0000","last_fullsized":"2024-09-16T01:19:01.238204+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:55.433241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"86'6","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238084+0000","last_change":"2024-09-16T01:18:58.925156+0000","last_active":"2024-09-16T01:19:01.238084+0000","last_peered":"2024-09-16T01:19:01.238084+0000","last_clean":"2024-09-16T01:19:01.238084+0000","last_became_active":"2024-09-16T01:18:58.924847+0000","last_became_peered":"2024-09-16T01:18:58.924847+0000","last_unstale":"2024-09-16T01:19:01.238084+0000","last_undegraded":"2024-09-16T01:19:01.238084+0000","last_fullsized":"2024-09-16T01:19:01.238084+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:40.086368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237641+0000","last_change":"2024-09-16T01:18:59.935367+0000","last_active":"2024-09-16T01:19:01.237641+0000","last_peered":"2024-09-16T01:19:01.237641+0000","last_clean":"2024-09-16T01:19:01.237641+0000","last_became_active":"2024-09-16T01:18:59.935084+0000","last_became_peered":"2024-09-16T01:18:59.935084+0000","last_unstale":"2024-09-16T01:19:01.237641+0000","last_undegraded":"2024-09-16T01:19:01.237641+0000","last_fullsized":"2024-09-16T01:19:01.237641+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:48.304942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933952+0000","last_change":"2024-09-16T01:18:58.932222+0000","last_active":"2024-09-16T01:19:00.933952+0000","last_peered":"2024-09-16T01:19:00.933952+0000","last_clean":"2024-09-16T01:19:00.933952+0000","last_became_active":"2024-09-16T01:18:58.931962+0000","last_became_peered":"2024-09-16T01:18:58.931962+0000","last_unstale":"2024-09-16T01:19:00.933952+0000","last_undegraded":"2024-09-16T01:19:00.933952+0000","last_fullsized":"2024-09-16T01:19:00.933952+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:40.086368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.172618+0000","last_change":"2024-09-16T01:18:59.926035+0000","last_active":"2024-09-16T01:19:01.172618+0000","last_peered":"2024-09-16T01:19:01.172618+0000","last_clean":"2024-09-16T01:19:01.172618+0000","last_became_active":"2024-09-16T01:18:59.925744+0000","last_became_peered":"2024-09-16T01:18:59.925744+0000","last_unstale":"2024-09-16T01:19:01.172618+0000","last_undegraded":"2024-09-16T01:19:01.172618+0000","last_fullsized":"2024-09-16T01:19:01.172618+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:07.423496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237575+0000","last_change":"2024-09-16T01:18:58.929016+0000","last_active":"2024-09-16T01:19:01.237575+0000","last_peered":"2024-09-16T01:19:01.237575+0000","last_clean":"2024-09-16T01:19:01.237575+0000","last_became_active":"2024-09-16T01:18:58.928763+0000","last_became_peered":"2024-09-16T01:18:58.928763+0000","last_unstale":"2024-09-16T01:19:01.237575+0000","last_undegraded":"2024-09-16T01:19:01.237575+0000","last_fullsized":"2024-09-16T01:19:01.237575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:49.420332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.934850+0000","last_change":"2024-09-16T01:18:59.944509+0000","last_active":"2024-09-16T01:19:00.934850+0000","last_peered":"2024-09-16T01:19:00.934850+0000","last_clean":"2024-09-16T01:19:00.934850+0000","last_became_active":"2024-09-16T01:18:59.944235+0000","last_became_peered":"2024-09-16T01:18:59.944235+0000","last_unstale":"2024-09-16T01:19:00.934850+0000","last_undegraded":"2024-09-16T01:19:00.934850+0000","last_fullsized":"2024-09-16T01:19:00.934850+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:43.962866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237694+0000","last_change":"2024-09-16T01:18:58.931784+0000","last_active":"2024-09-16T01:19:01.237694+0000","last_peered":"2024-09-16T01:19:01.237694+0000","last_clean":"2024-09-16T01:19:01.237694+0000","last_became_active":"2024-09-16T01:18:58.931496+0000","last_became_peered":"2024-09-16T01:18:58.931496+0000","last_unstale":"2024-09-16T01:19:01.237694+0000","last_undegraded":"2024-09-16T01:19:01.237694+0000","last_fullsized":"2024-09-16T01:19:01.237694+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:56.666019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.935045+0000","last_change":"2024-09-16T01:18:59.937035+0000","last_active":"2024-09-16T01:19:00.935045+0000","last_peered":"2024-09-16T01:19:00.935045+0000","last_clean":"2024-09-16T01:19:00.935045+0000","last_became_active":"2024-09-16T01:18:59.936593+0000","last_became_peered":"2024-09-16T01:18:59.936593+0000","last_unstale":"2024-09-16T01:19:00.935045+0000","last_undegraded":"2024-09-16T01:19:00.935045+0000","last_fullsized":"2024-09-16T01:19:00.935045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:13.466219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"86'8","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237686+0000","last_change":"2024-09-16T01:18:58.936635+0000","last_active":"2024-09-16T01:19:01.237686+0000","last_peered":"2024-09-16T01:19:01.237686+0000","last_clean":"2024-09-16T01:19:01.237686+0000","last_became_active":"2024-09-16T01:18:58.936337+0000","last_became_peered":"2024-09-16T01:18:58.936337+0000","last_unstale":"2024-09-16T01:19:01.237686+0000","last_undegraded":"2024-09-16T01:19:01.237686+0000","last_fullsized":"2024-09-16T01:19:01.237686+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:32.207948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238107+0000","last_change":"2024-09-16T01:18:59.936723+0000","last_active":"2024-09-16T01:19:01.238107+0000","last_peered":"2024-09-16T01:19:01.238107+0000","last_clean":"2024-09-16T01:19:01.238107+0000","last_became_active":"2024-09-16T01:18:59.936467+0000","last_became_peered":"2024-09-16T01:18:59.936467+0000","last_unstale":"2024-09-16T01:19:01.238107+0000","last_undegraded":"2024-09-16T01:19:01.238107+0000","last_fullsized":"2024-09-16T01:19:01.238107+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:04.998706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238269+0000","last_change":"2024-09-16T01:18:58.928649+0000","last_active":"2024-09-16T01:19:01.238269+0000","last_peered":"2024-09-16T01:19:01.238269+0000","last_clean":"2024-09-16T01:19:01.238269+0000","last_became_active":"2024-09-16T01:18:58.928340+0000","last_became_peered":"2024-09-16T01:18:58.928340+0000","last_unstale":"2024-09-16T01:19:01.238269+0000","last_undegraded":"2024-09-16T01:19:01.238269+0000","last_fullsized":"2024-09-16T01:19:01.238269+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:23.659317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238213+0000","last_change":"2024-09-16T01:18:59.930948+0000","last_active":"2024-09-16T01:19:01.238213+0000","last_peered":"2024-09-16T01:19:01.238213+0000","last_clean":"2024-09-16T01:19:01.238213+0000","last_became_active":"2024-09-16T01:18:59.930673+0000","last_became_peered":"2024-09-16T01:18:59.930673+0000","last_unstale":"2024-09-16T01:19:01.238213+0000","last_undegraded":"2024-09-16T01:19:01.238213+0000","last_fullsized":"2024-09-16T01:19:01.238213+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:30.498623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933342+0000","last_change":"2024-09-16T01:18:58.929729+0000","last_active":"2024-09-16T01:19:00.933342+0000","last_peered":"2024-09-16T01:19:00.933342+0000","last_clean":"2024-09-16T01:19:00.933342+0000","last_became_active":"2024-09-16T01:18:58.929452+0000","last_became_peered":"2024-09-16T01:18:58.929452+0000","last_unstale":"2024-09-16T01:19:00.933342+0000","last_undegraded":"2024-09-16T01:19:00.933342+0000","last_fullsized":"2024-09-16T01:19:00.933342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:50.659352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.173180+0000","last_change":"2024-09-16T01:18:59.933533+0000","last_active":"2024-09-16T01:19:01.173180+0000","last_peered":"2024-09-16T01:19:01.173180+0000","last_clean":"2024-09-16T01:19:01.173180+0000","last_became_active":"2024-09-16T01:18:59.932991+0000","last_became_peered":"2024-09-16T01:18:59.932991+0000","last_unstale":"2024-09-16T01:19:01.173180+0000","last_undegraded":"2024-09-16T01:19:01.173180+0000","last_fullsized":"2024-09-16T01:19:01.173180+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:31.494894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.173294+0000","last_change":"2024-09-16T01:18:58.936287+0000","last_active":"2024-09-16T01:19:01.173294+0000","last_peered":"2024-09-16T01:19:01.173294+0000","last_clean":"2024-09-16T01:19:01.173294+0000","last_became_active":"2024-09-16T01:18:58.936024+0000","last_became_peered":"2024-09-16T01:18:58.936024+0000","last_unstale":"2024-09-16T01:19:01.173294+0000","last_undegraded":"2024-09-16T01:19:01.173294+0000","last_fullsized":"2024-09-16T01:19:01.173294+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:34.012849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237630+0000","last_change":"2024-09-16T01:18:59.937080+0000","last_active":"2024-09-16T01:19:01.237630+0000","last_peered":"2024-09-16T01:19:01.237630+0000","last_clean":"2024-09-16T01:19:01.237630+0000","last_became_active":"2024-09-16T01:18:59.936422+0000","last_became_peered":"2024-09-16T01:18:59.936422+0000","last_unstale":"2024-09-16T01:19:01.237630+0000","last_undegraded":"2024-09-16T01:19:01.237630+0000","last_fullsized":"2024-09-16T01:19:01.237630+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:46.004696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933027+0000","last_change":"2024-09-16T01:18:58.934383+0000","last_active":"2024-09-16T01:19:00.933027+0000","last_peered":"2024-09-16T01:19:00.933027+0000","last_clean":"2024-09-16T01:19:00.933027+0000","last_became_active":"2024-09-16T01:18:58.934097+0000","last_became_peered":"2024-09-16T01:18:58.934097+0000","last_unstale":"2024-09-16T01:19:00.933027+0000","last_undegraded":"2024-09-16T01:19:00.933027+0000","last_fullsized":"2024-09-16T01:19:00.933027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:50.505761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933516+0000","last_change":"2024-09-16T01:18:59.936507+0000","last_active":"2024-09-16T01:19:00.933516+0000","last_peered":"2024-09-16T01:19:00.933516+0000","last_clean":"2024-09-16T01:19:00.933516+0000","last_became_active":"2024-09-16T01:18:59.936183+0000","last_became_peered":"2024-09-16T01:18:59.936183+0000","last_unstale":"2024-09-16T01:19:00.933516+0000","last_undegraded":"2024-09-16T01:19:00.933516+0000","last_fullsized":"2024-09-16T01:19:00.933516+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:38:25.890341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.934769+0000","last_change":"2024-09-16T01:18:58.935004+0000","last_active":"2024-09-16T01:19:00.934769+0000","last_peered":"2024-09-16T01:19:00.934769+0000","last_clean":"2024-09-16T01:19:00.934769+0000","last_became_active":"2024-09-16T01:18:58.934717+0000","last_became_peered":"2024-09-16T01:18:58.934717+0000","last_unstale":"2024-09-16T01:19:00.934769+0000","last_undegraded":"2024-09-16T01:19:00.934769+0000","last_fullsized":"2024-09-16T01:19:00.934769+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:58.757335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933864+0000","last_change":"2024-09-16T01:18:59.933779+0000","last_active":"2024-09-16T01:19:00.933864+0000","last_peered":"2024-09-16T01:19:00.933864+0000","last_clean":"2024-09-16T01:19:00.933864+0000","last_became_active":"2024-09-16T01:18:59.933520+0000","last_became_peered":"2024-09-16T01:18:59.933520+0000","last_unstale":"2024-09-16T01:19:00.933864+0000","last_undegraded":"2024-09-16T01:19:00.933864+0000","last_fullsized":"2024-09-16T01:19:00.933864+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:41.035755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933571+0000","last_change":"2024-09-16T01:18:58.926740+0000","last_active":"2024-09-16T01:19:00.933571+0000","last_peered":"2024-09-16T01:19:00.933571+0000","last_clean":"2024-09-16T01:19:00.933571+0000","last_became_active":"2024-09-16T01:18:58.926457+0000","last_became_peered":"2024-09-16T01:18:58.926457+0000","last_unstale":"2024-09-16T01:19:00.933571+0000","last_undegraded":"2024-09-16T01:19:00.933571+0000","last_fullsized":"2024-09-16T01:19:00.933571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:43.620371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237879+0000","last_change":"2024-09-16T01:18:59.931237+0000","last_active":"2024-09-16T01:19:01.237879+0000","last_peered":"2024-09-16T01:19:01.237879+0000","last_clean":"2024-09-16T01:19:01.237879+0000","last_became_active":"2024-09-16T01:18:59.930976+0000","last_became_peered":"2024-09-16T01:18:59.930976+0000","last_unstale":"2024-09-16T01:19:01.237879+0000","last_undegraded":"2024-09-16T01:19:01.237879+0000","last_fullsized":"2024-09-16T01:19:01.237879+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:12.985819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.934703+0000","last_change":"2024-09-16T01:18:58.930311+0000","last_active":"2024-09-16T01:19:00.934703+0000","last_peered":"2024-09-16T01:19:00.934703+0000","last_clean":"2024-09-16T01:19:00.934703+0000","last_became_active":"2024-09-16T01:18:58.930044+0000","last_became_peered":"2024-09-16T01:18:58.930044+0000","last_unstale":"2024-09-16T01:19:00.934703+0000","last_undegraded":"2024-09-16T01:19:00.934703+0000","last_fullsized":"2024-09-16T01:19:00.934703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:39.163374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238201+0000","last_change":"2024-09-16T01:18:59.932267+0000","last_active":"2024-09-16T01:19:01.238201+0000","last_peered":"2024-09-16T01:19:01.238201+0000","last_clean":"2024-09-16T01:19:01.238201+0000","last_became_active":"2024-09-16T01:18:59.931852+0000","last_became_peered":"2024-09-16T01:18:59.931852+0000","last_unstale":"2024-09-16T01:19:01.238201+0000","last_undegraded":"2024-09-16T01:19:01.238201+0000","last_fullsized":"2024-09-16T01:19:01.238201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:44.624530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933671+0000","last_change":"2024-09-16T01:18:58.928634+0000","last_active":"2024-09-16T01:19:00.933671+0000","last_peered":"2024-09-16T01:19:00.933671+0000","last_clean":"2024-09-16T01:19:00.933671+0000","last_became_active":"2024-09-16T01:18:58.928338+0000","last_became_peered":"2024-09-16T01:18:58.928338+0000","last_unstale":"2024-09-16T01:19:00.933671+0000","last_undegraded":"2024-09-16T01:19:00.933671+0000","last_fullsized":"2024-09-16T01:19:00.933671+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:49.420332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237758+0000","last_change":"2024-09-16T01:18:59.937882+0000","last_active":"2024-09-16T01:19:01.237758+0000","last_peered":"2024-09-16T01:19:01.237758+0000","last_clean":"2024-09-16T01:19:01.237758+0000","last_became_active":"2024-09-16T01:18:59.937632+0000","last_became_peered":"2024-09-16T01:18:59.937632+0000","last_unstale":"2024-09-16T01:19:01.237758+0000","last_undegraded":"2024-09-16T01:19:01.237758+0000","last_fullsized":"2024-09-16T01:19:01.237758+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:33.197412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.173214+0000","last_change":"2024-09-16T01:18:58.931606+0000","last_active":"2024-09-16T01:19:01.173214+0000","last_peered":"2024-09-16T01:19:01.173214+0000","last_clean":"2024-09-16T01:19:01.173214+0000","last_became_active":"2024-09-16T01:18:58.931336+0000","last_became_peered":"2024-09-16T01:18:58.931336+0000","last_unstale":"2024-09-16T01:19:01.173214+0000","last_undegraded":"2024-09-16T01:19:01.173214+0000","last_fullsized":"2024-09-16T01:19:01.173214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:54.119282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237801+0000","last_change":"2024-09-16T01:18:59.934116+0000","last_active":"2024-09-16T01:19:01.237801+0000","last_peered":"2024-09-16T01:19:01.237801+0000","last_clean":"2024-09-16T01:19:01.237801+0000","last_became_active":"2024-09-16T01:18:59.933801+0000","last_became_peered":"2024-09-16T01:18:59.933801+0000","last_unstale":"2024-09-16T01:19:01.237801+0000","last_undegraded":"2024-09-16T01:19:01.237801+0000","last_fullsized":"2024-09-16T01:19:01.237801+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:28.210809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.173336+0000","last_change":"2024-09-16T01:18:58.933508+0000","last_active":"2024-09-16T01:19:01.173336+0000","last_peered":"2024-09-16T01:19:01.173336+0000","last_clean":"2024-09-16T01:19:01.173336+0000","last_became_active":"2024-09-16T01:18:58.933072+0000","last_became_peered":"2024-09-16T01:18:58.933072+0000","last_unstale":"2024-09-16T01:19:01.173336+0000","last_undegraded":"2024-09-16T01:19:01.173336+0000","last_fullsized":"2024-09-16T01:19:01.173336+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:05.885614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933353+0000","last_change":"2024-09-16T01:18:59.930893+0000","last_active":"2024-09-16T01:19:00.933353+0000","last_peered":"2024-09-16T01:19:00.933353+0000","last_clean":"2024-09-16T01:19:00.933353+0000","last_became_active":"2024-09-16T01:18:59.930616+0000","last_became_peered":"2024-09-16T01:18:59.930616+0000","last_unstale":"2024-09-16T01:19:00.933353+0000","last_undegraded":"2024-09-16T01:19:00.933353+0000","last_fullsized":"2024-09-16T01:19:00.933353+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:03.413796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238236+0000","last_change":"2024-09-16T01:18:58.933920+0000","last_active":"2024-09-16T01:19:01.238236+0000","last_peered":"2024-09-16T01:19:01.238236+0000","last_clean":"2024-09-16T01:19:01.238236+0000","last_became_active":"2024-09-16T01:18:58.933693+0000","last_became_peered":"2024-09-16T01:18:58.933693+0000","last_unstale":"2024-09-16T01:19:01.238236+0000","last_undegraded":"2024-09-16T01:19:01.238236+0000","last_fullsized":"2024-09-16T01:19:01.238236+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:26.264630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.934746+0000","last_change":"2024-09-16T01:18:59.930331+0000","last_active":"2024-09-16T01:19:00.934746+0000","last_peered":"2024-09-16T01:19:00.934746+0000","last_clean":"2024-09-16T01:19:00.934746+0000","last_became_active":"2024-09-16T01:18:59.930076+0000","last_became_peered":"2024-09-16T01:18:59.930076+0000","last_unstale":"2024-09-16T01:19:00.934746+0000","last_undegraded":"2024-09-16T01:19:00.934746+0000","last_fullsized":"2024-09-16T01:19:00.934746+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:41:44.251361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237927+0000","last_change":"2024-09-16T01:18:58.935362+0000","last_active":"2024-09-16T01:19:01.237927+0000","last_peered":"2024-09-16T01:19:01.237927+0000","last_clean":"2024-09-16T01:19:01.237927+0000","last_became_active":"2024-09-16T01:18:58.933462+0000","last_became_peered":"2024-09-16T01:18:58.933462+0000","last_unstale":"2024-09-16T01:19:01.237927+0000","last_undegraded":"2024-09-16T01:19:01.237927+0000","last_fullsized":"2024-09-16T01:19:01.237927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:48.149837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238400+0000","last_change":"2024-09-16T01:18:59.946768+0000","last_active":"2024-09-16T01:19:01.238400+0000","last_peered":"2024-09-16T01:19:01.238400+0000","last_clean":"2024-09-16T01:19:01.238400+0000","last_became_active":"2024-09-16T01:18:59.946467+0000","last_became_peered":"2024-09-16T01:18:59.946467+0000","last_unstale":"2024-09-16T01:19:01.238400+0000","last_undegraded":"2024-09-16T01:19:01.238400+0000","last_fullsized":"2024-09-16T01:19:01.238400+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:40:49.153996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933800+0000","last_change":"2024-09-16T01:18:58.934322+0000","last_active":"2024-09-16T01:19:00.933800+0000","last_peered":"2024-09-16T01:19:00.933800+0000","last_clean":"2024-09-16T01:19:00.933800+0000","last_became_active":"2024-09-16T01:18:58.934066+0000","last_became_peered":"2024-09-16T01:18:58.934066+0000","last_unstale":"2024-09-16T01:19:00.933800+0000","last_undegraded":"2024-09-16T01:19:00.933800+0000","last_fullsized":"2024-09-16T01:19:00.933800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:52.946764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237955+0000","last_change":"2024-09-16T01:18:59.932593+0000","last_active":"2024-09-16T01:19:01.237955+0000","last_peered":"2024-09-16T01:19:01.237955+0000","last_clean":"2024-09-16T01:19:01.237955+0000","last_became_active":"2024-09-16T01:18:59.932202+0000","last_became_peered":"2024-09-16T01:18:59.932202+0000","last_unstale":"2024-09-16T01:19:01.237955+0000","last_undegraded":"2024-09-16T01:19:01.237955+0000","last_fullsized":"2024-09-16T01:19:01.237955+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:53.950923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238093+0000","last_change":"2024-09-16T01:18:58.932035+0000","last_active":"2024-09-16T01:19:01.238093+0000","last_peered":"2024-09-16T01:19:01.238093+0000","last_clean":"2024-09-16T01:19:01.238093+0000","last_became_active":"2024-09-16T01:18:58.931687+0000","last_became_peered":"2024-09-16T01:18:58.931687+0000","last_unstale":"2024-09-16T01:19:01.238093+0000","last_undegraded":"2024-09-16T01:19:01.238093+0000","last_fullsized":"2024-09-16T01:19:01.238093+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:28.832567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.237899+0000","last_change":"2024-09-16T01:18:59.938736+0000","last_active":"2024-09-16T01:19:01.237899+0000","last_peered":"2024-09-16T01:19:01.237899+0000","last_clean":"2024-09-16T01:19:01.237899+0000","last_became_active":"2024-09-16T01:18:59.938466+0000","last_became_peered":"2024-09-16T01:18:59.938466+0000","last_unstale":"2024-09-16T01:19:01.237899+0000","last_undegraded":"2024-09-16T01:19:01.237899+0000","last_fullsized":"2024-09-16T01:19:01.237899+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:12.244393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.934097+0000","last_change":"2024-09-16T01:18:58.932788+0000","last_active":"2024-09-16T01:19:00.934097+0000","last_peered":"2024-09-16T01:19:00.934097+0000","last_clean":"2024-09-16T01:19:00.934097+0000","last_became_active":"2024-09-16T01:18:58.932522+0000","last_became_peered":"2024-09-16T01:18:58.932522+0000","last_unstale":"2024-09-16T01:19:00.934097+0000","last_undegraded":"2024-09-16T01:19:00.934097+0000","last_fullsized":"2024-09-16T01:19:00.934097+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:44:11.013897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.933580+0000","last_change":"2024-09-16T01:18:59.937996+0000","last_active":"2024-09-16T01:19:00.933580+0000","last_peered":"2024-09-16T01:19:00.933580+0000","last_clean":"2024-09-16T01:19:00.933580+0000","last_became_active":"2024-09-16T01:18:59.937698+0000","last_became_peered":"2024-09-16T01:18:59.937698+0000","last_unstale":"2024-09-16T01:19:00.933580+0000","last_undegraded":"2024-09-16T01:19:00.933580+0000","last_fullsized":"2024-09-16T01:19:00.933580+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:58.909218+0000","last_clean_scrub_stamp":"2024-09-16T01:18:58.909218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:54:52.071194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:01.238336+0000","last_change":"2024-09-16T01:18:58.936078+0000","last_active":"2024-09-16T01:19:01.238336+0000","last_peered":"2024-09-16T01:19:01.238336+0000","last_clean":"2024-09-16T01:19:01.238336+0000","last_became_active":"2024-09-16T01:18:58.935800+0000","last_became_peered":"2024-09-16T01:18:58.935800+0000","last_unstale":"2024-09-16T01:19:01.238336+0000","last_undegraded":"2024-09-16T01:19:01.238336+0000","last_fullsized":"2024-09-16T01:19:01.238336+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:18:57.905059+0000","last_clean_scrub_stamp":"2024-09-16T01:18:57.905059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:57.959851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":291,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-16T01:19:00.934163+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:19:00.934163+0000","last_peered":"2024-09-16T01:19:00.934163+0000","last_clean":"2024-09-16T01:19:00.934163+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:19:00.934163+0000","last_undegraded":"2024-09-16T01:19:00.934163+0000","last_fullsized":"2024-09-16T01:19:00.934163+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32824,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339016,"statfs":{"total":96636764160,"available":96603152384,"internally_reserved":0,"allocated":1675264,"data_stored":1079282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1093632,"data_stored":491074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1073152,"data_stored":488858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1081344,"data_stored":489018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1073152,"data_stored":488858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1073152,"data_stored":488858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1077248,"data_stored":488928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32844,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338996,"statfs":{"total":96636764160,"available":96603131904,"internally_reserved":0,"allocated":1691648,"data_stored":1081544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:19:04.198 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:19:04.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T01:19:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.338+0000 7f1fa0450640 1 Processor -- start 2024-09-16T01:19:04.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.338+0000 7f1fa0450640 1 -- start start 2024-09-16T01:19:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1fa0450640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f9815e7f0 0x7f1f980b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1fa0450640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f980af210 0x7f1f98070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1fa0450640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f9806cdc0 con 0x7f1f980b7250 2024-09-16T01:19:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1fa0450640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1f9806d0a0 con 0x7f1f9815e7f0 2024-09-16T01:19:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1fa0450640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1f9806d380 con 0x7f1f980af210 2024-09-16T01:19:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1f9e1ec640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f9815e7f0 0x7f1f980b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1f9e1ec640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f9815e7f0 0x7f1f980b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53916/0 (socket says 172.21.15.81:53916) 2024-09-16T01:19:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1f9e1ec640 1 -- 172.21.15.81:0/1939744990 learned_addr learned my addr 172.21.15.81:0/1939744990 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1f9d9eb640 1 --2- 172.21.15.81:0/1939744990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f980af210 0x7f1f98070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1f9e1ec640 1 -- 172.21.15.81:0/1939744990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f980af210 msgr2=0x7f1f98070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1f9e1ec640 1 --2- 172.21.15.81:0/1939744990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f980af210 0x7f1f98070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1f9e1ec640 1 -- 172.21.15.81:0/1939744990 >> v1:172.21.15.102:6789/0 conn(0x7f1f980b7250 legacy=0x7f1f9809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.339+0000 7f1f9e1ec640 1 -- 172.21.15.81:0/1939744990 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f9806d660 con 0x7f1f9815e7f0 2024-09-16T01:19:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.340+0000 7f1f9e1ec640 1 --2- 172.21.15.81:0/1939744990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f9815e7f0 0x7f1f980b6d10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009870 tx=0x7f1f9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165a951e507e0ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.340+0000 7f1f9d1ea640 1 -- 172.21.15.81:0/1939744990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94037070 con 0x7f1f9815e7f0 2024-09-16T01:19:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.340+0000 7f1f9d1ea640 1 -- 172.21.15.81:0/1939744990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f94032440 con 0x7f1f9815e7f0 2024-09-16T01:19:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.340+0000 7f1f9d1ea640 1 -- 172.21.15.81:0/1939744990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f94032810 con 0x7f1f9815e7f0 2024-09-16T01:19:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.341+0000 7f1fa0450640 1 -- 172.21.15.81:0/1939744990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f9815e7f0 msgr2=0x7f1f980b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.341+0000 7f1fa0450640 1 --2- 172.21.15.81:0/1939744990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f9815e7f0 0x7f1f980b6d10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009870 tx=0x7f1f9402a270 comp rx=0 tx=0).stop 2024-09-16T01:19:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.341+0000 7f1fa0450640 1 -- 172.21.15.81:0/1939744990 shutdown_connections 2024-09-16T01:19:04.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.341+0000 7f1fa0450640 1 --2- 172.21.15.81:0/1939744990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f980af210 0x7f1f98070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.341+0000 7f1fa0450640 1 --2- 172.21.15.81:0/1939744990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f9815e7f0 0x7f1f980b6d10 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.341+0000 7f1fa0450640 1 -- 172.21.15.81:0/1939744990 >> 172.21.15.81:0/1939744990 conn(0x7f1f980b3f30 msgr2=0x7f1f980b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.341+0000 7f1fa0450640 1 -- 172.21.15.81:0/1939744990 shutdown_connections 2024-09-16T01:19:04.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.341+0000 7f1fa0450640 1 -- 172.21.15.81:0/1939744990 wait complete. 2024-09-16T01:19:04.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.342+0000 7f1fa0450640 1 Processor -- start 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.342+0000 7f1fa0450640 1 -- start start 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1fa0450640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f980af210 0x7f1f98146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1fa0450640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f980b7250 0x7f1f98155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1fa0450640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f9815e7f0 0x7f1f98155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1fa0450640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f98070fb0 con 0x7f1f980b7250 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1fa0450640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f980b6150 con 0x7f1f9815e7f0 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1fa0450640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1f98071130 con 0x7f1f980af210 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f9d9eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f980b7250 0x7f1f98155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f9d9eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f980b7250 0x7f1f98155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53924/0 (socket says 172.21.15.81:53924) 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f9d9eb640 1 -- 172.21.15.81:0/3364413242 learned_addr learned my addr 172.21.15.81:0/3364413242 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f9e9ed640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f9815e7f0 0x7f1f98155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f9e1ec640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f980af210 0x7f1f98146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f9d9eb640 1 -- 172.21.15.81:0/3364413242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f980af210 msgr2=0x7f1f98146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f9d9eb640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f980af210 0x7f1f98146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f9d9eb640 1 -- 172.21.15.81:0/3364413242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f9815e7f0 msgr2=0x7f1f98155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f9d9eb640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f9815e7f0 0x7f1f98155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f9d9eb640 1 -- 172.21.15.81:0/3364413242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f98157030 con 0x7f1f980b7250 2024-09-16T01:19:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f9d9eb640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f980b7250 0x7f1f98155000 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800d600 tx=0x7f1f8800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f8effd640 1 -- 172.21.15.81:0/3364413242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88004240 con 0x7f1f980b7250 2024-09-16T01:19:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f8effd640 1 -- 172.21.15.81:0/3364413242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f880043e0 con 0x7f1f980b7250 2024-09-16T01:19:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1fa0450640 1 -- 172.21.15.81:0/3364413242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f98157310 con 0x7f1f980b7250 2024-09-16T01:19:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1f8effd640 1 -- 172.21.15.81:0/3364413242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88003830 con 0x7f1f980b7250 2024-09-16T01:19:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.343+0000 7f1fa0450640 1 -- 172.21.15.81:0/3364413242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f981578d0 con 0x7f1f980b7250 2024-09-16T01:19:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.344+0000 7f1fa0450640 1 -- 172.21.15.81:0/3364413242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f98070a70 con 0x7f1f980b7250 2024-09-16T01:19:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.345+0000 7f1f8effd640 1 -- 172.21.15.81:0/3364413242 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1f880039d0 con 0x7f1f980b7250 2024-09-16T01:19:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.345+0000 7f1f8effd640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f7c06c2b0 0x7f1f7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.346+0000 7f1f9e1ec640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f7c06c2b0 0x7f1f7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.346+0000 7f1f8effd640 1 -- 172.21.15.81:0/3364413242 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f1f8808b6e0 con 0x7f1f980b7250 2024-09-16T01:19:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.346+0000 7f1f9e1ec640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f7c06c2b0 0x7f1f7c06e770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1f94034000 tx=0x7f1f9402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:04.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.350+0000 7f1f8effd640 1 -- 172.21.15.81:0/3364413242 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f88059680 con 0x7f1f980b7250 2024-09-16T01:19:04.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.581+0000 7f1fa0450640 1 -- 172.21.15.81:0/3364413242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1f980b32b0 con 0x7f1f980b7250 2024-09-16T01:19:04.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.583+0000 7f1f8effd640 1 -- 172.21.15.81:0/3364413242 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f1f8805d980 con 0x7f1f980b7250 2024-09-16T01:19:04.585 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-16T01:19:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg== 2024-09-16T01:19:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-16T01:19:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-16T01:19:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T01:19:04.585 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-16T01:19:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.585+0000 7f1fa0450640 1 -- 172.21.15.81:0/3364413242 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f7c06c2b0 msgr2=0x7f1f7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.585+0000 7f1fa0450640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f7c06c2b0 0x7f1f7c06e770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1f94034000 tx=0x7f1f9402e000 comp rx=0 tx=0).stop 2024-09-16T01:19:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.585+0000 7f1fa0450640 1 -- 172.21.15.81:0/3364413242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f980b7250 msgr2=0x7f1f98155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.585+0000 7f1fa0450640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f980b7250 0x7f1f98155000 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800d600 tx=0x7f1f8800dac0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.585+0000 7f1fa0450640 1 -- 172.21.15.81:0/3364413242 shutdown_connections 2024-09-16T01:19:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.586+0000 7f1fa0450640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1f7c06c2b0 0x7f1f7c06e770 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.586+0000 7f1fa0450640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f9815e7f0 0x7f1f98155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.586+0000 7f1fa0450640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f980b7250 0x7f1f98155000 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.586+0000 7f1fa0450640 1 --2- 172.21.15.81:0/3364413242 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f980af210 0x7f1f98146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.586+0000 7f1fa0450640 1 -- 172.21.15.81:0/3364413242 >> 172.21.15.81:0/3364413242 conn(0x7f1f980b3f30 msgr2=0x7f1f980b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.586+0000 7f1fa0450640 1 -- 172.21.15.81:0/3364413242 shutdown_connections 2024-09-16T01:19:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.586+0000 7f1fa0450640 1 -- 172.21.15.81:0/3364413242 wait complete. 2024-09-16T01:19:04.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:19:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.694+0000 7f4137a50640 1 Processor -- start 2024-09-16T01:19:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.694+0000 7f4137a50640 1 -- start start 2024-09-16T01:19:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4137a50640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f413006df60 0x7f413009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4137a50640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f413009af70 0x7f4130168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4137a50640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413006cec0 con 0x7f413015e5d0 2024-09-16T01:19:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4137a50640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f413006dad0 con 0x7f413009af70 2024-09-16T01:19:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4137a50640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f413006d1a0 con 0x7f413006df60 2024-09-16T01:19:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4135fed640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f413009af70 0x7f4130168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4135fed640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f413009af70 0x7f4130168560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53932/0 (socket says 172.21.15.81:53932) 2024-09-16T01:19:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4135fed640 1 -- 172.21.15.81:0/1558107578 learned_addr learned my addr 172.21.15.81:0/1558107578 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f41357ec640 1 --1- 172.21.15.81:0/1558107578 >> v1:172.21.15.81:6789/0 conn(0x7f413015e5d0 0x7f41300d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49558/0 (socket says 172.21.15.81:49558) 2024-09-16T01:19:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4134feb640 1 --2- 172.21.15.81:0/1558107578 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f413006df60 0x7f413009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4135fed640 1 -- 172.21.15.81:0/1558107578 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f413006df60 msgr2=0x7f413009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4135fed640 1 --2- 172.21.15.81:0/1558107578 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f413006df60 0x7f413009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4135fed640 1 -- 172.21.15.81:0/1558107578 >> v1:172.21.15.81:6789/0 conn(0x7f413015e5d0 legacy=0x7f41300d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4127fff640 1 -- 172.21.15.81:0/1558107578 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547397729 0 0) 0x7f413006cec0 con 0x7f413015e5d0 2024-09-16T01:19:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.695+0000 7f4135fed640 1 -- 172.21.15.81:0/1558107578 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413006d480 con 0x7f413009af70 2024-09-16T01:19:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.696+0000 7f4135fed640 1 --2- 172.21.15.81:0/1558107578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f413009af70 0x7f4130168560 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4128009e50 tx=0x7f412802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1152089ffc20b1ab server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.696+0000 7f4127fff640 1 -- 172.21.15.81:0/1558107578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128036070 con 0x7f413009af70 2024-09-16T01:19:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.696+0000 7f4127fff640 1 -- 172.21.15.81:0/1558107578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4128031600 con 0x7f413009af70 2024-09-16T01:19:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.696+0000 7f4127fff640 1 -- 172.21.15.81:0/1558107578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41280319d0 con 0x7f413009af70 2024-09-16T01:19:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.696+0000 7f4137a50640 1 -- 172.21.15.81:0/1558107578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f413009af70 msgr2=0x7f4130168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.696+0000 7f4137a50640 1 --2- 172.21.15.81:0/1558107578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f413009af70 0x7f4130168560 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4128009e50 tx=0x7f412802a7a0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.697+0000 7f4137a50640 1 -- 172.21.15.81:0/1558107578 shutdown_connections 2024-09-16T01:19:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.697+0000 7f4137a50640 1 --2- 172.21.15.81:0/1558107578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f413009af70 0x7f4130168560 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.697+0000 7f4137a50640 1 --2- 172.21.15.81:0/1558107578 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f413006df60 0x7f413009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.697+0000 7f4137a50640 1 -- 172.21.15.81:0/1558107578 >> 172.21.15.81:0/1558107578 conn(0x7f41300d23a0 msgr2=0x7f41300d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.697+0000 7f4137a50640 1 -- 172.21.15.81:0/1558107578 shutdown_connections 2024-09-16T01:19:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.697+0000 7f4137a50640 1 -- 172.21.15.81:0/1558107578 wait complete. 2024-09-16T01:19:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.698+0000 7f4137a50640 1 Processor -- start 2024-09-16T01:19:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.698+0000 7f4137a50640 1 -- start start 2024-09-16T01:19:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4137a50640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f413006df60 0x7f41300c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4137a50640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f413009af70 0x7f41301f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4137a50640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f413015e5d0 0x7f41300af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4137a50640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f41300d1980 con 0x7f413009af70 2024-09-16T01:19:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4137a50640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f41300d1800 con 0x7f413006df60 2024-09-16T01:19:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4137a50640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f413015e9b0 con 0x7f413015e5d0 2024-09-16T01:19:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4134feb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f413009af70 0x7f41301f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4134feb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f413009af70 0x7f41301f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53942/0 (socket says 172.21.15.81:53942) 2024-09-16T01:19:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4134feb640 1 -- 172.21.15.81:0/4199578084 learned_addr learned my addr 172.21.15.81:0/4199578084 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f41357ec640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f413006df60 0x7f41300c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4135fed640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f413015e5d0 0x7f41300af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4134feb640 1 -- 172.21.15.81:0/4199578084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f413015e5d0 msgr2=0x7f41300af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4134feb640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f413015e5d0 0x7f41300af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4134feb640 1 -- 172.21.15.81:0/4199578084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f413006df60 msgr2=0x7f41300c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4134feb640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f413006df60 0x7f41300c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4134feb640 1 -- 172.21.15.81:0/4199578084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41300b72b0 con 0x7f413009af70 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4134feb640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f413009af70 0x7f41301f3b00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f412000d600 tx=0x7f412000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4125ffb640 1 -- 172.21.15.81:0/4199578084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120004240 con 0x7f413009af70 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4125ffb640 1 -- 172.21.15.81:0/4199578084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41200043e0 con 0x7f413009af70 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4137a50640 1 -- 172.21.15.81:0/4199578084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41301f7ad0 con 0x7f413009af70 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.699+0000 7f4125ffb640 1 -- 172.21.15.81:0/4199578084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120003830 con 0x7f413009af70 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.700+0000 7f4137a50640 1 -- 172.21.15.81:0/4199578084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41301f8090 con 0x7f413009af70 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.701+0000 7f4137a50640 1 -- 172.21.15.81:0/4199578084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413009aa30 con 0x7f413009af70 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.701+0000 7f4125ffb640 1 -- 172.21.15.81:0/4199578084 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f41200039d0 con 0x7f413009af70 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.701+0000 7f4125ffb640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f411406c2b0 0x7f411406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.701+0000 7f41357ec640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f411406c2b0 0x7f411406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.701+0000 7f4125ffb640 1 -- 172.21.15.81:0/4199578084 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f412008b6f0 con 0x7f413009af70 2024-09-16T01:19:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.702+0000 7f41357ec640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f411406c2b0 0x7f411406e770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f412c000f60 tx=0x7f412c007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:04.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.706+0000 7f4125ffb640 1 -- 172.21.15.81:0/4199578084 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4120059680 con 0x7f413009af70 2024-09-16T01:19:04.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.905+0000 7f4137a50640 1 -- 172.21.15.81:0/4199578084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41300b8320 con 0x7f413009af70 2024-09-16T01:19:04.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.906+0000 7f4125ffb640 1 -- 172.21.15.81:0/4199578084 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5228 (secure 0 0 0) 0x7f412005d980 con 0x7f413009af70 2024-09-16T01:19:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:04.908 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":43,"btime":"2024-09-16T01:19:02:921518+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3998032766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3998032766},{"type":"v1","addr":"172.21.15.102:6835","nonce":3998032766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5794,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/978156526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":978156526},{"type":"v1","addr":"172.21.15.102:6834","nonce":978156526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6384,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1184176189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1184176189},{"type":"v1","addr":"172.21.15.81:6836","nonce":1184176189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:59.261790+0000","modified":"2024-09-16T01:19:02.182262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2778062051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2778062051},{"type":"v1","addr":"172.21.15.81:6837","nonce":2778062051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-16T01:19:04.908 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 43 2024-09-16T01:19:04.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.908+0000 7f4137a50640 1 -- 172.21.15.81:0/4199578084 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f411406c2b0 msgr2=0x7f411406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.908+0000 7f4137a50640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f411406c2b0 0x7f411406e770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f412c000f60 tx=0x7f412c007d50 comp rx=0 tx=0).stop 2024-09-16T01:19:04.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.908+0000 7f4137a50640 1 -- 172.21.15.81:0/4199578084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f413009af70 msgr2=0x7f41301f3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:04.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.908+0000 7f4137a50640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f413009af70 0x7f41301f3b00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f412000d600 tx=0x7f412000dac0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.908+0000 7f4137a50640 1 -- 172.21.15.81:0/4199578084 shutdown_connections 2024-09-16T01:19:04.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.908+0000 7f4137a50640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f411406c2b0 0x7f411406e770 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.908+0000 7f4137a50640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f413015e5d0 0x7f41300af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.908+0000 7f4137a50640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f413009af70 0x7f41301f3b00 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.908+0000 7f4137a50640 1 --2- 172.21.15.81:0/4199578084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f413006df60 0x7f41300c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.908+0000 7f4137a50640 1 -- 172.21.15.81:0/4199578084 >> 172.21.15.81:0/4199578084 conn(0x7f41300d23a0 msgr2=0x7f41301499f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.908+0000 7f4137a50640 1 -- 172.21.15.81:0/4199578084 shutdown_connections 2024-09-16T01:19:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:04.908+0000 7f4137a50640 1 -- 172.21.15.81:0/4199578084 wait complete. 2024-09-16T01:19:05.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:18:59.261790+0000', 'modified': '2024-09-16T01:19:02.182262+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6387}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6387': {'gid': 6387, 'name': 'c', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2778062051', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 2778062051}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2778062051}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6387, 'qdb_cluster': [6387]} 2024-09-16T01:19:05.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:19:05.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-16T01:19:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.423+0000 7f498486e640 1 Processor -- start 2024-09-16T01:19:05.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.423+0000 7f498486e640 1 -- start start 2024-09-16T01:19:05.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f498486e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f498006f870 0x7f4980162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f498486e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f498015eb60 con 0x7f49800b69d0 2024-09-16T01:19:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f498486e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f498015ee40 con 0x7f49800b0180 2024-09-16T01:19:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f498486e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f49800b6db0 con 0x7f498006f870 2024-09-16T01:19:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f497e59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f49800b69d0 0x7f49800afa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49560/0 (socket says 172.21.15.81:49560) 2024-09-16T01:19:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f497e59c640 1 -- 172.21.15.81:0/1471679840 learned_addr learned my addr 172.21.15.81:0/1471679840 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f497ed9d640 1 --2- 172.21.15.81:0/1471679840 >> v2:172.21.15.102:3300/0 conn(0x7f498006f870 0x7f4980162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561153885 0 0) 0x7f498015eb60 con 0x7f49800b69d0 2024-09-16T01:19:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4968003520 con 0x7f49800b69d0 2024-09-16T01:19:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4254079104 0 0) 0x7f4968003520 con 0x7f49800b69d0 2024-09-16T01:19:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 >> v2:172.21.15.102:3300/0 conn(0x7f498006f870 msgr2=0x7f4980162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f497d59a640 1 --2- 172.21.15.81:0/1471679840 >> v2:172.21.15.102:3300/0 conn(0x7f498006f870 0x7f4980162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 >> v1:172.21.15.102:6789/0 conn(0x7f49800b0180 legacy=0x7f4980154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498015f120 con 0x7f49800b69d0 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f4970001670 con 0x7f49800b69d0 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.424+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 >> v1:172.21.15.81:6789/0 conn(0x7f49800b69d0 legacy=0x7f49800afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497d59a640 1 --2- 172.21.15.81:0/1471679840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49680039e0 0x7f4968003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497d59a640 1 --2- 172.21.15.81:0/1471679840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4968004800 0x7f4968004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497d59a640 1 --2- 172.21.15.81:0/1471679840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49680052e0 0x7f496800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f49800b6db0 con 0x7f49680052e0 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f496800c1e0 con 0x7f4968004800 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f496800c3e0 con 0x7f49680039e0 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497ed9d640 1 --2- 172.21.15.81:0/1471679840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49680052e0 0x7f496800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497dd9b640 1 --2- 172.21.15.81:0/1471679840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4968004800 0x7f4968004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497e59c640 1 --2- 172.21.15.81:0/1471679840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49680039e0 0x7f4968003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497ed9d640 1 -- 172.21.15.81:0/1471679840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49680039e0 msgr2=0x7f4968003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497ed9d640 1 --2- 172.21.15.81:0/1471679840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49680039e0 0x7f4968003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497ed9d640 1 -- 172.21.15.81:0/1471679840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4968004800 msgr2=0x7f4968004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497ed9d640 1 --2- 172.21.15.81:0/1471679840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4968004800 0x7f4968004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497ed9d640 1 -- 172.21.15.81:0/1471679840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4968003520 con 0x7f49680052e0 2024-09-16T01:19:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.425+0000 7f497e59c640 1 --2- 172.21.15.81:0/1471679840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49680039e0 0x7f4968003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.426+0000 7f497ed9d640 1 -- 172.21.15.81:0/1471679840 reap_dead start 2024-09-16T01:19:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.426+0000 7f497ed9d640 1 --2- 172.21.15.81:0/1471679840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49680052e0 0x7f496800b9c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4978009f90 tx=0x7f4968005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313325f06533bec9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.426+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978035020 con 0x7f49680052e0 2024-09-16T01:19:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.426+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4978003b90 con 0x7f49680052e0 2024-09-16T01:19:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.426+0000 7f497d59a640 1 -- 172.21.15.81:0/1471679840 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978009c10 con 0x7f49680052e0 2024-09-16T01:19:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.426+0000 7f498486e640 1 -- 172.21.15.81:0/1471679840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49680052e0 msgr2=0x7f496800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.426+0000 7f498486e640 1 --2- 172.21.15.81:0/1471679840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49680052e0 0x7f496800b9c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f4978009f90 tx=0x7f4968005830 comp rx=0 tx=0).stop 2024-09-16T01:19:05.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.426+0000 7f498486e640 1 -- 172.21.15.81:0/1471679840 shutdown_connections 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.426+0000 7f498486e640 1 --2- 172.21.15.81:0/1471679840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49680052e0 0x7f496800b9c0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.426+0000 7f498486e640 1 -- 172.21.15.81:0/1471679840 >> 172.21.15.81:0/1471679840 conn(0x7f498006bc10 msgr2=0x7f498006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.426+0000 7f498486e640 1 -- 172.21.15.81:0/1471679840 shutdown_connections 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.426+0000 7f498486e640 1 -- 172.21.15.81:0/1471679840 wait complete. 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.428+0000 7f498486e640 1 Processor -- start 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.428+0000 7f498486e640 1 -- start start 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.428+0000 7f498486e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49680052e0 0x7f49800cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.428+0000 7f498486e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4980154b60 0x7f49801580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f498486e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f498015b320 0x7f498015b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f498486e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4980162bd0 con 0x7f498015b320 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f498486e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4980162a50 con 0x7f4980154b60 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f498486e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4980162d50 con 0x7f49680052e0 2024-09-16T01:19:05.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f498015b320 0x7f498015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f498015b320 0x7f498015b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53962/0 (socket says 172.21.15.81:53962) 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497ed9d640 1 -- 172.21.15.81:0/3254253316 learned_addr learned my addr 172.21.15.81:0/3254253316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497e59c640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49680052e0 0x7f49800cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497dd9b640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4980154b60 0x7f49801580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497ed9d640 1 -- 172.21.15.81:0/3254253316 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49680052e0 msgr2=0x7f49800cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497ed9d640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49680052e0 0x7f49800cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497ed9d640 1 -- 172.21.15.81:0/3254253316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4980154b60 msgr2=0x7f49801580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497ed9d640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4980154b60 0x7f49801580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497ed9d640 1 -- 172.21.15.81:0/3254253316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49800cff00 con 0x7f498015b320 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497dd9b640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4980154b60 0x7f49801580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497e59c640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49680052e0 0x7f49800cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f497ed9d640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f498015b320 0x7f498015b7d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f497800e230 tx=0x7f4978009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f496effd640 1 -- 172.21.15.81:0/3254253316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978035070 con 0x7f498015b320 2024-09-16T01:19:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f496effd640 1 -- 172.21.15.81:0/3254253316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4978041070 con 0x7f498015b320 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f498486e640 1 -- 172.21.15.81:0/3254253316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49800d01e0 con 0x7f498015b320 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f496effd640 1 -- 172.21.15.81:0/3254253316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978009c10 con 0x7f498015b320 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.429+0000 7f498486e640 1 -- 172.21.15.81:0/3254253316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4980155a10 con 0x7f498015b320 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.431+0000 7f496effd640 1 -- 172.21.15.81:0/3254253316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4978005d10 con 0x7f498015b320 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.431+0000 7f496effd640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f496006c2b0 0x7f496006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.431+0000 7f496effd640 1 -- 172.21.15.81:0/3254253316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f49780ac200 con 0x7f498015b320 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.431+0000 7f497e59c640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f496006c2b0 0x7f496006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.432+0000 7f497e59c640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f496006c2b0 0x7f496006e770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4970001eb0 tx=0x7f4970009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.432+0000 7f4987608740 1 Processor -- start 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.432+0000 7f4987608740 1 -- start start 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f4987608740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4d2c0 0x563e11b92a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f4987608740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4aa80 0x563e11b4d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f4987608740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b478b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f4987608740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563e11aaf520 con 0x563e11b4d2c0 2024-09-16T01:19:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f4987608740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563e11a573e0 con 0x563e11b4aa80 2024-09-16T01:19:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f4987608740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x563e11aab4e0 con 0x563e11b4ea50 2024-09-16T01:19:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f497e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4d2c0 0x563e11b92a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f497e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4d2c0 0x563e11b92a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53978/0 (socket says 172.21.15.81:53978) 2024-09-16T01:19:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f497e59c640 1 -- 172.21.15.81:0/430329833 learned_addr learned my addr 172.21.15.81:0/430329833 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f497dd9b640 1 --2- 172.21.15.81:0/430329833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4aa80 0x563e11b4d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f497ed9d640 1 --2- 172.21.15.81:0/430329833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f497e59c640 1 -- 172.21.15.81:0/430329833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 msgr2=0x563e11b478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f497e59c640 1 --2- 172.21.15.81:0/430329833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f497e59c640 1 -- 172.21.15.81:0/430329833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4aa80 msgr2=0x563e11b4d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f497e59c640 1 --2- 172.21.15.81:0/430329833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4aa80 0x563e11b4d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f497e59c640 1 -- 172.21.15.81:0/430329833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e11a722f0 con 0x563e11b4d2c0 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f497dd9b640 1 --2- 172.21.15.81:0/430329833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4aa80 0x563e11b4d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.433+0000 7f497ed9d640 1 --2- 172.21.15.81:0/430329833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.434+0000 7f497e59c640 1 --2- 172.21.15.81:0/430329833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4d2c0 0x563e11b92a60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4970010a90 tx=0x7f497000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5050a73b7ce522ae server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.434+0000 7f495ffff640 1 -- 172.21.15.81:0/430329833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970027070 con 0x563e11b4d2c0 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.434+0000 7f495ffff640 1 -- 172.21.15.81:0/430329833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4970014b80 con 0x563e11b4d2c0 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.434+0000 7f495ffff640 1 -- 172.21.15.81:0/430329833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970013360 con 0x563e11b4d2c0 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.434+0000 7f4987608740 1 -- 172.21.15.81:0/430329833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4d2c0 msgr2=0x563e11b92a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.434+0000 7f4987608740 1 --2- 172.21.15.81:0/430329833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4d2c0 0x563e11b92a60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4970010a90 tx=0x7f497000c000 comp rx=0 tx=0).stop 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.434+0000 7f4987608740 1 -- 172.21.15.81:0/430329833 shutdown_connections 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.434+0000 7f4987608740 1 --2- 172.21.15.81:0/430329833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.434+0000 7f4987608740 1 --2- 172.21.15.81:0/430329833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4aa80 0x563e11b4d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.434+0000 7f4987608740 1 --2- 172.21.15.81:0/430329833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4d2c0 0x563e11b92a60 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.434+0000 7f4987608740 1 -- 172.21.15.81:0/430329833 >> 172.21.15.81:0/430329833 conn(0x563e11b49a80 msgr2=0x563e11b91f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:05.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.435+0000 7f4987608740 1 -- 172.21.15.81:0/430329833 shutdown_connections 2024-09-16T01:19:05.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.435+0000 7f4987608740 1 -- 172.21.15.81:0/430329833 wait complete. 2024-09-16T01:19:05.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.435+0000 7f4987608740 1 -- start start 2024-09-16T01:19:05.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.435+0000 7f4987608740 1 Processor -- start 2024-09-16T01:19:05.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f4987608740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4d2c0 0x563e11b6dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f4987608740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4ea50 0x563e11b6d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f4987608740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b6c030 0x563e11b6b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f4987608740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563e11b48f20 con 0x563e11b4ea50 2024-09-16T01:19:05.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f4987608740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563e11a38450 con 0x563e11b6c030 2024-09-16T01:19:05.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f4987608740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x563e11b93290 con 0x563e11b4d2c0 2024-09-16T01:19:05.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f4987608740 10 client.0 _ll_register_callbacks cb 0x563e117c1ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f497dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4ea50 0x563e11b6d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f497dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4ea50 0x563e11b6d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53990/0 (socket says 172.21.15.81:53990) 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f497dd9b640 1 -- 172.21.15.81:0/1373560491 learned_addr learned my addr 172.21.15.81:0/1373560491 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f497ed9d640 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b6c030 0x563e11b6b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f497e59c640 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4d2c0 0x563e11b6dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f497dd9b640 1 -- 172.21.15.81:0/1373560491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4d2c0 msgr2=0x563e11b6dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f497dd9b640 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4d2c0 0x563e11b6dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f497dd9b640 1 -- 172.21.15.81:0/1373560491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b6c030 msgr2=0x563e11b6b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f497dd9b640 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b6c030 0x563e11b6b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f497dd9b640 1 -- 172.21.15.81:0/1373560491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e117c22d0 con 0x563e11b4ea50 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.436+0000 7f497ed9d640 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b6c030 0x563e11b6b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f497dd9b640 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4ea50 0x563e11b6d270 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4974003ae0 tx=0x7f4974001290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4923adae69cecc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:05.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f495d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f495d7fa640 1 -- 172.21.15.81:0/1373560491 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974016480 con 0x563e11b4ea50 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f495d7fa640 1 -- 172.21.15.81:0/1373560491 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f4974016620 con 0x563e11b4ea50 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f4987608740 1 -- 172.21.15.81:0/1373560491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4970014b80 con 0x563e11b4ea50 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f495d7fa640 1 -- 172.21.15.81:0/1373560491 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f4974022050 con 0x563e11b4ea50 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f4987608740 10 client.6519 fetch_fsmap learned FSMap version 43 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f4987608740 1 -- 172.21.15.81:0/1373560491 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x563e1188c6b0 con 0x563e11b4ea50 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f495d7fa640 1 -- 172.21.15.81:0/1373560491 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4970014b80 con 0x563e11b4ea50 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f495d7fa640 1 -- 172.21.15.81:0/1373560491 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 43) ==== 3502+0+0 (secure 0 0 0) 0x7f4974025020 con 0x563e11b4ea50 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f4987608740 10 client.6519 fetch_fsmap finished waiting for FSMap version 43 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f4987608740 10 client.6519 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f4987608740 20 client.6519 populate_metadata read hostname 'smithi081' 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f4987608740 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.81:6835/2778062051,v1:172.21.15.81:6837/2778062051] conn(0x563e11b467d0 0x563e11b46bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f4987608740 4 client.6519 mds_command: new command op to 6387 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f4987608740 1 -- 172.21.15.81:0/1373560491 --> [v2:172.21.15.81:6835/2778062051,v1:172.21.15.81:6837/2778062051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e11abcc50 con 0x563e11b467d0 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.437+0000 7f497e59c640 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.81:6835/2778062051,v1:172.21.15.81:6837/2778062051] conn(0x563e11b467d0 0x563e11b46bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f495d7fa640 10 client.6519 ms_handle_connect on v2:172.21.15.81:6835/2778062051 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f497e59c640 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.81:6835/2778062051,v1:172.21.15.81:6837/2778062051] conn(0x563e11b467d0 0x563e11b46bb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e6152509542a5d3 server_cookie=7721683888015cd in_seq=0 out_seq=0 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f495d7fa640 1 -- 172.21.15.81:0/1373560491 <== mds.0 v2:172.21.15.81:6835/2778062051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e11abcc50 con 0x563e11b467d0 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f495d7fa640 10 client.6519 handle_command_reply: tid=0 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f4987608740 1 client.6519 shutdown 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f4987608740 1 -- 172.21.15.81:0/1373560491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4ea50 msgr2=0x563e11b6d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f4987608740 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4ea50 0x563e11b6d270 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4974003ae0 tx=0x7f4974001290 comp rx=0 tx=0).stop 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f4987608740 1 -- 172.21.15.81:0/1373560491 shutdown_connections 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f4987608740 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.81:6835/2778062051,v1:172.21.15.81:6837/2778062051] conn(0x563e11b467d0 0x563e11b46bb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f4987608740 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b6c030 0x563e11b6b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f4987608740 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b4ea50 0x563e11b6d270 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f4987608740 1 --2- 172.21.15.81:0/1373560491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4d2c0 0x563e11b6dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f495d7fa640 0 client.6519 ms_handle_reset on v2:172.21.15.81:6835/2778062051 2024-09-16T01:19:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f4987608740 1 -- 172.21.15.81:0/1373560491 >> 172.21.15.81:0/1373560491 conn(0x563e11b4aa80 msgr2=0x563e11b91700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.438+0000 7f4987608740 1 -- 172.21.15.81:0/1373560491 shutdown_connections 2024-09-16T01:19:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.439+0000 7f4987608740 1 -- 172.21.15.81:0/1373560491 wait complete. 2024-09-16T01:19:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.439+0000 7f4987608740 20 client.6519 trim_cache size 0 max 16384 2024-09-16T01:19:05.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.456+0000 7f4987608740 1 Processor -- start 2024-09-16T01:19:05.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.456+0000 7f4987608740 1 -- start start 2024-09-16T01:19:05.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f4987608740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4d2c0 0x563e11b484c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f4987608740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b72330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f4987608740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 0x563e11b8b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f4987608740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f49802017f0 con 0x563e11b6c030 2024-09-16T01:19:05.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f4987608740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4980200870 con 0x563e11b4d2c0 2024-09-16T01:19:05.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f4987608740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f49801ffbd0 con 0x563e11b4ea50 2024-09-16T01:19:05.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 0x563e11b8b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 0x563e11b8b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54002/0 (socket says 172.21.15.81:54002) 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497ed9d640 1 -- 172.21.15.81:0/1815079798 learned_addr learned my addr 172.21.15.81:0/1815079798 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497e59c640 1 --2- 172.21.15.81:0/1815079798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4d2c0 0x563e11b484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497dd9b640 1 --2- 172.21.15.81:0/1815079798 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b72330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497ed9d640 1 -- 172.21.15.81:0/1815079798 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 msgr2=0x563e11b72330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497ed9d640 1 --2- 172.21.15.81:0/1815079798 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b72330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497ed9d640 1 -- 172.21.15.81:0/1815079798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4d2c0 msgr2=0x563e11b484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497ed9d640 1 --2- 172.21.15.81:0/1815079798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4d2c0 0x563e11b484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497ed9d640 1 -- 172.21.15.81:0/1815079798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e11b436c0 con 0x563e11b6c030 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497e59c640 1 --2- 172.21.15.81:0/1815079798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4d2c0 0x563e11b484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497dd9b640 1 --2- 172.21.15.81:0/1815079798 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b72330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f497ed9d640 1 --2- 172.21.15.81:0/1815079798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 0x563e11b8b900 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4978003ff0 tx=0x7f4978039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64052f5910bbe991 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f495f7fe640 1 -- 172.21.15.81:0/1815079798 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497807a170 con 0x563e11b6c030 2024-09-16T01:19:05.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f495f7fe640 1 -- 172.21.15.81:0/1815079798 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f497807e520 con 0x563e11b6c030 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.457+0000 7f495f7fe640 1 -- 172.21.15.81:0/1815079798 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978082d50 con 0x563e11b6c030 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.458+0000 7f4987608740 1 -- 172.21.15.81:0/1815079798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 msgr2=0x563e11b8b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.458+0000 7f4987608740 1 --2- 172.21.15.81:0/1815079798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 0x563e11b8b900 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f4978003ff0 tx=0x7f4978039000 comp rx=0 tx=0).stop 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.458+0000 7f4987608740 1 -- 172.21.15.81:0/1815079798 shutdown_connections 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.458+0000 7f4987608740 1 --2- 172.21.15.81:0/1815079798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 0x563e11b8b900 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.458+0000 7f4987608740 1 --2- 172.21.15.81:0/1815079798 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b72330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.458+0000 7f4987608740 1 --2- 172.21.15.81:0/1815079798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4d2c0 0x563e11b484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.458+0000 7f4987608740 1 -- 172.21.15.81:0/1815079798 >> 172.21.15.81:0/1815079798 conn(0x563e11b4aa80 msgr2=0x563e11ba19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.458+0000 7f4987608740 1 -- 172.21.15.81:0/1815079798 shutdown_connections 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.458+0000 7f4987608740 1 -- 172.21.15.81:0/1815079798 wait complete. 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.458+0000 7f4987608740 1 -- start start 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.459+0000 7f4987608740 1 Processor -- start 2024-09-16T01:19:05.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.459+0000 7f4987608740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4d2c0 0x563e11b71120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.459+0000 7f4987608740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b8baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.459+0000 7f4987608740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 0x563e11c0d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.459+0000 7f4987608740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563e11b6bd90 con 0x563e11b6c030 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.459+0000 7f4987608740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4980200220 con 0x563e11b4d2c0 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.459+0000 7f4987608740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x563e11b76e70 con 0x563e11b4ea50 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.459+0000 7f4987608740 10 client.0 _ll_register_callbacks cb 0x7f49740036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f497ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 0x563e11c0d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f497ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 0x563e11c0d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54010/0 (socket says 172.21.15.81:54010) 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f497ed9d640 1 -- 172.21.15.81:0/2241659173 learned_addr learned my addr 172.21.15.81:0/2241659173 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f497e59c640 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4d2c0 0x563e11b71120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f497dd9b640 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b8baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f497ed9d640 1 -- 172.21.15.81:0/2241659173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 msgr2=0x563e11b8baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f497ed9d640 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b8baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f497ed9d640 1 -- 172.21.15.81:0/2241659173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4d2c0 msgr2=0x563e11b71120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f497ed9d640 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4d2c0 0x563e11b71120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f497ed9d640 1 -- 172.21.15.81:0/2241659173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e11c10370 con 0x563e11b6c030 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f497dd9b640 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b8baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f497ed9d640 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 0x563e11c0d370 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f497800e200 tx=0x7f497800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426c68092c93f855 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f495d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f495d7fa640 1 -- 172.21.15.81:0/2241659173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978078470 con 0x563e11b6c030 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f495d7fa640 1 -- 172.21.15.81:0/2241659173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f49780767e0 con 0x563e11b6c030 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f4987608740 1 -- 172.21.15.81:0/2241659173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f497807e520 con 0x563e11b6c030 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f495d7fa640 1 -- 172.21.15.81:0/2241659173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f49780aa350 con 0x563e11b6c030 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f4987608740 10 client.6525 fetch_fsmap learned FSMap version 43 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f4987608740 1 -- 172.21.15.81:0/2241659173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) -- 0x563e11b6e4d0 con 0x563e11b6c030 2024-09-16T01:19:05.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f495d7fa640 1 -- 172.21.15.81:0/2241659173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f497807e520 con 0x563e11b6c030 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f495d7fa640 1 -- 172.21.15.81:0/2241659173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 43) ==== 3502+0+0 (secure 0 0 0) 0x7f497803a040 con 0x563e11b6c030 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f4987608740 10 client.6525 fetch_fsmap finished waiting for FSMap version 43 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f4987608740 10 client.6525 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.460+0000 7f4987608740 20 client.6525 populate_metadata read hostname 'smithi081' 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.81:6835/2778062051,v1:172.21.15.81:6837/2778062051] conn(0x563e11b905e0 0x563e11b909c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 4 client.6525 mds_command: new command op to 6387 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 -- 172.21.15.81:0/2241659173 --> [v2:172.21.15.81:6835/2778062051,v1:172.21.15.81:6837/2778062051] -- command(tid 0: {"prefix": "status"}) -- 0x563e11ab6fa0 con 0x563e11b905e0 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f497e59c640 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.81:6835/2778062051,v1:172.21.15.81:6837/2778062051] conn(0x563e11b905e0 0x563e11b909c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f495d7fa640 10 client.6525 ms_handle_connect on v2:172.21.15.81:6835/2778062051 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f497e59c640 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.81:6835/2778062051,v1:172.21.15.81:6837/2778062051] conn(0x563e11b905e0 0x563e11b909c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52f2795b8e3242a1 server_cookie=d4d205ea7dc02013 in_seq=0 out_seq=0 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f495d7fa640 1 -- 172.21.15.81:0/2241659173 <== mds.0 v2:172.21.15.81:6835/2778062051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x563e11ab6fa0 con 0x563e11b905e0 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f495d7fa640 10 client.6525 handle_command_reply: tid=0 2024-09-16T01:19:05.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 client.6525 shutdown 2024-09-16T01:19:05.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 -- 172.21.15.81:0/2241659173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 msgr2=0x563e11c0d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 0x563e11c0d370 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f497800e200 tx=0x7f497800b040 comp rx=0 tx=0).stop 2024-09-16T01:19:05.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 -- 172.21.15.81:0/2241659173 shutdown_connections 2024-09-16T01:19:05.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.81:6835/2778062051,v1:172.21.15.81:6837/2778062051] conn(0x563e11b905e0 0x563e11b909c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563e11b6c030 0x563e11c0d370 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f495d7fa640 0 client.6525 ms_handle_reset on v2:172.21.15.81:6835/2778062051 2024-09-16T01:19:05.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563e11b4ea50 0x563e11b8baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 --2- 172.21.15.81:0/2241659173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563e11b4d2c0 0x563e11b71120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 -- 172.21.15.81:0/2241659173 >> 172.21.15.81:0/2241659173 conn(0x563e11b4aa80 msgr2=0x563e11bb6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:05.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 -- 172.21.15.81:0/2241659173 shutdown_connections 2024-09-16T01:19:05.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.461+0000 7f4987608740 1 -- 172.21.15.81:0/2241659173 wait complete. 2024-09-16T01:19:05.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f4987608740 20 client.6525 trim_cache size 0 max 16384 2024-09-16T01:19:05.475 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:19:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973", 2024-09-16T01:19:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-16T01:19:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6387, 2024-09-16T01:19:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-16T01:19:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-16T01:19:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-16T01:19:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.5380380530000002, 2024-09-16T01:19:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 43, 2024-09-16T01:19:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 87, 2024-09-16T01:19:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 87, 2024-09-16T01:19:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 9.884546791 2024-09-16T01:19:05.476 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:19:05.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f498486e640 1 -- 172.21.15.81:0/3254253316 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f496006c2b0 msgr2=0x7f496006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f498486e640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f496006c2b0 0x7f496006e770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4970001eb0 tx=0x7f4970009040 comp rx=0 tx=0).stop 2024-09-16T01:19:05.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f498486e640 1 -- 172.21.15.81:0/3254253316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f498015b320 msgr2=0x7f498015b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f498486e640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f498015b320 0x7f498015b7d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f497800e230 tx=0x7f4978009750 comp rx=0 tx=0).stop 2024-09-16T01:19:05.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f498486e640 1 -- 172.21.15.81:0/3254253316 shutdown_connections 2024-09-16T01:19:05.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f498486e640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f496006c2b0 0x7f496006e770 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f498486e640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f498015b320 0x7f498015b7d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f498486e640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4980154b60 0x7f49801580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f498486e640 1 --2- 172.21.15.81:0/3254253316 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49680052e0 0x7f49800cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f498486e640 1 -- 172.21.15.81:0/3254253316 >> 172.21.15.81:0/3254253316 conn(0x7f498006bc10 msgr2=0x7f49800afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:05.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f498486e640 1 -- 172.21.15.81:0/3254253316 shutdown_connections 2024-09-16T01:19:05.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.462+0000 7f498486e640 1 -- 172.21.15.81:0/3254253316 wait complete. 2024-09-16T01:19:05.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:19:05.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.575+0000 7ff4dfbc4640 1 Processor -- start 2024-09-16T01:19:05.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.576+0000 7ff4dfbc4640 1 -- start start 2024-09-16T01:19:05.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.576+0000 7ff4dfbc4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4d8161c80 0x7ff4d806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.576+0000 7ff4dfbc4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff4d8162060 0x7ff4d80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.576+0000 7ff4dfbc4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4d806e870 con 0x7ff4d80b64b0 2024-09-16T01:19:05.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.576+0000 7ff4dfbc4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d806d9f0 con 0x7ff4d8161c80 2024-09-16T01:19:05.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.576+0000 7ff4dfbc4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d806dcd0 con 0x7ff4d8162060 2024-09-16T01:19:05.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.577+0000 7ff4dd960640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4d8161c80 0x7ff4d806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.577+0000 7ff4dd960640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff4d8161c80 0x7ff4d806e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54016/0 (socket says 172.21.15.81:54016) 2024-09-16T01:19:05.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.577+0000 7ff4dd960640 1 -- 172.21.15.81:0/1065628938 learned_addr learned my addr 172.21.15.81:0/1065628938 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:05.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.577+0000 7ff4dd960640 1 -- 172.21.15.81:0/1065628938 >> v2:172.21.15.102:3300/0 conn(0x7ff4d8162060 msgr2=0x7ff4d80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.577+0000 7ff4dd15f640 1 --2- 172.21.15.81:0/1065628938 >> v2:172.21.15.102:3300/0 conn(0x7ff4d8162060 0x7ff4d80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.577+0000 7ff4dd960640 1 --2- 172.21.15.81:0/1065628938 >> v2:172.21.15.102:3300/0 conn(0x7ff4d8162060 0x7ff4d80b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.577+0000 7ff4dd960640 1 -- 172.21.15.81:0/1065628938 >> v1:172.21.15.102:6789/0 conn(0x7ff4d80b64b0 legacy=0x7ff4d8162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:05.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.577+0000 7ff4dd960640 1 -- 172.21.15.81:0/1065628938 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d806dfb0 con 0x7ff4d8161c80 2024-09-16T01:19:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.578+0000 7ff4dd960640 1 --2- 172.21.15.81:0/1065628938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d8161c80 0x7ff4d806e330 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff4d808e830 tx=0x7ff4c802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6d4f5633329fad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.578+0000 7ff4dc95e640 1 -- 172.21.15.81:0/1065628938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8036070 con 0x7ff4d8161c80 2024-09-16T01:19:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.578+0000 7ff4dc95e640 1 -- 172.21.15.81:0/1065628938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c8031600 con 0x7ff4d8161c80 2024-09-16T01:19:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.578+0000 7ff4dc95e640 1 -- 172.21.15.81:0/1065628938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c80319d0 con 0x7ff4d8161c80 2024-09-16T01:19:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.578+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/1065628938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d8161c80 msgr2=0x7ff4d806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.578+0000 7ff4dfbc4640 1 --2- 172.21.15.81:0/1065628938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d8161c80 0x7ff4d806e330 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff4d808e830 tx=0x7ff4c802a6f0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.578+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/1065628938 shutdown_connections 2024-09-16T01:19:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.578+0000 7ff4dfbc4640 1 --2- 172.21.15.81:0/1065628938 >> v2:172.21.15.102:3300/0 conn(0x7ff4d8162060 0x7ff4d80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.578+0000 7ff4dfbc4640 1 --2- 172.21.15.81:0/1065628938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d8161c80 0x7ff4d806e330 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.578+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/1065628938 >> 172.21.15.81:0/1065628938 conn(0x7ff4d80d44f0 msgr2=0x7ff4d80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.578+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/1065628938 shutdown_connections 2024-09-16T01:19:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.578+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/1065628938 wait complete. 2024-09-16T01:19:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.580+0000 7ff4dfbc4640 1 Processor -- start 2024-09-16T01:19:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.580+0000 7ff4dfbc4640 1 -- start start 2024-09-16T01:19:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.580+0000 7ff4dfbc4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d80b64b0 0x7ff4d81f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.580+0000 7ff4dfbc4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4d8161c80 0x7ff4d80c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.580+0000 7ff4dfbc4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4d8162060 0x7ff4d80b95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.580+0000 7ff4dfbc4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d80d2a10 con 0x7ff4d80b64b0 2024-09-16T01:19:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.580+0000 7ff4dfbc4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d80d2890 con 0x7ff4d8162060 2024-09-16T01:19:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.580+0000 7ff4dfbc4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d80b6960 con 0x7ff4d8161c80 2024-09-16T01:19:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.580+0000 7ff4dd960640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d80b64b0 0x7ff4d81f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.580+0000 7ff4dd960640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d80b64b0 0x7ff4d81f3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54020/0 (socket says 172.21.15.81:54020) 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.580+0000 7ff4dd960640 1 -- 172.21.15.81:0/2609132287 learned_addr learned my addr 172.21.15.81:0/2609132287 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4de161640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4d8162060 0x7ff4d80b95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4dd15f640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4d8161c80 0x7ff4d80c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4dd960640 1 -- 172.21.15.81:0/2609132287 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4d8161c80 msgr2=0x7ff4d80c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4dd960640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4d8161c80 0x7ff4d80c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4dd960640 1 -- 172.21.15.81:0/2609132287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4d8162060 msgr2=0x7ff4d80b95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4dd960640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4d8162060 0x7ff4d80b95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4dd960640 1 -- 172.21.15.81:0/2609132287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d80b9b10 con 0x7ff4d80b64b0 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4de161640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4d8162060 0x7ff4d80b95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4dd960640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d80b64b0 0x7ff4d81f3e10 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8034040 tx=0x7ff4c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4d67fc640 1 -- 172.21.15.81:0/2609132287 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8036050 con 0x7ff4d80b64b0 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4d67fc640 1 -- 172.21.15.81:0/2609132287 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4c8042070 con 0x7ff4d80b64b0 2024-09-16T01:19:05.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4d67fc640 1 -- 172.21.15.81:0/2609132287 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c8009510 con 0x7ff4d80b64b0 2024-09-16T01:19:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/2609132287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d80b8770 con 0x7ff4d80b64b0 2024-09-16T01:19:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.581+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/2609132287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d80c8450 con 0x7ff4d80b64b0 2024-09-16T01:19:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.582+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/2609132287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d80ba470 con 0x7ff4d80b64b0 2024-09-16T01:19:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.582+0000 7ff4d67fc640 1 -- 172.21.15.81:0/2609132287 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff4c8007c30 con 0x7ff4d80b64b0 2024-09-16T01:19:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.583+0000 7ff4d67fc640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff4c406c2b0 0x7ff4c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.583+0000 7ff4d67fc640 1 -- 172.21.15.81:0/2609132287 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7ff4c80ac570 con 0x7ff4d80b64b0 2024-09-16T01:19:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.583+0000 7ff4dd15f640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff4c406c2b0 0x7ff4c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:05.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.583+0000 7ff4dd15f640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff4c406c2b0 0x7ff4c406e770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc006fd0 tx=0x7ff4cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:05.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.587+0000 7ff4d67fc640 1 -- 172.21.15.81:0/2609132287 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff4d806e870 con 0x7ff4d80b64b0 2024-09-16T01:19:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.785+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/2609132287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff4d80d31f0 con 0x7ff4d80b64b0 2024-09-16T01:19:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.786+0000 7ff4d67fc640 1 -- 172.21.15.81:0/2609132287 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) ==== 53+0+73 (secure 0 0 0) 0x7ff4c807ab50 con 0x7ff4d80b64b0 2024-09-16T01:19:05.787 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:19:05.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.787+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/2609132287 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff4c406c2b0 msgr2=0x7ff4c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.787+0000 7ff4dfbc4640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff4c406c2b0 0x7ff4c406e770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc006fd0 tx=0x7ff4cc008040 comp rx=0 tx=0).stop 2024-09-16T01:19:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.787+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/2609132287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d80b64b0 msgr2=0x7ff4d81f3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.787+0000 7ff4dfbc4640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d80b64b0 0x7ff4d81f3e10 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8034040 tx=0x7ff4c8004a40 comp rx=0 tx=0).stop 2024-09-16T01:19:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.787+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/2609132287 shutdown_connections 2024-09-16T01:19:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.787+0000 7ff4dfbc4640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff4c406c2b0 0x7ff4c406e770 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.787+0000 7ff4dfbc4640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4d8162060 0x7ff4d80b95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.787+0000 7ff4dfbc4640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4d8161c80 0x7ff4d80c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.787+0000 7ff4dfbc4640 1 --2- 172.21.15.81:0/2609132287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4d80b64b0 0x7ff4d81f3e10 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.787+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/2609132287 >> 172.21.15.81:0/2609132287 conn(0x7ff4d80d44f0 msgr2=0x7ff4d80b4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.788+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/2609132287 shutdown_connections 2024-09-16T01:19:05.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:05.788+0000 7ff4dfbc4640 1 -- 172.21.15.81:0/2609132287 wait complete. 2024-09-16T01:19:05.800 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:19:05.800 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:19:05.800 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:19:05.800 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:19:05.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:19:05.800 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:19:05.801 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:19:05.801 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:19:05.801 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:19:05.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:05.801 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:19:05.816 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:19:05.817 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:19:05.817 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:19:05.817 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:05.817 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:19:05.817 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:05.817 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:19:05.817 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:19:05.817 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:19:05.817 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:19:05.817 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:19:05.817 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:19:05.817 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42592sec preferred_lft 42592sec 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::bc22:19ff:fe0c:8fb1/64 scope link 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:05.818 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:19:05.819 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 86:bb:d8:38:80:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:19:05.819 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::84bb:d8ff:fe38:80af/64 scope link 2024-09-16T01:19:05.819 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:05.819 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:19:05.819 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:19:05.819 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::828:dff:febd:ee39/64 scope link 2024-09-16T01:19:05.819 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:05.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:05.819 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:19:05.879 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:19:05.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:05.881 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:19:05.938 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:19:05.938 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:19:05.938 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:19:05.938 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:19:05.938 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:19:05.938 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:19:05.938 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:19:05.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:19:05.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:19:05.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:19:05.939 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:19:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:19:06.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:19:06.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:06.065 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:19:06.080 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:19:06.081 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:19:06.081 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:19:06.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:06.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-16T01:19:06.145 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:19:06.146 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:19:06.201 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:19:06.201 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:19:06.201 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:19:06.256 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:19:06.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:06.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:19:06.339 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:19:06.339 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:19:06.339 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:19:06.348 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:19:06.348 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:19:06.348 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:19:06.348 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:19:06.348 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:19:06.353 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:19:06.353 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:19:06.353 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:19:06.353 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:19:06.353 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:19:06.353 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:19:06.354 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:19:06.354 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:19:06.354 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:19:06.354 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:19:06.354 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:19:06.354 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:19:06.354 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:19:06.355 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:19:06.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:06.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:19:06.421 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:19:06.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:19:06.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:19:06.522 INFO:teuthology.orchestra.run.smithi081.stdout:client5510 2024-09-16T01:19:06.523 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:19:06.523 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:19:06.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:19:06.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.675+0000 7f10ae79f640 1 Processor -- start 2024-09-16T01:19:06.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.675+0000 7f10ae79f640 1 -- start start 2024-09-16T01:19:06.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10ae79f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10a8072dc0 0x7f10a80b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:06.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10ae79f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10a80b3c90 0x7f10a806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10ae79f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a80b44c0 con 0x7f10a80afd60 2024-09-16T01:19:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10ae79f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f10a80b0140 con 0x7f10a8072dc0 2024-09-16T01:19:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10ae79f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f10a815ead0 con 0x7f10a80b3c90 2024-09-16T01:19:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10a77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10a8072dc0 0x7f10a80b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10a7fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f10a80afd60 0x7f10a80726b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49568/0 (socket says 172.21.15.81:49568) 2024-09-16T01:19:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10a7fff640 1 -- 172.21.15.81:0/2370990952 learned_addr learned my addr 172.21.15.81:0/2370990952 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10acd3c640 1 --2- 172.21.15.81:0/2370990952 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10a80b3c90 0x7f10a806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10a77fe640 1 -- 172.21.15.81:0/2370990952 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10a80b3c90 msgr2=0x7f10a806f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10a77fe640 1 --2- 172.21.15.81:0/2370990952 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10a80b3c90 0x7f10a806f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10a77fe640 1 -- 172.21.15.81:0/2370990952 >> v1:172.21.15.81:6789/0 conn(0x7f10a80afd60 legacy=0x7f10a80726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.676+0000 7f10a77fe640 1 -- 172.21.15.81:0/2370990952 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a815edb0 con 0x7f10a8072dc0 2024-09-16T01:19:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.677+0000 7f10a77fe640 1 --2- 172.21.15.81:0/2370990952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a8072dc0 0x7f10a80b3750 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f109c0097a0 tx=0x7f109c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a56f4a75c5634a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.677+0000 7f10a6ffd640 1 -- 172.21.15.81:0/2370990952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c037070 con 0x7f10a8072dc0 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.677+0000 7f10a6ffd640 1 -- 172.21.15.81:0/2370990952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c032440 con 0x7f10a8072dc0 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.677+0000 7f10a6ffd640 1 -- 172.21.15.81:0/2370990952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c032810 con 0x7f10a8072dc0 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.678+0000 7f10ae79f640 1 -- 172.21.15.81:0/2370990952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a8072dc0 msgr2=0x7f10a80b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.678+0000 7f10ae79f640 1 --2- 172.21.15.81:0/2370990952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a8072dc0 0x7f10a80b3750 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f109c0097a0 tx=0x7f109c02a180 comp rx=0 tx=0).stop 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.678+0000 7f10ae79f640 1 -- 172.21.15.81:0/2370990952 shutdown_connections 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.678+0000 7f10ae79f640 1 --2- 172.21.15.81:0/2370990952 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10a80b3c90 0x7f10a806f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.678+0000 7f10ae79f640 1 --2- 172.21.15.81:0/2370990952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a8072dc0 0x7f10a80b3750 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.678+0000 7f10ae79f640 1 -- 172.21.15.81:0/2370990952 >> 172.21.15.81:0/2370990952 conn(0x7f10a806c030 msgr2=0x7f10a806c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.678+0000 7f10ae79f640 1 -- 172.21.15.81:0/2370990952 shutdown_connections 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.678+0000 7f10ae79f640 1 -- 172.21.15.81:0/2370990952 wait complete. 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.679+0000 7f10ae79f640 1 Processor -- start 2024-09-16T01:19:06.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.679+0000 7f10ae79f640 1 -- start start 2024-09-16T01:19:06.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10ae79f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10a8072dc0 0x7f10a80b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:06.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10ae79f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10a80afd60 0x7f10a80b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:06.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10ae79f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a80b3c90 0x7f10a814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:06.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10ae79f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f10a815f890 con 0x7f10a80b3c90 2024-09-16T01:19:06.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10ae79f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f10a815f370 con 0x7f10a80afd60 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10ae79f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f10a80b4120 con 0x7f10a8072dc0 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10acd3c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a80b3c90 0x7f10a814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10acd3c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a80b3c90 0x7f10a814d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54028/0 (socket says 172.21.15.81:54028) 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10acd3c640 1 -- 172.21.15.81:0/3594536793 learned_addr learned my addr 172.21.15.81:0/3594536793 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10a7fff640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10a8072dc0 0x7f10a80b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10a77fe640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10a80afd60 0x7f10a80b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10acd3c640 1 -- 172.21.15.81:0/3594536793 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10a8072dc0 msgr2=0x7f10a80b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10acd3c640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10a8072dc0 0x7f10a80b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10acd3c640 1 -- 172.21.15.81:0/3594536793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10a80afd60 msgr2=0x7f10a80b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10acd3c640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10a80afd60 0x7f10a80b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10acd3c640 1 -- 172.21.15.81:0/3594536793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a8160ba0 con 0x7f10a80b3c90 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.680+0000 7f10a77fe640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10a80afd60 0x7f10a80b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:06.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.681+0000 7f10acd3c640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a80b3c90 0x7f10a814d650 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f10a0007e60 tx=0x7f10a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.681+0000 7f10a4ff9640 1 -- 172.21.15.81:0/3594536793 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0014420 con 0x7f10a80b3c90 2024-09-16T01:19:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.681+0000 7f10a4ff9640 1 -- 172.21.15.81:0/3594536793 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a0019070 con 0x7f10a80b3c90 2024-09-16T01:19:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.681+0000 7f10a4ff9640 1 -- 172.21.15.81:0/3594536793 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0014820 con 0x7f10a80b3c90 2024-09-16T01:19:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.681+0000 7f10ae79f640 1 -- 172.21.15.81:0/3594536793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a81527f0 con 0x7f10a80b3c90 2024-09-16T01:19:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.681+0000 7f10ae79f640 1 -- 172.21.15.81:0/3594536793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a8152db0 con 0x7f10a80b3c90 2024-09-16T01:19:06.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.682+0000 7f10ae79f640 1 -- 172.21.15.81:0/3594536793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a80b3750 con 0x7f10a80b3c90 2024-09-16T01:19:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.682+0000 7f10a4ff9640 1 -- 172.21.15.81:0/3594536793 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f10a00149c0 con 0x7f10a80b3c90 2024-09-16T01:19:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.683+0000 7f10a4ff9640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f109406c2b0 0x7f109406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.683+0000 7f10a4ff9640 1 -- 172.21.15.81:0/3594536793 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f10a008be00 con 0x7f10a80b3c90 2024-09-16T01:19:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.683+0000 7f10a7fff640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f109406c2b0 0x7f109406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:06.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.683+0000 7f10a7fff640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f109406c2b0 0x7f109406e770 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f10a8153cc0 tx=0x7f1098009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:06.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.687+0000 7f10a4ff9640 1 -- 172.21.15.81:0/3594536793 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10a005a3e0 con 0x7f10a80b3c90 2024-09-16T01:19:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.884+0000 7f10ae79f640 1 -- 172.21.15.81:0/3594536793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f10a806d250 con 0x7f10a80b3c90 2024-09-16T01:19:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.884+0000 7f10a4ff9640 1 -- 172.21.15.81:0/3594536793 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) ==== 53+0+73 (secure 0 0 0) 0x7f10a0059ce0 con 0x7f10a80b3c90 2024-09-16T01:19:06.886 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:19:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.886+0000 7f10ae79f640 1 -- 172.21.15.81:0/3594536793 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f109406c2b0 msgr2=0x7f109406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.886+0000 7f10ae79f640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f109406c2b0 0x7f109406e770 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f10a8153cc0 tx=0x7f1098009040 comp rx=0 tx=0).stop 2024-09-16T01:19:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.886+0000 7f10ae79f640 1 -- 172.21.15.81:0/3594536793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a80b3c90 msgr2=0x7f10a814d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.886+0000 7f10ae79f640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a80b3c90 0x7f10a814d650 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f10a0007e60 tx=0x7f10a000e4b0 comp rx=0 tx=0).stop 2024-09-16T01:19:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.887+0000 7f10ae79f640 1 -- 172.21.15.81:0/3594536793 shutdown_connections 2024-09-16T01:19:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.887+0000 7f10ae79f640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f109406c2b0 0x7f109406e770 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.887+0000 7f10ae79f640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10a80b3c90 0x7f10a814d650 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.887+0000 7f10ae79f640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10a80afd60 0x7f10a80b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.887+0000 7f10ae79f640 1 --2- 172.21.15.81:0/3594536793 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f10a8072dc0 0x7f10a80b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.887+0000 7f10ae79f640 1 -- 172.21.15.81:0/3594536793 >> 172.21.15.81:0/3594536793 conn(0x7f10a806c030 msgr2=0x7f10a815fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.887+0000 7f10ae79f640 1 -- 172.21.15.81:0/3594536793 shutdown_connections 2024-09-16T01:19:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:06.887+0000 7f10ae79f640 1 -- 172.21.15.81:0/3594536793 wait complete. 2024-09-16T01:19:06.899 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:19:06.899 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:19:06.899 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-16T01:19:06.899 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T01:19:06.899 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:19:06.899 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:19:06.899 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:19:06.899 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:19:06.899 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:19:06.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:06.900 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-16T01:19:06.919 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:19:06.919 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:19:06.919 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:19:06.919 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:06.919 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:19:06.919 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:06.919 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:19:06.919 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-16T01:19:06.919 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42593sec preferred_lft 42593sec 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:19:06.920 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:19:06.921 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:19:06.921 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:06.921 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::fc48:18ff:fedc:b80f/64 scope link 2024-09-16T01:19:06.921 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:06.921 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:19:06.921 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 2e:4a:65:c9:20:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:19:06.921 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::2c4a:65ff:fec9:204f/64 scope link 2024-09-16T01:19:06.921 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:06.921 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:19:06.921 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:19:06.921 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::1072:70ff:fefd:f9f1/64 scope link 2024-09-16T01:19:06.921 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:19:06.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:06.922 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:19:06.987 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:19:06.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:06.989 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-16T01:19:07.047 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-16T01:19:07.047 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:19:07.047 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:19:07.047 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:19:07.047 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:19:07.047 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:19:07.048 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:19:07.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:19:07.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:19:07.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:19:07.048 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:19:07.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:19:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:19:07.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:19:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:19:07.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:07.179 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:19:07.194 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T01:19:07.195 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:19:07.195 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:19:07.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:07.195 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-16T01:19:07.260 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:19:07.260 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T01:19:07.315 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:19:07.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:19:07.316 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:19:07.371 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:19:07.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:07.371 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:19:07.454 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:19:07.454 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:19:07.454 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:19:07.462 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:19:07.462 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:19:07.463 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:19:07.463 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:19:07.463 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:19:07.468 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:19:07.468 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:19:07.468 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:19:07.468 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:19:07.468 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:19:07.468 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:19:07.469 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:19:07.469 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:19:07.469 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T01:19:07.469 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:19:07.469 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:19:07.469 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:19:07.469 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:19:07.471 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:19:07.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:19:07.471 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:19:07.536 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:19:07.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:19:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:19:07.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:19:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:19:07.633 INFO:teuthology.orchestra.run.smithi102.stdout:client5519 2024-09-16T01:19:07.633 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:19:07.633 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:19:07.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-09-16T01:19:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.758+0000 7fb903191640 1 Processor -- start 2024-09-16T01:19:07.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.759+0000 7fb903191640 1 -- start start 2024-09-16T01:19:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.759+0000 7fb903191640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8fc162e30 0x7fb8fc06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.759+0000 7fb903191640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8fc0cf280 0x7fb8fc0d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.759+0000 7fb903191640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8fc15ff70 con 0x7fb8fc162340 2024-09-16T01:19:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.759+0000 7fb903191640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb8fc06de90 con 0x7fb8fc162e30 2024-09-16T01:19:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.759+0000 7fb903191640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb8fc163270 con 0x7fb8fc0cf280 2024-09-16T01:19:07.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.760+0000 7fb8f3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8fc162e30 0x7fb8fc06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.760+0000 7fb900f2d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb8fc162340 0x7fb8fc162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49576/0 (socket says 172.21.15.81:49576) 2024-09-16T01:19:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.760+0000 7fb900f2d640 1 -- 172.21.15.81:0/869749637 learned_addr learned my addr 172.21.15.81:0/869749637 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.760+0000 7fb90172e640 1 --2- 172.21.15.81:0/869749637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8fc0cf280 0x7fb8fc0d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.760+0000 7fb8f3fff640 1 -- 172.21.15.81:0/869749637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8fc0cf280 msgr2=0x7fb8fc0d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.760+0000 7fb8f3fff640 1 --2- 172.21.15.81:0/869749637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8fc0cf280 0x7fb8fc0d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.760+0000 7fb8f3fff640 1 -- 172.21.15.81:0/869749637 >> v1:172.21.15.81:6789/0 conn(0x7fb8fc162340 legacy=0x7fb8fc162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:07.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.760+0000 7fb8f3fff640 1 -- 172.21.15.81:0/869749637 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc0d4d10 con 0x7fb8fc162e30 2024-09-16T01:19:07.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.760+0000 7fb8f37fe640 1 -- 172.21.15.81:0/869749637 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279000203 0 0) 0x7fb8fc15ff70 con 0x7fb8fc162340 2024-09-16T01:19:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.761+0000 7fb8f3fff640 1 --2- 172.21.15.81:0/869749637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc162e30 0x7fb8fc06d740 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009790 tx=0x7fb8ec02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aab35d0d207de6c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:07.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.761+0000 7fb8f37fe640 1 -- 172.21.15.81:0/869749637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec037070 con 0x7fb8fc162e30 2024-09-16T01:19:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.761+0000 7fb8f37fe640 1 -- 172.21.15.81:0/869749637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ec02ae50 con 0x7fb8fc162e30 2024-09-16T01:19:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.761+0000 7fb8f37fe640 1 -- 172.21.15.81:0/869749637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec032660 con 0x7fb8fc162e30 2024-09-16T01:19:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.761+0000 7fb903191640 1 -- 172.21.15.81:0/869749637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc162e30 msgr2=0x7fb8fc06d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.761+0000 7fb903191640 1 --2- 172.21.15.81:0/869749637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc162e30 0x7fb8fc06d740 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009790 tx=0x7fb8ec02a100 comp rx=0 tx=0).stop 2024-09-16T01:19:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.761+0000 7fb903191640 1 -- 172.21.15.81:0/869749637 shutdown_connections 2024-09-16T01:19:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.761+0000 7fb903191640 1 --2- 172.21.15.81:0/869749637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8fc0cf280 0x7fb8fc0d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.761+0000 7fb903191640 1 --2- 172.21.15.81:0/869749637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc162e30 0x7fb8fc06d740 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.761+0000 7fb903191640 1 -- 172.21.15.81:0/869749637 >> 172.21.15.81:0/869749637 conn(0x7fb8fc08bfc0 msgr2=0x7fb8fc0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.761+0000 7fb903191640 1 -- 172.21.15.81:0/869749637 shutdown_connections 2024-09-16T01:19:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.761+0000 7fb903191640 1 -- 172.21.15.81:0/869749637 wait complete. 2024-09-16T01:19:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.762+0000 7fb903191640 1 Processor -- start 2024-09-16T01:19:07.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.763+0000 7fb903191640 1 -- start start 2024-09-16T01:19:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.763+0000 7fb903191640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8fc0cf280 0x7fb8fc14e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.763+0000 7fb903191640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc162340 0x7fb8fc1ebd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.763+0000 7fb903191640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8fc162e30 0x7fb8fc1616e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.763+0000 7fb903191640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc0cf710 con 0x7fb8fc162340 2024-09-16T01:19:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.763+0000 7fb903191640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc0d2470 con 0x7fb8fc0cf280 2024-09-16T01:19:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.763+0000 7fb903191640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb8fc0d52d0 con 0x7fb8fc162e30 2024-09-16T01:19:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb8f3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc162340 0x7fb8fc1ebd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb8f3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc162340 0x7fb8fc1ebd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54046/0 (socket says 172.21.15.81:54046) 2024-09-16T01:19:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb8f3fff640 1 -- 172.21.15.81:0/3328217111 learned_addr learned my addr 172.21.15.81:0/3328217111 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb900f2d640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8fc0cf280 0x7fb8fc14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:07.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb90172e640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8fc162e30 0x7fb8fc1616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb8f3fff640 1 -- 172.21.15.81:0/3328217111 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8fc162e30 msgr2=0x7fb8fc1616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb8f3fff640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8fc162e30 0x7fb8fc1616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb8f3fff640 1 -- 172.21.15.81:0/3328217111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8fc0cf280 msgr2=0x7fb8fc14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb8f3fff640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8fc0cf280 0x7fb8fc14e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb8f3fff640 1 -- 172.21.15.81:0/3328217111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc14ee50 con 0x7fb8fc162340 2024-09-16T01:19:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb8f3fff640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc162340 0x7fb8fc1ebd00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec000c00 tx=0x7fb8ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb8f17fa640 1 -- 172.21.15.81:0/3328217111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec037040 con 0x7fb8fc162340 2024-09-16T01:19:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb8f17fa640 1 -- 172.21.15.81:0/3328217111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ec004030 con 0x7fb8fc162340 2024-09-16T01:19:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb8f17fa640 1 -- 172.21.15.81:0/3328217111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec004400 con 0x7fb8fc162340 2024-09-16T01:19:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb903191640 1 -- 172.21.15.81:0/3328217111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8fc1ec240 con 0x7fb8fc162340 2024-09-16T01:19:07.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.764+0000 7fb903191640 1 -- 172.21.15.81:0/3328217111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8fc0b9c20 con 0x7fb8fc162340 2024-09-16T01:19:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.765+0000 7fb903191640 1 -- 172.21.15.81:0/3328217111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8fc0b9a10 con 0x7fb8fc162340 2024-09-16T01:19:07.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.766+0000 7fb8f17fa640 1 -- 172.21.15.81:0/3328217111 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb8ec005990 con 0x7fb8fc162340 2024-09-16T01:19:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.766+0000 7fb8f17fa640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8e806c2b0 0x7fb8e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.766+0000 7fb8f17fa640 1 -- 172.21.15.81:0/3328217111 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fb8ec0abc10 con 0x7fb8fc162340 2024-09-16T01:19:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.766+0000 7fb900f2d640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8e806c2b0 0x7fb8e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.767+0000 7fb900f2d640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8e806c2b0 0x7fb8e806e770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8000f60 tx=0x7fb8f8007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.771+0000 7fb8f17fa640 1 -- 172.21.15.81:0/3328217111 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8fc14ee50 con 0x7fb8fc162340 2024-09-16T01:19:07.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.936+0000 7fb903191640 1 -- 172.21.15.81:0/3328217111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7fb8fc06d740 con 0x7fb8fc162340 2024-09-16T01:19:07.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.941+0000 7fb8f17fa640 1 -- 172.21.15.81:0/3328217111 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7fb8ec079ba0 con 0x7fb8fc162340 2024-09-16T01:19:07.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.943+0000 7fb903191640 1 -- 172.21.15.81:0/3328217111 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8e806c2b0 msgr2=0x7fb8e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:07.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.943+0000 7fb903191640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8e806c2b0 0x7fb8e806e770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8000f60 tx=0x7fb8f8007d50 comp rx=0 tx=0).stop 2024-09-16T01:19:07.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.943+0000 7fb903191640 1 -- 172.21.15.81:0/3328217111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc162340 msgr2=0x7fb8fc1ebd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:07.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.943+0000 7fb903191640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc162340 0x7fb8fc1ebd00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec000c00 tx=0x7fb8ec0046c0 comp rx=0 tx=0).stop 2024-09-16T01:19:07.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.943+0000 7fb903191640 1 -- 172.21.15.81:0/3328217111 shutdown_connections 2024-09-16T01:19:07.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.943+0000 7fb903191640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8e806c2b0 0x7fb8e806e770 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:07.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.943+0000 7fb903191640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8fc162e30 0x7fb8fc1616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:07.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.943+0000 7fb903191640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8fc162340 0x7fb8fc1ebd00 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:07.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.943+0000 7fb903191640 1 --2- 172.21.15.81:0/3328217111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8fc0cf280 0x7fb8fc14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:07.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.943+0000 7fb903191640 1 -- 172.21.15.81:0/3328217111 >> 172.21.15.81:0/3328217111 conn(0x7fb8fc08bfc0 msgr2=0x7fb8fc0b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:07.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.943+0000 7fb903191640 1 -- 172.21.15.81:0/3328217111 shutdown_connections 2024-09-16T01:19:07.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:07.943+0000 7fb903191640 1 -- 172.21.15.81:0/3328217111 wait complete. 2024-09-16T01:19:07.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 200 2024-09-16T01:19:08.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.056+0000 7f66f013b640 1 Processor -- start 2024-09-16T01:19:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.056+0000 7f66f013b640 1 -- start start 2024-09-16T01:19:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.057+0000 7f66f013b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f66e80cd120 0x7f66e8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.057+0000 7f66f013b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66e815b950 0x7f66e815e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.057+0000 7f66f013b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e815be00 con 0x7f66e815b570 2024-09-16T01:19:08.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.057+0000 7f66f013b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f66e80740e0 con 0x7f66e80cd120 2024-09-16T01:19:08.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.057+0000 7f66f013b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f66e8073b20 con 0x7f66e815b950 2024-09-16T01:19:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.057+0000 7f66ed6d6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f66e80cd120 0x7f66e8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.057+0000 7f66ee6d8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66e815b950 0x7f66e815e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.057+0000 7f66eded7640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f66e815b570 0x7f66e80cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:41466/0 (socket says 172.21.15.81:41466) 2024-09-16T01:19:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.057+0000 7f66eded7640 1 -- 172.21.15.81:0/3689874534 learned_addr learned my addr 172.21.15.81:0/3689874534 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.057+0000 7f66eced5640 1 -- 172.21.15.81:0/3689874534 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2039290814 0 0) 0x7f66e815be00 con 0x7f66e815b570 2024-09-16T01:19:08.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.058+0000 7f66eced5640 1 -- 172.21.15.81:0/3689874534 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66d4003440 con 0x7f66e815b570 2024-09-16T01:19:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.058+0000 7f66ed6d6640 1 -- 172.21.15.81:0/3689874534 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66e815b950 msgr2=0x7f66e815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.058+0000 7f66ed6d6640 1 --2- 172.21.15.81:0/3689874534 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66e815b950 0x7f66e815e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.058+0000 7f66ed6d6640 1 -- 172.21.15.81:0/3689874534 >> v1:172.21.15.102:6789/0 conn(0x7f66e815b570 legacy=0x7f66e80cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.058+0000 7f66ed6d6640 1 -- 172.21.15.81:0/3689874534 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e8073e00 con 0x7f66e80cd120 2024-09-16T01:19:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.058+0000 7f66ee6d8640 1 --2- 172.21.15.81:0/3689874534 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66e815b950 0x7f66e815e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:19:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.058+0000 7f66ed6d6640 1 --2- 172.21.15.81:0/3689874534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66e80cd120 0x7f66e8071e40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f66d80097a0 tx=0x7f66d802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=148925769dd0ce78 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.058+0000 7f66eced5640 1 -- 172.21.15.81:0/3689874534 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8037070 con 0x7f66e80cd120 2024-09-16T01:19:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.058+0000 7f66eced5640 1 -- 172.21.15.81:0/3689874534 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d802ae50 con 0x7f66e80cd120 2024-09-16T01:19:08.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.059+0000 7f66eced5640 1 -- 172.21.15.81:0/3689874534 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8032660 con 0x7f66e80cd120 2024-09-16T01:19:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.059+0000 7f66f013b640 1 -- 172.21.15.81:0/3689874534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66e80cd120 msgr2=0x7f66e8071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.059+0000 7f66f013b640 1 --2- 172.21.15.81:0/3689874534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66e80cd120 0x7f66e8071e40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f66d80097a0 tx=0x7f66d802a100 comp rx=0 tx=0).stop 2024-09-16T01:19:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.059+0000 7f66f013b640 1 -- 172.21.15.81:0/3689874534 shutdown_connections 2024-09-16T01:19:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.059+0000 7f66f013b640 1 --2- 172.21.15.81:0/3689874534 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66e815b950 0x7f66e815e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.059+0000 7f66f013b640 1 --2- 172.21.15.81:0/3689874534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66e80cd120 0x7f66e8071e40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.059+0000 7f66f013b640 1 -- 172.21.15.81:0/3689874534 >> 172.21.15.81:0/3689874534 conn(0x7f66e806bdf0 msgr2=0x7f66e806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.059+0000 7f66f013b640 1 -- 172.21.15.81:0/3689874534 shutdown_connections 2024-09-16T01:19:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.059+0000 7f66f013b640 1 -- 172.21.15.81:0/3689874534 wait complete. 2024-09-16T01:19:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.060+0000 7f66f013b640 1 Processor -- start 2024-09-16T01:19:08.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.060+0000 7f66f013b640 1 -- start start 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66f013b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66e80cd120 0x7f66e814f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66f013b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66e815b570 0x7f66e81561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66f013b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66e815b950 0x7f66e8156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66f013b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66e80cf840 con 0x7f66e815b950 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66f013b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f66e8072450 con 0x7f66e80cd120 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66f013b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f66e80cf9c0 con 0x7f66e815b570 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66ee6d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66e815b950 0x7f66e8156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66eded7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66e80cd120 0x7f66e814f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66ed6d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66e815b570 0x7f66e81561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66eded7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66e80cd120 0x7f66e814f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:53438/0 (socket says 172.21.15.81:53438) 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66eded7640 1 -- 172.21.15.81:0/2265711698 learned_addr learned my addr 172.21.15.81:0/2265711698 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66eded7640 1 -- 172.21.15.81:0/2265711698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66e815b570 msgr2=0x7f66e81561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66eded7640 1 --2- 172.21.15.81:0/2265711698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66e815b570 0x7f66e81561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66eded7640 1 -- 172.21.15.81:0/2265711698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66e815b950 msgr2=0x7f66e8156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66eded7640 1 --2- 172.21.15.81:0/2265711698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66e815b950 0x7f66e8156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.061+0000 7f66eded7640 1 -- 172.21.15.81:0/2265711698 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e80ad1a0 con 0x7f66e80cd120 2024-09-16T01:19:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.062+0000 7f66eded7640 1 --2- 172.21.15.81:0/2265711698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66e80cd120 0x7f66e814f810 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c430 tx=0x7f66e400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.062+0000 7f66de7fc640 1 -- 172.21.15.81:0/2265711698 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e4017070 con 0x7f66e80cd120 2024-09-16T01:19:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.062+0000 7f66de7fc640 1 -- 172.21.15.81:0/2265711698 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e4005ce0 con 0x7f66e80cd120 2024-09-16T01:19:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.062+0000 7f66f013b640 1 -- 172.21.15.81:0/2265711698 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e80ad480 con 0x7f66e80cd120 2024-09-16T01:19:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.062+0000 7f66de7fc640 1 -- 172.21.15.81:0/2265711698 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e40072f0 con 0x7f66e80cd120 2024-09-16T01:19:08.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.062+0000 7f66f013b640 1 -- 172.21.15.81:0/2265711698 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e80ada40 con 0x7f66e80cd120 2024-09-16T01:19:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.063+0000 7f66f013b640 1 -- 172.21.15.81:0/2265711698 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e8071e40 con 0x7f66e80cd120 2024-09-16T01:19:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.063+0000 7f66de7fc640 1 -- 172.21.15.81:0/2265711698 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f66e401a070 con 0x7f66e80cd120 2024-09-16T01:19:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.064+0000 7f66de7fc640 1 --2- 172.21.15.81:0/2265711698 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f66cc06c2b0 0x7f66cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.064+0000 7f66de7fc640 1 -- 172.21.15.81:0/2265711698 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f66e408a9c0 con 0x7f66e80cd120 2024-09-16T01:19:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.064+0000 7f66ed6d6640 1 --2- 172.21.15.81:0/2265711698 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f66cc06c2b0 0x7f66cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.064+0000 7f66ed6d6640 1 --2- 172.21.15.81:0/2265711698 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f66cc06c2b0 0x7f66cc06e770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f66d8034000 tx=0x7f66d802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:08.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.068+0000 7f66de7fc640 1 -- 172.21.15.81:0/2265711698 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66e40588c0 con 0x7f66e80cd120 2024-09-16T01:19:08.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.235+0000 7f66f013b640 1 -- 172.21.15.81:0/2265711698 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7f66e806ce20 con 0x7f66e80cd120 2024-09-16T01:19:08.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.240+0000 7f66de7fc640 1 -- 172.21.15.81:0/2265711698 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7f66e405cbc0 con 0x7f66e80cd120 2024-09-16T01:19:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.242+0000 7f66f013b640 1 -- 172.21.15.81:0/2265711698 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f66cc06c2b0 msgr2=0x7f66cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.242+0000 7f66f013b640 1 --2- 172.21.15.81:0/2265711698 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f66cc06c2b0 0x7f66cc06e770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f66d8034000 tx=0x7f66d802e000 comp rx=0 tx=0).stop 2024-09-16T01:19:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.242+0000 7f66f013b640 1 -- 172.21.15.81:0/2265711698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66e80cd120 msgr2=0x7f66e814f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.242+0000 7f66f013b640 1 --2- 172.21.15.81:0/2265711698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66e80cd120 0x7f66e814f810 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f66e400c430 tx=0x7f66e400c830 comp rx=0 tx=0).stop 2024-09-16T01:19:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.242+0000 7f66f013b640 1 -- 172.21.15.81:0/2265711698 shutdown_connections 2024-09-16T01:19:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.242+0000 7f66f013b640 1 --2- 172.21.15.81:0/2265711698 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f66cc06c2b0 0x7f66cc06e770 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.242+0000 7f66f013b640 1 --2- 172.21.15.81:0/2265711698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66e815b950 0x7f66e8156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.242+0000 7f66f013b640 1 --2- 172.21.15.81:0/2265711698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66e815b570 0x7f66e81561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.242+0000 7f66f013b640 1 --2- 172.21.15.81:0/2265711698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66e80cd120 0x7f66e814f810 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.242+0000 7f66f013b640 1 -- 172.21.15.81:0/2265711698 >> 172.21.15.81:0/2265711698 conn(0x7f66e806bdf0 msgr2=0x7f66e80cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.242+0000 7f66f013b640 1 -- 172.21.15.81:0/2265711698 shutdown_connections 2024-09-16T01:19:08.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.242+0000 7f66f013b640 1 -- 172.21.15.81:0/2265711698 wait complete. 2024-09-16T01:19:08.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 400 2024-09-16T01:19:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.353+0000 7efdd7d66640 1 Processor -- start 2024-09-16T01:19:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.354+0000 7efdd7d66640 1 -- start start 2024-09-16T01:19:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.354+0000 7efdd7d66640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efdd0162340 0x7efdd006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd7d66640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efdd00cf280 0x7efdd0162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd7d66640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd015ff70 con 0x7efdd0162c60 2024-09-16T01:19:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd7d66640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efdd006de90 con 0x7efdd00cf280 2024-09-16T01:19:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd7d66640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efdd00d4d10 con 0x7efdd0162340 2024-09-16T01:19:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd5b02640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efdd0162340 0x7efdd006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd5301640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efdd00cf280 0x7efdd0162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd6303640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7efdd0162c60 0x7efdd00d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:41468/0 (socket says 172.21.15.81:41468) 2024-09-16T01:19:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd6303640 1 -- 172.21.15.81:0/738503660 learned_addr learned my addr 172.21.15.81:0/738503660 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd5b02640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efdd0162340 0x7efdd006d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:34546/0 (socket says 172.21.15.81:34546) 2024-09-16T01:19:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd5301640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efdd00cf280 0x7efdd0162720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:53450/0 (socket says 172.21.15.81:53450) 2024-09-16T01:19:08.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd5301640 1 -- 172.21.15.81:0/738503660 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efdd0162340 msgr2=0x7efdd006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd5301640 1 --2- 172.21.15.81:0/738503660 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efdd0162340 0x7efdd006d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd5301640 1 -- 172.21.15.81:0/738503660 >> v1:172.21.15.102:6789/0 conn(0x7efdd0162c60 legacy=0x7efdd00d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd5301640 1 -- 172.21.15.81:0/738503660 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd00d4ff0 con 0x7efdd00cf280 2024-09-16T01:19:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd4b00640 1 -- 172.21.15.81:0/738503660 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1914133764 0 0) 0x7efdd015ff70 con 0x7efdd0162c60 2024-09-16T01:19:08.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.355+0000 7efdd5b02640 1 --2- 172.21.15.81:0/738503660 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efdd0162340 0x7efdd006d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:19:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.356+0000 7efdd5301640 1 --2- 172.21.15.81:0/738503660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdd00cf280 0x7efdd0162720 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009790 tx=0x7efdcc02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c53bd6f8a273ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.356+0000 7efdd4b00640 1 -- 172.21.15.81:0/738503660 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc037070 con 0x7efdd00cf280 2024-09-16T01:19:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.356+0000 7efdd4b00640 1 -- 172.21.15.81:0/738503660 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc02ae50 con 0x7efdd00cf280 2024-09-16T01:19:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.356+0000 7efdd4b00640 1 -- 172.21.15.81:0/738503660 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc032660 con 0x7efdd00cf280 2024-09-16T01:19:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.357+0000 7efdd7d66640 1 -- 172.21.15.81:0/738503660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdd00cf280 msgr2=0x7efdd0162720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.357+0000 7efdd7d66640 1 --2- 172.21.15.81:0/738503660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdd00cf280 0x7efdd0162720 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009790 tx=0x7efdcc02a100 comp rx=0 tx=0).stop 2024-09-16T01:19:08.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.357+0000 7efdd7d66640 1 -- 172.21.15.81:0/738503660 shutdown_connections 2024-09-16T01:19:08.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.357+0000 7efdd7d66640 1 --2- 172.21.15.81:0/738503660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdd00cf280 0x7efdd0162720 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.357+0000 7efdd7d66640 1 --2- 172.21.15.81:0/738503660 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efdd0162340 0x7efdd006d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.357+0000 7efdd7d66640 1 -- 172.21.15.81:0/738503660 >> 172.21.15.81:0/738503660 conn(0x7efdd008bfc0 msgr2=0x7efdd00d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:08.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.357+0000 7efdd7d66640 1 -- 172.21.15.81:0/738503660 shutdown_connections 2024-09-16T01:19:08.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.357+0000 7efdd7d66640 1 -- 172.21.15.81:0/738503660 wait complete. 2024-09-16T01:19:08.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.358+0000 7efdd7d66640 1 Processor -- start 2024-09-16T01:19:08.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.358+0000 7efdd7d66640 1 -- start start 2024-09-16T01:19:08.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd7d66640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdd00cf280 0x7efdd01eab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd7d66640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd0162340 0x7efdd00b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd7d66640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efdd0162c60 0x7efdd0152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd7d66640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efdd00cf6c0 con 0x7efdd0162340 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd7d66640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efdd00d52d0 con 0x7efdd00cf280 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd7d66640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efdd0163110 con 0x7efdd0162c60 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd5301640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd0162340 0x7efdd00b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd5301640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd0162340 0x7efdd00b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54070/0 (socket says 172.21.15.81:54070) 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd5301640 1 -- 172.21.15.81:0/3748942460 learned_addr learned my addr 172.21.15.81:0/3748942460 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd6303640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efdd0162c60 0x7efdd0152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd5b02640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdd00cf280 0x7efdd01eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd5301640 1 -- 172.21.15.81:0/3748942460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efdd0162c60 msgr2=0x7efdd0152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd5301640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efdd0162c60 0x7efdd0152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd5301640 1 -- 172.21.15.81:0/3748942460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdd00cf280 msgr2=0x7efdd01eab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd5301640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdd00cf280 0x7efdd01eab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd5301640 1 -- 172.21.15.81:0/3748942460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd00b73a0 con 0x7efdd0162340 2024-09-16T01:19:08.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd5301640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd0162340 0x7efdd00b2640 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7efdcc035040 tx=0x7efdcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:08.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdc27fc640 1 -- 172.21.15.81:0/3748942460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc042020 con 0x7efdd0162340 2024-09-16T01:19:08.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdc27fc640 1 -- 172.21.15.81:0/3748942460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdcc005990 con 0x7efdd0162340 2024-09-16T01:19:08.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd7d66640 1 -- 172.21.15.81:0/3748942460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd00b7680 con 0x7efdd0162340 2024-09-16T01:19:08.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdc27fc640 1 -- 172.21.15.81:0/3748942460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc037040 con 0x7efdd0162340 2024-09-16T01:19:08.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.359+0000 7efdd7d66640 1 -- 172.21.15.81:0/3748942460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd00b7f20 con 0x7efdd0162340 2024-09-16T01:19:08.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.361+0000 7efdd7d66640 1 -- 172.21.15.81:0/3748942460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd006e600 con 0x7efdd0162340 2024-09-16T01:19:08.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.361+0000 7efdc27fc640 1 -- 172.21.15.81:0/3748942460 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efdcc045020 con 0x7efdd0162340 2024-09-16T01:19:08.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.361+0000 7efdc27fc640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efdb406c2e0 0x7efdb406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.362+0000 7efdc27fc640 1 -- 172.21.15.81:0/3748942460 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7efdcc0ab8e0 con 0x7efdd0162340 2024-09-16T01:19:08.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.362+0000 7efdd5b02640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efdb406c2e0 0x7efdb406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.362+0000 7efdd5b02640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efdb406c2e0 0x7efdb406e7a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009560 tx=0x7efdc4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:08.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.366+0000 7efdc27fc640 1 -- 172.21.15.81:0/3748942460 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efdd006e600 con 0x7efdd0162340 2024-09-16T01:19:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.530+0000 7efdd7d66640 1 -- 172.21.15.81:0/3748942460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7efdd0162720 con 0x7efdd0162340 2024-09-16T01:19:08.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.534+0000 7efdc27fc640 1 -- 172.21.15.81:0/3748942460 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v27)=0 v27) ==== 128+0+0 (secure 0 0 0) 0x7efdcc04c070 con 0x7efdd0162340 2024-09-16T01:19:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.536+0000 7efdd7d66640 1 -- 172.21.15.81:0/3748942460 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efdb406c2e0 msgr2=0x7efdb406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.536+0000 7efdd7d66640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efdb406c2e0 0x7efdb406e7a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009560 tx=0x7efdc4009190 comp rx=0 tx=0).stop 2024-09-16T01:19:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.536+0000 7efdd7d66640 1 -- 172.21.15.81:0/3748942460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd0162340 msgr2=0x7efdd00b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.536+0000 7efdd7d66640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd0162340 0x7efdd00b2640 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7efdcc035040 tx=0x7efdcc0046c0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.536+0000 7efdd7d66640 1 -- 172.21.15.81:0/3748942460 shutdown_connections 2024-09-16T01:19:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.536+0000 7efdd7d66640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efdb406c2e0 0x7efdb406e7a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.536+0000 7efdd7d66640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efdd0162c60 0x7efdd0152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.536+0000 7efdd7d66640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdd0162340 0x7efdd00b2640 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.536+0000 7efdd7d66640 1 --2- 172.21.15.81:0/3748942460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efdd00cf280 0x7efdd01eab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.536+0000 7efdd7d66640 1 -- 172.21.15.81:0/3748942460 >> 172.21.15.81:0/3748942460 conn(0x7efdd008bfc0 msgr2=0x7efdd00d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.536+0000 7efdd7d66640 1 -- 172.21.15.81:0/3748942460 shutdown_connections 2024-09-16T01:19:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.536+0000 7efdd7d66640 1 -- 172.21.15.81:0/3748942460 wait complete. 2024-09-16T01:19:08.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 800 2024-09-16T01:19:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.648+0000 7f4c2f29b640 1 Processor -- start 2024-09-16T01:19:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.648+0000 7f4c2f29b640 1 -- start start 2024-09-16T01:19:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.649+0000 7f4c2f29b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4c280b5f80 0x7f4c28162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.649+0000 7f4c2f29b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c280d4c10 0x7f4c280b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.649+0000 7f4c2f29b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c280d2600 con 0x7f4c280d3320 2024-09-16T01:19:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.649+0000 7f4c2f29b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4c280d5420 con 0x7f4c280d4c10 2024-09-16T01:19:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.649+0000 7f4c2f29b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4c280d2e90 con 0x7f4c280b5f80 2024-09-16T01:19:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.649+0000 7f4c2c836640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c280d4c10 0x7f4c280b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.649+0000 7f4c2d838640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4c280d3320 0x7f4c280ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49590/0 (socket says 172.21.15.81:49590) 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.649+0000 7f4c2c836640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c280d4c10 0x7f4c280b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54080/0 (socket says 172.21.15.81:54080) 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.649+0000 7f4c2d838640 1 -- 172.21.15.81:0/48992303 learned_addr learned my addr 172.21.15.81:0/48992303 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.650+0000 7f4c2c836640 1 -- 172.21.15.81:0/48992303 >> v2:172.21.15.102:3300/0 conn(0x7f4c280b5f80 msgr2=0x7f4c28162980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.650+0000 7f4c2d037640 1 --2- 172.21.15.81:0/48992303 >> v2:172.21.15.102:3300/0 conn(0x7f4c280b5f80 0x7f4c28162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.650+0000 7f4c2c836640 1 --2- 172.21.15.81:0/48992303 >> v2:172.21.15.102:3300/0 conn(0x7f4c280b5f80 0x7f4c28162980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.650+0000 7f4c1ffff640 1 -- 172.21.15.81:0/48992303 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235969372 0 0) 0x7f4c20001110 con 0x7f4c280d3320 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.650+0000 7f4c2c836640 1 -- 172.21.15.81:0/48992303 >> v1:172.21.15.81:6789/0 conn(0x7f4c280d3320 legacy=0x7f4c280ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.650+0000 7f4c2c836640 1 -- 172.21.15.81:0/48992303 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c280b3c10 con 0x7f4c280d4c10 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.650+0000 7f4c2d037640 1 --2- 172.21.15.81:0/48992303 >> v2:172.21.15.102:3300/0 conn(0x7f4c280b5f80 0x7f4c28162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.650+0000 7f4c2c836640 1 --2- 172.21.15.81:0/48992303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c280d4c10 0x7f4c280b6360 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4c180097a0 tx=0x7f4c1802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960fa4ae61cd4b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.650+0000 7f4c1ffff640 1 -- 172.21.15.81:0/48992303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18037070 con 0x7f4c280d4c10 2024-09-16T01:19:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.650+0000 7f4c1ffff640 1 -- 172.21.15.81:0/48992303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c18032440 con 0x7f4c280d4c10 2024-09-16T01:19:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.651+0000 7f4c1ffff640 1 -- 172.21.15.81:0/48992303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18032810 con 0x7f4c280d4c10 2024-09-16T01:19:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.651+0000 7f4c2f29b640 1 -- 172.21.15.81:0/48992303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c280d4c10 msgr2=0x7f4c280b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.651+0000 7f4c2f29b640 1 --2- 172.21.15.81:0/48992303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c280d4c10 0x7f4c280b6360 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4c180097a0 tx=0x7f4c1802a1e0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.651+0000 7f4c2f29b640 1 -- 172.21.15.81:0/48992303 shutdown_connections 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.651+0000 7f4c2f29b640 1 --2- 172.21.15.81:0/48992303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c280d4c10 0x7f4c280b6360 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.651+0000 7f4c2f29b640 1 --2- 172.21.15.81:0/48992303 >> v2:172.21.15.102:3300/0 conn(0x7f4c280b5f80 0x7f4c28162980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.651+0000 7f4c2f29b640 1 -- 172.21.15.81:0/48992303 >> 172.21.15.81:0/48992303 conn(0x7f4c2808bfc0 msgr2=0x7f4c280d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.651+0000 7f4c2f29b640 1 -- 172.21.15.81:0/48992303 shutdown_connections 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.651+0000 7f4c2f29b640 1 -- 172.21.15.81:0/48992303 wait complete. 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.652+0000 7f4c2f29b640 1 Processor -- start 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.652+0000 7f4c2f29b640 1 -- start start 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2f29b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c280b5f80 0x7f4c281e8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2f29b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280d3320 0x7f4c280b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2f29b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c280d4c10 0x7f4c2815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2f29b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c280d5140 con 0x7f4c280b5f80 2024-09-16T01:19:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2f29b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4c280d2880 con 0x7f4c280d3320 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2f29b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4c280d2b20 con 0x7f4c280d4c10 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2d037640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c280b5f80 0x7f4c281e8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2d037640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c280b5f80 0x7f4c281e8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54086/0 (socket says 172.21.15.81:54086) 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2d037640 1 -- 172.21.15.81:0/247744629 learned_addr learned my addr 172.21.15.81:0/247744629 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2c836640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280d3320 0x7f4c280b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2d838640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c280d4c10 0x7f4c2815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2d037640 1 -- 172.21.15.81:0/247744629 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c280d4c10 msgr2=0x7f4c2815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2d037640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c280d4c10 0x7f4c2815c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2d037640 1 -- 172.21.15.81:0/247744629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280d3320 msgr2=0x7f4c280b8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2d037640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280d3320 0x7f4c280b8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2d037640 1 -- 172.21.15.81:0/247744629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c280b9500 con 0x7f4c280b5f80 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.653+0000 7f4c2c836640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280d3320 0x7f4c280b8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.654+0000 7f4c2d037640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c280b5f80 0x7f4c281e8ef0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400cf60 tx=0x7f4c2400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.654+0000 7f4c1dffb640 1 -- 172.21.15.81:0/247744629 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2401a070 con 0x7f4c280b5f80 2024-09-16T01:19:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.654+0000 7f4c1dffb640 1 -- 172.21.15.81:0/247744629 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2400d840 con 0x7f4c280b5f80 2024-09-16T01:19:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.654+0000 7f4c1dffb640 1 -- 172.21.15.81:0/247744629 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c2400dc10 con 0x7f4c280b5f80 2024-09-16T01:19:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.654+0000 7f4c2f29b640 1 -- 172.21.15.81:0/247744629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c280b97e0 con 0x7f4c280b5f80 2024-09-16T01:19:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.654+0000 7f4c2f29b640 1 -- 172.21.15.81:0/247744629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c280b9da0 con 0x7f4c280b5f80 2024-09-16T01:19:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.655+0000 7f4c2f29b640 1 -- 172.21.15.81:0/247744629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c280b6360 con 0x7f4c280b5f80 2024-09-16T01:19:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.655+0000 7f4c1dffb640 1 -- 172.21.15.81:0/247744629 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4c2401d070 con 0x7f4c280b5f80 2024-09-16T01:19:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.656+0000 7f4c1dffb640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c0c06c2b0 0x7f4c0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.656+0000 7f4c1dffb640 1 -- 172.21.15.81:0/247744629 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f4c2408bde0 con 0x7f4c280b5f80 2024-09-16T01:19:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.656+0000 7f4c2c836640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c0c06c2b0 0x7f4c0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.656+0000 7f4c2c836640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c0c06c2b0 0x7f4c0c06e770 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4c18034000 tx=0x7f4c1802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.660+0000 7f4c1dffb640 1 -- 172.21.15.81:0/247744629 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c24059d70 con 0x7f4c280b5f80 2024-09-16T01:19:08.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:19:08.722 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:19:08.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.831+0000 7f4c2f29b640 1 -- 172.21.15.81:0/247744629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7f4c280d4480 con 0x7f4c280b5f80 2024-09-16T01:19:08.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.835+0000 7f4c1dffb640 1 -- 172.21.15.81:0/247744629 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v28)=0 v28) ==== 124+0+0 (secure 0 0 0) 0x7f4c2405e070 con 0x7f4c280b5f80 2024-09-16T01:19:08.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.837+0000 7f4c2f29b640 1 -- 172.21.15.81:0/247744629 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c0c06c2b0 msgr2=0x7f4c0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.837+0000 7f4c2f29b640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c0c06c2b0 0x7f4c0c06e770 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4c18034000 tx=0x7f4c1802e000 comp rx=0 tx=0).stop 2024-09-16T01:19:08.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.837+0000 7f4c2f29b640 1 -- 172.21.15.81:0/247744629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c280b5f80 msgr2=0x7f4c281e8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:08.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.837+0000 7f4c2f29b640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c280b5f80 0x7f4c281e8ef0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400cf60 tx=0x7f4c2400cf90 comp rx=0 tx=0).stop 2024-09-16T01:19:08.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.837+0000 7f4c2f29b640 1 -- 172.21.15.81:0/247744629 shutdown_connections 2024-09-16T01:19:08.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.837+0000 7f4c2f29b640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c0c06c2b0 0x7f4c0c06e770 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.837+0000 7f4c2f29b640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c280d4c10 0x7f4c2815c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.837+0000 7f4c2f29b640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c280d3320 0x7f4c280b8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.837+0000 7f4c2f29b640 1 --2- 172.21.15.81:0/247744629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c280b5f80 0x7f4c281e8ef0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.837+0000 7f4c2f29b640 1 -- 172.21.15.81:0/247744629 >> 172.21.15.81:0/247744629 conn(0x7f4c2808bfc0 msgr2=0x7f4c280d3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.837+0000 7f4c2f29b640 1 -- 172.21.15.81:0/247744629 shutdown_connections 2024-09-16T01:19:08.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.837+0000 7f4c2f29b640 1 -- 172.21.15.81:0/247744629 wait complete. 2024-09-16T01:19:08.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-16T01:19:08.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.949+0000 7fb431186640 1 Processor -- start 2024-09-16T01:19:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.949+0000 7fb431186640 1 -- start start 2024-09-16T01:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb431186640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb42c15e6c0 0x7fb42c0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb431186640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb42c0cfcb0 0x7fb42c0b1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb431186640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb42c0d34f0 con 0x7fb42c0d5090 2024-09-16T01:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb431186640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb42c0cf400 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb431186640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb42c0b10d0 con 0x7fb42c15e6c0 2024-09-16T01:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb42b59e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb42c0cfcb0 0x7fb42c0b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb42ad9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb42c15e6c0 0x7fb42c0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb42b59e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb42c0cfcb0 0x7fb42c0b1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:53496/0 (socket says 172.21.15.81:53496) 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb42b59e640 1 -- 172.21.15.81:0/162951638 learned_addr learned my addr 172.21.15.81:0/162951638 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb423fff640 1 --1- 172.21.15.81:0/162951638 >> v1:172.21.15.102:6789/0 conn(0x7fb42c0d5090 0x7fb42c0cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:41470/0 (socket says 172.21.15.81:41470) 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb42b59e640 1 -- 172.21.15.81:0/162951638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb42c15e6c0 msgr2=0x7fb42c0cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb42b59e640 1 --2- 172.21.15.81:0/162951638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb42c15e6c0 0x7fb42c0cebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb42b59e640 1 -- 172.21.15.81:0/162951638 >> v1:172.21.15.102:6789/0 conn(0x7fb42c0d5090 legacy=0x7fb42c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb42b59e640 1 -- 172.21.15.81:0/162951638 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c0d3790 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.950+0000 7fb42a59c640 1 -- 172.21.15.81:0/162951638 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747407916 0 0) 0x7fb42c0d34f0 con 0x7fb42c0d5090 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.951+0000 7fb42b59e640 1 --2- 172.21.15.81:0/162951638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb42c0cfcb0 0x7fb42c0b1540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb424009e50 tx=0x7fb42402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84208595d5c470c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.951+0000 7fb42a59c640 1 -- 172.21.15.81:0/162951638 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424036070 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.951+0000 7fb42a59c640 1 -- 172.21.15.81:0/162951638 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb424031600 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.951+0000 7fb42a59c640 1 -- 172.21.15.81:0/162951638 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4240319d0 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.952+0000 7fb431186640 1 -- 172.21.15.81:0/162951638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb42c0cfcb0 msgr2=0x7fb42c0b1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.952+0000 7fb431186640 1 --2- 172.21.15.81:0/162951638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb42c0cfcb0 0x7fb42c0b1540 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb424009e50 tx=0x7fb42402a5f0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.952+0000 7fb431186640 1 -- 172.21.15.81:0/162951638 shutdown_connections 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.952+0000 7fb431186640 1 --2- 172.21.15.81:0/162951638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb42c0cfcb0 0x7fb42c0b1540 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.952+0000 7fb431186640 1 --2- 172.21.15.81:0/162951638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb42c15e6c0 0x7fb42c0cebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.952+0000 7fb431186640 1 -- 172.21.15.81:0/162951638 >> 172.21.15.81:0/162951638 conn(0x7fb42c08bfc0 msgr2=0x7fb42c0d4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.952+0000 7fb431186640 1 -- 172.21.15.81:0/162951638 shutdown_connections 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.952+0000 7fb431186640 1 -- 172.21.15.81:0/162951638 wait complete. 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.953+0000 7fb431186640 1 Processor -- start 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.953+0000 7fb431186640 1 -- start start 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.954+0000 7fb431186640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb42c0cfcb0 0x7fb42c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.954+0000 7fb431186640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb42c0d5090 0x7fb42c1f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.954+0000 7fb431186640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb42c15e6c0 0x7fb42c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.954+0000 7fb431186640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c15eaa0 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.954+0000 7fb431186640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c0cf0f0 con 0x7fb42c0d5090 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.954+0000 7fb431186640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb42c15ec20 con 0x7fb42c15e6c0 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.954+0000 7fb42ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb42c0cfcb0 0x7fb42c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.954+0000 7fb42ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb42c0cfcb0 0x7fb42c0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54098/0 (socket says 172.21.15.81:54098) 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.954+0000 7fb42ad9d640 1 -- 172.21.15.81:0/1181774288 learned_addr learned my addr 172.21.15.81:0/1181774288 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.954+0000 7fb423fff640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb42c0d5090 0x7fb42c1f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.954+0000 7fb42b59e640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb42c15e6c0 0x7fb42c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.955+0000 7fb42ad9d640 1 -- 172.21.15.81:0/1181774288 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb42c15e6c0 msgr2=0x7fb42c0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.955+0000 7fb42ad9d640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb42c15e6c0 0x7fb42c0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.955+0000 7fb42ad9d640 1 -- 172.21.15.81:0/1181774288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb42c0d5090 msgr2=0x7fb42c1f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.955+0000 7fb42ad9d640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb42c0d5090 0x7fb42c1f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.955+0000 7fb42ad9d640 1 -- 172.21.15.81:0/1181774288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c0cb7d0 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.955+0000 7fb423fff640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb42c0d5090 0x7fb42c1f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.955+0000 7fb42ad9d640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb42c0cfcb0 0x7fb42c0cc590 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00e8a0 tx=0x7fb41c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.955+0000 7fb4237fe640 1 -- 172.21.15.81:0/1181774288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c017070 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.955+0000 7fb4237fe640 1 -- 172.21.15.81:0/1181774288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41c00c940 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.955+0000 7fb4237fe640 1 -- 172.21.15.81:0/1181774288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c00cd30 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.955+0000 7fb431186640 1 -- 172.21.15.81:0/1181774288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42c0cbab0 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.955+0000 7fb431186640 1 -- 172.21.15.81:0/1181774288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42c0cc070 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.956+0000 7fb431186640 1 -- 172.21.15.81:0/1181774288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb42c068e20 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.956+0000 7fb4237fe640 1 -- 172.21.15.81:0/1181774288 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb41c01a070 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.957+0000 7fb4237fe640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb40c06c2b0 0x7fb40c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.957+0000 7fb4237fe640 1 -- 172.21.15.81:0/1181774288 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fb41c08b760 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.957+0000 7fb423fff640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb40c06c2b0 0x7fb40c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.957+0000 7fb423fff640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb40c06c2b0 0x7fb40c06e770 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb42c1f76d0 tx=0x7fb414007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:08.961+0000 7fb4237fe640 1 -- 172.21.15.81:0/1181774288 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb42c068e20 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.128+0000 7fb431186640 1 -- 172.21.15.81:0/1181774288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7fb42c0cebb0 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.128+0000 7fb4237fe640 1 -- 172.21.15.81:0/1181774288 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v28) ==== 106+0+4 (secure 0 0 0) 0x7fb41c0596f0 con 0x7fb42c0cfcb0 2024-09-16T01:19:09.131 INFO:teuthology.orchestra.run.smithi081.stdout:100 2024-09-16T01:19:09.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.130+0000 7fb431186640 1 -- 172.21.15.81:0/1181774288 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb40c06c2b0 msgr2=0x7fb40c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.130+0000 7fb431186640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb40c06c2b0 0x7fb40c06e770 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb42c1f76d0 tx=0x7fb414007de0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.130+0000 7fb431186640 1 -- 172.21.15.81:0/1181774288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb42c0cfcb0 msgr2=0x7fb42c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.130+0000 7fb431186640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb42c0cfcb0 0x7fb42c0cc590 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00e8a0 tx=0x7fb41c00ed60 comp rx=0 tx=0).stop 2024-09-16T01:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.130+0000 7fb431186640 1 -- 172.21.15.81:0/1181774288 shutdown_connections 2024-09-16T01:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.130+0000 7fb431186640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb40c06c2b0 0x7fb40c06e770 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.130+0000 7fb431186640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb42c15e6c0 0x7fb42c0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.130+0000 7fb431186640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb42c0d5090 0x7fb42c1f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.130+0000 7fb431186640 1 --2- 172.21.15.81:0/1181774288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb42c0cfcb0 0x7fb42c0cc590 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.130+0000 7fb431186640 1 -- 172.21.15.81:0/1181774288 >> 172.21.15.81:0/1181774288 conn(0x7fb42c08bfc0 msgr2=0x7fb42c0cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.130+0000 7fb431186640 1 -- 172.21.15.81:0/1181774288 shutdown_connections 2024-09-16T01:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.130+0000 7fb431186640 1 -- 172.21.15.81:0/1181774288 wait complete. 2024-09-16T01:19:09.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-09-16T01:19:09.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.242+0000 7f6db3766640 1 Processor -- start 2024-09-16T01:19:09.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.242+0000 7f6db3766640 1 -- start start 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.243+0000 7f6db3766640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6dac158b50 0x7f6dac0b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.243+0000 7f6db3766640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dac0b6820 con 0x7f6dac0b6360 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.243+0000 7f6db3766640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dac0b6b00 con 0x7f6dac09b140 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.243+0000 7f6db3766640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6dac0b6de0 con 0x7f6dac158b50 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.243+0000 7f6db0d01640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6dac0b6360 0x7f6dac09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49604/0 (socket says 172.21.15.81:49604) 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.243+0000 7f6db0d01640 1 -- 172.21.15.81:0/964086625 learned_addr learned my addr 172.21.15.81:0/964086625 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.243+0000 7f6db1502640 1 --2- 172.21.15.81:0/964086625 >> v2:172.21.15.102:3300/0 conn(0x7f6dac158b50 0x7f6dac0b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.244+0000 7f6da3fff640 1 -- 172.21.15.81:0/964086625 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270587202 0 0) 0x7f6dac0b6820 con 0x7f6dac0b6360 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.244+0000 7f6da3fff640 1 -- 172.21.15.81:0/964086625 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d98003520 con 0x7f6dac0b6360 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.244+0000 7f6da3fff640 1 -- 172.21.15.81:0/964086625 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4032838841 0 0) 0x7f6dac0b6b00 con 0x7f6dac09b140 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.244+0000 7f6da3fff640 1 -- 172.21.15.81:0/964086625 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dac0b6820 con 0x7f6dac09b140 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.244+0000 7f6da3fff640 1 -- 172.21.15.81:0/964086625 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2663929636 0 0) 0x7f6d98003520 con 0x7f6dac0b6360 2024-09-16T01:19:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.244+0000 7f6db1502640 1 -- 172.21.15.81:0/964086625 >> v1:172.21.15.102:6789/0 conn(0x7f6dac09b140 legacy=0x7f6dac06fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.244+0000 7f6db1502640 1 -- 172.21.15.81:0/964086625 >> v1:172.21.15.81:6789/0 conn(0x7f6dac0b6360 legacy=0x7f6dac09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.244+0000 7f6db1502640 1 -- 172.21.15.81:0/964086625 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac0b70c0 con 0x7f6dac158b50 2024-09-16T01:19:09.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.245+0000 7f6db1502640 1 --2- 172.21.15.81:0/964086625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac158b50 0x7f6dac0b5e20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6da80097a0 tx=0x7f6da802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e372059c97d8702d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:09.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.245+0000 7f6da3fff640 1 -- 172.21.15.81:0/964086625 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8037070 con 0x7f6dac158b50 2024-09-16T01:19:09.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.245+0000 7f6da3fff640 1 -- 172.21.15.81:0/964086625 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da802abc0 con 0x7f6dac158b50 2024-09-16T01:19:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.245+0000 7f6da3fff640 1 -- 172.21.15.81:0/964086625 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c001670 con 0x7f6dac158b50 2024-09-16T01:19:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.245+0000 7f6db3766640 1 -- 172.21.15.81:0/964086625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac158b50 msgr2=0x7f6dac0b5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.245+0000 7f6db3766640 1 --2- 172.21.15.81:0/964086625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac158b50 0x7f6dac0b5e20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6da80097a0 tx=0x7f6da802a130 comp rx=0 tx=0).stop 2024-09-16T01:19:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.245+0000 7f6db3766640 1 -- 172.21.15.81:0/964086625 shutdown_connections 2024-09-16T01:19:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.245+0000 7f6db3766640 1 --2- 172.21.15.81:0/964086625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac158b50 0x7f6dac0b5e20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.245+0000 7f6db3766640 1 -- 172.21.15.81:0/964086625 >> 172.21.15.81:0/964086625 conn(0x7f6dac0b79e0 msgr2=0x7f6dac0b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.246+0000 7f6db3766640 1 -- 172.21.15.81:0/964086625 shutdown_connections 2024-09-16T01:19:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.246+0000 7f6db3766640 1 -- 172.21.15.81:0/964086625 wait complete. 2024-09-16T01:19:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.247+0000 7f6db3766640 1 Processor -- start 2024-09-16T01:19:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.247+0000 7f6db3766640 1 -- start start 2024-09-16T01:19:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.247+0000 7f6db3766640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac09b140 0x7f6dac0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.247+0000 7f6db3766640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac0b6360 0x7f6dac0b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.247+0000 7f6db3766640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6dac158b50 0x7f6dac156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.247+0000 7f6db3766640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac15f950 con 0x7f6dac0b6360 2024-09-16T01:19:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.247+0000 7f6db3766640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6dac0b7430 con 0x7f6dac09b140 2024-09-16T01:19:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.247+0000 7f6db3766640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6dac15fad0 con 0x7f6dac158b50 2024-09-16T01:19:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db0d01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac0b6360 0x7f6dac0b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db0d01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac0b6360 0x7f6dac0b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54100/0 (socket says 172.21.15.81:54100) 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db0d01640 1 -- 172.21.15.81:0/2853088079 learned_addr learned my addr 172.21.15.81:0/2853088079 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db1502640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac09b140 0x7f6dac0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db1d03640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6dac158b50 0x7f6dac156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db0d01640 1 -- 172.21.15.81:0/2853088079 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6dac158b50 msgr2=0x7f6dac156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db0d01640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6dac158b50 0x7f6dac156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db0d01640 1 -- 172.21.15.81:0/2853088079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac09b140 msgr2=0x7f6dac0b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db0d01640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac09b140 0x7f6dac0b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db0d01640 1 -- 172.21.15.81:0/2853088079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dac1f4120 con 0x7f6dac0b6360 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db1502640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac09b140 0x7f6dac0b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db0d01640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac0b6360 0x7f6dac0b0810 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c000fd0 tx=0x7f6d9c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6da1ffb640 1 -- 172.21.15.81:0/2853088079 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c017070 con 0x7f6dac0b6360 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6da1ffb640 1 -- 172.21.15.81:0/2853088079 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9c005ad0 con 0x7f6dac0b6360 2024-09-16T01:19:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db3766640 1 -- 172.21.15.81:0/2853088079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dac157bd0 con 0x7f6dac0b6360 2024-09-16T01:19:09.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6da1ffb640 1 -- 172.21.15.81:0/2853088079 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c007070 con 0x7f6dac0b6360 2024-09-16T01:19:09.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.248+0000 7f6db3766640 1 -- 172.21.15.81:0/2853088079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dac1f4690 con 0x7f6dac0b6360 2024-09-16T01:19:09.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.249+0000 7f6db3766640 1 -- 172.21.15.81:0/2853088079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dac0b5e20 con 0x7f6dac0b6360 2024-09-16T01:19:09.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.250+0000 7f6da1ffb640 1 -- 172.21.15.81:0/2853088079 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6d9c01a070 con 0x7f6dac0b6360 2024-09-16T01:19:09.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.250+0000 7f6da1ffb640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6d9006c2b0 0x7f6d9006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.250+0000 7f6da1ffb640 1 -- 172.21.15.81:0/2853088079 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f6d9c08a940 con 0x7f6dac0b6360 2024-09-16T01:19:09.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.250+0000 7f6db1502640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6d9006c2b0 0x7f6d9006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.251+0000 7f6db1502640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6d9006c2b0 0x7f6d9006e770 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6da8034000 tx=0x7f6da802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:09.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.254+0000 7f6da1ffb640 1 -- 172.21.15.81:0/2853088079 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d9c0588d0 con 0x7f6dac0b6360 2024-09-16T01:19:09.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.419+0000 7f6db3766640 1 -- 172.21.15.81:0/2853088079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7f6dac155870 con 0x7f6dac0b6360 2024-09-16T01:19:09.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.419+0000 7f6da1ffb640 1 -- 172.21.15.81:0/2853088079 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v28) ==== 112+0+10 (secure 0 0 0) 0x7f6d9c05cbd0 con 0x7f6dac0b6360 2024-09-16T01:19:09.421 INFO:teuthology.orchestra.run.smithi081.stdout:60.000000 2024-09-16T01:19:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.421+0000 7f6db3766640 1 -- 172.21.15.81:0/2853088079 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6d9006c2b0 msgr2=0x7f6d9006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.421+0000 7f6db3766640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6d9006c2b0 0x7f6d9006e770 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6da8034000 tx=0x7f6da802e000 comp rx=0 tx=0).stop 2024-09-16T01:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.421+0000 7f6db3766640 1 -- 172.21.15.81:0/2853088079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac0b6360 msgr2=0x7f6dac0b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.421+0000 7f6db3766640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac0b6360 0x7f6dac0b0810 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c000fd0 tx=0x7f6d9c00cbe0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.421+0000 7f6db3766640 1 -- 172.21.15.81:0/2853088079 shutdown_connections 2024-09-16T01:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.421+0000 7f6db3766640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6d9006c2b0 0x7f6d9006e770 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.421+0000 7f6db3766640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6dac158b50 0x7f6dac156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.421+0000 7f6db3766640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dac0b6360 0x7f6dac0b0810 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.421+0000 7f6db3766640 1 --2- 172.21.15.81:0/2853088079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dac09b140 0x7f6dac0b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.421+0000 7f6db3766640 1 -- 172.21.15.81:0/2853088079 >> 172.21.15.81:0/2853088079 conn(0x7f6dac0b79e0 msgr2=0x7f6dac161700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.421+0000 7f6db3766640 1 -- 172.21.15.81:0/2853088079 shutdown_connections 2024-09-16T01:19:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.421+0000 7f6db3766640 1 -- 172.21.15.81:0/2853088079 wait complete. 2024-09-16T01:19:09.434 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:19:09.434 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:19:09.450 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:19:09.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:19:09.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:19:09.546 INFO:teuthology.orchestra.run.smithi081.stdout:client5510 2024-09-16T01:19:09.546 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:19:09.546 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:19:09.562 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-16T01:19:09.562 DEBUG:teuthology.orchestra.run.smithi081:> import fcntl 2024-09-16T01:19:09.562 DEBUG:teuthology.orchestra.run.smithi081:> import sys 2024-09-16T01:19:09.562 DEBUG:teuthology.orchestra.run.smithi081:> import time 2024-09-16T01:19:09.562 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-16T01:19:09.562 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:19:09.562 DEBUG:teuthology.orchestra.run.smithi081:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-16T01:19:09.562 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:19:09.562 DEBUG:teuthology.orchestra.run.smithi081:> n = 400 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> abs_path = "/home/ubuntu/cephtest/mnt.0/subdir" 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> if not os.path.exists(abs_path): 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> os.makedirs(abs_path) 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> handles = [] 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> for i in range(0, n): 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> fname = "file_"+str(i) 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> path = os.path.join(abs_path, fname) 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> handles.append(open(path, '"'"'w'"'"')) 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> print("waiting with handles open", file=sys.stderr) 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> while True: 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> print("open_n_background: keeping files open", file=sys.stderr) 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-16T01:19:09.563 DEBUG:teuthology.orchestra.run.smithi081:> if os.read(0, 4096) == b"": 2024-09-16T01:19:09.564 DEBUG:teuthology.orchestra.run.smithi081:> break 2024-09-16T01:19:09.564 DEBUG:teuthology.orchestra.run.smithi081:> except BlockingIOError: 2024-09-16T01:19:09.564 DEBUG:teuthology.orchestra.run.smithi081:> pass 2024-09-16T01:19:09.564 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(2) 2024-09-16T01:19:09.564 DEBUG:teuthology.orchestra.run.smithi081:> print("stdin closed, goodbye!", file=sys.stderr) 2024-09-16T01:19:09.564 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-16T01:19:09.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:19:09.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.703+0000 7fd4fa8e6640 1 Processor -- start 2024-09-16T01:19:09.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.703+0000 7fd4fa8e6640 1 -- start start 2024-09-16T01:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.704+0000 7fd4fa8e6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f415e710 0x7fd4f40d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.704+0000 7fd4fa8e6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f40d2170 con 0x7fd4f40b6010 2024-09-16T01:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.704+0000 7fd4fa8e6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f40d2410 con 0x7fd4f40cfb60 2024-09-16T01:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.704+0000 7fd4fa8e6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f40d2d20 con 0x7fd4f415e710 2024-09-16T01:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.704+0000 7fd4f8e83640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd4f40b6010 0x7fd4f406ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49608/0 (socket says 172.21.15.81:49608) 2024-09-16T01:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.704+0000 7fd4f8e83640 1 -- 172.21.15.81:0/3111472090 learned_addr learned my addr 172.21.15.81:0/3111472090 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.704+0000 7fd4f3fff640 1 --2- 172.21.15.81:0/3111472090 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f415e710 0x7fd4f40d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.705+0000 7fd4f2ffd640 1 -- 172.21.15.81:0/3111472090 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1118291722 0 0) 0x7fd4f40d2170 con 0x7fd4f40b6010 2024-09-16T01:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.705+0000 7fd4f2ffd640 1 -- 172.21.15.81:0/3111472090 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4dc003520 con 0x7fd4f40b6010 2024-09-16T01:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.705+0000 7fd4f2ffd640 1 -- 172.21.15.81:0/3111472090 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4102115603 0 0) 0x7fd4f40d2410 con 0x7fd4f40cfb60 2024-09-16T01:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.705+0000 7fd4f2ffd640 1 -- 172.21.15.81:0/3111472090 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4f40d2170 con 0x7fd4f40cfb60 2024-09-16T01:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.705+0000 7fd4f2ffd640 1 -- 172.21.15.81:0/3111472090 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2778394509 0 0) 0x7fd4dc003520 con 0x7fd4f40b6010 2024-09-16T01:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.705+0000 7fd4f3fff640 1 -- 172.21.15.81:0/3111472090 >> v1:172.21.15.102:6789/0 conn(0x7fd4f40cfb60 legacy=0x7fd4f40cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.705+0000 7fd4f3fff640 1 -- 172.21.15.81:0/3111472090 >> v1:172.21.15.81:6789/0 conn(0x7fd4f40b6010 legacy=0x7fd4f406ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.705+0000 7fd4f3fff640 1 -- 172.21.15.81:0/3111472090 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f40d5240 con 0x7fd4f415e710 2024-09-16T01:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.706+0000 7fd4f3fff640 1 --2- 172.21.15.81:0/3111472090 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f415e710 0x7fd4f40d31b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40097d0 tx=0x7fd4e402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f29aae54c7efae8f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.706+0000 7fd4f2ffd640 1 -- 172.21.15.81:0/3111472090 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4037070 con 0x7fd4f415e710 2024-09-16T01:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.706+0000 7fd4f2ffd640 1 -- 172.21.15.81:0/3111472090 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e402ac30 con 0x7fd4f415e710 2024-09-16T01:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.706+0000 7fd4f2ffd640 1 -- 172.21.15.81:0/3111472090 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0019f0 con 0x7fd4f415e710 2024-09-16T01:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.707+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3111472090 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f415e710 msgr2=0x7fd4f40d31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.707+0000 7fd4fa8e6640 1 --2- 172.21.15.81:0/3111472090 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f415e710 0x7fd4f40d31b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40097d0 tx=0x7fd4e402a1a0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.707+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3111472090 shutdown_connections 2024-09-16T01:19:09.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.707+0000 7fd4fa8e6640 1 --2- 172.21.15.81:0/3111472090 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f415e710 0x7fd4f40d31b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.707+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3111472090 >> 172.21.15.81:0/3111472090 conn(0x7fd4f408bfc0 msgr2=0x7fd4f40d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:09.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.707+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3111472090 shutdown_connections 2024-09-16T01:19:09.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.707+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3111472090 wait complete. 2024-09-16T01:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.708+0000 7fd4fa8e6640 1 Processor -- start 2024-09-16T01:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.708+0000 7fd4fa8e6640 1 -- start start 2024-09-16T01:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4fa8e6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f40b6010 0x7fd4f4158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4fa8e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f40cfb60 0x7fd4f4158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4fa8e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4f415e710 0x7fd4f40b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4fa8e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f40b64a0 con 0x7fd4f40cfb60 2024-09-16T01:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4fa8e6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f40d29b0 con 0x7fd4f415e710 2024-09-16T01:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4fa8e6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f40b6620 con 0x7fd4f40b6010 2024-09-16T01:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f40cfb60 0x7fd4f4158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f40cfb60 0x7fd4f4158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54110/0 (socket says 172.21.15.81:54110) 2024-09-16T01:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4f37fe640 1 -- 172.21.15.81:0/3895382332 learned_addr learned my addr 172.21.15.81:0/3895382332 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4f8e83640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4f415e710 0x7fd4f40b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4f3fff640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f40b6010 0x7fd4f4158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4f37fe640 1 -- 172.21.15.81:0/3895382332 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f40b6010 msgr2=0x7fd4f4158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4f37fe640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f40b6010 0x7fd4f4158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4f37fe640 1 -- 172.21.15.81:0/3895382332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4f415e710 msgr2=0x7fd4f40b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4f37fe640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4f415e710 0x7fd4f40b8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4f37fe640 1 -- 172.21.15.81:0/3895382332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f40b9370 con 0x7fd4f40cfb60 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.709+0000 7fd4f37fe640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f40cfb60 0x7fd4f4158140 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800c530 tx=0x7fd4e800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.710+0000 7fd4f0ff9640 1 -- 172.21.15.81:0/3895382332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e80052d0 con 0x7fd4f40cfb60 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.710+0000 7fd4f0ff9640 1 -- 172.21.15.81:0/3895382332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e8005470 con 0x7fd4f40cfb60 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.710+0000 7fd4f0ff9640 1 -- 172.21.15.81:0/3895382332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8003880 con 0x7fd4f40cfb60 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.710+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3895382332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f40b9610 con 0x7fd4f40cfb60 2024-09-16T01:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.710+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3895382332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f415ed40 con 0x7fd4f40cfb60 2024-09-16T01:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.711+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3895382332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f40ce9c0 con 0x7fd4f40cfb60 2024-09-16T01:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.711+0000 7fd4f0ff9640 1 -- 172.21.15.81:0/3895382332 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd4e8003a20 con 0x7fd4f40cfb60 2024-09-16T01:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.712+0000 7fd4f0ff9640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4e006c2b0 0x7fd4e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.712+0000 7fd4f0ff9640 1 -- 172.21.15.81:0/3895382332 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fd4e808b260 con 0x7fd4f40cfb60 2024-09-16T01:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.712+0000 7fd4f3fff640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4e006c2b0 0x7fd4e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.712+0000 7fd4f3fff640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4e006c2b0 0x7fd4e006e770 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4034000 tx=0x7fd4e402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.716+0000 7fd4f0ff9640 1 -- 172.21.15.81:0/3895382332 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4e80591a0 con 0x7fd4f40cfb60 2024-09-16T01:19:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.930+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3895382332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4f40b6cf0 con 0x7fd4f40cfb60 2024-09-16T01:19:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.930+0000 7fd4f0ff9640 1 -- 172.21.15.81:0/3895382332 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5228 (secure 0 0 0) 0x7fd4e805d4a0 con 0x7fd4f40cfb60 2024-09-16T01:19:09.932 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:09.932 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":43,"btime":"2024-09-16T01:19:02:921518+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3998032766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3998032766},{"type":"v1","addr":"172.21.15.102:6835","nonce":3998032766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5794,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/978156526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":978156526},{"type":"v1","addr":"172.21.15.102:6834","nonce":978156526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6384,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1184176189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1184176189},{"type":"v1","addr":"172.21.15.81:6836","nonce":1184176189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:59.261790+0000","modified":"2024-09-16T01:19:02.182262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2778062051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2778062051},{"type":"v1","addr":"172.21.15.81:6837","nonce":2778062051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-16T01:19:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 43 2024-09-16T01:19:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.932+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3895382332 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4e006c2b0 msgr2=0x7fd4e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.932+0000 7fd4fa8e6640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4e006c2b0 0x7fd4e006e770 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4034000 tx=0x7fd4e402e000 comp rx=0 tx=0).stop 2024-09-16T01:19:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.932+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3895382332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f40cfb60 msgr2=0x7fd4f4158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.932+0000 7fd4fa8e6640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f40cfb60 0x7fd4f4158140 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800c530 tx=0x7fd4e800c9f0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.932+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3895382332 shutdown_connections 2024-09-16T01:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.932+0000 7fd4fa8e6640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4e006c2b0 0x7fd4e006e770 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.932+0000 7fd4fa8e6640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4f415e710 0x7fd4f40b8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.932+0000 7fd4fa8e6640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4f40cfb60 0x7fd4f4158140 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.932+0000 7fd4fa8e6640 1 --2- 172.21.15.81:0/3895382332 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4f40b6010 0x7fd4f4158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.932+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3895382332 >> 172.21.15.81:0/3895382332 conn(0x7fd4f408bfc0 msgr2=0x7fd4f40d3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.932+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3895382332 shutdown_connections 2024-09-16T01:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:09.932+0000 7fd4fa8e6640 1 -- 172.21.15.81:0/3895382332 wait complete. 2024-09-16T01:19:09.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-16T01:19:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:waiting with handles open 2024-09-16T01:19:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:10.066 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5519,"entity":{"name":{"type":"client","num":5519},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":2090814879}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":2.590947796,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9922371007427433,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5519 v1:192.168.0.1:0/2090814879","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi102","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":5510,"entity":{"name":{"type":"client","num":5510},"addr":{"type":"v1","addr":"172.21.15.81:0","nonce":549791260}},"state":"open","num_leases":1,"num_caps":402,"request_load_avg":426,"uptime":3.7069253099999999,"requests_in_flight":400,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":168.75418596703767,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":159.44125146838525,"halflife":1.5},"recall_caps_throttle2o":{"value":141.91512181972266,"halflife":0.5},"session_cache_liveness":{"value":804.61923297209728,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.5510 v1:172.21.15.81:0/549791260","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi081","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-16T01:19:10.067 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi102", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2090814879, "type": "v1" }, "name": { "num": 5519, "type": "client" } }, "id": 5519, "inst": "client.5519 v1:192.168.0.1:0/2090814879", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9922371007427433 }, "state": "open", "uptime": 2.590947796 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi081", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 549791260, "type": "v1" }, "name": { "num": 5510, "type": "client" } }, "id": 5510, "inst": "client.5510 v1:172.21.15.81:0/549791260", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 402, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 168.75418596703767 }, "recall_caps_throttle": { "halflife": 1.5, "value": 159.44125146838525 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 141.91512181972266 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 426, "requests_in_flight": 400, "session_cache_liveness": { "halflife": 300, "value": 804.6192329720973 }, "state": "open", "uptime": 3.70692531 } ] 2024-09-16T01:19:10.067 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-09-16T01:19:10.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:19:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.161+0000 7fdf7f10a640 1 Processor -- start 2024-09-16T01:19:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.162+0000 7fdf7f10a640 1 -- start start 2024-09-16T01:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.162+0000 7fdf7f10a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf78072320 0x7fdf780cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.162+0000 7fdf7f10a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf78146140 con 0x7fdf7815e1f0 2024-09-16T01:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.162+0000 7fdf7f10a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf7806eed0 con 0x7fdf78072de0 2024-09-16T01:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.162+0000 7fdf7f10a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdf780cd740 con 0x7fdf78072320 2024-09-16T01:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.162+0000 7fdf7d6a7640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdf7815e1f0 0x7fdf7806e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49624/0 (socket says 172.21.15.81:49624) 2024-09-16T01:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf7d6a7640 1 -- 172.21.15.81:0/276620020 learned_addr learned my addr 172.21.15.81:0/276620020 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf7cea6640 1 --2- 172.21.15.81:0/276620020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf78072320 0x7fdf780cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1502722114 0 0) 0x7fdf78146140 con 0x7fdf7815e1f0 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf68003520 con 0x7fdf7815e1f0 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 24547518 0 0) 0x7fdf68003520 con 0x7fdf7815e1f0 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf78072320 msgr2=0x7fdf780cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 --2- 172.21.15.81:0/276620020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf78072320 0x7fdf780cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 >> v1:172.21.15.102:6789/0 conn(0x7fdf78072de0 legacy=0x7fdf7806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf780cda20 con 0x7fdf7815e1f0 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fdf700019f0 con 0x7fdf7815e1f0 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 >> v1:172.21.15.81:6789/0 conn(0x7fdf7815e1f0 legacy=0x7fdf7806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 --2- 172.21.15.81:0/276620020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf78072320 0x7fdf680039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 --2- 172.21.15.81:0/276620020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68003f20 0x7fdf68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 --2- 172.21.15.81:0/276620020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf68004d40 0x7fdf680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdf780cd740 con 0x7fdf68004d40 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6800bad0 con 0x7fdf68003f20 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdf6800bcd0 con 0x7fdf78072320 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf7d6a7640 1 --2- 172.21.15.81:0/276620020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf68004d40 0x7fdf680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf7cea6640 1 --2- 172.21.15.81:0/276620020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf78072320 0x7fdf680039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.163+0000 7fdf77fff640 1 --2- 172.21.15.81:0/276620020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68003f20 0x7fdf68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.164+0000 7fdf7d6a7640 1 -- 172.21.15.81:0/276620020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf78072320 msgr2=0x7fdf680039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.164+0000 7fdf7d6a7640 1 --2- 172.21.15.81:0/276620020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf78072320 0x7fdf680039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.164+0000 7fdf7d6a7640 1 -- 172.21.15.81:0/276620020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68003f20 msgr2=0x7fdf68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.164+0000 7fdf7d6a7640 1 --2- 172.21.15.81:0/276620020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68003f20 0x7fdf68004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.164+0000 7fdf7d6a7640 1 -- 172.21.15.81:0/276620020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf68003520 con 0x7fdf68004d40 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.164+0000 7fdf7d6a7640 1 --2- 172.21.15.81:0/276620020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf68004d40 0x7fdf680051c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000a850 tx=0x7fdf68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36879e55293a4073 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.164+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7000a4a0 con 0x7fdf68004d40 2024-09-16T01:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.164+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7002f070 con 0x7fdf68004d40 2024-09-16T01:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.164+0000 7fdf777fe640 1 -- 172.21.15.81:0/276620020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7002bcf0 con 0x7fdf68004d40 2024-09-16T01:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.165+0000 7fdf7f10a640 1 -- 172.21.15.81:0/276620020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf68004d40 msgr2=0x7fdf680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.165+0000 7fdf7f10a640 1 --2- 172.21.15.81:0/276620020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf68004d40 0x7fdf680051c0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000a850 tx=0x7fdf68005830 comp rx=0 tx=0).stop 2024-09-16T01:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.165+0000 7fdf7d6a7640 1 -- 172.21.15.81:0/276620020 reap_dead start 2024-09-16T01:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.165+0000 7fdf7f10a640 1 -- 172.21.15.81:0/276620020 shutdown_connections 2024-09-16T01:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.165+0000 7fdf7f10a640 1 -- 172.21.15.81:0/276620020 >> 172.21.15.81:0/276620020 conn(0x7fdf78067d70 msgr2=0x7fdf7806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.165+0000 7fdf7f10a640 1 -- 172.21.15.81:0/276620020 shutdown_connections 2024-09-16T01:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.165+0000 7fdf7f10a640 1 -- 172.21.15.81:0/276620020 wait complete. 2024-09-16T01:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.166+0000 7fdf7f10a640 1 Processor -- start 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.166+0000 7fdf7f10a640 1 -- start start 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf7f10a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68004d40 0x7fdf78143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf7f10a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf781443d0 0x7fdf780c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf7f10a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf780cba30 0x7fdf780b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf7f10a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdf78072700 con 0x7fdf781443d0 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf7f10a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7815c9e0 con 0x7fdf68004d40 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf7f10a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdf78072880 con 0x7fdf780cba30 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf77fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf781443d0 0x7fdf780c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf77fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf781443d0 0x7fdf780c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54124/0 (socket says 172.21.15.81:54124) 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf77fff640 1 -- 172.21.15.81:0/1630416885 learned_addr learned my addr 172.21.15.81:0/1630416885 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf77fff640 1 -- 172.21.15.81:0/1630416885 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf780cba30 msgr2=0x7fdf780b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf7d6a7640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf780cba30 0x7fdf780b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf7cea6640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68004d40 0x7fdf78143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf77fff640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf780cba30 0x7fdf780b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf77fff640 1 -- 172.21.15.81:0/1630416885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68004d40 msgr2=0x7fdf78143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf77fff640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68004d40 0x7fdf78143380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf77fff640 1 -- 172.21.15.81:0/1630416885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf780a9610 con 0x7fdf781443d0 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.167+0000 7fdf7cea6640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68004d40 0x7fdf78143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.168+0000 7fdf77fff640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf781443d0 0x7fdf780c8db0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400f750 tx=0x7fdf6400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.168+0000 7fdf757fa640 1 -- 172.21.15.81:0/1630416885 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf640050d0 con 0x7fdf781443d0 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.168+0000 7fdf757fa640 1 -- 172.21.15.81:0/1630416885 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf64018070 con 0x7fdf781443d0 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.168+0000 7fdf7f10a640 1 -- 172.21.15.81:0/1630416885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf780ab4d0 con 0x7fdf781443d0 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.168+0000 7fdf757fa640 1 -- 172.21.15.81:0/1630416885 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf6400d6d0 con 0x7fdf781443d0 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.168+0000 7fdf7f10a640 1 -- 172.21.15.81:0/1630416885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf780aba90 con 0x7fdf781443d0 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.169+0000 7fdf7f10a640 1 -- 172.21.15.81:0/1630416885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf780cce60 con 0x7fdf781443d0 2024-09-16T01:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.169+0000 7fdf757fa640 1 -- 172.21.15.81:0/1630416885 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdf6400d870 con 0x7fdf781443d0 2024-09-16T01:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.170+0000 7fdf757fa640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdf5c06c2e0 0x7fdf5c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.170+0000 7fdf757fa640 1 -- 172.21.15.81:0/1630416885 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fdf6408b480 con 0x7fdf781443d0 2024-09-16T01:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.170+0000 7fdf7cea6640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdf5c06c2e0 0x7fdf5c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.170+0000 7fdf7cea6640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdf5c06c2e0 0x7fdf5c06e7a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009ab0 tx=0x7fdf6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.174+0000 7fdf757fa640 1 -- 172.21.15.81:0/1630416885 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf64059a60 con 0x7fdf781443d0 2024-09-16T01:19:10.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.371+0000 7fdf7f10a640 1 -- 172.21.15.81:0/1630416885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdf780a97e0 con 0x7fdf781443d0 2024-09-16T01:19:10.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.372+0000 7fdf757fa640 1 -- 172.21.15.81:0/1630416885 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fdf6401be40 con 0x7fdf781443d0 2024-09-16T01:19:10.374 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:10.374 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T01:19:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.374+0000 7fdf7f10a640 1 -- 172.21.15.81:0/1630416885 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdf5c06c2e0 msgr2=0x7fdf5c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.374+0000 7fdf7f10a640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdf5c06c2e0 0x7fdf5c06e7a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009ab0 tx=0x7fdf6c008040 comp rx=0 tx=0).stop 2024-09-16T01:19:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.374+0000 7fdf7f10a640 1 -- 172.21.15.81:0/1630416885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf781443d0 msgr2=0x7fdf780c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.374+0000 7fdf7f10a640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf781443d0 0x7fdf780c8db0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400f750 tx=0x7fdf6400fc10 comp rx=0 tx=0).stop 2024-09-16T01:19:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.374+0000 7fdf7f10a640 1 -- 172.21.15.81:0/1630416885 shutdown_connections 2024-09-16T01:19:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.374+0000 7fdf7f10a640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdf5c06c2e0 0x7fdf5c06e7a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.374+0000 7fdf7f10a640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf780cba30 0x7fdf780b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.374+0000 7fdf7f10a640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf781443d0 0x7fdf780c8db0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.374+0000 7fdf7f10a640 1 --2- 172.21.15.81:0/1630416885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf68004d40 0x7fdf78143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.374+0000 7fdf7f10a640 1 -- 172.21.15.81:0/1630416885 >> 172.21.15.81:0/1630416885 conn(0x7fdf78067d70 msgr2=0x7fdf780b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:10.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.374+0000 7fdf7f10a640 1 -- 172.21.15.81:0/1630416885 shutdown_connections 2024-09-16T01:19:10.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:10.374+0000 7fdf7f10a640 1 -- 172.21.15.81:0/1630416885 wait complete. 2024-09-16T01:19:10.387 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2024-09-16T01:19:10.387 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:19:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:14.025 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:15.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:19:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.496+0000 7f6f2f280640 1 Processor -- start 2024-09-16T01:19:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.496+0000 7f6f2f280640 1 -- start start 2024-09-16T01:19:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.497+0000 7f6f2f280640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6f28145e00 0x7f6f280cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.497+0000 7f6f2f280640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f280af720 con 0x7f6f280d0be0 2024-09-16T01:19:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.497+0000 7f6f2f280640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2815d8f0 con 0x7f6f2815d460 2024-09-16T01:19:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.497+0000 7f6f2f280640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6f281461e0 con 0x7f6f28145e00 2024-09-16T01:19:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.497+0000 7f6f2d81d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6f280d0be0 0x7f6f280afc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50682/0 (socket says 172.21.15.81:50682) 2024-09-16T01:19:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.497+0000 7f6f2d81d640 1 -- 172.21.15.81:0/2668146560 learned_addr learned my addr 172.21.15.81:0/2668146560 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.497+0000 7f6f2d01c640 1 --2- 172.21.15.81:0/2668146560 >> v2:172.21.15.102:3300/0 conn(0x7f6f28145e00 0x7f6f280cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.497+0000 7f6f1ffff640 1 -- 172.21.15.81:0/2668146560 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023736377 0 0) 0x7f6f280af720 con 0x7f6f280d0be0 2024-09-16T01:19:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.497+0000 7f6f1ffff640 1 -- 172.21.15.81:0/2668146560 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f14003520 con 0x7f6f280d0be0 2024-09-16T01:19:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.497+0000 7f6f1ffff640 1 -- 172.21.15.81:0/2668146560 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380699944 0 0) 0x7f6f2815d8f0 con 0x7f6f2815d460 2024-09-16T01:19:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.497+0000 7f6f1ffff640 1 -- 172.21.15.81:0/2668146560 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f280af720 con 0x7f6f2815d460 2024-09-16T01:19:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.497+0000 7f6f2d01c640 1 -- 172.21.15.81:0/2668146560 >> v1:172.21.15.102:6789/0 conn(0x7f6f2815d460 legacy=0x7f6f280d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.498+0000 7f6f1ffff640 1 -- 172.21.15.81:0/2668146560 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1373385877 0 0) 0x7f6f14003520 con 0x7f6f280d0be0 2024-09-16T01:19:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.498+0000 7f6f2d01c640 1 -- 172.21.15.81:0/2668146560 >> v1:172.21.15.81:6789/0 conn(0x7f6f280d0be0 legacy=0x7f6f280afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.498+0000 7f6f2d01c640 1 -- 172.21.15.81:0/2668146560 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f280cdf90 con 0x7f6f28145e00 2024-09-16T01:19:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.498+0000 7f6f2d01c640 1 --2- 172.21.15.81:0/2668146560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f28145e00 0x7f6f280cd8a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6f240097a0 tx=0x7f6f2402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0ad97b126d0d2b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.498+0000 7f6f1ffff640 1 -- 172.21.15.81:0/2668146560 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24037070 con 0x7f6f28145e00 2024-09-16T01:19:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.498+0000 7f6f1ffff640 1 -- 172.21.15.81:0/2668146560 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f2402ac50 con 0x7f6f28145e00 2024-09-16T01:19:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.498+0000 7f6f1ffff640 1 -- 172.21.15.81:0/2668146560 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20001a10 con 0x7f6f28145e00 2024-09-16T01:19:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.499+0000 7f6f2f280640 1 -- 172.21.15.81:0/2668146560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f28145e00 msgr2=0x7f6f280cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.499+0000 7f6f2f280640 1 --2- 172.21.15.81:0/2668146560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f28145e00 0x7f6f280cd8a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6f240097a0 tx=0x7f6f2402a1c0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.499+0000 7f6f2f280640 1 -- 172.21.15.81:0/2668146560 shutdown_connections 2024-09-16T01:19:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.499+0000 7f6f2f280640 1 --2- 172.21.15.81:0/2668146560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f28145e00 0x7f6f280cd8a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.499+0000 7f6f2f280640 1 -- 172.21.15.81:0/2668146560 >> 172.21.15.81:0/2668146560 conn(0x7f6f280b2f40 msgr2=0x7f6f280b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.499+0000 7f6f2f280640 1 -- 172.21.15.81:0/2668146560 shutdown_connections 2024-09-16T01:19:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.499+0000 7f6f2f280640 1 -- 172.21.15.81:0/2668146560 wait complete. 2024-09-16T01:19:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.500+0000 7f6f2f280640 1 Processor -- start 2024-09-16T01:19:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.500+0000 7f6f2f280640 1 -- start start 2024-09-16T01:19:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.501+0000 7f6f2f280640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f280d0be0 0x7f6f28144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.501+0000 7f6f2f280640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f28145e00 0x7f6f281f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.501+0000 7f6f2f280640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f2815d460 0x7f6f2809bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.501+0000 7f6f2f280640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280ce830 con 0x7f6f280d0be0 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.501+0000 7f6f2f280640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6f280ce550 con 0x7f6f28145e00 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.501+0000 7f6f2f280640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6f280cede0 con 0x7f6f2815d460 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.501+0000 7f6f2d01c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f280d0be0 0x7f6f28144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.501+0000 7f6f2d01c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f280d0be0 0x7f6f28144f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60140/0 (socket says 172.21.15.81:60140) 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.501+0000 7f6f2d01c640 1 -- 172.21.15.81:0/3909947131 learned_addr learned my addr 172.21.15.81:0/3909947131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.501+0000 7f6f2d81d640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f2815d460 0x7f6f2809bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.501+0000 7f6f2c81b640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f28145e00 0x7f6f281f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.502+0000 7f6f2d01c640 1 -- 172.21.15.81:0/3909947131 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f2815d460 msgr2=0x7f6f2809bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.502+0000 7f6f2d01c640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f2815d460 0x7f6f2809bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.502+0000 7f6f2d01c640 1 -- 172.21.15.81:0/3909947131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f28145e00 msgr2=0x7f6f281f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.502+0000 7f6f2d01c640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f28145e00 0x7f6f281f3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.502+0000 7f6f2d01c640 1 -- 172.21.15.81:0/3909947131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2809c8b0 con 0x7f6f280d0be0 2024-09-16T01:19:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.502+0000 7f6f2d01c640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f280d0be0 0x7f6f28144f10 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6f240098c0 tx=0x7f6f240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.502+0000 7f6f1dffb640 1 -- 172.21.15.81:0/3909947131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24042020 con 0x7f6f280d0be0 2024-09-16T01:19:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.502+0000 7f6f1dffb640 1 -- 172.21.15.81:0/3909947131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f2403d470 con 0x7f6f280d0be0 2024-09-16T01:19:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.502+0000 7f6f1dffb640 1 -- 172.21.15.81:0/3909947131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24037040 con 0x7f6f280d0be0 2024-09-16T01:19:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.502+0000 7f6f2f280640 1 -- 172.21.15.81:0/3909947131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f28157120 con 0x7f6f280d0be0 2024-09-16T01:19:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.502+0000 7f6f2f280640 1 -- 172.21.15.81:0/3909947131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f281576e0 con 0x7f6f280d0be0 2024-09-16T01:19:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.503+0000 7f6f2f280640 1 -- 172.21.15.81:0/3909947131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f2815c730 con 0x7f6f280d0be0 2024-09-16T01:19:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.504+0000 7f6f1dffb640 1 -- 172.21.15.81:0/3909947131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f24045020 con 0x7f6f280d0be0 2024-09-16T01:19:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.504+0000 7f6f1dffb640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6f0c06c2b0 0x7f6f0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.504+0000 7f6f1dffb640 1 -- 172.21.15.81:0/3909947131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f6f240abbf0 con 0x7f6f280d0be0 2024-09-16T01:19:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.504+0000 7f6f2c81b640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6f0c06c2b0 0x7f6f0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.505+0000 7f6f2c81b640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6f0c06c2b0 0x7f6f0c06e770 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6f2815a180 tx=0x7f6f18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.509+0000 7f6f1dffb640 1 -- 172.21.15.81:0/3909947131 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f2404c030 con 0x7f6f280d0be0 2024-09-16T01:19:15.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.713+0000 7f6f2f280640 1 -- 172.21.15.81:0/3909947131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6f28145450 con 0x7f6f280d0be0 2024-09-16T01:19:15.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.713+0000 7f6f1dffb640 1 -- 172.21.15.81:0/3909947131 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f6f2407a260 con 0x7f6f280d0be0 2024-09-16T01:19:15.715 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:15.715 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:19:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.715+0000 7f6f2f280640 1 -- 172.21.15.81:0/3909947131 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6f0c06c2b0 msgr2=0x7f6f0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.715+0000 7f6f2f280640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6f0c06c2b0 0x7f6f0c06e770 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6f2815a180 tx=0x7f6f18009040 comp rx=0 tx=0).stop 2024-09-16T01:19:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.715+0000 7f6f2f280640 1 -- 172.21.15.81:0/3909947131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f280d0be0 msgr2=0x7f6f28144f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.715+0000 7f6f2f280640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f280d0be0 0x7f6f28144f10 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6f240098c0 tx=0x7f6f240046c0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.715+0000 7f6f2f280640 1 -- 172.21.15.81:0/3909947131 shutdown_connections 2024-09-16T01:19:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.715+0000 7f6f2f280640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6f0c06c2b0 0x7f6f0c06e770 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.715+0000 7f6f2f280640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f2815d460 0x7f6f2809bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.715+0000 7f6f2f280640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f28145e00 0x7f6f281f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.715+0000 7f6f2f280640 1 --2- 172.21.15.81:0/3909947131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f280d0be0 0x7f6f28144f10 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.715+0000 7f6f2f280640 1 -- 172.21.15.81:0/3909947131 >> 172.21.15.81:0/3909947131 conn(0x7f6f280b2f40 msgr2=0x7f6f280b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.716+0000 7f6f2f280640 1 -- 172.21.15.81:0/3909947131 shutdown_connections 2024-09-16T01:19:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.716+0000 7f6f2f280640 1 -- 172.21.15.81:0/3909947131 wait complete. 2024-09-16T01:19:15.728 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-16T01:19:15.728 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-09-16T01:19:15.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:19:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.824+0000 7fb95b8c0640 1 Processor -- start 2024-09-16T01:19:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.824+0000 7fb95b8c0640 1 -- start start 2024-09-16T01:19:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.825+0000 7fb95b8c0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb95415e740 0x7fb9540d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.825+0000 7fb95b8c0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9540d0780 con 0x7fb95409b690 2024-09-16T01:19:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.825+0000 7fb95b8c0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9540d0a60 con 0x7fb95406dbd0 2024-09-16T01:19:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.825+0000 7fb95b8c0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb95415eb20 con 0x7fb95415e740 2024-09-16T01:19:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.825+0000 7fb958e5b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb95409b690 0x7fb95406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:50686/0 (socket says 172.21.15.81:50686) 2024-09-16T01:19:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.825+0000 7fb958e5b640 1 -- 172.21.15.81:0/2671038981 learned_addr learned my addr 172.21.15.81:0/2671038981 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb95965c640 1 --2- 172.21.15.81:0/2671038981 >> v2:172.21.15.102:3300/0 conn(0x7fb95415e740 0x7fb9540d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.825+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879044998 0 0) 0x7fb9540d0780 con 0x7fb95409b690 2024-09-16T01:19:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb940003520 con 0x7fb95409b690 2024-09-16T01:19:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4062822319 0 0) 0x7fb940003520 con 0x7fb95409b690 2024-09-16T01:19:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 >> v2:172.21.15.102:3300/0 conn(0x7fb95415e740 msgr2=0x7fb9540d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 --2- 172.21.15.81:0/2671038981 >> v2:172.21.15.102:3300/0 conn(0x7fb95415e740 0x7fb9540d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 >> v1:172.21.15.102:6789/0 conn(0x7fb95406dbd0 legacy=0x7fb954070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9540d0d40 con 0x7fb95409b690 2024-09-16T01:19:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fb944001670 con 0x7fb95409b690 2024-09-16T01:19:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 >> v1:172.21.15.81:6789/0 conn(0x7fb95409b690 legacy=0x7fb95406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 --2- 172.21.15.81:0/2671038981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9400039b0 0x7fb940003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 --2- 172.21.15.81:0/2671038981 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9400043b0 0x7fb940004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 --2- 172.21.15.81:0/2671038981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb940005080 0x7fb94000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb95415eb20 con 0x7fb940005080 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb94000bf30 con 0x7fb9400039b0 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb94000c130 con 0x7fb9400043b0 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb959e5d640 1 --2- 172.21.15.81:0/2671038981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb940005080 0x7fb94000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb95965c640 1 --2- 172.21.15.81:0/2671038981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9400039b0 0x7fb940003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb958e5b640 1 --2- 172.21.15.81:0/2671038981 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9400043b0 0x7fb940004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb959e5d640 1 -- 172.21.15.81:0/2671038981 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9400043b0 msgr2=0x7fb940004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb959e5d640 1 --2- 172.21.15.81:0/2671038981 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9400043b0 0x7fb940004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb959e5d640 1 -- 172.21.15.81:0/2671038981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9400039b0 msgr2=0x7fb940003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb959e5d640 1 --2- 172.21.15.81:0/2671038981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9400039b0 0x7fb940003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb959e5d640 1 -- 172.21.15.81:0/2671038981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb940003520 con 0x7fb940005080 2024-09-16T01:19:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.826+0000 7fb95965c640 1 --2- 172.21.15.81:0/2671038981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9400039b0 0x7fb940003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.827+0000 7fb959e5d640 1 -- 172.21.15.81:0/2671038981 reap_dead start 2024-09-16T01:19:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.827+0000 7fb959e5d640 1 --2- 172.21.15.81:0/2671038981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb940005080 0x7fb94000b9c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb94c001f60 tx=0x7fb940005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534f0d9508ce881f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.827+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c001b30 con 0x7fb940005080 2024-09-16T01:19:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.827+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c003b90 con 0x7fb940005080 2024-09-16T01:19:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.827+0000 7fb94bfff640 1 -- 172.21.15.81:0/2671038981 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c005110 con 0x7fb940005080 2024-09-16T01:19:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.828+0000 7fb95b8c0640 1 -- 172.21.15.81:0/2671038981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb940005080 msgr2=0x7fb94000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.828+0000 7fb95b8c0640 1 --2- 172.21.15.81:0/2671038981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb940005080 0x7fb94000b9c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb94c001f60 tx=0x7fb940005830 comp rx=0 tx=0).stop 2024-09-16T01:19:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.828+0000 7fb95b8c0640 1 -- 172.21.15.81:0/2671038981 shutdown_connections 2024-09-16T01:19:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.828+0000 7fb95b8c0640 1 --2- 172.21.15.81:0/2671038981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb940005080 0x7fb94000b9c0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.828+0000 7fb95b8c0640 1 -- 172.21.15.81:0/2671038981 >> 172.21.15.81:0/2671038981 conn(0x7fb9540d23a0 msgr2=0x7fb9540d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.828+0000 7fb95b8c0640 1 -- 172.21.15.81:0/2671038981 shutdown_connections 2024-09-16T01:19:15.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.828+0000 7fb95b8c0640 1 -- 172.21.15.81:0/2671038981 wait complete. 2024-09-16T01:19:15.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.829+0000 7fb95b8c0640 1 Processor -- start 2024-09-16T01:19:15.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.829+0000 7fb95b8c0640 1 -- start start 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb95b8c0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb940005080 0x7fb9540b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb95b8c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb95415d4a0 0x7fb9541f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb95b8c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540ca3f0 0x7fb95409c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb95b8c0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb95406dfe0 con 0x7fb9540ca3f0 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb95b8c0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb95409bac0 con 0x7fb95415d4a0 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb95b8c0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb9540d1540 con 0x7fb940005080 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb959e5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540ca3f0 0x7fb95409c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb959e5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540ca3f0 0x7fb95409c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60164/0 (socket says 172.21.15.81:60164) 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb959e5d640 1 -- 172.21.15.81:0/3317348948 learned_addr learned my addr 172.21.15.81:0/3317348948 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb95965c640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb940005080 0x7fb9540b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb958e5b640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb95415d4a0 0x7fb9541f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb959e5d640 1 -- 172.21.15.81:0/3317348948 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb940005080 msgr2=0x7fb9540b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb959e5d640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb940005080 0x7fb9540b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb959e5d640 1 -- 172.21.15.81:0/3317348948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb95415d4a0 msgr2=0x7fb9541f3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb959e5d640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb95415d4a0 0x7fb9541f3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb959e5d640 1 -- 172.21.15.81:0/3317348948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9541f44d0 con 0x7fb9540ca3f0 2024-09-16T01:19:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb959e5d640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540ca3f0 0x7fb95409c2c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb94c002050 tx=0x7fb94c0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb949ffb640 1 -- 172.21.15.81:0/3317348948 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c006b50 con 0x7fb9540ca3f0 2024-09-16T01:19:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb949ffb640 1 -- 172.21.15.81:0/3317348948 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c006cf0 con 0x7fb9540ca3f0 2024-09-16T01:19:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb95b8c0640 1 -- 172.21.15.81:0/3317348948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9541f47b0 con 0x7fb9540ca3f0 2024-09-16T01:19:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.830+0000 7fb949ffb640 1 -- 172.21.15.81:0/3317348948 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c03e670 con 0x7fb9540ca3f0 2024-09-16T01:19:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.831+0000 7fb95b8c0640 1 -- 172.21.15.81:0/3317348948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9541f4d70 con 0x7fb9540ca3f0 2024-09-16T01:19:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.831+0000 7fb95b8c0640 1 -- 172.21.15.81:0/3317348948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9540d0a60 con 0x7fb9540ca3f0 2024-09-16T01:19:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.832+0000 7fb949ffb640 1 -- 172.21.15.81:0/3317348948 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb94c030070 con 0x7fb9540ca3f0 2024-09-16T01:19:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.833+0000 7fb949ffb640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb93806c2e0 0x7fb93806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.833+0000 7fb949ffb640 1 -- 172.21.15.81:0/3317348948 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7fb94c0ab3c0 con 0x7fb9540ca3f0 2024-09-16T01:19:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.833+0000 7fb95965c640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb93806c2e0 0x7fb93806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.833+0000 7fb95965c640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb93806c2e0 0x7fb93806e7a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb950009990 tx=0x7fb950008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:15.837+0000 7fb949ffb640 1 -- 172.21.15.81:0/3317348948 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb94c0799a0 con 0x7fb9540ca3f0 2024-09-16T01:19:16.027 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:16.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.042+0000 7fb95b8c0640 1 -- 172.21.15.81:0/3317348948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb9540d1cb0 con 0x7fb9540ca3f0 2024-09-16T01:19:16.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.042+0000 7fb949ffb640 1 -- 172.21.15.81:0/3317348948 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fb94c0792a0 con 0x7fb9540ca3f0 2024-09-16T01:19:16.044 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:16.044 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:19:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.044+0000 7fb95b8c0640 1 -- 172.21.15.81:0/3317348948 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb93806c2e0 msgr2=0x7fb93806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:16.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.044+0000 7fb95b8c0640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb93806c2e0 0x7fb93806e7a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb950009990 tx=0x7fb950008040 comp rx=0 tx=0).stop 2024-09-16T01:19:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.044+0000 7fb95b8c0640 1 -- 172.21.15.81:0/3317348948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540ca3f0 msgr2=0x7fb95409c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.044+0000 7fb95b8c0640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540ca3f0 0x7fb95409c2c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fb94c002050 tx=0x7fb94c0015b0 comp rx=0 tx=0).stop 2024-09-16T01:19:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.044+0000 7fb95b8c0640 1 -- 172.21.15.81:0/3317348948 shutdown_connections 2024-09-16T01:19:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.044+0000 7fb95b8c0640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb93806c2e0 0x7fb93806e7a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.044+0000 7fb95b8c0640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9540ca3f0 0x7fb95409c2c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.044+0000 7fb95b8c0640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb95415d4a0 0x7fb9541f3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.044+0000 7fb95b8c0640 1 --2- 172.21.15.81:0/3317348948 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb940005080 0x7fb9540b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.044+0000 7fb95b8c0640 1 -- 172.21.15.81:0/3317348948 >> 172.21.15.81:0/3317348948 conn(0x7fb9540d23a0 msgr2=0x7fb9540ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.044+0000 7fb95b8c0640 1 -- 172.21.15.81:0/3317348948 shutdown_connections 2024-09-16T01:19:16.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:16.044+0000 7fb95b8c0640 1 -- 172.21.15.81:0/3317348948 wait complete. 2024-09-16T01:19:16.057 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:19:16.057 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:19:18.028 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:21.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:19:21.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.167+0000 7f2c3a79f640 1 Processor -- start 2024-09-16T01:19:21.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.167+0000 7f2c3a79f640 1 -- start start 2024-09-16T01:19:21.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c3a79f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c34161fa0 0x7f2c340b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:21.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c3a79f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c340726b0 0x7f2c34072b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:21.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c3a79f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c340b3710 con 0x7f2c3415e330 2024-09-16T01:19:21.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c3a79f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2c34162510 con 0x7f2c34161fa0 2024-09-16T01:19:21.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c3a79f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2c341627f0 con 0x7f2c340726b0 2024-09-16T01:19:21.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c337fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c34161fa0 0x7f2c340b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:21.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c33fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2c3415e330 0x7f2c3406f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40844/0 (socket says 172.21.15.81:40844) 2024-09-16T01:19:21.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c337fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c34161fa0 0x7f2c340b5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41224/0 (socket says 172.21.15.81:41224) 2024-09-16T01:19:21.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c33fff640 1 -- 172.21.15.81:0/629270846 learned_addr learned my addr 172.21.15.81:0/629270846 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:21.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c337fe640 1 -- 172.21.15.81:0/629270846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c340726b0 msgr2=0x7f2c34072b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:21.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c337fe640 1 --2- 172.21.15.81:0/629270846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c340726b0 0x7f2c34072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:21.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c337fe640 1 -- 172.21.15.81:0/629270846 >> v1:172.21.15.81:6789/0 conn(0x7f2c3415e330 legacy=0x7f2c3406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:21.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c32ffd640 1 -- 172.21.15.81:0/629270846 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4113498555 0 0) 0x7f2c340b3710 con 0x7f2c3415e330 2024-09-16T01:19:21.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.168+0000 7f2c337fe640 1 -- 172.21.15.81:0/629270846 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c34162ad0 con 0x7f2c34161fa0 2024-09-16T01:19:21.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.169+0000 7f2c337fe640 1 --2- 172.21.15.81:0/629270846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c34161fa0 0x7f2c340b5530 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2c280097a0 tx=0x7f2c2802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f4756f50c30d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.169+0000 7f2c32ffd640 1 -- 172.21.15.81:0/629270846 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28037070 con 0x7f2c34161fa0 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.169+0000 7f2c32ffd640 1 -- 172.21.15.81:0/629270846 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2802ae50 con 0x7f2c34161fa0 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.169+0000 7f2c32ffd640 1 -- 172.21.15.81:0/629270846 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28032660 con 0x7f2c34161fa0 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.170+0000 7f2c3a79f640 1 -- 172.21.15.81:0/629270846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c34161fa0 msgr2=0x7f2c340b5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.170+0000 7f2c3a79f640 1 --2- 172.21.15.81:0/629270846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c34161fa0 0x7f2c340b5530 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2c280097a0 tx=0x7f2c2802a100 comp rx=0 tx=0).stop 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.170+0000 7f2c3a79f640 1 -- 172.21.15.81:0/629270846 shutdown_connections 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.170+0000 7f2c3a79f640 1 --2- 172.21.15.81:0/629270846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c340726b0 0x7f2c34072b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.170+0000 7f2c3a79f640 1 --2- 172.21.15.81:0/629270846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c34161fa0 0x7f2c340b5530 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.170+0000 7f2c3a79f640 1 -- 172.21.15.81:0/629270846 >> 172.21.15.81:0/629270846 conn(0x7f2c3406c030 msgr2=0x7f2c3406c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.170+0000 7f2c3a79f640 1 -- 172.21.15.81:0/629270846 shutdown_connections 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.170+0000 7f2c3a79f640 1 -- 172.21.15.81:0/629270846 wait complete. 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.171+0000 7f2c3a79f640 1 Processor -- start 2024-09-16T01:19:21.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.171+0000 7f2c3a79f640 1 -- start start 2024-09-16T01:19:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c3a79f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c340726b0 0x7f2c3414b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c3a79f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3415e330 0x7f2c34160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c3a79f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c34161fa0 0x7f2c34161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:21.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c3a79f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3415e710 con 0x7f2c3415e330 2024-09-16T01:19:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c3a79f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c340b3bc0 con 0x7f2c340726b0 2024-09-16T01:19:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c3a79f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2c3414dcc0 con 0x7f2c34161fa0 2024-09-16T01:19:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3415e330 0x7f2c34160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3415e330 0x7f2c34160e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41226/0 (socket says 172.21.15.81:41226) 2024-09-16T01:19:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c337fe640 1 -- 172.21.15.81:0/3878654413 learned_addr learned my addr 172.21.15.81:0/3878654413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c33fff640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c340726b0 0x7f2c3414b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c38d3c640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c34161fa0 0x7f2c34161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c337fe640 1 -- 172.21.15.81:0/3878654413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c34161fa0 msgr2=0x7f2c34161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c337fe640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c34161fa0 0x7f2c34161370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c337fe640 1 -- 172.21.15.81:0/3878654413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c340726b0 msgr2=0x7f2c3414b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c337fe640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c340726b0 0x7f2c3414b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:21.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c337fe640 1 -- 172.21.15.81:0/3878654413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3414b840 con 0x7f2c3415e330 2024-09-16T01:19:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.172+0000 7f2c33fff640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c340726b0 0x7f2c3414b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.173+0000 7f2c337fe640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3415e330 0x7f2c34160e30 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2c280097a0 tx=0x7f2c280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.173+0000 7f2c30ff9640 1 -- 172.21.15.81:0/3878654413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28037040 con 0x7f2c3415e330 2024-09-16T01:19:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.173+0000 7f2c30ff9640 1 -- 172.21.15.81:0/3878654413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c28004030 con 0x7f2c3415e330 2024-09-16T01:19:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.173+0000 7f2c3a79f640 1 -- 172.21.15.81:0/3878654413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c340b2240 con 0x7f2c3415e330 2024-09-16T01:19:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.173+0000 7f2c30ff9640 1 -- 172.21.15.81:0/3878654413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28006e10 con 0x7f2c3415e330 2024-09-16T01:19:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.173+0000 7f2c3a79f640 1 -- 172.21.15.81:0/3878654413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c340b2800 con 0x7f2c3415e330 2024-09-16T01:19:21.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.174+0000 7f2c3a79f640 1 -- 172.21.15.81:0/3878654413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c340b5530 con 0x7f2c3415e330 2024-09-16T01:19:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.174+0000 7f2c30ff9640 1 -- 172.21.15.81:0/3878654413 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2c2803d650 con 0x7f2c3415e330 2024-09-16T01:19:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.175+0000 7f2c30ff9640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c2006c2b0 0x7f2c2006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.175+0000 7f2c30ff9640 1 -- 172.21.15.81:0/3878654413 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6101+0+0 (secure 0 0 0) 0x7f2c280abbf0 con 0x7f2c3415e330 2024-09-16T01:19:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.175+0000 7f2c33fff640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c2006c2b0 0x7f2c2006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:21.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.175+0000 7f2c33fff640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c2006c2b0 0x7f2c2006e770 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2c24000f60 tx=0x7f2c24007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:21.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.179+0000 7f2c30ff9640 1 -- 172.21.15.81:0/3878654413 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c28042020 con 0x7f2c3415e330 2024-09-16T01:19:21.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.380+0000 7f2c3a79f640 1 -- 172.21.15.81:0/3878654413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2c3415bfb0 con 0x7f2c3415e330 2024-09-16T01:19:21.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.380+0000 7f2c30ff9640 1 -- 172.21.15.81:0/3878654413 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f2c2807a260 con 0x7f2c3415e330 2024-09-16T01:19:21.382 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:21.382 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:19:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.383+0000 7f2c3a79f640 1 -- 172.21.15.81:0/3878654413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c2006c2b0 msgr2=0x7f2c2006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:21.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.383+0000 7f2c3a79f640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c2006c2b0 0x7f2c2006e770 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2c24000f60 tx=0x7f2c24007c10 comp rx=0 tx=0).stop 2024-09-16T01:19:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.383+0000 7f2c3a79f640 1 -- 172.21.15.81:0/3878654413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3415e330 msgr2=0x7f2c34160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.383+0000 7f2c3a79f640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3415e330 0x7f2c34160e30 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2c280097a0 tx=0x7f2c280046c0 comp rx=0 tx=0).stop 2024-09-16T01:19:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.383+0000 7f2c3a79f640 1 -- 172.21.15.81:0/3878654413 shutdown_connections 2024-09-16T01:19:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.383+0000 7f2c3a79f640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2c2006c2b0 0x7f2c2006e770 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.383+0000 7f2c3a79f640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c34161fa0 0x7f2c34161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.383+0000 7f2c3a79f640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c3415e330 0x7f2c34160e30 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.383+0000 7f2c3a79f640 1 --2- 172.21.15.81:0/3878654413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c340726b0 0x7f2c3414b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.383+0000 7f2c3a79f640 1 -- 172.21.15.81:0/3878654413 >> 172.21.15.81:0/3878654413 conn(0x7f2c3406c030 msgr2=0x7f2c340ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.383+0000 7f2c3a79f640 1 -- 172.21.15.81:0/3878654413 shutdown_connections 2024-09-16T01:19:21.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:21.383+0000 7f2c3a79f640 1 -- 172.21.15.81:0/3878654413 wait complete. 2024-09-16T01:19:21.395 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:19:21.395 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:19:22.032 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:24.034 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:26.036 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:26.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:19:26.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.505+0000 7ff1fcf31640 1 Processor -- start 2024-09-16T01:19:26.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.505+0000 7ff1fcf31640 1 -- start start 2024-09-16T01:19:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1fcf31640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1f80d04a0 0x7ff1f80d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1fcf31640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1f806cb30 con 0x7ff1f8147360 2024-09-16T01:19:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1fcf31640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1f806bfb0 con 0x7ff1f80ae550 2024-09-16T01:19:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1fcf31640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f806c290 con 0x7ff1f80d04a0 2024-09-16T01:19:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1f659c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff1f8147360 0x7ff1f8070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40846/0 (socket says 172.21.15.81:40846) 2024-09-16T01:19:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1f659c640 1 -- 172.21.15.81:0/2147545550 learned_addr learned my addr 172.21.15.81:0/2147545550 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352547674 0 0) 0x7ff1f806cb30 con 0x7ff1f8147360 2024-09-16T01:19:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1e4003520 con 0x7ff1f8147360 2024-09-16T01:19:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1effff640 1 --2- 172.21.15.81:0/2147545550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1f80d04a0 0x7ff1f80d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2878364219 0 0) 0x7ff1e4003520 con 0x7ff1f8147360 2024-09-16T01:19:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1f80d04a0 msgr2=0x7ff1f80d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1f5d9b640 1 --2- 172.21.15.81:0/2147545550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1f80d04a0 0x7ff1f80d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 >> v1:172.21.15.102:6789/0 conn(0x7ff1f80ae550 legacy=0x7ff1f80ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f806c570 con 0x7ff1f8147360 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.506+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7ff1e8001670 con 0x7ff1f8147360 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 >> v1:172.21.15.81:6789/0 conn(0x7ff1f8147360 legacy=0x7ff1f8070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f5d9b640 1 --2- 172.21.15.81:0/2147545550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1f80d04a0 0x7ff1e40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f5d9b640 1 --2- 172.21.15.81:0/2147545550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1e4004010 0x7ff1e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f5d9b640 1 --2- 172.21.15.81:0/2147545550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e4004d40 0x7ff1e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f806c290 con 0x7ff1e4004d40 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e400bc00 con 0x7ff1e4004010 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e400be00 con 0x7ff1f80d04a0 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f6d9d640 1 --2- 172.21.15.81:0/2147545550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e4004d40 0x7ff1e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f659c640 1 --2- 172.21.15.81:0/2147545550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1f80d04a0 0x7ff1e40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1effff640 1 --2- 172.21.15.81:0/2147545550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1e4004010 0x7ff1e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f6d9d640 1 -- 172.21.15.81:0/2147545550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1f80d04a0 msgr2=0x7ff1e40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f6d9d640 1 --2- 172.21.15.81:0/2147545550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1f80d04a0 0x7ff1e40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f6d9d640 1 -- 172.21.15.81:0/2147545550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1e4004010 msgr2=0x7ff1e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f6d9d640 1 --2- 172.21.15.81:0/2147545550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1e4004010 0x7ff1e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.507+0000 7ff1f6d9d640 1 -- 172.21.15.81:0/2147545550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e4003520 con 0x7ff1e4004d40 2024-09-16T01:19:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.508+0000 7ff1f6d9d640 1 --2- 172.21.15.81:0/2147545550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e4004d40 0x7ff1e40051c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0001e50 tx=0x7ff1e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cae709e8e0f50a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.508+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0001a70 con 0x7ff1e4004d40 2024-09-16T01:19:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.508+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f0003970 con 0x7ff1e4004d40 2024-09-16T01:19:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.508+0000 7ff1f5d9b640 1 -- 172.21.15.81:0/2147545550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0003d60 con 0x7ff1e4004d40 2024-09-16T01:19:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.508+0000 7ff1fcf31640 1 -- 172.21.15.81:0/2147545550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e4004d40 msgr2=0x7ff1e40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.508+0000 7ff1fcf31640 1 --2- 172.21.15.81:0/2147545550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1e4004d40 0x7ff1e40051c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0001e50 tx=0x7ff1e4005830 comp rx=0 tx=0).stop 2024-09-16T01:19:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.508+0000 7ff1f6d9d640 1 -- 172.21.15.81:0/2147545550 reap_dead start 2024-09-16T01:19:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.508+0000 7ff1fcf31640 1 -- 172.21.15.81:0/2147545550 shutdown_connections 2024-09-16T01:19:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.508+0000 7ff1fcf31640 1 -- 172.21.15.81:0/2147545550 >> 172.21.15.81:0/2147545550 conn(0x7ff1f80b2f40 msgr2=0x7ff1f80b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.508+0000 7ff1fcf31640 1 -- 172.21.15.81:0/2147545550 shutdown_connections 2024-09-16T01:19:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.508+0000 7ff1fcf31640 1 -- 172.21.15.81:0/2147545550 wait complete. 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.510+0000 7ff1fcf31640 1 Processor -- start 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.510+0000 7ff1fcf31640 1 -- start start 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1fcf31640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1e4004d40 0x7ff1f813b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1fcf31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f81f4560 0x7ff1f81f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1fcf31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1f81f4f20 0x7ff1f80b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1fcf31640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f806bc10 con 0x7ff1f81f4560 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1fcf31640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff1f8070fa0 con 0x7ff1f81f4f20 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1fcf31640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff1f806bd90 con 0x7ff1e4004d40 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1effff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f81f4560 0x7ff1f81f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1effff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f81f4560 0x7ff1f81f49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41240/0 (socket says 172.21.15.81:41240) 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1effff640 1 -- 172.21.15.81:0/4229348514 learned_addr learned my addr 172.21.15.81:0/4229348514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1f659c640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1e4004d40 0x7ff1f813b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1f6d9d640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1f81f4f20 0x7ff1f80b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1effff640 1 -- 172.21.15.81:0/4229348514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1e4004d40 msgr2=0x7ff1f813b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1effff640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1e4004d40 0x7ff1f813b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1effff640 1 -- 172.21.15.81:0/4229348514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1f81f4f20 msgr2=0x7ff1f80b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1effff640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1f81f4f20 0x7ff1f80b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1effff640 1 -- 172.21.15.81:0/4229348514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1f81f1cd0 con 0x7ff1f81f4560 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1effff640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f81f4560 0x7ff1f81f49e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000b820 tx=0x7ff1e000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1eeffd640 1 -- 172.21.15.81:0/4229348514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0018070 con 0x7ff1f81f4560 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1eeffd640 1 -- 172.21.15.81:0/4229348514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e000be10 con 0x7ff1f81f4560 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1eeffd640 1 -- 172.21.15.81:0/4229348514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0010c60 con 0x7ff1f81f4560 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1fcf31640 1 -- 172.21.15.81:0/4229348514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1f81411e0 con 0x7ff1f81f4560 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.511+0000 7ff1fcf31640 1 -- 172.21.15.81:0/4229348514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1f81417a0 con 0x7ff1f81f4560 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.512+0000 7ff1fcf31640 1 -- 172.21.15.81:0/4229348514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1f8070890 con 0x7ff1f81f4560 2024-09-16T01:19:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.513+0000 7ff1eeffd640 1 -- 172.21.15.81:0/4229348514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff1e001b070 con 0x7ff1f81f4560 2024-09-16T01:19:26.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.513+0000 7ff1eeffd640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1d806c2b0 0x7ff1d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:26.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.513+0000 7ff1eeffd640 1 -- 172.21.15.81:0/4229348514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7ff1e008b900 con 0x7ff1f81f4560 2024-09-16T01:19:26.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.513+0000 7ff1f659c640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1d806c2b0 0x7ff1d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:26.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.514+0000 7ff1f659c640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1d806c2b0 0x7ff1d806e770 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8001050 tx=0x7ff1e8000f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:26.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.518+0000 7ff1eeffd640 1 -- 172.21.15.81:0/4229348514 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1e00598b0 con 0x7ff1f81f4560 2024-09-16T01:19:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.720+0000 7ff1fcf31640 1 -- 172.21.15.81:0/4229348514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff1f8145610 con 0x7ff1f81f4560 2024-09-16T01:19:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.720+0000 7ff1eeffd640 1 -- 172.21.15.81:0/4229348514 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7ff1e005dbb0 con 0x7ff1f81f4560 2024-09-16T01:19:26.721 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:26.721 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:19:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.722+0000 7ff1fcf31640 1 -- 172.21.15.81:0/4229348514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1d806c2b0 msgr2=0x7ff1d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.722+0000 7ff1fcf31640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1d806c2b0 0x7ff1d806e770 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8001050 tx=0x7ff1e8000f80 comp rx=0 tx=0).stop 2024-09-16T01:19:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.722+0000 7ff1fcf31640 1 -- 172.21.15.81:0/4229348514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f81f4560 msgr2=0x7ff1f81f49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.722+0000 7ff1fcf31640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f81f4560 0x7ff1f81f49e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000b820 tx=0x7ff1e000bce0 comp rx=0 tx=0).stop 2024-09-16T01:19:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.722+0000 7ff1fcf31640 1 -- 172.21.15.81:0/4229348514 shutdown_connections 2024-09-16T01:19:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.722+0000 7ff1fcf31640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1d806c2b0 0x7ff1d806e770 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.722+0000 7ff1fcf31640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1f81f4f20 0x7ff1f80b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.722+0000 7ff1fcf31640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1f81f4560 0x7ff1f81f49e0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.722+0000 7ff1fcf31640 1 --2- 172.21.15.81:0/4229348514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1e4004d40 0x7ff1f813b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.722+0000 7ff1fcf31640 1 -- 172.21.15.81:0/4229348514 >> 172.21.15.81:0/4229348514 conn(0x7ff1f80b2f40 msgr2=0x7ff1f80b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.722+0000 7ff1fcf31640 1 -- 172.21.15.81:0/4229348514 shutdown_connections 2024-09-16T01:19:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:26.722+0000 7ff1fcf31640 1 -- 172.21.15.81:0/4229348514 wait complete. 2024-09-16T01:19:26.734 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:19:26.734 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:19:28.038 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:30.040 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:31.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:19:31.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.844+0000 7f7b02bf8640 1 Processor -- start 2024-09-16T01:19:31.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.844+0000 7f7b02bf8640 1 -- start start 2024-09-16T01:19:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7b02bf8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7afc161c80 0x7f7afc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7b02bf8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7afc0b6680 0x7f7afc0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7b02bf8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7afc06e870 con 0x7f7afc162060 2024-09-16T01:19:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7b02bf8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7afc06d9f0 con 0x7f7afc161c80 2024-09-16T01:19:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7b02bf8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7afc06dcd0 con 0x7f7afc0b6680 2024-09-16T01:19:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7afbfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7afc162060 0x7f7afc0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59142/0 (socket says 172.21.15.81:59142) 2024-09-16T01:19:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7b00994640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7afc161c80 0x7f7afc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7afbfff640 1 -- 172.21.15.81:0/3458762116 learned_addr learned my addr 172.21.15.81:0/3458762116 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7b01195640 1 --2- 172.21.15.81:0/3458762116 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7afc0b6680 0x7f7afc0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:31.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7b00994640 1 -- 172.21.15.81:0/3458762116 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7afc0b6680 msgr2=0x7f7afc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:31.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7b00994640 1 --2- 172.21.15.81:0/3458762116 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7afc0b6680 0x7f7afc0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:31.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7b00994640 1 -- 172.21.15.81:0/3458762116 >> v1:172.21.15.81:6789/0 conn(0x7f7afc162060 legacy=0x7f7afc0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:31.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7afb7fe640 1 -- 172.21.15.81:0/3458762116 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79812303 0 0) 0x7f7ae8001110 con 0x7f7afc162060 2024-09-16T01:19:31.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.845+0000 7f7b00994640 1 -- 172.21.15.81:0/3458762116 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc06dfb0 con 0x7f7afc161c80 2024-09-16T01:19:31.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.846+0000 7f7b00994640 1 --2- 172.21.15.81:0/3458762116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc161c80 0x7f7afc06e330 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7af00097a0 tx=0x7f7af002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c802715d10bab988 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:31.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.846+0000 7f7afb7fe640 1 -- 172.21.15.81:0/3458762116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af0037070 con 0x7f7afc161c80 2024-09-16T01:19:31.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.846+0000 7f7afb7fe640 1 -- 172.21.15.81:0/3458762116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af0032440 con 0x7f7afc161c80 2024-09-16T01:19:31.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.846+0000 7f7afb7fe640 1 -- 172.21.15.81:0/3458762116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af0032810 con 0x7f7afc161c80 2024-09-16T01:19:31.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.847+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3458762116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc161c80 msgr2=0x7f7afc06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:31.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.847+0000 7f7b02bf8640 1 --2- 172.21.15.81:0/3458762116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc161c80 0x7f7afc06e330 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f7af00097a0 tx=0x7f7af002a180 comp rx=0 tx=0).stop 2024-09-16T01:19:31.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.847+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3458762116 shutdown_connections 2024-09-16T01:19:31.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.847+0000 7f7b02bf8640 1 --2- 172.21.15.81:0/3458762116 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7afc0b6680 0x7f7afc0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:31.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.847+0000 7f7b02bf8640 1 --2- 172.21.15.81:0/3458762116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc161c80 0x7f7afc06e330 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:31.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.847+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3458762116 >> 172.21.15.81:0/3458762116 conn(0x7f7afc0d44f0 msgr2=0x7f7afc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:31.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.847+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3458762116 shutdown_connections 2024-09-16T01:19:31.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.847+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3458762116 wait complete. 2024-09-16T01:19:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.848+0000 7f7b02bf8640 1 Processor -- start 2024-09-16T01:19:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.848+0000 7f7b02bf8640 1 -- start start 2024-09-16T01:19:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b02bf8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc0b6680 0x7f7afc0b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b02bf8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7afc161c80 0x7f7afc0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b02bf8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7afc162060 0x7f7afc0cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b02bf8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc0b6cb0 con 0x7f7afc0b6680 2024-09-16T01:19:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b02bf8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7afc0b6b30 con 0x7f7afc161c80 2024-09-16T01:19:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b02bf8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7afc0cf720 con 0x7f7afc162060 2024-09-16T01:19:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b00994640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc0b6680 0x7f7afc0b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b00994640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc0b6680 0x7f7afc0b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35140/0 (socket says 172.21.15.81:35140) 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b00994640 1 -- 172.21.15.81:0/3794426729 learned_addr learned my addr 172.21.15.81:0/3794426729 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b01195640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7afc162060 0x7f7afc0cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7afbfff640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7afc161c80 0x7f7afc0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b00994640 1 -- 172.21.15.81:0/3794426729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7afc162060 msgr2=0x7f7afc0cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b00994640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7afc162060 0x7f7afc0cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b00994640 1 -- 172.21.15.81:0/3794426729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7afc161c80 msgr2=0x7f7afc0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b00994640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7afc161c80 0x7f7afc0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b00994640 1 -- 172.21.15.81:0/3794426729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7afc0b2250 con 0x7f7afc0b6680 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b01195640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7afc162060 0x7f7afc0cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7afbfff640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7afc161c80 0x7f7afc0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.849+0000 7f7b00994640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc0b6680 0x7f7afc0b32f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f7af0000c00 tx=0x7f7af00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.850+0000 7f7af97fa640 1 -- 172.21.15.81:0/3794426729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af0037050 con 0x7f7afc0b6680 2024-09-16T01:19:31.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.850+0000 7f7af97fa640 1 -- 172.21.15.81:0/3794426729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7af0038040 con 0x7f7afc0b6680 2024-09-16T01:19:31.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.850+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3794426729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7afc0b2530 con 0x7f7afc0b6680 2024-09-16T01:19:31.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.850+0000 7f7af97fa640 1 -- 172.21.15.81:0/3794426729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af0004490 con 0x7f7afc0b6680 2024-09-16T01:19:31.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.850+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3794426729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7afc0b2af0 con 0x7f7afc0b6680 2024-09-16T01:19:31.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.851+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3794426729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7afc0cf1e0 con 0x7f7afc0b6680 2024-09-16T01:19:31.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.851+0000 7f7af97fa640 1 -- 172.21.15.81:0/3794426729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7af0030900 con 0x7f7afc0b6680 2024-09-16T01:19:31.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.852+0000 7f7af97fa640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7ae006c2e0 0x7f7ae006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:31.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.852+0000 7f7af97fa640 1 -- 172.21.15.81:0/3794426729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f7af00ac230 con 0x7f7afc0b6680 2024-09-16T01:19:31.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.852+0000 7f7afbfff640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7ae006c2e0 0x7f7ae006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:31.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.852+0000 7f7afbfff640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7ae006c2e0 0x7f7ae006e7a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0ce820 tx=0x7f7ae8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:31.856+0000 7f7af97fa640 1 -- 172.21.15.81:0/3794426729 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7af007a8c0 con 0x7f7afc0b6680 2024-09-16T01:19:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.063+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3794426729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7afc0cec50 con 0x7f7afc0b6680 2024-09-16T01:19:32.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.063+0000 7f7af97fa640 1 -- 172.21.15.81:0/3794426729 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f7af007a1c0 con 0x7f7afc0b6680 2024-09-16T01:19:32.064 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:32.064 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:19:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.065+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3794426729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7ae006c2e0 msgr2=0x7f7ae006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.065+0000 7f7b02bf8640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7ae006c2e0 0x7f7ae006e7a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0ce820 tx=0x7f7ae8009040 comp rx=0 tx=0).stop 2024-09-16T01:19:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.065+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3794426729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc0b6680 msgr2=0x7f7afc0b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.065+0000 7f7b02bf8640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc0b6680 0x7f7afc0b32f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f7af0000c00 tx=0x7f7af00046c0 comp rx=0 tx=0).stop 2024-09-16T01:19:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.065+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3794426729 shutdown_connections 2024-09-16T01:19:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.065+0000 7f7b02bf8640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7ae006c2e0 0x7f7ae006e7a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.065+0000 7f7b02bf8640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7afc162060 0x7f7afc0cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.065+0000 7f7b02bf8640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7afc161c80 0x7f7afc0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.065+0000 7f7b02bf8640 1 --2- 172.21.15.81:0/3794426729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7afc0b6680 0x7f7afc0b32f0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.065+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3794426729 >> 172.21.15.81:0/3794426729 conn(0x7f7afc0d44f0 msgr2=0x7f7afc15fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.066+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3794426729 shutdown_connections 2024-09-16T01:19:32.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:32.066+0000 7f7b02bf8640 1 -- 172.21.15.81:0/3794426729 wait complete. 2024-09-16T01:19:32.077 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:19:32.077 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:19:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:37.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:19:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.186+0000 7f9a820e4640 1 Processor -- start 2024-09-16T01:19:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.186+0000 7f9a820e4640 1 -- start start 2024-09-16T01:19:37.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.187+0000 7f9a820e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a7c072d30 0x7f9a7c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.187+0000 7f9a820e4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7c06fae0 con 0x7f9a7c06f700 2024-09-16T01:19:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.187+0000 7f9a820e4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7c0cdbe0 con 0x7f9a7c15b300 2024-09-16T01:19:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.187+0000 7f9a820e4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9a7c0728a0 con 0x7f9a7c072d30 2024-09-16T01:19:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.187+0000 7f9a7affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a7c072d30 0x7f9a7c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.187+0000 7f9a7bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9a7c06f700 0x7f9a7c15b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59150/0 (socket says 172.21.15.81:59150) 2024-09-16T01:19:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.187+0000 7f9a7bfff640 1 -- 172.21.15.81:0/3558681972 learned_addr learned my addr 172.21.15.81:0/3558681972 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:19:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.188+0000 7f9a7affd640 1 -- 172.21.15.81:0/3558681972 >> v1:172.21.15.102:6789/0 conn(0x7f9a7c15b300 legacy=0x7f9a7c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.188+0000 7f9a7affd640 1 -- 172.21.15.81:0/3558681972 >> v1:172.21.15.81:6789/0 conn(0x7f9a7c06f700 legacy=0x7f9a7c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.188+0000 7f9a7a7fc640 1 -- 172.21.15.81:0/3558681972 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049981993 0 0) 0x7f9a7c06fae0 con 0x7f9a7c06f700 2024-09-16T01:19:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.188+0000 7f9a7affd640 1 -- 172.21.15.81:0/3558681972 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c0cd900 con 0x7f9a7c072d30 2024-09-16T01:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.188+0000 7f9a7affd640 1 --2- 172.21.15.81:0/3558681972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7c072d30 0x7f9a7c06f1c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9a700097a0 tx=0x7f9a7002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a313779c1ac71c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.188+0000 7f9a7a7fc640 1 -- 172.21.15.81:0/3558681972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70037070 con 0x7f9a7c072d30 2024-09-16T01:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.189+0000 7f9a7a7fc640 1 -- 172.21.15.81:0/3558681972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a7002ae50 con 0x7f9a7c072d30 2024-09-16T01:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.189+0000 7f9a7a7fc640 1 -- 172.21.15.81:0/3558681972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70032660 con 0x7f9a7c072d30 2024-09-16T01:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.189+0000 7f9a820e4640 1 -- 172.21.15.81:0/3558681972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7c072d30 msgr2=0x7f9a7c06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.189+0000 7f9a820e4640 1 --2- 172.21.15.81:0/3558681972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7c072d30 0x7f9a7c06f1c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9a700097a0 tx=0x7f9a7002a140 comp rx=0 tx=0).stop 2024-09-16T01:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.189+0000 7f9a820e4640 1 -- 172.21.15.81:0/3558681972 shutdown_connections 2024-09-16T01:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.189+0000 7f9a820e4640 1 --2- 172.21.15.81:0/3558681972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7c072d30 0x7f9a7c06f1c0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.189+0000 7f9a820e4640 1 -- 172.21.15.81:0/3558681972 >> 172.21.15.81:0/3558681972 conn(0x7f9a7c067d70 msgr2=0x7f9a7c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.189+0000 7f9a820e4640 1 -- 172.21.15.81:0/3558681972 shutdown_connections 2024-09-16T01:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.189+0000 7f9a820e4640 1 -- 172.21.15.81:0/3558681972 wait complete. 2024-09-16T01:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.190+0000 7f9a820e4640 1 Processor -- start 2024-09-16T01:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.191+0000 7f9a820e4640 1 -- start start 2024-09-16T01:19:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.191+0000 7f9a820e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a7c06f700 0x7f9a7c0b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.191+0000 7f9a820e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7c072d30 0x7f9a7c06e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.191+0000 7f9a820e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a7c15b300 0x7f9a7c06e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.191+0000 7f9a820e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c0cd5c0 con 0x7f9a7c072d30 2024-09-16T01:19:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.191+0000 7f9a820e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c072530 con 0x7f9a7c06f700 2024-09-16T01:19:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.191+0000 7f9a820e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7c0cffe0 con 0x7f9a7c15b300 2024-09-16T01:19:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.191+0000 7f9a7affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7c072d30 0x7f9a7c06e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.191+0000 7f9a7affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7c072d30 0x7f9a7c06e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35170/0 (socket says 172.21.15.81:35170) 2024-09-16T01:19:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.191+0000 7f9a7affd640 1 -- 172.21.15.81:0/3717418044 learned_addr learned my addr 172.21.15.81:0/3717418044 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a7b7fe640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a7c06f700 0x7f9a7c0b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a7bfff640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a7c15b300 0x7f9a7c06e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a7affd640 1 -- 172.21.15.81:0/3717418044 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a7c15b300 msgr2=0x7f9a7c06e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a7affd640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a7c15b300 0x7f9a7c06e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a7affd640 1 -- 172.21.15.81:0/3717418044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a7c06f700 msgr2=0x7f9a7c0b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a7affd640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a7c06f700 0x7f9a7c0b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a7affd640 1 -- 172.21.15.81:0/3717418044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c155f00 con 0x7f9a7c072d30 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a7bfff640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a7c15b300 0x7f9a7c06e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a7affd640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7c072d30 0x7f9a7c06e0b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9a700098c0 tx=0x7f9a700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a63fff640 1 -- 172.21.15.81:0/3717418044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70042070 con 0x7f9a7c072d30 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a63fff640 1 -- 172.21.15.81:0/3717418044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a7003e670 con 0x7f9a7c072d30 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a63fff640 1 -- 172.21.15.81:0/3717418044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70037040 con 0x7f9a7c072d30 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a820e4640 1 -- 172.21.15.81:0/3717418044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c1561e0 con 0x7f9a7c072d30 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.192+0000 7f9a820e4640 1 -- 172.21.15.81:0/3717418044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c0b2f00 con 0x7f9a7c072d30 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.193+0000 7f9a820e4640 1 -- 172.21.15.81:0/3717418044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7c06f1c0 con 0x7f9a7c072d30 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.194+0000 7f9a63fff640 1 -- 172.21.15.81:0/3717418044 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a70045070 con 0x7f9a7c072d30 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.194+0000 7f9a63fff640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a6806c2e0 0x7f9a6806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.194+0000 7f9a7b7fe640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a6806c2e0 0x7f9a6806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.194+0000 7f9a63fff640 1 -- 172.21.15.81:0/3717418044 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f9a700abf50 con 0x7f9a7c072d30 2024-09-16T01:19:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.195+0000 7f9a7b7fe640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a6806c2e0 0x7f9a6806e7a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c001db0 tx=0x7f9a6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.199+0000 7f9a63fff640 1 -- 172.21.15.81:0/3717418044 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a7007a5e0 con 0x7f9a7c072d30 2024-09-16T01:19:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.399+0000 7f9a820e4640 1 -- 172.21.15.81:0/3717418044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9a7c1e5ac0 con 0x7f9a7c072d30 2024-09-16T01:19:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.399+0000 7f9a63fff640 1 -- 172.21.15.81:0/3717418044 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f9a70079ee0 con 0x7f9a7c072d30 2024-09-16T01:19:37.400 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:37.400 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:19:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.401+0000 7f9a820e4640 1 -- 172.21.15.81:0/3717418044 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a6806c2e0 msgr2=0x7f9a6806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.401+0000 7f9a820e4640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a6806c2e0 0x7f9a6806e7a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c001db0 tx=0x7f9a6c009040 comp rx=0 tx=0).stop 2024-09-16T01:19:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.401+0000 7f9a820e4640 1 -- 172.21.15.81:0/3717418044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7c072d30 msgr2=0x7f9a7c06e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.401+0000 7f9a820e4640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7c072d30 0x7f9a7c06e0b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9a700098c0 tx=0x7f9a700046c0 comp rx=0 tx=0).stop 2024-09-16T01:19:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.401+0000 7f9a820e4640 1 -- 172.21.15.81:0/3717418044 shutdown_connections 2024-09-16T01:19:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.401+0000 7f9a820e4640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a6806c2e0 0x7f9a6806e7a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.401+0000 7f9a820e4640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a7c15b300 0x7f9a7c06e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:37.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.401+0000 7f9a820e4640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a7c072d30 0x7f9a7c06e0b0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:37.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.401+0000 7f9a820e4640 1 --2- 172.21.15.81:0/3717418044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a7c06f700 0x7f9a7c0b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:37.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.401+0000 7f9a820e4640 1 -- 172.21.15.81:0/3717418044 >> 172.21.15.81:0/3717418044 conn(0x7f9a7c067d70 msgr2=0x7f9a7c15bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:37.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.401+0000 7f9a820e4640 1 -- 172.21.15.81:0/3717418044 shutdown_connections 2024-09-16T01:19:37.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:37.401+0000 7f9a820e4640 1 -- 172.21.15.81:0/3717418044 wait complete. 2024-09-16T01:19:37.413 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:19:37.413 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:19:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:38.783 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:19:38.787 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:19:40.051 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:42.053 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:42.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:19:42.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.522+0000 7fa13456d640 1 Processor -- start 2024-09-16T01:19:42.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.522+0000 7fa13456d640 1 -- start start 2024-09-16T01:19:42.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.523+0000 7fa13456d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa12c15b300 0x7fa12c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:42.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.523+0000 7fa13456d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa12c0cd3f0 0x7fa12c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:42.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.523+0000 7fa13456d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12c0cdbe0 con 0x7fa12c072d30 2024-09-16T01:19:42.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.523+0000 7fa13456d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa12c0728a0 con 0x7fa12c0cd3f0 2024-09-16T01:19:42.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.523+0000 7fa13456d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa12c0cd900 con 0x7fa12c15b300 2024-09-16T01:19:42.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.523+0000 7fa131b08640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa12c0cd3f0 0x7fa12c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.523+0000 7fa131b08640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa12c0cd3f0 0x7fa12c06f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57232/0 (socket says 172.21.15.81:57232) 2024-09-16T01:19:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.523+0000 7fa131b08640 1 -- 172.21.15.81:0/2557125956 learned_addr learned my addr 172.21.15.81:0/2557125956 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.523+0000 7fa132b0a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa12c072d30 0x7fa12c0b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60586/0 (socket says 172.21.15.81:60586) 2024-09-16T01:19:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.524+0000 7fa132309640 1 --2- 172.21.15.81:0/2557125956 >> v2:172.21.15.102:3300/0 conn(0x7fa12c15b300 0x7fa12c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.524+0000 7fa131b08640 1 -- 172.21.15.81:0/2557125956 >> v2:172.21.15.102:3300/0 conn(0x7fa12c15b300 msgr2=0x7fa12c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.524+0000 7fa131b08640 1 --2- 172.21.15.81:0/2557125956 >> v2:172.21.15.102:3300/0 conn(0x7fa12c15b300 0x7fa12c0cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.524+0000 7fa131b08640 1 -- 172.21.15.81:0/2557125956 >> v1:172.21.15.81:6789/0 conn(0x7fa12c072d30 legacy=0x7fa12c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.524+0000 7fa131b08640 1 -- 172.21.15.81:0/2557125956 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c072250 con 0x7fa12c0cd3f0 2024-09-16T01:19:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.524+0000 7fa131b08640 1 --2- 172.21.15.81:0/2557125956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0cd3f0 0x7fa12c06f1c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa12c070250 tx=0x7fa11c02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ad8f6dc2933028 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.524+0000 7fa131307640 1 -- 172.21.15.81:0/2557125956 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c036020 con 0x7fa12c0cd3f0 2024-09-16T01:19:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.525+0000 7fa131307640 1 -- 172.21.15.81:0/2557125956 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa11c032640 con 0x7fa12c0cd3f0 2024-09-16T01:19:42.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.525+0000 7fa131307640 1 -- 172.21.15.81:0/2557125956 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c032a10 con 0x7fa12c0cd3f0 2024-09-16T01:19:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.525+0000 7fa13456d640 1 -- 172.21.15.81:0/2557125956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0cd3f0 msgr2=0x7fa12c06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.525+0000 7fa13456d640 1 --2- 172.21.15.81:0/2557125956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0cd3f0 0x7fa12c06f1c0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fa12c070250 tx=0x7fa11c02c940 comp rx=0 tx=0).stop 2024-09-16T01:19:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.525+0000 7fa13456d640 1 -- 172.21.15.81:0/2557125956 shutdown_connections 2024-09-16T01:19:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.525+0000 7fa13456d640 1 --2- 172.21.15.81:0/2557125956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c0cd3f0 0x7fa12c06f1c0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.525+0000 7fa13456d640 1 --2- 172.21.15.81:0/2557125956 >> v2:172.21.15.102:3300/0 conn(0x7fa12c15b300 0x7fa12c0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:42.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.525+0000 7fa13456d640 1 -- 172.21.15.81:0/2557125956 >> 172.21.15.81:0/2557125956 conn(0x7fa12c067d70 msgr2=0x7fa12c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.525+0000 7fa13456d640 1 -- 172.21.15.81:0/2557125956 shutdown_connections 2024-09-16T01:19:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.525+0000 7fa13456d640 1 -- 172.21.15.81:0/2557125956 wait complete. 2024-09-16T01:19:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.526+0000 7fa13456d640 1 Processor -- start 2024-09-16T01:19:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.526+0000 7fa13456d640 1 -- start start 2024-09-16T01:19:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.527+0000 7fa13456d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa12c072d30 0x7fa12c0b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.527+0000 7fa13456d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa12c0cd3f0 0x7fa12c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.527+0000 7fa13456d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c15b300 0x7fa12c152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.527+0000 7fa13456d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c0d0160 con 0x7fa12c15b300 2024-09-16T01:19:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.527+0000 7fa13456d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c0cffe0 con 0x7fa12c0cd3f0 2024-09-16T01:19:42.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.527+0000 7fa13456d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa12c06f700 con 0x7fa12c072d30 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.527+0000 7fa132b0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c15b300 0x7fa12c152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.527+0000 7fa132b0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c15b300 0x7fa12c152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57240/0 (socket says 172.21.15.81:57240) 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.527+0000 7fa132b0a640 1 -- 172.21.15.81:0/3740218103 learned_addr learned my addr 172.21.15.81:0/3740218103 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa132309640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa12c072d30 0x7fa12c0b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa131b08640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa12c0cd3f0 0x7fa12c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa132b0a640 1 -- 172.21.15.81:0/3740218103 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa12c072d30 msgr2=0x7fa12c0b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa132b0a640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa12c072d30 0x7fa12c0b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa132b0a640 1 -- 172.21.15.81:0/3740218103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa12c0cd3f0 msgr2=0x7fa12c152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa132b0a640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa12c0cd3f0 0x7fa12c152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa132b0a640 1 -- 172.21.15.81:0/3740218103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c155410 con 0x7fa12c15b300 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa131b08640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa12c0cd3f0 0x7fa12c152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa132b0a640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c15b300 0x7fa12c152a50 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c7b0 tx=0x7fa12400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:42.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa122ffd640 1 -- 172.21.15.81:0/3740218103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa124017070 con 0x7fa12c15b300 2024-09-16T01:19:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa122ffd640 1 -- 172.21.15.81:0/3740218103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa12400a640 con 0x7fa12c15b300 2024-09-16T01:19:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa13456d640 1 -- 172.21.15.81:0/3740218103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa12c1556f0 con 0x7fa12c15b300 2024-09-16T01:19:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa122ffd640 1 -- 172.21.15.81:0/3740218103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12400a9f0 con 0x7fa12c15b300 2024-09-16T01:19:42.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.528+0000 7fa13456d640 1 -- 172.21.15.81:0/3740218103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa12c155cb0 con 0x7fa12c15b300 2024-09-16T01:19:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.529+0000 7fa13456d640 1 -- 172.21.15.81:0/3740218103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa12c06fac0 con 0x7fa12c15b300 2024-09-16T01:19:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.529+0000 7fa122ffd640 1 -- 172.21.15.81:0/3740218103 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa12401a070 con 0x7fa12c15b300 2024-09-16T01:19:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.530+0000 7fa122ffd640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa11006c2b0 0x7fa11006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.530+0000 7fa122ffd640 1 -- 172.21.15.81:0/3740218103 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fa12408aaf0 con 0x7fa12c15b300 2024-09-16T01:19:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.530+0000 7fa132309640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa11006c2b0 0x7fa11006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:42.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.530+0000 7fa132309640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa11006c2b0 0x7fa11006e770 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa128006fd0 tx=0x7fa128008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:42.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.534+0000 7fa122ffd640 1 -- 172.21.15.81:0/3740218103 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa124058aa0 con 0x7fa12c15b300 2024-09-16T01:19:42.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.733+0000 7fa13456d640 1 -- 172.21.15.81:0/3740218103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa12c15bf80 con 0x7fa12c15b300 2024-09-16T01:19:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.733+0000 7fa122ffd640 1 -- 172.21.15.81:0/3740218103 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fa12405cda0 con 0x7fa12c15b300 2024-09-16T01:19:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:42.734 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:19:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.735+0000 7fa13456d640 1 -- 172.21.15.81:0/3740218103 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa11006c2b0 msgr2=0x7fa11006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.735+0000 7fa13456d640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa11006c2b0 0x7fa11006e770 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa128006fd0 tx=0x7fa128008040 comp rx=0 tx=0).stop 2024-09-16T01:19:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.735+0000 7fa13456d640 1 -- 172.21.15.81:0/3740218103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c15b300 msgr2=0x7fa12c152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.735+0000 7fa13456d640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c15b300 0x7fa12c152a50 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fa12400c7b0 tx=0x7fa12400cc70 comp rx=0 tx=0).stop 2024-09-16T01:19:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.735+0000 7fa13456d640 1 -- 172.21.15.81:0/3740218103 shutdown_connections 2024-09-16T01:19:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.735+0000 7fa13456d640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa11006c2b0 0x7fa11006e770 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.735+0000 7fa13456d640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa12c15b300 0x7fa12c152a50 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.735+0000 7fa13456d640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa12c0cd3f0 0x7fa12c152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.735+0000 7fa13456d640 1 --2- 172.21.15.81:0/3740218103 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa12c072d30 0x7fa12c0b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.735+0000 7fa13456d640 1 -- 172.21.15.81:0/3740218103 >> 172.21.15.81:0/3740218103 conn(0x7fa12c067d70 msgr2=0x7fa12c15d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.735+0000 7fa13456d640 1 -- 172.21.15.81:0/3740218103 shutdown_connections 2024-09-16T01:19:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:42.735+0000 7fa13456d640 1 -- 172.21.15.81:0/3740218103 wait complete. 2024-09-16T01:19:42.747 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:19:42.747 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:19:44.055 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:46.057 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:47.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:19:47.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.856+0000 7f5eec6d0640 1 Processor -- start 2024-09-16T01:19:47.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.856+0000 7f5eec6d0640 1 -- start start 2024-09-16T01:19:47.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.857+0000 7f5eec6d0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ee415ba30 0x7f5ee406f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:47.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.857+0000 7f5eec6d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5ee406fd50 0x7f5ee4072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:47.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.857+0000 7f5eec6d0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ee4072e80 0x7f5ee406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:47.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.857+0000 7f5eec6d0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5ee40b4180 con 0x7f5ee415ba30 2024-09-16T01:19:47.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.857+0000 7f5eec6d0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5ee40b3570 con 0x7f5ee406fd50 2024-09-16T01:19:47.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.857+0000 7f5eec6d0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee40b3850 con 0x7f5ee4072e80 2024-09-16T01:19:47.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.857+0000 7f5eea46c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ee415ba30 0x7f5ee406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:47.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.857+0000 7f5eea46c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ee415ba30 0x7f5ee406f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57256/0 (socket says 172.21.15.81:57256) 2024-09-16T01:19:47.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.857+0000 7f5eea46c640 1 -- 172.21.15.81:0/829820059 learned_addr learned my addr 172.21.15.81:0/829820059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:47.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.858+0000 7f5eea46c640 1 -- 172.21.15.81:0/829820059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ee4072e80 msgr2=0x7f5ee406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:47.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.858+0000 7f5ee9c6b640 1 --2- 172.21.15.81:0/829820059 >> v2:172.21.15.102:3300/0 conn(0x7f5ee406fd50 0x7f5ee4072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:47.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.858+0000 7f5eeac6d640 1 --2- 172.21.15.81:0/829820059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ee4072e80 0x7f5ee406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:47.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.858+0000 7f5eea46c640 1 --2- 172.21.15.81:0/829820059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ee4072e80 0x7f5ee406e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:47.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.858+0000 7f5eea46c640 1 -- 172.21.15.81:0/829820059 >> v2:172.21.15.102:3300/0 conn(0x7f5ee406fd50 msgr2=0x7f5ee4072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:47.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.858+0000 7f5eea46c640 1 --2- 172.21.15.81:0/829820059 >> v2:172.21.15.102:3300/0 conn(0x7f5ee406fd50 0x7f5ee4072940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:47.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.858+0000 7f5eea46c640 1 -- 172.21.15.81:0/829820059 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee40b3b30 con 0x7f5ee415ba30 2024-09-16T01:19:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.858+0000 7f5eea46c640 1 --2- 172.21.15.81:0/829820059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee415ba30 0x7f5ee406f810 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40cfff0 tx=0x7f5ee002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e07227954bf495 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.858+0000 7f5ee946a640 1 -- 172.21.15.81:0/829820059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0037070 con 0x7f5ee415ba30 2024-09-16T01:19:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.859+0000 7f5ee946a640 1 -- 172.21.15.81:0/829820059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee0032440 con 0x7f5ee415ba30 2024-09-16T01:19:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.859+0000 7f5ee946a640 1 -- 172.21.15.81:0/829820059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0032810 con 0x7f5ee415ba30 2024-09-16T01:19:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.859+0000 7f5eec6d0640 1 -- 172.21.15.81:0/829820059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee415ba30 msgr2=0x7f5ee406f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.859+0000 7f5eec6d0640 1 --2- 172.21.15.81:0/829820059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee415ba30 0x7f5ee406f810 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40cfff0 tx=0x7f5ee002a1e0 comp rx=0 tx=0).stop 2024-09-16T01:19:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.859+0000 7f5eec6d0640 1 -- 172.21.15.81:0/829820059 shutdown_connections 2024-09-16T01:19:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.859+0000 7f5eec6d0640 1 --2- 172.21.15.81:0/829820059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ee4072e80 0x7f5ee406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.859+0000 7f5eec6d0640 1 --2- 172.21.15.81:0/829820059 >> v2:172.21.15.102:3300/0 conn(0x7f5ee406fd50 0x7f5ee4072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.859+0000 7f5eec6d0640 1 --2- 172.21.15.81:0/829820059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee415ba30 0x7f5ee406f810 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.859+0000 7f5eec6d0640 1 -- 172.21.15.81:0/829820059 >> 172.21.15.81:0/829820059 conn(0x7f5ee4067d70 msgr2=0x7f5ee406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.859+0000 7f5eec6d0640 1 -- 172.21.15.81:0/829820059 shutdown_connections 2024-09-16T01:19:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.859+0000 7f5eec6d0640 1 -- 172.21.15.81:0/829820059 wait complete. 2024-09-16T01:19:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.860+0000 7f5eec6d0640 1 Processor -- start 2024-09-16T01:19:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.860+0000 7f5eec6d0640 1 -- start start 2024-09-16T01:19:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.861+0000 7f5eec6d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406fd50 0x7f5ee4153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.861+0000 7f5eec6d0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ee4072e80 0x7f5ee40a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.861+0000 7f5eec6d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee415ba30 0x7f5ee41448e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.861+0000 7f5eec6d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee40ce810 con 0x7f5ee406fd50 2024-09-16T01:19:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.861+0000 7f5eec6d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee40b5990 con 0x7f5ee415ba30 2024-09-16T01:19:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.861+0000 7f5eec6d0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee40ccfe0 con 0x7f5ee4072e80 2024-09-16T01:19:47.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.861+0000 7f5eea46c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406fd50 0x7f5ee4153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.861+0000 7f5eea46c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406fd50 0x7f5ee4153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57266/0 (socket says 172.21.15.81:57266) 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.861+0000 7f5eea46c640 1 -- 172.21.15.81:0/2623639394 learned_addr learned my addr 172.21.15.81:0/2623639394 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.861+0000 7f5eeac6d640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee415ba30 0x7f5ee41448e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.861+0000 7f5ee9c6b640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ee4072e80 0x7f5ee40a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5eea46c640 1 -- 172.21.15.81:0/2623639394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ee4072e80 msgr2=0x7f5ee40a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5eea46c640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ee4072e80 0x7f5ee40a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5eea46c640 1 -- 172.21.15.81:0/2623639394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee415ba30 msgr2=0x7f5ee41448e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5eea46c640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee415ba30 0x7f5ee41448e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5eea46c640 1 -- 172.21.15.81:0/2623639394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee4141dd0 con 0x7f5ee406fd50 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5eeac6d640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee415ba30 0x7f5ee41448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5ee9c6b640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ee4072e80 0x7f5ee40a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5eea46c640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406fd50 0x7f5ee4153fa0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5ee002a220 tx=0x7f5ee00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5edaffd640 1 -- 172.21.15.81:0/2623639394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0037040 con 0x7f5ee406fd50 2024-09-16T01:19:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5edaffd640 1 -- 172.21.15.81:0/2623639394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee0042070 con 0x7f5ee406fd50 2024-09-16T01:19:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5eec6d0640 1 -- 172.21.15.81:0/2623639394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee41420b0 con 0x7f5ee406fd50 2024-09-16T01:19:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5edaffd640 1 -- 172.21.15.81:0/2623639394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0030bb0 con 0x7f5ee406fd50 2024-09-16T01:19:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.862+0000 7f5eec6d0640 1 -- 172.21.15.81:0/2623639394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee4142670 con 0x7f5ee406fd50 2024-09-16T01:19:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.863+0000 7f5eec6d0640 1 -- 172.21.15.81:0/2623639394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee406f810 con 0x7f5ee406fd50 2024-09-16T01:19:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.863+0000 7f5edaffd640 1 -- 172.21.15.81:0/2623639394 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5ee0047460 con 0x7f5ee406fd50 2024-09-16T01:19:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.864+0000 7f5edaffd640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5ec806c2e0 0x7f5ec806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:47.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.864+0000 7f5edaffd640 1 -- 172.21.15.81:0/2623639394 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f5ee00ac270 con 0x7f5ee406fd50 2024-09-16T01:19:47.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.864+0000 7f5ee9c6b640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5ec806c2e0 0x7f5ec806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:47.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.864+0000 7f5ee9c6b640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5ec806c2e0 0x7f5ec806e7a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4075950 tx=0x7f5ed4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:47.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:47.868+0000 7f5edaffd640 1 -- 172.21.15.81:0/2623639394 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ee0045360 con 0x7f5ee406fd50 2024-09-16T01:19:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:48.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.077+0000 7f5eec6d0640 1 -- 172.21.15.81:0/2623639394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5ee415def0 con 0x7f5ee406fd50 2024-09-16T01:19:48.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.077+0000 7f5edaffd640 1 -- 172.21.15.81:0/2623639394 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f5ee007a7e0 con 0x7f5ee406fd50 2024-09-16T01:19:48.079 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:48.079 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:19:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.079+0000 7f5eec6d0640 1 -- 172.21.15.81:0/2623639394 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5ec806c2e0 msgr2=0x7f5ec806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.079+0000 7f5eec6d0640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5ec806c2e0 0x7f5ec806e7a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4075950 tx=0x7f5ed4008040 comp rx=0 tx=0).stop 2024-09-16T01:19:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.079+0000 7f5eec6d0640 1 -- 172.21.15.81:0/2623639394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406fd50 msgr2=0x7f5ee4153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.079+0000 7f5eec6d0640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406fd50 0x7f5ee4153fa0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5ee002a220 tx=0x7f5ee00046c0 comp rx=0 tx=0).stop 2024-09-16T01:19:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.079+0000 7f5eec6d0640 1 -- 172.21.15.81:0/2623639394 shutdown_connections 2024-09-16T01:19:48.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.079+0000 7f5eec6d0640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5ec806c2e0 0x7f5ec806e7a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:48.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.079+0000 7f5eec6d0640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee415ba30 0x7f5ee41448e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:48.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.079+0000 7f5eec6d0640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5ee4072e80 0x7f5ee40a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:48.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.079+0000 7f5eec6d0640 1 --2- 172.21.15.81:0/2623639394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee406fd50 0x7f5ee4153fa0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:48.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.079+0000 7f5eec6d0640 1 -- 172.21.15.81:0/2623639394 >> 172.21.15.81:0/2623639394 conn(0x7f5ee4067d70 msgr2=0x7f5ee40b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:48.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.079+0000 7f5eec6d0640 1 -- 172.21.15.81:0/2623639394 shutdown_connections 2024-09-16T01:19:48.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:48.079+0000 7f5eec6d0640 1 -- 172.21.15.81:0/2623639394 wait complete. 2024-09-16T01:19:48.092 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:19:48.092 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:19:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:52.062 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:53.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:19:53.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.201+0000 7f68f7e0e640 1 Processor -- start 2024-09-16T01:19:53.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.202+0000 7f68f7e0e640 1 -- start start 2024-09-16T01:19:53.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.202+0000 7f68f7e0e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68f015b300 0x7f68f00cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:53.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.202+0000 7f68f7e0e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68f00cd3f0 0x7f68f006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:53.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.202+0000 7f68f7e0e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f68f0072d30 0x7f68f006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:53.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.202+0000 7f68f7e0e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f68f00728a0 con 0x7f68f00cd3f0 2024-09-16T01:19:53.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.202+0000 7f68f7e0e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f68f00cdbe0 con 0x7f68f0072d30 2024-09-16T01:19:53.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.202+0000 7f68f7e0e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f68f00cd900 con 0x7f68f015b300 2024-09-16T01:19:53.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.203+0000 7f68f53a9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68f00cd3f0 0x7f68f006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:53.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.203+0000 7f68f53a9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68f00cd3f0 0x7f68f006f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37966/0 (socket says 172.21.15.81:37966) 2024-09-16T01:19:53.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.203+0000 7f68f53a9640 1 -- 172.21.15.81:0/2413330286 learned_addr learned my addr 172.21.15.81:0/2413330286 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:53.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.203+0000 7f68f5baa640 1 --2- 172.21.15.81:0/2413330286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68f015b300 0x7f68f00cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:53.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.203+0000 7f68f63ab640 1 --2- 172.21.15.81:0/2413330286 >> v2:172.21.15.102:3300/0 conn(0x7f68f0072d30 0x7f68f006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:53.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.203+0000 7f68f53a9640 1 -- 172.21.15.81:0/2413330286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68f015b300 msgr2=0x7f68f00cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:53.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.203+0000 7f68f53a9640 1 --2- 172.21.15.81:0/2413330286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68f015b300 0x7f68f00cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.203+0000 7f68f53a9640 1 -- 172.21.15.81:0/2413330286 >> v2:172.21.15.102:3300/0 conn(0x7f68f0072d30 msgr2=0x7f68f006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:53.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.203+0000 7f68f53a9640 1 --2- 172.21.15.81:0/2413330286 >> v2:172.21.15.102:3300/0 conn(0x7f68f0072d30 0x7f68f006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.203+0000 7f68f53a9640 1 -- 172.21.15.81:0/2413330286 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f0072250 con 0x7f68f00cd3f0 2024-09-16T01:19:53.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.204+0000 7f68f53a9640 1 --2- 172.21.15.81:0/2413330286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68f00cd3f0 0x7f68f006f1c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f68f0072040 tx=0x7f68e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d164dac5a31db4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:53.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.204+0000 7f68f4ba8640 1 -- 172.21.15.81:0/2413330286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e0037070 con 0x7f68f00cd3f0 2024-09-16T01:19:53.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.204+0000 7f68f4ba8640 1 -- 172.21.15.81:0/2413330286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e0032440 con 0x7f68f00cd3f0 2024-09-16T01:19:53.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.204+0000 7f68f4ba8640 1 -- 172.21.15.81:0/2413330286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e0032810 con 0x7f68f00cd3f0 2024-09-16T01:19:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.204+0000 7f68f7e0e640 1 -- 172.21.15.81:0/2413330286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68f00cd3f0 msgr2=0x7f68f006f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.204+0000 7f68f7e0e640 1 --2- 172.21.15.81:0/2413330286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68f00cd3f0 0x7f68f006f1c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f68f0072040 tx=0x7f68e002a1e0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.204+0000 7f68f7e0e640 1 -- 172.21.15.81:0/2413330286 shutdown_connections 2024-09-16T01:19:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.204+0000 7f68f7e0e640 1 --2- 172.21.15.81:0/2413330286 >> v2:172.21.15.102:3300/0 conn(0x7f68f0072d30 0x7f68f006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.204+0000 7f68f7e0e640 1 --2- 172.21.15.81:0/2413330286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68f00cd3f0 0x7f68f006f1c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.204+0000 7f68f7e0e640 1 --2- 172.21.15.81:0/2413330286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68f015b300 0x7f68f00cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.204+0000 7f68f7e0e640 1 -- 172.21.15.81:0/2413330286 >> 172.21.15.81:0/2413330286 conn(0x7f68f0067d70 msgr2=0x7f68f006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.204+0000 7f68f7e0e640 1 -- 172.21.15.81:0/2413330286 shutdown_connections 2024-09-16T01:19:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.205+0000 7f68f7e0e640 1 -- 172.21.15.81:0/2413330286 wait complete. 2024-09-16T01:19:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.206+0000 7f68f7e0e640 1 Processor -- start 2024-09-16T01:19:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.206+0000 7f68f7e0e640 1 -- start start 2024-09-16T01:19:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.206+0000 7f68f7e0e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f0072d30 0x7f68f0145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.206+0000 7f68f7e0e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68f00cd3f0 0x7f68f0159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.206+0000 7f68f7e0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68f015b300 0x7f68f0155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.206+0000 7f68f7e0e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68f00d0160 con 0x7f68f015b300 2024-09-16T01:19:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.206+0000 7f68f7e0e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f68f00cffe0 con 0x7f68f0072d30 2024-09-16T01:19:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.206+0000 7f68f7e0e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f68f00b3c40 con 0x7f68f00cd3f0 2024-09-16T01:19:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f63ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68f015b300 0x7f68f0155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f63ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68f015b300 0x7f68f0155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37980/0 (socket says 172.21.15.81:37980) 2024-09-16T01:19:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f63ab640 1 -- 172.21.15.81:0/1516058146 learned_addr learned my addr 172.21.15.81:0/1516058146 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f5baa640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f0072d30 0x7f68f0145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f53a9640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68f00cd3f0 0x7f68f0159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f63ab640 1 -- 172.21.15.81:0/1516058146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68f00cd3f0 msgr2=0x7f68f0159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f63ab640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68f00cd3f0 0x7f68f0159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f63ab640 1 -- 172.21.15.81:0/1516058146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f0072d30 msgr2=0x7f68f0145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f63ab640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f0072d30 0x7f68f0145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f63ab640 1 -- 172.21.15.81:0/1516058146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f01527c0 con 0x7f68f015b300 2024-09-16T01:19:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f63ab640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68f015b300 0x7f68f0155100 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f68e8007e90 tx=0x7f68e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68e67fc640 1 -- 172.21.15.81:0/1516058146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8014420 con 0x7f68f015b300 2024-09-16T01:19:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68e67fc640 1 -- 172.21.15.81:0/1516058146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e8019070 con 0x7f68f015b300 2024-09-16T01:19:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68e67fc640 1 -- 172.21.15.81:0/1516058146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8014820 con 0x7f68f015b300 2024-09-16T01:19:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f7e0e640 1 -- 172.21.15.81:0/1516058146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f0159ea0 con 0x7f68f015b300 2024-09-16T01:19:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.207+0000 7f68f7e0e640 1 -- 172.21.15.81:0/1516058146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f0152d40 con 0x7f68f015b300 2024-09-16T01:19:53.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.208+0000 7f68f7e0e640 1 -- 172.21.15.81:0/1516058146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f015cf90 con 0x7f68f015b300 2024-09-16T01:19:53.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.209+0000 7f68e67fc640 1 -- 172.21.15.81:0/1516058146 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f68e80149c0 con 0x7f68f015b300 2024-09-16T01:19:53.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.209+0000 7f68e67fc640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f68d406c2b0 0x7f68d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:53.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.209+0000 7f68e67fc640 1 -- 172.21.15.81:0/1516058146 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f68e808bdc0 con 0x7f68f015b300 2024-09-16T01:19:53.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.209+0000 7f68f5baa640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f68d406c2b0 0x7f68d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:53.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.210+0000 7f68f5baa640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f68d406c2b0 0x7f68d406e770 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0079a0 tx=0x7f68ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:53.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.214+0000 7f68e67fc640 1 -- 172.21.15.81:0/1516058146 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f68e8059c50 con 0x7f68f015b300 2024-09-16T01:19:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.412+0000 7f68f7e0e640 1 -- 172.21.15.81:0/1516058146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f68f015ccb0 con 0x7f68f015b300 2024-09-16T01:19:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.413+0000 7f68e67fc640 1 -- 172.21.15.81:0/1516058146 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f68e805df50 con 0x7f68f015b300 2024-09-16T01:19:53.415 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:53.415 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:19:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.415+0000 7f68f7e0e640 1 -- 172.21.15.81:0/1516058146 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f68d406c2b0 msgr2=0x7f68d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.415+0000 7f68f7e0e640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f68d406c2b0 0x7f68d406e770 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0079a0 tx=0x7f68ec008040 comp rx=0 tx=0).stop 2024-09-16T01:19:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.415+0000 7f68f7e0e640 1 -- 172.21.15.81:0/1516058146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68f015b300 msgr2=0x7f68f0155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.415+0000 7f68f7e0e640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68f015b300 0x7f68f0155100 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f68e8007e90 tx=0x7f68e800e4b0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.415+0000 7f68f7e0e640 1 -- 172.21.15.81:0/1516058146 shutdown_connections 2024-09-16T01:19:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.415+0000 7f68f7e0e640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f68d406c2b0 0x7f68d406e770 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.415+0000 7f68f7e0e640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68f015b300 0x7f68f0155100 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.415+0000 7f68f7e0e640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f68f00cd3f0 0x7f68f0159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.415+0000 7f68f7e0e640 1 --2- 172.21.15.81:0/1516058146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68f0072d30 0x7f68f0145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.415+0000 7f68f7e0e640 1 -- 172.21.15.81:0/1516058146 >> 172.21.15.81:0/1516058146 conn(0x7f68f0067d70 msgr2=0x7f68f015b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.415+0000 7f68f7e0e640 1 -- 172.21.15.81:0/1516058146 shutdown_connections 2024-09-16T01:19:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:53.415+0000 7f68f7e0e640 1 -- 172.21.15.81:0/1516058146 wait complete. 2024-09-16T01:19:53.427 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:19:53.427 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:19:54.064 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:56.066 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:58.068 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:19:58.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:19:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.535+0000 7fbadc311640 1 Processor -- start 2024-09-16T01:19:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.535+0000 7fbadc311640 1 -- start start 2024-09-16T01:19:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbadc311640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbad4072940 0x7fbad4072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbadc311640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbad40b4880 0x7fbad40b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbadc311640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad40b3570 con 0x7fbad415ba30 2024-09-16T01:19:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbadc311640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fbad40732e0 con 0x7fbad40b4880 2024-09-16T01:19:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbadc311640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbad40b4180 con 0x7fbad4072940 2024-09-16T01:19:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbada8ae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbad40b4880 0x7fbad40b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbada8ae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbad40b4880 0x7fbad40b4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37984/0 (socket says 172.21.15.81:37984) 2024-09-16T01:19:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbada8ae640 1 -- 172.21.15.81:0/2405253080 learned_addr learned my addr 172.21.15.81:0/2405253080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbad98ac640 1 --2- 172.21.15.81:0/2405253080 >> v2:172.21.15.102:3300/0 conn(0x7fbad4072940 0x7fbad4072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbada8ae640 1 -- 172.21.15.81:0/2405253080 >> v2:172.21.15.102:3300/0 conn(0x7fbad4072940 msgr2=0x7fbad4072da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbada8ae640 1 --2- 172.21.15.81:0/2405253080 >> v2:172.21.15.102:3300/0 conn(0x7fbad4072940 0x7fbad4072da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbada8ae640 1 -- 172.21.15.81:0/2405253080 >> v1:172.21.15.102:6789/0 conn(0x7fbad415ba30 legacy=0x7fbad406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:19:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbada8ae640 1 -- 172.21.15.81:0/2405253080 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad40b3850 con 0x7fbad40b4880 2024-09-16T01:19:58.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.536+0000 7fbad98ac640 1 --2- 172.21.15.81:0/2405253080 >> v2:172.21.15.102:3300/0 conn(0x7fbad4072940 0x7fbad4072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.537+0000 7fbada8ae640 1 --2- 172.21.15.81:0/2405253080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad40b4880 0x7fbad40b4d10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fbad40cfff0 tx=0x7fbacc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793ec3ae2a48a08e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.537+0000 7fbad90ab640 1 -- 172.21.15.81:0/2405253080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc036070 con 0x7fbad40b4880 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.537+0000 7fbad90ab640 1 -- 172.21.15.81:0/2405253080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc031600 con 0x7fbad40b4880 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.537+0000 7fbad90ab640 1 -- 172.21.15.81:0/2405253080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc0319d0 con 0x7fbad40b4880 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.538+0000 7fbadc311640 1 -- 172.21.15.81:0/2405253080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad40b4880 msgr2=0x7fbad40b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.538+0000 7fbadc311640 1 --2- 172.21.15.81:0/2405253080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad40b4880 0x7fbad40b4d10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fbad40cfff0 tx=0x7fbacc02a730 comp rx=0 tx=0).stop 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.538+0000 7fbadc311640 1 -- 172.21.15.81:0/2405253080 shutdown_connections 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.538+0000 7fbadc311640 1 --2- 172.21.15.81:0/2405253080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad40b4880 0x7fbad40b4d10 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.538+0000 7fbadc311640 1 --2- 172.21.15.81:0/2405253080 >> v2:172.21.15.102:3300/0 conn(0x7fbad4072940 0x7fbad4072da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.538+0000 7fbadc311640 1 -- 172.21.15.81:0/2405253080 >> 172.21.15.81:0/2405253080 conn(0x7fbad4067d70 msgr2=0x7fbad406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.538+0000 7fbadc311640 1 -- 172.21.15.81:0/2405253080 shutdown_connections 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.538+0000 7fbadc311640 1 -- 172.21.15.81:0/2405253080 wait complete. 2024-09-16T01:19:58.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.539+0000 7fbadc311640 1 Processor -- start 2024-09-16T01:19:58.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.539+0000 7fbadc311640 1 -- start start 2024-09-16T01:19:58.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbadc311640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbad4072940 0x7fbad4149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:58.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbadc311640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbad40b4880 0x7fbad4151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbadc311640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad415ba30 0x7fbad414a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbadc311640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbad406ff20 con 0x7fbad415ba30 2024-09-16T01:19:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbadc311640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbad40b3e10 con 0x7fbad40b4880 2024-09-16T01:19:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbadc311640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbad40ce810 con 0x7fbad4072940 2024-09-16T01:19:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbada8ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad415ba30 0x7fbad414a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbada8ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad415ba30 0x7fbad414a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37990/0 (socket says 172.21.15.81:37990) 2024-09-16T01:19:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbada8ae640 1 -- 172.21.15.81:0/2684289985 learned_addr learned my addr 172.21.15.81:0/2684289985 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:19:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbada0ad640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbad4072940 0x7fbad4149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbad98ac640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbad40b4880 0x7fbad4151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbada8ae640 1 -- 172.21.15.81:0/2684289985 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbad4072940 msgr2=0x7fbad4149c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbada8ae640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbad4072940 0x7fbad4149c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:58.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbada8ae640 1 -- 172.21.15.81:0/2684289985 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbad40b4880 msgr2=0x7fbad4151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbada8ae640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbad40b4880 0x7fbad4151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.540+0000 7fbada8ae640 1 -- 172.21.15.81:0/2684289985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad41511f0 con 0x7fbad415ba30 2024-09-16T01:19:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.541+0000 7fbada8ae640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad415ba30 0x7fbad414a810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009f40 tx=0x7fbacc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.541+0000 7fbacaffd640 1 -- 172.21.15.81:0/2684289985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc036050 con 0x7fbad415ba30 2024-09-16T01:19:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.541+0000 7fbacaffd640 1 -- 172.21.15.81:0/2684289985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc042070 con 0x7fbad415ba30 2024-09-16T01:19:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.541+0000 7fbacaffd640 1 -- 172.21.15.81:0/2684289985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc009510 con 0x7fbad415ba30 2024-09-16T01:19:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.541+0000 7fbadc311640 1 -- 172.21.15.81:0/2684289985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad41514d0 con 0x7fbad415ba30 2024-09-16T01:19:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.541+0000 7fbadc311640 1 -- 172.21.15.81:0/2684289985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad4151a90 con 0x7fbad415ba30 2024-09-16T01:19:58.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.542+0000 7fbadc311640 1 -- 172.21.15.81:0/2684289985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad40ccfe0 con 0x7fbad415ba30 2024-09-16T01:19:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.542+0000 7fbacaffd640 1 -- 172.21.15.81:0/2684289985 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbacc007bf0 con 0x7fbad415ba30 2024-09-16T01:19:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.543+0000 7fbacaffd640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbab806c2b0 0x7fbab806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:19:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.543+0000 7fbada0ad640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbab806c2b0 0x7fbab806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:19:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.543+0000 7fbacaffd640 1 -- 172.21.15.81:0/2684289985 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fbacc0ac430 con 0x7fbad415ba30 2024-09-16T01:19:58.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.543+0000 7fbada0ad640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbab806c2b0 0x7fbab806e770 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbad00016e0 tx=0x7fbad0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:19:58.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.547+0000 7fbacaffd640 1 -- 172.21.15.81:0/2684289985 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbacc07a340 con 0x7fbad415ba30 2024-09-16T01:19:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.746+0000 7fbadc311640 1 -- 172.21.15.81:0/2684289985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbad4151c60 con 0x7fbad415ba30 2024-09-16T01:19:58.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.746+0000 7fbacaffd640 1 -- 172.21.15.81:0/2684289985 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fbacc07e640 con 0x7fbad415ba30 2024-09-16T01:19:58.748 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:19:58.748 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:19:58.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.748+0000 7fbadc311640 1 -- 172.21.15.81:0/2684289985 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbab806c2b0 msgr2=0x7fbab806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:58.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.748+0000 7fbadc311640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbab806c2b0 0x7fbab806e770 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbad00016e0 tx=0x7fbad0009040 comp rx=0 tx=0).stop 2024-09-16T01:19:58.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.748+0000 7fbadc311640 1 -- 172.21.15.81:0/2684289985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad415ba30 msgr2=0x7fbad414a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:19:58.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.748+0000 7fbadc311640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad415ba30 0x7fbad414a810 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009f40 tx=0x7fbacc004a40 comp rx=0 tx=0).stop 2024-09-16T01:19:58.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.748+0000 7fbadc311640 1 -- 172.21.15.81:0/2684289985 shutdown_connections 2024-09-16T01:19:58.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.748+0000 7fbadc311640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbab806c2b0 0x7fbab806e770 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:58.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.748+0000 7fbadc311640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbad415ba30 0x7fbad414a810 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:58.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.748+0000 7fbadc311640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbad40b4880 0x7fbad4151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:58.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.748+0000 7fbadc311640 1 --2- 172.21.15.81:0/2684289985 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbad4072940 0x7fbad4149c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:19:58.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.748+0000 7fbadc311640 1 -- 172.21.15.81:0/2684289985 >> 172.21.15.81:0/2684289985 conn(0x7fbad4067d70 msgr2=0x7fbad4150020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:19:58.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.748+0000 7fbadc311640 1 -- 172.21.15.81:0/2684289985 shutdown_connections 2024-09-16T01:19:58.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:19:58.748+0000 7fbadc311640 1 -- 172.21.15.81:0/2684289985 wait complete. 2024-09-16T01:19:58.761 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:19:58.761 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:20:00.071 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:02.073 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:03.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:20:03.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.872+0000 7fdded0d7640 1 Processor -- start 2024-09-16T01:20:03.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.872+0000 7fdded0d7640 1 -- start start 2024-09-16T01:20:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdded0d7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdde815b300 0x7fdde80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdded0d7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdde806f8d0 0x7fdde815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdded0d7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdde80cdbe0 con 0x7fdde80cd3f0 2024-09-16T01:20:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdded0d7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fdde80728a0 con 0x7fdde806f8d0 2024-09-16T01:20:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdded0d7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fdde80cd900 con 0x7fdde815b300 2024-09-16T01:20:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdde759e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdde806f8d0 0x7fdde815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:03.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdddffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdde80cd3f0 0x7fdde806f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43400/0 (socket says 172.21.15.81:43400) 2024-09-16T01:20:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdddffff640 1 -- 172.21.15.81:0/324378773 learned_addr learned my addr 172.21.15.81:0/324378773 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:20:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdde6d9d640 1 --2- 172.21.15.81:0/324378773 >> v2:172.21.15.102:3300/0 conn(0x7fdde815b300 0x7fdde80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdde759e640 1 -- 172.21.15.81:0/324378773 >> v2:172.21.15.102:3300/0 conn(0x7fdde815b300 msgr2=0x7fdde80cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdde759e640 1 --2- 172.21.15.81:0/324378773 >> v2:172.21.15.102:3300/0 conn(0x7fdde815b300 0x7fdde80cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdde759e640 1 -- 172.21.15.81:0/324378773 >> v1:172.21.15.81:6789/0 conn(0x7fdde80cd3f0 legacy=0x7fdde806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.874+0000 7fdde759e640 1 -- 172.21.15.81:0/324378773 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde8072250 con 0x7fdde806f8d0 2024-09-16T01:20:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.874+0000 7fdde6d9d640 1 --2- 172.21.15.81:0/324378773 >> v2:172.21.15.102:3300/0 conn(0x7fdde815b300 0x7fdde80cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:20:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.873+0000 7fdde659c640 1 -- 172.21.15.81:0/324378773 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 629923245 0 0) 0x7fdde80cdbe0 con 0x7fdde80cd3f0 2024-09-16T01:20:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.874+0000 7fdde759e640 1 --2- 172.21.15.81:0/324378773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde806f8d0 0x7fdde815b6e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fdde8070250 tx=0x7fdde002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cc1f9df534cad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.874+0000 7fdde659c640 1 -- 172.21.15.81:0/324378773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0007740 con 0x7fdde806f8d0 2024-09-16T01:20:03.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.874+0000 7fdde659c640 1 -- 172.21.15.81:0/324378773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde00078e0 con 0x7fdde806f8d0 2024-09-16T01:20:03.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.874+0000 7fdde659c640 1 -- 172.21.15.81:0/324378773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0007cb0 con 0x7fdde806f8d0 2024-09-16T01:20:03.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.875+0000 7fdded0d7640 1 -- 172.21.15.81:0/324378773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde806f8d0 msgr2=0x7fdde815b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.875+0000 7fdded0d7640 1 --2- 172.21.15.81:0/324378773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde806f8d0 0x7fdde815b6e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fdde8070250 tx=0x7fdde002a680 comp rx=0 tx=0).stop 2024-09-16T01:20:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.875+0000 7fdded0d7640 1 -- 172.21.15.81:0/324378773 shutdown_connections 2024-09-16T01:20:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.875+0000 7fdded0d7640 1 --2- 172.21.15.81:0/324378773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde806f8d0 0x7fdde815b6e0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.875+0000 7fdded0d7640 1 --2- 172.21.15.81:0/324378773 >> v2:172.21.15.102:3300/0 conn(0x7fdde815b300 0x7fdde80cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.875+0000 7fdded0d7640 1 -- 172.21.15.81:0/324378773 >> 172.21.15.81:0/324378773 conn(0x7fdde8067d70 msgr2=0x7fdde806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.875+0000 7fdded0d7640 1 -- 172.21.15.81:0/324378773 shutdown_connections 2024-09-16T01:20:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.875+0000 7fdded0d7640 1 -- 172.21.15.81:0/324378773 wait complete. 2024-09-16T01:20:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.877+0000 7fdded0d7640 1 Processor -- start 2024-09-16T01:20:03.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.877+0000 7fdded0d7640 1 -- start start 2024-09-16T01:20:03.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.877+0000 7fdded0d7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdde806f8d0 0x7fdde8156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:03.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.877+0000 7fdded0d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdde80cd3f0 0x7fdde80a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:03.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.877+0000 7fdded0d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde815b300 0x7fdde8144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:03.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.877+0000 7fdded0d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdde80d0160 con 0x7fdde815b300 2024-09-16T01:20:03.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.877+0000 7fdded0d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdde80cffe0 con 0x7fdde80cd3f0 2024-09-16T01:20:03.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.877+0000 7fdded0d7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdde8072d30 con 0x7fdde806f8d0 2024-09-16T01:20:03.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdde759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde815b300 0x7fdde8144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:03.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdde759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde815b300 0x7fdde8144b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36568/0 (socket says 172.21.15.81:36568) 2024-09-16T01:20:03.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdde759e640 1 -- 172.21.15.81:0/3286271089 learned_addr learned my addr 172.21.15.81:0/3286271089 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:03.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdddffff640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdde80cd3f0 0x7fdde80a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:03.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdde6d9d640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdde806f8d0 0x7fdde8156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:03.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdde759e640 1 -- 172.21.15.81:0/3286271089 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdde806f8d0 msgr2=0x7fdde8156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:03.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdde759e640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdde806f8d0 0x7fdde8156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:03.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdde759e640 1 -- 172.21.15.81:0/3286271089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdde80cd3f0 msgr2=0x7fdde80a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:03.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdde759e640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdde80cd3f0 0x7fdde80a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:03.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdde759e640 1 -- 172.21.15.81:0/3286271089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde8156b30 con 0x7fdde815b300 2024-09-16T01:20:03.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdde759e640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde815b300 0x7fdde8144b90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009e50 tx=0x7fdde0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:03.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdddf7fe640 1 -- 172.21.15.81:0/3286271089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0040070 con 0x7fdde815b300 2024-09-16T01:20:03.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdddf7fe640 1 -- 172.21.15.81:0/3286271089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde0031bf0 con 0x7fdde815b300 2024-09-16T01:20:03.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdded0d7640 1 -- 172.21.15.81:0/3286271089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde8156e10 con 0x7fdde815b300 2024-09-16T01:20:03.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdddf7fe640 1 -- 172.21.15.81:0/3286271089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0045460 con 0x7fdde815b300 2024-09-16T01:20:03.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.878+0000 7fdded0d7640 1 -- 172.21.15.81:0/3286271089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde81573d0 con 0x7fdde815b300 2024-09-16T01:20:03.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.879+0000 7fdded0d7640 1 -- 172.21.15.81:0/3286271089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde80a9c40 con 0x7fdde815b300 2024-09-16T01:20:03.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.880+0000 7fdddf7fe640 1 -- 172.21.15.81:0/3286271089 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdde0039040 con 0x7fdde815b300 2024-09-16T01:20:03.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.880+0000 7fdddf7fe640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fddc806c2b0 0x7fddc806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:03.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.880+0000 7fdddf7fe640 1 -- 172.21.15.81:0/3286271089 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fdde00ad030 con 0x7fdde815b300 2024-09-16T01:20:03.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.880+0000 7fdde6d9d640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fddc806c2b0 0x7fddc806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:03.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.881+0000 7fdde6d9d640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fddc806c2b0 0x7fddc806e770 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fddd8006fd0 tx=0x7fddd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:03.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:03.884+0000 7fdddf7fe640 1 -- 172.21.15.81:0/3286271089 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdde007b5a0 con 0x7fdde815b300 2024-09-16T01:20:04.075 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:04.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.092+0000 7fdded0d7640 1 -- 172.21.15.81:0/3286271089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdde8159ca0 con 0x7fdde815b300 2024-09-16T01:20:04.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.093+0000 7fdddf7fe640 1 -- 172.21.15.81:0/3286271089 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fdde007aea0 con 0x7fdde815b300 2024-09-16T01:20:04.094 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:20:04.095 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:20:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.095+0000 7fdded0d7640 1 -- 172.21.15.81:0/3286271089 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fddc806c2b0 msgr2=0x7fddc806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.095+0000 7fdded0d7640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fddc806c2b0 0x7fddc806e770 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fddd8006fd0 tx=0x7fddd8008040 comp rx=0 tx=0).stop 2024-09-16T01:20:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.095+0000 7fdded0d7640 1 -- 172.21.15.81:0/3286271089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde815b300 msgr2=0x7fdde8144b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.095+0000 7fdded0d7640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde815b300 0x7fdde8144b90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009e50 tx=0x7fdde0004a40 comp rx=0 tx=0).stop 2024-09-16T01:20:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.095+0000 7fdded0d7640 1 -- 172.21.15.81:0/3286271089 shutdown_connections 2024-09-16T01:20:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.095+0000 7fdded0d7640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fddc806c2b0 0x7fddc806e770 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.095+0000 7fdded0d7640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde815b300 0x7fdde8144b90 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.095+0000 7fdded0d7640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdde80cd3f0 0x7fdde80a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.095+0000 7fdded0d7640 1 --2- 172.21.15.81:0/3286271089 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdde806f8d0 0x7fdde8156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:04.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.095+0000 7fdded0d7640 1 -- 172.21.15.81:0/3286271089 >> 172.21.15.81:0/3286271089 conn(0x7fdde8067d70 msgr2=0x7fdde815a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.095+0000 7fdded0d7640 1 -- 172.21.15.81:0/3286271089 shutdown_connections 2024-09-16T01:20:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:04.095+0000 7fdded0d7640 1 -- 172.21.15.81:0/3286271089 wait complete. 2024-09-16T01:20:04.108 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:20:04.108 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:20:06.076 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:08.078 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:08.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:20:08.934 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:20:09.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:20:09.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.386+0000 7fb74d4d0640 1 Processor -- start 2024-09-16T01:20:09.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.386+0000 7fb74d4d0640 1 -- start start 2024-09-16T01:20:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.387+0000 7fb74d4d0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb748161c80 0x7fb74806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.387+0000 7fb74d4d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb7480b6680 0x7fb7480cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.387+0000 7fb74d4d0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb74806e870 con 0x7fb748162060 2024-09-16T01:20:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.387+0000 7fb74d4d0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb74806d9f0 con 0x7fb7480b6680 2024-09-16T01:20:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.387+0000 7fb74d4d0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb74806dcd0 con 0x7fb748161c80 2024-09-16T01:20:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.387+0000 7fb746ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb748161c80 0x7fb74806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.387+0000 7fb7477fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb7480b6680 0x7fb7480cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:09.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.387+0000 7fb7467fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb748162060 0x7fb7480b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:60460/0 (socket says 172.21.15.81:60460) 2024-09-16T01:20:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.387+0000 7fb7467fc640 1 -- 172.21.15.81:0/76250672 learned_addr learned my addr 172.21.15.81:0/76250672 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:20:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.388+0000 7fb746ffd640 1 -- 172.21.15.81:0/76250672 >> v2:172.21.15.102:3300/0 conn(0x7fb7480b6680 msgr2=0x7fb7480cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:09.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.388+0000 7fb746ffd640 1 --2- 172.21.15.81:0/76250672 >> v2:172.21.15.102:3300/0 conn(0x7fb7480b6680 0x7fb7480cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.388+0000 7fb746ffd640 1 -- 172.21.15.81:0/76250672 >> v1:172.21.15.102:6789/0 conn(0x7fb748162060 legacy=0x7fb7480b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.388+0000 7fb746ffd640 1 -- 172.21.15.81:0/76250672 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74806dfb0 con 0x7fb748161c80 2024-09-16T01:20:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.389+0000 7fb746ffd640 1 --2- 172.21.15.81:0/76250672 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb748161c80 0x7fb74806e330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7380097a0 tx=0x7fb73802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba4c5e806e71deee server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.389+0000 7fb745ffb640 1 -- 172.21.15.81:0/76250672 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738037070 con 0x7fb748161c80 2024-09-16T01:20:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.389+0000 7fb745ffb640 1 -- 172.21.15.81:0/76250672 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb738032440 con 0x7fb748161c80 2024-09-16T01:20:09.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.389+0000 7fb745ffb640 1 -- 172.21.15.81:0/76250672 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738032810 con 0x7fb748161c80 2024-09-16T01:20:09.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.389+0000 7fb74d4d0640 1 -- 172.21.15.81:0/76250672 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb748161c80 msgr2=0x7fb74806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:09.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.389+0000 7fb74d4d0640 1 --2- 172.21.15.81:0/76250672 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb748161c80 0x7fb74806e330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb7380097a0 tx=0x7fb73802a180 comp rx=0 tx=0).stop 2024-09-16T01:20:09.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.389+0000 7fb74d4d0640 1 -- 172.21.15.81:0/76250672 shutdown_connections 2024-09-16T01:20:09.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.389+0000 7fb74d4d0640 1 --2- 172.21.15.81:0/76250672 >> v2:172.21.15.102:3300/0 conn(0x7fb7480b6680 0x7fb7480cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:09.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.389+0000 7fb74d4d0640 1 --2- 172.21.15.81:0/76250672 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb748161c80 0x7fb74806e330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:09.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.389+0000 7fb74d4d0640 1 -- 172.21.15.81:0/76250672 >> 172.21.15.81:0/76250672 conn(0x7fb7480d44f0 msgr2=0x7fb7480d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:09.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.389+0000 7fb74d4d0640 1 -- 172.21.15.81:0/76250672 shutdown_connections 2024-09-16T01:20:09.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.389+0000 7fb74d4d0640 1 -- 172.21.15.81:0/76250672 wait complete. 2024-09-16T01:20:09.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.391+0000 7fb74d4d0640 1 Processor -- start 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.391+0000 7fb74d4d0640 1 -- start start 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb74d4d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7480b6680 0x7fb7480b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb74d4d0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb748161c80 0x7fb7481eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb74d4d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb748162060 0x7fb7481566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb74d4d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7480b6b30 con 0x7fb748162060 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb74d4d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb7480d2aa0 con 0x7fb7480b6680 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb74d4d0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb7480b6cb0 con 0x7fb748161c80 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb7477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb748162060 0x7fb7481566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb7477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb748162060 0x7fb7481566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36584/0 (socket says 172.21.15.81:36584) 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb7477fe640 1 -- 172.21.15.81:0/1779281422 learned_addr learned my addr 172.21.15.81:0/1779281422 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb746ffd640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7480b6680 0x7fb7480b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb7467fc640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb748161c80 0x7fb7481eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:09.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb7477fe640 1 -- 172.21.15.81:0/1779281422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb748161c80 msgr2=0x7fb7481eaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb7477fe640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb748161c80 0x7fb7481eaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb7477fe640 1 -- 172.21.15.81:0/1779281422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7480b6680 msgr2=0x7fb7480b8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb7477fe640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7480b6680 0x7fb7480b8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb7477fe640 1 -- 172.21.15.81:0/1779281422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7480ba230 con 0x7fb748162060 2024-09-16T01:20:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb7477fe640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb748162060 0x7fb7481566f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb74000efc0 tx=0x7fb74000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb72f7fe640 1 -- 172.21.15.81:0/1779281422 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740018020 con 0x7fb748162060 2024-09-16T01:20:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb72f7fe640 1 -- 172.21.15.81:0/1779281422 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb740014480 con 0x7fb748162060 2024-09-16T01:20:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb74d4d0640 1 -- 172.21.15.81:0/1779281422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7480b9190 con 0x7fb748162060 2024-09-16T01:20:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb72f7fe640 1 -- 172.21.15.81:0/1779281422 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740014870 con 0x7fb748162060 2024-09-16T01:20:09.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.392+0000 7fb74d4d0640 1 -- 172.21.15.81:0/1779281422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7480b9750 con 0x7fb748162060 2024-09-16T01:20:09.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.393+0000 7fb74d4d0640 1 -- 172.21.15.81:0/1779281422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb74806e330 con 0x7fb748162060 2024-09-16T01:20:09.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.394+0000 7fb72f7fe640 1 -- 172.21.15.81:0/1779281422 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb74001b020 con 0x7fb748162060 2024-09-16T01:20:09.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.394+0000 7fb72f7fe640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb73406c2b0 0x7fb73406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:09.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.394+0000 7fb72f7fe640 1 -- 172.21.15.81:0/1779281422 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fb74008c2c0 con 0x7fb748162060 2024-09-16T01:20:09.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.394+0000 7fb746ffd640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb73406c2b0 0x7fb73406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:09.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.395+0000 7fb746ffd640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb73406c2b0 0x7fb73406e770 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb738034000 tx=0x7fb73802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:09.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.399+0000 7fb72f7fe640 1 -- 172.21.15.81:0/1779281422 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb740022020 con 0x7fb748162060 2024-09-16T01:20:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.601+0000 7fb74d4d0640 1 -- 172.21.15.81:0/1779281422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb7480d42d0 con 0x7fb748162060 2024-09-16T01:20:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.601+0000 7fb72f7fe640 1 -- 172.21.15.81:0/1779281422 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fb740010040 con 0x7fb748162060 2024-09-16T01:20:09.603 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:20:09.603 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:20:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.603+0000 7fb74d4d0640 1 -- 172.21.15.81:0/1779281422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb73406c2b0 msgr2=0x7fb73406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.603+0000 7fb74d4d0640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb73406c2b0 0x7fb73406e770 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb738034000 tx=0x7fb73802e000 comp rx=0 tx=0).stop 2024-09-16T01:20:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.603+0000 7fb74d4d0640 1 -- 172.21.15.81:0/1779281422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb748162060 msgr2=0x7fb7481566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.603+0000 7fb74d4d0640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb748162060 0x7fb7481566f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb74000efc0 tx=0x7fb74000c490 comp rx=0 tx=0).stop 2024-09-16T01:20:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.603+0000 7fb74d4d0640 1 -- 172.21.15.81:0/1779281422 shutdown_connections 2024-09-16T01:20:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.603+0000 7fb74d4d0640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb73406c2b0 0x7fb73406e770 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.603+0000 7fb74d4d0640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb748162060 0x7fb7481566f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.603+0000 7fb74d4d0640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb748161c80 0x7fb7481eaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.603+0000 7fb74d4d0640 1 --2- 172.21.15.81:0/1779281422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7480b6680 0x7fb7480b8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.603+0000 7fb74d4d0640 1 -- 172.21.15.81:0/1779281422 >> 172.21.15.81:0/1779281422 conn(0x7fb7480d44f0 msgr2=0x7fb74806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.603+0000 7fb74d4d0640 1 -- 172.21.15.81:0/1779281422 shutdown_connections 2024-09-16T01:20:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:09.603+0000 7fb74d4d0640 1 -- 172.21.15.81:0/1779281422 wait complete. 2024-09-16T01:20:09.616 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:20:09.616 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:20:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:14.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:20:14.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.725+0000 7fd8c5f9d640 1 Processor -- start 2024-09-16T01:20:14.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.725+0000 7fd8c5f9d640 1 -- start start 2024-09-16T01:20:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.726+0000 7fd8c5f9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8c00d2cc0 0x7fd8c00d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.726+0000 7fd8c5f9d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8c006cf50 con 0x7fd8c0161ad0 2024-09-16T01:20:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.726+0000 7fd8c5f9d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8c006d230 con 0x7fd8c009bb50 2024-09-16T01:20:14.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.726+0000 7fd8c5f9d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd8c006d830 con 0x7fd8c00d2cc0 2024-09-16T01:20:14.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.726+0000 7fd8c579c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8c00d2cc0 0x7fd8c00d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:14.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.726+0000 7fd8c4f9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd8c0161ad0 0x7fd8c009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43832/0 (socket says 172.21.15.81:43832) 2024-09-16T01:20:14.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.726+0000 7fd8c4f9b640 1 -- 172.21.15.81:0/2480421002 learned_addr learned my addr 172.21.15.81:0/2480421002 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:20:14.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.726+0000 7fd8c579c640 1 -- 172.21.15.81:0/2480421002 >> v1:172.21.15.102:6789/0 conn(0x7fd8c009bb50 legacy=0x7fd8c00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:14.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.726+0000 7fd8c579c640 1 -- 172.21.15.81:0/2480421002 >> v1:172.21.15.81:6789/0 conn(0x7fd8c0161ad0 legacy=0x7fd8c009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:14.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.726+0000 7fd8c579c640 1 -- 172.21.15.81:0/2480421002 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c006db10 con 0x7fd8c00d2cc0 2024-09-16T01:20:14.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.727+0000 7fd8c579c640 1 --2- 172.21.15.81:0/2480421002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c00d2cc0 0x7fd8c00d0a10 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009d90 tx=0x7fd8b802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931e655414a5a8bb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:14.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.727+0000 7fd8bf7fe640 1 -- 172.21.15.81:0/2480421002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8007740 con 0x7fd8c00d2cc0 2024-09-16T01:20:14.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.727+0000 7fd8bf7fe640 1 -- 172.21.15.81:0/2480421002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b80078e0 con 0x7fd8c00d2cc0 2024-09-16T01:20:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.727+0000 7fd8bf7fe640 1 -- 172.21.15.81:0/2480421002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8007cb0 con 0x7fd8c00d2cc0 2024-09-16T01:20:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.728+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/2480421002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c00d2cc0 msgr2=0x7fd8c00d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.728+0000 7fd8c5f9d640 1 --2- 172.21.15.81:0/2480421002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c00d2cc0 0x7fd8c00d0a10 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009d90 tx=0x7fd8b802a6a0 comp rx=0 tx=0).stop 2024-09-16T01:20:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.728+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/2480421002 shutdown_connections 2024-09-16T01:20:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.728+0000 7fd8c5f9d640 1 --2- 172.21.15.81:0/2480421002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c00d2cc0 0x7fd8c00d0a10 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.728+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/2480421002 >> 172.21.15.81:0/2480421002 conn(0x7fd8c00d21a0 msgr2=0x7fd8c00d25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.728+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/2480421002 shutdown_connections 2024-09-16T01:20:14.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.728+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/2480421002 wait complete. 2024-09-16T01:20:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.729+0000 7fd8c5f9d640 1 Processor -- start 2024-09-16T01:20:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.729+0000 7fd8c5f9d640 1 -- start start 2024-09-16T01:20:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.730+0000 7fd8c5f9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c009bb50 0x7fd8c01584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.730+0000 7fd8c5f9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8c00d2cc0 0x7fd8c00b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.730+0000 7fd8c5f9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8c0161ad0 0x7fd8c00b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.730+0000 7fd8c5f9d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c009b2c0 con 0x7fd8c009bb50 2024-09-16T01:20:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.730+0000 7fd8c5f9d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd8c009b140 con 0x7fd8c0161ad0 2024-09-16T01:20:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.730+0000 7fd8c5f9d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd8c00b3540 con 0x7fd8c00d2cc0 2024-09-16T01:20:14.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.730+0000 7fd8c4f9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c009bb50 0x7fd8c01584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.730+0000 7fd8c4f9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c009bb50 0x7fd8c01584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33012/0 (socket says 172.21.15.81:33012) 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.730+0000 7fd8c4f9b640 1 -- 172.21.15.81:0/180127955 learned_addr learned my addr 172.21.15.81:0/180127955 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.730+0000 7fd8c579c640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8c0161ad0 0x7fd8c00b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.731+0000 7fd8c4f9b640 1 -- 172.21.15.81:0/180127955 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8c00d2cc0 msgr2=0x7fd8c00b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.731+0000 7fd8c4f9b640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8c00d2cc0 0x7fd8c00b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.731+0000 7fd8c4f9b640 1 -- 172.21.15.81:0/180127955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8c0161ad0 msgr2=0x7fd8c00b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.731+0000 7fd8c4f9b640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8c0161ad0 0x7fd8c00b5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.731+0000 7fd8c4f9b640 1 -- 172.21.15.81:0/180127955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8c00b6b40 con 0x7fd8c009bb50 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.731+0000 7fd8c4f9b640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c009bb50 0x7fd8c01584f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400c3c0 tx=0x7fd8b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.731+0000 7fd8bd7fa640 1 -- 172.21.15.81:0/180127955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4017070 con 0x7fd8c009bb50 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.731+0000 7fd8bd7fa640 1 -- 172.21.15.81:0/180127955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b4005ce0 con 0x7fd8c009bb50 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.731+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/180127955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8c00b6de0 con 0x7fd8c009bb50 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.731+0000 7fd8bd7fa640 1 -- 172.21.15.81:0/180127955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40072f0 con 0x7fd8c009bb50 2024-09-16T01:20:14.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.731+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/180127955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8c00b73a0 con 0x7fd8c009bb50 2024-09-16T01:20:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.732+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/180127955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c009aa30 con 0x7fd8c009bb50 2024-09-16T01:20:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.732+0000 7fd8bd7fa640 1 -- 172.21.15.81:0/180127955 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd8b401a070 con 0x7fd8c009bb50 2024-09-16T01:20:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.733+0000 7fd8bd7fa640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd8a406c2b0 0x7fd8a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.733+0000 7fd8bd7fa640 1 -- 172.21.15.81:0/180127955 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fd8b408a990 con 0x7fd8c009bb50 2024-09-16T01:20:14.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.733+0000 7fd8bffff640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd8a406c2b0 0x7fd8a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:14.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.733+0000 7fd8bffff640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd8a406c2b0 0x7fd8a406e770 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd8c01f7d80 tx=0x7fd8ac0079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:14.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.737+0000 7fd8bd7fa640 1 -- 172.21.15.81:0/180127955 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8b4058f90 con 0x7fd8c009bb50 2024-09-16T01:20:14.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.938+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/180127955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd8c00cdfe0 con 0x7fd8c009bb50 2024-09-16T01:20:14.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.938+0000 7fd8bd7fa640 1 -- 172.21.15.81:0/180127955 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fd8b4058890 con 0x7fd8c009bb50 2024-09-16T01:20:14.939 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:20:14.939 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:20:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.940+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/180127955 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd8a406c2b0 msgr2=0x7fd8a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.940+0000 7fd8c5f9d640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd8a406c2b0 0x7fd8a406e770 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd8c01f7d80 tx=0x7fd8ac0079b0 comp rx=0 tx=0).stop 2024-09-16T01:20:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.940+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/180127955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c009bb50 msgr2=0x7fd8c01584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.940+0000 7fd8c5f9d640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c009bb50 0x7fd8c01584f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400c3c0 tx=0x7fd8b400c880 comp rx=0 tx=0).stop 2024-09-16T01:20:14.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.940+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/180127955 shutdown_connections 2024-09-16T01:20:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.940+0000 7fd8c5f9d640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd8a406c2b0 0x7fd8a406e770 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.940+0000 7fd8c5f9d640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8c0161ad0 0x7fd8c00b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.940+0000 7fd8c5f9d640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8c00d2cc0 0x7fd8c00b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.940+0000 7fd8c5f9d640 1 --2- 172.21.15.81:0/180127955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8c009bb50 0x7fd8c01584f0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.940+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/180127955 >> 172.21.15.81:0/180127955 conn(0x7fd8c00d21a0 msgr2=0x7fd8c0159640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.940+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/180127955 shutdown_connections 2024-09-16T01:20:14.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:14.940+0000 7fd8c5f9d640 1 -- 172.21.15.81:0/180127955 wait complete. 2024-09-16T01:20:14.952 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:20:14.952 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:20:16.086 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:19.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:20:20.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.060+0000 7fc99f480640 1 Processor -- start 2024-09-16T01:20:20.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.060+0000 7fc99f480640 1 -- start start 2024-09-16T01:20:20.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.061+0000 7fc99f480640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9980af560 0x7fc9981691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:20.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.061+0000 7fc99f480640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99806cb30 con 0x7fc998147360 2024-09-16T01:20:20.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.061+0000 7fc99f480640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc99806bfb0 con 0x7fc9980d04a0 2024-09-16T01:20:20.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.061+0000 7fc99f480640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc99806c290 con 0x7fc9980af560 2024-09-16T01:20:20.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.061+0000 7fc99da1d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc9980af560 0x7fc9981691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:20.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.061+0000 7fc99d21c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc998147360 0x7fc998070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43848/0 (socket says 172.21.15.81:43848) 2024-09-16T01:20:20.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.061+0000 7fc99d21c640 1 -- 172.21.15.81:0/3917484331 learned_addr learned my addr 172.21.15.81:0/3917484331 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:20:20.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.062+0000 7fc99da1d640 1 -- 172.21.15.81:0/3917484331 >> v1:172.21.15.102:6789/0 conn(0x7fc9980d04a0 legacy=0x7fc9980d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:20.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.062+0000 7fc99da1d640 1 -- 172.21.15.81:0/3917484331 >> v1:172.21.15.81:6789/0 conn(0x7fc998147360 legacy=0x7fc998070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:20.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.062+0000 7fc99da1d640 1 -- 172.21.15.81:0/3917484331 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99806c570 con 0x7fc9980af560 2024-09-16T01:20:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.062+0000 7fc99da1d640 1 --2- 172.21.15.81:0/3917484331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9980af560 0x7fc9981691e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc990009d90 tx=0x7fc99002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b135a0dfaadf1f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.063+0000 7fc98ffff640 1 -- 172.21.15.81:0/3917484331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990031600 con 0x7fc9980af560 2024-09-16T01:20:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.063+0000 7fc98ffff640 1 -- 172.21.15.81:0/3917484331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9900317a0 con 0x7fc9980af560 2024-09-16T01:20:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.063+0000 7fc98ffff640 1 -- 172.21.15.81:0/3917484331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990031b70 con 0x7fc9980af560 2024-09-16T01:20:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.063+0000 7fc99f480640 1 -- 172.21.15.81:0/3917484331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9980af560 msgr2=0x7fc9981691e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.063+0000 7fc99f480640 1 --2- 172.21.15.81:0/3917484331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9980af560 0x7fc9981691e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fc990009d90 tx=0x7fc99002a610 comp rx=0 tx=0).stop 2024-09-16T01:20:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.063+0000 7fc99f480640 1 -- 172.21.15.81:0/3917484331 shutdown_connections 2024-09-16T01:20:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.063+0000 7fc99f480640 1 --2- 172.21.15.81:0/3917484331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9980af560 0x7fc9981691e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.063+0000 7fc99f480640 1 -- 172.21.15.81:0/3917484331 >> 172.21.15.81:0/3917484331 conn(0x7fc9980b2f40 msgr2=0x7fc9980b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.063+0000 7fc99f480640 1 -- 172.21.15.81:0/3917484331 shutdown_connections 2024-09-16T01:20:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.063+0000 7fc99f480640 1 -- 172.21.15.81:0/3917484331 wait complete. 2024-09-16T01:20:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.064+0000 7fc99f480640 1 Processor -- start 2024-09-16T01:20:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.065+0000 7fc99f480640 1 -- start start 2024-09-16T01:20:20.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.065+0000 7fc99f480640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9980af560 0x7fc998141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:20.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.065+0000 7fc99f480640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9980d04a0 0x7fc9980b6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:20.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.065+0000 7fc99f480640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc998147360 0x7fc99815d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:20.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.065+0000 7fc99f480640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc99806bc10 con 0x7fc9980af560 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.065+0000 7fc99f480640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc998070fa0 con 0x7fc9980d04a0 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.065+0000 7fc99f480640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc99806bd90 con 0x7fc998147360 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.065+0000 7fc99d21c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9980af560 0x7fc998141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.065+0000 7fc99d21c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9980af560 0x7fc998141a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33032/0 (socket says 172.21.15.81:33032) 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.065+0000 7fc99d21c640 1 -- 172.21.15.81:0/1734287715 learned_addr learned my addr 172.21.15.81:0/1734287715 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc99da1d640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc998147360 0x7fc99815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc99ca1b640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9980d04a0 0x7fc9980b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc99d21c640 1 -- 172.21.15.81:0/1734287715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc998147360 msgr2=0x7fc99815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc99d21c640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc998147360 0x7fc99815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc99d21c640 1 -- 172.21.15.81:0/1734287715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9980d04a0 msgr2=0x7fc9980b6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc99d21c640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9980d04a0 0x7fc9980b6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc99d21c640 1 -- 172.21.15.81:0/1734287715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9980b58a0 con 0x7fc9980af560 2024-09-16T01:20:20.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc99d21c640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9980af560 0x7fc998141a90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc99400c3c0 tx=0x7fc99400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:20.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc98dffb640 1 -- 172.21.15.81:0/1734287715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc994017070 con 0x7fc9980af560 2024-09-16T01:20:20.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc98dffb640 1 -- 172.21.15.81:0/1734287715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc994005ce0 con 0x7fc9980af560 2024-09-16T01:20:20.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc99f480640 1 -- 172.21.15.81:0/1734287715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9980b5b80 con 0x7fc9980af560 2024-09-16T01:20:20.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc98dffb640 1 -- 172.21.15.81:0/1734287715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9940072f0 con 0x7fc9980af560 2024-09-16T01:20:20.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.066+0000 7fc99f480640 1 -- 172.21.15.81:0/1734287715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9980b6140 con 0x7fc9980af560 2024-09-16T01:20:20.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.067+0000 7fc99f480640 1 -- 172.21.15.81:0/1734287715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9980d08f0 con 0x7fc9980af560 2024-09-16T01:20:20.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.068+0000 7fc98dffb640 1 -- 172.21.15.81:0/1734287715 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc99401a070 con 0x7fc9980af560 2024-09-16T01:20:20.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.068+0000 7fc98dffb640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc97c06c2b0 0x7fc97c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:20.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.068+0000 7fc99ca1b640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc97c06c2b0 0x7fc97c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:20.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.068+0000 7fc98dffb640 1 -- 172.21.15.81:0/1734287715 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fc99408a990 con 0x7fc9980af560 2024-09-16T01:20:20.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.069+0000 7fc99ca1b640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc97c06c2b0 0x7fc97c06e770 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc99815cb30 tx=0x7fc988009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:20.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.073+0000 7fc98dffb640 1 -- 172.21.15.81:0/1734287715 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc994058f00 con 0x7fc9980af560 2024-09-16T01:20:20.090 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:20.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.279+0000 7fc99f480640 1 -- 172.21.15.81:0/1734287715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc9980cea60 con 0x7fc9980af560 2024-09-16T01:20:20.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.279+0000 7fc98dffb640 1 -- 172.21.15.81:0/1734287715 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fc994058800 con 0x7fc9980af560 2024-09-16T01:20:20.280 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:20:20.280 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:20:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.281+0000 7fc99f480640 1 -- 172.21.15.81:0/1734287715 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc97c06c2b0 msgr2=0x7fc97c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.281+0000 7fc99f480640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc97c06c2b0 0x7fc97c06e770 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc99815cb30 tx=0x7fc988009040 comp rx=0 tx=0).stop 2024-09-16T01:20:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.281+0000 7fc99f480640 1 -- 172.21.15.81:0/1734287715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9980af560 msgr2=0x7fc998141a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.281+0000 7fc99f480640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9980af560 0x7fc998141a90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc99400c3c0 tx=0x7fc99400c880 comp rx=0 tx=0).stop 2024-09-16T01:20:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.281+0000 7fc99f480640 1 -- 172.21.15.81:0/1734287715 shutdown_connections 2024-09-16T01:20:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.281+0000 7fc99f480640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc97c06c2b0 0x7fc97c06e770 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.281+0000 7fc99f480640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc998147360 0x7fc99815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.281+0000 7fc99f480640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9980d04a0 0x7fc9980b6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.281+0000 7fc99f480640 1 --2- 172.21.15.81:0/1734287715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc9980af560 0x7fc998141a90 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:20.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.281+0000 7fc99f480640 1 -- 172.21.15.81:0/1734287715 >> 172.21.15.81:0/1734287715 conn(0x7fc9980b2f40 msgr2=0x7fc99806f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:20.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.281+0000 7fc99f480640 1 -- 172.21.15.81:0/1734287715 shutdown_connections 2024-09-16T01:20:20.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:20.281+0000 7fc99f480640 1 -- 172.21.15.81:0/1734287715 wait complete. 2024-09-16T01:20:20.293 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:20:20.293 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:20:22.092 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:24.095 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:25.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:20:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.403+0000 7fede94c3640 1 Processor -- start 2024-09-16T01:20:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.404+0000 7fede94c3640 1 -- start start 2024-09-16T01:20:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.404+0000 7fede94c3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede40b6680 0x7fede4169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.404+0000 7fede94c3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede406d9f0 con 0x7fede4162060 2024-09-16T01:20:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.404+0000 7fede94c3640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede406dcd0 con 0x7fede4161c80 2024-09-16T01:20:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.404+0000 7fede94c3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fede406dfb0 con 0x7fede40b6680 2024-09-16T01:20:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede27fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fede4162060 0x7fede40b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35666/0 (socket says 172.21.15.81:35666) 2024-09-16T01:20:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede27fc640 1 -- 172.21.15.81:0/2664685977 learned_addr learned my addr 172.21.15.81:0/2664685977 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:20:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede37fe640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede40b6680 0x7fede4169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2558708679 0 0) 0x7fede406d9f0 con 0x7fede4162060 2024-09-16T01:20:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedcc003520 con 0x7fede4162060 2024-09-16T01:20:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445772729 0 0) 0x7fede406dcd0 con 0x7fede4161c80 2024-09-16T01:20:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede406d9f0 con 0x7fede4161c80 2024-09-16T01:20:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1327953930 0 0) 0x7fedcc003520 con 0x7fede4162060 2024-09-16T01:20:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede40b6680 msgr2=0x7fede4169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede40b6680 0x7fede4169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 >> v1:172.21.15.102:6789/0 conn(0x7fede4161c80 legacy=0x7fede406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede40d01f0 con 0x7fede4162060 2024-09-16T01:20:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fedd8001670 con 0x7fede4162060 2024-09-16T01:20:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede37fe640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede40b6680 0x7fede4169830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:20:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 >> v1:172.21.15.81:6789/0 conn(0x7fede4162060 legacy=0x7fede40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:25.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedcc003b70 0x7fedcc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:25.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede40b6680 0x7fedcc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:25.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedcc004d40 0x7fedcc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:25.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fede406dfb0 con 0x7fedcc004d40 2024-09-16T01:20:25.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc00ba70 con 0x7fedcc003b70 2024-09-16T01:20:25.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fedcc00bc20 con 0x7fede40b6680 2024-09-16T01:20:25.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede37fe640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedcc004d40 0x7fedcc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:25.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede2ffd640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedcc003b70 0x7fedcc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:25.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.405+0000 7fede27fc640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede40b6680 0x7fedcc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:25.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.406+0000 7fede37fe640 1 -- 172.21.15.81:0/2664685977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede40b6680 msgr2=0x7fedcc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:25.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.406+0000 7fede37fe640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fede40b6680 0x7fedcc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:25.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.406+0000 7fede37fe640 1 -- 172.21.15.81:0/2664685977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedcc003b70 msgr2=0x7fedcc003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.406+0000 7fede37fe640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fedcc003b70 0x7fedcc003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.406+0000 7fede37fe640 1 -- 172.21.15.81:0/2664685977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc003520 con 0x7fedcc004d40 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.406+0000 7fede37fe640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedcc004d40 0x7fedcc0051c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7feddc00e350 tx=0x7fedcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e253d0385359b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.407+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc033070 con 0x7fedcc004d40 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.407+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feddc02f660 con 0x7fedcc004d40 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.407+0000 7fede1ffb640 1 -- 172.21.15.81:0/2664685977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc009de0 con 0x7fedcc004d40 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.407+0000 7fede94c3640 1 -- 172.21.15.81:0/2664685977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedcc004d40 msgr2=0x7fedcc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.407+0000 7fede94c3640 1 --2- 172.21.15.81:0/2664685977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedcc004d40 0x7fedcc0051c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7feddc00e350 tx=0x7fedcc005830 comp rx=0 tx=0).stop 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.407+0000 7fede37fe640 1 -- 172.21.15.81:0/2664685977 reap_dead start 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.407+0000 7fede94c3640 1 -- 172.21.15.81:0/2664685977 shutdown_connections 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.407+0000 7fede94c3640 1 -- 172.21.15.81:0/2664685977 >> 172.21.15.81:0/2664685977 conn(0x7fede40d44f0 msgr2=0x7fede40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.407+0000 7fede94c3640 1 -- 172.21.15.81:0/2664685977 shutdown_connections 2024-09-16T01:20:25.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.407+0000 7fede94c3640 1 -- 172.21.15.81:0/2664685977 wait complete. 2024-09-16T01:20:25.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.409+0000 7fede94c3640 1 Processor -- start 2024-09-16T01:20:25.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.409+0000 7fede94c3640 1 -- start start 2024-09-16T01:20:25.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.409+0000 7fede94c3640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fedcc004d40 0x7fede41574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:25.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.409+0000 7fede94c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede415f3a0 0x7fede40b9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.409+0000 7fede94c3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fede40b9690 0x7fede40b9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.409+0000 7fede94c3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fede40b6cb0 con 0x7fede415f3a0 2024-09-16T01:20:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.409+0000 7fede94c3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fede40b6b30 con 0x7fede40b9690 2024-09-16T01:20:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.409+0000 7fede94c3640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fede4167820 con 0x7fedcc004d40 2024-09-16T01:20:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.409+0000 7fede27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede415f3a0 0x7fede40b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.409+0000 7fede27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede415f3a0 0x7fede40b9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58136/0 (socket says 172.21.15.81:58136) 2024-09-16T01:20:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.409+0000 7fede27fc640 1 -- 172.21.15.81:0/2003292871 learned_addr learned my addr 172.21.15.81:0/2003292871 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fede37fe640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fede40b9690 0x7fede40b9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fede2ffd640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fedcc004d40 0x7fede41574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fede27fc640 1 -- 172.21.15.81:0/2003292871 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fedcc004d40 msgr2=0x7fede41574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fede27fc640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fedcc004d40 0x7fede41574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fede27fc640 1 -- 172.21.15.81:0/2003292871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fede40b9690 msgr2=0x7fede40b9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fede27fc640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fede40b9690 0x7fede40b9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fede27fc640 1 -- 172.21.15.81:0/2003292871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede40ba050 con 0x7fede415f3a0 2024-09-16T01:20:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fede37fe640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fede40b9690 0x7fede40b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:20:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fede27fc640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede415f3a0 0x7fede40b9150 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fedd8004f70 tx=0x7fedd80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fedcb7fe640 1 -- 172.21.15.81:0/2003292871 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd8007740 con 0x7fede415f3a0 2024-09-16T01:20:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fedcb7fe640 1 -- 172.21.15.81:0/2003292871 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd8018070 con 0x7fede415f3a0 2024-09-16T01:20:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fede94c3640 1 -- 172.21.15.81:0/2003292871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede40b7f60 con 0x7fede415f3a0 2024-09-16T01:20:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fedcb7fe640 1 -- 172.21.15.81:0/2003292871 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd800fb60 con 0x7fede415f3a0 2024-09-16T01:20:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.410+0000 7fede94c3640 1 -- 172.21.15.81:0/2003292871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede40b8520 con 0x7fede415f3a0 2024-09-16T01:20:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.411+0000 7fede94c3640 1 -- 172.21.15.81:0/2003292871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede40b4c70 con 0x7fede415f3a0 2024-09-16T01:20:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.412+0000 7fedcb7fe640 1 -- 172.21.15.81:0/2003292871 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fedd800fd00 con 0x7fede415f3a0 2024-09-16T01:20:25.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.412+0000 7fedcb7fe640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedd006c450 0x7fedd006e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:25.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.412+0000 7fedcb7fe640 1 -- 172.21.15.81:0/2003292871 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fedd808b6a0 con 0x7fede415f3a0 2024-09-16T01:20:25.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.412+0000 7fede2ffd640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedd006c450 0x7fedd006e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:25.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.413+0000 7fede2ffd640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedd006c450 0x7fedd006e910 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fedd40055b0 tx=0x7fedd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:25.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.417+0000 7fedcb7fe640 1 -- 172.21.15.81:0/2003292871 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fede40b4c70 con 0x7fede415f3a0 2024-09-16T01:20:25.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.618+0000 7fede94c3640 1 -- 172.21.15.81:0/2003292871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fede40b5f70 con 0x7fede415f3a0 2024-09-16T01:20:25.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.619+0000 7fedcb7fe640 1 -- 172.21.15.81:0/2003292871 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fedd8059ca0 con 0x7fede415f3a0 2024-09-16T01:20:25.620 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:20:25.620 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:20:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.621+0000 7fede94c3640 1 -- 172.21.15.81:0/2003292871 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedd006c450 msgr2=0x7fedd006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.621+0000 7fede94c3640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedd006c450 0x7fedd006e910 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fedd40055b0 tx=0x7fedd4009040 comp rx=0 tx=0).stop 2024-09-16T01:20:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.621+0000 7fede94c3640 1 -- 172.21.15.81:0/2003292871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede415f3a0 msgr2=0x7fede40b9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.621+0000 7fede94c3640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede415f3a0 0x7fede40b9150 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fedd8004f70 tx=0x7fedd80074f0 comp rx=0 tx=0).stop 2024-09-16T01:20:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.621+0000 7fede94c3640 1 -- 172.21.15.81:0/2003292871 shutdown_connections 2024-09-16T01:20:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.621+0000 7fede94c3640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedd006c450 0x7fedd006e910 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.621+0000 7fede94c3640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fede40b9690 0x7fede40b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.621+0000 7fede94c3640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fede415f3a0 0x7fede40b9150 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.621+0000 7fede94c3640 1 --2- 172.21.15.81:0/2003292871 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fedcc004d40 0x7fede41574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:25.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.621+0000 7fede94c3640 1 -- 172.21.15.81:0/2003292871 >> 172.21.15.81:0/2003292871 conn(0x7fede40d44f0 msgr2=0x7fede40cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:25.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.621+0000 7fede94c3640 1 -- 172.21.15.81:0/2003292871 shutdown_connections 2024-09-16T01:20:25.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:25.621+0000 7fede94c3640 1 -- 172.21.15.81:0/2003292871 wait complete. 2024-09-16T01:20:25.632 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:20:25.633 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:20:26.097 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:30.101 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:30.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:20:30.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.742+0000 7f75d8282640 1 Processor -- start 2024-09-16T01:20:30.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.742+0000 7f75d8282640 1 -- start start 2024-09-16T01:20:30.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.743+0000 7f75d8282640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75d0147360 0x7f75d0070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:30.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.743+0000 7f75d8282640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f75d00d0bb0 0x7f75d00ae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.743+0000 7f75d8282640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75d006cb30 con 0x7f75d0070dd0 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.743+0000 7f75d8282640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f75d006bfb0 con 0x7f75d0147360 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.743+0000 7f75d8282640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f75d006c290 con 0x7f75d00d0bb0 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.743+0000 7f75d601e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f75d0147360 0x7f75d0070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.743+0000 7f75d581d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f75d0070dd0 0x7f75d00d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35678/0 (socket says 172.21.15.81:35678) 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.743+0000 7f75d581d640 1 -- 172.21.15.81:0/3711355887 learned_addr learned my addr 172.21.15.81:0/3711355887 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.744+0000 7f75d681f640 1 --2- 172.21.15.81:0/3711355887 >> v2:172.21.15.102:3300/0 conn(0x7f75d00d0bb0 0x7f75d00ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.744+0000 7f75d601e640 1 -- 172.21.15.81:0/3711355887 >> v2:172.21.15.102:3300/0 conn(0x7f75d00d0bb0 msgr2=0x7f75d00ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.744+0000 7f75d601e640 1 --2- 172.21.15.81:0/3711355887 >> v2:172.21.15.102:3300/0 conn(0x7f75d00d0bb0 0x7f75d00ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.744+0000 7f75d601e640 1 -- 172.21.15.81:0/3711355887 >> v1:172.21.15.81:6789/0 conn(0x7f75d0070dd0 legacy=0x7f75d00d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.744+0000 7f75d601e640 1 -- 172.21.15.81:0/3711355887 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d006c570 con 0x7f75d0147360 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.744+0000 7f75d501c640 1 -- 172.21.15.81:0/3711355887 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399573932 0 0) 0x7f75d006cb30 con 0x7f75d0070dd0 2024-09-16T01:20:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.744+0000 7f75d601e640 1 --2- 172.21.15.81:0/3711355887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d0147360 0x7f75d0070890 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f75d00ced00 tx=0x7f75cc02a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cab1bde98baf396 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:30.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.745+0000 7f75d501c640 1 -- 172.21.15.81:0/3711355887 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc037070 con 0x7f75d0147360 2024-09-16T01:20:30.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.745+0000 7f75d501c640 1 -- 172.21.15.81:0/3711355887 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75cc02add0 con 0x7f75d0147360 2024-09-16T01:20:30.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.745+0000 7f75d501c640 1 -- 172.21.15.81:0/3711355887 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc032660 con 0x7f75d0147360 2024-09-16T01:20:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.745+0000 7f75d8282640 1 -- 172.21.15.81:0/3711355887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d0147360 msgr2=0x7f75d0070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.745+0000 7f75d8282640 1 --2- 172.21.15.81:0/3711355887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d0147360 0x7f75d0070890 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f75d00ced00 tx=0x7f75cc02a080 comp rx=0 tx=0).stop 2024-09-16T01:20:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.745+0000 7f75d8282640 1 -- 172.21.15.81:0/3711355887 shutdown_connections 2024-09-16T01:20:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.745+0000 7f75d8282640 1 --2- 172.21.15.81:0/3711355887 >> v2:172.21.15.102:3300/0 conn(0x7f75d00d0bb0 0x7f75d00ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.745+0000 7f75d8282640 1 --2- 172.21.15.81:0/3711355887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d0147360 0x7f75d0070890 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.745+0000 7f75d8282640 1 -- 172.21.15.81:0/3711355887 >> 172.21.15.81:0/3711355887 conn(0x7f75d00b2f40 msgr2=0x7f75d00b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.745+0000 7f75d8282640 1 -- 172.21.15.81:0/3711355887 shutdown_connections 2024-09-16T01:20:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.745+0000 7f75d8282640 1 -- 172.21.15.81:0/3711355887 wait complete. 2024-09-16T01:20:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.746+0000 7f75d8282640 1 Processor -- start 2024-09-16T01:20:30.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.747+0000 7f75d8282640 1 -- start start 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.747+0000 7f75d8282640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75d0070dd0 0x7f75d01f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.747+0000 7f75d8282640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75d00d0bb0 0x7f75d00b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.747+0000 7f75d8282640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d0147360 0x7f75d009e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d8282640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75d006bd90 con 0x7f75d0147360 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d8282640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f75d006bc10 con 0x7f75d0070dd0 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d8282640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f75d00aea90 con 0x7f75d00d0bb0 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d681f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d0147360 0x7f75d009e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d681f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d0147360 0x7f75d009e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58152/0 (socket says 172.21.15.81:58152) 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d681f640 1 -- 172.21.15.81:0/999459918 learned_addr learned my addr 172.21.15.81:0/999459918 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d601e640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75d0070dd0 0x7f75d01f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d581d640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75d00d0bb0 0x7f75d00b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d681f640 1 -- 172.21.15.81:0/999459918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75d00d0bb0 msgr2=0x7f75d00b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d681f640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75d00d0bb0 0x7f75d00b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:30.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d681f640 1 -- 172.21.15.81:0/999459918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75d0070dd0 msgr2=0x7f75d01f3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:30.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d681f640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75d0070dd0 0x7f75d01f3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:30.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d681f640 1 -- 172.21.15.81:0/999459918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d00b6720 con 0x7f75d0147360 2024-09-16T01:20:30.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d581d640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75d00d0bb0 0x7f75d00b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:20:30.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d681f640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d0147360 0x7f75d009e110 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f75c8007e40 tx=0x7f75c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:30.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75c6ffd640 1 -- 172.21.15.81:0/999459918 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c8014620 con 0x7f75d0147360 2024-09-16T01:20:30.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75c6ffd640 1 -- 172.21.15.81:0/999459918 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c8019070 con 0x7f75d0147360 2024-09-16T01:20:30.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75c6ffd640 1 -- 172.21.15.81:0/999459918 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c8014a20 con 0x7f75d0147360 2024-09-16T01:20:30.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d8282640 1 -- 172.21.15.81:0/999459918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d00b6a00 con 0x7f75d0147360 2024-09-16T01:20:30.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.748+0000 7f75d8282640 1 -- 172.21.15.81:0/999459918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d013a090 con 0x7f75d0147360 2024-09-16T01:20:30.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.749+0000 7f75d8282640 1 -- 172.21.15.81:0/999459918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d00ae550 con 0x7f75d0147360 2024-09-16T01:20:30.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.750+0000 7f75c6ffd640 1 -- 172.21.15.81:0/999459918 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f75c8014bc0 con 0x7f75d0147360 2024-09-16T01:20:30.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.750+0000 7f75c6ffd640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f75b406c2b0 0x7f75b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:30.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.750+0000 7f75d601e640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f75b406c2b0 0x7f75b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:30.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.750+0000 7f75c6ffd640 1 -- 172.21.15.81:0/999459918 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f75c808be10 con 0x7f75d0147360 2024-09-16T01:20:30.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.751+0000 7f75d601e640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f75b406c2b0 0x7f75b406e770 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f75cc034000 tx=0x7f75cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:30.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.755+0000 7f75c6ffd640 1 -- 172.21.15.81:0/999459918 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75c805a410 con 0x7f75d0147360 2024-09-16T01:20:30.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.957+0000 7f75d8282640 1 -- 172.21.15.81:0/999459918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f75d00702c0 con 0x7f75d0147360 2024-09-16T01:20:30.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.957+0000 7f75c6ffd640 1 -- 172.21.15.81:0/999459918 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f75c8059d10 con 0x7f75d0147360 2024-09-16T01:20:30.958 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:20:30.958 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:20:30.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.959+0000 7f75d8282640 1 -- 172.21.15.81:0/999459918 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f75b406c2b0 msgr2=0x7f75b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:30.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.959+0000 7f75d8282640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f75b406c2b0 0x7f75b406e770 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f75cc034000 tx=0x7f75cc02e000 comp rx=0 tx=0).stop 2024-09-16T01:20:30.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.959+0000 7f75d8282640 1 -- 172.21.15.81:0/999459918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d0147360 msgr2=0x7f75d009e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:30.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.959+0000 7f75d8282640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d0147360 0x7f75d009e110 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f75c8007e40 tx=0x7f75c800e4b0 comp rx=0 tx=0).stop 2024-09-16T01:20:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.959+0000 7f75d8282640 1 -- 172.21.15.81:0/999459918 shutdown_connections 2024-09-16T01:20:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.959+0000 7f75d8282640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f75b406c2b0 0x7f75b406e770 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.959+0000 7f75d8282640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75d0147360 0x7f75d009e110 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.959+0000 7f75d8282640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f75d00d0bb0 0x7f75d00b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.959+0000 7f75d8282640 1 --2- 172.21.15.81:0/999459918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f75d0070dd0 0x7f75d01f3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.959+0000 7f75d8282640 1 -- 172.21.15.81:0/999459918 >> 172.21.15.81:0/999459918 conn(0x7f75d00b2f40 msgr2=0x7f75d00b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.959+0000 7f75d8282640 1 -- 172.21.15.81:0/999459918 shutdown_connections 2024-09-16T01:20:30.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:30.959+0000 7f75d8282640 1 -- 172.21.15.81:0/999459918 wait complete. 2024-09-16T01:20:30.971 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:20:30.971 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:20:32.103 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:35.972 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:20:36.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.078+0000 7fcdb559f640 1 Processor -- start 2024-09-16T01:20:36.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.079+0000 7fcdb559f640 1 -- start start 2024-09-16T01:20:36.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.079+0000 7fcdb559f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb015e990 0x7fcdb00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:36.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.079+0000 7fcdb559f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcdb00ae140 0x7fcdb00ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:36.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.079+0000 7fcdb559f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdb00b6520 con 0x7fcdb015e5b0 2024-09-16T01:20:36.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.079+0000 7fcdb559f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fcdb00b2c30 con 0x7fcdb00ae140 2024-09-16T01:20:36.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.079+0000 7fcdb559f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb00aeb30 con 0x7fcdb015e990 2024-09-16T01:20:36.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.080+0000 7fcdaf7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcdb00ae140 0x7fcdb00ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:36.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.080+0000 7fcdae7fc640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb015e990 0x7fcdb00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:36.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.080+0000 7fcdaeffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fcdb015e5b0 0x7fcdb00b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:41398/0 (socket says 172.21.15.81:41398) 2024-09-16T01:20:36.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.080+0000 7fcdaeffd640 1 -- 172.21.15.81:0/1038831727 learned_addr learned my addr 172.21.15.81:0/1038831727 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:20:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.080+0000 7fcdaf7fe640 1 -- 172.21.15.81:0/1038831727 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb015e990 msgr2=0x7fcdb00b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.080+0000 7fcdaf7fe640 1 --2- 172.21.15.81:0/1038831727 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb015e990 0x7fcdb00b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.080+0000 7fcdaf7fe640 1 -- 172.21.15.81:0/1038831727 >> v1:172.21.15.102:6789/0 conn(0x7fcdb015e5b0 legacy=0x7fcdb00b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.080+0000 7fcdaf7fe640 1 -- 172.21.15.81:0/1038831727 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb00b1a40 con 0x7fcdb00ae140 2024-09-16T01:20:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.080+0000 7fcdae7fc640 1 --2- 172.21.15.81:0/1038831727 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb015e990 0x7fcdb00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:20:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.081+0000 7fcdaf7fe640 1 --2- 172.21.15.81:0/1038831727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb00ae140 0x7fcdb00ae5f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcda80097a0 tx=0x7fcda802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8b1ee32305620dd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:36.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.081+0000 7fcdadffb640 1 -- 172.21.15.81:0/1038831727 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda8037070 con 0x7fcdb00ae140 2024-09-16T01:20:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.081+0000 7fcdadffb640 1 -- 172.21.15.81:0/1038831727 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda8032440 con 0x7fcdb00ae140 2024-09-16T01:20:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.081+0000 7fcdadffb640 1 -- 172.21.15.81:0/1038831727 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda8032810 con 0x7fcdb00ae140 2024-09-16T01:20:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.082+0000 7fcdb559f640 1 -- 172.21.15.81:0/1038831727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb00ae140 msgr2=0x7fcdb00ae5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.082+0000 7fcdb559f640 1 --2- 172.21.15.81:0/1038831727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb00ae140 0x7fcdb00ae5f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcda80097a0 tx=0x7fcda802a180 comp rx=0 tx=0).stop 2024-09-16T01:20:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.082+0000 7fcdb559f640 1 -- 172.21.15.81:0/1038831727 shutdown_connections 2024-09-16T01:20:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.082+0000 7fcdb559f640 1 --2- 172.21.15.81:0/1038831727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb00ae140 0x7fcdb00ae5f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.082+0000 7fcdb559f640 1 --2- 172.21.15.81:0/1038831727 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb015e990 0x7fcdb00b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.082+0000 7fcdb559f640 1 -- 172.21.15.81:0/1038831727 >> 172.21.15.81:0/1038831727 conn(0x7fcdb0073490 msgr2=0x7fcdb00b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.082+0000 7fcdb559f640 1 -- 172.21.15.81:0/1038831727 shutdown_connections 2024-09-16T01:20:36.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.082+0000 7fcdb559f640 1 -- 172.21.15.81:0/1038831727 wait complete. 2024-09-16T01:20:36.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.083+0000 7fcdb559f640 1 Processor -- start 2024-09-16T01:20:36.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.083+0000 7fcdb559f640 1 -- start start 2024-09-16T01:20:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdb559f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb00ae140 0x7fcdb01f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdb559f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb015e5b0 0x7fcdb01e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdb559f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb015e990 0x7fcdb014b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdb559f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb00b0490 con 0x7fcdb015e5b0 2024-09-16T01:20:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdb559f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb00b2000 con 0x7fcdb00ae140 2024-09-16T01:20:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdb559f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb00b07e0 con 0x7fcdb015e990 2024-09-16T01:20:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdae7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb015e5b0 0x7fcdb01e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdaf7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb015e990 0x7fcdb014b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdaeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb00ae140 0x7fcdb01f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:36.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdae7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb015e5b0 0x7fcdb01e73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45582/0 (socket says 172.21.15.81:45582) 2024-09-16T01:20:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdae7fc640 1 -- 172.21.15.81:0/3262976489 learned_addr learned my addr 172.21.15.81:0/3262976489 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdae7fc640 1 -- 172.21.15.81:0/3262976489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb015e990 msgr2=0x7fcdb014b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdae7fc640 1 --2- 172.21.15.81:0/3262976489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb015e990 0x7fcdb014b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdae7fc640 1 -- 172.21.15.81:0/3262976489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb00ae140 msgr2=0x7fcdb01f44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdae7fc640 1 --2- 172.21.15.81:0/3262976489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb00ae140 0x7fcdb01f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.084+0000 7fcdae7fc640 1 -- 172.21.15.81:0/3262976489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb00ce9b0 con 0x7fcdb015e5b0 2024-09-16T01:20:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.085+0000 7fcdae7fc640 1 --2- 172.21.15.81:0/3262976489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb015e5b0 0x7fcdb01e73e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fcda400e910 tx=0x7fcda400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.085+0000 7fcd977fe640 1 -- 172.21.15.81:0/3262976489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4017070 con 0x7fcdb015e5b0 2024-09-16T01:20:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.085+0000 7fcd977fe640 1 -- 172.21.15.81:0/3262976489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda400ca00 con 0x7fcdb015e5b0 2024-09-16T01:20:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.085+0000 7fcdb559f640 1 -- 172.21.15.81:0/3262976489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb00cec90 con 0x7fcdb015e5b0 2024-09-16T01:20:36.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.085+0000 7fcd977fe640 1 -- 172.21.15.81:0/3262976489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda400cdb0 con 0x7fcdb015e5b0 2024-09-16T01:20:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.085+0000 7fcdb559f640 1 -- 172.21.15.81:0/3262976489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb00cf250 con 0x7fcdb015e5b0 2024-09-16T01:20:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.086+0000 7fcdb559f640 1 -- 172.21.15.81:0/3262976489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb00ae5f0 con 0x7fcdb015e5b0 2024-09-16T01:20:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.086+0000 7fcd977fe640 1 -- 172.21.15.81:0/3262976489 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcda401a070 con 0x7fcdb015e5b0 2024-09-16T01:20:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.087+0000 7fcd977fe640 1 --2- 172.21.15.81:0/3262976489 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd9c06c2b0 0x7fcd9c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.087+0000 7fcd977fe640 1 -- 172.21.15.81:0/3262976489 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fcda408b7f0 con 0x7fcdb015e5b0 2024-09-16T01:20:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.087+0000 7fcdaeffd640 1 --2- 172.21.15.81:0/3262976489 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd9c06c2b0 0x7fcd9c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:36.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.087+0000 7fcdaeffd640 1 --2- 172.21.15.81:0/3262976489 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd9c06c2b0 0x7fcd9c06e770 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcda00012e0 tx=0x7fcda0001a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:36.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.091+0000 7fcd977fe640 1 -- 172.21.15.81:0/3262976489 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcda4059720 con 0x7fcdb015e5b0 2024-09-16T01:20:36.107 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.294+0000 7fcdb559f640 1 -- 172.21.15.81:0/3262976489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcdb01f4a30 con 0x7fcdb015e5b0 2024-09-16T01:20:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.294+0000 7fcd977fe640 1 -- 172.21.15.81:0/3262976489 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fcda405da20 con 0x7fcdb015e5b0 2024-09-16T01:20:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:20:36.296 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:20:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.296+0000 7fcdb559f640 1 -- 172.21.15.81:0/3262976489 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd9c06c2b0 msgr2=0x7fcd9c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.296+0000 7fcdb559f640 1 --2- 172.21.15.81:0/3262976489 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd9c06c2b0 0x7fcd9c06e770 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcda00012e0 tx=0x7fcda0001a30 comp rx=0 tx=0).stop 2024-09-16T01:20:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.296+0000 7fcdb559f640 1 -- 172.21.15.81:0/3262976489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb015e5b0 msgr2=0x7fcdb01e73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.296+0000 7fcdb559f640 1 --2- 172.21.15.81:0/3262976489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb015e5b0 0x7fcdb01e73e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fcda400e910 tx=0x7fcda400edd0 comp rx=0 tx=0).stop 2024-09-16T01:20:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.296+0000 7fcdb559f640 1 -- 172.21.15.81:0/3262976489 shutdown_connections 2024-09-16T01:20:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.296+0000 7fcdb559f640 1 --2- 172.21.15.81:0/3262976489 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd9c06c2b0 0x7fcd9c06e770 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.296+0000 7fcdb559f640 1 --2- 172.21.15.81:0/3262976489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb015e990 0x7fcdb014b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.296+0000 7fcdb559f640 1 --2- 172.21.15.81:0/3262976489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb015e5b0 0x7fcdb01e73e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.296+0000 7fcdb559f640 1 --2- 172.21.15.81:0/3262976489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb00ae140 0x7fcdb01f44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.296+0000 7fcdb559f640 1 -- 172.21.15.81:0/3262976489 >> 172.21.15.81:0/3262976489 conn(0x7fcdb0073490 msgr2=0x7fcdb006eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.296+0000 7fcdb559f640 1 -- 172.21.15.81:0/3262976489 shutdown_connections 2024-09-16T01:20:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:36.296+0000 7fcdb559f640 1 -- 172.21.15.81:0/3262976489 wait complete. 2024-09-16T01:20:36.309 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:20:36.309 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:20:38.109 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:38.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:20:38.991 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:20:40.112 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:41.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:20:41.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.416+0000 7f5d47be4640 1 Processor -- start 2024-09-16T01:20:41.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.417+0000 7f5d47be4640 1 -- start start 2024-09-16T01:20:41.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.417+0000 7f5d47be4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5d40162060 0x7f5d400b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:41.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.417+0000 7f5d47be4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d400b64b0 0x7f5d400b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:41.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.417+0000 7f5d47be4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4006d9f0 con 0x7f5d40161c80 2024-09-16T01:20:41.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.418+0000 7f5d47be4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5d4006dcd0 con 0x7f5d40162060 2024-09-16T01:20:41.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.418+0000 7f5d47be4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4006dfb0 con 0x7f5d400b64b0 2024-09-16T01:20:41.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.418+0000 7f5d4517f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5d40162060 0x7f5d400b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:41.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.418+0000 7f5d45980640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5d40161c80 0x7f5d4006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53680/0 (socket says 172.21.15.81:53680) 2024-09-16T01:20:41.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.418+0000 7f5d45980640 1 -- 172.21.15.81:0/3337173572 learned_addr learned my addr 172.21.15.81:0/3337173572 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:20:41.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.418+0000 7f5d4517f640 1 -- 172.21.15.81:0/3337173572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d400b64b0 msgr2=0x7f5d400b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:41.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.418+0000 7f5d46181640 1 --2- 172.21.15.81:0/3337173572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d400b64b0 0x7f5d400b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:41.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.418+0000 7f5d4517f640 1 --2- 172.21.15.81:0/3337173572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d400b64b0 0x7f5d400b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.418+0000 7f5d4497e640 1 -- 172.21.15.81:0/3337173572 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2270683502 0 0) 0x7f5d4006d9f0 con 0x7f5d40161c80 2024-09-16T01:20:41.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.418+0000 7f5d4517f640 1 -- 172.21.15.81:0/3337173572 >> v1:172.21.15.81:6789/0 conn(0x7f5d40161c80 legacy=0x7f5d4006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:41.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.418+0000 7f5d4517f640 1 -- 172.21.15.81:0/3337173572 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d400d01f0 con 0x7f5d40162060 2024-09-16T01:20:41.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.418+0000 7f5d46181640 1 --2- 172.21.15.81:0/3337173572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d400b64b0 0x7f5d400b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:20:41.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.419+0000 7f5d4517f640 1 --2- 172.21.15.81:0/3337173572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d40162060 0x7f5d400b5f70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5d300097a0 tx=0x7f5d3002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3ba17402decaf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:41.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.419+0000 7f5d4497e640 1 -- 172.21.15.81:0/3337173572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30037070 con 0x7f5d40162060 2024-09-16T01:20:41.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.419+0000 7f5d4497e640 1 -- 172.21.15.81:0/3337173572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d30032440 con 0x7f5d40162060 2024-09-16T01:20:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.419+0000 7f5d4497e640 1 -- 172.21.15.81:0/3337173572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30032810 con 0x7f5d40162060 2024-09-16T01:20:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.419+0000 7f5d47be4640 1 -- 172.21.15.81:0/3337173572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d40162060 msgr2=0x7f5d400b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.419+0000 7f5d47be4640 1 --2- 172.21.15.81:0/3337173572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d40162060 0x7f5d400b5f70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5d300097a0 tx=0x7f5d3002a180 comp rx=0 tx=0).stop 2024-09-16T01:20:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.419+0000 7f5d47be4640 1 -- 172.21.15.81:0/3337173572 shutdown_connections 2024-09-16T01:20:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.419+0000 7f5d47be4640 1 --2- 172.21.15.81:0/3337173572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d400b64b0 0x7f5d400b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.419+0000 7f5d47be4640 1 --2- 172.21.15.81:0/3337173572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d40162060 0x7f5d400b5f70 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.420+0000 7f5d47be4640 1 -- 172.21.15.81:0/3337173572 >> 172.21.15.81:0/3337173572 conn(0x7f5d400d44f0 msgr2=0x7f5d400d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.420+0000 7f5d47be4640 1 -- 172.21.15.81:0/3337173572 shutdown_connections 2024-09-16T01:20:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.420+0000 7f5d47be4640 1 -- 172.21.15.81:0/3337173572 wait complete. 2024-09-16T01:20:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.421+0000 7f5d47be4640 1 Processor -- start 2024-09-16T01:20:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.421+0000 7f5d47be4640 1 -- start start 2024-09-16T01:20:41.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.421+0000 7f5d47be4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b64b0 0x7f5d40160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:41.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.421+0000 7f5d47be4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d40161c80 0x7f5d40159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:41.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.421+0000 7f5d47be4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d40162060 0x7f5d400ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:41.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.421+0000 7f5d47be4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d400cf360 con 0x7f5d400b64b0 2024-09-16T01:20:41.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.421+0000 7f5d47be4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5d400cf1e0 con 0x7f5d40162060 2024-09-16T01:20:41.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.421+0000 7f5d47be4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5d400cf4e0 con 0x7f5d40161c80 2024-09-16T01:20:41.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d45980640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b64b0 0x7f5d40160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:41.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d45980640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b64b0 0x7f5d40160390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41394/0 (socket says 172.21.15.81:41394) 2024-09-16T01:20:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d45980640 1 -- 172.21.15.81:0/3774696611 learned_addr learned my addr 172.21.15.81:0/3774696611 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d45980640 1 -- 172.21.15.81:0/3774696611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d40161c80 msgr2=0x7f5d40159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d45980640 1 --2- 172.21.15.81:0/3774696611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d40161c80 0x7f5d40159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d45980640 1 -- 172.21.15.81:0/3774696611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d40162060 msgr2=0x7f5d400ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d45980640 1 --2- 172.21.15.81:0/3774696611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d40162060 0x7f5d400ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d45980640 1 -- 172.21.15.81:0/3774696611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d400cae50 con 0x7f5d400b64b0 2024-09-16T01:20:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d45980640 1 --2- 172.21.15.81:0/3774696611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b64b0 0x7f5d40160390 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c4d0 tx=0x7f5d3c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d367fc640 1 -- 172.21.15.81:0/3774696611 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c018070 con 0x7f5d400b64b0 2024-09-16T01:20:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d367fc640 1 -- 172.21.15.81:0/3774696611 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c007500 con 0x7f5d400b64b0 2024-09-16T01:20:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d47be4640 1 -- 172.21.15.81:0/3774696611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d40160970 con 0x7f5d400b64b0 2024-09-16T01:20:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d367fc640 1 -- 172.21.15.81:0/3774696611 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c004a20 con 0x7f5d400b64b0 2024-09-16T01:20:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.422+0000 7f5d47be4640 1 -- 172.21.15.81:0/3774696611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d400cc450 con 0x7f5d400b64b0 2024-09-16T01:20:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.423+0000 7f5d47be4640 1 -- 172.21.15.81:0/3774696611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d400b5f70 con 0x7f5d400b64b0 2024-09-16T01:20:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.424+0000 7f5d367fc640 1 -- 172.21.15.81:0/3774696611 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5d3c01b070 con 0x7f5d400b64b0 2024-09-16T01:20:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.424+0000 7f5d367fc640 1 --2- 172.21.15.81:0/3774696611 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5d2406c2b0 0x7f5d2406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.424+0000 7f5d367fc640 1 -- 172.21.15.81:0/3774696611 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f5d3c08a980 con 0x7f5d400b64b0 2024-09-16T01:20:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.424+0000 7f5d4517f640 1 --2- 172.21.15.81:0/3774696611 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5d2406c2b0 0x7f5d2406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.425+0000 7f5d4517f640 1 --2- 172.21.15.81:0/3774696611 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5d2406c2b0 0x7f5d2406e770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5d30034000 tx=0x7f5d3002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:41.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.428+0000 7f5d367fc640 1 -- 172.21.15.81:0/3774696611 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d3c058ef0 con 0x7f5d400b64b0 2024-09-16T01:20:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.627+0000 7f5d47be4640 1 -- 172.21.15.81:0/3774696611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5d400ba470 con 0x7f5d400b64b0 2024-09-16T01:20:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.628+0000 7f5d367fc640 1 -- 172.21.15.81:0/3774696611 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f5d3c0587f0 con 0x7f5d400b64b0 2024-09-16T01:20:41.630 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:20:41.630 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:20:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.629+0000 7f5d47be4640 1 -- 172.21.15.81:0/3774696611 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5d2406c2b0 msgr2=0x7f5d2406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.629+0000 7f5d47be4640 1 --2- 172.21.15.81:0/3774696611 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5d2406c2b0 0x7f5d2406e770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5d30034000 tx=0x7f5d3002c000 comp rx=0 tx=0).stop 2024-09-16T01:20:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.629+0000 7f5d47be4640 1 -- 172.21.15.81:0/3774696611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b64b0 msgr2=0x7f5d40160390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.629+0000 7f5d47be4640 1 --2- 172.21.15.81:0/3774696611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b64b0 0x7f5d40160390 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c4d0 tx=0x7f5d3c00c990 comp rx=0 tx=0).stop 2024-09-16T01:20:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.630+0000 7f5d47be4640 1 -- 172.21.15.81:0/3774696611 shutdown_connections 2024-09-16T01:20:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.630+0000 7f5d47be4640 1 --2- 172.21.15.81:0/3774696611 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5d2406c2b0 0x7f5d2406e770 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.630+0000 7f5d47be4640 1 --2- 172.21.15.81:0/3774696611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d40162060 0x7f5d400ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.630+0000 7f5d47be4640 1 --2- 172.21.15.81:0/3774696611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d40161c80 0x7f5d40159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.630+0000 7f5d47be4640 1 --2- 172.21.15.81:0/3774696611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d400b64b0 0x7f5d40160390 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.630+0000 7f5d47be4640 1 -- 172.21.15.81:0/3774696611 >> 172.21.15.81:0/3774696611 conn(0x7f5d400d44f0 msgr2=0x7f5d400d2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:41.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.630+0000 7f5d47be4640 1 -- 172.21.15.81:0/3774696611 shutdown_connections 2024-09-16T01:20:41.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:41.630+0000 7f5d47be4640 1 -- 172.21.15.81:0/3774696611 wait complete. 2024-09-16T01:20:41.642 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:20:41.642 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:20:42.113 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:44.115 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:46.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:20:46.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.751+0000 7f3291e27640 1 Processor -- start 2024-09-16T01:20:46.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.751+0000 7f3291e27640 1 -- start start 2024-09-16T01:20:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.751+0000 7f3291e27640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f328c161c80 0x7f328c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f3291e27640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f328c162060 0x7f328c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f3291e27640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f328c06e870 con 0x7f328c0b64b0 2024-09-16T01:20:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f3291e27640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f328c06d9f0 con 0x7f328c161c80 2024-09-16T01:20:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f3291e27640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f328c06dcd0 con 0x7f328c162060 2024-09-16T01:20:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f328b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f328c161c80 0x7f328c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f328b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f328c161c80 0x7f328c06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41402/0 (socket says 172.21.15.81:41402) 2024-09-16T01:20:46.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f328b7fe640 1 -- 172.21.15.81:0/86696733 learned_addr learned my addr 172.21.15.81:0/86696733 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f328affd640 1 --2- 172.21.15.81:0/86696733 >> v2:172.21.15.102:3300/0 conn(0x7f328c162060 0x7f328c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f328b7fe640 1 -- 172.21.15.81:0/86696733 >> v2:172.21.15.102:3300/0 conn(0x7f328c162060 msgr2=0x7f328c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f328b7fe640 1 --2- 172.21.15.81:0/86696733 >> v2:172.21.15.102:3300/0 conn(0x7f328c162060 0x7f328c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f328b7fe640 1 -- 172.21.15.81:0/86696733 >> v1:172.21.15.102:6789/0 conn(0x7f328c0b64b0 legacy=0x7f328c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f328b7fe640 1 -- 172.21.15.81:0/86696733 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328c06dfb0 con 0x7f328c161c80 2024-09-16T01:20:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.752+0000 7f328affd640 1 --2- 172.21.15.81:0/86696733 >> v2:172.21.15.102:3300/0 conn(0x7f328c162060 0x7f328c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:20:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.753+0000 7f328b7fe640 1 --2- 172.21.15.81:0/86696733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328c161c80 0x7f328c06e330 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f328c08e830 tx=0x7f327c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef31c3719b85902 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.753+0000 7f328a7fc640 1 -- 172.21.15.81:0/86696733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c037070 con 0x7f328c161c80 2024-09-16T01:20:46.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.753+0000 7f328a7fc640 1 -- 172.21.15.81:0/86696733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f327c032440 con 0x7f328c161c80 2024-09-16T01:20:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.753+0000 7f328a7fc640 1 -- 172.21.15.81:0/86696733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327c032810 con 0x7f328c161c80 2024-09-16T01:20:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.753+0000 7f3291e27640 1 -- 172.21.15.81:0/86696733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328c161c80 msgr2=0x7f328c06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.753+0000 7f3291e27640 1 --2- 172.21.15.81:0/86696733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328c161c80 0x7f328c06e330 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f328c08e830 tx=0x7f327c02a230 comp rx=0 tx=0).stop 2024-09-16T01:20:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.754+0000 7f3291e27640 1 -- 172.21.15.81:0/86696733 shutdown_connections 2024-09-16T01:20:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.754+0000 7f3291e27640 1 --2- 172.21.15.81:0/86696733 >> v2:172.21.15.102:3300/0 conn(0x7f328c162060 0x7f328c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.754+0000 7f3291e27640 1 --2- 172.21.15.81:0/86696733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328c161c80 0x7f328c06e330 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:46.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.754+0000 7f3291e27640 1 -- 172.21.15.81:0/86696733 >> 172.21.15.81:0/86696733 conn(0x7f328c0d44f0 msgr2=0x7f328c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:46.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.754+0000 7f3291e27640 1 -- 172.21.15.81:0/86696733 shutdown_connections 2024-09-16T01:20:46.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.754+0000 7f3291e27640 1 -- 172.21.15.81:0/86696733 wait complete. 2024-09-16T01:20:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.755+0000 7f3291e27640 1 Processor -- start 2024-09-16T01:20:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.755+0000 7f3291e27640 1 -- start start 2024-09-16T01:20:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f3291e27640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f328c0b64b0 0x7f328c0b9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f3291e27640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f328c161c80 0x7f328c15f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f3291e27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328c162060 0x7f328c0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f3291e27640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f328c0d2a10 con 0x7f328c162060 2024-09-16T01:20:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f3291e27640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f328c0d2890 con 0x7f328c161c80 2024-09-16T01:20:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f3291e27640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f328c0b6960 con 0x7f328c0b64b0 2024-09-16T01:20:46.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f328bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328c162060 0x7f328c0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f328bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328c162060 0x7f328c0cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41408/0 (socket says 172.21.15.81:41408) 2024-09-16T01:20:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f328bfff640 1 -- 172.21.15.81:0/249358181 learned_addr learned my addr 172.21.15.81:0/249358181 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f328b7fe640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f328c0b64b0 0x7f328c0b9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f328affd640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f328c161c80 0x7f328c15f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f328bfff640 1 -- 172.21.15.81:0/249358181 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f328c0b64b0 msgr2=0x7f328c0b9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f328bfff640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f328c0b64b0 0x7f328c0b9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f328bfff640 1 -- 172.21.15.81:0/249358181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f328c161c80 msgr2=0x7f328c15f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f328bfff640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f328c161c80 0x7f328c15f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f328bfff640 1 -- 172.21.15.81:0/249358181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f328c0cb660 con 0x7f328c162060 2024-09-16T01:20:46.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f328bfff640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328c162060 0x7f328c0cbe20 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f328400c7b0 tx=0x7f328400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f3273fff640 1 -- 172.21.15.81:0/249358181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3284004b60 con 0x7f328c162060 2024-09-16T01:20:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f3273fff640 1 -- 172.21.15.81:0/249358181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3284004d00 con 0x7f328c162060 2024-09-16T01:20:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f3273fff640 1 -- 172.21.15.81:0/249358181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328400aa90 con 0x7f328c162060 2024-09-16T01:20:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.756+0000 7f3291e27640 1 -- 172.21.15.81:0/249358181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f328c0b9a70 con 0x7f328c162060 2024-09-16T01:20:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.757+0000 7f3291e27640 1 -- 172.21.15.81:0/249358181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f328c0cb900 con 0x7f328c162060 2024-09-16T01:20:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.758+0000 7f3291e27640 1 -- 172.21.15.81:0/249358181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f328c0cbb00 con 0x7f328c162060 2024-09-16T01:20:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.758+0000 7f3273fff640 1 -- 172.21.15.81:0/249358181 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f328400ac30 con 0x7f328c162060 2024-09-16T01:20:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.759+0000 7f3273fff640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f327806c2b0 0x7f327806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.759+0000 7f3273fff640 1 -- 172.21.15.81:0/249358181 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f328408b8f0 con 0x7f328c162060 2024-09-16T01:20:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.759+0000 7f328b7fe640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f327806c2b0 0x7f327806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:46.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.759+0000 7f328b7fe640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f327806c2b0 0x7f327806e770 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f327c034000 tx=0x7f327c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:46.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.763+0000 7f3273fff640 1 -- 172.21.15.81:0/249358181 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f328c0cbb00 con 0x7f328c162060 2024-09-16T01:20:46.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.962+0000 7f3291e27640 1 -- 172.21.15.81:0/249358181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f328c0ba470 con 0x7f328c162060 2024-09-16T01:20:46.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.962+0000 7f3273fff640 1 -- 172.21.15.81:0/249358181 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f3284020070 con 0x7f328c162060 2024-09-16T01:20:46.964 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:20:46.964 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:20:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.964+0000 7f3291e27640 1 -- 172.21.15.81:0/249358181 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f327806c2b0 msgr2=0x7f327806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.964+0000 7f3291e27640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f327806c2b0 0x7f327806e770 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f327c034000 tx=0x7f327c02e000 comp rx=0 tx=0).stop 2024-09-16T01:20:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.964+0000 7f3291e27640 1 -- 172.21.15.81:0/249358181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328c162060 msgr2=0x7f328c0cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.964+0000 7f3291e27640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328c162060 0x7f328c0cbe20 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f328400c7b0 tx=0x7f328400cc70 comp rx=0 tx=0).stop 2024-09-16T01:20:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.964+0000 7f3291e27640 1 -- 172.21.15.81:0/249358181 shutdown_connections 2024-09-16T01:20:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.964+0000 7f3291e27640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f327806c2b0 0x7f327806e770 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.964+0000 7f3291e27640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328c162060 0x7f328c0cbe20 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.964+0000 7f3291e27640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f328c161c80 0x7f328c15f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.964+0000 7f3291e27640 1 --2- 172.21.15.81:0/249358181 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f328c0b64b0 0x7f328c0b9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.964+0000 7f3291e27640 1 -- 172.21.15.81:0/249358181 >> 172.21.15.81:0/249358181 conn(0x7f328c0d44f0 msgr2=0x7f328c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.964+0000 7f3291e27640 1 -- 172.21.15.81:0/249358181 shutdown_connections 2024-09-16T01:20:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:46.964+0000 7f3291e27640 1 -- 172.21.15.81:0/249358181 wait complete. 2024-09-16T01:20:46.976 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:20:46.976 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:20:48.120 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:50.122 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:51.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:20:52.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.083+0000 7fd6a23b9640 1 Processor -- start 2024-09-16T01:20:52.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.083+0000 7fd6a23b9640 1 -- start start 2024-09-16T01:20:52.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.084+0000 7fd6a23b9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd69c15b300 0x7fd69c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.084+0000 7fd6a23b9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd69c0cd3f0 0x7fd69c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.084+0000 7fd6a23b9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd69c072d30 0x7fd69c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.084+0000 7fd6a23b9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd69c0728a0 con 0x7fd69c072d30 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.084+0000 7fd6a23b9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd69c0cdbe0 con 0x7fd69c0cd3f0 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.084+0000 7fd6a23b9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c0cd900 con 0x7fd69c15b300 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.084+0000 7fd6a0956640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd69c072d30 0x7fd69c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.085+0000 7fd6a0956640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd69c072d30 0x7fd69c06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59660/0 (socket says 172.21.15.81:59660) 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.085+0000 7fd6a0956640 1 -- 172.21.15.81:0/1871710516 learned_addr learned my addr 172.21.15.81:0/1871710516 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.085+0000 7fd69bfff640 1 --2- 172.21.15.81:0/1871710516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd69c15b300 0x7fd69c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.085+0000 7fd69b7fe640 1 --2- 172.21.15.81:0/1871710516 >> v2:172.21.15.102:3300/0 conn(0x7fd69c0cd3f0 0x7fd69c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.085+0000 7fd6a0956640 1 -- 172.21.15.81:0/1871710516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd69c15b300 msgr2=0x7fd69c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.085+0000 7fd6a0956640 1 --2- 172.21.15.81:0/1871710516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd69c15b300 0x7fd69c0cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.085+0000 7fd6a0956640 1 -- 172.21.15.81:0/1871710516 >> v2:172.21.15.102:3300/0 conn(0x7fd69c0cd3f0 msgr2=0x7fd69c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:52.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.085+0000 7fd6a0956640 1 --2- 172.21.15.81:0/1871710516 >> v2:172.21.15.102:3300/0 conn(0x7fd69c0cd3f0 0x7fd69c06f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:52.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.085+0000 7fd6a0956640 1 -- 172.21.15.81:0/1871710516 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c072250 con 0x7fd69c072d30 2024-09-16T01:20:52.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.085+0000 7fd6a0956640 1 --2- 172.21.15.81:0/1871710516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c072d30 0x7fd69c06f700 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd69c06fd40 tx=0x7fd69402c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ac0370d37fa0d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:52.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.086+0000 7fd69affd640 1 -- 172.21.15.81:0/1871710516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69400b2e0 con 0x7fd69c072d30 2024-09-16T01:20:52.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.086+0000 7fd69affd640 1 -- 172.21.15.81:0/1871710516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd694009600 con 0x7fd69c072d30 2024-09-16T01:20:52.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.086+0000 7fd69affd640 1 -- 172.21.15.81:0/1871710516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69400b480 con 0x7fd69c072d30 2024-09-16T01:20:52.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.086+0000 7fd6a23b9640 1 -- 172.21.15.81:0/1871710516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c072d30 msgr2=0x7fd69c06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:52.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.086+0000 7fd6a23b9640 1 --2- 172.21.15.81:0/1871710516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c072d30 0x7fd69c06f700 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd69c06fd40 tx=0x7fd69402c8a0 comp rx=0 tx=0).stop 2024-09-16T01:20:52.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.086+0000 7fd6a23b9640 1 -- 172.21.15.81:0/1871710516 shutdown_connections 2024-09-16T01:20:52.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.086+0000 7fd6a23b9640 1 --2- 172.21.15.81:0/1871710516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c072d30 0x7fd69c06f700 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:52.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.086+0000 7fd6a23b9640 1 --2- 172.21.15.81:0/1871710516 >> v2:172.21.15.102:3300/0 conn(0x7fd69c0cd3f0 0x7fd69c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:52.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.086+0000 7fd6a23b9640 1 --2- 172.21.15.81:0/1871710516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd69c15b300 0x7fd69c0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:52.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.086+0000 7fd6a23b9640 1 -- 172.21.15.81:0/1871710516 >> 172.21.15.81:0/1871710516 conn(0x7fd69c067d70 msgr2=0x7fd69c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:52.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.086+0000 7fd6a23b9640 1 -- 172.21.15.81:0/1871710516 shutdown_connections 2024-09-16T01:20:52.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.086+0000 7fd6a23b9640 1 -- 172.21.15.81:0/1871710516 wait complete. 2024-09-16T01:20:52.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.088+0000 7fd6a23b9640 1 Processor -- start 2024-09-16T01:20:52.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.088+0000 7fd6a23b9640 1 -- start start 2024-09-16T01:20:52.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.088+0000 7fd6a23b9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd69c072d30 0x7fd69c158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:52.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a23b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd69c0cd3f0 0x7fd69c147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a23b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c15b300 0x7fd69c147e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a23b9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c0d0160 con 0x7fd69c15b300 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a23b9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c0cffe0 con 0x7fd69c0cd3f0 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a23b9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c0b3c40 con 0x7fd69c072d30 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a0956640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c15b300 0x7fd69c147e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a0956640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c15b300 0x7fd69c147e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59676/0 (socket says 172.21.15.81:59676) 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a0956640 1 -- 172.21.15.81:0/496489480 learned_addr learned my addr 172.21.15.81:0/496489480 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd69b7fe640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd69c0cd3f0 0x7fd69c147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd69bfff640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd69c072d30 0x7fd69c158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a0956640 1 -- 172.21.15.81:0/496489480 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd69c072d30 msgr2=0x7fd69c158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a0956640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd69c072d30 0x7fd69c158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a0956640 1 -- 172.21.15.81:0/496489480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd69c0cd3f0 msgr2=0x7fd69c147950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:52.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a0956640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd69c0cd3f0 0x7fd69c147950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a0956640 1 -- 172.21.15.81:0/496489480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c0c71f0 con 0x7fd69c15b300 2024-09-16T01:20:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a0956640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c15b300 0x7fd69c147e90 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd69402ce90 tx=0x7fd694004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd698ff9640 1 -- 172.21.15.81:0/496489480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd694041070 con 0x7fd69c15b300 2024-09-16T01:20:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd698ff9640 1 -- 172.21.15.81:0/496489480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd69403d820 con 0x7fd69c15b300 2024-09-16T01:20:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a23b9640 1 -- 172.21.15.81:0/496489480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69c0c7ed0 con 0x7fd69c15b300 2024-09-16T01:20:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd698ff9640 1 -- 172.21.15.81:0/496489480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69403dbd0 con 0x7fd69c15b300 2024-09-16T01:20:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.089+0000 7fd6a23b9640 1 -- 172.21.15.81:0/496489480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69c1592a0 con 0x7fd69c15b300 2024-09-16T01:20:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.090+0000 7fd6a23b9640 1 -- 172.21.15.81:0/496489480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69c0c7cc0 con 0x7fd69c15b300 2024-09-16T01:20:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.091+0000 7fd698ff9640 1 -- 172.21.15.81:0/496489480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd6940333f0 con 0x7fd69c15b300 2024-09-16T01:20:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.091+0000 7fd698ff9640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd68806c2e0 0x7fd68806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.091+0000 7fd698ff9640 1 -- 172.21.15.81:0/496489480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fd694030030 con 0x7fd69c15b300 2024-09-16T01:20:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.091+0000 7fd69bfff640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd68806c2e0 0x7fd68806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.092+0000 7fd69bfff640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd68806c2e0 0x7fd68806e7a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0079a0 tx=0x7fd68c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:52.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.096+0000 7fd698ff9640 1 -- 172.21.15.81:0/496489480 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd69404a060 con 0x7fd69c15b300 2024-09-16T01:20:52.123 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:52.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.296+0000 7fd6a23b9640 1 -- 172.21.15.81:0/496489480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd69c159f60 con 0x7fd69c15b300 2024-09-16T01:20:52.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.296+0000 7fd698ff9640 1 -- 172.21.15.81:0/496489480 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fd69407c660 con 0x7fd69c15b300 2024-09-16T01:20:52.298 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:20:52.298 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:20:52.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.298+0000 7fd6a23b9640 1 -- 172.21.15.81:0/496489480 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd68806c2e0 msgr2=0x7fd68806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:52.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.298+0000 7fd6a23b9640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd68806c2e0 0x7fd68806e7a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0079a0 tx=0x7fd68c008040 comp rx=0 tx=0).stop 2024-09-16T01:20:52.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.298+0000 7fd6a23b9640 1 -- 172.21.15.81:0/496489480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c15b300 msgr2=0x7fd69c147e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:52.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.298+0000 7fd6a23b9640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c15b300 0x7fd69c147e90 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd69402ce90 tx=0x7fd694004a40 comp rx=0 tx=0).stop 2024-09-16T01:20:52.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.298+0000 7fd6a23b9640 1 -- 172.21.15.81:0/496489480 shutdown_connections 2024-09-16T01:20:52.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.298+0000 7fd6a23b9640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd68806c2e0 0x7fd68806e7a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:52.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.298+0000 7fd6a23b9640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd69c15b300 0x7fd69c147e90 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:52.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.298+0000 7fd6a23b9640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd69c0cd3f0 0x7fd69c147950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:52.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.298+0000 7fd6a23b9640 1 --2- 172.21.15.81:0/496489480 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd69c072d30 0x7fd69c158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:52.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.298+0000 7fd6a23b9640 1 -- 172.21.15.81:0/496489480 >> 172.21.15.81:0/496489480 conn(0x7fd69c067d70 msgr2=0x7fd69c15a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:52.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.298+0000 7fd6a23b9640 1 -- 172.21.15.81:0/496489480 shutdown_connections 2024-09-16T01:20:52.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:52.298+0000 7fd6a23b9640 1 -- 172.21.15.81:0/496489480 wait complete. 2024-09-16T01:20:52.311 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:20:52.311 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:20:54.125 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:56.127 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:20:57.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:20:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.419+0000 7efda49e4640 1 Processor -- start 2024-09-16T01:20:57.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.419+0000 7efda49e4640 1 -- start start 2024-09-16T01:20:57.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.420+0000 7efda49e4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efda00b6680 0x7efda0169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:57.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.420+0000 7efda49e4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda006d9f0 con 0x7efda0162060 2024-09-16T01:20:57.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.420+0000 7efda49e4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda006dcd0 con 0x7efda0161c80 2024-09-16T01:20:57.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.420+0000 7efda49e4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efda006dfb0 con 0x7efda00b6680 2024-09-16T01:20:57.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9dd9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efda0162060 0x7efda00b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35004/0 (socket says 172.21.15.81:35004) 2024-09-16T01:20:57.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9dd9b640 1 -- 172.21.15.81:0/1947713073 learned_addr learned my addr 172.21.15.81:0/1947713073 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:20:57.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9ed9d640 1 --2- 172.21.15.81:0/1947713073 >> v2:172.21.15.102:3300/0 conn(0x7efda00b6680 0x7efda0169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:57.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480237340 0 0) 0x7efda006d9f0 con 0x7efda0162060 2024-09-16T01:20:57.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd8c003520 con 0x7efda0162060 2024-09-16T01:20:57.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 48825271 0 0) 0x7efd8c003520 con 0x7efda0162060 2024-09-16T01:20:57.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 >> v2:172.21.15.102:3300/0 conn(0x7efda00b6680 msgr2=0x7efda0169830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:57.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 --2- 172.21.15.81:0/1947713073 >> v2:172.21.15.102:3300/0 conn(0x7efda00b6680 0x7efda0169830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 >> v1:172.21.15.102:6789/0 conn(0x7efda0161c80 legacy=0x7efda006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:57.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda00d01f0 con 0x7efda0162060 2024-09-16T01:20:57.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7efd88001670 con 0x7efda0162060 2024-09-16T01:20:57.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 >> v1:172.21.15.81:6789/0 conn(0x7efda0162060 legacy=0x7efda00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 --2- 172.21.15.81:0/1947713073 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd8c0039b0 0x7efd8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 --2- 172.21.15.81:0/1947713073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c004800 0x7efd8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 --2- 172.21.15.81:0/1947713073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c0051c0 0x7efd8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efda006dfb0 con 0x7efd8c0051c0 2024-09-16T01:20:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c00c060 con 0x7efd8c004800 2024-09-16T01:20:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efd8c00c260 con 0x7efd8c0039b0 2024-09-16T01:20:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9ed9d640 1 --2- 172.21.15.81:0/1947713073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c0051c0 0x7efd8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9dd9b640 1 --2- 172.21.15.81:0/1947713073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c004800 0x7efd8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.421+0000 7efd9e59c640 1 --2- 172.21.15.81:0/1947713073 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd8c0039b0 0x7efd8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.422+0000 7efd9ed9d640 1 -- 172.21.15.81:0/1947713073 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd8c0039b0 msgr2=0x7efd8c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:57.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.422+0000 7efd9ed9d640 1 --2- 172.21.15.81:0/1947713073 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd8c0039b0 0x7efd8c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.422+0000 7efd9ed9d640 1 -- 172.21.15.81:0/1947713073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c004800 msgr2=0x7efd8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:20:57.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.422+0000 7efd9ed9d640 1 --2- 172.21.15.81:0/1947713073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c004800 0x7efd8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.422+0000 7efd9ed9d640 1 -- 172.21.15.81:0/1947713073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c003520 con 0x7efd8c0051c0 2024-09-16T01:20:57.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.422+0000 7efd9ed9d640 1 -- 172.21.15.81:0/1947713073 reap_dead start 2024-09-16T01:20:57.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.422+0000 7efd9ed9d640 1 --2- 172.21.15.81:0/1947713073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c0051c0 0x7efd8c00b9c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7efd90009ac0 tx=0x7efd8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548576c93a5ed00b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:57.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.422+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90009690 con 0x7efd8c0051c0 2024-09-16T01:20:57.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.423+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd90004020 con 0x7efd8c0051c0 2024-09-16T01:20:57.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.423+0000 7efd9d59a640 1 -- 172.21.15.81:0/1947713073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90004410 con 0x7efd8c0051c0 2024-09-16T01:20:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.423+0000 7efda49e4640 1 -- 172.21.15.81:0/1947713073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c0051c0 msgr2=0x7efd8c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.423+0000 7efda49e4640 1 --2- 172.21.15.81:0/1947713073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c0051c0 0x7efd8c00b9c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7efd90009ac0 tx=0x7efd8c005830 comp rx=0 tx=0).stop 2024-09-16T01:20:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.423+0000 7efda49e4640 1 -- 172.21.15.81:0/1947713073 shutdown_connections 2024-09-16T01:20:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.423+0000 7efda49e4640 1 --2- 172.21.15.81:0/1947713073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c0051c0 0x7efd8c00b9c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.423+0000 7efda49e4640 1 -- 172.21.15.81:0/1947713073 >> 172.21.15.81:0/1947713073 conn(0x7efda00d44f0 msgr2=0x7efda00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.423+0000 7efda49e4640 1 -- 172.21.15.81:0/1947713073 shutdown_connections 2024-09-16T01:20:57.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.423+0000 7efda49e4640 1 -- 172.21.15.81:0/1947713073 wait complete. 2024-09-16T01:20:57.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.425+0000 7efda49e4640 1 Processor -- start 2024-09-16T01:20:57.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.425+0000 7efda49e4640 1 -- start start 2024-09-16T01:20:57.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.425+0000 7efda49e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0051c0 0x7efda0159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:57.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.425+0000 7efda49e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda00b7340 0x7efda00b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.425+0000 7efda49e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b77a0 0x7efda00b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.425+0000 7efda49e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efda00b6b30 con 0x7efda00b77a0 2024-09-16T01:20:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.425+0000 7efda49e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efda00d2aa0 con 0x7efd8c0051c0 2024-09-16T01:20:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.425+0000 7efda49e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efda00b6cb0 con 0x7efda00b7340 2024-09-16T01:20:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.425+0000 7efd9ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b77a0 0x7efda00b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd9ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b77a0 0x7efda00b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59686/0 (socket says 172.21.15.81:59686) 2024-09-16T01:20:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd9ed9d640 1 -- 172.21.15.81:0/1050481930 learned_addr learned my addr 172.21.15.81:0/1050481930 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:20:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd9dd9b640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda00b7340 0x7efda00b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd9ed9d640 1 -- 172.21.15.81:0/1050481930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda00b7340 msgr2=0x7efda00b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd9ed9d640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda00b7340 0x7efda00b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd9e59c640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0051c0 0x7efda0159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd9ed9d640 1 -- 172.21.15.81:0/1050481930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0051c0 msgr2=0x7efda0159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd9ed9d640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0051c0 0x7efda0159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd9ed9d640 1 -- 172.21.15.81:0/1050481930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda0159f70 con 0x7efda00b77a0 2024-09-16T01:20:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd9ed9d640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b77a0 0x7efda00b2720 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7efd90009bb0 tx=0x7efd90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd96ffd640 1 -- 172.21.15.81:0/1050481930 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90003e50 con 0x7efda00b77a0 2024-09-16T01:20:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd96ffd640 1 -- 172.21.15.81:0/1050481930 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd90040070 con 0x7efda00b77a0 2024-09-16T01:20:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efda49e4640 1 -- 172.21.15.81:0/1050481930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda00b7d20 con 0x7efda00b77a0 2024-09-16T01:20:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efd96ffd640 1 -- 172.21.15.81:0/1050481930 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9003a470 con 0x7efda00b77a0 2024-09-16T01:20:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.426+0000 7efda49e4640 1 -- 172.21.15.81:0/1050481930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda00b82e0 con 0x7efda00b77a0 2024-09-16T01:20:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.427+0000 7efda49e4640 1 -- 172.21.15.81:0/1050481930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda00b5f70 con 0x7efda00b77a0 2024-09-16T01:20:57.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.428+0000 7efd96ffd640 1 -- 172.21.15.81:0/1050481930 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efd9003a610 con 0x7efda00b77a0 2024-09-16T01:20:57.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.428+0000 7efd96ffd640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8006c480 0x7efd8006e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:20:57.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.428+0000 7efd96ffd640 1 -- 172.21.15.81:0/1050481930 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7efd900ab120 con 0x7efda00b77a0 2024-09-16T01:20:57.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.428+0000 7efd9e59c640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8006c480 0x7efd8006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:20:57.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.429+0000 7efd9e59c640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8006c480 0x7efd8006e940 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efd98003e50 tx=0x7efd98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:20:57.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.433+0000 7efd96ffd640 1 -- 172.21.15.81:0/1050481930 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd90049020 con 0x7efda00b77a0 2024-09-16T01:20:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.632+0000 7efda49e4640 1 -- 172.21.15.81:0/1050481930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efda00d1660 con 0x7efda00b77a0 2024-09-16T01:20:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.632+0000 7efd96ffd640 1 -- 172.21.15.81:0/1050481930 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7efd90079690 con 0x7efda00b77a0 2024-09-16T01:20:57.634 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:20:57.634 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:20:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.634+0000 7efda49e4640 1 -- 172.21.15.81:0/1050481930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8006c480 msgr2=0x7efd8006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.634+0000 7efda49e4640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8006c480 0x7efd8006e940 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efd98003e50 tx=0x7efd98009040 comp rx=0 tx=0).stop 2024-09-16T01:20:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.634+0000 7efda49e4640 1 -- 172.21.15.81:0/1050481930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b77a0 msgr2=0x7efda00b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:20:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.634+0000 7efda49e4640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b77a0 0x7efda00b2720 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7efd90009bb0 tx=0x7efd90004730 comp rx=0 tx=0).stop 2024-09-16T01:20:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.634+0000 7efda49e4640 1 -- 172.21.15.81:0/1050481930 shutdown_connections 2024-09-16T01:20:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.634+0000 7efda49e4640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8006c480 0x7efd8006e940 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.634+0000 7efda49e4640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda00b77a0 0x7efda00b2720 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.634+0000 7efda49e4640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda00b7340 0x7efda00b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.634+0000 7efda49e4640 1 --2- 172.21.15.81:0/1050481930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd8c0051c0 0x7efda0159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:20:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.634+0000 7efda49e4640 1 -- 172.21.15.81:0/1050481930 >> 172.21.15.81:0/1050481930 conn(0x7efda00d44f0 msgr2=0x7efda00d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:20:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.634+0000 7efda49e4640 1 -- 172.21.15.81:0/1050481930 shutdown_connections 2024-09-16T01:20:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:20:57.634+0000 7efda49e4640 1 -- 172.21.15.81:0/1050481930 wait complete. 2024-09-16T01:20:57.647 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:20:57.647 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:20:58.130 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:00.131 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:02.133 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:02.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:21:02.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.757+0000 7fb918111640 1 Processor -- start 2024-09-16T01:21:02.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.757+0000 7fb918111640 1 -- start start 2024-09-16T01:21:02.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.758+0000 7fb918111640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb91015e5d0 0x7fb9100d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:02.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.758+0000 7fb918111640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb91009b140 0x7fb910168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:02.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.758+0000 7fb918111640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb91006cec0 con 0x7fb91006df60 2024-09-16T01:21:02.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.758+0000 7fb918111640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb91006dad0 con 0x7fb91015e5d0 2024-09-16T01:21:02.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.758+0000 7fb918111640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb91006d1a0 con 0x7fb91009b140 2024-09-16T01:21:02.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.758+0000 7fb915ead640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb91015e5d0 0x7fb9100d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:02.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.758+0000 7fb915ead640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb91015e5d0 0x7fb9100d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44940/0 (socket says 172.21.15.81:44940) 2024-09-16T01:21:02.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.758+0000 7fb915ead640 1 -- 172.21.15.81:0/2826538214 learned_addr learned my addr 172.21.15.81:0/2826538214 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:02.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.758+0000 7fb9166ae640 1 --2- 172.21.15.81:0/2826538214 >> v2:172.21.15.102:3300/0 conn(0x7fb91009b140 0x7fb910168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:02.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.759+0000 7fb915ead640 1 -- 172.21.15.81:0/2826538214 >> v2:172.21.15.102:3300/0 conn(0x7fb91009b140 msgr2=0x7fb910168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:02.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.759+0000 7fb915ead640 1 --2- 172.21.15.81:0/2826538214 >> v2:172.21.15.102:3300/0 conn(0x7fb91009b140 0x7fb910168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:02.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.759+0000 7fb915ead640 1 -- 172.21.15.81:0/2826538214 >> v1:172.21.15.102:6789/0 conn(0x7fb91006df60 legacy=0x7fb91009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:02.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.759+0000 7fb915ead640 1 -- 172.21.15.81:0/2826538214 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91006d480 con 0x7fb91015e5d0 2024-09-16T01:21:02.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.759+0000 7fb915ead640 1 --2- 172.21.15.81:0/2826538214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb91015e5d0 0x7fb9100d10f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb900009870 tx=0x7fb90002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b40e585f638451e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:02.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.759+0000 7fb914eab640 1 -- 172.21.15.81:0/2826538214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb900037070 con 0x7fb91015e5d0 2024-09-16T01:21:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.759+0000 7fb914eab640 1 -- 172.21.15.81:0/2826538214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb900032640 con 0x7fb91015e5d0 2024-09-16T01:21:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.759+0000 7fb914eab640 1 -- 172.21.15.81:0/2826538214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb900032a10 con 0x7fb91015e5d0 2024-09-16T01:21:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.760+0000 7fb918111640 1 -- 172.21.15.81:0/2826538214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb91015e5d0 msgr2=0x7fb9100d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.760+0000 7fb918111640 1 --2- 172.21.15.81:0/2826538214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb91015e5d0 0x7fb9100d10f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb900009870 tx=0x7fb90002a330 comp rx=0 tx=0).stop 2024-09-16T01:21:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.760+0000 7fb918111640 1 -- 172.21.15.81:0/2826538214 shutdown_connections 2024-09-16T01:21:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.760+0000 7fb918111640 1 --2- 172.21.15.81:0/2826538214 >> v2:172.21.15.102:3300/0 conn(0x7fb91009b140 0x7fb910168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.760+0000 7fb918111640 1 --2- 172.21.15.81:0/2826538214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb91015e5d0 0x7fb9100d10f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.760+0000 7fb918111640 1 -- 172.21.15.81:0/2826538214 >> 172.21.15.81:0/2826538214 conn(0x7fb9100d23a0 msgr2=0x7fb9100d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.760+0000 7fb918111640 1 -- 172.21.15.81:0/2826538214 shutdown_connections 2024-09-16T01:21:02.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.760+0000 7fb918111640 1 -- 172.21.15.81:0/2826538214 wait complete. 2024-09-16T01:21:02.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.761+0000 7fb918111640 1 Processor -- start 2024-09-16T01:21:02.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.761+0000 7fb918111640 1 -- start start 2024-09-16T01:21:02.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.762+0000 7fb918111640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb91006df60 0x7fb910156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:02.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.762+0000 7fb918111640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb91009b140 0x7fb9100c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:02.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.762+0000 7fb918111640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb91015e5d0 0x7fb91015b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:02.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.762+0000 7fb918111640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb91015eb30 con 0x7fb91009b140 2024-09-16T01:21:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.762+0000 7fb918111640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb91015e9b0 con 0x7fb91015e5d0 2024-09-16T01:21:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.762+0000 7fb918111640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb9100d1630 con 0x7fb91006df60 2024-09-16T01:21:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.762+0000 7fb9156ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb91009b140 0x7fb9100c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.762+0000 7fb9156ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb91009b140 0x7fb9100c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44954/0 (socket says 172.21.15.81:44954) 2024-09-16T01:21:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.762+0000 7fb9156ac640 1 -- 172.21.15.81:0/1281632261 learned_addr learned my addr 172.21.15.81:0/1281632261 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.762+0000 7fb9166ae640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb91015e5d0 0x7fb91015b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.762+0000 7fb915ead640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb91006df60 0x7fb910156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.763+0000 7fb9156ac640 1 -- 172.21.15.81:0/1281632261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb91006df60 msgr2=0x7fb910156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.763+0000 7fb9156ac640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb91006df60 0x7fb910156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.763+0000 7fb9156ac640 1 -- 172.21.15.81:0/1281632261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb91015e5d0 msgr2=0x7fb91015b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.763+0000 7fb9156ac640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb91015e5d0 0x7fb91015b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:02.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.763+0000 7fb9156ac640 1 -- 172.21.15.81:0/1281632261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9100c69a0 con 0x7fb91009b140 2024-09-16T01:21:02.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.763+0000 7fb9156ac640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb91009b140 0x7fb9100c6110 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00c400 tx=0x7fb90c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:02.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.763+0000 7fb9067fc640 1 -- 172.21.15.81:0/1281632261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c0052d0 con 0x7fb91009b140 2024-09-16T01:21:02.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.763+0000 7fb9067fc640 1 -- 172.21.15.81:0/1281632261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90c005490 con 0x7fb91009b140 2024-09-16T01:21:02.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.763+0000 7fb918111640 1 -- 172.21.15.81:0/1281632261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9100c6c80 con 0x7fb91009b140 2024-09-16T01:21:02.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.763+0000 7fb9067fc640 1 -- 172.21.15.81:0/1281632261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c007260 con 0x7fb91009b140 2024-09-16T01:21:02.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.763+0000 7fb918111640 1 -- 172.21.15.81:0/1281632261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9100c7240 con 0x7fb91009b140 2024-09-16T01:21:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.764+0000 7fb918111640 1 -- 172.21.15.81:0/1281632261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9100d10f0 con 0x7fb91009b140 2024-09-16T01:21:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.764+0000 7fb9067fc640 1 -- 172.21.15.81:0/1281632261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb90c007400 con 0x7fb91009b140 2024-09-16T01:21:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.765+0000 7fb9067fc640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8f406c2b0 0x7fb8f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.765+0000 7fb9067fc640 1 -- 172.21.15.81:0/1281632261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7fb90c08aa30 con 0x7fb91009b140 2024-09-16T01:21:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.765+0000 7fb915ead640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8f406c2b0 0x7fb8f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:02.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.766+0000 7fb915ead640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8f406c2b0 0x7fb8f406e770 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb900034000 tx=0x7fb90002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:02.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.769+0000 7fb9067fc640 1 -- 172.21.15.81:0/1281632261 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb90c0589e0 con 0x7fb91009b140 2024-09-16T01:21:02.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.970+0000 7fb918111640 1 -- 172.21.15.81:0/1281632261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb9100c7620 con 0x7fb91009b140 2024-09-16T01:21:02.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.971+0000 7fb9067fc640 1 -- 172.21.15.81:0/1281632261 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fb90c05cce0 con 0x7fb91009b140 2024-09-16T01:21:02.972 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:02.972 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:21:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.973+0000 7fb918111640 1 -- 172.21.15.81:0/1281632261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8f406c2b0 msgr2=0x7fb8f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.973+0000 7fb918111640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8f406c2b0 0x7fb8f406e770 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb900034000 tx=0x7fb90002e000 comp rx=0 tx=0).stop 2024-09-16T01:21:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.973+0000 7fb918111640 1 -- 172.21.15.81:0/1281632261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb91009b140 msgr2=0x7fb9100c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.973+0000 7fb918111640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb91009b140 0x7fb9100c6110 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00c400 tx=0x7fb90c00c8c0 comp rx=0 tx=0).stop 2024-09-16T01:21:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.973+0000 7fb918111640 1 -- 172.21.15.81:0/1281632261 shutdown_connections 2024-09-16T01:21:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.973+0000 7fb918111640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb8f406c2b0 0x7fb8f406e770 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.973+0000 7fb918111640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb91015e5d0 0x7fb91015b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.973+0000 7fb918111640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb91009b140 0x7fb9100c6110 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:02.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.973+0000 7fb918111640 1 --2- 172.21.15.81:0/1281632261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb91006df60 0x7fb910156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:02.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.973+0000 7fb918111640 1 -- 172.21.15.81:0/1281632261 >> 172.21.15.81:0/1281632261 conn(0x7fb9100d23a0 msgr2=0x7fb910070180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:02.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.973+0000 7fb918111640 1 -- 172.21.15.81:0/1281632261 shutdown_connections 2024-09-16T01:21:02.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:02.973+0000 7fb918111640 1 -- 172.21.15.81:0/1281632261 wait complete. 2024-09-16T01:21:02.984 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:21:02.984 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:21:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:06.138 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:07.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:21:08.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.093+0000 7f59c048d640 1 Processor -- start 2024-09-16T01:21:08.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.093+0000 7f59c048d640 1 -- start start 2024-09-16T01:21:08.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.094+0000 7f59c048d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59b8072d30 0x7f59b806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:08.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.094+0000 7f59c048d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f59b806f700 0x7f59b815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:08.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.094+0000 7f59c048d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59b806fae0 con 0x7f59b815b300 2024-09-16T01:21:08.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.094+0000 7f59c048d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f59b80728a0 con 0x7f59b8072d30 2024-09-16T01:21:08.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.094+0000 7f59c048d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f59b80cdbe0 con 0x7f59b806f700 2024-09-16T01:21:08.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.094+0000 7f59bda28640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59b8072d30 0x7f59b806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:08.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.094+0000 7f59bda28640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59b8072d30 0x7f59b806f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44962/0 (socket says 172.21.15.81:44962) 2024-09-16T01:21:08.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.094+0000 7f59bda28640 1 -- 172.21.15.81:0/3080651145 learned_addr learned my addr 172.21.15.81:0/3080651145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:08.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.094+0000 7f59bea2a640 1 --2- 172.21.15.81:0/3080651145 >> v2:172.21.15.102:3300/0 conn(0x7f59b806f700 0x7f59b815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:08.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.095+0000 7f59bda28640 1 -- 172.21.15.81:0/3080651145 >> v2:172.21.15.102:3300/0 conn(0x7f59b806f700 msgr2=0x7f59b815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:08.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.095+0000 7f59bda28640 1 --2- 172.21.15.81:0/3080651145 >> v2:172.21.15.102:3300/0 conn(0x7f59b806f700 0x7f59b815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.095+0000 7f59bda28640 1 -- 172.21.15.81:0/3080651145 >> v1:172.21.15.102:6789/0 conn(0x7f59b815b300 legacy=0x7f59b80cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:08.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.095+0000 7f59bda28640 1 -- 172.21.15.81:0/3080651145 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b80cd900 con 0x7f59b8072d30 2024-09-16T01:21:08.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.095+0000 7f59bda28640 1 --2- 172.21.15.81:0/3080651145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b8072d30 0x7f59b806f1c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f59b80b38f0 tx=0x7f59a802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd175879db09748a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:08.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.096+0000 7f59bd227640 1 -- 172.21.15.81:0/3080651145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a8033640 con 0x7f59b8072d30 2024-09-16T01:21:08.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.096+0000 7f59bd227640 1 -- 172.21.15.81:0/3080651145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a8038070 con 0x7f59b8072d30 2024-09-16T01:21:08.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.096+0000 7f59bd227640 1 -- 172.21.15.81:0/3080651145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a8033a00 con 0x7f59b8072d30 2024-09-16T01:21:08.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.096+0000 7f59c048d640 1 -- 172.21.15.81:0/3080651145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b8072d30 msgr2=0x7f59b806f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:08.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.096+0000 7f59c048d640 1 --2- 172.21.15.81:0/3080651145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b8072d30 0x7f59b806f1c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f59b80b38f0 tx=0x7f59a802c8b0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.096+0000 7f59c048d640 1 -- 172.21.15.81:0/3080651145 shutdown_connections 2024-09-16T01:21:08.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.096+0000 7f59c048d640 1 --2- 172.21.15.81:0/3080651145 >> v2:172.21.15.102:3300/0 conn(0x7f59b806f700 0x7f59b815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.096+0000 7f59c048d640 1 --2- 172.21.15.81:0/3080651145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b8072d30 0x7f59b806f1c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.096+0000 7f59c048d640 1 -- 172.21.15.81:0/3080651145 >> 172.21.15.81:0/3080651145 conn(0x7f59b8067d70 msgr2=0x7f59b806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.096+0000 7f59c048d640 1 -- 172.21.15.81:0/3080651145 shutdown_connections 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.096+0000 7f59c048d640 1 -- 172.21.15.81:0/3080651145 wait complete. 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.097+0000 7f59c048d640 1 Processor -- start 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.097+0000 7f59c048d640 1 -- start start 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.098+0000 7f59c048d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59b806f700 0x7f59b814f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.098+0000 7f59c048d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b8072d30 0x7f59b80c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.098+0000 7f59c048d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59b815b300 0x7f59b8152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.098+0000 7f59c048d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59b80cd5c0 con 0x7f59b8072d30 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.098+0000 7f59c048d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f59b8072530 con 0x7f59b815b300 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.098+0000 7f59c048d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f59b80cffe0 con 0x7f59b806f700 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.098+0000 7f59bda28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b8072d30 0x7f59b80c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.098+0000 7f59bda28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b8072d30 0x7f59b80c6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44972/0 (socket says 172.21.15.81:44972) 2024-09-16T01:21:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.098+0000 7f59bda28640 1 -- 172.21.15.81:0/2074043436 learned_addr learned my addr 172.21.15.81:0/2074043436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.098+0000 7f59be229640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59b806f700 0x7f59b814f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.098+0000 7f59bea2a640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59b815b300 0x7f59b8152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.099+0000 7f59bda28640 1 -- 172.21.15.81:0/2074043436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59b806f700 msgr2=0x7f59b814f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.099+0000 7f59bda28640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59b806f700 0x7f59b814f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.099+0000 7f59bda28640 1 -- 172.21.15.81:0/2074043436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59b815b300 msgr2=0x7f59b8152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.099+0000 7f59bda28640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59b815b300 0x7f59b8152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.099+0000 7f59bda28640 1 -- 172.21.15.81:0/2074043436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59b80c6a80 con 0x7f59b8072d30 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.099+0000 7f59bda28640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b8072d30 0x7f59b80c6030 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f59a802c8f0 tx=0x7f59a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.099+0000 7f59aeffd640 1 -- 172.21.15.81:0/2074043436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a80465f0 con 0x7f59b8072d30 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.099+0000 7f59aeffd640 1 -- 172.21.15.81:0/2074043436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a8033e50 con 0x7f59b8072d30 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.099+0000 7f59c048d640 1 -- 172.21.15.81:0/2074043436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59b8155ad0 con 0x7f59b8072d30 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.099+0000 7f59aeffd640 1 -- 172.21.15.81:0/2074043436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a80469d0 con 0x7f59b8072d30 2024-09-16T01:21:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.099+0000 7f59c048d640 1 -- 172.21.15.81:0/2074043436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59b80c6d60 con 0x7f59b8072d30 2024-09-16T01:21:08.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.100+0000 7f59c048d640 1 -- 172.21.15.81:0/2074043436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59b8156290 con 0x7f59b8072d30 2024-09-16T01:21:08.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.100+0000 7f59aeffd640 1 -- 172.21.15.81:0/2074043436 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f59a804d060 con 0x7f59b8072d30 2024-09-16T01:21:08.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.101+0000 7f59aeffd640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f599c06c2b0 0x7f599c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:08.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.101+0000 7f59aeffd640 1 -- 172.21.15.81:0/2074043436 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f59a80ae390 con 0x7f59b8072d30 2024-09-16T01:21:08.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.101+0000 7f59be229640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f599c06c2b0 0x7f599c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:08.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.101+0000 7f59be229640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f599c06c2b0 0x7f599c06e770 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f59b4001780 tx=0x7f59b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.105+0000 7f59aeffd640 1 -- 172.21.15.81:0/2074043436 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59b8156290 con 0x7f59b8072d30 2024-09-16T01:21:08.139 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.309+0000 7f59c048d640 1 -- 172.21.15.81:0/2074043436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f59b815c750 con 0x7f59b8072d30 2024-09-16T01:21:08.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.309+0000 7f59aeffd640 1 -- 172.21.15.81:0/2074043436 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f59a8041070 con 0x7f59b8072d30 2024-09-16T01:21:08.310 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:08.310 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:21:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.312+0000 7f59c048d640 1 -- 172.21.15.81:0/2074043436 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f599c06c2b0 msgr2=0x7f599c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.312+0000 7f59c048d640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f599c06c2b0 0x7f599c06e770 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f59b4001780 tx=0x7f59b4009040 comp rx=0 tx=0).stop 2024-09-16T01:21:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.312+0000 7f59c048d640 1 -- 172.21.15.81:0/2074043436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b8072d30 msgr2=0x7f59b80c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.312+0000 7f59c048d640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b8072d30 0x7f59b80c6030 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f59a802c8f0 tx=0x7f59a80046c0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.312+0000 7f59c048d640 1 -- 172.21.15.81:0/2074043436 shutdown_connections 2024-09-16T01:21:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.312+0000 7f59c048d640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f599c06c2b0 0x7f599c06e770 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.312+0000 7f59c048d640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59b815b300 0x7f59b8152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.312+0000 7f59c048d640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b8072d30 0x7f59b80c6030 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.312+0000 7f59c048d640 1 --2- 172.21.15.81:0/2074043436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59b806f700 0x7f59b814f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:08.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.312+0000 7f59c048d640 1 -- 172.21.15.81:0/2074043436 >> 172.21.15.81:0/2074043436 conn(0x7f59b8067d70 msgr2=0x7f59b80cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.312+0000 7f59c048d640 1 -- 172.21.15.81:0/2074043436 shutdown_connections 2024-09-16T01:21:08.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:08.312+0000 7f59c048d640 1 -- 172.21.15.81:0/2074043436 wait complete. 2024-09-16T01:21:08.323 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:21:08.323 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:21:09.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:21:09.115 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:21:10.141 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:13.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:21:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.434+0000 7faefad86640 1 Processor -- start 2024-09-16T01:21:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.434+0000 7faefad86640 1 -- start start 2024-09-16T01:21:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.435+0000 7faefad86640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faef40b69d0 0x7faef4162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.435+0000 7faefad86640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faef40af280 0x7faef40afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.435+0000 7faefad86640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faef415eb60 con 0x7faef40affb0 2024-09-16T01:21:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.435+0000 7faefad86640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7faef40b6db0 con 0x7faef40b69d0 2024-09-16T01:21:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.435+0000 7faefad86640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7faef415ee40 con 0x7faef40af280 2024-09-16T01:21:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.435+0000 7faef9323640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faef40affb0 0x7faef4154d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47302/0 (socket says 172.21.15.81:47302) 2024-09-16T01:21:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.435+0000 7faef9323640 1 -- 172.21.15.81:0/561892854 learned_addr learned my addr 172.21.15.81:0/561892854 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef8b22640 1 --2- 172.21.15.81:0/561892854 >> v2:172.21.15.102:3300/0 conn(0x7faef40b69d0 0x7faef4162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef3fff640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faef40af280 0x7faef40afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121166924 0 0) 0x7faef415eb60 con 0x7faef40affb0 2024-09-16T01:21:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faedc003520 con 0x7faef40affb0 2024-09-16T01:21:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 203221018 0 0) 0x7faedc003520 con 0x7faef40affb0 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faef40af280 msgr2=0x7faef40afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faef40af280 0x7faef40afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 >> v2:172.21.15.102:3300/0 conn(0x7faef40b69d0 msgr2=0x7faef4162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 --2- 172.21.15.81:0/561892854 >> v2:172.21.15.102:3300/0 conn(0x7faef40b69d0 0x7faef4162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef415f120 con 0x7faef40affb0 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7faeec0019f0 con 0x7faef40affb0 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 >> v1:172.21.15.81:6789/0 conn(0x7faef40affb0 legacy=0x7faef4154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc0039b0 0x7faedc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc004800 0x7faedc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faedc0051c0 0x7faedc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faef40b6db0 con 0x7faedc0039b0 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faef415ee40 con 0x7faedc0051c0 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7faedc00c000 con 0x7faedc004800 2024-09-16T01:21:13.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef3fff640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faef40af280 0x7faef40afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:21:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef8b22640 1 --2- 172.21.15.81:0/561892854 >> v2:172.21.15.102:3300/0 conn(0x7faef40b69d0 0x7faef4162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:21:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef8b22640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc0039b0 0x7faedc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef9323640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faedc0051c0 0x7faedc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef3fff640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc004800 0x7faedc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef8b22640 1 -- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc004800 msgr2=0x7faedc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef8b22640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc004800 0x7faedc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef8b22640 1 -- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faedc0051c0 msgr2=0x7faedc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef8b22640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faedc0051c0 0x7faedc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef8b22640 1 -- 172.21.15.81:0/561892854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faedc003520 con 0x7faedc0039b0 2024-09-16T01:21:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.436+0000 7faef3fff640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faedc004800 0x7faedc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:13.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.437+0000 7faef8b22640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc0039b0 0x7faedc003dd0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7faee4009c70 tx=0x7faedc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38145fd0a327e0b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.437+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4009840 con 0x7faedc0039b0 2024-09-16T01:21:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.437+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee4004020 con 0x7faedc0039b0 2024-09-16T01:21:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.437+0000 7faef37fe640 1 -- 172.21.15.81:0/561892854 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee40043d0 con 0x7faedc0039b0 2024-09-16T01:21:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.438+0000 7faefad86640 1 -- 172.21.15.81:0/561892854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc0039b0 msgr2=0x7faedc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.438+0000 7faefad86640 1 --2- 172.21.15.81:0/561892854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc0039b0 0x7faedc003dd0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7faee4009c70 tx=0x7faedc005830 comp rx=0 tx=0).stop 2024-09-16T01:21:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.438+0000 7faef9323640 1 -- 172.21.15.81:0/561892854 reap_dead start 2024-09-16T01:21:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.438+0000 7faefad86640 1 -- 172.21.15.81:0/561892854 shutdown_connections 2024-09-16T01:21:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.438+0000 7faefad86640 1 -- 172.21.15.81:0/561892854 >> 172.21.15.81:0/561892854 conn(0x7faef406bc10 msgr2=0x7faef406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.438+0000 7faefad86640 1 -- 172.21.15.81:0/561892854 shutdown_connections 2024-09-16T01:21:13.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.438+0000 7faefad86640 1 -- 172.21.15.81:0/561892854 wait complete. 2024-09-16T01:21:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.439+0000 7faefad86640 1 Processor -- start 2024-09-16T01:21:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.439+0000 7faefad86640 1 -- start start 2024-09-16T01:21:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faefad86640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc0039b0 0x7faef4154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faefad86640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faef415cb80 0x7faef415d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faefad86640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faef41e9550 0x7faef41e99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faefad86640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faef40afa70 con 0x7faedc0039b0 2024-09-16T01:21:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faefad86640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faef40af6e0 con 0x7faef41e9550 2024-09-16T01:21:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faefad86640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7faef40afbf0 con 0x7faef415cb80 2024-09-16T01:21:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faef8b22640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc0039b0 0x7faef4154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faef8b22640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc0039b0 0x7faef4154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45050/0 (socket says 172.21.15.81:45050) 2024-09-16T01:21:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faef8b22640 1 -- 172.21.15.81:0/190005095 learned_addr learned my addr 172.21.15.81:0/190005095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faef3fff640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faef415cb80 0x7faef415d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faef9323640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faef41e9550 0x7faef41e99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faef8b22640 1 -- 172.21.15.81:0/190005095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faef415cb80 msgr2=0x7faef415d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faef8b22640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faef415cb80 0x7faef415d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faef8b22640 1 -- 172.21.15.81:0/190005095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faef41e9550 msgr2=0x7faef41e99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faef8b22640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faef41e9550 0x7faef41e99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.440+0000 7faef8b22640 1 -- 172.21.15.81:0/190005095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef41f4790 con 0x7faedc0039b0 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.441+0000 7faef8b22640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc0039b0 0x7faef4154320 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7faee4033040 tx=0x7faee4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.441+0000 7faef17fa640 1 -- 172.21.15.81:0/190005095 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4040070 con 0x7faedc0039b0 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.441+0000 7faef17fa640 1 -- 172.21.15.81:0/190005095 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faee4003820 con 0x7faedc0039b0 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.441+0000 7faefad86640 1 -- 172.21.15.81:0/190005095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef41f4a70 con 0x7faedc0039b0 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.441+0000 7faef17fa640 1 -- 172.21.15.81:0/190005095 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faee4003c10 con 0x7faedc0039b0 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.441+0000 7faefad86640 1 -- 172.21.15.81:0/190005095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef41f5030 con 0x7faedc0039b0 2024-09-16T01:21:13.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.442+0000 7faefad86640 1 -- 172.21.15.81:0/190005095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef4162a50 con 0x7faedc0039b0 2024-09-16T01:21:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.442+0000 7faef17fa640 1 -- 172.21.15.81:0/190005095 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faee4043070 con 0x7faedc0039b0 2024-09-16T01:21:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.443+0000 7faef17fa640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faee006c2b0 0x7faee006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.443+0000 7faef17fa640 1 -- 172.21.15.81:0/190005095 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7faee40abfd0 con 0x7faedc0039b0 2024-09-16T01:21:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.443+0000 7faef3fff640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faee006c2b0 0x7faee006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:13.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.443+0000 7faef3fff640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faee006c2b0 0x7faee006e770 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faef4157930 tx=0x7faee8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:13.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.447+0000 7faef17fa640 1 -- 172.21.15.81:0/190005095 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faee407a540 con 0x7faedc0039b0 2024-09-16T01:21:13.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.647+0000 7faefad86640 1 -- 172.21.15.81:0/190005095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faef4158dd0 con 0x7faedc0039b0 2024-09-16T01:21:13.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.648+0000 7faef17fa640 1 -- 172.21.15.81:0/190005095 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7faee4079e40 con 0x7faedc0039b0 2024-09-16T01:21:13.649 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:13.650 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:21:13.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.650+0000 7faefad86640 1 -- 172.21.15.81:0/190005095 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faee006c2b0 msgr2=0x7faee006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:13.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.650+0000 7faefad86640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faee006c2b0 0x7faee006e770 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7faef4157930 tx=0x7faee8008040 comp rx=0 tx=0).stop 2024-09-16T01:21:13.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.650+0000 7faefad86640 1 -- 172.21.15.81:0/190005095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc0039b0 msgr2=0x7faef4154320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:13.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.650+0000 7faefad86640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc0039b0 0x7faef4154320 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7faee4033040 tx=0x7faee4004730 comp rx=0 tx=0).stop 2024-09-16T01:21:13.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.650+0000 7faefad86640 1 -- 172.21.15.81:0/190005095 shutdown_connections 2024-09-16T01:21:13.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.650+0000 7faefad86640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faee006c2b0 0x7faee006e770 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:13.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.650+0000 7faefad86640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faef41e9550 0x7faef41e99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:13.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.650+0000 7faefad86640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faef415cb80 0x7faef415d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:13.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.650+0000 7faefad86640 1 --2- 172.21.15.81:0/190005095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faedc0039b0 0x7faef4154320 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:13.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.650+0000 7faefad86640 1 -- 172.21.15.81:0/190005095 >> 172.21.15.81:0/190005095 conn(0x7faef406bc10 msgr2=0x7faef40b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:13.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.650+0000 7faefad86640 1 -- 172.21.15.81:0/190005095 shutdown_connections 2024-09-16T01:21:13.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:13.650+0000 7faefad86640 1 -- 172.21.15.81:0/190005095 wait complete. 2024-09-16T01:21:13.662 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:21:13.662 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:21:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:16.147 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:18.149 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:18.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:21:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.771+0000 7f9488c82640 1 Processor -- start 2024-09-16T01:21:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.771+0000 7f9488c82640 1 -- start start 2024-09-16T01:21:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9488c82640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f948415b300 0x7f94840cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9488c82640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94840cd3f0 0x7f948406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9488c82640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94840cdbe0 con 0x7f9484072d30 2024-09-16T01:21:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9488c82640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f94840728a0 con 0x7f94840cd3f0 2024-09-16T01:21:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9488c82640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f94840cd900 con 0x7f948415b300 2024-09-16T01:21:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9479d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94840cd3f0 0x7f948406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9479d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94840cd3f0 0x7f948406f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45056/0 (socket says 172.21.15.81:45056) 2024-09-16T01:21:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9479d9b640 1 -- 172.21.15.81:0/3810207650 learned_addr learned my addr 172.21.15.81:0/3810207650 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9482d9d640 1 --1- 172.21.15.81:0/3810207650 >> v1:172.21.15.81:6789/0 conn(0x7f9484072d30 0x7f94840b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47314/0 (socket says 172.21.15.81:47314) 2024-09-16T01:21:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9479d9b640 1 -- 172.21.15.81:0/3810207650 >> v2:172.21.15.102:3300/0 conn(0x7f948415b300 msgr2=0x7f94840cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9479d9b640 1 --2- 172.21.15.81:0/3810207650 >> v2:172.21.15.102:3300/0 conn(0x7f948415b300 0x7f94840cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9479d9b640 1 -- 172.21.15.81:0/3810207650 >> v1:172.21.15.81:6789/0 conn(0x7f9484072d30 legacy=0x7f94840b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9479d9b640 1 -- 172.21.15.81:0/3810207650 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9484072250 con 0x7f94840cd3f0 2024-09-16T01:21:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.772+0000 7f9481d9b640 1 -- 172.21.15.81:0/3810207650 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321358873 0 0) 0x7f94840cdbe0 con 0x7f9484072d30 2024-09-16T01:21:18.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.773+0000 7f9479d9b640 1 --2- 172.21.15.81:0/3810207650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94840cd3f0 0x7f948406f1c0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9484070250 tx=0x7f946c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c84110372e26679 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:18.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.773+0000 7f9481d9b640 1 -- 172.21.15.81:0/3810207650 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c037070 con 0x7f94840cd3f0 2024-09-16T01:21:18.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.773+0000 7f9481d9b640 1 -- 172.21.15.81:0/3810207650 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f946c032440 con 0x7f94840cd3f0 2024-09-16T01:21:18.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.773+0000 7f9481d9b640 1 -- 172.21.15.81:0/3810207650 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c032810 con 0x7f94840cd3f0 2024-09-16T01:21:18.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.773+0000 7f9488c82640 1 -- 172.21.15.81:0/3810207650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94840cd3f0 msgr2=0x7f948406f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.773+0000 7f9488c82640 1 --2- 172.21.15.81:0/3810207650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94840cd3f0 0x7f948406f1c0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9484070250 tx=0x7f946c02a270 comp rx=0 tx=0).stop 2024-09-16T01:21:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.773+0000 7f9488c82640 1 -- 172.21.15.81:0/3810207650 shutdown_connections 2024-09-16T01:21:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.774+0000 7f9488c82640 1 --2- 172.21.15.81:0/3810207650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94840cd3f0 0x7f948406f1c0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.774+0000 7f9488c82640 1 --2- 172.21.15.81:0/3810207650 >> v2:172.21.15.102:3300/0 conn(0x7f948415b300 0x7f94840cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.774+0000 7f9488c82640 1 -- 172.21.15.81:0/3810207650 >> 172.21.15.81:0/3810207650 conn(0x7f9484067d70 msgr2=0x7f948406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.774+0000 7f9488c82640 1 -- 172.21.15.81:0/3810207650 shutdown_connections 2024-09-16T01:21:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.774+0000 7f9488c82640 1 -- 172.21.15.81:0/3810207650 wait complete. 2024-09-16T01:21:18.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.775+0000 7f9488c82640 1 Processor -- start 2024-09-16T01:21:18.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.775+0000 7f9488c82640 1 -- start start 2024-09-16T01:21:18.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9488c82640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9484072d30 0x7f9484156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9488c82640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f94840cd3f0 0x7f94841e8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9488c82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948415b300 0x7f94841e94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9488c82640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94840d0160 con 0x7f948415b300 2024-09-16T01:21:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9488c82640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f94840cffe0 con 0x7f9484072d30 2024-09-16T01:21:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9488c82640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f948406f700 con 0x7f94840cd3f0 2024-09-16T01:21:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9482d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948415b300 0x7f94841e94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9482d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948415b300 0x7f94841e94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45068/0 (socket says 172.21.15.81:45068) 2024-09-16T01:21:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9482d9d640 1 -- 172.21.15.81:0/3643360315 learned_addr learned my addr 172.21.15.81:0/3643360315 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f948259c640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9484072d30 0x7f9484156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9479d9b640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f94840cd3f0 0x7f94841e8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9482d9d640 1 -- 172.21.15.81:0/3643360315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f94840cd3f0 msgr2=0x7f94841e8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9482d9d640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f94840cd3f0 0x7f94841e8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9482d9d640 1 -- 172.21.15.81:0/3643360315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9484072d30 msgr2=0x7f9484156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9482d9d640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9484072d30 0x7f9484156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.776+0000 7f9482d9d640 1 -- 172.21.15.81:0/3643360315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94841e7f10 con 0x7f948415b300 2024-09-16T01:21:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.777+0000 7f9482d9d640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948415b300 0x7f94841e94f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f947c00c7d0 tx=0x7f947c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.777+0000 7f947b7fe640 1 -- 172.21.15.81:0/3643360315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c018070 con 0x7f948415b300 2024-09-16T01:21:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.777+0000 7f947b7fe640 1 -- 172.21.15.81:0/3643360315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947c00a640 con 0x7f948415b300 2024-09-16T01:21:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.777+0000 7f9488c82640 1 -- 172.21.15.81:0/3643360315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94841e81f0 con 0x7f948415b300 2024-09-16T01:21:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.777+0000 7f947b7fe640 1 -- 172.21.15.81:0/3643360315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c00aa70 con 0x7f948415b300 2024-09-16T01:21:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.777+0000 7f9488c82640 1 -- 172.21.15.81:0/3643360315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94841e87b0 con 0x7f948415b300 2024-09-16T01:21:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.778+0000 7f9488c82640 1 -- 172.21.15.81:0/3643360315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f948406fac0 con 0x7f948415b300 2024-09-16T01:21:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.778+0000 7f947b7fe640 1 -- 172.21.15.81:0/3643360315 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f947c01b070 con 0x7f948415b300 2024-09-16T01:21:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.779+0000 7f947b7fe640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f946406c2b0 0x7f946406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.779+0000 7f947b7fe640 1 -- 172.21.15.81:0/3643360315 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f947c08abd0 con 0x7f948415b300 2024-09-16T01:21:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.779+0000 7f948259c640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f946406c2b0 0x7f946406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:18.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.779+0000 7f948259c640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f946406c2b0 0x7f946406e770 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f94740098e0 tx=0x7f9474009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:18.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.783+0000 7f947b7fe640 1 -- 172.21.15.81:0/3643360315 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f947c058af0 con 0x7f948415b300 2024-09-16T01:21:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.982+0000 7f9488c82640 1 -- 172.21.15.81:0/3643360315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9484158760 con 0x7f948415b300 2024-09-16T01:21:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.982+0000 7f947b7fe640 1 -- 172.21.15.81:0/3643360315 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f947c05cdf0 con 0x7f948415b300 2024-09-16T01:21:18.983 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:18.983 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:21:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.984+0000 7f9488c82640 1 -- 172.21.15.81:0/3643360315 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f946406c2b0 msgr2=0x7f946406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.984+0000 7f9488c82640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f946406c2b0 0x7f946406e770 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f94740098e0 tx=0x7f9474009060 comp rx=0 tx=0).stop 2024-09-16T01:21:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.984+0000 7f9488c82640 1 -- 172.21.15.81:0/3643360315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948415b300 msgr2=0x7f94841e94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.984+0000 7f9488c82640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948415b300 0x7f94841e94f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f947c00c7d0 tx=0x7f947c00cc90 comp rx=0 tx=0).stop 2024-09-16T01:21:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.984+0000 7f9488c82640 1 -- 172.21.15.81:0/3643360315 shutdown_connections 2024-09-16T01:21:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.984+0000 7f9488c82640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f946406c2b0 0x7f946406e770 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.984+0000 7f9488c82640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f948415b300 0x7f94841e94f0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.984+0000 7f9488c82640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f94840cd3f0 0x7f94841e8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.984+0000 7f9488c82640 1 --2- 172.21.15.81:0/3643360315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9484072d30 0x7f9484156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.984+0000 7f9488c82640 1 -- 172.21.15.81:0/3643360315 >> 172.21.15.81:0/3643360315 conn(0x7f9484067d70 msgr2=0x7f94840b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.984+0000 7f9488c82640 1 -- 172.21.15.81:0/3643360315 shutdown_connections 2024-09-16T01:21:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:18.984+0000 7f9488c82640 1 -- 172.21.15.81:0/3643360315 wait complete. 2024-09-16T01:21:18.996 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:21:18.996 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:21:20.151 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:23.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:21:24.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.104+0000 7f7ad5cd9640 1 Processor -- start 2024-09-16T01:21:24.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.104+0000 7f7ad5cd9640 1 -- start start 2024-09-16T01:21:24.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.105+0000 7f7ad5cd9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7ad015fc30 0x7f7ad0071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:24.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.105+0000 7f7ad5cd9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ad00b17d0 0x7f7ad009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:24.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.105+0000 7f7ad5cd9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad009ba30 con 0x7f7ad009af70 2024-09-16T01:21:24.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.105+0000 7f7ad5cd9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad00b1590 con 0x7f7ad015fc30 2024-09-16T01:21:24.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.105+0000 7f7ad5cd9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad0160ab0 con 0x7f7ad00b17d0 2024-09-16T01:21:24.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.105+0000 7f7acffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7ad009af70 0x7f7ad00d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42496/0 (socket says 172.21.15.81:42496) 2024-09-16T01:21:24.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.106+0000 7f7acffff640 1 -- 172.21.15.81:0/3850166763 learned_addr learned my addr 172.21.15.81:0/3850166763 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:24.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.106+0000 7f7acf7fe640 1 --2- 172.21.15.81:0/3850166763 >> v2:172.21.15.102:3300/0 conn(0x7f7ad015fc30 0x7f7ad0071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:24.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.106+0000 7f7aceffd640 1 --2- 172.21.15.81:0/3850166763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ad00b17d0 0x7f7ad009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:24.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.106+0000 7f7ace7fc640 1 -- 172.21.15.81:0/3850166763 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1699497032 0 0) 0x7f7ad009ba30 con 0x7f7ad009af70 2024-09-16T01:21:24.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.106+0000 7f7ace7fc640 1 -- 172.21.15.81:0/3850166763 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ab8003520 con 0x7f7ad009af70 2024-09-16T01:21:24.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.106+0000 7f7acf7fe640 1 -- 172.21.15.81:0/3850166763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ad00b17d0 msgr2=0x7f7ad009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:24.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.106+0000 7f7acf7fe640 1 --2- 172.21.15.81:0/3850166763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ad00b17d0 0x7f7ad009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.106+0000 7f7acf7fe640 1 -- 172.21.15.81:0/3850166763 >> v1:172.21.15.81:6789/0 conn(0x7f7ad009af70 legacy=0x7f7ad00d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:24.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.106+0000 7f7ace7fc640 1 -- 172.21.15.81:0/3850166763 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2703816061 0 0) 0x7f7ab8003520 con 0x7f7ad009af70 2024-09-16T01:21:24.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.106+0000 7f7acf7fe640 1 -- 172.21.15.81:0/3850166763 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad009bcf0 con 0x7f7ad015fc30 2024-09-16T01:21:24.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.107+0000 7f7acf7fe640 1 --2- 172.21.15.81:0/3850166763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ad015fc30 0x7f7ad0071e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00097a0 tx=0x7f7ac002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8101152c5827f296 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:24.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.107+0000 7f7ace7fc640 1 -- 172.21.15.81:0/3850166763 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0037070 con 0x7f7ad015fc30 2024-09-16T01:21:24.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.107+0000 7f7ace7fc640 1 -- 172.21.15.81:0/3850166763 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac002ab10 con 0x7f7ad015fc30 2024-09-16T01:21:24.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.107+0000 7f7ace7fc640 1 -- 172.21.15.81:0/3850166763 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80019f0 con 0x7f7ad015fc30 2024-09-16T01:21:24.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.107+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/3850166763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ad015fc30 msgr2=0x7f7ad0071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:24.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.107+0000 7f7ad5cd9640 1 --2- 172.21.15.81:0/3850166763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ad015fc30 0x7f7ad0071e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00097a0 tx=0x7f7ac002a080 comp rx=0 tx=0).stop 2024-09-16T01:21:24.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.108+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/3850166763 shutdown_connections 2024-09-16T01:21:24.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.108+0000 7f7ad5cd9640 1 --2- 172.21.15.81:0/3850166763 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ad00b17d0 0x7f7ad009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.108+0000 7f7ad5cd9640 1 --2- 172.21.15.81:0/3850166763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ad015fc30 0x7f7ad0071e40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.108+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/3850166763 >> 172.21.15.81:0/3850166763 conn(0x7f7ad00d23a0 msgr2=0x7f7ad00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:24.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.108+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/3850166763 shutdown_connections 2024-09-16T01:21:24.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.108+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/3850166763 wait complete. 2024-09-16T01:21:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.109+0000 7f7ad5cd9640 1 Processor -- start 2024-09-16T01:21:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.109+0000 7f7ad5cd9640 1 -- start start 2024-09-16T01:21:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7ad5cd9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ad009af70 0x7f7ad00c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7ad5cd9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad00b17d0 0x7f7ad00b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7ad5cd9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ad015fc30 0x7f7ad00cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7ad5cd9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad00b1bd0 con 0x7f7ad00b17d0 2024-09-16T01:21:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7ad5cd9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad0160fe0 con 0x7f7ad009af70 2024-09-16T01:21:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7ad5cd9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad0071500 con 0x7f7ad015fc30 2024-09-16T01:21:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7aceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad00b17d0 0x7f7ad00b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:24.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7aceffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad00b17d0 0x7f7ad00b5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54204/0 (socket says 172.21.15.81:54204) 2024-09-16T01:21:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7aceffd640 1 -- 172.21.15.81:0/894170444 learned_addr learned my addr 172.21.15.81:0/894170444 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7acf7fe640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ad009af70 0x7f7ad00c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7acffff640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ad015fc30 0x7f7ad00cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7aceffd640 1 -- 172.21.15.81:0/894170444 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ad015fc30 msgr2=0x7f7ad00cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7aceffd640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ad015fc30 0x7f7ad00cfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7aceffd640 1 -- 172.21.15.81:0/894170444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ad009af70 msgr2=0x7f7ad00c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7aceffd640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ad009af70 0x7f7ad00c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7aceffd640 1 -- 172.21.15.81:0/894170444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad00b6550 con 0x7f7ad00b17d0 2024-09-16T01:21:24.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7aceffd640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad00b17d0 0x7f7ad00b5b90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400e9b0 tx=0x7f7ac400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:24.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7ab7fff640 1 -- 172.21.15.81:0/894170444 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4017070 con 0x7f7ad00b17d0 2024-09-16T01:21:24.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7ab7fff640 1 -- 172.21.15.81:0/894170444 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac400c9a0 con 0x7f7ad00b17d0 2024-09-16T01:21:24.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/894170444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad00b6830 con 0x7f7ad00b17d0 2024-09-16T01:21:24.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.110+0000 7f7ab7fff640 1 -- 172.21.15.81:0/894170444 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400cd90 con 0x7f7ad00b17d0 2024-09-16T01:21:24.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.111+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/894170444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad00b6df0 con 0x7f7ad00b17d0 2024-09-16T01:21:24.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.111+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/894170444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad00b71d0 con 0x7f7ad00b17d0 2024-09-16T01:21:24.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.112+0000 7f7ab7fff640 1 -- 172.21.15.81:0/894170444 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7ac401a070 con 0x7f7ad00b17d0 2024-09-16T01:21:24.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.112+0000 7f7ab7fff640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7abc06c2e0 0x7f7abc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:24.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.112+0000 7f7ab7fff640 1 -- 172.21.15.81:0/894170444 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f7ac408b900 con 0x7f7ad00b17d0 2024-09-16T01:21:24.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.113+0000 7f7acf7fe640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7abc06c2e0 0x7f7abc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:24.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.113+0000 7f7acf7fe640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7abc06c2e0 0x7f7abc06e7a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0034000 tx=0x7f7ac002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:24.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.117+0000 7f7ab7fff640 1 -- 172.21.15.81:0/894170444 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ad00b71d0 con 0x7f7ad00b17d0 2024-09-16T01:21:24.156 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:24.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.319+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/894170444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7ad00b1ec0 con 0x7f7ad00b17d0 2024-09-16T01:21:24.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.320+0000 7f7ab7fff640 1 -- 172.21.15.81:0/894170444 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f7ac4059820 con 0x7f7ad00b17d0 2024-09-16T01:21:24.322 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:24.322 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:21:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.322+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/894170444 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7abc06c2e0 msgr2=0x7f7abc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.322+0000 7f7ad5cd9640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7abc06c2e0 0x7f7abc06e7a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0034000 tx=0x7f7ac002e000 comp rx=0 tx=0).stop 2024-09-16T01:21:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.322+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/894170444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad00b17d0 msgr2=0x7f7ad00b5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.322+0000 7f7ad5cd9640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad00b17d0 0x7f7ad00b5b90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400e9b0 tx=0x7f7ac400ee70 comp rx=0 tx=0).stop 2024-09-16T01:21:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.322+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/894170444 shutdown_connections 2024-09-16T01:21:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.322+0000 7f7ad5cd9640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7abc06c2e0 0x7f7abc06e7a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.322+0000 7f7ad5cd9640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ad015fc30 0x7f7ad00cfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.322+0000 7f7ad5cd9640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ad00b17d0 0x7f7ad00b5b90 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.322+0000 7f7ad5cd9640 1 --2- 172.21.15.81:0/894170444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ad009af70 0x7f7ad00c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.322+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/894170444 >> 172.21.15.81:0/894170444 conn(0x7f7ad00d23a0 msgr2=0x7f7ad00ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:24.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.322+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/894170444 shutdown_connections 2024-09-16T01:21:24.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24.322+0000 7f7ad5cd9640 1 -- 172.21.15.81:0/894170444 wait complete. 2024-09-16T01:21:24.336 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:21:24.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:24 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-16T01:21:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:21:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:stdin closed, goodbye! 2024-09-16T01:21:26.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:21:26.178 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:21:26.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:21:26.262 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:21:26.306 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:21:26.307 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:21:26.307 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 400\nabs_path = "/home/ubuntu/cephtest/mnt.0/subdir"\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi081') 2024-09-16T01:21:26.307 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:21:26.307 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:26.326 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:21:26.326 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:26.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:21:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.531+0000 7f868d6dd640 1 Processor -- start 2024-09-16T01:21:26.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.531+0000 7f868d6dd640 1 -- start start 2024-09-16T01:21:26.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.532+0000 7f868d6dd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f868815d3e0 0x7f86880ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.532+0000 7f868d6dd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f868815d870 con 0x7f86880ce8b0 2024-09-16T01:21:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.532+0000 7f868d6dd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86880d00a0 con 0x7f86880d06e0 2024-09-16T01:21:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.532+0000 7f868d6dd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f868809b080 con 0x7f868815d3e0 2024-09-16T01:21:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.532+0000 7f867e7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f86880ce8b0 0x7f868809b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42504/0 (socket says 172.21.15.81:42504) 2024-09-16T01:21:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.532+0000 7f867e7fc640 1 -- 172.21.15.81:0/3471630813 learned_addr learned my addr 172.21.15.81:0/3471630813 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.532+0000 7f86877fe640 1 --2- 172.21.15.81:0/3471630813 >> v2:172.21.15.102:3300/0 conn(0x7f868815d3e0 0x7f86880ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.533+0000 7f86867fc640 1 -- 172.21.15.81:0/3471630813 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643982251 0 0) 0x7f868815d870 con 0x7f86880ce8b0 2024-09-16T01:21:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.533+0000 7f86867fc640 1 -- 172.21.15.81:0/3471630813 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8674003520 con 0x7f86880ce8b0 2024-09-16T01:21:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.533+0000 7f86867fc640 1 -- 172.21.15.81:0/3471630813 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306091044 0 0) 0x7f86880d00a0 con 0x7f86880d06e0 2024-09-16T01:21:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.533+0000 7f86867fc640 1 -- 172.21.15.81:0/3471630813 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f868815d870 con 0x7f86880d06e0 2024-09-16T01:21:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.533+0000 7f86877fe640 1 -- 172.21.15.81:0/3471630813 >> v1:172.21.15.102:6789/0 conn(0x7f86880d06e0 legacy=0x7f86880d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.533+0000 7f86867fc640 1 -- 172.21.15.81:0/3471630813 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3752566633 0 0) 0x7f8674003520 con 0x7f86880ce8b0 2024-09-16T01:21:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.533+0000 7f86877fe640 1 -- 172.21.15.81:0/3471630813 >> v1:172.21.15.81:6789/0 conn(0x7f86880ce8b0 legacy=0x7f868809b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.533+0000 7f86877fe640 1 -- 172.21.15.81:0/3471630813 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86880d0380 con 0x7f868815d3e0 2024-09-16T01:21:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.534+0000 7f86877fe640 1 --2- 172.21.15.81:0/3471630813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f868815d3e0 0x7f86880ccf90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8680009d90 tx=0x7f868002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d365a796a027de55 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.534+0000 7f86867fc640 1 -- 172.21.15.81:0/3471630813 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8670001670 con 0x7f868815d3e0 2024-09-16T01:21:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.534+0000 7f86867fc640 1 -- 172.21.15.81:0/3471630813 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8680007540 con 0x7f868815d3e0 2024-09-16T01:21:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.534+0000 7f86867fc640 1 -- 172.21.15.81:0/3471630813 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86800078f0 con 0x7f868815d3e0 2024-09-16T01:21:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.534+0000 7f868d6dd640 1 -- 172.21.15.81:0/3471630813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f868815d3e0 msgr2=0x7f86880ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.534+0000 7f868d6dd640 1 --2- 172.21.15.81:0/3471630813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f868815d3e0 0x7f86880ccf90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8680009d90 tx=0x7f868002a680 comp rx=0 tx=0).stop 2024-09-16T01:21:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.534+0000 7f868d6dd640 1 -- 172.21.15.81:0/3471630813 shutdown_connections 2024-09-16T01:21:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.534+0000 7f868d6dd640 1 --2- 172.21.15.81:0/3471630813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f868815d3e0 0x7f86880ccf90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.534+0000 7f868d6dd640 1 -- 172.21.15.81:0/3471630813 >> 172.21.15.81:0/3471630813 conn(0x7f86880d23a0 msgr2=0x7f86880d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.534+0000 7f868d6dd640 1 -- 172.21.15.81:0/3471630813 shutdown_connections 2024-09-16T01:21:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.535+0000 7f868d6dd640 1 -- 172.21.15.81:0/3471630813 wait complete. 2024-09-16T01:21:26.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.536+0000 7f868d6dd640 1 Processor -- start 2024-09-16T01:21:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.536+0000 7f868d6dd640 1 -- start start 2024-09-16T01:21:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f868d6dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86880ce8b0 0x7f86880b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f868d6dd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86880d06e0 0x7f8688159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f868d6dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868815d3e0 0x7f86880b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f868d6dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f868815c740 con 0x7f868815d3e0 2024-09-16T01:21:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f868d6dd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f868809ad10 con 0x7f86880d06e0 2024-09-16T01:21:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f868d6dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f868809bc20 con 0x7f86880ce8b0 2024-09-16T01:21:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f86877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868815d3e0 0x7f86880b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f86877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868815d3e0 0x7f86880b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54208/0 (socket says 172.21.15.81:54208) 2024-09-16T01:21:26.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f86877fe640 1 -- 172.21.15.81:0/1047670305 learned_addr learned my addr 172.21.15.81:0/1047670305 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f867e7fc640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86880d06e0 0x7f8688159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f8686ffd640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86880ce8b0 0x7f86880b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f86877fe640 1 -- 172.21.15.81:0/1047670305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86880ce8b0 msgr2=0x7f86880b7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f86877fe640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86880ce8b0 0x7f86880b7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f86877fe640 1 -- 172.21.15.81:0/1047670305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86880d06e0 msgr2=0x7f8688159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f86877fe640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86880d06e0 0x7f8688159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f86877fe640 1 -- 172.21.15.81:0/1047670305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86880c5920 con 0x7f868815d3e0 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f8686ffd640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86880ce8b0 0x7f86880b7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f86877fe640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868815d3e0 0x7f86880b5c80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f868002ac70 tx=0x7f8680004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f867ffff640 1 -- 172.21.15.81:0/1047670305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8680009450 con 0x7f868815d3e0 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.537+0000 7f867ffff640 1 -- 172.21.15.81:0/1047670305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8680004240 con 0x7f868815d3e0 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.538+0000 7f867ffff640 1 -- 172.21.15.81:0/1047670305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86800045f0 con 0x7f868815d3e0 2024-09-16T01:21:26.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.538+0000 7f868d6dd640 1 -- 172.21.15.81:0/1047670305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f868815f7b0 con 0x7f868815d3e0 2024-09-16T01:21:26.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.538+0000 7f868d6dd640 1 -- 172.21.15.81:0/1047670305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f868815fd70 con 0x7f868815d3e0 2024-09-16T01:21:26.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.539+0000 7f868d6dd640 1 -- 172.21.15.81:0/1047670305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86880d00a0 con 0x7f868815d3e0 2024-09-16T01:21:26.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.539+0000 7f867ffff640 1 -- 172.21.15.81:0/1047670305 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8680039040 con 0x7f868815d3e0 2024-09-16T01:21:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.539+0000 7f867ffff640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f866806c2b0 0x7f866806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.540+0000 7f867ffff640 1 -- 172.21.15.81:0/1047670305 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f86800ac880 con 0x7f868815d3e0 2024-09-16T01:21:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.540+0000 7f8686ffd640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f866806c2b0 0x7f866806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.540+0000 7f8686ffd640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f866806c2b0 0x7f866806e770 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f86780011e0 tx=0x7f8678009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:26.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.544+0000 7f867ffff640 1 -- 172.21.15.81:0/1047670305 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8680040030 con 0x7f868815d3e0 2024-09-16T01:21:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.722+0000 7f868d6dd640 1 -- 172.21.15.81:0/1047670305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f86880d31d0 con 0x7f868815d3e0 2024-09-16T01:21:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.723+0000 7f867ffff640 1 -- 172.21.15.81:0/1047670305 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v89) ==== 80+0+0 (secure 0 0 0) 0x7f868007a7a0 con 0x7f868815d3e0 2024-09-16T01:21:26.725 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:21:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.725+0000 7f868d6dd640 1 -- 172.21.15.81:0/1047670305 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f866806c2b0 msgr2=0x7f866806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.725+0000 7f868d6dd640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f866806c2b0 0x7f866806e770 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f86780011e0 tx=0x7f8678009040 comp rx=0 tx=0).stop 2024-09-16T01:21:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.725+0000 7f868d6dd640 1 -- 172.21.15.81:0/1047670305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868815d3e0 msgr2=0x7f86880b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.725+0000 7f868d6dd640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868815d3e0 0x7f86880b5c80 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f868002ac70 tx=0x7f8680004a40 comp rx=0 tx=0).stop 2024-09-16T01:21:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.725+0000 7f868d6dd640 1 -- 172.21.15.81:0/1047670305 shutdown_connections 2024-09-16T01:21:26.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.725+0000 7f868d6dd640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f866806c2b0 0x7f866806e770 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.725+0000 7f868d6dd640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f868815d3e0 0x7f86880b5c80 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.725+0000 7f868d6dd640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86880d06e0 0x7f8688159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.725+0000 7f868d6dd640 1 --2- 172.21.15.81:0/1047670305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86880ce8b0 0x7f86880b7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.725+0000 7f868d6dd640 1 -- 172.21.15.81:0/1047670305 >> 172.21.15.81:0/1047670305 conn(0x7f86880d23a0 msgr2=0x7f86880cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:26.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.725+0000 7f868d6dd640 1 -- 172.21.15.81:0/1047670305 shutdown_connections 2024-09-16T01:21:26.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.725+0000 7f868d6dd640 1 -- 172.21.15.81:0/1047670305 wait complete. 2024-09-16T01:21:26.738 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:21:26.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:26.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:21:26.784 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:21:26.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:26.784 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:21:26.817 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:21:26.817 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:21:26.818 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:26.835 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:21:26.835 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:26.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:21:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.990+0000 7f26671f1640 1 Processor -- start 2024-09-16T01:21:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.990+0000 7f26671f1640 1 -- start start 2024-09-16T01:21:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.991+0000 7f26671f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26600b69d0 0x7f2660162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.991+0000 7f26671f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f266015eb60 con 0x7f26600af280 2024-09-16T01:21:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.991+0000 7f26671f1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f266015ee40 con 0x7f26600b0180 2024-09-16T01:21:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.991+0000 7f26671f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f26600b6db0 con 0x7f26600b69d0 2024-09-16T01:21:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.991+0000 7f2664f8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26600b69d0 0x7f2660162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.991+0000 7f265ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f26600af280 0x7f26600afa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42520/0 (socket says 172.21.15.81:42520) 2024-09-16T01:21:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.991+0000 7f2664f8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26600b69d0 0x7f2660162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54210/0 (socket says 172.21.15.81:54210) 2024-09-16T01:21:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.991+0000 7f265ffff640 1 -- 172.21.15.81:0/24933981 learned_addr learned my addr 172.21.15.81:0/24933981 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:26.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.991+0000 7f2664f8d640 1 -- 172.21.15.81:0/24933981 >> v1:172.21.15.102:6789/0 conn(0x7f26600b0180 legacy=0x7f2660154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.991+0000 7f2664f8d640 1 -- 172.21.15.81:0/24933981 >> v1:172.21.15.81:6789/0 conn(0x7f26600af280 legacy=0x7f26600afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.991+0000 7f2664f8d640 1 -- 172.21.15.81:0/24933981 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266015f120 con 0x7f26600b69d0 2024-09-16T01:21:26.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.992+0000 7f2664f8d640 1 --2- 172.21.15.81:0/24933981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26600b69d0 0x7f2660162a50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f26600b6f30 tx=0x7f265002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f79961f90fd276 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:26.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.992+0000 7f265f7fe640 1 -- 172.21.15.81:0/24933981 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2650037070 con 0x7f26600b69d0 2024-09-16T01:21:26.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.992+0000 7f265f7fe640 1 -- 172.21.15.81:0/24933981 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265002ae50 con 0x7f26600b69d0 2024-09-16T01:21:26.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.992+0000 7f265f7fe640 1 -- 172.21.15.81:0/24933981 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2650032660 con 0x7f26600b69d0 2024-09-16T01:21:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.993+0000 7f26671f1640 1 -- 172.21.15.81:0/24933981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26600b69d0 msgr2=0x7f2660162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.993+0000 7f26671f1640 1 --2- 172.21.15.81:0/24933981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26600b69d0 0x7f2660162a50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f26600b6f30 tx=0x7f265002a100 comp rx=0 tx=0).stop 2024-09-16T01:21:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.993+0000 7f26671f1640 1 -- 172.21.15.81:0/24933981 shutdown_connections 2024-09-16T01:21:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.993+0000 7f26671f1640 1 --2- 172.21.15.81:0/24933981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26600b69d0 0x7f2660162a50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.993+0000 7f26671f1640 1 -- 172.21.15.81:0/24933981 >> 172.21.15.81:0/24933981 conn(0x7f266006bc10 msgr2=0x7f266006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.993+0000 7f26671f1640 1 -- 172.21.15.81:0/24933981 shutdown_connections 2024-09-16T01:21:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.993+0000 7f26671f1640 1 -- 172.21.15.81:0/24933981 wait complete. 2024-09-16T01:21:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.994+0000 7f26671f1640 1 Processor -- start 2024-09-16T01:21:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.994+0000 7f26671f1640 1 -- start start 2024-09-16T01:21:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f26671f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26600af280 0x7f2660145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f26671f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26600b0180 0x7f26601486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f26671f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26600b69d0 0x7f2660157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f26671f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f266006f870 con 0x7f26600b69d0 2024-09-16T01:21:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f26671f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f26600af710 con 0x7f26600af280 2024-09-16T01:21:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f26671f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f266006f9f0 con 0x7f26600b0180 2024-09-16T01:21:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f266578e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26600b69d0 0x7f2660157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f266578e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26600b69d0 0x7f2660157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54214/0 (socket says 172.21.15.81:54214) 2024-09-16T01:21:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f266578e640 1 -- 172.21.15.81:0/2129239746 learned_addr learned my addr 172.21.15.81:0/2129239746 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f2664f8d640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26600af280 0x7f2660145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f265ffff640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26600b0180 0x7f26601486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f266578e640 1 -- 172.21.15.81:0/2129239746 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26600b0180 msgr2=0x7f26601486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:26.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f266578e640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26600b0180 0x7f26601486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f266578e640 1 -- 172.21.15.81:0/2129239746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26600af280 msgr2=0x7f2660145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f266578e640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26600af280 0x7f2660145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f266578e640 1 -- 172.21.15.81:0/2129239746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2660148ff0 con 0x7f26600b69d0 2024-09-16T01:21:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.995+0000 7f266578e640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26600b69d0 0x7f2660157100 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f265800c3f0 tx=0x7f265800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.996+0000 7f265d7fa640 1 -- 172.21.15.81:0/2129239746 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658017070 con 0x7f26600b69d0 2024-09-16T01:21:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.996+0000 7f265d7fa640 1 -- 172.21.15.81:0/2129239746 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26580052d0 con 0x7f26600b69d0 2024-09-16T01:21:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.996+0000 7f265d7fa640 1 -- 172.21.15.81:0/2129239746 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658003830 con 0x7f26600b69d0 2024-09-16T01:21:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.996+0000 7f26671f1640 1 -- 172.21.15.81:0/2129239746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26601492d0 con 0x7f26600b69d0 2024-09-16T01:21:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.996+0000 7f26671f1640 1 -- 172.21.15.81:0/2129239746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2660146700 con 0x7f26600b69d0 2024-09-16T01:21:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.997+0000 7f26671f1640 1 -- 172.21.15.81:0/2129239746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2660162a50 con 0x7f26600b69d0 2024-09-16T01:21:27.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.997+0000 7f265d7fa640 1 -- 172.21.15.81:0/2129239746 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f265801a070 con 0x7f26600b69d0 2024-09-16T01:21:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.998+0000 7f265d7fa640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f264c06c2b0 0x7f264c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.998+0000 7f265d7fa640 1 -- 172.21.15.81:0/2129239746 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f265808a7c0 con 0x7f26600b69d0 2024-09-16T01:21:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.998+0000 7f2664f8d640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f264c06c2b0 0x7f264c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:26.998+0000 7f2664f8d640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f264c06c2b0 0x7f264c06e770 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2650034000 tx=0x7f265002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:27.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.002+0000 7f265d7fa640 1 -- 172.21.15.81:0/2129239746 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26580587a0 con 0x7f26600b69d0 2024-09-16T01:21:27.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.178+0000 7f26671f1640 1 -- 172.21.15.81:0/2129239746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f266006d750 con 0x7f26600b69d0 2024-09-16T01:21:27.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.178+0000 7f265d7fa640 1 -- 172.21.15.81:0/2129239746 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v89) ==== 80+0+0 (secure 0 0 0) 0x7f265805caa0 con 0x7f26600b69d0 2024-09-16T01:21:27.180 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:21:27.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.180+0000 7f26671f1640 1 -- 172.21.15.81:0/2129239746 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f264c06c2b0 msgr2=0x7f264c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.180+0000 7f26671f1640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f264c06c2b0 0x7f264c06e770 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2650034000 tx=0x7f265002e000 comp rx=0 tx=0).stop 2024-09-16T01:21:27.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.180+0000 7f26671f1640 1 -- 172.21.15.81:0/2129239746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26600b69d0 msgr2=0x7f2660157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.180+0000 7f26671f1640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26600b69d0 0x7f2660157100 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f265800c3f0 tx=0x7f265800c7f0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.180+0000 7f26671f1640 1 -- 172.21.15.81:0/2129239746 shutdown_connections 2024-09-16T01:21:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.180+0000 7f26671f1640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f264c06c2b0 0x7f264c06e770 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.180+0000 7f26671f1640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26600b69d0 0x7f2660157100 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.180+0000 7f26671f1640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26600b0180 0x7f26601486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.180+0000 7f26671f1640 1 --2- 172.21.15.81:0/2129239746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26600af280 0x7f2660145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.180+0000 7f26671f1640 1 -- 172.21.15.81:0/2129239746 >> 172.21.15.81:0/2129239746 conn(0x7f266006bc10 msgr2=0x7f2660162070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.180+0000 7f26671f1640 1 -- 172.21.15.81:0/2129239746 shutdown_connections 2024-09-16T01:21:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.180+0000 7f26671f1640 1 -- 172.21.15.81:0/2129239746 wait complete. 2024-09-16T01:21:27.193 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:21:27.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:27.193 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T01:21:27.226 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:21:27.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:27.226 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:21:27.284 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:21:27.284 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:21:27.284 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:27.300 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:21:27.301 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:21:27.301 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:21:27.301 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:27.343 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:21:27.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:21:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.438+0000 7ff2b4b03640 1 Processor -- start 2024-09-16T01:21:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.438+0000 7ff2b4b03640 1 -- start start 2024-09-16T01:21:27.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.439+0000 7ff2b4b03640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2b00d1540 0x7ff2b006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.439+0000 7ff2b4b03640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff2b009b690 0x7ff2b006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.439+0000 7ff2b4b03640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2b00d1970 con 0x7ff2b015e740 2024-09-16T01:21:27.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.439+0000 7ff2b4b03640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff2b015eb20 con 0x7ff2b00d1540 2024-09-16T01:21:27.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.439+0000 7ff2b4b03640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff2b006d260 con 0x7ff2b009b690 2024-09-16T01:21:27.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.439+0000 7ff2add9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2b00d1540 0x7ff2b006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.439+0000 7ff2add9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2b00d1540 0x7ff2b006dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54222/0 (socket says 172.21.15.81:54222) 2024-09-16T01:21:27.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.439+0000 7ff2add9b640 1 -- 172.21.15.81:0/3182140949 learned_addr learned my addr 172.21.15.81:0/3182140949 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:27.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.440+0000 7ff2aed9d640 1 --2- 172.21.15.81:0/3182140949 >> v2:172.21.15.102:3300/0 conn(0x7ff2b009b690 0x7ff2b006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.440+0000 7ff2add9b640 1 -- 172.21.15.81:0/3182140949 >> v2:172.21.15.102:3300/0 conn(0x7ff2b009b690 msgr2=0x7ff2b006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.440+0000 7ff2add9b640 1 --2- 172.21.15.81:0/3182140949 >> v2:172.21.15.102:3300/0 conn(0x7ff2b009b690 0x7ff2b006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.440+0000 7ff2add9b640 1 -- 172.21.15.81:0/3182140949 >> v1:172.21.15.102:6789/0 conn(0x7ff2b015e740 legacy=0x7ff2b006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.440+0000 7ff2add9b640 1 -- 172.21.15.81:0/3182140949 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b00d0780 con 0x7ff2b00d1540 2024-09-16T01:21:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.440+0000 7ff2add9b640 1 --2- 172.21.15.81:0/3182140949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b00d1540 0x7ff2b006dbd0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff2b006cba0 tx=0x7ff29802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bda4fd0a4085a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:27.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.441+0000 7ff2ad59a640 1 -- 172.21.15.81:0/3182140949 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff298037070 con 0x7ff2b00d1540 2024-09-16T01:21:27.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.441+0000 7ff2ad59a640 1 -- 172.21.15.81:0/3182140949 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff29802ae50 con 0x7ff2b00d1540 2024-09-16T01:21:27.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.441+0000 7ff2ad59a640 1 -- 172.21.15.81:0/3182140949 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff298032860 con 0x7ff2b00d1540 2024-09-16T01:21:27.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.441+0000 7ff2b4b03640 1 -- 172.21.15.81:0/3182140949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b00d1540 msgr2=0x7ff2b006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.441+0000 7ff2b4b03640 1 --2- 172.21.15.81:0/3182140949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b00d1540 0x7ff2b006dbd0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff2b006cba0 tx=0x7ff29802a300 comp rx=0 tx=0).stop 2024-09-16T01:21:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.441+0000 7ff2b4b03640 1 -- 172.21.15.81:0/3182140949 shutdown_connections 2024-09-16T01:21:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.441+0000 7ff2b4b03640 1 --2- 172.21.15.81:0/3182140949 >> v2:172.21.15.102:3300/0 conn(0x7ff2b009b690 0x7ff2b006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.441+0000 7ff2b4b03640 1 --2- 172.21.15.81:0/3182140949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b00d1540 0x7ff2b006dbd0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.441+0000 7ff2b4b03640 1 -- 172.21.15.81:0/3182140949 >> 172.21.15.81:0/3182140949 conn(0x7ff2b00d23a0 msgr2=0x7ff2b00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.441+0000 7ff2b4b03640 1 -- 172.21.15.81:0/3182140949 shutdown_connections 2024-09-16T01:21:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.441+0000 7ff2b4b03640 1 -- 172.21.15.81:0/3182140949 wait complete. 2024-09-16T01:21:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2b4b03640 1 Processor -- start 2024-09-16T01:21:27.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2b4b03640 1 -- start start 2024-09-16T01:21:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2b4b03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b009b690 0x7ff2b00ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2b4b03640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2b00d1540 0x7ff2b015ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2b4b03640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff2b015e740 0x7ff2b015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2b4b03640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b00d1020 con 0x7ff2b009b690 2024-09-16T01:21:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2b4b03640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b00d0d40 con 0x7ff2b00d1540 2024-09-16T01:21:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2b4b03640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff2b009baa0 con 0x7ff2b015e740 2024-09-16T01:21:27.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2ae59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b009b690 0x7ff2b00ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2ae59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b009b690 0x7ff2b00ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54228/0 (socket says 172.21.15.81:54228) 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2ae59c640 1 -- 172.21.15.81:0/1562284160 learned_addr learned my addr 172.21.15.81:0/1562284160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2add9b640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2b00d1540 0x7ff2b015ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.443+0000 7ff2aed9d640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff2b015e740 0x7ff2b015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.444+0000 7ff2ae59c640 1 -- 172.21.15.81:0/1562284160 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff2b015e740 msgr2=0x7ff2b015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.444+0000 7ff2ae59c640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff2b015e740 0x7ff2b015c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.444+0000 7ff2ae59c640 1 -- 172.21.15.81:0/1562284160 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2b00d1540 msgr2=0x7ff2b015ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.444+0000 7ff2ae59c640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2b00d1540 0x7ff2b015ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.444+0000 7ff2ae59c640 1 -- 172.21.15.81:0/1562284160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b00c9510 con 0x7ff2b009b690 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.444+0000 7ff2aed9d640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff2b015e740 0x7ff2b015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.444+0000 7ff2ae59c640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b009b690 0x7ff2b00ca5b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800c7c0 tx=0x7ff2a800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.444+0000 7ff2a6ffd640 1 -- 172.21.15.81:0/1562284160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8003b70 con 0x7ff2b009b690 2024-09-16T01:21:27.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.444+0000 7ff2a6ffd640 1 -- 172.21.15.81:0/1562284160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2a8003d10 con 0x7ff2b009b690 2024-09-16T01:21:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.444+0000 7ff2a6ffd640 1 -- 172.21.15.81:0/1562284160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800aa90 con 0x7ff2b009b690 2024-09-16T01:21:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.444+0000 7ff2b4b03640 1 -- 172.21.15.81:0/1562284160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b00c97f0 con 0x7ff2b009b690 2024-09-16T01:21:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.444+0000 7ff2b4b03640 1 -- 172.21.15.81:0/1562284160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b00c9db0 con 0x7ff2b009b690 2024-09-16T01:21:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.445+0000 7ff2b4b03640 1 -- 172.21.15.81:0/1562284160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b006cd20 con 0x7ff2b009b690 2024-09-16T01:21:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.445+0000 7ff2a6ffd640 1 -- 172.21.15.81:0/1562284160 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff2a800ac30 con 0x7ff2b009b690 2024-09-16T01:21:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.446+0000 7ff2a6ffd640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff29006c2b0 0x7ff29006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.446+0000 7ff2a6ffd640 1 -- 172.21.15.81:0/1562284160 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7ff2a808b4a0 con 0x7ff2b009b690 2024-09-16T01:21:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.446+0000 7ff2add9b640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff29006c2b0 0x7ff29006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.446+0000 7ff2add9b640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff29006c2b0 0x7ff29006e770 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff298034000 tx=0x7ff29802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:27.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.450+0000 7ff2a6ffd640 1 -- 172.21.15.81:0/1562284160 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2a8059aa0 con 0x7ff2b009b690 2024-09-16T01:21:27.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.650+0000 7ff2b4b03640 1 -- 172.21.15.81:0/1562284160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2b00b8320 con 0x7ff2b009b690 2024-09-16T01:21:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.651+0000 7ff2a6ffd640 1 -- 172.21.15.81:0/1562284160 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5229 (secure 0 0 0) 0x7ff2a80593a0 con 0x7ff2b009b690 2024-09-16T01:21:27.653 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:27.653 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":46,"btime":"2024-09-16T01:20:24:179686+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3998032766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3998032766},{"type":"v1","addr":"172.21.15.102:6835","nonce":3998032766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5794,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/978156526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":978156526},{"type":"v1","addr":"172.21.15.102:6834","nonce":978156526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6384,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1184176189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1184176189},{"type":"v1","addr":"172.21.15.81:6836","nonce":1184176189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:59.261790+0000","modified":"2024-09-16T01:20:23.958747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":24,"addr":"172.21.15.81:6837/2778062051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2778062051},{"type":"v1","addr":"172.21.15.81:6837","nonce":2778062051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-16T01:21:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 46 2024-09-16T01:21:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.653+0000 7ff2b4b03640 1 -- 172.21.15.81:0/1562284160 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff29006c2b0 msgr2=0x7ff29006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.653+0000 7ff2b4b03640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff29006c2b0 0x7ff29006e770 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff298034000 tx=0x7ff29802e000 comp rx=0 tx=0).stop 2024-09-16T01:21:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.653+0000 7ff2b4b03640 1 -- 172.21.15.81:0/1562284160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b009b690 msgr2=0x7ff2b00ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.653+0000 7ff2b4b03640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b009b690 0x7ff2b00ca5b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800c7c0 tx=0x7ff2a800cc80 comp rx=0 tx=0).stop 2024-09-16T01:21:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.653+0000 7ff2b4b03640 1 -- 172.21.15.81:0/1562284160 shutdown_connections 2024-09-16T01:21:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.653+0000 7ff2b4b03640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff29006c2b0 0x7ff29006e770 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.653+0000 7ff2b4b03640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff2b015e740 0x7ff2b015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.653+0000 7ff2b4b03640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff2b00d1540 0x7ff2b015ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.653+0000 7ff2b4b03640 1 --2- 172.21.15.81:0/1562284160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b009b690 0x7ff2b00ca5b0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.653+0000 7ff2b4b03640 1 -- 172.21.15.81:0/1562284160 >> 172.21.15.81:0/1562284160 conn(0x7ff2b00d23a0 msgr2=0x7ff2b00b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.653+0000 7ff2b4b03640 1 -- 172.21.15.81:0/1562284160 shutdown_connections 2024-09-16T01:21:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.653+0000 7ff2b4b03640 1 -- 172.21.15.81:0/1562284160 wait complete. 2024-09-16T01:21:27.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:21:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.761+0000 7f92655c6640 1 Processor -- start 2024-09-16T01:21:27.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.761+0000 7f92655c6640 1 -- start start 2024-09-16T01:21:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.762+0000 7f92655c6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f926015c520 0x7f926009b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.762+0000 7f92655c6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92600b1620 0x7f92600b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.762+0000 7f92655c6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92600cec00 con 0x7f92600d0980 2024-09-16T01:21:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.762+0000 7f92655c6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f926009bd90 con 0x7f92600b1620 2024-09-16T01:21:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.762+0000 7f92655c6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f92600d0010 con 0x7f926015c520 2024-09-16T01:21:27.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.762+0000 7f925e7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92600b1620 0x7f92600b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.762+0000 7f925e7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92600b1620 0x7f92600b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54230/0 (socket says 172.21.15.81:54230) 2024-09-16T01:21:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.762+0000 7f925e7fc640 1 -- 172.21.15.81:0/1365531670 learned_addr learned my addr 172.21.15.81:0/1365531670 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.762+0000 7f925effd640 1 --2- 172.21.15.81:0/1365531670 >> v2:172.21.15.102:3300/0 conn(0x7f926015c520 0x7f926009b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.762+0000 7f925e7fc640 1 -- 172.21.15.81:0/1365531670 >> v2:172.21.15.102:3300/0 conn(0x7f926015c520 msgr2=0x7f926009b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.762+0000 7f925e7fc640 1 --2- 172.21.15.81:0/1365531670 >> v2:172.21.15.102:3300/0 conn(0x7f926015c520 0x7f926009b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.762+0000 7f925e7fc640 1 -- 172.21.15.81:0/1365531670 >> v1:172.21.15.102:6789/0 conn(0x7f92600d0980 legacy=0x7f92600cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.763+0000 7f925e7fc640 1 -- 172.21.15.81:0/1365531670 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92600d02f0 con 0x7f92600b1620 2024-09-16T01:21:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.763+0000 7f925e7fc640 1 --2- 172.21.15.81:0/1365531670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600b1620 0x7f92600b1d40 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9260073340 tx=0x7f925402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf21d852d1b5da7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.763+0000 7f925dffb640 1 -- 172.21.15.81:0/1365531670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254037070 con 0x7f92600b1620 2024-09-16T01:21:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.763+0000 7f925dffb640 1 -- 172.21.15.81:0/1365531670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9254032440 con 0x7f92600b1620 2024-09-16T01:21:27.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.763+0000 7f925dffb640 1 -- 172.21.15.81:0/1365531670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254032810 con 0x7f92600b1620 2024-09-16T01:21:27.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.764+0000 7f92655c6640 1 -- 172.21.15.81:0/1365531670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600b1620 msgr2=0x7f92600b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.764+0000 7f92655c6640 1 --2- 172.21.15.81:0/1365531670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600b1620 0x7f92600b1d40 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9260073340 tx=0x7f925402a270 comp rx=0 tx=0).stop 2024-09-16T01:21:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.764+0000 7f92655c6640 1 -- 172.21.15.81:0/1365531670 shutdown_connections 2024-09-16T01:21:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.764+0000 7f92655c6640 1 --2- 172.21.15.81:0/1365531670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600b1620 0x7f92600b1d40 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.764+0000 7f92655c6640 1 --2- 172.21.15.81:0/1365531670 >> v2:172.21.15.102:3300/0 conn(0x7f926015c520 0x7f926009b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.764+0000 7f92655c6640 1 -- 172.21.15.81:0/1365531670 >> 172.21.15.81:0/1365531670 conn(0x7f92600d23a0 msgr2=0x7f92600d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.764+0000 7f92655c6640 1 -- 172.21.15.81:0/1365531670 shutdown_connections 2024-09-16T01:21:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.764+0000 7f92655c6640 1 -- 172.21.15.81:0/1365531670 wait complete. 2024-09-16T01:21:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.765+0000 7f92655c6640 1 Processor -- start 2024-09-16T01:21:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.765+0000 7f92655c6640 1 -- start start 2024-09-16T01:21:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.766+0000 7f92655c6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f92600b1620 0x7f92600ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.766+0000 7f92655c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d0980 0x7f92601f8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.766+0000 7f92655c6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f926015c520 0x7f92601f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.766+0000 7f92655c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f926015c900 con 0x7f92600d0980 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.766+0000 7f92655c6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f92600d05d0 con 0x7f926015c520 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.766+0000 7f92655c6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f92601540e0 con 0x7f92600b1620 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.766+0000 7f925e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d0980 0x7f92601f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.766+0000 7f925e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d0980 0x7f92601f8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54232/0 (socket says 172.21.15.81:54232) 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.766+0000 7f925e7fc640 1 -- 172.21.15.81:0/1979590306 learned_addr learned my addr 172.21.15.81:0/1979590306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.766+0000 7f925f7fe640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f926015c520 0x7f92601f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.766+0000 7f925effd640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f92600b1620 0x7f92600ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.767+0000 7f925e7fc640 1 -- 172.21.15.81:0/1979590306 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f92600b1620 msgr2=0x7f92600ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.767+0000 7f925e7fc640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f92600b1620 0x7f92600ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.767+0000 7f925e7fc640 1 -- 172.21.15.81:0/1979590306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f926015c520 msgr2=0x7f92601f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.767+0000 7f925e7fc640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f926015c520 0x7f92601f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.767+0000 7f925e7fc640 1 -- 172.21.15.81:0/1979590306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926006dab0 con 0x7f92600d0980 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.767+0000 7f925effd640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f92600b1620 0x7f92600ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:27.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.767+0000 7f925e7fc640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d0980 0x7f92601f8000 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f925402a2b0 tx=0x7f92540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:27.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.767+0000 7f92477fe640 1 -- 172.21.15.81:0/1979590306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254041020 con 0x7f92600d0980 2024-09-16T01:21:27.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.767+0000 7f92477fe640 1 -- 172.21.15.81:0/1979590306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92540306c0 con 0x7f92600d0980 2024-09-16T01:21:27.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.767+0000 7f92477fe640 1 -- 172.21.15.81:0/1979590306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254037040 con 0x7f92600d0980 2024-09-16T01:21:27.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.767+0000 7f92655c6640 1 -- 172.21.15.81:0/1979590306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926006dd90 con 0x7f92600d0980 2024-09-16T01:21:27.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.767+0000 7f92655c6640 1 -- 172.21.15.81:0/1979590306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f926006e350 con 0x7f92600d0980 2024-09-16T01:21:27.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.768+0000 7f92655c6640 1 -- 172.21.15.81:0/1979590306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92600b1d40 con 0x7f92600d0980 2024-09-16T01:21:27.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.768+0000 7f92477fe640 1 -- 172.21.15.81:0/1979590306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9254044020 con 0x7f92600d0980 2024-09-16T01:21:27.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.769+0000 7f92477fe640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f924c06c2b0 0x7f924c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:27.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.769+0000 7f92477fe640 1 -- 172.21.15.81:0/1979590306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f92540abd60 con 0x7f92600d0980 2024-09-16T01:21:27.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.769+0000 7f925effd640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f924c06c2b0 0x7f924c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:27.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.769+0000 7f925effd640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f924c06c2b0 0x7f924c06e770 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9250009a80 tx=0x7f92500039d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:27.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.773+0000 7f92477fe640 1 -- 172.21.15.81:0/1979590306 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f925404b030 con 0x7f92600d0980 2024-09-16T01:21:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.975+0000 7f92655c6640 1 -- 172.21.15.81:0/1979590306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92600af770 con 0x7f92600d0980 2024-09-16T01:21:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.976+0000 7f92477fe640 1 -- 172.21.15.81:0/1979590306 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5229 (secure 0 0 0) 0x7f925407a360 con 0x7f92600d0980 2024-09-16T01:21:27.977 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:27.978 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":46,"btime":"2024-09-16T01:20:24:179686+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3998032766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3998032766},{"type":"v1","addr":"172.21.15.102:6835","nonce":3998032766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5794,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/978156526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":978156526},{"type":"v1","addr":"172.21.15.102:6834","nonce":978156526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6384,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1184176189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1184176189},{"type":"v1","addr":"172.21.15.81:6836","nonce":1184176189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:59.261790+0000","modified":"2024-09-16T01:20:23.958747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":24,"addr":"172.21.15.81:6837/2778062051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2778062051},{"type":"v1","addr":"172.21.15.81:6837","nonce":2778062051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-16T01:21:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 46 2024-09-16T01:21:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.978+0000 7f92655c6640 1 -- 172.21.15.81:0/1979590306 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f924c06c2b0 msgr2=0x7f924c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.978+0000 7f92655c6640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f924c06c2b0 0x7f924c06e770 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9250009a80 tx=0x7f92500039d0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.978+0000 7f92655c6640 1 -- 172.21.15.81:0/1979590306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d0980 msgr2=0x7f92601f8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.978+0000 7f92655c6640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d0980 0x7f92601f8000 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f925402a2b0 tx=0x7f92540046c0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.978+0000 7f92655c6640 1 -- 172.21.15.81:0/1979590306 shutdown_connections 2024-09-16T01:21:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.978+0000 7f92655c6640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f924c06c2b0 0x7f924c06e770 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.978+0000 7f92655c6640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f926015c520 0x7f92601f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.978+0000 7f92655c6640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d0980 0x7f92601f8000 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.978+0000 7f92655c6640 1 --2- 172.21.15.81:0/1979590306 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f92600b1620 0x7f92600ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.978+0000 7f92655c6640 1 -- 172.21.15.81:0/1979590306 >> 172.21.15.81:0/1979590306 conn(0x7f92600d23a0 msgr2=0x7f92600cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.978+0000 7f92655c6640 1 -- 172.21.15.81:0/1979590306 shutdown_connections 2024-09-16T01:21:27.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:27.978+0000 7f92655c6640 1 -- 172.21.15.81:0/1979590306 wait complete. 2024-09-16T01:21:27.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:21:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.086+0000 7f28ae0d7640 1 Processor -- start 2024-09-16T01:21:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.086+0000 7f28ae0d7640 1 -- start start 2024-09-16T01:21:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28ae0d7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f28a8072d30 0x7f28a806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28ae0d7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28a806f700 0x7f28a815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28ae0d7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a806fae0 con 0x7f28a815b300 2024-09-16T01:21:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28ae0d7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f28a80728a0 con 0x7f28a806f700 2024-09-16T01:21:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28ae0d7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f28a80cdbe0 con 0x7f28a8072d30 2024-09-16T01:21:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28a7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28a806f700 0x7f28a815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28a77fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f28a815b300 0x7f28a80cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42530/0 (socket says 172.21.15.81:42530) 2024-09-16T01:21:28.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28a77fe640 1 -- 172.21.15.81:0/95727706 learned_addr learned my addr 172.21.15.81:0/95727706 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28a7fff640 1 -- 172.21.15.81:0/95727706 >> v2:172.21.15.102:3300/0 conn(0x7f28a8072d30 msgr2=0x7f28a806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28a7fff640 1 --2- 172.21.15.81:0/95727706 >> v2:172.21.15.102:3300/0 conn(0x7f28a8072d30 0x7f28a806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28a7fff640 1 -- 172.21.15.81:0/95727706 >> v1:172.21.15.81:6789/0 conn(0x7f28a815b300 legacy=0x7f28a80cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28a7fff640 1 -- 172.21.15.81:0/95727706 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a80cd900 con 0x7f28a806f700 2024-09-16T01:21:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.087+0000 7f28a67fc640 1 -- 172.21.15.81:0/95727706 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931621625 0 0) 0x7f28a806fae0 con 0x7f28a815b300 2024-09-16T01:21:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.088+0000 7f28a7fff640 1 --2- 172.21.15.81:0/95727706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f700 0x7f28a815b6e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f28a80b57c0 tx=0x7f28a002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d1f703ee19dd11 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.088+0000 7f28a67fc640 1 -- 172.21.15.81:0/95727706 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a0007740 con 0x7f28a806f700 2024-09-16T01:21:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.088+0000 7f28a67fc640 1 -- 172.21.15.81:0/95727706 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a00078e0 con 0x7f28a806f700 2024-09-16T01:21:28.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.088+0000 7f28a67fc640 1 -- 172.21.15.81:0/95727706 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a0007cb0 con 0x7f28a806f700 2024-09-16T01:21:28.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.089+0000 7f28ae0d7640 1 -- 172.21.15.81:0/95727706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f700 msgr2=0x7f28a815b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.089+0000 7f28ae0d7640 1 --2- 172.21.15.81:0/95727706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f700 0x7f28a815b6e0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f28a80b57c0 tx=0x7f28a002a5f0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.089+0000 7f28ae0d7640 1 -- 172.21.15.81:0/95727706 shutdown_connections 2024-09-16T01:21:28.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.089+0000 7f28ae0d7640 1 --2- 172.21.15.81:0/95727706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a806f700 0x7f28a815b6e0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.089+0000 7f28ae0d7640 1 --2- 172.21.15.81:0/95727706 >> v2:172.21.15.102:3300/0 conn(0x7f28a8072d30 0x7f28a806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.089+0000 7f28ae0d7640 1 -- 172.21.15.81:0/95727706 >> 172.21.15.81:0/95727706 conn(0x7f28a8067d70 msgr2=0x7f28a806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:28.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.089+0000 7f28ae0d7640 1 -- 172.21.15.81:0/95727706 shutdown_connections 2024-09-16T01:21:28.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.089+0000 7f28ae0d7640 1 -- 172.21.15.81:0/95727706 wait complete. 2024-09-16T01:21:28.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.090+0000 7f28ae0d7640 1 Processor -- start 2024-09-16T01:21:28.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.090+0000 7f28ae0d7640 1 -- start start 2024-09-16T01:21:28.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28ae0d7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28a806f700 0x7f28a815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28ae0d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a8072d30 0x7f28a81f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28ae0d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28a815b300 0x7f28a8151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28ae0d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28a80cd5c0 con 0x7f28a8072d30 2024-09-16T01:21:28.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28ae0d7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f28a8072530 con 0x7f28a815b300 2024-09-16T01:21:28.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28ae0d7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f28a80cffe0 con 0x7f28a806f700 2024-09-16T01:21:28.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a8072d30 0x7f28a81f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a8072d30 0x7f28a81f4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54248/0 (socket says 172.21.15.81:54248) 2024-09-16T01:21:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28a6ffd640 1 -- 172.21.15.81:0/3288309727 learned_addr learned my addr 172.21.15.81:0/3288309727 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28a7fff640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28a815b300 0x7f28a8151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28a6ffd640 1 -- 172.21.15.81:0/3288309727 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28a806f700 msgr2=0x7f28a815a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28a6ffd640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28a806f700 0x7f28a815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28a6ffd640 1 -- 172.21.15.81:0/3288309727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28a815b300 msgr2=0x7f28a8151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28a6ffd640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28a815b300 0x7f28a8151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28a6ffd640 1 -- 172.21.15.81:0/3288309727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a80b2160 con 0x7f28a8072d30 2024-09-16T01:21:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28a7fff640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28a815b300 0x7f28a8151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.091+0000 7f28a6ffd640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a8072d30 0x7f28a81f4660 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f289c00b4a0 tx=0x7f289c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.092+0000 7f288ffff640 1 -- 172.21.15.81:0/3288309727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c014070 con 0x7f28a8072d30 2024-09-16T01:21:28.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.092+0000 7f288ffff640 1 -- 172.21.15.81:0/3288309727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c010610 con 0x7f28a8072d30 2024-09-16T01:21:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.092+0000 7f28ae0d7640 1 -- 172.21.15.81:0/3288309727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a80b2440 con 0x7f28a8072d30 2024-09-16T01:21:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.092+0000 7f288ffff640 1 -- 172.21.15.81:0/3288309727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c010a00 con 0x7f28a8072d30 2024-09-16T01:21:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.092+0000 7f28ae0d7640 1 -- 172.21.15.81:0/3288309727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a815d600 con 0x7f28a8072d30 2024-09-16T01:21:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.093+0000 7f28ae0d7640 1 -- 172.21.15.81:0/3288309727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a806f1c0 con 0x7f28a8072d30 2024-09-16T01:21:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.093+0000 7f288ffff640 1 -- 172.21.15.81:0/3288309727 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f289c017070 con 0x7f28a8072d30 2024-09-16T01:21:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.093+0000 7f288ffff640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f289406c2b0 0x7f289406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.093+0000 7f288ffff640 1 -- 172.21.15.81:0/3288309727 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f289c08b030 con 0x7f28a8072d30 2024-09-16T01:21:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.094+0000 7f28a77fe640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f289406c2b0 0x7f289406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.094+0000 7f28a77fe640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f289406c2b0 0x7f289406e770 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2898007fd0 tx=0x7f2898007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:28.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.098+0000 7f288ffff640 1 -- 172.21.15.81:0/3288309727 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f289c059630 con 0x7f28a8072d30 2024-09-16T01:21:28.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.264+0000 7f28ae0d7640 1 -- 172.21.15.81:0/3288309727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28a80b4ad0 con 0x7f28a8072d30 2024-09-16T01:21:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.265+0000 7f288ffff640 1 -- 172.21.15.81:0/3288309727 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+17138 (secure 0 0 0) 0x7f289c058f30 con 0x7f28a8072d30 2024-09-16T01:21:28.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:28.268 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":89,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:19:22.982071+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:18:57.600304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-16T01:18:58.228275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.a","mappings":[{"from":1,"to":7}]},{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.24","mappings":[{"from":1,"to":5}]},{"pgid":"14.3c","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:21:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.267+0000 7f28ae0d7640 1 -- 172.21.15.81:0/3288309727 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f289406c2b0 msgr2=0x7f289406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.267+0000 7f28ae0d7640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f289406c2b0 0x7f289406e770 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2898007fd0 tx=0x7f2898007920 comp rx=0 tx=0).stop 2024-09-16T01:21:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.267+0000 7f28ae0d7640 1 -- 172.21.15.81:0/3288309727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a8072d30 msgr2=0x7f28a81f4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.267+0000 7f28ae0d7640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a8072d30 0x7f28a81f4660 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f289c00b4a0 tx=0x7f289c00b960 comp rx=0 tx=0).stop 2024-09-16T01:21:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.267+0000 7f28ae0d7640 1 -- 172.21.15.81:0/3288309727 shutdown_connections 2024-09-16T01:21:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.267+0000 7f28ae0d7640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f289406c2b0 0x7f289406e770 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.267+0000 7f28ae0d7640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28a815b300 0x7f28a8151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.267+0000 7f28ae0d7640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a8072d30 0x7f28a81f4660 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.267+0000 7f28ae0d7640 1 --2- 172.21.15.81:0/3288309727 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28a806f700 0x7f28a815a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.267+0000 7f28ae0d7640 1 -- 172.21.15.81:0/3288309727 >> 172.21.15.81:0/3288309727 conn(0x7f28a8067d70 msgr2=0x7f28a806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.267+0000 7f28ae0d7640 1 -- 172.21.15.81:0/3288309727 shutdown_connections 2024-09-16T01:21:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.267+0000 7f28ae0d7640 1 -- 172.21.15.81:0/3288309727 wait complete. 2024-09-16T01:21:28.281 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:21:28.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:21:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.378+0000 7f9c00d28640 1 Processor -- start 2024-09-16T01:21:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.378+0000 7f9c00d28640 1 -- start start 2024-09-16T01:21:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.378+0000 7f9c00d28640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc145e00 0x7f9bfc0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9c00d28640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bfc0af720 con 0x7f9bfc0d0be0 2024-09-16T01:21:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9c00d28640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bfc15d8c0 con 0x7f9bfc15d460 2024-09-16T01:21:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9c00d28640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9bfc1461e0 con 0x7f9bfc145e00 2024-09-16T01:21:28.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bfad9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9bfc0d0be0 0x7f9bfc0afc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42540/0 (socket says 172.21.15.81:42540) 2024-09-16T01:21:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bfad9d640 1 -- 172.21.15.81:0/933023343 learned_addr learned my addr 172.21.15.81:0/933023343 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44790207 0 0) 0x7f9bfc0af720 con 0x7f9bfc0d0be0 2024-09-16T01:21:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9be8003520 con 0x7f9bfc0d0be0 2024-09-16T01:21:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bfa59c640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc145e00 0x7f9bfc0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3471032787 0 0) 0x7f9be8003520 con 0x7f9bfc0d0be0 2024-09-16T01:21:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc145e00 msgr2=0x7f9bfc0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc145e00 0x7f9bfc0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 >> v1:172.21.15.102:6789/0 conn(0x7f9bfc15d460 legacy=0x7f9bfc0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc0cdf90 con 0x7f9bfc0d0be0 2024-09-16T01:21:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f9bf4001a10 con 0x7f9bfc0d0be0 2024-09-16T01:21:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 >> v1:172.21.15.81:6789/0 conn(0x7f9bfc0d0be0 legacy=0x7f9bfc0afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc145e00 0x7f9be80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be8003f60 0x7f9be8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9be8004d40 0x7f9be80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc1461e0 con 0x7f9be8003f60 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9be800baa0 con 0x7f9be8004d40 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9be800bca0 con 0x7f9bfc145e00 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.379+0000 7f9bf1d9b640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be8003f60 0x7f9be8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.380+0000 7f9bfa59c640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc145e00 0x7f9be80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.380+0000 7f9bfad9d640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9be8004d40 0x7f9be80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.380+0000 7f9bf1d9b640 1 -- 172.21.15.81:0/933023343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc145e00 msgr2=0x7f9be80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.380+0000 7f9bf1d9b640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc145e00 0x7f9be80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.380+0000 7f9bf1d9b640 1 -- 172.21.15.81:0/933023343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9be8004d40 msgr2=0x7f9be80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.380+0000 7f9bf1d9b640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9be8004d40 0x7f9be80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.380+0000 7f9bf1d9b640 1 -- 172.21.15.81:0/933023343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be8003520 con 0x7f9be8003f60 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.380+0000 7f9bfad9d640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9be8004d40 0x7f9be80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.380+0000 7f9bf1d9b640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be8003f60 0x7f9be8004800 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9be4001720 tx=0x7f9be8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5db68a377fb4534 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.381+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4001370 con 0x7f9be8003f60 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.381+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be40052d0 con 0x7f9be8003f60 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.381+0000 7f9bf9d9b640 1 -- 172.21.15.81:0/933023343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be402abc0 con 0x7f9be8003f60 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.381+0000 7f9c00d28640 1 -- 172.21.15.81:0/933023343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be8003f60 msgr2=0x7f9be8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.381+0000 7f9c00d28640 1 --2- 172.21.15.81:0/933023343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be8003f60 0x7f9be8004800 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f9be4001720 tx=0x7f9be8005830 comp rx=0 tx=0).stop 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.381+0000 7f9bfad9d640 1 -- 172.21.15.81:0/933023343 reap_dead start 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.381+0000 7f9c00d28640 1 -- 172.21.15.81:0/933023343 shutdown_connections 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.381+0000 7f9c00d28640 1 -- 172.21.15.81:0/933023343 >> 172.21.15.81:0/933023343 conn(0x7f9bfc0b2f40 msgr2=0x7f9bfc0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.381+0000 7f9c00d28640 1 -- 172.21.15.81:0/933023343 shutdown_connections 2024-09-16T01:21:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.381+0000 7f9c00d28640 1 -- 172.21.15.81:0/933023343 wait complete. 2024-09-16T01:21:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.383+0000 7f9c00d28640 1 Processor -- start 2024-09-16T01:21:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.383+0000 7f9c00d28640 1 -- start start 2024-09-16T01:21:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.383+0000 7f9c00d28640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9be8003f60 0x7f9bfc13e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.383+0000 7f9c00d28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bfc13d570 0x7f9bfc159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.383+0000 7f9c00d28640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc159c50 0x7f9bfc1f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.383+0000 7f9c00d28640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc0ce830 con 0x7f9bfc13d570 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.383+0000 7f9c00d28640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc0ce550 con 0x7f9be8003f60 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.383+0000 7f9c00d28640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9bfc0cede0 con 0x7f9bfc159c50 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.383+0000 7f9bf1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bfc13d570 0x7f9bfc159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bf1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bfc13d570 0x7f9bfc159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54268/0 (socket says 172.21.15.81:54268) 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bf1d9b640 1 -- 172.21.15.81:0/3084186028 learned_addr learned my addr 172.21.15.81:0/3084186028 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bfa59c640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9be8003f60 0x7f9bfc13e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bfad9d640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc159c50 0x7f9bfc1f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bf1d9b640 1 -- 172.21.15.81:0/3084186028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc159c50 msgr2=0x7f9bfc1f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bf1d9b640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc159c50 0x7f9bfc1f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bf1d9b640 1 -- 172.21.15.81:0/3084186028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9be8003f60 msgr2=0x7f9bfc13e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bf1d9b640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9be8003f60 0x7f9bfc13e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bf1d9b640 1 -- 172.21.15.81:0/3084186028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc141180 con 0x7f9bfc13d570 2024-09-16T01:21:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bf1d9b640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bfc13d570 0x7f9bfc159710 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f9be4008fd0 tx=0x7f9be4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bf37fe640 1 -- 172.21.15.81:0/3084186028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4037040 con 0x7f9bfc13d570 2024-09-16T01:21:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bf37fe640 1 -- 172.21.15.81:0/3084186028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be4005480 con 0x7f9bfc13d570 2024-09-16T01:21:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9c00d28640 1 -- 172.21.15.81:0/3084186028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bfc141460 con 0x7f9bfc13d570 2024-09-16T01:21:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9bf37fe640 1 -- 172.21.15.81:0/3084186028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4007a30 con 0x7f9bfc13d570 2024-09-16T01:21:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.384+0000 7f9c00d28640 1 -- 172.21.15.81:0/3084186028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bfc141a20 con 0x7f9bfc13d570 2024-09-16T01:21:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.385+0000 7f9c00d28640 1 -- 172.21.15.81:0/3084186028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bfc0cd8a0 con 0x7f9bfc13d570 2024-09-16T01:21:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.386+0000 7f9bf37fe640 1 -- 172.21.15.81:0/3084186028 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9be4044020 con 0x7f9bfc13d570 2024-09-16T01:21:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.386+0000 7f9bf37fe640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9bdc06c2b0 0x7f9bdc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.386+0000 7f9bf37fe640 1 -- 172.21.15.81:0/3084186028 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f9be4007640 con 0x7f9bfc13d570 2024-09-16T01:21:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.386+0000 7f9bfa59c640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9bdc06c2b0 0x7f9bdc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.386+0000 7f9bfa59c640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9bdc06c2b0 0x7f9bdc06e770 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009bc0 tx=0x7f9bec009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.390+0000 7f9bf37fe640 1 -- 172.21.15.81:0/3084186028 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9be4079910 con 0x7f9bfc13d570 2024-09-16T01:21:28.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.590+0000 7f9c00d28640 1 -- 172.21.15.81:0/3084186028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bfc0b63c0 con 0x7f9bfc13d570 2024-09-16T01:21:28.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.590+0000 7f9bf37fe640 1 -- 172.21.15.81:0/3084186028 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5229 (secure 0 0 0) 0x7f9be4079210 con 0x7f9bfc13d570 2024-09-16T01:21:28.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:28.592 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":46,"btime":"2024-09-16T01:20:24:179686+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3998032766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3998032766},{"type":"v1","addr":"172.21.15.102:6835","nonce":3998032766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5794,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/978156526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":978156526},{"type":"v1","addr":"172.21.15.102:6834","nonce":978156526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6384,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1184176189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1184176189},{"type":"v1","addr":"172.21.15.81:6836","nonce":1184176189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:59.261790+0000","modified":"2024-09-16T01:20:23.958747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":24,"addr":"172.21.15.81:6837/2778062051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2778062051},{"type":"v1","addr":"172.21.15.81:6837","nonce":2778062051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-16T01:21:28.592 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 46 2024-09-16T01:21:28.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.592+0000 7f9c00d28640 1 -- 172.21.15.81:0/3084186028 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9bdc06c2b0 msgr2=0x7f9bdc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.592+0000 7f9c00d28640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9bdc06c2b0 0x7f9bdc06e770 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009bc0 tx=0x7f9bec009190 comp rx=0 tx=0).stop 2024-09-16T01:21:28.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.592+0000 7f9c00d28640 1 -- 172.21.15.81:0/3084186028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bfc13d570 msgr2=0x7f9bfc159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.592+0000 7f9c00d28640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bfc13d570 0x7f9bfc159710 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f9be4008fd0 tx=0x7f9be4001120 comp rx=0 tx=0).stop 2024-09-16T01:21:28.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.592+0000 7f9c00d28640 1 -- 172.21.15.81:0/3084186028 shutdown_connections 2024-09-16T01:21:28.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.592+0000 7f9c00d28640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9bdc06c2b0 0x7f9bdc06e770 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.592+0000 7f9c00d28640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9bfc159c50 0x7f9bfc1f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.592+0000 7f9c00d28640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bfc13d570 0x7f9bfc159710 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.592+0000 7f9c00d28640 1 --2- 172.21.15.81:0/3084186028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9be8003f60 0x7f9bfc13e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.592+0000 7f9c00d28640 1 -- 172.21.15.81:0/3084186028 >> 172.21.15.81:0/3084186028 conn(0x7f9bfc0b2f40 msgr2=0x7f9bfc0b1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:28.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.592+0000 7f9c00d28640 1 -- 172.21.15.81:0/3084186028 shutdown_connections 2024-09-16T01:21:28.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.592+0000 7f9c00d28640 1 -- 172.21.15.81:0/3084186028 wait complete. 2024-09-16T01:21:28.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:21:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.700+0000 7f4c0cca4640 1 Processor -- start 2024-09-16T01:21:28.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.700+0000 7f4c0cca4640 1 -- start start 2024-09-16T01:21:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c0cca4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c0815b300 0x7f4c080cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c0cca4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4c0806f8d0 0x7f4c0815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c0cca4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c080cdbe0 con 0x7f4c080cd3f0 2024-09-16T01:21:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c0cca4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4c080728a0 con 0x7f4c0815b300 2024-09-16T01:21:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c0cca4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4c080cd900 con 0x7f4c0806f8d0 2024-09-16T01:21:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c0659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c0815b300 0x7f4c080cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4bfffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4c080cd3f0 0x7f4c0806f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42546/0 (socket says 172.21.15.81:42546) 2024-09-16T01:21:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c0659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c0815b300 0x7f4c080cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54278/0 (socket says 172.21.15.81:54278) 2024-09-16T01:21:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4bfffff640 1 -- 172.21.15.81:0/176532231 learned_addr learned my addr 172.21.15.81:0/176532231 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c06d9d640 1 --2- 172.21.15.81:0/176532231 >> v2:172.21.15.102:3300/0 conn(0x7f4c0806f8d0 0x7f4c0815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c0659c640 1 -- 172.21.15.81:0/176532231 >> v2:172.21.15.102:3300/0 conn(0x7f4c0806f8d0 msgr2=0x7f4c0815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c0659c640 1 --2- 172.21.15.81:0/176532231 >> v2:172.21.15.102:3300/0 conn(0x7f4c0806f8d0 0x7f4c0815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c0659c640 1 -- 172.21.15.81:0/176532231 >> v1:172.21.15.81:6789/0 conn(0x7f4c080cd3f0 legacy=0x7f4c0806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c05d9b640 1 -- 172.21.15.81:0/176532231 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3465918305 0 0) 0x7f4c080cdbe0 con 0x7f4c080cd3f0 2024-09-16T01:21:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.701+0000 7f4c0659c640 1 -- 172.21.15.81:0/176532231 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c08072250 con 0x7f4c0815b300 2024-09-16T01:21:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.702+0000 7f4c0659c640 1 --2- 172.21.15.81:0/176532231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0815b300 0x7f4c080cceb0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4c080b38f0 tx=0x7f4bf802c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d5c4342734b080 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.702+0000 7f4c05d9b640 1 -- 172.21.15.81:0/176532231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8032770 con 0x7f4c0815b300 2024-09-16T01:21:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.702+0000 7f4c05d9b640 1 -- 172.21.15.81:0/176532231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf8038070 con 0x7f4c0815b300 2024-09-16T01:21:28.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.702+0000 7f4c05d9b640 1 -- 172.21.15.81:0/176532231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8032b30 con 0x7f4c0815b300 2024-09-16T01:21:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.703+0000 7f4c0cca4640 1 -- 172.21.15.81:0/176532231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0815b300 msgr2=0x7f4c080cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.703+0000 7f4c0cca4640 1 --2- 172.21.15.81:0/176532231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0815b300 0x7f4c080cceb0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4c080b38f0 tx=0x7f4bf802c870 comp rx=0 tx=0).stop 2024-09-16T01:21:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.703+0000 7f4c0cca4640 1 -- 172.21.15.81:0/176532231 shutdown_connections 2024-09-16T01:21:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.703+0000 7f4c0cca4640 1 --2- 172.21.15.81:0/176532231 >> v2:172.21.15.102:3300/0 conn(0x7f4c0806f8d0 0x7f4c0815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.703+0000 7f4c0cca4640 1 --2- 172.21.15.81:0/176532231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0815b300 0x7f4c080cceb0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.703+0000 7f4c0cca4640 1 -- 172.21.15.81:0/176532231 >> 172.21.15.81:0/176532231 conn(0x7f4c08067d70 msgr2=0x7f4c0806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.703+0000 7f4c0cca4640 1 -- 172.21.15.81:0/176532231 shutdown_connections 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.703+0000 7f4c0cca4640 1 -- 172.21.15.81:0/176532231 wait complete. 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.704+0000 7f4c0cca4640 1 Processor -- start 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.704+0000 7f4c0cca4640 1 -- start start 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0cca4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0806f8d0 0x7f4c0814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0cca4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c080cd3f0 0x7f4c08153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0cca4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c0815b300 0x7f4c08153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0cca4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c080d0160 con 0x7f4c0806f8d0 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0cca4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4c080cffe0 con 0x7f4c080cd3f0 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0cca4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4c08072d30 con 0x7f4c0815b300 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0806f8d0 0x7f4c0814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0806f8d0 0x7f4c0814f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54290/0 (socket says 172.21.15.81:54290) 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0659c640 1 -- 172.21.15.81:0/3707651592 learned_addr learned my addr 172.21.15.81:0/3707651592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4bfffff640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c080cd3f0 0x7f4c08153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c06d9d640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c0815b300 0x7f4c08153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0659c640 1 -- 172.21.15.81:0/3707651592 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c0815b300 msgr2=0x7f4c08153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0659c640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c0815b300 0x7f4c08153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0659c640 1 -- 172.21.15.81:0/3707651592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c080cd3f0 msgr2=0x7f4c08153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0659c640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c080cd3f0 0x7f4c08153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4c0659c640 1 -- 172.21.15.81:0/3707651592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c081f4000 con 0x7f4c0806f8d0 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.705+0000 7f4bfffff640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c080cd3f0 0x7f4c08153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.706+0000 7f4c0659c640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0806f8d0 0x7f4c0814f990 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8035040 tx=0x7f4bf8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.706+0000 7f4bfeffd640 1 -- 172.21.15.81:0/3707651592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8006e10 con 0x7f4c0806f8d0 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.706+0000 7f4bfeffd640 1 -- 172.21.15.81:0/3707651592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf8032e50 con 0x7f4c0806f8d0 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.706+0000 7f4c0cca4640 1 -- 172.21.15.81:0/3707651592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c081f4270 con 0x7f4c0806f8d0 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.706+0000 7f4bfeffd640 1 -- 172.21.15.81:0/3707651592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8033e60 con 0x7f4c0806f8d0 2024-09-16T01:21:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.706+0000 7f4c0cca4640 1 -- 172.21.15.81:0/3707651592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c081f4830 con 0x7f4c0806f8d0 2024-09-16T01:21:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.707+0000 7f4c0cca4640 1 -- 172.21.15.81:0/3707651592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c0806bd40 con 0x7f4c0806f8d0 2024-09-16T01:21:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.707+0000 7f4bfeffd640 1 -- 172.21.15.81:0/3707651592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4bf8032070 con 0x7f4c0806f8d0 2024-09-16T01:21:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.708+0000 7f4bfeffd640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4be806c2b0 0x7f4be806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.708+0000 7f4bfeffd640 1 -- 172.21.15.81:0/3707651592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f4bf80ac400 con 0x7f4c0806f8d0 2024-09-16T01:21:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.708+0000 7f4bfffff640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4be806c2b0 0x7f4be806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.708+0000 7f4bfffff640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4be806c2b0 0x7f4be806e770 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4c0815b750 tx=0x7f4bf0007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.712+0000 7f4bfeffd640 1 -- 172.21.15.81:0/3707651592 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bf807a440 con 0x7f4c0806f8d0 2024-09-16T01:21:28.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.911+0000 7f4c0cca4640 1 -- 172.21.15.81:0/3707651592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c0806d090 con 0x7f4c0806f8d0 2024-09-16T01:21:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.911+0000 7f4bfeffd640 1 -- 172.21.15.81:0/3707651592 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5229 (secure 0 0 0) 0x7f4bf807e740 con 0x7f4c0806f8d0 2024-09-16T01:21:28.913 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:28.913 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":46,"btime":"2024-09-16T01:20:24:179686+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3998032766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3998032766},{"type":"v1","addr":"172.21.15.102:6835","nonce":3998032766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5794,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/978156526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":978156526},{"type":"v1","addr":"172.21.15.102:6834","nonce":978156526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6384,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1184176189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1184176189},{"type":"v1","addr":"172.21.15.81:6836","nonce":1184176189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:18:59.261790+0000","modified":"2024-09-16T01:20:23.958747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6387},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6387":{"gid":6387,"name":"c","rank":0,"incarnation":40,"state":"up:active","state_seq":24,"addr":"172.21.15.81:6837/2778062051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2778062051},{"type":"v1","addr":"172.21.15.81:6837","nonce":2778062051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6387,"qdb_cluster":[6387]},"id":6}]} 2024-09-16T01:21:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 46 2024-09-16T01:21:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.913+0000 7f4c0cca4640 1 -- 172.21.15.81:0/3707651592 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4be806c2b0 msgr2=0x7f4be806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.913+0000 7f4c0cca4640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4be806c2b0 0x7f4be806e770 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4c0815b750 tx=0x7f4bf0007c10 comp rx=0 tx=0).stop 2024-09-16T01:21:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.913+0000 7f4c0cca4640 1 -- 172.21.15.81:0/3707651592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0806f8d0 msgr2=0x7f4c0814f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.913+0000 7f4c0cca4640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0806f8d0 0x7f4c0814f990 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8035040 tx=0x7f4bf8004730 comp rx=0 tx=0).stop 2024-09-16T01:21:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.913+0000 7f4c0cca4640 1 -- 172.21.15.81:0/3707651592 shutdown_connections 2024-09-16T01:21:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.913+0000 7f4c0cca4640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4be806c2b0 0x7f4be806e770 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.913+0000 7f4c0cca4640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4c0815b300 0x7f4c08153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.913+0000 7f4c0cca4640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4c080cd3f0 0x7f4c08153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.913+0000 7f4c0cca4640 1 --2- 172.21.15.81:0/3707651592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c0806f8d0 0x7f4c0814f990 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.913+0000 7f4c0cca4640 1 -- 172.21.15.81:0/3707651592 >> 172.21.15.81:0/3707651592 conn(0x7f4c08067d70 msgr2=0x7f4c0806ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.913+0000 7f4c0cca4640 1 -- 172.21.15.81:0/3707651592 shutdown_connections 2024-09-16T01:21:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:28.913+0000 7f4c0cca4640 1 -- 172.21.15.81:0/3707651592 wait complete. 2024-09-16T01:21:28.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:21:29.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.022+0000 7f4b09c1e640 1 Processor -- start 2024-09-16T01:21:29.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.022+0000 7f4b09c1e640 1 -- start start 2024-09-16T01:21:29.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b09c1e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b040b69d0 0x7f4b04162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b09c1e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4b040af280 0x7f4b040afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b09c1e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b040affb0 0x7f4b04154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b09c1e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4b040b6db0 con 0x7f4b040affb0 2024-09-16T01:21:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b09c1e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4b0415eb60 con 0x7f4b040af280 2024-09-16T01:21:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b09c1e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4b0415ee40 con 0x7f4b040b69d0 2024-09-16T01:21:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b03fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b040affb0 0x7f4b04154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b03fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b040affb0 0x7f4b04154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54302/0 (socket says 172.21.15.81:54302) 2024-09-16T01:21:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b03fff640 1 -- 172.21.15.81:0/2050135489 learned_addr learned my addr 172.21.15.81:0/2050135489 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b037fe640 1 --2- 172.21.15.81:0/2050135489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b040b69d0 0x7f4b04162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b02ffd640 1 --2- 172.21.15.81:0/2050135489 >> v2:172.21.15.102:3300/0 conn(0x7f4b040af280 0x7f4b040afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b03fff640 1 -- 172.21.15.81:0/2050135489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b040b69d0 msgr2=0x7f4b04162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b03fff640 1 --2- 172.21.15.81:0/2050135489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b040b69d0 0x7f4b04162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b03fff640 1 -- 172.21.15.81:0/2050135489 >> v2:172.21.15.102:3300/0 conn(0x7f4b040af280 msgr2=0x7f4b040afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b03fff640 1 --2- 172.21.15.81:0/2050135489 >> v2:172.21.15.102:3300/0 conn(0x7f4b040af280 0x7f4b040afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.023+0000 7f4b03fff640 1 -- 172.21.15.81:0/2050135489 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0415f120 con 0x7f4b040affb0 2024-09-16T01:21:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.024+0000 7f4b03fff640 1 --2- 172.21.15.81:0/2050135489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040affb0 0x7f4b04154d00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009870 tx=0x7f4afc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b14a7bca5cffa21 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.024+0000 7f4b027fc640 1 -- 172.21.15.81:0/2050135489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc037070 con 0x7f4b040affb0 2024-09-16T01:21:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.024+0000 7f4b027fc640 1 -- 172.21.15.81:0/2050135489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4afc02ae10 con 0x7f4b040affb0 2024-09-16T01:21:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.024+0000 7f4b027fc640 1 -- 172.21.15.81:0/2050135489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc032660 con 0x7f4b040affb0 2024-09-16T01:21:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.025+0000 7f4b09c1e640 1 -- 172.21.15.81:0/2050135489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040affb0 msgr2=0x7f4b04154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.025+0000 7f4b09c1e640 1 --2- 172.21.15.81:0/2050135489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040affb0 0x7f4b04154d00 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009870 tx=0x7f4afc02a100 comp rx=0 tx=0).stop 2024-09-16T01:21:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.025+0000 7f4b09c1e640 1 -- 172.21.15.81:0/2050135489 shutdown_connections 2024-09-16T01:21:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.025+0000 7f4b09c1e640 1 --2- 172.21.15.81:0/2050135489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040affb0 0x7f4b04154d00 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.025+0000 7f4b09c1e640 1 --2- 172.21.15.81:0/2050135489 >> v2:172.21.15.102:3300/0 conn(0x7f4b040af280 0x7f4b040afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.025+0000 7f4b09c1e640 1 --2- 172.21.15.81:0/2050135489 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b040b69d0 0x7f4b04162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.025+0000 7f4b09c1e640 1 -- 172.21.15.81:0/2050135489 >> 172.21.15.81:0/2050135489 conn(0x7f4b0406bc10 msgr2=0x7f4b0406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.025+0000 7f4b09c1e640 1 -- 172.21.15.81:0/2050135489 shutdown_connections 2024-09-16T01:21:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.025+0000 7f4b09c1e640 1 -- 172.21.15.81:0/2050135489 wait complete. 2024-09-16T01:21:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.026+0000 7f4b09c1e640 1 Processor -- start 2024-09-16T01:21:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.026+0000 7f4b09c1e640 1 -- start start 2024-09-16T01:21:29.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b09c1e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040af280 0x7f4b0415fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b09c1e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b040affb0 0x7f4b04153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b09c1e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b040b69d0 0x7f4b0415d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b09c1e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b04155240 con 0x7f4b040af280 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b09c1e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4b040af6e0 con 0x7f4b040affb0 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b09c1e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4b041553c0 con 0x7f4b040b69d0 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040af280 0x7f4b0415fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040af280 0x7f4b0415fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54312/0 (socket says 172.21.15.81:54312) 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b037fe640 1 -- 172.21.15.81:0/329131468 learned_addr learned my addr 172.21.15.81:0/329131468 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b02ffd640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b040affb0 0x7f4b04153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b03fff640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b040b69d0 0x7f4b0415d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b037fe640 1 -- 172.21.15.81:0/329131468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b040b69d0 msgr2=0x7f4b0415d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b037fe640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b040b69d0 0x7f4b0415d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b037fe640 1 -- 172.21.15.81:0/329131468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b040affb0 msgr2=0x7f4b04153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b037fe640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b040affb0 0x7f4b04153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b037fe640 1 -- 172.21.15.81:0/329131468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b04160180 con 0x7f4b040af280 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b03fff640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b040b69d0 0x7f4b0415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b02ffd640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b040affb0 0x7f4b04153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.027+0000 7f4b037fe640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040af280 0x7f4b0415fa80 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f4af400ccd0 tx=0x7f4af400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.028+0000 7f4aebfff640 1 -- 172.21.15.81:0/329131468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4003990 con 0x7f4b040af280 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.028+0000 7f4aebfff640 1 -- 172.21.15.81:0/329131468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af4003b30 con 0x7f4b040af280 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.028+0000 7f4aebfff640 1 -- 172.21.15.81:0/329131468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af4004020 con 0x7f4b040af280 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.028+0000 7f4b09c1e640 1 -- 172.21.15.81:0/329131468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b04160460 con 0x7f4b040af280 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.028+0000 7f4b09c1e640 1 -- 172.21.15.81:0/329131468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b04160a20 con 0x7f4b040af280 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.029+0000 7f4b09c1e640 1 -- 172.21.15.81:0/329131468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b04155820 con 0x7f4b040af280 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.029+0000 7f4aebfff640 1 -- 172.21.15.81:0/329131468 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4af40041c0 con 0x7f4b040af280 2024-09-16T01:21:29.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.029+0000 7f4aebfff640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4af006c2b0 0x7f4af006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.030+0000 7f4aebfff640 1 -- 172.21.15.81:0/329131468 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f4af408bb70 con 0x7f4b040af280 2024-09-16T01:21:29.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.030+0000 7f4b02ffd640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4af006c2b0 0x7f4af006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.030+0000 7f4b02ffd640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4af006c2b0 0x7f4af006e770 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4af8006fd0 tx=0x7f4af8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:29.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.034+0000 7f4aebfff640 1 -- 172.21.15.81:0/329131468 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4af4014030 con 0x7f4b040af280 2024-09-16T01:21:29.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.201+0000 7f4b09c1e640 1 -- 172.21.15.81:0/329131468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b0406ee30 con 0x7f4b040af280 2024-09-16T01:21:29.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.202+0000 7f4aebfff640 1 -- 172.21.15.81:0/329131468 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+17138 (secure 0 0 0) 0x7f4af405a0e0 con 0x7f4b040af280 2024-09-16T01:21:29.204 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:29.205 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":89,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:19:22.982071+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:18:57.600304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-16T01:18:58.228275+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.a","mappings":[{"from":1,"to":7}]},{"pgid":"14.10","mappings":[{"from":1,"to":2}]},{"pgid":"14.24","mappings":[{"from":1,"to":5}]},{"pgid":"14.3c","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:21:29.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.205+0000 7f4b09c1e640 1 -- 172.21.15.81:0/329131468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4af006c2b0 msgr2=0x7f4af006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.205+0000 7f4b09c1e640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4af006c2b0 0x7f4af006e770 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4af8006fd0 tx=0x7f4af8008040 comp rx=0 tx=0).stop 2024-09-16T01:21:29.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.205+0000 7f4b09c1e640 1 -- 172.21.15.81:0/329131468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040af280 msgr2=0x7f4b0415fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.205+0000 7f4b09c1e640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040af280 0x7f4b0415fa80 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f4af400ccd0 tx=0x7f4af400a5c0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.205+0000 7f4b09c1e640 1 -- 172.21.15.81:0/329131468 shutdown_connections 2024-09-16T01:21:29.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.205+0000 7f4b09c1e640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4af006c2b0 0x7f4af006e770 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.205+0000 7f4b09c1e640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b040b69d0 0x7f4b0415d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.205+0000 7f4b09c1e640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b040affb0 0x7f4b04153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.205+0000 7f4b09c1e640 1 --2- 172.21.15.81:0/329131468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b040af280 0x7f4b0415fa80 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.205+0000 7f4b09c1e640 1 -- 172.21.15.81:0/329131468 >> 172.21.15.81:0/329131468 conn(0x7f4b0406bc10 msgr2=0x7f4b040b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:29.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.205+0000 7f4b09c1e640 1 -- 172.21.15.81:0/329131468 shutdown_connections 2024-09-16T01:21:29.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.205+0000 7f4b09c1e640 1 -- 172.21.15.81:0/329131468 wait complete. 2024-09-16T01:21:29.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:21:29.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.315+0000 7f46e65e4640 1 Processor -- start 2024-09-16T01:21:29.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.315+0000 7f46e65e4640 1 -- start start 2024-09-16T01:21:29.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46e65e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46e015e740 0x7f46e00d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46e65e4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f46e009b690 0x7f46e006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46e65e4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e00d0780 con 0x7f46e006d4c0 2024-09-16T01:21:29.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46e65e4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f46e015eb20 con 0x7f46e015e740 2024-09-16T01:21:29.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46e65e4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f46e006d260 con 0x7f46e009b690 2024-09-16T01:21:29.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46dffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46e015e740 0x7f46e00d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46dffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46e015e740 0x7f46e00d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54322/0 (socket says 172.21.15.81:54322) 2024-09-16T01:21:29.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46dffff640 1 -- 172.21.15.81:0/799092517 learned_addr learned my addr 172.21.15.81:0/799092517 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:29.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46df7fe640 1 --2- 172.21.15.81:0/799092517 >> v2:172.21.15.102:3300/0 conn(0x7f46e009b690 0x7f46e006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46dffff640 1 -- 172.21.15.81:0/799092517 >> v2:172.21.15.102:3300/0 conn(0x7f46e009b690 msgr2=0x7f46e006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:29.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46dffff640 1 --2- 172.21.15.81:0/799092517 >> v2:172.21.15.102:3300/0 conn(0x7f46e009b690 0x7f46e006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46dffff640 1 -- 172.21.15.81:0/799092517 >> v1:172.21.15.102:6789/0 conn(0x7f46e006d4c0 legacy=0x7f46e006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:29.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.316+0000 7f46dffff640 1 -- 172.21.15.81:0/799092517 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e00d0a60 con 0x7f46e015e740 2024-09-16T01:21:29.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.317+0000 7f46dffff640 1 --2- 172.21.15.81:0/799092517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e015e740 0x7f46e00d1540 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f46e00691b0 tx=0x7f46d002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b1a68ad9971149 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:29.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.317+0000 7f46deffd640 1 -- 172.21.15.81:0/799092517 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0037070 con 0x7f46e015e740 2024-09-16T01:21:29.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.317+0000 7f46deffd640 1 -- 172.21.15.81:0/799092517 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d0032440 con 0x7f46e015e740 2024-09-16T01:21:29.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.317+0000 7f46deffd640 1 -- 172.21.15.81:0/799092517 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0032810 con 0x7f46e015e740 2024-09-16T01:21:29.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.318+0000 7f46e65e4640 1 -- 172.21.15.81:0/799092517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e015e740 msgr2=0x7f46e00d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.318+0000 7f46e65e4640 1 --2- 172.21.15.81:0/799092517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e015e740 0x7f46e00d1540 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f46e00691b0 tx=0x7f46d002a2c0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.318+0000 7f46e65e4640 1 -- 172.21.15.81:0/799092517 shutdown_connections 2024-09-16T01:21:29.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.318+0000 7f46e65e4640 1 --2- 172.21.15.81:0/799092517 >> v2:172.21.15.102:3300/0 conn(0x7f46e009b690 0x7f46e006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.318+0000 7f46e65e4640 1 --2- 172.21.15.81:0/799092517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e015e740 0x7f46e00d1540 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.318+0000 7f46e65e4640 1 -- 172.21.15.81:0/799092517 >> 172.21.15.81:0/799092517 conn(0x7f46e00d23a0 msgr2=0x7f46e00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:29.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.318+0000 7f46e65e4640 1 -- 172.21.15.81:0/799092517 shutdown_connections 2024-09-16T01:21:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.318+0000 7f46e65e4640 1 -- 172.21.15.81:0/799092517 wait complete. 2024-09-16T01:21:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.319+0000 7f46e65e4640 1 Processor -- start 2024-09-16T01:21:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.319+0000 7f46e65e4640 1 -- start start 2024-09-16T01:21:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46e65e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e006d4c0 0x7f46e0149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46e65e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e009b690 0x7f46e014bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46e65e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e015e740 0x7f46e0148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46e65e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46e009bac0 con 0x7f46e006d4c0 2024-09-16T01:21:29.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46e65e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f46e00d1020 con 0x7f46e009b690 2024-09-16T01:21:29.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46e65e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f46e006dfe0 con 0x7f46e015e740 2024-09-16T01:21:29.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e006d4c0 0x7f46e0149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e006d4c0 0x7f46e0149510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54334/0 (socket says 172.21.15.81:54334) 2024-09-16T01:21:29.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46dffff640 1 -- 172.21.15.81:0/33972651 learned_addr learned my addr 172.21.15.81:0/33972651 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:29.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46df7fe640 1 --2- 172.21.15.81:0/33972651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e009b690 0x7f46e014bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46dffff640 1 -- 172.21.15.81:0/33972651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e015e740 msgr2=0x7f46e0148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46e4b81640 1 --2- 172.21.15.81:0/33972651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e015e740 0x7f46e0148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46dffff640 1 --2- 172.21.15.81:0/33972651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e015e740 0x7f46e0148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46dffff640 1 -- 172.21.15.81:0/33972651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e009b690 msgr2=0x7f46e014bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46dffff640 1 --2- 172.21.15.81:0/33972651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e009b690 0x7f46e014bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46dffff640 1 -- 172.21.15.81:0/33972651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e014c4f0 con 0x7f46e006d4c0 2024-09-16T01:21:29.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46df7fe640 1 --2- 172.21.15.81:0/33972651 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46e009b690 0x7f46e014bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:29.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46e4b81640 1 --2- 172.21.15.81:0/33972651 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46e015e740 0x7f46e0148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:29.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.320+0000 7f46dffff640 1 --2- 172.21.15.81:0/33972651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e006d4c0 0x7f46e0149510 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f46d0000c00 tx=0x7f46d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:29.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.321+0000 7f46dcff9640 1 -- 172.21.15.81:0/33972651 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0041020 con 0x7f46e006d4c0 2024-09-16T01:21:29.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.321+0000 7f46dcff9640 1 -- 172.21.15.81:0/33972651 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d00306c0 con 0x7f46e006d4c0 2024-09-16T01:21:29.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.321+0000 7f46e65e4640 1 -- 172.21.15.81:0/33972651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e00b7990 con 0x7f46e006d4c0 2024-09-16T01:21:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.321+0000 7f46dcff9640 1 -- 172.21.15.81:0/33972651 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0037040 con 0x7f46e006d4c0 2024-09-16T01:21:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.321+0000 7f46e65e4640 1 -- 172.21.15.81:0/33972651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e00b7f20 con 0x7f46e006d4c0 2024-09-16T01:21:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.322+0000 7f46e65e4640 1 -- 172.21.15.81:0/33972651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e006cd20 con 0x7f46e006d4c0 2024-09-16T01:21:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.322+0000 7f46dcff9640 1 -- 172.21.15.81:0/33972651 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f46d0044020 con 0x7f46e006d4c0 2024-09-16T01:21:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.322+0000 7f46dcff9640 1 --2- 172.21.15.81:0/33972651 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46cc06c2b0 0x7f46cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.323+0000 7f46dcff9640 1 -- 172.21.15.81:0/33972651 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f46d00abde0 con 0x7f46e006d4c0 2024-09-16T01:21:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.323+0000 7f46df7fe640 1 --2- 172.21.15.81:0/33972651 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46cc06c2b0 0x7f46cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.323+0000 7f46df7fe640 1 --2- 172.21.15.81:0/33972651 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f46cc06c2b0 0x7f46cc06e770 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f46d4006fd0 tx=0x7f46d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:29.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.327+0000 7f46dcff9640 1 -- 172.21.15.81:0/33972651 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46d004b030 con 0x7f46e006d4c0 2024-09-16T01:21:29.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.527+0000 7f46e65e4640 1 -- 172.21.15.81:0/33972651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f46e00d1cb0 con 0x7f46e006d4c0 2024-09-16T01:21:29.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.527+0000 7f46dcff9640 1 -- 172.21.15.81:0/33972651 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=-1 MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it v46) ==== 316+0+0 (secure 0 0 0) 0x7f46e014c4f0 con 0x7f46e006d4c0 2024-09-16T01:21:29.529 INFO:teuthology.orchestra.run.smithi081.stderr:Error EPERM: MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it 2024-09-16T01:21:29.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:21:29.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs --yes-i-really-mean-it 2024-09-16T01:21:29.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.632+0000 7f9c53549640 1 Processor -- start 2024-09-16T01:21:29.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.632+0000 7f9c53549640 1 -- start start 2024-09-16T01:21:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.633+0000 7f9c53549640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c15c310 0x7f9c4c160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.633+0000 7f9c53549640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4c160e70 con 0x7f9c4c0b4800 2024-09-16T01:21:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.633+0000 7f9c53549640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c4c0af7a0 con 0x7f9c4c0d0370 2024-09-16T01:21:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.633+0000 7f9c53549640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9c4c0afa80 con 0x7f9c4c15c310 2024-09-16T01:21:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.633+0000 7f9c50ae4640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9c4c0b4800 0x7f9c4c0aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42560/0 (socket says 172.21.15.81:42560) 2024-09-16T01:21:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.633+0000 7f9c50ae4640 1 -- 172.21.15.81:0/205672939 learned_addr learned my addr 172.21.15.81:0/205672939 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c512e5640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c15c310 0x7f9c4c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3795575921 0 0) 0x7f9c4c160e70 con 0x7f9c4c0b4800 2024-09-16T01:21:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c38003520 con 0x7f9c4c0b4800 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044852165 0 0) 0x7f9c4c0af7a0 con 0x7f9c4c0d0370 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c4c160e70 con 0x7f9c4c0d0370 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1441565107 0 0) 0x7f9c38003520 con 0x7f9c4c0b4800 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c15c310 msgr2=0x7f9c4c160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c15c310 0x7f9c4c160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 >> v1:172.21.15.102:6789/0 conn(0x7f9c4c0d0370 legacy=0x7f9c4c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4c160130 con 0x7f9c4c0b4800 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f9c3c001670 con 0x7f9c4c0b4800 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c512e5640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c15c310 0x7f9c4c160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 >> v1:172.21.15.81:6789/0 conn(0x7f9c4c0b4800 legacy=0x7f9c4c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c38003b70 0x7f9c38003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c15c310 0x7f9c38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c38004d40 0x7f9c380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c0afa80 con 0x7f9c38004d40 2024-09-16T01:21:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3800ba70 con 0x7f9c38003b70 2024-09-16T01:21:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3800bbf0 con 0x7f9c4c15c310 2024-09-16T01:21:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c51ae6640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c38004d40 0x7f9c380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c512e5640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c38003b70 0x7f9c38003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c50ae4640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c15c310 0x7f9c38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c51ae6640 1 -- 172.21.15.81:0/205672939 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c15c310 msgr2=0x7f9c38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c51ae6640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c15c310 0x7f9c38004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c51ae6640 1 -- 172.21.15.81:0/205672939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c38003b70 msgr2=0x7f9c38003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c51ae6640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c38003b70 0x7f9c38003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.634+0000 7f9c51ae6640 1 -- 172.21.15.81:0/205672939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c38003520 con 0x7f9c38004d40 2024-09-16T01:21:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.635+0000 7f9c51ae6640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c38004d40 0x7f9c380051c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f9c44002000 tx=0x7f9c38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fb0d4aa060b32b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.635+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44001bf0 con 0x7f9c38004d40 2024-09-16T01:21:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.635+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c44003b70 con 0x7f9c38004d40 2024-09-16T01:21:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.635+0000 7f9c43fff640 1 -- 172.21.15.81:0/205672939 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c440050d0 con 0x7f9c38004d40 2024-09-16T01:21:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.636+0000 7f9c53549640 1 -- 172.21.15.81:0/205672939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c38004d40 msgr2=0x7f9c380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.636+0000 7f9c53549640 1 --2- 172.21.15.81:0/205672939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c38004d40 0x7f9c380051c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f9c44002000 tx=0x7f9c38005830 comp rx=0 tx=0).stop 2024-09-16T01:21:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.636+0000 7f9c51ae6640 1 -- 172.21.15.81:0/205672939 reap_dead start 2024-09-16T01:21:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.636+0000 7f9c53549640 1 -- 172.21.15.81:0/205672939 shutdown_connections 2024-09-16T01:21:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.636+0000 7f9c53549640 1 -- 172.21.15.81:0/205672939 >> 172.21.15.81:0/205672939 conn(0x7f9c4c06bdf0 msgr2=0x7f9c4c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.636+0000 7f9c53549640 1 -- 172.21.15.81:0/205672939 shutdown_connections 2024-09-16T01:21:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.636+0000 7f9c53549640 1 -- 172.21.15.81:0/205672939 wait complete. 2024-09-16T01:21:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.637+0000 7f9c53549640 1 Processor -- start 2024-09-16T01:21:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.637+0000 7f9c53549640 1 -- start start 2024-09-16T01:21:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c53549640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c38004d40 0x7f9c4c0c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c53549640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c4c1506a0 0x7f9c4c0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c53549640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c150b00 0x7f9c4c0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c53549640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c160ab0 con 0x7f9c4c1506a0 2024-09-16T01:21:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c53549640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9c4c160930 con 0x7f9c38004d40 2024-09-16T01:21:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c53549640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9c4c160c30 con 0x7f9c4c150b00 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c50ae4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c4c1506a0 0x7f9c4c0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c50ae4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c4c1506a0 0x7f9c4c0c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54356/0 (socket says 172.21.15.81:54356) 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c50ae4640 1 -- 172.21.15.81:0/1683286158 learned_addr learned my addr 172.21.15.81:0/1683286158 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c50ae4640 1 -- 172.21.15.81:0/1683286158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c150b00 msgr2=0x7f9c4c0c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c512e5640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c38004d40 0x7f9c4c0c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c51ae6640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c150b00 0x7f9c4c0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c50ae4640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c150b00 0x7f9c4c0c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c50ae4640 1 -- 172.21.15.81:0/1683286158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c38004d40 msgr2=0x7f9c4c0c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c50ae4640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c38004d40 0x7f9c4c0c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c50ae4640 1 -- 172.21.15.81:0/1683286158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4c0c69d0 con 0x7f9c4c1506a0 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c51ae6640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c150b00 0x7f9c4c0c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c512e5640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c38004d40 0x7f9c4c0c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c50ae4640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c4c1506a0 0x7f9c4c0c5f10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c007340 tx=0x7f9c3c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.638+0000 7f9c41ffb640 1 -- 172.21.15.81:0/1683286158 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00f860 con 0x7f9c4c1506a0 2024-09-16T01:21:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.639+0000 7f9c41ffb640 1 -- 172.21.15.81:0/1683286158 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3c018070 con 0x7f9c4c1506a0 2024-09-16T01:21:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.639+0000 7f9c53549640 1 -- 172.21.15.81:0/1683286158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c4c0c6cb0 con 0x7f9c4c1506a0 2024-09-16T01:21:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.639+0000 7f9c41ffb640 1 -- 172.21.15.81:0/1683286158 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00fc60 con 0x7f9c4c1506a0 2024-09-16T01:21:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.639+0000 7f9c53549640 1 -- 172.21.15.81:0/1683286158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c4c0c7270 con 0x7f9c4c1506a0 2024-09-16T01:21:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.640+0000 7f9c53549640 1 -- 172.21.15.81:0/1683286158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c4c0d0820 con 0x7f9c4c1506a0 2024-09-16T01:21:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.640+0000 7f9c41ffb640 1 -- 172.21.15.81:0/1683286158 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9c3c01d460 con 0x7f9c4c1506a0 2024-09-16T01:21:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.641+0000 7f9c41ffb640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9c3006c2e0 0x7f9c3006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.641+0000 7f9c41ffb640 1 -- 172.21.15.81:0/1683286158 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6217+0+0 (secure 0 0 0) 0x7f9c3c08b630 con 0x7f9c4c1506a0 2024-09-16T01:21:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.641+0000 7f9c512e5640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9c3006c2e0 0x7f9c3006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.641+0000 7f9c512e5640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9c3006c2e0 0x7f9c3006e7a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009ab0 tx=0x7f9c48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:29.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.645+0000 7f9c41ffb640 1 -- 172.21.15.81:0/1683286158 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c3c059ba0 con 0x7f9c4c1506a0 2024-09-16T01:21:29.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.843+0000 7f9c53549640 1 -- 172.21.15.81:0/1683286158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9c4c0cfea0 con 0x7f9c4c1506a0 2024-09-16T01:21:29.845 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-16T01:21:29.844+0000 7f4e951a0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:21:29.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.845+0000 7f9c41ffb640 1 -- 172.21.15.81:0/1683286158 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) ==== 191+0+0 (secure 0 0 0) 0x7f9c3c0594a0 con 0x7f9c4c1506a0 2024-09-16T01:21:29.847 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:21:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.848+0000 7f9c53549640 1 -- 172.21.15.81:0/1683286158 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9c3006c2e0 msgr2=0x7f9c3006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.848+0000 7f9c53549640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9c3006c2e0 0x7f9c3006e7a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009ab0 tx=0x7f9c48008040 comp rx=0 tx=0).stop 2024-09-16T01:21:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.848+0000 7f9c53549640 1 -- 172.21.15.81:0/1683286158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c4c1506a0 msgr2=0x7f9c4c0c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.848+0000 7f9c53549640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c4c1506a0 0x7f9c4c0c5f10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c007340 tx=0x7f9c3c007800 comp rx=0 tx=0).stop 2024-09-16T01:21:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.848+0000 7f9c53549640 1 -- 172.21.15.81:0/1683286158 shutdown_connections 2024-09-16T01:21:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.848+0000 7f9c53549640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9c3006c2e0 0x7f9c3006e7a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.848+0000 7f9c53549640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c4c150b00 0x7f9c4c0c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.848+0000 7f9c53549640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c4c1506a0 0x7f9c4c0c5f10 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.848+0000 7f9c53549640 1 --2- 172.21.15.81:0/1683286158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c38004d40 0x7f9c4c0c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.848+0000 7f9c53549640 1 -- 172.21.15.81:0/1683286158 >> 172.21.15.81:0/1683286158 conn(0x7f9c4c06bdf0 msgr2=0x7f9c4c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.848+0000 7f9c53549640 1 -- 172.21.15.81:0/1683286158 shutdown_connections 2024-09-16T01:21:29.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.848+0000 7f9c53549640 1 -- 172.21.15.81:0/1683286158 wait complete. 2024-09-16T01:21:29.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:21:29.886 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:21:29.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.963+0000 7fb447df1640 1 Processor -- start 2024-09-16T01:21:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.963+0000 7fb447df1640 1 -- start start 2024-09-16T01:21:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb447df1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb440155930 0x7fb4400addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb447df1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb44015b720 0x7fb44015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb447df1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb44015c1e0 con 0x7fb4400d0370 2024-09-16T01:21:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb447df1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb44015c4c0 con 0x7fb440155930 2024-09-16T01:21:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb447df1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb4400b3340 con 0x7fb44015b720 2024-09-16T01:21:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb445b8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb440155930 0x7fb4400addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb445b8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb440155930 0x7fb4400addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54386/0 (socket says 172.21.15.81:54386) 2024-09-16T01:21:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb445b8d640 1 -- 172.21.15.81:0/3343879645 learned_addr learned my addr 172.21.15.81:0/3343879645 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb44538c640 1 --2- 172.21.15.81:0/3343879645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb44015b720 0x7fb44015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb445b8d640 1 -- 172.21.15.81:0/3343879645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb44015b720 msgr2=0x7fb44015bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb445b8d640 1 --2- 172.21.15.81:0/3343879645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb44015b720 0x7fb44015bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb445b8d640 1 -- 172.21.15.81:0/3343879645 >> v1:172.21.15.102:6789/0 conn(0x7fb4400d0370 legacy=0x7fb4400b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.964+0000 7fb445b8d640 1 -- 172.21.15.81:0/3343879645 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4400b3620 con 0x7fb440155930 2024-09-16T01:21:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.965+0000 7fb445b8d640 1 --2- 172.21.15.81:0/3343879645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb440155930 0x7fb4400addd0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb434009870 tx=0x7fb43402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ef74f8f6169579 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.965+0000 7fb444b8b640 1 -- 172.21.15.81:0/3343879645 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434037070 con 0x7fb440155930 2024-09-16T01:21:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.965+0000 7fb444b8b640 1 -- 172.21.15.81:0/3343879645 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb434032440 con 0x7fb440155930 2024-09-16T01:21:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.965+0000 7fb444b8b640 1 -- 172.21.15.81:0/3343879645 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434032810 con 0x7fb440155930 2024-09-16T01:21:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.965+0000 7fb447df1640 1 -- 172.21.15.81:0/3343879645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb440155930 msgr2=0x7fb4400addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.965+0000 7fb447df1640 1 --2- 172.21.15.81:0/3343879645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb440155930 0x7fb4400addd0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fb434009870 tx=0x7fb43402a270 comp rx=0 tx=0).stop 2024-09-16T01:21:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.965+0000 7fb447df1640 1 -- 172.21.15.81:0/3343879645 shutdown_connections 2024-09-16T01:21:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.965+0000 7fb447df1640 1 --2- 172.21.15.81:0/3343879645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb44015b720 0x7fb44015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.965+0000 7fb447df1640 1 --2- 172.21.15.81:0/3343879645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb440155930 0x7fb4400addd0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.965+0000 7fb447df1640 1 -- 172.21.15.81:0/3343879645 >> 172.21.15.81:0/3343879645 conn(0x7fb44006bdf0 msgr2=0x7fb44006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.966+0000 7fb447df1640 1 -- 172.21.15.81:0/3343879645 shutdown_connections 2024-09-16T01:21:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.966+0000 7fb447df1640 1 -- 172.21.15.81:0/3343879645 wait complete. 2024-09-16T01:21:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.967+0000 7fb447df1640 1 Processor -- start 2024-09-16T01:21:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.967+0000 7fb447df1640 1 -- start start 2024-09-16T01:21:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.967+0000 7fb447df1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4400d0370 0x7fb44014b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.967+0000 7fb447df1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb440155930 0x7fb440147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.967+0000 7fb447df1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44015b720 0x7fb440145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.967+0000 7fb447df1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4400ae490 con 0x7fb44015b720 2024-09-16T01:21:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.967+0000 7fb447df1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb4400ae310 con 0x7fb4400d0370 2024-09-16T01:21:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.967+0000 7fb447df1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb4400b4250 con 0x7fb440155930 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.967+0000 7fb44638e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44015b720 0x7fb440145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb44638e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44015b720 0x7fb440145350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54398/0 (socket says 172.21.15.81:54398) 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb44638e640 1 -- 172.21.15.81:0/590176541 learned_addr learned my addr 172.21.15.81:0/590176541 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb44538c640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb440155930 0x7fb440147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb445b8d640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4400d0370 0x7fb44014b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb44638e640 1 -- 172.21.15.81:0/590176541 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb440155930 msgr2=0x7fb440147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb44638e640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb440155930 0x7fb440147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb44638e640 1 -- 172.21.15.81:0/590176541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4400d0370 msgr2=0x7fb44014b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb44638e640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4400d0370 0x7fb44014b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb44638e640 1 -- 172.21.15.81:0/590176541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb440148580 con 0x7fb44015b720 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb445b8d640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4400d0370 0x7fb44014b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb44638e640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44015b720 0x7fb440145350 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c7a0 tx=0x7fb43800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb4327fc640 1 -- 172.21.15.81:0/590176541 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438003b70 con 0x7fb44015b720 2024-09-16T01:21:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb4327fc640 1 -- 172.21.15.81:0/590176541 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb438003d30 con 0x7fb44015b720 2024-09-16T01:21:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb447df1640 1 -- 172.21.15.81:0/590176541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb440148860 con 0x7fb44015b720 2024-09-16T01:21:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb4327fc640 1 -- 172.21.15.81:0/590176541 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43800aa90 con 0x7fb44015b720 2024-09-16T01:21:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.968+0000 7fb447df1640 1 -- 172.21.15.81:0/590176541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb440146e90 con 0x7fb44015b720 2024-09-16T01:21:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.969+0000 7fb447df1640 1 -- 172.21.15.81:0/590176541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4400addd0 con 0x7fb44015b720 2024-09-16T01:21:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.970+0000 7fb4327fc640 1 -- 172.21.15.81:0/590176541 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb43800ac30 con 0x7fb44015b720 2024-09-16T01:21:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.970+0000 7fb4327fc640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb42406c2b0 0x7fb42406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.970+0000 7fb4327fc640 1 -- 172.21.15.81:0/590176541 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7fb43808b540 con 0x7fb44015b720 2024-09-16T01:21:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.970+0000 7fb445b8d640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb42406c2b0 0x7fb42406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.971+0000 7fb445b8d640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb42406c2b0 0x7fb42406e770 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb434034000 tx=0x7fb43402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:29.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:29.974+0000 7fb4327fc640 1 -- 172.21.15.81:0/590176541 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb438059a60 con 0x7fb44015b720 2024-09-16T01:21:30.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.178+0000 7fb447df1640 1 -- 172.21.15.81:0/590176541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb44006ce90 con 0x7fb44015b720 2024-09-16T01:21:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.851+0000 7fb4327fc640 1 -- 172.21.15.81:0/590176541 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) ==== 104+0+0 (secure 0 0 0) 0x7fb438059360 con 0x7fb44015b720 2024-09-16T01:21:30.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.854+0000 7fb447df1640 1 -- 172.21.15.81:0/590176541 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb42406c2b0 msgr2=0x7fb42406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:30.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.854+0000 7fb447df1640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb42406c2b0 0x7fb42406e770 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fb434034000 tx=0x7fb43402e000 comp rx=0 tx=0).stop 2024-09-16T01:21:30.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.854+0000 7fb447df1640 1 -- 172.21.15.81:0/590176541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44015b720 msgr2=0x7fb440145350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:30.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.854+0000 7fb447df1640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44015b720 0x7fb440145350 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fb43800c7a0 tx=0x7fb43800cc60 comp rx=0 tx=0).stop 2024-09-16T01:21:30.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.854+0000 7fb447df1640 1 -- 172.21.15.81:0/590176541 shutdown_connections 2024-09-16T01:21:30.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.854+0000 7fb447df1640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb42406c2b0 0x7fb42406e770 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.854+0000 7fb447df1640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb44015b720 0x7fb440145350 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.854+0000 7fb447df1640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb440155930 0x7fb440147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.854+0000 7fb447df1640 1 --2- 172.21.15.81:0/590176541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb4400d0370 0x7fb44014b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:30.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.854+0000 7fb447df1640 1 -- 172.21.15.81:0/590176541 >> 172.21.15.81:0/590176541 conn(0x7fb44006bdf0 msgr2=0x7fb4400aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:30.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.854+0000 7fb447df1640 1 -- 172.21.15.81:0/590176541 shutdown_connections 2024-09-16T01:21:30.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:30.854+0000 7fb447df1640 1 -- 172.21.15.81:0/590176541 wait complete. 2024-09-16T01:21:30.868 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:21:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.012+0000 7f1208f1a640 1 Processor -- start 2024-09-16T01:21:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.012+0000 7f1208f1a640 1 -- start start 2024-09-16T01:21:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.013+0000 7f1208f1a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120415e410 0x7f12040b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.013+0000 7f1208f1a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12040ae240 con 0x7f12040b40c0 2024-09-16T01:21:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.013+0000 7f1208f1a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12040ae520 con 0x7f120406bc10 2024-09-16T01:21:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.013+0000 7f1208f1a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f12040ae800 con 0x7f120415e410 2024-09-16T01:21:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.013+0000 7f1201d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f12040b40c0 0x7f12040aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42564/0 (socket says 172.21.15.81:42564) 2024-09-16T01:21:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.013+0000 7f1201d9b640 1 -- 172.21.15.81:0/1539290838 learned_addr learned my addr 172.21.15.81:0/1539290838 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.013+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 597756266 0 0) 0x7f12040ae240 con 0x7f12040b40c0 2024-09-16T01:21:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.013+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11ec003520 con 0x7f12040b40c0 2024-09-16T01:21:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.013+0000 7f120259c640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120415e410 0x7f12040b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2390355408 0 0) 0x7f11ec003520 con 0x7f12040b40c0 2024-09-16T01:21:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120415e410 msgr2=0x7f12040b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120415e410 0x7f12040b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 >> v1:172.21.15.102:6789/0 conn(0x7f120406bc10 legacy=0x7f12040aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:31.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12040aeae0 con 0x7f12040b40c0 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f11f8001670 con 0x7f12040b40c0 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120259c640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120415e410 0x7f12040b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 >> v1:172.21.15.81:6789/0 conn(0x7f12040b40c0 legacy=0x7f12040aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ec0039e0 0x7f11ec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec004800 0x7f11ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120415e410 0x7f11ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12040ae800 con 0x7f11ec0039e0 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f11ec0054e0 con 0x7f11ec004800 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f11ec00bf00 con 0x7f120415e410 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120259c640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ec0039e0 0x7f11ec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f1201d9b640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec004800 0x7f11ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f1202d9d640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120415e410 0x7f11ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:31.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120259c640 1 -- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120415e410 msgr2=0x7f11ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:31.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120259c640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f120415e410 0x7f11ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120259c640 1 -- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec004800 msgr2=0x7f11ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:31.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120259c640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec004800 0x7f11ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f120259c640 1 -- 172.21.15.81:0/1539290838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11ec003520 con 0x7f11ec0039e0 2024-09-16T01:21:31.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.014+0000 7f1201d9b640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec004800 0x7f11ec004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:31.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.015+0000 7f120259c640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ec0039e0 0x7f11ec003e00 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f11f40098a0 tx=0x7f11ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb82209fea52af7d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:31.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.015+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f400f040 con 0x7f11ec0039e0 2024-09-16T01:21:31.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.015+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f402ace0 con 0x7f11ec0039e0 2024-09-16T01:21:31.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.015+0000 7f120159a640 1 -- 172.21.15.81:0/1539290838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f4004250 con 0x7f11ec0039e0 2024-09-16T01:21:31.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.015+0000 7f1208f1a640 1 -- 172.21.15.81:0/1539290838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ec0039e0 msgr2=0x7f11ec003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:31.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.015+0000 7f1208f1a640 1 --2- 172.21.15.81:0/1539290838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11ec0039e0 0x7f11ec003e00 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f11f40098a0 tx=0x7f11ec005830 comp rx=0 tx=0).stop 2024-09-16T01:21:31.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.015+0000 7f1202d9d640 1 -- 172.21.15.81:0/1539290838 reap_dead start 2024-09-16T01:21:31.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.015+0000 7f1208f1a640 1 -- 172.21.15.81:0/1539290838 shutdown_connections 2024-09-16T01:21:31.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.015+0000 7f1208f1a640 1 -- 172.21.15.81:0/1539290838 >> 172.21.15.81:0/1539290838 conn(0x7f120409aa30 msgr2=0x7f12040b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:31.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.015+0000 7f1208f1a640 1 -- 172.21.15.81:0/1539290838 shutdown_connections 2024-09-16T01:21:31.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.015+0000 7f1208f1a640 1 -- 172.21.15.81:0/1539290838 wait complete. 2024-09-16T01:21:31.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.017+0000 7f1208f1a640 1 Processor -- start 2024-09-16T01:21:31.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.017+0000 7f1208f1a640 1 -- start start 2024-09-16T01:21:31.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.017+0000 7f1208f1a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec0039e0 0x7f120415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1208f1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12040ca4b0 0x7f120415d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1208f1a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f12041607e0 0x7f12041f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1208f1a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f120415e970 con 0x7f12040ca4b0 2024-09-16T01:21:31.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1208f1a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f120415e7f0 con 0x7f11ec0039e0 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1208f1a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f12040b5fe0 con 0x7f12041607e0 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1201d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12040ca4b0 0x7f120415d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1201d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12040ca4b0 0x7f120415d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36806/0 (socket says 172.21.15.81:36806) 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1201d9b640 1 -- 172.21.15.81:0/3910194252 learned_addr learned my addr 172.21.15.81:0/3910194252 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1202d9d640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f12041607e0 0x7f12041f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f120259c640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec0039e0 0x7f120415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1201d9b640 1 -- 172.21.15.81:0/3910194252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f12041607e0 msgr2=0x7f12041f4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1201d9b640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f12041607e0 0x7f12041f4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1201d9b640 1 -- 172.21.15.81:0/3910194252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec0039e0 msgr2=0x7f120415b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1201d9b640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec0039e0 0x7f120415b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1201d9b640 1 -- 172.21.15.81:0/3910194252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120415c140 con 0x7f12040ca4b0 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1202d9d640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f12041607e0 0x7f12041f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f120259c640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec0039e0 0x7f120415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1201d9b640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12040ca4b0 0x7f120415d1c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f11f800e8c0 tx=0x7f11f800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f11f2ffd640 1 -- 172.21.15.81:0/3910194252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f800c870 con 0x7f12040ca4b0 2024-09-16T01:21:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f11f2ffd640 1 -- 172.21.15.81:0/3910194252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f8018070 con 0x7f12040ca4b0 2024-09-16T01:21:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f11f2ffd640 1 -- 172.21.15.81:0/3910194252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f800cc10 con 0x7f12040ca4b0 2024-09-16T01:21:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1208f1a640 1 -- 172.21.15.81:0/3910194252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120415c420 con 0x7f12040ca4b0 2024-09-16T01:21:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.018+0000 7f1208f1a640 1 -- 172.21.15.81:0/3910194252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f120415c9e0 con 0x7f12040ca4b0 2024-09-16T01:21:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.019+0000 7f1208f1a640 1 -- 172.21.15.81:0/3910194252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f120406c040 con 0x7f12040ca4b0 2024-09-16T01:21:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.020+0000 7f11f2ffd640 1 -- 172.21.15.81:0/3910194252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f11f801d460 con 0x7f12040ca4b0 2024-09-16T01:21:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.020+0000 7f11f2ffd640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f11e406c2b0 0x7f11e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.020+0000 7f120259c640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f11e406c2b0 0x7f11e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.020+0000 7f11f2ffd640 1 -- 172.21.15.81:0/3910194252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6303+0+0 (secure 0 0 0) 0x7f11f808b7e0 con 0x7f12040ca4b0 2024-09-16T01:21:31.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.021+0000 7f120259c640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f11e406c2b0 0x7f11e406e770 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f11f4033000 tx=0x7f11f402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:31.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.025+0000 7f11f2ffd640 1 -- 172.21.15.81:0/3910194252 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11f8059620 con 0x7f12040ca4b0 2024-09-16T01:21:31.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.190+0000 7f1208f1a640 1 -- 172.21.15.81:0/3910194252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f120406f5b0 con 0x7f12040ca4b0 2024-09-16T01:21:31.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.852+0000 7f11f2ffd640 1 -- 172.21.15.81:0/3910194252 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) ==== 181+0+0 (secure 0 0 0) 0x7f11f805d920 con 0x7f12040ca4b0 2024-09-16T01:21:31.854 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:21:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.855+0000 7f1208f1a640 1 -- 172.21.15.81:0/3910194252 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f11e406c2b0 msgr2=0x7f11e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.855+0000 7f1208f1a640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f11e406c2b0 0x7f11e406e770 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f11f4033000 tx=0x7f11f402e000 comp rx=0 tx=0).stop 2024-09-16T01:21:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.855+0000 7f1208f1a640 1 -- 172.21.15.81:0/3910194252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12040ca4b0 msgr2=0x7f120415d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.855+0000 7f1208f1a640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12040ca4b0 0x7f120415d1c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f11f800e8c0 tx=0x7f11f800ed80 comp rx=0 tx=0).stop 2024-09-16T01:21:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.855+0000 7f1208f1a640 1 -- 172.21.15.81:0/3910194252 shutdown_connections 2024-09-16T01:21:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.855+0000 7f1208f1a640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f11e406c2b0 0x7f11e406e770 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.855+0000 7f1208f1a640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f12041607e0 0x7f12041f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.855+0000 7f1208f1a640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12040ca4b0 0x7f120415d1c0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.855+0000 7f1208f1a640 1 --2- 172.21.15.81:0/3910194252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11ec0039e0 0x7f120415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.855+0000 7f1208f1a640 1 -- 172.21.15.81:0/3910194252 >> 172.21.15.81:0/3910194252 conn(0x7f120409aa30 msgr2=0x7f12040afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.855+0000 7f1208f1a640 1 -- 172.21.15.81:0/3910194252 shutdown_connections 2024-09-16T01:21:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.855+0000 7f1208f1a640 1 -- 172.21.15.81:0/3910194252 wait complete. 2024-09-16T01:21:31.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:21:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.979+0000 7fabea70a640 1 Processor -- start 2024-09-16T01:21:31.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.979+0000 7fabea70a640 1 -- start start 2024-09-16T01:21:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.980+0000 7fabea70a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabe415fff0 0x7fabe40d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.980+0000 7fabea70a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabe40d09c0 0x7fabe4070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.980+0000 7fabea70a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabe4160430 con 0x7fabe41621f0 2024-09-16T01:21:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.980+0000 7fabea70a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fabe40702f0 con 0x7fabe415fff0 2024-09-16T01:21:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.980+0000 7fabea70a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fabe40d1040 con 0x7fabe40d09c0 2024-09-16T01:21:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.980+0000 7fabe37fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fabe415fff0 0x7fabe40d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.980+0000 7fabe3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fabe41621f0 0x7fabe41625d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37964/0 (socket says 172.21.15.81:37964) 2024-09-16T01:21:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.980+0000 7fabe3fff640 1 -- 172.21.15.81:0/868272411 learned_addr learned my addr 172.21.15.81:0/868272411 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.981+0000 7fabe8ca7640 1 --2- 172.21.15.81:0/868272411 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabe40d09c0 0x7fabe4070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.981+0000 7fabe37fe640 1 -- 172.21.15.81:0/868272411 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabe40d09c0 msgr2=0x7fabe4070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.981+0000 7fabe37fe640 1 --2- 172.21.15.81:0/868272411 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabe40d09c0 0x7fabe4070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.981+0000 7fabe37fe640 1 -- 172.21.15.81:0/868272411 >> v1:172.21.15.81:6789/0 conn(0x7fabe41621f0 legacy=0x7fabe41625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:31.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.981+0000 7fabe2ffd640 1 -- 172.21.15.81:0/868272411 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4287769555 0 0) 0x7fabe4160430 con 0x7fabe41621f0 2024-09-16T01:21:31.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.981+0000 7fabe37fe640 1 -- 172.21.15.81:0/868272411 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe40d1320 con 0x7fabe415fff0 2024-09-16T01:21:31.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.981+0000 7fabe8ca7640 1 --2- 172.21.15.81:0/868272411 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabe40d09c0 0x7fabe4070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:31.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.981+0000 7fabe37fe640 1 --2- 172.21.15.81:0/868272411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe415fff0 0x7fabe40d0480 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fabd80097a0 tx=0x7fabd802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15aba56a9943a82a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:31.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.982+0000 7fabe2ffd640 1 -- 172.21.15.81:0/868272411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd8037070 con 0x7fabe415fff0 2024-09-16T01:21:31.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.982+0000 7fabe2ffd640 1 -- 172.21.15.81:0/868272411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd8032440 con 0x7fabe415fff0 2024-09-16T01:21:31.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.982+0000 7fabe2ffd640 1 -- 172.21.15.81:0/868272411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd8032810 con 0x7fabe415fff0 2024-09-16T01:21:31.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.982+0000 7fabea70a640 1 -- 172.21.15.81:0/868272411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe415fff0 msgr2=0x7fabe40d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:31.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.982+0000 7fabea70a640 1 --2- 172.21.15.81:0/868272411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe415fff0 0x7fabe40d0480 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fabd80097a0 tx=0x7fabd802a210 comp rx=0 tx=0).stop 2024-09-16T01:21:31.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.982+0000 7fabea70a640 1 -- 172.21.15.81:0/868272411 shutdown_connections 2024-09-16T01:21:31.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.982+0000 7fabea70a640 1 --2- 172.21.15.81:0/868272411 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabe40d09c0 0x7fabe4070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.982+0000 7fabea70a640 1 --2- 172.21.15.81:0/868272411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe415fff0 0x7fabe40d0480 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.982+0000 7fabea70a640 1 -- 172.21.15.81:0/868272411 >> 172.21.15.81:0/868272411 conn(0x7fabe40b3de0 msgr2=0x7fabe40b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:31.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.982+0000 7fabea70a640 1 -- 172.21.15.81:0/868272411 shutdown_connections 2024-09-16T01:21:31.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.982+0000 7fabea70a640 1 -- 172.21.15.81:0/868272411 wait complete. 2024-09-16T01:21:31.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.983+0000 7fabea70a640 1 Processor -- start 2024-09-16T01:21:31.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.984+0000 7fabea70a640 1 -- start start 2024-09-16T01:21:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.984+0000 7fabea70a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe40d09c0 0x7fabe40b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.984+0000 7fabea70a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe415fff0 0x7fabe41567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.984+0000 7fabea70a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabe41621f0 0x7fabe40b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.984+0000 7fabea70a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fabe4163050 con 0x7fabe415fff0 2024-09-16T01:21:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.984+0000 7fabea70a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fabe4162ed0 con 0x7fabe40d09c0 2024-09-16T01:21:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.984+0000 7fabea70a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fabe415f960 con 0x7fabe41621f0 2024-09-16T01:21:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.984+0000 7fabe37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe415fff0 0x7fabe41567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:31.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.984+0000 7fabe37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe415fff0 0x7fabe41567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36820/0 (socket says 172.21.15.81:36820) 2024-09-16T01:21:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.984+0000 7fabe37fe640 1 -- 172.21.15.81:0/2862770476 learned_addr learned my addr 172.21.15.81:0/2862770476 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.985+0000 7fabe37fe640 1 -- 172.21.15.81:0/2862770476 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabe41621f0 msgr2=0x7fabe40b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.985+0000 7fabe37fe640 1 --2- 172.21.15.81:0/2862770476 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabe41621f0 0x7fabe40b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.985+0000 7fabe37fe640 1 -- 172.21.15.81:0/2862770476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe40d09c0 msgr2=0x7fabe40b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.985+0000 7fabe37fe640 1 --2- 172.21.15.81:0/2862770476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe40d09c0 0x7fabe40b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.985+0000 7fabe37fe640 1 -- 172.21.15.81:0/2862770476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe40b56a0 con 0x7fabe415fff0 2024-09-16T01:21:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.985+0000 7fabe37fe640 1 --2- 172.21.15.81:0/2862770476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe415fff0 0x7fabe41567d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fabd80097a0 tx=0x7fabd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.985+0000 7fabe0ff9640 1 -- 172.21.15.81:0/2862770476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd8037050 con 0x7fabe415fff0 2024-09-16T01:21:31.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.985+0000 7fabe0ff9640 1 -- 172.21.15.81:0/2862770476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd8038040 con 0x7fabe415fff0 2024-09-16T01:21:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.985+0000 7fabea70a640 1 -- 172.21.15.81:0/2862770476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabe40b5980 con 0x7fabe415fff0 2024-09-16T01:21:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.985+0000 7fabe0ff9640 1 -- 172.21.15.81:0/2862770476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd8004490 con 0x7fabe415fff0 2024-09-16T01:21:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.985+0000 7fabea70a640 1 -- 172.21.15.81:0/2862770476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe40b5f40 con 0x7fabe415fff0 2024-09-16T01:21:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.986+0000 7fabea70a640 1 -- 172.21.15.81:0/2862770476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabe40d0480 con 0x7fabe415fff0 2024-09-16T01:21:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.986+0000 7fabe0ff9640 1 -- 172.21.15.81:0/2862770476 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fabd8030980 con 0x7fabe415fff0 2024-09-16T01:21:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.987+0000 7fabe0ff9640 1 --2- 172.21.15.81:0/2862770476 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fabd006c2e0 0x7fabd006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.987+0000 7fabe0ff9640 1 -- 172.21.15.81:0/2862770476 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5865+0+0 (secure 0 0 0) 0x7fabd80ac090 con 0x7fabe415fff0 2024-09-16T01:21:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.987+0000 7fabe3fff640 1 --2- 172.21.15.81:0/2862770476 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fabd006c2e0 0x7fabd006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.987+0000 7fabe3fff640 1 --2- 172.21.15.81:0/2862770476 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fabd006c2e0 0x7fabd006e7a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fabd4007fd0 tx=0x7fabd4007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:31.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:31.991+0000 7fabe0ff9640 1 -- 172.21.15.81:0/2862770476 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fabd807a880 con 0x7fabe415fff0 2024-09-16T01:21:32.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.158+0000 7fabea70a640 1 -- 172.21.15.81:0/2862770476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fabe40b4cf0 con 0x7fabe415fff0 2024-09-16T01:21:32.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.859+0000 7fabe0ff9640 1 -- 172.21.15.81:0/2862770476 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) ==== 169+0+0 (secure 0 0 0) 0x7fabd807a180 con 0x7fabe415fff0 2024-09-16T01:21:32.861 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-16T01:21:32.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.861+0000 7fabea70a640 1 -- 172.21.15.81:0/2862770476 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fabd006c2e0 msgr2=0x7fabd006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:32.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.861+0000 7fabea70a640 1 --2- 172.21.15.81:0/2862770476 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fabd006c2e0 0x7fabd006e7a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fabd4007fd0 tx=0x7fabd4007920 comp rx=0 tx=0).stop 2024-09-16T01:21:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.861+0000 7fabea70a640 1 -- 172.21.15.81:0/2862770476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe415fff0 msgr2=0x7fabe41567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.861+0000 7fabea70a640 1 --2- 172.21.15.81:0/2862770476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe415fff0 0x7fabe41567d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fabd80097a0 tx=0x7fabd80046c0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.861+0000 7fabea70a640 1 -- 172.21.15.81:0/2862770476 shutdown_connections 2024-09-16T01:21:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.861+0000 7fabea70a640 1 --2- 172.21.15.81:0/2862770476 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fabd006c2e0 0x7fabd006e7a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.861+0000 7fabea70a640 1 --2- 172.21.15.81:0/2862770476 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fabe41621f0 0x7fabe40b1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.861+0000 7fabea70a640 1 --2- 172.21.15.81:0/2862770476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabe415fff0 0x7fabe41567d0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.861+0000 7fabea70a640 1 --2- 172.21.15.81:0/2862770476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fabe40d09c0 0x7fabe40b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.861+0000 7fabea70a640 1 -- 172.21.15.81:0/2862770476 >> 172.21.15.81:0/2862770476 conn(0x7fabe40b3de0 msgr2=0x7fabe409b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.862+0000 7fabea70a640 1 -- 172.21.15.81:0/2862770476 shutdown_connections 2024-09-16T01:21:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.862+0000 7fabea70a640 1 -- 172.21.15.81:0/2862770476 wait complete. 2024-09-16T01:21:32.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_warning_threshold 2024-09-16T01:21:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.978+0000 7f1376fe4640 1 Processor -- start 2024-09-16T01:21:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.978+0000 7f1376fe4640 1 -- start start 2024-09-16T01:21:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.978+0000 7f1376fe4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13700b1920 0x7f137009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.978+0000 7f1376fe4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1370071160 0x7f13700700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.978+0000 7f1376fe4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13700ce720 con 0x7f137009af70 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.978+0000 7f1376fe4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f13700cea00 con 0x7f1370071160 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.978+0000 7f1376fe4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f13700ccfe0 con 0x7f13700b1920 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.979+0000 7f1375581640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1370071160 0x7f13700700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.979+0000 7f1375581640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1370071160 0x7f13700700c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36822/0 (socket says 172.21.15.81:36822) 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.979+0000 7f1375581640 1 -- 172.21.15.81:0/1377726619 learned_addr learned my addr 172.21.15.81:0/1377726619 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.979+0000 7f1374d80640 1 --2- 172.21.15.81:0/1377726619 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13700b1920 0x7f137009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.979+0000 7f1375581640 1 -- 172.21.15.81:0/1377726619 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13700b1920 msgr2=0x7f137009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.979+0000 7f1375581640 1 --2- 172.21.15.81:0/1377726619 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13700b1920 0x7f137009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.979+0000 7f1375581640 1 -- 172.21.15.81:0/1377726619 >> v1:172.21.15.102:6789/0 conn(0x7f137009af70 legacy=0x7f13700cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.979+0000 7f1375581640 1 -- 172.21.15.81:0/1377726619 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13700cd2c0 con 0x7f1370071160 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.980+0000 7f1375581640 1 --2- 172.21.15.81:0/1377726619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370071160 0x7f13700700c0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f1368009e50 tx=0x7f136802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a43016c611a520c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.980+0000 7f136f7fe640 1 -- 172.21.15.81:0/1377726619 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368036070 con 0x7f1370071160 2024-09-16T01:21:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.980+0000 7f136f7fe640 1 -- 172.21.15.81:0/1377726619 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1368031600 con 0x7f1370071160 2024-09-16T01:21:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.980+0000 7f136f7fe640 1 -- 172.21.15.81:0/1377726619 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13680319d0 con 0x7f1370071160 2024-09-16T01:21:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.980+0000 7f1376fe4640 1 -- 172.21.15.81:0/1377726619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370071160 msgr2=0x7f13700700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.980+0000 7f1376fe4640 1 --2- 172.21.15.81:0/1377726619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370071160 0x7f13700700c0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f1368009e50 tx=0x7f136802a680 comp rx=0 tx=0).stop 2024-09-16T01:21:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.980+0000 7f1376fe4640 1 -- 172.21.15.81:0/1377726619 shutdown_connections 2024-09-16T01:21:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.980+0000 7f1376fe4640 1 --2- 172.21.15.81:0/1377726619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1370071160 0x7f13700700c0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.980+0000 7f1376fe4640 1 --2- 172.21.15.81:0/1377726619 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13700b1920 0x7f137009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.980+0000 7f1376fe4640 1 -- 172.21.15.81:0/1377726619 >> 172.21.15.81:0/1377726619 conn(0x7f13700b3de0 msgr2=0x7f13700b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.980+0000 7f1376fe4640 1 -- 172.21.15.81:0/1377726619 shutdown_connections 2024-09-16T01:21:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.980+0000 7f1376fe4640 1 -- 172.21.15.81:0/1377726619 wait complete. 2024-09-16T01:21:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.981+0000 7f1376fe4640 1 Processor -- start 2024-09-16T01:21:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.981+0000 7f1376fe4640 1 -- start start 2024-09-16T01:21:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.982+0000 7f1376fe4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1370071160 0x7f137009fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.982+0000 7f1376fe4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f137009af70 0x7f13700cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.982+0000 7f1376fe4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13700b1920 0x7f13700cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.982+0000 7f1376fe4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13700d01f0 con 0x7f13700b1920 2024-09-16T01:21:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.982+0000 7f1376fe4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f13700d0070 con 0x7f1370071160 2024-09-16T01:21:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.982+0000 7f1376fe4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f13700cdef0 con 0x7f137009af70 2024-09-16T01:21:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.982+0000 7f1375581640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13700b1920 0x7f13700cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.982+0000 7f1375581640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13700b1920 0x7f13700cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36838/0 (socket says 172.21.15.81:36838) 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.982+0000 7f1375581640 1 -- 172.21.15.81:0/2395596388 learned_addr learned my addr 172.21.15.81:0/2395596388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.982+0000 7f1374d80640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1370071160 0x7f137009fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.982+0000 7f136ffff640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f137009af70 0x7f13700cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.983+0000 7f1375581640 1 -- 172.21.15.81:0/2395596388 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f137009af70 msgr2=0x7f13700cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.983+0000 7f1375581640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f137009af70 0x7f13700cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.983+0000 7f1375581640 1 -- 172.21.15.81:0/2395596388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1370071160 msgr2=0x7f137009fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.983+0000 7f1375581640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1370071160 0x7f137009fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.983+0000 7f1375581640 1 -- 172.21.15.81:0/2395596388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137009cff0 con 0x7f13700b1920 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.983+0000 7f1375581640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13700b1920 0x7f13700cb7d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1368009f70 tx=0x7f1368004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.983+0000 7f136d7fa640 1 -- 172.21.15.81:0/2395596388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136803f020 con 0x7f13700b1920 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.983+0000 7f136d7fa640 1 -- 172.21.15.81:0/2395596388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1368037040 con 0x7f13700b1920 2024-09-16T01:21:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.983+0000 7f1376fe4640 1 -- 172.21.15.81:0/2395596388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137009d2d0 con 0x7f13700b1920 2024-09-16T01:21:32.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.983+0000 7f136d7fa640 1 -- 172.21.15.81:0/2395596388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1368036070 con 0x7f13700b1920 2024-09-16T01:21:32.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.983+0000 7f1376fe4640 1 -- 172.21.15.81:0/2395596388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f137009d890 con 0x7f13700b1920 2024-09-16T01:21:32.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.984+0000 7f1376fe4640 1 -- 172.21.15.81:0/2395596388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1370068de0 con 0x7f13700b1920 2024-09-16T01:21:32.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.985+0000 7f136d7fa640 1 -- 172.21.15.81:0/2395596388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1368042020 con 0x7f13700b1920 2024-09-16T01:21:32.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.985+0000 7f136d7fa640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f135406c2b0 0x7f135406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:32.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.985+0000 7f136d7fa640 1 -- 172.21.15.81:0/2395596388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7f13680ab5d0 con 0x7f13700b1920 2024-09-16T01:21:32.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.985+0000 7f1374d80640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f135406c2b0 0x7f135406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:32.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.985+0000 7f1374d80640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f135406c2b0 0x7f135406e770 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f13640079a0 tx=0x7f1364008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:32.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:32.989+0000 7f136d7fa640 1 -- 172.21.15.81:0/2395596388 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1370068de0 con 0x7f13700b1920 2024-09-16T01:21:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.156+0000 7f1376fe4640 1 -- 172.21.15.81:0/2395596388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"} v 0) -- 0x7f137009aa30 con 0x7f13700b1920 2024-09-16T01:21:33.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.159+0000 7f136d7fa640 1 -- 172.21.15.81:0/2395596388 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"}]=0 v29) ==== 111+0+0 (secure 0 0 0) 0x7f1368049030 con 0x7f13700b1920 2024-09-16T01:21:33.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.162+0000 7f1376fe4640 1 -- 172.21.15.81:0/2395596388 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f135406c2b0 msgr2=0x7f135406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.162+0000 7f1376fe4640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f135406c2b0 0x7f135406e770 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f13640079a0 tx=0x7f1364008040 comp rx=0 tx=0).stop 2024-09-16T01:21:33.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.162+0000 7f1376fe4640 1 -- 172.21.15.81:0/2395596388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13700b1920 msgr2=0x7f13700cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.162+0000 7f1376fe4640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13700b1920 0x7f13700cb7d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f1368009f70 tx=0x7f1368004a40 comp rx=0 tx=0).stop 2024-09-16T01:21:33.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.162+0000 7f1376fe4640 1 -- 172.21.15.81:0/2395596388 shutdown_connections 2024-09-16T01:21:33.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.162+0000 7f1376fe4640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f135406c2b0 0x7f135406e770 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.162+0000 7f1376fe4640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13700b1920 0x7f13700cb7d0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.162+0000 7f1376fe4640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f137009af70 0x7f13700cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.162+0000 7f1376fe4640 1 --2- 172.21.15.81:0/2395596388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1370071160 0x7f137009fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.162+0000 7f1376fe4640 1 -- 172.21.15.81:0/2395596388 >> 172.21.15.81:0/2395596388 conn(0x7f13700b3de0 msgr2=0x7f13700b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:33.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.162+0000 7f1376fe4640 1 -- 172.21.15.81:0/2395596388 shutdown_connections 2024-09-16T01:21:33.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.162+0000 7f1376fe4640 1 -- 172.21.15.81:0/2395596388 wait complete. 2024-09-16T01:21:33.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_memory_limit 2024-09-16T01:21:33.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.280+0000 7f970c791640 1 Processor -- start 2024-09-16T01:21:33.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.280+0000 7f970c791640 1 -- start start 2024-09-16T01:21:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970c791640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9704155930 0x7f97040addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970c791640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f97040d0a80 0x7f970415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970c791640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f970415c1e0 con 0x7f970415b720 2024-09-16T01:21:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970c791640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f970415c4c0 con 0x7f97040d0a80 2024-09-16T01:21:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970c791640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f97040b3340 con 0x7f9704155930 2024-09-16T01:21:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f9709d2c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f970415b720 0x7f97040d0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37974/0 (socket says 172.21.15.81:37974) 2024-09-16T01:21:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f9709d2c640 1 -- 172.21.15.81:0/3579594658 learned_addr learned my addr 172.21.15.81:0/3579594658 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:33.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043232437 0 0) 0x7f970415c1e0 con 0x7f970415b720 2024-09-16T01:21:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96ec005730 con 0x7f970415b720 2024-09-16T01:21:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970a52d640 1 --2- 172.21.15.81:0/3579594658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9704155930 0x7f97040addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970ad2e640 1 --2- 172.21.15.81:0/3579594658 >> v2:172.21.15.102:3300/0 conn(0x7f97040d0a80 0x7f970415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 890885701 0 0) 0x7f96ec005730 con 0x7f970415b720 2024-09-16T01:21:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9704155930 msgr2=0x7f97040addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 --2- 172.21.15.81:0/3579594658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9704155930 0x7f97040addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 >> v2:172.21.15.102:3300/0 conn(0x7f97040d0a80 msgr2=0x7f970415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 --2- 172.21.15.81:0/3579594658 >> v2:172.21.15.102:3300/0 conn(0x7f97040d0a80 0x7f970415bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97040b3620 con 0x7f970415b720 2024-09-16T01:21:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f96f8001670 con 0x7f970415b720 2024-09-16T01:21:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 >> v1:172.21.15.81:6789/0 conn(0x7f970415b720 legacy=0x7f97040d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 --2- 172.21.15.81:0/3579594658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9704155930 0x7f96ec005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 --2- 172.21.15.81:0/3579594658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96ec006140 0x7f96ec006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 --2- 172.21.15.81:0/3579594658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec006f50 0x7f96ec0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f970415c4c0 con 0x7f96ec006f50 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97040b3340 con 0x7f96ec006140 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f96ec00dbd0 con 0x7f9704155930 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.281+0000 7f970ad2e640 1 --2- 172.21.15.81:0/3579594658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec006f50 0x7f96ec0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.282+0000 7f970a52d640 1 --2- 172.21.15.81:0/3579594658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9704155930 0x7f96ec005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.282+0000 7f9709d2c640 1 --2- 172.21.15.81:0/3579594658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96ec006140 0x7f96ec006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.282+0000 7f970ad2e640 1 -- 172.21.15.81:0/3579594658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9704155930 msgr2=0x7f96ec005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.282+0000 7f970ad2e640 1 --2- 172.21.15.81:0/3579594658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9704155930 0x7f96ec005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.282+0000 7f970ad2e640 1 -- 172.21.15.81:0/3579594658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96ec006140 msgr2=0x7f96ec006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.282+0000 7f970ad2e640 1 --2- 172.21.15.81:0/3579594658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96ec006140 0x7f96ec006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.282+0000 7f970ad2e640 1 -- 172.21.15.81:0/3579594658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec005730 con 0x7f96ec006f50 2024-09-16T01:21:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.282+0000 7f970ad2e640 1 --2- 172.21.15.81:0/3579594658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec006f50 0x7f96ec0073d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009f90 tx=0x7f96ec007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c77e81f5697ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.282+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc009c10 con 0x7f96ec006f50 2024-09-16T01:21:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.283+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96fc036070 con 0x7f96ec006f50 2024-09-16T01:21:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.283+0000 7f970952b640 1 -- 172.21.15.81:0/3579594658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc031630 con 0x7f96ec006f50 2024-09-16T01:21:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.283+0000 7f970c791640 1 -- 172.21.15.81:0/3579594658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec006f50 msgr2=0x7f96ec0073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.283+0000 7f970c791640 1 --2- 172.21.15.81:0/3579594658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96ec006f50 0x7f96ec0073d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009f90 tx=0x7f96ec007a40 comp rx=0 tx=0).stop 2024-09-16T01:21:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.283+0000 7f970ad2e640 1 -- 172.21.15.81:0/3579594658 reap_dead start 2024-09-16T01:21:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.283+0000 7f970c791640 1 -- 172.21.15.81:0/3579594658 shutdown_connections 2024-09-16T01:21:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.283+0000 7f970c791640 1 -- 172.21.15.81:0/3579594658 >> 172.21.15.81:0/3579594658 conn(0x7f970406bdf0 msgr2=0x7f970406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.283+0000 7f970c791640 1 -- 172.21.15.81:0/3579594658 shutdown_connections 2024-09-16T01:21:33.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.283+0000 7f970c791640 1 -- 172.21.15.81:0/3579594658 wait complete. 2024-09-16T01:21:33.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.284+0000 7f970c791640 1 Processor -- start 2024-09-16T01:21:33.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.284+0000 7f970c791640 1 -- start start 2024-09-16T01:21:33.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970c791640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96ec006f50 0x7f9704152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970c791640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f970414ea60 0x7f970415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970c791640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97041481a0 0x7f9704148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970c791640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97040adf50 con 0x7f97041481a0 2024-09-16T01:21:33.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970c791640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f97040addd0 con 0x7f970414ea60 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970c791640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f97040ae0d0 con 0x7f96ec006f50 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970ad2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97041481a0 0x7f9704148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970ad2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97041481a0 0x7f9704148620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36850/0 (socket says 172.21.15.81:36850) 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970ad2e640 1 -- 172.21.15.81:0/3428398642 learned_addr learned my addr 172.21.15.81:0/3428398642 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970a52d640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96ec006f50 0x7f9704152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f9709d2c640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f970414ea60 0x7f970415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970ad2e640 1 -- 172.21.15.81:0/3428398642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96ec006f50 msgr2=0x7f9704152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970ad2e640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96ec006f50 0x7f9704152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970ad2e640 1 -- 172.21.15.81:0/3428398642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f970414ea60 msgr2=0x7f970415a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970ad2e640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f970414ea60 0x7f970415a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.285+0000 7f970ad2e640 1 -- 172.21.15.81:0/3428398642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97041f7390 con 0x7f97041481a0 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.286+0000 7f970ad2e640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97041481a0 0x7f9704148620 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009f90 tx=0x7f96fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:33.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.286+0000 7f9702ffd640 1 -- 172.21.15.81:0/3428398642 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc009c10 con 0x7f97041481a0 2024-09-16T01:21:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.286+0000 7f9702ffd640 1 -- 172.21.15.81:0/3428398642 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96fc031dd0 con 0x7f97041481a0 2024-09-16T01:21:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.286+0000 7f970c791640 1 -- 172.21.15.81:0/3428398642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97041f7670 con 0x7f97041481a0 2024-09-16T01:21:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.286+0000 7f9702ffd640 1 -- 172.21.15.81:0/3428398642 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc044670 con 0x7f97041481a0 2024-09-16T01:21:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.286+0000 7f970c791640 1 -- 172.21.15.81:0/3428398642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97041f7c30 con 0x7f97041481a0 2024-09-16T01:21:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.287+0000 7f970c791640 1 -- 172.21.15.81:0/3428398642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97040ae460 con 0x7f97041481a0 2024-09-16T01:21:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.287+0000 7f9702ffd640 1 -- 172.21.15.81:0/3428398642 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f96fc005d10 con 0x7f97041481a0 2024-09-16T01:21:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.288+0000 7f9702ffd640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f96f006c2e0 0x7f96f006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.288+0000 7f970a52d640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f96f006c2e0 0x7f96f006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.288+0000 7f9702ffd640 1 -- 172.21.15.81:0/3428398642 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7f96fc0abee0 con 0x7f97041481a0 2024-09-16T01:21:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.288+0000 7f970a52d640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f96f006c2e0 0x7f96f006e7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009bc0 tx=0x7f96f4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:33.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.292+0000 7f9702ffd640 1 -- 172.21.15.81:0/3428398642 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96fc07a850 con 0x7f97041481a0 2024-09-16T01:21:33.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.457+0000 7f970c791640 1 -- 172.21.15.81:0/3428398642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"} v 0) -- 0x7f97041f7fa0 con 0x7f97041481a0 2024-09-16T01:21:33.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.460+0000 7f9702ffd640 1 -- 172.21.15.81:0/3428398642 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"}]=0 v30) ==== 105+0+0 (secure 0 0 0) 0x7f96fc07a150 con 0x7f97041481a0 2024-09-16T01:21:33.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.462+0000 7f970c791640 1 -- 172.21.15.81:0/3428398642 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f96f006c2e0 msgr2=0x7f96f006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.462+0000 7f970c791640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f96f006c2e0 0x7f96f006e7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009bc0 tx=0x7f96f4009190 comp rx=0 tx=0).stop 2024-09-16T01:21:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.462+0000 7f970c791640 1 -- 172.21.15.81:0/3428398642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97041481a0 msgr2=0x7f9704148620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.462+0000 7f970c791640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97041481a0 0x7f9704148620 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009f90 tx=0x7f96fc009750 comp rx=0 tx=0).stop 2024-09-16T01:21:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.462+0000 7f970c791640 1 -- 172.21.15.81:0/3428398642 shutdown_connections 2024-09-16T01:21:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.462+0000 7f970c791640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f96f006c2e0 0x7f96f006e7a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.462+0000 7f970c791640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97041481a0 0x7f9704148620 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.462+0000 7f970c791640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f970414ea60 0x7f970415a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.462+0000 7f970c791640 1 --2- 172.21.15.81:0/3428398642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96ec006f50 0x7f9704152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.462+0000 7f970c791640 1 -- 172.21.15.81:0/3428398642 >> 172.21.15.81:0/3428398642 conn(0x7f970406bdf0 msgr2=0x7f9704072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.463+0000 7f970c791640 1 -- 172.21.15.81:0/3428398642 shutdown_connections 2024-09-16T01:21:33.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.463+0000 7f970c791640 1 -- 172.21.15.81:0/3428398642 wait complete. 2024-09-16T01:21:33.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-16T01:21:33.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.572+0000 7fede365c640 1 Processor -- start 2024-09-16T01:21:33.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.572+0000 7fede365c640 1 -- start start 2024-09-16T01:21:33.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.573+0000 7fede365c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feddc0722b0 0x7feddc072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.573+0000 7fede365c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feddc0cded0 0x7feddc165ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.573+0000 7fede365c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feddc072bd0 con 0x7feddc0cda90 2024-09-16T01:21:33.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.573+0000 7fede365c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7feddc06f320 con 0x7feddc0cded0 2024-09-16T01:21:33.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.573+0000 7fede365c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feddc06ed60 con 0x7feddc0722b0 2024-09-16T01:21:33.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.573+0000 7fede1bf9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feddc0cded0 0x7feddc165ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.573+0000 7fede0bf7640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feddc0cda90 0x7feddc06e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37982/0 (socket says 172.21.15.81:37982) 2024-09-16T01:21:33.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.573+0000 7fede0bf7640 1 -- 172.21.15.81:0/687619984 learned_addr learned my addr 172.21.15.81:0/687619984 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:33.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.574+0000 7fede1bf9640 1 -- 172.21.15.81:0/687619984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feddc0722b0 msgr2=0x7feddc072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:33.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.574+0000 7fede1bf9640 1 --2- 172.21.15.81:0/687619984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feddc0722b0 0x7feddc072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.574+0000 7fede1bf9640 1 -- 172.21.15.81:0/687619984 >> v1:172.21.15.81:6789/0 conn(0x7feddc0cda90 legacy=0x7feddc06e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.574+0000 7fede1bf9640 1 -- 172.21.15.81:0/687619984 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc06f040 con 0x7feddc0cded0 2024-09-16T01:21:33.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.574+0000 7feddbfff640 1 -- 172.21.15.81:0/687619984 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577940200 0 0) 0x7feddc072bd0 con 0x7feddc0cda90 2024-09-16T01:21:33.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.574+0000 7fede1bf9640 1 --2- 172.21.15.81:0/687619984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feddc0cded0 0x7feddc165ec0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fedd40097a0 tx=0x7fedd402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8ee09a7c3cc0a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:33.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.574+0000 7feddbfff640 1 -- 172.21.15.81:0/687619984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4037070 con 0x7feddc0cded0 2024-09-16T01:21:33.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.574+0000 7feddbfff640 1 -- 172.21.15.81:0/687619984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd402ae50 con 0x7feddc0cded0 2024-09-16T01:21:33.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.574+0000 7feddbfff640 1 -- 172.21.15.81:0/687619984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4032660 con 0x7feddc0cded0 2024-09-16T01:21:33.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.575+0000 7fede365c640 1 -- 172.21.15.81:0/687619984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feddc0cded0 msgr2=0x7feddc165ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.575+0000 7fede365c640 1 --2- 172.21.15.81:0/687619984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feddc0cded0 0x7feddc165ec0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fedd40097a0 tx=0x7fedd402a100 comp rx=0 tx=0).stop 2024-09-16T01:21:33.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.575+0000 7fede365c640 1 -- 172.21.15.81:0/687619984 shutdown_connections 2024-09-16T01:21:33.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.575+0000 7fede365c640 1 --2- 172.21.15.81:0/687619984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feddc0cded0 0x7feddc165ec0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.575+0000 7fede365c640 1 --2- 172.21.15.81:0/687619984 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feddc0722b0 0x7feddc072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.575+0000 7fede365c640 1 -- 172.21.15.81:0/687619984 >> 172.21.15.81:0/687619984 conn(0x7feddc06bc10 msgr2=0x7feddc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:33.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.575+0000 7fede365c640 1 -- 172.21.15.81:0/687619984 shutdown_connections 2024-09-16T01:21:33.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.575+0000 7fede365c640 1 -- 172.21.15.81:0/687619984 wait complete. 2024-09-16T01:21:33.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.576+0000 7fede365c640 1 Processor -- start 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.576+0000 7fede365c640 1 -- start start 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede365c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feddc0722b0 0x7feddc152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede365c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feddc0cda90 0x7feddc156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede365c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feddc0cded0 0x7feddc150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede365c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feddc06ea20 con 0x7feddc0cded0 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede365c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feddc0cd570 con 0x7feddc0cda90 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede365c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feddc073130 con 0x7feddc0722b0 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede1bf9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feddc0cded0 0x7feddc150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede1bf9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feddc0cded0 0x7feddc150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36866/0 (socket says 172.21.15.81:36866) 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede1bf9640 1 -- 172.21.15.81:0/2199950243 learned_addr learned my addr 172.21.15.81:0/2199950243 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede0bf7640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feddc0cda90 0x7feddc156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede13f8640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feddc0722b0 0x7feddc152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede1bf9640 1 -- 172.21.15.81:0/2199950243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feddc0722b0 msgr2=0x7feddc152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede1bf9640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feddc0722b0 0x7feddc152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede1bf9640 1 -- 172.21.15.81:0/2199950243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feddc0cda90 msgr2=0x7feddc156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede1bf9640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feddc0cda90 0x7feddc156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede1bf9640 1 -- 172.21.15.81:0/2199950243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feddc155f10 con 0x7feddc0cded0 2024-09-16T01:21:33.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.577+0000 7fede0bf7640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feddc0cda90 0x7feddc156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:33.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.578+0000 7fede1bf9640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feddc0cded0 0x7feddc150080 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fedd40098c0 tx=0x7fedd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:33.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.578+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2199950243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4042070 con 0x7feddc0cded0 2024-09-16T01:21:33.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.578+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2199950243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd4032e10 con 0x7feddc0cded0 2024-09-16T01:21:33.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.578+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2199950243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedd4037040 con 0x7feddc0cded0 2024-09-16T01:21:33.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.578+0000 7fede365c640 1 -- 172.21.15.81:0/2199950243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feddc1561d0 con 0x7feddc0cded0 2024-09-16T01:21:33.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.578+0000 7fede365c640 1 -- 172.21.15.81:0/2199950243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feddc0b44d0 con 0x7feddc0cded0 2024-09-16T01:21:33.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.579+0000 7fede365c640 1 -- 172.21.15.81:0/2199950243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feddc072690 con 0x7feddc0cded0 2024-09-16T01:21:33.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.579+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2199950243 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fedd4045070 con 0x7feddc0cded0 2024-09-16T01:21:33.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.580+0000 7fedd9ffb640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedc806c2b0 0x7fedc806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.580+0000 7fede13f8640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedc806c2b0 0x7fedc806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.580+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2199950243 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7fedd40ab8e0 con 0x7feddc0cded0 2024-09-16T01:21:33.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.580+0000 7fede13f8640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedc806c2b0 0x7fedc806e770 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7feddc0aefd0 tx=0x7fedcc0094f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:33.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.584+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2199950243 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fedd407a250 con 0x7feddc0cded0 2024-09-16T01:21:33.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.750+0000 7fede365c640 1 -- 172.21.15.81:0/2199950243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7feddc0b46a0 con 0x7feddc0cded0 2024-09-16T01:21:33.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.755+0000 7fedd9ffb640 1 -- 172.21.15.81:0/2199950243 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7fedd4079b50 con 0x7feddc0cded0 2024-09-16T01:21:33.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.757+0000 7fede365c640 1 -- 172.21.15.81:0/2199950243 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedc806c2b0 msgr2=0x7fedc806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.757+0000 7fede365c640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedc806c2b0 0x7fedc806e770 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7feddc0aefd0 tx=0x7fedcc0094f0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.757+0000 7fede365c640 1 -- 172.21.15.81:0/2199950243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feddc0cded0 msgr2=0x7feddc150080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.757+0000 7fede365c640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feddc0cded0 0x7feddc150080 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fedd40098c0 tx=0x7fedd40046c0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.758+0000 7fede365c640 1 -- 172.21.15.81:0/2199950243 shutdown_connections 2024-09-16T01:21:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.758+0000 7fede365c640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedc806c2b0 0x7fedc806e770 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.758+0000 7fede365c640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feddc0cded0 0x7feddc150080 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.758+0000 7fede365c640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feddc0cda90 0x7feddc156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.758+0000 7fede365c640 1 --2- 172.21.15.81:0/2199950243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feddc0722b0 0x7feddc152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.758+0000 7fede365c640 1 -- 172.21.15.81:0/2199950243 >> 172.21.15.81:0/2199950243 conn(0x7feddc06bc10 msgr2=0x7feddc06e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.758+0000 7fede365c640 1 -- 172.21.15.81:0/2199950243 shutdown_connections 2024-09-16T01:21:33.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.758+0000 7fede365c640 1 -- 172.21.15.81:0/2199950243 wait complete. 2024-09-16T01:21:33.770 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_max_caps 2024-09-16T01:21:33.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.869+0000 7fe9f9a65640 1 Processor -- start 2024-09-16T01:21:33.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.869+0000 7fe9f9a65640 1 -- start start 2024-09-16T01:21:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.870+0000 7fe9f9a65640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9f415e640 0x7fe9f40d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.870+0000 7fe9f9a65640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f40d0110 con 0x7fe9f41621b0 2024-09-16T01:21:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.870+0000 7fe9f9a65640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9f40d3a60 con 0x7fe9f40d5100 2024-09-16T01:21:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.870+0000 7fe9f9a65640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f40cec40 con 0x7fe9f415e640 2024-09-16T01:21:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.870+0000 7fe9f3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe9f41621b0 0x7fe9f406ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37984/0 (socket says 172.21.15.81:37984) 2024-09-16T01:21:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.870+0000 7fe9f3fff640 1 -- 172.21.15.81:0/3149274344 learned_addr learned my addr 172.21.15.81:0/3149274344 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578455017 0 0) 0x7fe9f40d0110 con 0x7fe9f41621b0 2024-09-16T01:21:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e0003520 con 0x7fe9f41621b0 2024-09-16T01:21:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f37fe640 1 --2- 172.21.15.81:0/3149274344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9f415e640 0x7fe9f40d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1412949590 0 0) 0x7fe9e0003520 con 0x7fe9f41621b0 2024-09-16T01:21:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9f415e640 msgr2=0x7fe9f40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 --2- 172.21.15.81:0/3149274344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9f415e640 0x7fe9f40d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 >> v1:172.21.15.102:6789/0 conn(0x7fe9f40d5100 legacy=0x7fe9f40cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f40cef20 con 0x7fe9f41621b0 2024-09-16T01:21:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fe9ec0019f0 con 0x7fe9f41621b0 2024-09-16T01:21:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 >> v1:172.21.15.81:6789/0 conn(0x7fe9f41621b0 legacy=0x7fe9f406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 --2- 172.21.15.81:0/3149274344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9f415e640 0x7fe9e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 --2- 172.21.15.81:0/3149274344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9e0003f60 0x7fe9e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 --2- 172.21.15.81:0/3149274344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e0004d40 0x7fe9e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f40cec40 con 0x7fe9e0004d40 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e000bb30 con 0x7fe9e0003f60 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e000bd30 con 0x7fe9f415e640 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f3fff640 1 --2- 172.21.15.81:0/3149274344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e0004d40 0x7fe9e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f37fe640 1 --2- 172.21.15.81:0/3149274344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9f415e640 0x7fe9e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9ebfff640 1 --2- 172.21.15.81:0/3149274344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9e0003f60 0x7fe9e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f3fff640 1 -- 172.21.15.81:0/3149274344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9f415e640 msgr2=0x7fe9e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f3fff640 1 --2- 172.21.15.81:0/3149274344 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9f415e640 0x7fe9e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f3fff640 1 -- 172.21.15.81:0/3149274344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9e0003f60 msgr2=0x7fe9e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f3fff640 1 --2- 172.21.15.81:0/3149274344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9e0003f60 0x7fe9e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.871+0000 7fe9f3fff640 1 -- 172.21.15.81:0/3149274344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e0003520 con 0x7fe9e0004d40 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.872+0000 7fe9f3fff640 1 --2- 172.21.15.81:0/3149274344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e0004d40 0x7fe9e00051c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00a850 tx=0x7fe9e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e5ef71bc01a9de server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.872+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec00a4a0 con 0x7fe9e0004d40 2024-09-16T01:21:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.872+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ec02f070 con 0x7fe9e0004d40 2024-09-16T01:21:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.872+0000 7fe9f2ffd640 1 -- 172.21.15.81:0/3149274344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec02bd20 con 0x7fe9e0004d40 2024-09-16T01:21:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.873+0000 7fe9f9a65640 1 -- 172.21.15.81:0/3149274344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e0004d40 msgr2=0x7fe9e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.873+0000 7fe9f9a65640 1 --2- 172.21.15.81:0/3149274344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e0004d40 0x7fe9e00051c0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec00a850 tx=0x7fe9e0005830 comp rx=0 tx=0).stop 2024-09-16T01:21:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.873+0000 7fe9f3fff640 1 -- 172.21.15.81:0/3149274344 reap_dead start 2024-09-16T01:21:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.873+0000 7fe9f9a65640 1 -- 172.21.15.81:0/3149274344 shutdown_connections 2024-09-16T01:21:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.873+0000 7fe9f9a65640 1 -- 172.21.15.81:0/3149274344 >> 172.21.15.81:0/3149274344 conn(0x7fe9f408bfc0 msgr2=0x7fe9f40d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.873+0000 7fe9f9a65640 1 -- 172.21.15.81:0/3149274344 shutdown_connections 2024-09-16T01:21:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.873+0000 7fe9f9a65640 1 -- 172.21.15.81:0/3149274344 wait complete. 2024-09-16T01:21:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.874+0000 7fe9f9a65640 1 Processor -- start 2024-09-16T01:21:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.874+0000 7fe9f9a65640 1 -- start start 2024-09-16T01:21:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9f9a65640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9e0004d40 0x7fe9f40cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9f9a65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f415ab00 0x7fe9f4157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9f9a65640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9f40cdeb0 0x7fe9f40ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9f9a65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f415ea20 con 0x7fe9f415ab00 2024-09-16T01:21:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9f9a65640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f40cf4e0 con 0x7fe9f40cdeb0 2024-09-16T01:21:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9f9a65640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe9f406d530 con 0x7fe9e0004d40 2024-09-16T01:21:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9ebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f415ab00 0x7fe9f4157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9ebfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f415ab00 0x7fe9f4157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36886/0 (socket says 172.21.15.81:36886) 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9ebfff640 1 -- 172.21.15.81:0/2387692451 learned_addr learned my addr 172.21.15.81:0/2387692451 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9f37fe640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9e0004d40 0x7fe9f40cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9f3fff640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9f40cdeb0 0x7fe9f40ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9ebfff640 1 -- 172.21.15.81:0/2387692451 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9e0004d40 msgr2=0x7fe9f40cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9ebfff640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9e0004d40 0x7fe9f40cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9ebfff640 1 -- 172.21.15.81:0/2387692451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9f40cdeb0 msgr2=0x7fe9f40ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9ebfff640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9f40cdeb0 0x7fe9f40ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9ebfff640 1 -- 172.21.15.81:0/2387692451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f40cc8f0 con 0x7fe9f415ab00 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9f3fff640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9f40cdeb0 0x7fe9f40ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.875+0000 7fe9ebfff640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f415ab00 0x7fe9f4157e40 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00f7f0 tx=0x7fe9dc00fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.876+0000 7fe9f0ff9640 1 -- 172.21.15.81:0/2387692451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0050d0 con 0x7fe9f415ab00 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.876+0000 7fe9f0ff9640 1 -- 172.21.15.81:0/2387692451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9dc018070 con 0x7fe9f415ab00 2024-09-16T01:21:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.876+0000 7fe9f0ff9640 1 -- 172.21.15.81:0/2387692451 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc00d730 con 0x7fe9f415ab00 2024-09-16T01:21:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.876+0000 7fe9f9a65640 1 -- 172.21.15.81:0/2387692451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f40ccbd0 con 0x7fe9f415ab00 2024-09-16T01:21:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.876+0000 7fe9f9a65640 1 -- 172.21.15.81:0/2387692451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f40cd190 con 0x7fe9f415ab00 2024-09-16T01:21:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.877+0000 7fe9f9a65640 1 -- 172.21.15.81:0/2387692451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f4162660 con 0x7fe9f415ab00 2024-09-16T01:21:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.877+0000 7fe9f0ff9640 1 -- 172.21.15.81:0/2387692451 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe9dc00d8d0 con 0x7fe9f415ab00 2024-09-16T01:21:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.877+0000 7fe9f0ff9640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9d406c2e0 0x7fe9d406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.877+0000 7fe9f0ff9640 1 -- 172.21.15.81:0/2387692451 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7fe9dc08afa0 con 0x7fe9f415ab00 2024-09-16T01:21:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.878+0000 7fe9f37fe640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9d406c2e0 0x7fe9d406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.878+0000 7fe9f37fe640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9d406c2e0 0x7fe9d406e7a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009bc0 tx=0x7fe9e4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:33.882+0000 7fe9f0ff9640 1 -- 172.21.15.81:0/2387692451 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9dc059910 con 0x7fe9f415ab00 2024-09-16T01:21:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.047+0000 7fe9f9a65640 1 -- 172.21.15.81:0/2387692451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"} v 0) -- 0x7fe9f408c4d0 con 0x7fe9f415ab00 2024-09-16T01:21:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.052+0000 7fe9f0ff9640 1 -- 172.21.15.81:0/2387692451 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"}]=0 v32) ==== 102+0+0 (secure 0 0 0) 0x7fe9dc059210 con 0x7fe9f415ab00 2024-09-16T01:21:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.054+0000 7fe9f9a65640 1 -- 172.21.15.81:0/2387692451 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9d406c2e0 msgr2=0x7fe9d406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.054+0000 7fe9f9a65640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9d406c2e0 0x7fe9d406e7a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009bc0 tx=0x7fe9e4009190 comp rx=0 tx=0).stop 2024-09-16T01:21:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.054+0000 7fe9f9a65640 1 -- 172.21.15.81:0/2387692451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f415ab00 msgr2=0x7fe9f4157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.054+0000 7fe9f9a65640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f415ab00 0x7fe9f4157e40 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00f7f0 tx=0x7fe9dc00fbf0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.054+0000 7fe9f9a65640 1 -- 172.21.15.81:0/2387692451 shutdown_connections 2024-09-16T01:21:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.054+0000 7fe9f9a65640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9d406c2e0 0x7fe9d406e7a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.054+0000 7fe9f9a65640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9f40cdeb0 0x7fe9f40ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.054+0000 7fe9f9a65640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9f415ab00 0x7fe9f4157e40 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.054+0000 7fe9f9a65640 1 --2- 172.21.15.81:0/2387692451 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9e0004d40 0x7fe9f40cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.054+0000 7fe9f9a65640 1 -- 172.21.15.81:0/2387692451 >> 172.21.15.81:0/2387692451 conn(0x7fe9f408bfc0 msgr2=0x7fe9f40b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.054+0000 7fe9f9a65640 1 -- 172.21.15.81:0/2387692451 shutdown_connections 2024-09-16T01:21:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.054+0000 7fe9f9a65640 1 -- 172.21.15.81:0/2387692451 wait complete. 2024-09-16T01:21:34.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_min_caps_working_set 2024-09-16T01:21:34.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.166+0000 7f9dd3766640 1 Processor -- start 2024-09-16T01:21:34.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.166+0000 7f9dd3766640 1 -- start start 2024-09-16T01:21:34.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.167+0000 7f9dd3766640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9dcc15b720 0x7f9dcc15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.167+0000 7f9dd3766640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9dcc0d0370 0x7f9dcc0d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.167+0000 7f9dd3766640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dcc0ae4e0 con 0x7f9dcc155930 2024-09-16T01:21:34.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.167+0000 7f9dd3766640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9dcc0d0c90 con 0x7f9dcc15b720 2024-09-16T01:21:34.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.167+0000 7f9dd3766640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9dcc15c1e0 con 0x7f9dcc0d0370 2024-09-16T01:21:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.167+0000 7f9dd0d01640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9dcc15b720 0x7f9dcc15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.167+0000 7f9dd1502640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9dcc155930 0x7f9dcc0addd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37992/0 (socket says 172.21.15.81:37992) 2024-09-16T01:21:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.167+0000 7f9dd1502640 1 -- 172.21.15.81:0/1435339640 learned_addr learned my addr 172.21.15.81:0/1435339640 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.168+0000 7f9dd0d01640 1 -- 172.21.15.81:0/1435339640 >> v2:172.21.15.102:3300/0 conn(0x7f9dcc0d0370 msgr2=0x7f9dcc0d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.168+0000 7f9dd0d01640 1 --2- 172.21.15.81:0/1435339640 >> v2:172.21.15.102:3300/0 conn(0x7f9dcc0d0370 0x7f9dcc0d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.168+0000 7f9dd0d01640 1 -- 172.21.15.81:0/1435339640 >> v1:172.21.15.81:6789/0 conn(0x7f9dcc155930 legacy=0x7f9dcc0addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.168+0000 7f9dc3fff640 1 -- 172.21.15.81:0/1435339640 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059247465 0 0) 0x7f9dc8001490 con 0x7f9dcc155930 2024-09-16T01:21:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.168+0000 7f9dd0d01640 1 -- 172.21.15.81:0/1435339640 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc15c4c0 con 0x7f9dcc15b720 2024-09-16T01:21:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.168+0000 7f9dd0d01640 1 --2- 172.21.15.81:0/1435339640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dcc15b720 0x7f9dcc15bbb0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0d0f30 tx=0x7f9dbc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24aa29f6aca9eda9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.168+0000 7f9dc3fff640 1 -- 172.21.15.81:0/1435339640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc037070 con 0x7f9dcc15b720 2024-09-16T01:21:34.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.169+0000 7f9dc3fff640 1 -- 172.21.15.81:0/1435339640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dbc032440 con 0x7f9dcc15b720 2024-09-16T01:21:34.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.169+0000 7f9dc3fff640 1 -- 172.21.15.81:0/1435339640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc032810 con 0x7f9dcc15b720 2024-09-16T01:21:34.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.169+0000 7f9dd3766640 1 -- 172.21.15.81:0/1435339640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dcc15b720 msgr2=0x7f9dcc15bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.169+0000 7f9dd3766640 1 --2- 172.21.15.81:0/1435339640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dcc15b720 0x7f9dcc15bbb0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0d0f30 tx=0x7f9dbc02a1a0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.169+0000 7f9dd3766640 1 -- 172.21.15.81:0/1435339640 shutdown_connections 2024-09-16T01:21:34.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.169+0000 7f9dd3766640 1 --2- 172.21.15.81:0/1435339640 >> v2:172.21.15.102:3300/0 conn(0x7f9dcc0d0370 0x7f9dcc0d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.169+0000 7f9dd3766640 1 --2- 172.21.15.81:0/1435339640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dcc15b720 0x7f9dcc15bbb0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.169+0000 7f9dd3766640 1 -- 172.21.15.81:0/1435339640 >> 172.21.15.81:0/1435339640 conn(0x7f9dcc06bdf0 msgr2=0x7f9dcc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:34.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.169+0000 7f9dd3766640 1 -- 172.21.15.81:0/1435339640 shutdown_connections 2024-09-16T01:21:34.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.169+0000 7f9dd3766640 1 -- 172.21.15.81:0/1435339640 wait complete. 2024-09-16T01:21:34.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.170+0000 7f9dd3766640 1 Processor -- start 2024-09-16T01:21:34.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.170+0000 7f9dd3766640 1 -- start start 2024-09-16T01:21:34.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd3766640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dcc0d0370 0x7f9dcc153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd3766640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dcc155930 0x7f9dcc1e39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd3766640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dcc15b720 0x7f9dcc147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd3766640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc06f8b0 con 0x7f9dcc155930 2024-09-16T01:21:34.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd3766640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc0b3620 con 0x7f9dcc15b720 2024-09-16T01:21:34.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd3766640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9dcc06fa30 con 0x7f9dcc0d0370 2024-09-16T01:21:34.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd0d01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dcc155930 0x7f9dcc1e39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd0d01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dcc155930 0x7f9dcc1e39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36910/0 (socket says 172.21.15.81:36910) 2024-09-16T01:21:34.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd0d01640 1 -- 172.21.15.81:0/909040838 learned_addr learned my addr 172.21.15.81:0/909040838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:34.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd1502640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dcc0d0370 0x7f9dcc153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd1d03640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dcc15b720 0x7f9dcc147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd0d01640 1 -- 172.21.15.81:0/909040838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dcc0d0370 msgr2=0x7f9dcc153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd0d01640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dcc0d0370 0x7f9dcc153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd0d01640 1 -- 172.21.15.81:0/909040838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dcc15b720 msgr2=0x7f9dcc147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd0d01640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dcc15b720 0x7f9dcc147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.171+0000 7f9dd0d01640 1 -- 172.21.15.81:0/909040838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc1e5240 con 0x7f9dcc155930 2024-09-16T01:21:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.172+0000 7f9dd0d01640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dcc155930 0x7f9dcc1e39b0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc000c00 tx=0x7f9dbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.172+0000 7f9dc1ffb640 1 -- 172.21.15.81:0/909040838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc041070 con 0x7f9dcc155930 2024-09-16T01:21:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.172+0000 7f9dc1ffb640 1 -- 172.21.15.81:0/909040838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dbc03c950 con 0x7f9dcc155930 2024-09-16T01:21:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.172+0000 7f9dd3766640 1 -- 172.21.15.81:0/909040838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc09c890 con 0x7f9dcc155930 2024-09-16T01:21:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.172+0000 7f9dc1ffb640 1 -- 172.21.15.81:0/909040838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc037040 con 0x7f9dcc155930 2024-09-16T01:21:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.172+0000 7f9dd3766640 1 -- 172.21.15.81:0/909040838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc09ce50 con 0x7f9dcc155930 2024-09-16T01:21:34.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.173+0000 7f9dd3766640 1 -- 172.21.15.81:0/909040838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dcc0d0750 con 0x7f9dcc155930 2024-09-16T01:21:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.173+0000 7f9dc1ffb640 1 -- 172.21.15.81:0/909040838 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9dbc044070 con 0x7f9dcc155930 2024-09-16T01:21:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.174+0000 7f9dc1ffb640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9db006c2b0 0x7f9db006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.174+0000 7f9dc1ffb640 1 -- 172.21.15.81:0/909040838 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7f9dbc0ac100 con 0x7f9dcc155930 2024-09-16T01:21:34.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.174+0000 7f9dd1502640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9db006c2b0 0x7f9db006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.174+0000 7f9dd1502640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9db006c2b0 0x7f9db006e770 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80012e0 tx=0x7f9dc8007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:34.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.178+0000 7f9dc1ffb640 1 -- 172.21.15.81:0/909040838 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9dbc07ab00 con 0x7f9dcc155930 2024-09-16T01:21:34.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.343+0000 7f9dd3766640 1 -- 172.21.15.81:0/909040838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"} v 0) -- 0x7f9dcc154d00 con 0x7f9dcc155930 2024-09-16T01:21:34.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.348+0000 7f9dc1ffb640 1 -- 172.21.15.81:0/909040838 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"}]=0 v33) ==== 107+0+0 (secure 0 0 0) 0x7f9dbc07a400 con 0x7f9dcc155930 2024-09-16T01:21:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.351+0000 7f9dd3766640 1 -- 172.21.15.81:0/909040838 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9db006c2b0 msgr2=0x7f9db006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.351+0000 7f9dd3766640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9db006c2b0 0x7f9db006e770 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80012e0 tx=0x7f9dc8007cf0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.351+0000 7f9dd3766640 1 -- 172.21.15.81:0/909040838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dcc155930 msgr2=0x7f9dcc1e39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.351+0000 7f9dd3766640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dcc155930 0x7f9dcc1e39b0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc000c00 tx=0x7f9dbc0046c0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.351+0000 7f9dd3766640 1 -- 172.21.15.81:0/909040838 shutdown_connections 2024-09-16T01:21:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.351+0000 7f9dd3766640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9db006c2b0 0x7f9db006e770 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.351+0000 7f9dd3766640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dcc15b720 0x7f9dcc147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.351+0000 7f9dd3766640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dcc155930 0x7f9dcc1e39b0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.351+0000 7f9dd3766640 1 --2- 172.21.15.81:0/909040838 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dcc0d0370 0x7f9dcc153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.351+0000 7f9dd3766640 1 -- 172.21.15.81:0/909040838 >> 172.21.15.81:0/909040838 conn(0x7f9dcc06bdf0 msgr2=0x7f9dcc06c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.351+0000 7f9dd3766640 1 -- 172.21.15.81:0/909040838 shutdown_connections 2024-09-16T01:21:34.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.351+0000 7f9dd3766640 1 -- 172.21.15.81:0/909040838 wait complete. 2024-09-16T01:21:34.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set' 2024-09-16T01:21:34.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.461+0000 7fa117453640 1 Processor -- start 2024-09-16T01:21:34.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.461+0000 7fa117453640 1 -- start start 2024-09-16T01:21:34.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.462+0000 7fa117453640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa11015e5f0 0x7fa1100d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.462+0000 7fa117453640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa1100d30f0 0x7fa1100b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.462+0000 7fa117453640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1100d3690 con 0x7fa1100b64c0 2024-09-16T01:21:34.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.462+0000 7fa117453640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa11006d530 con 0x7fa11015e5f0 2024-09-16T01:21:34.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.462+0000 7fa117453640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa1100d3970 con 0x7fa1100d30f0 2024-09-16T01:21:34.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.462+0000 7fa1151ef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa11015e5f0 0x7fa1100d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.462+0000 7fa1151ef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa11015e5f0 0x7fa1100d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36914/0 (socket says 172.21.15.81:36914) 2024-09-16T01:21:34.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.462+0000 7fa1151ef640 1 -- 172.21.15.81:0/2841243425 learned_addr learned my addr 172.21.15.81:0/2841243425 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:34.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.463+0000 7fa1151ef640 1 -- 172.21.15.81:0/2841243425 >> v2:172.21.15.102:3300/0 conn(0x7fa1100d30f0 msgr2=0x7fa1100b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:34.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.463+0000 7fa1151ef640 1 --2- 172.21.15.81:0/2841243425 >> v2:172.21.15.102:3300/0 conn(0x7fa1100d30f0 0x7fa1100b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.463+0000 7fa1151ef640 1 -- 172.21.15.81:0/2841243425 >> v1:172.21.15.102:6789/0 conn(0x7fa1100b64c0 legacy=0x7fa1100cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:34.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.463+0000 7fa1151ef640 1 -- 172.21.15.81:0/2841243425 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11006cee0 con 0x7fa11015e5f0 2024-09-16T01:21:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.463+0000 7fa1151ef640 1 --2- 172.21.15.81:0/2841243425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa11015e5f0 0x7fa1100d4dd0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fa11008e520 tx=0x7fa10c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf696039a0de411 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.463+0000 7fa107fff640 1 -- 172.21.15.81:0/2841243425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c037070 con 0x7fa11015e5f0 2024-09-16T01:21:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.463+0000 7fa107fff640 1 -- 172.21.15.81:0/2841243425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c032440 con 0x7fa11015e5f0 2024-09-16T01:21:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.464+0000 7fa107fff640 1 -- 172.21.15.81:0/2841243425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c032810 con 0x7fa11015e5f0 2024-09-16T01:21:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.464+0000 7fa117453640 1 -- 172.21.15.81:0/2841243425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa11015e5f0 msgr2=0x7fa1100d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.464+0000 7fa117453640 1 --2- 172.21.15.81:0/2841243425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa11015e5f0 0x7fa1100d4dd0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fa11008e520 tx=0x7fa10c02a230 comp rx=0 tx=0).stop 2024-09-16T01:21:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.464+0000 7fa117453640 1 -- 172.21.15.81:0/2841243425 shutdown_connections 2024-09-16T01:21:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.464+0000 7fa117453640 1 --2- 172.21.15.81:0/2841243425 >> v2:172.21.15.102:3300/0 conn(0x7fa1100d30f0 0x7fa1100b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.464+0000 7fa117453640 1 --2- 172.21.15.81:0/2841243425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa11015e5f0 0x7fa1100d4dd0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.464+0000 7fa117453640 1 -- 172.21.15.81:0/2841243425 >> 172.21.15.81:0/2841243425 conn(0x7fa11008bfc0 msgr2=0x7fa1100d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.464+0000 7fa117453640 1 -- 172.21.15.81:0/2841243425 shutdown_connections 2024-09-16T01:21:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.464+0000 7fa117453640 1 -- 172.21.15.81:0/2841243425 wait complete. 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.465+0000 7fa117453640 1 Processor -- start 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.465+0000 7fa117453640 1 -- start start 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.466+0000 7fa117453640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1100b64c0 0x7fa1100c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.466+0000 7fa117453640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1100d30f0 0x7fa1100b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.466+0000 7fa117453640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa11015e5f0 0x7fa1100b9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.466+0000 7fa117453640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa1100d5310 con 0x7fa1100d30f0 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.466+0000 7fa117453640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa11015e9d0 con 0x7fa1100b64c0 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.466+0000 7fa117453640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa11006e9d0 con 0x7fa11015e5f0 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.466+0000 7fa1149ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1100d30f0 0x7fa1100b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.466+0000 7fa1149ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1100d30f0 0x7fa1100b83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36922/0 (socket says 172.21.15.81:36922) 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.466+0000 7fa1149ee640 1 -- 172.21.15.81:0/616768778 learned_addr learned my addr 172.21.15.81:0/616768778 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.466+0000 7fa1151ef640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1100b64c0 0x7fa1100c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.466+0000 7fa1159f0640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa11015e5f0 0x7fa1100b9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.467+0000 7fa1149ee640 1 -- 172.21.15.81:0/616768778 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa11015e5f0 msgr2=0x7fa1100b9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.467+0000 7fa1149ee640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa11015e5f0 0x7fa1100b9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.467+0000 7fa1149ee640 1 -- 172.21.15.81:0/616768778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1100b64c0 msgr2=0x7fa1100c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.467+0000 7fa1149ee640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1100b64c0 0x7fa1100c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.467+0000 7fa1149ee640 1 -- 172.21.15.81:0/616768778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1100c9be0 con 0x7fa1100d30f0 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.467+0000 7fa1159f0640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa11015e5f0 0x7fa1100b9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.467+0000 7fa1149ee640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1100d30f0 0x7fa1100b83d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fa10000b4d0 tx=0x7fa10000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.467+0000 7fa105ffb640 1 -- 172.21.15.81:0/616768778 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100014070 con 0x7fa1100d30f0 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.467+0000 7fa105ffb640 1 -- 172.21.15.81:0/616768778 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa100010870 con 0x7fa1100d30f0 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.467+0000 7fa117453640 1 -- 172.21.15.81:0/616768778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1100cad00 con 0x7fa1100d30f0 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.467+0000 7fa105ffb640 1 -- 172.21.15.81:0/616768778 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100010c60 con 0x7fa1100d30f0 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.467+0000 7fa117453640 1 -- 172.21.15.81:0/616768778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1100c8ec0 con 0x7fa1100d30f0 2024-09-16T01:21:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.468+0000 7fa117453640 1 -- 172.21.15.81:0/616768778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1100b5f80 con 0x7fa1100d30f0 2024-09-16T01:21:34.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.469+0000 7fa105ffb640 1 -- 172.21.15.81:0/616768778 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa100017070 con 0x7fa1100d30f0 2024-09-16T01:21:34.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.469+0000 7fa105ffb640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa0f406c2b0 0x7fa0f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.469+0000 7fa1151ef640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa0f406c2b0 0x7fa0f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.469+0000 7fa105ffb640 1 -- 172.21.15.81:0/616768778 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7fa10008b080 con 0x7fa1100d30f0 2024-09-16T01:21:34.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.470+0000 7fa1151ef640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa0f406c2b0 0x7fa0f406e770 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa10c034000 tx=0x7fa10c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:34.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.473+0000 7fa105ffb640 1 -- 172.21.15.81:0/616768778 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa100059960 con 0x7fa1100d30f0 2024-09-16T01:21:34.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.701+0000 7fa117453640 1 -- 172.21.15.81:0/616768778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]} v 0) -- 0x7fa1100d2c50 con 0x7fa1100d30f0 2024-09-16T01:21:34.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.862+0000 7fa105ffb640 1 -- 172.21.15.81:0/616768778 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]}]=0 v292) ==== 160+0+0 (secure 0 0 0) 0x7fa100059260 con 0x7fa1100d30f0 2024-09-16T01:21:34.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.864+0000 7fa117453640 1 -- 172.21.15.81:0/616768778 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa0f406c2b0 msgr2=0x7fa0f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.864+0000 7fa117453640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa0f406c2b0 0x7fa0f406e770 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa10c034000 tx=0x7fa10c02e000 comp rx=0 tx=0).stop 2024-09-16T01:21:34.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.864+0000 7fa117453640 1 -- 172.21.15.81:0/616768778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1100d30f0 msgr2=0x7fa1100b83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.864+0000 7fa117453640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1100d30f0 0x7fa1100b83d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fa10000b4d0 tx=0x7fa10000b990 comp rx=0 tx=0).stop 2024-09-16T01:21:34.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.864+0000 7fa117453640 1 -- 172.21.15.81:0/616768778 shutdown_connections 2024-09-16T01:21:34.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.864+0000 7fa117453640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa0f406c2b0 0x7fa0f406e770 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.864+0000 7fa117453640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa11015e5f0 0x7fa1100b9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.864+0000 7fa117453640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1100d30f0 0x7fa1100b83d0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.864+0000 7fa117453640 1 --2- 172.21.15.81:0/616768778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1100b64c0 0x7fa1100c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.864+0000 7fa117453640 1 -- 172.21.15.81:0/616768778 >> 172.21.15.81:0/616768778 conn(0x7fa11008bfc0 msgr2=0x7fa1100b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:34.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.864+0000 7fa117453640 1 -- 172.21.15.81:0/616768778 shutdown_connections 2024-09-16T01:21:34.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.864+0000 7fa117453640 1 -- 172.21.15.81:0/616768778 wait complete. 2024-09-16T01:21:34.877 INFO:tasks.cephfs_test_runner:When a client has inodes pinned in its cache (open files), that the MDS ... ok 2024-09-16T01:21:34.877 INFO:tasks.cephfs_test_runner:Starting test: test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) When a client does not advance its oldest tid, the MDS should notice that 2024-09-16T01:21:34.877 INFO:tasks.cephfs_test_runner:test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-16T01:21:34.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:21:34.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.975+0000 7fdfcfb13640 1 Processor -- start 2024-09-16T01:21:34.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.975+0000 7fdfcfb13640 1 -- start start 2024-09-16T01:21:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.976+0000 7fdfcfb13640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdfc80d04a0 0x7fdfc80d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.976+0000 7fdfcfb13640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc80ae550 0x7fdfc80ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.976+0000 7fdfcfb13640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc806cb30 con 0x7fdfc8147360 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.976+0000 7fdfcfb13640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fdfc80d0e50 con 0x7fdfc80d04a0 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.976+0000 7fdfcfb13640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc806bfb0 con 0x7fdfc80ae550 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.976+0000 7fdfcd8af640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdfc8147360 0x7fdfc8070890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38006/0 (socket says 172.21.15.81:38006) 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.976+0000 7fdfcd8af640 1 -- 172.21.15.81:0/808942854 learned_addr learned my addr 172.21.15.81:0/808942854 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.976+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211553222 0 0) 0x7fdfc806cb30 con 0x7fdfc8147360 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.976+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfb4003520 con 0x7fdfc8147360 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.976+0000 7fdfcd0ae640 1 --2- 172.21.15.81:0/808942854 >> v2:172.21.15.102:3300/0 conn(0x7fdfc80d04a0 0x7fdfc80d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.976+0000 7fdfce0b0640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc80ae550 0x7fdfc80ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 488365696 0 0) 0x7fdfb4003520 con 0x7fdfc8147360 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc80ae550 msgr2=0x7fdfc80ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc80ae550 0x7fdfc80ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 >> v2:172.21.15.102:3300/0 conn(0x7fdfc80d04a0 msgr2=0x7fdfc80d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 --2- 172.21.15.81:0/808942854 >> v2:172.21.15.102:3300/0 conn(0x7fdfc80d04a0 0x7fdfc80d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc806c290 con 0x7fdfc8147360 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fdfc4001670 con 0x7fdfc8147360 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfce0b0640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc80ae550 0x7fdfc80ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 >> v1:172.21.15.81:6789/0 conn(0x7fdfc8147360 legacy=0x7fdfc8070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb40039b0 0x7fdfb4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfb4004800 0x7fdfb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc80ae550 0x7fdfb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc80d0e50 con 0x7fdfb40039b0 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc806bfb0 con 0x7fdfb4004800 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb400ba70 con 0x7fdfc80ae550 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcd8af640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb40039b0 0x7fdfb4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcd0ae640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfb4004800 0x7fdfb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfce0b0640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc80ae550 0x7fdfb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcd8af640 1 -- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc80ae550 msgr2=0x7fdfb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcd8af640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc80ae550 0x7fdfb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcd8af640 1 -- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfb4004800 msgr2=0x7fdfb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcd8af640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfb4004800 0x7fdfb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcd8af640 1 -- 172.21.15.81:0/808942854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb4003520 con 0x7fdfb40039b0 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.977+0000 7fdfcd0ae640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfb4004800 0x7fdfb4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.978+0000 7fdfcd8af640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb40039b0 0x7fdfb4003dd0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fdfc400c210 tx=0x7fdfb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b167762db96434d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.978+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4007d50 con 0x7fdfb40039b0 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.978+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc4005af0 con 0x7fdfb40039b0 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.978+0000 7fdfcc8ad640 1 -- 172.21.15.81:0/808942854 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4007070 con 0x7fdfb40039b0 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.978+0000 7fdfcfb13640 1 -- 172.21.15.81:0/808942854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb40039b0 msgr2=0x7fdfb4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.978+0000 7fdfcfb13640 1 --2- 172.21.15.81:0/808942854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb40039b0 0x7fdfb4003dd0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fdfc400c210 tx=0x7fdfb4005830 comp rx=0 tx=0).stop 2024-09-16T01:21:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.978+0000 7fdfce0b0640 1 -- 172.21.15.81:0/808942854 reap_dead start 2024-09-16T01:21:34.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.978+0000 7fdfcfb13640 1 -- 172.21.15.81:0/808942854 shutdown_connections 2024-09-16T01:21:34.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.978+0000 7fdfcfb13640 1 -- 172.21.15.81:0/808942854 >> 172.21.15.81:0/808942854 conn(0x7fdfc80b2f40 msgr2=0x7fdfc80b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:34.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.979+0000 7fdfcfb13640 1 -- 172.21.15.81:0/808942854 shutdown_connections 2024-09-16T01:21:34.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.979+0000 7fdfcfb13640 1 -- 172.21.15.81:0/808942854 wait complete. 2024-09-16T01:21:34.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.980+0000 7fdfcfb13640 1 Processor -- start 2024-09-16T01:21:34.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.980+0000 7fdfcfb13640 1 -- start start 2024-09-16T01:21:34.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcfb13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb40039b0 0x7fdfc813b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcfb13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfc813d930 0x7fdfc8161250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcfb13640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc8140630 0x7fdfc8140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcfb13640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8070fa0 con 0x7fdfb40039b0 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcfb13640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc806c850 con 0x7fdfc813d930 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcfb13640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc806bc10 con 0x7fdfc8140630 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcd8af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb40039b0 0x7fdfc813b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcd8af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb40039b0 0x7fdfc813b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36948/0 (socket says 172.21.15.81:36948) 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcd8af640 1 -- 172.21.15.81:0/596971468 learned_addr learned my addr 172.21.15.81:0/596971468 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcd8af640 1 -- 172.21.15.81:0/596971468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc8140630 msgr2=0x7fdfc8140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcd0ae640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfc813d930 0x7fdfc8161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcd8af640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc8140630 0x7fdfc8140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcd8af640 1 -- 172.21.15.81:0/596971468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfc813d930 msgr2=0x7fdfc8161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcd8af640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfc813d930 0x7fdfc8161250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:34.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcd8af640 1 -- 172.21.15.81:0/596971468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc8161790 con 0x7fdfb40039b0 2024-09-16T01:21:34.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcd8af640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb40039b0 0x7fdfc813b2f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4034040 tx=0x7fdfc4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:34.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfbe7fc640 1 -- 172.21.15.81:0/596971468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4042070 con 0x7fdfb40039b0 2024-09-16T01:21:34.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfbe7fc640 1 -- 172.21.15.81:0/596971468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc4007480 con 0x7fdfb40039b0 2024-09-16T01:21:34.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcfb13640 1 -- 172.21.15.81:0/596971468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc813de80 con 0x7fdfb40039b0 2024-09-16T01:21:34.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfbe7fc640 1 -- 172.21.15.81:0/596971468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4001c90 con 0x7fdfb40039b0 2024-09-16T01:21:34.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.981+0000 7fdfcfb13640 1 -- 172.21.15.81:0/596971468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc813e440 con 0x7fdfb40039b0 2024-09-16T01:21:34.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.982+0000 7fdfcfb13640 1 -- 172.21.15.81:0/596971468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc80d0910 con 0x7fdfb40039b0 2024-09-16T01:21:34.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.983+0000 7fdfbe7fc640 1 -- 172.21.15.81:0/596971468 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdfc4045070 con 0x7fdfb40039b0 2024-09-16T01:21:34.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.984+0000 7fdfbe7fc640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdfac06c2e0 0x7fdfac06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:34.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.984+0000 7fdfcd0ae640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdfac06c2e0 0x7fdfac06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:34.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.984+0000 7fdfbe7fc640 1 -- 172.21.15.81:0/596971468 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7fdfc40abde0 con 0x7fdfb40039b0 2024-09-16T01:21:34.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.984+0000 7fdfcd0ae640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdfac06c2e0 0x7fdfac06e7a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdfc80b6f70 tx=0x7fdfb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:34.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:34.988+0000 7fdfbe7fc640 1 -- 172.21.15.81:0/596971468 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdfc4005ac0 con 0x7fdfb40039b0 2024-09-16T01:21:35.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.155+0000 7fdfcfb13640 1 -- 172.21.15.81:0/596971468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfc80704d0 con 0x7fdfb40039b0 2024-09-16T01:21:35.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.156+0000 7fdfbe7fc640 1 -- 172.21.15.81:0/596971468 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+13306 (secure 0 0 0) 0x7fdfc407a100 con 0x7fdfb40039b0 2024-09-16T01:21:35.158 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:35.158 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":92,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:21:32.854530+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/2778062051":"2024-09-17T01:21:29.845197+0000","172.21.15.81:6835/2778062051":"2024-09-17T01:21:29.845197+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:21:35.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.158+0000 7fdfcfb13640 1 -- 172.21.15.81:0/596971468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdfac06c2e0 msgr2=0x7fdfac06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.158+0000 7fdfcfb13640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdfac06c2e0 0x7fdfac06e7a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdfc80b6f70 tx=0x7fdfb8008040 comp rx=0 tx=0).stop 2024-09-16T01:21:35.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.158+0000 7fdfcfb13640 1 -- 172.21.15.81:0/596971468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb40039b0 msgr2=0x7fdfc813b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.158+0000 7fdfcfb13640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb40039b0 0x7fdfc813b2f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4034040 tx=0x7fdfc4001a40 comp rx=0 tx=0).stop 2024-09-16T01:21:35.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.158+0000 7fdfcfb13640 1 -- 172.21.15.81:0/596971468 shutdown_connections 2024-09-16T01:21:35.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.158+0000 7fdfcfb13640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdfac06c2e0 0x7fdfac06e7a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.158+0000 7fdfcfb13640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfc8140630 0x7fdfc8140ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.158+0000 7fdfcfb13640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfc813d930 0x7fdfc8161250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.158+0000 7fdfcfb13640 1 --2- 172.21.15.81:0/596971468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb40039b0 0x7fdfc813b2f0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.158+0000 7fdfcfb13640 1 -- 172.21.15.81:0/596971468 >> 172.21.15.81:0/596971468 conn(0x7fdfc80b2f40 msgr2=0x7fdfc80b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.158+0000 7fdfcfb13640 1 -- 172.21.15.81:0/596971468 shutdown_connections 2024-09-16T01:21:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.158+0000 7fdfcfb13640 1 -- 172.21.15.81:0/596971468 wait complete. 2024-09-16T01:21:35.171 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:15:28.088452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:21:35.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:21:35.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.270+0000 7f261ff59640 1 Processor -- start 2024-09-16T01:21:35.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.270+0000 7f261ff59640 1 -- start start 2024-09-16T01:21:35.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.271+0000 7f261ff59640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f261815e7f0 0x7f26180b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.271+0000 7f261ff59640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2618071180 0x7f261806de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.271+0000 7f261ff59640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f261806cdc0 con 0x7f26180af210 2024-09-16T01:21:35.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.271+0000 7f261ff59640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f261806d0a0 con 0x7f261815e7f0 2024-09-16T01:21:35.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.271+0000 7f261ff59640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f261806d380 con 0x7f2618071180 2024-09-16T01:21:35.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.271+0000 7f261e4f6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2618071180 0x7f261806de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.271+0000 7f261d4f4640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f26180af210 0x7f2618070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:54840/0 (socket says 172.21.15.81:54840) 2024-09-16T01:21:35.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.271+0000 7f261dcf5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f261815e7f0 0x7f26180b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.271+0000 7f261d4f4640 1 -- 172.21.15.81:0/2161739805 learned_addr learned my addr 172.21.15.81:0/2161739805 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:35.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.272+0000 7f261dcf5640 1 -- 172.21.15.81:0/2161739805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2618071180 msgr2=0x7f261806de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:35.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.272+0000 7f261dcf5640 1 --2- 172.21.15.81:0/2161739805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2618071180 0x7f261806de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.272+0000 7f261dcf5640 1 -- 172.21.15.81:0/2161739805 >> v1:172.21.15.102:6789/0 conn(0x7f26180af210 legacy=0x7f2618070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.272+0000 7f261dcf5640 1 -- 172.21.15.81:0/2161739805 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f261806d660 con 0x7f261815e7f0 2024-09-16T01:21:35.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.272+0000 7f261dcf5640 1 --2- 172.21.15.81:0/2161739805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f261815e7f0 0x7f26180b6d10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f26140097a0 tx=0x7f261402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2194444893cd7c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:35.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.272+0000 7f261ccf3640 1 -- 172.21.15.81:0/2161739805 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2614037070 con 0x7f261815e7f0 2024-09-16T01:21:35.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.273+0000 7f261ccf3640 1 -- 172.21.15.81:0/2161739805 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2614032440 con 0x7f261815e7f0 2024-09-16T01:21:35.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.273+0000 7f261ccf3640 1 -- 172.21.15.81:0/2161739805 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2614032810 con 0x7f261815e7f0 2024-09-16T01:21:35.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.273+0000 7f261ff59640 1 -- 172.21.15.81:0/2161739805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f261815e7f0 msgr2=0x7f26180b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.273+0000 7f261ff59640 1 --2- 172.21.15.81:0/2161739805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f261815e7f0 0x7f26180b6d10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f26140097a0 tx=0x7f261402a180 comp rx=0 tx=0).stop 2024-09-16T01:21:35.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.273+0000 7f261ff59640 1 -- 172.21.15.81:0/2161739805 shutdown_connections 2024-09-16T01:21:35.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.273+0000 7f261ff59640 1 --2- 172.21.15.81:0/2161739805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2618071180 0x7f261806de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.273+0000 7f261ff59640 1 --2- 172.21.15.81:0/2161739805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f261815e7f0 0x7f26180b6d10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.273+0000 7f261ff59640 1 -- 172.21.15.81:0/2161739805 >> 172.21.15.81:0/2161739805 conn(0x7f26180b3f30 msgr2=0x7f26180b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:35.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.273+0000 7f261ff59640 1 -- 172.21.15.81:0/2161739805 shutdown_connections 2024-09-16T01:21:35.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.273+0000 7f261ff59640 1 -- 172.21.15.81:0/2161739805 wait complete. 2024-09-16T01:21:35.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.274+0000 7f261ff59640 1 Processor -- start 2024-09-16T01:21:35.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.274+0000 7f261ff59640 1 -- start start 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261ff59640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2618071180 0x7f26181e7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261ff59640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26180af210 0x7f2618150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261ff59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261815e7f0 0x7f2618150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261ff59640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f26180b73d0 con 0x7f261815e7f0 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261ff59640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f26180b7250 con 0x7f2618071180 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261ff59640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f26180b7550 con 0x7f26180af210 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261e4f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261815e7f0 0x7f2618150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261e4f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261815e7f0 0x7f2618150d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36956/0 (socket says 172.21.15.81:36956) 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261e4f6640 1 -- 172.21.15.81:0/2845891229 learned_addr learned my addr 172.21.15.81:0/2845891229 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261dcf5640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2618071180 0x7f26181e7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261d4f4640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26180af210 0x7f2618150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261e4f6640 1 -- 172.21.15.81:0/2845891229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26180af210 msgr2=0x7f2618150850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261e4f6640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26180af210 0x7f2618150850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261e4f6640 1 -- 172.21.15.81:0/2845891229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2618071180 msgr2=0x7f26181e7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261e4f6640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2618071180 0x7f26181e7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261e4f6640 1 -- 172.21.15.81:0/2845891229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26181e6f20 con 0x7f261815e7f0 2024-09-16T01:21:35.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.275+0000 7f261dcf5640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2618071180 0x7f26181e7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:35.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.276+0000 7f261e4f6640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261815e7f0 0x7f2618150d90 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f261000ebe0 tx=0x7f261000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:35.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.276+0000 7f260e7fc640 1 -- 172.21.15.81:0/2845891229 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2610018020 con 0x7f261815e7f0 2024-09-16T01:21:35.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.276+0000 7f260e7fc640 1 -- 172.21.15.81:0/2845891229 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f261000cce0 con 0x7f261815e7f0 2024-09-16T01:21:35.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.276+0000 7f261ff59640 1 -- 172.21.15.81:0/2845891229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26181e7200 con 0x7f261815e7f0 2024-09-16T01:21:35.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.276+0000 7f260e7fc640 1 -- 172.21.15.81:0/2845891229 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26100146c0 con 0x7f261815e7f0 2024-09-16T01:21:35.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.276+0000 7f261ff59640 1 -- 172.21.15.81:0/2845891229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26181e77c0 con 0x7f261815e7f0 2024-09-16T01:21:35.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.277+0000 7f261ff59640 1 -- 172.21.15.81:0/2845891229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26181e79c0 con 0x7f261815e7f0 2024-09-16T01:21:35.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.277+0000 7f260e7fc640 1 -- 172.21.15.81:0/2845891229 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f261001b020 con 0x7f261815e7f0 2024-09-16T01:21:35.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.278+0000 7f260e7fc640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f25fc06c2b0 0x7f25fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.278+0000 7f260e7fc640 1 -- 172.21.15.81:0/2845891229 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7f261008c040 con 0x7f261815e7f0 2024-09-16T01:21:35.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.278+0000 7f261dcf5640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f25fc06c2b0 0x7f25fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.278+0000 7f261dcf5640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f25fc06c2b0 0x7f25fc06e770 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2614034000 tx=0x7f261402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:35.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.282+0000 7f260e7fc640 1 -- 172.21.15.81:0/2845891229 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26181e79c0 con 0x7f261815e7f0 2024-09-16T01:21:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.447+0000 7f261ff59640 1 -- 172.21.15.81:0/2845891229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f26180b6d10 con 0x7f261815e7f0 2024-09-16T01:21:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.448+0000 7f260e7fc640 1 -- 172.21.15.81:0/2845891229 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7f2610022020 con 0x7f261815e7f0 2024-09-16T01:21:35.450 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-16T01:21:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.450+0000 7f261ff59640 1 -- 172.21.15.81:0/2845891229 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f25fc06c2b0 msgr2=0x7f25fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.450+0000 7f261ff59640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f25fc06c2b0 0x7f25fc06e770 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2614034000 tx=0x7f261402e000 comp rx=0 tx=0).stop 2024-09-16T01:21:35.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.450+0000 7f261ff59640 1 -- 172.21.15.81:0/2845891229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261815e7f0 msgr2=0x7f2618150d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.450+0000 7f261ff59640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261815e7f0 0x7f2618150d90 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f261000ebe0 tx=0x7f261000c490 comp rx=0 tx=0).stop 2024-09-16T01:21:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.450+0000 7f261ff59640 1 -- 172.21.15.81:0/2845891229 shutdown_connections 2024-09-16T01:21:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.450+0000 7f261ff59640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f25fc06c2b0 0x7f25fc06e770 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.450+0000 7f261ff59640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f261815e7f0 0x7f2618150d90 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.450+0000 7f261ff59640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26180af210 0x7f2618150850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.450+0000 7f261ff59640 1 --2- 172.21.15.81:0/2845891229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2618071180 0x7f26181e7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.450+0000 7f261ff59640 1 -- 172.21.15.81:0/2845891229 >> 172.21.15.81:0/2845891229 conn(0x7f26180b3f30 msgr2=0x7f26180b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.450+0000 7f261ff59640 1 -- 172.21.15.81:0/2845891229 shutdown_connections 2024-09-16T01:21:35.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.450+0000 7f261ff59640 1 -- 172.21.15.81:0/2845891229 wait complete. 2024-09-16T01:21:35.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid' 2024-09-16T01:21:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.559+0000 7fed9bffd640 1 Processor -- start 2024-09-16T01:21:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.559+0000 7fed9bffd640 1 -- start start 2024-09-16T01:21:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.560+0000 7fed9bffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed9415e740 0x7fed940d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.560+0000 7fed9bffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed9406dbd0 0x7fed9406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.560+0000 7fed9bffd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed9406e040 con 0x7fed9409b690 2024-09-16T01:21:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.560+0000 7fed9bffd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fed9415eb20 con 0x7fed9406dbd0 2024-09-16T01:21:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.560+0000 7fed9bffd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fed9406d260 con 0x7fed9415e740 2024-09-16T01:21:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.560+0000 7fed9a59a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fed9406dbd0 0x7fed9406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.560+0000 7fed99598640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fed9409b690 0x7fed9406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38016/0 (socket says 172.21.15.81:38016) 2024-09-16T01:21:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.560+0000 7fed99598640 1 -- 172.21.15.81:0/3481391724 learned_addr learned my addr 172.21.15.81:0/3481391724 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.561+0000 7fed99d99640 1 --2- 172.21.15.81:0/3481391724 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed9415e740 0x7fed940d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.561+0000 7fed9a59a640 1 -- 172.21.15.81:0/3481391724 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed9415e740 msgr2=0x7fed940d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.561+0000 7fed9a59a640 1 --2- 172.21.15.81:0/3481391724 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed9415e740 0x7fed940d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.561+0000 7fed9a59a640 1 -- 172.21.15.81:0/3481391724 >> v1:172.21.15.81:6789/0 conn(0x7fed9409b690 legacy=0x7fed9406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.561+0000 7fed9a59a640 1 -- 172.21.15.81:0/3481391724 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed940d0780 con 0x7fed9406dbd0 2024-09-16T01:21:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.561+0000 7fed98d97640 1 -- 172.21.15.81:0/3481391724 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1838055020 0 0) 0x7fed9406e040 con 0x7fed9409b690 2024-09-16T01:21:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.561+0000 7fed99d99640 1 --2- 172.21.15.81:0/3481391724 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed9415e740 0x7fed940d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.561+0000 7fed9a59a640 1 --2- 172.21.15.81:0/3481391724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed9406dbd0 0x7fed9406cd20 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009dc0 tx=0x7fed8c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e26f207451d4441 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.562+0000 7fed98d97640 1 -- 172.21.15.81:0/3481391724 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c007740 con 0x7fed9406dbd0 2024-09-16T01:21:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.562+0000 7fed98d97640 1 -- 172.21.15.81:0/3481391724 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8c0078e0 con 0x7fed9406dbd0 2024-09-16T01:21:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.562+0000 7fed98d97640 1 -- 172.21.15.81:0/3481391724 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c007cb0 con 0x7fed9406dbd0 2024-09-16T01:21:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.562+0000 7fed9bffd640 1 -- 172.21.15.81:0/3481391724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed9406dbd0 msgr2=0x7fed9406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.562+0000 7fed9bffd640 1 --2- 172.21.15.81:0/3481391724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed9406dbd0 0x7fed9406cd20 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009dc0 tx=0x7fed8c02a710 comp rx=0 tx=0).stop 2024-09-16T01:21:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.562+0000 7fed9bffd640 1 -- 172.21.15.81:0/3481391724 shutdown_connections 2024-09-16T01:21:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.562+0000 7fed9bffd640 1 --2- 172.21.15.81:0/3481391724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed9406dbd0 0x7fed9406cd20 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.562+0000 7fed9bffd640 1 --2- 172.21.15.81:0/3481391724 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed9415e740 0x7fed940d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.562+0000 7fed9bffd640 1 -- 172.21.15.81:0/3481391724 >> 172.21.15.81:0/3481391724 conn(0x7fed940d23a0 msgr2=0x7fed940d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.562+0000 7fed9bffd640 1 -- 172.21.15.81:0/3481391724 shutdown_connections 2024-09-16T01:21:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.562+0000 7fed9bffd640 1 -- 172.21.15.81:0/3481391724 wait complete. 2024-09-16T01:21:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.563+0000 7fed9bffd640 1 Processor -- start 2024-09-16T01:21:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.563+0000 7fed9bffd640 1 -- start start 2024-09-16T01:21:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9bffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed9406dbd0 0x7fed940c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9bffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed9409b690 0x7fed940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9bffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed9415e740 0x7fed94157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9bffd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed940d1020 con 0x7fed9415e740 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9bffd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fed940d0d40 con 0x7fed9409b690 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9bffd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fed9409ba90 con 0x7fed9406dbd0 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9a59a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed9415e740 0x7fed94157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9a59a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed9415e740 0x7fed94157160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36980/0 (socket says 172.21.15.81:36980) 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9a59a640 1 -- 172.21.15.81:0/3321657689 learned_addr learned my addr 172.21.15.81:0/3321657689 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed99d99640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed9406dbd0 0x7fed940c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed99598640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed9409b690 0x7fed940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9a59a640 1 -- 172.21.15.81:0/3321657689 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed9406dbd0 msgr2=0x7fed940c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9a59a640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed9406dbd0 0x7fed940c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9a59a640 1 -- 172.21.15.81:0/3321657689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed9409b690 msgr2=0x7fed940b77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9a59a640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed9409b690 0x7fed940b77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.564+0000 7fed9a59a640 1 -- 172.21.15.81:0/3321657689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed940c6260 con 0x7fed9415e740 2024-09-16T01:21:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.565+0000 7fed9a59a640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed9415e740 0x7fed94157160 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009dc0 tx=0x7fed8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.565+0000 7fed8a7fc640 1 -- 172.21.15.81:0/3321657689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c03f070 con 0x7fed9415e740 2024-09-16T01:21:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.565+0000 7fed8a7fc640 1 -- 172.21.15.81:0/3321657689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8c031c40 con 0x7fed9415e740 2024-09-16T01:21:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.565+0000 7fed9bffd640 1 -- 172.21.15.81:0/3321657689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed940b7fd0 con 0x7fed9415e740 2024-09-16T01:21:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.565+0000 7fed8a7fc640 1 -- 172.21.15.81:0/3321657689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c003990 con 0x7fed9415e740 2024-09-16T01:21:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.565+0000 7fed9bffd640 1 -- 172.21.15.81:0/3321657689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed941e84a0 con 0x7fed9415e740 2024-09-16T01:21:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.566+0000 7fed9bffd640 1 -- 172.21.15.81:0/3321657689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed9406cd20 con 0x7fed9415e740 2024-09-16T01:21:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.566+0000 7fed8a7fc640 1 -- 172.21.15.81:0/3321657689 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fed8c003b30 con 0x7fed9415e740 2024-09-16T01:21:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.567+0000 7fed8a7fc640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed7806c2b0 0x7fed7806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.567+0000 7fed99d99640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed7806c2b0 0x7fed7806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.567+0000 7fed8a7fc640 1 -- 172.21.15.81:0/3321657689 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7fed8c0ac0a0 con 0x7fed9415e740 2024-09-16T01:21:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.567+0000 7fed99d99640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed7806c2b0 0x7fed7806e770 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fed941f75a0 tx=0x7fed90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.571+0000 7fed8a7fc640 1 -- 172.21.15.81:0/3321657689 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed940c6260 con 0x7fed9415e740 2024-09-16T01:21:35.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.801+0000 7fed9bffd640 1 -- 172.21.15.81:0/3321657689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]} v 0) -- 0x7fed940d1cb0 con 0x7fed9415e740 2024-09-16T01:21:35.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.863+0000 7fed8a7fc640 1 -- 172.21.15.81:0/3321657689 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]}]=0 v293) ==== 153+0+0 (secure 0 0 0) 0x7fed8c07a3c0 con 0x7fed9415e740 2024-09-16T01:21:35.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.865+0000 7fed9bffd640 1 -- 172.21.15.81:0/3321657689 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed7806c2b0 msgr2=0x7fed7806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.865+0000 7fed9bffd640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed7806c2b0 0x7fed7806e770 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fed941f75a0 tx=0x7fed90008040 comp rx=0 tx=0).stop 2024-09-16T01:21:35.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.865+0000 7fed9bffd640 1 -- 172.21.15.81:0/3321657689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed9415e740 msgr2=0x7fed94157160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.865+0000 7fed9bffd640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed9415e740 0x7fed94157160 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009dc0 tx=0x7fed8c004a40 comp rx=0 tx=0).stop 2024-09-16T01:21:35.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.865+0000 7fed9bffd640 1 -- 172.21.15.81:0/3321657689 shutdown_connections 2024-09-16T01:21:35.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.865+0000 7fed9bffd640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed7806c2b0 0x7fed7806e770 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.865+0000 7fed9bffd640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed9415e740 0x7fed94157160 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.865+0000 7fed9bffd640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed9409b690 0x7fed940b77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.865+0000 7fed9bffd640 1 --2- 172.21.15.81:0/3321657689 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed9406dbd0 0x7fed940c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.865+0000 7fed9bffd640 1 -- 172.21.15.81:0/3321657689 >> 172.21.15.81:0/3321657689 conn(0x7fed940d23a0 msgr2=0x7fed940ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:35.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.865+0000 7fed9bffd640 1 -- 172.21.15.81:0/3321657689 shutdown_connections 2024-09-16T01:21:35.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.865+0000 7fed9bffd640 1 -- 172.21.15.81:0/3321657689 wait complete. 2024-09-16T01:21:35.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T01:21:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.977+0000 7fa876549640 1 Processor -- start 2024-09-16T01:21:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.977+0000 7fa876549640 1 -- start start 2024-09-16T01:21:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.978+0000 7fa876549640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa87015e7f0 0x7fa8700b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.978+0000 7fa876549640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8700af210 0x7fa870070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.978+0000 7fa876549640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87006cdc0 con 0x7fa8700b7250 2024-09-16T01:21:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.978+0000 7fa876549640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa87006d0a0 con 0x7fa87015e7f0 2024-09-16T01:21:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.978+0000 7fa876549640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa87006d380 con 0x7fa8700af210 2024-09-16T01:21:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.978+0000 7fa86ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa87015e7f0 0x7fa8700b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.978+0000 7fa86ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa87015e7f0 0x7fa8700b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36996/0 (socket says 172.21.15.81:36996) 2024-09-16T01:21:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.978+0000 7fa86ffff640 1 -- 172.21.15.81:0/3609936637 learned_addr learned my addr 172.21.15.81:0/3609936637 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:35.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.978+0000 7fa86ffff640 1 -- 172.21.15.81:0/3609936637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8700af210 msgr2=0x7fa870070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:35.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.978+0000 7fa86ffff640 1 --2- 172.21.15.81:0/3609936637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8700af210 0x7fa870070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.978+0000 7fa86ffff640 1 -- 172.21.15.81:0/3609936637 >> v1:172.21.15.102:6789/0 conn(0x7fa8700b7250 legacy=0x7fa87009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:35.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.978+0000 7fa86ffff640 1 -- 172.21.15.81:0/3609936637 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87006d660 con 0x7fa87015e7f0 2024-09-16T01:21:35.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.979+0000 7fa86ffff640 1 --2- 172.21.15.81:0/3609936637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87015e7f0 0x7fa8700b6d10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa860009870 tx=0x7fa86002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe3fe3d7b04caca server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:35.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.979+0000 7fa86effd640 1 -- 172.21.15.81:0/3609936637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860037070 con 0x7fa87015e7f0 2024-09-16T01:21:35.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.979+0000 7fa86effd640 1 -- 172.21.15.81:0/3609936637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa860032440 con 0x7fa87015e7f0 2024-09-16T01:21:35.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.979+0000 7fa86effd640 1 -- 172.21.15.81:0/3609936637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860032810 con 0x7fa87015e7f0 2024-09-16T01:21:35.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.980+0000 7fa876549640 1 -- 172.21.15.81:0/3609936637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87015e7f0 msgr2=0x7fa8700b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.980+0000 7fa876549640 1 --2- 172.21.15.81:0/3609936637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87015e7f0 0x7fa8700b6d10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fa860009870 tx=0x7fa86002a230 comp rx=0 tx=0).stop 2024-09-16T01:21:35.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.980+0000 7fa876549640 1 -- 172.21.15.81:0/3609936637 shutdown_connections 2024-09-16T01:21:35.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.980+0000 7fa876549640 1 --2- 172.21.15.81:0/3609936637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8700af210 0x7fa870070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.980+0000 7fa876549640 1 --2- 172.21.15.81:0/3609936637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87015e7f0 0x7fa8700b6d10 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.980+0000 7fa876549640 1 -- 172.21.15.81:0/3609936637 >> 172.21.15.81:0/3609936637 conn(0x7fa8700b3f30 msgr2=0x7fa8700b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:35.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.980+0000 7fa876549640 1 -- 172.21.15.81:0/3609936637 shutdown_connections 2024-09-16T01:21:35.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.980+0000 7fa876549640 1 -- 172.21.15.81:0/3609936637 wait complete. 2024-09-16T01:21:35.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.981+0000 7fa876549640 1 Processor -- start 2024-09-16T01:21:35.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.981+0000 7fa876549640 1 -- start start 2024-09-16T01:21:35.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa876549640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8700af210 0x7fa8700cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa876549640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8700b7250 0x7fa8700cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa876549640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87015e7f0 0x7fa8700cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa876549640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa870070fb0 con 0x7fa87015e7f0 2024-09-16T01:21:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa876549640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa8700b6150 con 0x7fa8700af210 2024-09-16T01:21:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa876549640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa870071130 con 0x7fa8700b7250 2024-09-16T01:21:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa874ae6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87015e7f0 0x7fa8700cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa874ae6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87015e7f0 0x7fa8700cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37008/0 (socket says 172.21.15.81:37008) 2024-09-16T01:21:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa874ae6640 1 -- 172.21.15.81:0/3563098712 learned_addr learned my addr 172.21.15.81:0/3563098712 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa86ffff640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8700af210 0x7fa8700cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa86f7fe640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8700b7250 0x7fa8700cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa874ae6640 1 -- 172.21.15.81:0/3563098712 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8700b7250 msgr2=0x7fa8700cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa874ae6640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8700b7250 0x7fa8700cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa874ae6640 1 -- 172.21.15.81:0/3563098712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8700af210 msgr2=0x7fa8700cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa874ae6640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8700af210 0x7fa8700cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:35.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa874ae6640 1 -- 172.21.15.81:0/3563098712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa870157cc0 con 0x7fa87015e7f0 2024-09-16T01:21:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa874ae6640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87015e7f0 0x7fa8700cc9b0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fa86800be90 tx=0x7fa86800bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa86cff9640 1 -- 172.21.15.81:0/3563098712 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868019070 con 0x7fa87015e7f0 2024-09-16T01:21:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa86cff9640 1 -- 172.21.15.81:0/3563098712 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa868014440 con 0x7fa87015e7f0 2024-09-16T01:21:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa876549640 1 -- 172.21.15.81:0/3563098712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa870143420 con 0x7fa87015e7f0 2024-09-16T01:21:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa86cff9640 1 -- 172.21.15.81:0/3563098712 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868014870 con 0x7fa87015e7f0 2024-09-16T01:21:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.982+0000 7fa876549640 1 -- 172.21.15.81:0/3563098712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8701579e0 con 0x7fa87015e7f0 2024-09-16T01:21:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.983+0000 7fa876549640 1 -- 172.21.15.81:0/3563098712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa870070a70 con 0x7fa87015e7f0 2024-09-16T01:21:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.984+0000 7fa86cff9640 1 -- 172.21.15.81:0/3563098712 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa86801c070 con 0x7fa87015e7f0 2024-09-16T01:21:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.984+0000 7fa86cff9640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa85c06c2b0 0x7fa85c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.984+0000 7fa86cff9640 1 -- 172.21.15.81:0/3563098712 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7fa86808b2b0 con 0x7fa87015e7f0 2024-09-16T01:21:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.984+0000 7fa86ffff640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa85c06c2b0 0x7fa85c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.985+0000 7fa86ffff640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa85c06c2b0 0x7fa85c06e770 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa860034000 tx=0x7fa86002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:35.989+0000 7fa86cff9640 1 -- 172.21.15.81:0/3563098712 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa868059c20 con 0x7fa87015e7f0 2024-09-16T01:21:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.154+0000 7fa876549640 1 -- 172.21.15.81:0/3563098712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa8700b2f60 con 0x7fa87015e7f0 2024-09-16T01:21:36.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.158+0000 7fa86cff9640 1 -- 172.21.15.81:0/3563098712 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7fa868059520 con 0x7fa87015e7f0 2024-09-16T01:21:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.160+0000 7fa876549640 1 -- 172.21.15.81:0/3563098712 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa85c06c2b0 msgr2=0x7fa85c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.160+0000 7fa876549640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa85c06c2b0 0x7fa85c06e770 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa860034000 tx=0x7fa86002e000 comp rx=0 tx=0).stop 2024-09-16T01:21:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.160+0000 7fa876549640 1 -- 172.21.15.81:0/3563098712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87015e7f0 msgr2=0x7fa8700cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.160+0000 7fa876549640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87015e7f0 0x7fa8700cc9b0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fa86800be90 tx=0x7fa86800bf80 comp rx=0 tx=0).stop 2024-09-16T01:21:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.160+0000 7fa876549640 1 -- 172.21.15.81:0/3563098712 shutdown_connections 2024-09-16T01:21:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.160+0000 7fa876549640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa85c06c2b0 0x7fa85c06e770 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.160+0000 7fa876549640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa87015e7f0 0x7fa8700cc9b0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.160+0000 7fa876549640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa8700b7250 0x7fa8700cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.160+0000 7fa876549640 1 --2- 172.21.15.81:0/3563098712 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa8700af210 0x7fa8700cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.160+0000 7fa876549640 1 -- 172.21.15.81:0/3563098712 >> 172.21.15.81:0/3563098712 conn(0x7fa8700b3f30 msgr2=0x7fa8700b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.160+0000 7fa876549640 1 -- 172.21.15.81:0/3563098712 shutdown_connections 2024-09-16T01:21:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.160+0000 7fa876549640 1 -- 172.21.15.81:0/3563098712 wait complete. 2024-09-16T01:21:36.173 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:21:36.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:21:36.221 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:21:36.272 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:21:36.272 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:21:36.272 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:36.287 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:21:36.287 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:21:36.288 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:36.305 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:21:36.305 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:21:36.305 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:36.343 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:21:36.343 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:21:36.343 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:36.362 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:21:36.362 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T01:21:36.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:21:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.480+0000 7f35ca253640 1 Processor -- start 2024-09-16T01:21:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.480+0000 7f35ca253640 1 -- start start 2024-09-16T01:21:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.481+0000 7f35ca253640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c415fc30 0x7f35c4071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.481+0000 7f35ca253640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f35c40b17d0 0x7f35c409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.481+0000 7f35ca253640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35c409ba30 con 0x7f35c409af70 2024-09-16T01:21:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.481+0000 7f35ca253640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f35c40b1590 con 0x7f35c40b17d0 2024-09-16T01:21:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.481+0000 7f35ca253640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f35c4160ab0 con 0x7f35c415fc30 2024-09-16T01:21:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.482+0000 7f35c3fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f35c409af70 0x7f35c40d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:54868/0 (socket says 172.21.15.81:54868) 2024-09-16T01:21:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.482+0000 7f35c2ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f35c40b17d0 0x7f35c409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.482+0000 7f35c3fff640 1 -- 172.21.15.81:0/284128409 learned_addr learned my addr 172.21.15.81:0/284128409 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.482+0000 7f35c37fe640 1 --2- 172.21.15.81:0/284128409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c415fc30 0x7f35c4071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.482+0000 7f35c27fc640 1 -- 172.21.15.81:0/284128409 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3055406805 0 0) 0x7f35c409ba30 con 0x7f35c409af70 2024-09-16T01:21:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.482+0000 7f35c27fc640 1 -- 172.21.15.81:0/284128409 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35ac003520 con 0x7f35c409af70 2024-09-16T01:21:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.482+0000 7f35c37fe640 1 -- 172.21.15.81:0/284128409 >> v2:172.21.15.102:3300/0 conn(0x7f35c40b17d0 msgr2=0x7f35c409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.482+0000 7f35c37fe640 1 --2- 172.21.15.81:0/284128409 >> v2:172.21.15.102:3300/0 conn(0x7f35c40b17d0 0x7f35c409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.482+0000 7f35c37fe640 1 -- 172.21.15.81:0/284128409 >> v1:172.21.15.102:6789/0 conn(0x7f35c409af70 legacy=0x7f35c40d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.482+0000 7f35c37fe640 1 -- 172.21.15.81:0/284128409 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c409bcf0 con 0x7f35c415fc30 2024-09-16T01:21:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.482+0000 7f35c2ffd640 1 --2- 172.21.15.81:0/284128409 >> v2:172.21.15.102:3300/0 conn(0x7f35c40b17d0 0x7f35c409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:21:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.483+0000 7f35c37fe640 1 --2- 172.21.15.81:0/284128409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c415fc30 0x7f35c4071e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009d90 tx=0x7f35b402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d816bfec1ad14a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.483+0000 7f35c27fc640 1 -- 172.21.15.81:0/284128409 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4031600 con 0x7f35c415fc30 2024-09-16T01:21:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.483+0000 7f35c27fc640 1 -- 172.21.15.81:0/284128409 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b40317a0 con 0x7f35c415fc30 2024-09-16T01:21:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.483+0000 7f35c27fc640 1 -- 172.21.15.81:0/284128409 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4031b50 con 0x7f35c415fc30 2024-09-16T01:21:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.483+0000 7f35ca253640 1 -- 172.21.15.81:0/284128409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c415fc30 msgr2=0x7f35c4071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.483+0000 7f35ca253640 1 --2- 172.21.15.81:0/284128409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c415fc30 0x7f35c4071e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009d90 tx=0x7f35b402a5d0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.484+0000 7f35ca253640 1 -- 172.21.15.81:0/284128409 shutdown_connections 2024-09-16T01:21:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.484+0000 7f35ca253640 1 --2- 172.21.15.81:0/284128409 >> v2:172.21.15.102:3300/0 conn(0x7f35c40b17d0 0x7f35c409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.484+0000 7f35ca253640 1 --2- 172.21.15.81:0/284128409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c415fc30 0x7f35c4071e40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.484+0000 7f35ca253640 1 -- 172.21.15.81:0/284128409 >> 172.21.15.81:0/284128409 conn(0x7f35c40d23a0 msgr2=0x7f35c40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.484+0000 7f35ca253640 1 -- 172.21.15.81:0/284128409 shutdown_connections 2024-09-16T01:21:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.484+0000 7f35ca253640 1 -- 172.21.15.81:0/284128409 wait complete. 2024-09-16T01:21:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.485+0000 7f35ca253640 1 Processor -- start 2024-09-16T01:21:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.485+0000 7f35ca253640 1 -- start start 2024-09-16T01:21:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35ca253640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c409af70 0x7f35c41f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35ca253640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c40b17d0 0x7f35c40cf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35ca253640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c415fc30 0x7f35c40b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35ca253640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35c40b1bd0 con 0x7f35c415fc30 2024-09-16T01:21:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35ca253640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f35c4160fe0 con 0x7f35c409af70 2024-09-16T01:21:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35ca253640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f35c4071500 con 0x7f35c40b17d0 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35c3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c415fc30 0x7f35c40b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35c3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c415fc30 0x7f35c40b68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37020/0 (socket says 172.21.15.81:37020) 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35c3fff640 1 -- 172.21.15.81:0/1011795426 learned_addr learned my addr 172.21.15.81:0/1011795426 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35c37fe640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c409af70 0x7f35c41f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35c2ffd640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c40b17d0 0x7f35c40cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35c3fff640 1 -- 172.21.15.81:0/1011795426 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c40b17d0 msgr2=0x7f35c40cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35c3fff640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c40b17d0 0x7f35c40cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35c3fff640 1 -- 172.21.15.81:0/1011795426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c409af70 msgr2=0x7f35c41f55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35c3fff640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c409af70 0x7f35c41f55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35c3fff640 1 -- 172.21.15.81:0/1011795426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c40b5270 con 0x7f35c415fc30 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35c3fff640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c415fc30 0x7f35c40b68d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c430 tx=0x7f35bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35abfff640 1 -- 172.21.15.81:0/1011795426 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc017070 con 0x7f35c415fc30 2024-09-16T01:21:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35abfff640 1 -- 172.21.15.81:0/1011795426 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc005ce0 con 0x7f35c415fc30 2024-09-16T01:21:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.486+0000 7f35ca253640 1 -- 172.21.15.81:0/1011795426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c40b5550 con 0x7f35c415fc30 2024-09-16T01:21:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.487+0000 7f35abfff640 1 -- 172.21.15.81:0/1011795426 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc007310 con 0x7f35c415fc30 2024-09-16T01:21:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.487+0000 7f35ca253640 1 -- 172.21.15.81:0/1011795426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c40b5b10 con 0x7f35c415fc30 2024-09-16T01:21:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.488+0000 7f35ca253640 1 -- 172.21.15.81:0/1011795426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c409aa30 con 0x7f35c415fc30 2024-09-16T01:21:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.488+0000 7f35abfff640 1 -- 172.21.15.81:0/1011795426 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f35bc01a070 con 0x7f35c415fc30 2024-09-16T01:21:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.488+0000 7f35abfff640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f35b006c2b0 0x7f35b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.488+0000 7f35abfff640 1 -- 172.21.15.81:0/1011795426 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5335+0+0 (secure 0 0 0) 0x7f35bc08a660 con 0x7f35c415fc30 2024-09-16T01:21:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.488+0000 7f35c37fe640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f35b006c2b0 0x7f35b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.489+0000 7f35c37fe640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f35b006c2b0 0x7f35b006e770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f35b4034000 tx=0x7f35b402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.493+0000 7f35abfff640 1 -- 172.21.15.81:0/1011795426 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f35bc058980 con 0x7f35c415fc30 2024-09-16T01:21:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.691+0000 7f35ca253640 1 -- 172.21.15.81:0/1011795426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35c40b8320 con 0x7f35c415fc30 2024-09-16T01:21:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.692+0000 7f35abfff640 1 -- 172.21.15.81:0/1011795426 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+3914 (secure 0 0 0) 0x7f35bc05cc80 con 0x7f35c415fc30 2024-09-16T01:21:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:36.694 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":48,"btime":"2024-09-16T01:21:30:847117+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5432,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/3998032766","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":3998032766},{"type":"v1","addr":"172.21.15.102:6835","nonce":3998032766}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":5794,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/978156526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":978156526},{"type":"v1","addr":"172.21.15.102:6834","nonce":978156526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6384,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1184176189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1184176189},{"type":"v1","addr":"172.21.15.81:6836","nonce":1184176189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6840,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3778059472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3778059472},{"type":"v1","addr":"172.21.15.81:6837","nonce":3778059472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":48}],"filesystems":[]} 2024-09-16T01:21:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 48 2024-09-16T01:21:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.694+0000 7f35ca253640 1 -- 172.21.15.81:0/1011795426 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f35b006c2b0 msgr2=0x7f35b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.694+0000 7f35ca253640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f35b006c2b0 0x7f35b006e770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f35b4034000 tx=0x7f35b402f000 comp rx=0 tx=0).stop 2024-09-16T01:21:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.694+0000 7f35ca253640 1 -- 172.21.15.81:0/1011795426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c415fc30 msgr2=0x7f35c40b68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.694+0000 7f35ca253640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c415fc30 0x7f35c40b68d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00c430 tx=0x7f35bc00c8f0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.694+0000 7f35ca253640 1 -- 172.21.15.81:0/1011795426 shutdown_connections 2024-09-16T01:21:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.694+0000 7f35ca253640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f35b006c2b0 0x7f35b006e770 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.694+0000 7f35ca253640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35c415fc30 0x7f35c40b68d0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.694+0000 7f35ca253640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35c40b17d0 0x7f35c40cf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.694+0000 7f35ca253640 1 --2- 172.21.15.81:0/1011795426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35c409af70 0x7f35c41f55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.694+0000 7f35ca253640 1 -- 172.21.15.81:0/1011795426 >> 172.21.15.81:0/1011795426 conn(0x7f35c40d23a0 msgr2=0x7f35c4160010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.694+0000 7f35ca253640 1 -- 172.21.15.81:0/1011795426 shutdown_connections 2024-09-16T01:21:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.694+0000 7f35ca253640 1 -- 172.21.15.81:0/1011795426 wait complete. 2024-09-16T01:21:36.707 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:21:36.707 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T01:21:36.707 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:21:36.707 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:21:36.708 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:21:36.708 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T01:21:36.708 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:21:36.708 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:21:36.708 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:21:36.708 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T01:21:36.709 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:21:36.709 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:21:36.709 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:21:36.709 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T01:21:36.709 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:21:36.709 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:21:36.716 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:21:36.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:21:36.717 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:21:36.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:21:36.720 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:21:36.720 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:21:36.720 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:21:36.721 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:21:36.759 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:21:36.759 DEBUG:teuthology.parallel:result is None 2024-09-16T01:21:36.760 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:21:36.760 DEBUG:teuthology.parallel:result is None 2024-09-16T01:21:36.762 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:21:36.763 DEBUG:teuthology.parallel:result is None 2024-09-16T01:21:36.763 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:21:36.763 DEBUG:teuthology.parallel:result is None 2024-09-16T01:21:36.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T01:21:36.833 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:21:36.833 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:21:36.845 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:21:36.845 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-16T01:21:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.867+0000 7ff89914b640 1 Processor -- start 2024-09-16T01:21:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.868+0000 7ff89914b640 1 -- start start 2024-09-16T01:21:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.868+0000 7ff89914b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff894162060 0x7ff8940b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.868+0000 7ff89914b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff8940b64b0 0x7ff8940b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.868+0000 7ff89914b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff89406d9f0 con 0x7ff894161c80 2024-09-16T01:21:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.868+0000 7ff89914b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff89406dcd0 con 0x7ff8940b64b0 2024-09-16T01:21:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.868+0000 7ff89914b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff89406dfb0 con 0x7ff894162060 2024-09-16T01:21:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.868+0000 7ff892d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff894161c80 0x7ff89406e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38024/0 (socket says 172.21.15.81:38024) 2024-09-16T01:21:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.868+0000 7ff892d9d640 1 -- 172.21.15.81:0/3146407098 learned_addr learned my addr 172.21.15.81:0/3146407098 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.869+0000 7ff89359e640 1 --2- 172.21.15.81:0/3146407098 >> v2:172.21.15.102:3300/0 conn(0x7ff8940b64b0 0x7ff8940b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.869+0000 7ff89259c640 1 --2- 172.21.15.81:0/3146407098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff894162060 0x7ff8940b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.869+0000 7ff891d9b640 1 -- 172.21.15.81:0/3146407098 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418677456 0 0) 0x7ff89406d9f0 con 0x7ff894161c80 2024-09-16T01:21:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.869+0000 7ff891d9b640 1 -- 172.21.15.81:0/3146407098 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff87c003520 con 0x7ff894161c80 2024-09-16T01:21:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.869+0000 7ff891d9b640 1 -- 172.21.15.81:0/3146407098 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2422997051 0 0) 0x7ff87c003520 con 0x7ff894161c80 2024-09-16T01:21:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.869+0000 7ff89259c640 1 -- 172.21.15.81:0/3146407098 >> v2:172.21.15.102:3300/0 conn(0x7ff8940b64b0 msgr2=0x7ff8940b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.869+0000 7ff89259c640 1 --2- 172.21.15.81:0/3146407098 >> v2:172.21.15.102:3300/0 conn(0x7ff8940b64b0 0x7ff8940b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.869+0000 7ff89259c640 1 -- 172.21.15.81:0/3146407098 >> v1:172.21.15.81:6789/0 conn(0x7ff894161c80 legacy=0x7ff89406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.869+0000 7ff89259c640 1 -- 172.21.15.81:0/3146407098 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8940d01f0 con 0x7ff894162060 2024-09-16T01:21:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.869+0000 7ff89359e640 1 --2- 172.21.15.81:0/3146407098 >> v2:172.21.15.102:3300/0 conn(0x7ff8940b64b0 0x7ff8940b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:21:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.870+0000 7ff89259c640 1 --2- 172.21.15.81:0/3146407098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff894162060 0x7ff8940b5f70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff8880097a0 tx=0x7ff88802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48749e7f1ed21ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.871+0000 7ff891d9b640 1 -- 172.21.15.81:0/3146407098 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff888037070 con 0x7ff894162060 2024-09-16T01:21:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.871+0000 7ff891d9b640 1 -- 172.21.15.81:0/3146407098 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88802aba0 con 0x7ff894162060 2024-09-16T01:21:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.871+0000 7ff891d9b640 1 -- 172.21.15.81:0/3146407098 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff884001670 con 0x7ff894162060 2024-09-16T01:21:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.871+0000 7ff89914b640 1 -- 172.21.15.81:0/3146407098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff894162060 msgr2=0x7ff8940b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.871+0000 7ff89914b640 1 --2- 172.21.15.81:0/3146407098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff894162060 0x7ff8940b5f70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff8880097a0 tx=0x7ff88802a110 comp rx=0 tx=0).stop 2024-09-16T01:21:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.871+0000 7ff89914b640 1 -- 172.21.15.81:0/3146407098 shutdown_connections 2024-09-16T01:21:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.871+0000 7ff89914b640 1 --2- 172.21.15.81:0/3146407098 >> v2:172.21.15.102:3300/0 conn(0x7ff8940b64b0 0x7ff8940b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.871+0000 7ff89914b640 1 --2- 172.21.15.81:0/3146407098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff894162060 0x7ff8940b5f70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.871+0000 7ff89914b640 1 -- 172.21.15.81:0/3146407098 >> 172.21.15.81:0/3146407098 conn(0x7ff8940d44f0 msgr2=0x7ff8940d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.871+0000 7ff89914b640 1 -- 172.21.15.81:0/3146407098 shutdown_connections 2024-09-16T01:21:36.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.871+0000 7ff89914b640 1 -- 172.21.15.81:0/3146407098 wait complete. 2024-09-16T01:21:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.873+0000 7ff89914b640 1 Processor -- start 2024-09-16T01:21:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.873+0000 7ff89914b640 1 -- start start 2024-09-16T01:21:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff89914b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8940b64b0 0x7ff8941599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff89914b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff894161c80 0x7ff8940b8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:36.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff89914b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff894162060 0x7ff89415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff89914b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8940cf1e0 con 0x7ff8940b64b0 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff89914b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff8940d2aa0 con 0x7ff894161c80 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff89914b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff8940cf360 con 0x7ff894162060 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff892d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8940b64b0 0x7ff8941599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff892d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8940b64b0 0x7ff8941599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37070/0 (socket says 172.21.15.81:37070) 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff892d9d640 1 -- 172.21.15.81:0/3237111611 learned_addr learned my addr 172.21.15.81:0/3237111611 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff89359e640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff894162060 0x7ff89415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff89259c640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff894161c80 0x7ff8940b8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff892d9d640 1 -- 172.21.15.81:0/3237111611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff894162060 msgr2=0x7ff89415eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff892d9d640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff894162060 0x7ff89415eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff892d9d640 1 -- 172.21.15.81:0/3237111611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff894161c80 msgr2=0x7ff8940b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff892d9d640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff894161c80 0x7ff8940b8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:36.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff892d9d640 1 -- 172.21.15.81:0/3237111611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff894159ee0 con 0x7ff8940b64b0 2024-09-16T01:21:36.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.874+0000 7ff892d9d640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8940b64b0 0x7ff8941599a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff88400c780 tx=0x7ff88400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.879+0000 7ff87b7fe640 1 -- 172.21.15.81:0/3237111611 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff884017070 con 0x7ff8940b64b0 2024-09-16T01:21:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.879+0000 7ff87b7fe640 1 -- 172.21.15.81:0/3237111611 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff884005ad0 con 0x7ff8940b64b0 2024-09-16T01:21:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.879+0000 7ff89914b640 1 -- 172.21.15.81:0/3237111611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8941f7c70 con 0x7ff8940b64b0 2024-09-16T01:21:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.879+0000 7ff87b7fe640 1 -- 172.21.15.81:0/3237111611 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff884007070 con 0x7ff8940b64b0 2024-09-16T01:21:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.879+0000 7ff89914b640 1 -- 172.21.15.81:0/3237111611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8941f8230 con 0x7ff8940b64b0 2024-09-16T01:21:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.880+0000 7ff89914b640 1 -- 172.21.15.81:0/3237111611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8940b5f70 con 0x7ff8940b64b0 2024-09-16T01:21:36.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.880+0000 7ff87b7fe640 1 -- 172.21.15.81:0/3237111611 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff88401a070 con 0x7ff8940b64b0 2024-09-16T01:21:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.881+0000 7ff87b7fe640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff88006c2b0 0x7ff88006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.881+0000 7ff87b7fe640 1 -- 172.21.15.81:0/3237111611 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5335+0+0 (secure 0 0 0) 0x7ff88408a720 con 0x7ff8940b64b0 2024-09-16T01:21:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.881+0000 7ff89259c640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff88006c2b0 0x7ff88006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:36.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.881+0000 7ff89259c640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff88006c2b0 0x7ff88006e770 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff888034000 tx=0x7ff88802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:36.889+0000 7ff87b7fe640 1 -- 172.21.15.81:0/3237111611 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff884058920 con 0x7ff8940b64b0 2024-09-16T01:21:37.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.067+0000 7ff89914b640 1 -- 172.21.15.81:0/3237111611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ff8940d3820 con 0x7ff8940b64b0 2024-09-16T01:21:37.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.891+0000 7ff87b7fe640 1 -- 172.21.15.81:0/3237111611 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v97) ==== 97+0+0 (secure 0 0 0) 0x7ff88405cc20 con 0x7ff8940b64b0 2024-09-16T01:21:37.893 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-16T01:21:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.893+0000 7ff89914b640 1 -- 172.21.15.81:0/3237111611 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff88006c2b0 msgr2=0x7ff88006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.893+0000 7ff89914b640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff88006c2b0 0x7ff88006e770 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff888034000 tx=0x7ff88802e000 comp rx=0 tx=0).stop 2024-09-16T01:21:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.893+0000 7ff89914b640 1 -- 172.21.15.81:0/3237111611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8940b64b0 msgr2=0x7ff8941599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.893+0000 7ff89914b640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8940b64b0 0x7ff8941599a0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff88400c780 tx=0x7ff88400cb80 comp rx=0 tx=0).stop 2024-09-16T01:21:37.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.893+0000 7ff89914b640 1 -- 172.21.15.81:0/3237111611 shutdown_connections 2024-09-16T01:21:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.893+0000 7ff89914b640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff88006c2b0 0x7ff88006e770 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.893+0000 7ff89914b640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff894162060 0x7ff89415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.893+0000 7ff89914b640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff894161c80 0x7ff8940b8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.893+0000 7ff89914b640 1 --2- 172.21.15.81:0/3237111611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8940b64b0 0x7ff8941599a0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.893+0000 7ff89914b640 1 -- 172.21.15.81:0/3237111611 >> 172.21.15.81:0/3237111611 conn(0x7ff8940d44f0 msgr2=0x7ff8940d3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.893+0000 7ff89914b640 1 -- 172.21.15.81:0/3237111611 shutdown_connections 2024-09-16T01:21:37.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:37.893+0000 7ff89914b640 1 -- 172.21.15.81:0/3237111611 wait complete. 2024-09-16T01:21:37.908 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T01:21:38.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.009+0000 7fcdba9b0640 1 Processor -- start 2024-09-16T01:21:38.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.010+0000 7fcdba9b0640 1 -- start start 2024-09-16T01:21:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.010+0000 7fcdba9b0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcdb415e740 0x7fcdb40d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.010+0000 7fcdba9b0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcdb409b690 0x7fcdb406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.010+0000 7fcdba9b0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdb40d0780 con 0x7fcdb406d4c0 2024-09-16T01:21:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.010+0000 7fcdba9b0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fcdb415eb20 con 0x7fcdb415e740 2024-09-16T01:21:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.010+0000 7fcdba9b0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fcdb406d260 con 0x7fcdb409b690 2024-09-16T01:21:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.010+0000 7fcdb3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcdb415e740 0x7fcdb40d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.011+0000 7fcdb3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcdb415e740 0x7fcdb40d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37080/0 (socket says 172.21.15.81:37080) 2024-09-16T01:21:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.011+0000 7fcdb3fff640 1 -- 172.21.15.81:0/672406248 learned_addr learned my addr 172.21.15.81:0/672406248 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.011+0000 7fcdb3fff640 1 -- 172.21.15.81:0/672406248 >> v2:172.21.15.102:3300/0 conn(0x7fcdb409b690 msgr2=0x7fcdb406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.011+0000 7fcdb3fff640 1 --2- 172.21.15.81:0/672406248 >> v2:172.21.15.102:3300/0 conn(0x7fcdb409b690 0x7fcdb406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.011+0000 7fcdb3fff640 1 -- 172.21.15.81:0/672406248 >> v1:172.21.15.102:6789/0 conn(0x7fcdb406d4c0 legacy=0x7fcdb406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:38.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.011+0000 7fcdb3fff640 1 -- 172.21.15.81:0/672406248 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb40d0a60 con 0x7fcdb415e740 2024-09-16T01:21:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.011+0000 7fcdb3fff640 1 --2- 172.21.15.81:0/672406248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb415e740 0x7fcdb40d1540 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40691b0 tx=0x7fcda402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623a73214dd0d78a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.012+0000 7fcdb37fe640 1 -- 172.21.15.81:0/672406248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4037070 con 0x7fcdb415e740 2024-09-16T01:21:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.012+0000 7fcdb37fe640 1 -- 172.21.15.81:0/672406248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda4032440 con 0x7fcdb415e740 2024-09-16T01:21:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.012+0000 7fcdb37fe640 1 -- 172.21.15.81:0/672406248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4032810 con 0x7fcdb415e740 2024-09-16T01:21:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.012+0000 7fcdba9b0640 1 -- 172.21.15.81:0/672406248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb415e740 msgr2=0x7fcdb40d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.012+0000 7fcdba9b0640 1 --2- 172.21.15.81:0/672406248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb415e740 0x7fcdb40d1540 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40691b0 tx=0x7fcda402a2c0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.012+0000 7fcdba9b0640 1 -- 172.21.15.81:0/672406248 shutdown_connections 2024-09-16T01:21:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.012+0000 7fcdba9b0640 1 --2- 172.21.15.81:0/672406248 >> v2:172.21.15.102:3300/0 conn(0x7fcdb409b690 0x7fcdb406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.012+0000 7fcdba9b0640 1 --2- 172.21.15.81:0/672406248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb415e740 0x7fcdb40d1540 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.012+0000 7fcdba9b0640 1 -- 172.21.15.81:0/672406248 >> 172.21.15.81:0/672406248 conn(0x7fcdb40d23a0 msgr2=0x7fcdb40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.012+0000 7fcdba9b0640 1 -- 172.21.15.81:0/672406248 shutdown_connections 2024-09-16T01:21:38.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.012+0000 7fcdba9b0640 1 -- 172.21.15.81:0/672406248 wait complete. 2024-09-16T01:21:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.014+0000 7fcdba9b0640 1 Processor -- start 2024-09-16T01:21:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.014+0000 7fcdba9b0640 1 -- start start 2024-09-16T01:21:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.014+0000 7fcdba9b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb406d4c0 0x7fcdb40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.014+0000 7fcdba9b0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb409b690 0x7fcdb40b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.014+0000 7fcdba9b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb415e740 0x7fcdb4151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.014+0000 7fcdba9b0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb409bac0 con 0x7fcdb406d4c0 2024-09-16T01:21:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.014+0000 7fcdba9b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb40d1020 con 0x7fcdb415e740 2024-09-16T01:21:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.014+0000 7fcdba9b0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb406dfe0 con 0x7fcdb409b690 2024-09-16T01:21:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.014+0000 7fcdb3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb406d4c0 0x7fcdb40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.014+0000 7fcdb3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb406d4c0 0x7fcdb40c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37094/0 (socket says 172.21.15.81:37094) 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.014+0000 7fcdb3fff640 1 -- 172.21.15.81:0/4102527208 learned_addr learned my addr 172.21.15.81:0/4102527208 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.014+0000 7fcdb8f4d640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb415e740 0x7fcdb4151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdabfff640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb409b690 0x7fcdb40b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdb3fff640 1 -- 172.21.15.81:0/4102527208 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb409b690 msgr2=0x7fcdb40b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdb3fff640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb409b690 0x7fcdb40b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdb3fff640 1 -- 172.21.15.81:0/4102527208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb415e740 msgr2=0x7fcdb4151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdb3fff640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb415e740 0x7fcdb4151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdb3fff640 1 -- 172.21.15.81:0/4102527208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb40ca510 con 0x7fcdb406d4c0 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdb8f4d640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb415e740 0x7fcdb4151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdb3fff640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb406d4c0 0x7fcdb40c9e80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fcda4000c00 tx=0x7fcda40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdb17fa640 1 -- 172.21.15.81:0/4102527208 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4041070 con 0x7fcdb406d4c0 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdb17fa640 1 -- 172.21.15.81:0/4102527208 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcda403c870 con 0x7fcdb406d4c0 2024-09-16T01:21:38.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdba9b0640 1 -- 172.21.15.81:0/4102527208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb40ca7f0 con 0x7fcdb406d4c0 2024-09-16T01:21:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdb17fa640 1 -- 172.21.15.81:0/4102527208 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcda4037040 con 0x7fcdb406d4c0 2024-09-16T01:21:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.015+0000 7fcdba9b0640 1 -- 172.21.15.81:0/4102527208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb40cadb0 con 0x7fcdb406d4c0 2024-09-16T01:21:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.016+0000 7fcdba9b0640 1 -- 172.21.15.81:0/4102527208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb406cd20 con 0x7fcdb406d4c0 2024-09-16T01:21:38.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.017+0000 7fcdb17fa640 1 -- 172.21.15.81:0/4102527208 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcda4044070 con 0x7fcdb406d4c0 2024-09-16T01:21:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.017+0000 7fcdb17fa640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd9406c2e0 0x7fcd9406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.017+0000 7fcdb17fa640 1 -- 172.21.15.81:0/4102527208 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5249+0+0 (secure 0 0 0) 0x7fcda40abd80 con 0x7fcdb406d4c0 2024-09-16T01:21:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.017+0000 7fcdabfff640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd9406c2e0 0x7fcd9406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.018+0000 7fcdabfff640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd9406c2e0 0x7fcd9406e7a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40b7a60 tx=0x7fcd9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:38.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.021+0000 7fcdb17fa640 1 -- 172.21.15.81:0/4102527208 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcda407a740 con 0x7fcdb406d4c0 2024-09-16T01:21:38.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.250+0000 7fcdba9b0640 1 -- 172.21.15.81:0/4102527208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcdb40d1cb0 con 0x7fcdb406d4c0 2024-09-16T01:21:38.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.250+0000 7fcdb17fa640 1 -- 172.21.15.81:0/4102527208 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fcda407a040 con 0x7fcdb406d4c0 2024-09-16T01:21:38.252 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmx4OgCRAAkmpWDpuwqbDuz0taNg8bag==", 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-16T01:21:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmSNpLFRAAzc9Sr8b65zH9VZFYvqsYpA==", 2024-09-16T01:21:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:21:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:21:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-16T01:21:38.254 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmcCavEBAA0CuddD0zPcjqrMSOD5c6OA==", 2024-09-16T01:21:38.255 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:38.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:21:38.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:21:38.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.255 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-16T01:21:38.255 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmVeRcHBAANIL7HFYSc43qv7Zg0llkYQ==", 2024-09-16T01:21:38.255 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:38.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:21:38.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:21:38.256 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.257 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-16T01:21:38.257 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDhudmUtTqORAAkZKChid+qoa+0nIgpuun7g==", 2024-09-16T01:21:38.257 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:38.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:38.257 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.258 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-16T01:21:38.258 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCHhudmUhtiABAA2vDoACv8RJ2KD9p1cdKClA==", 2024-09-16T01:21:38.258 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:38.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:38.258 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.258 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-16T01:21:38.258 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCKhudmhOmRHxAAbGjJkUZLras/b6omekdz7A==", 2024-09-16T01:21:38.259 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:38.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:38.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.259 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-16T01:21:38.259 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCNhudmA+csIRAAW1kenpimaWIak/qgG+UeXw==", 2024-09-16T01:21:38.259 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCThudmvgQBLxAAWLto5pG0iyiQPSnxldWYwg==", 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCXhudmKfyiIhAALbJHvDeQtVgSCKjD1X3OYg==", 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-16T01:21:38.261 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCahudmPG/9JBAA6d/gK0K/5c9Gp4uKOLCCOw==", 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCdhudmVdY3NhAAXlOaeE0XidHVCaeQrirBAg==", 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.263 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-16T01:21:38.263 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg==", 2024-09-16T01:21:38.263 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:38.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-16T01:21:38.263 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T01:21:38.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmMgEhKRAAUD2kJ9eOFJscZ6ATlO5PmQ==", 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.264 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmwfD5JRAAPhdVLFZD07Uy75g3zStblg==", 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudm8/qzLhAAVFRbGhXH00h2LS9ZC9rraA==", 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:38.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:21:38.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:21:38.266 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:21:38.266 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.266 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-16T01:21:38.266 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/hudmBWr2KRAA/hELsRHNpxj3KqJbOSY74g==", 2024-09-16T01:21:38.266 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:21:38.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:21:38.266 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:21:38.267 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.267 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-16T01:21:38.267 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmRdtyBhAAMQngXCuTHg6AjACCw/SmCg==", 2024-09-16T01:21:38.267 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:21:38.267 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:21:38.267 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:38.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.268 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-16T01:21:38.268 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmqULCAhAAMbYmGXWGiINwif20O1JG3g==", 2024-09-16T01:21:38.268 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:38.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:21:38.268 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:21:38.268 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:38.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.268 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-16T01:21:38.268 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:21:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.252+0000 7fcdba9b0640 1 -- 172.21.15.81:0/4102527208 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd9406c2e0 msgr2=0x7fcd9406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.252+0000 7fcdba9b0640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd9406c2e0 0x7fcd9406e7a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40b7a60 tx=0x7fcd9c008040 comp rx=0 tx=0).stop 2024-09-16T01:21:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.252+0000 7fcdba9b0640 1 -- 172.21.15.81:0/4102527208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb406d4c0 msgr2=0x7fcdb40c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.252+0000 7fcdba9b0640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb406d4c0 0x7fcdb40c9e80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fcda4000c00 tx=0x7fcda40046c0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.252+0000 7fcdba9b0640 1 -- 172.21.15.81:0/4102527208 shutdown_connections 2024-09-16T01:21:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.252+0000 7fcdba9b0640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd9406c2e0 0x7fcd9406e7a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.252+0000 7fcdba9b0640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcdb415e740 0x7fcdb4151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.252+0000 7fcdba9b0640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcdb409b690 0x7fcdb40b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.252+0000 7fcdba9b0640 1 --2- 172.21.15.81:0/4102527208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdb406d4c0 0x7fcdb40c9e80 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.252+0000 7fcdba9b0640 1 -- 172.21.15.81:0/4102527208 >> 172.21.15.81:0/4102527208 conn(0x7fcdb40d23a0 msgr2=0x7fcdb40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.252+0000 7fcdba9b0640 1 -- 172.21.15.81:0/4102527208 shutdown_connections 2024-09-16T01:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.252+0000 7fcdba9b0640 1 -- 172.21.15.81:0/4102527208 wait complete. 2024-09-16T01:21:38.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:21:38.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.368+0000 7f37f9853640 1 Processor -- start 2024-09-16T01:21:38.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.368+0000 7f37f9853640 1 -- start start 2024-09-16T01:21:38.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.369+0000 7f37f9853640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f4161c80 0x7f37f406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.369+0000 7f37f9853640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f37f40b6680 0x7f37f40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.369+0000 7f37f9853640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37f406e870 con 0x7f37f4162060 2024-09-16T01:21:38.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.369+0000 7f37f9853640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f37f406d9f0 con 0x7f37f40b6680 2024-09-16T01:21:38.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.369+0000 7f37f9853640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f37f406dcd0 con 0x7f37f4161c80 2024-09-16T01:21:38.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.369+0000 7f37ea7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f37f4162060 0x7f37f40b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38036/0 (socket says 172.21.15.81:38036) 2024-09-16T01:21:38.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.369+0000 7f37ea7fc640 1 -- 172.21.15.81:0/2781768165 learned_addr learned my addr 172.21.15.81:0/2781768165 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:38.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.369+0000 7f37f2ffd640 1 --2- 172.21.15.81:0/2781768165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f4161c80 0x7f37f406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.369+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2832805543 0 0) 0x7f37dc001110 con 0x7f37f4162060 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.369+0000 7f37f37fe640 1 --2- 172.21.15.81:0/2781768165 >> v2:172.21.15.102:3300/0 conn(0x7f37f40b6680 0x7f37f40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.369+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37e0003520 con 0x7f37f4162060 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 967735123 0 0) 0x7f37e0003520 con 0x7f37f4162060 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f4161c80 msgr2=0x7f37f406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 --2- 172.21.15.81:0/2781768165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f4161c80 0x7f37f406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 >> v2:172.21.15.102:3300/0 conn(0x7f37f40b6680 msgr2=0x7f37f40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 --2- 172.21.15.81:0/2781768165 >> v2:172.21.15.102:3300/0 conn(0x7f37f40b6680 0x7f37f40cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f406dfb0 con 0x7f37f4162060 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f37dc001840 con 0x7f37f4162060 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 >> v1:172.21.15.81:6789/0 conn(0x7f37f4162060 legacy=0x7f37f40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 --2- 172.21.15.81:0/2781768165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37e00039b0 0x7f37e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 --2- 172.21.15.81:0/2781768165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f4161c80 0x7f37e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 --2- 172.21.15.81:0/2781768165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e0004d40 0x7f37e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37f406d9f0 con 0x7f37e0004d40 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f37f406dcd0 con 0x7f37e00039b0 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f37e000b9c0 con 0x7f37f4161c80 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f37fe640 1 --2- 172.21.15.81:0/2781768165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e0004d40 0x7f37e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f2ffd640 1 --2- 172.21.15.81:0/2781768165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37e00039b0 0x7f37e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37ea7fc640 1 --2- 172.21.15.81:0/2781768165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f4161c80 0x7f37e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f37fe640 1 -- 172.21.15.81:0/2781768165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f4161c80 msgr2=0x7f37e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f37fe640 1 --2- 172.21.15.81:0/2781768165 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f4161c80 0x7f37e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f37fe640 1 -- 172.21.15.81:0/2781768165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37e00039b0 msgr2=0x7f37e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f37fe640 1 --2- 172.21.15.81:0/2781768165 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37e00039b0 0x7f37e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.370+0000 7f37f37fe640 1 -- 172.21.15.81:0/2781768165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e0003520 con 0x7f37e0004d40 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.371+0000 7f37f37fe640 1 --2- 172.21.15.81:0/2781768165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e0004d40 0x7f37e00051c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009fc0 tx=0x7f37e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134f6a93387e9e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:38.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.371+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec009c10 con 0x7f37e0004d40 2024-09-16T01:21:38.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.371+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ec036070 con 0x7f37e0004d40 2024-09-16T01:21:38.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.371+0000 7f37f27fc640 1 -- 172.21.15.81:0/2781768165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ec02d070 con 0x7f37e0004d40 2024-09-16T01:21:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.372+0000 7f37f9853640 1 -- 172.21.15.81:0/2781768165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e0004d40 msgr2=0x7f37e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.372+0000 7f37f9853640 1 --2- 172.21.15.81:0/2781768165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e0004d40 0x7f37e00051c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f37ec009fc0 tx=0x7f37e0005830 comp rx=0 tx=0).stop 2024-09-16T01:21:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.372+0000 7f37f37fe640 1 -- 172.21.15.81:0/2781768165 reap_dead start 2024-09-16T01:21:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.372+0000 7f37f9853640 1 -- 172.21.15.81:0/2781768165 shutdown_connections 2024-09-16T01:21:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.372+0000 7f37f9853640 1 -- 172.21.15.81:0/2781768165 >> 172.21.15.81:0/2781768165 conn(0x7f37f40d44f0 msgr2=0x7f37f40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.372+0000 7f37f9853640 1 -- 172.21.15.81:0/2781768165 shutdown_connections 2024-09-16T01:21:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.372+0000 7f37f9853640 1 -- 172.21.15.81:0/2781768165 wait complete. 2024-09-16T01:21:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.373+0000 7f37f9853640 1 Processor -- start 2024-09-16T01:21:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.373+0000 7f37f9853640 1 -- start start 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f9853640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37e0004d40 0x7f37f41f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f9853640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37f40b8390 0x7f37f4157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f9853640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f40b92b0 0x7f37f4158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f9853640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37f40b6b30 con 0x7f37f40b8390 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f9853640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f37f40d2aa0 con 0x7f37e0004d40 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f9853640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f37f40b6cb0 con 0x7f37f40b92b0 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37ea7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37f40b8390 0x7f37f4157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37ea7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37f40b8390 0x7f37f4157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37106/0 (socket says 172.21.15.81:37106) 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37ea7fc640 1 -- 172.21.15.81:0/590671417 learned_addr learned my addr 172.21.15.81:0/590671417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f37fe640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f40b92b0 0x7f37f4158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f2ffd640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37e0004d40 0x7f37f41f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37ea7fc640 1 -- 172.21.15.81:0/590671417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f40b92b0 msgr2=0x7f37f4158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37ea7fc640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f40b92b0 0x7f37f4158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37ea7fc640 1 -- 172.21.15.81:0/590671417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37e0004d40 msgr2=0x7f37f41f4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37ea7fc640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37e0004d40 0x7f37f41f4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37ea7fc640 1 -- 172.21.15.81:0/590671417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f40b9d00 con 0x7f37f40b8390 2024-09-16T01:21:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f37fe640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f40b92b0 0x7f37f4158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f2ffd640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37e0004d40 0x7f37f41f4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37ea7fc640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37f40b8390 0x7f37f4157570 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f37dc000fb0 tx=0x7f37dc007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f0ff9640 1 -- 172.21.15.81:0/590671417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00f930 con 0x7f37f40b8390 2024-09-16T01:21:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f0ff9640 1 -- 172.21.15.81:0/590671417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc018070 con 0x7f37f40b8390 2024-09-16T01:21:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f9853640 1 -- 172.21.15.81:0/590671417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f40b9a20 con 0x7f37f40b8390 2024-09-16T01:21:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f0ff9640 1 -- 172.21.15.81:0/590671417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00fd50 con 0x7f37f40b8390 2024-09-16T01:21:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.374+0000 7f37f9853640 1 -- 172.21.15.81:0/590671417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f40cc540 con 0x7f37f40b8390 2024-09-16T01:21:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.375+0000 7f37f9853640 1 -- 172.21.15.81:0/590671417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f406e330 con 0x7f37f40b8390 2024-09-16T01:21:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.376+0000 7f37f0ff9640 1 -- 172.21.15.81:0/590671417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f37dc01d460 con 0x7f37f40b8390 2024-09-16T01:21:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.376+0000 7f37f0ff9640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f37d406c2b0 0x7f37d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.376+0000 7f37f0ff9640 1 -- 172.21.15.81:0/590671417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5249+0+0 (secure 0 0 0) 0x7f37dc08b3e0 con 0x7f37f40b8390 2024-09-16T01:21:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.376+0000 7f37f2ffd640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f37d406c2b0 0x7f37d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.377+0000 7f37f2ffd640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f37d406c2b0 0x7f37d406e770 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009a40 tx=0x7f37e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:38.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.381+0000 7f37f0ff9640 1 -- 172.21.15.81:0/590671417 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37f406e870 con 0x7f37f40b8390 2024-09-16T01:21:38.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.549+0000 7f37f9853640 1 -- 172.21.15.81:0/590671417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f37f40ba470 con 0x7f37f40b8390 2024-09-16T01:21:38.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.549+0000 7f37f0ff9640 1 -- 172.21.15.81:0/590671417 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) ==== 84+0+65 (secure 0 0 0) 0x7f37dc059d10 con 0x7f37f40b8390 2024-09-16T01:21:38.551 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:38.551 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-16T01:21:38.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:38.551 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-16T01:21:38.551 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-16T01:21:38.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:38.552 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-16T01:21:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.551+0000 7f37f9853640 1 -- 172.21.15.81:0/590671417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f37d406c2b0 msgr2=0x7f37d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.551+0000 7f37f9853640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f37d406c2b0 0x7f37d406e770 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009a40 tx=0x7f37e4008040 comp rx=0 tx=0).stop 2024-09-16T01:21:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.551+0000 7f37f9853640 1 -- 172.21.15.81:0/590671417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37f40b8390 msgr2=0x7f37f4157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.551+0000 7f37f9853640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37f40b8390 0x7f37f4157570 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f37dc000fb0 tx=0x7f37dc007720 comp rx=0 tx=0).stop 2024-09-16T01:21:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.551+0000 7f37f9853640 1 -- 172.21.15.81:0/590671417 shutdown_connections 2024-09-16T01:21:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.551+0000 7f37f9853640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f37d406c2b0 0x7f37d406e770 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.551+0000 7f37f9853640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f37f40b92b0 0x7f37f4158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.551+0000 7f37f9853640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37f40b8390 0x7f37f4157570 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.551+0000 7f37f9853640 1 --2- 172.21.15.81:0/590671417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37e0004d40 0x7f37f41f4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.551+0000 7f37f9853640 1 -- 172.21.15.81:0/590671417 >> 172.21.15.81:0/590671417 conn(0x7f37f40d44f0 msgr2=0x7f37f40cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.551+0000 7f37f9853640 1 -- 172.21.15.81:0/590671417 shutdown_connections 2024-09-16T01:21:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.551+0000 7f37f9853640 1 -- 172.21.15.81:0/590671417 wait complete. 2024-09-16T01:21:38.564 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:21:38.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:21:38.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.665+0000 7f2b31776640 1 Processor -- start 2024-09-16T01:21:38.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.665+0000 7f2b31776640 1 -- start start 2024-09-16T01:21:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b31776640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2b2c145f20 0x7f2b2c0d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b31776640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2b2c0d1480 0x7f2b2c0b2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b31776640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b2c0afa60 con 0x7f2b2c0b2960 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b31776640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2c0b2db0 con 0x7f2b2c0d1480 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b31776640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2c0d1a40 con 0x7f2b2c145f20 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b2a7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2b2c0d1480 0x7f2b2c0b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b2a7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2b2c0d1480 0x7f2b2c0b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37118/0 (socket says 172.21.15.81:37118) 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b2a7fc640 1 -- 172.21.15.81:0/2610695654 learned_addr learned my addr 172.21.15.81:0/2610695654 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b2affd640 1 --2- 172.21.15.81:0/2610695654 >> v2:172.21.15.102:3300/0 conn(0x7f2b2c145f20 0x7f2b2c0d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b2a7fc640 1 -- 172.21.15.81:0/2610695654 >> v2:172.21.15.102:3300/0 conn(0x7f2b2c145f20 msgr2=0x7f2b2c0d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b2a7fc640 1 --2- 172.21.15.81:0/2610695654 >> v2:172.21.15.102:3300/0 conn(0x7f2b2c145f20 0x7f2b2c0d0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b2a7fc640 1 -- 172.21.15.81:0/2610695654 >> v1:172.21.15.102:6789/0 conn(0x7f2b2c0b2960 legacy=0x7f2b2c15ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.666+0000 7f2b2a7fc640 1 -- 172.21.15.81:0/2610695654 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c0d1d20 con 0x7f2b2c0d1480 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.667+0000 7f2b2a7fc640 1 --2- 172.21.15.81:0/2610695654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c0d1480 0x7f2b2c0b2420 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c074050 tx=0x7f2b2002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ea5385b67d2ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.667+0000 7f2b29ffb640 1 -- 172.21.15.81:0/2610695654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20037070 con 0x7f2b2c0d1480 2024-09-16T01:21:38.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.667+0000 7f2b29ffb640 1 -- 172.21.15.81:0/2610695654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b20032440 con 0x7f2b2c0d1480 2024-09-16T01:21:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.667+0000 7f2b29ffb640 1 -- 172.21.15.81:0/2610695654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20032810 con 0x7f2b2c0d1480 2024-09-16T01:21:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.668+0000 7f2b31776640 1 -- 172.21.15.81:0/2610695654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c0d1480 msgr2=0x7f2b2c0b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.668+0000 7f2b31776640 1 --2- 172.21.15.81:0/2610695654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c0d1480 0x7f2b2c0b2420 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c074050 tx=0x7f2b2002a1a0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.668+0000 7f2b31776640 1 -- 172.21.15.81:0/2610695654 shutdown_connections 2024-09-16T01:21:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.668+0000 7f2b31776640 1 --2- 172.21.15.81:0/2610695654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c0d1480 0x7f2b2c0b2420 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.668+0000 7f2b31776640 1 --2- 172.21.15.81:0/2610695654 >> v2:172.21.15.102:3300/0 conn(0x7f2b2c145f20 0x7f2b2c0d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.668+0000 7f2b31776640 1 -- 172.21.15.81:0/2610695654 >> 172.21.15.81:0/2610695654 conn(0x7f2b2c09aa30 msgr2=0x7f2b2c0b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.668+0000 7f2b31776640 1 -- 172.21.15.81:0/2610695654 shutdown_connections 2024-09-16T01:21:38.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.668+0000 7f2b31776640 1 -- 172.21.15.81:0/2610695654 wait complete. 2024-09-16T01:21:38.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.669+0000 7f2b31776640 1 Processor -- start 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.669+0000 7f2b31776640 1 -- start start 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b31776640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b2c0b2960 0x7f2b2c13fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b31776640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b2c0d1480 0x7f2b2c1f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b31776640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c145f20 0x7f2b2c13f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b31776640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c06bde0 con 0x7f2b2c145f20 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b31776640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c0d2000 con 0x7f2b2c0b2960 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b31776640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2c06bf60 con 0x7f2b2c0d1480 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b2b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c145f20 0x7f2b2c13f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b2b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c145f20 0x7f2b2c13f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37132/0 (socket says 172.21.15.81:37132) 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b2b7fe640 1 -- 172.21.15.81:0/2706282636 learned_addr learned my addr 172.21.15.81:0/2706282636 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b2affd640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b2c0b2960 0x7f2b2c13fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b2a7fc640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b2c0d1480 0x7f2b2c1f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b2b7fe640 1 -- 172.21.15.81:0/2706282636 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b2c0d1480 msgr2=0x7f2b2c1f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b2b7fe640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b2c0d1480 0x7f2b2c1f24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b2b7fe640 1 -- 172.21.15.81:0/2706282636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b2c0b2960 msgr2=0x7f2b2c13fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b2b7fe640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b2c0b2960 0x7f2b2c13fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b2b7fe640 1 -- 172.21.15.81:0/2706282636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c140110 con 0x7f2b2c145f20 2024-09-16T01:21:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.670+0000 7f2b2b7fe640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c145f20 0x7f2b2c13f280 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c780 tx=0x7f2b2400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.671+0000 7f2b137fe640 1 -- 172.21.15.81:0/2706282636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b24004b60 con 0x7f2b2c145f20 2024-09-16T01:21:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.671+0000 7f2b137fe640 1 -- 172.21.15.81:0/2706282636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b24004d00 con 0x7f2b2c145f20 2024-09-16T01:21:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.671+0000 7f2b31776640 1 -- 172.21.15.81:0/2706282636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2c1403f0 con 0x7f2b2c145f20 2024-09-16T01:21:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.671+0000 7f2b137fe640 1 -- 172.21.15.81:0/2706282636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400aa90 con 0x7f2b2c145f20 2024-09-16T01:21:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.671+0000 7f2b31776640 1 -- 172.21.15.81:0/2706282636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2c1409b0 con 0x7f2b2c145f20 2024-09-16T01:21:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.672+0000 7f2b31776640 1 -- 172.21.15.81:0/2706282636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b2c0b2420 con 0x7f2b2c145f20 2024-09-16T01:21:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.672+0000 7f2b137fe640 1 -- 172.21.15.81:0/2706282636 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2b2400ac30 con 0x7f2b2c145f20 2024-09-16T01:21:38.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.673+0000 7f2b137fe640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2b1806c2b0 0x7f2b1806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:38.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.673+0000 7f2b137fe640 1 -- 172.21.15.81:0/2706282636 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5249+0+0 (secure 0 0 0) 0x7f2b2408b410 con 0x7f2b2c145f20 2024-09-16T01:21:38.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.673+0000 7f2b2affd640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2b1806c2b0 0x7f2b1806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:38.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.673+0000 7f2b2affd640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2b1806c2b0 0x7f2b1806e770 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c13f0c0 tx=0x7f2b1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:38.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.677+0000 7f2b137fe640 1 -- 172.21.15.81:0/2706282636 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b24020070 con 0x7f2b2c145f20 2024-09-16T01:21:38.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.843+0000 7f2b31776640 1 -- 172.21.15.81:0/2706282636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2b2c1432d0 con 0x7f2b2c145f20 2024-09-16T01:21:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.896+0000 7f2b137fe640 1 -- 172.21.15.81:0/2706282636 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v98) ==== 138+0+0 (secure 0 0 0) 0x7f2b240596f0 con 0x7f2b2c145f20 2024-09-16T01:21:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-16T01:21:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.899+0000 7f2b31776640 1 -- 172.21.15.81:0/2706282636 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2b1806c2b0 msgr2=0x7f2b1806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.899+0000 7f2b31776640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2b1806c2b0 0x7f2b1806e770 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c13f0c0 tx=0x7f2b1c008040 comp rx=0 tx=0).stop 2024-09-16T01:21:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.899+0000 7f2b31776640 1 -- 172.21.15.81:0/2706282636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c145f20 msgr2=0x7f2b2c13f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.899+0000 7f2b31776640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c145f20 0x7f2b2c13f280 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c780 tx=0x7f2b2400cc40 comp rx=0 tx=0).stop 2024-09-16T01:21:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.899+0000 7f2b31776640 1 -- 172.21.15.81:0/2706282636 shutdown_connections 2024-09-16T01:21:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.899+0000 7f2b31776640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2b1806c2b0 0x7f2b1806e770 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.899+0000 7f2b31776640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c145f20 0x7f2b2c13f280 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.899+0000 7f2b31776640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b2c0d1480 0x7f2b2c1f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.899+0000 7f2b31776640 1 --2- 172.21.15.81:0/2706282636 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b2c0b2960 0x7f2b2c13fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:38.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.899+0000 7f2b31776640 1 -- 172.21.15.81:0/2706282636 >> 172.21.15.81:0/2706282636 conn(0x7f2b2c09aa30 msgr2=0x7f2b2c1441c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:38.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.899+0000 7f2b31776640 1 -- 172.21.15.81:0/2706282636 shutdown_connections 2024-09-16T01:21:38.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:38.900+0000 7f2b31776640 1 -- 172.21.15.81:0/2706282636 wait complete. 2024-09-16T01:21:38.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:21:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.020+0000 7fb8b683c640 1 Processor -- start 2024-09-16T01:21:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.020+0000 7fb8b683c640 1 -- start start 2024-09-16T01:21:39.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.021+0000 7fb8b683c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8b00af210 0x7fb8b0070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:39.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.021+0000 7fb8b683c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b006cdc0 con 0x7fb8b015e7f0 2024-09-16T01:21:39.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.021+0000 7fb8b683c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8b006d0a0 con 0x7fb8b0070fb0 2024-09-16T01:21:39.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.021+0000 7fb8b683c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb8b0071420 con 0x7fb8b00af210 2024-09-16T01:21:39.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.021+0000 7fb8af7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8b00af210 0x7fb8b0070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:39.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.021+0000 7fb8affff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb8b015e7f0 0x7fb8b00b6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38040/0 (socket says 172.21.15.81:38040) 2024-09-16T01:21:39.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.021+0000 7fb8affff640 1 -- 172.21.15.81:0/670858952 learned_addr learned my addr 172.21.15.81:0/670858952 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:39.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.022+0000 7fb8af7fe640 1 -- 172.21.15.81:0/670858952 >> v1:172.21.15.102:6789/0 conn(0x7fb8b0070fb0 legacy=0x7fb8b006de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:39.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.022+0000 7fb8af7fe640 1 -- 172.21.15.81:0/670858952 >> v1:172.21.15.81:6789/0 conn(0x7fb8b015e7f0 legacy=0x7fb8b00b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:39.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.022+0000 7fb8af7fe640 1 -- 172.21.15.81:0/670858952 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b006d380 con 0x7fb8b00af210 2024-09-16T01:21:39.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.022+0000 7fb8aeffd640 1 -- 172.21.15.81:0/670858952 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040825797 0 0) 0x7fb8b006cdc0 con 0x7fb8b015e7f0 2024-09-16T01:21:39.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.022+0000 7fb8af7fe640 1 --2- 172.21.15.81:0/670858952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b00af210 0x7fb8b0070a70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40097a0 tx=0x7fb8a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad2adcaefd67107 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:39.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.022+0000 7fb8aeffd640 1 -- 172.21.15.81:0/670858952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4037070 con 0x7fb8b00af210 2024-09-16T01:21:39.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.023+0000 7fb8aeffd640 1 -- 172.21.15.81:0/670858952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a4032440 con 0x7fb8b00af210 2024-09-16T01:21:39.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.023+0000 7fb8aeffd640 1 -- 172.21.15.81:0/670858952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4032810 con 0x7fb8b00af210 2024-09-16T01:21:39.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.023+0000 7fb8b683c640 1 -- 172.21.15.81:0/670858952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b00af210 msgr2=0x7fb8b0070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:39.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.023+0000 7fb8b683c640 1 --2- 172.21.15.81:0/670858952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b00af210 0x7fb8b0070a70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40097a0 tx=0x7fb8a402a1e0 comp rx=0 tx=0).stop 2024-09-16T01:21:39.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.023+0000 7fb8b683c640 1 -- 172.21.15.81:0/670858952 shutdown_connections 2024-09-16T01:21:39.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.023+0000 7fb8b683c640 1 --2- 172.21.15.81:0/670858952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b00af210 0x7fb8b0070a70 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:39.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.023+0000 7fb8b683c640 1 -- 172.21.15.81:0/670858952 >> 172.21.15.81:0/670858952 conn(0x7fb8b00b3f30 msgr2=0x7fb8b00b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:39.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.023+0000 7fb8b683c640 1 -- 172.21.15.81:0/670858952 shutdown_connections 2024-09-16T01:21:39.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.023+0000 7fb8b683c640 1 -- 172.21.15.81:0/670858952 wait complete. 2024-09-16T01:21:39.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.024+0000 7fb8b683c640 1 Processor -- start 2024-09-16T01:21:39.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.025+0000 7fb8b683c640 1 -- start start 2024-09-16T01:21:39.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.025+0000 7fb8b683c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b0070fb0 0x7fb8b01522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:39.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.025+0000 7fb8b683c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b00af210 0x7fb8b0154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.025+0000 7fb8b683c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b015e7f0 0x7fb8b00cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.025+0000 7fb8b683c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b00b5f40 con 0x7fb8b0070fb0 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.025+0000 7fb8b683c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b00b7420 con 0x7fb8b00af210 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.025+0000 7fb8b683c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb8b00b60c0 con 0x7fb8b015e7f0 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.025+0000 7fb8affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b0070fb0 0x7fb8b01522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.025+0000 7fb8affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b0070fb0 0x7fb8b01522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37148/0 (socket says 172.21.15.81:37148) 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.025+0000 7fb8affff640 1 -- 172.21.15.81:0/1611714705 learned_addr learned my addr 172.21.15.81:0/1611714705 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.025+0000 7fb8af7fe640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b00af210 0x7fb8b0154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8b4dd9640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b015e7f0 0x7fb8b00cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8affff640 1 -- 172.21.15.81:0/1611714705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b015e7f0 msgr2=0x7fb8b00cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8affff640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b015e7f0 0x7fb8b00cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8affff640 1 -- 172.21.15.81:0/1611714705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b00af210 msgr2=0x7fb8b0154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8affff640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b00af210 0x7fb8b0154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:39.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8affff640 1 -- 172.21.15.81:0/1611714705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b0152830 con 0x7fb8b0070fb0 2024-09-16T01:21:39.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8b4dd9640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b015e7f0 0x7fb8b00cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:39.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8affff640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b0070fb0 0x7fb8b01522f0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000c4d0 tx=0x7fb8a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:39.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8acff9640 1 -- 172.21.15.81:0/1611714705 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0018070 con 0x7fb8b0070fb0 2024-09-16T01:21:39.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8acff9640 1 -- 172.21.15.81:0/1611714705 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8a0007500 con 0x7fb8b0070fb0 2024-09-16T01:21:39.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8b683c640 1 -- 172.21.15.81:0/1611714705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b0153bc0 con 0x7fb8b0070fb0 2024-09-16T01:21:39.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8acff9640 1 -- 172.21.15.81:0/1611714705 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0004a20 con 0x7fb8b0070fb0 2024-09-16T01:21:39.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.026+0000 7fb8b683c640 1 -- 172.21.15.81:0/1611714705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b01e9510 con 0x7fb8b0070fb0 2024-09-16T01:21:39.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.027+0000 7fb8b683c640 1 -- 172.21.15.81:0/1611714705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8b0070a70 con 0x7fb8b0070fb0 2024-09-16T01:21:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.028+0000 7fb8acff9640 1 -- 172.21.15.81:0/1611714705 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb8a001b070 con 0x7fb8b0070fb0 2024-09-16T01:21:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.028+0000 7fb8acff9640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb89c06c2e0 0x7fb89c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.028+0000 7fb8acff9640 1 -- 172.21.15.81:0/1611714705 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5619+0+0 (secure 0 0 0) 0x7fb8a008a680 con 0x7fb8b0070fb0 2024-09-16T01:21:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.028+0000 7fb8af7fe640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb89c06c2e0 0x7fb89c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.029+0000 7fb8af7fe640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb89c06c2e0 0x7fb89c06e7a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4034000 tx=0x7fb8a402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:39.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.033+0000 7fb8acff9640 1 -- 172.21.15.81:0/1611714705 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8b0152830 con 0x7fb8b0070fb0 2024-09-16T01:21:39.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.200+0000 7fb8b683c640 1 -- 172.21.15.81:0/1611714705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb8b00b0f00 con 0x7fb8b0070fb0 2024-09-16T01:21:39.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:21:39.237 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:21:39.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.901+0000 7fb8acff9640 1 -- 172.21.15.81:0/1611714705 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v99) ==== 170+0+0 (secure 0 0 0) 0x7fb8a00587f0 con 0x7fb8b0070fb0 2024-09-16T01:21:39.903 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-16T01:21:39.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.904+0000 7fb8b683c640 1 -- 172.21.15.81:0/1611714705 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb89c06c2e0 msgr2=0x7fb89c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:39.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.904+0000 7fb8b683c640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb89c06c2e0 0x7fb89c06e7a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4034000 tx=0x7fb8a402e000 comp rx=0 tx=0).stop 2024-09-16T01:21:39.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.904+0000 7fb8b683c640 1 -- 172.21.15.81:0/1611714705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b0070fb0 msgr2=0x7fb8b01522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:39.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.904+0000 7fb8b683c640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b0070fb0 0x7fb8b01522f0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000c4d0 tx=0x7fb8a000c990 comp rx=0 tx=0).stop 2024-09-16T01:21:39.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.904+0000 7fb8b683c640 1 -- 172.21.15.81:0/1611714705 shutdown_connections 2024-09-16T01:21:39.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.904+0000 7fb8b683c640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb89c06c2e0 0x7fb89c06e7a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:39.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.904+0000 7fb8b683c640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8b015e7f0 0x7fb8b00cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:39.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.904+0000 7fb8b683c640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8b00af210 0x7fb8b0154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:39.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.904+0000 7fb8b683c640 1 --2- 172.21.15.81:0/1611714705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8b0070fb0 0x7fb8b01522f0 secure :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000c4d0 tx=0x7fb8a000c990 comp rx=0 tx=0).stop 2024-09-16T01:21:39.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.904+0000 7fb8b683c640 1 -- 172.21.15.81:0/1611714705 >> 172.21.15.81:0/1611714705 conn(0x7fb8b00b3f30 msgr2=0x7fb8b00af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:39.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.905+0000 7fb8b683c640 1 -- 172.21.15.81:0/1611714705 shutdown_connections 2024-09-16T01:21:39.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:39.905+0000 7fb8b683c640 1 -- 172.21.15.81:0/1611714705 wait complete. 2024-09-16T01:21:39.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:21:40.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.031+0000 7fd1d153b640 1 Processor -- start 2024-09-16T01:21:40.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.031+0000 7fd1d153b640 1 -- start start 2024-09-16T01:21:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.032+0000 7fd1d153b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc0cfc00 0x7fd1cc0ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.032+0000 7fd1d153b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1cc0b30e0 con 0x7fd1cc156740 2024-09-16T01:21:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.032+0000 7fd1d153b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1cc0b33c0 con 0x7fd1cc0cf790 2024-09-16T01:21:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.032+0000 7fd1d153b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd1cc06edc0 con 0x7fd1cc0cfc00 2024-09-16T01:21:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.032+0000 7fd1caffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd1cc156740 0x7fd1cc0b45b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38054/0 (socket says 172.21.15.81:38054) 2024-09-16T01:21:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.032+0000 7fd1caffd640 1 -- 172.21.15.81:0/2363281355 learned_addr learned my addr 172.21.15.81:0/2363281355 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.032+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322078552 0 0) 0x7fd1cc0b30e0 con 0x7fd1cc156740 2024-09-16T01:21:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.032+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1b8003520 con 0x7fd1cc156740 2024-09-16T01:21:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.032+0000 7fd1cb7fe640 1 --2- 172.21.15.81:0/2363281355 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc0cfc00 0x7fd1cc0ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 509545829 0 0) 0x7fd1b8003520 con 0x7fd1cc156740 2024-09-16T01:21:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc0cfc00 msgr2=0x7fd1cc0ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 --2- 172.21.15.81:0/2363281355 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc0cfc00 0x7fd1cc0ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 >> v1:172.21.15.102:6789/0 conn(0x7fd1cc0cf790 legacy=0x7fd1cc0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1cc0b36a0 con 0x7fd1cc156740 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fd1bc001690 con 0x7fd1cc156740 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 >> v1:172.21.15.81:6789/0 conn(0x7fd1cc156740 legacy=0x7fd1cc0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 --2- 172.21.15.81:0/2363281355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b80039e0 0x7fd1b8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 --2- 172.21.15.81:0/2363281355 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc0cfc00 0x7fd1b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 --2- 172.21.15.81:0/2363281355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b8004d40 0x7fd1b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc06edc0 con 0x7fd1b8004d40 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b800ba70 con 0x7fd1b80039e0 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b800bc70 con 0x7fd1cc0cfc00 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1cb7fe640 1 --2- 172.21.15.81:0/2363281355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b8004d40 0x7fd1b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:40.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1c3fff640 1 --2- 172.21.15.81:0/2363281355 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc0cfc00 0x7fd1b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1caffd640 1 --2- 172.21.15.81:0/2363281355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b80039e0 0x7fd1b8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1cb7fe640 1 -- 172.21.15.81:0/2363281355 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc0cfc00 msgr2=0x7fd1b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1cb7fe640 1 --2- 172.21.15.81:0/2363281355 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc0cfc00 0x7fd1b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1cb7fe640 1 -- 172.21.15.81:0/2363281355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b80039e0 msgr2=0x7fd1b8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1cb7fe640 1 --2- 172.21.15.81:0/2363281355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b80039e0 0x7fd1b8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.033+0000 7fd1cb7fe640 1 -- 172.21.15.81:0/2363281355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b8003520 con 0x7fd1b8004d40 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.034+0000 7fd1cb7fe640 1 --2- 172.21.15.81:0/2363281355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b8004d40 0x7fd1b80051c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009f90 tx=0x7fd1b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39322a6cb436c87a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.034+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4009c10 con 0x7fd1b8004d40 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.034+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c4036070 con 0x7fd1b8004d40 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.034+0000 7fd1ca7fc640 1 -- 172.21.15.81:0/2363281355 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4031850 con 0x7fd1b8004d40 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.035+0000 7fd1d153b640 1 -- 172.21.15.81:0/2363281355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b8004d40 msgr2=0x7fd1b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.035+0000 7fd1d153b640 1 --2- 172.21.15.81:0/2363281355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b8004d40 0x7fd1b80051c0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009f90 tx=0x7fd1b8005830 comp rx=0 tx=0).stop 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.035+0000 7fd1cb7fe640 1 -- 172.21.15.81:0/2363281355 reap_dead start 2024-09-16T01:21:40.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.035+0000 7fd1d153b640 1 -- 172.21.15.81:0/2363281355 shutdown_connections 2024-09-16T01:21:40.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.035+0000 7fd1d153b640 1 -- 172.21.15.81:0/2363281355 >> 172.21.15.81:0/2363281355 conn(0x7fd1cc06bdf0 msgr2=0x7fd1cc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:40.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.035+0000 7fd1d153b640 1 -- 172.21.15.81:0/2363281355 shutdown_connections 2024-09-16T01:21:40.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.035+0000 7fd1d153b640 1 -- 172.21.15.81:0/2363281355 wait complete. 2024-09-16T01:21:40.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.036+0000 7fd1d153b640 1 Processor -- start 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.036+0000 7fd1d153b640 1 -- start start 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1d153b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b8004d40 0x7fd1cc146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1d153b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc14bc70 0x7fd1cc14c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1d153b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1cc1f2480 0x7fd1cc1f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1d153b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc0b4cc0 con 0x7fd1cc1f2480 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1d153b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc0b3c60 con 0x7fd1b8004d40 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1d153b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd1cc0d0070 con 0x7fd1cc14bc70 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1cb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1cc1f2480 0x7fd1cc1f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1cb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1cc1f2480 0x7fd1cc1f2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37170/0 (socket says 172.21.15.81:37170) 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1cb7fe640 1 -- 172.21.15.81:0/2501060989 learned_addr learned my addr 172.21.15.81:0/2501060989 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1caffd640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b8004d40 0x7fd1cc146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1c3fff640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc14bc70 0x7fd1cc14c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:40.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1cb7fe640 1 -- 172.21.15.81:0/2501060989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc14bc70 msgr2=0x7fd1cc14c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1cb7fe640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc14bc70 0x7fd1cc14c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1cb7fe640 1 -- 172.21.15.81:0/2501060989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b8004d40 msgr2=0x7fd1cc146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1cb7fe640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b8004d40 0x7fd1cc146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1cb7fe640 1 -- 172.21.15.81:0/2501060989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1cc0af690 con 0x7fd1cc1f2480 2024-09-16T01:21:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1cb7fe640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1cc1f2480 0x7fd1cc1f2900 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd1c402aeb0 tx=0x7fd1c4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1c37fe640 1 -- 172.21.15.81:0/2501060989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4003b90 con 0x7fd1cc1f2480 2024-09-16T01:21:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1c37fe640 1 -- 172.21.15.81:0/2501060989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c4040030 con 0x7fd1cc1f2480 2024-09-16T01:21:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1d153b640 1 -- 172.21.15.81:0/2501060989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1cc1f31b0 con 0x7fd1cc1f2480 2024-09-16T01:21:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.037+0000 7fd1c37fe640 1 -- 172.21.15.81:0/2501060989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4004020 con 0x7fd1cc1f2480 2024-09-16T01:21:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.038+0000 7fd1d153b640 1 -- 172.21.15.81:0/2501060989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1cc0afc30 con 0x7fd1cc1f2480 2024-09-16T01:21:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.039+0000 7fd1d153b640 1 -- 172.21.15.81:0/2501060989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1cc14c630 con 0x7fd1cc1f2480 2024-09-16T01:21:40.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.039+0000 7fd1c37fe640 1 -- 172.21.15.81:0/2501060989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd1c4005d10 con 0x7fd1cc1f2480 2024-09-16T01:21:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.040+0000 7fd1c37fe640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd1ac06c2e0 0x7fd1ac06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.040+0000 7fd1caffd640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd1ac06c2e0 0x7fd1ac06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.040+0000 7fd1c37fe640 1 -- 172.21.15.81:0/2501060989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 6001+0+0 (secure 0 0 0) 0x7fd1c40ac8a0 con 0x7fd1cc1f2480 2024-09-16T01:21:40.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.040+0000 7fd1caffd640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd1ac06c2e0 0x7fd1ac06e7a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0b4120 tx=0x7fd1bc007bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:40.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.044+0000 7fd1c37fe640 1 -- 172.21.15.81:0/2501060989 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1c404a020 con 0x7fd1cc1f2480 2024-09-16T01:21:40.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.251+0000 7fd1d153b640 1 -- 172.21.15.81:0/2501060989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd1cc068f50 con 0x7fd1cc1f2480 2024-09-16T01:21:40.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.903+0000 7fd1c37fe640 1 -- 172.21.15.81:0/2501060989 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v50) ==== 174+0+0 (secure 0 0 0) 0x7fd1cc068f50 con 0x7fd1cc1f2480 2024-09-16T01:21:40.905 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 15 and data pool 16 2024-09-16T01:21:40.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.906+0000 7fd1d153b640 1 -- 172.21.15.81:0/2501060989 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd1ac06c2e0 msgr2=0x7fd1ac06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:40.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.907+0000 7fd1d153b640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd1ac06c2e0 0x7fd1ac06e7a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0b4120 tx=0x7fd1bc007bf0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.907+0000 7fd1d153b640 1 -- 172.21.15.81:0/2501060989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1cc1f2480 msgr2=0x7fd1cc1f2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:40.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.907+0000 7fd1d153b640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1cc1f2480 0x7fd1cc1f2900 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd1c402aeb0 tx=0x7fd1c4009750 comp rx=0 tx=0).stop 2024-09-16T01:21:40.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.907+0000 7fd1d153b640 1 -- 172.21.15.81:0/2501060989 shutdown_connections 2024-09-16T01:21:40.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.907+0000 7fd1d153b640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd1ac06c2e0 0x7fd1ac06e7a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.907+0000 7fd1d153b640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1cc1f2480 0x7fd1cc1f2900 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.907+0000 7fd1d153b640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1cc14bc70 0x7fd1cc14c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.907+0000 7fd1d153b640 1 --2- 172.21.15.81:0/2501060989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b8004d40 0x7fd1cc146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:40.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.907+0000 7fd1d153b640 1 -- 172.21.15.81:0/2501060989 >> 172.21.15.81:0/2501060989 conn(0x7fd1cc06bdf0 msgr2=0x7fd1cc0cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:40.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.907+0000 7fd1d153b640 1 -- 172.21.15.81:0/2501060989 shutdown_connections 2024-09-16T01:21:40.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:40.907+0000 7fd1d153b640 1 -- 172.21.15.81:0/2501060989 wait complete. 2024-09-16T01:21:40.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:21:41.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.038+0000 7f9a9ab23640 1 Processor -- start 2024-09-16T01:21:41.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.038+0000 7f9a9ab23640 1 -- start start 2024-09-16T01:21:41.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.039+0000 7f9a9ab23640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a940afd70 0x7f9a94160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.039+0000 7f9a9ab23640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a940b5f80 0x7f9a940b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.039+0000 7f9a9ab23640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a940b68e0 con 0x7f9a9406e7d0 2024-09-16T01:21:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.039+0000 7f9a9ab23640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9a94160d60 con 0x7f9a940afd70 2024-09-16T01:21:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.039+0000 7f9a9ab23640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9406fdb0 con 0x7f9a940b5f80 2024-09-16T01:21:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.039+0000 7f9a988bf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a940afd70 0x7f9a94160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.039+0000 7f9a990c0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9a9406e7d0 0x7f9a9406ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49092/0 (socket says 172.21.15.81:49092) 2024-09-16T01:21:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.039+0000 7f9a990c0640 1 -- 172.21.15.81:0/3085257060 learned_addr learned my addr 172.21.15.81:0/3085257060 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.039+0000 7f9a93fff640 1 --2- 172.21.15.81:0/3085257060 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a940b5f80 0x7f9a940b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.040+0000 7f9a988bf640 1 -- 172.21.15.81:0/3085257060 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a940b5f80 msgr2=0x7f9a940b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.040+0000 7f9a988bf640 1 --2- 172.21.15.81:0/3085257060 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a940b5f80 0x7f9a940b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.040+0000 7f9a988bf640 1 -- 172.21.15.81:0/3085257060 >> v1:172.21.15.81:6789/0 conn(0x7f9a9406e7d0 legacy=0x7f9a9406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.040+0000 7f9a937fe640 1 -- 172.21.15.81:0/3085257060 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236641694 0 0) 0x7f9a940b68e0 con 0x7f9a9406e7d0 2024-09-16T01:21:41.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.040+0000 7f9a988bf640 1 -- 172.21.15.81:0/3085257060 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a94070090 con 0x7f9a940afd70 2024-09-16T01:21:41.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.040+0000 7f9a988bf640 1 --2- 172.21.15.81:0/3085257060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a940afd70 0x7f9a94160820 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f9a840097a0 tx=0x7f9a8402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c336023910ca566 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:41.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.040+0000 7f9a937fe640 1 -- 172.21.15.81:0/3085257060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84037070 con 0x7f9a940afd70 2024-09-16T01:21:41.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.040+0000 7f9a937fe640 1 -- 172.21.15.81:0/3085257060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a84032440 con 0x7f9a940afd70 2024-09-16T01:21:41.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.040+0000 7f9a937fe640 1 -- 172.21.15.81:0/3085257060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84032810 con 0x7f9a940afd70 2024-09-16T01:21:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.041+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3085257060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a940afd70 msgr2=0x7f9a94160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.041+0000 7f9a9ab23640 1 --2- 172.21.15.81:0/3085257060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a940afd70 0x7f9a94160820 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f9a840097a0 tx=0x7f9a8402a180 comp rx=0 tx=0).stop 2024-09-16T01:21:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.041+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3085257060 shutdown_connections 2024-09-16T01:21:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.041+0000 7f9a9ab23640 1 --2- 172.21.15.81:0/3085257060 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a940b5f80 0x7f9a940b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.041+0000 7f9a9ab23640 1 --2- 172.21.15.81:0/3085257060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a940afd70 0x7f9a94160820 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.041+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3085257060 >> 172.21.15.81:0/3085257060 conn(0x7f9a9406bc10 msgr2=0x7f9a9406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.041+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3085257060 shutdown_connections 2024-09-16T01:21:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.041+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3085257060 wait complete. 2024-09-16T01:21:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.042+0000 7f9a9ab23640 1 Processor -- start 2024-09-16T01:21:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.042+0000 7f9a9ab23640 1 -- start start 2024-09-16T01:21:41.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a9ab23640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a9406e7d0 0x7f9a941f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a9ab23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a940afd70 0x7f9a94151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a9ab23640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a940b5f80 0x7f9a941516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a9ab23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9406fa80 con 0x7f9a940afd70 2024-09-16T01:21:41.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a9ab23640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9a94070650 con 0x7f9a9406e7d0 2024-09-16T01:21:41.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a9ab23640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a940b0150 con 0x7f9a940b5f80 2024-09-16T01:21:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a940afd70 0x7f9a94151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a93fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a940afd70 0x7f9a94151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34620/0 (socket says 172.21.15.81:34620) 2024-09-16T01:21:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a93fff640 1 -- 172.21.15.81:0/3310820922 learned_addr learned my addr 172.21.15.81:0/3310820922 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a988bf640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a9406e7d0 0x7f9a941f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a990c0640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a940b5f80 0x7f9a941516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a93fff640 1 -- 172.21.15.81:0/3310820922 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a940b5f80 msgr2=0x7f9a941516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a93fff640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a940b5f80 0x7f9a941516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a93fff640 1 -- 172.21.15.81:0/3310820922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a9406e7d0 msgr2=0x7f9a941f4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.043+0000 7f9a93fff640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a9406e7d0 0x7f9a941f4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.044+0000 7f9a93fff640 1 -- 172.21.15.81:0/3310820922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a940af1f0 con 0x7f9a940afd70 2024-09-16T01:21:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.044+0000 7f9a990c0640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a940b5f80 0x7f9a941516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.044+0000 7f9a93fff640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a940afd70 0x7f9a94151180 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800d5d0 tx=0x7f9a8800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.044+0000 7f9a917fa640 1 -- 172.21.15.81:0/3310820922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a88004240 con 0x7f9a940afd70 2024-09-16T01:21:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.044+0000 7f9a917fa640 1 -- 172.21.15.81:0/3310820922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a880043e0 con 0x7f9a940afd70 2024-09-16T01:21:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.044+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3310820922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a940ae430 con 0x7f9a940afd70 2024-09-16T01:21:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.044+0000 7f9a917fa640 1 -- 172.21.15.81:0/3310820922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a88003830 con 0x7f9a940afd70 2024-09-16T01:21:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.044+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3310820922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a940ae9f0 con 0x7f9a940afd70 2024-09-16T01:21:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.045+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3310820922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a94160060 con 0x7f9a940afd70 2024-09-16T01:21:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.045+0000 7f9a917fa640 1 -- 172.21.15.81:0/3310820922 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a880039d0 con 0x7f9a940afd70 2024-09-16T01:21:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.046+0000 7f9a917fa640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a8006c2b0 0x7f9a8006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.046+0000 7f9a917fa640 1 -- 172.21.15.81:0/3310820922 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f9a8808b7d0 con 0x7f9a940afd70 2024-09-16T01:21:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.046+0000 7f9a988bf640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a8006c2b0 0x7f9a8006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.046+0000 7f9a988bf640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a8006c2b0 0x7f9a8006e770 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9a84034000 tx=0x7f9a8402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:41.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.050+0000 7f9a917fa640 1 -- 172.21.15.81:0/3310820922 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a88059dc0 con 0x7f9a940afd70 2024-09-16T01:21:41.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.218+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3310820922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a94067fc0 con 0x7f9a940afd70 2024-09-16T01:21:41.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.220+0000 7f9a917fa640 1 -- 172.21.15.81:0/3310820922 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16949 (secure 0 0 0) 0x7f9a880596c0 con 0x7f9a940afd70 2024-09-16T01:21:41.221 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:41.222 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":100,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:21:40.253297+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:38.862612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:39.221418+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:21:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.222+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3310820922 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a8006c2b0 msgr2=0x7f9a8006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.222+0000 7f9a9ab23640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a8006c2b0 0x7f9a8006e770 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9a84034000 tx=0x7f9a8402e000 comp rx=0 tx=0).stop 2024-09-16T01:21:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.222+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3310820922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a940afd70 msgr2=0x7f9a94151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.222+0000 7f9a9ab23640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a940afd70 0x7f9a94151180 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800d5d0 tx=0x7f9a8800da90 comp rx=0 tx=0).stop 2024-09-16T01:21:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.222+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3310820922 shutdown_connections 2024-09-16T01:21:41.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.222+0000 7f9a9ab23640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a8006c2b0 0x7f9a8006e770 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.222+0000 7f9a9ab23640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a940b5f80 0x7f9a941516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.222+0000 7f9a9ab23640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a940afd70 0x7f9a94151180 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.222+0000 7f9a9ab23640 1 --2- 172.21.15.81:0/3310820922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a9406e7d0 0x7f9a941f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.222+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3310820922 >> 172.21.15.81:0/3310820922 conn(0x7f9a9406bc10 msgr2=0x7f9a9415f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:41.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.222+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3310820922 shutdown_connections 2024-09-16T01:21:41.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.222+0000 7f9a9ab23640 1 -- 172.21.15.81:0/3310820922 wait complete. 2024-09-16T01:21:41.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:21:41.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.331+0000 7ff6c3fd6640 1 Processor -- start 2024-09-16T01:21:41.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.332+0000 7ff6c3fd6640 1 -- start start 2024-09-16T01:21:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.332+0000 7ff6c3fd6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6bc147360 0x7ff6bc070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.332+0000 7ff6c3fd6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6bc070dd0 0x7ff6bc0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.332+0000 7ff6c3fd6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6bc06cb30 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.332+0000 7ff6c3fd6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff6bc0d0e30 con 0x7ff6bc070dd0 2024-09-16T01:21:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.332+0000 7ff6c3fd6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff6bc06bfb0 con 0x7ff6bc147360 2024-09-16T01:21:41.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.333+0000 7ff6c1571640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6bc070dd0 0x7ff6bc0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.333+0000 7ff6c1571640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff6bc070dd0 0x7ff6bc0d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34624/0 (socket says 172.21.15.81:34624) 2024-09-16T01:21:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.333+0000 7ff6c1571640 1 -- 172.21.15.81:0/3528646394 learned_addr learned my addr 172.21.15.81:0/3528646394 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.333+0000 7ff6c1d72640 1 --2- 172.21.15.81:0/3528646394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6bc147360 0x7ff6bc070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.333+0000 7ff6c1571640 1 -- 172.21.15.81:0/3528646394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6bc147360 msgr2=0x7ff6bc070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.333+0000 7ff6c1571640 1 --2- 172.21.15.81:0/3528646394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6bc147360 0x7ff6bc070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.333+0000 7ff6c1571640 1 -- 172.21.15.81:0/3528646394 >> v1:172.21.15.102:6789/0 conn(0x7ff6bc0d09e0 legacy=0x7ff6bc06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.333+0000 7ff6c1571640 1 -- 172.21.15.81:0/3528646394 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6bc06c290 con 0x7ff6bc070dd0 2024-09-16T01:21:41.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.334+0000 7ff6c1571640 1 --2- 172.21.15.81:0/3528646394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6bc070dd0 0x7ff6bc0d04a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009870 tx=0x7ff6b002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd74850583c3a753 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:41.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.334+0000 7ff6c0d70640 1 -- 172.21.15.81:0/3528646394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0037070 con 0x7ff6bc070dd0 2024-09-16T01:21:41.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.334+0000 7ff6c0d70640 1 -- 172.21.15.81:0/3528646394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b0032440 con 0x7ff6bc070dd0 2024-09-16T01:21:41.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.334+0000 7ff6c0d70640 1 -- 172.21.15.81:0/3528646394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0032810 con 0x7ff6bc070dd0 2024-09-16T01:21:41.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.334+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/3528646394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6bc070dd0 msgr2=0x7ff6bc0d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.334+0000 7ff6c3fd6640 1 --2- 172.21.15.81:0/3528646394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6bc070dd0 0x7ff6bc0d04a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0009870 tx=0x7ff6b002a1c0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.334+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/3528646394 shutdown_connections 2024-09-16T01:21:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.334+0000 7ff6c3fd6640 1 --2- 172.21.15.81:0/3528646394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6bc070dd0 0x7ff6bc0d04a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.334+0000 7ff6c3fd6640 1 --2- 172.21.15.81:0/3528646394 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6bc147360 0x7ff6bc070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.334+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/3528646394 >> 172.21.15.81:0/3528646394 conn(0x7ff6bc0b2f40 msgr2=0x7ff6bc0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.334+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/3528646394 shutdown_connections 2024-09-16T01:21:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.334+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/3528646394 wait complete. 2024-09-16T01:21:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.336+0000 7ff6c3fd6640 1 Processor -- start 2024-09-16T01:21:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.336+0000 7ff6c3fd6640 1 -- start start 2024-09-16T01:21:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.336+0000 7ff6c3fd6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6bc070dd0 0x7ff6bc161240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.336+0000 7ff6c3fd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6bc0d09e0 0x7ff6bc1f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.336+0000 7ff6c3fd6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6bc147360 0x7ff6bc09d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.336+0000 7ff6c3fd6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc06bc10 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.336+0000 7ff6c3fd6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff6bc06c850 con 0x7ff6bc070dd0 2024-09-16T01:21:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.336+0000 7ff6c3fd6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff6bc06bd90 con 0x7ff6bc147360 2024-09-16T01:21:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.336+0000 7ff6c1571640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6bc0d09e0 0x7ff6bc1f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.336+0000 7ff6c1571640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6bc0d09e0 0x7ff6bc1f3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34638/0 (socket says 172.21.15.81:34638) 2024-09-16T01:21:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.336+0000 7ff6c1571640 1 -- 172.21.15.81:0/823448946 learned_addr learned my addr 172.21.15.81:0/823448946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:41.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.336+0000 7ff6c1d72640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6bc070dd0 0x7ff6bc161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.337+0000 7ff6c2573640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6bc147360 0x7ff6bc09d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.337+0000 7ff6c1571640 1 -- 172.21.15.81:0/823448946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6bc147360 msgr2=0x7ff6bc09d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.337+0000 7ff6c1571640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6bc147360 0x7ff6bc09d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.337+0000 7ff6c1571640 1 -- 172.21.15.81:0/823448946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6bc070dd0 msgr2=0x7ff6bc161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.337+0000 7ff6c1571640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6bc070dd0 0x7ff6bc161240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.337+0000 7ff6c1571640 1 -- 172.21.15.81:0/823448946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6bc161780 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.337+0000 7ff6c1571640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6bc0d09e0 0x7ff6bc1f3d70 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff6b002a200 tx=0x7ff6b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.337+0000 7ff6ba7fc640 1 -- 172.21.15.81:0/823448946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0041020 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.337+0000 7ff6ba7fc640 1 -- 172.21.15.81:0/823448946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b00306c0 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.337+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/823448946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6bc0b43c0 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.337+0000 7ff6ba7fc640 1 -- 172.21.15.81:0/823448946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0037040 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.337+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/823448946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6bc0b4980 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.338+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/823448946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6bc0d04a0 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.339+0000 7ff6ba7fc640 1 -- 172.21.15.81:0/823448946 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff6b0044020 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.339+0000 7ff6ba7fc640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff6a806c2b0 0x7ff6a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.339+0000 7ff6c1d72640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff6a806c2b0 0x7ff6a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.339+0000 7ff6ba7fc640 1 -- 172.21.15.81:0/823448946 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7ff6b00abc00 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.340+0000 7ff6c1d72640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff6a806c2b0 0x7ff6a806e770 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40079a0 tx=0x7ff6b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.343+0000 7ff6ba7fc640 1 -- 172.21.15.81:0/823448946 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6b00b2080 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.508+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/823448946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6bc06dfa0 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.509+0000 7ff6ba7fc640 1 -- 172.21.15.81:0/823448946 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16949 (secure 0 0 0) 0x7ff6b004b030 con 0x7ff6bc0d09e0 2024-09-16T01:21:41.511 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:41.511 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":100,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:21:40.253297+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:38.862612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:39.221418+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:21:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.511+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/823448946 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff6a806c2b0 msgr2=0x7ff6a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.511+0000 7ff6c3fd6640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff6a806c2b0 0x7ff6a806e770 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40079a0 tx=0x7ff6b4008040 comp rx=0 tx=0).stop 2024-09-16T01:21:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.511+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/823448946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6bc0d09e0 msgr2=0x7ff6bc1f3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.511+0000 7ff6c3fd6640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6bc0d09e0 0x7ff6bc1f3d70 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff6b002a200 tx=0x7ff6b00046c0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.511+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/823448946 shutdown_connections 2024-09-16T01:21:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.511+0000 7ff6c3fd6640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff6a806c2b0 0x7ff6a806e770 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.511+0000 7ff6c3fd6640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff6bc147360 0x7ff6bc09d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.511+0000 7ff6c3fd6640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6bc0d09e0 0x7ff6bc1f3d70 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.511+0000 7ff6c3fd6640 1 --2- 172.21.15.81:0/823448946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff6bc070dd0 0x7ff6bc161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.511+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/823448946 >> 172.21.15.81:0/823448946 conn(0x7ff6bc0b2f40 msgr2=0x7ff6bc145960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.511+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/823448946 shutdown_connections 2024-09-16T01:21:41.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.511+0000 7ff6c3fd6640 1 -- 172.21.15.81:0/823448946 wait complete. 2024-09-16T01:21:41.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:21:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.623+0000 7f8fbd5fd640 1 Processor -- start 2024-09-16T01:21:41.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.623+0000 7f8fbd5fd640 1 -- start start 2024-09-16T01:21:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fbd5fd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8fb8162e30 0x7f8fb806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fbd5fd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8fb80cf280 0x7f8fb80d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fbd5fd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb815ff70 con 0x7f8fb8162340 2024-09-16T01:21:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fbd5fd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb806de90 con 0x7f8fb80cf280 2024-09-16T01:21:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fbd5fd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb8163270 con 0x7f8fb8162e30 2024-09-16T01:21:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fb77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8fb80cf280 0x7f8fb80d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fb77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8fb80cf280 0x7f8fb80d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34642/0 (socket says 172.21.15.81:34642) 2024-09-16T01:21:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fb6ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8fb8162340 0x7f8fb8162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49102/0 (socket says 172.21.15.81:49102) 2024-09-16T01:21:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fb77fe640 1 -- 172.21.15.81:0/3184604291 learned_addr learned my addr 172.21.15.81:0/3184604291 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:41.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8faffff640 1 --2- 172.21.15.81:0/3184604291 >> v2:172.21.15.102:3300/0 conn(0x7f8fb8162e30 0x7f8fb806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fb77fe640 1 -- 172.21.15.81:0/3184604291 >> v2:172.21.15.102:3300/0 conn(0x7f8fb8162e30 msgr2=0x7f8fb806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fb77fe640 1 --2- 172.21.15.81:0/3184604291 >> v2:172.21.15.102:3300/0 conn(0x7f8fb8162e30 0x7f8fb806d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fb77fe640 1 -- 172.21.15.81:0/3184604291 >> v1:172.21.15.81:6789/0 conn(0x7f8fb8162340 legacy=0x7f8fb8162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fb77fe640 1 -- 172.21.15.81:0/3184604291 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb80d4d10 con 0x7f8fb80cf280 2024-09-16T01:21:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.624+0000 7f8fb67fc640 1 -- 172.21.15.81:0/3184604291 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060692304 0 0) 0x7f8fb815ff70 con 0x7f8fb8162340 2024-09-16T01:21:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.625+0000 7f8fb77fe640 1 --2- 172.21.15.81:0/3184604291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb80cf280 0x7f8fb80d2990 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80a23d0 tx=0x7f8fb002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b3bc71e7632af8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.625+0000 7f8fb67fc640 1 -- 172.21.15.81:0/3184604291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0036070 con 0x7f8fb80cf280 2024-09-16T01:21:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.625+0000 7f8fb67fc640 1 -- 172.21.15.81:0/3184604291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb0031600 con 0x7f8fb80cf280 2024-09-16T01:21:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.625+0000 7f8fb67fc640 1 -- 172.21.15.81:0/3184604291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb00319d0 con 0x7f8fb80cf280 2024-09-16T01:21:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.626+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/3184604291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb80cf280 msgr2=0x7f8fb80d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.626+0000 7f8fbd5fd640 1 --2- 172.21.15.81:0/3184604291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb80cf280 0x7f8fb80d2990 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80a23d0 tx=0x7f8fb002a6a0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.626+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/3184604291 shutdown_connections 2024-09-16T01:21:41.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.626+0000 7f8fbd5fd640 1 --2- 172.21.15.81:0/3184604291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb80cf280 0x7f8fb80d2990 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.626+0000 7f8fbd5fd640 1 --2- 172.21.15.81:0/3184604291 >> v2:172.21.15.102:3300/0 conn(0x7f8fb8162e30 0x7f8fb806d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.626+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/3184604291 >> 172.21.15.81:0/3184604291 conn(0x7f8fb808bfc0 msgr2=0x7f8fb80d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:41.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.626+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/3184604291 shutdown_connections 2024-09-16T01:21:41.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.626+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/3184604291 wait complete. 2024-09-16T01:21:41.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.627+0000 7f8fbd5fd640 1 Processor -- start 2024-09-16T01:21:41.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.627+0000 7f8fbd5fd640 1 -- start start 2024-09-16T01:21:41.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fbd5fd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb80cf280 0x7f8fb815d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fbd5fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fb8162340 0x7f8fb80b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fbd5fd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fb8162e30 0x7f8fb815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fbd5fd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb80cf6f0 con 0x7f8fb80cf280 2024-09-16T01:21:41.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fbd5fd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb80d2470 con 0x7f8fb8162340 2024-09-16T01:21:41.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fbd5fd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb80d52d0 con 0x7f8fb8162e30 2024-09-16T01:21:41.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fb6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb80cf280 0x7f8fb815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fb6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb80cf280 0x7f8fb815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34646/0 (socket says 172.21.15.81:34646) 2024-09-16T01:21:41.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fb6ffd640 1 -- 172.21.15.81:0/65842970 learned_addr learned my addr 172.21.15.81:0/65842970 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:41.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fb77fe640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fb8162e30 0x7f8fb815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8faffff640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fb8162340 0x7f8fb80b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fb6ffd640 1 -- 172.21.15.81:0/65842970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fb8162e30 msgr2=0x7f8fb815f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fb6ffd640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fb8162e30 0x7f8fb815f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fb6ffd640 1 -- 172.21.15.81:0/65842970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fb8162340 msgr2=0x7f8fb80b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fb6ffd640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fb8162340 0x7f8fb80b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fb6ffd640 1 -- 172.21.15.81:0/65842970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb815f7a0 con 0x7f8fb80cf280 2024-09-16T01:21:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fb77fe640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fb8162e30 0x7f8fb815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fb6ffd640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb80cf280 0x7f8fb815d560 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800c4d0 tx=0x7f8fa800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8faf7fe640 1 -- 172.21.15.81:0/65842970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8018070 con 0x7f8fb80cf280 2024-09-16T01:21:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8faf7fe640 1 -- 172.21.15.81:0/65842970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa8007500 con 0x7f8fb80cf280 2024-09-16T01:21:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/65842970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb815db40 con 0x7f8fb80cf280 2024-09-16T01:21:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8faf7fe640 1 -- 172.21.15.81:0/65842970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8004a20 con 0x7f8fb80cf280 2024-09-16T01:21:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.628+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/65842970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb815e100 con 0x7f8fb80cf280 2024-09-16T01:21:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.629+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/65842970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb806d740 con 0x7f8fb80cf280 2024-09-16T01:21:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.630+0000 7f8faf7fe640 1 -- 172.21.15.81:0/65842970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8fa801b070 con 0x7f8fb80cf280 2024-09-16T01:21:41.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.630+0000 7f8faf7fe640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8f9806c2b0 0x7f8f9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.630+0000 7f8faf7fe640 1 -- 172.21.15.81:0/65842970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 6101+0+0 (secure 0 0 0) 0x7f8fa808a890 con 0x7f8fb80cf280 2024-09-16T01:21:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.630+0000 7f8faffff640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8f9806c2b0 0x7f8f9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.631+0000 7f8faffff640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8f9806c2b0 0x7f8f9806e770 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8fb806e6e0 tx=0x7f8fa0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:41.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.634+0000 7f8faf7fe640 1 -- 172.21.15.81:0/65842970 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8fa8058e70 con 0x7f8fb80cf280 2024-09-16T01:21:41.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.838+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/65842970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8fb808e640 con 0x7f8fb80cf280 2024-09-16T01:21:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.915+0000 7f8faf7fe640 1 -- 172.21.15.81:0/65842970 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) ==== 118+0+0 (secure 0 0 0) 0x7f8fa8058770 con 0x7f8fb80cf280 2024-09-16T01:21:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.918+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/65842970 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8f9806c2b0 msgr2=0x7f8f9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.918+0000 7f8fbd5fd640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8f9806c2b0 0x7f8f9806e770 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8fb806e6e0 tx=0x7f8fa0008040 comp rx=0 tx=0).stop 2024-09-16T01:21:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.918+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/65842970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb80cf280 msgr2=0x7f8fb815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.918+0000 7f8fbd5fd640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb80cf280 0x7f8fb815d560 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800c4d0 tx=0x7f8fa800c990 comp rx=0 tx=0).stop 2024-09-16T01:21:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.918+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/65842970 shutdown_connections 2024-09-16T01:21:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.918+0000 7f8fbd5fd640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8f9806c2b0 0x7f8f9806e770 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.918+0000 7f8fbd5fd640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8fb8162e30 0x7f8fb815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.918+0000 7f8fbd5fd640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8fb8162340 0x7f8fb80b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.918+0000 7f8fbd5fd640 1 --2- 172.21.15.81:0/65842970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb80cf280 0x7f8fb815d560 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.918+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/65842970 >> 172.21.15.81:0/65842970 conn(0x7f8fb808bfc0 msgr2=0x7f8fb8161a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.918+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/65842970 shutdown_connections 2024-09-16T01:21:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:41.918+0000 7f8fbd5fd640 1 -- 172.21.15.81:0/65842970 wait complete. 2024-09-16T01:21:41.931 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T01:21:41.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:21:42.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.032+0000 7f376468d640 1 Processor -- start 2024-09-16T01:21:42.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.032+0000 7f376468d640 1 -- start start 2024-09-16T01:21:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f376468d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f375c156740 0x7f375c0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f376468d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f375c0b4af0 0x7f375c0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f376468d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f375c0b30e0 con 0x7f375c0cfcd0 2024-09-16T01:21:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f376468d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f375c0d0140 con 0x7f375c156740 2024-09-16T01:21:42.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f376468d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f375c06edc0 con 0x7f375c0b4af0 2024-09-16T01:21:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f3762429640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f375c156740 0x7f375c0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f3762429640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f375c156740 0x7f375c0b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34654/0 (socket says 172.21.15.81:34654) 2024-09-16T01:21:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f3762429640 1 -- 172.21.15.81:0/4211048233 learned_addr learned my addr 172.21.15.81:0/4211048233 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f3761c28640 1 --2- 172.21.15.81:0/4211048233 >> v2:172.21.15.102:3300/0 conn(0x7f375c0b4af0 0x7f375c0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f3762429640 1 -- 172.21.15.81:0/4211048233 >> v2:172.21.15.102:3300/0 conn(0x7f375c0b4af0 msgr2=0x7f375c0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f3762429640 1 --2- 172.21.15.81:0/4211048233 >> v2:172.21.15.102:3300/0 conn(0x7f375c0b4af0 0x7f375c0cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f3762429640 1 -- 172.21.15.81:0/4211048233 >> v1:172.21.15.102:6789/0 conn(0x7f375c0cfcd0 legacy=0x7f375c15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:42.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.033+0000 7f3762429640 1 -- 172.21.15.81:0/4211048233 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375c0b33c0 con 0x7f375c156740 2024-09-16T01:21:42.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.034+0000 7f3762429640 1 --2- 172.21.15.81:0/4211048233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c156740 0x7f375c0b45b0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f375c15a370 tx=0x7f375802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef707ed5c76ff39a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.034+0000 7f3761427640 1 -- 172.21.15.81:0/4211048233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3758037070 con 0x7f375c156740 2024-09-16T01:21:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.034+0000 7f3761427640 1 -- 172.21.15.81:0/4211048233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3758032440 con 0x7f375c156740 2024-09-16T01:21:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.034+0000 7f3761427640 1 -- 172.21.15.81:0/4211048233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3758032810 con 0x7f375c156740 2024-09-16T01:21:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.035+0000 7f376468d640 1 -- 172.21.15.81:0/4211048233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c156740 msgr2=0x7f375c0b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.035+0000 7f376468d640 1 --2- 172.21.15.81:0/4211048233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c156740 0x7f375c0b45b0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f375c15a370 tx=0x7f375802a230 comp rx=0 tx=0).stop 2024-09-16T01:21:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.035+0000 7f376468d640 1 -- 172.21.15.81:0/4211048233 shutdown_connections 2024-09-16T01:21:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.035+0000 7f376468d640 1 --2- 172.21.15.81:0/4211048233 >> v2:172.21.15.102:3300/0 conn(0x7f375c0b4af0 0x7f375c0cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.035+0000 7f376468d640 1 --2- 172.21.15.81:0/4211048233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c156740 0x7f375c0b45b0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.035+0000 7f376468d640 1 -- 172.21.15.81:0/4211048233 >> 172.21.15.81:0/4211048233 conn(0x7f375c06bdf0 msgr2=0x7f375c06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.035+0000 7f376468d640 1 -- 172.21.15.81:0/4211048233 shutdown_connections 2024-09-16T01:21:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.035+0000 7f376468d640 1 -- 172.21.15.81:0/4211048233 wait complete. 2024-09-16T01:21:42.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.036+0000 7f376468d640 1 Processor -- start 2024-09-16T01:21:42.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.036+0000 7f376468d640 1 -- start start 2024-09-16T01:21:42.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f376468d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f375c0b4af0 0x7f375c14c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f376468d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c0cfcd0 0x7f375c151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f376468d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f375c156740 0x7f375c151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f376468d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f375c0b3c60 con 0x7f375c0cfcd0 2024-09-16T01:21:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f376468d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f375c0b3980 con 0x7f375c156740 2024-09-16T01:21:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f376468d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f375c0d0890 con 0x7f375c0b4af0 2024-09-16T01:21:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3761c28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c0cfcd0 0x7f375c151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3761c28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c0cfcd0 0x7f375c151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34656/0 (socket says 172.21.15.81:34656) 2024-09-16T01:21:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3761c28640 1 -- 172.21.15.81:0/3833484223 learned_addr learned my addr 172.21.15.81:0/3833484223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3762c2a640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f375c156740 0x7f375c151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3762429640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f375c0b4af0 0x7f375c14c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3761c28640 1 -- 172.21.15.81:0/3833484223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f375c0b4af0 msgr2=0x7f375c14c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3761c28640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f375c0b4af0 0x7f375c14c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3761c28640 1 -- 172.21.15.81:0/3833484223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f375c156740 msgr2=0x7f375c151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3761c28640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f375c156740 0x7f375c151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3761c28640 1 -- 172.21.15.81:0/3833484223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375c14cc70 con 0x7f375c0cfcd0 2024-09-16T01:21:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3761c28640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c0cfcd0 0x7f375c151640 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f374c00d800 tx=0x7f374c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3752ffd640 1 -- 172.21.15.81:0/3833484223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c00b660 con 0x7f375c0cfcd0 2024-09-16T01:21:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3752ffd640 1 -- 172.21.15.81:0/3833484223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f374c019070 con 0x7f375c0cfcd0 2024-09-16T01:21:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f3752ffd640 1 -- 172.21.15.81:0/3833484223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f374c00ba20 con 0x7f375c0cfcd0 2024-09-16T01:21:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f376468d640 1 -- 172.21.15.81:0/3833484223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375c0720d0 con 0x7f375c0cfcd0 2024-09-16T01:21:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.037+0000 7f376468d640 1 -- 172.21.15.81:0/3833484223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f375c072690 con 0x7f375c0cfcd0 2024-09-16T01:21:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.038+0000 7f376468d640 1 -- 172.21.15.81:0/3833484223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f375c156b20 con 0x7f375c0cfcd0 2024-09-16T01:21:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.039+0000 7f3752ffd640 1 -- 172.21.15.81:0/3833484223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f374c00bbc0 con 0x7f375c0cfcd0 2024-09-16T01:21:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.039+0000 7f3752ffd640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f374006c2e0 0x7f374006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.039+0000 7f3752ffd640 1 -- 172.21.15.81:0/3833484223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f374c08b7f0 con 0x7f375c0cfcd0 2024-09-16T01:21:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.039+0000 7f3762429640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f374006c2e0 0x7f374006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.040+0000 7f3762429640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f374006c2e0 0x7f374006e7a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3758034000 tx=0x7f375802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.044+0000 7f3752ffd640 1 -- 172.21.15.81:0/3833484223 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f375c14cc70 con 0x7f375c0cfcd0 2024-09-16T01:21:42.165 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-16T01:21:42.163+0000 7f211cfae640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:21:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.243+0000 7f376468d640 1 -- 172.21.15.81:0/3833484223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f375c0ced60 con 0x7f375c0cfcd0 2024-09-16T01:21:42.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.926+0000 7f3752ffd640 1 -- 172.21.15.81:0/3833484223 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) ==== 122+0+0 (secure 0 0 0) 0x7f374c059810 con 0x7f375c0cfcd0 2024-09-16T01:21:42.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.928+0000 7f376468d640 1 -- 172.21.15.81:0/3833484223 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f374006c2e0 msgr2=0x7f374006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:42.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.928+0000 7f376468d640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f374006c2e0 0x7f374006e7a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3758034000 tx=0x7f375802e000 comp rx=0 tx=0).stop 2024-09-16T01:21:42.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.928+0000 7f376468d640 1 -- 172.21.15.81:0/3833484223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c0cfcd0 msgr2=0x7f375c151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:42.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.928+0000 7f376468d640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c0cfcd0 0x7f375c151640 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f374c00d800 tx=0x7f374c00dcc0 comp rx=0 tx=0).stop 2024-09-16T01:21:42.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.928+0000 7f376468d640 1 -- 172.21.15.81:0/3833484223 shutdown_connections 2024-09-16T01:21:42.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.928+0000 7f376468d640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f374006c2e0 0x7f374006e7a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:42.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.928+0000 7f376468d640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f375c156740 0x7f375c151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:42.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.928+0000 7f376468d640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f375c0cfcd0 0x7f375c151640 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:42.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.928+0000 7f376468d640 1 --2- 172.21.15.81:0/3833484223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f375c0b4af0 0x7f375c14c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:42.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.928+0000 7f376468d640 1 -- 172.21.15.81:0/3833484223 >> 172.21.15.81:0/3833484223 conn(0x7f375c06bdf0 msgr2=0x7f375c0ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:42.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.928+0000 7f376468d640 1 -- 172.21.15.81:0/3833484223 shutdown_connections 2024-09-16T01:21:42.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:42.928+0000 7f376468d640 1 -- 172.21.15.81:0/3833484223 wait complete. 2024-09-16T01:21:42.943 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:21:42.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:21:43.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.043+0000 7fb1e2bfd640 1 Processor -- start 2024-09-16T01:21:43.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.043+0000 7fb1e2bfd640 1 -- start start 2024-09-16T01:21:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1e2bfd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc0b69d0 0x7fb1dc162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1e2bfd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb1dc0af280 0x7fb1dc0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1e2bfd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1dc15eb60 con 0x7fb1dc0affb0 2024-09-16T01:21:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1e2bfd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb1dc0b6db0 con 0x7fb1dc0af280 2024-09-16T01:21:43.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1e2bfd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb1dc15ee40 con 0x7fb1dc0b69d0 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1e119a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb1dc0affb0 0x7fb1dc154d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49116/0 (socket says 172.21.15.81:49116) 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1e119a640 1 -- 172.21.15.81:0/1714497469 learned_addr learned my addr 172.21.15.81:0/1714497469 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1e0999640 1 --2- 172.21.15.81:0/1714497469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc0b69d0 0x7fb1dc162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d3fff640 1 --2- 172.21.15.81:0/1714497469 >> v2:172.21.15.102:3300/0 conn(0x7fb1dc0af280 0x7fb1dc0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165832305 0 0) 0x7fb1dc15eb60 con 0x7fb1dc0affb0 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1c4003520 con 0x7fb1dc0affb0 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 325924491 0 0) 0x7fb1c4003520 con 0x7fb1dc0affb0 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc0b69d0 msgr2=0x7fb1dc162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d37fe640 1 --2- 172.21.15.81:0/1714497469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc0b69d0 0x7fb1dc162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 >> v2:172.21.15.102:3300/0 conn(0x7fb1dc0af280 msgr2=0x7fb1dc0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d37fe640 1 --2- 172.21.15.81:0/1714497469 >> v2:172.21.15.102:3300/0 conn(0x7fb1dc0af280 0x7fb1dc0afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1dc15f120 con 0x7fb1dc0affb0 2024-09-16T01:21:43.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fb1d40019f0 con 0x7fb1dc0affb0 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d3fff640 1 --2- 172.21.15.81:0/1714497469 >> v2:172.21.15.102:3300/0 conn(0x7fb1dc0af280 0x7fb1dc0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 >> v1:172.21.15.81:6789/0 conn(0x7fb1dc0affb0 legacy=0x7fb1dc154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.044+0000 7fb1d37fe640 1 --2- 172.21.15.81:0/1714497469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c40039b0 0x7fb1c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1d37fe640 1 --2- 172.21.15.81:0/1714497469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc0b69d0 0x7fb1c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1d37fe640 1 --2- 172.21.15.81:0/1714497469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c4004d40 0x7fb1c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc0b6db0 con 0x7fb1c4004d40 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc15ee40 con 0x7fb1c40039b0 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c400ba40 con 0x7fb1dc0b69d0 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1e119a640 1 --2- 172.21.15.81:0/1714497469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c4004d40 0x7fb1c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1e0999640 1 --2- 172.21.15.81:0/1714497469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c40039b0 0x7fb1c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1d3fff640 1 --2- 172.21.15.81:0/1714497469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc0b69d0 0x7fb1c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1e119a640 1 -- 172.21.15.81:0/1714497469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc0b69d0 msgr2=0x7fb1c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1e119a640 1 --2- 172.21.15.81:0/1714497469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc0b69d0 0x7fb1c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1e119a640 1 -- 172.21.15.81:0/1714497469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c40039b0 msgr2=0x7fb1c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1e119a640 1 --2- 172.21.15.81:0/1714497469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1c40039b0 0x7fb1c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.045+0000 7fb1e119a640 1 -- 172.21.15.81:0/1714497469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c4003520 con 0x7fb1c4004d40 2024-09-16T01:21:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.046+0000 7fb1e119a640 1 --2- 172.21.15.81:0/1714497469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c4004d40 0x7fb1c40051c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400a840 tx=0x7fb1c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41496d2872164f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.046+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400a460 con 0x7fb1c4004d40 2024-09-16T01:21:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.046+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d402f070 con 0x7fb1c4004d40 2024-09-16T01:21:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.046+0000 7fb1d37fe640 1 -- 172.21.15.81:0/1714497469 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1d402bcb0 con 0x7fb1c4004d40 2024-09-16T01:21:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.046+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1714497469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c4004d40 msgr2=0x7fb1c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.046+0000 7fb1e2bfd640 1 --2- 172.21.15.81:0/1714497469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c4004d40 0x7fb1c40051c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400a840 tx=0x7fb1c4005830 comp rx=0 tx=0).stop 2024-09-16T01:21:43.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.046+0000 7fb1e119a640 1 -- 172.21.15.81:0/1714497469 reap_dead start 2024-09-16T01:21:43.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.046+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1714497469 shutdown_connections 2024-09-16T01:21:43.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.046+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1714497469 >> 172.21.15.81:0/1714497469 conn(0x7fb1dc06bc10 msgr2=0x7fb1dc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:43.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.046+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1714497469 shutdown_connections 2024-09-16T01:21:43.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.046+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1714497469 wait complete. 2024-09-16T01:21:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.047+0000 7fb1e2bfd640 1 Processor -- start 2024-09-16T01:21:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.048+0000 7fb1e2bfd640 1 -- start start 2024-09-16T01:21:43.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.048+0000 7fb1e2bfd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc15d8a0 0x7fb1dc1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.048+0000 7fb1e2bfd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc15dc80 0x7fb1dc154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.048+0000 7fb1e2bfd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1dc1522d0 0x7fb1dc152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.048+0000 7fb1e2bfd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc162a50 con 0x7fb1dc15dc80 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.048+0000 7fb1e2bfd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc0af6e0 con 0x7fb1dc1522d0 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.048+0000 7fb1e2bfd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb1dc162bd0 con 0x7fb1dc15d8a0 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.048+0000 7fb1d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc15dc80 0x7fb1dc154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.048+0000 7fb1d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc15dc80 0x7fb1dc154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34672/0 (socket says 172.21.15.81:34672) 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1e0999640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc15d8a0 0x7fb1dc1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1d3fff640 1 -- 172.21.15.81:0/1906620770 learned_addr learned my addr 172.21.15.81:0/1906620770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1e119a640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1dc1522d0 0x7fb1dc152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1d3fff640 1 -- 172.21.15.81:0/1906620770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc15d8a0 msgr2=0x7fb1dc1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1d3fff640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc15d8a0 0x7fb1dc1551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1d3fff640 1 -- 172.21.15.81:0/1906620770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1dc1522d0 msgr2=0x7fb1dc152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1d3fff640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1dc1522d0 0x7fb1dc152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1d3fff640 1 -- 172.21.15.81:0/1906620770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1dc156560 con 0x7fb1dc15dc80 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1e0999640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc15d8a0 0x7fb1dc1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1d3fff640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc15dc80 0x7fb1dc154000 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc011d00 tx=0x7fb1cc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1d17fa640 1 -- 172.21.15.81:0/1906620770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc00fd20 con 0x7fb1dc15dc80 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1d17fa640 1 -- 172.21.15.81:0/1906620770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1cc014440 con 0x7fb1dc15dc80 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1906620770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1dc156840 con 0x7fb1dc15dc80 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1d17fa640 1 -- 172.21.15.81:0/1906620770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc014830 con 0x7fb1dc15dc80 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.049+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1906620770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1dc155720 con 0x7fb1dc15dc80 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.050+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1906620770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1dc0705f0 con 0x7fb1dc15dc80 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.051+0000 7fb1d17fa640 1 -- 172.21.15.81:0/1906620770 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb1cc012040 con 0x7fb1dc15dc80 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.051+0000 7fb1d17fa640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb1c806c2e0 0x7fb1c806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.051+0000 7fb1d17fa640 1 -- 172.21.15.81:0/1906620770 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fb1cc08bc80 con 0x7fb1dc15dc80 2024-09-16T01:21:43.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.051+0000 7fb1e0999640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb1c806c2e0 0x7fb1c806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.052+0000 7fb1e0999640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb1c806c2e0 0x7fb1c806e7a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0d0b30 tx=0x7fb1d8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:43.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.055+0000 7fb1d17fa640 1 -- 172.21.15.81:0/1906620770 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb1cc019030 con 0x7fb1dc15dc80 2024-09-16T01:21:43.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.255+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1906620770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb1dc06f940 con 0x7fb1dc15dc80 2024-09-16T01:21:43.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.255+0000 7fb1d17fa640 1 -- 172.21.15.81:0/1906620770 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5231 (secure 0 0 0) 0x7fb1cc05a2f0 con 0x7fb1dc15dc80 2024-09-16T01:21:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:43.258 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"btime":"2024-09-16T01:21:42:921033+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3103388370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3103388370},{"type":"v1","addr":"172.21.15.102:6834","nonce":3103388370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":5750,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1937467713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1937467713},{"type":"v1","addr":"172.21.15.102:6835","nonce":1937467713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1728333369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1728333369},{"type":"v1","addr":"172.21.15.81:6836","nonce":1728333369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:21:40.253611+0000","modified":"2024-09-16T01:21:42.245713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6945":{"gid":6945,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2688004165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2688004165},{"type":"v1","addr":"172.21.15.81:6837","nonce":2688004165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6945,"qdb_cluster":[6945]},"id":7}]} 2024-09-16T01:21:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2024-09-16T01:21:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.257+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1906620770 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb1c806c2e0 msgr2=0x7fb1c806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.257+0000 7fb1e2bfd640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb1c806c2e0 0x7fb1c806e7a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0d0b30 tx=0x7fb1d8009190 comp rx=0 tx=0).stop 2024-09-16T01:21:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.257+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1906620770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc15dc80 msgr2=0x7fb1dc154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.257+0000 7fb1e2bfd640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc15dc80 0x7fb1dc154000 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc011d00 tx=0x7fb1cc00f610 comp rx=0 tx=0).stop 2024-09-16T01:21:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.257+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1906620770 shutdown_connections 2024-09-16T01:21:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.257+0000 7fb1e2bfd640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb1c806c2e0 0x7fb1c806e7a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.257+0000 7fb1e2bfd640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1dc1522d0 0x7fb1dc152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.257+0000 7fb1e2bfd640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc15dc80 0x7fb1dc154000 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.257+0000 7fb1e2bfd640 1 --2- 172.21.15.81:0/1906620770 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1dc15d8a0 0x7fb1dc1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.257+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1906620770 >> 172.21.15.81:0/1906620770 conn(0x7fb1dc06bc10 msgr2=0x7fb1dc06e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.257+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1906620770 shutdown_connections 2024-09-16T01:21:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.257+0000 7fb1e2bfd640 1 -- 172.21.15.81:0/1906620770 wait complete. 2024-09-16T01:21:43.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:21:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.365+0000 7fc257bf1640 1 Processor -- start 2024-09-16T01:21:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.366+0000 7fc257bf1640 1 -- start start 2024-09-16T01:21:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.366+0000 7fc257bf1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc250071750 0x7fc2500d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.366+0000 7fc257bf1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2500d0b20 0x7fc2501680c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.366+0000 7fc257bf1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2500d12c0 con 0x7fc25009aca0 2024-09-16T01:21:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.366+0000 7fc257bf1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc25006d040 con 0x7fc2500d0b20 2024-09-16T01:21:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.366+0000 7fc257bf1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc2500d15a0 con 0x7fc250071750 2024-09-16T01:21:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.367+0000 7fc25618e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2500d0b20 0x7fc2501680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.367+0000 7fc25618e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2500d0b20 0x7fc2501680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34684/0 (socket says 172.21.15.81:34684) 2024-09-16T01:21:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.367+0000 7fc25618e640 1 -- 172.21.15.81:0/4108803119 learned_addr learned my addr 172.21.15.81:0/4108803119 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.367+0000 7fc25518c640 1 --2- 172.21.15.81:0/4108803119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc250071750 0x7fc2500d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.367+0000 7fc25618e640 1 -- 172.21.15.81:0/4108803119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc250071750 msgr2=0x7fc2500d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.367+0000 7fc25618e640 1 --2- 172.21.15.81:0/4108803119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc250071750 0x7fc2500d05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.367+0000 7fc25618e640 1 -- 172.21.15.81:0/4108803119 >> v1:172.21.15.102:6789/0 conn(0x7fc25009aca0 legacy=0x7fc25009b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:43.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.367+0000 7fc25618e640 1 -- 172.21.15.81:0/4108803119 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2500d1880 con 0x7fc2500d0b20 2024-09-16T01:21:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.368+0000 7fc25618e640 1 --2- 172.21.15.81:0/4108803119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2500d0b20 0x7fc2501680c0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fc248009e50 tx=0x7fc24802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118cadc48f961bf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.368+0000 7fc25498b640 1 -- 172.21.15.81:0/4108803119 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc248036070 con 0x7fc2500d0b20 2024-09-16T01:21:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.368+0000 7fc25498b640 1 -- 172.21.15.81:0/4108803119 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc248031600 con 0x7fc2500d0b20 2024-09-16T01:21:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.368+0000 7fc25498b640 1 -- 172.21.15.81:0/4108803119 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2480319d0 con 0x7fc2500d0b20 2024-09-16T01:21:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.368+0000 7fc257bf1640 1 -- 172.21.15.81:0/4108803119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2500d0b20 msgr2=0x7fc2501680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.368+0000 7fc257bf1640 1 --2- 172.21.15.81:0/4108803119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2500d0b20 0x7fc2501680c0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fc248009e50 tx=0x7fc24802a6c0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.368+0000 7fc257bf1640 1 -- 172.21.15.81:0/4108803119 shutdown_connections 2024-09-16T01:21:43.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.368+0000 7fc257bf1640 1 --2- 172.21.15.81:0/4108803119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2500d0b20 0x7fc2501680c0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.368+0000 7fc257bf1640 1 --2- 172.21.15.81:0/4108803119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc250071750 0x7fc2500d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.368+0000 7fc257bf1640 1 -- 172.21.15.81:0/4108803119 >> 172.21.15.81:0/4108803119 conn(0x7fc2500d23a0 msgr2=0x7fc2500d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:43.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.368+0000 7fc257bf1640 1 -- 172.21.15.81:0/4108803119 shutdown_connections 2024-09-16T01:21:43.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.368+0000 7fc257bf1640 1 -- 172.21.15.81:0/4108803119 wait complete. 2024-09-16T01:21:43.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.369+0000 7fc257bf1640 1 Processor -- start 2024-09-16T01:21:43.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.370+0000 7fc257bf1640 1 -- start start 2024-09-16T01:21:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.370+0000 7fc257bf1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250071750 0x7fc2501523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.370+0000 7fc257bf1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc25009aca0 0x7fc250156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.370+0000 7fc257bf1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2500d0b20 0x7fc2500c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.370+0000 7fc257bf1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2500d0fb0 con 0x7fc250071750 2024-09-16T01:21:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.370+0000 7fc257bf1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc250070220 con 0x7fc2500d0b20 2024-09-16T01:21:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.370+0000 7fc257bf1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc25009b790 con 0x7fc25009aca0 2024-09-16T01:21:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.370+0000 7fc25598d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250071750 0x7fc2501523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.370+0000 7fc25598d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250071750 0x7fc2501523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34688/0 (socket says 172.21.15.81:34688) 2024-09-16T01:21:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.370+0000 7fc25598d640 1 -- 172.21.15.81:0/1027071209 learned_addr learned my addr 172.21.15.81:0/1027071209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.370+0000 7fc25618e640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2500d0b20 0x7fc2500c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.370+0000 7fc25518c640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc25009aca0 0x7fc250156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.371+0000 7fc25598d640 1 -- 172.21.15.81:0/1027071209 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc25009aca0 msgr2=0x7fc250156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.371+0000 7fc25598d640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc25009aca0 0x7fc250156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.371+0000 7fc25598d640 1 -- 172.21.15.81:0/1027071209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2500d0b20 msgr2=0x7fc2500c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.371+0000 7fc25598d640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2500d0b20 0x7fc2500c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.371+0000 7fc25598d640 1 -- 172.21.15.81:0/1027071209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc250158740 con 0x7fc250071750 2024-09-16T01:21:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.371+0000 7fc25518c640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc25009aca0 0x7fc250156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.371+0000 7fc25598d640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250071750 0x7fc2501523f0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fc24400c460 tx=0x7fc24400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.371+0000 7fc2427fc640 1 -- 172.21.15.81:0/1027071209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244011790 con 0x7fc250071750 2024-09-16T01:21:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.371+0000 7fc2427fc640 1 -- 172.21.15.81:0/1027071209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc244017070 con 0x7fc250071750 2024-09-16T01:21:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.371+0000 7fc257bf1640 1 -- 172.21.15.81:0/1027071209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc250158a20 con 0x7fc250071750 2024-09-16T01:21:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.371+0000 7fc2427fc640 1 -- 172.21.15.81:0/1027071209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc244011bb0 con 0x7fc250071750 2024-09-16T01:21:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.371+0000 7fc257bf1640 1 -- 172.21.15.81:0/1027071209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2500ccf60 con 0x7fc250071750 2024-09-16T01:21:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.372+0000 7fc257bf1640 1 -- 172.21.15.81:0/1027071209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2500d05e0 con 0x7fc250071750 2024-09-16T01:21:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.373+0000 7fc2427fc640 1 -- 172.21.15.81:0/1027071209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc24401c460 con 0x7fc250071750 2024-09-16T01:21:43.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.373+0000 7fc2427fc640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc23406c2b0 0x7fc23406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.373+0000 7fc2427fc640 1 -- 172.21.15.81:0/1027071209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fc24408b330 con 0x7fc250071750 2024-09-16T01:21:43.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.373+0000 7fc25518c640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc23406c2b0 0x7fc23406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.373+0000 7fc25518c640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc23406c2b0 0x7fc23406e770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc25015b3c0 tx=0x7fc24c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:43.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.377+0000 7fc2427fc640 1 -- 172.21.15.81:0/1027071209 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2440599a0 con 0x7fc250071750 2024-09-16T01:21:43.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.545+0000 7fc257bf1640 1 -- 172.21.15.81:0/1027071209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2500cf250 con 0x7fc250071750 2024-09-16T01:21:43.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.546+0000 7fc2427fc640 1 -- 172.21.15.81:0/1027071209 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16936 (secure 0 0 0) 0x7fc2440592a0 con 0x7fc250071750 2024-09-16T01:21:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:43.548 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":101,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:21:41.916386+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:38.862612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:39.221418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:21:43.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.548+0000 7fc257bf1640 1 -- 172.21.15.81:0/1027071209 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc23406c2b0 msgr2=0x7fc23406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.548+0000 7fc257bf1640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc23406c2b0 0x7fc23406e770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc25015b3c0 tx=0x7fc24c008040 comp rx=0 tx=0).stop 2024-09-16T01:21:43.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.548+0000 7fc257bf1640 1 -- 172.21.15.81:0/1027071209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250071750 msgr2=0x7fc2501523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.548+0000 7fc257bf1640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250071750 0x7fc2501523f0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fc24400c460 tx=0x7fc24400c920 comp rx=0 tx=0).stop 2024-09-16T01:21:43.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.548+0000 7fc257bf1640 1 -- 172.21.15.81:0/1027071209 shutdown_connections 2024-09-16T01:21:43.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.548+0000 7fc257bf1640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc23406c2b0 0x7fc23406e770 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.548+0000 7fc257bf1640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2500d0b20 0x7fc2500c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.548+0000 7fc257bf1640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc25009aca0 0x7fc250156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.548+0000 7fc257bf1640 1 --2- 172.21.15.81:0/1027071209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc250071750 0x7fc2501523f0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.548+0000 7fc257bf1640 1 -- 172.21.15.81:0/1027071209 >> 172.21.15.81:0/1027071209 conn(0x7fc2500d23a0 msgr2=0x7fc25015d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:43.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.548+0000 7fc257bf1640 1 -- 172.21.15.81:0/1027071209 shutdown_connections 2024-09-16T01:21:43.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.548+0000 7fc257bf1640 1 -- 172.21.15.81:0/1027071209 wait complete. 2024-09-16T01:21:43.561 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:21:43.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:21:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.657+0000 7fe23763c640 1 Processor -- start 2024-09-16T01:21:43.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.657+0000 7fe23763c640 1 -- start start 2024-09-16T01:21:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe23763c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe230072320 0x7fe2300cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe23763c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe230072de0 0x7fe23006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe23763c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe230072700 0x7fe23006e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe23763c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe230146140 con 0x7fe230072320 2024-09-16T01:21:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe23763c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe2300cd740 con 0x7fe230072700 2024-09-16T01:21:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe23763c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe2300cda20 con 0x7fe230072de0 2024-09-16T01:21:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe2353d8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe230072320 0x7fe2300cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe2353d8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe230072320 0x7fe2300cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34696/0 (socket says 172.21.15.81:34696) 2024-09-16T01:21:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe2353d8640 1 -- 172.21.15.81:0/2554556054 learned_addr learned my addr 172.21.15.81:0/2554556054 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe235bd9640 1 --2- 172.21.15.81:0/2554556054 >> v2:172.21.15.102:3300/0 conn(0x7fe230072700 0x7fe23006e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe234bd7640 1 --2- 172.21.15.81:0/2554556054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe230072de0 0x7fe23006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe2353d8640 1 -- 172.21.15.81:0/2554556054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe230072de0 msgr2=0x7fe23006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe2353d8640 1 --2- 172.21.15.81:0/2554556054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe230072de0 0x7fe23006e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe2353d8640 1 -- 172.21.15.81:0/2554556054 >> v2:172.21.15.102:3300/0 conn(0x7fe230072700 msgr2=0x7fe23006e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe2353d8640 1 --2- 172.21.15.81:0/2554556054 >> v2:172.21.15.102:3300/0 conn(0x7fe230072700 0x7fe23006e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.658+0000 7fe2353d8640 1 -- 172.21.15.81:0/2554556054 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2300cdd00 con 0x7fe230072320 2024-09-16T01:21:43.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.659+0000 7fe2353d8640 1 --2- 172.21.15.81:0/2554556054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe230072320 0x7fe2300cce60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe23006f4e0 tx=0x7fe22c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ef71e65c80cf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:43.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.659+0000 7fe227fff640 1 -- 172.21.15.81:0/2554556054 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c036070 con 0x7fe230072320 2024-09-16T01:21:43.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.659+0000 7fe227fff640 1 -- 172.21.15.81:0/2554556054 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe22c031600 con 0x7fe230072320 2024-09-16T01:21:43.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.659+0000 7fe227fff640 1 -- 172.21.15.81:0/2554556054 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0319d0 con 0x7fe230072320 2024-09-16T01:21:43.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.660+0000 7fe23763c640 1 -- 172.21.15.81:0/2554556054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe230072320 msgr2=0x7fe2300cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.660+0000 7fe23763c640 1 --2- 172.21.15.81:0/2554556054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe230072320 0x7fe2300cce60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe23006f4e0 tx=0x7fe22c02a610 comp rx=0 tx=0).stop 2024-09-16T01:21:43.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.660+0000 7fe23763c640 1 -- 172.21.15.81:0/2554556054 shutdown_connections 2024-09-16T01:21:43.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.660+0000 7fe23763c640 1 --2- 172.21.15.81:0/2554556054 >> v2:172.21.15.102:3300/0 conn(0x7fe230072700 0x7fe23006e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.660+0000 7fe23763c640 1 --2- 172.21.15.81:0/2554556054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe230072de0 0x7fe23006e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.660+0000 7fe23763c640 1 --2- 172.21.15.81:0/2554556054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe230072320 0x7fe2300cce60 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.660+0000 7fe23763c640 1 -- 172.21.15.81:0/2554556054 >> 172.21.15.81:0/2554556054 conn(0x7fe230067d70 msgr2=0x7fe23006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:43.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.660+0000 7fe23763c640 1 -- 172.21.15.81:0/2554556054 shutdown_connections 2024-09-16T01:21:43.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.660+0000 7fe23763c640 1 -- 172.21.15.81:0/2554556054 wait complete. 2024-09-16T01:21:43.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.661+0000 7fe23763c640 1 Processor -- start 2024-09-16T01:21:43.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.661+0000 7fe23763c640 1 -- start start 2024-09-16T01:21:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe23763c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe230072320 0x7fe2300ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe23763c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe230072700 0x7fe2300a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe23763c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe230072de0 0x7fe2300ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe23763c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2300cd520 con 0x7fe230072320 2024-09-16T01:21:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe23763c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe2300cd3a0 con 0x7fe230072de0 2024-09-16T01:21:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe23763c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe23006eb30 con 0x7fe230072700 2024-09-16T01:21:43.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe2353d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe230072320 0x7fe2300ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe2353d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe230072320 0x7fe2300ac7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34704/0 (socket says 172.21.15.81:34704) 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe2353d8640 1 -- 172.21.15.81:0/1582120054 learned_addr learned my addr 172.21.15.81:0/1582120054 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe234bd7640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe230072700 0x7fe2300a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe235bd9640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe230072de0 0x7fe2300ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe2353d8640 1 -- 172.21.15.81:0/1582120054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe230072700 msgr2=0x7fe2300a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe2353d8640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe230072700 0x7fe2300a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe2353d8640 1 -- 172.21.15.81:0/1582120054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe230072de0 msgr2=0x7fe2300ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe2353d8640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe230072de0 0x7fe2300ad950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe2353d8640 1 -- 172.21.15.81:0/1582120054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2300a9f50 con 0x7fe230072320 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.662+0000 7fe234bd7640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe230072700 0x7fe2300a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.663+0000 7fe2353d8640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe230072320 0x7fe2300ac7c0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe22c034040 tx=0x7fe22c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.663+0000 7fe225ffb640 1 -- 172.21.15.81:0/1582120054 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c036050 con 0x7fe230072320 2024-09-16T01:21:43.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.663+0000 7fe225ffb640 1 -- 172.21.15.81:0/1582120054 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe22c042070 con 0x7fe230072320 2024-09-16T01:21:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.663+0000 7fe225ffb640 1 -- 172.21.15.81:0/1582120054 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c009510 con 0x7fe230072320 2024-09-16T01:21:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.663+0000 7fe23763c640 1 -- 172.21.15.81:0/1582120054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2300aa230 con 0x7fe230072320 2024-09-16T01:21:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.663+0000 7fe23763c640 1 -- 172.21.15.81:0/1582120054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2300aa7f0 con 0x7fe230072320 2024-09-16T01:21:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.664+0000 7fe23763c640 1 -- 172.21.15.81:0/1582120054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe230073240 con 0x7fe230072320 2024-09-16T01:21:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.664+0000 7fe225ffb640 1 -- 172.21.15.81:0/1582120054 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe22c007c50 con 0x7fe230072320 2024-09-16T01:21:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.665+0000 7fe225ffb640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe21406c2b0 0x7fe21406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.665+0000 7fe225ffb640 1 -- 172.21.15.81:0/1582120054 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fe22c0ac380 con 0x7fe230072320 2024-09-16T01:21:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.665+0000 7fe234bd7640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe21406c2b0 0x7fe21406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.665+0000 7fe234bd7640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe21406c2b0 0x7fe21406e770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe2301456c0 tx=0x7fe220008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:43.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.669+0000 7fe225ffb640 1 -- 172.21.15.81:0/1582120054 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe230073240 con 0x7fe230072320 2024-09-16T01:21:43.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.830+0000 7fe23763c640 1 -- 172.21.15.81:0/1582120054 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe230144a60 con 0x7fe21406c2b0 2024-09-16T01:21:43.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.836+0000 7fe225ffb640 1 -- 172.21.15.81:0/1582120054 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237282 (secure 0 0 0) 0x7fe230144a60 con 0x7fe21406c2b0 2024-09-16T01:21:43.841 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:43.842 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:21:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.839+0000 7fe23763c640 1 -- 172.21.15.81:0/1582120054 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe21406c2b0 msgr2=0x7fe21406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.839+0000 7fe23763c640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe21406c2b0 0x7fe21406e770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe2301456c0 tx=0x7fe220008040 comp rx=0 tx=0).stop 2024-09-16T01:21:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.839+0000 7fe23763c640 1 -- 172.21.15.81:0/1582120054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe230072320 msgr2=0x7fe2300ac7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.839+0000 7fe23763c640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe230072320 0x7fe2300ac7c0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe22c034040 tx=0x7fe22c004a40 comp rx=0 tx=0).stop 2024-09-16T01:21:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.839+0000 7fe23763c640 1 -- 172.21.15.81:0/1582120054 shutdown_connections 2024-09-16T01:21:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.839+0000 7fe23763c640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe21406c2b0 0x7fe21406e770 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.839+0000 7fe23763c640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe230072de0 0x7fe2300ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.839+0000 7fe23763c640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe230072700 0x7fe2300a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.839+0000 7fe23763c640 1 --2- 172.21.15.81:0/1582120054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe230072320 0x7fe2300ac7c0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.839+0000 7fe23763c640 1 -- 172.21.15.81:0/1582120054 >> 172.21.15.81:0/1582120054 conn(0x7fe230067d70 msgr2=0x7fe2300ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.839+0000 7fe23763c640 1 -- 172.21.15.81:0/1582120054 shutdown_connections 2024-09-16T01:21:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.839+0000 7fe23763c640 1 -- 172.21.15.81:0/1582120054 wait complete. 2024-09-16T01:21:43.851 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2024-09-16T01:21:42.139391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":260028,"kb_used_data":10484,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714692,"statfs":{"total":773094113280,"available":772827844608,"internally_reserved":0,"allocated":10735616,"data_stored":5531031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000756"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:39.898072+0000","last_change":"2024-09-16T01:21:39.898072+0000","last_active":"2024-09-16T01:21:39.898072+0000","last_peered":"2024-09-16T01:21:39.898072+0000","last_clean":"2024-09-16T01:21:39.898072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:39.898072+0000","last_undegraded":"2024-09-16T01:21:39.898072+0000","last_fullsized":"2024-09-16T01:21:39.898072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:38.893030+0000","last_change":"2024-09-16T01:21:38.893030+0000","last_active":"2024-09-16T01:21:38.893030+0000","last_peered":"2024-09-16T01:21:38.893030+0000","last_clean":"2024-09-16T01:21:38.893030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:38.893030+0000","last_undegraded":"2024-09-16T01:21:38.893030+0000","last_fullsized":"2024-09-16T01:21:38.893030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":308,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-16T01:21:37.066413+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:21:37.066413+0000","last_peered":"2024-09-16T01:21:37.066413+0000","last_clean":"2024-09-16T01:21:37.066413+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:21:37.066413+0000","last_undegraded":"2024-09-16T01:21:37.066413+0000","last_fullsized":"2024-09-16T01:21:37.066413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1133465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574926,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1191936,"data_stored":543097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1191936,"data_stored":543097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32364,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339476,"statfs":{"total":96636764160,"available":96603623424,"internally_reserved":0,"allocated":1204224,"data_stored":548616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32360,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1191936,"data_stored":543097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32356,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1191936,"data_stored":543097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32356,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1191936,"data_stored":543097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":1133465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:21:43.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:21:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.997+0000 7f6e29791640 1 Processor -- start 2024-09-16T01:21:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.997+0000 7f6e29791640 1 -- start start 2024-09-16T01:21:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.998+0000 7f6e29791640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e240b6680 0x7f6e24169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.998+0000 7f6e29791640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e2406d9f0 con 0x7f6e24162060 2024-09-16T01:21:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.998+0000 7f6e29791640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e2406dcd0 con 0x7f6e24161c80 2024-09-16T01:21:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.998+0000 7f6e29791640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6e2406dfb0 con 0x7f6e240b6680 2024-09-16T01:21:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.998+0000 7f6e237fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e240b6680 0x7f6e24169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.998+0000 7f6e227fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6e24162060 0x7f6e240b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49124/0 (socket says 172.21.15.81:49124) 2024-09-16T01:21:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.998+0000 7f6e227fc640 1 -- 172.21.15.81:0/2847951784 learned_addr learned my addr 172.21.15.81:0/2847951784 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.998+0000 7f6e237fe640 1 --2- 172.21.15.81:0/2847951784 >> v2:172.21.15.81:3300/0 conn(0x7f6e240b6680 0x7f6e24169830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34718/0 (socket says 172.21.15.81:34718) 2024-09-16T01:21:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.998+0000 7f6e237fe640 1 -- 172.21.15.81:0/2847951784 >> v1:172.21.15.102:6789/0 conn(0x7f6e24161c80 legacy=0x7f6e2406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.998+0000 7f6e237fe640 1 -- 172.21.15.81:0/2847951784 >> v1:172.21.15.81:6789/0 conn(0x7f6e24162060 legacy=0x7f6e240b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.998+0000 7f6e237fe640 1 -- 172.21.15.81:0/2847951784 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e240d01f0 con 0x7f6e240b6680 2024-09-16T01:21:44.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.999+0000 7f6e237fe640 1 --2- 172.21.15.81:0/2847951784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e240b6680 0x7f6e24169830 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009d90 tx=0x7f6e1c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2fee6d00df82c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:44.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.999+0000 7f6e21ffb640 1 -- 172.21.15.81:0/2847951784 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c007740 con 0x7f6e240b6680 2024-09-16T01:21:44.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.999+0000 7f6e21ffb640 1 -- 172.21.15.81:0/2847951784 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0078e0 con 0x7f6e240b6680 2024-09-16T01:21:44.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:43.999+0000 7f6e21ffb640 1 -- 172.21.15.81:0/2847951784 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c007cb0 con 0x7f6e240b6680 2024-09-16T01:21:44.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.000+0000 7f6e29791640 1 -- 172.21.15.81:0/2847951784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e240b6680 msgr2=0x7f6e24169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.000+0000 7f6e29791640 1 --2- 172.21.15.81:0/2847951784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e240b6680 0x7f6e24169830 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009d90 tx=0x7f6e1c02a6a0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.000+0000 7f6e29791640 1 -- 172.21.15.81:0/2847951784 shutdown_connections 2024-09-16T01:21:44.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.000+0000 7f6e29791640 1 --2- 172.21.15.81:0/2847951784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e240b6680 0x7f6e24169830 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.000+0000 7f6e29791640 1 -- 172.21.15.81:0/2847951784 >> 172.21.15.81:0/2847951784 conn(0x7f6e240d44f0 msgr2=0x7f6e240d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:44.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.000+0000 7f6e29791640 1 -- 172.21.15.81:0/2847951784 shutdown_connections 2024-09-16T01:21:44.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.000+0000 7f6e29791640 1 -- 172.21.15.81:0/2847951784 wait complete. 2024-09-16T01:21:44.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.001+0000 7f6e29791640 1 Processor -- start 2024-09-16T01:21:44.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.001+0000 7f6e29791640 1 -- start start 2024-09-16T01:21:44.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e29791640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e240b6680 0x7f6e240b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e29791640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e24161c80 0x7f6e2415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e29791640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e24162060 0x7f6e2415c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e29791640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6e240b6cb0 con 0x7f6e24162060 2024-09-16T01:21:44.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e29791640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6e240b6b30 con 0x7f6e240b6680 2024-09-16T01:21:44.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e29791640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6e24169d70 con 0x7f6e24161c80 2024-09-16T01:21:44.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e24162060 0x7f6e2415c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e24162060 0x7f6e2415c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34724/0 (socket says 172.21.15.81:34724) 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e237fe640 1 -- 172.21.15.81:0/168413646 learned_addr learned my addr 172.21.15.81:0/168413646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e22ffd640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e240b6680 0x7f6e240b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e227fc640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e24161c80 0x7f6e2415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e237fe640 1 -- 172.21.15.81:0/168413646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e24161c80 msgr2=0x7f6e2415c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e237fe640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e24161c80 0x7f6e2415c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e237fe640 1 -- 172.21.15.81:0/168413646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e240b6680 msgr2=0x7f6e240b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e237fe640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e240b6680 0x7f6e240b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e237fe640 1 -- 172.21.15.81:0/168413646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e240b82c0 con 0x7f6e24162060 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e22ffd640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e240b6680 0x7f6e240b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e237fe640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e24162060 0x7f6e2415c830 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c02ac90 tx=0x7f6e1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.002+0000 7f6e0b7fe640 1 -- 172.21.15.81:0/168413646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c040070 con 0x7f6e24162060 2024-09-16T01:21:44.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.003+0000 7f6e0b7fe640 1 -- 172.21.15.81:0/168413646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c031c40 con 0x7f6e24162060 2024-09-16T01:21:44.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.003+0000 7f6e0b7fe640 1 -- 172.21.15.81:0/168413646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c03c420 con 0x7f6e24162060 2024-09-16T01:21:44.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.003+0000 7f6e29791640 1 -- 172.21.15.81:0/168413646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e240b8d00 con 0x7f6e24162060 2024-09-16T01:21:44.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.003+0000 7f6e29791640 1 -- 172.21.15.81:0/168413646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e240b92c0 con 0x7f6e24162060 2024-09-16T01:21:44.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.004+0000 7f6e29791640 1 -- 172.21.15.81:0/168413646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e240b5f70 con 0x7f6e24162060 2024-09-16T01:21:44.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.004+0000 7f6e0b7fe640 1 -- 172.21.15.81:0/168413646 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6e1c039040 con 0x7f6e24162060 2024-09-16T01:21:44.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.005+0000 7f6e0b7fe640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6e1006c2b0 0x7f6e1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.005+0000 7f6e0b7fe640 1 -- 172.21.15.81:0/168413646 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f6e1c0acbb0 con 0x7f6e24162060 2024-09-16T01:21:44.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.005+0000 7f6e22ffd640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6e1006c2b0 0x7f6e1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.005+0000 7f6e22ffd640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6e1006c2b0 0x7f6e1006e770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6e240d2eb0 tx=0x7f6e14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:44.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.009+0000 7f6e0b7fe640 1 -- 172.21.15.81:0/168413646 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e1c07b190 con 0x7f6e24162060 2024-09-16T01:21:44.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.171+0000 7f6e29791640 1 -- 172.21.15.81:0/168413646 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e240d1ab0 con 0x7f6e1006c2b0 2024-09-16T01:21:44.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.177+0000 7f6e0b7fe640 1 -- 172.21.15.81:0/168413646 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252259 (secure 0 0 0) 0x7f6e240d1ab0 con 0x7f6e1006c2b0 2024-09-16T01:21:44.181 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:21:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.179+0000 7f6e29791640 1 -- 172.21.15.81:0/168413646 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6e1006c2b0 msgr2=0x7f6e1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.179+0000 7f6e29791640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6e1006c2b0 0x7f6e1006e770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6e240d2eb0 tx=0x7f6e14008040 comp rx=0 tx=0).stop 2024-09-16T01:21:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.179+0000 7f6e29791640 1 -- 172.21.15.81:0/168413646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e24162060 msgr2=0x7f6e2415c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.179+0000 7f6e29791640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e24162060 0x7f6e2415c830 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c02ac90 tx=0x7f6e1c004a40 comp rx=0 tx=0).stop 2024-09-16T01:21:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.180+0000 7f6e29791640 1 -- 172.21.15.81:0/168413646 shutdown_connections 2024-09-16T01:21:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.180+0000 7f6e29791640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6e1006c2b0 0x7f6e1006e770 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.180+0000 7f6e29791640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e24162060 0x7f6e2415c830 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.180+0000 7f6e29791640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6e24161c80 0x7f6e2415c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.180+0000 7f6e29791640 1 --2- 172.21.15.81:0/168413646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6e240b6680 0x7f6e240b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.180+0000 7f6e29791640 1 -- 172.21.15.81:0/168413646 >> 172.21.15.81:0/168413646 conn(0x7f6e240d44f0 msgr2=0x7f6e240b45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.180+0000 7f6e29791640 1 -- 172.21.15.81:0/168413646 shutdown_connections 2024-09-16T01:21:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.180+0000 7f6e29791640 1 -- 172.21.15.81:0/168413646 wait complete. 2024-09-16T01:21:44.193 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-09-16T01:21:44.139686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":105,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260544,"kb_used_data":11016,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714176,"statfs":{"total":773094113280,"available":772827316224,"internally_reserved":0,"allocated":11280384,"data_stored":5788364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.241530"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000664+0000","last_change":"2024-09-16T01:21:40.924818+0000","last_active":"2024-09-16T01:21:42.000664+0000","last_peered":"2024-09-16T01:21:42.000664+0000","last_clean":"2024-09-16T01:21:42.000664+0000","last_became_active":"2024-09-16T01:21:40.924527+0000","last_became_peered":"2024-09-16T01:21:40.924527+0000","last_unstale":"2024-09-16T01:21:42.000664+0000","last_undegraded":"2024-09-16T01:21:42.000664+0000","last_fullsized":"2024-09-16T01:21:42.000664+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:21.015761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000232+0000","last_change":"2024-09-16T01:21:40.926858+0000","last_active":"2024-09-16T01:21:42.000232+0000","last_peered":"2024-09-16T01:21:42.000232+0000","last_clean":"2024-09-16T01:21:42.000232+0000","last_became_active":"2024-09-16T01:21:40.926585+0000","last_became_peered":"2024-09-16T01:21:40.926585+0000","last_unstale":"2024-09-16T01:21:42.000232+0000","last_undegraded":"2024-09-16T01:21:42.000232+0000","last_fullsized":"2024-09-16T01:21:42.000232+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:41.799261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999780+0000","last_change":"2024-09-16T01:21:40.923990+0000","last_active":"2024-09-16T01:21:41.999780+0000","last_peered":"2024-09-16T01:21:41.999780+0000","last_clean":"2024-09-16T01:21:41.999780+0000","last_became_active":"2024-09-16T01:21:40.923705+0000","last_became_peered":"2024-09-16T01:21:40.923705+0000","last_unstale":"2024-09-16T01:21:41.999780+0000","last_undegraded":"2024-09-16T01:21:41.999780+0000","last_fullsized":"2024-09-16T01:21:41.999780+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:20:40.411241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.001842+0000","last_change":"2024-09-16T01:21:40.922675+0000","last_active":"2024-09-16T01:21:42.001842+0000","last_peered":"2024-09-16T01:21:42.001842+0000","last_clean":"2024-09-16T01:21:42.001842+0000","last_became_active":"2024-09-16T01:21:40.922396+0000","last_became_peered":"2024-09-16T01:21:40.922396+0000","last_unstale":"2024-09-16T01:21:42.001842+0000","last_undegraded":"2024-09-16T01:21:42.001842+0000","last_fullsized":"2024-09-16T01:21:42.001842+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:42:56.673532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000750+0000","last_change":"2024-09-16T01:21:40.916929+0000","last_active":"2024-09-16T01:21:42.000750+0000","last_peered":"2024-09-16T01:21:42.000750+0000","last_clean":"2024-09-16T01:21:42.000750+0000","last_became_active":"2024-09-16T01:21:40.916665+0000","last_became_peered":"2024-09-16T01:21:40.916665+0000","last_unstale":"2024-09-16T01:21:42.000750+0000","last_undegraded":"2024-09-16T01:21:42.000750+0000","last_fullsized":"2024-09-16T01:21:42.000750+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:10.264960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999837+0000","last_change":"2024-09-16T01:21:40.934211+0000","last_active":"2024-09-16T01:21:41.999837+0000","last_peered":"2024-09-16T01:21:41.999837+0000","last_clean":"2024-09-16T01:21:41.999837+0000","last_became_active":"2024-09-16T01:21:40.933884+0000","last_became_peered":"2024-09-16T01:21:40.933884+0000","last_unstale":"2024-09-16T01:21:41.999837+0000","last_undegraded":"2024-09-16T01:21:41.999837+0000","last_fullsized":"2024-09-16T01:21:41.999837+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:50.689463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999718+0000","last_change":"2024-09-16T01:21:40.934317+0000","last_active":"2024-09-16T01:21:41.999718+0000","last_peered":"2024-09-16T01:21:41.999718+0000","last_clean":"2024-09-16T01:21:41.999718+0000","last_became_active":"2024-09-16T01:21:40.933976+0000","last_became_peered":"2024-09-16T01:21:40.933976+0000","last_unstale":"2024-09-16T01:21:41.999718+0000","last_undegraded":"2024-09-16T01:21:41.999718+0000","last_fullsized":"2024-09-16T01:21:41.999718+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:40.246470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999568+0000","last_change":"2024-09-16T01:21:40.921275+0000","last_active":"2024-09-16T01:21:41.999568+0000","last_peered":"2024-09-16T01:21:41.999568+0000","last_clean":"2024-09-16T01:21:41.999568+0000","last_became_active":"2024-09-16T01:21:40.920517+0000","last_became_peered":"2024-09-16T01:21:40.920517+0000","last_unstale":"2024-09-16T01:21:41.999568+0000","last_undegraded":"2024-09-16T01:21:41.999568+0000","last_fullsized":"2024-09-16T01:21:41.999568+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:14.186266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000233+0000","last_change":"2024-09-16T01:21:40.933858+0000","last_active":"2024-09-16T01:21:42.000233+0000","last_peered":"2024-09-16T01:21:42.000233+0000","last_clean":"2024-09-16T01:21:42.000233+0000","last_became_active":"2024-09-16T01:21:40.933582+0000","last_became_peered":"2024-09-16T01:21:40.933582+0000","last_unstale":"2024-09-16T01:21:42.000233+0000","last_undegraded":"2024-09-16T01:21:42.000233+0000","last_fullsized":"2024-09-16T01:21:42.000233+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:18:30.528228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999962+0000","last_change":"2024-09-16T01:21:40.924971+0000","last_active":"2024-09-16T01:21:41.999962+0000","last_peered":"2024-09-16T01:21:41.999962+0000","last_clean":"2024-09-16T01:21:41.999962+0000","last_became_active":"2024-09-16T01:21:40.924374+0000","last_became_peered":"2024-09-16T01:21:40.924374+0000","last_unstale":"2024-09-16T01:21:41.999962+0000","last_undegraded":"2024-09-16T01:21:41.999962+0000","last_fullsized":"2024-09-16T01:21:41.999962+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:40.246470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.927393+0000","last_change":"2024-09-16T01:21:40.928454+0000","last_active":"2024-09-16T01:21:41.927393+0000","last_peered":"2024-09-16T01:21:41.927393+0000","last_clean":"2024-09-16T01:21:41.927393+0000","last_became_active":"2024-09-16T01:21:40.928105+0000","last_became_peered":"2024-09-16T01:21:40.928105+0000","last_unstale":"2024-09-16T01:21:41.927393+0000","last_undegraded":"2024-09-16T01:21:41.927393+0000","last_fullsized":"2024-09-16T01:21:41.927393+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:44.298879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926537+0000","last_change":"2024-09-16T01:21:40.920616+0000","last_active":"2024-09-16T01:21:41.926537+0000","last_peered":"2024-09-16T01:21:41.926537+0000","last_clean":"2024-09-16T01:21:41.926537+0000","last_became_active":"2024-09-16T01:21:40.920342+0000","last_became_peered":"2024-09-16T01:21:40.920342+0000","last_unstale":"2024-09-16T01:21:41.926537+0000","last_undegraded":"2024-09-16T01:21:41.926537+0000","last_fullsized":"2024-09-16T01:21:41.926537+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:10.264960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.001660+0000","last_change":"2024-09-16T01:21:40.928881+0000","last_active":"2024-09-16T01:21:42.001660+0000","last_peered":"2024-09-16T01:21:42.001660+0000","last_clean":"2024-09-16T01:21:42.001660+0000","last_became_active":"2024-09-16T01:21:40.927912+0000","last_became_peered":"2024-09-16T01:21:40.927912+0000","last_unstale":"2024-09-16T01:21:42.001660+0000","last_undegraded":"2024-09-16T01:21:42.001660+0000","last_fullsized":"2024-09-16T01:21:42.001660+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:18:30.528228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.925589+0000","last_change":"2024-09-16T01:21:40.920179+0000","last_active":"2024-09-16T01:21:41.925589+0000","last_peered":"2024-09-16T01:21:41.925589+0000","last_clean":"2024-09-16T01:21:41.925589+0000","last_became_active":"2024-09-16T01:21:40.919891+0000","last_became_peered":"2024-09-16T01:21:40.919891+0000","last_unstale":"2024-09-16T01:21:41.925589+0000","last_undegraded":"2024-09-16T01:21:41.925589+0000","last_fullsized":"2024-09-16T01:21:41.925589+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:10.865481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.925616+0000","last_change":"2024-09-16T01:21:40.921229+0000","last_active":"2024-09-16T01:21:41.925616+0000","last_peered":"2024-09-16T01:21:41.925616+0000","last_clean":"2024-09-16T01:21:41.925616+0000","last_became_active":"2024-09-16T01:21:40.920952+0000","last_became_peered":"2024-09-16T01:21:40.920952+0000","last_unstale":"2024-09-16T01:21:41.925616+0000","last_undegraded":"2024-09-16T01:21:41.925616+0000","last_fullsized":"2024-09-16T01:21:41.925616+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:37.794559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.925650+0000","last_change":"2024-09-16T01:21:40.922047+0000","last_active":"2024-09-16T01:21:41.925650+0000","last_peered":"2024-09-16T01:21:41.925650+0000","last_clean":"2024-09-16T01:21:41.925650+0000","last_became_active":"2024-09-16T01:21:40.921732+0000","last_became_peered":"2024-09-16T01:21:40.921732+0000","last_unstale":"2024-09-16T01:21:41.925650+0000","last_undegraded":"2024-09-16T01:21:41.925650+0000","last_fullsized":"2024-09-16T01:21:41.925650+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:33:16.786713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000793+0000","last_change":"2024-09-16T01:21:40.922061+0000","last_active":"2024-09-16T01:21:42.000793+0000","last_peered":"2024-09-16T01:21:42.000793+0000","last_clean":"2024-09-16T01:21:42.000793+0000","last_became_active":"2024-09-16T01:21:40.921808+0000","last_became_peered":"2024-09-16T01:21:40.921808+0000","last_unstale":"2024-09-16T01:21:42.000793+0000","last_undegraded":"2024-09-16T01:21:42.000793+0000","last_fullsized":"2024-09-16T01:21:42.000793+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:18:18.831128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000294+0000","last_change":"2024-09-16T01:21:40.930270+0000","last_active":"2024-09-16T01:21:42.000294+0000","last_peered":"2024-09-16T01:21:42.000294+0000","last_clean":"2024-09-16T01:21:42.000294+0000","last_became_active":"2024-09-16T01:21:40.929942+0000","last_became_peered":"2024-09-16T01:21:40.929942+0000","last_unstale":"2024-09-16T01:21:42.000294+0000","last_undegraded":"2024-09-16T01:21:42.000294+0000","last_fullsized":"2024-09-16T01:21:42.000294+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:51.017133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999909+0000","last_change":"2024-09-16T01:21:40.926350+0000","last_active":"2024-09-16T01:21:41.999909+0000","last_peered":"2024-09-16T01:21:41.999909+0000","last_clean":"2024-09-16T01:21:41.999909+0000","last_became_active":"2024-09-16T01:21:40.926067+0000","last_became_peered":"2024-09-16T01:21:40.926067+0000","last_unstale":"2024-09-16T01:21:41.999909+0000","last_undegraded":"2024-09-16T01:21:41.999909+0000","last_fullsized":"2024-09-16T01:21:41.999909+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:50.936405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926656+0000","last_change":"2024-09-16T01:21:40.921530+0000","last_active":"2024-09-16T01:21:41.926656+0000","last_peered":"2024-09-16T01:21:41.926656+0000","last_clean":"2024-09-16T01:21:41.926656+0000","last_became_active":"2024-09-16T01:21:40.921239+0000","last_became_peered":"2024-09-16T01:21:40.921239+0000","last_unstale":"2024-09-16T01:21:41.926656+0000","last_undegraded":"2024-09-16T01:21:41.926656+0000","last_fullsized":"2024-09-16T01:21:41.926656+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:44.298879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000668+0000","last_change":"2024-09-16T01:21:40.920587+0000","last_active":"2024-09-16T01:21:42.000668+0000","last_peered":"2024-09-16T01:21:42.000668+0000","last_clean":"2024-09-16T01:21:42.000668+0000","last_became_active":"2024-09-16T01:21:40.920088+0000","last_became_peered":"2024-09-16T01:21:40.920088+0000","last_unstale":"2024-09-16T01:21:42.000668+0000","last_undegraded":"2024-09-16T01:21:42.000668+0000","last_fullsized":"2024-09-16T01:21:42.000668+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:00.161340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000750+0000","last_change":"2024-09-16T01:21:40.919219+0000","last_active":"2024-09-16T01:21:42.000750+0000","last_peered":"2024-09-16T01:21:42.000750+0000","last_clean":"2024-09-16T01:21:42.000750+0000","last_became_active":"2024-09-16T01:21:40.918955+0000","last_became_peered":"2024-09-16T01:21:40.918955+0000","last_unstale":"2024-09-16T01:21:42.000750+0000","last_undegraded":"2024-09-16T01:21:42.000750+0000","last_fullsized":"2024-09-16T01:21:42.000750+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:44.194522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999649+0000","last_change":"2024-09-16T01:21:40.918839+0000","last_active":"2024-09-16T01:21:41.999649+0000","last_peered":"2024-09-16T01:21:41.999649+0000","last_clean":"2024-09-16T01:21:41.999649+0000","last_became_active":"2024-09-16T01:21:40.918308+0000","last_became_peered":"2024-09-16T01:21:40.918308+0000","last_unstale":"2024-09-16T01:21:41.999649+0000","last_undegraded":"2024-09-16T01:21:41.999649+0000","last_fullsized":"2024-09-16T01:21:41.999649+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:01.985917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000345+0000","last_change":"2024-09-16T01:21:40.925226+0000","last_active":"2024-09-16T01:21:42.000345+0000","last_peered":"2024-09-16T01:21:42.000345+0000","last_clean":"2024-09-16T01:21:42.000345+0000","last_became_active":"2024-09-16T01:21:40.924945+0000","last_became_peered":"2024-09-16T01:21:40.924945+0000","last_unstale":"2024-09-16T01:21:42.000345+0000","last_undegraded":"2024-09-16T01:21:42.000345+0000","last_fullsized":"2024-09-16T01:21:42.000345+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:38.105034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926544+0000","last_change":"2024-09-16T01:21:40.917888+0000","last_active":"2024-09-16T01:21:41.926544+0000","last_peered":"2024-09-16T01:21:41.926544+0000","last_clean":"2024-09-16T01:21:41.926544+0000","last_became_active":"2024-09-16T01:21:40.917506+0000","last_became_peered":"2024-09-16T01:21:40.917506+0000","last_unstale":"2024-09-16T01:21:41.926544+0000","last_undegraded":"2024-09-16T01:21:41.926544+0000","last_fullsized":"2024-09-16T01:21:41.926544+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:44.194522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926828+0000","last_change":"2024-09-16T01:21:40.921413+0000","last_active":"2024-09-16T01:21:41.926828+0000","last_peered":"2024-09-16T01:21:41.926828+0000","last_clean":"2024-09-16T01:21:41.926828+0000","last_became_active":"2024-09-16T01:21:40.921137+0000","last_became_peered":"2024-09-16T01:21:40.921137+0000","last_unstale":"2024-09-16T01:21:41.926828+0000","last_undegraded":"2024-09-16T01:21:41.926828+0000","last_fullsized":"2024-09-16T01:21:41.926828+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:18:30.528228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.927407+0000","last_change":"2024-09-16T01:21:40.919243+0000","last_active":"2024-09-16T01:21:41.927407+0000","last_peered":"2024-09-16T01:21:41.927407+0000","last_clean":"2024-09-16T01:21:41.927407+0000","last_became_active":"2024-09-16T01:21:40.918959+0000","last_became_peered":"2024-09-16T01:21:40.918959+0000","last_unstale":"2024-09-16T01:21:41.927407+0000","last_undegraded":"2024-09-16T01:21:41.927407+0000","last_fullsized":"2024-09-16T01:21:41.927407+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:18:30.528228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999930+0000","last_change":"2024-09-16T01:21:40.931537+0000","last_active":"2024-09-16T01:21:41.999930+0000","last_peered":"2024-09-16T01:21:41.999930+0000","last_clean":"2024-09-16T01:21:41.999930+0000","last_became_active":"2024-09-16T01:21:40.930790+0000","last_became_peered":"2024-09-16T01:21:40.930790+0000","last_unstale":"2024-09-16T01:21:41.999930+0000","last_undegraded":"2024-09-16T01:21:41.999930+0000","last_fullsized":"2024-09-16T01:21:41.999930+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:44.194522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000724+0000","last_change":"2024-09-16T01:21:40.920351+0000","last_active":"2024-09-16T01:21:42.000724+0000","last_peered":"2024-09-16T01:21:42.000724+0000","last_clean":"2024-09-16T01:21:42.000724+0000","last_became_active":"2024-09-16T01:21:40.919796+0000","last_became_peered":"2024-09-16T01:21:40.919796+0000","last_unstale":"2024-09-16T01:21:42.000724+0000","last_undegraded":"2024-09-16T01:21:42.000724+0000","last_fullsized":"2024-09-16T01:21:42.000724+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:37.502832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926905+0000","last_change":"2024-09-16T01:21:40.917855+0000","last_active":"2024-09-16T01:21:41.926905+0000","last_peered":"2024-09-16T01:21:41.926905+0000","last_clean":"2024-09-16T01:21:41.926905+0000","last_became_active":"2024-09-16T01:21:40.917555+0000","last_became_peered":"2024-09-16T01:21:40.917555+0000","last_unstale":"2024-09-16T01:21:41.926905+0000","last_undegraded":"2024-09-16T01:21:41.926905+0000","last_fullsized":"2024-09-16T01:21:41.926905+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:41.799261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999732+0000","last_change":"2024-09-16T01:21:40.932027+0000","last_active":"2024-09-16T01:21:41.999732+0000","last_peered":"2024-09-16T01:21:41.999732+0000","last_clean":"2024-09-16T01:21:41.999732+0000","last_became_active":"2024-09-16T01:21:40.931757+0000","last_became_peered":"2024-09-16T01:21:40.931757+0000","last_unstale":"2024-09-16T01:21:41.999732+0000","last_undegraded":"2024-09-16T01:21:41.999732+0000","last_fullsized":"2024-09-16T01:21:41.999732+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:38.105034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999706+0000","last_change":"2024-09-16T01:21:40.917679+0000","last_active":"2024-09-16T01:21:41.999706+0000","last_peered":"2024-09-16T01:21:41.999706+0000","last_clean":"2024-09-16T01:21:41.999706+0000","last_became_active":"2024-09-16T01:21:40.917380+0000","last_became_peered":"2024-09-16T01:21:40.917380+0000","last_unstale":"2024-09-16T01:21:41.999706+0000","last_undegraded":"2024-09-16T01:21:41.999706+0000","last_fullsized":"2024-09-16T01:21:41.999706+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:53.974672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000179+0000","last_change":"2024-09-16T01:21:40.923359+0000","last_active":"2024-09-16T01:21:42.000179+0000","last_peered":"2024-09-16T01:21:42.000179+0000","last_clean":"2024-09-16T01:21:42.000179+0000","last_became_active":"2024-09-16T01:21:40.922765+0000","last_became_peered":"2024-09-16T01:21:40.922765+0000","last_unstale":"2024-09-16T01:21:42.000179+0000","last_undegraded":"2024-09-16T01:21:42.000179+0000","last_fullsized":"2024-09-16T01:21:42.000179+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:01.806523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"100'4","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.001803+0000","last_change":"2024-09-16T01:21:39.917760+0000","last_active":"2024-09-16T01:21:42.001803+0000","last_peered":"2024-09-16T01:21:42.001803+0000","last_clean":"2024-09-16T01:21:42.001803+0000","last_became_active":"2024-09-16T01:21:39.917528+0000","last_became_peered":"2024-09-16T01:21:39.917528+0000","last_unstale":"2024-09-16T01:21:42.001803+0000","last_undegraded":"2024-09-16T01:21:42.001803+0000","last_fullsized":"2024-09-16T01:21:42.001803+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:25.164848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000270+0000","last_change":"2024-09-16T01:21:40.935983+0000","last_active":"2024-09-16T01:21:42.000270+0000","last_peered":"2024-09-16T01:21:42.000270+0000","last_clean":"2024-09-16T01:21:42.000270+0000","last_became_active":"2024-09-16T01:21:40.935270+0000","last_became_peered":"2024-09-16T01:21:40.935270+0000","last_unstale":"2024-09-16T01:21:42.000270+0000","last_undegraded":"2024-09-16T01:21:42.000270+0000","last_fullsized":"2024-09-16T01:21:42.000270+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:45.987559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000045+0000","last_change":"2024-09-16T01:21:39.921359+0000","last_active":"2024-09-16T01:21:42.000045+0000","last_peered":"2024-09-16T01:21:42.000045+0000","last_clean":"2024-09-16T01:21:42.000045+0000","last_became_active":"2024-09-16T01:21:39.920987+0000","last_became_peered":"2024-09-16T01:21:39.920987+0000","last_unstale":"2024-09-16T01:21:42.000045+0000","last_undegraded":"2024-09-16T01:21:42.000045+0000","last_fullsized":"2024-09-16T01:21:42.000045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:51.241264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.927055+0000","last_change":"2024-09-16T01:21:40.917211+0000","last_active":"2024-09-16T01:21:41.927055+0000","last_peered":"2024-09-16T01:21:41.927055+0000","last_clean":"2024-09-16T01:21:41.927055+0000","last_became_active":"2024-09-16T01:21:40.916938+0000","last_became_peered":"2024-09-16T01:21:40.916938+0000","last_unstale":"2024-09-16T01:21:41.927055+0000","last_undegraded":"2024-09-16T01:21:41.927055+0000","last_fullsized":"2024-09-16T01:21:41.927055+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:51.017133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926623+0000","last_change":"2024-09-16T01:21:39.919297+0000","last_active":"2024-09-16T01:21:41.926623+0000","last_peered":"2024-09-16T01:21:41.926623+0000","last_clean":"2024-09-16T01:21:41.926623+0000","last_became_active":"2024-09-16T01:21:39.919006+0000","last_became_peered":"2024-09-16T01:21:39.919006+0000","last_unstale":"2024-09-16T01:21:41.926623+0000","last_undegraded":"2024-09-16T01:21:41.926623+0000","last_fullsized":"2024-09-16T01:21:41.926623+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:21:44.157710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.927282+0000","last_change":"2024-09-16T01:21:40.916918+0000","last_active":"2024-09-16T01:21:41.927282+0000","last_peered":"2024-09-16T01:21:41.927282+0000","last_clean":"2024-09-16T01:21:41.927282+0000","last_became_active":"2024-09-16T01:21:40.916545+0000","last_became_peered":"2024-09-16T01:21:40.916545+0000","last_unstale":"2024-09-16T01:21:41.927282+0000","last_undegraded":"2024-09-16T01:21:41.927282+0000","last_fullsized":"2024-09-16T01:21:41.927282+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:44.194522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000756+0000","last_change":"2024-09-16T01:21:39.917295+0000","last_active":"2024-09-16T01:21:42.000756+0000","last_peered":"2024-09-16T01:21:42.000756+0000","last_clean":"2024-09-16T01:21:42.000756+0000","last_became_active":"2024-09-16T01:21:39.916030+0000","last_became_peered":"2024-09-16T01:21:39.916030+0000","last_unstale":"2024-09-16T01:21:42.000756+0000","last_undegraded":"2024-09-16T01:21:42.000756+0000","last_fullsized":"2024-09-16T01:21:42.000756+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:15.884700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.001781+0000","last_change":"2024-09-16T01:21:40.934136+0000","last_active":"2024-09-16T01:21:42.001781+0000","last_peered":"2024-09-16T01:21:42.001781+0000","last_clean":"2024-09-16T01:21:42.001781+0000","last_became_active":"2024-09-16T01:21:40.933835+0000","last_became_peered":"2024-09-16T01:21:40.933835+0000","last_unstale":"2024-09-16T01:21:42.001781+0000","last_undegraded":"2024-09-16T01:21:42.001781+0000","last_fullsized":"2024-09-16T01:21:42.001781+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:51.017133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.925774+0000","last_change":"2024-09-16T01:21:39.918272+0000","last_active":"2024-09-16T01:21:41.925774+0000","last_peered":"2024-09-16T01:21:41.925774+0000","last_clean":"2024-09-16T01:21:41.925774+0000","last_became_active":"2024-09-16T01:21:39.917961+0000","last_became_peered":"2024-09-16T01:21:39.917961+0000","last_unstale":"2024-09-16T01:21:41.925774+0000","last_undegraded":"2024-09-16T01:21:41.925774+0000","last_fullsized":"2024-09-16T01:21:41.925774+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:35.723216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000167+0000","last_change":"2024-09-16T01:21:40.926979+0000","last_active":"2024-09-16T01:21:42.000167+0000","last_peered":"2024-09-16T01:21:42.000167+0000","last_clean":"2024-09-16T01:21:42.000167+0000","last_became_active":"2024-09-16T01:21:40.926721+0000","last_became_peered":"2024-09-16T01:21:40.926721+0000","last_unstale":"2024-09-16T01:21:42.000167+0000","last_undegraded":"2024-09-16T01:21:42.000167+0000","last_fullsized":"2024-09-16T01:21:42.000167+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:05.381834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.927438+0000","last_change":"2024-09-16T01:21:39.917075+0000","last_active":"2024-09-16T01:21:41.927438+0000","last_peered":"2024-09-16T01:21:41.927438+0000","last_clean":"2024-09-16T01:21:41.927438+0000","last_became_active":"2024-09-16T01:21:39.915954+0000","last_became_peered":"2024-09-16T01:21:39.915954+0000","last_unstale":"2024-09-16T01:21:41.927438+0000","last_undegraded":"2024-09-16T01:21:41.927438+0000","last_fullsized":"2024-09-16T01:21:41.927438+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:58.021169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000327+0000","last_change":"2024-09-16T01:21:40.923136+0000","last_active":"2024-09-16T01:21:42.000327+0000","last_peered":"2024-09-16T01:21:42.000327+0000","last_clean":"2024-09-16T01:21:42.000327+0000","last_became_active":"2024-09-16T01:21:40.922857+0000","last_became_peered":"2024-09-16T01:21:40.922857+0000","last_unstale":"2024-09-16T01:21:42.000327+0000","last_undegraded":"2024-09-16T01:21:42.000327+0000","last_fullsized":"2024-09-16T01:21:42.000327+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:29.896123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926261+0000","last_change":"2024-09-16T01:21:39.916260+0000","last_active":"2024-09-16T01:21:41.926261+0000","last_peered":"2024-09-16T01:21:41.926261+0000","last_clean":"2024-09-16T01:21:41.926261+0000","last_became_active":"2024-09-16T01:21:39.915965+0000","last_became_peered":"2024-09-16T01:21:39.915965+0000","last_unstale":"2024-09-16T01:21:41.926261+0000","last_undegraded":"2024-09-16T01:21:41.926261+0000","last_fullsized":"2024-09-16T01:21:41.926261+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:23.559568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.001708+0000","last_change":"2024-09-16T01:21:40.926464+0000","last_active":"2024-09-16T01:21:42.001708+0000","last_peered":"2024-09-16T01:21:42.001708+0000","last_clean":"2024-09-16T01:21:42.001708+0000","last_became_active":"2024-09-16T01:21:40.926001+0000","last_became_peered":"2024-09-16T01:21:40.926001+0000","last_unstale":"2024-09-16T01:21:42.001708+0000","last_undegraded":"2024-09-16T01:21:42.001708+0000","last_fullsized":"2024-09-16T01:21:42.001708+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:41.799261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.001367+0000","last_change":"2024-09-16T01:21:39.920608+0000","last_active":"2024-09-16T01:21:42.001367+0000","last_peered":"2024-09-16T01:21:42.001367+0000","last_clean":"2024-09-16T01:21:42.001367+0000","last_became_active":"2024-09-16T01:21:39.920346+0000","last_became_peered":"2024-09-16T01:21:39.920346+0000","last_unstale":"2024-09-16T01:21:42.001367+0000","last_undegraded":"2024-09-16T01:21:42.001367+0000","last_fullsized":"2024-09-16T01:21:42.001367+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:43:08.954744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000051+0000","last_change":"2024-09-16T01:21:40.923509+0000","last_active":"2024-09-16T01:21:42.000051+0000","last_peered":"2024-09-16T01:21:42.000051+0000","last_clean":"2024-09-16T01:21:42.000051+0000","last_became_active":"2024-09-16T01:21:40.923089+0000","last_became_peered":"2024-09-16T01:21:40.923089+0000","last_unstale":"2024-09-16T01:21:42.000051+0000","last_undegraded":"2024-09-16T01:21:42.000051+0000","last_fullsized":"2024-09-16T01:21:42.000051+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:50.833377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926512+0000","last_change":"2024-09-16T01:21:39.918484+0000","last_active":"2024-09-16T01:21:41.926512+0000","last_peered":"2024-09-16T01:21:41.926512+0000","last_clean":"2024-09-16T01:21:41.926512+0000","last_became_active":"2024-09-16T01:21:39.918238+0000","last_became_peered":"2024-09-16T01:21:39.918238+0000","last_unstale":"2024-09-16T01:21:41.926512+0000","last_undegraded":"2024-09-16T01:21:41.926512+0000","last_fullsized":"2024-09-16T01:21:41.926512+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:38.069370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000625+0000","last_change":"2024-09-16T01:21:40.930810+0000","last_active":"2024-09-16T01:21:42.000625+0000","last_peered":"2024-09-16T01:21:42.000625+0000","last_clean":"2024-09-16T01:21:42.000625+0000","last_became_active":"2024-09-16T01:21:40.930527+0000","last_became_peered":"2024-09-16T01:21:40.930527+0000","last_unstale":"2024-09-16T01:21:42.000625+0000","last_undegraded":"2024-09-16T01:21:42.000625+0000","last_fullsized":"2024-09-16T01:21:42.000625+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:50.689463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999709+0000","last_change":"2024-09-16T01:21:39.917094+0000","last_active":"2024-09-16T01:21:41.999709+0000","last_peered":"2024-09-16T01:21:41.999709+0000","last_clean":"2024-09-16T01:21:41.999709+0000","last_became_active":"2024-09-16T01:21:39.916842+0000","last_became_peered":"2024-09-16T01:21:39.916842+0000","last_unstale":"2024-09-16T01:21:41.999709+0000","last_undegraded":"2024-09-16T01:21:41.999709+0000","last_fullsized":"2024-09-16T01:21:41.999709+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:28:50.471329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000493+0000","last_change":"2024-09-16T01:21:40.921496+0000","last_active":"2024-09-16T01:21:42.000493+0000","last_peered":"2024-09-16T01:21:42.000493+0000","last_clean":"2024-09-16T01:21:42.000493+0000","last_became_active":"2024-09-16T01:21:40.921235+0000","last_became_peered":"2024-09-16T01:21:40.921235+0000","last_unstale":"2024-09-16T01:21:42.000493+0000","last_undegraded":"2024-09-16T01:21:42.000493+0000","last_fullsized":"2024-09-16T01:21:42.000493+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:26:33.507488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"100'3","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926281+0000","last_change":"2024-09-16T01:21:39.920091+0000","last_active":"2024-09-16T01:21:41.926281+0000","last_peered":"2024-09-16T01:21:41.926281+0000","last_clean":"2024-09-16T01:21:41.926281+0000","last_became_active":"2024-09-16T01:21:39.919789+0000","last_became_peered":"2024-09-16T01:21:39.919789+0000","last_unstale":"2024-09-16T01:21:41.926281+0000","last_undegraded":"2024-09-16T01:21:41.926281+0000","last_fullsized":"2024-09-16T01:21:41.926281+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:27.320907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.001011+0000","last_change":"2024-09-16T01:21:40.931463+0000","last_active":"2024-09-16T01:21:42.001011+0000","last_peered":"2024-09-16T01:21:42.001011+0000","last_clean":"2024-09-16T01:21:42.001011+0000","last_became_active":"2024-09-16T01:21:40.931229+0000","last_became_peered":"2024-09-16T01:21:40.931229+0000","last_unstale":"2024-09-16T01:21:42.001011+0000","last_undegraded":"2024-09-16T01:21:42.001011+0000","last_fullsized":"2024-09-16T01:21:42.001011+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:18:30.528228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"100'6","reported_seq":20,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000034+0000","last_change":"2024-09-16T01:21:39.922559+0000","last_active":"2024-09-16T01:21:42.000034+0000","last_peered":"2024-09-16T01:21:42.000034+0000","last_clean":"2024-09-16T01:21:42.000034+0000","last_became_active":"2024-09-16T01:21:39.922295+0000","last_became_peered":"2024-09-16T01:21:39.922295+0000","last_unstale":"2024-09-16T01:21:42.000034+0000","last_undegraded":"2024-09-16T01:21:42.000034+0000","last_fullsized":"2024-09-16T01:21:42.000034+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:22.893681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.927265+0000","last_change":"2024-09-16T01:21:40.927414+0000","last_active":"2024-09-16T01:21:41.927265+0000","last_peered":"2024-09-16T01:21:41.927265+0000","last_clean":"2024-09-16T01:21:41.927265+0000","last_became_active":"2024-09-16T01:21:40.926775+0000","last_became_peered":"2024-09-16T01:21:40.926775+0000","last_unstale":"2024-09-16T01:21:41.927265+0000","last_undegraded":"2024-09-16T01:21:41.927265+0000","last_fullsized":"2024-09-16T01:21:41.927265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:10.264960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000984+0000","last_change":"2024-09-16T01:21:39.922197+0000","last_active":"2024-09-16T01:21:42.000984+0000","last_peered":"2024-09-16T01:21:42.000984+0000","last_clean":"2024-09-16T01:21:42.000984+0000","last_became_active":"2024-09-16T01:21:39.921905+0000","last_became_peered":"2024-09-16T01:21:39.921905+0000","last_unstale":"2024-09-16T01:21:42.000984+0000","last_undegraded":"2024-09-16T01:21:42.000984+0000","last_fullsized":"2024-09-16T01:21:42.000984+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:58.021169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000109+0000","last_change":"2024-09-16T01:21:40.934221+0000","last_active":"2024-09-16T01:21:42.000109+0000","last_peered":"2024-09-16T01:21:42.000109+0000","last_clean":"2024-09-16T01:21:42.000109+0000","last_became_active":"2024-09-16T01:21:40.933918+0000","last_became_peered":"2024-09-16T01:21:40.933918+0000","last_unstale":"2024-09-16T01:21:42.000109+0000","last_undegraded":"2024-09-16T01:21:42.000109+0000","last_fullsized":"2024-09-16T01:21:42.000109+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:44.298879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.001505+0000","last_change":"2024-09-16T01:21:39.917073+0000","last_active":"2024-09-16T01:21:42.001505+0000","last_peered":"2024-09-16T01:21:42.001505+0000","last_clean":"2024-09-16T01:21:42.001505+0000","last_became_active":"2024-09-16T01:21:39.916833+0000","last_became_peered":"2024-09-16T01:21:39.916833+0000","last_unstale":"2024-09-16T01:21:42.001505+0000","last_undegraded":"2024-09-16T01:21:42.001505+0000","last_fullsized":"2024-09-16T01:21:42.001505+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:31:23.764798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999954+0000","last_change":"2024-09-16T01:21:40.928386+0000","last_active":"2024-09-16T01:21:41.999954+0000","last_peered":"2024-09-16T01:21:41.999954+0000","last_clean":"2024-09-16T01:21:41.999954+0000","last_became_active":"2024-09-16T01:21:40.928095+0000","last_became_peered":"2024-09-16T01:21:40.928095+0000","last_unstale":"2024-09-16T01:21:41.999954+0000","last_undegraded":"2024-09-16T01:21:41.999954+0000","last_fullsized":"2024-09-16T01:21:41.999954+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:51.326179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000363+0000","last_change":"2024-09-16T01:21:39.920198+0000","last_active":"2024-09-16T01:21:42.000363+0000","last_peered":"2024-09-16T01:21:42.000363+0000","last_clean":"2024-09-16T01:21:42.000363+0000","last_became_active":"2024-09-16T01:21:39.919954+0000","last_became_peered":"2024-09-16T01:21:39.919954+0000","last_unstale":"2024-09-16T01:21:42.000363+0000","last_undegraded":"2024-09-16T01:21:42.000363+0000","last_fullsized":"2024-09-16T01:21:42.000363+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:46.357249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000922+0000","last_change":"2024-09-16T01:21:40.921974+0000","last_active":"2024-09-16T01:21:42.000922+0000","last_peered":"2024-09-16T01:21:42.000922+0000","last_clean":"2024-09-16T01:21:42.000922+0000","last_became_active":"2024-09-16T01:21:40.921691+0000","last_became_peered":"2024-09-16T01:21:40.921691+0000","last_unstale":"2024-09-16T01:21:42.000922+0000","last_undegraded":"2024-09-16T01:21:42.000922+0000","last_fullsized":"2024-09-16T01:21:42.000922+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:09.875320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"100'8","reported_seq":22,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.925896+0000","last_change":"2024-09-16T01:21:39.917514+0000","last_active":"2024-09-16T01:21:41.925896+0000","last_peered":"2024-09-16T01:21:41.925896+0000","last_clean":"2024-09-16T01:21:41.925896+0000","last_became_active":"2024-09-16T01:21:39.917221+0000","last_became_peered":"2024-09-16T01:21:39.917221+0000","last_unstale":"2024-09-16T01:21:41.925896+0000","last_undegraded":"2024-09-16T01:21:41.925896+0000","last_fullsized":"2024-09-16T01:21:41.925896+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:15.884700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999783+0000","last_change":"2024-09-16T01:21:40.932148+0000","last_active":"2024-09-16T01:21:41.999783+0000","last_peered":"2024-09-16T01:21:41.999783+0000","last_clean":"2024-09-16T01:21:41.999783+0000","last_became_active":"2024-09-16T01:21:40.931906+0000","last_became_peered":"2024-09-16T01:21:40.931906+0000","last_unstale":"2024-09-16T01:21:41.999783+0000","last_undegraded":"2024-09-16T01:21:41.999783+0000","last_fullsized":"2024-09-16T01:21:41.999783+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:53.233246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000249+0000","last_change":"2024-09-16T01:21:39.915200+0000","last_active":"2024-09-16T01:21:42.000249+0000","last_peered":"2024-09-16T01:21:42.000249+0000","last_clean":"2024-09-16T01:21:42.000249+0000","last_became_active":"2024-09-16T01:21:39.914918+0000","last_became_peered":"2024-09-16T01:21:39.914918+0000","last_unstale":"2024-09-16T01:21:42.000249+0000","last_undegraded":"2024-09-16T01:21:42.000249+0000","last_fullsized":"2024-09-16T01:21:42.000249+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:40.435768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999866+0000","last_change":"2024-09-16T01:21:40.931621+0000","last_active":"2024-09-16T01:21:41.999866+0000","last_peered":"2024-09-16T01:21:41.999866+0000","last_clean":"2024-09-16T01:21:41.999866+0000","last_became_active":"2024-09-16T01:21:40.931332+0000","last_became_peered":"2024-09-16T01:21:40.931332+0000","last_unstale":"2024-09-16T01:21:41.999866+0000","last_undegraded":"2024-09-16T01:21:41.999866+0000","last_fullsized":"2024-09-16T01:21:41.999866+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:10.264960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"100'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926392+0000","last_change":"2024-09-16T01:21:39.916602+0000","last_active":"2024-09-16T01:21:41.926392+0000","last_peered":"2024-09-16T01:21:41.926392+0000","last_clean":"2024-09-16T01:21:41.926392+0000","last_became_active":"2024-09-16T01:21:39.916349+0000","last_became_peered":"2024-09-16T01:21:39.916349+0000","last_unstale":"2024-09-16T01:21:41.926392+0000","last_undegraded":"2024-09-16T01:21:41.926392+0000","last_fullsized":"2024-09-16T01:21:41.926392+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:00.849088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000889+0000","last_change":"2024-09-16T01:21:40.919913+0000","last_active":"2024-09-16T01:21:42.000889+0000","last_peered":"2024-09-16T01:21:42.000889+0000","last_clean":"2024-09-16T01:21:42.000889+0000","last_became_active":"2024-09-16T01:21:40.919641+0000","last_became_peered":"2024-09-16T01:21:40.919641+0000","last_unstale":"2024-09-16T01:21:42.000889+0000","last_undegraded":"2024-09-16T01:21:42.000889+0000","last_fullsized":"2024-09-16T01:21:42.000889+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:44.298879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.927306+0000","last_change":"2024-09-16T01:21:39.918225+0000","last_active":"2024-09-16T01:21:41.927306+0000","last_peered":"2024-09-16T01:21:41.927306+0000","last_clean":"2024-09-16T01:21:41.927306+0000","last_became_active":"2024-09-16T01:21:39.917853+0000","last_became_peered":"2024-09-16T01:21:39.917853+0000","last_unstale":"2024-09-16T01:21:41.927306+0000","last_undegraded":"2024-09-16T01:21:41.927306+0000","last_fullsized":"2024-09-16T01:21:41.927306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:23.559568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000450+0000","last_change":"2024-09-16T01:21:40.924756+0000","last_active":"2024-09-16T01:21:42.000450+0000","last_peered":"2024-09-16T01:21:42.000450+0000","last_clean":"2024-09-16T01:21:42.000450+0000","last_became_active":"2024-09-16T01:21:40.924022+0000","last_became_peered":"2024-09-16T01:21:40.924022+0000","last_unstale":"2024-09-16T01:21:42.000450+0000","last_undegraded":"2024-09-16T01:21:42.000450+0000","last_fullsized":"2024-09-16T01:21:42.000450+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:27.722018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000816+0000","last_change":"2024-09-16T01:21:39.923370+0000","last_active":"2024-09-16T01:21:42.000816+0000","last_peered":"2024-09-16T01:21:42.000816+0000","last_clean":"2024-09-16T01:21:42.000816+0000","last_became_active":"2024-09-16T01:21:39.923103+0000","last_became_peered":"2024-09-16T01:21:39.923103+0000","last_unstale":"2024-09-16T01:21:42.000816+0000","last_undegraded":"2024-09-16T01:21:42.000816+0000","last_fullsized":"2024-09-16T01:21:42.000816+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:42:55.671198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000039+0000","last_change":"2024-09-16T01:21:40.924235+0000","last_active":"2024-09-16T01:21:42.000039+0000","last_peered":"2024-09-16T01:21:42.000039+0000","last_clean":"2024-09-16T01:21:42.000039+0000","last_became_active":"2024-09-16T01:21:40.921661+0000","last_became_peered":"2024-09-16T01:21:40.921661+0000","last_unstale":"2024-09-16T01:21:42.000039+0000","last_undegraded":"2024-09-16T01:21:42.000039+0000","last_fullsized":"2024-09-16T01:21:42.000039+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:03.910036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000351+0000","last_change":"2024-09-16T01:21:39.920570+0000","last_active":"2024-09-16T01:21:42.000351+0000","last_peered":"2024-09-16T01:21:42.000351+0000","last_clean":"2024-09-16T01:21:42.000351+0000","last_became_active":"2024-09-16T01:21:39.920333+0000","last_became_peered":"2024-09-16T01:21:39.920333+0000","last_unstale":"2024-09-16T01:21:42.000351+0000","last_undegraded":"2024-09-16T01:21:42.000351+0000","last_fullsized":"2024-09-16T01:21:42.000351+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:18:10.633005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.001836+0000","last_change":"2024-09-16T01:21:40.927783+0000","last_active":"2024-09-16T01:21:42.001836+0000","last_peered":"2024-09-16T01:21:42.001836+0000","last_clean":"2024-09-16T01:21:42.001836+0000","last_became_active":"2024-09-16T01:21:40.927516+0000","last_became_peered":"2024-09-16T01:21:40.927516+0000","last_unstale":"2024-09-16T01:21:42.001836+0000","last_undegraded":"2024-09-16T01:21:42.001836+0000","last_fullsized":"2024-09-16T01:21:42.001836+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:29.896123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999835+0000","last_change":"2024-09-16T01:21:39.917681+0000","last_active":"2024-09-16T01:21:41.999835+0000","last_peered":"2024-09-16T01:21:41.999835+0000","last_clean":"2024-09-16T01:21:41.999835+0000","last_became_active":"2024-09-16T01:21:39.917328+0000","last_became_peered":"2024-09-16T01:21:39.917328+0000","last_unstale":"2024-09-16T01:21:41.999835+0000","last_undegraded":"2024-09-16T01:21:41.999835+0000","last_fullsized":"2024-09-16T01:21:41.999835+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:13.290722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000007+0000","last_change":"2024-09-16T01:21:40.935780+0000","last_active":"2024-09-16T01:21:42.000007+0000","last_peered":"2024-09-16T01:21:42.000007+0000","last_clean":"2024-09-16T01:21:42.000007+0000","last_became_active":"2024-09-16T01:21:40.935518+0000","last_became_peered":"2024-09-16T01:21:40.935518+0000","last_unstale":"2024-09-16T01:21:42.000007+0000","last_undegraded":"2024-09-16T01:21:42.000007+0000","last_fullsized":"2024-09-16T01:21:42.000007+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:15:09.916562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999796+0000","last_change":"2024-09-16T01:21:39.923928+0000","last_active":"2024-09-16T01:21:41.999796+0000","last_peered":"2024-09-16T01:21:41.999796+0000","last_clean":"2024-09-16T01:21:41.999796+0000","last_became_active":"2024-09-16T01:21:39.923656+0000","last_became_peered":"2024-09-16T01:21:39.923656+0000","last_unstale":"2024-09-16T01:21:41.999796+0000","last_undegraded":"2024-09-16T01:21:41.999796+0000","last_fullsized":"2024-09-16T01:21:41.999796+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:56.162541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999921+0000","last_change":"2024-09-16T01:21:40.925231+0000","last_active":"2024-09-16T01:21:41.999921+0000","last_peered":"2024-09-16T01:21:41.999921+0000","last_clean":"2024-09-16T01:21:41.999921+0000","last_became_active":"2024-09-16T01:21:40.924684+0000","last_became_peered":"2024-09-16T01:21:40.924684+0000","last_unstale":"2024-09-16T01:21:41.999921+0000","last_undegraded":"2024-09-16T01:21:41.999921+0000","last_fullsized":"2024-09-16T01:21:41.999921+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:34.414444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000145+0000","last_change":"2024-09-16T01:21:39.921529+0000","last_active":"2024-09-16T01:21:42.000145+0000","last_peered":"2024-09-16T01:21:42.000145+0000","last_clean":"2024-09-16T01:21:42.000145+0000","last_became_active":"2024-09-16T01:21:39.921274+0000","last_became_peered":"2024-09-16T01:21:39.921274+0000","last_unstale":"2024-09-16T01:21:42.000145+0000","last_undegraded":"2024-09-16T01:21:42.000145+0000","last_fullsized":"2024-09-16T01:21:42.000145+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:54:13.290722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.925475+0000","last_change":"2024-09-16T01:21:40.918703+0000","last_active":"2024-09-16T01:21:41.925475+0000","last_peered":"2024-09-16T01:21:41.925475+0000","last_clean":"2024-09-16T01:21:41.925475+0000","last_became_active":"2024-09-16T01:21:40.918405+0000","last_became_peered":"2024-09-16T01:21:40.918405+0000","last_unstale":"2024-09-16T01:21:41.925475+0000","last_undegraded":"2024-09-16T01:21:41.925475+0000","last_fullsized":"2024-09-16T01:21:41.925475+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:50.689463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"101'1","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.912107+0000","last_change":"2024-09-16T01:21:39.919109+0000","last_active":"2024-09-16T01:21:42.912107+0000","last_peered":"2024-09-16T01:21:42.912107+0000","last_clean":"2024-09-16T01:21:42.912107+0000","last_became_active":"2024-09-16T01:21:39.918780+0000","last_became_peered":"2024-09-16T01:21:39.918780+0000","last_unstale":"2024-09-16T01:21:42.912107+0000","last_undegraded":"2024-09-16T01:21:42.912107+0000","last_fullsized":"2024-09-16T01:21:42.912107+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:40.323492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.001516+0000","last_change":"2024-09-16T01:21:40.929841+0000","last_active":"2024-09-16T01:21:42.001516+0000","last_peered":"2024-09-16T01:21:42.001516+0000","last_clean":"2024-09-16T01:21:42.001516+0000","last_became_active":"2024-09-16T01:21:40.929587+0000","last_became_peered":"2024-09-16T01:21:40.929587+0000","last_unstale":"2024-09-16T01:21:42.001516+0000","last_undegraded":"2024-09-16T01:21:42.001516+0000","last_fullsized":"2024-09-16T01:21:42.001516+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:44.298879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000105+0000","last_change":"2024-09-16T01:21:39.918550+0000","last_active":"2024-09-16T01:21:42.000105+0000","last_peered":"2024-09-16T01:21:42.000105+0000","last_clean":"2024-09-16T01:21:42.000105+0000","last_became_active":"2024-09-16T01:21:39.917893+0000","last_became_peered":"2024-09-16T01:21:39.917893+0000","last_unstale":"2024-09-16T01:21:42.000105+0000","last_undegraded":"2024-09-16T01:21:42.000105+0000","last_fullsized":"2024-09-16T01:21:42.000105+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:47:37.431912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926009+0000","last_change":"2024-09-16T01:21:40.918633+0000","last_active":"2024-09-16T01:21:41.926009+0000","last_peered":"2024-09-16T01:21:41.926009+0000","last_clean":"2024-09-16T01:21:41.926009+0000","last_became_active":"2024-09-16T01:21:40.917821+0000","last_became_peered":"2024-09-16T01:21:40.917821+0000","last_unstale":"2024-09-16T01:21:41.926009+0000","last_undegraded":"2024-09-16T01:21:41.926009+0000","last_fullsized":"2024-09-16T01:21:41.926009+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:40.246470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000845+0000","last_change":"2024-09-16T01:21:39.922699+0000","last_active":"2024-09-16T01:21:42.000845+0000","last_peered":"2024-09-16T01:21:42.000845+0000","last_clean":"2024-09-16T01:21:42.000845+0000","last_became_active":"2024-09-16T01:21:39.922440+0000","last_became_peered":"2024-09-16T01:21:39.922440+0000","last_unstale":"2024-09-16T01:21:42.000845+0000","last_undegraded":"2024-09-16T01:21:42.000845+0000","last_fullsized":"2024-09-16T01:21:42.000845+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:23.559568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999625+0000","last_change":"2024-09-16T01:21:40.934769+0000","last_active":"2024-09-16T01:21:41.999625+0000","last_peered":"2024-09-16T01:21:41.999625+0000","last_clean":"2024-09-16T01:21:41.999625+0000","last_became_active":"2024-09-16T01:21:40.934486+0000","last_became_peered":"2024-09-16T01:21:40.934486+0000","last_unstale":"2024-09-16T01:21:41.999625+0000","last_undegraded":"2024-09-16T01:21:41.999625+0000","last_fullsized":"2024-09-16T01:21:41.999625+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:09.199662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926753+0000","last_change":"2024-09-16T01:21:39.918834+0000","last_active":"2024-09-16T01:21:41.926753+0000","last_peered":"2024-09-16T01:21:41.926753+0000","last_clean":"2024-09-16T01:21:41.926753+0000","last_became_active":"2024-09-16T01:21:39.917586+0000","last_became_peered":"2024-09-16T01:21:39.917586+0000","last_unstale":"2024-09-16T01:21:41.926753+0000","last_undegraded":"2024-09-16T01:21:41.926753+0000","last_fullsized":"2024-09-16T01:21:41.926753+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:58.021169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000977+0000","last_change":"2024-09-16T01:21:40.919581+0000","last_active":"2024-09-16T01:21:42.000977+0000","last_peered":"2024-09-16T01:21:42.000977+0000","last_clean":"2024-09-16T01:21:42.000977+0000","last_became_active":"2024-09-16T01:21:40.919299+0000","last_became_peered":"2024-09-16T01:21:40.919299+0000","last_unstale":"2024-09-16T01:21:42.000977+0000","last_undegraded":"2024-09-16T01:21:42.000977+0000","last_fullsized":"2024-09-16T01:21:42.000977+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:46.616326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000577+0000","last_change":"2024-09-16T01:21:39.919966+0000","last_active":"2024-09-16T01:21:42.000577+0000","last_peered":"2024-09-16T01:21:42.000577+0000","last_clean":"2024-09-16T01:21:42.000577+0000","last_became_active":"2024-09-16T01:21:39.919616+0000","last_became_peered":"2024-09-16T01:21:39.919616+0000","last_unstale":"2024-09-16T01:21:42.000577+0000","last_undegraded":"2024-09-16T01:21:42.000577+0000","last_fullsized":"2024-09-16T01:21:42.000577+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:10:37.013302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.926109+0000","last_change":"2024-09-16T01:21:40.921911+0000","last_active":"2024-09-16T01:21:41.926109+0000","last_peered":"2024-09-16T01:21:41.926109+0000","last_clean":"2024-09-16T01:21:41.926109+0000","last_became_active":"2024-09-16T01:21:40.921614+0000","last_became_peered":"2024-09-16T01:21:40.921614+0000","last_unstale":"2024-09-16T01:21:41.926109+0000","last_undegraded":"2024-09-16T01:21:41.926109+0000","last_fullsized":"2024-09-16T01:21:41.926109+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:55.531999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999844+0000","last_change":"2024-09-16T01:21:39.919640+0000","last_active":"2024-09-16T01:21:41.999844+0000","last_peered":"2024-09-16T01:21:41.999844+0000","last_clean":"2024-09-16T01:21:41.999844+0000","last_became_active":"2024-09-16T01:21:39.919329+0000","last_became_peered":"2024-09-16T01:21:39.919329+0000","last_unstale":"2024-09-16T01:21:41.999844+0000","last_undegraded":"2024-09-16T01:21:41.999844+0000","last_fullsized":"2024-09-16T01:21:41.999844+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:15.884700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.927214+0000","last_change":"2024-09-16T01:21:40.923901+0000","last_active":"2024-09-16T01:21:41.927214+0000","last_peered":"2024-09-16T01:21:41.927214+0000","last_clean":"2024-09-16T01:21:41.927214+0000","last_became_active":"2024-09-16T01:21:40.923295+0000","last_became_peered":"2024-09-16T01:21:40.923295+0000","last_unstale":"2024-09-16T01:21:41.927214+0000","last_undegraded":"2024-09-16T01:21:41.927214+0000","last_fullsized":"2024-09-16T01:21:41.927214+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:50.689463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.999873+0000","last_change":"2024-09-16T01:21:39.919836+0000","last_active":"2024-09-16T01:21:41.999873+0000","last_peered":"2024-09-16T01:21:41.999873+0000","last_clean":"2024-09-16T01:21:41.999873+0000","last_became_active":"2024-09-16T01:21:39.919430+0000","last_became_peered":"2024-09-16T01:21:39.919430+0000","last_unstale":"2024-09-16T01:21:41.999873+0000","last_undegraded":"2024-09-16T01:21:41.999873+0000","last_fullsized":"2024-09-16T01:21:41.999873+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:21.723307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.927013+0000","last_change":"2024-09-16T01:21:40.923538+0000","last_active":"2024-09-16T01:21:41.927013+0000","last_peered":"2024-09-16T01:21:41.927013+0000","last_clean":"2024-09-16T01:21:41.927013+0000","last_became_active":"2024-09-16T01:21:40.923004+0000","last_became_peered":"2024-09-16T01:21:40.923004+0000","last_unstale":"2024-09-16T01:21:41.927013+0000","last_undegraded":"2024-09-16T01:21:41.927013+0000","last_fullsized":"2024-09-16T01:21:41.927013+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:39.898072+0000","last_clean_scrub_stamp":"2024-09-16T01:21:39.898072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:38.105034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"100'2","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:42.000136+0000","last_change":"2024-09-16T01:21:39.921215+0000","last_active":"2024-09-16T01:21:42.000136+0000","last_peered":"2024-09-16T01:21:42.000136+0000","last_clean":"2024-09-16T01:21:42.000136+0000","last_became_active":"2024-09-16T01:21:39.920732+0000","last_became_peered":"2024-09-16T01:21:39.920732+0000","last_unstale":"2024-09-16T01:21:42.000136+0000","last_undegraded":"2024-09-16T01:21:42.000136+0000","last_fullsized":"2024-09-16T01:21:42.000136+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:38.893030+0000","last_clean_scrub_stamp":"2024-09-16T01:21:38.893030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:19.147283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":318,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-16T01:21:41.925697+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:21:41.925697+0000","last_peered":"2024-09-16T01:21:41.925697+0000","last_clean":"2024-09-16T01:21:41.925697+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:21:41.925697+0000","last_undegraded":"2024-09-16T01:21:41.925697+0000","last_fullsized":"2024-09-16T01:21:41.925697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574926,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33008,"kb_used_data":1812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338832,"statfs":{"total":96636764160,"available":96602963968,"internally_reserved":0,"allocated":1855488,"data_stored":1165879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1273856,"data_stored":577567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1253376,"data_stored":575351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1261568,"data_stored":575443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1257472,"data_stored":575933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":575385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":575385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33008,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338832,"statfs":{"total":96636764160,"available":96602963968,"internally_reserved":0,"allocated":1863680,"data_stored":1167421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:21:44.197 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:21:44.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T01:21:44.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.335+0000 7f48c679f640 1 Processor -- start 2024-09-16T01:21:44.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.335+0000 7f48c679f640 1 -- start start 2024-09-16T01:21:44.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.336+0000 7f48c679f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48c00d4380 0x7f48c00d47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.336+0000 7f48c679f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c00cf680 0x7f48c00cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.336+0000 7f48c679f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c00cf1e0 con 0x7f48c015e350 2024-09-16T01:21:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.336+0000 7f48c679f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f48c00d4d30 con 0x7f48c00d4380 2024-09-16T01:21:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.336+0000 7f48c679f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f48c00d3690 con 0x7f48c00cf680 2024-09-16T01:21:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.336+0000 7f48c4f9c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48c00d4380 0x7f48c00d47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.336+0000 7f48c579d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f48c015e350 0x7f48c00d1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49128/0 (socket says 172.21.15.81:49128) 2024-09-16T01:21:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.336+0000 7f48c579d640 1 -- 172.21.15.81:0/2716605420 learned_addr learned my addr 172.21.15.81:0/2716605420 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.337+0000 7f48c5f9e640 1 --2- 172.21.15.81:0/2716605420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c00cf680 0x7f48c00cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.337+0000 7f48c4f9c640 1 -- 172.21.15.81:0/2716605420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c00cf680 msgr2=0x7f48c00cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.337+0000 7f48c4f9c640 1 --2- 172.21.15.81:0/2716605420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c00cf680 0x7f48c00cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.337+0000 7f48c4f9c640 1 -- 172.21.15.81:0/2716605420 >> v1:172.21.15.81:6789/0 conn(0x7f48c015e350 legacy=0x7f48c00d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.337+0000 7f48c4f9c640 1 -- 172.21.15.81:0/2716605420 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c00d2a80 con 0x7f48c00d4380 2024-09-16T01:21:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.337+0000 7f48c4f9c640 1 --2- 172.21.15.81:0/2716605420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c00d4380 0x7f48c00d47f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009790 tx=0x7f48b002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3607edb6acf0169f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.337+0000 7f48b7fff640 1 -- 172.21.15.81:0/2716605420 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0037070 con 0x7f48c00d4380 2024-09-16T01:21:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.337+0000 7f48b7fff640 1 -- 172.21.15.81:0/2716605420 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b0032440 con 0x7f48c00d4380 2024-09-16T01:21:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.337+0000 7f48b7fff640 1 -- 172.21.15.81:0/2716605420 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0032810 con 0x7f48c00d4380 2024-09-16T01:21:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.338+0000 7f48c679f640 1 -- 172.21.15.81:0/2716605420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c00d4380 msgr2=0x7f48c00d47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.338+0000 7f48c679f640 1 --2- 172.21.15.81:0/2716605420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c00d4380 0x7f48c00d47f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009790 tx=0x7f48b002a180 comp rx=0 tx=0).stop 2024-09-16T01:21:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.338+0000 7f48c679f640 1 -- 172.21.15.81:0/2716605420 shutdown_connections 2024-09-16T01:21:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.338+0000 7f48c679f640 1 --2- 172.21.15.81:0/2716605420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c00cf680 0x7f48c00cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.338+0000 7f48c679f640 1 --2- 172.21.15.81:0/2716605420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c00d4380 0x7f48c00d47f0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.338+0000 7f48c679f640 1 -- 172.21.15.81:0/2716605420 >> 172.21.15.81:0/2716605420 conn(0x7f48c009d710 msgr2=0x7f48c008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:44.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.338+0000 7f48c679f640 1 -- 172.21.15.81:0/2716605420 shutdown_connections 2024-09-16T01:21:44.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.338+0000 7f48c679f640 1 -- 172.21.15.81:0/2716605420 wait complete. 2024-09-16T01:21:44.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.339+0000 7f48c679f640 1 Processor -- start 2024-09-16T01:21:44.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.339+0000 7f48c679f640 1 -- start start 2024-09-16T01:21:44.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c679f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c00cf680 0x7f48c00cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c679f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c00d4380 0x7f48c01f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c679f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c015e350 0x7f48c00b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c679f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48c00d3320 con 0x7f48c015e350 2024-09-16T01:21:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c679f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f48c00d3040 con 0x7f48c00d4380 2024-09-16T01:21:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c679f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f48c00b3620 con 0x7f48c00cf680 2024-09-16T01:21:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c5f9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c015e350 0x7f48c00b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c5f9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c015e350 0x7f48c00b8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34730/0 (socket says 172.21.15.81:34730) 2024-09-16T01:21:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c5f9e640 1 -- 172.21.15.81:0/262511909 learned_addr learned my addr 172.21.15.81:0/262511909 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c579d640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c00cf680 0x7f48c00cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c4f9c640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c00d4380 0x7f48c01f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c5f9e640 1 -- 172.21.15.81:0/262511909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c00cf680 msgr2=0x7f48c00cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c5f9e640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c00cf680 0x7f48c00cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c5f9e640 1 -- 172.21.15.81:0/262511909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c00d4380 msgr2=0x7f48c01f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c5f9e640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c00d4380 0x7f48c01f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.340+0000 7f48c5f9e640 1 -- 172.21.15.81:0/262511909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c00b8a30 con 0x7f48c015e350 2024-09-16T01:21:44.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.341+0000 7f48c5f9e640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c015e350 0x7f48c00b8290 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f48b8007e60 tx=0x7f48b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:44.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.341+0000 7f48b5ffb640 1 -- 172.21.15.81:0/262511909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8014420 con 0x7f48c015e350 2024-09-16T01:21:44.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.341+0000 7f48b5ffb640 1 -- 172.21.15.81:0/262511909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b8019070 con 0x7f48c015e350 2024-09-16T01:21:44.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.341+0000 7f48b5ffb640 1 -- 172.21.15.81:0/262511909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8014820 con 0x7f48c015e350 2024-09-16T01:21:44.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.341+0000 7f48c679f640 1 -- 172.21.15.81:0/262511909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c00b8d10 con 0x7f48c015e350 2024-09-16T01:21:44.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.341+0000 7f48c679f640 1 -- 172.21.15.81:0/262511909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c00b92d0 con 0x7f48c015e350 2024-09-16T01:21:44.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.342+0000 7f48c679f640 1 -- 172.21.15.81:0/262511909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c015e730 con 0x7f48c015e350 2024-09-16T01:21:44.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.342+0000 7f48b5ffb640 1 -- 172.21.15.81:0/262511909 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f48b80149c0 con 0x7f48c015e350 2024-09-16T01:21:44.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.343+0000 7f48b5ffb640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f48a406c2b0 0x7f48a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.343+0000 7f48b5ffb640 1 -- 172.21.15.81:0/262511909 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f48b808be00 con 0x7f48c015e350 2024-09-16T01:21:44.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.343+0000 7f48c579d640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f48a406c2b0 0x7f48a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.343+0000 7f48c579d640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f48a406c2b0 0x7f48a406e770 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f48bc000f60 tx=0x7f48bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:44.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.347+0000 7f48b5ffb640 1 -- 172.21.15.81:0/262511909 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f48b805a3e0 con 0x7f48c015e350 2024-09-16T01:21:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.577+0000 7f48c679f640 1 -- 172.21.15.81:0/262511909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f48c00ba370 con 0x7f48c015e350 2024-09-16T01:21:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.579+0000 7f48b5ffb640 1 -- 172.21.15.81:0/262511909 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f48b8059ce0 con 0x7f48c015e350 2024-09-16T01:21:44.580 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-16T01:21:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg== 2024-09-16T01:21:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-16T01:21:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-16T01:21:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T01:21:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-16T01:21:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.581+0000 7f48c679f640 1 -- 172.21.15.81:0/262511909 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f48a406c2b0 msgr2=0x7f48a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.581+0000 7f48c679f640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f48a406c2b0 0x7f48a406e770 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f48bc000f60 tx=0x7f48bc009040 comp rx=0 tx=0).stop 2024-09-16T01:21:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.581+0000 7f48c679f640 1 -- 172.21.15.81:0/262511909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c015e350 msgr2=0x7f48c00b8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.581+0000 7f48c679f640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c015e350 0x7f48c00b8290 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f48b8007e60 tx=0x7f48b800e4b0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.581+0000 7f48c679f640 1 -- 172.21.15.81:0/262511909 shutdown_connections 2024-09-16T01:21:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.581+0000 7f48c679f640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f48a406c2b0 0x7f48a406e770 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.581+0000 7f48c679f640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48c015e350 0x7f48c00b8290 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.581+0000 7f48c679f640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48c00d4380 0x7f48c01f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.581+0000 7f48c679f640 1 --2- 172.21.15.81:0/262511909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48c00cf680 0x7f48c00cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.581+0000 7f48c679f640 1 -- 172.21.15.81:0/262511909 >> 172.21.15.81:0/262511909 conn(0x7f48c009d710 msgr2=0x7f48c00d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.581+0000 7f48c679f640 1 -- 172.21.15.81:0/262511909 shutdown_connections 2024-09-16T01:21:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.581+0000 7f48c679f640 1 -- 172.21.15.81:0/262511909 wait complete. 2024-09-16T01:21:44.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:21:44.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.689+0000 7fdf124af640 1 Processor -- start 2024-09-16T01:21:44.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.689+0000 7fdf124af640 1 -- start start 2024-09-16T01:21:44.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf124af640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf0c0b0180 0x7fdf0c162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf124af640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf0c0af280 0x7fdf0c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf124af640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf0c15eb60 con 0x7fdf0c0b69d0 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf124af640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0c0b6db0 con 0x7fdf0c0af280 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf124af640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0c15ee40 con 0x7fdf0c0b0180 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf10a4c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf0c0af280 0x7fdf0c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf10a4c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf0c0af280 0x7fdf0c154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34740/0 (socket says 172.21.15.81:34740) 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf10a4c640 1 -- 172.21.15.81:0/615045637 learned_addr learned my addr 172.21.15.81:0/615045637 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf0b7fe640 1 --2- 172.21.15.81:0/615045637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf0c0b0180 0x7fdf0c162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf10a4c640 1 -- 172.21.15.81:0/615045637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf0c0b0180 msgr2=0x7fdf0c162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf10a4c640 1 --2- 172.21.15.81:0/615045637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf0c0b0180 0x7fdf0c162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf10a4c640 1 -- 172.21.15.81:0/615045637 >> v1:172.21.15.102:6789/0 conn(0x7fdf0c0b69d0 legacy=0x7fdf0c0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.690+0000 7fdf10a4c640 1 -- 172.21.15.81:0/615045637 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c15f120 con 0x7fdf0c0af280 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.691+0000 7fdf10a4c640 1 --2- 172.21.15.81:0/615045637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf0c0af280 0x7fdf0c154d00 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009e50 tx=0x7fdf0402a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d5fec3ef3bb4d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:44.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.691+0000 7fdf0affd640 1 -- 172.21.15.81:0/615045637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf04036070 con 0x7fdf0c0af280 2024-09-16T01:21:44.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.691+0000 7fdf0affd640 1 -- 172.21.15.81:0/615045637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf04031600 con 0x7fdf0c0af280 2024-09-16T01:21:44.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.691+0000 7fdf0affd640 1 -- 172.21.15.81:0/615045637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf040319d0 con 0x7fdf0c0af280 2024-09-16T01:21:44.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.691+0000 7fdf124af640 1 -- 172.21.15.81:0/615045637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf0c0af280 msgr2=0x7fdf0c154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.691+0000 7fdf124af640 1 --2- 172.21.15.81:0/615045637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf0c0af280 0x7fdf0c154d00 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fdf04009e50 tx=0x7fdf0402a5b0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.691+0000 7fdf124af640 1 -- 172.21.15.81:0/615045637 shutdown_connections 2024-09-16T01:21:44.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.691+0000 7fdf124af640 1 --2- 172.21.15.81:0/615045637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf0c0af280 0x7fdf0c154d00 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.691+0000 7fdf124af640 1 --2- 172.21.15.81:0/615045637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf0c0b0180 0x7fdf0c162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.691+0000 7fdf124af640 1 -- 172.21.15.81:0/615045637 >> 172.21.15.81:0/615045637 conn(0x7fdf0c06bc10 msgr2=0x7fdf0c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:44.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.692+0000 7fdf124af640 1 -- 172.21.15.81:0/615045637 shutdown_connections 2024-09-16T01:21:44.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.692+0000 7fdf124af640 1 -- 172.21.15.81:0/615045637 wait complete. 2024-09-16T01:21:44.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.693+0000 7fdf124af640 1 Processor -- start 2024-09-16T01:21:44.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.693+0000 7fdf124af640 1 -- start start 2024-09-16T01:21:44.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf124af640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf0c0af280 0x7fdf0c151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf124af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf0c0b0180 0x7fdf0c1604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf124af640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf0c0b69d0 0x7fdf0c153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf124af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c155240 con 0x7fdf0c0b0180 2024-09-16T01:21:44.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf124af640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0c0af6f0 con 0x7fdf0c0b69d0 2024-09-16T01:21:44.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf124af640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0c1553c0 con 0x7fdf0c0af280 2024-09-16T01:21:44.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf0b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf0c0b0180 0x7fdf0c1604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf0b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf0c0b0180 0x7fdf0c1604d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34756/0 (socket says 172.21.15.81:34756) 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf0b7fe640 1 -- 172.21.15.81:0/521970955 learned_addr learned my addr 172.21.15.81:0/521970955 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf0b7fe640 1 -- 172.21.15.81:0/521970955 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf0c0af280 msgr2=0x7fdf0c151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf0b7fe640 1 --2- 172.21.15.81:0/521970955 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf0c0af280 0x7fdf0c151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf0b7fe640 1 -- 172.21.15.81:0/521970955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf0c0b69d0 msgr2=0x7fdf0c153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf0b7fe640 1 --2- 172.21.15.81:0/521970955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf0c0b69d0 0x7fdf0c153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf0b7fe640 1 -- 172.21.15.81:0/521970955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0c15a980 con 0x7fdf0c0b0180 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf0b7fe640 1 --2- 172.21.15.81:0/521970955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf0c0b0180 0x7fdf0c1604d0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c7f0 tx=0x7fdef400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf08ff9640 1 -- 172.21.15.81:0/521970955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4015070 con 0x7fdf0c0b0180 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf08ff9640 1 -- 172.21.15.81:0/521970955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef4004240 con 0x7fdf0c0b0180 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf124af640 1 -- 172.21.15.81:0/521970955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0c15ac60 con 0x7fdf0c0b0180 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf08ff9640 1 -- 172.21.15.81:0/521970955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4007620 con 0x7fdf0c0b0180 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.694+0000 7fdf124af640 1 -- 172.21.15.81:0/521970955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0c15b220 con 0x7fdf0c0b0180 2024-09-16T01:21:44.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.695+0000 7fdf124af640 1 -- 172.21.15.81:0/521970955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf0c1557d0 con 0x7fdf0c0b0180 2024-09-16T01:21:44.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.696+0000 7fdf08ff9640 1 -- 172.21.15.81:0/521970955 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdef40077c0 con 0x7fdf0c0b0180 2024-09-16T01:21:44.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.696+0000 7fdf08ff9640 1 --2- 172.21.15.81:0/521970955 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdeec06c2b0 0x7fdeec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:44.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.696+0000 7fdf08ff9640 1 -- 172.21.15.81:0/521970955 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fdef408b460 con 0x7fdf0c0b0180 2024-09-16T01:21:44.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.696+0000 7fdf0bfff640 1 --2- 172.21.15.81:0/521970955 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdeec06c2b0 0x7fdeec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:44.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.697+0000 7fdf0bfff640 1 --2- 172.21.15.81:0/521970955 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdeec06c2b0 0x7fdeec06e770 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdefc006fd0 tx=0x7fdefc006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:44.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.701+0000 7fdf08ff9640 1 -- 172.21.15.81:0/521970955 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdef4059ad0 con 0x7fdf0c0b0180 2024-09-16T01:21:44.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.899+0000 7fdf124af640 1 -- 172.21.15.81:0/521970955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf0c06faa0 con 0x7fdf0c0b0180 2024-09-16T01:21:44.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.900+0000 7fdf08ff9640 1 -- 172.21.15.81:0/521970955 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5231 (secure 0 0 0) 0x7fdef40593d0 con 0x7fdf0c0b0180 2024-09-16T01:21:44.902 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:44.902 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"btime":"2024-09-16T01:21:42:921033+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3103388370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3103388370},{"type":"v1","addr":"172.21.15.102:6834","nonce":3103388370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":5750,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1937467713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1937467713},{"type":"v1","addr":"172.21.15.102:6835","nonce":1937467713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1728333369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1728333369},{"type":"v1","addr":"172.21.15.81:6836","nonce":1728333369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:21:40.253611+0000","modified":"2024-09-16T01:21:42.245713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6945":{"gid":6945,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2688004165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2688004165},{"type":"v1","addr":"172.21.15.81:6837","nonce":2688004165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6945,"qdb_cluster":[6945]},"id":7}]} 2024-09-16T01:21:44.902 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2024-09-16T01:21:44.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.902+0000 7fdf124af640 1 -- 172.21.15.81:0/521970955 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdeec06c2b0 msgr2=0x7fdeec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.902+0000 7fdf124af640 1 --2- 172.21.15.81:0/521970955 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdeec06c2b0 0x7fdeec06e770 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdefc006fd0 tx=0x7fdefc006bc0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.902+0000 7fdf124af640 1 -- 172.21.15.81:0/521970955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf0c0b0180 msgr2=0x7fdf0c1604d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:44.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.902+0000 7fdf124af640 1 --2- 172.21.15.81:0/521970955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf0c0b0180 0x7fdf0c1604d0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c7f0 tx=0x7fdef400ccb0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.902+0000 7fdf124af640 1 -- 172.21.15.81:0/521970955 shutdown_connections 2024-09-16T01:21:44.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.902+0000 7fdf124af640 1 --2- 172.21.15.81:0/521970955 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdeec06c2b0 0x7fdeec06e770 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.902+0000 7fdf124af640 1 --2- 172.21.15.81:0/521970955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf0c0b69d0 0x7fdf0c153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.902+0000 7fdf124af640 1 --2- 172.21.15.81:0/521970955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf0c0b0180 0x7fdf0c1604d0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.902+0000 7fdf124af640 1 --2- 172.21.15.81:0/521970955 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdf0c0af280 0x7fdf0c151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:44.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.902+0000 7fdf124af640 1 -- 172.21.15.81:0/521970955 >> 172.21.15.81:0/521970955 conn(0x7fdf0c06bc10 msgr2=0x7fdf0c0afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:44.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.902+0000 7fdf124af640 1 -- 172.21.15.81:0/521970955 shutdown_connections 2024-09-16T01:21:44.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:44.902+0000 7fdf124af640 1 -- 172.21.15.81:0/521970955 wait complete. 2024-09-16T01:21:45.317 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:21:40.253611+0000', 'modified': '2024-09-16T01:21:42.245713+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6945}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6945': {'gid': 6945, 'name': 'a', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2688004165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 2688004165}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2688004165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6945, 'qdb_cluster': [6945]} 2024-09-16T01:21:45.318 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:21:45.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-16T01:21:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.418+0000 7faf58d6d640 1 Processor -- start 2024-09-16T01:21:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.418+0000 7faf58d6d640 1 -- start start 2024-09-16T01:21:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf58d6d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf54072940 0x7faf54072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf58d6d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faf540b4880 0x7faf540b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf58d6d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf540b3570 con 0x7faf5415ba30 2024-09-16T01:21:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf58d6d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7faf540732e0 con 0x7faf54072940 2024-09-16T01:21:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf58d6d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7faf540b4180 con 0x7faf540b4880 2024-09-16T01:21:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf51d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf54072940 0x7faf54072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf51d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf54072940 0x7faf54072da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34760/0 (socket says 172.21.15.81:34760) 2024-09-16T01:21:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf51d9b640 1 -- 172.21.15.81:0/2817540353 learned_addr learned my addr 172.21.15.81:0/2817540353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf52d9d640 1 --2- 172.21.15.81:0/2817540353 >> v2:172.21.15.102:3300/0 conn(0x7faf540b4880 0x7faf540b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf51d9b640 1 -- 172.21.15.81:0/2817540353 >> v2:172.21.15.102:3300/0 conn(0x7faf540b4880 msgr2=0x7faf540b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf51d9b640 1 --2- 172.21.15.81:0/2817540353 >> v2:172.21.15.102:3300/0 conn(0x7faf540b4880 0x7faf540b4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf51d9b640 1 -- 172.21.15.81:0/2817540353 >> v1:172.21.15.102:6789/0 conn(0x7faf5415ba30 legacy=0x7faf5406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.419+0000 7faf51d9b640 1 -- 172.21.15.81:0/2817540353 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf540b3850 con 0x7faf54072940 2024-09-16T01:21:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.420+0000 7faf51d9b640 1 --2- 172.21.15.81:0/2817540353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf54072940 0x7faf54072da0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7faf540b4610 tx=0x7faf3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f70f2f2e317795 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.420+0000 7faf5159a640 1 -- 172.21.15.81:0/2817540353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c037070 con 0x7faf54072940 2024-09-16T01:21:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.420+0000 7faf5159a640 1 -- 172.21.15.81:0/2817540353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c032440 con 0x7faf54072940 2024-09-16T01:21:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.420+0000 7faf5159a640 1 -- 172.21.15.81:0/2817540353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c032810 con 0x7faf54072940 2024-09-16T01:21:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.421+0000 7faf58d6d640 1 -- 172.21.15.81:0/2817540353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf54072940 msgr2=0x7faf54072da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.421+0000 7faf58d6d640 1 --2- 172.21.15.81:0/2817540353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf54072940 0x7faf54072da0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7faf540b4610 tx=0x7faf3c02a270 comp rx=0 tx=0).stop 2024-09-16T01:21:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.421+0000 7faf58d6d640 1 -- 172.21.15.81:0/2817540353 shutdown_connections 2024-09-16T01:21:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.421+0000 7faf58d6d640 1 --2- 172.21.15.81:0/2817540353 >> v2:172.21.15.102:3300/0 conn(0x7faf540b4880 0x7faf540b4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.421+0000 7faf58d6d640 1 --2- 172.21.15.81:0/2817540353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf54072940 0x7faf54072da0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.421+0000 7faf58d6d640 1 -- 172.21.15.81:0/2817540353 >> 172.21.15.81:0/2817540353 conn(0x7faf54067d70 msgr2=0x7faf5406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.421+0000 7faf58d6d640 1 -- 172.21.15.81:0/2817540353 shutdown_connections 2024-09-16T01:21:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.421+0000 7faf58d6d640 1 -- 172.21.15.81:0/2817540353 wait complete. 2024-09-16T01:21:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.422+0000 7faf58d6d640 1 Processor -- start 2024-09-16T01:21:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.422+0000 7faf58d6d640 1 -- start start 2024-09-16T01:21:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf58d6d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf54072940 0x7faf54149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf58d6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf540b4880 0x7faf54143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf58d6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf5415ba30 0x7faf5414bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf58d6d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faf5406ff20 con 0x7faf540b4880 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf58d6d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faf540b3e10 con 0x7faf5415ba30 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf58d6d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7faf540ce810 con 0x7faf54072940 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf51d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf540b4880 0x7faf54143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf51d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf540b4880 0x7faf54143e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34774/0 (socket says 172.21.15.81:34774) 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf51d9b640 1 -- 172.21.15.81:0/2584821638 learned_addr learned my addr 172.21.15.81:0/2584821638 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf5259c640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf54072940 0x7faf54149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf52d9d640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf5415ba30 0x7faf5414bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf51d9b640 1 -- 172.21.15.81:0/2584821638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf54072940 msgr2=0x7faf54149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf51d9b640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf54072940 0x7faf54149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf51d9b640 1 -- 172.21.15.81:0/2584821638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf5415ba30 msgr2=0x7faf5414bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf51d9b640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf5415ba30 0x7faf5414bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf51d9b640 1 -- 172.21.15.81:0/2584821638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf54149320 con 0x7faf540b4880 2024-09-16T01:21:45.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf5259c640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf54072940 0x7faf54149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:45.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf52d9d640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf5415ba30 0x7faf5414bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:45.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.423+0000 7faf51d9b640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf540b4880 0x7faf54143e70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7faf3c02a2b0 tx=0x7faf3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:45.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.424+0000 7faf4affd640 1 -- 172.21.15.81:0/2584821638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c037040 con 0x7faf540b4880 2024-09-16T01:21:45.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.424+0000 7faf4affd640 1 -- 172.21.15.81:0/2584821638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c042070 con 0x7faf540b4880 2024-09-16T01:21:45.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.424+0000 7faf4affd640 1 -- 172.21.15.81:0/2584821638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c030880 con 0x7faf540b4880 2024-09-16T01:21:45.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.424+0000 7faf58d6d640 1 -- 172.21.15.81:0/2584821638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5415c820 con 0x7faf540b4880 2024-09-16T01:21:45.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.424+0000 7faf58d6d640 1 -- 172.21.15.81:0/2584821638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5415cdc0 con 0x7faf540b4880 2024-09-16T01:21:45.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.425+0000 7faf4affd640 1 -- 172.21.15.81:0/2584821638 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faf3c030a20 con 0x7faf540b4880 2024-09-16T01:21:45.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.426+0000 7faf4affd640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faf3406c2b0 0x7faf3406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.426+0000 7faf5259c640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faf3406c2b0 0x7faf3406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.426+0000 7faf4affd640 1 -- 172.21.15.81:0/2584821638 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7faf3c0abe40 con 0x7faf540b4880 2024-09-16T01:21:45.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.426+0000 7faf5259c640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faf3406c2b0 0x7faf3406e770 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7faf540b1700 tx=0x7faf44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.427+0000 7faf5bbe8740 1 Processor -- start 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.427+0000 7faf5bbe8740 1 -- start start 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf5bbe8740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602ceb8fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf5bbe8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb47a80 0x5602ceb4a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf5bbe8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb4ba50 0x5602ceb448b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf5bbe8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5602ceaac520 con 0x5602ceb47a80 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf5bbe8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5602cea543e0 con 0x5602ceb4ba50 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf5bbe8740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5602ceaa84e0 con 0x5602ceb4a2c0 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf51d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb47a80 0x5602ceb4a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf51d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb47a80 0x5602ceb4a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34786/0 (socket says 172.21.15.81:34786) 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf51d9b640 1 -- 172.21.15.81:0/1366563525 learned_addr learned my addr 172.21.15.81:0/1366563525 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf52d9d640 1 --2- 172.21.15.81:0/1366563525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb4ba50 0x5602ceb448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf5259c640 1 --2- 172.21.15.81:0/1366563525 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602ceb8fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf51d9b640 1 -- 172.21.15.81:0/1366563525 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 msgr2=0x5602ceb8fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf51d9b640 1 --2- 172.21.15.81:0/1366563525 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602ceb8fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf51d9b640 1 -- 172.21.15.81:0/1366563525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb4ba50 msgr2=0x5602ceb448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf51d9b640 1 --2- 172.21.15.81:0/1366563525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb4ba50 0x5602ceb448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf51d9b640 1 -- 172.21.15.81:0/1366563525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602cea6f2f0 con 0x5602ceb47a80 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf5259c640 1 --2- 172.21.15.81:0/1366563525 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602ceb8fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf51d9b640 1 --2- 172.21.15.81:0/1366563525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb47a80 0x5602ceb4a6a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7faf3c079850 tx=0x7faf3c079940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b11b163410d8ca server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf33fff640 1 -- 172.21.15.81:0/1366563525 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c079d10 con 0x5602ceb47a80 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf33fff640 1 -- 172.21.15.81:0/1366563525 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c07e0c0 con 0x5602ceb47a80 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.428+0000 7faf33fff640 1 -- 172.21.15.81:0/1366563525 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0828f0 con 0x5602ceb47a80 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.429+0000 7faf5bbe8740 1 -- 172.21.15.81:0/1366563525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb47a80 msgr2=0x5602ceb4a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.429+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/1366563525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb47a80 0x5602ceb4a6a0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7faf3c079850 tx=0x7faf3c079940 comp rx=0 tx=0).stop 2024-09-16T01:21:45.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.429+0000 7faf5bbe8740 1 -- 172.21.15.81:0/1366563525 shutdown_connections 2024-09-16T01:21:45.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.429+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/1366563525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb4ba50 0x5602ceb448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.429+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/1366563525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb47a80 0x5602ceb4a6a0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.429+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/1366563525 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602ceb8fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.429+0000 7faf5bbe8740 1 -- 172.21.15.81:0/1366563525 >> 172.21.15.81:0/1366563525 conn(0x5602ceb46a80 msgr2=0x5602ceb8ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:45.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.429+0000 7faf5bbe8740 1 -- 172.21.15.81:0/1366563525 shutdown_connections 2024-09-16T01:21:45.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.429+0000 7faf5bbe8740 1 -- 172.21.15.81:0/1366563525 wait complete. 2024-09-16T01:21:45.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.430+0000 7faf5bbe8740 1 -- start start 2024-09-16T01:21:45.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.430+0000 7faf5bbe8740 1 Processor -- start 2024-09-16T01:21:45.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf5bbe8740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602ceb69bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf5bbe8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb4ba50 0x5602ceb6a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf5bbe8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb6af50 0x5602ceb6b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf5bbe8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5602ceb45f20 con 0x5602ceb6af50 2024-09-16T01:21:45.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf5bbe8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5602cea35450 con 0x5602ceb4ba50 2024-09-16T01:21:45.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf5bbe8740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5602ceb90290 con 0x5602ceb4a2c0 2024-09-16T01:21:45.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf5bbe8740 10 client.0 _ll_register_callbacks cb 0x5602ce7beac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:21:45.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf52d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb6af50 0x5602ceb6b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf52d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb6af50 0x5602ceb6b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34802/0 (socket says 172.21.15.81:34802) 2024-09-16T01:21:45.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf52d9d640 1 -- 172.21.15.81:0/158856701 learned_addr learned my addr 172.21.15.81:0/158856701 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:45.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf5259c640 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602ceb69bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf51d9b640 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb4ba50 0x5602ceb6a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf52d9d640 1 -- 172.21.15.81:0/158856701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 msgr2=0x5602ceb69bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:45.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf52d9d640 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602ceb69bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf52d9d640 1 -- 172.21.15.81:0/158856701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb4ba50 msgr2=0x5602ceb6a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:45.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf52d9d640 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb4ba50 0x5602ceb6a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf52d9d640 1 -- 172.21.15.81:0/158856701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602ce7bf2d0 con 0x5602ceb6af50 2024-09-16T01:21:45.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf52d9d640 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb6af50 0x5602ceb6b3d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009de0 tx=0x7faf4c0136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b17e4f42f12c0a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:45.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf317fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:21:45.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf317fa640 1 -- 172.21.15.81:0/158856701 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c01a030 con 0x5602ceb6af50 2024-09-16T01:21:45.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf317fa640 1 -- 172.21.15.81:0/158856701 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7faf4c016460 con 0x5602ceb6af50 2024-09-16T01:21:45.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf5bbe8740 1 -- 172.21.15.81:0/158856701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf3c07e0c0 con 0x5602ceb6af50 2024-09-16T01:21:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf317fa640 1 -- 172.21.15.81:0/158856701 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7faf4c005990 con 0x5602ceb6af50 2024-09-16T01:21:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf5bbe8740 10 client.7080 fetch_fsmap learned FSMap version 52 2024-09-16T01:21:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf5bbe8740 1 -- 172.21.15.81:0/158856701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x5602ce8896b0 con 0x5602ceb6af50 2024-09-16T01:21:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.431+0000 7faf317fa640 1 -- 172.21.15.81:0/158856701 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c07e0c0 con 0x5602ceb6af50 2024-09-16T01:21:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.432+0000 7faf317fa640 1 -- 172.21.15.81:0/158856701 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 52) ==== 3502+0+0 (secure 0 0 0) 0x7faf4c005b30 con 0x5602ceb6af50 2024-09-16T01:21:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.432+0000 7faf5bbe8740 10 client.7080 fetch_fsmap finished waiting for FSMap version 52 2024-09-16T01:21:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.432+0000 7faf5bbe8740 10 client.7080 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:21:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.432+0000 7faf5bbe8740 20 client.7080 populate_metadata read hostname 'smithi081' 2024-09-16T01:21:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.432+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.81:6835/2688004165,v1:172.21.15.81:6837/2688004165] conn(0x5602ceb9f5a0 0x5602ceb9f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.432+0000 7faf5bbe8740 4 client.7080 mds_command: new command op to 6945 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.432+0000 7faf5bbe8740 1 -- 172.21.15.81:0/158856701 --> [v2:172.21.15.81:6835/2688004165,v1:172.21.15.81:6837/2688004165] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602ceab9c50 con 0x5602ceb9f5a0 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.432+0000 7faf5259c640 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.81:6835/2688004165,v1:172.21.15.81:6837/2688004165] conn(0x5602ceb9f5a0 0x5602ceb9f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.432+0000 7faf317fa640 10 client.7080 ms_handle_connect on v2:172.21.15.81:6835/2688004165 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.432+0000 7faf5259c640 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.81:6835/2688004165,v1:172.21.15.81:6837/2688004165] conn(0x5602ceb9f5a0 0x5602ceb9f980 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99213470c1716448 server_cookie=5c62a3f92e6fc6e in_seq=0 out_seq=0 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf317fa640 1 -- 172.21.15.81:0/158856701 <== mds.0 v2:172.21.15.81:6835/2688004165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602ceab9c50 con 0x5602ceb9f5a0 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf317fa640 10 client.7080 handle_command_reply: tid=0 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf5bbe8740 1 client.7080 shutdown 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf5bbe8740 1 -- 172.21.15.81:0/158856701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb6af50 msgr2=0x5602ceb6b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb6af50 0x5602ceb6b3d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009de0 tx=0x7faf4c0136b0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf5bbe8740 1 -- 172.21.15.81:0/158856701 shutdown_connections 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.81:6835/2688004165,v1:172.21.15.81:6837/2688004165] conn(0x5602ceb9f5a0 0x5602ceb9f980 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb6af50 0x5602ceb6b3d0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb4ba50 0x5602ceb6a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf317fa640 0 client.7080 ms_handle_reset on v2:172.21.15.81:6835/2688004165 2024-09-16T01:21:45.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/158856701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602ceb69bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf5bbe8740 1 -- 172.21.15.81:0/158856701 >> 172.21.15.81:0/158856701 conn(0x5602ceb47a80 msgr2=0x5602ceb90a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:45.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf5bbe8740 1 -- 172.21.15.81:0/158856701 shutdown_connections 2024-09-16T01:21:45.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf5bbe8740 1 -- 172.21.15.81:0/158856701 wait complete. 2024-09-16T01:21:45.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.433+0000 7faf5bbe8740 20 client.7080 trim_cache size 0 max 16384 2024-09-16T01:21:45.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.451+0000 7faf5bbe8740 1 Processor -- start 2024-09-16T01:21:45.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.451+0000 7faf5bbe8740 1 -- start start 2024-09-16T01:21:45.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.451+0000 7faf5bbe8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4a2c0 0x5602ceb74800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.451+0000 7faf5bbe8740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4ba50 0x5602cebb2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5bbe8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb6af50 0x5602cebb3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5bbe8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faf541fdfb0 con 0x5602ceb4a2c0 2024-09-16T01:21:45.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5bbe8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faf541487f0 con 0x5602ceb6af50 2024-09-16T01:21:45.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5bbe8740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7faf54148e40 con 0x5602ceb4ba50 2024-09-16T01:21:45.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4a2c0 0x5602ceb74800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4a2c0 0x5602ceb74800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34814/0 (socket says 172.21.15.81:34814) 2024-09-16T01:21:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5259c640 1 -- 172.21.15.81:0/3024749205 learned_addr learned my addr 172.21.15.81:0/3024749205 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5259c640 1 -- 172.21.15.81:0/3024749205 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4ba50 msgr2=0x5602cebb2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5259c640 1 --2- 172.21.15.81:0/3024749205 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4ba50 0x5602cebb2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5259c640 1 -- 172.21.15.81:0/3024749205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb6af50 msgr2=0x5602cebb3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5259c640 1 --2- 172.21.15.81:0/3024749205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb6af50 0x5602cebb3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5259c640 1 -- 172.21.15.81:0/3024749205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ceb924e0 con 0x5602ceb4a2c0 2024-09-16T01:21:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf5259c640 1 --2- 172.21.15.81:0/3024749205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4a2c0 0x5602ceb74800 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7faf4400e530 tx=0x7faf44017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42dea6c5c3b490c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf337fe640 1 -- 172.21.15.81:0/3024749205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4400ed30 con 0x5602ceb4a2c0 2024-09-16T01:21:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf337fe640 1 -- 172.21.15.81:0/3024749205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf440055a0 con 0x5602ceb4a2c0 2024-09-16T01:21:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.452+0000 7faf337fe640 1 -- 172.21.15.81:0/3024749205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf44005750 con 0x5602ceb4a2c0 2024-09-16T01:21:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.453+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3024749205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4a2c0 msgr2=0x5602ceb74800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.453+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/3024749205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4a2c0 0x5602ceb74800 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7faf4400e530 tx=0x7faf44017040 comp rx=0 tx=0).stop 2024-09-16T01:21:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.453+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3024749205 shutdown_connections 2024-09-16T01:21:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.453+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/3024749205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb6af50 0x5602cebb3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.453+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/3024749205 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4ba50 0x5602cebb2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.453+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/3024749205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4a2c0 0x5602ceb74800 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.453+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3024749205 >> 172.21.15.81:0/3024749205 conn(0x5602ceb47a80 msgr2=0x5602ceb90a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.453+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3024749205 shutdown_connections 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.453+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3024749205 wait complete. 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.453+0000 7faf5bbe8740 1 -- start start 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.453+0000 7faf5bbe8740 1 Processor -- start 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.454+0000 7faf5bbe8740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602cec11dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.454+0000 7faf5bbe8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4ba50 0x5602cec0d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.454+0000 7faf5bbe8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb6af50 0x5602ceba3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.454+0000 7faf5bbe8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5602ceba2770 con 0x5602ceb4ba50 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.454+0000 7faf5bbe8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5602ceb45570 con 0x5602ceb6af50 2024-09-16T01:21:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.454+0000 7faf5bbe8740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5602ceb44c80 con 0x5602ceb4a2c0 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.454+0000 7faf5bbe8740 10 client.0 _ll_register_callbacks cb 0x7faf4c009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.454+0000 7faf51d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4ba50 0x5602cec0d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.454+0000 7faf51d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4ba50 0x5602cec0d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34818/0 (socket says 172.21.15.81:34818) 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.454+0000 7faf51d9b640 1 -- 172.21.15.81:0/3346537663 learned_addr learned my addr 172.21.15.81:0/3346537663 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf52d9d640 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb6af50 0x5602ceba3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf5259c640 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602cec11dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf51d9b640 1 -- 172.21.15.81:0/3346537663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 msgr2=0x5602cec11dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf51d9b640 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602cec11dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf51d9b640 1 -- 172.21.15.81:0/3346537663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb6af50 msgr2=0x5602ceba3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf51d9b640 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb6af50 0x5602ceba3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf51d9b640 1 -- 172.21.15.81:0/3346537663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602ceb45020 con 0x5602ceb4ba50 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf52d9d640 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb6af50 0x5602ceba3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf5259c640 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602cec11dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf51d9b640 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4ba50 0x5602cec0d660 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7faf3c000c00 tx=0x7faf3c032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbd848b899c746d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf317fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf317fa640 1 -- 172.21.15.81:0/3346537663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c07e0c0 con 0x5602ceb4ba50 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf317fa640 1 -- 172.21.15.81:0/3346537663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7faf3c030d10 con 0x5602ceb4ba50 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3346537663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf440055a0 con 0x5602ceb4ba50 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf317fa640 1 -- 172.21.15.81:0/3346537663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7faf3c0a3050 con 0x5602ceb4ba50 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf5bbe8740 10 client.7086 fetch_fsmap learned FSMap version 52 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3346537663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x5602cec0dba0 con 0x5602ceb4ba50 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf317fa640 1 -- 172.21.15.81:0/3346537663 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf440055a0 con 0x5602ceb4ba50 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf317fa640 1 -- 172.21.15.81:0/3346537663 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 52) ==== 3502+0+0 (secure 0 0 0) 0x7faf3c03a070 con 0x5602ceb4ba50 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf5bbe8740 10 client.7086 fetch_fsmap finished waiting for FSMap version 52 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf5bbe8740 10 client.7086 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:21:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf5bbe8740 20 client.7086 populate_metadata read hostname 'smithi081' 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.81:6835/2688004165,v1:172.21.15.81:6837/2688004165] conn(0x5602ceb8b450 0x5602ceb8b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf5bbe8740 4 client.7086 mds_command: new command op to 6945 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.455+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3346537663 --> [v2:172.21.15.81:6835/2688004165,v1:172.21.15.81:6837/2688004165] -- command(tid 0: {"prefix": "status"}) -- 0x5602ceab3fa0 con 0x5602ceb8b450 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5259c640 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.81:6835/2688004165,v1:172.21.15.81:6837/2688004165] conn(0x5602ceb8b450 0x5602ceb8b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf317fa640 10 client.7086 ms_handle_connect on v2:172.21.15.81:6835/2688004165 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5259c640 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.81:6835/2688004165,v1:172.21.15.81:6837/2688004165] conn(0x5602ceb8b450 0x5602ceb8b830 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41ecdace426ff3c4 server_cookie=c179b90636e0e4ae in_seq=0 out_seq=0 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf317fa640 1 -- 172.21.15.81:0/3346537663 <== mds.0 v2:172.21.15.81:6835/2688004165 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5602ceab3fa0 con 0x5602ceb8b450 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf317fa640 10 client.7086 handle_command_reply: tid=0 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5bbe8740 1 client.7086 shutdown 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3346537663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4ba50 msgr2=0x5602cec0d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4ba50 0x5602cec0d660 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7faf3c000c00 tx=0x7faf3c032f90 comp rx=0 tx=0).stop 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3346537663 shutdown_connections 2024-09-16T01:21:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.81:6835/2688004165,v1:172.21.15.81:6837/2688004165] conn(0x5602ceb8b450 0x5602ceb8b830 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602ceb6af50 0x5602ceba3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5602ceb4ba50 0x5602cec0d660 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf317fa640 0 client.7086 ms_handle_reset on v2:172.21.15.81:6835/2688004165 2024-09-16T01:21:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5bbe8740 1 --2- 172.21.15.81:0/3346537663 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5602ceb4a2c0 0x5602cec11dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3346537663 >> 172.21.15.81:0/3346537663 conn(0x5602ceb47a80 msgr2=0x5602cebb2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3346537663 shutdown_connections 2024-09-16T01:21:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.456+0000 7faf5bbe8740 1 -- 172.21.15.81:0/3346537663 wait complete. 2024-09-16T01:21:45.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf5bbe8740 20 client.7086 trim_cache size 0 max 16384 2024-09-16T01:21:45.465 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:21:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973", 2024-09-16T01:21:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-16T01:21:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6945, 2024-09-16T01:21:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-16T01:21:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-16T01:21:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-16T01:21:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.5529122559999999, 2024-09-16T01:21:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 52, 2024-09-16T01:21:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 101, 2024-09-16T01:21:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 101, 2024-09-16T01:21:45.466 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 8.6229897300000005 2024-09-16T01:21:45.466 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:21:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf58d6d640 1 -- 172.21.15.81:0/2584821638 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faf3406c2b0 msgr2=0x7faf3406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf58d6d640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faf3406c2b0 0x7faf3406e770 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7faf540b1700 tx=0x7faf44009040 comp rx=0 tx=0).stop 2024-09-16T01:21:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf58d6d640 1 -- 172.21.15.81:0/2584821638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf540b4880 msgr2=0x7faf54143e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf58d6d640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf540b4880 0x7faf54143e70 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7faf3c02a2b0 tx=0x7faf3c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf58d6d640 1 -- 172.21.15.81:0/2584821638 shutdown_connections 2024-09-16T01:21:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf58d6d640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faf3406c2b0 0x7faf3406e770 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf58d6d640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf5415ba30 0x7faf5414bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf58d6d640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf540b4880 0x7faf54143e70 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf58d6d640 1 --2- 172.21.15.81:0/2584821638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf54072940 0x7faf54149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf58d6d640 1 -- 172.21.15.81:0/2584821638 >> 172.21.15.81:0/2584821638 conn(0x7faf54067d70 msgr2=0x7faf54159730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf58d6d640 1 -- 172.21.15.81:0/2584821638 shutdown_connections 2024-09-16T01:21:45.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.457+0000 7faf58d6d640 1 -- 172.21.15.81:0/2584821638 wait complete. 2024-09-16T01:21:45.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:21:45.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.565+0000 7f6481dd8640 1 Processor -- start 2024-09-16T01:21:45.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.565+0000 7f6481dd8640 1 -- start start 2024-09-16T01:21:45.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.566+0000 7f6481dd8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f647c15e740 0x7f647c0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.566+0000 7f6481dd8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f647c09b690 0x7f647c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.566+0000 7f6481dd8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f647c06d4c0 0x7f647c06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.566+0000 7f6481dd8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f647c15eb20 con 0x7f647c06d4c0 2024-09-16T01:21:45.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.566+0000 7f6481dd8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f647c06d260 con 0x7f647c09b690 2024-09-16T01:21:45.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.566+0000 7f6481dd8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f647c0d0780 con 0x7f647c15e740 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.566+0000 7f647bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f647c06d4c0 0x7f647c06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.566+0000 7f647bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f647c06d4c0 0x7f647c06d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34824/0 (socket says 172.21.15.81:34824) 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.566+0000 7f647bfff640 1 -- 172.21.15.81:0/4127776200 learned_addr learned my addr 172.21.15.81:0/4127776200 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.567+0000 7f647b7fe640 1 --2- 172.21.15.81:0/4127776200 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f647c15e740 0x7f647c0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.567+0000 7f647affd640 1 --2- 172.21.15.81:0/4127776200 >> v2:172.21.15.102:3300/0 conn(0x7f647c09b690 0x7f647c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.567+0000 7f647bfff640 1 -- 172.21.15.81:0/4127776200 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f647c15e740 msgr2=0x7f647c0d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.567+0000 7f647bfff640 1 --2- 172.21.15.81:0/4127776200 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f647c15e740 0x7f647c0d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.567+0000 7f647bfff640 1 -- 172.21.15.81:0/4127776200 >> v2:172.21.15.102:3300/0 conn(0x7f647c09b690 msgr2=0x7f647c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.567+0000 7f647bfff640 1 --2- 172.21.15.81:0/4127776200 >> v2:172.21.15.102:3300/0 conn(0x7f647c09b690 0x7f647c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.567+0000 7f647bfff640 1 -- 172.21.15.81:0/4127776200 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c0d0a60 con 0x7f647c06d4c0 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.567+0000 7f647bfff640 1 --2- 172.21.15.81:0/4127776200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f647c06d4c0 0x7f647c06d910 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f647c0738c0 tx=0x7f647402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e67f3913be4ae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.567+0000 7f647a7fc640 1 -- 172.21.15.81:0/4127776200 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474037070 con 0x7f647c06d4c0 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.567+0000 7f647a7fc640 1 -- 172.21.15.81:0/4127776200 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6474032440 con 0x7f647c06d4c0 2024-09-16T01:21:45.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.567+0000 7f647a7fc640 1 -- 172.21.15.81:0/4127776200 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474032810 con 0x7f647c06d4c0 2024-09-16T01:21:45.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.568+0000 7f6481dd8640 1 -- 172.21.15.81:0/4127776200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f647c06d4c0 msgr2=0x7f647c06d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.568+0000 7f6481dd8640 1 --2- 172.21.15.81:0/4127776200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f647c06d4c0 0x7f647c06d910 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f647c0738c0 tx=0x7f647402a2a0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.568+0000 7f6481dd8640 1 -- 172.21.15.81:0/4127776200 shutdown_connections 2024-09-16T01:21:45.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.568+0000 7f6481dd8640 1 --2- 172.21.15.81:0/4127776200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f647c06d4c0 0x7f647c06d910 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.568+0000 7f6481dd8640 1 --2- 172.21.15.81:0/4127776200 >> v2:172.21.15.102:3300/0 conn(0x7f647c09b690 0x7f647c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.568+0000 7f6481dd8640 1 --2- 172.21.15.81:0/4127776200 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f647c15e740 0x7f647c0d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.568+0000 7f6481dd8640 1 -- 172.21.15.81:0/4127776200 >> 172.21.15.81:0/4127776200 conn(0x7f647c0d23a0 msgr2=0x7f647c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.568+0000 7f6481dd8640 1 -- 172.21.15.81:0/4127776200 shutdown_connections 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.568+0000 7f6481dd8640 1 -- 172.21.15.81:0/4127776200 wait complete. 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.569+0000 7f6481dd8640 1 Processor -- start 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.569+0000 7f6481dd8640 1 -- start start 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f6481dd8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647c06d4c0 0x7f647c15f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f6481dd8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f647c09b690 0x7f647c1623e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f6481dd8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f647c15e740 0x7f647c071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f6481dd8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f647c09ba90 con 0x7f647c15e740 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f6481dd8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f647c0d1020 con 0x7f647c06d4c0 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f6481dd8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f647c06de50 con 0x7f647c09b690 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f647bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f647c15e740 0x7f647c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f647bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f647c15e740 0x7f647c071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34838/0 (socket says 172.21.15.81:34838) 2024-09-16T01:21:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f647bfff640 1 -- 172.21.15.81:0/2659296369 learned_addr learned my addr 172.21.15.81:0/2659296369 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f647bfff640 1 -- 172.21.15.81:0/2659296369 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f647c09b690 msgr2=0x7f647c1623e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f647bfff640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f647c09b690 0x7f647c1623e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f647b7fe640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647c06d4c0 0x7f647c15f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f647bfff640 1 -- 172.21.15.81:0/2659296369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647c06d4c0 msgr2=0x7f647c15f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f647bfff640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647c06d4c0 0x7f647c15f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.570+0000 7f647bfff640 1 -- 172.21.15.81:0/2659296369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647c15ff40 con 0x7f647c15e740 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.571+0000 7f647bfff640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f647c15e740 0x7f647c071420 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f647402a2e0 tx=0x7f64740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.571+0000 7f6463fff640 1 -- 172.21.15.81:0/2659296369 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474037040 con 0x7f647c15e740 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.571+0000 7f6463fff640 1 -- 172.21.15.81:0/2659296369 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6474042070 con 0x7f647c15e740 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.571+0000 7f6481dd8640 1 -- 172.21.15.81:0/2659296369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647c160220 con 0x7f647c15e740 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.571+0000 7f6463fff640 1 -- 172.21.15.81:0/2659296369 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6474030bd0 con 0x7f647c15e740 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.571+0000 7f6481dd8640 1 -- 172.21.15.81:0/2659296369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f647c1618d0 con 0x7f647c15e740 2024-09-16T01:21:45.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.572+0000 7f6481dd8640 1 -- 172.21.15.81:0/2659296369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647c06d910 con 0x7f647c15e740 2024-09-16T01:21:45.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.572+0000 7f6463fff640 1 -- 172.21.15.81:0/2659296369 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6474047460 con 0x7f647c15e740 2024-09-16T01:21:45.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.573+0000 7f6463fff640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f646806c2b0 0x7f646806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:45.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.573+0000 7f6463fff640 1 -- 172.21.15.81:0/2659296369 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f64740ac200 con 0x7f647c15e740 2024-09-16T01:21:45.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.573+0000 7f647b7fe640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f646806c2b0 0x7f646806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:45.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.573+0000 7f647b7fe640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f646806c2b0 0x7f646806e770 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f647c071df0 tx=0x7f646c008420 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:45.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.577+0000 7f6463fff640 1 -- 172.21.15.81:0/2659296369 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f647407a7e0 con 0x7f647c15e740 2024-09-16T01:21:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.775+0000 7f6481dd8640 1 -- 172.21.15.81:0/2659296369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f647c0d1cb0 con 0x7f647c15e740 2024-09-16T01:21:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.776+0000 7f6463fff640 1 -- 172.21.15.81:0/2659296369 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) ==== 53+0+73 (secure 0 0 0) 0x7f647407a0e0 con 0x7f647c15e740 2024-09-16T01:21:45.778 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:21:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.778+0000 7f6481dd8640 1 -- 172.21.15.81:0/2659296369 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f646806c2b0 msgr2=0x7f646806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.778+0000 7f6481dd8640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f646806c2b0 0x7f646806e770 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f647c071df0 tx=0x7f646c008420 comp rx=0 tx=0).stop 2024-09-16T01:21:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.778+0000 7f6481dd8640 1 -- 172.21.15.81:0/2659296369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f647c15e740 msgr2=0x7f647c071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.778+0000 7f6481dd8640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f647c15e740 0x7f647c071420 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f647402a2e0 tx=0x7f64740046c0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.778+0000 7f6481dd8640 1 -- 172.21.15.81:0/2659296369 shutdown_connections 2024-09-16T01:21:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.778+0000 7f6481dd8640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f646806c2b0 0x7f646806e770 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.778+0000 7f6481dd8640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f647c15e740 0x7f647c071420 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.778+0000 7f6481dd8640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f647c09b690 0x7f647c1623e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.778+0000 7f6481dd8640 1 --2- 172.21.15.81:0/2659296369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f647c06d4c0 0x7f647c15f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.778+0000 7f6481dd8640 1 -- 172.21.15.81:0/2659296369 >> 172.21.15.81:0/2659296369 conn(0x7f647c0d23a0 msgr2=0x7f647c15d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.778+0000 7f6481dd8640 1 -- 172.21.15.81:0/2659296369 shutdown_connections 2024-09-16T01:21:45.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:45.778+0000 7f6481dd8640 1 -- 172.21.15.81:0/2659296369 wait complete. 2024-09-16T01:21:45.790 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:21:45.790 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:21:45.790 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:21:45.790 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:21:45.790 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:21:45.790 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:21:45.791 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:21:45.791 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:21:45.791 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:21:45.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:45.791 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:21:45.807 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:21:45.807 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:21:45.807 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:21:45.807 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:45.807 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:21:45.808 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:45.808 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:21:45.808 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:21:45.808 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:21:45.808 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:21:45.808 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:21:45.808 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:21:45.809 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:21:45.809 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:21:45.809 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:21:45.809 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:21:45.809 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:21:45.809 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42432sec preferred_lft 42432sec 2024-09-16T01:21:45.809 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:21:45.809 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:45.810 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:21:45.810 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:21:45.810 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:21:45.810 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:45.810 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::bc22:19ff:fe0c:8fb1/64 scope link 2024-09-16T01:21:45.810 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:45.811 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:21:45.811 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 86:bb:d8:38:80:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:21:45.811 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::84bb:d8ff:fe38:80af/64 scope link 2024-09-16T01:21:45.811 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:45.811 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:21:45.811 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:21:45.812 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::828:dff:febd:ee39/64 scope link 2024-09-16T01:21:45.812 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:45.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:45.812 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:21:45.871 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:21:45.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:45.872 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:21:45.929 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:21:45.929 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:21:45.929 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:21:45.929 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:21:45.929 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:21:45.930 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:21:45.930 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:21:45.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:21:45.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:21:45.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:21:45.930 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:21:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:21:46.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:21:46.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:46.055 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:21:46.070 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:21:46.071 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:21:46.071 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:21:46.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:46.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-16T01:21:46.135 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:21:46.135 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:21:46.192 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:21:46.192 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:21:46.193 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:21:46.247 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:21:46.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:46.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:21:46.330 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:21:46.331 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:21:46.331 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:21:46.339 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:21:46.339 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:21:46.340 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:21:46.340 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:21:46.340 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:21:46.345 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:21:46.345 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:21:46.345 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:21:46.345 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:21:46.345 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:21:46.345 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:21:46.345 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:21:46.345 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:21:46.346 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:21:46.346 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:21:46.346 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:21:46.346 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:21:46.346 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:21:46.347 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:21:46.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:46.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:21:46.412 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:21:46.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:21:46.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:21:46.512 INFO:teuthology.orchestra.run.smithi081.stdout:client5825 2024-09-16T01:21:46.513 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:21:46.513 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:46.531 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:21:46.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.667+0000 7fd5568d0640 1 Processor -- start 2024-09-16T01:21:46.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.667+0000 7fd5568d0640 1 -- start start 2024-09-16T01:21:46.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.667+0000 7fd5568d0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd550161c80 0x7fd55006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:46.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.667+0000 7fd5568d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd550162060 0x7fd5500b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:46.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.668+0000 7fd5568d0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd55006e870 con 0x7fd5500b64b0 2024-09-16T01:21:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.668+0000 7fd5568d0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd55006d9f0 con 0x7fd550161c80 2024-09-16T01:21:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.668+0000 7fd5568d0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd55006dcd0 con 0x7fd550162060 2024-09-16T01:21:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.668+0000 7fd54ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd550161c80 0x7fd55006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.668+0000 7fd554e6d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd5500b64b0 0x7fd550162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49136/0 (socket says 172.21.15.81:49136) 2024-09-16T01:21:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.668+0000 7fd554e6d640 1 -- 172.21.15.81:0/2757670748 learned_addr learned my addr 172.21.15.81:0/2757670748 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.668+0000 7fd54ffff640 1 -- 172.21.15.81:0/2757670748 >> v2:172.21.15.102:3300/0 conn(0x7fd550162060 msgr2=0x7fd5500b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.668+0000 7fd54f7fe640 1 --2- 172.21.15.81:0/2757670748 >> v2:172.21.15.102:3300/0 conn(0x7fd550162060 0x7fd5500b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.668+0000 7fd54effd640 1 -- 172.21.15.81:0/2757670748 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 34495591 0 0) 0x7fd548001490 con 0x7fd5500b64b0 2024-09-16T01:21:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.668+0000 7fd54ffff640 1 --2- 172.21.15.81:0/2757670748 >> v2:172.21.15.102:3300/0 conn(0x7fd550162060 0x7fd5500b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.668+0000 7fd54ffff640 1 -- 172.21.15.81:0/2757670748 >> v1:172.21.15.81:6789/0 conn(0x7fd5500b64b0 legacy=0x7fd550162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.668+0000 7fd54ffff640 1 -- 172.21.15.81:0/2757670748 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55006dfb0 con 0x7fd550161c80 2024-09-16T01:21:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.669+0000 7fd54ffff640 1 --2- 172.21.15.81:0/2757670748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd550161c80 0x7fd55006e330 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd55008e830 tx=0x7fd54002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596a3c64b59e8683 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.669+0000 7fd54effd640 1 -- 172.21.15.81:0/2757670748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd540037070 con 0x7fd550161c80 2024-09-16T01:21:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.669+0000 7fd54effd640 1 -- 172.21.15.81:0/2757670748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd540032440 con 0x7fd550161c80 2024-09-16T01:21:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.669+0000 7fd54effd640 1 -- 172.21.15.81:0/2757670748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd540032810 con 0x7fd550161c80 2024-09-16T01:21:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.669+0000 7fd5568d0640 1 -- 172.21.15.81:0/2757670748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd550161c80 msgr2=0x7fd55006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.669+0000 7fd5568d0640 1 --2- 172.21.15.81:0/2757670748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd550161c80 0x7fd55006e330 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd55008e830 tx=0x7fd54002a1a0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.669+0000 7fd5568d0640 1 -- 172.21.15.81:0/2757670748 shutdown_connections 2024-09-16T01:21:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.669+0000 7fd5568d0640 1 --2- 172.21.15.81:0/2757670748 >> v2:172.21.15.102:3300/0 conn(0x7fd550162060 0x7fd5500b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.669+0000 7fd5568d0640 1 --2- 172.21.15.81:0/2757670748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd550161c80 0x7fd55006e330 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.669+0000 7fd5568d0640 1 -- 172.21.15.81:0/2757670748 >> 172.21.15.81:0/2757670748 conn(0x7fd5500d44f0 msgr2=0x7fd5500d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.669+0000 7fd5568d0640 1 -- 172.21.15.81:0/2757670748 shutdown_connections 2024-09-16T01:21:46.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.669+0000 7fd5568d0640 1 -- 172.21.15.81:0/2757670748 wait complete. 2024-09-16T01:21:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.671+0000 7fd5568d0640 1 Processor -- start 2024-09-16T01:21:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.671+0000 7fd5568d0640 1 -- start start 2024-09-16T01:21:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.671+0000 7fd5568d0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5500b64b0 0x7fd5500ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.671+0000 7fd5568d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd550161c80 0x7fd5500b9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.671+0000 7fd5568d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd550162060 0x7fd550155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.671+0000 7fd5568d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd5500d2a10 con 0x7fd550161c80 2024-09-16T01:21:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.671+0000 7fd5568d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd5500d2890 con 0x7fd550162060 2024-09-16T01:21:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.671+0000 7fd5568d0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd5500b6960 con 0x7fd5500b64b0 2024-09-16T01:21:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd550161c80 0x7fd5500b9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd550161c80 0x7fd5500b9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34848/0 (socket says 172.21.15.81:34848) 2024-09-16T01:21:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54f7fe640 1 -- 172.21.15.81:0/1013362692 learned_addr learned my addr 172.21.15.81:0/1013362692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd554e6d640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd550162060 0x7fd550155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54ffff640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5500b64b0 0x7fd5500ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54f7fe640 1 -- 172.21.15.81:0/1013362692 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5500b64b0 msgr2=0x7fd5500ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54f7fe640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5500b64b0 0x7fd5500ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54f7fe640 1 -- 172.21.15.81:0/1013362692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd550162060 msgr2=0x7fd550155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54f7fe640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd550162060 0x7fd550155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54f7fe640 1 -- 172.21.15.81:0/1013362692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5500b74e0 con 0x7fd550161c80 2024-09-16T01:21:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54f7fe640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd550161c80 0x7fd5500b9ce0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fd54400c7f0 tx=0x7fd54400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54cff9640 1 -- 172.21.15.81:0/1013362692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544015070 con 0x7fd550161c80 2024-09-16T01:21:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54cff9640 1 -- 172.21.15.81:0/1013362692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd544007820 con 0x7fd550161c80 2024-09-16T01:21:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd54cff9640 1 -- 172.21.15.81:0/1013362692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544007bd0 con 0x7fd550161c80 2024-09-16T01:21:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd5568d0640 1 -- 172.21.15.81:0/1013362692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5500b77c0 con 0x7fd550161c80 2024-09-16T01:21:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.672+0000 7fd5568d0640 1 -- 172.21.15.81:0/1013362692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5500b7d80 con 0x7fd550161c80 2024-09-16T01:21:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.673+0000 7fd5568d0640 1 -- 172.21.15.81:0/1013362692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5500ba470 con 0x7fd550161c80 2024-09-16T01:21:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.674+0000 7fd54cff9640 1 -- 172.21.15.81:0/1013362692 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd544018070 con 0x7fd550161c80 2024-09-16T01:21:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.674+0000 7fd54cff9640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd53c06c2b0 0x7fd53c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.674+0000 7fd54cff9640 1 -- 172.21.15.81:0/1013362692 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fd54408b330 con 0x7fd550161c80 2024-09-16T01:21:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.674+0000 7fd54ffff640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd53c06c2b0 0x7fd53c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.675+0000 7fd54ffff640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd53c06c2b0 0x7fd53c06e770 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd540034000 tx=0x7fd54002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:46.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.679+0000 7fd54cff9640 1 -- 172.21.15.81:0/1013362692 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd544059230 con 0x7fd550161c80 2024-09-16T01:21:46.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.880+0000 7fd5568d0640 1 -- 172.21.15.81:0/1013362692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd550160950 con 0x7fd550161c80 2024-09-16T01:21:46.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.880+0000 7fd54cff9640 1 -- 172.21.15.81:0/1013362692 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) ==== 53+0+73 (secure 0 0 0) 0x7fd54405d530 con 0x7fd550161c80 2024-09-16T01:21:46.882 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:21:46.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.882+0000 7fd5568d0640 1 -- 172.21.15.81:0/1013362692 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd53c06c2b0 msgr2=0x7fd53c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:46.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.882+0000 7fd5568d0640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd53c06c2b0 0x7fd53c06e770 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd540034000 tx=0x7fd54002e000 comp rx=0 tx=0).stop 2024-09-16T01:21:46.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.882+0000 7fd5568d0640 1 -- 172.21.15.81:0/1013362692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd550161c80 msgr2=0x7fd5500b9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:46.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.882+0000 7fd5568d0640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd550161c80 0x7fd5500b9ce0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fd54400c7f0 tx=0x7fd54400ccb0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.882+0000 7fd5568d0640 1 -- 172.21.15.81:0/1013362692 shutdown_connections 2024-09-16T01:21:46.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.882+0000 7fd5568d0640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd53c06c2b0 0x7fd53c06e770 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.882+0000 7fd5568d0640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd550162060 0x7fd550155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.882+0000 7fd5568d0640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd550161c80 0x7fd5500b9ce0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.882+0000 7fd5568d0640 1 --2- 172.21.15.81:0/1013362692 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5500b64b0 0x7fd5500ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:46.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.882+0000 7fd5568d0640 1 -- 172.21.15.81:0/1013362692 >> 172.21.15.81:0/1013362692 conn(0x7fd5500d44f0 msgr2=0x7fd5500d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:46.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.882+0000 7fd5568d0640 1 -- 172.21.15.81:0/1013362692 shutdown_connections 2024-09-16T01:21:46.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:46.882+0000 7fd5568d0640 1 -- 172.21.15.81:0/1013362692 wait complete. 2024-09-16T01:21:46.896 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:21:46.896 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:21:46.896 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-16T01:21:46.896 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T01:21:46.896 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:21:46.896 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:21:46.896 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:21:46.896 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:21:46.896 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:21:46.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:46.897 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-16T01:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-16T01:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-16T01:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:21:46.916 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42433sec preferred_lft 42433sec 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:46.917 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::fc48:18ff:fedc:b80f/64 scope link 2024-09-16T01:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 2e:4a:65:c9:20:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::2c4a:65ff:fec9:204f/64 scope link 2024-09-16T01:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::1072:70ff:fefd:f9f1/64 scope link 2024-09-16T01:21:46.918 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:21:46.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:46.918 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:21:46.982 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:21:46.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:46.984 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-16T01:21:47.041 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-16T01:21:47.041 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:21:47.042 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:21:47.042 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:21:47.042 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:21:47.042 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:21:47.042 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:21:47.042 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:21:47.042 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:21:47.042 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:21:47.042 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:21:47.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:21:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:21:47.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:21:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:21:47.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:47.173 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:21:47.188 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T01:21:47.188 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:21:47.188 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:21:47.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:47.188 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-16T01:21:47.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:21:47.253 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T01:21:47.308 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:21:47.309 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:21:47.309 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:21:47.364 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:21:47.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:47.364 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:21:47.447 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:21:47.447 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:21:47.447 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:21:47.456 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:21:47.456 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:21:47.456 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:21:47.457 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:21:47.457 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:21:47.473 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:21:47.474 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:21:47.474 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:21:47.474 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:21:47.474 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:21:47.474 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:21:47.474 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:21:47.474 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:21:47.474 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T01:21:47.474 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:21:47.475 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:21:47.475 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:21:47.475 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:21:47.476 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:21:47.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:47.476 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:21:47.541 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:21:47.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:21:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:21:47.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:21:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:21:47.636 INFO:teuthology.orchestra.run.smithi102.stdout:client6298 2024-09-16T01:21:47.637 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:21:47.637 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:47.653 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:21:47.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:21:47.709 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:21:47.757 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:21:47.758 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:21:47.758 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:21:47.758 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:47.776 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:21:47.777 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:47.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:21:47.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.984+0000 7f1667053640 1 Processor -- start 2024-09-16T01:21:47.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.985+0000 7f1667053640 1 -- start start 2024-09-16T01:21:47.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.985+0000 7f1667053640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1660162060 0x7f16600b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:47.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.985+0000 7f1667053640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f16600b64b0 0x7f16600b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:47.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.985+0000 7f1667053640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166006d9f0 con 0x7f1660161c80 2024-09-16T01:21:47.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.985+0000 7f1667053640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f166006dcd0 con 0x7f16600b64b0 2024-09-16T01:21:47.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.985+0000 7f1667053640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f166006dfb0 con 0x7f1660162060 2024-09-16T01:21:47.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.985+0000 7f16655f0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f16600b64b0 0x7f16600b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:47.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.986+0000 7f1664def640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1660161c80 0x7f166006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49140/0 (socket says 172.21.15.81:49140) 2024-09-16T01:21:47.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.986+0000 7f1664def640 1 -- 172.21.15.81:0/4221082177 learned_addr learned my addr 172.21.15.81:0/4221082177 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:47.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.986+0000 7f1657fff640 1 --2- 172.21.15.81:0/4221082177 >> v2:172.21.15.102:3300/0 conn(0x7f1660162060 0x7f16600b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:47.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.986+0000 7f16655f0640 1 -- 172.21.15.81:0/4221082177 >> v2:172.21.15.102:3300/0 conn(0x7f1660162060 msgr2=0x7f16600b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:47.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.986+0000 7f16655f0640 1 --2- 172.21.15.81:0/4221082177 >> v2:172.21.15.102:3300/0 conn(0x7f1660162060 0x7f16600b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:47.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.986+0000 7f16655f0640 1 -- 172.21.15.81:0/4221082177 >> v1:172.21.15.81:6789/0 conn(0x7f1660161c80 legacy=0x7f166006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:47.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.986+0000 7f16577fe640 1 -- 172.21.15.81:0/4221082177 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880274222 0 0) 0x7f166006d9f0 con 0x7f1660161c80 2024-09-16T01:21:47.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.986+0000 7f16655f0640 1 -- 172.21.15.81:0/4221082177 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16600d01f0 con 0x7f16600b64b0 2024-09-16T01:21:47.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.987+0000 7f16655f0640 1 --2- 172.21.15.81:0/4221082177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16600b64b0 0x7f16600b6960 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f166008e830 tx=0x7f165802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fc1ff45f3bb261 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:47.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.987+0000 7f16577fe640 1 -- 172.21.15.81:0/4221082177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658007740 con 0x7f16600b64b0 2024-09-16T01:21:47.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.987+0000 7f16577fe640 1 -- 172.21.15.81:0/4221082177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16580078e0 con 0x7f16600b64b0 2024-09-16T01:21:47.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.987+0000 7f16577fe640 1 -- 172.21.15.81:0/4221082177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658007cb0 con 0x7f16600b64b0 2024-09-16T01:21:47.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.987+0000 7f1667053640 1 -- 172.21.15.81:0/4221082177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16600b64b0 msgr2=0x7f16600b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:47.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.987+0000 7f1667053640 1 --2- 172.21.15.81:0/4221082177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16600b64b0 0x7f16600b6960 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f166008e830 tx=0x7f165802a680 comp rx=0 tx=0).stop 2024-09-16T01:21:47.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.987+0000 7f1667053640 1 -- 172.21.15.81:0/4221082177 shutdown_connections 2024-09-16T01:21:47.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.987+0000 7f1667053640 1 --2- 172.21.15.81:0/4221082177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16600b64b0 0x7f16600b6960 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:47.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.987+0000 7f1667053640 1 --2- 172.21.15.81:0/4221082177 >> v2:172.21.15.102:3300/0 conn(0x7f1660162060 0x7f16600b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:47.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.987+0000 7f1667053640 1 -- 172.21.15.81:0/4221082177 >> 172.21.15.81:0/4221082177 conn(0x7f16600d44f0 msgr2=0x7f16600d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:47.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.987+0000 7f1667053640 1 -- 172.21.15.81:0/4221082177 shutdown_connections 2024-09-16T01:21:47.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.987+0000 7f1667053640 1 -- 172.21.15.81:0/4221082177 wait complete. 2024-09-16T01:21:47.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.989+0000 7f1667053640 1 Processor -- start 2024-09-16T01:21:47.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.989+0000 7f1667053640 1 -- start start 2024-09-16T01:21:47.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.989+0000 7f1667053640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16600b64b0 0x7f16600cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:47.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f1667053640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1660161c80 0x7f1660159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:47.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f1667053640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1660162060 0x7f16600b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:47.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f1667053640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16600cf1e0 con 0x7f1660162060 2024-09-16T01:21:47.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f1667053640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f16600d2aa0 con 0x7f16600b64b0 2024-09-16T01:21:47.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f1667053640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f16600cf360 con 0x7f1660161c80 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f16655f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1660162060 0x7f16600b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f16655f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1660162060 0x7f16600b7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34864/0 (socket says 172.21.15.81:34864) 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f16655f0640 1 -- 172.21.15.81:0/160116425 learned_addr learned my addr 172.21.15.81:0/160116425 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f1657fff640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1660161c80 0x7f1660159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f1664def640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16600b64b0 0x7f16600cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f16655f0640 1 -- 172.21.15.81:0/160116425 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1660161c80 msgr2=0x7f1660159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f16655f0640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1660161c80 0x7f1660159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f16655f0640 1 -- 172.21.15.81:0/160116425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16600b64b0 msgr2=0x7f16600cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f16655f0640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16600b64b0 0x7f16600cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f16655f0640 1 -- 172.21.15.81:0/160116425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16600cb5c0 con 0x7f1660162060 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f1664def640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16600b64b0 0x7f16600cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f16655f0640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1660162060 0x7f16600b7f60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f165802ac70 tx=0x7f1658004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:47.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f16557fa640 1 -- 172.21.15.81:0/160116425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658040070 con 0x7f1660162060 2024-09-16T01:21:47.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f16557fa640 1 -- 172.21.15.81:0/160116425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1658031c90 con 0x7f1660162060 2024-09-16T01:21:47.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f1667053640 1 -- 172.21.15.81:0/160116425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16600cb8a0 con 0x7f1660162060 2024-09-16T01:21:47.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f16557fa640 1 -- 172.21.15.81:0/160116425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1658045680 con 0x7f1660162060 2024-09-16T01:21:47.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.990+0000 7f1667053640 1 -- 172.21.15.81:0/160116425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16600cbe60 con 0x7f1660162060 2024-09-16T01:21:47.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.991+0000 7f1667053640 1 -- 172.21.15.81:0/160116425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16600b5f70 con 0x7f1660162060 2024-09-16T01:21:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.992+0000 7f16557fa640 1 -- 172.21.15.81:0/160116425 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1658039040 con 0x7f1660162060 2024-09-16T01:21:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.992+0000 7f16557fa640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f164c06c2b0 0x7f164c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.993+0000 7f16557fa640 1 -- 172.21.15.81:0/160116425 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f16580acf70 con 0x7f1660162060 2024-09-16T01:21:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.993+0000 7f1664def640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f164c06c2b0 0x7f164c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.993+0000 7f1664def640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f164c06c2b0 0x7f164c06e770 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f165c000f60 tx=0x7f165c007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:47.997+0000 7f16557fa640 1 -- 172.21.15.81:0/160116425 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f165807b7c0 con 0x7f1660162060 2024-09-16T01:21:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.175+0000 7f1667053640 1 -- 172.21.15.81:0/160116425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f16600ba470 con 0x7f1660162060 2024-09-16T01:21:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.175+0000 7f16557fa640 1 -- 172.21.15.81:0/160116425 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v101) ==== 80+0+0 (secure 0 0 0) 0x7f165807b0c0 con 0x7f1660162060 2024-09-16T01:21:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:21:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.177+0000 7f1667053640 1 -- 172.21.15.81:0/160116425 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f164c06c2b0 msgr2=0x7f164c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.177+0000 7f1667053640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f164c06c2b0 0x7f164c06e770 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f165c000f60 tx=0x7f165c007c10 comp rx=0 tx=0).stop 2024-09-16T01:21:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.177+0000 7f1667053640 1 -- 172.21.15.81:0/160116425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1660162060 msgr2=0x7f16600b7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.177+0000 7f1667053640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1660162060 0x7f16600b7f60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f165802ac70 tx=0x7f1658004a40 comp rx=0 tx=0).stop 2024-09-16T01:21:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.177+0000 7f1667053640 1 -- 172.21.15.81:0/160116425 shutdown_connections 2024-09-16T01:21:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.178+0000 7f1667053640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f164c06c2b0 0x7f164c06e770 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.178+0000 7f1667053640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1660162060 0x7f16600b7f60 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.178+0000 7f1667053640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1660161c80 0x7f1660159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.178+0000 7f1667053640 1 --2- 172.21.15.81:0/160116425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16600b64b0 0x7f16600cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.178+0000 7f1667053640 1 -- 172.21.15.81:0/160116425 >> 172.21.15.81:0/160116425 conn(0x7f16600d44f0 msgr2=0x7f16600746d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.178+0000 7f1667053640 1 -- 172.21.15.81:0/160116425 shutdown_connections 2024-09-16T01:21:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.178+0000 7f1667053640 1 -- 172.21.15.81:0/160116425 wait complete. 2024-09-16T01:21:48.190 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:21:48.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:48.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:21:48.218 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:21:48.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:48.218 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:21:48.274 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:21:48.274 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:21:48.275 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:48.292 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:21:48.292 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:48.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:21:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.448+0000 7fdc92dc6640 1 Processor -- start 2024-09-16T01:21:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.448+0000 7fdc92dc6640 1 -- start start 2024-09-16T01:21:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.449+0000 7fdc92dc6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdc8c0d30f0 0x7fdc8c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.449+0000 7fdc92dc6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8c0d3690 con 0x7fdc8c15e5f0 2024-09-16T01:21:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.449+0000 7fdc92dc6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8c0d3970 con 0x7fdc8c0b64c0 2024-09-16T01:21:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.449+0000 7fdc92dc6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fdc8c06d530 con 0x7fdc8c0d30f0 2024-09-16T01:21:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.449+0000 7fdc90b62640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdc8c15e5f0 0x7fdc8c0d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49154/0 (socket says 172.21.15.81:49154) 2024-09-16T01:21:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.449+0000 7fdc90b62640 1 -- 172.21.15.81:0/2381801572 learned_addr learned my addr 172.21.15.81:0/2381801572 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8bfff640 1 --2- 172.21.15.81:0/2381801572 >> v2:172.21.15.102:3300/0 conn(0x7fdc8c0d30f0 0x7fdc8c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180178227 0 0) 0x7fdc8c0d3690 con 0x7fdc8c15e5f0 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc74003520 con 0x7fdc8c15e5f0 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 430590107 0 0) 0x7fdc74003520 con 0x7fdc8c15e5f0 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 >> v2:172.21.15.102:3300/0 conn(0x7fdc8c0d30f0 msgr2=0x7fdc8c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 --2- 172.21.15.81:0/2381801572 >> v2:172.21.15.102:3300/0 conn(0x7fdc8c0d30f0 0x7fdc8c0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 >> v1:172.21.15.102:6789/0 conn(0x7fdc8c0b64c0 legacy=0x7fdc8c06d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c06cee0 con 0x7fdc8c15e5f0 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fdc7c001670 con 0x7fdc8c15e5f0 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8bfff640 1 --2- 172.21.15.81:0/2381801572 >> v2:172.21.15.102:3300/0 conn(0x7fdc8c0d30f0 0x7fdc8c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 >> v1:172.21.15.81:6789/0 conn(0x7fdc8c15e5f0 legacy=0x7fdc8c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 --2- 172.21.15.81:0/2381801572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc740039b0 0x7fdc74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 --2- 172.21.15.81:0/2381801572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc74004800 0x7fdc74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 --2- 172.21.15.81:0/2381801572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 0x7fdc7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c06d530 con 0x7fdc740051c0 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7400c060 con 0x7fdc740039b0 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7400c260 con 0x7fdc74004800 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc91363640 1 --2- 172.21.15.81:0/2381801572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 0x7fdc7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc90b62640 1 --2- 172.21.15.81:0/2381801572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc740039b0 0x7fdc74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc8bfff640 1 --2- 172.21.15.81:0/2381801572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc74004800 0x7fdc74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc91363640 1 -- 172.21.15.81:0/2381801572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc74004800 msgr2=0x7fdc74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc91363640 1 --2- 172.21.15.81:0/2381801572 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc74004800 0x7fdc74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc91363640 1 -- 172.21.15.81:0/2381801572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc740039b0 msgr2=0x7fdc74003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc91363640 1 --2- 172.21.15.81:0/2381801572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc740039b0 0x7fdc74003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.450+0000 7fdc91363640 1 -- 172.21.15.81:0/2381801572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc74003520 con 0x7fdc740051c0 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.451+0000 7fdc91363640 1 -- 172.21.15.81:0/2381801572 reap_dead start 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.451+0000 7fdc91363640 1 --2- 172.21.15.81:0/2381801572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 0x7fdc7400b9c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fdc84001750 tx=0x7fdc74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df49bebd48143c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:48.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.451+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84001370 con 0x7fdc740051c0 2024-09-16T01:21:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.451+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc84005310 con 0x7fdc740051c0 2024-09-16T01:21:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.451+0000 7fdc8b7fe640 1 -- 172.21.15.81:0/2381801572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8402abe0 con 0x7fdc740051c0 2024-09-16T01:21:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.452+0000 7fdc92dc6640 1 -- 172.21.15.81:0/2381801572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 msgr2=0x7fdc7400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.452+0000 7fdc92dc6640 1 --2- 172.21.15.81:0/2381801572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 0x7fdc7400b9c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fdc84001750 tx=0x7fdc74005830 comp rx=0 tx=0).stop 2024-09-16T01:21:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.452+0000 7fdc92dc6640 1 -- 172.21.15.81:0/2381801572 shutdown_connections 2024-09-16T01:21:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.452+0000 7fdc92dc6640 1 --2- 172.21.15.81:0/2381801572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 0x7fdc7400b9c0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.452+0000 7fdc92dc6640 1 -- 172.21.15.81:0/2381801572 >> 172.21.15.81:0/2381801572 conn(0x7fdc8c08bfc0 msgr2=0x7fdc8c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.452+0000 7fdc92dc6640 1 -- 172.21.15.81:0/2381801572 shutdown_connections 2024-09-16T01:21:48.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.452+0000 7fdc92dc6640 1 -- 172.21.15.81:0/2381801572 wait complete. 2024-09-16T01:21:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.453+0000 7fdc92dc6640 1 Processor -- start 2024-09-16T01:21:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.453+0000 7fdc92dc6640 1 -- start start 2024-09-16T01:21:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc92dc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 0x7fdc8c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc92dc6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c09ec60 0x7fdc8c0a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc92dc6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c0b3f60 0x7fdc8c0b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc92dc6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c0b5f80 con 0x7fdc740051c0 2024-09-16T01:21:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc92dc6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c15e9d0 con 0x7fdc8c0b3f60 2024-09-16T01:21:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc92dc6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdc8c0b6100 con 0x7fdc8c09ec60 2024-09-16T01:21:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc90b62640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 0x7fdc8c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc90b62640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 0x7fdc8c15d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34874/0 (socket says 172.21.15.81:34874) 2024-09-16T01:21:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc90b62640 1 -- 172.21.15.81:0/3515907741 learned_addr learned my addr 172.21.15.81:0/3515907741 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc8bfff640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c09ec60 0x7fdc8c0a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc91363640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c0b3f60 0x7fdc8c0b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc90b62640 1 -- 172.21.15.81:0/3515907741 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c09ec60 msgr2=0x7fdc8c0a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc90b62640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c09ec60 0x7fdc8c0a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc90b62640 1 -- 172.21.15.81:0/3515907741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c0b3f60 msgr2=0x7fdc8c0b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc90b62640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c0b3f60 0x7fdc8c0b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc90b62640 1 -- 172.21.15.81:0/3515907741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c0a1b40 con 0x7fdc740051c0 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc8bfff640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c09ec60 0x7fdc8c0a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc91363640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c0b3f60 0x7fdc8c0b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.454+0000 7fdc90b62640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 0x7fdc8c15d870 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c007290 tx=0x7fdc7c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.455+0000 7fdc897fa640 1 -- 172.21.15.81:0/3515907741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c00f960 con 0x7fdc740051c0 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.455+0000 7fdc897fa640 1 -- 172.21.15.81:0/3515907741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc7c018070 con 0x7fdc740051c0 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.455+0000 7fdc92dc6640 1 -- 172.21.15.81:0/3515907741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8c0c8f70 con 0x7fdc740051c0 2024-09-16T01:21:48.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.455+0000 7fdc897fa640 1 -- 172.21.15.81:0/3515907741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c00fd40 con 0x7fdc740051c0 2024-09-16T01:21:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.455+0000 7fdc92dc6640 1 -- 172.21.15.81:0/3515907741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc8c0a1780 con 0x7fdc740051c0 2024-09-16T01:21:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.456+0000 7fdc92dc6640 1 -- 172.21.15.81:0/3515907741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc8c0d4dd0 con 0x7fdc740051c0 2024-09-16T01:21:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.456+0000 7fdc897fa640 1 -- 172.21.15.81:0/3515907741 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdc7c01d460 con 0x7fdc740051c0 2024-09-16T01:21:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.457+0000 7fdc897fa640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc7806c2e0 0x7fdc7806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.457+0000 7fdc897fa640 1 -- 172.21.15.81:0/3515907741 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fdc7c08b600 con 0x7fdc740051c0 2024-09-16T01:21:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.457+0000 7fdc8bfff640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc7806c2e0 0x7fdc7806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.457+0000 7fdc8bfff640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc7806c2e0 0x7fdc7806e7a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c09eab0 tx=0x7fdc8000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:48.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.461+0000 7fdc897fa640 1 -- 172.21.15.81:0/3515907741 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc7c059be0 con 0x7fdc740051c0 2024-09-16T01:21:48.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.637+0000 7fdc92dc6640 1 -- 172.21.15.81:0/3515907741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdc8c06bda0 con 0x7fdc740051c0 2024-09-16T01:21:48.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.638+0000 7fdc897fa640 1 -- 172.21.15.81:0/3515907741 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v101) ==== 80+0+0 (secure 0 0 0) 0x7fdc7c0594e0 con 0x7fdc740051c0 2024-09-16T01:21:48.640 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:21:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.640+0000 7fdc92dc6640 1 -- 172.21.15.81:0/3515907741 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc7806c2e0 msgr2=0x7fdc7806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.640+0000 7fdc92dc6640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc7806c2e0 0x7fdc7806e7a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c09eab0 tx=0x7fdc8000b040 comp rx=0 tx=0).stop 2024-09-16T01:21:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.640+0000 7fdc92dc6640 1 -- 172.21.15.81:0/3515907741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 msgr2=0x7fdc8c15d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.640+0000 7fdc92dc6640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 0x7fdc8c15d870 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c007290 tx=0x7fdc7c007750 comp rx=0 tx=0).stop 2024-09-16T01:21:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.640+0000 7fdc92dc6640 1 -- 172.21.15.81:0/3515907741 shutdown_connections 2024-09-16T01:21:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.640+0000 7fdc92dc6640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc7806c2e0 0x7fdc7806e7a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.640+0000 7fdc92dc6640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c0b3f60 0x7fdc8c0b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.640+0000 7fdc92dc6640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c09ec60 0x7fdc8c0a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.640+0000 7fdc92dc6640 1 --2- 172.21.15.81:0/3515907741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc740051c0 0x7fdc8c15d870 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.640+0000 7fdc92dc6640 1 -- 172.21.15.81:0/3515907741 >> 172.21.15.81:0/3515907741 conn(0x7fdc8c08bfc0 msgr2=0x7fdc8c0b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.640+0000 7fdc92dc6640 1 -- 172.21.15.81:0/3515907741 shutdown_connections 2024-09-16T01:21:48.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.640+0000 7fdc92dc6640 1 -- 172.21.15.81:0/3515907741 wait complete. 2024-09-16T01:21:48.652 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:21:48.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:48.653 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T01:21:48.685 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:21:48.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:21:48.686 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:21:48.744 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:21:48.745 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:21:48.745 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:48.760 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:21:48.761 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:21:48.761 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:21:48.761 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:48.803 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:21:48.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:21:48.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.899+0000 7fe7b37a6640 1 Processor -- start 2024-09-16T01:21:48.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.899+0000 7fe7b37a6640 1 -- start start 2024-09-16T01:21:48.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.900+0000 7fe7b37a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7ac0b69d0 0x7fe7ac162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.900+0000 7fe7b37a6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7ac0b0180 0x7fe7ac154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.900+0000 7fe7b37a6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7ac15eb60 con 0x7fe7ac0af280 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.900+0000 7fe7b37a6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ac0b6db0 con 0x7fe7ac0b0180 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.900+0000 7fe7b37a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac15ee40 con 0x7fe7ac0b69d0 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.900+0000 7fe7b1d43640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7ac0b0180 0x7fe7ac154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.900+0000 7fe7b0d41640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe7ac0af280 0x7fe7ac0afa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49162/0 (socket says 172.21.15.81:49162) 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.900+0000 7fe7b0d41640 1 -- 172.21.15.81:0/1033183379 learned_addr learned my addr 172.21.15.81:0/1033183379 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.900+0000 7fe7b1d43640 1 --2- 172.21.15.81:0/1033183379 >> v2:172.21.15.81:3300/0 conn(0x7fe7ac0b0180 0x7fe7ac154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34890/0 (socket says 172.21.15.81:34890) 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.901+0000 7fe7b1542640 1 --2- 172.21.15.81:0/1033183379 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7ac0b69d0 0x7fe7ac162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.901+0000 7fe7b1d43640 1 -- 172.21.15.81:0/1033183379 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7ac0b69d0 msgr2=0x7fe7ac162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.901+0000 7fe7b1d43640 1 --2- 172.21.15.81:0/1033183379 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7ac0b69d0 0x7fe7ac162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.901+0000 7fe7a3fff640 1 -- 172.21.15.81:0/1033183379 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3032443777 0 0) 0x7fe7ac15eb60 con 0x7fe7ac0af280 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.901+0000 7fe7b1d43640 1 -- 172.21.15.81:0/1033183379 >> v1:172.21.15.81:6789/0 conn(0x7fe7ac0af280 legacy=0x7fe7ac0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.901+0000 7fe7b1d43640 1 -- 172.21.15.81:0/1033183379 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac15f120 con 0x7fe7ac0b0180 2024-09-16T01:21:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.901+0000 7fe7b1d43640 1 --2- 172.21.15.81:0/1033183379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac0b0180 0x7fe7ac154d00 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009dc0 tx=0x7fe7a402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9205fca3c60554bc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.901+0000 7fe7a3fff640 1 -- 172.21.15.81:0/1033183379 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4007740 con 0x7fe7ac0b0180 2024-09-16T01:21:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.901+0000 7fe7a3fff640 1 -- 172.21.15.81:0/1033183379 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a40078e0 con 0x7fe7ac0b0180 2024-09-16T01:21:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.901+0000 7fe7a3fff640 1 -- 172.21.15.81:0/1033183379 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4007cb0 con 0x7fe7ac0b0180 2024-09-16T01:21:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.902+0000 7fe7b37a6640 1 -- 172.21.15.81:0/1033183379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac0b0180 msgr2=0x7fe7ac154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.902+0000 7fe7b37a6640 1 --2- 172.21.15.81:0/1033183379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac0b0180 0x7fe7ac154d00 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009dc0 tx=0x7fe7a402a560 comp rx=0 tx=0).stop 2024-09-16T01:21:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.902+0000 7fe7b37a6640 1 -- 172.21.15.81:0/1033183379 shutdown_connections 2024-09-16T01:21:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.902+0000 7fe7b37a6640 1 --2- 172.21.15.81:0/1033183379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac0b0180 0x7fe7ac154d00 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.902+0000 7fe7b37a6640 1 --2- 172.21.15.81:0/1033183379 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7ac0b69d0 0x7fe7ac162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.902+0000 7fe7b37a6640 1 -- 172.21.15.81:0/1033183379 >> 172.21.15.81:0/1033183379 conn(0x7fe7ac06bc10 msgr2=0x7fe7ac06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.902+0000 7fe7b37a6640 1 -- 172.21.15.81:0/1033183379 shutdown_connections 2024-09-16T01:21:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.902+0000 7fe7b37a6640 1 -- 172.21.15.81:0/1033183379 wait complete. 2024-09-16T01:21:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.903+0000 7fe7b37a6640 1 Processor -- start 2024-09-16T01:21:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.903+0000 7fe7b37a6640 1 -- start start 2024-09-16T01:21:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b37a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7ac0af280 0x7fe7ac14ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b37a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac0b0180 0x7fe7ac150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b37a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7ac0b69d0 0x7fe7ac0b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b37a6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac155240 con 0x7fe7ac0b0180 2024-09-16T01:21:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b37a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac0af6e0 con 0x7fe7ac0af280 2024-09-16T01:21:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b37a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac1553c0 con 0x7fe7ac0b69d0 2024-09-16T01:21:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b0d41640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac0b0180 0x7fe7ac150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b0d41640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac0b0180 0x7fe7ac150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34892/0 (socket says 172.21.15.81:34892) 2024-09-16T01:21:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b0d41640 1 -- 172.21.15.81:0/997801409 learned_addr learned my addr 172.21.15.81:0/997801409 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b1d43640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7ac0b69d0 0x7fe7ac0b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b1542640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7ac0af280 0x7fe7ac14ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b0d41640 1 -- 172.21.15.81:0/997801409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7ac0b69d0 msgr2=0x7fe7ac0b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b0d41640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7ac0b69d0 0x7fe7ac0b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b0d41640 1 -- 172.21.15.81:0/997801409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7ac0af280 msgr2=0x7fe7ac14ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b0d41640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7ac0af280 0x7fe7ac14ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.904+0000 7fe7b0d41640 1 -- 172.21.15.81:0/997801409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac0cf230 con 0x7fe7ac0b0180 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.905+0000 7fe7b0d41640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac0b0180 0x7fe7ac150150 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c4e0 tx=0x7fe79c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.905+0000 7fe7a1ffb640 1 -- 172.21.15.81:0/997801409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c018070 con 0x7fe7ac0b0180 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.905+0000 7fe7a1ffb640 1 -- 172.21.15.81:0/997801409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe79c007500 con 0x7fe7ac0b0180 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.905+0000 7fe7b37a6640 1 -- 172.21.15.81:0/997801409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac0cf510 con 0x7fe7ac0b0180 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.905+0000 7fe7a1ffb640 1 -- 172.21.15.81:0/997801409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c004a20 con 0x7fe7ac0b0180 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.905+0000 7fe7b37a6640 1 -- 172.21.15.81:0/997801409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac0cfad0 con 0x7fe7ac0b0180 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.906+0000 7fe7b37a6640 1 -- 172.21.15.81:0/997801409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ac0affa0 con 0x7fe7ac0b0180 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.906+0000 7fe7a1ffb640 1 -- 172.21.15.81:0/997801409 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe79c01b070 con 0x7fe7ac0b0180 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.907+0000 7fe7a1ffb640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe79006c2b0 0x7fe79006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.907+0000 7fe7a1ffb640 1 -- 172.21.15.81:0/997801409 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fe79c08a9f0 con 0x7fe7ac0b0180 2024-09-16T01:21:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.907+0000 7fe7b1542640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe79006c2b0 0x7fe79006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.907+0000 7fe7b1542640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe79006c2b0 0x7fe79006e770 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8006fd0 tx=0x7fe7a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:48.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:48.912+0000 7fe7a1ffb640 1 -- 172.21.15.81:0/997801409 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7ac0affa0 con 0x7fe7ac0b0180 2024-09-16T01:21:49.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.116+0000 7fe7b37a6640 1 -- 172.21.15.81:0/997801409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7ac155780 con 0x7fe7ac0b0180 2024-09-16T01:21:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.117+0000 7fe7a1ffb640 1 -- 172.21.15.81:0/997801409 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5231 (secure 0 0 0) 0x7fe79c08a020 con 0x7fe7ac0b0180 2024-09-16T01:21:49.119 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:49.119 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"btime":"2024-09-16T01:21:42:921033+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3103388370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3103388370},{"type":"v1","addr":"172.21.15.102:6834","nonce":3103388370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":5750,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1937467713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1937467713},{"type":"v1","addr":"172.21.15.102:6835","nonce":1937467713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1728333369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1728333369},{"type":"v1","addr":"172.21.15.81:6836","nonce":1728333369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:21:40.253611+0000","modified":"2024-09-16T01:21:42.245713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6945":{"gid":6945,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2688004165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2688004165},{"type":"v1","addr":"172.21.15.81:6837","nonce":2688004165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6945,"qdb_cluster":[6945]},"id":7}]} 2024-09-16T01:21:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2024-09-16T01:21:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.119+0000 7fe7b37a6640 1 -- 172.21.15.81:0/997801409 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe79006c2b0 msgr2=0x7fe79006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.119+0000 7fe7b37a6640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe79006c2b0 0x7fe79006e770 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8006fd0 tx=0x7fe7a8008040 comp rx=0 tx=0).stop 2024-09-16T01:21:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.119+0000 7fe7b37a6640 1 -- 172.21.15.81:0/997801409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac0b0180 msgr2=0x7fe7ac150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.119+0000 7fe7b37a6640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac0b0180 0x7fe7ac150150 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00c4e0 tx=0x7fe79c00c9a0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.119+0000 7fe7b37a6640 1 -- 172.21.15.81:0/997801409 shutdown_connections 2024-09-16T01:21:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.119+0000 7fe7b37a6640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe79006c2b0 0x7fe79006e770 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.119+0000 7fe7b37a6640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe7ac0b69d0 0x7fe7ac0b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.119+0000 7fe7b37a6640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7ac0b0180 0x7fe7ac150150 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.119+0000 7fe7b37a6640 1 --2- 172.21.15.81:0/997801409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7ac0af280 0x7fe7ac14ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.119+0000 7fe7b37a6640 1 -- 172.21.15.81:0/997801409 >> 172.21.15.81:0/997801409 conn(0x7fe7ac06bc10 msgr2=0x7fe7ac153420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.119+0000 7fe7b37a6640 1 -- 172.21.15.81:0/997801409 shutdown_connections 2024-09-16T01:21:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.119+0000 7fe7b37a6640 1 -- 172.21.15.81:0/997801409 wait complete. 2024-09-16T01:21:49.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:21:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.228+0000 7f3889f2a640 1 Processor -- start 2024-09-16T01:21:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.228+0000 7f3889f2a640 1 -- start start 2024-09-16T01:21:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.229+0000 7f3889f2a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f388415e740 0x7f38840d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.229+0000 7f3889f2a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f388409b690 0x7f388406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.229+0000 7f3889f2a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38840d0780 con 0x7f388406d4c0 2024-09-16T01:21:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.229+0000 7f3889f2a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f388415eb20 con 0x7f388415e740 2024-09-16T01:21:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.229+0000 7f3889f2a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f388406d260 con 0x7f388409b690 2024-09-16T01:21:49.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.229+0000 7f38837fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f388415e740 0x7f38840d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.229+0000 7f3883fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f388406d4c0 0x7f388406d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49170/0 (socket says 172.21.15.81:49170) 2024-09-16T01:21:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.229+0000 7f3883fff640 1 -- 172.21.15.81:0/2458670062 learned_addr learned my addr 172.21.15.81:0/2458670062 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.229+0000 7f38837fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f388415e740 0x7f38840d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34902/0 (socket says 172.21.15.81:34902) 2024-09-16T01:21:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.229+0000 7f38837fe640 1 -- 172.21.15.81:0/2458670062 >> v2:172.21.15.102:3300/0 conn(0x7f388409b690 msgr2=0x7f388406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.229+0000 7f3882ffd640 1 --2- 172.21.15.81:0/2458670062 >> v2:172.21.15.102:3300/0 conn(0x7f388409b690 0x7f388406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.229+0000 7f38827fc640 1 -- 172.21.15.81:0/2458670062 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1804956158 0 0) 0x7f38840d0780 con 0x7f388406d4c0 2024-09-16T01:21:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.230+0000 7f38837fe640 1 --2- 172.21.15.81:0/2458670062 >> v2:172.21.15.102:3300/0 conn(0x7f388409b690 0x7f388406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.230+0000 7f38837fe640 1 -- 172.21.15.81:0/2458670062 >> v1:172.21.15.81:6789/0 conn(0x7f388406d4c0 legacy=0x7f388406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.230+0000 7f38837fe640 1 -- 172.21.15.81:0/2458670062 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38840d0a60 con 0x7f388415e740 2024-09-16T01:21:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.230+0000 7f3882ffd640 1 --2- 172.21.15.81:0/2458670062 >> v2:172.21.15.102:3300/0 conn(0x7f388409b690 0x7f388406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.230+0000 7f38837fe640 1 --2- 172.21.15.81:0/2458670062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388415e740 0x7f38840d1540 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f38840691b0 tx=0x7f387402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2fc62e643e821 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:49.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.230+0000 7f38827fc640 1 -- 172.21.15.81:0/2458670062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3874007740 con 0x7f388415e740 2024-09-16T01:21:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.230+0000 7f38827fc640 1 -- 172.21.15.81:0/2458670062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38740078e0 con 0x7f388415e740 2024-09-16T01:21:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.230+0000 7f38827fc640 1 -- 172.21.15.81:0/2458670062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3874007cb0 con 0x7f388415e740 2024-09-16T01:21:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.231+0000 7f3889f2a640 1 -- 172.21.15.81:0/2458670062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388415e740 msgr2=0x7f38840d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.231+0000 7f3889f2a640 1 --2- 172.21.15.81:0/2458670062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388415e740 0x7f38840d1540 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f38840691b0 tx=0x7f387402a710 comp rx=0 tx=0).stop 2024-09-16T01:21:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.231+0000 7f3889f2a640 1 -- 172.21.15.81:0/2458670062 shutdown_connections 2024-09-16T01:21:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.231+0000 7f3889f2a640 1 --2- 172.21.15.81:0/2458670062 >> v2:172.21.15.102:3300/0 conn(0x7f388409b690 0x7f388406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.231+0000 7f3889f2a640 1 --2- 172.21.15.81:0/2458670062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388415e740 0x7f38840d1540 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.231+0000 7f3889f2a640 1 -- 172.21.15.81:0/2458670062 >> 172.21.15.81:0/2458670062 conn(0x7f38840d23a0 msgr2=0x7f38840d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.231+0000 7f3889f2a640 1 -- 172.21.15.81:0/2458670062 shutdown_connections 2024-09-16T01:21:49.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.231+0000 7f3889f2a640 1 -- 172.21.15.81:0/2458670062 wait complete. 2024-09-16T01:21:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.232+0000 7f3889f2a640 1 Processor -- start 2024-09-16T01:21:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.232+0000 7f3889f2a640 1 -- start start 2024-09-16T01:21:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3889f2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388406d4c0 0x7f3884157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3889f2a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f388409b690 0x7f38840b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3889f2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388415e740 0x7f38840b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3889f2a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f388409bac0 con 0x7f388415e740 2024-09-16T01:21:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3889f2a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f38840d1020 con 0x7f388406d4c0 2024-09-16T01:21:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3889f2a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f388406dfe0 con 0x7f388409b690 2024-09-16T01:21:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3883fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388415e740 0x7f38840b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3883fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388415e740 0x7f38840b6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34906/0 (socket says 172.21.15.81:34906) 2024-09-16T01:21:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3883fff640 1 -- 172.21.15.81:0/122693852 learned_addr learned my addr 172.21.15.81:0/122693852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f38837fe640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388406d4c0 0x7f3884157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3882ffd640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f388409b690 0x7f38840b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3883fff640 1 -- 172.21.15.81:0/122693852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f388409b690 msgr2=0x7f38840b6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3883fff640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f388409b690 0x7f38840b6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3883fff640 1 -- 172.21.15.81:0/122693852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388406d4c0 msgr2=0x7f3884157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3883fff640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388406d4c0 0x7f3884157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3883fff640 1 -- 172.21.15.81:0/122693852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38841f5260 con 0x7f388415e740 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f3882ffd640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f388409b690 0x7f38840b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.233+0000 7f38837fe640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388406d4c0 0x7f3884157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.234+0000 7f3883fff640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388415e740 0x7f38840b6cb0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f387c00c410 tx=0x7f387c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.234+0000 7f386bfff640 1 -- 172.21.15.81:0/122693852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c0074e0 con 0x7f388415e740 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.234+0000 7f386bfff640 1 -- 172.21.15.81:0/122693852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c0047e0 con 0x7f388415e740 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.234+0000 7f3889f2a640 1 -- 172.21.15.81:0/122693852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38841e8040 con 0x7f388415e740 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.234+0000 7f386bfff640 1 -- 172.21.15.81:0/122693852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c004bd0 con 0x7f388415e740 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.234+0000 7f3889f2a640 1 -- 172.21.15.81:0/122693852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38841e8600 con 0x7f388415e740 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.235+0000 7f3889f2a640 1 -- 172.21.15.81:0/122693852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38840d0780 con 0x7f388415e740 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.235+0000 7f386bfff640 1 -- 172.21.15.81:0/122693852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f387c011070 con 0x7f388415e740 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.236+0000 7f386bfff640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f387006c2b0 0x7f387006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.236+0000 7f38837fe640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f387006c2b0 0x7f387006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.236+0000 7f386bfff640 1 -- 172.21.15.81:0/122693852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f387c08b160 con 0x7f388415e740 2024-09-16T01:21:49.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.236+0000 7f38837fe640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f387006c2b0 0x7f387006e770 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3874034000 tx=0x7f387402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:49.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.241+0000 7f386bfff640 1 -- 172.21.15.81:0/122693852 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f387c059770 con 0x7f388415e740 2024-09-16T01:21:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.439+0000 7f3889f2a640 1 -- 172.21.15.81:0/122693852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38840d1cb0 con 0x7f388415e740 2024-09-16T01:21:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.439+0000 7f386bfff640 1 -- 172.21.15.81:0/122693852 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5231 (secure 0 0 0) 0x7f387c059070 con 0x7f388415e740 2024-09-16T01:21:49.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:49.441 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"btime":"2024-09-16T01:21:42:921033+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3103388370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3103388370},{"type":"v1","addr":"172.21.15.102:6834","nonce":3103388370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":5750,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1937467713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1937467713},{"type":"v1","addr":"172.21.15.102:6835","nonce":1937467713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1728333369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1728333369},{"type":"v1","addr":"172.21.15.81:6836","nonce":1728333369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:21:40.253611+0000","modified":"2024-09-16T01:21:42.245713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6945":{"gid":6945,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2688004165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2688004165},{"type":"v1","addr":"172.21.15.81:6837","nonce":2688004165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6945,"qdb_cluster":[6945]},"id":7}]} 2024-09-16T01:21:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2024-09-16T01:21:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.442+0000 7f3889f2a640 1 -- 172.21.15.81:0/122693852 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f387006c2b0 msgr2=0x7f387006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.442+0000 7f3889f2a640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f387006c2b0 0x7f387006e770 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3874034000 tx=0x7f387402f000 comp rx=0 tx=0).stop 2024-09-16T01:21:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.442+0000 7f3889f2a640 1 -- 172.21.15.81:0/122693852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388415e740 msgr2=0x7f38840b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.442+0000 7f3889f2a640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388415e740 0x7f38840b6cb0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f387c00c410 tx=0x7f387c00c8d0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.442+0000 7f3889f2a640 1 -- 172.21.15.81:0/122693852 shutdown_connections 2024-09-16T01:21:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.442+0000 7f3889f2a640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f387006c2b0 0x7f387006e770 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.442+0000 7f3889f2a640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f388415e740 0x7f38840b6cb0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.442+0000 7f3889f2a640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f388409b690 0x7f38840b6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.442+0000 7f3889f2a640 1 --2- 172.21.15.81:0/122693852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f388406d4c0 0x7f3884157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.442+0000 7f3889f2a640 1 -- 172.21.15.81:0/122693852 >> 172.21.15.81:0/122693852 conn(0x7f38840d23a0 msgr2=0x7f38840b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.442+0000 7f3889f2a640 1 -- 172.21.15.81:0/122693852 shutdown_connections 2024-09-16T01:21:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.442+0000 7f3889f2a640 1 -- 172.21.15.81:0/122693852 wait complete. 2024-09-16T01:21:49.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:21:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.551+0000 7f6ac3835640 1 Processor -- start 2024-09-16T01:21:49.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.551+0000 7f6ac3835640 1 -- start start 2024-09-16T01:21:49.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ac3835640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc06f8d0 0x7f6abc165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ac3835640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc0cdbe0 con 0x7f6abc072d30 2024-09-16T01:21:49.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ac3835640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc0cd900 con 0x7f6abc15b300 2024-09-16T01:21:49.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ac3835640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6abc0728a0 con 0x7f6abc06f8d0 2024-09-16T01:21:49.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ac0dd0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6abc072d30 0x7f6abc06f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49186/0 (socket says 172.21.15.81:49186) 2024-09-16T01:21:49.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ac0dd0640 1 -- 172.21.15.81:0/3141755886 learned_addr learned my addr 172.21.15.81:0/3141755886 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:49.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ac1dd2640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc06f8d0 0x7f6abc165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4166918499 0 0) 0x7f6abc0cdbe0 con 0x7f6abc072d30 2024-09-16T01:21:49.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa8003520 con 0x7f6abc072d30 2024-09-16T01:21:49.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000852720 0 0) 0x7f6abc0cd900 con 0x7f6abc15b300 2024-09-16T01:21:49.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6abc0cdbe0 con 0x7f6abc15b300 2024-09-16T01:21:49.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3461887989 0 0) 0x7f6aa8003520 con 0x7f6abc072d30 2024-09-16T01:21:49.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc06f8d0 msgr2=0x7f6abc165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:49.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ab3fff640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc06f8d0 0x7f6abc165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 >> v1:172.21.15.102:6789/0 conn(0x7f6abc15b300 legacy=0x7f6abc0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc072250 con 0x7f6abc072d30 2024-09-16T01:21:49.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.552+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f6aac001670 con 0x7f6abc072d30 2024-09-16T01:21:49.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 >> v1:172.21.15.81:6789/0 conn(0x7f6abc072d30 legacy=0x7f6abc06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ab3fff640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6aa8003b70 0x7f6aa8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ab3fff640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aa8004800 0x7f6aa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ab3fff640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc06f8d0 0x7f6aa80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0728a0 con 0x7f6aa8004800 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa800bb00 con 0x7f6aa8003b70 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6aa800bd00 con 0x7f6abc06f8d0 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ac0dd0640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aa8004800 0x7f6aa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ac15d1640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6aa8003b70 0x7f6aa8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ac1dd2640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc06f8d0 0x7f6aa80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ac0dd0640 1 -- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc06f8d0 msgr2=0x7f6aa80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ac0dd0640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc06f8d0 0x7f6aa80051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ac0dd0640 1 -- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6aa8003b70 msgr2=0x7f6aa8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ac0dd0640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6aa8003b70 0x7f6aa8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ac0dd0640 1 -- 172.21.15.81:0/3141755886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa8003520 con 0x7f6aa8004800 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ac15d1640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6aa8003b70 0x7f6aa8003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.553+0000 7f6ac1dd2640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc06f8d0 0x7f6aa80051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:49.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.554+0000 7f6ac0dd0640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aa8004800 0x7f6aa8004c80 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6aac007c80 tx=0x7f6aa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcca8b4e38020bc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:49.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.554+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac035070 con 0x7f6aa8004800 2024-09-16T01:21:49.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.554+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aac005af0 con 0x7f6aa8004800 2024-09-16T01:21:49.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.554+0000 7f6ab3fff640 1 -- 172.21.15.81:0/3141755886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac007cc0 con 0x7f6aa8004800 2024-09-16T01:21:49.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.554+0000 7f6ac3835640 1 -- 172.21.15.81:0/3141755886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aa8004800 msgr2=0x7f6aa8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.554+0000 7f6ac3835640 1 --2- 172.21.15.81:0/3141755886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aa8004800 0x7f6aa8004c80 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6aac007c80 tx=0x7f6aa8005830 comp rx=0 tx=0).stop 2024-09-16T01:21:49.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.554+0000 7f6ac1dd2640 1 -- 172.21.15.81:0/3141755886 reap_dead start 2024-09-16T01:21:49.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.554+0000 7f6ac3835640 1 -- 172.21.15.81:0/3141755886 shutdown_connections 2024-09-16T01:21:49.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.554+0000 7f6ac3835640 1 -- 172.21.15.81:0/3141755886 >> 172.21.15.81:0/3141755886 conn(0x7f6abc067d70 msgr2=0x7f6abc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:49.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.554+0000 7f6ac3835640 1 -- 172.21.15.81:0/3141755886 shutdown_connections 2024-09-16T01:21:49.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.554+0000 7f6ac3835640 1 -- 172.21.15.81:0/3141755886 wait complete. 2024-09-16T01:21:49.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.556+0000 7f6ac3835640 1 Processor -- start 2024-09-16T01:21:49.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.556+0000 7f6ac3835640 1 -- start start 2024-09-16T01:21:49.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.556+0000 7f6ac3835640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6aa8004800 0x7f6abc0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.556+0000 7f6ac3835640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc153c00 0x7f6abc14e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.556+0000 7f6ac3835640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc155a70 0x7f6abc155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.556+0000 7f6ac3835640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0cffe0 con 0x7f6abc155a70 2024-09-16T01:21:49.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.556+0000 7f6ac3835640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc0cd5c0 con 0x7f6aa8004800 2024-09-16T01:21:49.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.556+0000 7f6ac3835640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6abc0d0160 con 0x7f6abc153c00 2024-09-16T01:21:49.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.556+0000 7f6ac1dd2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc155a70 0x7f6abc155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.556+0000 7f6ac1dd2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc155a70 0x7f6abc155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34924/0 (socket says 172.21.15.81:34924) 2024-09-16T01:21:49.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.556+0000 7f6ac1dd2640 1 -- 172.21.15.81:0/2646464608 learned_addr learned my addr 172.21.15.81:0/2646464608 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:49.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ac15d1640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6aa8004800 0x7f6abc0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ac0dd0640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc153c00 0x7f6abc14e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ac1dd2640 1 -- 172.21.15.81:0/2646464608 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc153c00 msgr2=0x7f6abc14e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ac1dd2640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc153c00 0x7f6abc14e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ac1dd2640 1 -- 172.21.15.81:0/2646464608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6aa8004800 msgr2=0x7f6abc0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ac1dd2640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6aa8004800 0x7f6abc0cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ac1dd2640 1 -- 172.21.15.81:0/2646464608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc1540f0 con 0x7f6abc155a70 2024-09-16T01:21:49.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ac15d1640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6aa8004800 0x7f6abc0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:49.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ac1dd2640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc155a70 0x7f6abc155ef0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8004780 tx=0x7f6ab40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:49.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ab1ffb640 1 -- 172.21.15.81:0/2646464608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4016470 con 0x7f6abc155a70 2024-09-16T01:21:49.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ab1ffb640 1 -- 172.21.15.81:0/2646464608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab401c070 con 0x7f6abc155a70 2024-09-16T01:21:49.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ac3835640 1 -- 172.21.15.81:0/2646464608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6abc1543d0 con 0x7f6abc155a70 2024-09-16T01:21:49.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ab1ffb640 1 -- 172.21.15.81:0/2646464608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4016850 con 0x7f6abc155a70 2024-09-16T01:21:49.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.557+0000 7f6ac3835640 1 -- 172.21.15.81:0/2646464608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6abc154990 con 0x7f6abc155a70 2024-09-16T01:21:49.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.558+0000 7f6ac3835640 1 -- 172.21.15.81:0/2646464608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6abc0b2fc0 con 0x7f6abc155a70 2024-09-16T01:21:49.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.559+0000 7f6ab1ffb640 1 -- 172.21.15.81:0/2646464608 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6ab40169f0 con 0x7f6abc155a70 2024-09-16T01:21:49.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.559+0000 7f6ab1ffb640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6aa006c2b0 0x7f6aa006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.559+0000 7f6ac15d1640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6aa006c2b0 0x7f6aa006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.559+0000 7f6ab1ffb640 1 -- 172.21.15.81:0/2646464608 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f6ab408c0d0 con 0x7f6abc155a70 2024-09-16T01:21:49.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.560+0000 7f6ac15d1640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6aa006c2b0 0x7f6aa006e770 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80016f0 tx=0x7f6ab8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:49.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.565+0000 7f6ab1ffb640 1 -- 172.21.15.81:0/2646464608 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ab405a6b0 con 0x7f6abc155a70 2024-09-16T01:21:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.729+0000 7f6ac3835640 1 -- 172.21.15.81:0/2646464608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6abc15a720 con 0x7f6abc155a70 2024-09-16T01:21:49.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.730+0000 7f6ab1ffb640 1 -- 172.21.15.81:0/2646464608 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16936 (secure 0 0 0) 0x7f6ab4059fb0 con 0x7f6abc155a70 2024-09-16T01:21:49.732 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:49.733 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":101,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:21:41.916386+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:38.862612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:39.221418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:21:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.733+0000 7f6ac3835640 1 -- 172.21.15.81:0/2646464608 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6aa006c2b0 msgr2=0x7f6aa006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.733+0000 7f6ac3835640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6aa006c2b0 0x7f6aa006e770 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80016f0 tx=0x7f6ab8009040 comp rx=0 tx=0).stop 2024-09-16T01:21:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.733+0000 7f6ac3835640 1 -- 172.21.15.81:0/2646464608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc155a70 msgr2=0x7f6abc155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.733+0000 7f6ac3835640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc155a70 0x7f6abc155ef0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8004780 tx=0x7f6ab40115a0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.733+0000 7f6ac3835640 1 -- 172.21.15.81:0/2646464608 shutdown_connections 2024-09-16T01:21:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.733+0000 7f6ac3835640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6aa006c2b0 0x7f6aa006e770 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.733+0000 7f6ac3835640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc155a70 0x7f6abc155ef0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.733+0000 7f6ac3835640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6abc153c00 0x7f6abc14e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.733+0000 7f6ac3835640 1 --2- 172.21.15.81:0/2646464608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6aa8004800 0x7f6abc0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.733+0000 7f6ac3835640 1 -- 172.21.15.81:0/2646464608 >> 172.21.15.81:0/2646464608 conn(0x7f6abc067d70 msgr2=0x7f6abc0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.733+0000 7f6ac3835640 1 -- 172.21.15.81:0/2646464608 shutdown_connections 2024-09-16T01:21:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.733+0000 7f6ac3835640 1 -- 172.21.15.81:0/2646464608 wait complete. 2024-09-16T01:21:49.746 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:21:49.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:21:49.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.843+0000 7fbd2f253640 1 Processor -- start 2024-09-16T01:21:49.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.843+0000 7fbd2f253640 1 -- start start 2024-09-16T01:21:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.844+0000 7fbd2f253640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd280b3760 0x7fbd280b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.844+0000 7fbd2f253640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd280b2790 con 0x7fbd2809aa30 2024-09-16T01:21:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.844+0000 7fbd2f253640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd280b2a70 con 0x7fbd2806cd20 2024-09-16T01:21:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.844+0000 7fbd2f253640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fbd280d0670 con 0x7fbd280b3760 2024-09-16T01:21:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.844+0000 7fbd27fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd280b3760 0x7fbd280b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.844+0000 7fbd2cfef640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbd2809aa30 0x7fbd2809ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49198/0 (socket says 172.21.15.81:49198) 2024-09-16T01:21:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.844+0000 7fbd2cfef640 1 -- 172.21.15.81:0/1667069320 learned_addr learned my addr 172.21.15.81:0/1667069320 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.845+0000 7fbd27fff640 1 -- 172.21.15.81:0/1667069320 >> v1:172.21.15.102:6789/0 conn(0x7fbd2806cd20 legacy=0x7fbd28162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.845+0000 7fbd27fff640 1 -- 172.21.15.81:0/1667069320 >> v1:172.21.15.81:6789/0 conn(0x7fbd2809aa30 legacy=0x7fbd2809ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.845+0000 7fbd27fff640 1 -- 172.21.15.81:0/1667069320 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd280b2d50 con 0x7fbd280b3760 2024-09-16T01:21:49.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.845+0000 7fbd277fe640 1 -- 172.21.15.81:0/1667069320 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 657946352 0 0) 0x7fbd280b2790 con 0x7fbd2809aa30 2024-09-16T01:21:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.845+0000 7fbd27fff640 1 --2- 172.21.15.81:0/1667069320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd280b3760 0x7fbd280b3030 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009d90 tx=0x7fbd1802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb308adf3345c12 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.845+0000 7fbd277fe640 1 -- 172.21.15.81:0/1667069320 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18031600 con 0x7fbd280b3760 2024-09-16T01:21:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.845+0000 7fbd277fe640 1 -- 172.21.15.81:0/1667069320 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd180317a0 con 0x7fbd280b3760 2024-09-16T01:21:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.846+0000 7fbd277fe640 1 -- 172.21.15.81:0/1667069320 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18031b70 con 0x7fbd280b3760 2024-09-16T01:21:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.846+0000 7fbd2f253640 1 -- 172.21.15.81:0/1667069320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd280b3760 msgr2=0x7fbd280b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.846+0000 7fbd2f253640 1 --2- 172.21.15.81:0/1667069320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd280b3760 0x7fbd280b3030 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009d90 tx=0x7fbd1802a5d0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.846+0000 7fbd2f253640 1 -- 172.21.15.81:0/1667069320 shutdown_connections 2024-09-16T01:21:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.846+0000 7fbd2f253640 1 --2- 172.21.15.81:0/1667069320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd280b3760 0x7fbd280b3030 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.846+0000 7fbd2f253640 1 -- 172.21.15.81:0/1667069320 >> 172.21.15.81:0/1667069320 conn(0x7fbd280d23a0 msgr2=0x7fbd280d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.846+0000 7fbd2f253640 1 -- 172.21.15.81:0/1667069320 shutdown_connections 2024-09-16T01:21:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.846+0000 7fbd2f253640 1 -- 172.21.15.81:0/1667069320 wait complete. 2024-09-16T01:21:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.847+0000 7fbd2f253640 1 Processor -- start 2024-09-16T01:21:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.847+0000 7fbd2f253640 1 -- start start 2024-09-16T01:21:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.848+0000 7fbd2f253640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2806cd20 0x7fbd280b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.848+0000 7fbd2f253640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd2809aa30 0x7fbd28151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.848+0000 7fbd2f253640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd280b3760 0x7fbd281629b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.848+0000 7fbd2f253640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2815fe20 con 0x7fbd2806cd20 2024-09-16T01:21:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.848+0000 7fbd2f253640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2815fca0 con 0x7fbd280b3760 2024-09-16T01:21:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.848+0000 7fbd2f253640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbd280d1fe0 con 0x7fbd2809aa30 2024-09-16T01:21:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.848+0000 7fbd2cfef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2806cd20 0x7fbd280b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.848+0000 7fbd2cfef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2806cd20 0x7fbd280b7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34944/0 (socket says 172.21.15.81:34944) 2024-09-16T01:21:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.848+0000 7fbd2cfef640 1 -- 172.21.15.81:0/223342015 learned_addr learned my addr 172.21.15.81:0/223342015 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:49.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.849+0000 7fbd2cfef640 1 -- 172.21.15.81:0/223342015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd2809aa30 msgr2=0x7fbd28151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.849+0000 7fbd2cfef640 1 --2- 172.21.15.81:0/223342015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd2809aa30 0x7fbd28151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.849+0000 7fbd2cfef640 1 -- 172.21.15.81:0/223342015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd280b3760 msgr2=0x7fbd281629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.849+0000 7fbd2cfef640 1 --2- 172.21.15.81:0/223342015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd280b3760 0x7fbd281629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.849+0000 7fbd2cfef640 1 -- 172.21.15.81:0/223342015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd280b66f0 con 0x7fbd2806cd20 2024-09-16T01:21:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.849+0000 7fbd2cfef640 1 --2- 172.21.15.81:0/223342015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2806cd20 0x7fbd280b7a70 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c420 tx=0x7fbd2000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.849+0000 7fbd257fa640 1 -- 172.21.15.81:0/223342015 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd200074e0 con 0x7fbd2806cd20 2024-09-16T01:21:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.849+0000 7fbd257fa640 1 -- 172.21.15.81:0/223342015 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd200047e0 con 0x7fbd2806cd20 2024-09-16T01:21:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.849+0000 7fbd257fa640 1 -- 172.21.15.81:0/223342015 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20004c10 con 0x7fbd2806cd20 2024-09-16T01:21:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.849+0000 7fbd2f253640 1 -- 172.21.15.81:0/223342015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd280b69d0 con 0x7fbd2806cd20 2024-09-16T01:21:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.849+0000 7fbd2f253640 1 -- 172.21.15.81:0/223342015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd280b6f90 con 0x7fbd2806cd20 2024-09-16T01:21:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.850+0000 7fbd2f253640 1 -- 172.21.15.81:0/223342015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd280b3030 con 0x7fbd2806cd20 2024-09-16T01:21:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.850+0000 7fbd257fa640 1 -- 172.21.15.81:0/223342015 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd20011070 con 0x7fbd2806cd20 2024-09-16T01:21:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.851+0000 7fbd257fa640 1 --2- 172.21.15.81:0/223342015 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbd0806c2b0 0x7fbd0806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.851+0000 7fbd27fff640 1 --2- 172.21.15.81:0/223342015 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbd0806c2b0 0x7fbd0806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.851+0000 7fbd257fa640 1 -- 172.21.15.81:0/223342015 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fbd2008b220 con 0x7fbd2806cd20 2024-09-16T01:21:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.851+0000 7fbd27fff640 1 --2- 172.21.15.81:0/223342015 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbd0806c2b0 0x7fbd0806e770 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbd18034000 tx=0x7fbd1802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:49.855+0000 7fbd257fa640 1 -- 172.21.15.81:0/223342015 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd2000e280 con 0x7fbd2806cd20 2024-09-16T01:21:50.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.060+0000 7fbd2f253640 1 -- 172.21.15.81:0/223342015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd280b3cb0 con 0x7fbd2806cd20 2024-09-16T01:21:50.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.060+0000 7fbd257fa640 1 -- 172.21.15.81:0/223342015 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5231 (secure 0 0 0) 0x7fbd20059800 con 0x7fbd2806cd20 2024-09-16T01:21:50.062 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:50.062 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"btime":"2024-09-16T01:21:42:921033+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3103388370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3103388370},{"type":"v1","addr":"172.21.15.102:6834","nonce":3103388370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":5750,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1937467713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1937467713},{"type":"v1","addr":"172.21.15.102:6835","nonce":1937467713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1728333369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1728333369},{"type":"v1","addr":"172.21.15.81:6836","nonce":1728333369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:21:40.253611+0000","modified":"2024-09-16T01:21:42.245713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6945":{"gid":6945,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2688004165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2688004165},{"type":"v1","addr":"172.21.15.81:6837","nonce":2688004165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6945,"qdb_cluster":[6945]},"id":7}]} 2024-09-16T01:21:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2024-09-16T01:21:50.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.062+0000 7fbd2f253640 1 -- 172.21.15.81:0/223342015 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbd0806c2b0 msgr2=0x7fbd0806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.062+0000 7fbd2f253640 1 --2- 172.21.15.81:0/223342015 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbd0806c2b0 0x7fbd0806e770 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fbd18034000 tx=0x7fbd1802e000 comp rx=0 tx=0).stop 2024-09-16T01:21:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.062+0000 7fbd2f253640 1 -- 172.21.15.81:0/223342015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2806cd20 msgr2=0x7fbd280b7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.062+0000 7fbd2f253640 1 --2- 172.21.15.81:0/223342015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2806cd20 0x7fbd280b7a70 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c420 tx=0x7fbd2000c8e0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.063+0000 7fbd2f253640 1 -- 172.21.15.81:0/223342015 shutdown_connections 2024-09-16T01:21:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.063+0000 7fbd2f253640 1 --2- 172.21.15.81:0/223342015 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbd0806c2b0 0x7fbd0806e770 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.063+0000 7fbd2f253640 1 --2- 172.21.15.81:0/223342015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd280b3760 0x7fbd281629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.063+0000 7fbd2f253640 1 --2- 172.21.15.81:0/223342015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd2809aa30 0x7fbd28151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.063+0000 7fbd2f253640 1 --2- 172.21.15.81:0/223342015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd2806cd20 0x7fbd280b7a70 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.063+0000 7fbd2f253640 1 -- 172.21.15.81:0/223342015 >> 172.21.15.81:0/223342015 conn(0x7fbd280d23a0 msgr2=0x7fbd2806d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.063+0000 7fbd2f253640 1 -- 172.21.15.81:0/223342015 shutdown_connections 2024-09-16T01:21:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.063+0000 7fbd2f253640 1 -- 172.21.15.81:0/223342015 wait complete. 2024-09-16T01:21:50.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:21:50.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.173+0000 7f8b9cf98640 1 Processor -- start 2024-09-16T01:21:50.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.173+0000 7f8b9cf98640 1 -- start start 2024-09-16T01:21:50.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b9cf98640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8b9815b300 0x7f8b980cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b9cf98640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b980cd3f0 0x7f8b9806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b9cf98640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b980cdbe0 con 0x7f8b98072d30 2024-09-16T01:21:50.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b9cf98640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8b980728a0 con 0x7f8b9815b300 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b9cf98640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8b980cd900 con 0x7f8b980cd3f0 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b8dd9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b980cd3f0 0x7f8b9806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b9659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8b9815b300 0x7f8b980cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b8dd9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b980cd3f0 0x7f8b9806f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:42454/0 (socket says 172.21.15.81:42454) 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b96d9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8b98072d30 0x7f8b980b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:40898/0 (socket says 172.21.15.81:40898) 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b8dd9b640 1 -- 172.21.15.81:0/1907716598 learned_addr learned my addr 172.21.15.81:0/1907716598 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b9659c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8b9815b300 0x7f8b980cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:49438/0 (socket says 172.21.15.81:49438) 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b8dd9b640 1 -- 172.21.15.81:0/1907716598 >> v2:172.21.15.102:3300/0 conn(0x7f8b9815b300 msgr2=0x7f8b980cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b8dd9b640 1 --2- 172.21.15.81:0/1907716598 >> v2:172.21.15.102:3300/0 conn(0x7f8b9815b300 0x7f8b980cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b8dd9b640 1 -- 172.21.15.81:0/1907716598 >> v1:172.21.15.102:6789/0 conn(0x7f8b98072d30 legacy=0x7f8b980b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b8dd9b640 1 -- 172.21.15.81:0/1907716598 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b98072250 con 0x7f8b980cd3f0 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.174+0000 7f8b9659c640 1 --2- 172.21.15.81:0/1907716598 >> v2:172.21.15.102:3300/0 conn(0x7f8b9815b300 0x7f8b980cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:21:50.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.175+0000 7f8b8dd9b640 1 --2- 172.21.15.81:0/1907716598 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b980cd3f0 0x7f8b9806f1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009870 tx=0x7f8b8002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90bc9ad9d9c4b106 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.175+0000 7f8b95d9b640 1 -- 172.21.15.81:0/1907716598 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80037070 con 0x7f8b980cd3f0 2024-09-16T01:21:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.175+0000 7f8b95d9b640 1 -- 172.21.15.81:0/1907716598 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b80032440 con 0x7f8b980cd3f0 2024-09-16T01:21:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.175+0000 7f8b95d9b640 1 -- 172.21.15.81:0/1907716598 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80032810 con 0x7f8b980cd3f0 2024-09-16T01:21:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.176+0000 7f8b9cf98640 1 -- 172.21.15.81:0/1907716598 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b980cd3f0 msgr2=0x7f8b9806f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.176+0000 7f8b9cf98640 1 --2- 172.21.15.81:0/1907716598 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b980cd3f0 0x7f8b9806f1c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009870 tx=0x7f8b8002a270 comp rx=0 tx=0).stop 2024-09-16T01:21:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.176+0000 7f8b9cf98640 1 -- 172.21.15.81:0/1907716598 shutdown_connections 2024-09-16T01:21:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.176+0000 7f8b9cf98640 1 --2- 172.21.15.81:0/1907716598 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b980cd3f0 0x7f8b9806f1c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.176+0000 7f8b9cf98640 1 --2- 172.21.15.81:0/1907716598 >> v2:172.21.15.102:3300/0 conn(0x7f8b9815b300 0x7f8b980cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.176+0000 7f8b9cf98640 1 -- 172.21.15.81:0/1907716598 >> 172.21.15.81:0/1907716598 conn(0x7f8b98067d70 msgr2=0x7f8b9806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.176+0000 7f8b9cf98640 1 -- 172.21.15.81:0/1907716598 shutdown_connections 2024-09-16T01:21:50.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.176+0000 7f8b9cf98640 1 -- 172.21.15.81:0/1907716598 wait complete. 2024-09-16T01:21:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.177+0000 7f8b9cf98640 1 Processor -- start 2024-09-16T01:21:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.177+0000 7f8b9cf98640 1 -- start start 2024-09-16T01:21:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.178+0000 7f8b9cf98640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b98072d30 0x7f8b98144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.178+0000 7f8b9cf98640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b980cd3f0 0x7f8b981544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.178+0000 7f8b9cf98640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b9815b300 0x7f8b981567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.178+0000 7f8b9cf98640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8b980d0160 con 0x7f8b98072d30 2024-09-16T01:21:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.178+0000 7f8b9cf98640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8b980cffe0 con 0x7f8b9815b300 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.178+0000 7f8b9cf98640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9806f700 con 0x7f8b980cd3f0 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.178+0000 7f8b9659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b98072d30 0x7f8b98144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.178+0000 7f8b9659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b98072d30 0x7f8b98144dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34948/0 (socket says 172.21.15.81:34948) 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.178+0000 7f8b9659c640 1 -- 172.21.15.81:0/2528430154 learned_addr learned my addr 172.21.15.81:0/2528430154 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.178+0000 7f8b96d9d640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b9815b300 0x7f8b981567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.178+0000 7f8b8dd9b640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b980cd3f0 0x7f8b981544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.179+0000 7f8b9659c640 1 -- 172.21.15.81:0/2528430154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b980cd3f0 msgr2=0x7f8b981544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.179+0000 7f8b9659c640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b980cd3f0 0x7f8b981544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.179+0000 7f8b9659c640 1 -- 172.21.15.81:0/2528430154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b9815b300 msgr2=0x7f8b981567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.179+0000 7f8b9659c640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b9815b300 0x7f8b981567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.179+0000 7f8b9659c640 1 -- 172.21.15.81:0/2528430154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b98145300 con 0x7f8b98072d30 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.179+0000 7f8b9659c640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b98072d30 0x7f8b98144dc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800e990 tx=0x7f8b8800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.179+0000 7f8b8f7fe640 1 -- 172.21.15.81:0/2528430154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88017070 con 0x7f8b98072d30 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.179+0000 7f8b8f7fe640 1 -- 172.21.15.81:0/2528430154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8800c9e0 con 0x7f8b98072d30 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.179+0000 7f8b9cf98640 1 -- 172.21.15.81:0/2528430154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b98155700 con 0x7f8b98072d30 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.179+0000 7f8b8f7fe640 1 -- 172.21.15.81:0/2528430154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800cdb0 con 0x7f8b98072d30 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.179+0000 7f8b9cf98640 1 -- 172.21.15.81:0/2528430154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b98155cc0 con 0x7f8b98072d30 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.180+0000 7f8b9cf98640 1 -- 172.21.15.81:0/2528430154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9815a910 con 0x7f8b98072d30 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.181+0000 7f8b8f7fe640 1 -- 172.21.15.81:0/2528430154 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8b8801a070 con 0x7f8b98072d30 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.181+0000 7f8b8f7fe640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8b7806c2b0 0x7f8b7806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.181+0000 7f8b8f7fe640 1 -- 172.21.15.81:0/2528430154 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f8b8808b410 con 0x7f8b98072d30 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.181+0000 7f8b8dd9b640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8b7806c2b0 0x7f8b7806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.181+0000 7f8b8dd9b640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8b7806c2b0 0x7f8b7806e770 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8b80034000 tx=0x7f8b8002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.185+0000 7f8b8f7fe640 1 -- 172.21.15.81:0/2528430154 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b880593a0 con 0x7f8b98072d30 2024-09-16T01:21:50.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.384+0000 7f8b9cf98640 1 -- 172.21.15.81:0/2528430154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b9806d090 con 0x7f8b98072d30 2024-09-16T01:21:50.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.384+0000 7f8b8f7fe640 1 -- 172.21.15.81:0/2528430154 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5231 (secure 0 0 0) 0x7f8b8805d6a0 con 0x7f8b98072d30 2024-09-16T01:21:50.385 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:50.385 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"btime":"2024-09-16T01:21:42:921033+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3103388370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3103388370},{"type":"v1","addr":"172.21.15.102:6834","nonce":3103388370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":5750,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1937467713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1937467713},{"type":"v1","addr":"172.21.15.102:6835","nonce":1937467713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1728333369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1728333369},{"type":"v1","addr":"172.21.15.81:6836","nonce":1728333369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:21:40.253611+0000","modified":"2024-09-16T01:21:42.245713+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6945},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6945":{"gid":6945,"name":"a","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2688004165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2688004165},{"type":"v1","addr":"172.21.15.81:6837","nonce":2688004165}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6945,"qdb_cluster":[6945]},"id":7}]} 2024-09-16T01:21:50.385 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2024-09-16T01:21:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.386+0000 7f8b9cf98640 1 -- 172.21.15.81:0/2528430154 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8b7806c2b0 msgr2=0x7f8b7806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.386+0000 7f8b9cf98640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8b7806c2b0 0x7f8b7806e770 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8b80034000 tx=0x7f8b8002e000 comp rx=0 tx=0).stop 2024-09-16T01:21:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.386+0000 7f8b9cf98640 1 -- 172.21.15.81:0/2528430154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b98072d30 msgr2=0x7f8b98144dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.386+0000 7f8b9cf98640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b98072d30 0x7f8b98144dc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800e990 tx=0x7f8b8800ee50 comp rx=0 tx=0).stop 2024-09-16T01:21:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.386+0000 7f8b9cf98640 1 -- 172.21.15.81:0/2528430154 shutdown_connections 2024-09-16T01:21:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.386+0000 7f8b9cf98640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8b7806c2b0 0x7f8b7806e770 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.386+0000 7f8b9cf98640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b9815b300 0x7f8b981567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.386+0000 7f8b9cf98640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b980cd3f0 0x7f8b981544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.386+0000 7f8b9cf98640 1 --2- 172.21.15.81:0/2528430154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b98072d30 0x7f8b98144dc0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.386+0000 7f8b9cf98640 1 -- 172.21.15.81:0/2528430154 >> 172.21.15.81:0/2528430154 conn(0x7f8b98067d70 msgr2=0x7f8b980cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.386+0000 7f8b9cf98640 1 -- 172.21.15.81:0/2528430154 shutdown_connections 2024-09-16T01:21:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.386+0000 7f8b9cf98640 1 -- 172.21.15.81:0/2528430154 wait complete. 2024-09-16T01:21:50.398 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:21:50.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.526+0000 7fb354733640 1 Processor -- start 2024-09-16T01:21:50.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.526+0000 7fb354733640 1 -- start start 2024-09-16T01:21:50.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.527+0000 7fb354733640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb34c15ba30 0x7fb34c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.527+0000 7fb354733640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34c0b3570 con 0x7fb34c06fd50 2024-09-16T01:21:50.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.527+0000 7fb354733640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34c0b3850 con 0x7fb34c073050 2024-09-16T01:21:50.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.527+0000 7fb354733640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb34c0b4180 con 0x7fb34c15ba30 2024-09-16T01:21:50.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.527+0000 7fb3524cf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb34c15ba30 0x7fb34c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.527+0000 7fb351cce640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb34c06fd50 0x7fb34c072940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49202/0 (socket says 172.21.15.81:49202) 2024-09-16T01:21:50.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.527+0000 7fb351cce640 1 -- 172.21.15.81:0/2795666073 learned_addr learned my addr 172.21.15.81:0/2795666073 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:50.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.527+0000 7fb3524cf640 1 -- 172.21.15.81:0/2795666073 >> v1:172.21.15.102:6789/0 conn(0x7fb34c073050 legacy=0x7fb34c0b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.527+0000 7fb3524cf640 1 -- 172.21.15.81:0/2795666073 >> v1:172.21.15.81:6789/0 conn(0x7fb34c06fd50 legacy=0x7fb34c072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.527+0000 7fb3524cf640 1 -- 172.21.15.81:0/2795666073 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c0b3b30 con 0x7fb34c15ba30 2024-09-16T01:21:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.528+0000 7fb3524cf640 1 --2- 172.21.15.81:0/2795666073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c15ba30 0x7fb34c06f810 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0b4300 tx=0x7fb34802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9959f8fb5eaa1c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.528+0000 7fb3514cd640 1 -- 172.21.15.81:0/2795666073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348037070 con 0x7fb34c15ba30 2024-09-16T01:21:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.528+0000 7fb3514cd640 1 -- 172.21.15.81:0/2795666073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb348032440 con 0x7fb34c15ba30 2024-09-16T01:21:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.528+0000 7fb3514cd640 1 -- 172.21.15.81:0/2795666073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348032810 con 0x7fb34c15ba30 2024-09-16T01:21:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.528+0000 7fb354733640 1 -- 172.21.15.81:0/2795666073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c15ba30 msgr2=0x7fb34c06f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.528+0000 7fb354733640 1 --2- 172.21.15.81:0/2795666073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c15ba30 0x7fb34c06f810 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0b4300 tx=0x7fb34802a210 comp rx=0 tx=0).stop 2024-09-16T01:21:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.529+0000 7fb354733640 1 -- 172.21.15.81:0/2795666073 shutdown_connections 2024-09-16T01:21:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.529+0000 7fb354733640 1 --2- 172.21.15.81:0/2795666073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c15ba30 0x7fb34c06f810 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.529+0000 7fb354733640 1 -- 172.21.15.81:0/2795666073 >> 172.21.15.81:0/2795666073 conn(0x7fb34c067d70 msgr2=0x7fb34c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.529+0000 7fb354733640 1 -- 172.21.15.81:0/2795666073 shutdown_connections 2024-09-16T01:21:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.529+0000 7fb354733640 1 -- 172.21.15.81:0/2795666073 wait complete. 2024-09-16T01:21:50.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.530+0000 7fb354733640 1 Processor -- start 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.530+0000 7fb354733640 1 -- start start 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.530+0000 7fb354733640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb34c06fd50 0x7fb34c147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.530+0000 7fb354733640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c073050 0x7fb34c144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.530+0000 7fb354733640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb34c15ba30 0x7fb34c1451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.530+0000 7fb354733640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c0ccfe0 con 0x7fb34c073050 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.530+0000 7fb354733640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c0ce810 con 0x7fb34c15ba30 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.530+0000 7fb354733640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb34c0cd160 con 0x7fb34c06fd50 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb351cce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c073050 0x7fb34c144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb351cce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c073050 0x7fb34c144a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34958/0 (socket says 172.21.15.81:34958) 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb351cce640 1 -- 172.21.15.81:0/1132217250 learned_addr learned my addr 172.21.15.81:0/1132217250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb352cd0640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb34c15ba30 0x7fb34c1451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb3524cf640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb34c06fd50 0x7fb34c147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb351cce640 1 -- 172.21.15.81:0/1132217250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb34c06fd50 msgr2=0x7fb34c147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb351cce640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb34c06fd50 0x7fb34c147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb351cce640 1 -- 172.21.15.81:0/1132217250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb34c15ba30 msgr2=0x7fb34c1451b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb351cce640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb34c15ba30 0x7fb34c1451b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb351cce640 1 -- 172.21.15.81:0/1132217250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c147d20 con 0x7fb34c073050 2024-09-16T01:21:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb351cce640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c073050 0x7fb34c144a20 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00c4a0 tx=0x7fb33c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb342ffd640 1 -- 172.21.15.81:0/1132217250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c017070 con 0x7fb34c073050 2024-09-16T01:21:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb342ffd640 1 -- 172.21.15.81:0/1132217250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33c005ce0 con 0x7fb34c073050 2024-09-16T01:21:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb354733640 1 -- 172.21.15.81:0/1132217250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34c148000 con 0x7fb34c073050 2024-09-16T01:21:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb342ffd640 1 -- 172.21.15.81:0/1132217250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb33c007270 con 0x7fb34c073050 2024-09-16T01:21:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.531+0000 7fb354733640 1 -- 172.21.15.81:0/1132217250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb34c1456f0 con 0x7fb34c073050 2024-09-16T01:21:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.532+0000 7fb354733640 1 -- 172.21.15.81:0/1132217250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb34c0b5970 con 0x7fb34c073050 2024-09-16T01:21:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.533+0000 7fb342ffd640 1 -- 172.21.15.81:0/1132217250 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb33c01a070 con 0x7fb34c073050 2024-09-16T01:21:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.533+0000 7fb342ffd640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb33006c2b0 0x7fb33006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.533+0000 7fb342ffd640 1 -- 172.21.15.81:0/1132217250 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7fb33c08a820 con 0x7fb34c073050 2024-09-16T01:21:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.533+0000 7fb3524cf640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb33006c2b0 0x7fb33006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.534+0000 7fb3524cf640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb33006c2b0 0x7fb33006e770 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb348034000 tx=0x7fb34802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:50.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.537+0000 7fb342ffd640 1 -- 172.21.15.81:0/1132217250 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb34c0b5970 con 0x7fb34c073050 2024-09-16T01:21:50.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.709+0000 7fb354733640 1 -- 172.21.15.81:0/1132217250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb34c148520 con 0x7fb34c073050 2024-09-16T01:21:50.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.710+0000 7fb342ffd640 1 -- 172.21.15.81:0/1132217250 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16936 (secure 0 0 0) 0x7fb33c0587b0 con 0x7fb34c073050 2024-09-16T01:21:50.711 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:50.711 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":101,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:21:41.916386+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:38.862612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:39.221418+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:21:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.712+0000 7fb354733640 1 -- 172.21.15.81:0/1132217250 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb33006c2b0 msgr2=0x7fb33006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.712+0000 7fb354733640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb33006c2b0 0x7fb33006e770 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb348034000 tx=0x7fb34802e000 comp rx=0 tx=0).stop 2024-09-16T01:21:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.712+0000 7fb354733640 1 -- 172.21.15.81:0/1132217250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c073050 msgr2=0x7fb34c144a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.712+0000 7fb354733640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c073050 0x7fb34c144a20 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fb33c00c4a0 tx=0x7fb33c00c960 comp rx=0 tx=0).stop 2024-09-16T01:21:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.712+0000 7fb354733640 1 -- 172.21.15.81:0/1132217250 shutdown_connections 2024-09-16T01:21:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.712+0000 7fb354733640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb33006c2b0 0x7fb33006e770 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.712+0000 7fb354733640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb34c15ba30 0x7fb34c1451b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.712+0000 7fb354733640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c073050 0x7fb34c144a20 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.712+0000 7fb354733640 1 --2- 172.21.15.81:0/1132217250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb34c06fd50 0x7fb34c147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.712+0000 7fb354733640 1 -- 172.21.15.81:0/1132217250 >> 172.21.15.81:0/1132217250 conn(0x7fb34c067d70 msgr2=0x7fb34c15a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:50.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.712+0000 7fb354733640 1 -- 172.21.15.81:0/1132217250 shutdown_connections 2024-09-16T01:21:50.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.712+0000 7fb354733640 1 -- 172.21.15.81:0/1132217250 wait complete. 2024-09-16T01:21:50.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:21:50.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.822+0000 7f568f59e640 1 Processor -- start 2024-09-16T01:21:50.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.822+0000 7f568f59e640 1 -- start start 2024-09-16T01:21:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568f59e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f569009b140 0x7f569006e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568f59e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f569006ddd0 con 0x7f56901629e0 2024-09-16T01:21:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568f59e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f569006e0b0 con 0x7f56900b47b0 2024-09-16T01:21:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568f59e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f56900d1b60 con 0x7f569009b140 2024-09-16T01:21:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568e59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f56901629e0 0x7f5690070b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49214/0 (socket says 172.21.15.81:49214) 2024-09-16T01:21:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568e59c640 1 -- 172.21.15.81:0/666609174 learned_addr learned my addr 172.21.15.81:0/666609174 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:50.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568ed9d640 1 --2- 172.21.15.81:0/666609174 >> v2:172.21.15.102:3300/0 conn(0x7f569009b140 0x7f569006e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130714277 0 0) 0x7f569006ddd0 con 0x7f56901629e0 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5678003520 con 0x7f56901629e0 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3494581115 0 0) 0x7f5678003520 con 0x7f56901629e0 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 >> v2:172.21.15.102:3300/0 conn(0x7f569009b140 msgr2=0x7f569006e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 --2- 172.21.15.81:0/666609174 >> v2:172.21.15.102:3300/0 conn(0x7f569009b140 0x7f569006e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 >> v1:172.21.15.102:6789/0 conn(0x7f56900b47b0 legacy=0x7f569009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569006e6a0 con 0x7f56901629e0 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568ed9d640 1 --2- 172.21.15.81:0/666609174 >> v2:172.21.15.102:3300/0 conn(0x7f569009b140 0x7f569006e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f5680001690 con 0x7f56901629e0 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 >> v1:172.21.15.81:6789/0 conn(0x7f56901629e0 legacy=0x7f5690070b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 --2- 172.21.15.81:0/666609174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 0x7f5678003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 --2- 172.21.15.81:0/666609174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5678004800 0x7f5678004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 --2- 172.21.15.81:0/666609174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56780051c0 0x7f567800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56900d1b60 con 0x7f56780039b0 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f567800c160 con 0x7f56780051c0 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.823+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f567800c360 con 0x7f5678004800 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.824+0000 7f568e59c640 1 --2- 172.21.15.81:0/666609174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 0x7f5678003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.824+0000 7f568ed9d640 1 --2- 172.21.15.81:0/666609174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56780051c0 0x7f567800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.824+0000 7f568dd9b640 1 --2- 172.21.15.81:0/666609174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5678004800 0x7f5678004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.824+0000 7f568e59c640 1 -- 172.21.15.81:0/666609174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5678004800 msgr2=0x7f5678004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.824+0000 7f568e59c640 1 --2- 172.21.15.81:0/666609174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5678004800 0x7f5678004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.824+0000 7f568e59c640 1 -- 172.21.15.81:0/666609174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56780051c0 msgr2=0x7f567800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.824+0000 7f568e59c640 1 --2- 172.21.15.81:0/666609174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56780051c0 0x7f567800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.824+0000 7f568e59c640 1 -- 172.21.15.81:0/666609174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5678003520 con 0x7f56780039b0 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.824+0000 7f568ed9d640 1 -- 172.21.15.81:0/666609174 reap_dead start 2024-09-16T01:21:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.824+0000 7f568dd9b640 1 --2- 172.21.15.81:0/666609174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5678004800 0x7f5678004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.824+0000 7f568e59c640 1 --2- 172.21.15.81:0/666609174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 0x7f5678003dd0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f568000c210 tx=0x7f5678005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98852b323bd3203 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.825+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680007d60 con 0x7f56780039b0 2024-09-16T01:21:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.825+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5680005af0 con 0x7f56780039b0 2024-09-16T01:21:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.825+0000 7f568d59a640 1 -- 172.21.15.81:0/666609174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680007070 con 0x7f56780039b0 2024-09-16T01:21:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.825+0000 7f568f59e640 1 -- 172.21.15.81:0/666609174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 msgr2=0x7f5678003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.825+0000 7f568f59e640 1 --2- 172.21.15.81:0/666609174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 0x7f5678003dd0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f568000c210 tx=0x7f5678005830 comp rx=0 tx=0).stop 2024-09-16T01:21:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.825+0000 7f568f59e640 1 -- 172.21.15.81:0/666609174 shutdown_connections 2024-09-16T01:21:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.825+0000 7f568f59e640 1 --2- 172.21.15.81:0/666609174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 0x7f5678003dd0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.825+0000 7f568f59e640 1 -- 172.21.15.81:0/666609174 >> 172.21.15.81:0/666609174 conn(0x7f56900b3c90 msgr2=0x7f56900b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.825+0000 7f568f59e640 1 -- 172.21.15.81:0/666609174 shutdown_connections 2024-09-16T01:21:50.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.825+0000 7f568f59e640 1 -- 172.21.15.81:0/666609174 wait complete. 2024-09-16T01:21:50.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.827+0000 7f568f59e640 1 Processor -- start 2024-09-16T01:21:50.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.827+0000 7f568f59e640 1 -- start start 2024-09-16T01:21:50.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.827+0000 7f568f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 0x7f56900b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.827+0000 7f568f59e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56900b59e0 0x7f569015daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.827+0000 7f568f59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56901584f0 0x7f56901589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.827+0000 7f568f59e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f569006e9d0 con 0x7f56780039b0 2024-09-16T01:21:50.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.827+0000 7f568f59e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5690162fd0 con 0x7f56901584f0 2024-09-16T01:21:50.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.827+0000 7f568f59e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f569006eb50 con 0x7f56900b59e0 2024-09-16T01:21:50.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.827+0000 7f568e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 0x7f56900b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.827+0000 7f568e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 0x7f56900b74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34962/0 (socket says 172.21.15.81:34962) 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.827+0000 7f568e59c640 1 -- 172.21.15.81:0/4013613869 learned_addr learned my addr 172.21.15.81:0/4013613869 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f568dd9b640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56900b59e0 0x7f569015daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f568ed9d640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56901584f0 0x7f56901589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f568e59c640 1 -- 172.21.15.81:0/4013613869 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56900b59e0 msgr2=0x7f569015daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f568e59c640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56900b59e0 0x7f569015daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f568e59c640 1 -- 172.21.15.81:0/4013613869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56901584f0 msgr2=0x7f56901589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f568e59c640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56901584f0 0x7f56901589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f568e59c640 1 -- 172.21.15.81:0/4013613869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56900b61b0 con 0x7f56780039b0 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f568e59c640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 0x7f56900b74f0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f568000c330 tx=0x7f5680001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f567effd640 1 -- 172.21.15.81:0/4013613869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680042070 con 0x7f56780039b0 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f567effd640 1 -- 172.21.15.81:0/4013613869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56800047e0 con 0x7f56780039b0 2024-09-16T01:21:50.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f567effd640 1 -- 172.21.15.81:0/4013613869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680037040 con 0x7f56780039b0 2024-09-16T01:21:50.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f568f59e640 1 -- 172.21.15.81:0/4013613869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56900b7a30 con 0x7f56780039b0 2024-09-16T01:21:50.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.828+0000 7f568f59e640 1 -- 172.21.15.81:0/4013613869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56900b6730 con 0x7f56780039b0 2024-09-16T01:21:50.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.829+0000 7f568f59e640 1 -- 172.21.15.81:0/4013613869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569009aa30 con 0x7f56780039b0 2024-09-16T01:21:50.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.830+0000 7f567effd640 1 -- 172.21.15.81:0/4013613869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5680045070 con 0x7f56780039b0 2024-09-16T01:21:50.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.830+0000 7f567effd640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f567006c2e0 0x7f567006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:50.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.830+0000 7f567effd640 1 -- 172.21.15.81:0/4013613869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 6101+0+0 (secure 0 0 0) 0x7f56800aac30 con 0x7f56780039b0 2024-09-16T01:21:50.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.830+0000 7f568dd9b640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f567006c2e0 0x7f567006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:50.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.831+0000 7f568dd9b640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f567006c2e0 0x7f567006e7a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5684007fd0 tx=0x7f5684009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:50.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:50.834+0000 7f567effd640 1 -- 172.21.15.81:0/4013613869 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5680079210 con 0x7f56780039b0 2024-09-16T01:21:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.035+0000 7f568f59e640 1 -- 172.21.15.81:0/4013613869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f56900b8120 con 0x7f56780039b0 2024-09-16T01:21:51.036 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-16T01:21:51.035+0000 7f4e951a0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:21:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.036+0000 7f567effd640 1 -- 172.21.15.81:0/4013613869 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) ==== 161+0+0 (secure 0 0 0) 0x7f5680078b10 con 0x7f56780039b0 2024-09-16T01:21:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:21:51.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.039+0000 7f568f59e640 1 -- 172.21.15.81:0/4013613869 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f567006c2e0 msgr2=0x7f567006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:51.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.039+0000 7f568f59e640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f567006c2e0 0x7f567006e7a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5684007fd0 tx=0x7f5684009040 comp rx=0 tx=0).stop 2024-09-16T01:21:51.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.039+0000 7f568f59e640 1 -- 172.21.15.81:0/4013613869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 msgr2=0x7f56900b74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.039+0000 7f568f59e640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 0x7f56900b74f0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f568000c330 tx=0x7f5680001a60 comp rx=0 tx=0).stop 2024-09-16T01:21:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.039+0000 7f568f59e640 1 -- 172.21.15.81:0/4013613869 shutdown_connections 2024-09-16T01:21:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.039+0000 7f568f59e640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f567006c2e0 0x7f567006e7a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.039+0000 7f568f59e640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f56901584f0 0x7f56901589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.039+0000 7f568f59e640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f56900b59e0 0x7f569015daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.039+0000 7f568f59e640 1 --2- 172.21.15.81:0/4013613869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780039b0 0x7f56900b74f0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.039+0000 7f568f59e640 1 -- 172.21.15.81:0/4013613869 >> 172.21.15.81:0/4013613869 conn(0x7f56900b3c90 msgr2=0x7f56900cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.040+0000 7f568f59e640 1 -- 172.21.15.81:0/4013613869 shutdown_connections 2024-09-16T01:21:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.040+0000 7f568f59e640 1 -- 172.21.15.81:0/4013613869 wait complete. 2024-09-16T01:21:51.042 INFO:tasks.ceph.mds.a.smithi081.stderr: -2023> 2024-09-16T01:21:42.163+0000 7f211cfae640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:21:51.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:21:51.068 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:21:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.153+0000 7fd4cfcfa640 1 Processor -- start 2024-09-16T01:21:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.153+0000 7fd4cfcfa640 1 -- start start 2024-09-16T01:21:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cfcfa640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd4c815f950 0x7fd4c809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cfcfa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c809af70 0x7fd4c806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cfcfa640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c80b6820 con 0x7fd4c8158b50 2024-09-16T01:21:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cfcfa640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd4c80b6b00 con 0x7fd4c815f950 2024-09-16T01:21:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cfcfa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c80b6de0 con 0x7fd4c809af70 2024-09-16T01:21:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cd295640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd4c815f950 0x7fd4c809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4ce297640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c809af70 0x7fd4c806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cd295640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd4c815f950 0x7fd4c809aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:48166/0 (socket says 172.21.15.81:48166) 2024-09-16T01:21:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cda96640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd4c8158b50 0x7fd4c80b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:42602/0 (socket says 172.21.15.81:42602) 2024-09-16T01:21:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cd295640 1 -- 172.21.15.81:0/3907488445 learned_addr learned my addr 172.21.15.81:0/3907488445 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cd295640 1 -- 172.21.15.81:0/3907488445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c809af70 msgr2=0x7fd4c806fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cd295640 1 --2- 172.21.15.81:0/3907488445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c809af70 0x7fd4c806fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cd295640 1 -- 172.21.15.81:0/3907488445 >> v1:172.21.15.102:6789/0 conn(0x7fd4c8158b50 legacy=0x7fd4c80b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4cd295640 1 -- 172.21.15.81:0/3907488445 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c80b70c0 con 0x7fd4c815f950 2024-09-16T01:21:51.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.154+0000 7fd4ce297640 1 --2- 172.21.15.81:0/3907488445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c809af70 0x7fd4c806fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:21:51.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.155+0000 7fd4cd295640 1 --2- 172.21.15.81:0/3907488445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c815f950 0x7fd4c809aa30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009870 tx=0x7fd4b802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c904d4b8144303df server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:51.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.155+0000 7fd4cca94640 1 -- 172.21.15.81:0/3907488445 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8037070 con 0x7fd4c815f950 2024-09-16T01:21:51.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.155+0000 7fd4cca94640 1 -- 172.21.15.81:0/3907488445 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b8032440 con 0x7fd4c815f950 2024-09-16T01:21:51.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.155+0000 7fd4cca94640 1 -- 172.21.15.81:0/3907488445 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8032810 con 0x7fd4c815f950 2024-09-16T01:21:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.156+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/3907488445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c815f950 msgr2=0x7fd4c809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.156+0000 7fd4cfcfa640 1 --2- 172.21.15.81:0/3907488445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c815f950 0x7fd4c809aa30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8009870 tx=0x7fd4b802a270 comp rx=0 tx=0).stop 2024-09-16T01:21:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.156+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/3907488445 shutdown_connections 2024-09-16T01:21:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.156+0000 7fd4cfcfa640 1 --2- 172.21.15.81:0/3907488445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c809af70 0x7fd4c806fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.156+0000 7fd4cfcfa640 1 --2- 172.21.15.81:0/3907488445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c815f950 0x7fd4c809aa30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.156+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/3907488445 >> 172.21.15.81:0/3907488445 conn(0x7fd4c80b79e0 msgr2=0x7fd4c80b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.156+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/3907488445 shutdown_connections 2024-09-16T01:21:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.156+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/3907488445 wait complete. 2024-09-16T01:21:51.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.157+0000 7fd4cfcfa640 1 Processor -- start 2024-09-16T01:21:51.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.157+0000 7fd4cfcfa640 1 -- start start 2024-09-16T01:21:51.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4cfcfa640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c809af70 0x7fd4c80b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:51.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4cfcfa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c8158b50 0x7fd4c80cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4cfcfa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c815f950 0x7fd4c814f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4cfcfa640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c8158f30 con 0x7fd4c815f950 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4cfcfa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c80b6530 con 0x7fd4c8158b50 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4cfcfa640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c81590b0 con 0x7fd4c809af70 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4ce297640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c815f950 0x7fd4c814f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4ce297640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c815f950 0x7fd4c814f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51398/0 (socket says 172.21.15.81:51398) 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4ce297640 1 -- 172.21.15.81:0/2509027803 learned_addr learned my addr 172.21.15.81:0/2509027803 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4cda96640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c809af70 0x7fd4c80b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4cd295640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c8158b50 0x7fd4c80cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4ce297640 1 -- 172.21.15.81:0/2509027803 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c809af70 msgr2=0x7fd4c80b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4ce297640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c809af70 0x7fd4c80b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4ce297640 1 -- 172.21.15.81:0/2509027803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c8158b50 msgr2=0x7fd4c80cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:51.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4ce297640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c8158b50 0x7fd4c80cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:51.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.158+0000 7fd4ce297640 1 -- 172.21.15.81:0/2509027803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c80af420 con 0x7fd4c815f950 2024-09-16T01:21:51.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.159+0000 7fd4ce297640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c815f950 0x7fd4c814f7c0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000efc0 tx=0x7fd4c0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:51.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.159+0000 7fd4be7fc640 1 -- 172.21.15.81:0/2509027803 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0018030 con 0x7fd4c815f950 2024-09-16T01:21:51.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.159+0000 7fd4be7fc640 1 -- 172.21.15.81:0/2509027803 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c000cde0 con 0x7fd4c815f950 2024-09-16T01:21:51.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.159+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/2509027803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c80af700 con 0x7fd4c815f950 2024-09-16T01:21:51.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.159+0000 7fd4be7fc640 1 -- 172.21.15.81:0/2509027803 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0003bb0 con 0x7fd4c815f950 2024-09-16T01:21:51.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.159+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/2509027803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c80afcc0 con 0x7fd4c815f950 2024-09-16T01:21:51.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.160+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/2509027803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c809aa30 con 0x7fd4c815f950 2024-09-16T01:21:51.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.160+0000 7fd4be7fc640 1 -- 172.21.15.81:0/2509027803 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd4c001b070 con 0x7fd4c815f950 2024-09-16T01:21:51.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.161+0000 7fd4be7fc640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4ac06c2e0 0x7fd4ac06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:51.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.161+0000 7fd4be7fc640 1 -- 172.21.15.81:0/2509027803 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6187+0+0 (secure 0 0 0) 0x7fd4c008bf60 con 0x7fd4c815f950 2024-09-16T01:21:51.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.161+0000 7fd4cda96640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4ac06c2e0 0x7fd4ac06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:51.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.162+0000 7fd4cda96640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4ac06c2e0 0x7fd4ac06e7a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd4c806eb60 tx=0x7fd4c4007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:51.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.166+0000 7fd4be7fc640 1 -- 172.21.15.81:0/2509027803 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4c0010040 con 0x7fd4c815f950 2024-09-16T01:21:51.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:51.370+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/2509027803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd4c80b77a0 con 0x7fd4c815f950 2024-09-16T01:21:52.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.038+0000 7fd4be7fc640 1 -- 172.21.15.81:0/2509027803 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) ==== 104+0+0 (secure 0 0 0) 0x7fd4c005a580 con 0x7fd4c815f950 2024-09-16T01:21:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.042+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/2509027803 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4ac06c2e0 msgr2=0x7fd4ac06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.042+0000 7fd4cfcfa640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4ac06c2e0 0x7fd4ac06e7a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd4c806eb60 tx=0x7fd4c4007e80 comp rx=0 tx=0).stop 2024-09-16T01:21:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.042+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/2509027803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c815f950 msgr2=0x7fd4c814f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.042+0000 7fd4cfcfa640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c815f950 0x7fd4c814f7c0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000efc0 tx=0x7fd4c0009f90 comp rx=0 tx=0).stop 2024-09-16T01:21:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.042+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/2509027803 shutdown_connections 2024-09-16T01:21:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.042+0000 7fd4cfcfa640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4ac06c2e0 0x7fd4ac06e7a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.042+0000 7fd4cfcfa640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c815f950 0x7fd4c814f7c0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.042+0000 7fd4cfcfa640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c8158b50 0x7fd4c80cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.042+0000 7fd4cfcfa640 1 --2- 172.21.15.81:0/2509027803 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c809af70 0x7fd4c80b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.042+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/2509027803 >> 172.21.15.81:0/2509027803 conn(0x7fd4c80b79e0 msgr2=0x7fd4c8161280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.042+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/2509027803 shutdown_connections 2024-09-16T01:21:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.042+0000 7fd4cfcfa640 1 -- 172.21.15.81:0/2509027803 wait complete. 2024-09-16T01:21:52.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:21:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.205+0000 7fdd483e4640 1 Processor -- start 2024-09-16T01:21:52.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.205+0000 7fdd483e4640 1 -- start start 2024-09-16T01:21:52.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.206+0000 7fdd483e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd400b5fe0 0x7fdd400aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.206+0000 7fdd483e4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdd4006bc10 0x7fdd4006c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.206+0000 7fdd483e4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd400ae240 con 0x7fdd4015e410 2024-09-16T01:21:52.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.206+0000 7fdd483e4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fdd400b6430 con 0x7fdd4006bc10 2024-09-16T01:21:52.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.206+0000 7fdd483e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4006c580 con 0x7fdd400b5fe0 2024-09-16T01:21:52.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.206+0000 7fdd46180640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdd4015e410 0x7fdd400b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52530/0 (socket says 172.21.15.81:52530) 2024-09-16T01:21:52.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.206+0000 7fdd46180640 1 -- 172.21.15.81:0/1007143351 learned_addr learned my addr 172.21.15.81:0/1007143351 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:52.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.206+0000 7fdd46981640 1 --2- 172.21.15.81:0/1007143351 >> v2:172.21.15.102:3300/0 conn(0x7fdd4006bc10 0x7fdd4006c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.206+0000 7fdd4597f640 1 --2- 172.21.15.81:0/1007143351 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd400b5fe0 0x7fdd400aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.206+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4081162546 0 0) 0x7fdd400ae240 con 0x7fdd4015e410 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.206+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd2c003520 con 0x7fdd4015e410 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1370646523 0 0) 0x7fdd2c003520 con 0x7fdd4015e410 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd400b5fe0 msgr2=0x7fdd400aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 --2- 172.21.15.81:0/1007143351 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd400b5fe0 0x7fdd400aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 >> v2:172.21.15.102:3300/0 conn(0x7fdd4006bc10 msgr2=0x7fdd4006c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 --2- 172.21.15.81:0/1007143351 >> v2:172.21.15.102:3300/0 conn(0x7fdd4006bc10 0x7fdd4006c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd400ae520 con 0x7fdd4015e410 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fdd3c001670 con 0x7fdd4015e410 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 >> v1:172.21.15.81:6789/0 conn(0x7fdd4015e410 legacy=0x7fdd400b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 --2- 172.21.15.81:0/1007143351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c0039e0 0x7fdd2c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 --2- 172.21.15.81:0/1007143351 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd400b5fe0 0x7fdd2c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 --2- 172.21.15.81:0/1007143351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c004d40 0x7fdd2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4006c580 con 0x7fdd2c004d40 2024-09-16T01:21:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c00b9c0 con 0x7fdd2c0039e0 2024-09-16T01:21:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdd2c00bb90 con 0x7fdd400b5fe0 2024-09-16T01:21:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd46981640 1 --2- 172.21.15.81:0/1007143351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c004d40 0x7fdd2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd4597f640 1 --2- 172.21.15.81:0/1007143351 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd400b5fe0 0x7fdd2c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd46180640 1 --2- 172.21.15.81:0/1007143351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c0039e0 0x7fdd2c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd46981640 1 -- 172.21.15.81:0/1007143351 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd400b5fe0 msgr2=0x7fdd2c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd46981640 1 --2- 172.21.15.81:0/1007143351 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd400b5fe0 0x7fdd2c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd46981640 1 -- 172.21.15.81:0/1007143351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c0039e0 msgr2=0x7fdd2c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd46981640 1 --2- 172.21.15.81:0/1007143351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd2c0039e0 0x7fdd2c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.207+0000 7fdd46981640 1 -- 172.21.15.81:0/1007143351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c003520 con 0x7fdd2c004d40 2024-09-16T01:21:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.208+0000 7fdd46981640 1 --2- 172.21.15.81:0/1007143351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c004d40 0x7fdd2c0051c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800e170 tx=0x7fdd2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e39e3645c188935 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.208+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38034020 con 0x7fdd2c004d40 2024-09-16T01:21:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.208+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd38030430 con 0x7fdd2c004d40 2024-09-16T01:21:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.208+0000 7fdd4517e640 1 -- 172.21.15.81:0/1007143351 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd38009c10 con 0x7fdd2c004d40 2024-09-16T01:21:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.209+0000 7fdd483e4640 1 -- 172.21.15.81:0/1007143351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c004d40 msgr2=0x7fdd2c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.209+0000 7fdd483e4640 1 --2- 172.21.15.81:0/1007143351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c004d40 0x7fdd2c0051c0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800e170 tx=0x7fdd2c005830 comp rx=0 tx=0).stop 2024-09-16T01:21:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.209+0000 7fdd46981640 1 -- 172.21.15.81:0/1007143351 reap_dead start 2024-09-16T01:21:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.209+0000 7fdd483e4640 1 -- 172.21.15.81:0/1007143351 shutdown_connections 2024-09-16T01:21:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.209+0000 7fdd483e4640 1 -- 172.21.15.81:0/1007143351 >> 172.21.15.81:0/1007143351 conn(0x7fdd4009aa30 msgr2=0x7fdd400b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.209+0000 7fdd483e4640 1 -- 172.21.15.81:0/1007143351 shutdown_connections 2024-09-16T01:21:52.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.209+0000 7fdd483e4640 1 -- 172.21.15.81:0/1007143351 wait complete. 2024-09-16T01:21:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.210+0000 7fdd483e4640 1 Processor -- start 2024-09-16T01:21:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.210+0000 7fdd483e4640 1 -- start start 2024-09-16T01:21:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd483e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c004d40 0x7fdd4015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd483e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd4015fb70 0x7fdd401f7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd483e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd4014f0d0 0x7fdd4014f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd483e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4015e7f0 con 0x7fdd2c004d40 2024-09-16T01:21:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd483e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdd400aeae0 con 0x7fdd4015fb70 2024-09-16T01:21:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd483e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4015e970 con 0x7fdd4014f0d0 2024-09-16T01:21:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd46180640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c004d40 0x7fdd4015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd46180640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c004d40 0x7fdd4015d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51404/0 (socket says 172.21.15.81:51404) 2024-09-16T01:21:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd46180640 1 -- 172.21.15.81:0/3703915812 learned_addr learned my addr 172.21.15.81:0/3703915812 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd46180640 1 -- 172.21.15.81:0/3703915812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd4014f0d0 msgr2=0x7fdd4014f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd4597f640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd4015fb70 0x7fdd401f7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd46981640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd4014f0d0 0x7fdd4014f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd46180640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd4014f0d0 0x7fdd4014f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd46180640 1 -- 172.21.15.81:0/3703915812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd4015fb70 msgr2=0x7fdd401f7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd46180640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd4015fb70 0x7fdd401f7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd46180640 1 -- 172.21.15.81:0/3703915812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4014faa0 con 0x7fdd2c004d40 2024-09-16T01:21:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd4597f640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd4015fb70 0x7fdd401f7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd46180640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c004d40 0x7fdd4015d1a0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c007290 tx=0x7fdd3c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd36ffd640 1 -- 172.21.15.81:0/3703915812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c00f8e0 con 0x7fdd2c004d40 2024-09-16T01:21:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd36ffd640 1 -- 172.21.15.81:0/3703915812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd3c018070 con 0x7fdd2c004d40 2024-09-16T01:21:52.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd36ffd640 1 -- 172.21.15.81:0/3703915812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c00fcc0 con 0x7fdd2c004d40 2024-09-16T01:21:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd483e4640 1 -- 172.21.15.81:0/3703915812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd400cd230 con 0x7fdd2c004d40 2024-09-16T01:21:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.211+0000 7fdd483e4640 1 -- 172.21.15.81:0/3703915812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4015ac40 con 0x7fdd2c004d40 2024-09-16T01:21:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.212+0000 7fdd483e4640 1 -- 172.21.15.81:0/3703915812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4006c040 con 0x7fdd2c004d40 2024-09-16T01:21:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.213+0000 7fdd36ffd640 1 -- 172.21.15.81:0/3703915812 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdd3c01d460 con 0x7fdd2c004d40 2024-09-16T01:21:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.213+0000 7fdd36ffd640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd2406c2b0 0x7fdd2406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.213+0000 7fdd36ffd640 1 -- 172.21.15.81:0/3703915812 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 6187+0+0 (secure 0 0 0) 0x7fdd3c08b640 con 0x7fdd2c004d40 2024-09-16T01:21:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.213+0000 7fdd4597f640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd2406c2b0 0x7fdd2406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.214+0000 7fdd4597f640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd2406c2b0 0x7fdd2406e770 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009ab0 tx=0x7fdd30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:52.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.218+0000 7fdd36ffd640 1 -- 172.21.15.81:0/3703915812 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd3c00fe60 con 0x7fdd2c004d40 2024-09-16T01:21:52.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:52.384+0000 7fdd483e4640 1 -- 172.21.15.81:0/3703915812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdd400af380 con 0x7fdd2c004d40 2024-09-16T01:21:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.042+0000 7fdd36ffd640 1 -- 172.21.15.81:0/3703915812 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v103) ==== 181+0+0 (secure 0 0 0) 0x7fdd3c059be0 con 0x7fdd2c004d40 2024-09-16T01:21:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:21:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.045+0000 7fdd483e4640 1 -- 172.21.15.81:0/3703915812 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd2406c2b0 msgr2=0x7fdd2406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.045+0000 7fdd483e4640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd2406c2b0 0x7fdd2406e770 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009ab0 tx=0x7fdd30008040 comp rx=0 tx=0).stop 2024-09-16T01:21:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.045+0000 7fdd483e4640 1 -- 172.21.15.81:0/3703915812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c004d40 msgr2=0x7fdd4015d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.045+0000 7fdd483e4640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c004d40 0x7fdd4015d1a0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c007290 tx=0x7fdd3c007750 comp rx=0 tx=0).stop 2024-09-16T01:21:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.045+0000 7fdd483e4640 1 -- 172.21.15.81:0/3703915812 shutdown_connections 2024-09-16T01:21:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.045+0000 7fdd483e4640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd2406c2b0 0x7fdd2406e770 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.045+0000 7fdd483e4640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd4014f0d0 0x7fdd4014f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.045+0000 7fdd483e4640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd4015fb70 0x7fdd401f7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.045+0000 7fdd483e4640 1 --2- 172.21.15.81:0/3703915812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd2c004d40 0x7fdd4015d1a0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.045+0000 7fdd483e4640 1 -- 172.21.15.81:0/3703915812 >> 172.21.15.81:0/3703915812 conn(0x7fdd4009aa30 msgr2=0x7fdd400af660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.045+0000 7fdd483e4640 1 -- 172.21.15.81:0/3703915812 shutdown_connections 2024-09-16T01:21:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.045+0000 7fdd483e4640 1 -- 172.21.15.81:0/3703915812 wait complete. 2024-09-16T01:21:53.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:21:53.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.163+0000 7f53d41e4640 1 Processor -- start 2024-09-16T01:21:53.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.163+0000 7f53d41e4640 1 -- start start 2024-09-16T01:21:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d41e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53cc15e7f0 0x7f53cc0b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d41e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53cc0af210 0x7f53cc070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d41e4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f53cc0b7250 0x7f53cc070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d41e4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f53cc06cdc0 con 0x7f53cc0af210 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d41e4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f53cc06d0a0 con 0x7f53cc0b7250 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d41e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f53cc06d380 con 0x7f53cc15e7f0 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d177f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53cc0af210 0x7f53cc070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d177f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f53cc0af210 0x7f53cc070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51406/0 (socket says 172.21.15.81:51406) 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d177f640 1 -- 172.21.15.81:0/1993592259 learned_addr learned my addr 172.21.15.81:0/1993592259 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d2781640 1 --2- 172.21.15.81:0/1993592259 >> v2:172.21.15.102:3300/0 conn(0x7f53cc0b7250 0x7f53cc070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d1f80640 1 --2- 172.21.15.81:0/1993592259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53cc15e7f0 0x7f53cc0b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d177f640 1 -- 172.21.15.81:0/1993592259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53cc15e7f0 msgr2=0x7f53cc0b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d177f640 1 --2- 172.21.15.81:0/1993592259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53cc15e7f0 0x7f53cc0b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d177f640 1 -- 172.21.15.81:0/1993592259 >> v2:172.21.15.102:3300/0 conn(0x7f53cc0b7250 msgr2=0x7f53cc070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d177f640 1 --2- 172.21.15.81:0/1993592259 >> v2:172.21.15.102:3300/0 conn(0x7f53cc0b7250 0x7f53cc070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d177f640 1 -- 172.21.15.81:0/1993592259 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53cc06d660 con 0x7f53cc0af210 2024-09-16T01:21:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.164+0000 7f53d2781640 1 --2- 172.21.15.81:0/1993592259 >> v2:172.21.15.102:3300/0 conn(0x7f53cc0b7250 0x7f53cc070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.165+0000 7f53d177f640 1 --2- 172.21.15.81:0/1993592259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc0af210 0x7f53cc070a70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f53cc09bfc0 tx=0x7f53bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a949f51d47d16c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.165+0000 7f53d0f7e640 1 -- 172.21.15.81:0/1993592259 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc037070 con 0x7f53cc0af210 2024-09-16T01:21:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.165+0000 7f53d0f7e640 1 -- 172.21.15.81:0/1993592259 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53bc032440 con 0x7f53cc0af210 2024-09-16T01:21:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.165+0000 7f53d0f7e640 1 -- 172.21.15.81:0/1993592259 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc032810 con 0x7f53cc0af210 2024-09-16T01:21:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.166+0000 7f53d41e4640 1 -- 172.21.15.81:0/1993592259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc0af210 msgr2=0x7f53cc070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.166+0000 7f53d41e4640 1 --2- 172.21.15.81:0/1993592259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc0af210 0x7f53cc070a70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f53cc09bfc0 tx=0x7f53bc02a1e0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.166+0000 7f53d41e4640 1 -- 172.21.15.81:0/1993592259 shutdown_connections 2024-09-16T01:21:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.166+0000 7f53d41e4640 1 --2- 172.21.15.81:0/1993592259 >> v2:172.21.15.102:3300/0 conn(0x7f53cc0b7250 0x7f53cc070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.166+0000 7f53d41e4640 1 --2- 172.21.15.81:0/1993592259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc0af210 0x7f53cc070a70 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.166+0000 7f53d41e4640 1 --2- 172.21.15.81:0/1993592259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53cc15e7f0 0x7f53cc0b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.166+0000 7f53d41e4640 1 -- 172.21.15.81:0/1993592259 >> 172.21.15.81:0/1993592259 conn(0x7f53cc0b3f30 msgr2=0x7f53cc0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:53.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.166+0000 7f53d41e4640 1 -- 172.21.15.81:0/1993592259 shutdown_connections 2024-09-16T01:21:53.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.166+0000 7f53d41e4640 1 -- 172.21.15.81:0/1993592259 wait complete. 2024-09-16T01:21:53.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.167+0000 7f53d41e4640 1 Processor -- start 2024-09-16T01:21:53.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.167+0000 7f53d41e4640 1 -- start start 2024-09-16T01:21:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d41e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc0af210 0x7f53cc159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d41e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53cc0b7250 0x7f53cc147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d41e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53cc15e7f0 0x7f53cc0af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d41e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc09aa30 con 0x7f53cc0af210 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d41e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc0b6150 con 0x7f53cc15e7f0 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d41e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f53cc09abb0 con 0x7f53cc0b7250 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d1f80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc0af210 0x7f53cc159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d1f80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc0af210 0x7f53cc159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51408/0 (socket says 172.21.15.81:51408) 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d1f80640 1 -- 172.21.15.81:0/1976550744 learned_addr learned my addr 172.21.15.81:0/1976550744 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d177f640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53cc0b7250 0x7f53cc147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d2781640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53cc15e7f0 0x7f53cc0af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d1f80640 1 -- 172.21.15.81:0/1976550744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53cc0b7250 msgr2=0x7f53cc147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d1f80640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53cc0b7250 0x7f53cc147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d1f80640 1 -- 172.21.15.81:0/1976550744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53cc15e7f0 msgr2=0x7f53cc0af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d1f80640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53cc15e7f0 0x7f53cc0af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d1f80640 1 -- 172.21.15.81:0/1976550744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53cc159970 con 0x7f53cc0af210 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d177f640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53cc0b7250 0x7f53cc147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d2781640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53cc15e7f0 0x7f53cc0af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53d1f80640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc0af210 0x7f53cc159120 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f53c8007e70 tx=0x7f53c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.168+0000 7f53c27fc640 1 -- 172.21.15.81:0/1976550744 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8014620 con 0x7f53cc0af210 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.169+0000 7f53c27fc640 1 -- 172.21.15.81:0/1976550744 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c8019070 con 0x7f53cc0af210 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.169+0000 7f53c27fc640 1 -- 172.21.15.81:0/1976550744 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c8014a00 con 0x7f53cc0af210 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.169+0000 7f53d41e4640 1 -- 172.21.15.81:0/1976550744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53cc156370 con 0x7f53cc0af210 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.169+0000 7f53d41e4640 1 -- 172.21.15.81:0/1976550744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53cc159660 con 0x7f53cc0af210 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.169+0000 7f53d41e4640 1 -- 172.21.15.81:0/1976550744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53cc0b6d10 con 0x7f53cc0af210 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.170+0000 7f53c27fc640 1 -- 172.21.15.81:0/1976550744 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f53c8014ba0 con 0x7f53cc0af210 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.170+0000 7f53c27fc640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f53b006c2b0 0x7f53b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.171+0000 7f53c27fc640 1 -- 172.21.15.81:0/1976550744 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5749+0+0 (secure 0 0 0) 0x7f53c808bd10 con 0x7f53cc0af210 2024-09-16T01:21:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.171+0000 7f53d177f640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f53b006c2b0 0x7f53b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.171+0000 7f53d177f640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f53b006c2b0 0x7f53b006e770 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f53bc034000 tx=0x7f53bc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.175+0000 7f53c27fc640 1 -- 172.21.15.81:0/1976550744 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53c805a450 con 0x7f53cc0af210 2024-09-16T01:21:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:53.341+0000 7f53d41e4640 1 -- 172.21.15.81:0/1976550744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f53cc070e80 con 0x7f53cc0af210 2024-09-16T01:21:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.044+0000 7f53c27fc640 1 -- 172.21.15.81:0/1976550744 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v104) ==== 169+0+0 (secure 0 0 0) 0x7f53c8059d50 con 0x7f53cc0af210 2024-09-16T01:21:54.045 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-16T01:21:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.046+0000 7f53d41e4640 1 -- 172.21.15.81:0/1976550744 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f53b006c2b0 msgr2=0x7f53b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.046+0000 7f53d41e4640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f53b006c2b0 0x7f53b006e770 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f53bc034000 tx=0x7f53bc02e000 comp rx=0 tx=0).stop 2024-09-16T01:21:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.046+0000 7f53d41e4640 1 -- 172.21.15.81:0/1976550744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc0af210 msgr2=0x7f53cc159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.046+0000 7f53d41e4640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc0af210 0x7f53cc159120 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f53c8007e70 tx=0x7f53c800e4b0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.046+0000 7f53d41e4640 1 -- 172.21.15.81:0/1976550744 shutdown_connections 2024-09-16T01:21:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.046+0000 7f53d41e4640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f53b006c2b0 0x7f53b006e770 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.046+0000 7f53d41e4640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53cc15e7f0 0x7f53cc0af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.046+0000 7f53d41e4640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f53cc0b7250 0x7f53cc147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.046+0000 7f53d41e4640 1 --2- 172.21.15.81:0/1976550744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc0af210 0x7f53cc159120 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.046+0000 7f53d41e4640 1 -- 172.21.15.81:0/1976550744 >> 172.21.15.81:0/1976550744 conn(0x7f53cc0b3f30 msgr2=0x7f53cc0b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.046+0000 7f53d41e4640 1 -- 172.21.15.81:0/1976550744 shutdown_connections 2024-09-16T01:21:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.046+0000 7f53d41e4640 1 -- 172.21.15.81:0/1976550744 wait complete. 2024-09-16T01:21:54.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-16T01:21:54.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.161+0000 7feb6ca77640 1 Processor -- start 2024-09-16T01:21:54.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.161+0000 7feb6ca77640 1 -- start start 2024-09-16T01:21:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.162+0000 7feb6ca77640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb681621f0 0x7feb6815fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.162+0000 7feb6ca77640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feb681625d0 0x7feb680d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.162+0000 7feb6ca77640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb680d09c0 0x7feb68070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.162+0000 7feb6ca77640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7feb680702f0 con 0x7feb681621f0 2024-09-16T01:21:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.162+0000 7feb6ca77640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7feb680d1040 con 0x7feb681625d0 2024-09-16T01:21:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.162+0000 7feb6ca77640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feb680d1320 con 0x7feb680d09c0 2024-09-16T01:21:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.162+0000 7feb6659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb681621f0 0x7feb6815fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.162+0000 7feb6659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb681621f0 0x7feb6815fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51410/0 (socket says 172.21.15.81:51410) 2024-09-16T01:21:54.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.162+0000 7feb6659c640 1 -- 172.21.15.81:0/1787111059 learned_addr learned my addr 172.21.15.81:0/1787111059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.163+0000 7feb66d9d640 1 --2- 172.21.15.81:0/1787111059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb680d09c0 0x7feb68070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.163+0000 7feb5dd9b640 1 --2- 172.21.15.81:0/1787111059 >> v2:172.21.15.102:3300/0 conn(0x7feb681625d0 0x7feb680d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.163+0000 7feb6659c640 1 -- 172.21.15.81:0/1787111059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb680d09c0 msgr2=0x7feb68070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.163+0000 7feb6659c640 1 --2- 172.21.15.81:0/1787111059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb680d09c0 0x7feb68070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.163+0000 7feb6659c640 1 -- 172.21.15.81:0/1787111059 >> v2:172.21.15.102:3300/0 conn(0x7feb681625d0 msgr2=0x7feb680d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.163+0000 7feb6659c640 1 --2- 172.21.15.81:0/1787111059 >> v2:172.21.15.102:3300/0 conn(0x7feb681625d0 0x7feb680d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.163+0000 7feb6659c640 1 -- 172.21.15.81:0/1787111059 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb680d1600 con 0x7feb681621f0 2024-09-16T01:21:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.163+0000 7feb6659c640 1 --2- 172.21.15.81:0/1787111059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb681621f0 0x7feb6815fff0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7feb68073fd0 tx=0x7feb5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d064e823e00efa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.163+0000 7feb65d9b640 1 -- 172.21.15.81:0/1787111059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58037070 con 0x7feb681621f0 2024-09-16T01:21:54.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.163+0000 7feb65d9b640 1 -- 172.21.15.81:0/1787111059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb58032440 con 0x7feb681621f0 2024-09-16T01:21:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.164+0000 7feb65d9b640 1 -- 172.21.15.81:0/1787111059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58032810 con 0x7feb681621f0 2024-09-16T01:21:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.164+0000 7feb6ca77640 1 -- 172.21.15.81:0/1787111059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb681621f0 msgr2=0x7feb6815fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.164+0000 7feb6ca77640 1 --2- 172.21.15.81:0/1787111059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb681621f0 0x7feb6815fff0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7feb68073fd0 tx=0x7feb5802a270 comp rx=0 tx=0).stop 2024-09-16T01:21:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.164+0000 7feb6ca77640 1 -- 172.21.15.81:0/1787111059 shutdown_connections 2024-09-16T01:21:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.164+0000 7feb6ca77640 1 --2- 172.21.15.81:0/1787111059 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb680d09c0 0x7feb68070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.164+0000 7feb6ca77640 1 --2- 172.21.15.81:0/1787111059 >> v2:172.21.15.102:3300/0 conn(0x7feb681625d0 0x7feb680d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.164+0000 7feb6ca77640 1 --2- 172.21.15.81:0/1787111059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb681621f0 0x7feb6815fff0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.164+0000 7feb6ca77640 1 -- 172.21.15.81:0/1787111059 >> 172.21.15.81:0/1787111059 conn(0x7feb680b3de0 msgr2=0x7feb680b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.164+0000 7feb6ca77640 1 -- 172.21.15.81:0/1787111059 shutdown_connections 2024-09-16T01:21:54.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.164+0000 7feb6ca77640 1 -- 172.21.15.81:0/1787111059 wait complete. 2024-09-16T01:21:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.166+0000 7feb6ca77640 1 Processor -- start 2024-09-16T01:21:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.166+0000 7feb6ca77640 1 -- start start 2024-09-16T01:21:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.166+0000 7feb6ca77640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb680d09c0 0x7feb681e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.166+0000 7feb6ca77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb681621f0 0x7feb6815d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.166+0000 7feb6ca77640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb681625d0 0x7feb6809f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.166+0000 7feb6ca77640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feb68162a10 con 0x7feb681621f0 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.166+0000 7feb6ca77640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feb68070cc0 con 0x7feb681625d0 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.166+0000 7feb6ca77640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feb6815fb30 con 0x7feb680d09c0 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.166+0000 7feb5dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb681621f0 0x7feb6815d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.166+0000 7feb5dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb681621f0 0x7feb6815d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51418/0 (socket says 172.21.15.81:51418) 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.166+0000 7feb5dd9b640 1 -- 172.21.15.81:0/2051979747 learned_addr learned my addr 172.21.15.81:0/2051979747 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb6659c640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb680d09c0 0x7feb681e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb66d9d640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb681625d0 0x7feb6809f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb5dd9b640 1 -- 172.21.15.81:0/2051979747 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb680d09c0 msgr2=0x7feb681e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb5dd9b640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb680d09c0 0x7feb681e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb5dd9b640 1 -- 172.21.15.81:0/2051979747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb681625d0 msgr2=0x7feb6809f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:54.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb5dd9b640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb681625d0 0x7feb6809f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb5dd9b640 1 -- 172.21.15.81:0/2051979747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb681ea3d0 con 0x7feb681621f0 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb5dd9b640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb681621f0 0x7feb6815d920 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7feb5000d5f0 tx=0x7feb5000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb5f7fe640 1 -- 172.21.15.81:0/2051979747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb500125f0 con 0x7feb681621f0 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb5f7fe640 1 -- 172.21.15.81:0/2051979747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb50019070 con 0x7feb681621f0 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb6ca77640 1 -- 172.21.15.81:0/2051979747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb681ea6b0 con 0x7feb681621f0 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb5f7fe640 1 -- 172.21.15.81:0/2051979747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb500129d0 con 0x7feb681621f0 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.167+0000 7feb6ca77640 1 -- 172.21.15.81:0/2051979747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb681eac70 con 0x7feb681621f0 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.168+0000 7feb6ca77640 1 -- 172.21.15.81:0/2051979747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb6809b8c0 con 0x7feb681621f0 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.169+0000 7feb5f7fe640 1 -- 172.21.15.81:0/2051979747 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feb50012b70 con 0x7feb681621f0 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.169+0000 7feb5f7fe640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7feb4806c2b0 0x7feb4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.169+0000 7feb6659c640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7feb4806c2b0 0x7feb4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.169+0000 7feb5f7fe640 1 -- 172.21.15.81:0/2051979747 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7feb5008b4a0 con 0x7feb681621f0 2024-09-16T01:21:54.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.170+0000 7feb6659c640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7feb4806c2b0 0x7feb4806e770 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7feb58034000 tx=0x7feb5802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:54.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.174+0000 7feb5f7fe640 1 -- 172.21.15.81:0/2051979747 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb6809b8c0 con 0x7feb681621f0 2024-09-16T01:21:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.338+0000 7feb6ca77640 1 -- 172.21.15.81:0/2051979747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7feb680b4cf0 con 0x7feb681621f0 2024-09-16T01:21:54.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.343+0000 7feb5f7fe640 1 -- 172.21.15.81:0/2051979747 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7feb500597c0 con 0x7feb681621f0 2024-09-16T01:21:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.345+0000 7feb6ca77640 1 -- 172.21.15.81:0/2051979747 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7feb4806c2b0 msgr2=0x7feb4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.345+0000 7feb6ca77640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7feb4806c2b0 0x7feb4806e770 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7feb58034000 tx=0x7feb5802e000 comp rx=0 tx=0).stop 2024-09-16T01:21:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.345+0000 7feb6ca77640 1 -- 172.21.15.81:0/2051979747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb681621f0 msgr2=0x7feb6815d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.345+0000 7feb6ca77640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb681621f0 0x7feb6815d920 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7feb5000d5f0 tx=0x7feb5000dab0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.345+0000 7feb6ca77640 1 -- 172.21.15.81:0/2051979747 shutdown_connections 2024-09-16T01:21:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.345+0000 7feb6ca77640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7feb4806c2b0 0x7feb4806e770 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.345+0000 7feb6ca77640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb681625d0 0x7feb6809f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.345+0000 7feb6ca77640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb681621f0 0x7feb6815d920 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.345+0000 7feb6ca77640 1 --2- 172.21.15.81:0/2051979747 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb680d09c0 0x7feb681e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.345+0000 7feb6ca77640 1 -- 172.21.15.81:0/2051979747 >> 172.21.15.81:0/2051979747 conn(0x7feb680b3de0 msgr2=0x7feb6806e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.346+0000 7feb6ca77640 1 -- 172.21.15.81:0/2051979747 shutdown_connections 2024-09-16T01:21:54.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.346+0000 7feb6ca77640 1 -- 172.21.15.81:0/2051979747 wait complete. 2024-09-16T01:21:54.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid' 2024-09-16T01:21:54.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.456+0000 7f49b8d4b640 1 Processor -- start 2024-09-16T01:21:54.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.456+0000 7f49b8d4b640 1 -- start start 2024-09-16T01:21:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b8d4b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49b40d06e0 0x7f49b40ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b8d4b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f49b409b510 0x7f49b409b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b8d4b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49b40d00a0 con 0x7f49b415d3e0 2024-09-16T01:21:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b8d4b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f49b409b080 con 0x7f49b409b510 2024-09-16T01:21:54.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b8d4b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f49b40d0380 con 0x7f49b40d06e0 2024-09-16T01:21:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b2d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f49b409b510 0x7f49b409b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b1d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f49b415d3e0 0x7f49b40d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52532/0 (socket says 172.21.15.81:52532) 2024-09-16T01:21:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b2d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f49b409b510 0x7f49b409b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51424/0 (socket says 172.21.15.81:51424) 2024-09-16T01:21:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b1d9b640 1 -- 172.21.15.81:0/1725251093 learned_addr learned my addr 172.21.15.81:0/1725251093 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b259c640 1 --2- 172.21.15.81:0/1725251093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49b40d06e0 0x7f49b40ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b2d9d640 1 -- 172.21.15.81:0/1725251093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49b40d06e0 msgr2=0x7f49b40ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b2d9d640 1 --2- 172.21.15.81:0/1725251093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49b40d06e0 0x7f49b40ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b2d9d640 1 -- 172.21.15.81:0/1725251093 >> v1:172.21.15.81:6789/0 conn(0x7f49b415d3e0 legacy=0x7f49b40d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b2d9d640 1 -- 172.21.15.81:0/1725251093 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b409aa30 con 0x7f49b409b510 2024-09-16T01:21:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.457+0000 7f49b159a640 1 -- 172.21.15.81:0/1725251093 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508300412 0 0) 0x7f49b40d00a0 con 0x7f49b415d3e0 2024-09-16T01:21:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.458+0000 7f49b2d9d640 1 --2- 172.21.15.81:0/1725251093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49b409b510 0x7f49b409b9c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f49a40097a0 tx=0x7f49a402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2838e30b3ca0eebc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.458+0000 7f49b159a640 1 -- 172.21.15.81:0/1725251093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4037070 con 0x7f49b409b510 2024-09-16T01:21:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.458+0000 7f49b159a640 1 -- 172.21.15.81:0/1725251093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a4032440 con 0x7f49b409b510 2024-09-16T01:21:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.458+0000 7f49b159a640 1 -- 172.21.15.81:0/1725251093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4032810 con 0x7f49b409b510 2024-09-16T01:21:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.459+0000 7f49b8d4b640 1 -- 172.21.15.81:0/1725251093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49b409b510 msgr2=0x7f49b409b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.459+0000 7f49b8d4b640 1 --2- 172.21.15.81:0/1725251093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49b409b510 0x7f49b409b9c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f49a40097a0 tx=0x7f49a402a180 comp rx=0 tx=0).stop 2024-09-16T01:21:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.459+0000 7f49b8d4b640 1 -- 172.21.15.81:0/1725251093 shutdown_connections 2024-09-16T01:21:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.459+0000 7f49b8d4b640 1 --2- 172.21.15.81:0/1725251093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49b409b510 0x7f49b409b9c0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.459+0000 7f49b8d4b640 1 --2- 172.21.15.81:0/1725251093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49b40d06e0 0x7f49b40ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.459+0000 7f49b8d4b640 1 -- 172.21.15.81:0/1725251093 >> 172.21.15.81:0/1725251093 conn(0x7f49b40d23a0 msgr2=0x7f49b40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:54.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.459+0000 7f49b8d4b640 1 -- 172.21.15.81:0/1725251093 shutdown_connections 2024-09-16T01:21:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.459+0000 7f49b8d4b640 1 -- 172.21.15.81:0/1725251093 wait complete. 2024-09-16T01:21:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.460+0000 7f49b8d4b640 1 Processor -- start 2024-09-16T01:21:54.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.460+0000 7f49b8d4b640 1 -- start start 2024-09-16T01:21:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b8d4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49b409b510 0x7f49b40c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b8d4b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49b40d06e0 0x7f49b40c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b8d4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b415d3e0 0x7f49b414d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b8d4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f49b415c740 con 0x7f49b409b510 2024-09-16T01:21:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b8d4b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f49b415d800 con 0x7f49b415d3e0 2024-09-16T01:21:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b8d4b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f49b40ccf90 con 0x7f49b40d06e0 2024-09-16T01:21:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49b409b510 0x7f49b40c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49b409b510 0x7f49b40c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51440/0 (socket says 172.21.15.81:51440) 2024-09-16T01:21:54.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b259c640 1 -- 172.21.15.81:0/414787188 learned_addr learned my addr 172.21.15.81:0/414787188 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b259c640 1 -- 172.21.15.81:0/414787188 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49b40d06e0 msgr2=0x7f49b40c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b259c640 1 --2- 172.21.15.81:0/414787188 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49b40d06e0 0x7f49b40c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b259c640 1 -- 172.21.15.81:0/414787188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b415d3e0 msgr2=0x7f49b414d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b259c640 1 --2- 172.21.15.81:0/414787188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b415d3e0 0x7f49b414d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b259c640 1 -- 172.21.15.81:0/414787188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b40cc1a0 con 0x7f49b409b510 2024-09-16T01:21:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b259c640 1 --2- 172.21.15.81:0/414787188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49b409b510 0x7f49b40c6b30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f49ac007ef0 tx=0x7f49ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49aaffd640 1 -- 172.21.15.81:0/414787188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac014620 con 0x7f49b409b510 2024-09-16T01:21:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49aaffd640 1 -- 172.21.15.81:0/414787188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49ac019070 con 0x7f49b409b510 2024-09-16T01:21:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b8d4b640 1 -- 172.21.15.81:0/414787188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b40c6050 con 0x7f49b409b510 2024-09-16T01:21:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49aaffd640 1 -- 172.21.15.81:0/414787188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ac014a00 con 0x7f49b409b510 2024-09-16T01:21:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.461+0000 7f49b8d4b640 1 -- 172.21.15.81:0/414787188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b40c6610 con 0x7f49b409b510 2024-09-16T01:21:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.462+0000 7f49b8d4b640 1 -- 172.21.15.81:0/414787188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49b40d00a0 con 0x7f49b409b510 2024-09-16T01:21:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.463+0000 7f49aaffd640 1 -- 172.21.15.81:0/414787188 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f49ac014ba0 con 0x7f49b409b510 2024-09-16T01:21:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.463+0000 7f49aaffd640 1 --2- 172.21.15.81:0/414787188 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f499406c2b0 0x7f499406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.463+0000 7f49aaffd640 1 -- 172.21.15.81:0/414787188 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7f49ac08bc30 con 0x7f49b409b510 2024-09-16T01:21:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.463+0000 7f49b1d9b640 1 --2- 172.21.15.81:0/414787188 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f499406c2b0 0x7f499406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.464+0000 7f49b1d9b640 1 --2- 172.21.15.81:0/414787188 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f499406c2b0 0x7f499406e770 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f49b415bae0 tx=0x7f499c007980 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:54.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.468+0000 7f49aaffd640 1 -- 172.21.15.81:0/414787188 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49ac05a510 con 0x7f49b409b510 2024-09-16T01:21:54.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:54.696+0000 7f49b8d4b640 1 -- 172.21.15.81:0/414787188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]} v 0) -- 0x7f49b40d31d0 con 0x7f49b409b510 2024-09-16T01:21:55.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.059+0000 7f49aaffd640 1 -- 172.21.15.81:0/414787188 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]}]=0 v312) ==== 150+0+0 (secure 0 0 0) 0x7f49ac059e10 con 0x7f49b409b510 2024-09-16T01:21:55.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.061+0000 7f49b8d4b640 1 -- 172.21.15.81:0/414787188 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f499406c2b0 msgr2=0x7f499406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.061+0000 7f49b8d4b640 1 --2- 172.21.15.81:0/414787188 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f499406c2b0 0x7f499406e770 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f49b415bae0 tx=0x7f499c007980 comp rx=0 tx=0).stop 2024-09-16T01:21:55.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.061+0000 7f49b8d4b640 1 -- 172.21.15.81:0/414787188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49b409b510 msgr2=0x7f49b40c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.061+0000 7f49b8d4b640 1 --2- 172.21.15.81:0/414787188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49b409b510 0x7f49b40c6b30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f49ac007ef0 tx=0x7f49ac00e4b0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.061+0000 7f49b8d4b640 1 -- 172.21.15.81:0/414787188 shutdown_connections 2024-09-16T01:21:55.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.061+0000 7f49b8d4b640 1 --2- 172.21.15.81:0/414787188 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f499406c2b0 0x7f499406e770 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.061+0000 7f49b8d4b640 1 --2- 172.21.15.81:0/414787188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49b415d3e0 0x7f49b414d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.061+0000 7f49b8d4b640 1 --2- 172.21.15.81:0/414787188 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49b40d06e0 0x7f49b40c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.061+0000 7f49b8d4b640 1 --2- 172.21.15.81:0/414787188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49b409b510 0x7f49b40c6b30 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.061+0000 7f49b8d4b640 1 -- 172.21.15.81:0/414787188 >> 172.21.15.81:0/414787188 conn(0x7f49b40d23a0 msgr2=0x7f49b40afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:55.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.061+0000 7f49b8d4b640 1 -- 172.21.15.81:0/414787188 shutdown_connections 2024-09-16T01:21:55.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.061+0000 7f49b8d4b640 1 -- 172.21.15.81:0/414787188 wait complete. 2024-09-16T01:21:55.073 INFO:tasks.cephfs_test_runner:When a client does not advance its oldest tid, the MDS should notice that ... skipped 'Require FUSE client to inject client release failure' 2024-09-16T01:21:55.074 INFO:tasks.cephfs_test_runner:Starting test: test_client_pin (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-16T01:21:55.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:21:55.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.170+0000 7f4cc9d03640 1 Processor -- start 2024-09-16T01:21:55.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.170+0000 7f4cc9d03640 1 -- start start 2024-09-16T01:21:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.171+0000 7f4cc9d03640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4cc4161c80 0x7f4cc406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.171+0000 7f4cc9d03640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40b6680 0x7f4cc40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.171+0000 7f4cc9d03640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc406e870 con 0x7f4cc4162060 2024-09-16T01:21:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.171+0000 7f4cc9d03640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc406d9f0 con 0x7f4cc4161c80 2024-09-16T01:21:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.171+0000 7f4cc9d03640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc406dcd0 con 0x7f4cc40b6680 2024-09-16T01:21:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.171+0000 7f4cc2ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4cc4162060 0x7f4cc40b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52548/0 (socket says 172.21.15.81:52548) 2024-09-16T01:21:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.171+0000 7f4cc2ffd640 1 -- 172.21.15.81:0/724654728 learned_addr learned my addr 172.21.15.81:0/724654728 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc3fff640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40b6680 0x7f4cc40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc37fe640 1 --2- 172.21.15.81:0/724654728 >> v2:172.21.15.102:3300/0 conn(0x7f4cc4161c80 0x7f4cc406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2450319234 0 0) 0x7f4cb8001110 con 0x7f4cc4162060 2024-09-16T01:21:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cac003520 con 0x7f4cc4162060 2024-09-16T01:21:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3098301423 0 0) 0x7f4cac003520 con 0x7f4cc4162060 2024-09-16T01:21:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40b6680 msgr2=0x7f4cc40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40b6680 0x7f4cc40cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 >> v2:172.21.15.102:3300/0 conn(0x7f4cc4161c80 msgr2=0x7f4cc406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 --2- 172.21.15.81:0/724654728 >> v2:172.21.15.102:3300/0 conn(0x7f4cc4161c80 0x7f4cc406e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc406dfb0 con 0x7f4cc4162060 2024-09-16T01:21:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f4cb8001840 con 0x7f4cc4162060 2024-09-16T01:21:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 >> v1:172.21.15.81:6789/0 conn(0x7f4cc4162060 legacy=0x7f4cc40b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40b6680 0x7f4cac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cac003f30 0x7f4cac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cac004d40 0x7f4cac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc406d9f0 con 0x7f4cac003f30 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc406dcd0 con 0x7f4cac004d40 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4cac00b9c0 con 0x7f4cc40b6680 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc2ffd640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cac003f30 0x7f4cac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc37fe640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40b6680 0x7f4cac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc3fff640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cac004d40 0x7f4cac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc2ffd640 1 -- 172.21.15.81:0/724654728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40b6680 msgr2=0x7f4cac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc2ffd640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40b6680 0x7f4cac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc2ffd640 1 -- 172.21.15.81:0/724654728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cac004d40 msgr2=0x7f4cac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc2ffd640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cac004d40 0x7f4cac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc2ffd640 1 -- 172.21.15.81:0/724654728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac003520 con 0x7f4cac003f30 2024-09-16T01:21:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.172+0000 7f4cc37fe640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cc40b6680 0x7f4cac0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.173+0000 7f4cc2ffd640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cac003f30 0x7f4cac004800 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4162460 tx=0x7f4cac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef39127c5af8d502 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.173+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800c0e0 con 0x7f4cac003f30 2024-09-16T01:21:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.173+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb8034070 con 0x7f4cac003f30 2024-09-16T01:21:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.173+0000 7f4cc27fc640 1 -- 172.21.15.81:0/724654728 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8005d10 con 0x7f4cac003f30 2024-09-16T01:21:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.174+0000 7f4cc9d03640 1 -- 172.21.15.81:0/724654728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cac003f30 msgr2=0x7f4cac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.174+0000 7f4cc9d03640 1 --2- 172.21.15.81:0/724654728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cac003f30 0x7f4cac004800 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4162460 tx=0x7f4cac005830 comp rx=0 tx=0).stop 2024-09-16T01:21:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.174+0000 7f4cc3fff640 1 -- 172.21.15.81:0/724654728 reap_dead start 2024-09-16T01:21:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.174+0000 7f4cc9d03640 1 -- 172.21.15.81:0/724654728 shutdown_connections 2024-09-16T01:21:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.174+0000 7f4cc9d03640 1 -- 172.21.15.81:0/724654728 >> 172.21.15.81:0/724654728 conn(0x7f4cc40d44f0 msgr2=0x7f4cc40d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.174+0000 7f4cc9d03640 1 -- 172.21.15.81:0/724654728 shutdown_connections 2024-09-16T01:21:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.174+0000 7f4cc9d03640 1 -- 172.21.15.81:0/724654728 wait complete. 2024-09-16T01:21:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.175+0000 7f4cc9d03640 1 Processor -- start 2024-09-16T01:21:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.175+0000 7f4cc9d03640 1 -- start start 2024-09-16T01:21:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc9d03640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cac003f30 0x7f4cc4155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc9d03640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cc4155e70 0x7f4cc40cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc9d03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc40ccf10 0x7f4cc415e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc9d03640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc40b6b30 con 0x7f4cc40ccf10 2024-09-16T01:21:55.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc9d03640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc40d2aa0 con 0x7f4cc4155e70 2024-09-16T01:21:55.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc9d03640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc40b6cb0 con 0x7f4cac003f30 2024-09-16T01:21:55.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc40ccf10 0x7f4cc415e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc40ccf10 0x7f4cc415e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51456/0 (socket says 172.21.15.81:51456) 2024-09-16T01:21:55.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc3fff640 1 -- 172.21.15.81:0/1448565658 learned_addr learned my addr 172.21.15.81:0/1448565658 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:55.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc2ffd640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cc4155e70 0x7f4cc40cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc37fe640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cac003f30 0x7f4cc4155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc3fff640 1 -- 172.21.15.81:0/1448565658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cac003f30 msgr2=0x7f4cc4155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc3fff640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cac003f30 0x7f4cc4155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc3fff640 1 -- 172.21.15.81:0/1448565658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cc4155e70 msgr2=0x7f4cc40cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc3fff640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cc4155e70 0x7f4cc40cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc3fff640 1 -- 172.21.15.81:0/1448565658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc40cb930 con 0x7f4cc40ccf10 2024-09-16T01:21:55.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc3fff640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc40ccf10 0x7f4cc415e980 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc011490 tx=0x7f4cbc011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:55.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cabfff640 1 -- 172.21.15.81:0/1448565658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc003610 con 0x7f4cc40ccf10 2024-09-16T01:21:55.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cabfff640 1 -- 172.21.15.81:0/1448565658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc01b070 con 0x7f4cc40ccf10 2024-09-16T01:21:55.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc9d03640 1 -- 172.21.15.81:0/1448565658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc40cbc10 con 0x7f4cc40ccf10 2024-09-16T01:21:55.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cabfff640 1 -- 172.21.15.81:0/1448565658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc003a10 con 0x7f4cc40ccf10 2024-09-16T01:21:55.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.176+0000 7f4cc9d03640 1 -- 172.21.15.81:0/1448565658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc40cc1d0 con 0x7f4cc40ccf10 2024-09-16T01:21:55.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.178+0000 7f4cc9d03640 1 -- 172.21.15.81:0/1448565658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc406e330 con 0x7f4cc40ccf10 2024-09-16T01:21:55.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.178+0000 7f4cabfff640 1 -- 172.21.15.81:0/1448565658 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4cbc003bb0 con 0x7f4cc40ccf10 2024-09-16T01:21:55.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.178+0000 7f4cabfff640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4cb006c2b0 0x7f4cb006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.178+0000 7f4cabfff640 1 -- 172.21.15.81:0/1448565658 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7f4cbc08ae90 con 0x7f4cc40ccf10 2024-09-16T01:21:55.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.179+0000 7f4cc37fe640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4cb006c2b0 0x7f4cb006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.179+0000 7f4cc37fe640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4cb006c2b0 0x7f4cb006e770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009fd0 tx=0x7f4cb400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:55.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.183+0000 7f4cabfff640 1 -- 172.21.15.81:0/1448565658 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4cbc024020 con 0x7f4cc40ccf10 2024-09-16T01:21:55.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.348+0000 7f4cc9d03640 1 -- 172.21.15.81:0/1448565658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cc40b3070 con 0x7f4cc40ccf10 2024-09-16T01:21:55.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.349+0000 7f4cabfff640 1 -- 172.21.15.81:0/1448565658 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+13307 (secure 0 0 0) 0x7f4cbc059770 con 0x7f4cc40ccf10 2024-09-16T01:21:55.350 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:55.350 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":104,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:21:54.042836+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/2688004165":"2024-09-17T01:21:51.035777+0000","172.21.15.81:6835/2688004165":"2024-09-17T01:21:51.035777+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:21:55.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.351+0000 7f4cc9d03640 1 -- 172.21.15.81:0/1448565658 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4cb006c2b0 msgr2=0x7f4cb006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.351+0000 7f4cc9d03640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4cb006c2b0 0x7f4cb006e770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009fd0 tx=0x7f4cb400b040 comp rx=0 tx=0).stop 2024-09-16T01:21:55.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.351+0000 7f4cc9d03640 1 -- 172.21.15.81:0/1448565658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc40ccf10 msgr2=0x7f4cc415e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.351+0000 7f4cc9d03640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc40ccf10 0x7f4cc415e980 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc011490 tx=0x7f4cbc011950 comp rx=0 tx=0).stop 2024-09-16T01:21:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.351+0000 7f4cc9d03640 1 -- 172.21.15.81:0/1448565658 shutdown_connections 2024-09-16T01:21:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.351+0000 7f4cc9d03640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4cb006c2b0 0x7f4cb006e770 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.351+0000 7f4cc9d03640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc40ccf10 0x7f4cc415e980 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.351+0000 7f4cc9d03640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cc4155e70 0x7f4cc40cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.351+0000 7f4cc9d03640 1 --2- 172.21.15.81:0/1448565658 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4cac003f30 0x7f4cc4155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.351+0000 7f4cc9d03640 1 -- 172.21.15.81:0/1448565658 >> 172.21.15.81:0/1448565658 conn(0x7f4cc40d44f0 msgr2=0x7f4cc40b4770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.351+0000 7f4cc9d03640 1 -- 172.21.15.81:0/1448565658 shutdown_connections 2024-09-16T01:21:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.351+0000 7f4cc9d03640 1 -- 172.21.15.81:0/1448565658 wait complete. 2024-09-16T01:21:55.363 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:15:28.088452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:21:55.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:21:55.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.464+0000 7fc5d870a640 1 Processor -- start 2024-09-16T01:21:55.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.464+0000 7fc5d870a640 1 -- start start 2024-09-16T01:21:55.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.465+0000 7fc5d870a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5d015e7f0 0x7fc5d00b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.465+0000 7fc5d870a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5d00af210 0x7fc5d0070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.465+0000 7fc5d870a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5d006cdc0 con 0x7fc5d00b7250 2024-09-16T01:21:55.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.465+0000 7fc5d870a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc5d006d0a0 con 0x7fc5d015e7f0 2024-09-16T01:21:55.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.465+0000 7fc5d870a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc5d006d380 con 0x7fc5d00af210 2024-09-16T01:21:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.466+0000 7fc5d5ca5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5d00af210 0x7fc5d0070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.466+0000 7fc5d64a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5d015e7f0 0x7fc5d00b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.466+0000 7fc5d5ca5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5d00af210 0x7fc5d0070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:42718/0 (socket says 172.21.15.81:42718) 2024-09-16T01:21:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.466+0000 7fc5d6ca7640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc5d00b7250 0x7fc5d009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:42614/0 (socket says 172.21.15.81:42614) 2024-09-16T01:21:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.466+0000 7fc5d64a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc5d015e7f0 0x7fc5d00b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:48284/0 (socket says 172.21.15.81:48284) 2024-09-16T01:21:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.466+0000 7fc5d5ca5640 1 -- 172.21.15.81:0/592515485 learned_addr learned my addr 172.21.15.81:0/592515485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.466+0000 7fc5d5ca5640 1 -- 172.21.15.81:0/592515485 >> v2:172.21.15.102:3300/0 conn(0x7fc5d015e7f0 msgr2=0x7fc5d00b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:55.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.466+0000 7fc5d5ca5640 1 --2- 172.21.15.81:0/592515485 >> v2:172.21.15.102:3300/0 conn(0x7fc5d015e7f0 0x7fc5d00b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.466+0000 7fc5d5ca5640 1 -- 172.21.15.81:0/592515485 >> v1:172.21.15.102:6789/0 conn(0x7fc5d00b7250 legacy=0x7fc5d009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.466+0000 7fc5d5ca5640 1 -- 172.21.15.81:0/592515485 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d006d660 con 0x7fc5d00af210 2024-09-16T01:21:55.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.467+0000 7fc5d5ca5640 1 --2- 172.21.15.81:0/592515485 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5d00af210 0x7fc5d0070a70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009870 tx=0x7fc5c002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f75afac10ebd85a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.467+0000 7fc5d54a4640 1 -- 172.21.15.81:0/592515485 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0037070 con 0x7fc5d00af210 2024-09-16T01:21:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.467+0000 7fc5d54a4640 1 -- 172.21.15.81:0/592515485 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5c0032440 con 0x7fc5d00af210 2024-09-16T01:21:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.467+0000 7fc5d54a4640 1 -- 172.21.15.81:0/592515485 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0032810 con 0x7fc5d00af210 2024-09-16T01:21:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.467+0000 7fc5d870a640 1 -- 172.21.15.81:0/592515485 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5d00af210 msgr2=0x7fc5d0070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.467+0000 7fc5d870a640 1 --2- 172.21.15.81:0/592515485 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5d00af210 0x7fc5d0070a70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009870 tx=0x7fc5c002a270 comp rx=0 tx=0).stop 2024-09-16T01:21:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.467+0000 7fc5d870a640 1 -- 172.21.15.81:0/592515485 shutdown_connections 2024-09-16T01:21:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.467+0000 7fc5d870a640 1 --2- 172.21.15.81:0/592515485 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5d00af210 0x7fc5d0070a70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.467+0000 7fc5d870a640 1 --2- 172.21.15.81:0/592515485 >> v2:172.21.15.102:3300/0 conn(0x7fc5d015e7f0 0x7fc5d00b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.467+0000 7fc5d870a640 1 -- 172.21.15.81:0/592515485 >> 172.21.15.81:0/592515485 conn(0x7fc5d00b3f30 msgr2=0x7fc5d00b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.468+0000 7fc5d870a640 1 -- 172.21.15.81:0/592515485 shutdown_connections 2024-09-16T01:21:55.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.468+0000 7fc5d870a640 1 -- 172.21.15.81:0/592515485 wait complete. 2024-09-16T01:21:55.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.469+0000 7fc5d870a640 1 Processor -- start 2024-09-16T01:21:55.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.469+0000 7fc5d870a640 1 -- start start 2024-09-16T01:21:55.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.469+0000 7fc5d870a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d00af210 0x7fc5d01f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.469+0000 7fc5d870a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5d00b7250 0x7fc5d01519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.469+0000 7fc5d870a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5d015e7f0 0x7fc5d0154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.469+0000 7fc5d870a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d0070fb0 con 0x7fc5d00af210 2024-09-16T01:21:55.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.469+0000 7fc5d870a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc5d00b6150 con 0x7fc5d015e7f0 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.469+0000 7fc5d870a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc5d0071130 con 0x7fc5d00b7250 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d64a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d00af210 0x7fc5d01f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d64a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d00af210 0x7fc5d01f7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51458/0 (socket says 172.21.15.81:51458) 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d64a6640 1 -- 172.21.15.81:0/3319838990 learned_addr learned my addr 172.21.15.81:0/3319838990 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d5ca5640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5d00b7250 0x7fc5d01519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d6ca7640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5d015e7f0 0x7fc5d0154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d64a6640 1 -- 172.21.15.81:0/3319838990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5d00b7250 msgr2=0x7fc5d01519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d64a6640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5d00b7250 0x7fc5d01519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d64a6640 1 -- 172.21.15.81:0/3319838990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5d015e7f0 msgr2=0x7fc5d0154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d64a6640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5d015e7f0 0x7fc5d0154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d64a6640 1 -- 172.21.15.81:0/3319838990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d0155830 con 0x7fc5d00af210 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d64a6640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d00af210 0x7fc5d01f7ac0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00e9b0 tx=0x7fc5cc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5c6ffd640 1 -- 172.21.15.81:0/3319838990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc017070 con 0x7fc5d00af210 2024-09-16T01:21:55.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5c6ffd640 1 -- 172.21.15.81:0/3319838990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5cc00c9a0 con 0x7fc5d00af210 2024-09-16T01:21:55.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5c6ffd640 1 -- 172.21.15.81:0/3319838990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc00cd90 con 0x7fc5d00af210 2024-09-16T01:21:55.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d870a640 1 -- 172.21.15.81:0/3319838990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5d01f82f0 con 0x7fc5d00af210 2024-09-16T01:21:55.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.470+0000 7fc5d870a640 1 -- 172.21.15.81:0/3319838990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5d01f8000 con 0x7fc5d00af210 2024-09-16T01:21:55.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.471+0000 7fc5d870a640 1 -- 172.21.15.81:0/3319838990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5d0070a70 con 0x7fc5d00af210 2024-09-16T01:21:55.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.472+0000 7fc5c6ffd640 1 -- 172.21.15.81:0/3319838990 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc5cc01a070 con 0x7fc5d00af210 2024-09-16T01:21:55.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.472+0000 7fc5c6ffd640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc5b406c2b0 0x7fc5b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.472+0000 7fc5c6ffd640 1 -- 172.21.15.81:0/3319838990 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7fc5cc08b1b0 con 0x7fc5d00af210 2024-09-16T01:21:55.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.472+0000 7fc5d5ca5640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc5b406c2b0 0x7fc5b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.473+0000 7fc5d5ca5640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc5b406c2b0 0x7fc5b406e770 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0034000 tx=0x7fc5c002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:55.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.476+0000 7fc5c6ffd640 1 -- 172.21.15.81:0/3319838990 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5cc0594d0 con 0x7fc5d00af210 2024-09-16T01:21:55.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.644+0000 7fc5d870a640 1 -- 172.21.15.81:0/3319838990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc5d00afcc0 con 0x7fc5d00af210 2024-09-16T01:21:55.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.644+0000 7fc5c6ffd640 1 -- 172.21.15.81:0/3319838990 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) ==== 93+0+10 (secure 0 0 0) 0x7fc5cc05d7d0 con 0x7fc5d00af210 2024-09-16T01:21:55.645 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-16T01:21:55.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.646+0000 7fc5d870a640 1 -- 172.21.15.81:0/3319838990 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc5b406c2b0 msgr2=0x7fc5b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.646+0000 7fc5d870a640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc5b406c2b0 0x7fc5b406e770 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0034000 tx=0x7fc5c002e000 comp rx=0 tx=0).stop 2024-09-16T01:21:55.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.646+0000 7fc5d870a640 1 -- 172.21.15.81:0/3319838990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d00af210 msgr2=0x7fc5d01f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.646+0000 7fc5d870a640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d00af210 0x7fc5d01f7ac0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00e9b0 tx=0x7fc5cc00ee70 comp rx=0 tx=0).stop 2024-09-16T01:21:55.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.646+0000 7fc5d870a640 1 -- 172.21.15.81:0/3319838990 shutdown_connections 2024-09-16T01:21:55.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.646+0000 7fc5d870a640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc5b406c2b0 0x7fc5b406e770 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.646+0000 7fc5d870a640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc5d015e7f0 0x7fc5d0154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.646+0000 7fc5d870a640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc5d00b7250 0x7fc5d01519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.646+0000 7fc5d870a640 1 --2- 172.21.15.81:0/3319838990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d00af210 0x7fc5d01f7ac0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.646+0000 7fc5d870a640 1 -- 172.21.15.81:0/3319838990 >> 172.21.15.81:0/3319838990 conn(0x7fc5d00b3f30 msgr2=0x7fc5d00b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:55.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.646+0000 7fc5d870a640 1 -- 172.21.15.81:0/3319838990 shutdown_connections 2024-09-16T01:21:55.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.646+0000 7fc5d870a640 1 -- 172.21.15.81:0/3319838990 wait complete. 2024-09-16T01:21:55.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin' 2024-09-16T01:21:55.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.755+0000 7f1e1e19f640 1 Processor -- start 2024-09-16T01:21:55.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.755+0000 7f1e1e19f640 1 -- start start 2024-09-16T01:21:55.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e1e19f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e18072320 0x7f1e180cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e1e19f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e18072de0 0x7f1e1806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e1e19f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1e18072700 0x7f1e1806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e1e19f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1e18146140 con 0x7f1e18072320 2024-09-16T01:21:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e1e19f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1e180cd740 con 0x7f1e18072700 2024-09-16T01:21:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e1e19f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1e180cda20 con 0x7f1e18072de0 2024-09-16T01:21:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e177fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e18072320 0x7f1e180cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e177fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e18072320 0x7f1e180cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51462/0 (socket says 172.21.15.81:51462) 2024-09-16T01:21:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e177fe640 1 -- 172.21.15.81:0/484519610 learned_addr learned my addr 172.21.15.81:0/484519610 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e16ffd640 1 --2- 172.21.15.81:0/484519610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e18072de0 0x7f1e1806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e17fff640 1 --2- 172.21.15.81:0/484519610 >> v2:172.21.15.102:3300/0 conn(0x7f1e18072700 0x7f1e1806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e177fe640 1 -- 172.21.15.81:0/484519610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e18072de0 msgr2=0x7f1e1806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e177fe640 1 --2- 172.21.15.81:0/484519610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e18072de0 0x7f1e1806e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e177fe640 1 -- 172.21.15.81:0/484519610 >> v2:172.21.15.102:3300/0 conn(0x7f1e18072700 msgr2=0x7f1e1806e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e177fe640 1 --2- 172.21.15.81:0/484519610 >> v2:172.21.15.102:3300/0 conn(0x7f1e18072700 0x7f1e1806e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e177fe640 1 -- 172.21.15.81:0/484519610 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e180cdd00 con 0x7f1e18072320 2024-09-16T01:21:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.756+0000 7f1e17fff640 1 --2- 172.21.15.81:0/484519610 >> v2:172.21.15.102:3300/0 conn(0x7f1e18072700 0x7f1e1806e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.757+0000 7f1e177fe640 1 --2- 172.21.15.81:0/484519610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e18072320 0x7f1e180cce60 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f1e1806f4e0 tx=0x7f1e0802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72037fa6bf571878 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.757+0000 7f1e167fc640 1 -- 172.21.15.81:0/484519610 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e08037070 con 0x7f1e18072320 2024-09-16T01:21:55.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.757+0000 7f1e167fc640 1 -- 172.21.15.81:0/484519610 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e08032440 con 0x7f1e18072320 2024-09-16T01:21:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.757+0000 7f1e167fc640 1 -- 172.21.15.81:0/484519610 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e08032810 con 0x7f1e18072320 2024-09-16T01:21:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.758+0000 7f1e1e19f640 1 -- 172.21.15.81:0/484519610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e18072320 msgr2=0x7f1e180cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.758+0000 7f1e1e19f640 1 --2- 172.21.15.81:0/484519610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e18072320 0x7f1e180cce60 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f1e1806f4e0 tx=0x7f1e0802a140 comp rx=0 tx=0).stop 2024-09-16T01:21:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.758+0000 7f1e1e19f640 1 -- 172.21.15.81:0/484519610 shutdown_connections 2024-09-16T01:21:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.758+0000 7f1e1e19f640 1 --2- 172.21.15.81:0/484519610 >> v2:172.21.15.102:3300/0 conn(0x7f1e18072700 0x7f1e1806e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.758+0000 7f1e1e19f640 1 --2- 172.21.15.81:0/484519610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e18072de0 0x7f1e1806e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.758+0000 7f1e1e19f640 1 --2- 172.21.15.81:0/484519610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e18072320 0x7f1e180cce60 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.758+0000 7f1e1e19f640 1 -- 172.21.15.81:0/484519610 >> 172.21.15.81:0/484519610 conn(0x7f1e18067d70 msgr2=0x7f1e1806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.758+0000 7f1e1e19f640 1 -- 172.21.15.81:0/484519610 shutdown_connections 2024-09-16T01:21:55.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.758+0000 7f1e1e19f640 1 -- 172.21.15.81:0/484519610 wait complete. 2024-09-16T01:21:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.759+0000 7f1e1e19f640 1 Processor -- start 2024-09-16T01:21:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.759+0000 7f1e1e19f640 1 -- start start 2024-09-16T01:21:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e1e19f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e18072320 0x7f1e18141d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e1e19f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e18072700 0x7f1e180ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e1e19f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e18072de0 0x7f1e180c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e1e19f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1e180cd520 con 0x7f1e18072700 2024-09-16T01:21:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e1e19f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1e180cd3a0 con 0x7f1e18072320 2024-09-16T01:21:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e1e19f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1e1806eb30 con 0x7f1e18072de0 2024-09-16T01:21:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e16ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e18072700 0x7f1e180ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e16ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e18072700 0x7f1e180ab670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51470/0 (socket says 172.21.15.81:51470) 2024-09-16T01:21:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e16ffd640 1 -- 172.21.15.81:0/3347829097 learned_addr learned my addr 172.21.15.81:0/3347829097 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e177fe640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e18072320 0x7f1e18141d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e17fff640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e18072de0 0x7f1e180c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e16ffd640 1 -- 172.21.15.81:0/3347829097 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e18072de0 msgr2=0x7f1e180c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e16ffd640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e18072de0 0x7f1e180c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e16ffd640 1 -- 172.21.15.81:0/3347829097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e18072320 msgr2=0x7f1e18141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e16ffd640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e18072320 0x7f1e18141d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e16ffd640 1 -- 172.21.15.81:0/3347829097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e180ad0f0 con 0x7f1e18072700 2024-09-16T01:21:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e17fff640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e18072de0 0x7f1e180c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.760+0000 7f1e16ffd640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e18072700 0x7f1e180ab670 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00d5f0 tx=0x7f1e0c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.761+0000 7f1dfffff640 1 -- 172.21.15.81:0/3347829097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c0125f0 con 0x7f1e18072700 2024-09-16T01:21:55.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.761+0000 7f1dfffff640 1 -- 172.21.15.81:0/3347829097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e0c019070 con 0x7f1e18072700 2024-09-16T01:21:55.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.761+0000 7f1e1e19f640 1 -- 172.21.15.81:0/3347829097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e180ac050 con 0x7f1e18072700 2024-09-16T01:21:55.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.761+0000 7f1dfffff640 1 -- 172.21.15.81:0/3347829097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c0129d0 con 0x7f1e18072700 2024-09-16T01:21:55.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.761+0000 7f1e1e19f640 1 -- 172.21.15.81:0/3347829097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e180ac610 con 0x7f1e18072700 2024-09-16T01:21:55.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.762+0000 7f1e1e19f640 1 -- 172.21.15.81:0/3347829097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e180cce60 con 0x7f1e18072700 2024-09-16T01:21:55.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.762+0000 7f1dfffff640 1 -- 172.21.15.81:0/3347829097 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1e0c012b70 con 0x7f1e18072700 2024-09-16T01:21:55.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.763+0000 7f1dfffff640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1e0406c2b0 0x7f1e0406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:55.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.763+0000 7f1dfffff640 1 -- 172.21.15.81:0/3347829097 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7f1e0c08b570 con 0x7f1e18072700 2024-09-16T01:21:55.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.763+0000 7f1e177fe640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1e0406c2b0 0x7f1e0406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:55.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.763+0000 7f1e177fe640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1e0406c2b0 0x7f1e0406e770 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1e08034000 tx=0x7f1e0802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:55.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.767+0000 7f1dfffff640 1 -- 172.21.15.81:0/3347829097 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e0c059ee0 con 0x7f1e18072700 2024-09-16T01:21:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:55.997+0000 7f1e1e19f640 1 -- 172.21.15.81:0/3347829097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]} v 0) -- 0x7f1e1806d090 con 0x7f1e18072700 2024-09-16T01:21:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.060+0000 7f1dfffff640 1 -- 172.21.15.81:0/3347829097 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]}]=0 v313) ==== 146+0+0 (secure 0 0 0) 0x7f1e0c0597e0 con 0x7f1e18072700 2024-09-16T01:21:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.062+0000 7f1e1e19f640 1 -- 172.21.15.81:0/3347829097 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1e0406c2b0 msgr2=0x7f1e0406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.062+0000 7f1e1e19f640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1e0406c2b0 0x7f1e0406e770 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1e08034000 tx=0x7f1e0802e000 comp rx=0 tx=0).stop 2024-09-16T01:21:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.062+0000 7f1e1e19f640 1 -- 172.21.15.81:0/3347829097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e18072700 msgr2=0x7f1e180ab670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.062+0000 7f1e1e19f640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e18072700 0x7f1e180ab670 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c00d5f0 tx=0x7f1e0c00dab0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.062+0000 7f1e1e19f640 1 -- 172.21.15.81:0/3347829097 shutdown_connections 2024-09-16T01:21:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.062+0000 7f1e1e19f640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1e0406c2b0 0x7f1e0406e770 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.062+0000 7f1e1e19f640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e18072de0 0x7f1e180c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.062+0000 7f1e1e19f640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e18072700 0x7f1e180ab670 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.062+0000 7f1e1e19f640 1 --2- 172.21.15.81:0/3347829097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e18072320 0x7f1e18141d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.062+0000 7f1e1e19f640 1 -- 172.21.15.81:0/3347829097 >> 172.21.15.81:0/3347829097 conn(0x7f1e18067d70 msgr2=0x7f1e180c7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.062+0000 7f1e1e19f640 1 -- 172.21.15.81:0/3347829097 shutdown_connections 2024-09-16T01:21:56.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.062+0000 7f1e1e19f640 1 -- 172.21.15.81:0/3347829097 wait complete. 2024-09-16T01:21:56.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T01:21:56.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.175+0000 7fe197ee4640 1 Processor -- start 2024-09-16T01:21:56.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.175+0000 7fe197ee4640 1 -- start start 2024-09-16T01:21:56.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe197ee4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe19015e7f0 0x7fe1900b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:56.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe197ee4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe1900af210 0x7fe190070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:56.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe197ee4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19006cdc0 con 0x7fe1900b7250 2024-09-16T01:21:56.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe197ee4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe19006d0a0 con 0x7fe19015e7f0 2024-09-16T01:21:56.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe197ee4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe19006d380 con 0x7fe1900af210 2024-09-16T01:21:56.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe195c80640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe19015e7f0 0x7fe1900b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:56.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe195c80640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe19015e7f0 0x7fe1900b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51480/0 (socket says 172.21.15.81:51480) 2024-09-16T01:21:56.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe195c80640 1 -- 172.21.15.81:0/1933094302 learned_addr learned my addr 172.21.15.81:0/1933094302 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:56.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe19547f640 1 --2- 172.21.15.81:0/1933094302 >> v2:172.21.15.102:3300/0 conn(0x7fe1900af210 0x7fe190070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:56.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe195c80640 1 -- 172.21.15.81:0/1933094302 >> v2:172.21.15.102:3300/0 conn(0x7fe1900af210 msgr2=0x7fe190070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:56.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe195c80640 1 --2- 172.21.15.81:0/1933094302 >> v2:172.21.15.102:3300/0 conn(0x7fe1900af210 0x7fe190070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe195c80640 1 -- 172.21.15.81:0/1933094302 >> v1:172.21.15.102:6789/0 conn(0x7fe1900b7250 legacy=0x7fe19009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:56.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.176+0000 7fe195c80640 1 -- 172.21.15.81:0/1933094302 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19006d660 con 0x7fe19015e7f0 2024-09-16T01:21:56.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.177+0000 7fe195c80640 1 --2- 172.21.15.81:0/1933094302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19015e7f0 0x7fe1900b6d10 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fe1900b5ab0 tx=0x7fe18c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d52d840de9e32b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:56.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.177+0000 7fe194c7e640 1 -- 172.21.15.81:0/1933094302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c037070 con 0x7fe19015e7f0 2024-09-16T01:21:56.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.177+0000 7fe194c7e640 1 -- 172.21.15.81:0/1933094302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c032440 con 0x7fe19015e7f0 2024-09-16T01:21:56.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.177+0000 7fe194c7e640 1 -- 172.21.15.81:0/1933094302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c032810 con 0x7fe19015e7f0 2024-09-16T01:21:56.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.177+0000 7fe197ee4640 1 -- 172.21.15.81:0/1933094302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19015e7f0 msgr2=0x7fe1900b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.177+0000 7fe197ee4640 1 --2- 172.21.15.81:0/1933094302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19015e7f0 0x7fe1900b6d10 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fe1900b5ab0 tx=0x7fe18c02a270 comp rx=0 tx=0).stop 2024-09-16T01:21:56.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.178+0000 7fe197ee4640 1 -- 172.21.15.81:0/1933094302 shutdown_connections 2024-09-16T01:21:56.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.178+0000 7fe197ee4640 1 --2- 172.21.15.81:0/1933094302 >> v2:172.21.15.102:3300/0 conn(0x7fe1900af210 0x7fe190070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.178+0000 7fe197ee4640 1 --2- 172.21.15.81:0/1933094302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19015e7f0 0x7fe1900b6d10 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.178+0000 7fe197ee4640 1 -- 172.21.15.81:0/1933094302 >> 172.21.15.81:0/1933094302 conn(0x7fe1900b3f30 msgr2=0x7fe1900b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:56.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.178+0000 7fe197ee4640 1 -- 172.21.15.81:0/1933094302 shutdown_connections 2024-09-16T01:21:56.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.178+0000 7fe197ee4640 1 -- 172.21.15.81:0/1933094302 wait complete. 2024-09-16T01:21:56.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.179+0000 7fe197ee4640 1 Processor -- start 2024-09-16T01:21:56.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.179+0000 7fe197ee4640 1 -- start start 2024-09-16T01:21:56.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe197ee4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1900af210 0x7fe19015fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:56.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe197ee4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1900b7250 0x7fe190160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:56.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe197ee4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19015e7f0 0x7fe19015ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe197ee4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe190071130 con 0x7fe1900af210 2024-09-16T01:21:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe197ee4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe190070fb0 con 0x7fe1900b7250 2024-09-16T01:21:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe197ee4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe1900712b0 con 0x7fe19015e7f0 2024-09-16T01:21:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe195c80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1900af210 0x7fe19015fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe195c80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1900af210 0x7fe19015fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51486/0 (socket says 172.21.15.81:51486) 2024-09-16T01:21:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe195c80640 1 -- 172.21.15.81:0/778378928 learned_addr learned my addr 172.21.15.81:0/778378928 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe19547f640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1900b7250 0x7fe190160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe196481640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19015e7f0 0x7fe19015ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe195c80640 1 -- 172.21.15.81:0/778378928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19015e7f0 msgr2=0x7fe19015ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe195c80640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19015e7f0 0x7fe19015ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe195c80640 1 -- 172.21.15.81:0/778378928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1900b7250 msgr2=0x7fe190160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe195c80640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1900b7250 0x7fe190160360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe195c80640 1 -- 172.21.15.81:0/778378928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1901f47a0 con 0x7fe1900af210 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe195c80640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1900af210 0x7fe19015fe20 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fe18c02a2b0 tx=0x7fe18c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe1867fc640 1 -- 172.21.15.81:0/778378928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c041020 con 0x7fe1900af210 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe1867fc640 1 -- 172.21.15.81:0/778378928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c0306c0 con 0x7fe1900af210 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe1867fc640 1 -- 172.21.15.81:0/778378928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c037040 con 0x7fe1900af210 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe197ee4640 1 -- 172.21.15.81:0/778378928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1901f4a60 con 0x7fe1900af210 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.180+0000 7fe197ee4640 1 -- 172.21.15.81:0/778378928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1901f5020 con 0x7fe1900af210 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.181+0000 7fe197ee4640 1 -- 172.21.15.81:0/778378928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1901f5630 con 0x7fe1900af210 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.182+0000 7fe1867fc640 1 -- 172.21.15.81:0/778378928 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe18c044020 con 0x7fe1900af210 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.182+0000 7fe1867fc640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe17406c2b0 0x7fe17406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.182+0000 7fe19547f640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe17406c2b0 0x7fe17406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.182+0000 7fe1867fc640 1 -- 172.21.15.81:0/778378928 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7fe18c0aba30 con 0x7fe1900af210 2024-09-16T01:21:56.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.183+0000 7fe19547f640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe17406c2b0 0x7fe17406e770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe180006fd0 tx=0x7fe180008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:56.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.187+0000 7fe1867fc640 1 -- 172.21.15.81:0/778378928 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe18c04b030 con 0x7fe1900af210 2024-09-16T01:21:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.353+0000 7fe197ee4640 1 -- 172.21.15.81:0/778378928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe190070a70 con 0x7fe1900af210 2024-09-16T01:21:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.358+0000 7fe1867fc640 1 -- 172.21.15.81:0/778378928 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7fe18c07a3a0 con 0x7fe1900af210 2024-09-16T01:21:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.360+0000 7fe197ee4640 1 -- 172.21.15.81:0/778378928 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe17406c2b0 msgr2=0x7fe17406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.360+0000 7fe197ee4640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe17406c2b0 0x7fe17406e770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe180006fd0 tx=0x7fe180008040 comp rx=0 tx=0).stop 2024-09-16T01:21:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.360+0000 7fe197ee4640 1 -- 172.21.15.81:0/778378928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1900af210 msgr2=0x7fe19015fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.360+0000 7fe197ee4640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1900af210 0x7fe19015fe20 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fe18c02a2b0 tx=0x7fe18c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.360+0000 7fe197ee4640 1 -- 172.21.15.81:0/778378928 shutdown_connections 2024-09-16T01:21:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.360+0000 7fe197ee4640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe17406c2b0 0x7fe17406e770 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.360+0000 7fe197ee4640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19015e7f0 0x7fe19015ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.360+0000 7fe197ee4640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1900b7250 0x7fe190160360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.360+0000 7fe197ee4640 1 --2- 172.21.15.81:0/778378928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1900af210 0x7fe19015fe20 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.360+0000 7fe197ee4640 1 -- 172.21.15.81:0/778378928 >> 172.21.15.81:0/778378928 conn(0x7fe1900b3f30 msgr2=0x7fe1900b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.360+0000 7fe197ee4640 1 -- 172.21.15.81:0/778378928 shutdown_connections 2024-09-16T01:21:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.360+0000 7fe197ee4640 1 -- 172.21.15.81:0/778378928 wait complete. 2024-09-16T01:21:56.371 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:21:56.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:21:56.409 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:21:56.452 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:21:56.452 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:21:56.452 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:56.468 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:21:56.468 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:21:56.468 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:56.511 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:21:56.511 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:21:56.511 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:56.527 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:21:56.527 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:21:56.528 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:21:56.569 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:21:56.569 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T01:21:56.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:21:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.666+0000 7fb6dde7b640 1 Processor -- start 2024-09-16T01:21:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.666+0000 7fb6dde7b640 1 -- start start 2024-09-16T01:21:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.667+0000 7fb6dde7b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb6d815fc30 0x7fb6d8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.667+0000 7fb6dde7b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6d809b140 0x7fb6d80704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.667+0000 7fb6dde7b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d809ba30 con 0x7fb6d80b17d0 2024-09-16T01:21:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.667+0000 7fb6dde7b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d80b1590 con 0x7fb6d809b140 2024-09-16T01:21:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.667+0000 7fb6dde7b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d8160ab0 con 0x7fb6d815fc30 2024-09-16T01:21:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.667+0000 7fb6d7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6d809b140 0x7fb6d80704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.667+0000 7fb6d7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6d809b140 0x7fb6d80704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51502/0 (socket says 172.21.15.81:51502) 2024-09-16T01:21:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.667+0000 7fb6d7fff640 1 -- 172.21.15.81:0/1515737805 learned_addr learned my addr 172.21.15.81:0/1515737805 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.668+0000 7fb6d77fe640 1 --2- 172.21.15.81:0/1515737805 >> v2:172.21.15.102:3300/0 conn(0x7fb6d815fc30 0x7fb6d8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.668+0000 7fb6d7fff640 1 -- 172.21.15.81:0/1515737805 >> v2:172.21.15.102:3300/0 conn(0x7fb6d815fc30 msgr2=0x7fb6d8071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.668+0000 7fb6d7fff640 1 --2- 172.21.15.81:0/1515737805 >> v2:172.21.15.102:3300/0 conn(0x7fb6d815fc30 0x7fb6d8071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.668+0000 7fb6d7fff640 1 -- 172.21.15.81:0/1515737805 >> v1:172.21.15.81:6789/0 conn(0x7fb6d80b17d0 legacy=0x7fb6d809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.668+0000 7fb6d7fff640 1 -- 172.21.15.81:0/1515737805 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d809bcf0 con 0x7fb6d809b140 2024-09-16T01:21:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.668+0000 7fb6d67fc640 1 -- 172.21.15.81:0/1515737805 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4117047283 0 0) 0x7fb6d809ba30 con 0x7fb6d80b17d0 2024-09-16T01:21:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.668+0000 7fb6d7fff640 1 --2- 172.21.15.81:0/1515737805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d809b140 0x7fb6d80704f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80743f0 tx=0x7fb6d002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a812470befa6670f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.669+0000 7fb6d67fc640 1 -- 172.21.15.81:0/1515737805 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0036070 con 0x7fb6d809b140 2024-09-16T01:21:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.669+0000 7fb6d67fc640 1 -- 172.21.15.81:0/1515737805 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d0031600 con 0x7fb6d809b140 2024-09-16T01:21:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.669+0000 7fb6d67fc640 1 -- 172.21.15.81:0/1515737805 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00319d0 con 0x7fb6d809b140 2024-09-16T01:21:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.669+0000 7fb6dde7b640 1 -- 172.21.15.81:0/1515737805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d809b140 msgr2=0x7fb6d80704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.669+0000 7fb6dde7b640 1 --2- 172.21.15.81:0/1515737805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d809b140 0x7fb6d80704f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fb6d80743f0 tx=0x7fb6d002a6a0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.669+0000 7fb6dde7b640 1 -- 172.21.15.81:0/1515737805 shutdown_connections 2024-09-16T01:21:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.669+0000 7fb6dde7b640 1 --2- 172.21.15.81:0/1515737805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d809b140 0x7fb6d80704f0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.669+0000 7fb6dde7b640 1 --2- 172.21.15.81:0/1515737805 >> v2:172.21.15.102:3300/0 conn(0x7fb6d815fc30 0x7fb6d8071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.669+0000 7fb6dde7b640 1 -- 172.21.15.81:0/1515737805 >> 172.21.15.81:0/1515737805 conn(0x7fb6d80d23a0 msgr2=0x7fb6d80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.669+0000 7fb6dde7b640 1 -- 172.21.15.81:0/1515737805 shutdown_connections 2024-09-16T01:21:56.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.669+0000 7fb6dde7b640 1 -- 172.21.15.81:0/1515737805 wait complete. 2024-09-16T01:21:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.670+0000 7fb6dde7b640 1 Processor -- start 2024-09-16T01:21:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.670+0000 7fb6dde7b640 1 -- start start 2024-09-16T01:21:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.671+0000 7fb6dde7b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6d809b140 0x7fb6d815b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.671+0000 7fb6dde7b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d80b17d0 0x7fb6d80b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.671+0000 7fb6dde7b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d815fc30 0x7fb6d80b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.671+0000 7fb6dde7b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d80b1bd0 con 0x7fb6d815fc30 2024-09-16T01:21:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.671+0000 7fb6dde7b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d8160fe0 con 0x7fb6d80b17d0 2024-09-16T01:21:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.671+0000 7fb6dde7b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d8070a30 con 0x7fb6d809b140 2024-09-16T01:21:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.671+0000 7fb6d7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d815fc30 0x7fb6d80b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.671+0000 7fb6d7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d815fc30 0x7fb6d80b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51510/0 (socket says 172.21.15.81:51510) 2024-09-16T01:21:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.671+0000 7fb6d7fff640 1 -- 172.21.15.81:0/4196535729 learned_addr learned my addr 172.21.15.81:0/4196535729 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.671+0000 7fb6d77fe640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6d809b140 0x7fb6d815b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.671+0000 7fb6d7fff640 1 -- 172.21.15.81:0/4196535729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6d809b140 msgr2=0x7fb6d815b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.671+0000 7fb6d6ffd640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d80b17d0 0x7fb6d80b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.672+0000 7fb6d7fff640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6d809b140 0x7fb6d815b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.672+0000 7fb6d7fff640 1 -- 172.21.15.81:0/4196535729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d80b17d0 msgr2=0x7fb6d80b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.672+0000 7fb6d7fff640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d80b17d0 0x7fb6d80b7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.672+0000 7fb6d7fff640 1 -- 172.21.15.81:0/4196535729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d81f21e0 con 0x7fb6d815fc30 2024-09-16T01:21:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.672+0000 7fb6d7fff640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d815fc30 0x7fb6d80b0430 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009f40 tx=0x7fb6d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.672+0000 7fb6bffff640 1 -- 172.21.15.81:0/4196535729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0036050 con 0x7fb6d815fc30 2024-09-16T01:21:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.672+0000 7fb6bffff640 1 -- 172.21.15.81:0/4196535729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d0042070 con 0x7fb6d815fc30 2024-09-16T01:21:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.672+0000 7fb6dde7b640 1 -- 172.21.15.81:0/4196535729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d81f2480 con 0x7fb6d815fc30 2024-09-16T01:21:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.672+0000 7fb6bffff640 1 -- 172.21.15.81:0/4196535729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d0009510 con 0x7fb6d815fc30 2024-09-16T01:21:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.672+0000 7fb6dde7b640 1 -- 172.21.15.81:0/4196535729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d81f2a40 con 0x7fb6d815fc30 2024-09-16T01:21:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.673+0000 7fb6dde7b640 1 -- 172.21.15.81:0/4196535729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d80704f0 con 0x7fb6d815fc30 2024-09-16T01:21:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.673+0000 7fb6bffff640 1 -- 172.21.15.81:0/4196535729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb6d0007bd0 con 0x7fb6d815fc30 2024-09-16T01:21:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.674+0000 7fb6bffff640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6c406c2b0 0x7fb6c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.674+0000 7fb6d77fe640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6c406c2b0 0x7fb6c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.674+0000 7fb6bffff640 1 -- 172.21.15.81:0/4196535729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7fb6d00ac130 con 0x7fb6d815fc30 2024-09-16T01:21:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.674+0000 7fb6d77fe640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6c406c2b0 0x7fb6c406e770 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8006fd0 tx=0x7fb6c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.678+0000 7fb6bffff640 1 -- 172.21.15.81:0/4196535729 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6d0045360 con 0x7fb6d815fc30 2024-09-16T01:21:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.876+0000 7fb6dde7b640 1 -- 172.21.15.81:0/4196535729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6d80b8320 con 0x7fb6d815fc30 2024-09-16T01:21:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.877+0000 7fb6bffff640 1 -- 172.21.15.81:0/4196535729 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+3914 (secure 0 0 0) 0x7fb6d007aa10 con 0x7fb6d815fc30 2024-09-16T01:21:56.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:56.878 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"btime":"2024-09-16T01:21:52:037211+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5747,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3103388370","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3103388370},{"type":"v1","addr":"172.21.15.102:6834","nonce":3103388370}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":5750,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1937467713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1937467713},{"type":"v1","addr":"172.21.15.102:6835","nonce":1937467713}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1728333369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1728333369},{"type":"v1","addr":"172.21.15.81:6836","nonce":1728333369}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":7176,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/497347117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":497347117},{"type":"v1","addr":"172.21.15.81:6837","nonce":497347117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[]} 2024-09-16T01:21:56.878 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 54 2024-09-16T01:21:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.879+0000 7fb6dde7b640 1 -- 172.21.15.81:0/4196535729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6c406c2b0 msgr2=0x7fb6c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.879+0000 7fb6dde7b640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6c406c2b0 0x7fb6c406e770 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb6c8006fd0 tx=0x7fb6c8008040 comp rx=0 tx=0).stop 2024-09-16T01:21:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.879+0000 7fb6dde7b640 1 -- 172.21.15.81:0/4196535729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d815fc30 msgr2=0x7fb6d80b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.879+0000 7fb6dde7b640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d815fc30 0x7fb6d80b0430 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0009f40 tx=0x7fb6d0004a40 comp rx=0 tx=0).stop 2024-09-16T01:21:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.879+0000 7fb6dde7b640 1 -- 172.21.15.81:0/4196535729 shutdown_connections 2024-09-16T01:21:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.879+0000 7fb6dde7b640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6c406c2b0 0x7fb6c406e770 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.879+0000 7fb6dde7b640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6d815fc30 0x7fb6d80b0430 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.879+0000 7fb6dde7b640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6d80b17d0 0x7fb6d80b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.879+0000 7fb6dde7b640 1 --2- 172.21.15.81:0/4196535729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6d809b140 0x7fb6d815b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.879+0000 7fb6dde7b640 1 -- 172.21.15.81:0/4196535729 >> 172.21.15.81:0/4196535729 conn(0x7fb6d80d23a0 msgr2=0x7fb6d80af520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.879+0000 7fb6dde7b640 1 -- 172.21.15.81:0/4196535729 shutdown_connections 2024-09-16T01:21:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:56.879+0000 7fb6dde7b640 1 -- 172.21.15.81:0/4196535729 wait complete. 2024-09-16T01:21:56.890 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:21:56.891 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T01:21:56.891 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:21:56.891 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:21:56.891 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:21:56.891 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T01:21:56.891 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:21:56.891 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:21:56.892 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:21:56.892 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T01:21:56.892 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:21:56.892 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:21:56.892 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:21:56.892 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T01:21:56.892 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:21:56.892 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:21:56.900 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:21:56.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:21:56.901 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:21:56.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:21:56.907 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:21:56.907 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:21:56.908 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:21:56.908 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:21:56.942 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:21:56.943 DEBUG:teuthology.parallel:result is None 2024-09-16T01:21:56.943 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:21:56.943 DEBUG:teuthology.parallel:result is None 2024-09-16T01:21:56.949 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:21:56.949 DEBUG:teuthology.parallel:result is None 2024-09-16T01:21:56.950 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:21:56.950 DEBUG:teuthology.parallel:result is None 2024-09-16T01:21:56.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T01:21:57.017 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:21:57.017 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:21:57.038 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-16T01:21:57.038 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:21:57.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.053+0000 7faff190a640 1 Processor -- start 2024-09-16T01:21:57.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.053+0000 7faff190a640 1 -- start start 2024-09-16T01:21:57.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.054+0000 7faff190a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fafec162060 0x7fafec0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:57.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.054+0000 7faff190a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec06d9f0 con 0x7fafec0b64b0 2024-09-16T01:21:57.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.054+0000 7faff190a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec06dcd0 con 0x7fafec161c80 2024-09-16T01:21:57.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.054+0000 7faff190a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fafec06dfb0 con 0x7fafec162060 2024-09-16T01:21:57.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.054+0000 7fafe27fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fafec162060 0x7fafec0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:57.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.054+0000 7fafeb7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fafec0b64b0 0x7fafec0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52568/0 (socket says 172.21.15.81:52568) 2024-09-16T01:21:57.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.054+0000 7fafeb7fe640 1 -- 172.21.15.81:0/268871687 learned_addr learned my addr 172.21.15.81:0/268871687 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:57.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.055+0000 7fafe27fc640 1 -- 172.21.15.81:0/268871687 >> v1:172.21.15.102:6789/0 conn(0x7fafec161c80 legacy=0x7fafec06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:57.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.055+0000 7fafe27fc640 1 -- 172.21.15.81:0/268871687 >> v1:172.21.15.81:6789/0 conn(0x7fafec0b64b0 legacy=0x7fafec0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.055+0000 7fafe27fc640 1 -- 172.21.15.81:0/268871687 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec0d2890 con 0x7fafec162060 2024-09-16T01:21:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.055+0000 7fafea7fc640 1 -- 172.21.15.81:0/268871687 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281564906 0 0) 0x7fafec06d9f0 con 0x7fafec0b64b0 2024-09-16T01:21:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.055+0000 7fafe27fc640 1 --2- 172.21.15.81:0/268871687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafec162060 0x7fafec0b5f70 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fafd40097a0 tx=0x7fafd402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374f9ee6bb54dfcf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.055+0000 7fafea7fc640 1 -- 172.21.15.81:0/268871687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd4037070 con 0x7fafec162060 2024-09-16T01:21:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.055+0000 7fafea7fc640 1 -- 172.21.15.81:0/268871687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd4032440 con 0x7fafec162060 2024-09-16T01:21:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.055+0000 7fafea7fc640 1 -- 172.21.15.81:0/268871687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd4032810 con 0x7fafec162060 2024-09-16T01:21:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.056+0000 7faff190a640 1 -- 172.21.15.81:0/268871687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafec162060 msgr2=0x7fafec0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.056+0000 7faff190a640 1 --2- 172.21.15.81:0/268871687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafec162060 0x7fafec0b5f70 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fafd40097a0 tx=0x7fafd402a230 comp rx=0 tx=0).stop 2024-09-16T01:21:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.056+0000 7faff190a640 1 -- 172.21.15.81:0/268871687 shutdown_connections 2024-09-16T01:21:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.056+0000 7faff190a640 1 --2- 172.21.15.81:0/268871687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafec162060 0x7fafec0b5f70 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.056+0000 7faff190a640 1 -- 172.21.15.81:0/268871687 >> 172.21.15.81:0/268871687 conn(0x7fafec0d44f0 msgr2=0x7fafec0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.056+0000 7faff190a640 1 -- 172.21.15.81:0/268871687 shutdown_connections 2024-09-16T01:21:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.056+0000 7faff190a640 1 -- 172.21.15.81:0/268871687 wait complete. 2024-09-16T01:21:57.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.057+0000 7faff190a640 1 Processor -- start 2024-09-16T01:21:57.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.057+0000 7faff190a640 1 -- start start 2024-09-16T01:21:57.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.058+0000 7faff190a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafec0b64b0 0x7fafec0b96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:57.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.058+0000 7faff190a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafec161c80 0x7fafec0b9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:57.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.058+0000 7faff190a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafec162060 0x7fafec0b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:57.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.058+0000 7faff190a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fafec0b6d30 con 0x7fafec162060 2024-09-16T01:21:57.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.058+0000 7faff190a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fafec0b6bb0 con 0x7fafec0b64b0 2024-09-16T01:21:57.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.058+0000 7faff190a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fafec0cf8f0 con 0x7fafec161c80 2024-09-16T01:21:57.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.058+0000 7fafeb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafec162060 0x7fafec0b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:57.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.058+0000 7fafeb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafec162060 0x7fafec0b7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51550/0 (socket says 172.21.15.81:51550) 2024-09-16T01:21:57.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.058+0000 7fafeb7fe640 1 -- 172.21.15.81:0/950472250 learned_addr learned my addr 172.21.15.81:0/950472250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:57.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.058+0000 7fafeaffd640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafec0b64b0 0x7fafec0b96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:57.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.058+0000 7fafe27fc640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafec161c80 0x7fafec0b9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:57.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.058+0000 7fafeb7fe640 1 -- 172.21.15.81:0/950472250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafec161c80 msgr2=0x7fafec0b9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:57.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.059+0000 7fafeb7fe640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafec161c80 0x7fafec0b9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:57.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.059+0000 7fafeb7fe640 1 -- 172.21.15.81:0/950472250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafec0b64b0 msgr2=0x7fafec0b96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:57.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.059+0000 7fafeb7fe640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafec0b64b0 0x7fafec0b96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:57.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.059+0000 7fafeb7fe640 1 -- 172.21.15.81:0/950472250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec0c9780 con 0x7fafec162060 2024-09-16T01:21:57.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.059+0000 7fafeb7fe640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafec162060 0x7fafec0b7340 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fafe400c7a0 tx=0x7fafe400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:57.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.059+0000 7fafe8ff9640 1 -- 172.21.15.81:0/950472250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4018070 con 0x7fafec162060 2024-09-16T01:21:57.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.059+0000 7fafe8ff9640 1 -- 172.21.15.81:0/950472250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe400a640 con 0x7fafec162060 2024-09-16T01:21:57.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.059+0000 7fafe8ff9640 1 -- 172.21.15.81:0/950472250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe400aab0 con 0x7fafec162060 2024-09-16T01:21:57.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.059+0000 7faff190a640 1 -- 172.21.15.81:0/950472250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafec0c9a60 con 0x7fafec162060 2024-09-16T01:21:57.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.059+0000 7faff190a640 1 -- 172.21.15.81:0/950472250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafec0ca020 con 0x7fafec162060 2024-09-16T01:21:57.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.060+0000 7faff190a640 1 -- 172.21.15.81:0/950472250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafec06d9f0 con 0x7fafec162060 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.061+0000 7fafe8ff9640 1 -- 172.21.15.81:0/950472250 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fafe400ac50 con 0x7fafec162060 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.061+0000 7fafe8ff9640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fafcc06c2b0 0x7fafcc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.061+0000 7fafe8ff9640 1 -- 172.21.15.81:0/950472250 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5335+0+0 (secure 0 0 0) 0x7fafe408a8e0 con 0x7fafec162060 2024-09-16T01:21:57.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.061+0000 7fafeaffd640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fafcc06c2b0 0x7fafcc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:57.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.062+0000 7fafeaffd640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fafcc06c2b0 0x7fafcc06e770 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fafdc000f60 tx=0x7fafdc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:57.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.071+0000 7fafe8ff9640 1 -- 172.21.15.81:0/950472250 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fafe4058b70 con 0x7fafec162060 2024-09-16T01:21:57.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:57.252+0000 7faff190a640 1 -- 172.21.15.81:0/950472250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fafec0ba470 con 0x7fafec162060 2024-09-16T01:21:58.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.080+0000 7fafe8ff9640 1 -- 172.21.15.81:0/950472250 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v109) ==== 97+0+0 (secure 0 0 0) 0x7fafe405ce70 con 0x7fafec162060 2024-09-16T01:21:58.081 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-16T01:21:58.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.083+0000 7faff190a640 1 -- 172.21.15.81:0/950472250 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fafcc06c2b0 msgr2=0x7fafcc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.083+0000 7faff190a640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fafcc06c2b0 0x7fafcc06e770 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fafdc000f60 tx=0x7fafdc009040 comp rx=0 tx=0).stop 2024-09-16T01:21:58.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.083+0000 7faff190a640 1 -- 172.21.15.81:0/950472250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafec162060 msgr2=0x7fafec0b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.083+0000 7faff190a640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafec162060 0x7fafec0b7340 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fafe400c7a0 tx=0x7fafe400cc60 comp rx=0 tx=0).stop 2024-09-16T01:21:58.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.083+0000 7faff190a640 1 -- 172.21.15.81:0/950472250 shutdown_connections 2024-09-16T01:21:58.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.083+0000 7faff190a640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fafcc06c2b0 0x7fafcc06e770 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.083+0000 7faff190a640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafec162060 0x7fafec0b7340 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.083+0000 7faff190a640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fafec161c80 0x7fafec0b9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.083+0000 7faff190a640 1 --2- 172.21.15.81:0/950472250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafec0b64b0 0x7fafec0b96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.083+0000 7faff190a640 1 -- 172.21.15.81:0/950472250 >> 172.21.15.81:0/950472250 conn(0x7fafec0d44f0 msgr2=0x7fafec06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:58.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.083+0000 7faff190a640 1 -- 172.21.15.81:0/950472250 shutdown_connections 2024-09-16T01:21:58.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.084+0000 7faff190a640 1 -- 172.21.15.81:0/950472250 wait complete. 2024-09-16T01:21:58.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T01:21:58.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.201+0000 7f3682e53640 1 Processor -- start 2024-09-16T01:21:58.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.201+0000 7f3682e53640 1 -- start start 2024-09-16T01:21:58.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.202+0000 7f3682e53640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f367c0b6680 0x7f367c169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.202+0000 7f3682e53640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367c06d9f0 con 0x7f367c162060 2024-09-16T01:21:58.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.202+0000 7f3682e53640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367c06dcd0 con 0x7f367c161c80 2024-09-16T01:21:58.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.202+0000 7f3682e53640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f367c06dfb0 con 0x7f367c0b6680 2024-09-16T01:21:58.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.202+0000 7f36813f0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f367c0b6680 0x7f367c169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.202+0000 7f367bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f367c162060 0x7f367c0b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52582/0 (socket says 172.21.15.81:52582) 2024-09-16T01:21:58.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.202+0000 7f367bfff640 1 -- 172.21.15.81:0/2287892803 learned_addr learned my addr 172.21.15.81:0/2287892803 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:58.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.202+0000 7f36813f0640 1 --2- 172.21.15.81:0/2287892803 >> v2:172.21.15.81:3300/0 conn(0x7f367c0b6680 0x7f367c169830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51552/0 (socket says 172.21.15.81:51552) 2024-09-16T01:21:58.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.203+0000 7f36813f0640 1 -- 172.21.15.81:0/2287892803 >> v1:172.21.15.102:6789/0 conn(0x7f367c161c80 legacy=0x7f367c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.203+0000 7f36813f0640 1 -- 172.21.15.81:0/2287892803 >> v1:172.21.15.81:6789/0 conn(0x7f367c162060 legacy=0x7f367c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.203+0000 7f36813f0640 1 -- 172.21.15.81:0/2287892803 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367c0d01f0 con 0x7f367c0b6680 2024-09-16T01:21:58.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.203+0000 7f367b7fe640 1 -- 172.21.15.81:0/2287892803 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530081950 0 0) 0x7f367c06d9f0 con 0x7f367c162060 2024-09-16T01:21:58.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.203+0000 7f36813f0640 1 --2- 172.21.15.81:0/2287892803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367c0b6680 0x7f367c169830 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f3674009d90 tx=0x7f367402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f197dea68e6d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:58.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.203+0000 7f367b7fe640 1 -- 172.21.15.81:0/2287892803 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674007740 con 0x7f367c0b6680 2024-09-16T01:21:58.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.204+0000 7f367b7fe640 1 -- 172.21.15.81:0/2287892803 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36740078e0 con 0x7f367c0b6680 2024-09-16T01:21:58.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.204+0000 7f367b7fe640 1 -- 172.21.15.81:0/2287892803 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3674007cb0 con 0x7f367c0b6680 2024-09-16T01:21:58.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.204+0000 7f3682e53640 1 -- 172.21.15.81:0/2287892803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367c0b6680 msgr2=0x7f367c169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.204+0000 7f3682e53640 1 --2- 172.21.15.81:0/2287892803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367c0b6680 0x7f367c169830 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f3674009d90 tx=0x7f367402a6f0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.204+0000 7f3682e53640 1 -- 172.21.15.81:0/2287892803 shutdown_connections 2024-09-16T01:21:58.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.204+0000 7f3682e53640 1 --2- 172.21.15.81:0/2287892803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367c0b6680 0x7f367c169830 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.204+0000 7f3682e53640 1 -- 172.21.15.81:0/2287892803 >> 172.21.15.81:0/2287892803 conn(0x7f367c0d44f0 msgr2=0x7f367c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:58.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.204+0000 7f3682e53640 1 -- 172.21.15.81:0/2287892803 shutdown_connections 2024-09-16T01:21:58.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.204+0000 7f3682e53640 1 -- 172.21.15.81:0/2287892803 wait complete. 2024-09-16T01:21:58.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.205+0000 7f3682e53640 1 Processor -- start 2024-09-16T01:21:58.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.205+0000 7f3682e53640 1 -- start start 2024-09-16T01:21:58.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.206+0000 7f3682e53640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c0b6680 0x7f367c0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.206+0000 7f3682e53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367c161c80 0x7f367c0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.206+0000 7f3682e53640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f367c162060 0x7f367c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.206+0000 7f3682e53640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f367c0b6cb0 con 0x7f367c161c80 2024-09-16T01:21:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.206+0000 7f3682e53640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f367c0b6b30 con 0x7f367c0b6680 2024-09-16T01:21:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.206+0000 7f3682e53640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f367c169d70 con 0x7f367c162060 2024-09-16T01:21:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.206+0000 7f367bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367c161c80 0x7f367c0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.206+0000 7f367bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367c161c80 0x7f367c0ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51568/0 (socket says 172.21.15.81:51568) 2024-09-16T01:21:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.206+0000 7f367bfff640 1 -- 172.21.15.81:0/626413943 learned_addr learned my addr 172.21.15.81:0/626413943 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.206+0000 7f3680bef640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c0b6680 0x7f367c0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.207+0000 7f36813f0640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f367c162060 0x7f367c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.207+0000 7f367bfff640 1 -- 172.21.15.81:0/626413943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f367c162060 msgr2=0x7f367c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.207+0000 7f367bfff640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f367c162060 0x7f367c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.207+0000 7f367bfff640 1 -- 172.21.15.81:0/626413943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c0b6680 msgr2=0x7f367c0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.207+0000 7f367bfff640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c0b6680 0x7f367c0c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.207+0000 7f367bfff640 1 -- 172.21.15.81:0/626413943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367c0c8730 con 0x7f367c161c80 2024-09-16T01:21:58.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.207+0000 7f367bfff640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367c161c80 0x7f367c0ca5c0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f367000c460 tx=0x7f367000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:58.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.207+0000 7f36797fa640 1 -- 172.21.15.81:0/626413943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670018070 con 0x7f367c161c80 2024-09-16T01:21:58.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.207+0000 7f36797fa640 1 -- 172.21.15.81:0/626413943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3670007520 con 0x7f367c161c80 2024-09-16T01:21:58.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.207+0000 7f3682e53640 1 -- 172.21.15.81:0/626413943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367c0c8a10 con 0x7f367c161c80 2024-09-16T01:21:58.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.207+0000 7f36797fa640 1 -- 172.21.15.81:0/626413943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3670004a20 con 0x7f367c161c80 2024-09-16T01:21:58.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.207+0000 7f3682e53640 1 -- 172.21.15.81:0/626413943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367c0c8cf0 con 0x7f367c161c80 2024-09-16T01:21:58.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.208+0000 7f3682e53640 1 -- 172.21.15.81:0/626413943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367c0b5f70 con 0x7f367c161c80 2024-09-16T01:21:58.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.208+0000 7f36797fa640 1 -- 172.21.15.81:0/626413943 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f367001b070 con 0x7f367c161c80 2024-09-16T01:21:58.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.209+0000 7f36797fa640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f366806c2b0 0x7f366806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.209+0000 7f36797fa640 1 -- 172.21.15.81:0/626413943 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5249+0+0 (secure 0 0 0) 0x7f367008a530 con 0x7f367c161c80 2024-09-16T01:21:58.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.209+0000 7f3680bef640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f366806c2b0 0x7f366806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.209+0000 7f3680bef640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f366806c2b0 0x7f366806e770 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f366c000f60 tx=0x7f366c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:58.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.213+0000 7f36797fa640 1 -- 172.21.15.81:0/626413943 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36700588a0 con 0x7f367c161c80 2024-09-16T01:21:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.440+0000 7f3682e53640 1 -- 172.21.15.81:0/626413943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f367c0ba470 con 0x7f367c161c80 2024-09-16T01:21:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.440+0000 7f36797fa640 1 -- 172.21.15.81:0/626413943 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f367005f0c0 con 0x7f367c161c80 2024-09-16T01:21:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:58.441 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:21:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-16T01:21:58.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-16T01:21:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmx4OgCRAAkmpWDpuwqbDuz0taNg8bag==", 2024-09-16T01:21:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:21:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:21:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-16T01:21:58.442 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmSNpLFRAAzc9Sr8b65zH9VZFYvqsYpA==", 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmcCavEBAA0CuddD0zPcjqrMSOD5c6OA==", 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:58.443 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:21:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:21:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-16T01:21:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmVeRcHBAANIL7HFYSc43qv7Zg0llkYQ==", 2024-09-16T01:21:58.444 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:21:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:21:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-16T01:21:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDhudmUtTqORAAkZKChid+qoa+0nIgpuun7g==", 2024-09-16T01:21:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.445 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-16T01:21:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCHhudmUhtiABAA2vDoACv8RJ2KD9p1cdKClA==", 2024-09-16T01:21:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:58.446 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-16T01:21:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCKhudmhOmRHxAAbGjJkUZLras/b6omekdz7A==", 2024-09-16T01:21:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-16T01:21:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCNhudmA+csIRAAW1kenpimaWIak/qgG+UeXw==", 2024-09-16T01:21:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.448 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCThudmvgQBLxAAWLto5pG0iyiQPSnxldWYwg==", 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCXhudmKfyiIhAALbJHvDeQtVgSCKjD1X3OYg==", 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:58.449 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCahudmPG/9JBAA6d/gK0K/5c9Gp4uKOLCCOw==", 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.450 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCdhudmVdY3NhAAXlOaeE0XidHVCaeQrirBAg==", 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg==", 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.451 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmMgEhKRAAUD2kJ9eOFJscZ6ATlO5PmQ==", 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:21:58.452 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-16T01:21:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmwfD5JRAAPhdVLFZD07Uy75g3zStblg==", 2024-09-16T01:21:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:21:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:21:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:21:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudm8/qzLhAAVFRbGhXH00h2LS9ZC9rraA==", 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/hudmBWr2KRAA/hELsRHNpxj3KqJbOSY74g==", 2024-09-16T01:21:58.454 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmRdtyBhAAMQngXCuTHg6AjACCw/SmCg==", 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.455 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:21:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-16T01:21:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmqULCAhAAMbYmGXWGiINwif20O1JG3g==", 2024-09-16T01:21:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:21:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:21:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:21:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:21:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.456 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-16T01:21:58.456 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:21:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.442+0000 7f3682e53640 1 -- 172.21.15.81:0/626413943 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f366806c2b0 msgr2=0x7f366806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.442+0000 7f3682e53640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f366806c2b0 0x7f366806e770 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f366c000f60 tx=0x7f366c009040 comp rx=0 tx=0).stop 2024-09-16T01:21:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.442+0000 7f3682e53640 1 -- 172.21.15.81:0/626413943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367c161c80 msgr2=0x7f367c0ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.442+0000 7f3682e53640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367c161c80 0x7f367c0ca5c0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f367000c460 tx=0x7f367000c920 comp rx=0 tx=0).stop 2024-09-16T01:21:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.442+0000 7f3682e53640 1 -- 172.21.15.81:0/626413943 shutdown_connections 2024-09-16T01:21:58.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.442+0000 7f3682e53640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f366806c2b0 0x7f366806e770 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.442+0000 7f3682e53640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f367c162060 0x7f367c0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.442+0000 7f3682e53640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f367c161c80 0x7f367c0ca5c0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.442+0000 7f3682e53640 1 --2- 172.21.15.81:0/626413943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f367c0b6680 0x7f367c0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.442+0000 7f3682e53640 1 -- 172.21.15.81:0/626413943 >> 172.21.15.81:0/626413943 conn(0x7f367c0d44f0 msgr2=0x7f367c15d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.442+0000 7f3682e53640 1 -- 172.21.15.81:0/626413943 shutdown_connections 2024-09-16T01:21:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.442+0000 7f3682e53640 1 -- 172.21.15.81:0/626413943 wait complete. 2024-09-16T01:21:58.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:21:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.556+0000 7fc89bd31640 1 Processor -- start 2024-09-16T01:21:58.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.557+0000 7fc89bd31640 1 -- start start 2024-09-16T01:21:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.557+0000 7fc89bd31640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc8940b0180 0x7fc894162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.557+0000 7fc89bd31640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc89415eb60 con 0x7fc8940af280 2024-09-16T01:21:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.557+0000 7fc89bd31640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc89415ee40 con 0x7fc8940b69d0 2024-09-16T01:21:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.557+0000 7fc89bd31640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc8940b6db0 con 0x7fc8940b0180 2024-09-16T01:21:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.558+0000 7fc8992cc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc8940b0180 0x7fc894162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.558+0000 7fc89a2ce640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc8940af280 0x7fc894154d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52584/0 (socket says 172.21.15.81:52584) 2024-09-16T01:21:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.558+0000 7fc89a2ce640 1 -- 172.21.15.81:0/2066078844 learned_addr learned my addr 172.21.15.81:0/2066078844 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:21:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.558+0000 7fc8992cc640 1 -- 172.21.15.81:0/2066078844 >> v1:172.21.15.102:6789/0 conn(0x7fc8940b69d0 legacy=0x7fc8940afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.558+0000 7fc8992cc640 1 -- 172.21.15.81:0/2066078844 >> v1:172.21.15.81:6789/0 conn(0x7fc8940af280 legacy=0x7fc894154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.558+0000 7fc8992cc640 1 -- 172.21.15.81:0/2066078844 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89415f120 con 0x7fc8940b0180 2024-09-16T01:21:58.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.558+0000 7fc898acb640 1 -- 172.21.15.81:0/2066078844 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 317966894 0 0) 0x7fc89415eb60 con 0x7fc8940af280 2024-09-16T01:21:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.559+0000 7fc8992cc640 1 --2- 172.21.15.81:0/2066078844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8940b0180 0x7fc894162a50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fc8900097a0 tx=0x7fc89002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78ffabedcf153c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.559+0000 7fc898acb640 1 -- 172.21.15.81:0/2066078844 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc890037070 con 0x7fc8940b0180 2024-09-16T01:21:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.559+0000 7fc898acb640 1 -- 172.21.15.81:0/2066078844 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc890032440 con 0x7fc8940b0180 2024-09-16T01:21:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.559+0000 7fc898acb640 1 -- 172.21.15.81:0/2066078844 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89002ae60 con 0x7fc8940b0180 2024-09-16T01:21:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.559+0000 7fc89bd31640 1 -- 172.21.15.81:0/2066078844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8940b0180 msgr2=0x7fc894162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.559+0000 7fc89bd31640 1 --2- 172.21.15.81:0/2066078844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8940b0180 0x7fc894162a50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fc8900097a0 tx=0x7fc89002a110 comp rx=0 tx=0).stop 2024-09-16T01:21:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.559+0000 7fc89bd31640 1 -- 172.21.15.81:0/2066078844 shutdown_connections 2024-09-16T01:21:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.559+0000 7fc89bd31640 1 --2- 172.21.15.81:0/2066078844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8940b0180 0x7fc894162a50 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.559+0000 7fc89bd31640 1 -- 172.21.15.81:0/2066078844 >> 172.21.15.81:0/2066078844 conn(0x7fc89406bc10 msgr2=0x7fc89406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.559+0000 7fc89bd31640 1 -- 172.21.15.81:0/2066078844 shutdown_connections 2024-09-16T01:21:58.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.559+0000 7fc89bd31640 1 -- 172.21.15.81:0/2066078844 wait complete. 2024-09-16T01:21:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.561+0000 7fc89bd31640 1 Processor -- start 2024-09-16T01:21:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.561+0000 7fc89bd31640 1 -- start start 2024-09-16T01:21:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.561+0000 7fc89bd31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8940af280 0x7fc894158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.561+0000 7fc89bd31640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc8940b0180 0x7fc8940cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.561+0000 7fc89bd31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8940b69d0 0x7fc8941f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.561+0000 7fc89bd31640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc89406f870 con 0x7fc8940af280 2024-09-16T01:21:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.561+0000 7fc89bd31640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc8940af6d0 con 0x7fc8940b69d0 2024-09-16T01:21:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.561+0000 7fc89bd31640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc89406f9f0 con 0x7fc8940b0180 2024-09-16T01:21:58.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.561+0000 7fc899acd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8940af280 0x7fc894158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.561+0000 7fc899acd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8940af280 0x7fc894158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51584/0 (socket says 172.21.15.81:51584) 2024-09-16T01:21:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.561+0000 7fc899acd640 1 -- 172.21.15.81:0/2195774720 learned_addr learned my addr 172.21.15.81:0/2195774720 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc89a2ce640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8940b69d0 0x7fc8941f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc8992cc640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc8940b0180 0x7fc8940cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc899acd640 1 -- 172.21.15.81:0/2195774720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc8940b0180 msgr2=0x7fc8940cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc899acd640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc8940b0180 0x7fc8940cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc899acd640 1 -- 172.21.15.81:0/2195774720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8940b69d0 msgr2=0x7fc8941f7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc899acd640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8940b69d0 0x7fc8941f7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc899acd640 1 -- 172.21.15.81:0/2195774720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc894159760 con 0x7fc8940af280 2024-09-16T01:21:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc899acd640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8940af280 0x7fc894158e60 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fc88800c400 tx=0x7fc88800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc8867fc640 1 -- 172.21.15.81:0/2195774720 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc888017070 con 0x7fc8940af280 2024-09-16T01:21:58.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc8867fc640 1 -- 172.21.15.81:0/2195774720 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8880052d0 con 0x7fc8940af280 2024-09-16T01:21:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc89bd31640 1 -- 172.21.15.81:0/2195774720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc894159a40 con 0x7fc8940af280 2024-09-16T01:21:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc8867fc640 1 -- 172.21.15.81:0/2195774720 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc888003830 con 0x7fc8940af280 2024-09-16T01:21:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.562+0000 7fc89bd31640 1 -- 172.21.15.81:0/2195774720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89415a2e0 con 0x7fc8940af280 2024-09-16T01:21:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.563+0000 7fc89bd31640 1 -- 172.21.15.81:0/2195774720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc894159c10 con 0x7fc8940af280 2024-09-16T01:21:58.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.563+0000 7fc8867fc640 1 -- 172.21.15.81:0/2195774720 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc88801a070 con 0x7fc8940af280 2024-09-16T01:21:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.564+0000 7fc8867fc640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc87806c2b0 0x7fc87806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.564+0000 7fc8867fc640 1 -- 172.21.15.81:0/2195774720 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5249+0+0 (secure 0 0 0) 0x7fc88808a520 con 0x7fc8940af280 2024-09-16T01:21:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.564+0000 7fc8992cc640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc87806c2b0 0x7fc87806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.564+0000 7fc8992cc640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc87806c2b0 0x7fc87806e770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc890034000 tx=0x7fc89002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.568+0000 7fc8867fc640 1 -- 172.21.15.81:0/2195774720 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc888058800 con 0x7fc8940af280 2024-09-16T01:21:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.735+0000 7fc89bd31640 1 -- 172.21.15.81:0/2195774720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc894162a50 con 0x7fc8940af280 2024-09-16T01:21:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.735+0000 7fc8867fc640 1 -- 172.21.15.81:0/2195774720 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v109) ==== 84+0+65 (secure 0 0 0) 0x7fc88805cb00 con 0x7fc8940af280 2024-09-16T01:21:58.736 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:21:58.736 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-16T01:21:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:21:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-16T01:21:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-16T01:21:58.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:21:58.737 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-16T01:21:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.737+0000 7fc89bd31640 1 -- 172.21.15.81:0/2195774720 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc87806c2b0 msgr2=0x7fc87806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.737+0000 7fc89bd31640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc87806c2b0 0x7fc87806e770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc890034000 tx=0x7fc89002e000 comp rx=0 tx=0).stop 2024-09-16T01:21:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.737+0000 7fc89bd31640 1 -- 172.21.15.81:0/2195774720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8940af280 msgr2=0x7fc894158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.737+0000 7fc89bd31640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8940af280 0x7fc894158e60 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fc88800c400 tx=0x7fc88800c8c0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.737+0000 7fc89bd31640 1 -- 172.21.15.81:0/2195774720 shutdown_connections 2024-09-16T01:21:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.737+0000 7fc89bd31640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc87806c2b0 0x7fc87806e770 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.737+0000 7fc89bd31640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8940b69d0 0x7fc8941f7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.737+0000 7fc89bd31640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc8940b0180 0x7fc8940cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.737+0000 7fc89bd31640 1 --2- 172.21.15.81:0/2195774720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8940af280 0x7fc894158e60 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.737+0000 7fc89bd31640 1 -- 172.21.15.81:0/2195774720 >> 172.21.15.81:0/2195774720 conn(0x7fc89406bc10 msgr2=0x7fc8940b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.737+0000 7fc89bd31640 1 -- 172.21.15.81:0/2195774720 shutdown_connections 2024-09-16T01:21:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.737+0000 7fc89bd31640 1 -- 172.21.15.81:0/2195774720 wait complete. 2024-09-16T01:21:58.749 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:21:58.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:21:58.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.850+0000 7f3be0b5f640 1 Processor -- start 2024-09-16T01:21:58.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.850+0000 7f3be0b5f640 1 -- start start 2024-09-16T01:21:58.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.851+0000 7f3be0b5f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3bdc15e2e0 0x7f3bdc0b0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.851+0000 7f3be0b5f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3bdc067ae0 0x7f3bdc15f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.851+0000 7f3be0b5f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bdc15f8f0 con 0x7f3bdc0adce0 2024-09-16T01:21:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.851+0000 7f3be0b5f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3bdc0aec30 con 0x7f3bdc15e2e0 2024-09-16T01:21:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.851+0000 7f3be0b5f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3bdc067ff0 con 0x7f3bdc067ae0 2024-09-16T01:21:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.851+0000 7f3bda59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3bdc15e2e0 0x7f3bdc0b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.851+0000 7f3bda59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3bdc15e2e0 0x7f3bdc0b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51598/0 (socket says 172.21.15.81:51598) 2024-09-16T01:21:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.851+0000 7f3bda59c640 1 -- 172.21.15.81:0/48051419 learned_addr learned my addr 172.21.15.81:0/48051419 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.851+0000 7f3bd9d9b640 1 --2- 172.21.15.81:0/48051419 >> v2:172.21.15.102:3300/0 conn(0x7f3bdc067ae0 0x7f3bdc15f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.852+0000 7f3bda59c640 1 -- 172.21.15.81:0/48051419 >> v2:172.21.15.102:3300/0 conn(0x7f3bdc067ae0 msgr2=0x7f3bdc15f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.852+0000 7f3bda59c640 1 --2- 172.21.15.81:0/48051419 >> v2:172.21.15.102:3300/0 conn(0x7f3bdc067ae0 0x7f3bdc15f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.852+0000 7f3bda59c640 1 -- 172.21.15.81:0/48051419 >> v1:172.21.15.102:6789/0 conn(0x7f3bdc0adce0 legacy=0x7f3bdc0ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.852+0000 7f3bda59c640 1 -- 172.21.15.81:0/48051419 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc0af390 con 0x7f3bdc15e2e0 2024-09-16T01:21:58.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.852+0000 7f3bd9d9b640 1 --2- 172.21.15.81:0/48051419 >> v2:172.21.15.102:3300/0 conn(0x7f3bdc067ae0 0x7f3bdc15f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.852+0000 7f3bda59c640 1 --2- 172.21.15.81:0/48051419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bdc15e2e0 0x7f3bdc0b0150 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0b0690 tx=0x7f3bcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34eab23f650ebe6f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.852+0000 7f3bd959a640 1 -- 172.21.15.81:0/48051419 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc037070 con 0x7f3bdc15e2e0 2024-09-16T01:21:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.853+0000 7f3bd959a640 1 -- 172.21.15.81:0/48051419 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bcc032440 con 0x7f3bdc15e2e0 2024-09-16T01:21:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.853+0000 7f3bd959a640 1 -- 172.21.15.81:0/48051419 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc032810 con 0x7f3bdc15e2e0 2024-09-16T01:21:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.853+0000 7f3be0b5f640 1 -- 172.21.15.81:0/48051419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bdc15e2e0 msgr2=0x7f3bdc0b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.853+0000 7f3be0b5f640 1 --2- 172.21.15.81:0/48051419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bdc15e2e0 0x7f3bdc0b0150 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0b0690 tx=0x7f3bcc02a270 comp rx=0 tx=0).stop 2024-09-16T01:21:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.853+0000 7f3be0b5f640 1 -- 172.21.15.81:0/48051419 shutdown_connections 2024-09-16T01:21:58.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.853+0000 7f3be0b5f640 1 --2- 172.21.15.81:0/48051419 >> v2:172.21.15.102:3300/0 conn(0x7f3bdc067ae0 0x7f3bdc15f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.853+0000 7f3be0b5f640 1 --2- 172.21.15.81:0/48051419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bdc15e2e0 0x7f3bdc0b0150 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.853+0000 7f3be0b5f640 1 -- 172.21.15.81:0/48051419 >> 172.21.15.81:0/48051419 conn(0x7f3bdc073590 msgr2=0x7f3bdc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.853+0000 7f3be0b5f640 1 -- 172.21.15.81:0/48051419 shutdown_connections 2024-09-16T01:21:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.853+0000 7f3be0b5f640 1 -- 172.21.15.81:0/48051419 wait complete. 2024-09-16T01:21:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.854+0000 7f3be0b5f640 1 Processor -- start 2024-09-16T01:21:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.855+0000 7f3be0b5f640 1 -- start start 2024-09-16T01:21:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.855+0000 7f3be0b5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bdc067ae0 0x7f3bdc0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.855+0000 7f3be0b5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bdc0adce0 0x7f3bdc14f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.855+0000 7f3be0b5f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc15e2e0 0x7f3bdc15b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.855+0000 7f3be0b5f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc0afc30 con 0x7f3bdc067ae0 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.855+0000 7f3be0b5f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3bdc0af950 con 0x7f3bdc0adce0 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.855+0000 7f3be0b5f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3bdc15e6c0 con 0x7f3bdc15e2e0 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.855+0000 7f3bda59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bdc067ae0 0x7f3bdc0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.855+0000 7f3bda59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bdc067ae0 0x7f3bdc0cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51610/0 (socket says 172.21.15.81:51610) 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.855+0000 7f3bda59c640 1 -- 172.21.15.81:0/2485490992 learned_addr learned my addr 172.21.15.81:0/2485490992 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.855+0000 7f3bdad9d640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc15e2e0 0x7f3bdc15b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.855+0000 7f3bd9d9b640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bdc0adce0 0x7f3bdc14f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.856+0000 7f3bda59c640 1 -- 172.21.15.81:0/2485490992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc15e2e0 msgr2=0x7f3bdc15b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.856+0000 7f3bda59c640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc15e2e0 0x7f3bdc15b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.856+0000 7f3bda59c640 1 -- 172.21.15.81:0/2485490992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bdc0adce0 msgr2=0x7f3bdc14f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.856+0000 7f3bda59c640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bdc0adce0 0x7f3bdc14f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.856+0000 7f3bda59c640 1 -- 172.21.15.81:0/2485490992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bdc0cd990 con 0x7f3bdc067ae0 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.856+0000 7f3bdad9d640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc15e2e0 0x7f3bdc15b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:21:58.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.856+0000 7f3bda59c640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bdc067ae0 0x7f3bdc0cd450 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc02a2b0 tx=0x7f3bcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.856+0000 7f3bcaffd640 1 -- 172.21.15.81:0/2485490992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc041020 con 0x7f3bdc067ae0 2024-09-16T01:21:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.856+0000 7f3bcaffd640 1 -- 172.21.15.81:0/2485490992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bcc0306c0 con 0x7f3bdc067ae0 2024-09-16T01:21:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.856+0000 7f3be0b5f640 1 -- 172.21.15.81:0/2485490992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bdc14fe80 con 0x7f3bdc067ae0 2024-09-16T01:21:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.856+0000 7f3bcaffd640 1 -- 172.21.15.81:0/2485490992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc037040 con 0x7f3bdc067ae0 2024-09-16T01:21:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.856+0000 7f3be0b5f640 1 -- 172.21.15.81:0/2485490992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bdc0cdf10 con 0x7f3bdc067ae0 2024-09-16T01:21:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.857+0000 7f3be0b5f640 1 -- 172.21.15.81:0/2485490992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bdc15f3b0 con 0x7f3bdc067ae0 2024-09-16T01:21:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.857+0000 7f3bcaffd640 1 -- 172.21.15.81:0/2485490992 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3bcc044020 con 0x7f3bdc067ae0 2024-09-16T01:21:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.858+0000 7f3bcaffd640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3bbc06c2b0 0x7f3bbc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.858+0000 7f3bcaffd640 1 -- 172.21.15.81:0/2485490992 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 5249+0+0 (secure 0 0 0) 0x7f3bcc0abab0 con 0x7f3bdc067ae0 2024-09-16T01:21:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.858+0000 7f3bd9d9b640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3bbc06c2b0 0x7f3bbc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:58.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.858+0000 7f3bd9d9b640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3bbc06c2b0 0x7f3bbc06e770 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0006fd0 tx=0x7f3bd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:58.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:58.862+0000 7f3bcaffd640 1 -- 172.21.15.81:0/2485490992 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3bcc04b030 con 0x7f3bdc067ae0 2024-09-16T01:21:59.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.028+0000 7f3be0b5f640 1 -- 172.21.15.81:0/2485490992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3bdc06be60 con 0x7f3bdc067ae0 2024-09-16T01:21:59.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.085+0000 7f3bcaffd640 1 -- 172.21.15.81:0/2485490992 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v110) ==== 138+0+0 (secure 0 0 0) 0x7f3bcc07a3e0 con 0x7f3bdc067ae0 2024-09-16T01:21:59.086 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-16T01:21:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.087+0000 7f3be0b5f640 1 -- 172.21.15.81:0/2485490992 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3bbc06c2b0 msgr2=0x7f3bbc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.087+0000 7f3be0b5f640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3bbc06c2b0 0x7f3bbc06e770 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0006fd0 tx=0x7f3bd0008040 comp rx=0 tx=0).stop 2024-09-16T01:21:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.087+0000 7f3be0b5f640 1 -- 172.21.15.81:0/2485490992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bdc067ae0 msgr2=0x7f3bdc0cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.087+0000 7f3be0b5f640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bdc067ae0 0x7f3bdc0cd450 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc02a2b0 tx=0x7f3bcc0046c0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.087+0000 7f3be0b5f640 1 -- 172.21.15.81:0/2485490992 shutdown_connections 2024-09-16T01:21:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.087+0000 7f3be0b5f640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3bbc06c2b0 0x7f3bbc06e770 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.087+0000 7f3be0b5f640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3bdc15e2e0 0x7f3bdc15b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.087+0000 7f3be0b5f640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3bdc0adce0 0x7f3bdc14f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.087+0000 7f3be0b5f640 1 --2- 172.21.15.81:0/2485490992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bdc067ae0 0x7f3bdc0cd450 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.087+0000 7f3be0b5f640 1 -- 172.21.15.81:0/2485490992 >> 172.21.15.81:0/2485490992 conn(0x7f3bdc073590 msgr2=0x7f3bdc06c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:59.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.087+0000 7f3be0b5f640 1 -- 172.21.15.81:0/2485490992 shutdown_connections 2024-09-16T01:21:59.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.087+0000 7f3be0b5f640 1 -- 172.21.15.81:0/2485490992 wait complete. 2024-09-16T01:21:59.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:21:59.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.207+0000 7f83424ba640 1 Processor -- start 2024-09-16T01:21:59.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.207+0000 7f83424ba640 1 -- start start 2024-09-16T01:21:59.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f83424ba640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f833c06c320 0x7f833c0b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:59.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f83424ba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f833c15d350 0x7f833c165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:59.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f83424ba640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f833c15d8a0 con 0x7f833c145e50 2024-09-16T01:21:59.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f83424ba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f833c0b7230 con 0x7f833c15d350 2024-09-16T01:21:59.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f83424ba640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f833c0ae420 con 0x7f833c06c320 2024-09-16T01:21:59.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f8340a57640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f833c15d350 0x7f833c165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:59.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f8340a57640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f833c15d350 0x7f833c165ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51616/0 (socket says 172.21.15.81:51616) 2024-09-16T01:21:59.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f833bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f833c145e50 0x7f833c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52600/0 (socket says 172.21.15.81:52600) 2024-09-16T01:21:59.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f8340a57640 1 -- 172.21.15.81:0/1170856938 learned_addr learned my addr 172.21.15.81:0/1170856938 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:59.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f833b7fe640 1 --2- 172.21.15.81:0/1170856938 >> v2:172.21.15.102:3300/0 conn(0x7f833c06c320 0x7f833c0b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:59.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f8340a57640 1 -- 172.21.15.81:0/1170856938 >> v2:172.21.15.102:3300/0 conn(0x7f833c06c320 msgr2=0x7f833c0b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:21:59.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f8340a57640 1 --2- 172.21.15.81:0/1170856938 >> v2:172.21.15.102:3300/0 conn(0x7f833c06c320 0x7f833c0b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f8340a57640 1 -- 172.21.15.81:0/1170856938 >> v1:172.21.15.81:6789/0 conn(0x7f833c145e50 legacy=0x7f833c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:59.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f833affd640 1 -- 172.21.15.81:0/1170856938 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417041653 0 0) 0x7f833c15d8a0 con 0x7f833c145e50 2024-09-16T01:21:59.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.208+0000 7f8340a57640 1 -- 172.21.15.81:0/1170856938 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c15dba0 con 0x7f833c15d350 2024-09-16T01:21:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.209+0000 7f8340a57640 1 --2- 172.21.15.81:0/1170856938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c15d350 0x7f833c165ef0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f833c0cd2a0 tx=0x7f833402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64707c571826256b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.209+0000 7f833affd640 1 -- 172.21.15.81:0/1170856938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8334036070 con 0x7f833c15d350 2024-09-16T01:21:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.209+0000 7f833affd640 1 -- 172.21.15.81:0/1170856938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8334031600 con 0x7f833c15d350 2024-09-16T01:21:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.209+0000 7f833affd640 1 -- 172.21.15.81:0/1170856938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83340319d0 con 0x7f833c15d350 2024-09-16T01:21:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.210+0000 7f83424ba640 1 -- 172.21.15.81:0/1170856938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c15d350 msgr2=0x7f833c165ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.210+0000 7f83424ba640 1 --2- 172.21.15.81:0/1170856938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c15d350 0x7f833c165ef0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f833c0cd2a0 tx=0x7f833402a730 comp rx=0 tx=0).stop 2024-09-16T01:21:59.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.210+0000 7f83424ba640 1 -- 172.21.15.81:0/1170856938 shutdown_connections 2024-09-16T01:21:59.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.210+0000 7f83424ba640 1 --2- 172.21.15.81:0/1170856938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c15d350 0x7f833c165ef0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.210+0000 7f83424ba640 1 --2- 172.21.15.81:0/1170856938 >> v2:172.21.15.102:3300/0 conn(0x7f833c06c320 0x7f833c0b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.210+0000 7f83424ba640 1 -- 172.21.15.81:0/1170856938 >> 172.21.15.81:0/1170856938 conn(0x7f833c09aa30 msgr2=0x7f833c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:21:59.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.210+0000 7f83424ba640 1 -- 172.21.15.81:0/1170856938 shutdown_connections 2024-09-16T01:21:59.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.210+0000 7f83424ba640 1 -- 172.21.15.81:0/1170856938 wait complete. 2024-09-16T01:21:59.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.211+0000 7f83424ba640 1 Processor -- start 2024-09-16T01:21:59.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.211+0000 7f83424ba640 1 -- start start 2024-09-16T01:21:59.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f83424ba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f833c06c320 0x7f833c1f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:59.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f83424ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c145e50 0x7f833c137a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:59.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f83424ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f833c15d350 0x7f833c1e5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:59.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f83424ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f833c15e160 con 0x7f833c145e50 2024-09-16T01:21:59.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f83424ba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f833c15e4d0 con 0x7f833c06c320 2024-09-16T01:21:59.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f83424ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f833c15f970 con 0x7f833c15d350 2024-09-16T01:21:59.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f833b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c145e50 0x7f833c137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f833b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c145e50 0x7f833c137a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51626/0 (socket says 172.21.15.81:51626) 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f833b7fe640 1 -- 172.21.15.81:0/222808805 learned_addr learned my addr 172.21.15.81:0/222808805 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f833bfff640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f833c06c320 0x7f833c1f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f8340a57640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f833c15d350 0x7f833c1e5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f833b7fe640 1 -- 172.21.15.81:0/222808805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f833c15d350 msgr2=0x7f833c1e5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f833b7fe640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f833c15d350 0x7f833c1e5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f833b7fe640 1 -- 172.21.15.81:0/222808805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f833c06c320 msgr2=0x7f833c1f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f833b7fe640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f833c06c320 0x7f833c1f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f833b7fe640 1 -- 172.21.15.81:0/222808805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833c1e5b40 con 0x7f833c145e50 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f833bfff640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f833c06c320 0x7f833c1f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f8340a57640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f833c15d350 0x7f833c1e5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.212+0000 7f833b7fe640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c145e50 0x7f833c137a30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f833000d830 tx=0x7f833000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.213+0000 7f8338ff9640 1 -- 172.21.15.81:0/222808805 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833000b6c0 con 0x7f833c145e50 2024-09-16T01:21:59.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.213+0000 7f8338ff9640 1 -- 172.21.15.81:0/222808805 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8330019070 con 0x7f833c145e50 2024-09-16T01:21:59.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.213+0000 7f8338ff9640 1 -- 172.21.15.81:0/222808805 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833000ba80 con 0x7f833c145e50 2024-09-16T01:21:59.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.213+0000 7f83424ba640 1 -- 172.21.15.81:0/222808805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833c1e5de0 con 0x7f833c145e50 2024-09-16T01:21:59.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.213+0000 7f83424ba640 1 -- 172.21.15.81:0/222808805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833c1e63a0 con 0x7f833c145e50 2024-09-16T01:21:59.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.214+0000 7f83424ba640 1 -- 172.21.15.81:0/222808805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f833c0b6cf0 con 0x7f833c145e50 2024-09-16T01:21:59.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.214+0000 7f8338ff9640 1 -- 172.21.15.81:0/222808805 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f833001e460 con 0x7f833c145e50 2024-09-16T01:21:59.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.215+0000 7f8338ff9640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f832806c2b0 0x7f832806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:21:59.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.215+0000 7f8338ff9640 1 -- 172.21.15.81:0/222808805 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5619+0+0 (secure 0 0 0) 0x7f833008ba30 con 0x7f833c145e50 2024-09-16T01:21:59.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.215+0000 7f833bfff640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f832806c2b0 0x7f832806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:21:59.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.215+0000 7f833bfff640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f832806c2b0 0x7f832806e770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f832c000f60 tx=0x7f832c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:21:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.219+0000 7f8338ff9640 1 -- 172.21.15.81:0/222808805 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f833005a280 con 0x7f833c145e50 2024-09-16T01:21:59.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:21:59.384+0000 7f83424ba640 1 -- 172.21.15.81:0/222808805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f833c070760 con 0x7f833c145e50 2024-09-16T01:22:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.091+0000 7f8338ff9640 1 -- 172.21.15.81:0/222808805 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v111) ==== 170+0+0 (secure 0 0 0) 0x7f8330059b80 con 0x7f833c145e50 2024-09-16T01:22:00.092 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-16T01:22:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.093+0000 7f83424ba640 1 -- 172.21.15.81:0/222808805 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f832806c2b0 msgr2=0x7f832806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.093+0000 7f83424ba640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f832806c2b0 0x7f832806e770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f832c000f60 tx=0x7f832c009040 comp rx=0 tx=0).stop 2024-09-16T01:22:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.093+0000 7f83424ba640 1 -- 172.21.15.81:0/222808805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c145e50 msgr2=0x7f833c137a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.093+0000 7f83424ba640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c145e50 0x7f833c137a30 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f833000d830 tx=0x7f833000dcf0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.094+0000 7f83424ba640 1 -- 172.21.15.81:0/222808805 shutdown_connections 2024-09-16T01:22:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.094+0000 7f83424ba640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f832806c2b0 0x7f832806e770 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.094+0000 7f83424ba640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f833c15d350 0x7f833c1e5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.094+0000 7f83424ba640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f833c145e50 0x7f833c137a30 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.094+0000 7f83424ba640 1 --2- 172.21.15.81:0/222808805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f833c06c320 0x7f833c1f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.094+0000 7f83424ba640 1 -- 172.21.15.81:0/222808805 >> 172.21.15.81:0/222808805 conn(0x7f833c09aa30 msgr2=0x7f833c0b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.098+0000 7f83424ba640 1 -- 172.21.15.81:0/222808805 shutdown_connections 2024-09-16T01:22:00.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.100+0000 7f83424ba640 1 -- 172.21.15.81:0/222808805 wait complete. 2024-09-16T01:22:00.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:22:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.226+0000 7f4e5d07b640 1 Processor -- start 2024-09-16T01:22:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.226+0000 7f4e5d07b640 1 -- start start 2024-09-16T01:22:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.227+0000 7f4e5d07b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4e58161a20 0x7f4e580d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.227+0000 7f4e5d07b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e580d1420 0x7f4e580cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.227+0000 7f4e5d07b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e5806e820 con 0x7f4e580cf160 2024-09-16T01:22:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.227+0000 7f4e5d07b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4e58161e00 con 0x7f4e58161a20 2024-09-16T01:22:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.227+0000 7f4e5d07b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4e580d1830 con 0x7f4e580d1420 2024-09-16T01:22:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.227+0000 7f4e5759e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4e580cf160 0x7f4e580b5f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52602/0 (socket says 172.21.15.81:52602) 2024-09-16T01:22:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.227+0000 7f4e5759e640 1 -- 172.21.15.81:0/4220796893 learned_addr learned my addr 172.21.15.81:0/4220796893 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:00.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.227+0000 7f4e56d9d640 1 --2- 172.21.15.81:0/4220796893 >> v2:172.21.15.102:3300/0 conn(0x7f4e58161a20 0x7f4e580d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.227+0000 7f4e5659c640 1 --2- 172.21.15.81:0/4220796893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e580d1420 0x7f4e580cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.227+0000 7f4e55d9b640 1 -- 172.21.15.81:0/4220796893 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025507508 0 0) 0x7f4e5806e820 con 0x7f4e580cf160 2024-09-16T01:22:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.227+0000 7f4e55d9b640 1 -- 172.21.15.81:0/4220796893 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e40003520 con 0x7f4e580cf160 2024-09-16T01:22:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.228+0000 7f4e56d9d640 1 -- 172.21.15.81:0/4220796893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e580d1420 msgr2=0x7f4e580cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.228+0000 7f4e56d9d640 1 --2- 172.21.15.81:0/4220796893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e580d1420 0x7f4e580cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.228+0000 7f4e56d9d640 1 -- 172.21.15.81:0/4220796893 >> v1:172.21.15.81:6789/0 conn(0x7f4e580cf160 legacy=0x7f4e580b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.228+0000 7f4e56d9d640 1 -- 172.21.15.81:0/4220796893 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e580cf980 con 0x7f4e58161a20 2024-09-16T01:22:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.228+0000 7f4e5659c640 1 --2- 172.21.15.81:0/4220796893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e580d1420 0x7f4e580cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.228+0000 7f4e56d9d640 1 --2- 172.21.15.81:0/4220796893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e58161a20 0x7f4e580d0ee0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0097a0 tx=0x7f4e4c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=501de80cf6651389 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.229+0000 7f4e55d9b640 1 -- 172.21.15.81:0/4220796893 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c037070 con 0x7f4e58161a20 2024-09-16T01:22:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.229+0000 7f4e55d9b640 1 -- 172.21.15.81:0/4220796893 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e4c032440 con 0x7f4e58161a20 2024-09-16T01:22:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.229+0000 7f4e55d9b640 1 -- 172.21.15.81:0/4220796893 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c0327f0 con 0x7f4e58161a20 2024-09-16T01:22:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.229+0000 7f4e5d07b640 1 -- 172.21.15.81:0/4220796893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e58161a20 msgr2=0x7f4e580d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.229+0000 7f4e5d07b640 1 --2- 172.21.15.81:0/4220796893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e58161a20 0x7f4e580d0ee0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0097a0 tx=0x7f4e4c02a180 comp rx=0 tx=0).stop 2024-09-16T01:22:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.229+0000 7f4e5d07b640 1 -- 172.21.15.81:0/4220796893 shutdown_connections 2024-09-16T01:22:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.229+0000 7f4e5d07b640 1 --2- 172.21.15.81:0/4220796893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e580d1420 0x7f4e580cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.229+0000 7f4e5d07b640 1 --2- 172.21.15.81:0/4220796893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e58161a20 0x7f4e580d0ee0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.229+0000 7f4e5d07b640 1 -- 172.21.15.81:0/4220796893 >> 172.21.15.81:0/4220796893 conn(0x7f4e5809d850 msgr2=0x7f4e5808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.229+0000 7f4e5d07b640 1 -- 172.21.15.81:0/4220796893 shutdown_connections 2024-09-16T01:22:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.229+0000 7f4e5d07b640 1 -- 172.21.15.81:0/4220796893 wait complete. 2024-09-16T01:22:00.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.231+0000 7f4e5d07b640 1 Processor -- start 2024-09-16T01:22:00.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.231+0000 7f4e5d07b640 1 -- start start 2024-09-16T01:22:00.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.231+0000 7f4e5d07b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e580cf160 0x7f4e581f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:00.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.231+0000 7f4e5d07b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e580d1420 0x7f4e580b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:00.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.231+0000 7f4e5d07b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e58161a20 0x7f4e580a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:00.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.231+0000 7f4e5d07b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e580cff00 con 0x7f4e58161a20 2024-09-16T01:22:00.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.231+0000 7f4e5d07b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5806d050 con 0x7f4e580cf160 2024-09-16T01:22:00.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.231+0000 7f4e5d07b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5806d2f0 con 0x7f4e580d1420 2024-09-16T01:22:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e5759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e58161a20 0x7f4e580a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e5759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e58161a20 0x7f4e580a1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51636/0 (socket says 172.21.15.81:51636) 2024-09-16T01:22:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e5759e640 1 -- 172.21.15.81:0/2550773181 learned_addr learned my addr 172.21.15.81:0/2550773181 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e56d9d640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e580cf160 0x7f4e581f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e5659c640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e580d1420 0x7f4e580b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e5759e640 1 -- 172.21.15.81:0/2550773181 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e580d1420 msgr2=0x7f4e580b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e5759e640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e580d1420 0x7f4e580b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e5759e640 1 -- 172.21.15.81:0/2550773181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e580cf160 msgr2=0x7f4e581f3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e5759e640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e580cf160 0x7f4e581f3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e5759e640 1 -- 172.21.15.81:0/2550773181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e580b3f30 con 0x7f4e58161a20 2024-09-16T01:22:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e5759e640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e58161a20 0x7f4e580a1170 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000cb10 tx=0x7f4e5000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e3f7fe640 1 -- 172.21.15.81:0/2550773181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50017070 con 0x7f4e58161a20 2024-09-16T01:22:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e3f7fe640 1 -- 172.21.15.81:0/2550773181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5000ac70 con 0x7f4e58161a20 2024-09-16T01:22:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e3f7fe640 1 -- 172.21.15.81:0/2550773181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5000ae60 con 0x7f4e58161a20 2024-09-16T01:22:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.232+0000 7f4e5d07b640 1 -- 172.21.15.81:0/2550773181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e580a1ab0 con 0x7f4e58161a20 2024-09-16T01:22:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.233+0000 7f4e5d07b640 1 -- 172.21.15.81:0/2550773181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e5809e4a0 con 0x7f4e58161a20 2024-09-16T01:22:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.233+0000 7f4e5d07b640 1 -- 172.21.15.81:0/2550773181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e580b1040 con 0x7f4e58161a20 2024-09-16T01:22:00.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.234+0000 7f4e3f7fe640 1 -- 172.21.15.81:0/2550773181 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4e5001a070 con 0x7f4e58161a20 2024-09-16T01:22:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.234+0000 7f4e3f7fe640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e4406c2b0 0x7f4e4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.234+0000 7f4e3f7fe640 1 -- 172.21.15.81:0/2550773181 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 6001+0+0 (secure 0 0 0) 0x7f4e5008b270 con 0x7f4e58161a20 2024-09-16T01:22:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.234+0000 7f4e56d9d640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e4406c2b0 0x7f4e4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.235+0000 7f4e56d9d640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e4406c2b0 0x7f4e4406e770 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c034000 tx=0x7f4e4c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:00.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.239+0000 7f4e3f7fe640 1 -- 172.21.15.81:0/2550773181 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e50059270 con 0x7f4e58161a20 2024-09-16T01:22:00.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:00.438+0000 7f4e5d07b640 1 -- 172.21.15.81:0/2550773181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4e5806bda0 con 0x7f4e58161a20 2024-09-16T01:22:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 17 and data pool 18 2024-09-16T01:22:01.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.105+0000 7f4e3f7fe640 1 -- 172.21.15.81:0/2550773181 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v56) ==== 174+0+0 (secure 0 0 0) 0x7f4e5005d570 con 0x7f4e58161a20 2024-09-16T01:22:01.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.111+0000 7f4e5d07b640 1 -- 172.21.15.81:0/2550773181 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e4406c2b0 msgr2=0x7f4e4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.111+0000 7f4e5d07b640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e4406c2b0 0x7f4e4406e770 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c034000 tx=0x7f4e4c02e000 comp rx=0 tx=0).stop 2024-09-16T01:22:01.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.111+0000 7f4e5d07b640 1 -- 172.21.15.81:0/2550773181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e58161a20 msgr2=0x7f4e580a1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.111+0000 7f4e5d07b640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e58161a20 0x7f4e580a1170 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000cb10 tx=0x7f4e5000a060 comp rx=0 tx=0).stop 2024-09-16T01:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.111+0000 7f4e5d07b640 1 -- 172.21.15.81:0/2550773181 shutdown_connections 2024-09-16T01:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.112+0000 7f4e5d07b640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4e4406c2b0 0x7f4e4406e770 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.112+0000 7f4e5d07b640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e58161a20 0x7f4e580a1170 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.112+0000 7f4e5d07b640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4e580d1420 0x7f4e580b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.112+0000 7f4e5d07b640 1 --2- 172.21.15.81:0/2550773181 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e580cf160 0x7f4e581f3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.112+0000 7f4e5d07b640 1 -- 172.21.15.81:0/2550773181 >> 172.21.15.81:0/2550773181 conn(0x7f4e5809d850 msgr2=0x7f4e580b7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.112+0000 7f4e5d07b640 1 -- 172.21.15.81:0/2550773181 shutdown_connections 2024-09-16T01:22:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.112+0000 7f4e5d07b640 1 -- 172.21.15.81:0/2550773181 wait complete. 2024-09-16T01:22:01.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:22:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.237+0000 7f1d62ec9640 1 Processor -- start 2024-09-16T01:22:01.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.237+0000 7f1d62ec9640 1 -- start start 2024-09-16T01:22:01.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.238+0000 7f1d62ec9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d5c147e90 0x7f1d5c0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.238+0000 7f1d62ec9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d5c06f480 con 0x7f1d5c0725f0 2024-09-16T01:22:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.238+0000 7f1d62ec9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d5c06e900 con 0x7f1d5c147230 2024-09-16T01:22:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.238+0000 7f1d62ec9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5c0b34d0 con 0x7f1d5c147e90 2024-09-16T01:22:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.238+0000 7f1d61466640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1d5c0725f0 0x7f1d5c0aee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60104/0 (socket says 172.21.15.81:60104) 2024-09-16T01:22:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.238+0000 7f1d61466640 1 -- 172.21.15.81:0/434562811 learned_addr learned my addr 172.21.15.81:0/434562811 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.239+0000 7f1d53fff640 1 --2- 172.21.15.81:0/434562811 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d5c147e90 0x7f1d5c0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.239+0000 7f1d537fe640 1 -- 172.21.15.81:0/434562811 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322447741 0 0) 0x7f1d5c06f480 con 0x7f1d5c0725f0 2024-09-16T01:22:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.239+0000 7f1d537fe640 1 -- 172.21.15.81:0/434562811 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d44003520 con 0x7f1d5c0725f0 2024-09-16T01:22:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.239+0000 7f1d537fe640 1 -- 172.21.15.81:0/434562811 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1580453027 0 0) 0x7f1d5c06e900 con 0x7f1d5c147230 2024-09-16T01:22:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.239+0000 7f1d537fe640 1 -- 172.21.15.81:0/434562811 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d5c06f480 con 0x7f1d5c147230 2024-09-16T01:22:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.239+0000 7f1d53fff640 1 -- 172.21.15.81:0/434562811 >> v1:172.21.15.102:6789/0 conn(0x7f1d5c147230 legacy=0x7f1d5c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.239+0000 7f1d53fff640 1 -- 172.21.15.81:0/434562811 >> v1:172.21.15.81:6789/0 conn(0x7f1d5c0725f0 legacy=0x7f1d5c0aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.239+0000 7f1d53fff640 1 -- 172.21.15.81:0/434562811 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5c06ebe0 con 0x7f1d5c147e90 2024-09-16T01:22:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.240+0000 7f1d53fff640 1 --2- 172.21.15.81:0/434562811 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d5c147e90 0x7f1d5c0720b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0097d0 tx=0x7f1d4c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c461d5e9d4c1abec server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.240+0000 7f1d537fe640 1 -- 172.21.15.81:0/434562811 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c037070 con 0x7f1d5c147e90 2024-09-16T01:22:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.240+0000 7f1d537fe640 1 -- 172.21.15.81:0/434562811 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4c032440 con 0x7f1d5c147e90 2024-09-16T01:22:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.240+0000 7f1d537fe640 1 -- 172.21.15.81:0/434562811 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c032810 con 0x7f1d5c147e90 2024-09-16T01:22:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.240+0000 7f1d62ec9640 1 -- 172.21.15.81:0/434562811 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d5c147e90 msgr2=0x7f1d5c0720b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.240+0000 7f1d62ec9640 1 --2- 172.21.15.81:0/434562811 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d5c147e90 0x7f1d5c0720b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0097d0 tx=0x7f1d4c02a210 comp rx=0 tx=0).stop 2024-09-16T01:22:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.240+0000 7f1d62ec9640 1 -- 172.21.15.81:0/434562811 shutdown_connections 2024-09-16T01:22:01.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.240+0000 7f1d62ec9640 1 --2- 172.21.15.81:0/434562811 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d5c147e90 0x7f1d5c0720b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.240+0000 7f1d62ec9640 1 -- 172.21.15.81:0/434562811 >> 172.21.15.81:0/434562811 conn(0x7f1d5c067d70 msgr2=0x7f1d5c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.240+0000 7f1d62ec9640 1 -- 172.21.15.81:0/434562811 shutdown_connections 2024-09-16T01:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.240+0000 7f1d62ec9640 1 -- 172.21.15.81:0/434562811 wait complete. 2024-09-16T01:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.241+0000 7f1d62ec9640 1 Processor -- start 2024-09-16T01:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.242+0000 7f1d62ec9640 1 -- start start 2024-09-16T01:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.242+0000 7f1d62ec9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d5c0725f0 0x7f1d5c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.242+0000 7f1d62ec9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d5c147230 0x7f1d5c1f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.242+0000 7f1d62ec9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d5c147e90 0x7f1d5c0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.242+0000 7f1d62ec9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c072a40 con 0x7f1d5c147e90 2024-09-16T01:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.242+0000 7f1d62ec9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c06f1a0 con 0x7f1d5c147230 2024-09-16T01:22:01.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.242+0000 7f1d62ec9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5c147610 con 0x7f1d5c0725f0 2024-09-16T01:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.242+0000 7f1d61466640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d5c147e90 0x7f1d5c0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d61466640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d5c147e90 0x7f1d5c0c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41710/0 (socket says 172.21.15.81:41710) 2024-09-16T01:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d61466640 1 -- 172.21.15.81:0/2713519779 learned_addr learned my addr 172.21.15.81:0/2713519779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d53fff640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d5c147230 0x7f1d5c1f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d60c65640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d5c0725f0 0x7f1d5c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d61466640 1 -- 172.21.15.81:0/2713519779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d5c0725f0 msgr2=0x7f1d5c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d61466640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d5c0725f0 0x7f1d5c0cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d61466640 1 -- 172.21.15.81:0/2713519779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d5c147230 msgr2=0x7f1d5c1f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d61466640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d5c147230 0x7f1d5c1f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d61466640 1 -- 172.21.15.81:0/2713519779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5c0cfae0 con 0x7f1d5c147e90 2024-09-16T01:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d60c65640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d5c0725f0 0x7f1d5c0cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:01.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d53fff640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d5c147230 0x7f1d5c1f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d61466640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d5c147e90 0x7f1d5c0c9c50 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400cbc0 tx=0x7f1d5400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d517fa640 1 -- 172.21.15.81:0/2713519779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d54017070 con 0x7f1d5c147e90 2024-09-16T01:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d517fa640 1 -- 172.21.15.81:0/2713519779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d5400ace0 con 0x7f1d5c147e90 2024-09-16T01:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d517fa640 1 -- 172.21.15.81:0/2713519779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d54012600 con 0x7f1d5c147e90 2024-09-16T01:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d62ec9640 1 -- 172.21.15.81:0/2713519779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5c0c73d0 con 0x7f1d5c147e90 2024-09-16T01:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.243+0000 7f1d62ec9640 1 -- 172.21.15.81:0/2713519779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d5c0c7c70 con 0x7f1d5c147e90 2024-09-16T01:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.244+0000 7f1d62ec9640 1 -- 172.21.15.81:0/2713519779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d5c0c77c0 con 0x7f1d5c147e90 2024-09-16T01:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.245+0000 7f1d517fa640 1 -- 172.21.15.81:0/2713519779 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1d5401a070 con 0x7f1d5c147e90 2024-09-16T01:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.245+0000 7f1d517fa640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1d4806c2b0 0x7f1d4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.245+0000 7f1d517fa640 1 -- 172.21.15.81:0/2713519779 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 6101+0+0 (secure 0 0 0) 0x7f1d5408b2a0 con 0x7f1d5c147e90 2024-09-16T01:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.245+0000 7f1d60c65640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1d4806c2b0 0x7f1d4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.245+0000 7f1d60c65640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1d4806c2b0 0x7f1d4806e770 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c1466f0 tx=0x7f1d58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:01.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.249+0000 7f1d517fa640 1 -- 172.21.15.81:0/2713519779 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d54059240 con 0x7f1d5c147e90 2024-09-16T01:22:01.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.417+0000 7f1d62ec9640 1 -- 172.21.15.81:0/2713519779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d5c0720b0 con 0x7f1d5c147e90 2024-09-16T01:22:01.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.418+0000 7f1d517fa640 1 -- 172.21.15.81:0/2713519779 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) ==== 74+0+17025 (secure 0 0 0) 0x7f1d5405d540 con 0x7f1d5c147e90 2024-09-16T01:22:01.419 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:01.419 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":112,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:22:00.438862+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:59.046470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:59.403171+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:22:01.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.420+0000 7f1d62ec9640 1 -- 172.21.15.81:0/2713519779 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1d4806c2b0 msgr2=0x7f1d4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.420+0000 7f1d62ec9640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1d4806c2b0 0x7f1d4806e770 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c1466f0 tx=0x7f1d58009040 comp rx=0 tx=0).stop 2024-09-16T01:22:01.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.420+0000 7f1d62ec9640 1 -- 172.21.15.81:0/2713519779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d5c147e90 msgr2=0x7f1d5c0c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.420+0000 7f1d62ec9640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d5c147e90 0x7f1d5c0c9c50 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400cbc0 tx=0x7f1d5400a430 comp rx=0 tx=0).stop 2024-09-16T01:22:01.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.420+0000 7f1d62ec9640 1 -- 172.21.15.81:0/2713519779 shutdown_connections 2024-09-16T01:22:01.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.420+0000 7f1d62ec9640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1d4806c2b0 0x7f1d4806e770 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.420+0000 7f1d62ec9640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d5c147e90 0x7f1d5c0c9c50 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.420+0000 7f1d62ec9640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d5c147230 0x7f1d5c1f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.420+0000 7f1d62ec9640 1 --2- 172.21.15.81:0/2713519779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d5c0725f0 0x7f1d5c0cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.420+0000 7f1d62ec9640 1 -- 172.21.15.81:0/2713519779 >> 172.21.15.81:0/2713519779 conn(0x7f1d5c067d70 msgr2=0x7f1d5c142990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:01.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.420+0000 7f1d62ec9640 1 -- 172.21.15.81:0/2713519779 shutdown_connections 2024-09-16T01:22:01.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.421+0000 7f1d62ec9640 1 -- 172.21.15.81:0/2713519779 wait complete. 2024-09-16T01:22:01.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:22:01.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.531+0000 7f428659f640 1 Processor -- start 2024-09-16T01:22:01.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.531+0000 7f428659f640 1 -- start start 2024-09-16T01:22:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f428659f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42800d4180 0x7f42800d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f428659f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f428015e6a0 0x7f428006d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f428659f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42800d4aa0 con 0x7f428006dd60 2024-09-16T01:22:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f428659f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f428006e170 con 0x7f42800d4180 2024-09-16T01:22:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f428659f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f42800cefb0 con 0x7f428015e6a0 2024-09-16T01:22:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f428559d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f42800d4180 0x7f42800d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f4285d9e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f428006dd60 0x7f42800d0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60116/0 (socket says 172.21.15.81:60116) 2024-09-16T01:22:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f4285d9e640 1 -- 172.21.15.81:0/3049224783 learned_addr learned my addr 172.21.15.81:0/3049224783 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f4284d9c640 1 --2- 172.21.15.81:0/3049224783 >> v2:172.21.15.102:3300/0 conn(0x7f428015e6a0 0x7f428006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f428559d640 1 -- 172.21.15.81:0/3049224783 >> v2:172.21.15.102:3300/0 conn(0x7f428015e6a0 msgr2=0x7f428006d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f428559d640 1 --2- 172.21.15.81:0/3049224783 >> v2:172.21.15.102:3300/0 conn(0x7f428015e6a0 0x7f428006d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f428559d640 1 -- 172.21.15.81:0/3049224783 >> v1:172.21.15.81:6789/0 conn(0x7f428006dd60 legacy=0x7f42800d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.532+0000 7f428559d640 1 -- 172.21.15.81:0/3049224783 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42800d2c20 con 0x7f42800d4180 2024-09-16T01:22:01.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.533+0000 7f428559d640 1 --2- 172.21.15.81:0/3049224783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42800d4180 0x7f42800d4560 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f428008d740 tx=0x7f427c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e3bb691cbeb5b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:01.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.533+0000 7f4277fff640 1 -- 172.21.15.81:0/3049224783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c037070 con 0x7f42800d4180 2024-09-16T01:22:01.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.533+0000 7f4277fff640 1 -- 172.21.15.81:0/3049224783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427c032440 con 0x7f42800d4180 2024-09-16T01:22:01.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.533+0000 7f4277fff640 1 -- 172.21.15.81:0/3049224783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c02ae60 con 0x7f42800d4180 2024-09-16T01:22:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.533+0000 7f428659f640 1 -- 172.21.15.81:0/3049224783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42800d4180 msgr2=0x7f42800d4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.533+0000 7f428659f640 1 --2- 172.21.15.81:0/3049224783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42800d4180 0x7f42800d4560 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f428008d740 tx=0x7f427c02a110 comp rx=0 tx=0).stop 2024-09-16T01:22:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.534+0000 7f428659f640 1 -- 172.21.15.81:0/3049224783 shutdown_connections 2024-09-16T01:22:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.534+0000 7f428659f640 1 --2- 172.21.15.81:0/3049224783 >> v2:172.21.15.102:3300/0 conn(0x7f428015e6a0 0x7f428006d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.534+0000 7f428659f640 1 --2- 172.21.15.81:0/3049224783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42800d4180 0x7f42800d4560 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.534+0000 7f428659f640 1 -- 172.21.15.81:0/3049224783 >> 172.21.15.81:0/3049224783 conn(0x7f428009d6f0 msgr2=0x7f428008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.534+0000 7f428659f640 1 -- 172.21.15.81:0/3049224783 shutdown_connections 2024-09-16T01:22:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.534+0000 7f428659f640 1 -- 172.21.15.81:0/3049224783 wait complete. 2024-09-16T01:22:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.535+0000 7f428659f640 1 Processor -- start 2024-09-16T01:22:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.535+0000 7f428659f640 1 -- start start 2024-09-16T01:22:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.535+0000 7f428659f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f428006dd60 0x7f42801568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.535+0000 7f428659f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42800d4180 0x7f42800cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f428659f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f428015e6a0 0x7f42800cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f428659f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f428006e950 con 0x7f42800d4180 2024-09-16T01:22:01.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f428659f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f428006e670 con 0x7f428015e6a0 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f428659f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f42800cebd0 con 0x7f428006dd60 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4284d9c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42800d4180 0x7f42800cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4284d9c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42800d4180 0x7f42800cc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41722/0 (socket says 172.21.15.81:41722) 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4284d9c640 1 -- 172.21.15.81:0/2774842516 learned_addr learned my addr 172.21.15.81:0/2774842516 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f428559d640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f428006dd60 0x7f42801568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4285d9e640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f428015e6a0 0x7f42800cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4284d9c640 1 -- 172.21.15.81:0/2774842516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f428006dd60 msgr2=0x7f42801568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4284d9c640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f428006dd60 0x7f42801568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4284d9c640 1 -- 172.21.15.81:0/2774842516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f428015e6a0 msgr2=0x7f42800cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4284d9c640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f428015e6a0 0x7f42800cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4284d9c640 1 -- 172.21.15.81:0/2774842516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4280156e10 con 0x7f42800d4180 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f428559d640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f428006dd60 0x7f42801568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:01.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4284d9c640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42800d4180 0x7f42800cc390 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f427000d620 tx=0x7f427000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:01.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4275ffb640 1 -- 172.21.15.81:0/2774842516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427000b620 con 0x7f42800d4180 2024-09-16T01:22:01.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4275ffb640 1 -- 172.21.15.81:0/2774842516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4270019070 con 0x7f42800d4180 2024-09-16T01:22:01.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f428659f640 1 -- 172.21.15.81:0/2774842516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42800ccbc0 con 0x7f42800d4180 2024-09-16T01:22:01.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f4275ffb640 1 -- 172.21.15.81:0/2774842516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427000ba00 con 0x7f42800d4180 2024-09-16T01:22:01.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.536+0000 7f428659f640 1 -- 172.21.15.81:0/2774842516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4280159d40 con 0x7f42800d4180 2024-09-16T01:22:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.538+0000 7f428659f640 1 -- 172.21.15.81:0/2774842516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42800b2130 con 0x7f42800d4180 2024-09-16T01:22:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.538+0000 7f4275ffb640 1 -- 172.21.15.81:0/2774842516 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f427000bba0 con 0x7f42800d4180 2024-09-16T01:22:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.538+0000 7f4275ffb640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f426406c2b0 0x7f426406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.538+0000 7f4275ffb640 1 -- 172.21.15.81:0/2774842516 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 6101+0+0 (secure 0 0 0) 0x7f427008b940 con 0x7f42800d4180 2024-09-16T01:22:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.538+0000 7f428559d640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f426406c2b0 0x7f426406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.539+0000 7f428559d640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f426406c2b0 0x7f426406e770 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f427c034000 tx=0x7f427c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:01.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.543+0000 7f4275ffb640 1 -- 172.21.15.81:0/2774842516 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42800b2130 con 0x7f42800d4180 2024-09-16T01:22:01.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.709+0000 7f428659f640 1 -- 172.21.15.81:0/2774842516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4280159b30 con 0x7f42800d4180 2024-09-16T01:22:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.710+0000 7f4275ffb640 1 -- 172.21.15.81:0/2774842516 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) ==== 74+0+17025 (secure 0 0 0) 0x7f4270059fb0 con 0x7f42800d4180 2024-09-16T01:22:01.711 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:01.711 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":112,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:22:00.438862+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:59.046470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:59.403171+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:22:01.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.713+0000 7f428659f640 1 -- 172.21.15.81:0/2774842516 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f426406c2b0 msgr2=0x7f426406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.713+0000 7f428659f640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f426406c2b0 0x7f426406e770 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f427c034000 tx=0x7f427c02e000 comp rx=0 tx=0).stop 2024-09-16T01:22:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.713+0000 7f428659f640 1 -- 172.21.15.81:0/2774842516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42800d4180 msgr2=0x7f42800cc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.713+0000 7f428659f640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42800d4180 0x7f42800cc390 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f427000d620 tx=0x7f427000dae0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.713+0000 7f428659f640 1 -- 172.21.15.81:0/2774842516 shutdown_connections 2024-09-16T01:22:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.713+0000 7f428659f640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f426406c2b0 0x7f426406e770 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.713+0000 7f428659f640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f428015e6a0 0x7f42800cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.713+0000 7f428659f640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42800d4180 0x7f42800cc390 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.713+0000 7f428659f640 1 --2- 172.21.15.81:0/2774842516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f428006dd60 0x7f42801568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.713+0000 7f428659f640 1 -- 172.21.15.81:0/2774842516 >> 172.21.15.81:0/2774842516 conn(0x7f428009d6f0 msgr2=0x7f42800cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.713+0000 7f428659f640 1 -- 172.21.15.81:0/2774842516 shutdown_connections 2024-09-16T01:22:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.713+0000 7f428659f640 1 -- 172.21.15.81:0/2774842516 wait complete. 2024-09-16T01:22:01.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:22:01.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.826+0000 7f67757cf640 1 Processor -- start 2024-09-16T01:22:01.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.826+0000 7f67757cf640 1 -- start start 2024-09-16T01:22:01.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f67757cf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f67700d4c10 0x7f6770162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f67757cf640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f67700d3320 0x7f67700d37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f67757cf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67700d2600 con 0x7f67700b5f80 2024-09-16T01:22:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f67757cf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f67700d5420 con 0x7f67700d4c10 2024-09-16T01:22:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f67757cf640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f67700d2e90 con 0x7f67700d3320 2024-09-16T01:22:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f67667fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f67700d4c10 0x7f6770162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f67667fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f67700d4c10 0x7f6770162980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41724/0 (socket says 172.21.15.81:41724) 2024-09-16T01:22:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f67667fc640 1 -- 172.21.15.81:0/1864351191 learned_addr learned my addr 172.21.15.81:0/1864351191 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f676f7fe640 1 --2- 172.21.15.81:0/1864351191 >> v2:172.21.15.102:3300/0 conn(0x7f67700d3320 0x7f67700d37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f67667fc640 1 -- 172.21.15.81:0/1864351191 >> v2:172.21.15.102:3300/0 conn(0x7f67700d3320 msgr2=0x7f67700d37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f67667fc640 1 --2- 172.21.15.81:0/1864351191 >> v2:172.21.15.102:3300/0 conn(0x7f67700d3320 0x7f67700d37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f67667fc640 1 -- 172.21.15.81:0/1864351191 >> v1:172.21.15.81:6789/0 conn(0x7f67700b5f80 legacy=0x7f67700b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f67667fc640 1 -- 172.21.15.81:0/1864351191 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67700b3c10 con 0x7f67700d4c10 2024-09-16T01:22:01.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.827+0000 7f676e7fc640 1 -- 172.21.15.81:0/1864351191 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297730139 0 0) 0x7f6760001110 con 0x7f67700b5f80 2024-09-16T01:22:01.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.828+0000 7f67667fc640 1 --2- 172.21.15.81:0/1864351191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67700d4c10 0x7f6770162980 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f6758009870 tx=0x7f675802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442b5d0ce52797a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:01.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.828+0000 7f676e7fc640 1 -- 172.21.15.81:0/1864351191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6758037070 con 0x7f67700d4c10 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.828+0000 7f676e7fc640 1 -- 172.21.15.81:0/1864351191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6758032440 con 0x7f67700d4c10 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.828+0000 7f676e7fc640 1 -- 172.21.15.81:0/1864351191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6758032810 con 0x7f67700d4c10 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.829+0000 7f67757cf640 1 -- 172.21.15.81:0/1864351191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67700d4c10 msgr2=0x7f6770162980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.829+0000 7f67757cf640 1 --2- 172.21.15.81:0/1864351191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67700d4c10 0x7f6770162980 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f6758009870 tx=0x7f675802a2a0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.829+0000 7f67757cf640 1 -- 172.21.15.81:0/1864351191 shutdown_connections 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.829+0000 7f67757cf640 1 --2- 172.21.15.81:0/1864351191 >> v2:172.21.15.102:3300/0 conn(0x7f67700d3320 0x7f67700d37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.829+0000 7f67757cf640 1 --2- 172.21.15.81:0/1864351191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67700d4c10 0x7f6770162980 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.829+0000 7f67757cf640 1 -- 172.21.15.81:0/1864351191 >> 172.21.15.81:0/1864351191 conn(0x7f677008bfc0 msgr2=0x7f67700d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.829+0000 7f67757cf640 1 -- 172.21.15.81:0/1864351191 shutdown_connections 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.829+0000 7f67757cf640 1 -- 172.21.15.81:0/1864351191 wait complete. 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.830+0000 7f67757cf640 1 Processor -- start 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.830+0000 7f67757cf640 1 -- start start 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67757cf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67700b5f80 0x7f67701539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67757cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67700d3320 0x7f677015c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67757cf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67700d4c10 0x7f6770153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67757cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67700d2b20 con 0x7f67700d3320 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67757cf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f67700d2880 con 0x7f67700d4c10 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67757cf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f677015f690 con 0x7f67700b5f80 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67667fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67700d3320 0x7f677015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67667fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67700d3320 0x7f677015c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41734/0 (socket says 172.21.15.81:41734) 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67667fc640 1 -- 172.21.15.81:0/2348129417 learned_addr learned my addr 172.21.15.81:0/2348129417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67667fc640 1 -- 172.21.15.81:0/2348129417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67700b5f80 msgr2=0x7f67701539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67667fc640 1 --2- 172.21.15.81:0/2348129417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67700b5f80 0x7f67701539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67667fc640 1 -- 172.21.15.81:0/2348129417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67700d4c10 msgr2=0x7f6770153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67667fc640 1 --2- 172.21.15.81:0/2348129417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67700d4c10 0x7f6770153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67667fc640 1 -- 172.21.15.81:0/2348129417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67700b7580 con 0x7f67700d3320 2024-09-16T01:22:01.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67667fc640 1 --2- 172.21.15.81:0/2348129417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67700d3320 0x7f677015c910 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f675802a2e0 tx=0x7f67580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f6767fff640 1 -- 172.21.15.81:0/2348129417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6758041020 con 0x7f67700d3320 2024-09-16T01:22:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f6767fff640 1 -- 172.21.15.81:0/2348129417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67580306e0 con 0x7f67700d3320 2024-09-16T01:22:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f67757cf640 1 -- 172.21.15.81:0/2348129417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67700b7860 con 0x7f67700d3320 2024-09-16T01:22:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.831+0000 7f6767fff640 1 -- 172.21.15.81:0/2348129417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6758037040 con 0x7f67700d3320 2024-09-16T01:22:01.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.832+0000 7f67757cf640 1 -- 172.21.15.81:0/2348129417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67700b7e20 con 0x7f67700d3320 2024-09-16T01:22:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.832+0000 7f67757cf640 1 -- 172.21.15.81:0/2348129417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67700d37b0 con 0x7f67700d3320 2024-09-16T01:22:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.833+0000 7f6767fff640 1 -- 172.21.15.81:0/2348129417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6758044020 con 0x7f67700d3320 2024-09-16T01:22:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.833+0000 7f6767fff640 1 --2- 172.21.15.81:0/2348129417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f675006c2b0 0x7f675006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.833+0000 7f6767fff640 1 -- 172.21.15.81:0/2348129417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 6101+0+0 (secure 0 0 0) 0x7f67580abe00 con 0x7f67700d3320 2024-09-16T01:22:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.833+0000 7f676effd640 1 --2- 172.21.15.81:0/2348129417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f675006c2b0 0x7f675006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:01.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.834+0000 7f676effd640 1 --2- 172.21.15.81:0/2348129417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f675006c2b0 0x7f675006e770 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f67700b9500 tx=0x7f6760007b60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:01.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:01.837+0000 7f6767fff640 1 -- 172.21.15.81:0/2348129417 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f675804b030 con 0x7f67700d3320 2024-09-16T01:22:02.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.040+0000 7f67757cf640 1 -- 172.21.15.81:0/2348129417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6770160c00 con 0x7f67700d3320 2024-09-16T01:22:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.102+0000 7f6767fff640 1 -- 172.21.15.81:0/2348129417 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) ==== 118+0+0 (secure 0 0 0) 0x7f67700b3c10 con 0x7f67700d3320 2024-09-16T01:22:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.104+0000 7f67757cf640 1 -- 172.21.15.81:0/2348129417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f675006c2b0 msgr2=0x7f675006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.104+0000 7f67757cf640 1 --2- 172.21.15.81:0/2348129417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f675006c2b0 0x7f675006e770 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f67700b9500 tx=0x7f6760007b60 comp rx=0 tx=0).stop 2024-09-16T01:22:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.104+0000 7f67757cf640 1 -- 172.21.15.81:0/2348129417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67700d3320 msgr2=0x7f677015c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.104+0000 7f67757cf640 1 --2- 172.21.15.81:0/2348129417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67700d3320 0x7f677015c910 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f675802a2e0 tx=0x7f67580046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.104+0000 7f67757cf640 1 -- 172.21.15.81:0/2348129417 shutdown_connections 2024-09-16T01:22:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.104+0000 7f67757cf640 1 --2- 172.21.15.81:0/2348129417 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f675006c2b0 0x7f675006e770 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.104+0000 7f67757cf640 1 --2- 172.21.15.81:0/2348129417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67700d4c10 0x7f6770153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.104+0000 7f67757cf640 1 --2- 172.21.15.81:0/2348129417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67700d3320 0x7f677015c910 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.104+0000 7f67757cf640 1 --2- 172.21.15.81:0/2348129417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67700b5f80 0x7f67701539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.104+0000 7f67757cf640 1 -- 172.21.15.81:0/2348129417 >> 172.21.15.81:0/2348129417 conn(0x7f677008bfc0 msgr2=0x7f6770161120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.104+0000 7f67757cf640 1 -- 172.21.15.81:0/2348129417 shutdown_connections 2024-09-16T01:22:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.104+0000 7f67757cf640 1 -- 172.21.15.81:0/2348129417 wait complete. 2024-09-16T01:22:02.117 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T01:22:02.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:22:02.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.217+0000 7f1efc96d640 1 Processor -- start 2024-09-16T01:22:02.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.217+0000 7f1efc96d640 1 -- start start 2024-09-16T01:22:02.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.218+0000 7f1efc96d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1ef80b5fe0 0x7f1ef80aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:02.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.218+0000 7f1efc96d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ef806bc10 0x7f1ef806c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:02.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.218+0000 7f1efc96d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef80ae240 con 0x7f1ef815e410 2024-09-16T01:22:02.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.218+0000 7f1efc96d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef806c5c0 con 0x7f1ef80b5fe0 2024-09-16T01:22:02.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.218+0000 7f1efc96d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef80b6430 con 0x7f1ef806bc10 2024-09-16T01:22:02.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.219+0000 7f1ef5d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1ef80b5fe0 0x7f1ef80aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:02.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.219+0000 7f1ef6d9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ef806bc10 0x7f1ef806c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:02.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.219+0000 7f1ef659c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1ef815e410 0x7f1ef80b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:35184/0 (socket says 172.21.15.81:35184) 2024-09-16T01:22:02.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.219+0000 7f1ef659c640 1 -- 172.21.15.81:0/304136006 learned_addr learned my addr 172.21.15.81:0/304136006 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:02.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.219+0000 7f1ef5d9b640 1 -- 172.21.15.81:0/304136006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ef806bc10 msgr2=0x7f1ef806c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:02.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.219+0000 7f1ef5d9b640 1 --2- 172.21.15.81:0/304136006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ef806bc10 0x7f1ef806c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.219+0000 7f1ef5d9b640 1 -- 172.21.15.81:0/304136006 >> v1:172.21.15.102:6789/0 conn(0x7f1ef815e410 legacy=0x7f1ef80b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:02.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.219+0000 7f1ef5d9b640 1 -- 172.21.15.81:0/304136006 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef80ae520 con 0x7f1ef80b5fe0 2024-09-16T01:22:02.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.219+0000 7f1ef559a640 1 -- 172.21.15.81:0/304136006 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854339012 0 0) 0x7f1ef80ae240 con 0x7f1ef815e410 2024-09-16T01:22:02.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.220+0000 7f1ef5d9b640 1 --2- 172.21.15.81:0/304136006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef80b5fe0 0x7f1ef80aff40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0097a0 tx=0x7f1eec02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a6ed1b199587949 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:02.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.220+0000 7f1ef559a640 1 -- 172.21.15.81:0/304136006 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec037070 con 0x7f1ef80b5fe0 2024-09-16T01:22:02.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.220+0000 7f1ef559a640 1 -- 172.21.15.81:0/304136006 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eec02ae50 con 0x7f1ef80b5fe0 2024-09-16T01:22:02.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.220+0000 7f1ef559a640 1 -- 172.21.15.81:0/304136006 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec032660 con 0x7f1ef80b5fe0 2024-09-16T01:22:02.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.221+0000 7f1efc96d640 1 -- 172.21.15.81:0/304136006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef80b5fe0 msgr2=0x7f1ef80aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:02.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.221+0000 7f1efc96d640 1 --2- 172.21.15.81:0/304136006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef80b5fe0 0x7f1ef80aff40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1eec0097a0 tx=0x7f1eec02a100 comp rx=0 tx=0).stop 2024-09-16T01:22:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.221+0000 7f1efc96d640 1 -- 172.21.15.81:0/304136006 shutdown_connections 2024-09-16T01:22:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.221+0000 7f1efc96d640 1 --2- 172.21.15.81:0/304136006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ef806bc10 0x7f1ef806c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.221+0000 7f1efc96d640 1 --2- 172.21.15.81:0/304136006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef80b5fe0 0x7f1ef80aff40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.221+0000 7f1efc96d640 1 -- 172.21.15.81:0/304136006 >> 172.21.15.81:0/304136006 conn(0x7f1ef809aa30 msgr2=0x7f1ef80b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.221+0000 7f1efc96d640 1 -- 172.21.15.81:0/304136006 shutdown_connections 2024-09-16T01:22:02.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.221+0000 7f1efc96d640 1 -- 172.21.15.81:0/304136006 wait complete. 2024-09-16T01:22:02.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.222+0000 7f1efc96d640 1 Processor -- start 2024-09-16T01:22:02.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.222+0000 7f1efc96d640 1 -- start start 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1efc96d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ef806bc10 0x7f1ef815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1efc96d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef80b5fe0 0x7f1ef809c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1efc96d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ef815e410 0x7f1ef8150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1efc96d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef80b0480 con 0x7f1ef815e410 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1efc96d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef80aeae0 con 0x7f1ef80b5fe0 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1efc96d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef815e7f0 con 0x7f1ef806bc10 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1ef6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ef815e410 0x7f1ef8150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1ef6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ef815e410 0x7f1ef8150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41746/0 (socket says 172.21.15.81:41746) 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1ef6d9d640 1 -- 172.21.15.81:0/3206369217 learned_addr learned my addr 172.21.15.81:0/3206369217 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1ef5d9b640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef80b5fe0 0x7f1ef809c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1ef659c640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ef806bc10 0x7f1ef815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1ef6d9d640 1 -- 172.21.15.81:0/3206369217 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ef806bc10 msgr2=0x7f1ef815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:02.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1ef6d9d640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ef806bc10 0x7f1ef815d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1ef6d9d640 1 -- 172.21.15.81:0/3206369217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef80b5fe0 msgr2=0x7f1ef809c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:02.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1ef6d9d640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef80b5fe0 0x7f1ef809c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:02.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1ef6d9d640 1 -- 172.21.15.81:0/3206369217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef815d7b0 con 0x7f1ef815e410 2024-09-16T01:22:02.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1ef5d9b640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef80b5fe0 0x7f1ef809c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:02.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.223+0000 7f1ef6d9d640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ef815e410 0x7f1ef8150d50 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000efc0 tx=0x7f1ef000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:02.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.224+0000 7f1ee6ffd640 1 -- 172.21.15.81:0/3206369217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0018020 con 0x7f1ef815e410 2024-09-16T01:22:02.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.224+0000 7f1ee6ffd640 1 -- 172.21.15.81:0/3206369217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef0014480 con 0x7f1ef815e410 2024-09-16T01:22:02.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.224+0000 7f1efc96d640 1 -- 172.21.15.81:0/3206369217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef815da90 con 0x7f1ef815e410 2024-09-16T01:22:02.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.224+0000 7f1ee6ffd640 1 -- 172.21.15.81:0/3206369217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0014870 con 0x7f1ef815e410 2024-09-16T01:22:02.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.224+0000 7f1efc96d640 1 -- 172.21.15.81:0/3206369217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef815ad40 con 0x7f1ef815e410 2024-09-16T01:22:02.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.224+0000 7f1efc96d640 1 -- 172.21.15.81:0/3206369217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef806c080 con 0x7f1ef815e410 2024-09-16T01:22:02.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.225+0000 7f1ee6ffd640 1 -- 172.21.15.81:0/3206369217 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1ef0005d10 con 0x7f1ef815e410 2024-09-16T01:22:02.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.225+0000 7f1ee6ffd640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ed806c2b0 0x7f1ed806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:02.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.225+0000 7f1ee6ffd640 1 -- 172.21.15.81:0/3206369217 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f1ef008bfe0 con 0x7f1ef815e410 2024-09-16T01:22:02.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.225+0000 7f1ef659c640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ed806c2b0 0x7f1ed806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:02.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.226+0000 7f1ef659c640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ed806c2b0 0x7f1ed806e770 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8007fd0 tx=0x7f1ee8007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:02.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.230+0000 7f1ee6ffd640 1 -- 172.21.15.81:0/3206369217 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ef0022070 con 0x7f1ef815e410 2024-09-16T01:22:02.366 INFO:tasks.ceph.mds.b.smithi102.stderr:2024-09-16T01:22:02.365+0000 7efc853dd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:22:02.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:02.432+0000 7f1efc96d640 1 -- 172.21.15.81:0/3206369217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1ef815f240 con 0x7f1ef815e410 2024-09-16T01:22:03.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.113+0000 7f1ee6ffd640 1 -- 172.21.15.81:0/3206369217 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) ==== 122+0+0 (secure 0 0 0) 0x7f1ef0010040 con 0x7f1ef815e410 2024-09-16T01:22:03.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.116+0000 7f1efc96d640 1 -- 172.21.15.81:0/3206369217 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ed806c2b0 msgr2=0x7f1ed806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.116+0000 7f1efc96d640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ed806c2b0 0x7f1ed806e770 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8007fd0 tx=0x7f1ee8007de0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.116+0000 7f1efc96d640 1 -- 172.21.15.81:0/3206369217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ef815e410 msgr2=0x7f1ef8150d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.116+0000 7f1efc96d640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ef815e410 0x7f1ef8150d50 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000efc0 tx=0x7f1ef000c490 comp rx=0 tx=0).stop 2024-09-16T01:22:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.116+0000 7f1efc96d640 1 -- 172.21.15.81:0/3206369217 shutdown_connections 2024-09-16T01:22:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.116+0000 7f1efc96d640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1ed806c2b0 0x7f1ed806e770 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.116+0000 7f1efc96d640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ef815e410 0x7f1ef8150d50 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.116+0000 7f1efc96d640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ef80b5fe0 0x7f1ef809c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.116+0000 7f1efc96d640 1 --2- 172.21.15.81:0/3206369217 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ef806bc10 0x7f1ef815d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.116+0000 7f1efc96d640 1 -- 172.21.15.81:0/3206369217 >> 172.21.15.81:0/3206369217 conn(0x7f1ef809aa30 msgr2=0x7f1ef80b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.117+0000 7f1efc96d640 1 -- 172.21.15.81:0/3206369217 shutdown_connections 2024-09-16T01:22:03.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.117+0000 7f1efc96d640 1 -- 172.21.15.81:0/3206369217 wait complete. 2024-09-16T01:22:03.131 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:22:03.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.234+0000 7f793eb9d640 1 Processor -- start 2024-09-16T01:22:03.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.234+0000 7f793eb9d640 1 -- start start 2024-09-16T01:22:03.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.235+0000 7f793eb9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f79380d4180 0x7f79380d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.235+0000 7f793eb9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f793815e6a0 0x7f793806d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.235+0000 7f793eb9d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79380d4aa0 con 0x7f793806dd60 2024-09-16T01:22:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.235+0000 7f793eb9d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f79380cefb0 con 0x7f79380d4180 2024-09-16T01:22:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.235+0000 7f793eb9d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f79380d2c20 con 0x7f793815e6a0 2024-09-16T01:22:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.235+0000 7f793e39c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f793806dd60 0x7f79380d0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60126/0 (socket says 172.21.15.81:60126) 2024-09-16T01:22:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.235+0000 7f793e39c640 1 -- 172.21.15.81:0/874404591 learned_addr learned my addr 172.21.15.81:0/874404591 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.235+0000 7f793db9b640 1 --2- 172.21.15.81:0/874404591 >> v2:172.21.15.102:3300/0 conn(0x7f79380d4180 0x7f79380d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.235+0000 7f793d39a640 1 --2- 172.21.15.81:0/874404591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f793815e6a0 0x7f793806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.236+0000 7f793cb99640 1 -- 172.21.15.81:0/874404591 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 462508744 0 0) 0x7f79380d4aa0 con 0x7f793806dd60 2024-09-16T01:22:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.236+0000 7f793cb99640 1 -- 172.21.15.81:0/874404591 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7924003520 con 0x7f793806dd60 2024-09-16T01:22:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.236+0000 7f793db9b640 1 -- 172.21.15.81:0/874404591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f793815e6a0 msgr2=0x7f793806d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:03.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.236+0000 7f793db9b640 1 --2- 172.21.15.81:0/874404591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f793815e6a0 0x7f793806d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.236+0000 7f793db9b640 1 -- 172.21.15.81:0/874404591 >> v1:172.21.15.81:6789/0 conn(0x7f793806dd60 legacy=0x7f79380d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.236+0000 7f793db9b640 1 -- 172.21.15.81:0/874404591 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793806e390 con 0x7f79380d4180 2024-09-16T01:22:03.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.236+0000 7f793d39a640 1 --2- 172.21.15.81:0/874404591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f793815e6a0 0x7f793806d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:03.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.237+0000 7f793db9b640 1 --2- 172.21.15.81:0/874404591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79380d4180 0x7f79380d4560 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f79340097a0 tx=0x7f793402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9811eb2720ba6b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:03.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.237+0000 7f793cb99640 1 -- 172.21.15.81:0/874404591 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934037070 con 0x7f79380d4180 2024-09-16T01:22:03.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.237+0000 7f793cb99640 1 -- 172.21.15.81:0/874404591 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793402ae50 con 0x7f79380d4180 2024-09-16T01:22:03.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.237+0000 7f793cb99640 1 -- 172.21.15.81:0/874404591 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7934032640 con 0x7f79380d4180 2024-09-16T01:22:03.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.237+0000 7f793eb9d640 1 -- 172.21.15.81:0/874404591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79380d4180 msgr2=0x7f79380d4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.237+0000 7f793eb9d640 1 --2- 172.21.15.81:0/874404591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79380d4180 0x7f79380d4560 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f79340097a0 tx=0x7f793402a100 comp rx=0 tx=0).stop 2024-09-16T01:22:03.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.237+0000 7f793eb9d640 1 -- 172.21.15.81:0/874404591 shutdown_connections 2024-09-16T01:22:03.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.237+0000 7f793eb9d640 1 --2- 172.21.15.81:0/874404591 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f793815e6a0 0x7f793806d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.237+0000 7f793eb9d640 1 --2- 172.21.15.81:0/874404591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79380d4180 0x7f79380d4560 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.237+0000 7f793eb9d640 1 -- 172.21.15.81:0/874404591 >> 172.21.15.81:0/874404591 conn(0x7f793809d6f0 msgr2=0x7f793808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:03.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.237+0000 7f793eb9d640 1 -- 172.21.15.81:0/874404591 shutdown_connections 2024-09-16T01:22:03.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.238+0000 7f793eb9d640 1 -- 172.21.15.81:0/874404591 wait complete. 2024-09-16T01:22:03.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.239+0000 7f793eb9d640 1 Processor -- start 2024-09-16T01:22:03.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.239+0000 7f793eb9d640 1 -- start start 2024-09-16T01:22:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.239+0000 7f793eb9d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f793806dd60 0x7f79381edf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.239+0000 7f793eb9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d4180 0x7f79380d11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.239+0000 7f793eb9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f793815e6a0 0x7f79380d1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.239+0000 7f793eb9d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f79380cebd0 con 0x7f79380d4180 2024-09-16T01:22:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.239+0000 7f793eb9d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f793806e950 con 0x7f793815e6a0 2024-09-16T01:22:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.239+0000 7f793eb9d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f79380d0450 con 0x7f793806dd60 2024-09-16T01:22:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.239+0000 7f793d39a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d4180 0x7f79380d11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.239+0000 7f793d39a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d4180 0x7f79380d11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41756/0 (socket says 172.21.15.81:41756) 2024-09-16T01:22:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.239+0000 7f793d39a640 1 -- 172.21.15.81:0/4151826015 learned_addr learned my addr 172.21.15.81:0/4151826015 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f793db9b640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f793806dd60 0x7f79381edf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f793e39c640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f793815e6a0 0x7f79380d1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f793d39a640 1 -- 172.21.15.81:0/4151826015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f793806dd60 msgr2=0x7f79381edf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f793d39a640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f793806dd60 0x7f79381edf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f793d39a640 1 -- 172.21.15.81:0/4151826015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f793815e6a0 msgr2=0x7f79380d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f793d39a640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f793815e6a0 0x7f79380d1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f793d39a640 1 -- 172.21.15.81:0/4151826015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79381ee4c0 con 0x7f79380d4180 2024-09-16T01:22:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f793d39a640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d4180 0x7f79380d11d0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f792800e960 tx=0x7f792800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f792e7fc640 1 -- 172.21.15.81:0/4151826015 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928017070 con 0x7f79380d4180 2024-09-16T01:22:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f792e7fc640 1 -- 172.21.15.81:0/4151826015 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792800ca00 con 0x7f79380d4180 2024-09-16T01:22:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f793eb9d640 1 -- 172.21.15.81:0/4151826015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79381f7840 con 0x7f79380d4180 2024-09-16T01:22:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f792e7fc640 1 -- 172.21.15.81:0/4151826015 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792800cdd0 con 0x7f79380d4180 2024-09-16T01:22:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.240+0000 7f793eb9d640 1 -- 172.21.15.81:0/4151826015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79381f7e00 con 0x7f79380d4180 2024-09-16T01:22:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.241+0000 7f793eb9d640 1 -- 172.21.15.81:0/4151826015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79380d54f0 con 0x7f79380d4180 2024-09-16T01:22:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.242+0000 7f792e7fc640 1 -- 172.21.15.81:0/4151826015 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f792801a070 con 0x7f79380d4180 2024-09-16T01:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.242+0000 7f792e7fc640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f791c06c2b0 0x7f791c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.242+0000 7f792e7fc640 1 -- 172.21.15.81:0/4151826015 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f792808b330 con 0x7f79380d4180 2024-09-16T01:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.242+0000 7f793db9b640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f791c06c2b0 0x7f791c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.243+0000 7f793db9b640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f791c06c2b0 0x7f791c06e770 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7934034000 tx=0x7f793402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:03.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.246+0000 7f792e7fc640 1 -- 172.21.15.81:0/4151826015 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79380d54f0 con 0x7f79380d4180 2024-09-16T01:22:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.446+0000 7f793eb9d640 1 -- 172.21.15.81:0/4151826015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f793806d820 con 0x7f79380d4180 2024-09-16T01:22:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.447+0000 7f792e7fc640 1 -- 172.21.15.81:0/4151826015 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5228 (secure 0 0 0) 0x7f7928059350 con 0x7f79380d4180 2024-09-16T01:22:03.448 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:03.448 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"btime":"2024-09-16T01:22:03:106587+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2485445274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2485445274},{"type":"v1","addr":"172.21.15.81:6835","nonce":2485445274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1320169323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1320169323},{"type":"v1","addr":"172.21.15.81:6837","nonce":1320169323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2539150967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2539150967},{"type":"v1","addr":"172.21.15.102:6834","nonce":2539150967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:00.439163+0000","modified":"2024-09-16T01:22:02.433729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6835/415655488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":415655488},{"type":"v1","addr":"172.21.15.102:6835","nonce":415655488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7266,"qdb_cluster":[7266]},"id":8}]} 2024-09-16T01:22:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 58 2024-09-16T01:22:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.449+0000 7f793eb9d640 1 -- 172.21.15.81:0/4151826015 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f791c06c2b0 msgr2=0x7f791c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.449+0000 7f793eb9d640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f791c06c2b0 0x7f791c06e770 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7934034000 tx=0x7f793402e000 comp rx=0 tx=0).stop 2024-09-16T01:22:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.449+0000 7f793eb9d640 1 -- 172.21.15.81:0/4151826015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d4180 msgr2=0x7f79380d11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.449+0000 7f793eb9d640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d4180 0x7f79380d11d0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f792800e960 tx=0x7f792800ee20 comp rx=0 tx=0).stop 2024-09-16T01:22:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.449+0000 7f793eb9d640 1 -- 172.21.15.81:0/4151826015 shutdown_connections 2024-09-16T01:22:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.449+0000 7f793eb9d640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f791c06c2b0 0x7f791c06e770 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.449+0000 7f793eb9d640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f793815e6a0 0x7f79380d1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.449+0000 7f793eb9d640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79380d4180 0x7f79380d11d0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.449+0000 7f793eb9d640 1 --2- 172.21.15.81:0/4151826015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f793806dd60 0x7f79381edf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.449+0000 7f793eb9d640 1 -- 172.21.15.81:0/4151826015 >> 172.21.15.81:0/4151826015 conn(0x7f793809d6f0 msgr2=0x7f79380b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.449+0000 7f793eb9d640 1 -- 172.21.15.81:0/4151826015 shutdown_connections 2024-09-16T01:22:03.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.449+0000 7f793eb9d640 1 -- 172.21.15.81:0/4151826015 wait complete. 2024-09-16T01:22:03.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:22:03.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.558+0000 7fd2d6de4640 1 Processor -- start 2024-09-16T01:22:03.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.558+0000 7fd2d6de4640 1 -- start start 2024-09-16T01:22:03.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.559+0000 7fd2d6de4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd2d015e740 0x7fd2d00d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.559+0000 7fd2d6de4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2d009b690 0x7fd2d006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.559+0000 7fd2d6de4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d00d0780 con 0x7fd2d006d4c0 2024-09-16T01:22:03.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.559+0000 7fd2d6de4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d015eb20 con 0x7fd2d009b690 2024-09-16T01:22:03.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.559+0000 7fd2d6de4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d006d260 con 0x7fd2d015e740 2024-09-16T01:22:03.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.559+0000 7fd2cffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2d009b690 0x7fd2d006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.559+0000 7fd2cffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2d009b690 0x7fd2d006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41758/0 (socket says 172.21.15.81:41758) 2024-09-16T01:22:03.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.559+0000 7fd2cffff640 1 -- 172.21.15.81:0/3748172199 learned_addr learned my addr 172.21.15.81:0/3748172199 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:03.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.559+0000 7fd2cffff640 1 -- 172.21.15.81:0/3748172199 >> v2:172.21.15.102:3300/0 conn(0x7fd2d015e740 msgr2=0x7fd2d00d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:03.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.560+0000 7fd2cffff640 1 --2- 172.21.15.81:0/3748172199 >> v2:172.21.15.102:3300/0 conn(0x7fd2d015e740 0x7fd2d00d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.560+0000 7fd2cffff640 1 -- 172.21.15.81:0/3748172199 >> v1:172.21.15.102:6789/0 conn(0x7fd2d006d4c0 legacy=0x7fd2d006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:03.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.560+0000 7fd2cffff640 1 -- 172.21.15.81:0/3748172199 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d00d0a60 con 0x7fd2d009b690 2024-09-16T01:22:03.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.560+0000 7fd2cffff640 1 --2- 172.21.15.81:0/3748172199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d009b690 0x7fd2d006cd20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0074070 tx=0x7fd2bc02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e96144363d3a04 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:03.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.560+0000 7fd2cf7fe640 1 -- 172.21.15.81:0/3748172199 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc037070 con 0x7fd2d009b690 2024-09-16T01:22:03.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.560+0000 7fd2cf7fe640 1 -- 172.21.15.81:0/3748172199 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2bc032440 con 0x7fd2d009b690 2024-09-16T01:22:03.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.560+0000 7fd2cf7fe640 1 -- 172.21.15.81:0/3748172199 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc032810 con 0x7fd2d009b690 2024-09-16T01:22:03.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.561+0000 7fd2d6de4640 1 -- 172.21.15.81:0/3748172199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d009b690 msgr2=0x7fd2d006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.561+0000 7fd2d6de4640 1 --2- 172.21.15.81:0/3748172199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d009b690 0x7fd2d006cd20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0074070 tx=0x7fd2bc02a2c0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.561+0000 7fd2d6de4640 1 -- 172.21.15.81:0/3748172199 shutdown_connections 2024-09-16T01:22:03.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.561+0000 7fd2d6de4640 1 --2- 172.21.15.81:0/3748172199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d009b690 0x7fd2d006cd20 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.561+0000 7fd2d6de4640 1 --2- 172.21.15.81:0/3748172199 >> v2:172.21.15.102:3300/0 conn(0x7fd2d015e740 0x7fd2d00d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.561+0000 7fd2d6de4640 1 -- 172.21.15.81:0/3748172199 >> 172.21.15.81:0/3748172199 conn(0x7fd2d00d23a0 msgr2=0x7fd2d00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:03.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.561+0000 7fd2d6de4640 1 -- 172.21.15.81:0/3748172199 shutdown_connections 2024-09-16T01:22:03.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.561+0000 7fd2d6de4640 1 -- 172.21.15.81:0/3748172199 wait complete. 2024-09-16T01:22:03.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.562+0000 7fd2d6de4640 1 Processor -- start 2024-09-16T01:22:03.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.562+0000 7fd2d6de4640 1 -- start start 2024-09-16T01:22:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d6de4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d006d4c0 0x7fd2d0151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d6de4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d009b690 0x7fd2d00c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d6de4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d015e740 0x7fd2d00c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d6de4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d009bac0 con 0x7fd2d015e740 2024-09-16T01:22:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d6de4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d00d1020 con 0x7fd2d006d4c0 2024-09-16T01:22:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d6de4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d006dfe0 con 0x7fd2d009b690 2024-09-16T01:22:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d5381640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d015e740 0x7fd2d00c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d5381640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d015e740 0x7fd2d00c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41768/0 (socket says 172.21.15.81:41768) 2024-09-16T01:22:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d5381640 1 -- 172.21.15.81:0/97581463 learned_addr learned my addr 172.21.15.81:0/97581463 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d4b80640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d006d4c0 0x7fd2d0151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2cffff640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d009b690 0x7fd2d00c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d5381640 1 -- 172.21.15.81:0/97581463 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d009b690 msgr2=0x7fd2d00c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d5381640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d009b690 0x7fd2d00c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d5381640 1 -- 172.21.15.81:0/97581463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d006d4c0 msgr2=0x7fd2d0151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d5381640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d006d4c0 0x7fd2d0151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d5381640 1 -- 172.21.15.81:0/97581463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d0151bb0 con 0x7fd2d015e740 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2d4b80640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d006d4c0 0x7fd2d0151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.563+0000 7fd2cffff640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d009b690 0x7fd2d00c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.564+0000 7fd2d5381640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d015e740 0x7fd2d00c6260 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800b990 tx=0x7fd2c800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.564+0000 7fd2cd7fa640 1 -- 172.21.15.81:0/97581463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8019070 con 0x7fd2d015e740 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.564+0000 7fd2cd7fa640 1 -- 172.21.15.81:0/97581463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c800cba0 con 0x7fd2d015e740 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.564+0000 7fd2d6de4640 1 -- 172.21.15.81:0/97581463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d00ca8d0 con 0x7fd2d015e740 2024-09-16T01:22:03.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.564+0000 7fd2cd7fa640 1 -- 172.21.15.81:0/97581463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8014440 con 0x7fd2d015e740 2024-09-16T01:22:03.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.564+0000 7fd2d6de4640 1 -- 172.21.15.81:0/97581463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d00cae90 con 0x7fd2d015e740 2024-09-16T01:22:03.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.565+0000 7fd2d6de4640 1 -- 172.21.15.81:0/97581463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d006cd20 con 0x7fd2d015e740 2024-09-16T01:22:03.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.565+0000 7fd2cd7fa640 1 -- 172.21.15.81:0/97581463 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd2c801c070 con 0x7fd2d015e740 2024-09-16T01:22:03.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.566+0000 7fd2cd7fa640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd2b406c2b0 0x7fd2b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.566+0000 7fd2cd7fa640 1 -- 172.21.15.81:0/97581463 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fd2c808b360 con 0x7fd2d015e740 2024-09-16T01:22:03.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.566+0000 7fd2d4b80640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd2b406c2b0 0x7fd2b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.566+0000 7fd2d4b80640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd2b406c2b0 0x7fd2b406e770 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4006fd0 tx=0x7fd2c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:03.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.570+0000 7fd2cd7fa640 1 -- 172.21.15.81:0/97581463 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2c8059940 con 0x7fd2d015e740 2024-09-16T01:22:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.735+0000 7fd2d6de4640 1 -- 172.21.15.81:0/97581463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2d00d1cb0 con 0x7fd2d015e740 2024-09-16T01:22:03.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.737+0000 7fd2cd7fa640 1 -- 172.21.15.81:0/97581463 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+17012 (secure 0 0 0) 0x7fd2c8059240 con 0x7fd2d015e740 2024-09-16T01:22:03.738 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:03.738 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":113,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:22:02.101802+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:59.046470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:59.403171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:22:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.738+0000 7fd2d6de4640 1 -- 172.21.15.81:0/97581463 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd2b406c2b0 msgr2=0x7fd2b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.738+0000 7fd2d6de4640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd2b406c2b0 0x7fd2b406e770 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4006fd0 tx=0x7fd2c4008040 comp rx=0 tx=0).stop 2024-09-16T01:22:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.738+0000 7fd2d6de4640 1 -- 172.21.15.81:0/97581463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d015e740 msgr2=0x7fd2d00c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.738+0000 7fd2d6de4640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d015e740 0x7fd2d00c6260 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800b990 tx=0x7fd2c800be50 comp rx=0 tx=0).stop 2024-09-16T01:22:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.739+0000 7fd2d6de4640 1 -- 172.21.15.81:0/97581463 shutdown_connections 2024-09-16T01:22:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.739+0000 7fd2d6de4640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd2b406c2b0 0x7fd2b406e770 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.739+0000 7fd2d6de4640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d015e740 0x7fd2d00c6260 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.739+0000 7fd2d6de4640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d009b690 0x7fd2d00c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.739+0000 7fd2d6de4640 1 --2- 172.21.15.81:0/97581463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d006d4c0 0x7fd2d0151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.739+0000 7fd2d6de4640 1 -- 172.21.15.81:0/97581463 >> 172.21.15.81:0/97581463 conn(0x7fd2d00d23a0 msgr2=0x7fd2d00af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.739+0000 7fd2d6de4640 1 -- 172.21.15.81:0/97581463 shutdown_connections 2024-09-16T01:22:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.739+0000 7fd2d6de4640 1 -- 172.21.15.81:0/97581463 wait complete. 2024-09-16T01:22:03.751 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:22:03.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:22:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.848+0000 7fea2ed52640 1 Processor -- start 2024-09-16T01:22:03.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.848+0000 7fea2ed52640 1 -- start start 2024-09-16T01:22:03.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea2ed52640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fea28072320 0x7fea280cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea2ed52640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea2815e1f0 0x7fea2806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea2ed52640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea28146140 con 0x7fea28072de0 2024-09-16T01:22:03.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea2ed52640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fea280cd740 con 0x7fea28072320 2024-09-16T01:22:03.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea2ed52640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fea280cda20 con 0x7fea2815e1f0 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fea28072de0 0x7fea2806e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60136/0 (socket says 172.21.15.81:60136) 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1ffff640 1 -- 172.21.15.81:0/3099950784 learned_addr learned my addr 172.21.15.81:0/3099950784 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea2caee640 1 --2- 172.21.15.81:0/3099950784 >> v2:172.21.15.102:3300/0 conn(0x7fea28072320 0x7fea280cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea2d2ef640 1 --2- 172.21.15.81:0/3099950784 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea2815e1f0 0x7fea2806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2225925014 0 0) 0x7fea28146140 con 0x7fea28072de0 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea10003520 con 0x7fea28072de0 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3653328875 0 0) 0x7fea10003520 con 0x7fea28072de0 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea2815e1f0 msgr2=0x7fea2806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1f7fe640 1 --2- 172.21.15.81:0/3099950784 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea2815e1f0 0x7fea2806e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 >> v2:172.21.15.102:3300/0 conn(0x7fea28072320 msgr2=0x7fea280cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1f7fe640 1 --2- 172.21.15.81:0/3099950784 >> v2:172.21.15.102:3300/0 conn(0x7fea28072320 0x7fea280cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea280cdd00 con 0x7fea28072de0 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fea18001670 con 0x7fea28072de0 2024-09-16T01:22:03.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 >> v1:172.21.15.81:6789/0 conn(0x7fea28072de0 legacy=0x7fea2806e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1f7fe640 1 --2- 172.21.15.81:0/3099950784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea100039b0 0x7fea10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.849+0000 7fea1f7fe640 1 --2- 172.21.15.81:0/3099950784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea10004800 0x7fea10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.850+0000 7fea1f7fe640 1 --2- 172.21.15.81:0/3099950784 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea2815e1f0 0x7fea100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.850+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea280cd740 con 0x7fea100039b0 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.850+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fea280cda20 con 0x7fea10004800 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.850+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fea1000b9c0 con 0x7fea2815e1f0 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.850+0000 7fea2caee640 1 --2- 172.21.15.81:0/3099950784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea100039b0 0x7fea10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.850+0000 7fea2d2ef640 1 --2- 172.21.15.81:0/3099950784 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea2815e1f0 0x7fea100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.850+0000 7fea1ffff640 1 --2- 172.21.15.81:0/3099950784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea10004800 0x7fea10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.850+0000 7fea2caee640 1 -- 172.21.15.81:0/3099950784 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea2815e1f0 msgr2=0x7fea100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.850+0000 7fea2caee640 1 --2- 172.21.15.81:0/3099950784 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea2815e1f0 0x7fea100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.850+0000 7fea2caee640 1 -- 172.21.15.81:0/3099950784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea10004800 msgr2=0x7fea10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.850+0000 7fea2caee640 1 --2- 172.21.15.81:0/3099950784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea10004800 0x7fea10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.850+0000 7fea2caee640 1 -- 172.21.15.81:0/3099950784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea10003520 con 0x7fea100039b0 2024-09-16T01:22:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.851+0000 7fea2caee640 1 --2- 172.21.15.81:0/3099950784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea100039b0 0x7fea10003dd0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fea2400e170 tx=0x7fea10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcae0a4f99c1c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.851+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea24034020 con 0x7fea100039b0 2024-09-16T01:22:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.851+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea24030430 con 0x7fea100039b0 2024-09-16T01:22:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.851+0000 7fea1f7fe640 1 -- 172.21.15.81:0/3099950784 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea24009c10 con 0x7fea100039b0 2024-09-16T01:22:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.851+0000 7fea2ed52640 1 -- 172.21.15.81:0/3099950784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea100039b0 msgr2=0x7fea10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.851+0000 7fea2ed52640 1 --2- 172.21.15.81:0/3099950784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea100039b0 0x7fea10003dd0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fea2400e170 tx=0x7fea10005830 comp rx=0 tx=0).stop 2024-09-16T01:22:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.851+0000 7fea2d2ef640 1 -- 172.21.15.81:0/3099950784 reap_dead start 2024-09-16T01:22:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.851+0000 7fea2ed52640 1 -- 172.21.15.81:0/3099950784 shutdown_connections 2024-09-16T01:22:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.851+0000 7fea2ed52640 1 -- 172.21.15.81:0/3099950784 >> 172.21.15.81:0/3099950784 conn(0x7fea28067d70 msgr2=0x7fea2806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.851+0000 7fea2ed52640 1 -- 172.21.15.81:0/3099950784 shutdown_connections 2024-09-16T01:22:03.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.851+0000 7fea2ed52640 1 -- 172.21.15.81:0/3099950784 wait complete. 2024-09-16T01:22:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.852+0000 7fea2ed52640 1 Processor -- start 2024-09-16T01:22:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.853+0000 7fea2ed52640 1 -- start start 2024-09-16T01:22:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.853+0000 7fea2ed52640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea100039b0 0x7fea2813e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.853+0000 7fea2ed52640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea2813f140 0x7fea2813f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.853+0000 7fea2ed52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2815b4b0 0x7fea2815b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.853+0000 7fea2ed52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea280cd520 con 0x7fea2815b4b0 2024-09-16T01:22:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.853+0000 7fea2ed52640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fea280cd3a0 con 0x7fea2813f140 2024-09-16T01:22:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.853+0000 7fea2ed52640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fea28072700 con 0x7fea100039b0 2024-09-16T01:22:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.853+0000 7fea2d2ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2815b4b0 0x7fea2815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea2d2ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2815b4b0 0x7fea2815b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41790/0 (socket says 172.21.15.81:41790) 2024-09-16T01:22:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea2d2ef640 1 -- 172.21.15.81:0/3433796339 learned_addr learned my addr 172.21.15.81:0/3433796339 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:03.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea1ffff640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea2813f140 0x7fea2813f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea2caee640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea100039b0 0x7fea2813e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea2d2ef640 1 -- 172.21.15.81:0/3433796339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea100039b0 msgr2=0x7fea2813e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea2d2ef640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea100039b0 0x7fea2813e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea2d2ef640 1 -- 172.21.15.81:0/3433796339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea2813f140 msgr2=0x7fea2813f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea2d2ef640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea2813f140 0x7fea2813f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea2d2ef640 1 -- 172.21.15.81:0/3433796339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea281e4550 con 0x7fea2815b4b0 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea2caee640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea100039b0 0x7fea2813e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea2d2ef640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2815b4b0 0x7fea2815b940 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fea280705c0 tx=0x7fea20011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea1d7fa640 1 -- 172.21.15.81:0/3433796339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20019020 con 0x7fea2815b4b0 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea1d7fa640 1 -- 172.21.15.81:0/3433796339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea20003610 con 0x7fea2815b4b0 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea1d7fa640 1 -- 172.21.15.81:0/3433796339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20003a40 con 0x7fea2815b4b0 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea2ed52640 1 -- 172.21.15.81:0/3433796339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2815be80 con 0x7fea2815b4b0 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.854+0000 7fea2ed52640 1 -- 172.21.15.81:0/3433796339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea2813fee0 con 0x7fea2815b4b0 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.855+0000 7fea2ed52640 1 -- 172.21.15.81:0/3433796339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea280cce60 con 0x7fea2815b4b0 2024-09-16T01:22:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.856+0000 7fea1d7fa640 1 -- 172.21.15.81:0/3433796339 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fea2001c020 con 0x7fea2815b4b0 2024-09-16T01:22:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.856+0000 7fea1d7fa640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fea1406c2b0 0x7fea1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.856+0000 7fea1d7fa640 1 -- 172.21.15.81:0/3433796339 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fea2008b3c0 con 0x7fea2815b4b0 2024-09-16T01:22:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.856+0000 7fea2caee640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fea1406c2b0 0x7fea1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.857+0000 7fea2caee640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fea1406c2b0 0x7fea1406e770 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fea24035000 tx=0x7fea2402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:03.860+0000 7fea1d7fa640 1 -- 172.21.15.81:0/3433796339 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea20023070 con 0x7fea2815b4b0 2024-09-16T01:22:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.020+0000 7fea2ed52640 1 -- 172.21.15.81:0/3433796339 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fea280ce3c0 con 0x7fea1406c2b0 2024-09-16T01:22:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.026+0000 7fea1d7fa640 1 -- 172.21.15.81:0/3433796339 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237319 (secure 0 0 0) 0x7fea280ce3c0 con 0x7fea1406c2b0 2024-09-16T01:22:04.029 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:22:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.029+0000 7fea2ed52640 1 -- 172.21.15.81:0/3433796339 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fea1406c2b0 msgr2=0x7fea1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.029+0000 7fea2ed52640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fea1406c2b0 0x7fea1406e770 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fea24035000 tx=0x7fea2402f000 comp rx=0 tx=0).stop 2024-09-16T01:22:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.029+0000 7fea2ed52640 1 -- 172.21.15.81:0/3433796339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2815b4b0 msgr2=0x7fea2815b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.029+0000 7fea2ed52640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2815b4b0 0x7fea2815b940 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fea280705c0 tx=0x7fea20011920 comp rx=0 tx=0).stop 2024-09-16T01:22:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.029+0000 7fea2ed52640 1 -- 172.21.15.81:0/3433796339 shutdown_connections 2024-09-16T01:22:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.029+0000 7fea2ed52640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fea1406c2b0 0x7fea1406e770 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.029+0000 7fea2ed52640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea2815b4b0 0x7fea2815b940 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.029+0000 7fea2ed52640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea2813f140 0x7fea2813f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.029+0000 7fea2ed52640 1 --2- 172.21.15.81:0/3433796339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea100039b0 0x7fea2813e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.029+0000 7fea2ed52640 1 -- 172.21.15.81:0/3433796339 >> 172.21.15.81:0/3433796339 conn(0x7fea28067d70 msgr2=0x7fea280b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.029+0000 7fea2ed52640 1 -- 172.21.15.81:0/3433796339 shutdown_connections 2024-09-16T01:22:04.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.029+0000 7fea2ed52640 1 -- 172.21.15.81:0/3433796339 wait complete. 2024-09-16T01:22:04.040 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-16T01:22:02.142701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":261236,"kb_used_data":11688,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713484,"statfs":{"total":773094113280,"available":772826607616,"internally_reserved":0,"allocated":11968512,"data_stored":6111264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000620"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:22:00.086003+0000","last_change":"2024-09-16T01:22:00.086003+0000","last_active":"2024-09-16T01:22:00.086003+0000","last_peered":"2024-09-16T01:22:00.086003+0000","last_clean":"2024-09-16T01:22:00.086003+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:00.086003+0000","last_undegraded":"2024-09-16T01:22:00.086003+0000","last_fullsized":"2024-09-16T01:22:00.086003+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:21:59.081388+0000","last_change":"2024-09-16T01:21:59.081388+0000","last_active":"2024-09-16T01:21:59.081388+0000","last_peered":"2024-09-16T01:21:59.081388+0000","last_clean":"2024-09-16T01:21:59.081388+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:21:59.081388+0000","last_undegraded":"2024-09-16T01:21:59.081388+0000","last_fullsized":"2024-09-16T01:21:59.081388+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":329,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-09-16T01:21:57.098787+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:21:57.098787+0000","last_peered":"2024-09-16T01:21:57.098787+0000","last_clean":"2024-09-16T01:21:57.098787+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:21:57.098787+0000","last_undegraded":"2024-09-16T01:21:57.098787+0000","last_fullsized":"2024-09-16T01:21:57.098787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33088,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338752,"statfs":{"total":96636764160,"available":96602882048,"internally_reserved":0,"allocated":1941504,"data_stored":1206684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32516,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1347584,"data_stored":616316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32516,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1347584,"data_stored":616316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32508,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1347584,"data_stored":616316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32512,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339328,"statfs":{"total":96636764160,"available":96603471872,"internally_reserved":0,"allocated":1347584,"data_stored":616316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32508,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339332,"statfs":{"total":96636764160,"available":96603475968,"internally_reserved":0,"allocated":1347584,"data_stored":616316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":616316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33084,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338756,"statfs":{"total":96636764160,"available":96602886144,"internally_reserved":0,"allocated":1941504,"data_stored":1206684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:22:04.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:22:04.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.178+0000 7ff336637640 1 Processor -- start 2024-09-16T01:22:04.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.178+0000 7ff336637640 1 -- start start 2024-09-16T01:22:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff336637640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff33015e740 0x7ff3300d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff336637640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33009b690 0x7ff33006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff336637640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff33006e000 con 0x7ff33006d4c0 2024-09-16T01:22:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff336637640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff33015eb20 con 0x7ff33015e740 2024-09-16T01:22:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff336637640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff33006d260 con 0x7ff33009b690 2024-09-16T01:22:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff32ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff33015e740 0x7ff3300d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff32ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff33015e740 0x7ff3300d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41792/0 (socket says 172.21.15.81:41792) 2024-09-16T01:22:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff32ffff640 1 -- 172.21.15.81:0/1702935970 learned_addr learned my addr 172.21.15.81:0/1702935970 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:04.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff32f7fe640 1 --2- 172.21.15.81:0/1702935970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33009b690 0x7ff33006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff32ffff640 1 -- 172.21.15.81:0/1702935970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33009b690 msgr2=0x7ff33006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff32ffff640 1 --2- 172.21.15.81:0/1702935970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33009b690 0x7ff33006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff32ffff640 1 -- 172.21.15.81:0/1702935970 >> v1:172.21.15.102:6789/0 conn(0x7ff33006d4c0 legacy=0x7ff33006d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.179+0000 7ff32ffff640 1 -- 172.21.15.81:0/1702935970 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3300d0780 con 0x7ff33015e740 2024-09-16T01:22:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.180+0000 7ff32ffff640 1 --2- 172.21.15.81:0/1702935970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33015e740 0x7ff3300d1540 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7ff320009870 tx=0x7ff32002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08fe71e2ce0f190 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.180+0000 7ff32effd640 1 -- 172.21.15.81:0/1702935970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320037070 con 0x7ff33015e740 2024-09-16T01:22:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.180+0000 7ff32effd640 1 -- 172.21.15.81:0/1702935970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32002ae50 con 0x7ff33015e740 2024-09-16T01:22:04.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.180+0000 7ff32effd640 1 -- 172.21.15.81:0/1702935970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320032860 con 0x7ff33015e740 2024-09-16T01:22:04.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.181+0000 7ff336637640 1 -- 172.21.15.81:0/1702935970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33015e740 msgr2=0x7ff3300d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.181+0000 7ff336637640 1 --2- 172.21.15.81:0/1702935970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33015e740 0x7ff3300d1540 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7ff320009870 tx=0x7ff32002a300 comp rx=0 tx=0).stop 2024-09-16T01:22:04.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.181+0000 7ff336637640 1 -- 172.21.15.81:0/1702935970 shutdown_connections 2024-09-16T01:22:04.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.181+0000 7ff336637640 1 --2- 172.21.15.81:0/1702935970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33009b690 0x7ff33006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.181+0000 7ff336637640 1 --2- 172.21.15.81:0/1702935970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33015e740 0x7ff3300d1540 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.181+0000 7ff336637640 1 -- 172.21.15.81:0/1702935970 >> 172.21.15.81:0/1702935970 conn(0x7ff3300d23a0 msgr2=0x7ff3300d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:04.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.181+0000 7ff336637640 1 -- 172.21.15.81:0/1702935970 shutdown_connections 2024-09-16T01:22:04.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.181+0000 7ff336637640 1 -- 172.21.15.81:0/1702935970 wait complete. 2024-09-16T01:22:04.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.182+0000 7ff336637640 1 Processor -- start 2024-09-16T01:22:04.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.182+0000 7ff336637640 1 -- start start 2024-09-16T01:22:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff336637640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33006d4c0 0x7ff3300b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff336637640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33009b690 0x7ff330151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff336637640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff33015e740 0x7ff3300b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff336637640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3300d1020 con 0x7ff33006d4c0 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff336637640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff3300d0d40 con 0x7ff33015e740 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff336637640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff33009ba90 con 0x7ff33009b690 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff32ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33006d4c0 0x7ff3300b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff32ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33006d4c0 0x7ff3300b51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41804/0 (socket says 172.21.15.81:41804) 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff32ffff640 1 -- 172.21.15.81:0/2195899688 learned_addr learned my addr 172.21.15.81:0/2195899688 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff334bd4640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff33015e740 0x7ff3300b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff32f7fe640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33009b690 0x7ff330151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff32ffff640 1 -- 172.21.15.81:0/2195899688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33009b690 msgr2=0x7ff330151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff32ffff640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33009b690 0x7ff330151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff32ffff640 1 -- 172.21.15.81:0/2195899688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff33015e740 msgr2=0x7ff3300b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff32ffff640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff33015e740 0x7ff3300b6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff32ffff640 1 -- 172.21.15.81:0/2195899688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff330151d70 con 0x7ff33006d4c0 2024-09-16T01:22:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff334bd4640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff33015e740 0x7ff3300b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.183+0000 7ff32ffff640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33006d4c0 0x7ff3300b51f0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7ff320000c00 tx=0x7ff3200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.184+0000 7ff32cff9640 1 -- 172.21.15.81:0/2195899688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320041070 con 0x7ff33006d4c0 2024-09-16T01:22:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.184+0000 7ff32cff9640 1 -- 172.21.15.81:0/2195899688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32003c670 con 0x7ff33006d4c0 2024-09-16T01:22:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.184+0000 7ff336637640 1 -- 172.21.15.81:0/2195899688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3300b80f0 con 0x7ff33006d4c0 2024-09-16T01:22:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.184+0000 7ff32cff9640 1 -- 172.21.15.81:0/2195899688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff320037040 con 0x7ff33006d4c0 2024-09-16T01:22:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.184+0000 7ff336637640 1 -- 172.21.15.81:0/2195899688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3300b5b40 con 0x7ff33006d4c0 2024-09-16T01:22:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.185+0000 7ff336637640 1 -- 172.21.15.81:0/2195899688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33006cd20 con 0x7ff33006d4c0 2024-09-16T01:22:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.185+0000 7ff32cff9640 1 -- 172.21.15.81:0/2195899688 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff320044070 con 0x7ff33006d4c0 2024-09-16T01:22:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.186+0000 7ff32cff9640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff31c06c2b0 0x7ff31c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.186+0000 7ff32cff9640 1 -- 172.21.15.81:0/2195899688 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7ff3200ac0b0 con 0x7ff33006d4c0 2024-09-16T01:22:04.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.186+0000 7ff32f7fe640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff31c06c2b0 0x7ff31c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.186+0000 7ff32f7fe640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff31c06c2b0 0x7ff31c06e770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff3301631b0 tx=0x7ff324008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:04.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.190+0000 7ff32cff9640 1 -- 172.21.15.81:0/2195899688 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff330151d70 con 0x7ff33006d4c0 2024-09-16T01:22:04.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.355+0000 7ff336637640 1 -- 172.21.15.81:0/2195899688 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3300d1cb0 con 0x7ff31c06c2b0 2024-09-16T01:22:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.361+0000 7ff32cff9640 1 -- 172.21.15.81:0/2195899688 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252461 (secure 0 0 0) 0x7ff3300d1cb0 con 0x7ff31c06c2b0 2024-09-16T01:22:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:04.366 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:22:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.364+0000 7ff336637640 1 -- 172.21.15.81:0/2195899688 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff31c06c2b0 msgr2=0x7ff31c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.364+0000 7ff336637640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff31c06c2b0 0x7ff31c06e770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff3301631b0 tx=0x7ff324008040 comp rx=0 tx=0).stop 2024-09-16T01:22:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.364+0000 7ff336637640 1 -- 172.21.15.81:0/2195899688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33006d4c0 msgr2=0x7ff3300b51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.364+0000 7ff336637640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33006d4c0 0x7ff3300b51f0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7ff320000c00 tx=0x7ff3200046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.364+0000 7ff336637640 1 -- 172.21.15.81:0/2195899688 shutdown_connections 2024-09-16T01:22:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.364+0000 7ff336637640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff31c06c2b0 0x7ff31c06e770 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.364+0000 7ff336637640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff33015e740 0x7ff3300b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.364+0000 7ff336637640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff33009b690 0x7ff330151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.364+0000 7ff336637640 1 --2- 172.21.15.81:0/2195899688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33006d4c0 0x7ff3300b51f0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.364+0000 7ff336637640 1 -- 172.21.15.81:0/2195899688 >> 172.21.15.81:0/2195899688 conn(0x7ff3300d23a0 msgr2=0x7ff3300b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.364+0000 7ff336637640 1 -- 172.21.15.81:0/2195899688 shutdown_connections 2024-09-16T01:22:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.364+0000 7ff336637640 1 -- 172.21.15.81:0/2195899688 wait complete. 2024-09-16T01:22:04.375 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-16T01:22:04.143001+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261708,"kb_used_data":12172,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713012,"statfs":{"total":773094113280,"available":772826124288,"internally_reserved":0,"allocated":12464128,"data_stored":6340656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.056603"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.125178+0000","last_change":"2024-09-16T01:22:01.121860+0000","last_active":"2024-09-16T01:22:01.125178+0000","last_peered":"2024-09-16T01:22:01.125178+0000","last_clean":"2024-09-16T01:22:01.125178+0000","last_became_active":"2024-09-16T01:22:01.121145+0000","last_became_peered":"2024-09-16T01:22:01.121145+0000","last_unstale":"2024-09-16T01:22:01.125178+0000","last_undegraded":"2024-09-16T01:22:01.125178+0000","last_fullsized":"2024-09-16T01:22:01.125178+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:12.565970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.126863+0000","last_change":"2024-09-16T01:22:01.123720+0000","last_active":"2024-09-16T01:22:01.126863+0000","last_peered":"2024-09-16T01:22:01.126863+0000","last_clean":"2024-09-16T01:22:01.126863+0000","last_became_active":"2024-09-16T01:22:01.123403+0000","last_became_peered":"2024-09-16T01:22:01.123403+0000","last_unstale":"2024-09-16T01:22:01.126863+0000","last_undegraded":"2024-09-16T01:22:01.126863+0000","last_fullsized":"2024-09-16T01:22:01.126863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:12.511540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.118875+0000","last_change":"2024-09-16T01:22:01.112373+0000","last_active":"2024-09-16T01:22:01.118875+0000","last_peered":"2024-09-16T01:22:01.118875+0000","last_clean":"2024-09-16T01:22:01.118875+0000","last_became_active":"2024-09-16T01:22:01.112054+0000","last_became_peered":"2024-09-16T01:22:01.112054+0000","last_unstale":"2024-09-16T01:22:01.118875+0000","last_undegraded":"2024-09-16T01:22:01.118875+0000","last_fullsized":"2024-09-16T01:22:01.118875+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:10.772932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.120803+0000","last_change":"2024-09-16T01:22:01.118586+0000","last_active":"2024-09-16T01:22:01.120803+0000","last_peered":"2024-09-16T01:22:01.120803+0000","last_clean":"2024-09-16T01:22:01.120803+0000","last_became_active":"2024-09-16T01:22:01.118312+0000","last_became_peered":"2024-09-16T01:22:01.118312+0000","last_unstale":"2024-09-16T01:22:01.120803+0000","last_undegraded":"2024-09-16T01:22:01.120803+0000","last_fullsized":"2024-09-16T01:22:01.120803+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:11.021309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.121506+0000","last_change":"2024-09-16T01:22:01.119567+0000","last_active":"2024-09-16T01:22:01.121506+0000","last_peered":"2024-09-16T01:22:01.121506+0000","last_clean":"2024-09-16T01:22:01.121506+0000","last_became_active":"2024-09-16T01:22:01.119316+0000","last_became_peered":"2024-09-16T01:22:01.119316+0000","last_unstale":"2024-09-16T01:22:01.121506+0000","last_undegraded":"2024-09-16T01:22:01.121506+0000","last_fullsized":"2024-09-16T01:22:01.121506+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:01.168067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112367+0000","last_change":"2024-09-16T01:22:01.114605+0000","last_active":"2024-09-16T01:22:02.112367+0000","last_peered":"2024-09-16T01:22:02.112367+0000","last_clean":"2024-09-16T01:22:02.112367+0000","last_became_active":"2024-09-16T01:22:01.114353+0000","last_became_peered":"2024-09-16T01:22:01.114353+0000","last_unstale":"2024-09-16T01:22:02.112367+0000","last_undegraded":"2024-09-16T01:22:02.112367+0000","last_fullsized":"2024-09-16T01:22:02.112367+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:31.351096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112162+0000","last_change":"2024-09-16T01:22:01.112522+0000","last_active":"2024-09-16T01:22:02.112162+0000","last_peered":"2024-09-16T01:22:02.112162+0000","last_clean":"2024-09-16T01:22:02.112162+0000","last_became_active":"2024-09-16T01:22:01.112165+0000","last_became_peered":"2024-09-16T01:22:01.112165+0000","last_unstale":"2024-09-16T01:22:02.112162+0000","last_undegraded":"2024-09-16T01:22:02.112162+0000","last_fullsized":"2024-09-16T01:22:02.112162+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:24.809881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.126507+0000","last_change":"2024-09-16T01:22:01.120719+0000","last_active":"2024-09-16T01:22:01.126507+0000","last_peered":"2024-09-16T01:22:01.126507+0000","last_clean":"2024-09-16T01:22:01.126507+0000","last_became_active":"2024-09-16T01:22:01.119027+0000","last_became_peered":"2024-09-16T01:22:01.119027+0000","last_unstale":"2024-09-16T01:22:01.126507+0000","last_undegraded":"2024-09-16T01:22:01.126507+0000","last_fullsized":"2024-09-16T01:22:01.126507+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:26.856461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.119040+0000","last_change":"2024-09-16T01:22:01.115524+0000","last_active":"2024-09-16T01:22:01.119040+0000","last_peered":"2024-09-16T01:22:01.119040+0000","last_clean":"2024-09-16T01:22:01.119040+0000","last_became_active":"2024-09-16T01:22:01.115020+0000","last_became_peered":"2024-09-16T01:22:01.115020+0000","last_unstale":"2024-09-16T01:22:01.119040+0000","last_undegraded":"2024-09-16T01:22:01.119040+0000","last_fullsized":"2024-09-16T01:22:01.119040+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:54.602376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.863770+0000","last_change":"2024-09-16T01:22:01.104574+0000","last_active":"2024-09-16T01:22:02.863770+0000","last_peered":"2024-09-16T01:22:02.863770+0000","last_clean":"2024-09-16T01:22:02.863770+0000","last_became_active":"2024-09-16T01:22:01.104274+0000","last_became_peered":"2024-09-16T01:22:01.104274+0000","last_unstale":"2024-09-16T01:22:02.863770+0000","last_undegraded":"2024-09-16T01:22:02.863770+0000","last_fullsized":"2024-09-16T01:22:02.863770+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:15.069362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.116511+0000","last_change":"2024-09-16T01:22:01.109836+0000","last_active":"2024-09-16T01:22:01.116511+0000","last_peered":"2024-09-16T01:22:01.116511+0000","last_clean":"2024-09-16T01:22:01.116511+0000","last_became_active":"2024-09-16T01:22:01.109509+0000","last_became_peered":"2024-09-16T01:22:01.109509+0000","last_unstale":"2024-09-16T01:22:01.116511+0000","last_undegraded":"2024-09-16T01:22:01.116511+0000","last_fullsized":"2024-09-16T01:22:01.116511+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:42.239325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112705+0000","last_change":"2024-09-16T01:22:01.117495+0000","last_active":"2024-09-16T01:22:02.112705+0000","last_peered":"2024-09-16T01:22:02.112705+0000","last_clean":"2024-09-16T01:22:02.112705+0000","last_became_active":"2024-09-16T01:22:01.117132+0000","last_became_peered":"2024-09-16T01:22:01.117132+0000","last_unstale":"2024-09-16T01:22:02.112705+0000","last_undegraded":"2024-09-16T01:22:02.112705+0000","last_fullsized":"2024-09-16T01:22:02.112705+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:36.399553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.863623+0000","last_change":"2024-09-16T01:22:01.107205+0000","last_active":"2024-09-16T01:22:02.863623+0000","last_peered":"2024-09-16T01:22:02.863623+0000","last_clean":"2024-09-16T01:22:02.863623+0000","last_became_active":"2024-09-16T01:22:01.106247+0000","last_became_peered":"2024-09-16T01:22:01.106247+0000","last_unstale":"2024-09-16T01:22:02.863623+0000","last_undegraded":"2024-09-16T01:22:02.863623+0000","last_fullsized":"2024-09-16T01:22:02.863623+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:10.772932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.126830+0000","last_change":"2024-09-16T01:22:01.122822+0000","last_active":"2024-09-16T01:22:01.126830+0000","last_peered":"2024-09-16T01:22:01.126830+0000","last_clean":"2024-09-16T01:22:01.126830+0000","last_became_active":"2024-09-16T01:22:01.122041+0000","last_became_peered":"2024-09-16T01:22:01.122041+0000","last_unstale":"2024-09-16T01:22:01.126830+0000","last_undegraded":"2024-09-16T01:22:01.126830+0000","last_fullsized":"2024-09-16T01:22:01.126830+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:37.975522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.116340+0000","last_change":"2024-09-16T01:22:01.107543+0000","last_active":"2024-09-16T01:22:01.116340+0000","last_peered":"2024-09-16T01:22:01.116340+0000","last_clean":"2024-09-16T01:22:01.116340+0000","last_became_active":"2024-09-16T01:22:01.107291+0000","last_became_peered":"2024-09-16T01:22:01.107291+0000","last_unstale":"2024-09-16T01:22:01.116340+0000","last_undegraded":"2024-09-16T01:22:01.116340+0000","last_fullsized":"2024-09-16T01:22:01.116340+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:17.110608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112114+0000","last_change":"2024-09-16T01:22:01.113256+0000","last_active":"2024-09-16T01:22:02.112114+0000","last_peered":"2024-09-16T01:22:02.112114+0000","last_clean":"2024-09-16T01:22:02.112114+0000","last_became_active":"2024-09-16T01:22:01.112937+0000","last_became_peered":"2024-09-16T01:22:01.112937+0000","last_unstale":"2024-09-16T01:22:02.112114+0000","last_undegraded":"2024-09-16T01:22:02.112114+0000","last_fullsized":"2024-09-16T01:22:02.112114+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:58.527636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.863829+0000","last_change":"2024-09-16T01:22:01.107877+0000","last_active":"2024-09-16T01:22:02.863829+0000","last_peered":"2024-09-16T01:22:02.863829+0000","last_clean":"2024-09-16T01:22:02.863829+0000","last_became_active":"2024-09-16T01:22:01.107614+0000","last_became_peered":"2024-09-16T01:22:01.107614+0000","last_unstale":"2024-09-16T01:22:02.863829+0000","last_undegraded":"2024-09-16T01:22:02.863829+0000","last_fullsized":"2024-09-16T01:22:02.863829+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:16.970552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.126555+0000","last_change":"2024-09-16T01:22:01.122085+0000","last_active":"2024-09-16T01:22:01.126555+0000","last_peered":"2024-09-16T01:22:01.126555+0000","last_clean":"2024-09-16T01:22:01.126555+0000","last_became_active":"2024-09-16T01:22:01.121761+0000","last_became_peered":"2024-09-16T01:22:01.121761+0000","last_unstale":"2024-09-16T01:22:01.126555+0000","last_undegraded":"2024-09-16T01:22:01.126555+0000","last_fullsized":"2024-09-16T01:22:01.126555+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:22.513489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109391+0000","last_change":"2024-09-16T01:22:01.111727+0000","last_active":"2024-09-16T01:22:02.109391+0000","last_peered":"2024-09-16T01:22:02.109391+0000","last_clean":"2024-09-16T01:22:02.109391+0000","last_became_active":"2024-09-16T01:22:01.111442+0000","last_became_peered":"2024-09-16T01:22:01.111442+0000","last_unstale":"2024-09-16T01:22:02.109391+0000","last_undegraded":"2024-09-16T01:22:02.109391+0000","last_fullsized":"2024-09-16T01:22:02.109391+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:10.772932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.360460+0000","last_change":"2024-09-16T01:22:01.108097+0000","last_active":"2024-09-16T01:22:02.360460+0000","last_peered":"2024-09-16T01:22:02.360460+0000","last_clean":"2024-09-16T01:22:02.360460+0000","last_became_active":"2024-09-16T01:22:01.107839+0000","last_became_peered":"2024-09-16T01:22:01.107839+0000","last_unstale":"2024-09-16T01:22:02.360460+0000","last_undegraded":"2024-09-16T01:22:02.360460+0000","last_fullsized":"2024-09-16T01:22:02.360460+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:44.752541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.117592+0000","last_change":"2024-09-16T01:22:01.111905+0000","last_active":"2024-09-16T01:22:01.117592+0000","last_peered":"2024-09-16T01:22:01.117592+0000","last_clean":"2024-09-16T01:22:01.117592+0000","last_became_active":"2024-09-16T01:22:01.111628+0000","last_became_peered":"2024-09-16T01:22:01.111628+0000","last_unstale":"2024-09-16T01:22:01.117592+0000","last_undegraded":"2024-09-16T01:22:01.117592+0000","last_fullsized":"2024-09-16T01:22:01.117592+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:09.341726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.116727+0000","last_change":"2024-09-16T01:22:01.113407+0000","last_active":"2024-09-16T01:22:01.116727+0000","last_peered":"2024-09-16T01:22:01.116727+0000","last_clean":"2024-09-16T01:22:01.116727+0000","last_became_active":"2024-09-16T01:22:01.113123+0000","last_became_peered":"2024-09-16T01:22:01.113123+0000","last_unstale":"2024-09-16T01:22:01.116727+0000","last_undegraded":"2024-09-16T01:22:01.116727+0000","last_fullsized":"2024-09-16T01:22:01.116727+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:12.301018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.119134+0000","last_change":"2024-09-16T01:22:01.115374+0000","last_active":"2024-09-16T01:22:01.119134+0000","last_peered":"2024-09-16T01:22:01.119134+0000","last_clean":"2024-09-16T01:22:01.119134+0000","last_became_active":"2024-09-16T01:22:01.115077+0000","last_became_peered":"2024-09-16T01:22:01.115077+0000","last_unstale":"2024-09-16T01:22:01.119134+0000","last_undegraded":"2024-09-16T01:22:01.119134+0000","last_fullsized":"2024-09-16T01:22:01.119134+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:11.124336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.108454+0000","last_change":"2024-09-16T01:22:01.107595+0000","last_active":"2024-09-16T01:22:02.108454+0000","last_peered":"2024-09-16T01:22:02.108454+0000","last_clean":"2024-09-16T01:22:02.108454+0000","last_became_active":"2024-09-16T01:22:01.107343+0000","last_became_peered":"2024-09-16T01:22:01.107343+0000","last_unstale":"2024-09-16T01:22:02.108454+0000","last_undegraded":"2024-09-16T01:22:02.108454+0000","last_fullsized":"2024-09-16T01:22:02.108454+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:01.516465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109446+0000","last_change":"2024-09-16T01:22:01.114321+0000","last_active":"2024-09-16T01:22:02.109446+0000","last_peered":"2024-09-16T01:22:02.109446+0000","last_clean":"2024-09-16T01:22:02.109446+0000","last_became_active":"2024-09-16T01:22:01.110165+0000","last_became_peered":"2024-09-16T01:22:01.110165+0000","last_unstale":"2024-09-16T01:22:02.109446+0000","last_undegraded":"2024-09-16T01:22:02.109446+0000","last_fullsized":"2024-09-16T01:22:02.109446+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:16.970552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.360571+0000","last_change":"2024-09-16T01:22:01.113111+0000","last_active":"2024-09-16T01:22:02.360571+0000","last_peered":"2024-09-16T01:22:02.360571+0000","last_clean":"2024-09-16T01:22:02.360571+0000","last_became_active":"2024-09-16T01:22:01.112825+0000","last_became_peered":"2024-09-16T01:22:01.112825+0000","last_unstale":"2024-09-16T01:22:02.360571+0000","last_undegraded":"2024-09-16T01:22:02.360571+0000","last_fullsized":"2024-09-16T01:22:02.360571+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:05.350684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109537+0000","last_change":"2024-09-16T01:22:01.111139+0000","last_active":"2024-09-16T01:22:02.109537+0000","last_peered":"2024-09-16T01:22:02.109537+0000","last_clean":"2024-09-16T01:22:02.109537+0000","last_became_active":"2024-09-16T01:22:01.110847+0000","last_became_peered":"2024-09-16T01:22:01.110847+0000","last_unstale":"2024-09-16T01:22:02.109537+0000","last_undegraded":"2024-09-16T01:22:02.109537+0000","last_fullsized":"2024-09-16T01:22:02.109537+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:22.455673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112780+0000","last_change":"2024-09-16T01:22:01.102963+0000","last_active":"2024-09-16T01:22:02.112780+0000","last_peered":"2024-09-16T01:22:02.112780+0000","last_clean":"2024-09-16T01:22:02.112780+0000","last_became_active":"2024-09-16T01:22:01.102624+0000","last_became_peered":"2024-09-16T01:22:01.102624+0000","last_unstale":"2024-09-16T01:22:02.112780+0000","last_undegraded":"2024-09-16T01:22:02.112780+0000","last_fullsized":"2024-09-16T01:22:02.112780+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:50.372297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.360615+0000","last_change":"2024-09-16T01:22:01.112985+0000","last_active":"2024-09-16T01:22:02.360615+0000","last_peered":"2024-09-16T01:22:02.360615+0000","last_clean":"2024-09-16T01:22:02.360615+0000","last_became_active":"2024-09-16T01:22:01.112235+0000","last_became_peered":"2024-09-16T01:22:01.112235+0000","last_unstale":"2024-09-16T01:22:02.360615+0000","last_undegraded":"2024-09-16T01:22:02.360615+0000","last_fullsized":"2024-09-16T01:22:02.360615+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:59.262343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.120933+0000","last_change":"2024-09-16T01:22:01.117344+0000","last_active":"2024-09-16T01:22:01.120933+0000","last_peered":"2024-09-16T01:22:01.120933+0000","last_clean":"2024-09-16T01:22:01.120933+0000","last_became_active":"2024-09-16T01:22:01.116999+0000","last_became_peered":"2024-09-16T01:22:01.116999+0000","last_unstale":"2024-09-16T01:22:01.120933+0000","last_undegraded":"2024-09-16T01:22:01.120933+0000","last_fullsized":"2024-09-16T01:22:01.120933+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:22.455673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.108743+0000","last_change":"2024-09-16T01:22:01.110174+0000","last_active":"2024-09-16T01:22:02.108743+0000","last_peered":"2024-09-16T01:22:02.108743+0000","last_clean":"2024-09-16T01:22:02.108743+0000","last_became_active":"2024-09-16T01:22:01.109825+0000","last_became_peered":"2024-09-16T01:22:01.109825+0000","last_unstale":"2024-09-16T01:22:02.108743+0000","last_undegraded":"2024-09-16T01:22:02.108743+0000","last_fullsized":"2024-09-16T01:22:02.108743+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:22.455673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.108636+0000","last_change":"2024-09-16T01:22:01.108648+0000","last_active":"2024-09-16T01:22:02.108636+0000","last_peered":"2024-09-16T01:22:02.108636+0000","last_clean":"2024-09-16T01:22:02.108636+0000","last_became_active":"2024-09-16T01:22:01.108280+0000","last_became_peered":"2024-09-16T01:22:01.108280+0000","last_unstale":"2024-09-16T01:22:02.108636+0000","last_undegraded":"2024-09-16T01:22:02.108636+0000","last_fullsized":"2024-09-16T01:22:02.108636+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:10.772932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.863679+0000","last_change":"2024-09-16T01:22:01.102576+0000","last_active":"2024-09-16T01:22:02.863679+0000","last_peered":"2024-09-16T01:22:02.863679+0000","last_clean":"2024-09-16T01:22:02.863679+0000","last_became_active":"2024-09-16T01:22:01.102275+0000","last_became_peered":"2024-09-16T01:22:01.102275+0000","last_unstale":"2024-09-16T01:22:02.863679+0000","last_undegraded":"2024-09-16T01:22:02.863679+0000","last_fullsized":"2024-09-16T01:22:02.863679+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:22.455673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"112'4","reported_seq":18,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109596+0000","last_change":"2024-09-16T01:22:00.108517+0000","last_active":"2024-09-16T01:22:02.109596+0000","last_peered":"2024-09-16T01:22:02.109596+0000","last_clean":"2024-09-16T01:22:02.109596+0000","last_became_active":"2024-09-16T01:22:00.108260+0000","last_became_peered":"2024-09-16T01:22:00.108260+0000","last_unstale":"2024-09-16T01:22:02.109596+0000","last_undegraded":"2024-09-16T01:22:02.109596+0000","last_fullsized":"2024-09-16T01:22:02.109596+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:41.234709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112344+0000","last_change":"2024-09-16T01:22:01.113962+0000","last_active":"2024-09-16T01:22:02.112344+0000","last_peered":"2024-09-16T01:22:02.112344+0000","last_clean":"2024-09-16T01:22:02.112344+0000","last_became_active":"2024-09-16T01:22:01.113665+0000","last_became_peered":"2024-09-16T01:22:01.113665+0000","last_unstale":"2024-09-16T01:22:02.112344+0000","last_undegraded":"2024-09-16T01:22:02.112344+0000","last_fullsized":"2024-09-16T01:22:02.112344+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:35:54.455571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.863728+0000","last_change":"2024-09-16T01:22:00.108449+0000","last_active":"2024-09-16T01:22:02.863728+0000","last_peered":"2024-09-16T01:22:02.863728+0000","last_clean":"2024-09-16T01:22:02.863728+0000","last_became_active":"2024-09-16T01:22:00.108192+0000","last_became_peered":"2024-09-16T01:22:00.108192+0000","last_unstale":"2024-09-16T01:22:02.863728+0000","last_undegraded":"2024-09-16T01:22:02.863728+0000","last_fullsized":"2024-09-16T01:22:02.863728+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:58.978380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109208+0000","last_change":"2024-09-16T01:22:01.104838+0000","last_active":"2024-09-16T01:22:02.109208+0000","last_peered":"2024-09-16T01:22:02.109208+0000","last_clean":"2024-09-16T01:22:02.109208+0000","last_became_active":"2024-09-16T01:22:01.104540+0000","last_became_peered":"2024-09-16T01:22:01.104540+0000","last_unstale":"2024-09-16T01:22:02.109208+0000","last_undegraded":"2024-09-16T01:22:02.109208+0000","last_fullsized":"2024-09-16T01:22:02.109208+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:26.856461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"112'2","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.126409+0000","last_change":"2024-09-16T01:22:00.112842+0000","last_active":"2024-09-16T01:22:01.126409+0000","last_peered":"2024-09-16T01:22:01.126409+0000","last_clean":"2024-09-16T01:22:01.126409+0000","last_became_active":"2024-09-16T01:22:00.112565+0000","last_became_peered":"2024-09-16T01:22:00.112565+0000","last_unstale":"2024-09-16T01:22:01.126409+0000","last_undegraded":"2024-09-16T01:22:01.126409+0000","last_fullsized":"2024-09-16T01:22:01.126409+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:25.851845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.118863+0000","last_change":"2024-09-16T01:22:01.113430+0000","last_active":"2024-09-16T01:22:01.118863+0000","last_peered":"2024-09-16T01:22:01.118863+0000","last_clean":"2024-09-16T01:22:01.118863+0000","last_became_active":"2024-09-16T01:22:01.113062+0000","last_became_peered":"2024-09-16T01:22:01.113062+0000","last_unstale":"2024-09-16T01:22:01.118863+0000","last_undegraded":"2024-09-16T01:22:01.118863+0000","last_fullsized":"2024-09-16T01:22:01.118863+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:21:00.599172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.863646+0000","last_change":"2024-09-16T01:22:00.104289+0000","last_active":"2024-09-16T01:22:02.863646+0000","last_peered":"2024-09-16T01:22:02.863646+0000","last_clean":"2024-09-16T01:22:02.863646+0000","last_became_active":"2024-09-16T01:22:00.104014+0000","last_became_peered":"2024-09-16T01:22:00.104014+0000","last_unstale":"2024-09-16T01:22:02.863646+0000","last_undegraded":"2024-09-16T01:22:02.863646+0000","last_fullsized":"2024-09-16T01:22:02.863646+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:22.580183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.863675+0000","last_change":"2024-09-16T01:22:01.106530+0000","last_active":"2024-09-16T01:22:02.863675+0000","last_peered":"2024-09-16T01:22:02.863675+0000","last_clean":"2024-09-16T01:22:02.863675+0000","last_became_active":"2024-09-16T01:22:01.106214+0000","last_became_peered":"2024-09-16T01:22:01.106214+0000","last_unstale":"2024-09-16T01:22:02.863675+0000","last_undegraded":"2024-09-16T01:22:02.863675+0000","last_fullsized":"2024-09-16T01:22:02.863675+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:11.664302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"112'1","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.123633+0000","last_change":"2024-09-16T01:22:00.105806+0000","last_active":"2024-09-16T01:22:01.123633+0000","last_peered":"2024-09-16T01:22:01.123633+0000","last_clean":"2024-09-16T01:22:01.123633+0000","last_became_active":"2024-09-16T01:22:00.105175+0000","last_became_peered":"2024-09-16T01:22:00.105175+0000","last_unstale":"2024-09-16T01:22:01.123633+0000","last_undegraded":"2024-09-16T01:22:01.123633+0000","last_fullsized":"2024-09-16T01:22:01.123633+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:14.715315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.116756+0000","last_change":"2024-09-16T01:22:01.110654+0000","last_active":"2024-09-16T01:22:01.116756+0000","last_peered":"2024-09-16T01:22:01.116756+0000","last_clean":"2024-09-16T01:22:01.116756+0000","last_became_active":"2024-09-16T01:22:01.110397+0000","last_became_peered":"2024-09-16T01:22:01.110397+0000","last_unstale":"2024-09-16T01:22:01.116756+0000","last_undegraded":"2024-09-16T01:22:01.116756+0000","last_fullsized":"2024-09-16T01:22:01.116756+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:14.896270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112459+0000","last_change":"2024-09-16T01:22:00.107213+0000","last_active":"2024-09-16T01:22:02.112459+0000","last_peered":"2024-09-16T01:22:02.112459+0000","last_clean":"2024-09-16T01:22:02.112459+0000","last_became_active":"2024-09-16T01:22:00.106914+0000","last_became_peered":"2024-09-16T01:22:00.106914+0000","last_unstale":"2024-09-16T01:22:02.112459+0000","last_undegraded":"2024-09-16T01:22:02.112459+0000","last_fullsized":"2024-09-16T01:22:02.112459+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:51.746663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.126917+0000","last_change":"2024-09-16T01:22:01.123809+0000","last_active":"2024-09-16T01:22:01.126917+0000","last_peered":"2024-09-16T01:22:01.126917+0000","last_clean":"2024-09-16T01:22:01.126917+0000","last_became_active":"2024-09-16T01:22:01.123506+0000","last_became_peered":"2024-09-16T01:22:01.123506+0000","last_unstale":"2024-09-16T01:22:01.126917+0000","last_undegraded":"2024-09-16T01:22:01.126917+0000","last_fullsized":"2024-09-16T01:22:01.126917+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:33.745991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.108832+0000","last_change":"2024-09-16T01:22:00.101941+0000","last_active":"2024-09-16T01:22:02.108832+0000","last_peered":"2024-09-16T01:22:02.108832+0000","last_clean":"2024-09-16T01:22:02.108832+0000","last_became_active":"2024-09-16T01:22:00.101670+0000","last_became_peered":"2024-09-16T01:22:00.101670+0000","last_unstale":"2024-09-16T01:22:02.108832+0000","last_undegraded":"2024-09-16T01:22:02.108832+0000","last_fullsized":"2024-09-16T01:22:02.108832+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:30.048797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.863752+0000","last_change":"2024-09-16T01:22:01.114509+0000","last_active":"2024-09-16T01:22:02.863752+0000","last_peered":"2024-09-16T01:22:02.863752+0000","last_clean":"2024-09-16T01:22:02.863752+0000","last_became_active":"2024-09-16T01:22:01.114220+0000","last_became_peered":"2024-09-16T01:22:01.114220+0000","last_unstale":"2024-09-16T01:22:02.863752+0000","last_undegraded":"2024-09-16T01:22:02.863752+0000","last_fullsized":"2024-09-16T01:22:02.863752+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:31.883353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112220+0000","last_change":"2024-09-16T01:22:00.111549+0000","last_active":"2024-09-16T01:22:02.112220+0000","last_peered":"2024-09-16T01:22:02.112220+0000","last_clean":"2024-09-16T01:22:02.112220+0000","last_became_active":"2024-09-16T01:22:00.111278+0000","last_became_peered":"2024-09-16T01:22:00.111278+0000","last_unstale":"2024-09-16T01:22:02.112220+0000","last_undegraded":"2024-09-16T01:22:02.112220+0000","last_fullsized":"2024-09-16T01:22:02.112220+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:19.881575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109210+0000","last_change":"2024-09-16T01:22:01.110287+0000","last_active":"2024-09-16T01:22:02.109210+0000","last_peered":"2024-09-16T01:22:02.109210+0000","last_clean":"2024-09-16T01:22:02.109210+0000","last_became_active":"2024-09-16T01:22:01.109965+0000","last_became_peered":"2024-09-16T01:22:01.109965+0000","last_unstale":"2024-09-16T01:22:02.109210+0000","last_undegraded":"2024-09-16T01:22:02.109210+0000","last_fullsized":"2024-09-16T01:22:02.109210+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:01.516465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109687+0000","last_change":"2024-09-16T01:22:00.105495+0000","last_active":"2024-09-16T01:22:02.109687+0000","last_peered":"2024-09-16T01:22:02.109687+0000","last_clean":"2024-09-16T01:22:02.109687+0000","last_became_active":"2024-09-16T01:22:00.105226+0000","last_became_peered":"2024-09-16T01:22:00.105226+0000","last_unstale":"2024-09-16T01:22:02.109687+0000","last_undegraded":"2024-09-16T01:22:02.109687+0000","last_fullsized":"2024-09-16T01:22:02.109687+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:52:16.105993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109228+0000","last_change":"2024-09-16T01:22:01.113265+0000","last_active":"2024-09-16T01:22:02.109228+0000","last_peered":"2024-09-16T01:22:02.109228+0000","last_clean":"2024-09-16T01:22:02.109228+0000","last_became_active":"2024-09-16T01:22:01.113002+0000","last_became_peered":"2024-09-16T01:22:01.113002+0000","last_unstale":"2024-09-16T01:22:02.109228+0000","last_undegraded":"2024-09-16T01:22:02.109228+0000","last_fullsized":"2024-09-16T01:22:02.109228+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:22.513489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109299+0000","last_change":"2024-09-16T01:22:00.107588+0000","last_active":"2024-09-16T01:22:02.109299+0000","last_peered":"2024-09-16T01:22:02.109299+0000","last_clean":"2024-09-16T01:22:02.109299+0000","last_became_active":"2024-09-16T01:22:00.107192+0000","last_became_peered":"2024-09-16T01:22:00.107192+0000","last_unstale":"2024-09-16T01:22:02.109299+0000","last_undegraded":"2024-09-16T01:22:02.109299+0000","last_fullsized":"2024-09-16T01:22:02.109299+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:56.977875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.126337+0000","last_change":"2024-09-16T01:22:01.120058+0000","last_active":"2024-09-16T01:22:01.126337+0000","last_peered":"2024-09-16T01:22:01.126337+0000","last_clean":"2024-09-16T01:22:01.126337+0000","last_became_active":"2024-09-16T01:22:01.119182+0000","last_became_peered":"2024-09-16T01:22:01.119182+0000","last_unstale":"2024-09-16T01:22:01.126337+0000","last_undegraded":"2024-09-16T01:22:01.126337+0000","last_fullsized":"2024-09-16T01:22:01.126337+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:15.069362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"112'3","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109365+0000","last_change":"2024-09-16T01:22:00.109305+0000","last_active":"2024-09-16T01:22:02.109365+0000","last_peered":"2024-09-16T01:22:02.109365+0000","last_clean":"2024-09-16T01:22:02.109365+0000","last_became_active":"2024-09-16T01:22:00.109047+0000","last_became_peered":"2024-09-16T01:22:00.109047+0000","last_unstale":"2024-09-16T01:22:02.109365+0000","last_undegraded":"2024-09-16T01:22:02.109365+0000","last_fullsized":"2024-09-16T01:22:02.109365+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:25:58.978380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109542+0000","last_change":"2024-09-16T01:22:01.114351+0000","last_active":"2024-09-16T01:22:02.109542+0000","last_peered":"2024-09-16T01:22:02.109542+0000","last_clean":"2024-09-16T01:22:02.109542+0000","last_became_active":"2024-09-16T01:22:01.109260+0000","last_became_peered":"2024-09-16T01:22:01.109260+0000","last_unstale":"2024-09-16T01:22:02.109542+0000","last_undegraded":"2024-09-16T01:22:02.109542+0000","last_fullsized":"2024-09-16T01:22:02.109542+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:37.975522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"112'6","reported_seq":18,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.128191+0000","last_change":"2024-09-16T01:22:00.110018+0000","last_active":"2024-09-16T01:22:01.128191+0000","last_peered":"2024-09-16T01:22:01.128191+0000","last_clean":"2024-09-16T01:22:01.128191+0000","last_became_active":"2024-09-16T01:22:00.109735+0000","last_became_peered":"2024-09-16T01:22:00.109735+0000","last_unstale":"2024-09-16T01:22:01.128191+0000","last_undegraded":"2024-09-16T01:22:01.128191+0000","last_fullsized":"2024-09-16T01:22:01.128191+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:11.561354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109030+0000","last_change":"2024-09-16T01:22:01.115455+0000","last_active":"2024-09-16T01:22:02.109030+0000","last_peered":"2024-09-16T01:22:02.109030+0000","last_clean":"2024-09-16T01:22:02.109030+0000","last_became_active":"2024-09-16T01:22:01.115203+0000","last_became_peered":"2024-09-16T01:22:01.115203+0000","last_unstale":"2024-09-16T01:22:02.109030+0000","last_undegraded":"2024-09-16T01:22:02.109030+0000","last_fullsized":"2024-09-16T01:22:02.109030+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:11.664302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"112'2","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.127389+0000","last_change":"2024-09-16T01:22:00.109184+0000","last_active":"2024-09-16T01:22:01.127389+0000","last_peered":"2024-09-16T01:22:01.127389+0000","last_clean":"2024-09-16T01:22:01.127389+0000","last_became_active":"2024-09-16T01:22:00.108925+0000","last_became_peered":"2024-09-16T01:22:00.108925+0000","last_unstale":"2024-09-16T01:22:01.127389+0000","last_undegraded":"2024-09-16T01:22:01.127389+0000","last_fullsized":"2024-09-16T01:22:01.127389+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:13.891654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.863578+0000","last_change":"2024-09-16T01:22:01.109922+0000","last_active":"2024-09-16T01:22:02.863578+0000","last_peered":"2024-09-16T01:22:02.863578+0000","last_clean":"2024-09-16T01:22:02.863578+0000","last_became_active":"2024-09-16T01:22:01.109644+0000","last_became_peered":"2024-09-16T01:22:01.109644+0000","last_unstale":"2024-09-16T01:22:02.863578+0000","last_undegraded":"2024-09-16T01:22:02.863578+0000","last_fullsized":"2024-09-16T01:22:02.863578+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:01.516465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.108572+0000","last_change":"2024-09-16T01:22:00.104160+0000","last_active":"2024-09-16T01:22:01.108572+0000","last_peered":"2024-09-16T01:22:01.108572+0000","last_clean":"2024-09-16T01:22:01.108572+0000","last_became_active":"2024-09-16T01:22:00.103868+0000","last_became_peered":"2024-09-16T01:22:00.103868+0000","last_unstale":"2024-09-16T01:22:01.108572+0000","last_undegraded":"2024-09-16T01:22:01.108572+0000","last_fullsized":"2024-09-16T01:22:01.108572+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:10.659687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.360405+0000","last_change":"2024-09-16T01:22:01.109678+0000","last_active":"2024-09-16T01:22:02.360405+0000","last_peered":"2024-09-16T01:22:02.360405+0000","last_clean":"2024-09-16T01:22:02.360405+0000","last_became_active":"2024-09-16T01:22:01.109357+0000","last_became_peered":"2024-09-16T01:22:01.109357+0000","last_unstale":"2024-09-16T01:22:02.360405+0000","last_undegraded":"2024-09-16T01:22:02.360405+0000","last_fullsized":"2024-09-16T01:22:02.360405+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:29:37.077673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.104330+0000","last_change":"2024-09-16T01:22:00.110682+0000","last_active":"2024-09-16T01:22:01.104330+0000","last_peered":"2024-09-16T01:22:01.104330+0000","last_clean":"2024-09-16T01:22:01.104330+0000","last_became_active":"2024-09-16T01:22:00.110413+0000","last_became_peered":"2024-09-16T01:22:00.110413+0000","last_unstale":"2024-09-16T01:22:01.104330+0000","last_undegraded":"2024-09-16T01:22:01.104330+0000","last_fullsized":"2024-09-16T01:22:01.104330+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:11.296403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109137+0000","last_change":"2024-09-16T01:22:01.106584+0000","last_active":"2024-09-16T01:22:02.109137+0000","last_peered":"2024-09-16T01:22:02.109137+0000","last_clean":"2024-09-16T01:22:02.109137+0000","last_became_active":"2024-09-16T01:22:01.106217+0000","last_became_peered":"2024-09-16T01:22:01.106217+0000","last_unstale":"2024-09-16T01:22:02.109137+0000","last_undegraded":"2024-09-16T01:22:02.109137+0000","last_fullsized":"2024-09-16T01:22:02.109137+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:15.069362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.863828+0000","last_change":"2024-09-16T01:22:00.107352+0000","last_active":"2024-09-16T01:22:02.863828+0000","last_peered":"2024-09-16T01:22:02.863828+0000","last_clean":"2024-09-16T01:22:02.863828+0000","last_became_active":"2024-09-16T01:22:00.107071+0000","last_became_peered":"2024-09-16T01:22:00.107071+0000","last_unstale":"2024-09-16T01:22:02.863828+0000","last_undegraded":"2024-09-16T01:22:02.863828+0000","last_fullsized":"2024-09-16T01:22:02.863828+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:30.048797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.117348+0000","last_change":"2024-09-16T01:22:01.112710+0000","last_active":"2024-09-16T01:22:01.117348+0000","last_peered":"2024-09-16T01:22:01.117348+0000","last_clean":"2024-09-16T01:22:01.117348+0000","last_became_active":"2024-09-16T01:22:01.112456+0000","last_became_peered":"2024-09-16T01:22:01.112456+0000","last_unstale":"2024-09-16T01:22:01.117348+0000","last_undegraded":"2024-09-16T01:22:01.117348+0000","last_fullsized":"2024-09-16T01:22:01.117348+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:27.694182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.360557+0000","last_change":"2024-09-16T01:22:00.106031+0000","last_active":"2024-09-16T01:22:02.360557+0000","last_peered":"2024-09-16T01:22:02.360557+0000","last_clean":"2024-09-16T01:22:02.360557+0000","last_became_active":"2024-09-16T01:22:00.105586+0000","last_became_peered":"2024-09-16T01:22:00.105586+0000","last_unstale":"2024-09-16T01:22:02.360557+0000","last_undegraded":"2024-09-16T01:22:02.360557+0000","last_fullsized":"2024-09-16T01:22:02.360557+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:03:20.369893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112709+0000","last_change":"2024-09-16T01:22:01.107042+0000","last_active":"2024-09-16T01:22:02.112709+0000","last_peered":"2024-09-16T01:22:02.112709+0000","last_clean":"2024-09-16T01:22:02.112709+0000","last_became_active":"2024-09-16T01:22:01.106772+0000","last_became_peered":"2024-09-16T01:22:01.106772+0000","last_unstale":"2024-09-16T01:22:02.112709+0000","last_undegraded":"2024-09-16T01:22:02.112709+0000","last_fullsized":"2024-09-16T01:22:02.112709+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:53:51.465570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"112'1","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.124624+0000","last_change":"2024-09-16T01:22:00.111950+0000","last_active":"2024-09-16T01:22:01.124624+0000","last_peered":"2024-09-16T01:22:01.124624+0000","last_clean":"2024-09-16T01:22:01.124624+0000","last_became_active":"2024-09-16T01:22:00.111543+0000","last_became_peered":"2024-09-16T01:22:00.111543+0000","last_unstale":"2024-09-16T01:22:01.124624+0000","last_undegraded":"2024-09-16T01:22:01.124624+0000","last_fullsized":"2024-09-16T01:22:01.124624+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:21.508873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109578+0000","last_change":"2024-09-16T01:22:01.115284+0000","last_active":"2024-09-16T01:22:02.109578+0000","last_peered":"2024-09-16T01:22:02.109578+0000","last_clean":"2024-09-16T01:22:02.109578+0000","last_became_active":"2024-09-16T01:22:01.114881+0000","last_became_peered":"2024-09-16T01:22:01.114881+0000","last_unstale":"2024-09-16T01:22:02.109578+0000","last_undegraded":"2024-09-16T01:22:02.109578+0000","last_fullsized":"2024-09-16T01:22:02.109578+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:12.511540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.102280+0000","last_change":"2024-09-16T01:22:00.112711+0000","last_active":"2024-09-16T01:22:01.102280+0000","last_peered":"2024-09-16T01:22:01.102280+0000","last_clean":"2024-09-16T01:22:01.102280+0000","last_became_active":"2024-09-16T01:22:00.112384+0000","last_became_peered":"2024-09-16T01:22:00.112384+0000","last_unstale":"2024-09-16T01:22:01.102280+0000","last_undegraded":"2024-09-16T01:22:01.102280+0000","last_fullsized":"2024-09-16T01:22:01.102280+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:11.506925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112116+0000","last_change":"2024-09-16T01:22:01.108052+0000","last_active":"2024-09-16T01:22:02.112116+0000","last_peered":"2024-09-16T01:22:02.112116+0000","last_clean":"2024-09-16T01:22:02.112116+0000","last_became_active":"2024-09-16T01:22:01.107651+0000","last_became_peered":"2024-09-16T01:22:01.107651+0000","last_unstale":"2024-09-16T01:22:02.112116+0000","last_undegraded":"2024-09-16T01:22:02.112116+0000","last_fullsized":"2024-09-16T01:22:02.112116+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:24.230062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112407+0000","last_change":"2024-09-16T01:22:00.111129+0000","last_active":"2024-09-16T01:22:02.112407+0000","last_peered":"2024-09-16T01:22:02.112407+0000","last_clean":"2024-09-16T01:22:02.112407+0000","last_became_active":"2024-09-16T01:22:00.110848+0000","last_became_peered":"2024-09-16T01:22:00.110848+0000","last_unstale":"2024-09-16T01:22:02.112407+0000","last_undegraded":"2024-09-16T01:22:02.112407+0000","last_fullsized":"2024-09-16T01:22:02.112407+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:43.772836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.114470+0000","last_change":"2024-09-16T01:22:01.111243+0000","last_active":"2024-09-16T01:22:01.114470+0000","last_peered":"2024-09-16T01:22:01.114470+0000","last_clean":"2024-09-16T01:22:01.114470+0000","last_became_active":"2024-09-16T01:22:01.110386+0000","last_became_peered":"2024-09-16T01:22:01.110386+0000","last_unstale":"2024-09-16T01:22:01.114470+0000","last_undegraded":"2024-09-16T01:22:01.114470+0000","last_fullsized":"2024-09-16T01:22:01.114470+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:01.516465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.102612+0000","last_change":"2024-09-16T01:22:00.112808+0000","last_active":"2024-09-16T01:22:01.102612+0000","last_peered":"2024-09-16T01:22:01.102612+0000","last_clean":"2024-09-16T01:22:01.102612+0000","last_became_active":"2024-09-16T01:22:00.112299+0000","last_became_peered":"2024-09-16T01:22:00.112299+0000","last_unstale":"2024-09-16T01:22:01.102612+0000","last_undegraded":"2024-09-16T01:22:01.102612+0000","last_fullsized":"2024-09-16T01:22:01.102612+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:32.741376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.126506+0000","last_change":"2024-09-16T01:22:01.122222+0000","last_active":"2024-09-16T01:22:01.126506+0000","last_peered":"2024-09-16T01:22:01.126506+0000","last_clean":"2024-09-16T01:22:01.126506+0000","last_became_active":"2024-09-16T01:22:01.121930+0000","last_became_peered":"2024-09-16T01:22:01.121930+0000","last_unstale":"2024-09-16T01:22:01.126506+0000","last_undegraded":"2024-09-16T01:22:01.126506+0000","last_fullsized":"2024-09-16T01:22:01.126506+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:16.970552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.104508+0000","last_change":"2024-09-16T01:22:00.107954+0000","last_active":"2024-09-16T01:22:01.104508+0000","last_peered":"2024-09-16T01:22:01.104508+0000","last_clean":"2024-09-16T01:22:01.104508+0000","last_became_active":"2024-09-16T01:22:00.107661+0000","last_became_peered":"2024-09-16T01:22:00.107661+0000","last_unstale":"2024-09-16T01:22:01.104508+0000","last_undegraded":"2024-09-16T01:22:01.104508+0000","last_fullsized":"2024-09-16T01:22:01.104508+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:00.163452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.108990+0000","last_change":"2024-09-16T01:22:01.109418+0000","last_active":"2024-09-16T01:22:02.108990+0000","last_peered":"2024-09-16T01:22:02.108990+0000","last_clean":"2024-09-16T01:22:02.108990+0000","last_became_active":"2024-09-16T01:22:01.109128+0000","last_became_peered":"2024-09-16T01:22:01.109128+0000","last_unstale":"2024-09-16T01:22:02.108990+0000","last_undegraded":"2024-09-16T01:22:02.108990+0000","last_fullsized":"2024-09-16T01:22:02.108990+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:31.883353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.102166+0000","last_change":"2024-09-16T01:22:00.113308+0000","last_active":"2024-09-16T01:22:01.102166+0000","last_peered":"2024-09-16T01:22:01.102166+0000","last_clean":"2024-09-16T01:22:01.102166+0000","last_became_active":"2024-09-16T01:22:00.113038+0000","last_became_peered":"2024-09-16T01:22:00.113038+0000","last_unstale":"2024-09-16T01:22:01.102166+0000","last_undegraded":"2024-09-16T01:22:01.102166+0000","last_fullsized":"2024-09-16T01:22:01.102166+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:15.965936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112796+0000","last_change":"2024-09-16T01:22:01.104836+0000","last_active":"2024-09-16T01:22:02.112796+0000","last_peered":"2024-09-16T01:22:02.112796+0000","last_clean":"2024-09-16T01:22:02.112796+0000","last_became_active":"2024-09-16T01:22:01.104548+0000","last_became_peered":"2024-09-16T01:22:01.104548+0000","last_unstale":"2024-09-16T01:22:02.112796+0000","last_undegraded":"2024-09-16T01:22:02.112796+0000","last_fullsized":"2024-09-16T01:22:02.112796+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:30.170074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112679+0000","last_change":"2024-09-16T01:22:00.102405+0000","last_active":"2024-09-16T01:22:02.112679+0000","last_peered":"2024-09-16T01:22:02.112679+0000","last_clean":"2024-09-16T01:22:02.112679+0000","last_became_active":"2024-09-16T01:22:00.101676+0000","last_became_peered":"2024-09-16T01:22:00.101676+0000","last_unstale":"2024-09-16T01:22:02.112679+0000","last_undegraded":"2024-09-16T01:22:02.112679+0000","last_fullsized":"2024-09-16T01:22:02.112679+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:00.657385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.863801+0000","last_change":"2024-09-16T01:22:01.109913+0000","last_active":"2024-09-16T01:22:02.863801+0000","last_peered":"2024-09-16T01:22:02.863801+0000","last_clean":"2024-09-16T01:22:02.863801+0000","last_became_active":"2024-09-16T01:22:01.109624+0000","last_became_peered":"2024-09-16T01:22:01.109624+0000","last_unstale":"2024-09-16T01:22:02.863801+0000","last_undegraded":"2024-09-16T01:22:02.863801+0000","last_fullsized":"2024-09-16T01:22:02.863801+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:22.513489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"113'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.117267+0000","last_change":"2024-09-16T01:22:00.111750+0000","last_active":"2024-09-16T01:22:02.117267+0000","last_peered":"2024-09-16T01:22:02.117267+0000","last_clean":"2024-09-16T01:22:02.117267+0000","last_became_active":"2024-09-16T01:22:00.111445+0000","last_became_peered":"2024-09-16T01:22:00.111445+0000","last_unstale":"2024-09-16T01:22:02.117267+0000","last_undegraded":"2024-09-16T01:22:02.117267+0000","last_fullsized":"2024-09-16T01:22:02.117267+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:14.715315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.113208+0000","last_change":"2024-09-16T01:22:01.110404+0000","last_active":"2024-09-16T01:22:01.113208+0000","last_peered":"2024-09-16T01:22:01.113208+0000","last_clean":"2024-09-16T01:22:01.113208+0000","last_became_active":"2024-09-16T01:22:01.110026+0000","last_became_peered":"2024-09-16T01:22:01.110026+0000","last_unstale":"2024-09-16T01:22:01.113208+0000","last_undegraded":"2024-09-16T01:22:01.113208+0000","last_fullsized":"2024-09-16T01:22:01.113208+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:38.643115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.109633+0000","last_change":"2024-09-16T01:22:00.107924+0000","last_active":"2024-09-16T01:22:02.109633+0000","last_peered":"2024-09-16T01:22:02.109633+0000","last_clean":"2024-09-16T01:22:02.109633+0000","last_became_active":"2024-09-16T01:22:00.107649+0000","last_became_peered":"2024-09-16T01:22:00.107649+0000","last_unstale":"2024-09-16T01:22:02.109633+0000","last_undegraded":"2024-09-16T01:22:02.109633+0000","last_fullsized":"2024-09-16T01:22:02.109633+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:13.891654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.360525+0000","last_change":"2024-09-16T01:22:01.107350+0000","last_active":"2024-09-16T01:22:02.360525+0000","last_peered":"2024-09-16T01:22:02.360525+0000","last_clean":"2024-09-16T01:22:02.360525+0000","last_became_active":"2024-09-16T01:22:01.107083+0000","last_became_peered":"2024-09-16T01:22:01.107083+0000","last_unstale":"2024-09-16T01:22:02.360525+0000","last_undegraded":"2024-09-16T01:22:02.360525+0000","last_fullsized":"2024-09-16T01:22:02.360525+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:19.214142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112860+0000","last_change":"2024-09-16T01:22:00.108944+0000","last_active":"2024-09-16T01:22:02.112860+0000","last_peered":"2024-09-16T01:22:02.112860+0000","last_clean":"2024-09-16T01:22:02.112860+0000","last_became_active":"2024-09-16T01:22:00.108684+0000","last_became_peered":"2024-09-16T01:22:00.108684+0000","last_unstale":"2024-09-16T01:22:02.112860+0000","last_undegraded":"2024-09-16T01:22:02.112860+0000","last_fullsized":"2024-09-16T01:22:02.112860+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:04.172200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112268+0000","last_change":"2024-09-16T01:22:01.106375+0000","last_active":"2024-09-16T01:22:02.112268+0000","last_peered":"2024-09-16T01:22:02.112268+0000","last_clean":"2024-09-16T01:22:02.112268+0000","last_became_active":"2024-09-16T01:22:01.106118+0000","last_became_peered":"2024-09-16T01:22:01.106118+0000","last_unstale":"2024-09-16T01:22:02.112268+0000","last_undegraded":"2024-09-16T01:22:02.112268+0000","last_fullsized":"2024-09-16T01:22:02.112268+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:31:54.207310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.106103+0000","last_change":"2024-09-16T01:22:00.106396+0000","last_active":"2024-09-16T01:22:01.106103+0000","last_peered":"2024-09-16T01:22:01.106103+0000","last_clean":"2024-09-16T01:22:01.106103+0000","last_became_active":"2024-09-16T01:22:00.106136+0000","last_became_peered":"2024-09-16T01:22:00.106136+0000","last_unstale":"2024-09-16T01:22:01.106103+0000","last_undegraded":"2024-09-16T01:22:01.106103+0000","last_fullsized":"2024-09-16T01:22:01.106103+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:33:35.970029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.125377+0000","last_change":"2024-09-16T01:22:01.119523+0000","last_active":"2024-09-16T01:22:01.125377+0000","last_peered":"2024-09-16T01:22:01.125377+0000","last_clean":"2024-09-16T01:22:01.125377+0000","last_became_active":"2024-09-16T01:22:01.118958+0000","last_became_peered":"2024-09-16T01:22:01.118958+0000","last_unstale":"2024-09-16T01:22:01.125377+0000","last_undegraded":"2024-09-16T01:22:01.125377+0000","last_fullsized":"2024-09-16T01:22:01.125377+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:31.883353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.103723+0000","last_change":"2024-09-16T01:22:00.103530+0000","last_active":"2024-09-16T01:22:01.103723+0000","last_peered":"2024-09-16T01:22:01.103723+0000","last_clean":"2024-09-16T01:22:01.103723+0000","last_became_active":"2024-09-16T01:22:00.103249+0000","last_became_peered":"2024-09-16T01:22:00.103249+0000","last_unstale":"2024-09-16T01:22:01.103723+0000","last_undegraded":"2024-09-16T01:22:01.103723+0000","last_fullsized":"2024-09-16T01:22:01.103723+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:56.977875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.119071+0000","last_change":"2024-09-16T01:22:01.116371+0000","last_active":"2024-09-16T01:22:01.119071+0000","last_peered":"2024-09-16T01:22:01.119071+0000","last_clean":"2024-09-16T01:22:01.119071+0000","last_became_active":"2024-09-16T01:22:01.116068+0000","last_became_peered":"2024-09-16T01:22:01.116068+0000","last_unstale":"2024-09-16T01:22:01.119071+0000","last_undegraded":"2024-09-16T01:22:01.119071+0000","last_fullsized":"2024-09-16T01:22:01.119071+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:24.097967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.112142+0000","last_change":"2024-09-16T01:22:00.108321+0000","last_active":"2024-09-16T01:22:02.112142+0000","last_peered":"2024-09-16T01:22:02.112142+0000","last_clean":"2024-09-16T01:22:02.112142+0000","last_became_active":"2024-09-16T01:22:00.108030+0000","last_became_peered":"2024-09-16T01:22:00.108030+0000","last_unstale":"2024-09-16T01:22:02.112142+0000","last_undegraded":"2024-09-16T01:22:02.112142+0000","last_fullsized":"2024-09-16T01:22:02.112142+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:41.992036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-09-16T01:22:02.863802+0000","last_change":"2024-09-16T01:22:01.111189+0000","last_active":"2024-09-16T01:22:02.863802+0000","last_peered":"2024-09-16T01:22:02.863802+0000","last_clean":"2024-09-16T01:22:02.863802+0000","last_became_active":"2024-09-16T01:22:01.110874+0000","last_became_peered":"2024-09-16T01:22:01.110874+0000","last_unstale":"2024-09-16T01:22:02.863802+0000","last_undegraded":"2024-09-16T01:22:02.863802+0000","last_fullsized":"2024-09-16T01:22:02.863802+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:26.856461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.102203+0000","last_change":"2024-09-16T01:22:00.109989+0000","last_active":"2024-09-16T01:22:01.102203+0000","last_peered":"2024-09-16T01:22:01.102203+0000","last_clean":"2024-09-16T01:22:01.102203+0000","last_became_active":"2024-09-16T01:22:00.109714+0000","last_became_peered":"2024-09-16T01:22:00.109714+0000","last_unstale":"2024-09-16T01:22:01.102203+0000","last_undegraded":"2024-09-16T01:22:01.102203+0000","last_fullsized":"2024-09-16T01:22:01.102203+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:36.970907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.117613+0000","last_change":"2024-09-16T01:22:01.112678+0000","last_active":"2024-09-16T01:22:01.117613+0000","last_peered":"2024-09-16T01:22:01.117613+0000","last_clean":"2024-09-16T01:22:01.117613+0000","last_became_active":"2024-09-16T01:22:01.112431+0000","last_became_peered":"2024-09-16T01:22:01.112431+0000","last_unstale":"2024-09-16T01:22:01.117613+0000","last_undegraded":"2024-09-16T01:22:01.117613+0000","last_fullsized":"2024-09-16T01:22:01.117613+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:00.086003+0000","last_clean_scrub_stamp":"2024-09-16T01:22:00.086003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:22.173848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"112'8","reported_seq":20,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.127654+0000","last_change":"2024-09-16T01:22:00.109839+0000","last_active":"2024-09-16T01:22:01.127654+0000","last_peered":"2024-09-16T01:22:01.127654+0000","last_clean":"2024-09-16T01:22:01.127654+0000","last_became_active":"2024-09-16T01:22:00.109557+0000","last_became_peered":"2024-09-16T01:22:00.109557+0000","last_unstale":"2024-09-16T01:22:01.127654+0000","last_undegraded":"2024-09-16T01:22:01.127654+0000","last_fullsized":"2024-09-16T01:22:01.127654+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:21:59.081388+0000","last_clean_scrub_stamp":"2024-09-16T01:21:59.081388+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:26.689567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":337,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-16T01:22:01.102361+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:22:01.102361+0000","last_peered":"2024-09-16T01:22:01.102361+0000","last_clean":"2024-09-16T01:22:01.102361+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:22:01.102361+0000","last_undegraded":"2024-09-16T01:22:01.102361+0000","last_fullsized":"2024-09-16T01:22:01.102361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33148,"kb_used_data":1960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338692,"statfs":{"total":96636764160,"available":96602820608,"internally_reserved":0,"allocated":2007040,"data_stored":1233022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574931,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":649152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574930,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1417216,"data_stored":648730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1409024,"data_stored":643490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":643524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574931,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1396736,"data_stored":641878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1400832,"data_stored":641900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574930,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33156,"kb_used_data":1960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338684,"statfs":{"total":96636764160,"available":96602812416,"internally_reserved":0,"allocated":2007040,"data_stored":1238960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:22:04.379 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:22:04.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T01:22:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.520+0000 7f0ca2aa6640 1 Processor -- start 2024-09-16T01:22:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.520+0000 7f0ca2aa6640 1 -- start start 2024-09-16T01:22:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.521+0000 7f0ca2aa6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c9c15e410 0x7f0c9c0b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.521+0000 7f0ca2aa6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c9c0ae240 con 0x7f0c9c0b40c0 2024-09-16T01:22:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.521+0000 7f0ca2aa6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c9c0ae520 con 0x7f0c9c06bc10 2024-09-16T01:22:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.521+0000 7f0ca2aa6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0c9c0ae800 con 0x7f0c9c15e410 2024-09-16T01:22:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.521+0000 7f0c93fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0c9c0b40c0 0x7f0c9c0aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60150/0 (socket says 172.21.15.81:60150) 2024-09-16T01:22:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.521+0000 7f0c93fff640 1 -- 172.21.15.81:0/3323139887 learned_addr learned my addr 172.21.15.81:0/3323139887 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.521+0000 7f0ca0842640 1 --2- 172.21.15.81:0/3323139887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c9c15e410 0x7f0c9c0b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.521+0000 7f0c937fe640 1 -- 172.21.15.81:0/3323139887 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456442835 0 0) 0x7f0c9c0ae240 con 0x7f0c9c0b40c0 2024-09-16T01:22:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.521+0000 7f0c937fe640 1 -- 172.21.15.81:0/3323139887 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c84003520 con 0x7f0c9c0b40c0 2024-09-16T01:22:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.521+0000 7f0c937fe640 1 -- 172.21.15.81:0/3323139887 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3794872627 0 0) 0x7f0c9c0ae520 con 0x7f0c9c06bc10 2024-09-16T01:22:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.522+0000 7f0c937fe640 1 -- 172.21.15.81:0/3323139887 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c9c0ae240 con 0x7f0c9c06bc10 2024-09-16T01:22:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.522+0000 7f0ca0842640 1 -- 172.21.15.81:0/3323139887 >> v1:172.21.15.102:6789/0 conn(0x7f0c9c06bc10 legacy=0x7f0c9c0aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.522+0000 7f0c937fe640 1 -- 172.21.15.81:0/3323139887 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3235920406 0 0) 0x7f0c84003520 con 0x7f0c9c0b40c0 2024-09-16T01:22:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.522+0000 7f0ca0842640 1 -- 172.21.15.81:0/3323139887 >> v1:172.21.15.81:6789/0 conn(0x7f0c9c0b40c0 legacy=0x7f0c9c0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.522+0000 7f0ca0842640 1 -- 172.21.15.81:0/3323139887 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c0aeae0 con 0x7f0c9c15e410 2024-09-16T01:22:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.522+0000 7f0ca0842640 1 --2- 172.21.15.81:0/3323139887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c9c15e410 0x7f0c9c0b5fe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c980097d0 tx=0x7f0c9802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=834835f1667c3cde server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.523+0000 7f0c937fe640 1 -- 172.21.15.81:0/3323139887 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c98037070 con 0x7f0c9c15e410 2024-09-16T01:22:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.523+0000 7f0c937fe640 1 -- 172.21.15.81:0/3323139887 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9802ab90 con 0x7f0c9c15e410 2024-09-16T01:22:04.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.523+0000 7f0c937fe640 1 -- 172.21.15.81:0/3323139887 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c001670 con 0x7f0c9c15e410 2024-09-16T01:22:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.523+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3323139887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c9c15e410 msgr2=0x7f0c9c0b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.523+0000 7f0ca2aa6640 1 --2- 172.21.15.81:0/3323139887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c9c15e410 0x7f0c9c0b5fe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c980097d0 tx=0x7f0c9802a100 comp rx=0 tx=0).stop 2024-09-16T01:22:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.523+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3323139887 shutdown_connections 2024-09-16T01:22:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.523+0000 7f0ca2aa6640 1 --2- 172.21.15.81:0/3323139887 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c9c15e410 0x7f0c9c0b5fe0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.523+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3323139887 >> 172.21.15.81:0/3323139887 conn(0x7f0c9c09aa30 msgr2=0x7f0c9c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.523+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3323139887 shutdown_connections 2024-09-16T01:22:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.523+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3323139887 wait complete. 2024-09-16T01:22:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.524+0000 7f0ca2aa6640 1 Processor -- start 2024-09-16T01:22:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.524+0000 7f0ca2aa6640 1 -- start start 2024-09-16T01:22:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.525+0000 7f0ca2aa6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c06bc10 0x7f0c9c0cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.525+0000 7f0ca2aa6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c9c0b40c0 0x7f0c9c156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.525+0000 7f0ca2aa6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9c15e410 0x7f0c9c157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.525+0000 7f0ca2aa6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c15e970 con 0x7f0c9c15e410 2024-09-16T01:22:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.525+0000 7f0ca2aa6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c15e7f0 con 0x7f0c9c06bc10 2024-09-16T01:22:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.525+0000 7f0ca2aa6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0c9c0af6f0 con 0x7f0c9c0b40c0 2024-09-16T01:22:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.525+0000 7f0ca1043640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9c15e410 0x7f0c9c157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.525+0000 7f0ca1043640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9c15e410 0x7f0c9c157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41812/0 (socket says 172.21.15.81:41812) 2024-09-16T01:22:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.525+0000 7f0ca1043640 1 -- 172.21.15.81:0/3010358771 learned_addr learned my addr 172.21.15.81:0/3010358771 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.525+0000 7f0ca0842640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c06bc10 0x7f0c9c0cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.525+0000 7f0c93fff640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c9c0b40c0 0x7f0c9c156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0ca1043640 1 -- 172.21.15.81:0/3010358771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c9c0b40c0 msgr2=0x7f0c9c156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0ca1043640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c9c0b40c0 0x7f0c9c156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0ca1043640 1 -- 172.21.15.81:0/3010358771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c06bc10 msgr2=0x7f0c9c0cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0ca1043640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c06bc10 0x7f0c9c0cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0ca1043640 1 -- 172.21.15.81:0/3010358771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c152ea0 con 0x7f0c9c15e410 2024-09-16T01:22:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0ca0842640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c06bc10 0x7f0c9c0cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0c93fff640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c9c0b40c0 0x7f0c9c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0ca1043640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9c15e410 0x7f0c9c157190 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400c7c0 tx=0x7f0c9400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0c917fa640 1 -- 172.21.15.81:0/3010358771 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c94003b70 con 0x7f0c9c15e410 2024-09-16T01:22:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0c917fa640 1 -- 172.21.15.81:0/3010358771 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c94003d10 con 0x7f0c9c15e410 2024-09-16T01:22:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0c917fa640 1 -- 172.21.15.81:0/3010358771 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9400aa50 con 0x7f0c9c15e410 2024-09-16T01:22:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3010358771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c9c0cb630 con 0x7f0c9c15e410 2024-09-16T01:22:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.526+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3010358771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c9c0cbbf0 con 0x7f0c9c15e410 2024-09-16T01:22:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.527+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3010358771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c9c0afb00 con 0x7f0c9c15e410 2024-09-16T01:22:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.528+0000 7f0c917fa640 1 -- 172.21.15.81:0/3010358771 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0c9400abf0 con 0x7f0c9c15e410 2024-09-16T01:22:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.528+0000 7f0c917fa640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c8806c2b0 0x7f0c8806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.528+0000 7f0ca0842640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c8806c2b0 0x7f0c8806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.528+0000 7f0c917fa640 1 -- 172.21.15.81:0/3010358771 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f0c9408b600 con 0x7f0c9c15e410 2024-09-16T01:22:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.529+0000 7f0ca0842640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c8806c2b0 0x7f0c8806e770 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0c98034000 tx=0x7f0c9802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.532+0000 7f0c917fa640 1 -- 172.21.15.81:0/3010358771 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c94059b50 con 0x7f0c9c15e410 2024-09-16T01:22:04.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.764+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3010358771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0c9c06f300 con 0x7f0c9c15e410 2024-09-16T01:22:04.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.766+0000 7f0c917fa640 1 -- 172.21.15.81:0/3010358771 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f0c94059450 con 0x7f0c9c15e410 2024-09-16T01:22:04.767 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-16T01:22:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg== 2024-09-16T01:22:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-16T01:22:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-16T01:22:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T01:22:04.767 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-16T01:22:04.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.768+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3010358771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c8806c2b0 msgr2=0x7f0c8806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.768+0000 7f0ca2aa6640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c8806c2b0 0x7f0c8806e770 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0c98034000 tx=0x7f0c9802e000 comp rx=0 tx=0).stop 2024-09-16T01:22:04.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.768+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3010358771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9c15e410 msgr2=0x7f0c9c157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.768+0000 7f0ca2aa6640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9c15e410 0x7f0c9c157190 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400c7c0 tx=0x7f0c9400cc80 comp rx=0 tx=0).stop 2024-09-16T01:22:04.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.768+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3010358771 shutdown_connections 2024-09-16T01:22:04.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.768+0000 7f0ca2aa6640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c8806c2b0 0x7f0c8806e770 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.768+0000 7f0ca2aa6640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9c15e410 0x7f0c9c157190 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.768+0000 7f0ca2aa6640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c9c0b40c0 0x7f0c9c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.768+0000 7f0ca2aa6640 1 --2- 172.21.15.81:0/3010358771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c06bc10 0x7f0c9c0cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.768+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3010358771 >> 172.21.15.81:0/3010358771 conn(0x7f0c9c09aa30 msgr2=0x7f0c9c162020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:04.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.768+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3010358771 shutdown_connections 2024-09-16T01:22:04.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.768+0000 7f0ca2aa6640 1 -- 172.21.15.81:0/3010358771 wait complete. 2024-09-16T01:22:04.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.876+0000 7f709b981640 1 Processor -- start 2024-09-16T01:22:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.877+0000 7f709b981640 1 -- start start 2024-09-16T01:22:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.877+0000 7f709b981640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7094162060 0x7f70940b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.877+0000 7f709b981640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f70940b64b0 0x7f70940b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.877+0000 7f709b981640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709406d9f0 con 0x7f7094161c80 2024-09-16T01:22:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.877+0000 7f709b981640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f709406dcd0 con 0x7f70940b64b0 2024-09-16T01:22:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.877+0000 7f709b981640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f709406dfb0 con 0x7f7094162060 2024-09-16T01:22:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.878+0000 7f7098f1c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7094162060 0x7f70940b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.878+0000 7f7099f1e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f70940b64b0 0x7f70940b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.878+0000 7f7099f1e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f70940b64b0 0x7f70940b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:47698/0 (socket says 172.21.15.81:47698) 2024-09-16T01:22:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.878+0000 7f7098f1c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7094162060 0x7f70940b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:33810/0 (socket says 172.21.15.81:33810) 2024-09-16T01:22:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.878+0000 7f7099f1e640 1 -- 172.21.15.81:0/794823467 learned_addr learned my addr 172.21.15.81:0/794823467 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.878+0000 7f7099f1e640 1 -- 172.21.15.81:0/794823467 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7094162060 msgr2=0x7f70940b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.878+0000 7f7099f1e640 1 --2- 172.21.15.81:0/794823467 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7094162060 0x7f70940b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.878+0000 7f7099f1e640 1 -- 172.21.15.81:0/794823467 >> v1:172.21.15.102:6789/0 conn(0x7f7094161c80 legacy=0x7f709406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.878+0000 7f7099f1e640 1 -- 172.21.15.81:0/794823467 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70940d01f0 con 0x7f70940b64b0 2024-09-16T01:22:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.878+0000 7f7098f1c640 1 --2- 172.21.15.81:0/794823467 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7094162060 0x7f70940b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:04.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.879+0000 7f7099f1e640 1 --2- 172.21.15.81:0/794823467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70940b64b0 0x7f70940b6960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f708c009e50 tx=0x7f708c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b18b5fc7a463487 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.879+0000 7f708bfff640 1 -- 172.21.15.81:0/794823467 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c036070 con 0x7f70940b64b0 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.879+0000 7f708bfff640 1 -- 172.21.15.81:0/794823467 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708c031600 con 0x7f70940b64b0 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.879+0000 7f708bfff640 1 -- 172.21.15.81:0/794823467 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c0319d0 con 0x7f70940b64b0 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.879+0000 7f709b981640 1 -- 172.21.15.81:0/794823467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70940b64b0 msgr2=0x7f70940b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.879+0000 7f709b981640 1 --2- 172.21.15.81:0/794823467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70940b64b0 0x7f70940b6960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f708c009e50 tx=0x7f708c02a710 comp rx=0 tx=0).stop 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.880+0000 7f709b981640 1 -- 172.21.15.81:0/794823467 shutdown_connections 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.880+0000 7f709b981640 1 --2- 172.21.15.81:0/794823467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70940b64b0 0x7f70940b6960 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.880+0000 7f709b981640 1 --2- 172.21.15.81:0/794823467 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7094162060 0x7f70940b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.880+0000 7f709b981640 1 -- 172.21.15.81:0/794823467 >> 172.21.15.81:0/794823467 conn(0x7f70940d44f0 msgr2=0x7f70940d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.880+0000 7f709b981640 1 -- 172.21.15.81:0/794823467 shutdown_connections 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.880+0000 7f709b981640 1 -- 172.21.15.81:0/794823467 wait complete. 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.881+0000 7f709b981640 1 Processor -- start 2024-09-16T01:22:04.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.881+0000 7f709b981640 1 -- start start 2024-09-16T01:22:04.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f709b981640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70940b64b0 0x7f70941584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f709b981640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7094161c80 0x7f70940b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f709b981640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7094162060 0x7f7094158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f709b981640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70940cf1e0 con 0x7f7094161c80 2024-09-16T01:22:04.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f709b981640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f70940d2aa0 con 0x7f70940b64b0 2024-09-16T01:22:04.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f709b981640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f70940cf360 con 0x7f7094162060 2024-09-16T01:22:04.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7098f1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7094161c80 0x7f70940b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7098f1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7094161c80 0x7f70940b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41814/0 (socket says 172.21.15.81:41814) 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7098f1c640 1 -- 172.21.15.81:0/2775051071 learned_addr learned my addr 172.21.15.81:0/2775051071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7099f1e640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7094162060 0x7f7094158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f709971d640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70940b64b0 0x7f70941584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7098f1c640 1 -- 172.21.15.81:0/2775051071 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7094162060 msgr2=0x7f7094158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7098f1c640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7094162060 0x7f7094158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7098f1c640 1 -- 172.21.15.81:0/2775051071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70940b64b0 msgr2=0x7f70941584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7098f1c640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70940b64b0 0x7f70941584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7098f1c640 1 -- 172.21.15.81:0/2775051071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70940cc020 con 0x7f7094161c80 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7098f1c640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7094161c80 0x7f70940b4270 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f708400e910 tx=0x7f708400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7089ffb640 1 -- 172.21.15.81:0/2775051071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084017070 con 0x7f7094161c80 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7089ffb640 1 -- 172.21.15.81:0/2775051071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f708400ca00 con 0x7f7094161c80 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f7089ffb640 1 -- 172.21.15.81:0/2775051071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708400cdd0 con 0x7f7094161c80 2024-09-16T01:22:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.882+0000 7f709b981640 1 -- 172.21.15.81:0/2775051071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70940cc300 con 0x7f7094161c80 2024-09-16T01:22:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.883+0000 7f709b981640 1 -- 172.21.15.81:0/2775051071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70940cc8c0 con 0x7f7094161c80 2024-09-16T01:22:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.884+0000 7f709b981640 1 -- 172.21.15.81:0/2775051071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7094160c00 con 0x7f7094161c80 2024-09-16T01:22:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.884+0000 7f7089ffb640 1 -- 172.21.15.81:0/2775051071 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f708401a070 con 0x7f7094161c80 2024-09-16T01:22:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.884+0000 7f7089ffb640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f707806c2e0 0x7f707806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.885+0000 7f7089ffb640 1 -- 172.21.15.81:0/2775051071 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f708408b760 con 0x7f7094161c80 2024-09-16T01:22:04.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.885+0000 7f709971d640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f707806c2e0 0x7f707806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:04.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.885+0000 7f709971d640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f707806c2e0 0x7f707806e7a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7090001640 tx=0x7f7090009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:04.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:04.889+0000 7f7089ffb640 1 -- 172.21.15.81:0/2775051071 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7084059d50 con 0x7f7094161c80 2024-09-16T01:22:05.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.088+0000 7f709b981640 1 -- 172.21.15.81:0/2775051071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70940b5a10 con 0x7f7094161c80 2024-09-16T01:22:05.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.089+0000 7f7089ffb640 1 -- 172.21.15.81:0/2775051071 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5228 (secure 0 0 0) 0x7f7084059650 con 0x7f7094161c80 2024-09-16T01:22:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:05.090 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"btime":"2024-09-16T01:22:03:106587+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2485445274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2485445274},{"type":"v1","addr":"172.21.15.81:6835","nonce":2485445274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1320169323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1320169323},{"type":"v1","addr":"172.21.15.81:6837","nonce":1320169323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2539150967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2539150967},{"type":"v1","addr":"172.21.15.102:6834","nonce":2539150967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:00.439163+0000","modified":"2024-09-16T01:22:02.433729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6835/415655488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":415655488},{"type":"v1","addr":"172.21.15.102:6835","nonce":415655488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7266,"qdb_cluster":[7266]},"id":8}]} 2024-09-16T01:22:05.090 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 58 2024-09-16T01:22:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.091+0000 7f709b981640 1 -- 172.21.15.81:0/2775051071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f707806c2e0 msgr2=0x7f707806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.091+0000 7f709b981640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f707806c2e0 0x7f707806e7a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7090001640 tx=0x7f7090009040 comp rx=0 tx=0).stop 2024-09-16T01:22:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.091+0000 7f709b981640 1 -- 172.21.15.81:0/2775051071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7094161c80 msgr2=0x7f70940b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.091+0000 7f709b981640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7094161c80 0x7f70940b4270 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f708400e910 tx=0x7f708400edd0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.091+0000 7f709b981640 1 -- 172.21.15.81:0/2775051071 shutdown_connections 2024-09-16T01:22:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.091+0000 7f709b981640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f707806c2e0 0x7f707806e7a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.091+0000 7f709b981640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7094162060 0x7f7094158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.091+0000 7f709b981640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7094161c80 0x7f70940b4270 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.091+0000 7f709b981640 1 --2- 172.21.15.81:0/2775051071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70940b64b0 0x7f70941584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.091+0000 7f709b981640 1 -- 172.21.15.81:0/2775051071 >> 172.21.15.81:0/2775051071 conn(0x7f70940d44f0 msgr2=0x7f70940d3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.091+0000 7f709b981640 1 -- 172.21.15.81:0/2775051071 shutdown_connections 2024-09-16T01:22:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.091+0000 7f709b981640 1 -- 172.21.15.81:0/2775051071 wait complete. 2024-09-16T01:22:05.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:22:00.439163+0000', 'modified': '2024-09-16T01:22:02.433729+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7266': {'gid': 7266, 'name': 'b', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.102:6835/415655488', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.102:6833', 'nonce': 415655488}, {'type': 'v1', 'addr': '172.21.15.102:6835', 'nonce': 415655488}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7266, 'qdb_cluster': [7266]} 2024-09-16T01:22:05.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:22:05.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-16T01:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.608+0000 7f9ff22d2640 1 Processor -- start 2024-09-16T01:22:05.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.608+0000 7f9ff22d2640 1 -- start start 2024-09-16T01:22:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.609+0000 7f9ff22d2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fec072940 0x7f9fec072da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.609+0000 7f9ff22d2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fec0b3570 con 0x7f9fec0b4880 2024-09-16T01:22:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.609+0000 7f9ff22d2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fec0b3850 con 0x7f9fec15ba30 2024-09-16T01:22:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.609+0000 7f9ff22d2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9fec0732e0 con 0x7f9fec072940 2024-09-16T01:22:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.609+0000 7f9fe3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fec072940 0x7f9fec072da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.609+0000 7f9ff086f640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9fec0b4880 0x7f9fec0b4d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60166/0 (socket says 172.21.15.81:60166) 2024-09-16T01:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.609+0000 7f9ff086f640 1 -- 172.21.15.81:0/1489827884 learned_addr learned my addr 172.21.15.81:0/1489827884 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.609+0000 7f9fe3fff640 1 -- 172.21.15.81:0/1489827884 >> v1:172.21.15.102:6789/0 conn(0x7f9fec15ba30 legacy=0x7f9fec06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.609+0000 7f9fe3fff640 1 -- 172.21.15.81:0/1489827884 >> v1:172.21.15.81:6789/0 conn(0x7f9fec0b4880 legacy=0x7f9fec0b4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.609+0000 7f9fe3fff640 1 -- 172.21.15.81:0/1489827884 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec0b3b30 con 0x7f9fec072940 2024-09-16T01:22:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.609+0000 7f9feb7fe640 1 -- 172.21.15.81:0/1489827884 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037500016 0 0) 0x7f9fec0b3570 con 0x7f9fec0b4880 2024-09-16T01:22:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.610+0000 7f9fe3fff640 1 --2- 172.21.15.81:0/1489827884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec072940 0x7f9fec072da0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400a940 tx=0x7f9fd402b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1459e4d662164008 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.610+0000 7f9feb7fe640 1 -- 172.21.15.81:0/1489827884 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd400b040 con 0x7f9fec072940 2024-09-16T01:22:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.610+0000 7f9feb7fe640 1 -- 172.21.15.81:0/1489827884 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd4030710 con 0x7f9fec072940 2024-09-16T01:22:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.610+0000 7f9feb7fe640 1 -- 172.21.15.81:0/1489827884 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4030ae0 con 0x7f9fec072940 2024-09-16T01:22:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.611+0000 7f9ff22d2640 1 -- 172.21.15.81:0/1489827884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec072940 msgr2=0x7f9fec072da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.611+0000 7f9ff22d2640 1 --2- 172.21.15.81:0/1489827884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec072940 0x7f9fec072da0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400a940 tx=0x7f9fd402b5a0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.611+0000 7f9ff22d2640 1 -- 172.21.15.81:0/1489827884 shutdown_connections 2024-09-16T01:22:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.611+0000 7f9ff22d2640 1 --2- 172.21.15.81:0/1489827884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec072940 0x7f9fec072da0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.611+0000 7f9ff22d2640 1 -- 172.21.15.81:0/1489827884 >> 172.21.15.81:0/1489827884 conn(0x7f9fec067d70 msgr2=0x7f9fec06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.611+0000 7f9ff22d2640 1 -- 172.21.15.81:0/1489827884 shutdown_connections 2024-09-16T01:22:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.611+0000 7f9ff22d2640 1 -- 172.21.15.81:0/1489827884 wait complete. 2024-09-16T01:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.612+0000 7f9ff22d2640 1 Processor -- start 2024-09-16T01:22:05.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.612+0000 7f9ff22d2640 1 -- start start 2024-09-16T01:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9ff22d2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fec072940 0x7f9fec155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9ff22d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec0b4880 0x7f9fec1f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9ff22d2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fec15ba30 0x7f9fec0ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9ff22d2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec06ff20 con 0x7f9fec0b4880 2024-09-16T01:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9ff22d2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec0b4180 con 0x7f9fec072940 2024-09-16T01:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9ff22d2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9fec0ce810 con 0x7f9fec15ba30 2024-09-16T01:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9fe3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec0b4880 0x7f9fec1f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9fe3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec0b4880 0x7f9fec1f3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41834/0 (socket says 172.21.15.81:41834) 2024-09-16T01:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9fe3fff640 1 -- 172.21.15.81:0/2963518837 learned_addr learned my addr 172.21.15.81:0/2963518837 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9febfff640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fec072940 0x7f9fec155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9ff086f640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fec15ba30 0x7f9fec0ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9fe3fff640 1 -- 172.21.15.81:0/2963518837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fec15ba30 msgr2=0x7f9fec0ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9fe3fff640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fec15ba30 0x7f9fec0ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9fe3fff640 1 -- 172.21.15.81:0/2963518837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fec072940 msgr2=0x7f9fec155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9fe3fff640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fec072940 0x7f9fec155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9fe3fff640 1 -- 172.21.15.81:0/2963518837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec1555b0 con 0x7f9fec0b4880 2024-09-16T01:22:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9ff086f640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fec15ba30 0x7f9fec0ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9fe3fff640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec0b4880 0x7f9fec1f3020 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400a940 tx=0x7f9fd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.613+0000 7f9fe97fa640 1 -- 172.21.15.81:0/2963518837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4040070 con 0x7f9fec0b4880 2024-09-16T01:22:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.614+0000 7f9fe97fa640 1 -- 172.21.15.81:0/2963518837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd4033d50 con 0x7f9fec0b4880 2024-09-16T01:22:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.614+0000 7f9ff22d2640 1 -- 172.21.15.81:0/2963518837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fec155a70 con 0x7f9fec0b4880 2024-09-16T01:22:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.614+0000 7f9fe97fa640 1 -- 172.21.15.81:0/2963518837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4006e10 con 0x7f9fec0b4880 2024-09-16T01:22:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.614+0000 7f9ff22d2640 1 -- 172.21.15.81:0/2963518837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fec156030 con 0x7f9fec0b4880 2024-09-16T01:22:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.615+0000 7f9fe97fa640 1 -- 172.21.15.81:0/2963518837 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9fd4043070 con 0x7f9fec0b4880 2024-09-16T01:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.615+0000 7f9fe97fa640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9fcc06c2b0 0x7f9fcc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.615+0000 7f9fe97fa640 1 -- 172.21.15.81:0/2963518837 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f9fd40ac3c0 con 0x7f9fec0b4880 2024-09-16T01:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.616+0000 7f9febfff640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9fcc06c2b0 0x7f9fcc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.616+0000 7f9febfff640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9fcc06c2b0 0x7f9fcc06e770 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc006fd0 tx=0x7f9fdc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.616+0000 7f9ff5063740 1 Processor -- start 2024-09-16T01:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.616+0000 7f9ff5063740 1 -- start start 2024-09-16T01:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9ff5063740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c7346ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9ff5063740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c73426a80 0x563c734296a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9ff5063740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7342aa50 0x563c734238b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9ff5063740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c7338b520 con 0x563c734292c0 2024-09-16T01:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9ff5063740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563c733333e0 con 0x563c73426a80 2024-09-16T01:22:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9ff5063740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x563c733874e0 con 0x563c7342aa50 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9febfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c7346ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9febfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c7346ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41844/0 (socket says 172.21.15.81:41844) 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9febfff640 1 -- 172.21.15.81:0/750197190 learned_addr learned my addr 172.21.15.81:0/750197190 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9fe3fff640 1 --2- 172.21.15.81:0/750197190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c73426a80 0x563c734296a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9ff086f640 1 --2- 172.21.15.81:0/750197190 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7342aa50 0x563c734238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9febfff640 1 -- 172.21.15.81:0/750197190 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7342aa50 msgr2=0x563c734238b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9febfff640 1 --2- 172.21.15.81:0/750197190 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7342aa50 0x563c734238b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9febfff640 1 -- 172.21.15.81:0/750197190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c73426a80 msgr2=0x563c734296a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9febfff640 1 --2- 172.21.15.81:0/750197190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c73426a80 0x563c734296a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.617+0000 7f9febfff640 1 -- 172.21.15.81:0/750197190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7334e2f0 con 0x563c734292c0 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9febfff640 1 --2- 172.21.15.81:0/750197190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c7346ea60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00d910 tx=0x7f9fdc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ca2d0f5981b1f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9fe1ffb640 1 -- 172.21.15.81:0/750197190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc01a040 con 0x563c734292c0 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9fe1ffb640 1 -- 172.21.15.81:0/750197190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fdc023070 con 0x563c734292c0 2024-09-16T01:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9fe1ffb640 1 -- 172.21.15.81:0/750197190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc014bb0 con 0x563c734292c0 2024-09-16T01:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9ff5063740 1 -- 172.21.15.81:0/750197190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 msgr2=0x563c7346ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9ff5063740 1 --2- 172.21.15.81:0/750197190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c7346ea60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00d910 tx=0x7f9fdc010000 comp rx=0 tx=0).stop 2024-09-16T01:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9ff5063740 1 -- 172.21.15.81:0/750197190 shutdown_connections 2024-09-16T01:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9ff5063740 1 --2- 172.21.15.81:0/750197190 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7342aa50 0x563c734238b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9ff5063740 1 --2- 172.21.15.81:0/750197190 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c73426a80 0x563c734296a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9ff5063740 1 --2- 172.21.15.81:0/750197190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c7346ea60 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9ff5063740 1 -- 172.21.15.81:0/750197190 >> 172.21.15.81:0/750197190 conn(0x563c73425a80 msgr2=0x563c7346df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9ff5063740 1 -- 172.21.15.81:0/750197190 shutdown_connections 2024-09-16T01:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.618+0000 7f9ff5063740 1 -- 172.21.15.81:0/750197190 wait complete. 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.619+0000 7f9ff5063740 1 -- start start 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.619+0000 7f9ff5063740 1 Processor -- start 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9ff5063740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c73469980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9ff5063740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7342aa50 0x563c73469ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9ff5063740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7344e4b0 0x563c7346a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9ff5063740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c73424f20 con 0x563c734292c0 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9ff5063740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563c73314450 con 0x563c7344e4b0 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9ff5063740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x563c7346f290 con 0x563c7342aa50 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9ff5063740 10 client.0 _ll_register_callbacks cb 0x563c7309dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9febfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c73469980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9febfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c73469980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41848/0 (socket says 172.21.15.81:41848) 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9febfff640 1 -- 172.21.15.81:0/1512157563 learned_addr learned my addr 172.21.15.81:0/1512157563 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9fe3fff640 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7342aa50 0x563c73469ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9ff086f640 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7344e4b0 0x563c7346a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9febfff640 1 -- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7342aa50 msgr2=0x563c73469ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9febfff640 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7342aa50 0x563c73469ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9febfff640 1 -- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7344e4b0 msgr2=0x563c7346a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9febfff640 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7344e4b0 0x563c7346a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9febfff640 1 -- 172.21.15.81:0/1512157563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c7309e2d0 con 0x563c734292c0 2024-09-16T01:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9ff086f640 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7344e4b0 0x563c7346a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9febfff640 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c73469980 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc014d10 tx=0x7f9fdc004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a679b2d865b6ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.620+0000 7f9fcaffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1512157563 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc004250 con 0x563c734292c0 2024-09-16T01:22:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1512157563 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f9fdc0043f0 con 0x563c734292c0 2024-09-16T01:22:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9ff5063740 1 -- 172.21.15.81:0/1512157563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fdc023070 con 0x563c734292c0 2024-09-16T01:22:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1512157563 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f9fdc037050 con 0x563c734292c0 2024-09-16T01:22:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9ff5063740 10 client.7389 fetch_fsmap learned FSMap version 58 2024-09-16T01:22:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9ff5063740 1 -- 172.21.15.81:0/1512157563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) -- 0x563c731686b0 con 0x563c734292c0 2024-09-16T01:22:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1512157563 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fdc023070 con 0x563c734292c0 2024-09-16T01:22:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1512157563 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 58) ==== 3502+0+0 (secure 0 0 0) 0x7f9fdc03a020 con 0x563c734292c0 2024-09-16T01:22:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9ff5063740 10 client.7389 fetch_fsmap finished waiting for FSMap version 58 2024-09-16T01:22:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9ff5063740 10 client.7389 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9ff5063740 20 client.7389 populate_metadata read hostname 'smithi081' 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9ff5063740 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:6833/415655488,v1:172.21.15.102:6835/415655488] conn(0x563c73489920 0x563c7348bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9ff5063740 4 client.7389 mds_command: new command op to 7266 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9ff5063740 1 -- 172.21.15.81:0/1512157563 --> [v2:172.21.15.102:6833/415655488,v1:172.21.15.102:6835/415655488] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c73398c50 con 0x563c73489920 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.621+0000 7f9fe3fff640 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:6833/415655488,v1:172.21.15.102:6835/415655488] conn(0x563c73489920 0x563c7348bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.622+0000 7f9fcaffd640 10 client.7389 ms_handle_connect on v2:172.21.15.102:6833/415655488 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.622+0000 7f9fe3fff640 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:6833/415655488,v1:172.21.15.102:6835/415655488] conn(0x563c73489920 0x563c7348bd10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54726d2ef6f3f9ce server_cookie=3e49d9c9cbcea62 in_seq=0 out_seq=0 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9fcaffd640 1 -- 172.21.15.81:0/1512157563 <== mds.0 v2:172.21.15.102:6833/415655488 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c73398c50 con 0x563c73489920 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9fcaffd640 10 client.7389 handle_command_reply: tid=0 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9ff5063740 1 client.7389 shutdown 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9ff5063740 1 -- 172.21.15.81:0/1512157563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 msgr2=0x563c73469980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9ff5063740 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c73469980 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc014d10 tx=0x7f9fdc004680 comp rx=0 tx=0).stop 2024-09-16T01:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9ff5063740 1 -- 172.21.15.81:0/1512157563 shutdown_connections 2024-09-16T01:22:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9ff5063740 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:6833/415655488,v1:172.21.15.102:6835/415655488] conn(0x563c73489920 0x563c7348bd10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9ff5063740 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7344e4b0 0x563c7346a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9ff5063740 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7342aa50 0x563c73469ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9fcaffd640 0 client.7389 ms_handle_reset on v2:172.21.15.102:6833/415655488 2024-09-16T01:22:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9ff5063740 1 --2- 172.21.15.81:0/1512157563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c73469980 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9ff5063740 1 -- 172.21.15.81:0/1512157563 >> 172.21.15.81:0/1512157563 conn(0x563c73426a80 msgr2=0x563c7346bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9ff5063740 1 -- 172.21.15.81:0/1512157563 shutdown_connections 2024-09-16T01:22:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9ff5063740 1 -- 172.21.15.81:0/1512157563 wait complete. 2024-09-16T01:22:05.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.623+0000 7f9ff5063740 20 client.7389 trim_cache size 0 max 16384 2024-09-16T01:22:05.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.641+0000 7f9ff5063740 1 Processor -- start 2024-09-16T01:22:05.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.641+0000 7f9ff5063740 1 -- start start 2024-09-16T01:22:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9ff5063740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c7346bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9ff5063740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7342aa50 0x563c734685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9ff5063740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7344e4b0 0x563c73468b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9ff5063740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1feec0 con 0x563c734292c0 2024-09-16T01:22:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9ff5063740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1fdf10 con 0x563c7342aa50 2024-09-16T01:22:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9ff5063740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9fec1f5f80 con 0x563c7344e4b0 2024-09-16T01:22:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9febfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c7346bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9febfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c7346bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41854/0 (socket says 172.21.15.81:41854) 2024-09-16T01:22:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9febfff640 1 -- 172.21.15.81:0/2338739855 learned_addr learned my addr 172.21.15.81:0/2338739855 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:05.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9febfff640 1 -- 172.21.15.81:0/2338739855 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7344e4b0 msgr2=0x563c73468b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9febfff640 1 --2- 172.21.15.81:0/2338739855 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7344e4b0 0x563c73468b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9febfff640 1 -- 172.21.15.81:0/2338739855 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7342aa50 msgr2=0x563c734685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9febfff640 1 --2- 172.21.15.81:0/2338739855 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7342aa50 0x563c734685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9febfff640 1 -- 172.21.15.81:0/2338739855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c7346c4c0 con 0x563c734292c0 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9febfff640 1 --2- 172.21.15.81:0/2338739855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c7346bf80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00d8e0 tx=0x7f9fdc028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871a08595fd0167 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9fe17fa640 1 -- 172.21.15.81:0/2338739855 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc005910 con 0x563c734292c0 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9fe17fa640 1 -- 172.21.15.81:0/2338739855 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fdc023070 con 0x563c734292c0 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.642+0000 7f9fe17fa640 1 -- 172.21.15.81:0/2338739855 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc014270 con 0x563c734292c0 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.643+0000 7f9ff5063740 1 -- 172.21.15.81:0/2338739855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 msgr2=0x563c7346bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.643+0000 7f9ff5063740 1 --2- 172.21.15.81:0/2338739855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c7346bf80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00d8e0 tx=0x7f9fdc028000 comp rx=0 tx=0).stop 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.643+0000 7f9ff5063740 1 -- 172.21.15.81:0/2338739855 shutdown_connections 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.643+0000 7f9ff5063740 1 --2- 172.21.15.81:0/2338739855 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7344e4b0 0x563c73468b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.643+0000 7f9ff5063740 1 --2- 172.21.15.81:0/2338739855 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7342aa50 0x563c734685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.643+0000 7f9ff5063740 1 --2- 172.21.15.81:0/2338739855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c7346bf80 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.643+0000 7f9ff5063740 1 -- 172.21.15.81:0/2338739855 >> 172.21.15.81:0/2338739855 conn(0x563c73426a80 msgr2=0x563c7346ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.643+0000 7f9ff5063740 1 -- 172.21.15.81:0/2338739855 shutdown_connections 2024-09-16T01:22:05.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.643+0000 7f9ff5063740 1 -- 172.21.15.81:0/2338739855 wait complete. 2024-09-16T01:22:05.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.643+0000 7f9ff5063740 1 -- start start 2024-09-16T01:22:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.644+0000 7f9ff5063740 1 Processor -- start 2024-09-16T01:22:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.644+0000 7f9ff5063740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c73472860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.644+0000 7f9ff5063740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7342aa50 0x563c734efc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.644+0000 7f9ff5063740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7344e4b0 0x563c734d1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.644+0000 7f9ff5063740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563c73451f90 con 0x563c734292c0 2024-09-16T01:22:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.644+0000 7f9ff5063740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec1fd8f0 con 0x563c7342aa50 2024-09-16T01:22:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.644+0000 7f9ff5063740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x563c73453560 con 0x563c7344e4b0 2024-09-16T01:22:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.644+0000 7f9ff5063740 10 client.0 _ll_register_callbacks cb 0x7f9fdc00d7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:22:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.644+0000 7f9febfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c73472860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.644+0000 7f9febfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c73472860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41856/0 (socket says 172.21.15.81:41856) 2024-09-16T01:22:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.644+0000 7f9febfff640 1 -- 172.21.15.81:0/335930118 learned_addr learned my addr 172.21.15.81:0/335930118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9febfff640 1 -- 172.21.15.81:0/335930118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7344e4b0 msgr2=0x563c734d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9febfff640 1 --2- 172.21.15.81:0/335930118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7344e4b0 0x563c734d1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9febfff640 1 -- 172.21.15.81:0/335930118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7342aa50 msgr2=0x563c734efc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9febfff640 1 --2- 172.21.15.81:0/335930118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7342aa50 0x563c734efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9febfff640 1 -- 172.21.15.81:0/335930118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c73472da0 con 0x563c734292c0 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9febfff640 1 --2- 172.21.15.81:0/335930118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c73472860 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc014d10 tx=0x7f9fdc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4874d38d3a079ead server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9fcaffd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9fcaffd640 1 -- 172.21.15.81:0/335930118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc004230 con 0x563c734292c0 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9fcaffd640 1 -- 172.21.15.81:0/335930118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f9fdc0043d0 con 0x563c734292c0 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9ff5063740 1 -- 172.21.15.81:0/335930118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fdc023070 con 0x563c734292c0 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9fcaffd640 1 -- 172.21.15.81:0/335930118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7f9fdc04b050 con 0x563c734292c0 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9ff5063740 10 client.7395 fetch_fsmap learned FSMap version 58 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9ff5063740 1 -- 172.21.15.81:0/335930118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) -- 0x563c734f0170 con 0x563c734292c0 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9fcaffd640 1 -- 172.21.15.81:0/335930118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fdc023070 con 0x563c734292c0 2024-09-16T01:22:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9fcaffd640 1 -- 172.21.15.81:0/335930118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 58) ==== 3502+0+0 (secure 0 0 0) 0x7f9fdc04e020 con 0x563c734292c0 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9ff5063740 10 client.7395 fetch_fsmap finished waiting for FSMap version 58 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9ff5063740 10 client.7395 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9ff5063740 20 client.7395 populate_metadata read hostname 'smithi081' 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9ff5063740 1 --2- 172.21.15.81:0/335930118 >> [v2:172.21.15.102:6833/415655488,v1:172.21.15.102:6835/415655488] conn(0x563c7346af70 0x563c7346d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9ff5063740 4 client.7395 mds_command: new command op to 7266 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.645+0000 7f9ff5063740 1 -- 172.21.15.81:0/335930118 --> [v2:172.21.15.102:6833/415655488,v1:172.21.15.102:6835/415655488] -- command(tid 0: {"prefix": "status"}) -- 0x563c73392fa0 con 0x563c7346af70 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9fe3fff640 1 --2- 172.21.15.81:0/335930118 >> [v2:172.21.15.102:6833/415655488,v1:172.21.15.102:6835/415655488] conn(0x563c7346af70 0x563c7346d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9fcaffd640 10 client.7395 ms_handle_connect on v2:172.21.15.102:6833/415655488 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9fe3fff640 1 --2- 172.21.15.81:0/335930118 >> [v2:172.21.15.102:6833/415655488,v1:172.21.15.102:6835/415655488] conn(0x563c7346af70 0x563c7346d540 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64317a0c47c31a7c server_cookie=34db226469f21811 in_seq=0 out_seq=0 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9fcaffd640 1 -- 172.21.15.81:0/335930118 <== mds.0 v2:172.21.15.102:6833/415655488 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x563c73392fa0 con 0x563c7346af70 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9fcaffd640 10 client.7395 handle_command_reply: tid=0 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9ff5063740 1 client.7395 shutdown 2024-09-16T01:22:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9ff5063740 1 -- 172.21.15.81:0/335930118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 msgr2=0x563c73472860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9ff5063740 1 --2- 172.21.15.81:0/335930118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c73472860 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc014d10 tx=0x7f9fdc014000 comp rx=0 tx=0).stop 2024-09-16T01:22:05.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9ff5063740 1 -- 172.21.15.81:0/335930118 shutdown_connections 2024-09-16T01:22:05.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9ff5063740 1 --2- 172.21.15.81:0/335930118 >> [v2:172.21.15.102:6833/415655488,v1:172.21.15.102:6835/415655488] conn(0x563c7346af70 0x563c7346d540 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9ff5063740 1 --2- 172.21.15.81:0/335930118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x563c7344e4b0 0x563c734d1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9fcaffd640 0 client.7395 ms_handle_reset on v2:172.21.15.102:6833/415655488 2024-09-16T01:22:05.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9ff5063740 1 --2- 172.21.15.81:0/335930118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c7342aa50 0x563c734efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9ff5063740 1 --2- 172.21.15.81:0/335930118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c734292c0 0x563c73472860 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.646+0000 7f9ff5063740 1 -- 172.21.15.81:0/335930118 >> 172.21.15.81:0/335930118 conn(0x563c73426a80 msgr2=0x563c73452110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff5063740 1 -- 172.21.15.81:0/335930118 shutdown_connections 2024-09-16T01:22:05.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff5063740 1 -- 172.21.15.81:0/335930118 wait complete. 2024-09-16T01:22:05.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff5063740 20 client.7395 trim_cache size 0 max 16384 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973", 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7266, 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.5429046509999997, 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 58, 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 113, 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 113, 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 8.6073113939999999 2024-09-16T01:22:05.654 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:22:05.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff22d2640 1 -- 172.21.15.81:0/2963518837 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9fcc06c2b0 msgr2=0x7f9fcc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff22d2640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9fcc06c2b0 0x7f9fcc06e770 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc006fd0 tx=0x7f9fdc008040 comp rx=0 tx=0).stop 2024-09-16T01:22:05.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff22d2640 1 -- 172.21.15.81:0/2963518837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec0b4880 msgr2=0x7f9fec1f3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff22d2640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec0b4880 0x7f9fec1f3020 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9fd400a940 tx=0x7f9fd4004730 comp rx=0 tx=0).stop 2024-09-16T01:22:05.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff22d2640 1 -- 172.21.15.81:0/2963518837 shutdown_connections 2024-09-16T01:22:05.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff22d2640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9fcc06c2b0 0x7f9fcc06e770 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff22d2640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fec15ba30 0x7f9fec0ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff22d2640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fec0b4880 0x7f9fec1f3020 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff22d2640 1 --2- 172.21.15.81:0/2963518837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fec072940 0x7f9fec155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff22d2640 1 -- 172.21.15.81:0/2963518837 >> 172.21.15.81:0/2963518837 conn(0x7f9fec067d70 msgr2=0x7f9fec06f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff22d2640 1 -- 172.21.15.81:0/2963518837 shutdown_connections 2024-09-16T01:22:05.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.647+0000 7f9ff22d2640 1 -- 172.21.15.81:0/2963518837 wait complete. 2024-09-16T01:22:05.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:22:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.756+0000 7f0da60ba640 1 Processor -- start 2024-09-16T01:22:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.756+0000 7f0da60ba640 1 -- start start 2024-09-16T01:22:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.756+0000 7f0da60ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da015ba30 0x7f0da006f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.756+0000 7f0da60ba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0da006fd50 0x7f0da0072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.756+0000 7f0da60ba640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da00b3570 con 0x7f0da0072e80 2024-09-16T01:22:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.757+0000 7f0da60ba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0da00b4180 con 0x7f0da006fd50 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.757+0000 7f0da60ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0da00b3850 con 0x7f0da015ba30 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.757+0000 7f0d9effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0da006fd50 0x7f0da0072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.757+0000 7f0d9effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0da006fd50 0x7f0da0072940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41870/0 (socket says 172.21.15.81:41870) 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.757+0000 7f0d9effd640 1 -- 172.21.15.81:0/4096017947 learned_addr learned my addr 172.21.15.81:0/4096017947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.757+0000 7f0d9f7fe640 1 --2- 172.21.15.81:0/4096017947 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da015ba30 0x7f0da006f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.757+0000 7f0d9effd640 1 -- 172.21.15.81:0/4096017947 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da015ba30 msgr2=0x7f0da006f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.757+0000 7f0d9effd640 1 --2- 172.21.15.81:0/4096017947 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da015ba30 0x7f0da006f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.757+0000 7f0d9effd640 1 -- 172.21.15.81:0/4096017947 >> v1:172.21.15.102:6789/0 conn(0x7f0da0072e80 legacy=0x7f0da006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.757+0000 7f0d9effd640 1 -- 172.21.15.81:0/4096017947 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da00b3b30 con 0x7f0da006fd50 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.758+0000 7f0d9effd640 1 --2- 172.21.15.81:0/4096017947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da006fd50 0x7f0da0072940 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009870 tx=0x7f0d9402b380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d9255a1ce592ca server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.758+0000 7f0d9e7fc640 1 -- 172.21.15.81:0/4096017947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94038070 con 0x7f0da006fd50 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.758+0000 7f0d9e7fc640 1 -- 172.21.15.81:0/4096017947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d94033640 con 0x7f0da006fd50 2024-09-16T01:22:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.758+0000 7f0d9e7fc640 1 -- 172.21.15.81:0/4096017947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94033a10 con 0x7f0da006fd50 2024-09-16T01:22:05.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.758+0000 7f0da60ba640 1 -- 172.21.15.81:0/4096017947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da006fd50 msgr2=0x7f0da0072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.758+0000 7f0da60ba640 1 --2- 172.21.15.81:0/4096017947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da006fd50 0x7f0da0072940 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009870 tx=0x7f0d9402b380 comp rx=0 tx=0).stop 2024-09-16T01:22:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.758+0000 7f0da60ba640 1 -- 172.21.15.81:0/4096017947 shutdown_connections 2024-09-16T01:22:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.758+0000 7f0da60ba640 1 --2- 172.21.15.81:0/4096017947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da006fd50 0x7f0da0072940 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.758+0000 7f0da60ba640 1 --2- 172.21.15.81:0/4096017947 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da015ba30 0x7f0da006f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.758+0000 7f0da60ba640 1 -- 172.21.15.81:0/4096017947 >> 172.21.15.81:0/4096017947 conn(0x7f0da0067d70 msgr2=0x7f0da006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.758+0000 7f0da60ba640 1 -- 172.21.15.81:0/4096017947 shutdown_connections 2024-09-16T01:22:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.758+0000 7f0da60ba640 1 -- 172.21.15.81:0/4096017947 wait complete. 2024-09-16T01:22:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.759+0000 7f0da60ba640 1 Processor -- start 2024-09-16T01:22:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.760+0000 7f0da60ba640 1 -- start start 2024-09-16T01:22:05.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.760+0000 7f0da60ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da006fd50 0x7f0da014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.760+0000 7f0da60ba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0da0072e80 0x7f0da01f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.760+0000 7f0da60ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da015ba30 0x7f0da00b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.760+0000 7f0da60ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0da00b5890 con 0x7f0da006fd50 2024-09-16T01:22:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.760+0000 7f0da60ba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0da00ce810 con 0x7f0da0072e80 2024-09-16T01:22:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.760+0000 7f0da60ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0da00b5a10 con 0x7f0da015ba30 2024-09-16T01:22:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.760+0000 7f0d9f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da006fd50 0x7f0da014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d9f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da006fd50 0x7f0da014e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41876/0 (socket says 172.21.15.81:41876) 2024-09-16T01:22:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d9f7fe640 1 -- 172.21.15.81:0/628692088 learned_addr learned my addr 172.21.15.81:0/628692088 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d9ffff640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da015ba30 0x7f0da00b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d9effd640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0da0072e80 0x7f0da01f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d9f7fe640 1 -- 172.21.15.81:0/628692088 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da015ba30 msgr2=0x7f0da00b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d9f7fe640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da015ba30 0x7f0da00b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d9f7fe640 1 -- 172.21.15.81:0/628692088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0da0072e80 msgr2=0x7f0da01f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d9f7fe640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0da0072e80 0x7f0da01f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d9f7fe640 1 -- 172.21.15.81:0/628692088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da01f12b0 con 0x7f0da006fd50 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d9ffff640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da015ba30 0x7f0da00b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d9effd640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0da0072e80 0x7f0da01f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d9f7fe640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da006fd50 0x7f0da014e9a0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000f9c0 tx=0x7f0d9000fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d87fff640 1 -- 172.21.15.81:0/628692088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90007c30 con 0x7f0da006fd50 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d87fff640 1 -- 172.21.15.81:0/628692088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d90007dd0 con 0x7f0da006fd50 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0d87fff640 1 -- 172.21.15.81:0/628692088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d90011690 con 0x7f0da006fd50 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0da60ba640 1 -- 172.21.15.81:0/628692088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da01535a0 con 0x7f0da006fd50 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.761+0000 7f0da60ba640 1 -- 172.21.15.81:0/628692088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da014f510 con 0x7f0da006fd50 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.762+0000 7f0da60ba640 1 -- 172.21.15.81:0/628692088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da00ccfe0 con 0x7f0da006fd50 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.763+0000 7f0d87fff640 1 -- 172.21.15.81:0/628692088 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0d90019020 con 0x7f0da006fd50 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.763+0000 7f0d87fff640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d8c06c2e0 0x7f0d8c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.763+0000 7f0d87fff640 1 -- 172.21.15.81:0/628692088 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f0d9008d7c0 con 0x7f0da006fd50 2024-09-16T01:22:05.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.763+0000 7f0d9effd640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d8c06c2e0 0x7f0d8c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:05.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.763+0000 7f0d9effd640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d8c06c2e0 0x7f0d8c06e7a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0d94035000 tx=0x7f0d9402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:05.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.767+0000 7f0d87fff640 1 -- 172.21.15.81:0/628692088 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d9005bda0 con 0x7f0da006fd50 2024-09-16T01:22:05.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.966+0000 7f0da60ba640 1 -- 172.21.15.81:0/628692088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0da00cf0f0 con 0x7f0da006fd50 2024-09-16T01:22:05.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.966+0000 7f0d87fff640 1 -- 172.21.15.81:0/628692088 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) ==== 53+0+73 (secure 0 0 0) 0x7f0d9005b6a0 con 0x7f0da006fd50 2024-09-16T01:22:05.967 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:22:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.968+0000 7f0da60ba640 1 -- 172.21.15.81:0/628692088 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d8c06c2e0 msgr2=0x7f0d8c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.968+0000 7f0da60ba640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d8c06c2e0 0x7f0d8c06e7a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0d94035000 tx=0x7f0d9402f000 comp rx=0 tx=0).stop 2024-09-16T01:22:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.968+0000 7f0da60ba640 1 -- 172.21.15.81:0/628692088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da006fd50 msgr2=0x7f0da014e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.968+0000 7f0da60ba640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da006fd50 0x7f0da014e9a0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000f9c0 tx=0x7f0d9000fe80 comp rx=0 tx=0).stop 2024-09-16T01:22:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.968+0000 7f0da60ba640 1 -- 172.21.15.81:0/628692088 shutdown_connections 2024-09-16T01:22:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.968+0000 7f0da60ba640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d8c06c2e0 0x7f0d8c06e7a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.968+0000 7f0da60ba640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da015ba30 0x7f0da00b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.968+0000 7f0da60ba640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0da0072e80 0x7f0da01f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.968+0000 7f0da60ba640 1 --2- 172.21.15.81:0/628692088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da006fd50 0x7f0da014e9a0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.968+0000 7f0da60ba640 1 -- 172.21.15.81:0/628692088 >> 172.21.15.81:0/628692088 conn(0x7f0da0067d70 msgr2=0x7f0da00cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.968+0000 7f0da60ba640 1 -- 172.21.15.81:0/628692088 shutdown_connections 2024-09-16T01:22:05.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:05.968+0000 7f0da60ba640 1 -- 172.21.15.81:0/628692088 wait complete. 2024-09-16T01:22:05.979 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:22:05.979 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:22:05.979 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:22:05.980 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:22:05.980 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:22:05.980 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:22:05.980 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:22:05.980 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:22:05.980 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:22:05.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:05.980 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:22:05.997 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:22:05.997 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:22:05.997 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:22:05.997 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:05.997 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:22:05.997 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:05.997 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42412sec preferred_lft 42412sec 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:22:05.998 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::bc22:19ff:fe0c:8fb1/64 scope link 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 86:bb:d8:38:80:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::84bb:d8ff:fe38:80af/64 scope link 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::828:dff:febd:ee39/64 scope link 2024-09-16T01:22:05.999 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:06.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:06.000 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:22:06.061 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:22:06.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:06.063 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:22:06.119 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:22:06.120 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:22:06.120 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:22:06.120 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:22:06.120 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:22:06.120 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:22:06.120 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:22:06.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:22:06.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:22:06.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:22:06.121 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:22:06.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:22:06.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:22:06.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:06.246 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:22:06.261 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:22:06.261 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:22:06.261 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:22:06.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:06.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-16T01:22:06.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:22:06.327 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:22:06.382 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:22:06.382 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:22:06.382 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:22:06.437 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:22:06.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:06.438 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:22:06.520 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:22:06.520 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:22:06.520 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:22:06.529 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:22:06.529 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:22:06.529 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:22:06.529 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:22:06.529 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:22:06.547 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:22:06.547 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:22:06.547 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:22:06.547 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:22:06.548 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:22:06.548 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:22:06.548 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:22:06.548 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:22:06.550 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:22:06.550 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:22:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:22:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:22:06.551 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:22:06.551 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:22:06.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:06.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:22:06.615 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:22:06.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:22:06.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:22:06.720 INFO:teuthology.orchestra.run.smithi081.stdout:client6526 2024-09-16T01:22:06.721 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:22:06.721 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:06.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:22:06.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.873+0000 7f669acba640 1 Processor -- start 2024-09-16T01:22:06.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.874+0000 7f669acba640 1 -- start start 2024-09-16T01:22:06.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.874+0000 7f669acba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6694161c80 0x7f669406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:06.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.874+0000 7f669acba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66940b6680 0x7f66940cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:06.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.874+0000 7f669acba640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669406e870 con 0x7f6694162060 2024-09-16T01:22:06.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.874+0000 7f669acba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f669406d9f0 con 0x7f6694161c80 2024-09-16T01:22:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.874+0000 7f669acba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f669406dcd0 con 0x7f66940b6680 2024-09-16T01:22:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.874+0000 7f6698a56640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6694161c80 0x7f669406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.875+0000 7f6698a56640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6694161c80 0x7f669406e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41878/0 (socket says 172.21.15.81:41878) 2024-09-16T01:22:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.875+0000 7f6698a56640 1 -- 172.21.15.81:0/2915990429 learned_addr learned my addr 172.21.15.81:0/2915990429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.875+0000 7f6698a56640 1 -- 172.21.15.81:0/2915990429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66940b6680 msgr2=0x7f66940cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.875+0000 7f6699257640 1 --2- 172.21.15.81:0/2915990429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66940b6680 0x7f66940cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.875+0000 7f6698a56640 1 --2- 172.21.15.81:0/2915990429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66940b6680 0x7f66940cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.875+0000 7f6698a56640 1 -- 172.21.15.81:0/2915990429 >> v1:172.21.15.102:6789/0 conn(0x7f6694162060 legacy=0x7f66940b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.875+0000 7f6698a56640 1 -- 172.21.15.81:0/2915990429 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669406dfb0 con 0x7f6694161c80 2024-09-16T01:22:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.875+0000 7f6699257640 1 --2- 172.21.15.81:0/2915990429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66940b6680 0x7f66940cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.876+0000 7f6698a56640 1 --2- 172.21.15.81:0/2915990429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6694161c80 0x7f669406e330 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f6684009870 tx=0x7f668402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7e4fb5df4e9215 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.876+0000 7f66937fe640 1 -- 172.21.15.81:0/2915990429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684037070 con 0x7f6694161c80 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.876+0000 7f66937fe640 1 -- 172.21.15.81:0/2915990429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6684032440 con 0x7f6694161c80 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.876+0000 7f66937fe640 1 -- 172.21.15.81:0/2915990429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684032810 con 0x7f6694161c80 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.876+0000 7f669acba640 1 -- 172.21.15.81:0/2915990429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6694161c80 msgr2=0x7f669406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.876+0000 7f669acba640 1 --2- 172.21.15.81:0/2915990429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6694161c80 0x7f669406e330 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f6684009870 tx=0x7f668402a210 comp rx=0 tx=0).stop 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.876+0000 7f669acba640 1 -- 172.21.15.81:0/2915990429 shutdown_connections 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.876+0000 7f669acba640 1 --2- 172.21.15.81:0/2915990429 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f66940b6680 0x7f66940cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.876+0000 7f669acba640 1 --2- 172.21.15.81:0/2915990429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6694161c80 0x7f669406e330 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.876+0000 7f669acba640 1 -- 172.21.15.81:0/2915990429 >> 172.21.15.81:0/2915990429 conn(0x7f66940d44f0 msgr2=0x7f66940d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.876+0000 7f669acba640 1 -- 172.21.15.81:0/2915990429 shutdown_connections 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.876+0000 7f669acba640 1 -- 172.21.15.81:0/2915990429 wait complete. 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.877+0000 7f669acba640 1 Processor -- start 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.878+0000 7f669acba640 1 -- start start 2024-09-16T01:22:06.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.878+0000 7f669acba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66940b6680 0x7f66940b8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.878+0000 7f669acba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6694161c80 0x7f6694155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.878+0000 7f669acba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6694162060 0x7f66940cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.878+0000 7f669acba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66940b6cb0 con 0x7f6694161c80 2024-09-16T01:22:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.878+0000 7f669acba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f66940b6b30 con 0x7f66940b6680 2024-09-16T01:22:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.878+0000 7f669acba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f66940cf720 con 0x7f6694162060 2024-09-16T01:22:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.878+0000 7f6693fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6694161c80 0x7f6694155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.878+0000 7f6693fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6694161c80 0x7f6694155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41890/0 (socket says 172.21.15.81:41890) 2024-09-16T01:22:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f6693fff640 1 -- 172.21.15.81:0/2337635228 learned_addr learned my addr 172.21.15.81:0/2337635228 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f6699257640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6694162060 0x7f66940cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f6698a56640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66940b6680 0x7f66940b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f6693fff640 1 -- 172.21.15.81:0/2337635228 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6694162060 msgr2=0x7f66940cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f6693fff640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6694162060 0x7f66940cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f6693fff640 1 -- 172.21.15.81:0/2337635228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66940b6680 msgr2=0x7f66940b8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f6693fff640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66940b6680 0x7f66940b8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f6693fff640 1 -- 172.21.15.81:0/2337635228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66940ccaa0 con 0x7f6694161c80 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f6698a56640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66940b6680 0x7f66940b8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f6693fff640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6694161c80 0x7f6694155a80 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f668800b3c0 tx=0x7f668800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f66917fa640 1 -- 172.21.15.81:0/2337635228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688011830 con 0x7f6694161c80 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f66917fa640 1 -- 172.21.15.81:0/2337635228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6688016070 con 0x7f6694161c80 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f66917fa640 1 -- 172.21.15.81:0/2337635228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6688011c50 con 0x7f6694161c80 2024-09-16T01:22:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f669acba640 1 -- 172.21.15.81:0/2337635228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66940ccd80 con 0x7f6694161c80 2024-09-16T01:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.879+0000 7f669acba640 1 -- 172.21.15.81:0/2337635228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66940cd340 con 0x7f6694161c80 2024-09-16T01:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.880+0000 7f669acba640 1 -- 172.21.15.81:0/2337635228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66940ba470 con 0x7f6694161c80 2024-09-16T01:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.881+0000 7f66917fa640 1 -- 172.21.15.81:0/2337635228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f668801b460 con 0x7f6694161c80 2024-09-16T01:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.881+0000 7f66917fa640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f668006c2e0 0x7f668006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.881+0000 7f66917fa640 1 -- 172.21.15.81:0/2337635228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f668808aeb0 con 0x7f6694161c80 2024-09-16T01:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.881+0000 7f6698a56640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f668006c2e0 0x7f668006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.881+0000 7f6698a56640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f668006c2e0 0x7f668006e7a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6684034000 tx=0x7f668402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:06.885+0000 7f66917fa640 1 -- 172.21.15.81:0/2337635228 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6688020020 con 0x7f6694161c80 2024-09-16T01:22:07.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.087+0000 7f669acba640 1 -- 172.21.15.81:0/2337635228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f66940b6000 con 0x7f6694161c80 2024-09-16T01:22:07.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.087+0000 7f66917fa640 1 -- 172.21.15.81:0/2337635228 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) ==== 53+0+73 (secure 0 0 0) 0x7f6688059520 con 0x7f6694161c80 2024-09-16T01:22:07.088 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:22:07.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.089+0000 7f669acba640 1 -- 172.21.15.81:0/2337635228 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f668006c2e0 msgr2=0x7f668006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:07.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.089+0000 7f669acba640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f668006c2e0 0x7f668006e7a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6684034000 tx=0x7f668402e000 comp rx=0 tx=0).stop 2024-09-16T01:22:07.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.089+0000 7f669acba640 1 -- 172.21.15.81:0/2337635228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6694161c80 msgr2=0x7f6694155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.089+0000 7f669acba640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6694161c80 0x7f6694155a80 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f668800b3c0 tx=0x7f668800b880 comp rx=0 tx=0).stop 2024-09-16T01:22:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.089+0000 7f669acba640 1 -- 172.21.15.81:0/2337635228 shutdown_connections 2024-09-16T01:22:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.089+0000 7f669acba640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f668006c2e0 0x7f668006e7a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.089+0000 7f669acba640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6694162060 0x7f66940cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.089+0000 7f669acba640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6694161c80 0x7f6694155a80 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.089+0000 7f669acba640 1 --2- 172.21.15.81:0/2337635228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f66940b6680 0x7f66940b8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.089+0000 7f669acba640 1 -- 172.21.15.81:0/2337635228 >> 172.21.15.81:0/2337635228 conn(0x7f66940d44f0 msgr2=0x7f66940b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.089+0000 7f669acba640 1 -- 172.21.15.81:0/2337635228 shutdown_connections 2024-09-16T01:22:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.089+0000 7f669acba640 1 -- 172.21.15.81:0/2337635228 wait complete. 2024-09-16T01:22:07.101 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:22:07.101 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:22:07.101 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-16T01:22:07.101 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T01:22:07.101 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:22:07.101 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:22:07.102 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:22:07.102 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:22:07.102 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:22:07.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:07.102 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-16T01:22:07.122 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:22:07.123 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:22:07.123 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:22:07.123 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:07.123 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:22:07.123 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:07.123 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:22:07.124 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:07.124 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-16T01:22:07.124 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:22:07.124 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:07.124 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-16T01:22:07.124 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:22:07.124 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:07.125 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:22:07.125 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:07.125 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:22:07.125 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42413sec preferred_lft 42413sec 2024-09-16T01:22:07.125 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-16T01:22:07.125 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:07.125 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:22:07.125 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:07.125 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:22:07.125 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:07.125 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::fc48:18ff:fedc:b80f/64 scope link 2024-09-16T01:22:07.125 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:07.126 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:22:07.126 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 2e:4a:65:c9:20:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:22:07.126 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::2c4a:65ff:fec9:204f/64 scope link 2024-09-16T01:22:07.126 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:07.126 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:22:07.126 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:22:07.126 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::1072:70ff:fefd:f9f1/64 scope link 2024-09-16T01:22:07.126 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:07.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:07.127 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:22:07.191 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:22:07.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:07.193 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-16T01:22:07.253 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-16T01:22:07.253 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:22:07.253 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:22:07.254 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:22:07.254 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:22:07.254 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:22:07.254 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:22:07.254 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:22:07.254 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:22:07.254 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:22:07.254 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:22:07.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:22:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:22:07.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:22:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:22:07.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:07.399 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:22:07.418 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T01:22:07.418 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:22:07.418 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:22:07.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:07.418 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-16T01:22:07.488 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:22:07.488 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T01:22:07.547 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:22:07.547 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:22:07.547 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:22:07.605 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:22:07.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:07.638 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:22:07.696 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:22:07.696 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:22:07.696 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:22:07.705 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:22:07.706 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:22:07.706 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:22:07.706 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:22:07.706 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:22:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:22:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:22:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:22:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:22:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:22:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:22:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:22:07.711 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:22:07.712 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T01:22:07.712 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:22:07.712 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:22:07.712 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:22:07.712 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:22:07.713 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:22:07.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:07.714 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:22:07.746 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:22:07.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:22:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:22:07.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:22:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:22:07.844 INFO:teuthology.orchestra.run.smithi102.stdout:client6532 2024-09-16T01:22:07.845 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:22:07.845 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:07.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-09-16T01:22:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.974+0000 7efeb685e640 1 Processor -- start 2024-09-16T01:22:07.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.974+0000 7efeb685e640 1 -- start start 2024-09-16T01:22:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeb685e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efeb009b140 0x7efeb00700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeb685e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efeb00b14d0 0x7efeb0070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeb685e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb0072180 con 0x7efeb015c490 2024-09-16T01:22:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeb685e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7efeb015c870 con 0x7efeb009b140 2024-09-16T01:22:07.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeb685e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efeb0071bc0 con 0x7efeb00b14d0 2024-09-16T01:22:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeaf7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efeb009b140 0x7efeb00700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeaffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efeb015c490 0x7efeb009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60172/0 (socket says 172.21.15.81:60172) 2024-09-16T01:22:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeaf7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efeb009b140 0x7efeb00700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41900/0 (socket says 172.21.15.81:41900) 2024-09-16T01:22:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeaffff640 1 -- 172.21.15.81:0/4187270058 learned_addr learned my addr 172.21.15.81:0/4187270058 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeb4dfb640 1 --2- 172.21.15.81:0/4187270058 >> v2:172.21.15.102:3300/0 conn(0x7efeb00b14d0 0x7efeb0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:07.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeaf7fe640 1 -- 172.21.15.81:0/4187270058 >> v2:172.21.15.102:3300/0 conn(0x7efeb00b14d0 msgr2=0x7efeb0070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeaf7fe640 1 --2- 172.21.15.81:0/4187270058 >> v2:172.21.15.102:3300/0 conn(0x7efeb00b14d0 0x7efeb0070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeaf7fe640 1 -- 172.21.15.81:0/4187270058 >> v1:172.21.15.81:6789/0 conn(0x7efeb015c490 legacy=0x7efeb009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeaf7fe640 1 -- 172.21.15.81:0/4187270058 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb0071ea0 con 0x7efeb009b140 2024-09-16T01:22:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.975+0000 7efeaeffd640 1 -- 172.21.15.81:0/4187270058 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1821075362 0 0) 0x7efeb0072180 con 0x7efeb015c490 2024-09-16T01:22:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.976+0000 7efeaf7fe640 1 --2- 172.21.15.81:0/4187270058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb009b140 0x7efeb00700f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7efeb009b5f0 tx=0x7efea402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81646033c440fd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.976+0000 7efeaeffd640 1 -- 172.21.15.81:0/4187270058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4037070 con 0x7efeb009b140 2024-09-16T01:22:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.976+0000 7efeaeffd640 1 -- 172.21.15.81:0/4187270058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea4032440 con 0x7efeb009b140 2024-09-16T01:22:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.976+0000 7efeaeffd640 1 -- 172.21.15.81:0/4187270058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4032810 con 0x7efeb009b140 2024-09-16T01:22:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.977+0000 7efeb685e640 1 -- 172.21.15.81:0/4187270058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb009b140 msgr2=0x7efeb00700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.977+0000 7efeb685e640 1 --2- 172.21.15.81:0/4187270058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb009b140 0x7efeb00700f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7efeb009b5f0 tx=0x7efea402a1a0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.977+0000 7efeb685e640 1 -- 172.21.15.81:0/4187270058 shutdown_connections 2024-09-16T01:22:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.977+0000 7efeb685e640 1 --2- 172.21.15.81:0/4187270058 >> v2:172.21.15.102:3300/0 conn(0x7efeb00b14d0 0x7efeb0070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.977+0000 7efeb685e640 1 --2- 172.21.15.81:0/4187270058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb009b140 0x7efeb00700f0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.977+0000 7efeb685e640 1 -- 172.21.15.81:0/4187270058 >> 172.21.15.81:0/4187270058 conn(0x7efeb00b3f30 msgr2=0x7efeb00b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:07.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.977+0000 7efeb685e640 1 -- 172.21.15.81:0/4187270058 shutdown_connections 2024-09-16T01:22:07.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.977+0000 7efeb685e640 1 -- 172.21.15.81:0/4187270058 wait complete. 2024-09-16T01:22:07.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.978+0000 7efeb685e640 1 Processor -- start 2024-09-16T01:22:07.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.978+0000 7efeb685e640 1 -- start start 2024-09-16T01:22:07.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeb685e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efeb009b140 0x7efeb01f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:07.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeb685e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb00b14d0 0x7efeb01456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:07.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeb685e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efeb015c490 0x7efeb0151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:07.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeb685e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efeb009b8f0 con 0x7efeb00b14d0 2024-09-16T01:22:07.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeb685e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efeb00affa0 con 0x7efeb009b140 2024-09-16T01:22:07.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeb685e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efeb0070b70 con 0x7efeb015c490 2024-09-16T01:22:07.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeaf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb00b14d0 0x7efeb01456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:07.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeaf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb00b14d0 0x7efeb01456f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41914/0 (socket says 172.21.15.81:41914) 2024-09-16T01:22:07.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeaf7fe640 1 -- 172.21.15.81:0/435982813 learned_addr learned my addr 172.21.15.81:0/435982813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:07.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeaffff640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efeb009b140 0x7efeb01f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:07.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeb4dfb640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efeb015c490 0x7efeb0151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:07.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeaf7fe640 1 -- 172.21.15.81:0/435982813 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efeb015c490 msgr2=0x7efeb0151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:07.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeaf7fe640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efeb015c490 0x7efeb0151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeaf7fe640 1 -- 172.21.15.81:0/435982813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efeb009b140 msgr2=0x7efeb01f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:07.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeaf7fe640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efeb009b140 0x7efeb01f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:07.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.979+0000 7efeaf7fe640 1 -- 172.21.15.81:0/435982813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb01537b0 con 0x7efeb00b14d0 2024-09-16T01:22:07.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.980+0000 7efeaf7fe640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb00b14d0 0x7efeb01456f0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7efea4000c00 tx=0x7efea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:07.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.980+0000 7efeacff9640 1 -- 172.21.15.81:0/435982813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4037040 con 0x7efeb00b14d0 2024-09-16T01:22:07.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.980+0000 7efeacff9640 1 -- 172.21.15.81:0/435982813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea4042070 con 0x7efeb00b14d0 2024-09-16T01:22:07.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.980+0000 7efeb685e640 1 -- 172.21.15.81:0/435982813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb0153a90 con 0x7efeb00b14d0 2024-09-16T01:22:07.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.980+0000 7efeacff9640 1 -- 172.21.15.81:0/435982813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea4030a50 con 0x7efeb00b14d0 2024-09-16T01:22:07.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.980+0000 7efeb685e640 1 -- 172.21.15.81:0/435982813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb014ec30 con 0x7efeb00b14d0 2024-09-16T01:22:07.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.981+0000 7efeb685e640 1 -- 172.21.15.81:0/435982813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb009aa30 con 0x7efeb00b14d0 2024-09-16T01:22:07.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.981+0000 7efeacff9640 1 -- 172.21.15.81:0/435982813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efea4030bf0 con 0x7efeb00b14d0 2024-09-16T01:22:07.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.982+0000 7efeacff9640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efe9c06c2b0 0x7efe9c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:07.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.982+0000 7efeacff9640 1 -- 172.21.15.81:0/435982813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7efea40abe60 con 0x7efeb00b14d0 2024-09-16T01:22:07.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.982+0000 7efeaffff640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efe9c06c2b0 0x7efe9c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:07.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.982+0000 7efeaffff640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efe9c06c2b0 0x7efe9c06e770 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efea0007fd0 tx=0x7efea0007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:07.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:07.986+0000 7efeacff9640 1 -- 172.21.15.81:0/435982813 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efea4079e80 con 0x7efeb00b14d0 2024-09-16T01:22:08.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.154+0000 7efeb685e640 1 -- 172.21.15.81:0/435982813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7efeb00b5880 con 0x7efeb00b14d0 2024-09-16T01:22:08.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.157+0000 7efeacff9640 1 -- 172.21.15.81:0/435982813 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v37)=0 v37) ==== 121+0+0 (secure 0 0 0) 0x7efea407e180 con 0x7efeb00b14d0 2024-09-16T01:22:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.160+0000 7efeb685e640 1 -- 172.21.15.81:0/435982813 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efe9c06c2b0 msgr2=0x7efe9c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.160+0000 7efeb685e640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efe9c06c2b0 0x7efe9c06e770 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7efea0007fd0 tx=0x7efea0007de0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.160+0000 7efeb685e640 1 -- 172.21.15.81:0/435982813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb00b14d0 msgr2=0x7efeb01456f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.160+0000 7efeb685e640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb00b14d0 0x7efeb01456f0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7efea4000c00 tx=0x7efea40046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.160+0000 7efeb685e640 1 -- 172.21.15.81:0/435982813 shutdown_connections 2024-09-16T01:22:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.160+0000 7efeb685e640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efe9c06c2b0 0x7efe9c06e770 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.160+0000 7efeb685e640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efeb015c490 0x7efeb0151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.160+0000 7efeb685e640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb00b14d0 0x7efeb01456f0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.160+0000 7efeb685e640 1 --2- 172.21.15.81:0/435982813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efeb009b140 0x7efeb01f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.160+0000 7efeb685e640 1 -- 172.21.15.81:0/435982813 >> 172.21.15.81:0/435982813 conn(0x7efeb00b3f30 msgr2=0x7efeb00b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:08.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.160+0000 7efeb685e640 1 -- 172.21.15.81:0/435982813 shutdown_connections 2024-09-16T01:22:08.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.160+0000 7efeb685e640 1 -- 172.21.15.81:0/435982813 wait complete. 2024-09-16T01:22:08.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 400 2024-09-16T01:22:08.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.272+0000 7f61c3352640 1 Processor -- start 2024-09-16T01:22:08.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.273+0000 7f61c3352640 1 -- start start 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.273+0000 7f61c3352640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61bc15b570 0x7f61bc071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.273+0000 7f61c3352640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61bc073b20 con 0x7f61bc0cd120 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.273+0000 7f61c3352640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61bc073e00 con 0x7f61bc15b950 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.273+0000 7f61c3352640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f61bc0740e0 con 0x7f61bc15b570 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.274+0000 7f61c10ee640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61bc15b570 0x7f61bc071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.274+0000 7f61c18ef640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f61bc0cd120 0x7f61bc15e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60182/0 (socket says 172.21.15.81:60182) 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.274+0000 7f61c10ee640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61bc15b570 0x7f61bc071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41926/0 (socket says 172.21.15.81:41926) 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.274+0000 7f61c18ef640 1 -- 172.21.15.81:0/2917579254 learned_addr learned my addr 172.21.15.81:0/2917579254 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.274+0000 7f61c10ee640 1 -- 172.21.15.81:0/2917579254 >> v1:172.21.15.102:6789/0 conn(0x7f61bc15b950 legacy=0x7f61bc0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.274+0000 7f61c10ee640 1 -- 172.21.15.81:0/2917579254 >> v1:172.21.15.81:6789/0 conn(0x7f61bc0cd120 legacy=0x7f61bc15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.274+0000 7f61c10ee640 1 -- 172.21.15.81:0/2917579254 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc0cf320 con 0x7f61bc15b570 2024-09-16T01:22:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.274+0000 7f61affff640 1 -- 172.21.15.81:0/2917579254 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1901572217 0 0) 0x7f61bc073b20 con 0x7f61bc0cd120 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.275+0000 7f61c10ee640 1 --2- 172.21.15.81:0/2917579254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61bc15b570 0x7f61bc071e40 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f61b00097a0 tx=0x7f61b002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2023549fde84b8de server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.275+0000 7f61affff640 1 -- 172.21.15.81:0/2917579254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0037070 con 0x7f61bc15b570 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.275+0000 7f61affff640 1 -- 172.21.15.81:0/2917579254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b0032440 con 0x7f61bc15b570 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.275+0000 7f61affff640 1 -- 172.21.15.81:0/2917579254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0032810 con 0x7f61bc15b570 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.275+0000 7f61c3352640 1 -- 172.21.15.81:0/2917579254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61bc15b570 msgr2=0x7f61bc071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.275+0000 7f61c3352640 1 --2- 172.21.15.81:0/2917579254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61bc15b570 0x7f61bc071e40 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f61b00097a0 tx=0x7f61b002a1a0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.275+0000 7f61c3352640 1 -- 172.21.15.81:0/2917579254 shutdown_connections 2024-09-16T01:22:08.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.275+0000 7f61c3352640 1 --2- 172.21.15.81:0/2917579254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61bc15b570 0x7f61bc071e40 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.275+0000 7f61c3352640 1 -- 172.21.15.81:0/2917579254 >> 172.21.15.81:0/2917579254 conn(0x7f61bc06bdf0 msgr2=0x7f61bc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.275+0000 7f61c3352640 1 -- 172.21.15.81:0/2917579254 shutdown_connections 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.275+0000 7f61c3352640 1 -- 172.21.15.81:0/2917579254 wait complete. 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.276+0000 7f61c3352640 1 Processor -- start 2024-09-16T01:22:08.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.277+0000 7f61c3352640 1 -- start start 2024-09-16T01:22:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.277+0000 7f61c3352640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61bc0cd120 0x7f61bc149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.277+0000 7f61c3352640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61bc15b570 0x7f61bc149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.277+0000 7f61c3352640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61bc15b950 0x7f61bc157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.277+0000 7f61c3352640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc0cf840 con 0x7f61bc0cd120 2024-09-16T01:22:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.277+0000 7f61c3352640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc072450 con 0x7f61bc15b570 2024-09-16T01:22:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.277+0000 7f61c3352640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f61bc0cf9c0 con 0x7f61bc15b950 2024-09-16T01:22:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.277+0000 7f61c10ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61bc0cd120 0x7f61bc149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.277+0000 7f61c10ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61bc0cd120 0x7f61bc149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41934/0 (socket says 172.21.15.81:41934) 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.277+0000 7f61c10ee640 1 -- 172.21.15.81:0/2188507235 learned_addr learned my addr 172.21.15.81:0/2188507235 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.277+0000 7f61c18ef640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61bc15b950 0x7f61bc157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.277+0000 7f61c08ed640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61bc15b570 0x7f61bc149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.278+0000 7f61c10ee640 1 -- 172.21.15.81:0/2188507235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61bc15b950 msgr2=0x7f61bc157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.278+0000 7f61c10ee640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61bc15b950 0x7f61bc157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.278+0000 7f61c10ee640 1 -- 172.21.15.81:0/2188507235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61bc15b570 msgr2=0x7f61bc149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.278+0000 7f61c10ee640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61bc15b570 0x7f61bc149cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.278+0000 7f61c10ee640 1 -- 172.21.15.81:0/2188507235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc0ad300 con 0x7f61bc0cd120 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.278+0000 7f61c18ef640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61bc15b950 0x7f61bc157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.278+0000 7f61c10ee640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61bc0cd120 0x7f61bc149780 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f61b0035040 tx=0x7f61b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.278+0000 7f61adffb640 1 -- 172.21.15.81:0/2188507235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0037040 con 0x7f61bc0cd120 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.278+0000 7f61adffb640 1 -- 172.21.15.81:0/2188507235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b0004230 con 0x7f61bc0cd120 2024-09-16T01:22:08.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.278+0000 7f61adffb640 1 -- 172.21.15.81:0/2188507235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0032e40 con 0x7f61bc0cd120 2024-09-16T01:22:08.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.278+0000 7f61c3352640 1 -- 172.21.15.81:0/2188507235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61bc0ad020 con 0x7f61bc0cd120 2024-09-16T01:22:08.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.278+0000 7f61c3352640 1 -- 172.21.15.81:0/2188507235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61bc158d70 con 0x7f61bc0cd120 2024-09-16T01:22:08.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.279+0000 7f61c3352640 1 -- 172.21.15.81:0/2188507235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61bc071e40 con 0x7f61bc0cd120 2024-09-16T01:22:08.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.280+0000 7f61adffb640 1 -- 172.21.15.81:0/2188507235 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f61b00306f0 con 0x7f61bc0cd120 2024-09-16T01:22:08.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.280+0000 7f61adffb640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61a006c2b0 0x7f61a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.280+0000 7f61adffb640 1 -- 172.21.15.81:0/2188507235 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f61b00ac8f0 con 0x7f61bc0cd120 2024-09-16T01:22:08.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.280+0000 7f61c08ed640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61a006c2b0 0x7f61a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.280+0000 7f61c08ed640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61a006c2b0 0x7f61a006e770 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f61bc15da20 tx=0x7f61b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:08.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.284+0000 7f61adffb640 1 -- 172.21.15.81:0/2188507235 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61b007aed0 con 0x7f61bc0cd120 2024-09-16T01:22:08.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.451+0000 7f61c3352640 1 -- 172.21.15.81:0/2188507235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7f61bc14a200 con 0x7f61bc0cd120 2024-09-16T01:22:08.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.454+0000 7f61adffb640 1 -- 172.21.15.81:0/2188507235 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v38)=0 v38) ==== 119+0+0 (secure 0 0 0) 0x7f61b007a7d0 con 0x7f61bc0cd120 2024-09-16T01:22:08.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.457+0000 7f61c3352640 1 -- 172.21.15.81:0/2188507235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61a006c2b0 msgr2=0x7f61a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.457+0000 7f61c3352640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61a006c2b0 0x7f61a006e770 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f61bc15da20 tx=0x7f61b8009040 comp rx=0 tx=0).stop 2024-09-16T01:22:08.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.457+0000 7f61c3352640 1 -- 172.21.15.81:0/2188507235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61bc0cd120 msgr2=0x7f61bc149780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.457+0000 7f61c3352640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61bc0cd120 0x7f61bc149780 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f61b0035040 tx=0x7f61b00046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.457+0000 7f61c3352640 1 -- 172.21.15.81:0/2188507235 shutdown_connections 2024-09-16T01:22:08.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.457+0000 7f61c3352640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61a006c2b0 0x7f61a006e770 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.457+0000 7f61c3352640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61bc15b950 0x7f61bc157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.457+0000 7f61c3352640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61bc15b570 0x7f61bc149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.457+0000 7f61c3352640 1 --2- 172.21.15.81:0/2188507235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61bc0cd120 0x7f61bc149780 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.457+0000 7f61c3352640 1 -- 172.21.15.81:0/2188507235 >> 172.21.15.81:0/2188507235 conn(0x7f61bc06bdf0 msgr2=0x7f61bc147a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:08.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.457+0000 7f61c3352640 1 -- 172.21.15.81:0/2188507235 shutdown_connections 2024-09-16T01:22:08.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.457+0000 7f61c3352640 1 -- 172.21.15.81:0/2188507235 wait complete. 2024-09-16T01:22:08.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 800 2024-09-16T01:22:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.570+0000 7f38449f6640 1 Processor -- start 2024-09-16T01:22:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.570+0000 7f38449f6640 1 -- start start 2024-09-16T01:22:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.571+0000 7f38449f6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3840072980 0x7f3840162160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.571+0000 7f38449f6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f38401626a0 0x7f384006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.571+0000 7f38449f6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3840162ed0 con 0x7f3840155460 2024-09-16T01:22:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.571+0000 7f38449f6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f384015f430 con 0x7f38401626a0 2024-09-16T01:22:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.571+0000 7f38449f6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f384015ede0 con 0x7f3840072980 2024-09-16T01:22:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.571+0000 7f383e59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3840155460 0x7f3840072270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60192/0 (socket says 172.21.15.81:60192) 2024-09-16T01:22:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.571+0000 7f383e59c640 1 -- 172.21.15.81:0/300356120 learned_addr learned my addr 172.21.15.81:0/300356120 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.571+0000 7f383ed9d640 1 --2- 172.21.15.81:0/300356120 >> v2:172.21.15.102:3300/0 conn(0x7f38401626a0 0x7f384006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.571+0000 7f3835d9b640 1 --2- 172.21.15.81:0/300356120 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3840072980 0x7f3840162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.571+0000 7f383dd9b640 1 -- 172.21.15.81:0/300356120 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2530166195 0 0) 0x7f3840162ed0 con 0x7f3840155460 2024-09-16T01:22:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.571+0000 7f383dd9b640 1 -- 172.21.15.81:0/300356120 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f382c003520 con 0x7f3840155460 2024-09-16T01:22:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.571+0000 7f3835d9b640 1 -- 172.21.15.81:0/300356120 >> v2:172.21.15.102:3300/0 conn(0x7f38401626a0 msgr2=0x7f384006e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.572+0000 7f3835d9b640 1 --2- 172.21.15.81:0/300356120 >> v2:172.21.15.102:3300/0 conn(0x7f38401626a0 0x7f384006e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.572+0000 7f3835d9b640 1 -- 172.21.15.81:0/300356120 >> v1:172.21.15.81:6789/0 conn(0x7f3840155460 legacy=0x7f3840072270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.572+0000 7f383dd9b640 1 -- 172.21.15.81:0/300356120 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4209927973 0 0) 0x7f382c003520 con 0x7f3840155460 2024-09-16T01:22:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.572+0000 7f3835d9b640 1 -- 172.21.15.81:0/300356120 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384015f0c0 con 0x7f3840072980 2024-09-16T01:22:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.572+0000 7f383ed9d640 1 --2- 172.21.15.81:0/300356120 >> v2:172.21.15.102:3300/0 conn(0x7f38401626a0 0x7f384006e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.572+0000 7f3835d9b640 1 --2- 172.21.15.81:0/300356120 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3840072980 0x7f3840162160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f38280097a0 tx=0x7f382802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61c9c748054f1f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.572+0000 7f383dd9b640 1 -- 172.21.15.81:0/300356120 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828037070 con 0x7f3840072980 2024-09-16T01:22:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.572+0000 7f383dd9b640 1 -- 172.21.15.81:0/300356120 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f382802aba0 con 0x7f3840072980 2024-09-16T01:22:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.572+0000 7f383dd9b640 1 -- 172.21.15.81:0/300356120 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830001670 con 0x7f3840072980 2024-09-16T01:22:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.573+0000 7f38449f6640 1 -- 172.21.15.81:0/300356120 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3840072980 msgr2=0x7f3840162160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.573+0000 7f38449f6640 1 --2- 172.21.15.81:0/300356120 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3840072980 0x7f3840162160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f38280097a0 tx=0x7f382802a110 comp rx=0 tx=0).stop 2024-09-16T01:22:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.573+0000 7f38449f6640 1 -- 172.21.15.81:0/300356120 shutdown_connections 2024-09-16T01:22:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.573+0000 7f38449f6640 1 --2- 172.21.15.81:0/300356120 >> v2:172.21.15.102:3300/0 conn(0x7f38401626a0 0x7f384006e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.573+0000 7f38449f6640 1 --2- 172.21.15.81:0/300356120 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3840072980 0x7f3840162160 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.573+0000 7f38449f6640 1 -- 172.21.15.81:0/300356120 >> 172.21.15.81:0/300356120 conn(0x7f384006bc10 msgr2=0x7f384006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.573+0000 7f38449f6640 1 -- 172.21.15.81:0/300356120 shutdown_connections 2024-09-16T01:22:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.573+0000 7f38449f6640 1 -- 172.21.15.81:0/300356120 wait complete. 2024-09-16T01:22:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.574+0000 7f38449f6640 1 Processor -- start 2024-09-16T01:22:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.575+0000 7f38449f6640 1 -- start start 2024-09-16T01:22:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.575+0000 7f38449f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840072980 0x7f3840155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.575+0000 7f38449f6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3840155460 0x7f38401596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.575+0000 7f38449f6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38401626a0 0x7f3840159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.575+0000 7f38449f6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3840162cb0 con 0x7f3840072980 2024-09-16T01:22:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.575+0000 7f38449f6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3840162b30 con 0x7f38401626a0 2024-09-16T01:22:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.575+0000 7f38449f6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3840155840 con 0x7f3840155460 2024-09-16T01:22:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.575+0000 7f383e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840072980 0x7f3840155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.575+0000 7f383e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840072980 0x7f3840155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41950/0 (socket says 172.21.15.81:41950) 2024-09-16T01:22:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.575+0000 7f383e59c640 1 -- 172.21.15.81:0/102700088 learned_addr learned my addr 172.21.15.81:0/102700088 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f3835d9b640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3840155460 0x7f38401596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f383ed9d640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38401626a0 0x7f3840159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f383e59c640 1 -- 172.21.15.81:0/102700088 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3840155460 msgr2=0x7f38401596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f383e59c640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3840155460 0x7f38401596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f383e59c640 1 -- 172.21.15.81:0/102700088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38401626a0 msgr2=0x7f3840159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f383e59c640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38401626a0 0x7f3840159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f383e59c640 1 -- 172.21.15.81:0/102700088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3840149bd0 con 0x7f3840072980 2024-09-16T01:22:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f383ed9d640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38401626a0 0x7f3840159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f383e59c640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840072980 0x7f3840155c70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f383000c780 tx=0x7f383000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f38377fe640 1 -- 172.21.15.81:0/102700088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830017070 con 0x7f3840072980 2024-09-16T01:22:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f38377fe640 1 -- 172.21.15.81:0/102700088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3830005ad0 con 0x7f3840072980 2024-09-16T01:22:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f38449f6640 1 -- 172.21.15.81:0/102700088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38401587a0 con 0x7f3840072980 2024-09-16T01:22:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f38377fe640 1 -- 172.21.15.81:0/102700088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3830007070 con 0x7f3840072980 2024-09-16T01:22:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.576+0000 7f38449f6640 1 -- 172.21.15.81:0/102700088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38401561b0 con 0x7f3840072980 2024-09-16T01:22:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.577+0000 7f38449f6640 1 -- 172.21.15.81:0/102700088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f384006cba0 con 0x7f3840072980 2024-09-16T01:22:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.578+0000 7f38377fe640 1 -- 172.21.15.81:0/102700088 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f383001a070 con 0x7f3840072980 2024-09-16T01:22:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.578+0000 7f38377fe640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f382006c2b0 0x7f382006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.578+0000 7f3835d9b640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f382006c2b0 0x7f382006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.578+0000 7f38377fe640 1 -- 172.21.15.81:0/102700088 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f383008abd0 con 0x7f3840072980 2024-09-16T01:22:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.579+0000 7f3835d9b640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f382006c2b0 0x7f382006e770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3828034000 tx=0x7f382802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.582+0000 7f38377fe640 1 -- 172.21.15.81:0/102700088 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3830059130 con 0x7f3840072980 2024-09-16T01:22:08.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.748+0000 7f38449f6640 1 -- 172.21.15.81:0/102700088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7f384015f8a0 con 0x7f3840072980 2024-09-16T01:22:08.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.751+0000 7f38377fe640 1 -- 172.21.15.81:0/102700088 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v39)=0 v39) ==== 128+0+0 (secure 0 0 0) 0x7f3830058a30 con 0x7f3840072980 2024-09-16T01:22:08.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.753+0000 7f38449f6640 1 -- 172.21.15.81:0/102700088 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f382006c2b0 msgr2=0x7f382006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.753+0000 7f38449f6640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f382006c2b0 0x7f382006e770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3828034000 tx=0x7f382802e000 comp rx=0 tx=0).stop 2024-09-16T01:22:08.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.753+0000 7f38449f6640 1 -- 172.21.15.81:0/102700088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840072980 msgr2=0x7f3840155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.753+0000 7f38449f6640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840072980 0x7f3840155c70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f383000c780 tx=0x7f383000cc40 comp rx=0 tx=0).stop 2024-09-16T01:22:08.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.753+0000 7f38449f6640 1 -- 172.21.15.81:0/102700088 shutdown_connections 2024-09-16T01:22:08.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.753+0000 7f38449f6640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f382006c2b0 0x7f382006e770 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.753+0000 7f38449f6640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38401626a0 0x7f3840159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.753+0000 7f38449f6640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3840155460 0x7f38401596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.753+0000 7f38449f6640 1 --2- 172.21.15.81:0/102700088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3840072980 0x7f3840155c70 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.753+0000 7f38449f6640 1 -- 172.21.15.81:0/102700088 >> 172.21.15.81:0/102700088 conn(0x7f384006bc10 msgr2=0x7f384015de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:08.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.754+0000 7f38449f6640 1 -- 172.21.15.81:0/102700088 shutdown_connections 2024-09-16T01:22:08.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.754+0000 7f38449f6640 1 -- 172.21.15.81:0/102700088 wait complete. 2024-09-16T01:22:08.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-16T01:22:08.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.865+0000 7fdfb90e6640 1 Processor -- start 2024-09-16T01:22:08.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.865+0000 7fdfb90e6640 1 -- start start 2024-09-16T01:22:08.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb90e6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdfb409b9c0 0x7fdfb40b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb90e6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfb409aa30 0x7fdfb409ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb90e6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb409b380 con 0x7fdfb415c620 2024-09-16T01:22:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb90e6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb40b0600 con 0x7fdfb409b9c0 2024-09-16T01:22:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb90e6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb40afcd0 con 0x7fdfb409aa30 2024-09-16T01:22:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdfb409b9c0 0x7fdfb40b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb2d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdfb415c620 0x7fdfb40b0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60202/0 (socket says 172.21.15.81:60202) 2024-09-16T01:22:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb2d9d640 1 -- 172.21.15.81:0/397900917 learned_addr learned my addr 172.21.15.81:0/397900917 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb359e640 1 --2- 172.21.15.81:0/397900917 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfb409aa30 0x7fdfb409ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb259c640 1 -- 172.21.15.81:0/397900917 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfb409aa30 msgr2=0x7fdfb409ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:08.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb259c640 1 --2- 172.21.15.81:0/397900917 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfb409aa30 0x7fdfb409ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb259c640 1 -- 172.21.15.81:0/397900917 >> v1:172.21.15.81:6789/0 conn(0x7fdfb415c620 legacy=0x7fdfb40b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.866+0000 7fdfb259c640 1 -- 172.21.15.81:0/397900917 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb40affb0 con 0x7fdfb409b9c0 2024-09-16T01:22:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.867+0000 7fdfb259c640 1 --2- 172.21.15.81:0/397900917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb409b9c0 0x7fdfb40b67a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80097a0 tx=0x7fdfa802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a926742992b8c77 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.867+0000 7fdfb1d9b640 1 -- 172.21.15.81:0/397900917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8037070 con 0x7fdfb409b9c0 2024-09-16T01:22:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.867+0000 7fdfb1d9b640 1 -- 172.21.15.81:0/397900917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa8032440 con 0x7fdfb409b9c0 2024-09-16T01:22:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.867+0000 7fdfb1d9b640 1 -- 172.21.15.81:0/397900917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8032810 con 0x7fdfb409b9c0 2024-09-16T01:22:08.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.867+0000 7fdfb90e6640 1 -- 172.21.15.81:0/397900917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb409b9c0 msgr2=0x7fdfb40b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.867+0000 7fdfb90e6640 1 --2- 172.21.15.81:0/397900917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb409b9c0 0x7fdfb40b67a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80097a0 tx=0x7fdfa802a180 comp rx=0 tx=0).stop 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.867+0000 7fdfb90e6640 1 -- 172.21.15.81:0/397900917 shutdown_connections 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.867+0000 7fdfb90e6640 1 --2- 172.21.15.81:0/397900917 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfb409aa30 0x7fdfb409ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.867+0000 7fdfb90e6640 1 --2- 172.21.15.81:0/397900917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb409b9c0 0x7fdfb40b67a0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.867+0000 7fdfb90e6640 1 -- 172.21.15.81:0/397900917 >> 172.21.15.81:0/397900917 conn(0x7fdfb40b79e0 msgr2=0x7fdfb40b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.867+0000 7fdfb90e6640 1 -- 172.21.15.81:0/397900917 shutdown_connections 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.867+0000 7fdfb90e6640 1 -- 172.21.15.81:0/397900917 wait complete. 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.869+0000 7fdfb90e6640 1 Processor -- start 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.869+0000 7fdfb90e6640 1 -- start start 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb90e6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfb409aa30 0x7fdfb4154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb90e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb409b9c0 0x7fdfb415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb90e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfb415bb90 0x7fdfb415d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb90e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb40af980 con 0x7fdfb409b9c0 2024-09-16T01:22:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb90e6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb40b17a0 con 0x7fdfb415bb90 2024-09-16T01:22:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb90e6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb406fdb0 con 0x7fdfb409aa30 2024-09-16T01:22:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb409b9c0 0x7fdfb415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb409b9c0 0x7fdfb415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41964/0 (socket says 172.21.15.81:41964) 2024-09-16T01:22:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb259c640 1 -- 172.21.15.81:0/2319869742 learned_addr learned my addr 172.21.15.81:0/2319869742 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb359e640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfb415bb90 0x7fdfb415d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb2d9d640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfb409aa30 0x7fdfb4154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb259c640 1 -- 172.21.15.81:0/2319869742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfb409aa30 msgr2=0x7fdfb4154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb259c640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfb409aa30 0x7fdfb4154700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb259c640 1 -- 172.21.15.81:0/2319869742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfb415bb90 msgr2=0x7fdfb415d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb259c640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfb415bb90 0x7fdfb415d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb259c640 1 -- 172.21.15.81:0/2319869742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb415aaf0 con 0x7fdfb409b9c0 2024-09-16T01:22:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb359e640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfb415bb90 0x7fdfb415d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb259c640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb409b9c0 0x7fdfb415a360 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8035040 tx=0x7fdfa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdf9b7fe640 1 -- 172.21.15.81:0/2319869742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8037040 con 0x7fdfb409b9c0 2024-09-16T01:22:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdf9b7fe640 1 -- 172.21.15.81:0/2319869742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa8030770 con 0x7fdfb409b9c0 2024-09-16T01:22:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdfb90e6640 1 -- 172.21.15.81:0/2319869742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb415add0 con 0x7fdfb409b9c0 2024-09-16T01:22:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.870+0000 7fdf9b7fe640 1 -- 172.21.15.81:0/2319869742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8030b80 con 0x7fdfb409b9c0 2024-09-16T01:22:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.871+0000 7fdfb90e6640 1 -- 172.21.15.81:0/2319869742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb415b390 con 0x7fdfb409b9c0 2024-09-16T01:22:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.871+0000 7fdfb90e6640 1 -- 172.21.15.81:0/2319869742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb409ae40 con 0x7fdfb409b9c0 2024-09-16T01:22:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.872+0000 7fdf9b7fe640 1 -- 172.21.15.81:0/2319869742 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdfa8044020 con 0x7fdfb409b9c0 2024-09-16T01:22:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.872+0000 7fdf9b7fe640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdfa006c2b0 0x7fdfa006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.872+0000 7fdf9b7fe640 1 -- 172.21.15.81:0/2319869742 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fdfa80aba90 con 0x7fdfb409b9c0 2024-09-16T01:22:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.872+0000 7fdfb2d9d640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdfa006c2b0 0x7fdfa006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.873+0000 7fdfb2d9d640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdfa006c2b0 0x7fdfa006e770 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000f60 tx=0x7fdfa4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:08.877+0000 7fdf9b7fe640 1 -- 172.21.15.81:0/2319869742 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdfa8032e20 con 0x7fdfb409b9c0 2024-09-16T01:22:09.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.045+0000 7fdfb90e6640 1 -- 172.21.15.81:0/2319869742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7fdfb40ceb80 con 0x7fdfb409b9c0 2024-09-16T01:22:09.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.045+0000 7fdf9b7fe640 1 -- 172.21.15.81:0/2319869742 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v39) ==== 106+0+4 (secure 0 0 0) 0x7fdfa807a100 con 0x7fdfb409b9c0 2024-09-16T01:22:09.046 INFO:teuthology.orchestra.run.smithi081.stdout:100 2024-09-16T01:22:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.047+0000 7fdfb90e6640 1 -- 172.21.15.81:0/2319869742 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdfa006c2b0 msgr2=0x7fdfa006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.047+0000 7fdfb90e6640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdfa006c2b0 0x7fdfa006e770 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4000f60 tx=0x7fdfa4009040 comp rx=0 tx=0).stop 2024-09-16T01:22:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.047+0000 7fdfb90e6640 1 -- 172.21.15.81:0/2319869742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb409b9c0 msgr2=0x7fdfb415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.047+0000 7fdfb90e6640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb409b9c0 0x7fdfb415a360 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8035040 tx=0x7fdfa80046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.047+0000 7fdfb90e6640 1 -- 172.21.15.81:0/2319869742 shutdown_connections 2024-09-16T01:22:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.047+0000 7fdfb90e6640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdfa006c2b0 0x7fdfa006e770 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.047+0000 7fdfb90e6640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfb415bb90 0x7fdfb415d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.047+0000 7fdfb90e6640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfb409b9c0 0x7fdfb415a360 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.047+0000 7fdfb90e6640 1 --2- 172.21.15.81:0/2319869742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfb409aa30 0x7fdfb4154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.047+0000 7fdfb90e6640 1 -- 172.21.15.81:0/2319869742 >> 172.21.15.81:0/2319869742 conn(0x7fdfb40b79e0 msgr2=0x7fdfb40b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.047+0000 7fdfb90e6640 1 -- 172.21.15.81:0/2319869742 shutdown_connections 2024-09-16T01:22:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.047+0000 7fdfb90e6640 1 -- 172.21.15.81:0/2319869742 wait complete. 2024-09-16T01:22:09.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 100 2024-09-16T01:22:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.162+0000 7f6d06786640 1 Processor -- start 2024-09-16T01:22:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.162+0000 7f6d06786640 1 -- start start 2024-09-16T01:22:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.163+0000 7f6d06786640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6d0015c160 0x7f6d000b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.163+0000 7f6d06786640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d000b1870 0x7f6d000b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.163+0000 7f6d06786640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6d000b61d0 0x7f6d0015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.163+0000 7f6d06786640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6d000b1670 con 0x7f6d000b1870 2024-09-16T01:22:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.163+0000 7f6d06786640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6d0009b440 con 0x7f6d0015c160 2024-09-16T01:22:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.163+0000 7f6d06786640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6d000b6630 con 0x7f6d000b61d0 2024-09-16T01:22:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.163+0000 7f6cff7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d000b1870 0x7f6d000b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.163+0000 7f6cff7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d000b1870 0x7f6d000b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41974/0 (socket says 172.21.15.81:41974) 2024-09-16T01:22:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.163+0000 7f6cff7fe640 1 -- 172.21.15.81:0/3263838969 learned_addr learned my addr 172.21.15.81:0/3263838969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.163+0000 7f6d04d23640 1 --2- 172.21.15.81:0/3263838969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6d000b61d0 0x7f6d0015fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.163+0000 7f6cfffff640 1 --2- 172.21.15.81:0/3263838969 >> v2:172.21.15.102:3300/0 conn(0x7f6d0015c160 0x7f6d000b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.164+0000 7f6cff7fe640 1 -- 172.21.15.81:0/3263838969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6d000b61d0 msgr2=0x7f6d0015fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:09.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.164+0000 7f6cff7fe640 1 --2- 172.21.15.81:0/3263838969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6d000b61d0 0x7f6d0015fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.164+0000 7f6cff7fe640 1 -- 172.21.15.81:0/3263838969 >> v2:172.21.15.102:3300/0 conn(0x7f6d0015c160 msgr2=0x7f6d000b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.164+0000 7f6cff7fe640 1 --2- 172.21.15.81:0/3263838969 >> v2:172.21.15.102:3300/0 conn(0x7f6d0015c160 0x7f6d000b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.164+0000 7f6cff7fe640 1 -- 172.21.15.81:0/3263838969 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d000b5840 con 0x7f6d000b1870 2024-09-16T01:22:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.164+0000 7f6cff7fe640 1 --2- 172.21.15.81:0/3263838969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d000b1870 0x7f6d000b5c90 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f6d00072b00 tx=0x7f6cf402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce976bf134320d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.164+0000 7f6cfeffd640 1 -- 172.21.15.81:0/3263838969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4037070 con 0x7f6d000b1870 2024-09-16T01:22:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.164+0000 7f6cfeffd640 1 -- 172.21.15.81:0/3263838969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf4032440 con 0x7f6d000b1870 2024-09-16T01:22:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.164+0000 7f6cfeffd640 1 -- 172.21.15.81:0/3263838969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4032810 con 0x7f6d000b1870 2024-09-16T01:22:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.165+0000 7f6d06786640 1 -- 172.21.15.81:0/3263838969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d000b1870 msgr2=0x7f6d000b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.165+0000 7f6d06786640 1 --2- 172.21.15.81:0/3263838969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d000b1870 0x7f6d000b5c90 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f6d00072b00 tx=0x7f6cf402a1e0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.165+0000 7f6d06786640 1 -- 172.21.15.81:0/3263838969 shutdown_connections 2024-09-16T01:22:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.165+0000 7f6d06786640 1 --2- 172.21.15.81:0/3263838969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6d000b61d0 0x7f6d0015fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.165+0000 7f6d06786640 1 --2- 172.21.15.81:0/3263838969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d000b1870 0x7f6d000b5c90 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.165+0000 7f6d06786640 1 --2- 172.21.15.81:0/3263838969 >> v2:172.21.15.102:3300/0 conn(0x7f6d0015c160 0x7f6d000b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.165+0000 7f6d06786640 1 -- 172.21.15.81:0/3263838969 >> 172.21.15.81:0/3263838969 conn(0x7f6d000b3f60 msgr2=0x7f6d000b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.165+0000 7f6d06786640 1 -- 172.21.15.81:0/3263838969 shutdown_connections 2024-09-16T01:22:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.165+0000 7f6d06786640 1 -- 172.21.15.81:0/3263838969 wait complete. 2024-09-16T01:22:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.166+0000 7f6d06786640 1 Processor -- start 2024-09-16T01:22:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.166+0000 7f6d06786640 1 -- start start 2024-09-16T01:22:09.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.167+0000 7f6d06786640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d000b1870 0x7f6d0014c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.167+0000 7f6d06786640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d000b61d0 0x7f6d00148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.167+0000 7f6d06786640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6d0015c160 0x7f6d00153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.167+0000 7f6d06786640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0009bc50 con 0x7f6d000b61d0 2024-09-16T01:22:09.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.167+0000 7f6d06786640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0009b970 con 0x7f6d000b1870 2024-09-16T01:22:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.167+0000 7f6d06786640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6d000b1c80 con 0x7f6d0015c160 2024-09-16T01:22:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.167+0000 7f6cff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d000b61d0 0x7f6d00148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.167+0000 7f6cff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d000b61d0 0x7f6d00148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41976/0 (socket says 172.21.15.81:41976) 2024-09-16T01:22:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.167+0000 7f6cff7fe640 1 -- 172.21.15.81:0/3166921655 learned_addr learned my addr 172.21.15.81:0/3166921655 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.167+0000 7f6cfffff640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d000b1870 0x7f6d0014c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.167+0000 7f6d04d23640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6d0015c160 0x7f6d00153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.168+0000 7f6cff7fe640 1 -- 172.21.15.81:0/3166921655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6d0015c160 msgr2=0x7f6d00153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.168+0000 7f6cff7fe640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6d0015c160 0x7f6d00153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.168+0000 7f6cff7fe640 1 -- 172.21.15.81:0/3166921655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d000b1870 msgr2=0x7f6d0014c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.168+0000 7f6cff7fe640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d000b1870 0x7f6d0014c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.168+0000 7f6cff7fe640 1 -- 172.21.15.81:0/3166921655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0014cb80 con 0x7f6d000b61d0 2024-09-16T01:22:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.168+0000 7f6cff7fe640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d000b61d0 0x7f6d00148540 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f6cf402a220 tx=0x7f6cf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.168+0000 7f6cfcff9640 1 -- 172.21.15.81:0/3166921655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4041020 con 0x7f6d000b61d0 2024-09-16T01:22:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.168+0000 7f6cfcff9640 1 -- 172.21.15.81:0/3166921655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cf403d620 con 0x7f6d000b61d0 2024-09-16T01:22:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.168+0000 7f6cfcff9640 1 -- 172.21.15.81:0/3166921655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf4037040 con 0x7f6d000b61d0 2024-09-16T01:22:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.168+0000 7f6d06786640 1 -- 172.21.15.81:0/3166921655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0014ce60 con 0x7f6d000b61d0 2024-09-16T01:22:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.168+0000 7f6d06786640 1 -- 172.21.15.81:0/3166921655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d0014d420 con 0x7f6d000b61d0 2024-09-16T01:22:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.169+0000 7f6d06786640 1 -- 172.21.15.81:0/3166921655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d0015c540 con 0x7f6d000b61d0 2024-09-16T01:22:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.169+0000 7f6cfcff9640 1 -- 172.21.15.81:0/3166921655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6cf4044020 con 0x7f6d000b61d0 2024-09-16T01:22:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.170+0000 7f6cfcff9640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6cec06c2e0 0x7f6cec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.170+0000 7f6cfcff9640 1 -- 172.21.15.81:0/3166921655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f6cf40aba20 con 0x7f6d000b61d0 2024-09-16T01:22:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.170+0000 7f6cfffff640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6cec06c2e0 0x7f6cec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.170+0000 7f6cfffff640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6cec06c2e0 0x7f6cec06e7a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6d000b21e0 tx=0x7f6cf0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:09.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.174+0000 7f6cfcff9640 1 -- 172.21.15.81:0/3166921655 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cf404b030 con 0x7f6d000b61d0 2024-09-16T01:22:09.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.340+0000 7f6d06786640 1 -- 172.21.15.81:0/3166921655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7f6d00154a10 con 0x7f6d000b61d0 2024-09-16T01:22:09.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.344+0000 7f6cfcff9640 1 -- 172.21.15.81:0/3166921655 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v40)=0 v40) ==== 124+0+0 (secure 0 0 0) 0x7f6cf4079a40 con 0x7f6d000b61d0 2024-09-16T01:22:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.346+0000 7f6d06786640 1 -- 172.21.15.81:0/3166921655 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6cec06c2e0 msgr2=0x7f6cec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.346+0000 7f6d06786640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6cec06c2e0 0x7f6cec06e7a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6d000b21e0 tx=0x7f6cf0009190 comp rx=0 tx=0).stop 2024-09-16T01:22:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.346+0000 7f6d06786640 1 -- 172.21.15.81:0/3166921655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d000b61d0 msgr2=0x7f6d00148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.346+0000 7f6d06786640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d000b61d0 0x7f6d00148540 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f6cf402a220 tx=0x7f6cf40046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.346+0000 7f6d06786640 1 -- 172.21.15.81:0/3166921655 shutdown_connections 2024-09-16T01:22:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.346+0000 7f6d06786640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6cec06c2e0 0x7f6cec06e7a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.346+0000 7f6d06786640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6d0015c160 0x7f6d00153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.346+0000 7f6d06786640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d000b61d0 0x7f6d00148540 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.346+0000 7f6d06786640 1 --2- 172.21.15.81:0/3166921655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d000b1870 0x7f6d0014c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.346+0000 7f6d06786640 1 -- 172.21.15.81:0/3166921655 >> 172.21.15.81:0/3166921655 conn(0x7f6d000b3f60 msgr2=0x7f6d000d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.346+0000 7f6d06786640 1 -- 172.21.15.81:0/3166921655 shutdown_connections 2024-09-16T01:22:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.346+0000 7f6d06786640 1 -- 172.21.15.81:0/3166921655 wait complete. 2024-09-16T01:22:09.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_max_caps_per_client 2024-09-16T01:22:09.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.458+0000 7ffb0e8af640 1 Processor -- start 2024-09-16T01:22:09.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.458+0000 7ffb0e8af640 1 -- start start 2024-09-16T01:22:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.459+0000 7ffb0e8af640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffb08155930 0x7ffb080addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.459+0000 7ffb0e8af640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb0815b720 0x7ffb0815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.459+0000 7ffb0e8af640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb0815c1e0 con 0x7ffb080d0370 2024-09-16T01:22:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.459+0000 7ffb0e8af640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ffb0815c4c0 con 0x7ffb08155930 2024-09-16T01:22:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.459+0000 7ffb0e8af640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffb080b3340 con 0x7ffb0815b720 2024-09-16T01:22:09.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.459+0000 7ffb07fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffb08155930 0x7ffb080addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.459+0000 7ffb077fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb0815b720 0x7ffb0815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.459+0000 7ffb07fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffb08155930 0x7ffb080addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:47854/0 (socket says 172.21.15.81:47854) 2024-09-16T01:22:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.459+0000 7ffb07fff640 1 -- 172.21.15.81:0/3673997079 learned_addr learned my addr 172.21.15.81:0/3673997079 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.460+0000 7ffb07fff640 1 -- 172.21.15.81:0/3673997079 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb0815b720 msgr2=0x7ffb0815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.460+0000 7ffb07fff640 1 --2- 172.21.15.81:0/3673997079 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb0815b720 0x7ffb0815bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.460+0000 7ffb07fff640 1 -- 172.21.15.81:0/3673997079 >> v1:172.21.15.102:6789/0 conn(0x7ffb080d0370 legacy=0x7ffb080b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.460+0000 7ffb07fff640 1 -- 172.21.15.81:0/3673997079 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb080b3620 con 0x7ffb08155930 2024-09-16T01:22:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.460+0000 7ffb07fff640 1 --2- 172.21.15.81:0/3673997079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb08155930 0x7ffb080addd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009870 tx=0x7ffaf802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce09bbb709e24bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.461+0000 7ffb06ffd640 1 -- 172.21.15.81:0/3673997079 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8037070 con 0x7ffb08155930 2024-09-16T01:22:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.461+0000 7ffb06ffd640 1 -- 172.21.15.81:0/3673997079 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf8032440 con 0x7ffb08155930 2024-09-16T01:22:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.461+0000 7ffb06ffd640 1 -- 172.21.15.81:0/3673997079 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8032810 con 0x7ffb08155930 2024-09-16T01:22:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.461+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3673997079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb08155930 msgr2=0x7ffb080addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.461+0000 7ffb0e8af640 1 --2- 172.21.15.81:0/3673997079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb08155930 0x7ffb080addd0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009870 tx=0x7ffaf802a270 comp rx=0 tx=0).stop 2024-09-16T01:22:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.461+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3673997079 shutdown_connections 2024-09-16T01:22:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.461+0000 7ffb0e8af640 1 --2- 172.21.15.81:0/3673997079 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb0815b720 0x7ffb0815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.461+0000 7ffb0e8af640 1 --2- 172.21.15.81:0/3673997079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb08155930 0x7ffb080addd0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.461+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3673997079 >> 172.21.15.81:0/3673997079 conn(0x7ffb0806bdf0 msgr2=0x7ffb0806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.461+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3673997079 shutdown_connections 2024-09-16T01:22:09.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.461+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3673997079 wait complete. 2024-09-16T01:22:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.462+0000 7ffb0e8af640 1 Processor -- start 2024-09-16T01:22:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.462+0000 7ffb0e8af640 1 -- start start 2024-09-16T01:22:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.463+0000 7ffb0e8af640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb080d0370 0x7ffb08099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.463+0000 7ffb0e8af640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb08155930 0x7ffb080b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.463+0000 7ffb0e8af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb0815b720 0x7ffb0814a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.463+0000 7ffb0e8af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb080ae490 con 0x7ffb0815b720 2024-09-16T01:22:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.463+0000 7ffb0e8af640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffb080ae310 con 0x7ffb080d0370 2024-09-16T01:22:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.463+0000 7ffb0e8af640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffb080b4250 con 0x7ffb08155930 2024-09-16T01:22:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.463+0000 7ffb0ce4c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb0815b720 0x7ffb0814a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.463+0000 7ffb0ce4c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb0815b720 0x7ffb0814a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41980/0 (socket says 172.21.15.81:41980) 2024-09-16T01:22:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.463+0000 7ffb0ce4c640 1 -- 172.21.15.81:0/3433793416 learned_addr learned my addr 172.21.15.81:0/3433793416 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.463+0000 7ffb07fff640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb080d0370 0x7ffb08099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.463+0000 7ffb077fe640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb08155930 0x7ffb080b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.464+0000 7ffb0ce4c640 1 -- 172.21.15.81:0/3433793416 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb08155930 msgr2=0x7ffb080b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.464+0000 7ffb0ce4c640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb08155930 0x7ffb080b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.464+0000 7ffb0ce4c640 1 -- 172.21.15.81:0/3433793416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb080d0370 msgr2=0x7ffb08099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.464+0000 7ffb0ce4c640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb080d0370 0x7ffb08099980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.464+0000 7ffb0ce4c640 1 -- 172.21.15.81:0/3433793416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb08099ec0 con 0x7ffb0815b720 2024-09-16T01:22:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.464+0000 7ffb0ce4c640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb0815b720 0x7ffb0814a8b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000c7a0 tx=0x7ffb0000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.464+0000 7ffb04ff9640 1 -- 172.21.15.81:0/3433793416 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00003b70 con 0x7ffb0815b720 2024-09-16T01:22:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.464+0000 7ffb04ff9640 1 -- 172.21.15.81:0/3433793416 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb00003d30 con 0x7ffb0815b720 2024-09-16T01:22:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.464+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3433793416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb081455a0 con 0x7ffb0815b720 2024-09-16T01:22:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.464+0000 7ffb04ff9640 1 -- 172.21.15.81:0/3433793416 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0000aa90 con 0x7ffb0815b720 2024-09-16T01:22:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.464+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3433793416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb080cdec0 con 0x7ffb0815b720 2024-09-16T01:22:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.465+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3433793416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb08145ac0 con 0x7ffb0815b720 2024-09-16T01:22:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.465+0000 7ffb04ff9640 1 -- 172.21.15.81:0/3433793416 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffb0000ac30 con 0x7ffb0815b720 2024-09-16T01:22:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.466+0000 7ffb04ff9640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffaf406c2b0 0x7ffaf406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.466+0000 7ffb04ff9640 1 -- 172.21.15.81:0/3433793416 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7ffb0008b3d0 con 0x7ffb0815b720 2024-09-16T01:22:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.466+0000 7ffb07fff640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffaf406c2b0 0x7ffaf406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.466+0000 7ffb07fff640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffaf406c2b0 0x7ffaf406e770 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8034000 tx=0x7ffaf802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.470+0000 7ffb04ff9640 1 -- 172.21.15.81:0/3433793416 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb08145ac0 con 0x7ffb0815b720 2024-09-16T01:22:09.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:22:09.586 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:22:09.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.641+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3433793416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"} v 0) -- 0x7ffb080cdca0 con 0x7ffb0815b720 2024-09-16T01:22:09.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.641+0000 7ffb04ff9640 1 -- 172.21.15.81:0/3433793416 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"}]=0 v40) ==== 106+0+8 (secure 0 0 0) 0x7ffb08099ec0 con 0x7ffb0815b720 2024-09-16T01:22:09.643 INFO:teuthology.orchestra.run.smithi081.stdout:1048576 2024-09-16T01:22:09.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.644+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3433793416 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffaf406c2b0 msgr2=0x7ffaf406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.644+0000 7ffb0e8af640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffaf406c2b0 0x7ffaf406e770 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8034000 tx=0x7ffaf802e000 comp rx=0 tx=0).stop 2024-09-16T01:22:09.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.644+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3433793416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb0815b720 msgr2=0x7ffb0814a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.644+0000 7ffb0e8af640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb0815b720 0x7ffb0814a8b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000c7a0 tx=0x7ffb0000cc60 comp rx=0 tx=0).stop 2024-09-16T01:22:09.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.644+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3433793416 shutdown_connections 2024-09-16T01:22:09.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.644+0000 7ffb0e8af640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffaf406c2b0 0x7ffaf406e770 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.644+0000 7ffb0e8af640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb0815b720 0x7ffb0814a8b0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.644+0000 7ffb0e8af640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb08155930 0x7ffb080b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.644+0000 7ffb0e8af640 1 --2- 172.21.15.81:0/3433793416 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb080d0370 0x7ffb08099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.644+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3433793416 >> 172.21.15.81:0/3433793416 conn(0x7ffb0806bdf0 msgr2=0x7ffb080ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:09.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.644+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3433793416 shutdown_connections 2024-09-16T01:22:09.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.644+0000 7ffb0e8af640 1 -- 172.21.15.81:0/3433793416 wait complete. 2024-09-16T01:22:09.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-09-16T01:22:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.796+0000 7f241a22e640 1 Processor -- start 2024-09-16T01:22:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.796+0000 7f241a22e640 1 -- start start 2024-09-16T01:22:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f241a22e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f241406f910 0x7f241415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f241a22e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2414070050 0x7f24140b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f241a22e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24140b59e0 0x7f2414154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f241a22e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f24140b5e50 con 0x7f2414070050 2024-09-16T01:22:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f241a22e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f24140b4ce0 con 0x7f241406f910 2024-09-16T01:22:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f241a22e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f24140b3c40 con 0x7f24140b59e0 2024-09-16T01:22:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f2412ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2414070050 0x7f24140b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f2412ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2414070050 0x7f24140b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41994/0 (socket says 172.21.15.81:41994) 2024-09-16T01:22:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f2412ffd640 1 -- 172.21.15.81:0/4105489929 learned_addr learned my addr 172.21.15.81:0/4105489929 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f24137fe640 1 --2- 172.21.15.81:0/4105489929 >> v2:172.21.15.102:3300/0 conn(0x7f241406f910 0x7f241415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f2413fff640 1 --2- 172.21.15.81:0/4105489929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24140b59e0 0x7f2414154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f2412ffd640 1 -- 172.21.15.81:0/4105489929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24140b59e0 msgr2=0x7f2414154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f2412ffd640 1 --2- 172.21.15.81:0/4105489929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24140b59e0 0x7f2414154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f2412ffd640 1 -- 172.21.15.81:0/4105489929 >> v2:172.21.15.102:3300/0 conn(0x7f241406f910 msgr2=0x7f241415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f2412ffd640 1 --2- 172.21.15.81:0/4105489929 >> v2:172.21.15.102:3300/0 conn(0x7f241406f910 0x7f241415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.797+0000 7f2412ffd640 1 -- 172.21.15.81:0/4105489929 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24140b3f20 con 0x7f2414070050 2024-09-16T01:22:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.798+0000 7f2412ffd640 1 --2- 172.21.15.81:0/4105489929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414070050 0x7f24140b54a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f241406d720 tx=0x7f240802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de693f8a2619e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.798+0000 7f24127fc640 1 -- 172.21.15.81:0/4105489929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408037070 con 0x7f2414070050 2024-09-16T01:22:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.798+0000 7f24127fc640 1 -- 172.21.15.81:0/4105489929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240802ae00 con 0x7f2414070050 2024-09-16T01:22:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.798+0000 7f24127fc640 1 -- 172.21.15.81:0/4105489929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408032660 con 0x7f2414070050 2024-09-16T01:22:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.799+0000 7f241a22e640 1 -- 172.21.15.81:0/4105489929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414070050 msgr2=0x7f24140b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.799+0000 7f241a22e640 1 --2- 172.21.15.81:0/4105489929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414070050 0x7f24140b54a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f241406d720 tx=0x7f240802a0b0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.799+0000 7f241a22e640 1 -- 172.21.15.81:0/4105489929 shutdown_connections 2024-09-16T01:22:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.799+0000 7f241a22e640 1 --2- 172.21.15.81:0/4105489929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24140b59e0 0x7f2414154ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.799+0000 7f241a22e640 1 --2- 172.21.15.81:0/4105489929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414070050 0x7f24140b54a0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.799+0000 7f241a22e640 1 --2- 172.21.15.81:0/4105489929 >> v2:172.21.15.102:3300/0 conn(0x7f241406f910 0x7f241415f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.799+0000 7f241a22e640 1 -- 172.21.15.81:0/4105489929 >> 172.21.15.81:0/4105489929 conn(0x7f2414073530 msgr2=0x7f241406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.799+0000 7f241a22e640 1 -- 172.21.15.81:0/4105489929 shutdown_connections 2024-09-16T01:22:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.799+0000 7f241a22e640 1 -- 172.21.15.81:0/4105489929 wait complete. 2024-09-16T01:22:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.800+0000 7f241a22e640 1 Processor -- start 2024-09-16T01:22:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.800+0000 7f241a22e640 1 -- start start 2024-09-16T01:22:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f241a22e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f241406f910 0x7f24140b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f241a22e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414070050 0x7f241414df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f241a22e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24140b59e0 0x7f241414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f241a22e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24140b47c0 con 0x7f2414070050 2024-09-16T01:22:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f241a22e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f24140b44e0 con 0x7f24140b59e0 2024-09-16T01:22:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f241a22e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2414070480 con 0x7f241406f910 2024-09-16T01:22:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f2412ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414070050 0x7f241414df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f2412ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414070050 0x7f241414df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41996/0 (socket says 172.21.15.81:41996) 2024-09-16T01:22:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f2412ffd640 1 -- 172.21.15.81:0/2178527385 learned_addr learned my addr 172.21.15.81:0/2178527385 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f2413fff640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24140b59e0 0x7f241414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f24137fe640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f241406f910 0x7f24140b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f2412ffd640 1 -- 172.21.15.81:0/2178527385 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f241406f910 msgr2=0x7f24140b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f2412ffd640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f241406f910 0x7f24140b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f2412ffd640 1 -- 172.21.15.81:0/2178527385 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24140b59e0 msgr2=0x7f241414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f2412ffd640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24140b59e0 0x7f241414e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f2412ffd640 1 -- 172.21.15.81:0/2178527385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24141f4fc0 con 0x7f2414070050 2024-09-16T01:22:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f2413fff640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24140b59e0 0x7f241414e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.801+0000 7f2412ffd640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414070050 0x7f241414df80 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f240802a0f0 tx=0x7f24080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.802+0000 7f23fbfff640 1 -- 172.21.15.81:0/2178527385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408041070 con 0x7f2414070050 2024-09-16T01:22:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.802+0000 7f23fbfff640 1 -- 172.21.15.81:0/2178527385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240803c670 con 0x7f2414070050 2024-09-16T01:22:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.802+0000 7f241a22e640 1 -- 172.21.15.81:0/2178527385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24140c6110 con 0x7f2414070050 2024-09-16T01:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.802+0000 7f23fbfff640 1 -- 172.21.15.81:0/2178527385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408037040 con 0x7f2414070050 2024-09-16T01:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.802+0000 7f241a22e640 1 -- 172.21.15.81:0/2178527385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24140c66d0 con 0x7f2414070050 2024-09-16T01:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.803+0000 7f241a22e640 1 -- 172.21.15.81:0/2178527385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f241406fcf0 con 0x7f2414070050 2024-09-16T01:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.803+0000 7f23fbfff640 1 -- 172.21.15.81:0/2178527385 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f240803a070 con 0x7f2414070050 2024-09-16T01:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.803+0000 7f23fbfff640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f240006c2b0 0x7f240006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.804+0000 7f23fbfff640 1 -- 172.21.15.81:0/2178527385 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f24080ab760 con 0x7f2414070050 2024-09-16T01:22:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.804+0000 7f24137fe640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f240006c2b0 0x7f240006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.804+0000 7f24137fe640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f240006c2b0 0x7f240006e770 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2404006fd0 tx=0x7f2404008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.808+0000 7f23fbfff640 1 -- 172.21.15.81:0/2178527385 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2408079dd0 con 0x7f2414070050 2024-09-16T01:22:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.973+0000 7f241a22e640 1 -- 172.21.15.81:0/2178527385 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7f241406be60 con 0x7f2414070050 2024-09-16T01:22:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.973+0000 7f23fbfff640 1 -- 172.21.15.81:0/2178527385 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v40) ==== 112+0+10 (secure 0 0 0) 0x7f24080796d0 con 0x7f2414070050 2024-09-16T01:22:09.974 INFO:teuthology.orchestra.run.smithi081.stdout:60.000000 2024-09-16T01:22:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.975+0000 7f241a22e640 1 -- 172.21.15.81:0/2178527385 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f240006c2b0 msgr2=0x7f240006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.975+0000 7f241a22e640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f240006c2b0 0x7f240006e770 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2404006fd0 tx=0x7f2404008040 comp rx=0 tx=0).stop 2024-09-16T01:22:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.975+0000 7f241a22e640 1 -- 172.21.15.81:0/2178527385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414070050 msgr2=0x7f241414df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.975+0000 7f241a22e640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414070050 0x7f241414df80 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f240802a0f0 tx=0x7f24080046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.975+0000 7f241a22e640 1 -- 172.21.15.81:0/2178527385 shutdown_connections 2024-09-16T01:22:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.975+0000 7f241a22e640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f240006c2b0 0x7f240006e770 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.975+0000 7f241a22e640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f24140b59e0 0x7f241414e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.975+0000 7f241a22e640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2414070050 0x7f241414df80 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.975+0000 7f241a22e640 1 --2- 172.21.15.81:0/2178527385 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f241406f910 0x7f24140b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.975+0000 7f241a22e640 1 -- 172.21.15.81:0/2178527385 >> 172.21.15.81:0/2178527385 conn(0x7f2414073530 msgr2=0x7f24141e8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.975+0000 7f241a22e640 1 -- 172.21.15.81:0/2178527385 shutdown_connections 2024-09-16T01:22:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:09.975+0000 7f241a22e640 1 -- 172.21.15.81:0/2178527385 wait complete. 2024-09-16T01:22:09.986 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:22:09.987 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:10.002 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:22:10.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:22:10.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:22:10.099 INFO:teuthology.orchestra.run.smithi081.stdout:client6526 2024-09-16T01:22:10.099 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:22:10.099 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:10.116 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-16T01:22:10.116 DEBUG:teuthology.orchestra.run.smithi081:> import fcntl 2024-09-16T01:22:10.116 DEBUG:teuthology.orchestra.run.smithi081:> import sys 2024-09-16T01:22:10.116 DEBUG:teuthology.orchestra.run.smithi081:> import time 2024-09-16T01:22:10.116 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-16T01:22:10.116 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:22:10.116 DEBUG:teuthology.orchestra.run.smithi081:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-16T01:22:10.116 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:22:10.116 DEBUG:teuthology.orchestra.run.smithi081:> n = 800 2024-09-16T01:22:10.116 DEBUG:teuthology.orchestra.run.smithi081:> abs_path = "/home/ubuntu/cephtest/mnt.0/subdir" 2024-09-16T01:22:10.116 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> if not os.path.exists(abs_path): 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> os.makedirs(abs_path) 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> handles = [] 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> for i in range(0, n): 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> fname = "file_"+str(i) 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> path = os.path.join(abs_path, fname) 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> handles.append(open(path, '"'"'w'"'"')) 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> print("waiting with handles open", file=sys.stderr) 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> while True: 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> print("open_n_background: keeping files open", file=sys.stderr) 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-16T01:22:10.117 DEBUG:teuthology.orchestra.run.smithi081:> if os.read(0, 4096) == b"": 2024-09-16T01:22:10.118 DEBUG:teuthology.orchestra.run.smithi081:> break 2024-09-16T01:22:10.118 DEBUG:teuthology.orchestra.run.smithi081:> except BlockingIOError: 2024-09-16T01:22:10.118 DEBUG:teuthology.orchestra.run.smithi081:> pass 2024-09-16T01:22:10.118 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(2) 2024-09-16T01:22:10.118 DEBUG:teuthology.orchestra.run.smithi081:> print("stdin closed, goodbye!", file=sys.stderr) 2024-09-16T01:22:10.118 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-16T01:22:10.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:10.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.257+0000 7fe575f59640 1 Processor -- start 2024-09-16T01:22:10.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.257+0000 7fe575f59640 1 -- start start 2024-09-16T01:22:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe575f59640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5700b43f0 0x7fe57009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe575f59640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe5700b5050 0x7fe57015b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe575f59640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5700b3830 con 0x7fe57015b340 2024-09-16T01:22:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe575f59640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe5700b5bd0 con 0x7fe5700b5050 2024-09-16T01:22:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe575f59640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe5700b5610 con 0x7fe5700b43f0 2024-09-16T01:22:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe56f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe57015b340 0x7fe5700b4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60218/0 (socket says 172.21.15.81:60218) 2024-09-16T01:22:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe56f7fe640 1 -- 172.21.15.81:0/1143876362 learned_addr learned my addr 172.21.15.81:0/1143876362 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe56ffff640 1 --2- 172.21.15.81:0/1143876362 >> v2:172.21.15.102:3300/0 conn(0x7fe5700b5050 0x7fe57015b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe566ffd640 1 --2- 172.21.15.81:0/1143876362 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5700b43f0 0x7fe57009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe56effd640 1 -- 172.21.15.81:0/1143876362 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769623589 0 0) 0x7fe5700b3830 con 0x7fe57015b340 2024-09-16T01:22:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe56effd640 1 -- 172.21.15.81:0/1143876362 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe55c003520 con 0x7fe57015b340 2024-09-16T01:22:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe566ffd640 1 -- 172.21.15.81:0/1143876362 >> v2:172.21.15.102:3300/0 conn(0x7fe5700b5050 msgr2=0x7fe57015b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe56effd640 1 -- 172.21.15.81:0/1143876362 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3179696284 0 0) 0x7fe55c003520 con 0x7fe57015b340 2024-09-16T01:22:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe566ffd640 1 --2- 172.21.15.81:0/1143876362 >> v2:172.21.15.102:3300/0 conn(0x7fe5700b5050 0x7fe57015b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe566ffd640 1 -- 172.21.15.81:0/1143876362 >> v1:172.21.15.81:6789/0 conn(0x7fe57015b340 legacy=0x7fe5700b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe566ffd640 1 -- 172.21.15.81:0/1143876362 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5700b58f0 con 0x7fe5700b43f0 2024-09-16T01:22:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.258+0000 7fe56ffff640 1 --2- 172.21.15.81:0/1143876362 >> v2:172.21.15.102:3300/0 conn(0x7fe5700b5050 0x7fe57015b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:10.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.259+0000 7fe566ffd640 1 --2- 172.21.15.81:0/1143876362 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5700b43f0 0x7fe57009aa30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe5580097a0 tx=0x7fe55802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=926249e69c3cb1d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:10.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.259+0000 7fe56effd640 1 -- 172.21.15.81:0/1143876362 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558037070 con 0x7fe5700b43f0 2024-09-16T01:22:10.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.259+0000 7fe56effd640 1 -- 172.21.15.81:0/1143876362 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55802ac30 con 0x7fe5700b43f0 2024-09-16T01:22:10.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.259+0000 7fe56effd640 1 -- 172.21.15.81:0/1143876362 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe560001670 con 0x7fe5700b43f0 2024-09-16T01:22:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.260+0000 7fe575f59640 1 -- 172.21.15.81:0/1143876362 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5700b43f0 msgr2=0x7fe57009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.260+0000 7fe575f59640 1 --2- 172.21.15.81:0/1143876362 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5700b43f0 0x7fe57009aa30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe5580097a0 tx=0x7fe55802a1a0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.260+0000 7fe575f59640 1 -- 172.21.15.81:0/1143876362 shutdown_connections 2024-09-16T01:22:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.260+0000 7fe575f59640 1 --2- 172.21.15.81:0/1143876362 >> v2:172.21.15.102:3300/0 conn(0x7fe5700b5050 0x7fe57015b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.260+0000 7fe575f59640 1 --2- 172.21.15.81:0/1143876362 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5700b43f0 0x7fe57009aa30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.260+0000 7fe575f59640 1 -- 172.21.15.81:0/1143876362 >> 172.21.15.81:0/1143876362 conn(0x7fe570073490 msgr2=0x7fe5700b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.260+0000 7fe575f59640 1 -- 172.21.15.81:0/1143876362 shutdown_connections 2024-09-16T01:22:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.260+0000 7fe575f59640 1 -- 172.21.15.81:0/1143876362 wait complete. 2024-09-16T01:22:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.261+0000 7fe575f59640 1 Processor -- start 2024-09-16T01:22:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.261+0000 7fe575f59640 1 -- start start 2024-09-16T01:22:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe575f59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5700b43f0 0x7fe570146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe575f59640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5700b5050 0x7fe5700cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe575f59640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe57015b340 0x7fe5701550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe575f59640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5700cdb30 con 0x7fe5700b43f0 2024-09-16T01:22:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe575f59640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe57015d8f0 con 0x7fe5700b5050 2024-09-16T01:22:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe575f59640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe5700cdcb0 con 0x7fe57015b340 2024-09-16T01:22:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe56f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5700b43f0 0x7fe570146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe56f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5700b43f0 0x7fe570146b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42010/0 (socket says 172.21.15.81:42010) 2024-09-16T01:22:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe56f7fe640 1 -- 172.21.15.81:0/3182179833 learned_addr learned my addr 172.21.15.81:0/3182179833 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe56ffff640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe57015b340 0x7fe5701550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe566ffd640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5700b5050 0x7fe5700cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe56f7fe640 1 -- 172.21.15.81:0/3182179833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe57015b340 msgr2=0x7fe5701550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe56f7fe640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe57015b340 0x7fe5701550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe56f7fe640 1 -- 172.21.15.81:0/3182179833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5700b5050 msgr2=0x7fe5700cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe56f7fe640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5700b5050 0x7fe5700cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.262+0000 7fe56f7fe640 1 -- 172.21.15.81:0/3182179833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5700cde90 con 0x7fe5700b43f0 2024-09-16T01:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.263+0000 7fe56f7fe640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5700b43f0 0x7fe570146b30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fe56000c700 tx=0x7fe56000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.263+0000 7fe56cff9640 1 -- 172.21.15.81:0/3182179833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe560017070 con 0x7fe5700b43f0 2024-09-16T01:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.263+0000 7fe56cff9640 1 -- 172.21.15.81:0/3182179833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe560005ce0 con 0x7fe5700b43f0 2024-09-16T01:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.263+0000 7fe575f59640 1 -- 172.21.15.81:0/3182179833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5700ce130 con 0x7fe5700b43f0 2024-09-16T01:22:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.263+0000 7fe56cff9640 1 -- 172.21.15.81:0/3182179833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe560007270 con 0x7fe5700b43f0 2024-09-16T01:22:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.263+0000 7fe575f59640 1 -- 172.21.15.81:0/3182179833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5700ce6f0 con 0x7fe5700b43f0 2024-09-16T01:22:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.264+0000 7fe575f59640 1 -- 172.21.15.81:0/3182179833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe57009aa30 con 0x7fe5700b43f0 2024-09-16T01:22:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.264+0000 7fe56cff9640 1 -- 172.21.15.81:0/3182179833 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe56001a070 con 0x7fe5700b43f0 2024-09-16T01:22:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.265+0000 7fe56cff9640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe55006c2e0 0x7fe55006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.265+0000 7fe56cff9640 1 -- 172.21.15.81:0/3182179833 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fe56008a8d0 con 0x7fe5700b43f0 2024-09-16T01:22:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.265+0000 7fe566ffd640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe55006c2e0 0x7fe55006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.265+0000 7fe566ffd640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe55006c2e0 0x7fe55006e7a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe558034000 tx=0x7fe55802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.269+0000 7fe56cff9640 1 -- 172.21.15.81:0/3182179833 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5600587d0 con 0x7fe5700b43f0 2024-09-16T01:22:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.474+0000 7fe575f59640 1 -- 172.21.15.81:0/3182179833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe570070b50 con 0x7fe5700b43f0 2024-09-16T01:22:10.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.475+0000 7fe56cff9640 1 -- 172.21.15.81:0/3182179833 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+5228 (secure 0 0 0) 0x7fe56005cad0 con 0x7fe5700b43f0 2024-09-16T01:22:10.477 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:10.477 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"btime":"2024-09-16T01:22:03:106587+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2485445274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2485445274},{"type":"v1","addr":"172.21.15.81:6835","nonce":2485445274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1320169323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1320169323},{"type":"v1","addr":"172.21.15.81:6837","nonce":1320169323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2539150967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2539150967},{"type":"v1","addr":"172.21.15.102:6834","nonce":2539150967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:00.439163+0000","modified":"2024-09-16T01:22:02.433729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.102:6835/415655488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":415655488},{"type":"v1","addr":"172.21.15.102:6835","nonce":415655488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7266,"qdb_cluster":[7266]},"id":8}]} 2024-09-16T01:22:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 58 2024-09-16T01:22:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.477+0000 7fe575f59640 1 -- 172.21.15.81:0/3182179833 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe55006c2e0 msgr2=0x7fe55006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.477+0000 7fe575f59640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe55006c2e0 0x7fe55006e7a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe558034000 tx=0x7fe55802e000 comp rx=0 tx=0).stop 2024-09-16T01:22:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.477+0000 7fe575f59640 1 -- 172.21.15.81:0/3182179833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5700b43f0 msgr2=0x7fe570146b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.477+0000 7fe575f59640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5700b43f0 0x7fe570146b30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fe56000c700 tx=0x7fe56000cb00 comp rx=0 tx=0).stop 2024-09-16T01:22:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.478+0000 7fe575f59640 1 -- 172.21.15.81:0/3182179833 shutdown_connections 2024-09-16T01:22:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.478+0000 7fe575f59640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe55006c2e0 0x7fe55006e7a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.478+0000 7fe575f59640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe57015b340 0x7fe5701550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.478+0000 7fe575f59640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5700b5050 0x7fe5700cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.478+0000 7fe575f59640 1 --2- 172.21.15.81:0/3182179833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5700b43f0 0x7fe570146b30 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:10.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.478+0000 7fe575f59640 1 -- 172.21.15.81:0/3182179833 >> 172.21.15.81:0/3182179833 conn(0x7fe570073490 msgr2=0x7fe57015a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:10.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.478+0000 7fe575f59640 1 -- 172.21.15.81:0/3182179833 shutdown_connections 2024-09-16T01:22:10.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:10.478+0000 7fe575f59640 1 -- 172.21.15.81:0/3182179833 wait complete. 2024-09-16T01:22:10.490 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-16T01:22:10.612 INFO:teuthology.orchestra.run.smithi102.stdout:[{"id":6532,"entity":{"name":{"type":"client","num":6532},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":4215577957}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":2.8939372799999998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9915853153404739,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6532 v1:192.168.0.1:0/4215577957","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi102","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":6526,"entity":{"name":{"type":"client","num":6526},"addr":{"type":"v1","addr":"172.21.15.81:0","nonce":1939130418}},"state":"open","num_leases":1,"num_caps":500,"request_load_avg":523,"uptime":4.0579120529999999,"requests_in_flight":498,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1000.5514341268967,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.6526 v1:172.21.15.81:0/1939130418","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi081","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-16T01:22:10.613 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi102", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 4215577957, "type": "v1" }, "name": { "num": 6532, "type": "client" } }, "id": 6532, "inst": "client.6532 v1:192.168.0.1:0/4215577957", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.991585315340474 }, "state": "open", "uptime": 2.89393728 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi081", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 1939130418, "type": "v1" }, "name": { "num": 6526, "type": "client" } }, "id": 6526, "inst": "client.6526 v1:172.21.15.81:0/1939130418", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 500, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 523, "requests_in_flight": 498, "session_cache_liveness": { "halflife": 300, "value": 1000.5514341268967 }, "state": "open", "uptime": 4.057912053 } ] 2024-09-16T01:22:10.613 DEBUG:tasks.ceph_test_case:wait_until_equal: 500 != 802, waiting (timeout=600)... 2024-09-16T01:22:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:waiting with handles open 2024-09-16T01:22:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:22:13.006 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:22:15.008 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:22:15.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.723+0000 7f885316d640 1 Processor -- start 2024-09-16T01:22:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.723+0000 7f885316d640 1 -- start start 2024-09-16T01:22:15.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.724+0000 7f885316d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f884c147360 0x7f884c070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.724+0000 7f885316d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f884c070dd0 0x7f884c0d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.724+0000 7f885316d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f884c0d09e0 0x7f884c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.724+0000 7f885316d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f884c06cb30 con 0x7f884c070dd0 2024-09-16T01:22:15.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.724+0000 7f885316d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f884c0d0e30 con 0x7f884c0d09e0 2024-09-16T01:22:15.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.724+0000 7f885316d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f884c06bfb0 con 0x7f884c147360 2024-09-16T01:22:15.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.724+0000 7f884bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f884c070dd0 0x7f884c0d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.725+0000 7f884bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f884c070dd0 0x7f884c0d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53866/0 (socket says 172.21.15.81:53866) 2024-09-16T01:22:15.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.725+0000 7f884bfff640 1 -- 172.21.15.81:0/2619882796 learned_addr learned my addr 172.21.15.81:0/2619882796 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:15.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.725+0000 7f8850f09640 1 --2- 172.21.15.81:0/2619882796 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f884c147360 0x7f884c070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.725+0000 7f885170a640 1 --2- 172.21.15.81:0/2619882796 >> v2:172.21.15.102:3300/0 conn(0x7f884c0d09e0 0x7f884c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.725+0000 7f884bfff640 1 -- 172.21.15.81:0/2619882796 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f884c147360 msgr2=0x7f884c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:15.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.725+0000 7f884bfff640 1 --2- 172.21.15.81:0/2619882796 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f884c147360 0x7f884c070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.725+0000 7f884bfff640 1 -- 172.21.15.81:0/2619882796 >> v2:172.21.15.102:3300/0 conn(0x7f884c0d09e0 msgr2=0x7f884c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:15.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.725+0000 7f884bfff640 1 --2- 172.21.15.81:0/2619882796 >> v2:172.21.15.102:3300/0 conn(0x7f884c0d09e0 0x7f884c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.725+0000 7f884bfff640 1 -- 172.21.15.81:0/2619882796 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c06c290 con 0x7f884c070dd0 2024-09-16T01:22:15.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f884bfff640 1 --2- 172.21.15.81:0/2619882796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884c070dd0 0x7f884c0d04a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f884c072f50 tx=0x7f884002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be06cdf069645c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:15.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f884b7fe640 1 -- 172.21.15.81:0/2619882796 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840036070 con 0x7f884c070dd0 2024-09-16T01:22:15.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f884b7fe640 1 -- 172.21.15.81:0/2619882796 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8840031600 con 0x7f884c070dd0 2024-09-16T01:22:15.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f884b7fe640 1 -- 172.21.15.81:0/2619882796 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88400319d0 con 0x7f884c070dd0 2024-09-16T01:22:15.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f885316d640 1 -- 172.21.15.81:0/2619882796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884c070dd0 msgr2=0x7f884c0d04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f885316d640 1 --2- 172.21.15.81:0/2619882796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884c070dd0 0x7f884c0d04a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f884c072f50 tx=0x7f884002a610 comp rx=0 tx=0).stop 2024-09-16T01:22:15.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f885316d640 1 -- 172.21.15.81:0/2619882796 shutdown_connections 2024-09-16T01:22:15.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f885316d640 1 --2- 172.21.15.81:0/2619882796 >> v2:172.21.15.102:3300/0 conn(0x7f884c0d09e0 0x7f884c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f885316d640 1 --2- 172.21.15.81:0/2619882796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884c070dd0 0x7f884c0d04a0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f885316d640 1 --2- 172.21.15.81:0/2619882796 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f884c147360 0x7f884c070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f885316d640 1 -- 172.21.15.81:0/2619882796 >> 172.21.15.81:0/2619882796 conn(0x7f884c0b2f40 msgr2=0x7f884c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:15.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f885316d640 1 -- 172.21.15.81:0/2619882796 shutdown_connections 2024-09-16T01:22:15.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.726+0000 7f885316d640 1 -- 172.21.15.81:0/2619882796 wait complete. 2024-09-16T01:22:15.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.728+0000 7f885316d640 1 Processor -- start 2024-09-16T01:22:15.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.728+0000 7f885316d640 1 -- start start 2024-09-16T01:22:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.728+0000 7f885316d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884c070dd0 0x7f884c141cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.728+0000 7f885316d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f884c0d09e0 0x7f884c0b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f885316d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f884c147360 0x7f884c0b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f885316d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f884c06bc10 con 0x7f884c070dd0 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f885316d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f884c06c850 con 0x7f884c0d09e0 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f885316d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f884c06bd90 con 0x7f884c147360 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f8850f09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884c070dd0 0x7f884c141cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f8850f09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884c070dd0 0x7f884c141cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53880/0 (socket says 172.21.15.81:53880) 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f8850f09640 1 -- 172.21.15.81:0/517366032 learned_addr learned my addr 172.21.15.81:0/517366032 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f884bfff640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f884c0d09e0 0x7f884c0b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f885170a640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f884c147360 0x7f884c0b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f8850f09640 1 -- 172.21.15.81:0/517366032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f884c147360 msgr2=0x7f884c0b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f8850f09640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f884c147360 0x7f884c0b6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f8850f09640 1 -- 172.21.15.81:0/517366032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f884c0d09e0 msgr2=0x7f884c0b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f8850f09640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f884c0d09e0 0x7f884c0b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f8850f09640 1 -- 172.21.15.81:0/517366032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c1f4340 con 0x7f884c070dd0 2024-09-16T01:22:15.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f884bfff640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f884c0d09e0 0x7f884c0b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:15.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f885170a640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f884c147360 0x7f884c0b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:15.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f8850f09640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884c070dd0 0x7f884c141cc0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f883c00d830 tx=0x7f883c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:15.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f88497fa640 1 -- 172.21.15.81:0/517366032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c00b6c0 con 0x7f884c070dd0 2024-09-16T01:22:15.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f88497fa640 1 -- 172.21.15.81:0/517366032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f883c019070 con 0x7f884c070dd0 2024-09-16T01:22:15.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f88497fa640 1 -- 172.21.15.81:0/517366032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c00ba80 con 0x7f884c070dd0 2024-09-16T01:22:15.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f885316d640 1 -- 172.21.15.81:0/517366032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884c1f45e0 con 0x7f884c070dd0 2024-09-16T01:22:15.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.729+0000 7f885316d640 1 -- 172.21.15.81:0/517366032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884c1f4ba0 con 0x7f884c070dd0 2024-09-16T01:22:15.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.730+0000 7f885316d640 1 -- 172.21.15.81:0/517366032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f884c0d04a0 con 0x7f884c070dd0 2024-09-16T01:22:15.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.731+0000 7f88497fa640 1 -- 172.21.15.81:0/517366032 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f883c01e460 con 0x7f884c070dd0 2024-09-16T01:22:15.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.731+0000 7f88497fa640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f883806c2b0 0x7f883806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:15.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.731+0000 7f88497fa640 1 -- 172.21.15.81:0/517366032 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f883c08bca0 con 0x7f884c070dd0 2024-09-16T01:22:15.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.731+0000 7f884bfff640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f883806c2b0 0x7f883806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:15.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.732+0000 7f884bfff640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f883806c2b0 0x7f883806e770 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8840033000 tx=0x7f8840009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:15.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.736+0000 7f88497fa640 1 -- 172.21.15.81:0/517366032 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f883c05a280 con 0x7f884c070dd0 2024-09-16T01:22:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.935+0000 7f885316d640 1 -- 172.21.15.81:0/517366032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f884c09f150 con 0x7f884c070dd0 2024-09-16T01:22:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.935+0000 7f88497fa640 1 -- 172.21.15.81:0/517366032 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5228 (secure 0 0 0) 0x7f883c059b80 con 0x7f884c070dd0 2024-09-16T01:22:15.937 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:15.937 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":59,"btime":"2024-09-16T01:22:13:349866+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2485445274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2485445274},{"type":"v1","addr":"172.21.15.81:6835","nonce":2485445274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1320169323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1320169323},{"type":"v1","addr":"172.21.15.81:6837","nonce":1320169323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2539150967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2539150967},{"type":"v1","addr":"172.21.15.102:6834","nonce":2539150967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:00.439163+0000","modified":"2024-09-16T01:22:13.128563+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":6,"addr":"172.21.15.102:6835/415655488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":415655488},{"type":"v1","addr":"172.21.15.102:6835","nonce":415655488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7266,"qdb_cluster":[7266]},"id":8}]} 2024-09-16T01:22:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 59 2024-09-16T01:22:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.937+0000 7f885316d640 1 -- 172.21.15.81:0/517366032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f883806c2b0 msgr2=0x7f883806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.937+0000 7f885316d640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f883806c2b0 0x7f883806e770 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8840033000 tx=0x7f8840009000 comp rx=0 tx=0).stop 2024-09-16T01:22:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.937+0000 7f885316d640 1 -- 172.21.15.81:0/517366032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884c070dd0 msgr2=0x7f884c141cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.937+0000 7f885316d640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884c070dd0 0x7f884c141cc0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f883c00d830 tx=0x7f883c00dcf0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.937+0000 7f885316d640 1 -- 172.21.15.81:0/517366032 shutdown_connections 2024-09-16T01:22:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.937+0000 7f885316d640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f883806c2b0 0x7f883806e770 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.937+0000 7f885316d640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f884c147360 0x7f884c0b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.937+0000 7f885316d640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f884c0d09e0 0x7f884c0b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.937+0000 7f885316d640 1 --2- 172.21.15.81:0/517366032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f884c070dd0 0x7f884c141cc0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.937+0000 7f885316d640 1 -- 172.21.15.81:0/517366032 >> 172.21.15.81:0/517366032 conn(0x7f884c0b2f40 msgr2=0x7f884c0b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.937+0000 7f885316d640 1 -- 172.21.15.81:0/517366032 shutdown_connections 2024-09-16T01:22:15.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:15.937+0000 7f885316d640 1 -- 172.21.15.81:0/517366032 wait complete. 2024-09-16T01:22:15.950 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-16T01:22:16.076 INFO:teuthology.orchestra.run.smithi102.stdout:[{"id":6532,"entity":{"name":{"type":"client","num":6532},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":4215577957}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":8.3578188620000002,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9540561901592661,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6532 v1:192.168.0.1:0/4215577957","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi102","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":6526,"entity":{"name":{"type":"client","num":6526},"addr":{"type":"v1","addr":"172.21.15.81:0","nonce":1939130418}},"state":"open","num_leases":1,"num_caps":802,"request_load_avg":776,"uptime":9.5217936349999999,"requests_in_flight":0,"num_completed_requests":299,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":1933.3466991676707,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":629.11229997455132,"halflife":1.5},"recall_caps_throttle2o":{"value":143.74980844658222,"halflife":0.5},"session_cache_liveness":{"value":1584.7761071627324,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":530,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.6526 v1:172.21.15.81:0/1939130418","completed_requests":[{"tid":530,"created_ino":"0x100000003e9"},{"tid":531,"created_ino":"0x100000003ea"},{"tid":532,"created_ino":"0x100000003eb"},{"tid":533,"created_ino":"0x100000003ec"},{"tid":534,"created_ino":"0x100000003ed"},{"tid":535,"created_ino":"0x100000003ee"},{"tid":536,"created_ino":"0x100000003ef"},{"tid":537,"created_ino":"0x100000003f0"},{"tid":538,"created_ino":"0x100000003f1"},{"tid":539,"created_ino":"0x100000003f2"},{"tid":540,"created_ino":"0x100000003f3"},{"tid":541,"created_ino":"0x100000003f4"},{"tid":542,"created_ino":"0x100000003f5"},{"tid":543,"created_ino":"0x100000003f6"},{"tid":544,"created_ino":"0x100000003f7"},{"tid":545,"created_ino":"0x100000003f8"},{"tid":546,"created_ino":"0x100000003f9"},{"tid":547,"created_ino":"0x100000003fa"},{"tid":548,"created_ino":"0x100000003fb"},{"tid":549,"created_ino":"0x100000003fc"},{"tid":550,"created_ino":"0x100000003fd"},{"tid":551,"created_ino":"0x100000003fe"},{"tid":552,"created_ino":"0x100000003ff"},{"tid":553,"created_ino":"0x10000000400"},{"tid":554,"created_ino":"0x10000000401"},{"tid":555,"created_ino":"0x10000000402"},{"tid":556,"created_ino":"0x10000000403"},{"tid":557,"created_ino":"0x10000000404"},{"tid":558,"created_ino":"0x10000000405"},{"tid":559,"created_ino":"0x10000000406"},{"tid":560,"created_ino":"0x10000000407"},{"tid":561,"created_ino":"0x10000000408"},{"tid":562,"created_ino":"0x10000000409"},{"tid":563,"created_ino":"0x1000000040a"},{"tid":564,"created_ino":"0x1000000040b"},{"tid":565,"created_ino":"0x1000000040c"},{"tid":566,"created_ino":"0x1000000040d"},{"tid":567,"created_ino":"0x1000000040e"},{"tid":568,"created_ino":"0x1000000040f"},{"tid":569,"created_ino":"0x10000000410"},{"tid":570,"created_ino":"0x10000000411"},{"tid":571,"created_ino":"0x10000000412"},{"tid":572,"created_ino":"0x10000000413"},{"tid":573,"created_ino":"0x10000000414"},{"tid":574,"created_ino":"0x10000000415"},{"tid":575,"created_ino":"0x10000000416"},{"tid":576,"created_ino":"0x10000000417"},{"tid":577,"created_ino":"0x10000000418"},{"tid":578,"created_ino":"0x10000000419"},{"tid":579,"created_ino":"0x1000000041a"},{"tid":580,"created_ino":"0x1000000041b"},{"tid":581,"created_ino":"0x1000000041c"},{"tid":582,"created_ino":"0x1000000041d"},{"tid":583,"created_ino":"0x1000000041e"},{"tid":584,"created_ino":"0x1000000041f"},{"tid":585,"created_ino":"0x10000000420"},{"tid":586,"created_ino":"0x10000000421"},{"tid":587,"created_ino":"0x10000000422"},{"tid":588,"created_ino":"0x10000000423"},{"tid":589,"created_ino":"0x10000000424"},{"tid":590,"created_ino":"0x10000000425"},{"tid":591,"created_ino":"0x10000000426"},{"tid":592,"created_ino":"0x10000000427"},{"tid":593,"created_ino":"0x10000000428"},{"tid":594,"created_ino":"0x10000000429"},{"tid":595,"created_ino":"0x1000000042a"},{"tid":596,"created_ino":"0x1000000042b"},{"tid":597,"created_ino":"0x1000000042c"},{"tid":598,"created_ino":"0x1000000042d"},{"tid":599,"created_ino":"0x1000000042e"},{"tid":600,"created_ino":"0x1000000042f"},{"tid":601,"created_ino":"0x10000000430"},{"tid":602,"created_ino":"0x10000000431"},{"tid":603,"created_ino":"0x10000000432"},{"tid":604,"created_ino":"0x10000000433"},{"tid":605,"created_ino":"0x10000000434"},{"tid":606,"created_ino":"0x10000000435"},{"tid":607,"created_ino":"0x10000000436"},{"tid":608,"created_ino":"0x10000000437"},{"tid":609,"created_ino":"0x10000000438"},{"tid":610,"created_ino":"0x10000000439"},{"tid":611,"created_ino":"0x1000000043a"},{"tid":612,"created_ino":"0x1000000043b"},{"tid":613,"created_ino":"0x1000000043c"},{"tid":614,"created_ino":"0x1000000043d"},{"tid":615,"created_ino":"0x1000000043e"},{"tid":616,"created_ino":"0x1000000043f"},{"tid":617,"created_ino":"0x10000000440"},{"tid":618,"created_ino":"0x10000000441"},{"tid":619,"created_ino":"0x10000000442"},{"tid":620,"created_ino":"0x10000000443"},{"tid":621,"created_ino":"0x10000000444"},{"tid":622,"created_ino":"0x10000000445"},{"tid":623,"created_ino":"0x10000000446"},{"tid":624,"created_ino":"0x10000000447"},{"tid":625,"created_ino":"0x10000000448"},{"tid":626,"created_ino":"0x10000000449"},{"tid":627,"created_ino":"0x1000000044a"},{"tid":628,"created_ino":"0x1000000044b"},{"tid":629,"created_ino":"0x1000000044c"},{"tid":630,"created_ino":"0x1000000044d"},{"tid":631,"created_ino":"0x1000000044e"},{"tid":632,"created_ino":"0x1000000044f"},{"tid":633,"created_ino":"0x10000000450"},{"tid":634,"created_ino":"0x10000000451"},{"tid":635,"created_ino":"0x10000000452"},{"tid":636,"created_ino":"0x10000000453"},{"tid":637,"created_ino":"0x10000000454"},{"tid":638,"created_ino":"0x10000000455"},{"tid":639,"created_ino":"0x10000000456"},{"tid":640,"created_ino":"0x10000000457"},{"tid":641,"created_ino":"0x10000000458"},{"tid":642,"created_ino":"0x10000000459"},{"tid":643,"created_ino":"0x1000000045a"},{"tid":644,"created_ino":"0x1000000045b"},{"tid":645,"created_ino":"0x1000000045c"},{"tid":646,"created_ino":"0x1000000045d"},{"tid":647,"created_ino":"0x1000000045e"},{"tid":648,"created_ino":"0x1000000045f"},{"tid":649,"created_ino":"0x10000000460"},{"tid":650,"created_ino":"0x10000000461"},{"tid":651,"created_ino":"0x10000000462"},{"tid":652,"created_ino":"0x10000000463"},{"tid":653,"created_ino":"0x10000000464"},{"tid":654,"created_ino":"0x10000000465"},{"tid":655,"created_ino":"0x10000000466"},{"tid":656,"created_ino":"0x10000000467"},{"tid":657,"created_ino":"0x10000000468"},{"tid":658,"created_ino":"0x10000000469"},{"tid":659,"created_ino":"0x1000000046a"},{"tid":660,"created_ino":"0x1000000046b"},{"tid":661,"created_ino":"0x1000000046c"},{"tid":662,"created_ino":"0x1000000046d"},{"tid":663,"created_ino":"0x1000000046e"},{"tid":664,"created_ino":"0x1000000046f"},{"tid":665,"created_ino":"0x10000000470"},{"tid":666,"created_ino":"0x10000000471"},{"tid":667,"created_ino":"0x10000000472"},{"tid":668,"created_ino":"0x10000000473"},{"tid":669,"created_ino":"0x10000000474"},{"tid":670,"created_ino":"0x10000000475"},{"tid":671,"created_ino":"0x10000000476"},{"tid":672,"created_ino":"0x10000000477"},{"tid":673,"created_ino":"0x10000000478"},{"tid":674,"created_ino":"0x10000000479"},{"tid":675,"created_ino":"0x1000000047a"},{"tid":676,"created_ino":"0x1000000047b"},{"tid":677,"created_ino":"0x1000000047c"},{"tid":678,"created_ino":"0x1000000047d"},{"tid":679,"created_ino":"0x1000000047e"},{"tid":680,"created_ino":"0x1000000047f"},{"tid":681,"created_ino":"0x10000000480"},{"tid":682,"created_ino":"0x10000000481"},{"tid":683,"created_ino":"0x10000000482"},{"tid":684,"created_ino":"0x10000000483"},{"tid":685,"created_ino":"0x10000000484"},{"tid":686,"created_ino":"0x10000000485"},{"tid":687,"created_ino":"0x10000000486"},{"tid":688,"created_ino":"0x10000000487"},{"tid":689,"created_ino":"0x10000000488"},{"tid":690,"created_ino":"0x10000000489"},{"tid":691,"created_ino":"0x1000000048a"},{"tid":692,"created_ino":"0x1000000048b"},{"tid":693,"created_ino":"0x1000000048c"},{"tid":694,"created_ino":"0x1000000048d"},{"tid":695,"created_ino":"0x1000000048e"},{"tid":696,"created_ino":"0x1000000048f"},{"tid":697,"created_ino":"0x10000000490"},{"tid":698,"created_ino":"0x10000000491"},{"tid":699,"created_ino":"0x10000000492"},{"tid":700,"created_ino":"0x10000000493"},{"tid":701,"created_ino":"0x10000000494"},{"tid":702,"created_ino":"0x10000000495"},{"tid":703,"created_ino":"0x10000000496"},{"tid":704,"created_ino":"0x10000000497"},{"tid":705,"created_ino":"0x10000000498"},{"tid":706,"created_ino":"0x10000000499"},{"tid":707,"created_ino":"0x1000000049a"},{"tid":708,"created_ino":"0x1000000049b"},{"tid":709,"created_ino":"0x1000000049c"},{"tid":710,"created_ino":"0x1000000049d"},{"tid":711,"created_ino":"0x1000000049e"},{"tid":712,"created_ino":"0x1000000049f"},{"tid":713,"created_ino":"0x100000004a0"},{"tid":714,"created_ino":"0x100000004a1"},{"tid":715,"created_ino":"0x100000004a2"},{"tid":716,"created_ino":"0x100000004a3"},{"tid":717,"created_ino":"0x100000004a4"},{"tid":718,"created_ino":"0x100000004a5"},{"tid":719,"created_ino":"0x100000004a6"},{"tid":720,"created_ino":"0x100000004a7"},{"tid":721,"created_ino":"0x100000004a8"},{"tid":722,"created_ino":"0x100000004a9"},{"tid":723,"created_ino":"0x100000004aa"},{"tid":724,"created_ino":"0x100000004ab"},{"tid":725,"created_ino":"0x100000004ac"},{"tid":726,"created_ino":"0x100000004ad"},{"tid":727,"created_ino":"0x100000004ae"},{"tid":728,"created_ino":"0x100000004af"},{"tid":729,"created_ino":"0x100000004b0"},{"tid":730,"created_ino":"0x100000004b1"},{"tid":731,"created_ino":"0x100000004b2"},{"tid":732,"created_ino":"0x100000004b3"},{"tid":733,"created_ino":"0x100000004b4"},{"tid":734,"created_ino":"0x100000004b5"},{"tid":735,"created_ino":"0x100000004b6"},{"tid":736,"created_ino":"0x100000004b7"},{"tid":737,"created_ino":"0x100000004b8"},{"tid":738,"created_ino":"0x100000004b9"},{"tid":739,"created_ino":"0x100000004ba"},{"tid":740,"created_ino":"0x100000004bb"},{"tid":741,"created_ino":"0x100000004bc"},{"tid":742,"created_ino":"0x100000004bd"},{"tid":743,"created_ino":"0x100000004be"},{"tid":744,"created_ino":"0x100000004bf"},{"tid":745,"created_ino":"0x100000004c0"},{"tid":746,"created_ino":"0x100000004c1"},{"tid":747,"created_ino":"0x100000004c2"},{"tid":748,"created_ino":"0x100000004c3"},{"tid":749,"created_ino":"0x100000004c4"},{"tid":750,"created_ino":"0x100000004c5"},{"tid":751,"created_ino":"0x100000004c6"},{"tid":752,"created_ino":"0x100000004c7"},{"tid":753,"created_ino":"0x100000004c8"},{"tid":754,"created_ino":"0x100000004c9"},{"tid":755,"created_ino":"0x100000004ca"},{"tid":756,"created_ino":"0x100000004cb"},{"tid":757,"created_ino":"0x100000004cc"},{"tid":758,"created_ino":"0x100000004cd"},{"tid":759,"created_ino":"0x100000004ce"},{"tid":760,"created_ino":"0x100000004cf"},{"tid":761,"created_ino":"0x100000004d0"},{"tid":762,"created_ino":"0x100000004d1"},{"tid":763,"created_ino":"0x100000004d2"},{"tid":764,"created_ino":"0x100000004d3"},{"tid":765,"created_ino":"0x100000004d4"},{"tid":766,"created_ino":"0x100000004d5"},{"tid":767,"created_ino":"0x100000004d6"},{"tid":768,"created_ino":"0x100000004d7"},{"tid":769,"created_ino":"0x100000004d8"},{"tid":770,"created_ino":"0x100000004d9"},{"tid":771,"created_ino":"0x100000004da"},{"tid":772,"created_ino":"0x100000004db"},{"tid":773,"created_ino":"0x100000004dc"},{"tid":774,"created_ino":"0x100000004dd"},{"tid":775,"created_ino":"0x100000004de"},{"tid":776,"created_ino":"0x100000004df"},{"tid":777,"created_ino":"0x100000004e0"},{"tid":778,"created_ino":"0x100000004e1"},{"tid":779,"created_ino":"0x100000004e2"},{"tid":780,"created_ino":"0x100000004e3"},{"tid":781,"created_ino":"0x100000004e4"},{"tid":782,"created_ino":"0x100000004e5"},{"tid":783,"created_ino":"0x100000004e6"},{"tid":784,"created_ino":"0x100000004e7"},{"tid":785,"created_ino":"0x100000004e8"},{"tid":786,"created_ino":"0x100000004e9"},{"tid":787,"created_ino":"0x100000004ea"},{"tid":788,"created_ino":"0x100000004eb"},{"tid":789,"created_ino":"0x100000004ec"},{"tid":790,"created_ino":"0x100000004ed"},{"tid":791,"created_ino":"0x100000004ee"},{"tid":792,"created_ino":"0x100000004ef"},{"tid":793,"created_ino":"0x100000004f0"},{"tid":794,"created_ino":"0x100000004f1"},{"tid":795,"created_ino":"0x100000004f2"},{"tid":796,"created_ino":"0x100000004f3"},{"tid":797,"created_ino":"0x100000004f4"},{"tid":798,"created_ino":"0x100000004f5"},{"tid":799,"created_ino":"0x100000004f6"},{"tid":800,"created_ino":"0x100000004f7"},{"tid":801,"created_ino":"0x100000004f8"},{"tid":802,"created_ino":"0x100000004f9"},{"tid":803,"created_ino":"0x100000004fa"},{"tid":804,"created_ino":"0x100000004fb"},{"tid":805,"created_ino":"0x100000004fc"},{"tid":806,"created_ino":"0x100000004fd"},{"tid":807,"created_ino":"0x100000004fe"},{"tid":808,"created_ino":"0x100000004ff"},{"tid":809,"created_ino":"0x10000000500"},{"tid":810,"created_ino":"0x10000000501"},{"tid":811,"created_ino":"0x10000000502"},{"tid":812,"created_ino":"0x10000000503"},{"tid":813,"created_ino":"0x10000000504"},{"tid":814,"created_ino":"0x10000000505"},{"tid":815,"created_ino":"0x10000000506"},{"tid":816,"created_ino":"0x10000000507"},{"tid":817,"created_ino":"0x10000000508"},{"tid":818,"created_ino":"0x10000000509"},{"tid":819,"created_ino":"0x1000000050a"},{"tid":820,"created_ino":"0x1000000050b"},{"tid":821,"created_ino":"0x1000000050c"},{"tid":822,"created_ino":"0x1000000050d"},{"tid":823,"created_ino":"0x1000000050e"},{"tid":824,"created_ino":"0x1000000050f"},{"tid":825,"created_ino":"0x10000000510"},{"tid":826,"created_ino":"0x10000000511"},{"tid":827,"created_ino":"0x10000000512"},{"tid":828,"created_ino":"0x10000000513"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x10000000514","length":203},{"start":"0x100000005e0","length":501}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi081","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-16T01:22:16.079 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi102", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 4215577957, "type": "v1" }, "name": { "num": 6532, "type": "client" } }, "id": 6532, "inst": "client.6532 v1:192.168.0.1:0/4215577957", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.954056190159266 }, "state": "open", "uptime": 8.357818862 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi081", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x100000003e9", "tid": 530 }, { "created_ino": "0x100000003ea", "tid": 531 }, { "created_ino": "0x100000003eb", "tid": 532 }, { "created_ino": "0x100000003ec", "tid": 533 }, { "created_ino": "0x100000003ed", "tid": 534 }, { "created_ino": "0x100000003ee", "tid": 535 }, { "created_ino": "0x100000003ef", "tid": 536 }, { "created_ino": "0x100000003f0", "tid": 537 }, { "created_ino": "0x100000003f1", "tid": 538 }, { "created_ino": "0x100000003f2", "tid": 539 }, { "created_ino": "0x100000003f3", "tid": 540 }, { "created_ino": "0x100000003f4", "tid": 541 }, { "created_ino": "0x100000003f5", "tid": 542 }, { "created_ino": "0x100000003f6", "tid": 543 }, { "created_ino": "0x100000003f7", "tid": 544 }, { "created_ino": "0x100000003f8", "tid": 545 }, { "created_ino": "0x100000003f9", "tid": 546 }, { "created_ino": "0x100000003fa", "tid": 547 }, { "created_ino": "0x100000003fb", "tid": 548 }, { "created_ino": "0x100000003fc", "tid": 549 }, { "created_ino": "0x100000003fd", "tid": 550 }, { "created_ino": "0x100000003fe", "tid": 551 }, { "created_ino": "0x100000003ff", "tid": 552 }, { "created_ino": "0x10000000400", "tid": 553 }, { "created_ino": "0x10000000401", "tid": 554 }, { "created_ino": "0x10000000402", "tid": 555 }, { "created_ino": "0x10000000403", "tid": 556 }, { "created_ino": "0x10000000404", "tid": 557 }, { "created_ino": "0x10000000405", "tid": 558 }, { "created_ino": "0x10000000406", "tid": 559 }, { "created_ino": "0x10000000407", "tid": 560 }, { "created_ino": "0x10000000408", "tid": 561 }, { "created_ino": "0x10000000409", "tid": 562 }, { "created_ino": "0x1000000040a", "tid": 563 }, { "created_ino": "0x1000000040b", "tid": 564 }, { "created_ino": "0x1000000040c", "tid": 565 }, { "created_ino": "0x1000000040d", "tid": 566 }, { "created_ino": "0x1000000040e", "tid": 567 }, { "created_ino": "0x1000000040f", "tid": 568 }, { "created_ino": "0x10000000410", "tid": 569 }, { "created_ino": "0x10000000411", "tid": 570 }, { "created_ino": "0x10000000412", "tid": 571 }, { "created_ino": "0x10000000413", "tid": 572 }, { "created_ino": "0x10000000414", "tid": 573 }, { "created_ino": "0x10000000415", "tid": 574 }, { "created_ino": "0x10000000416", "tid": 575 }, { "created_ino": "0x10000000417", "tid": 576 }, { "created_ino": "0x10000000418", "tid": 577 }, { "created_ino": "0x10000000419", "tid": 578 }, { "created_ino": "0x1000000041a", "tid": 579 }, { "created_ino": "0x1000000041b", "tid": 580 }, { "created_ino": "0x1000000041c", "tid": 581 }, { "created_ino": "0x1000000041d", "tid": 582 }, { "created_ino": "0x1000000041e", "tid": 583 }, { "created_ino": "0x1000000041f", "tid": 584 }, { "created_ino": "0x10000000420", "tid": 585 }, { "created_ino": "0x10000000421", "tid": 586 }, { "created_ino": "0x10000000422", "tid": 587 }, { "created_ino": "0x10000000423", "tid": 588 }, { "created_ino": "0x10000000424", "tid": 589 }, { "created_ino": "0x10000000425", "tid": 590 }, { "created_ino": "0x10000000426", "tid": 591 }, { "created_ino": "0x10000000427", "tid": 592 }, { "created_ino": "0x10000000428", "tid": 593 }, { "created_ino": "0x10000000429", "tid": 594 }, { "created_ino": "0x1000000042a", "tid": 595 }, { "created_ino": "0x1000000042b", "tid": 596 }, { "created_ino": "0x1000000042c", "tid": 597 }, { "created_ino": "0x1000000042d", "tid": 598 }, { "created_ino": "0x1000000042e", "tid": 599 }, { "created_ino": "0x1000000042f", "tid": 600 }, { "created_ino": "0x10000000430", "tid": 601 }, { "created_ino": "0x10000000431", "tid": 602 }, { "created_ino": "0x10000000432", "tid": 603 }, { "created_ino": "0x10000000433", "tid": 604 }, { "created_ino": "0x10000000434", "tid": 605 }, { "created_ino": "0x10000000435", "tid": 606 }, { "created_ino": "0x10000000436", "tid": 607 }, { "created_ino": "0x10000000437", "tid": 608 }, { "created_ino": "0x10000000438", "tid": 609 }, { "created_ino": "0x10000000439", "tid": 610 }, { "created_ino": "0x1000000043a", "tid": 611 }, { "created_ino": "0x1000000043b", "tid": 612 }, { "created_ino": "0x1000000043c", "tid": 613 }, { "created_ino": "0x1000000043d", "tid": 614 }, { "created_ino": "0x1000000043e", "tid": 615 }, { "created_ino": "0x1000000043f", "tid": 616 }, { "created_ino": "0x10000000440", "tid": 617 }, { "created_ino": "0x10000000441", "tid": 618 }, { "created_ino": "0x10000000442", "tid": 619 }, { "created_ino": "0x10000000443", "tid": 620 }, { "created_ino": "0x10000000444", "tid": 621 }, { "created_ino": "0x10000000445", "tid": 622 }, { "created_ino": "0x10000000446", "tid": 623 }, { "created_ino": "0x10000000447", "tid": 624 }, { "created_ino": "0x10000000448", "tid": 625 }, { "created_ino": "0x10000000449", "tid": 626 }, { "created_ino": "0x1000000044a", "tid": 627 }, { "created_ino": "0x1000000044b", "tid": 628 }, { "created_ino": "0x1000000044c", "tid": 629 }, { "created_ino": "0x1000000044d", "tid": 630 }, { "created_ino": "0x1000000044e", "tid": 631 }, { "created_ino": "0x1000000044f", "tid": 632 }, { "created_ino": "0x10000000450", "tid": 633 }, { "created_ino": "0x10000000451", "tid": 634 }, { "created_ino": "0x10000000452", "tid": 635 }, { "created_ino": "0x10000000453", "tid": 636 }, { "created_ino": "0x10000000454", "tid": 637 }, { "created_ino": "0x10000000455", "tid": 638 }, { "created_ino": "0x10000000456", "tid": 639 }, { "created_ino": "0x10000000457", "tid": 640 }, { "created_ino": "0x10000000458", "tid": 641 }, { "created_ino": "0x10000000459", "tid": 642 }, { "created_ino": "0x1000000045a", "tid": 643 }, { "created_ino": "0x1000000045b", "tid": 644 }, { "created_ino": "0x1000000045c", "tid": 645 }, { "created_ino": "0x1000000045d", "tid": 646 }, { "created_ino": "0x1000000045e", "tid": 647 }, { "created_ino": "0x1000000045f", "tid": 648 }, { "created_ino": "0x10000000460", "tid": 649 }, { "created_ino": "0x10000000461", "tid": 650 }, { "created_ino": "0x10000000462", "tid": 651 }, { "created_ino": "0x10000000463", "tid": 652 }, { "created_ino": "0x10000000464", "tid": 653 }, { "created_ino": "0x10000000465", "tid": 654 }, { "created_ino": "0x10000000466", "tid": 655 }, { "created_ino": "0x10000000467", "tid": 656 }, { "created_ino": "0x10000000468", "tid": 657 }, { "created_ino": "0x10000000469", "tid": 658 }, { "created_ino": "0x1000000046a", "tid": 659 }, { "created_ino": "0x1000000046b", "tid": 660 }, { "created_ino": "0x1000000046c", "tid": 661 }, { "created_ino": "0x1000000046d", "tid": 662 }, { "created_ino": "0x1000000046e", "tid": 663 }, { "created_ino": "0x1000000046f", "tid": 664 }, { "created_ino": "0x10000000470", "tid": 665 }, { "created_ino": "0x10000000471", "tid": 666 }, { "created_ino": "0x10000000472", "tid": 667 }, { "created_ino": "0x10000000473", "tid": 668 }, { "created_ino": "0x10000000474", "tid": 669 }, { "created_ino": "0x10000000475", "tid": 670 }, { "created_ino": "0x10000000476", "tid": 671 }, { "created_ino": "0x10000000477", "tid": 672 }, { "created_ino": "0x10000000478", "tid": 673 }, { "created_ino": "0x10000000479", "tid": 674 }, { "created_ino": "0x1000000047a", "tid": 675 }, { "created_ino": "0x1000000047b", "tid": 676 }, { "created_ino": "0x1000000047c", "tid": 677 }, { "created_ino": "0x1000000047d", "tid": 678 }, { "created_ino": "0x1000000047e", "tid": 679 }, { "created_ino": "0x1000000047f", "tid": 680 }, { "created_ino": "0x10000000480", "tid": 681 }, { "created_ino": "0x10000000481", "tid": 682 }, { "created_ino": "0x10000000482", "tid": 683 }, { "created_ino": "0x10000000483", "tid": 684 }, { "created_ino": "0x10000000484", "tid": 685 }, { "created_ino": "0x10000000485", "tid": 686 }, { "created_ino": "0x10000000486", "tid": 687 }, { "created_ino": "0x10000000487", "tid": 688 }, { "created_ino": "0x10000000488", "tid": 689 }, { "created_ino": "0x10000000489", "tid": 690 }, { "created_ino": "0x1000000048a", "tid": 691 }, { "created_ino": "0x1000000048b", "tid": 692 }, { "created_ino": "0x1000000048c", "tid": 693 }, { "created_ino": "0x1000000048d", "tid": 694 }, { "created_ino": "0x1000000048e", "tid": 695 }, { "created_ino": "0x1000000048f", "tid": 696 }, { "created_ino": "0x10000000490", "tid": 697 }, { "created_ino": "0x10000000491", "tid": 698 }, { "created_ino": "0x10000000492", "tid": 699 }, { "created_ino": "0x10000000493", "tid": 700 }, { "created_ino": "0x10000000494", "tid": 701 }, { "created_ino": "0x10000000495", "tid": 702 }, { "created_ino": "0x10000000496", "tid": 703 }, { "created_ino": "0x10000000497", "tid": 704 }, { "created_ino": "0x10000000498", "tid": 705 }, { "created_ino": "0x10000000499", "tid": 706 }, { "created_ino": "0x1000000049a", "tid": 707 }, { "created_ino": "0x1000000049b", "tid": 708 }, { "created_ino": "0x1000000049c", "tid": 709 }, { "created_ino": "0x1000000049d", "tid": 710 }, { "created_ino": "0x1000000049e", "tid": 711 }, { "created_ino": "0x1000000049f", "tid": 712 }, { "created_ino": "0x100000004a0", "tid": 713 }, { "created_ino": "0x100000004a1", "tid": 714 }, { "created_ino": "0x100000004a2", "tid": 715 }, { "created_ino": "0x100000004a3", "tid": 716 }, { "created_ino": "0x100000004a4", "tid": 717 }, { "created_ino": "0x100000004a5", "tid": 718 }, { "created_ino": "0x100000004a6", "tid": 719 }, { "created_ino": "0x100000004a7", "tid": 720 }, { "created_ino": "0x100000004a8", "tid": 721 }, { "created_ino": "0x100000004a9", "tid": 722 }, { "created_ino": "0x100000004aa", "tid": 723 }, { "created_ino": "0x100000004ab", "tid": 724 }, { "created_ino": "0x100000004ac", "tid": 725 }, { "created_ino": "0x100000004ad", "tid": 726 }, { "created_ino": "0x100000004ae", "tid": 727 }, { "created_ino": "0x100000004af", "tid": 728 }, { "created_ino": "0x100000004b0", "tid": 729 }, { "created_ino": "0x100000004b1", "tid": 730 }, { "created_ino": "0x100000004b2", "tid": 731 }, { "created_ino": "0x100000004b3", "tid": 732 }, { "created_ino": "0x100000004b4", "tid": 733 }, { "created_ino": "0x100000004b5", "tid": 734 }, { "created_ino": "0x100000004b6", "tid": 735 }, { "created_ino": "0x100000004b7", "tid": 736 }, { "created_ino": "0x100000004b8", "tid": 737 }, { "created_ino": "0x100000004b9", "tid": 738 }, { "created_ino": "0x100000004ba", "tid": 739 }, { "created_ino": "0x100000004bb", "tid": 740 }, { "created_ino": "0x100000004bc", "tid": 741 }, { "created_ino": "0x100000004bd", "tid": 742 }, { "created_ino": "0x100000004be", "tid": 743 }, { "created_ino": "0x100000004bf", "tid": 744 }, { "created_ino": "0x100000004c0", "tid": 745 }, { "created_ino": "0x100000004c1", "tid": 746 }, { "created_ino": "0x100000004c2", "tid": 747 }, { "created_ino": "0x100000004c3", "tid": 748 }, { "created_ino": "0x100000004c4", "tid": 749 }, { "created_ino": "0x100000004c5", "tid": 750 }, { "created_ino": "0x100000004c6", "tid": 751 }, { "created_ino": "0x100000004c7", "tid": 752 }, { "created_ino": "0x100000004c8", "tid": 753 }, { "created_ino": "0x100000004c9", "tid": 754 }, { "created_ino": "0x100000004ca", "tid": 755 }, { "created_ino": "0x100000004cb", "tid": 756 }, { "created_ino": "0x100000004cc", "tid": 757 }, { "created_ino": "0x100000004cd", "tid": 758 }, { "created_ino": "0x100000004ce", "tid": 759 }, { "created_ino": "0x100000004cf", "tid": 760 }, { "created_ino": "0x100000004d0", "tid": 761 }, { "created_ino": "0x100000004d1", "tid": 762 }, { "created_ino": "0x100000004d2", "tid": 763 }, { "created_ino": "0x100000004d3", "tid": 764 }, { "created_ino": "0x100000004d4", "tid": 765 }, { "created_ino": "0x100000004d5", "tid": 766 }, { "created_ino": "0x100000004d6", "tid": 767 }, { "created_ino": "0x100000004d7", "tid": 768 }, { "created_ino": "0x100000004d8", "tid": 769 }, { "created_ino": "0x100000004d9", "tid": 770 }, { "created_ino": "0x100000004da", "tid": 771 }, { "created_ino": "0x100000004db", "tid": 772 }, { "created_ino": "0x100000004dc", "tid": 773 }, { "created_ino": "0x100000004dd", "tid": 774 }, { "created_ino": "0x100000004de", "tid": 775 }, { "created_ino": "0x100000004df", "tid": 776 }, { "created_ino": "0x100000004e0", "tid": 777 }, { "created_ino": "0x100000004e1", "tid": 778 }, { "created_ino": "0x100000004e2", "tid": 779 }, { "created_ino": "0x100000004e3", "tid": 780 }, { "created_ino": "0x100000004e4", "tid": 781 }, { "created_ino": "0x100000004e5", "tid": 782 }, { "created_ino": "0x100000004e6", "tid": 783 }, { "created_ino": "0x100000004e7", "tid": 784 }, { "created_ino": "0x100000004e8", "tid": 785 }, { "created_ino": "0x100000004e9", "tid": 786 }, { "created_ino": "0x100000004ea", "tid": 787 }, { "created_ino": "0x100000004eb", "tid": 788 }, { "created_ino": "0x100000004ec", "tid": 789 }, { "created_ino": "0x100000004ed", "tid": 790 }, { "created_ino": "0x100000004ee", "tid": 791 }, { "created_ino": "0x100000004ef", "tid": 792 }, { "created_ino": "0x100000004f0", "tid": 793 }, { "created_ino": "0x100000004f1", "tid": 794 }, { "created_ino": "0x100000004f2", "tid": 795 }, { "created_ino": "0x100000004f3", "tid": 796 }, { "created_ino": "0x100000004f4", "tid": 797 }, { "created_ino": "0x100000004f5", "tid": 798 }, { "created_ino": "0x100000004f6", "tid": 799 }, { "created_ino": "0x100000004f7", "tid": 800 }, { "created_ino": "0x100000004f8", "tid": 801 }, { "created_ino": "0x100000004f9", "tid": 802 }, { "created_ino": "0x100000004fa", "tid": 803 }, { "created_ino": "0x100000004fb", "tid": 804 }, { "created_ino": "0x100000004fc", "tid": 805 }, { "created_ino": "0x100000004fd", "tid": 806 }, { "created_ino": "0x100000004fe", "tid": 807 }, { "created_ino": "0x100000004ff", "tid": 808 }, { "created_ino": "0x10000000500", "tid": 809 }, { "created_ino": "0x10000000501", "tid": 810 }, { "created_ino": "0x10000000502", "tid": 811 }, { "created_ino": "0x10000000503", "tid": 812 }, { "created_ino": "0x10000000504", "tid": 813 }, { "created_ino": "0x10000000505", "tid": 814 }, { "created_ino": "0x10000000506", "tid": 815 }, { "created_ino": "0x10000000507", "tid": 816 }, { "created_ino": "0x10000000508", "tid": 817 }, { "created_ino": "0x10000000509", "tid": 818 }, { "created_ino": "0x1000000050a", "tid": 819 }, { "created_ino": "0x1000000050b", "tid": 820 }, { "created_ino": "0x1000000050c", "tid": 821 }, { "created_ino": "0x1000000050d", "tid": 822 }, { "created_ino": "0x1000000050e", "tid": 823 }, { "created_ino": "0x1000000050f", "tid": 824 }, { "created_ino": "0x10000000510", "tid": 825 }, { "created_ino": "0x10000000511", "tid": 826 }, { "created_ino": "0x10000000512", "tid": 827 }, { "created_ino": "0x10000000513", "tid": 828 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 1939130418, "type": "v1" }, "name": { "num": 6526, "type": "client" } }, "id": 6526, "inst": "client.6526 v1:172.21.15.81:0/1939130418", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 530, "num_caps": 802, "num_completed_flushes": 0, "num_completed_requests": 299, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 203, "start": "0x10000000514" }, { "length": 501, "start": "0x100000005e0" } ], "recall_caps": { "halflife": 60, "value": 1933.3466991676707 }, "recall_caps_throttle": { "halflife": 1.5, "value": 629.1122999745513 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 143.74980844658222 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 776, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1584.7761071627324 }, "state": "open", "uptime": 9.521793635 } ] 2024-09-16T01:22:16.079 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-09-16T01:22:16.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:22:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.177+0000 7f0647149640 1 Processor -- start 2024-09-16T01:22:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.177+0000 7f0647149640 1 -- start start 2024-09-16T01:22:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.178+0000 7f0647149640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f064006dbd0 0x7f064009b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.178+0000 7f0647149640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06400d1970 con 0x7f064015e740 2024-09-16T01:22:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.178+0000 7f0647149640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064006e000 con 0x7f06400d1540 2024-09-16T01:22:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.178+0000 7f0647149640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f064015eb20 con 0x7f064006dbd0 2024-09-16T01:22:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.178+0000 7f0644ee5640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f064015e740 0x7f064006d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42188/0 (socket says 172.21.15.81:42188) 2024-09-16T01:22:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.178+0000 7f0644ee5640 1 -- 172.21.15.81:0/3346627338 learned_addr learned my addr 172.21.15.81:0/3346627338 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.178+0000 7f06456e6640 1 --2- 172.21.15.81:0/3346627338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f064006dbd0 0x7f064009b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.178+0000 7f06377fe640 1 -- 172.21.15.81:0/3346627338 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069691861 0 0) 0x7f06400d1970 con 0x7f064015e740 2024-09-16T01:22:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.178+0000 7f06377fe640 1 -- 172.21.15.81:0/3346627338 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0628003520 con 0x7f064015e740 2024-09-16T01:22:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.178+0000 7f06377fe640 1 -- 172.21.15.81:0/3346627338 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624575050 0 0) 0x7f064006e000 con 0x7f06400d1540 2024-09-16T01:22:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.178+0000 7f06377fe640 1 -- 172.21.15.81:0/3346627338 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06400d1970 con 0x7f06400d1540 2024-09-16T01:22:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.179+0000 7f06456e6640 1 -- 172.21.15.81:0/3346627338 >> v1:172.21.15.102:6789/0 conn(0x7f06400d1540 legacy=0x7f0640070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.179+0000 7f06456e6640 1 -- 172.21.15.81:0/3346627338 >> v1:172.21.15.81:6789/0 conn(0x7f064015e740 legacy=0x7f064006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.179+0000 7f06456e6640 1 -- 172.21.15.81:0/3346627338 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06400d0780 con 0x7f064006dbd0 2024-09-16T01:22:16.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.179+0000 7f06456e6640 1 --2- 172.21.15.81:0/3346627338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f064006dbd0 0x7f064009b690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0638009dc0 tx=0x7f063802a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94f468371ffca93b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:16.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.179+0000 7f06377fe640 1 -- 172.21.15.81:0/3346627338 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638007740 con 0x7f064006dbd0 2024-09-16T01:22:16.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.179+0000 7f06377fe640 1 -- 172.21.15.81:0/3346627338 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06380078e0 con 0x7f064006dbd0 2024-09-16T01:22:16.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.179+0000 7f06377fe640 1 -- 172.21.15.81:0/3346627338 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638007c90 con 0x7f064006dbd0 2024-09-16T01:22:16.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.180+0000 7f0647149640 1 -- 172.21.15.81:0/3346627338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f064006dbd0 msgr2=0x7f064009b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.180+0000 7f0647149640 1 --2- 172.21.15.81:0/3346627338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f064006dbd0 0x7f064009b690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0638009dc0 tx=0x7f063802a760 comp rx=0 tx=0).stop 2024-09-16T01:22:16.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.180+0000 7f0647149640 1 -- 172.21.15.81:0/3346627338 shutdown_connections 2024-09-16T01:22:16.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.180+0000 7f0647149640 1 --2- 172.21.15.81:0/3346627338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f064006dbd0 0x7f064009b690 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.180+0000 7f0647149640 1 -- 172.21.15.81:0/3346627338 >> 172.21.15.81:0/3346627338 conn(0x7f06400d23a0 msgr2=0x7f06400d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:16.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.180+0000 7f0647149640 1 -- 172.21.15.81:0/3346627338 shutdown_connections 2024-09-16T01:22:16.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.180+0000 7f0647149640 1 -- 172.21.15.81:0/3346627338 wait complete. 2024-09-16T01:22:16.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.181+0000 7f0647149640 1 Processor -- start 2024-09-16T01:22:16.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.181+0000 7f0647149640 1 -- start start 2024-09-16T01:22:16.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f0647149640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064006dbd0 0x7f06400b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f0647149640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06400d1540 0x7f06400cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f0647149640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064015e740 0x7f06400cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f0647149640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06400d1020 con 0x7f064006dbd0 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f0647149640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f06400d0d40 con 0x7f064015e740 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f0647149640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f064006cd20 con 0x7f06400d1540 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f0644ee5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064006dbd0 0x7f06400b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f0644ee5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064006dbd0 0x7f06400b7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53890/0 (socket says 172.21.15.81:53890) 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f0644ee5640 1 -- 172.21.15.81:0/119315415 learned_addr learned my addr 172.21.15.81:0/119315415 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f0637fff640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06400d1540 0x7f06400cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f06456e6640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064015e740 0x7f06400cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f0644ee5640 1 -- 172.21.15.81:0/119315415 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06400d1540 msgr2=0x7f06400cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.182+0000 7f0644ee5640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06400d1540 0x7f06400cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.183+0000 7f0644ee5640 1 -- 172.21.15.81:0/119315415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064015e740 msgr2=0x7f06400cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.183+0000 7f0644ee5640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064015e740 0x7f06400cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.183+0000 7f0644ee5640 1 -- 172.21.15.81:0/119315415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06400afda0 con 0x7f064006dbd0 2024-09-16T01:22:16.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.183+0000 7f06456e6640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064015e740 0x7f06400cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:16.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.183+0000 7f0637fff640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06400d1540 0x7f06400cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:16.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.183+0000 7f0644ee5640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064006dbd0 0x7f06400b7c70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f063c00c440 tx=0x7f063c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:16.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.183+0000 7f06357fa640 1 -- 172.21.15.81:0/119315415 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c017070 con 0x7f064006dbd0 2024-09-16T01:22:16.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.183+0000 7f06357fa640 1 -- 172.21.15.81:0/119315415 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063c005ce0 con 0x7f064006dbd0 2024-09-16T01:22:16.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.183+0000 7f0647149640 1 -- 172.21.15.81:0/119315415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06400b0080 con 0x7f064006dbd0 2024-09-16T01:22:16.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.183+0000 7f06357fa640 1 -- 172.21.15.81:0/119315415 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c007270 con 0x7f064006dbd0 2024-09-16T01:22:16.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.183+0000 7f0647149640 1 -- 172.21.15.81:0/119315415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06400c9830 con 0x7f064006dbd0 2024-09-16T01:22:16.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.184+0000 7f0647149640 1 -- 172.21.15.81:0/119315415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f064006d0e0 con 0x7f064006dbd0 2024-09-16T01:22:16.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.184+0000 7f06357fa640 1 -- 172.21.15.81:0/119315415 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f063c01a070 con 0x7f064006dbd0 2024-09-16T01:22:16.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.185+0000 7f06357fa640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f062c06c2b0 0x7f062c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:16.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.185+0000 7f06357fa640 1 -- 172.21.15.81:0/119315415 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f063c08a800 con 0x7f064006dbd0 2024-09-16T01:22:16.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.185+0000 7f0637fff640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f062c06c2b0 0x7f062c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:16.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.185+0000 7f0637fff640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f062c06c2b0 0x7f062c06e770 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f06401f7c40 tx=0x7f0630009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:16.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.189+0000 7f06357fa640 1 -- 172.21.15.81:0/119315415 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f063c0587a0 con 0x7f064006dbd0 2024-09-16T01:22:16.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.393+0000 7f0647149640 1 -- 172.21.15.81:0/119315415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f06400d1cb0 con 0x7f064006dbd0 2024-09-16T01:22:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.394+0000 7f06357fa640 1 -- 172.21.15.81:0/119315415 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f063c05caa0 con 0x7f064006dbd0 2024-09-16T01:22:16.396 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:16.396 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:22:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.396+0000 7f0647149640 1 -- 172.21.15.81:0/119315415 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f062c06c2b0 msgr2=0x7f062c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.396+0000 7f0647149640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f062c06c2b0 0x7f062c06e770 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f06401f7c40 tx=0x7f0630009040 comp rx=0 tx=0).stop 2024-09-16T01:22:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.396+0000 7f0647149640 1 -- 172.21.15.81:0/119315415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064006dbd0 msgr2=0x7f06400b7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.396+0000 7f0647149640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064006dbd0 0x7f06400b7c70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f063c00c440 tx=0x7f063c00c900 comp rx=0 tx=0).stop 2024-09-16T01:22:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.396+0000 7f0647149640 1 -- 172.21.15.81:0/119315415 shutdown_connections 2024-09-16T01:22:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.396+0000 7f0647149640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f062c06c2b0 0x7f062c06e770 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.396+0000 7f0647149640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064015e740 0x7f06400cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.396+0000 7f0647149640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f06400d1540 0x7f06400cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.396+0000 7f0647149640 1 --2- 172.21.15.81:0/119315415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f064006dbd0 0x7f06400b7c70 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:16.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.396+0000 7f0647149640 1 -- 172.21.15.81:0/119315415 >> 172.21.15.81:0/119315415 conn(0x7f06400d23a0 msgr2=0x7f06400b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.396+0000 7f0647149640 1 -- 172.21.15.81:0/119315415 shutdown_connections 2024-09-16T01:22:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:16.396+0000 7f0647149640 1 -- 172.21.15.81:0/119315415 wait complete. 2024-09-16T01:22:16.409 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:22:16.409 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:22:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:22:19.013 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:22:21.015 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:22:21.410 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:22:21.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.518+0000 7f6ffe552640 1 Processor -- start 2024-09-16T01:22:21.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.518+0000 7f6ffe552640 1 -- start start 2024-09-16T01:22:21.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.519+0000 7f6ffe552640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff8158c70 0x7f6ff80cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.519+0000 7f6ffe552640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ff815f5e0 0x7f6ff806f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.519+0000 7f6ffe552640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff80ce530 con 0x7f6ff815fae0 2024-09-16T01:22:21.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.519+0000 7f6ffe552640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff80ce810 con 0x7f6ff815f5e0 2024-09-16T01:22:21.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.519+0000 7f6ffe552640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff80ceaf0 con 0x7f6ff8158c70 2024-09-16T01:22:21.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.519+0000 7f6ffcaef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ff815f5e0 0x7f6ff806f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.519+0000 7f6ffcaef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ff815f5e0 0x7f6ff806f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51284/0 (socket says 172.21.15.81:51284) 2024-09-16T01:22:21.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.519+0000 7f6ffcaef640 1 -- 172.21.15.81:0/3372945458 learned_addr learned my addr 172.21.15.81:0/3372945458 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:21.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.519+0000 7f6ffcaef640 1 -- 172.21.15.81:0/3372945458 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff8158c70 msgr2=0x7f6ff80cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:21.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.519+0000 7f6ffcaef640 1 --2- 172.21.15.81:0/3372945458 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff8158c70 0x7f6ff80cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.519+0000 7f6ffcaef640 1 -- 172.21.15.81:0/3372945458 >> v1:172.21.15.102:6789/0 conn(0x7f6ff815fae0 legacy=0x7f6ff815eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:21.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.519+0000 7f6ffcaef640 1 -- 172.21.15.81:0/3372945458 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff806f100 con 0x7f6ff815f5e0 2024-09-16T01:22:21.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.520+0000 7f6ffcaef640 1 --2- 172.21.15.81:0/3372945458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff815f5e0 0x7f6ff806f900 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009e50 tx=0x7f6ff002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfc9c19c4e9f118 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:21.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.520+0000 7f6ff6ffd640 1 -- 172.21.15.81:0/3372945458 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0036070 con 0x7f6ff815f5e0 2024-09-16T01:22:21.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.520+0000 7f6ff6ffd640 1 -- 172.21.15.81:0/3372945458 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff0031600 con 0x7f6ff815f5e0 2024-09-16T01:22:21.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.520+0000 7f6ff6ffd640 1 -- 172.21.15.81:0/3372945458 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff00319d0 con 0x7f6ff815f5e0 2024-09-16T01:22:21.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.521+0000 7f6ffe552640 1 -- 172.21.15.81:0/3372945458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff815f5e0 msgr2=0x7f6ff806f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.521+0000 7f6ffe552640 1 --2- 172.21.15.81:0/3372945458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff815f5e0 0x7f6ff806f900 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0009e50 tx=0x7f6ff002a6c0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.521+0000 7f6ffe552640 1 -- 172.21.15.81:0/3372945458 shutdown_connections 2024-09-16T01:22:21.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.521+0000 7f6ffe552640 1 --2- 172.21.15.81:0/3372945458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff815f5e0 0x7f6ff806f900 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.521+0000 7f6ffe552640 1 --2- 172.21.15.81:0/3372945458 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff8158c70 0x7f6ff80cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.521+0000 7f6ffe552640 1 -- 172.21.15.81:0/3372945458 >> 172.21.15.81:0/3372945458 conn(0x7f6ff80b2f40 msgr2=0x7f6ff80b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:21.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.521+0000 7f6ffe552640 1 -- 172.21.15.81:0/3372945458 shutdown_connections 2024-09-16T01:22:21.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.521+0000 7f6ffe552640 1 -- 172.21.15.81:0/3372945458 wait complete. 2024-09-16T01:22:21.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.522+0000 7f6ffe552640 1 Processor -- start 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.522+0000 7f6ffe552640 1 -- start start 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ffe552640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ff8158c70 0x7f6ff815b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ffe552640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff815f5e0 0x7f6ff814ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ffe552640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff815fae0 0x7f6ff8155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ffe552640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff80ce280 con 0x7f6ff815f5e0 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ffe552640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff80ce100 con 0x7f6ff8158c70 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ffe552640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff8159050 con 0x7f6ff815fae0 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ff77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff815f5e0 0x7f6ff814ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ff77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff815f5e0 0x7f6ff814ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51296/0 (socket says 172.21.15.81:51296) 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ff77fe640 1 -- 172.21.15.81:0/2061346799 learned_addr learned my addr 172.21.15.81:0/2061346799 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ff7fff640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ff8158c70 0x7f6ff815b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ffcaef640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff815fae0 0x7f6ff8155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ff77fe640 1 -- 172.21.15.81:0/2061346799 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff815fae0 msgr2=0x7f6ff8155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ff77fe640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff815fae0 0x7f6ff8155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ff77fe640 1 -- 172.21.15.81:0/2061346799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ff8158c70 msgr2=0x7f6ff815b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ff77fe640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ff8158c70 0x7f6ff815b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ff77fe640 1 -- 172.21.15.81:0/2061346799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff81f66b0 con 0x7f6ff815f5e0 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ff7fff640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ff8158c70 0x7f6ff815b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.523+0000 7f6ffcaef640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff815fae0 0x7f6ff8155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.524+0000 7f6ff77fe640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff815f5e0 0x7f6ff814ab90 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00b410 tx=0x7f6fec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.524+0000 7f6ff4ff9640 1 -- 172.21.15.81:0/2061346799 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec015020 con 0x7f6ff815f5e0 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.524+0000 7f6ff4ff9640 1 -- 172.21.15.81:0/2061346799 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec011830 con 0x7f6ff815f5e0 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.524+0000 7f6ff4ff9640 1 -- 172.21.15.81:0/2061346799 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec011c20 con 0x7f6ff815f5e0 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.524+0000 7f6ffe552640 1 -- 172.21.15.81:0/2061346799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff81f6990 con 0x7f6ff815f5e0 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.524+0000 7f6ffe552640 1 -- 172.21.15.81:0/2061346799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff81f6f50 con 0x7f6ff815f5e0 2024-09-16T01:22:21.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.525+0000 7f6ffe552640 1 -- 172.21.15.81:0/2061346799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff80cdbc0 con 0x7f6ff815f5e0 2024-09-16T01:22:21.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.525+0000 7f6ff4ff9640 1 -- 172.21.15.81:0/2061346799 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6fec018020 con 0x7f6ff815f5e0 2024-09-16T01:22:21.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.526+0000 7f6ff4ff9640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6fe406c2b0 0x7f6fe406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.526+0000 7f6ff4ff9640 1 -- 172.21.15.81:0/2061346799 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f6fec08b4b0 con 0x7f6ff815f5e0 2024-09-16T01:22:21.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.526+0000 7f6ff7fff640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6fe406c2b0 0x7f6fe406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.526+0000 7f6ff7fff640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6fe406c2b0 0x7f6fe406e770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80b6290 tx=0x7f6fe8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:21.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.530+0000 7f6ff4ff9640 1 -- 172.21.15.81:0/2061346799 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6fec01f020 con 0x7f6ff815f5e0 2024-09-16T01:22:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.731+0000 7f6ffe552640 1 -- 172.21.15.81:0/2061346799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6ff81594c0 con 0x7f6ff815f5e0 2024-09-16T01:22:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.732+0000 7f6ff4ff9640 1 -- 172.21.15.81:0/2061346799 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f6fec0172c0 con 0x7f6ff815f5e0 2024-09-16T01:22:21.734 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:21.734 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:22:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.734+0000 7f6ffe552640 1 -- 172.21.15.81:0/2061346799 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6fe406c2b0 msgr2=0x7f6fe406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.734+0000 7f6ffe552640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6fe406c2b0 0x7f6fe406e770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6ff80b6290 tx=0x7f6fe8008040 comp rx=0 tx=0).stop 2024-09-16T01:22:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.734+0000 7f6ffe552640 1 -- 172.21.15.81:0/2061346799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff815f5e0 msgr2=0x7f6ff814ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.734+0000 7f6ffe552640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff815f5e0 0x7f6ff814ab90 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00b410 tx=0x7f6fec00b8d0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.734+0000 7f6ffe552640 1 -- 172.21.15.81:0/2061346799 shutdown_connections 2024-09-16T01:22:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.734+0000 7f6ffe552640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6fe406c2b0 0x7f6fe406e770 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.734+0000 7f6ffe552640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff815fae0 0x7f6ff8155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.734+0000 7f6ffe552640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ff815f5e0 0x7f6ff814ab90 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.734+0000 7f6ffe552640 1 --2- 172.21.15.81:0/2061346799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ff8158c70 0x7f6ff815b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.734+0000 7f6ffe552640 1 -- 172.21.15.81:0/2061346799 >> 172.21.15.81:0/2061346799 conn(0x7f6ff80b2f40 msgr2=0x7f6ff80ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:21.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.734+0000 7f6ffe552640 1 -- 172.21.15.81:0/2061346799 shutdown_connections 2024-09-16T01:22:21.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.734+0000 7f6ffe552640 1 -- 172.21.15.81:0/2061346799 wait complete. 2024-09-16T01:22:21.746 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-16T01:22:21.747 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-09-16T01:22:21.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:22:21.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.841+0000 7f8e872f1640 1 Processor -- start 2024-09-16T01:22:21.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.842+0000 7f8e872f1640 1 -- start start 2024-09-16T01:22:21.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.842+0000 7f8e872f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e8015b300 0x7f8e800cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.842+0000 7f8e872f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e800cdbe0 con 0x7f8e800cd3f0 2024-09-16T01:22:21.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.842+0000 7f8e872f1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e800cd900 con 0x7f8e8006f8d0 2024-09-16T01:22:21.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.842+0000 7f8e872f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8e800728a0 con 0x7f8e8015b300 2024-09-16T01:22:21.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.843+0000 7f8e8508d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e8015b300 0x7f8e800cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.843+0000 7f8e8488c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8e800cd3f0 0x7f8e8006f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60154/0 (socket says 172.21.15.81:60154) 2024-09-16T01:22:21.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.843+0000 7f8e8488c640 1 -- 172.21.15.81:0/3558923742 learned_addr learned my addr 172.21.15.81:0/3558923742 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:21.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.843+0000 7f8e8508d640 1 -- 172.21.15.81:0/3558923742 >> v1:172.21.15.102:6789/0 conn(0x7f8e8006f8d0 legacy=0x7f8e8015b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.843+0000 7f8e8508d640 1 -- 172.21.15.81:0/3558923742 >> v1:172.21.15.81:6789/0 conn(0x7f8e800cd3f0 legacy=0x7f8e8006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.843+0000 7f8e73fff640 1 -- 172.21.15.81:0/3558923742 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3788021747 0 0) 0x7f8e800cdbe0 con 0x7f8e800cd3f0 2024-09-16T01:22:21.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.843+0000 7f8e8508d640 1 -- 172.21.15.81:0/3558923742 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e80072250 con 0x7f8e8015b300 2024-09-16T01:22:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.844+0000 7f8e8508d640 1 --2- 172.21.15.81:0/3558923742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e8015b300 0x7f8e800cceb0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f8e740097a0 tx=0x7f8e7402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54717e547ca1ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.844+0000 7f8e73fff640 1 -- 172.21.15.81:0/3558923742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74037070 con 0x7f8e8015b300 2024-09-16T01:22:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.844+0000 7f8e73fff640 1 -- 172.21.15.81:0/3558923742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e74032440 con 0x7f8e8015b300 2024-09-16T01:22:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.844+0000 7f8e73fff640 1 -- 172.21.15.81:0/3558923742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74032810 con 0x7f8e8015b300 2024-09-16T01:22:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.844+0000 7f8e872f1640 1 -- 172.21.15.81:0/3558923742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e8015b300 msgr2=0x7f8e800cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.844+0000 7f8e872f1640 1 --2- 172.21.15.81:0/3558923742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e8015b300 0x7f8e800cceb0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f8e740097a0 tx=0x7f8e7402a230 comp rx=0 tx=0).stop 2024-09-16T01:22:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.844+0000 7f8e872f1640 1 -- 172.21.15.81:0/3558923742 shutdown_connections 2024-09-16T01:22:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.844+0000 7f8e872f1640 1 --2- 172.21.15.81:0/3558923742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e8015b300 0x7f8e800cceb0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.844+0000 7f8e872f1640 1 -- 172.21.15.81:0/3558923742 >> 172.21.15.81:0/3558923742 conn(0x7f8e80067d70 msgr2=0x7f8e8006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.844+0000 7f8e872f1640 1 -- 172.21.15.81:0/3558923742 shutdown_connections 2024-09-16T01:22:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.844+0000 7f8e872f1640 1 -- 172.21.15.81:0/3558923742 wait complete. 2024-09-16T01:22:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.846+0000 7f8e872f1640 1 Processor -- start 2024-09-16T01:22:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.846+0000 7f8e872f1640 1 -- start start 2024-09-16T01:22:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.846+0000 7f8e872f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e8006f8d0 0x7f8e8014ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.846+0000 7f8e872f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e800cd3f0 0x7f8e800abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.846+0000 7f8e872f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e8015b300 0x7f8e800ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.846+0000 7f8e872f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8e800d0160 con 0x7f8e800cd3f0 2024-09-16T01:22:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.846+0000 7f8e872f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8e800cffe0 con 0x7f8e8006f8d0 2024-09-16T01:22:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.846+0000 7f8e872f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8e80072d30 con 0x7f8e8015b300 2024-09-16T01:22:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.846+0000 7f8e8488c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e800cd3f0 0x7f8e800abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.846+0000 7f8e8488c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e800cd3f0 0x7f8e800abfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51304/0 (socket says 172.21.15.81:51304) 2024-09-16T01:22:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.846+0000 7f8e8488c640 1 -- 172.21.15.81:0/1420869428 learned_addr learned my addr 172.21.15.81:0/1420869428 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.847+0000 7f8e8488c640 1 -- 172.21.15.81:0/1420869428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e8015b300 msgr2=0x7f8e800ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.847+0000 7f8e8488c640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e8015b300 0x7f8e800ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.847+0000 7f8e8488c640 1 -- 172.21.15.81:0/1420869428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e8006f8d0 msgr2=0x7f8e8014ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.847+0000 7f8e8508d640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e8006f8d0 0x7f8e8014ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.847+0000 7f8e8488c640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e8006f8d0 0x7f8e8014ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.847+0000 7f8e8488c640 1 -- 172.21.15.81:0/1420869428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e80157f20 con 0x7f8e800cd3f0 2024-09-16T01:22:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.847+0000 7f8e8488c640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e800cd3f0 0x7f8e800abfc0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00c4d0 tx=0x7f8e7c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.847+0000 7f8e71ffb640 1 -- 172.21.15.81:0/1420869428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c018070 con 0x7f8e800cd3f0 2024-09-16T01:22:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.847+0000 7f8e71ffb640 1 -- 172.21.15.81:0/1420869428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e7c0074e0 con 0x7f8e800cd3f0 2024-09-16T01:22:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.847+0000 7f8e872f1640 1 -- 172.21.15.81:0/1420869428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e800ab390 con 0x7f8e800cd3f0 2024-09-16T01:22:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.847+0000 7f8e71ffb640 1 -- 172.21.15.81:0/1420869428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c004a20 con 0x7f8e800cd3f0 2024-09-16T01:22:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.847+0000 7f8e872f1640 1 -- 172.21.15.81:0/1420869428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e800aa2f0 con 0x7f8e800cd3f0 2024-09-16T01:22:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.848+0000 7f8e872f1640 1 -- 172.21.15.81:0/1420869428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e800b1c00 con 0x7f8e800cd3f0 2024-09-16T01:22:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.849+0000 7f8e71ffb640 1 -- 172.21.15.81:0/1420869428 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8e7c01b070 con 0x7f8e800cd3f0 2024-09-16T01:22:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.849+0000 7f8e71ffb640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8e6406c2b0 0x7f8e6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.849+0000 7f8e71ffb640 1 -- 172.21.15.81:0/1420869428 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f8e7c08a970 con 0x7f8e800cd3f0 2024-09-16T01:22:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.849+0000 7f8e8508d640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8e6406c2b0 0x7f8e6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.850+0000 7f8e8508d640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8e6406c2b0 0x7f8e6406e770 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8e74034000 tx=0x7f8e7402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:21.853+0000 7f8e71ffb640 1 -- 172.21.15.81:0/1420869428 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e80157f20 con 0x7f8e800cd3f0 2024-09-16T01:22:22.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.055+0000 7f8e872f1640 1 -- 172.21.15.81:0/1420869428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8e8006d090 con 0x7f8e800cd3f0 2024-09-16T01:22:22.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.055+0000 7f8e71ffb640 1 -- 172.21.15.81:0/1420869428 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f8e7c058ec0 con 0x7f8e800cd3f0 2024-09-16T01:22:22.057 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:22.057 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:22:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.057+0000 7f8e872f1640 1 -- 172.21.15.81:0/1420869428 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8e6406c2b0 msgr2=0x7f8e6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:22.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.057+0000 7f8e872f1640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8e6406c2b0 0x7f8e6406e770 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8e74034000 tx=0x7f8e7402e000 comp rx=0 tx=0).stop 2024-09-16T01:22:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.057+0000 7f8e872f1640 1 -- 172.21.15.81:0/1420869428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e800cd3f0 msgr2=0x7f8e800abfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.057+0000 7f8e872f1640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e800cd3f0 0x7f8e800abfc0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00c4d0 tx=0x7f8e7c00c990 comp rx=0 tx=0).stop 2024-09-16T01:22:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.057+0000 7f8e872f1640 1 -- 172.21.15.81:0/1420869428 shutdown_connections 2024-09-16T01:22:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.057+0000 7f8e872f1640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8e6406c2b0 0x7f8e6406e770 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.057+0000 7f8e872f1640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e8015b300 0x7f8e800ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.057+0000 7f8e872f1640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e800cd3f0 0x7f8e800abfc0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.057+0000 7f8e872f1640 1 --2- 172.21.15.81:0/1420869428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e8006f8d0 0x7f8e8014ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:22.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.057+0000 7f8e872f1640 1 -- 172.21.15.81:0/1420869428 >> 172.21.15.81:0/1420869428 conn(0x7f8e80067d70 msgr2=0x7f8e8006f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:22.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.057+0000 7f8e872f1640 1 -- 172.21.15.81:0/1420869428 shutdown_connections 2024-09-16T01:22:22.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22.057+0000 7f8e872f1640 1 -- 172.21.15.81:0/1420869428 wait complete. 2024-09-16T01:22:22.070 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-16T01:22:22.070 INFO:tasks.cephfs.test_client_limits:Terminating process holding files open 2024-09-16T01:22:22.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:22 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-16T01:22:23.017 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:22:23.017 INFO:teuthology.orchestra.run.smithi081.stderr:stdin closed, goodbye! 2024-09-16T01:22:23.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:22:23.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:23.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.191+0000 7f0fbf3d6640 1 Processor -- start 2024-09-16T01:22:23.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.191+0000 7f0fbf3d6640 1 -- start start 2024-09-16T01:22:23.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.192+0000 7f0fbf3d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb806f870 0x7f0fb8162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.192+0000 7f0fbf3d6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb815eb60 con 0x7f0fb80b0180 2024-09-16T01:22:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.192+0000 7f0fbf3d6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb815ee40 con 0x7f0fb80b69d0 2024-09-16T01:22:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.192+0000 7f0fbf3d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb80b6db0 con 0x7f0fb806f870 2024-09-16T01:22:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.192+0000 7f0fbc971640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0fb80b0180 0x7f0fb8154d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60162/0 (socket says 172.21.15.81:60162) 2024-09-16T01:22:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.192+0000 7f0fbc971640 1 -- 172.21.15.81:0/3725529730 learned_addr learned my addr 172.21.15.81:0/3725529730 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.192+0000 7f0fbd973640 1 --2- 172.21.15.81:0/3725529730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb806f870 0x7f0fb8162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.193+0000 7f0fb7fff640 1 -- 172.21.15.81:0/3725529730 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581204239 0 0) 0x7f0fb815eb60 con 0x7f0fb80b0180 2024-09-16T01:22:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.193+0000 7f0fb7fff640 1 -- 172.21.15.81:0/3725529730 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fa0003520 con 0x7f0fb80b0180 2024-09-16T01:22:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.193+0000 7f0fb7fff640 1 -- 172.21.15.81:0/3725529730 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 829577130 0 0) 0x7f0fb815ee40 con 0x7f0fb80b69d0 2024-09-16T01:22:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.193+0000 7f0fb7fff640 1 -- 172.21.15.81:0/3725529730 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fb815eb60 con 0x7f0fb80b69d0 2024-09-16T01:22:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.193+0000 7f0fbd973640 1 -- 172.21.15.81:0/3725529730 >> v1:172.21.15.102:6789/0 conn(0x7f0fb80b69d0 legacy=0x7f0fb80afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.193+0000 7f0fbd973640 1 -- 172.21.15.81:0/3725529730 >> v1:172.21.15.81:6789/0 conn(0x7f0fb80b0180 legacy=0x7f0fb8154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.193+0000 7f0fbd973640 1 -- 172.21.15.81:0/3725529730 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb815f120 con 0x7f0fb806f870 2024-09-16T01:22:23.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.194+0000 7f0fbd973640 1 --2- 172.21.15.81:0/3725529730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb806f870 0x7f0fb8162a50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00097d0 tx=0x7f0fb002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9972d8c22052dbd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:23.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.194+0000 7f0fb7fff640 1 -- 172.21.15.81:0/3725529730 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0037070 con 0x7f0fb806f870 2024-09-16T01:22:23.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.194+0000 7f0fb7fff640 1 -- 172.21.15.81:0/3725529730 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb002ae50 con 0x7f0fb806f870 2024-09-16T01:22:23.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.194+0000 7f0fb7fff640 1 -- 172.21.15.81:0/3725529730 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0032660 con 0x7f0fb806f870 2024-09-16T01:22:23.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.194+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/3725529730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb806f870 msgr2=0x7f0fb8162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.194+0000 7f0fbf3d6640 1 --2- 172.21.15.81:0/3725529730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb806f870 0x7f0fb8162a50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0fb00097d0 tx=0x7f0fb002a100 comp rx=0 tx=0).stop 2024-09-16T01:22:23.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.194+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/3725529730 shutdown_connections 2024-09-16T01:22:23.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.194+0000 7f0fbf3d6640 1 --2- 172.21.15.81:0/3725529730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb806f870 0x7f0fb8162a50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.194+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/3725529730 >> 172.21.15.81:0/3725529730 conn(0x7f0fb806bc10 msgr2=0x7f0fb806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:23.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.194+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/3725529730 shutdown_connections 2024-09-16T01:22:23.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.194+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/3725529730 wait complete. 2024-09-16T01:22:23.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.196+0000 7f0fbf3d6640 1 Processor -- start 2024-09-16T01:22:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.196+0000 7f0fbf3d6640 1 -- start start 2024-09-16T01:22:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.196+0000 7f0fbf3d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb806f870 0x7f0fb8159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.196+0000 7f0fbf3d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fb80b0180 0x7f0fb81f8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.196+0000 7f0fbf3d6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb80b69d0 0x7f0fb815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.196+0000 7f0fbf3d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb80af400 con 0x7f0fb806f870 2024-09-16T01:22:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.196+0000 7f0fbf3d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb80af280 con 0x7f0fb80b0180 2024-09-16T01:22:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.196+0000 7f0fbf3d6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb80af580 con 0x7f0fb80b69d0 2024-09-16T01:22:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbd172640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb806f870 0x7f0fb8159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbd172640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb806f870 0x7f0fb8159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51308/0 (socket says 172.21.15.81:51308) 2024-09-16T01:22:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbd172640 1 -- 172.21.15.81:0/38516729 learned_addr learned my addr 172.21.15.81:0/38516729 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbc971640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fb80b0180 0x7f0fb81f8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbd973640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb80b69d0 0x7f0fb815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbd172640 1 -- 172.21.15.81:0/38516729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb80b69d0 msgr2=0x7f0fb815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbd172640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb80b69d0 0x7f0fb815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbd172640 1 -- 172.21.15.81:0/38516729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fb80b0180 msgr2=0x7f0fb81f8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbd172640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fb80b0180 0x7f0fb81f8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbd172640 1 -- 172.21.15.81:0/38516729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb815a720 con 0x7f0fb806f870 2024-09-16T01:22:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbd172640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb806f870 0x7f0fb8159c00 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800c8a0 tx=0x7f0fa800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fb5ffb640 1 -- 172.21.15.81:0/38516729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8003b70 con 0x7f0fb806f870 2024-09-16T01:22:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fb5ffb640 1 -- 172.21.15.81:0/38516729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa8003d30 con 0x7f0fb806f870 2024-09-16T01:22:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fb5ffb640 1 -- 172.21.15.81:0/38516729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800aa30 con 0x7f0fb806f870 2024-09-16T01:22:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/38516729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb815a9d0 con 0x7f0fb806f870 2024-09-16T01:22:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.197+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/38516729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb8159400 con 0x7f0fb806f870 2024-09-16T01:22:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.198+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/38516729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb80aef90 con 0x7f0fb806f870 2024-09-16T01:22:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.199+0000 7f0fb5ffb640 1 -- 172.21.15.81:0/38516729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0fa800abd0 con 0x7f0fb806f870 2024-09-16T01:22:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.199+0000 7f0fb5ffb640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0fa406c2e0 0x7f0fa406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.199+0000 7f0fb5ffb640 1 -- 172.21.15.81:0/38516729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f0fa808b3a0 con 0x7f0fb806f870 2024-09-16T01:22:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.199+0000 7f0fbc971640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0fa406c2e0 0x7f0fa406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.200+0000 7f0fbc971640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0fa406c2e0 0x7f0fa406e7a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0fb81f7c80 tx=0x7f0fac007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.203+0000 7f0fb5ffb640 1 -- 172.21.15.81:0/38516729 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0fb80aef90 con 0x7f0fb806f870 2024-09-16T01:22:23.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.404+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/38516729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fb815c370 con 0x7f0fb806f870 2024-09-16T01:22:23.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.404+0000 7f0fb5ffb640 1 -- 172.21.15.81:0/38516729 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5228 (secure 0 0 0) 0x7f0fa8059340 con 0x7f0fb806f870 2024-09-16T01:22:23.406 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:23.407 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":60,"btime":"2024-09-16T01:22:17:366287+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2485445274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2485445274},{"type":"v1","addr":"172.21.15.81:6835","nonce":2485445274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1320169323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1320169323},{"type":"v1","addr":"172.21.15.81:6837","nonce":1320169323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2539150967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2539150967},{"type":"v1","addr":"172.21.15.102:6834","nonce":2539150967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:00.439163+0000","modified":"2024-09-16T01:22:17.128872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":7,"addr":"172.21.15.102:6835/415655488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":415655488},{"type":"v1","addr":"172.21.15.102:6835","nonce":415655488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7266,"qdb_cluster":[7266]},"id":8}]} 2024-09-16T01:22:23.407 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 60 2024-09-16T01:22:23.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.406+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/38516729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0fa406c2e0 msgr2=0x7f0fa406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.406+0000 7f0fbf3d6640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0fa406c2e0 0x7f0fa406e7a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0fb81f7c80 tx=0x7f0fac007d30 comp rx=0 tx=0).stop 2024-09-16T01:22:23.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.406+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/38516729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb806f870 msgr2=0x7f0fb8159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.406+0000 7f0fbf3d6640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb806f870 0x7f0fb8159c00 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800c8a0 tx=0x7f0fa800cd60 comp rx=0 tx=0).stop 2024-09-16T01:22:23.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.406+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/38516729 shutdown_connections 2024-09-16T01:22:23.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.406+0000 7f0fbf3d6640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0fa406c2e0 0x7f0fa406e7a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.406+0000 7f0fbf3d6640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0fb80b69d0 0x7f0fb815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.406+0000 7f0fbf3d6640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0fb80b0180 0x7f0fb81f8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.406+0000 7f0fbf3d6640 1 --2- 172.21.15.81:0/38516729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb806f870 0x7f0fb8159c00 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.407+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/38516729 >> 172.21.15.81:0/38516729 conn(0x7f0fb806bc10 msgr2=0x7f0fb80ae880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:23.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.407+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/38516729 shutdown_connections 2024-09-16T01:22:23.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.407+0000 7f0fbf3d6640 1 -- 172.21.15.81:0/38516729 wait complete. 2024-09-16T01:22:23.419 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-16T01:22:23.535 INFO:teuthology.orchestra.run.smithi102.stdout:[{"id":6532,"entity":{"name":{"type":"client","num":6532},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":4215577957}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":15.819657142000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9035632755011735,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6532 v1:192.168.0.1:0/4215577957","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi102","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":6526,"entity":{"name":{"type":"client","num":6526},"addr":{"type":"v1","addr":"172.21.15.81:0","nonce":1939130418}},"state":"open","num_leases":1,"num_caps":402,"request_load_avg":712,"uptime":16.983631915,"requests_in_flight":0,"num_completed_requests":299,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":4435.0844619964246,"halflife":60},"release_caps":{"value":398.54386489678933,"halflife":60},"recall_caps_throttle":{"value":895.19886542708525,"halflife":1.5},"recall_caps_throttle2o":{"value":305.4492520701238,"halflife":0.5},"session_cache_liveness":{"value":1557.6879410683573,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":530,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.6526 v1:172.21.15.81:0/1939130418","completed_requests":[{"tid":530,"created_ino":"0x100000003e9"},{"tid":531,"created_ino":"0x100000003ea"},{"tid":532,"created_ino":"0x100000003eb"},{"tid":533,"created_ino":"0x100000003ec"},{"tid":534,"created_ino":"0x100000003ed"},{"tid":535,"created_ino":"0x100000003ee"},{"tid":536,"created_ino":"0x100000003ef"},{"tid":537,"created_ino":"0x100000003f0"},{"tid":538,"created_ino":"0x100000003f1"},{"tid":539,"created_ino":"0x100000003f2"},{"tid":540,"created_ino":"0x100000003f3"},{"tid":541,"created_ino":"0x100000003f4"},{"tid":542,"created_ino":"0x100000003f5"},{"tid":543,"created_ino":"0x100000003f6"},{"tid":544,"created_ino":"0x100000003f7"},{"tid":545,"created_ino":"0x100000003f8"},{"tid":546,"created_ino":"0x100000003f9"},{"tid":547,"created_ino":"0x100000003fa"},{"tid":548,"created_ino":"0x100000003fb"},{"tid":549,"created_ino":"0x100000003fc"},{"tid":550,"created_ino":"0x100000003fd"},{"tid":551,"created_ino":"0x100000003fe"},{"tid":552,"created_ino":"0x100000003ff"},{"tid":553,"created_ino":"0x10000000400"},{"tid":554,"created_ino":"0x10000000401"},{"tid":555,"created_ino":"0x10000000402"},{"tid":556,"created_ino":"0x10000000403"},{"tid":557,"created_ino":"0x10000000404"},{"tid":558,"created_ino":"0x10000000405"},{"tid":559,"created_ino":"0x10000000406"},{"tid":560,"created_ino":"0x10000000407"},{"tid":561,"created_ino":"0x10000000408"},{"tid":562,"created_ino":"0x10000000409"},{"tid":563,"created_ino":"0x1000000040a"},{"tid":564,"created_ino":"0x1000000040b"},{"tid":565,"created_ino":"0x1000000040c"},{"tid":566,"created_ino":"0x1000000040d"},{"tid":567,"created_ino":"0x1000000040e"},{"tid":568,"created_ino":"0x1000000040f"},{"tid":569,"created_ino":"0x10000000410"},{"tid":570,"created_ino":"0x10000000411"},{"tid":571,"created_ino":"0x10000000412"},{"tid":572,"created_ino":"0x10000000413"},{"tid":573,"created_ino":"0x10000000414"},{"tid":574,"created_ino":"0x10000000415"},{"tid":575,"created_ino":"0x10000000416"},{"tid":576,"created_ino":"0x10000000417"},{"tid":577,"created_ino":"0x10000000418"},{"tid":578,"created_ino":"0x10000000419"},{"tid":579,"created_ino":"0x1000000041a"},{"tid":580,"created_ino":"0x1000000041b"},{"tid":581,"created_ino":"0x1000000041c"},{"tid":582,"created_ino":"0x1000000041d"},{"tid":583,"created_ino":"0x1000000041e"},{"tid":584,"created_ino":"0x1000000041f"},{"tid":585,"created_ino":"0x10000000420"},{"tid":586,"created_ino":"0x10000000421"},{"tid":587,"created_ino":"0x10000000422"},{"tid":588,"created_ino":"0x10000000423"},{"tid":589,"created_ino":"0x10000000424"},{"tid":590,"created_ino":"0x10000000425"},{"tid":591,"created_ino":"0x10000000426"},{"tid":592,"created_ino":"0x10000000427"},{"tid":593,"created_ino":"0x10000000428"},{"tid":594,"created_ino":"0x10000000429"},{"tid":595,"created_ino":"0x1000000042a"},{"tid":596,"created_ino":"0x1000000042b"},{"tid":597,"created_ino":"0x1000000042c"},{"tid":598,"created_ino":"0x1000000042d"},{"tid":599,"created_ino":"0x1000000042e"},{"tid":600,"created_ino":"0x1000000042f"},{"tid":601,"created_ino":"0x10000000430"},{"tid":602,"created_ino":"0x10000000431"},{"tid":603,"created_ino":"0x10000000432"},{"tid":604,"created_ino":"0x10000000433"},{"tid":605,"created_ino":"0x10000000434"},{"tid":606,"created_ino":"0x10000000435"},{"tid":607,"created_ino":"0x10000000436"},{"tid":608,"created_ino":"0x10000000437"},{"tid":609,"created_ino":"0x10000000438"},{"tid":610,"created_ino":"0x10000000439"},{"tid":611,"created_ino":"0x1000000043a"},{"tid":612,"created_ino":"0x1000000043b"},{"tid":613,"created_ino":"0x1000000043c"},{"tid":614,"created_ino":"0x1000000043d"},{"tid":615,"created_ino":"0x1000000043e"},{"tid":616,"created_ino":"0x1000000043f"},{"tid":617,"created_ino":"0x10000000440"},{"tid":618,"created_ino":"0x10000000441"},{"tid":619,"created_ino":"0x10000000442"},{"tid":620,"created_ino":"0x10000000443"},{"tid":621,"created_ino":"0x10000000444"},{"tid":622,"created_ino":"0x10000000445"},{"tid":623,"created_ino":"0x10000000446"},{"tid":624,"created_ino":"0x10000000447"},{"tid":625,"created_ino":"0x10000000448"},{"tid":626,"created_ino":"0x10000000449"},{"tid":627,"created_ino":"0x1000000044a"},{"tid":628,"created_ino":"0x1000000044b"},{"tid":629,"created_ino":"0x1000000044c"},{"tid":630,"created_ino":"0x1000000044d"},{"tid":631,"created_ino":"0x1000000044e"},{"tid":632,"created_ino":"0x1000000044f"},{"tid":633,"created_ino":"0x10000000450"},{"tid":634,"created_ino":"0x10000000451"},{"tid":635,"created_ino":"0x10000000452"},{"tid":636,"created_ino":"0x10000000453"},{"tid":637,"created_ino":"0x10000000454"},{"tid":638,"created_ino":"0x10000000455"},{"tid":639,"created_ino":"0x10000000456"},{"tid":640,"created_ino":"0x10000000457"},{"tid":641,"created_ino":"0x10000000458"},{"tid":642,"created_ino":"0x10000000459"},{"tid":643,"created_ino":"0x1000000045a"},{"tid":644,"created_ino":"0x1000000045b"},{"tid":645,"created_ino":"0x1000000045c"},{"tid":646,"created_ino":"0x1000000045d"},{"tid":647,"created_ino":"0x1000000045e"},{"tid":648,"created_ino":"0x1000000045f"},{"tid":649,"created_ino":"0x10000000460"},{"tid":650,"created_ino":"0x10000000461"},{"tid":651,"created_ino":"0x10000000462"},{"tid":652,"created_ino":"0x10000000463"},{"tid":653,"created_ino":"0x10000000464"},{"tid":654,"created_ino":"0x10000000465"},{"tid":655,"created_ino":"0x10000000466"},{"tid":656,"created_ino":"0x10000000467"},{"tid":657,"created_ino":"0x10000000468"},{"tid":658,"created_ino":"0x10000000469"},{"tid":659,"created_ino":"0x1000000046a"},{"tid":660,"created_ino":"0x1000000046b"},{"tid":661,"created_ino":"0x1000000046c"},{"tid":662,"created_ino":"0x1000000046d"},{"tid":663,"created_ino":"0x1000000046e"},{"tid":664,"created_ino":"0x1000000046f"},{"tid":665,"created_ino":"0x10000000470"},{"tid":666,"created_ino":"0x10000000471"},{"tid":667,"created_ino":"0x10000000472"},{"tid":668,"created_ino":"0x10000000473"},{"tid":669,"created_ino":"0x10000000474"},{"tid":670,"created_ino":"0x10000000475"},{"tid":671,"created_ino":"0x10000000476"},{"tid":672,"created_ino":"0x10000000477"},{"tid":673,"created_ino":"0x10000000478"},{"tid":674,"created_ino":"0x10000000479"},{"tid":675,"created_ino":"0x1000000047a"},{"tid":676,"created_ino":"0x1000000047b"},{"tid":677,"created_ino":"0x1000000047c"},{"tid":678,"created_ino":"0x1000000047d"},{"tid":679,"created_ino":"0x1000000047e"},{"tid":680,"created_ino":"0x1000000047f"},{"tid":681,"created_ino":"0x10000000480"},{"tid":682,"created_ino":"0x10000000481"},{"tid":683,"created_ino":"0x10000000482"},{"tid":684,"created_ino":"0x10000000483"},{"tid":685,"created_ino":"0x10000000484"},{"tid":686,"created_ino":"0x10000000485"},{"tid":687,"created_ino":"0x10000000486"},{"tid":688,"created_ino":"0x10000000487"},{"tid":689,"created_ino":"0x10000000488"},{"tid":690,"created_ino":"0x10000000489"},{"tid":691,"created_ino":"0x1000000048a"},{"tid":692,"created_ino":"0x1000000048b"},{"tid":693,"created_ino":"0x1000000048c"},{"tid":694,"created_ino":"0x1000000048d"},{"tid":695,"created_ino":"0x1000000048e"},{"tid":696,"created_ino":"0x1000000048f"},{"tid":697,"created_ino":"0x10000000490"},{"tid":698,"created_ino":"0x10000000491"},{"tid":699,"created_ino":"0x10000000492"},{"tid":700,"created_ino":"0x10000000493"},{"tid":701,"created_ino":"0x10000000494"},{"tid":702,"created_ino":"0x10000000495"},{"tid":703,"created_ino":"0x10000000496"},{"tid":704,"created_ino":"0x10000000497"},{"tid":705,"created_ino":"0x10000000498"},{"tid":706,"created_ino":"0x10000000499"},{"tid":707,"created_ino":"0x1000000049a"},{"tid":708,"created_ino":"0x1000000049b"},{"tid":709,"created_ino":"0x1000000049c"},{"tid":710,"created_ino":"0x1000000049d"},{"tid":711,"created_ino":"0x1000000049e"},{"tid":712,"created_ino":"0x1000000049f"},{"tid":713,"created_ino":"0x100000004a0"},{"tid":714,"created_ino":"0x100000004a1"},{"tid":715,"created_ino":"0x100000004a2"},{"tid":716,"created_ino":"0x100000004a3"},{"tid":717,"created_ino":"0x100000004a4"},{"tid":718,"created_ino":"0x100000004a5"},{"tid":719,"created_ino":"0x100000004a6"},{"tid":720,"created_ino":"0x100000004a7"},{"tid":721,"created_ino":"0x100000004a8"},{"tid":722,"created_ino":"0x100000004a9"},{"tid":723,"created_ino":"0x100000004aa"},{"tid":724,"created_ino":"0x100000004ab"},{"tid":725,"created_ino":"0x100000004ac"},{"tid":726,"created_ino":"0x100000004ad"},{"tid":727,"created_ino":"0x100000004ae"},{"tid":728,"created_ino":"0x100000004af"},{"tid":729,"created_ino":"0x100000004b0"},{"tid":730,"created_ino":"0x100000004b1"},{"tid":731,"created_ino":"0x100000004b2"},{"tid":732,"created_ino":"0x100000004b3"},{"tid":733,"created_ino":"0x100000004b4"},{"tid":734,"created_ino":"0x100000004b5"},{"tid":735,"created_ino":"0x100000004b6"},{"tid":736,"created_ino":"0x100000004b7"},{"tid":737,"created_ino":"0x100000004b8"},{"tid":738,"created_ino":"0x100000004b9"},{"tid":739,"created_ino":"0x100000004ba"},{"tid":740,"created_ino":"0x100000004bb"},{"tid":741,"created_ino":"0x100000004bc"},{"tid":742,"created_ino":"0x100000004bd"},{"tid":743,"created_ino":"0x100000004be"},{"tid":744,"created_ino":"0x100000004bf"},{"tid":745,"created_ino":"0x100000004c0"},{"tid":746,"created_ino":"0x100000004c1"},{"tid":747,"created_ino":"0x100000004c2"},{"tid":748,"created_ino":"0x100000004c3"},{"tid":749,"created_ino":"0x100000004c4"},{"tid":750,"created_ino":"0x100000004c5"},{"tid":751,"created_ino":"0x100000004c6"},{"tid":752,"created_ino":"0x100000004c7"},{"tid":753,"created_ino":"0x100000004c8"},{"tid":754,"created_ino":"0x100000004c9"},{"tid":755,"created_ino":"0x100000004ca"},{"tid":756,"created_ino":"0x100000004cb"},{"tid":757,"created_ino":"0x100000004cc"},{"tid":758,"created_ino":"0x100000004cd"},{"tid":759,"created_ino":"0x100000004ce"},{"tid":760,"created_ino":"0x100000004cf"},{"tid":761,"created_ino":"0x100000004d0"},{"tid":762,"created_ino":"0x100000004d1"},{"tid":763,"created_ino":"0x100000004d2"},{"tid":764,"created_ino":"0x100000004d3"},{"tid":765,"created_ino":"0x100000004d4"},{"tid":766,"created_ino":"0x100000004d5"},{"tid":767,"created_ino":"0x100000004d6"},{"tid":768,"created_ino":"0x100000004d7"},{"tid":769,"created_ino":"0x100000004d8"},{"tid":770,"created_ino":"0x100000004d9"},{"tid":771,"created_ino":"0x100000004da"},{"tid":772,"created_ino":"0x100000004db"},{"tid":773,"created_ino":"0x100000004dc"},{"tid":774,"created_ino":"0x100000004dd"},{"tid":775,"created_ino":"0x100000004de"},{"tid":776,"created_ino":"0x100000004df"},{"tid":777,"created_ino":"0x100000004e0"},{"tid":778,"created_ino":"0x100000004e1"},{"tid":779,"created_ino":"0x100000004e2"},{"tid":780,"created_ino":"0x100000004e3"},{"tid":781,"created_ino":"0x100000004e4"},{"tid":782,"created_ino":"0x100000004e5"},{"tid":783,"created_ino":"0x100000004e6"},{"tid":784,"created_ino":"0x100000004e7"},{"tid":785,"created_ino":"0x100000004e8"},{"tid":786,"created_ino":"0x100000004e9"},{"tid":787,"created_ino":"0x100000004ea"},{"tid":788,"created_ino":"0x100000004eb"},{"tid":789,"created_ino":"0x100000004ec"},{"tid":790,"created_ino":"0x100000004ed"},{"tid":791,"created_ino":"0x100000004ee"},{"tid":792,"created_ino":"0x100000004ef"},{"tid":793,"created_ino":"0x100000004f0"},{"tid":794,"created_ino":"0x100000004f1"},{"tid":795,"created_ino":"0x100000004f2"},{"tid":796,"created_ino":"0x100000004f3"},{"tid":797,"created_ino":"0x100000004f4"},{"tid":798,"created_ino":"0x100000004f5"},{"tid":799,"created_ino":"0x100000004f6"},{"tid":800,"created_ino":"0x100000004f7"},{"tid":801,"created_ino":"0x100000004f8"},{"tid":802,"created_ino":"0x100000004f9"},{"tid":803,"created_ino":"0x100000004fa"},{"tid":804,"created_ino":"0x100000004fb"},{"tid":805,"created_ino":"0x100000004fc"},{"tid":806,"created_ino":"0x100000004fd"},{"tid":807,"created_ino":"0x100000004fe"},{"tid":808,"created_ino":"0x100000004ff"},{"tid":809,"created_ino":"0x10000000500"},{"tid":810,"created_ino":"0x10000000501"},{"tid":811,"created_ino":"0x10000000502"},{"tid":812,"created_ino":"0x10000000503"},{"tid":813,"created_ino":"0x10000000504"},{"tid":814,"created_ino":"0x10000000505"},{"tid":815,"created_ino":"0x10000000506"},{"tid":816,"created_ino":"0x10000000507"},{"tid":817,"created_ino":"0x10000000508"},{"tid":818,"created_ino":"0x10000000509"},{"tid":819,"created_ino":"0x1000000050a"},{"tid":820,"created_ino":"0x1000000050b"},{"tid":821,"created_ino":"0x1000000050c"},{"tid":822,"created_ino":"0x1000000050d"},{"tid":823,"created_ino":"0x1000000050e"},{"tid":824,"created_ino":"0x1000000050f"},{"tid":825,"created_ino":"0x10000000510"},{"tid":826,"created_ino":"0x10000000511"},{"tid":827,"created_ino":"0x10000000512"},{"tid":828,"created_ino":"0x10000000513"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x10000000514","length":203},{"start":"0x100000005e0","length":501}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi081","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-16T01:22:23.538 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi102", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 4215577957, "type": "v1" }, "name": { "num": 6532, "type": "client" } }, "id": 6532, "inst": "client.6532 v1:192.168.0.1:0/4215577957", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9035632755011735 }, "state": "open", "uptime": 15.819657142 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi081", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x100000003e9", "tid": 530 }, { "created_ino": "0x100000003ea", "tid": 531 }, { "created_ino": "0x100000003eb", "tid": 532 }, { "created_ino": "0x100000003ec", "tid": 533 }, { "created_ino": "0x100000003ed", "tid": 534 }, { "created_ino": "0x100000003ee", "tid": 535 }, { "created_ino": "0x100000003ef", "tid": 536 }, { "created_ino": "0x100000003f0", "tid": 537 }, { "created_ino": "0x100000003f1", "tid": 538 }, { "created_ino": "0x100000003f2", "tid": 539 }, { "created_ino": "0x100000003f3", "tid": 540 }, { "created_ino": "0x100000003f4", "tid": 541 }, { "created_ino": "0x100000003f5", "tid": 542 }, { "created_ino": "0x100000003f6", "tid": 543 }, { "created_ino": "0x100000003f7", "tid": 544 }, { "created_ino": "0x100000003f8", "tid": 545 }, { "created_ino": "0x100000003f9", "tid": 546 }, { "created_ino": "0x100000003fa", "tid": 547 }, { "created_ino": "0x100000003fb", "tid": 548 }, { "created_ino": "0x100000003fc", "tid": 549 }, { "created_ino": "0x100000003fd", "tid": 550 }, { "created_ino": "0x100000003fe", "tid": 551 }, { "created_ino": "0x100000003ff", "tid": 552 }, { "created_ino": "0x10000000400", "tid": 553 }, { "created_ino": "0x10000000401", "tid": 554 }, { "created_ino": "0x10000000402", "tid": 555 }, { "created_ino": "0x10000000403", "tid": 556 }, { "created_ino": "0x10000000404", "tid": 557 }, { "created_ino": "0x10000000405", "tid": 558 }, { "created_ino": "0x10000000406", "tid": 559 }, { "created_ino": "0x10000000407", "tid": 560 }, { "created_ino": "0x10000000408", "tid": 561 }, { "created_ino": "0x10000000409", "tid": 562 }, { "created_ino": "0x1000000040a", "tid": 563 }, { "created_ino": "0x1000000040b", "tid": 564 }, { "created_ino": "0x1000000040c", "tid": 565 }, { "created_ino": "0x1000000040d", "tid": 566 }, { "created_ino": "0x1000000040e", "tid": 567 }, { "created_ino": "0x1000000040f", "tid": 568 }, { "created_ino": "0x10000000410", "tid": 569 }, { "created_ino": "0x10000000411", "tid": 570 }, { "created_ino": "0x10000000412", "tid": 571 }, { "created_ino": "0x10000000413", "tid": 572 }, { "created_ino": "0x10000000414", "tid": 573 }, { "created_ino": "0x10000000415", "tid": 574 }, { "created_ino": "0x10000000416", "tid": 575 }, { "created_ino": "0x10000000417", "tid": 576 }, { "created_ino": "0x10000000418", "tid": 577 }, { "created_ino": "0x10000000419", "tid": 578 }, { "created_ino": "0x1000000041a", "tid": 579 }, { "created_ino": "0x1000000041b", "tid": 580 }, { "created_ino": "0x1000000041c", "tid": 581 }, { "created_ino": "0x1000000041d", "tid": 582 }, { "created_ino": "0x1000000041e", "tid": 583 }, { "created_ino": "0x1000000041f", "tid": 584 }, { "created_ino": "0x10000000420", "tid": 585 }, { "created_ino": "0x10000000421", "tid": 586 }, { "created_ino": "0x10000000422", "tid": 587 }, { "created_ino": "0x10000000423", "tid": 588 }, { "created_ino": "0x10000000424", "tid": 589 }, { "created_ino": "0x10000000425", "tid": 590 }, { "created_ino": "0x10000000426", "tid": 591 }, { "created_ino": "0x10000000427", "tid": 592 }, { "created_ino": "0x10000000428", "tid": 593 }, { "created_ino": "0x10000000429", "tid": 594 }, { "created_ino": "0x1000000042a", "tid": 595 }, { "created_ino": "0x1000000042b", "tid": 596 }, { "created_ino": "0x1000000042c", "tid": 597 }, { "created_ino": "0x1000000042d", "tid": 598 }, { "created_ino": "0x1000000042e", "tid": 599 }, { "created_ino": "0x1000000042f", "tid": 600 }, { "created_ino": "0x10000000430", "tid": 601 }, { "created_ino": "0x10000000431", "tid": 602 }, { "created_ino": "0x10000000432", "tid": 603 }, { "created_ino": "0x10000000433", "tid": 604 }, { "created_ino": "0x10000000434", "tid": 605 }, { "created_ino": "0x10000000435", "tid": 606 }, { "created_ino": "0x10000000436", "tid": 607 }, { "created_ino": "0x10000000437", "tid": 608 }, { "created_ino": "0x10000000438", "tid": 609 }, { "created_ino": "0x10000000439", "tid": 610 }, { "created_ino": "0x1000000043a", "tid": 611 }, { "created_ino": "0x1000000043b", "tid": 612 }, { "created_ino": "0x1000000043c", "tid": 613 }, { "created_ino": "0x1000000043d", "tid": 614 }, { "created_ino": "0x1000000043e", "tid": 615 }, { "created_ino": "0x1000000043f", "tid": 616 }, { "created_ino": "0x10000000440", "tid": 617 }, { "created_ino": "0x10000000441", "tid": 618 }, { "created_ino": "0x10000000442", "tid": 619 }, { "created_ino": "0x10000000443", "tid": 620 }, { "created_ino": "0x10000000444", "tid": 621 }, { "created_ino": "0x10000000445", "tid": 622 }, { "created_ino": "0x10000000446", "tid": 623 }, { "created_ino": "0x10000000447", "tid": 624 }, { "created_ino": "0x10000000448", "tid": 625 }, { "created_ino": "0x10000000449", "tid": 626 }, { "created_ino": "0x1000000044a", "tid": 627 }, { "created_ino": "0x1000000044b", "tid": 628 }, { "created_ino": "0x1000000044c", "tid": 629 }, { "created_ino": "0x1000000044d", "tid": 630 }, { "created_ino": "0x1000000044e", "tid": 631 }, { "created_ino": "0x1000000044f", "tid": 632 }, { "created_ino": "0x10000000450", "tid": 633 }, { "created_ino": "0x10000000451", "tid": 634 }, { "created_ino": "0x10000000452", "tid": 635 }, { "created_ino": "0x10000000453", "tid": 636 }, { "created_ino": "0x10000000454", "tid": 637 }, { "created_ino": "0x10000000455", "tid": 638 }, { "created_ino": "0x10000000456", "tid": 639 }, { "created_ino": "0x10000000457", "tid": 640 }, { "created_ino": "0x10000000458", "tid": 641 }, { "created_ino": "0x10000000459", "tid": 642 }, { "created_ino": "0x1000000045a", "tid": 643 }, { "created_ino": "0x1000000045b", "tid": 644 }, { "created_ino": "0x1000000045c", "tid": 645 }, { "created_ino": "0x1000000045d", "tid": 646 }, { "created_ino": "0x1000000045e", "tid": 647 }, { "created_ino": "0x1000000045f", "tid": 648 }, { "created_ino": "0x10000000460", "tid": 649 }, { "created_ino": "0x10000000461", "tid": 650 }, { "created_ino": "0x10000000462", "tid": 651 }, { "created_ino": "0x10000000463", "tid": 652 }, { "created_ino": "0x10000000464", "tid": 653 }, { "created_ino": "0x10000000465", "tid": 654 }, { "created_ino": "0x10000000466", "tid": 655 }, { "created_ino": "0x10000000467", "tid": 656 }, { "created_ino": "0x10000000468", "tid": 657 }, { "created_ino": "0x10000000469", "tid": 658 }, { "created_ino": "0x1000000046a", "tid": 659 }, { "created_ino": "0x1000000046b", "tid": 660 }, { "created_ino": "0x1000000046c", "tid": 661 }, { "created_ino": "0x1000000046d", "tid": 662 }, { "created_ino": "0x1000000046e", "tid": 663 }, { "created_ino": "0x1000000046f", "tid": 664 }, { "created_ino": "0x10000000470", "tid": 665 }, { "created_ino": "0x10000000471", "tid": 666 }, { "created_ino": "0x10000000472", "tid": 667 }, { "created_ino": "0x10000000473", "tid": 668 }, { "created_ino": "0x10000000474", "tid": 669 }, { "created_ino": "0x10000000475", "tid": 670 }, { "created_ino": "0x10000000476", "tid": 671 }, { "created_ino": "0x10000000477", "tid": 672 }, { "created_ino": "0x10000000478", "tid": 673 }, { "created_ino": "0x10000000479", "tid": 674 }, { "created_ino": "0x1000000047a", "tid": 675 }, { "created_ino": "0x1000000047b", "tid": 676 }, { "created_ino": "0x1000000047c", "tid": 677 }, { "created_ino": "0x1000000047d", "tid": 678 }, { "created_ino": "0x1000000047e", "tid": 679 }, { "created_ino": "0x1000000047f", "tid": 680 }, { "created_ino": "0x10000000480", "tid": 681 }, { "created_ino": "0x10000000481", "tid": 682 }, { "created_ino": "0x10000000482", "tid": 683 }, { "created_ino": "0x10000000483", "tid": 684 }, { "created_ino": "0x10000000484", "tid": 685 }, { "created_ino": "0x10000000485", "tid": 686 }, { "created_ino": "0x10000000486", "tid": 687 }, { "created_ino": "0x10000000487", "tid": 688 }, { "created_ino": "0x10000000488", "tid": 689 }, { "created_ino": "0x10000000489", "tid": 690 }, { "created_ino": "0x1000000048a", "tid": 691 }, { "created_ino": "0x1000000048b", "tid": 692 }, { "created_ino": "0x1000000048c", "tid": 693 }, { "created_ino": "0x1000000048d", "tid": 694 }, { "created_ino": "0x1000000048e", "tid": 695 }, { "created_ino": "0x1000000048f", "tid": 696 }, { "created_ino": "0x10000000490", "tid": 697 }, { "created_ino": "0x10000000491", "tid": 698 }, { "created_ino": "0x10000000492", "tid": 699 }, { "created_ino": "0x10000000493", "tid": 700 }, { "created_ino": "0x10000000494", "tid": 701 }, { "created_ino": "0x10000000495", "tid": 702 }, { "created_ino": "0x10000000496", "tid": 703 }, { "created_ino": "0x10000000497", "tid": 704 }, { "created_ino": "0x10000000498", "tid": 705 }, { "created_ino": "0x10000000499", "tid": 706 }, { "created_ino": "0x1000000049a", "tid": 707 }, { "created_ino": "0x1000000049b", "tid": 708 }, { "created_ino": "0x1000000049c", "tid": 709 }, { "created_ino": "0x1000000049d", "tid": 710 }, { "created_ino": "0x1000000049e", "tid": 711 }, { "created_ino": "0x1000000049f", "tid": 712 }, { "created_ino": "0x100000004a0", "tid": 713 }, { "created_ino": "0x100000004a1", "tid": 714 }, { "created_ino": "0x100000004a2", "tid": 715 }, { "created_ino": "0x100000004a3", "tid": 716 }, { "created_ino": "0x100000004a4", "tid": 717 }, { "created_ino": "0x100000004a5", "tid": 718 }, { "created_ino": "0x100000004a6", "tid": 719 }, { "created_ino": "0x100000004a7", "tid": 720 }, { "created_ino": "0x100000004a8", "tid": 721 }, { "created_ino": "0x100000004a9", "tid": 722 }, { "created_ino": "0x100000004aa", "tid": 723 }, { "created_ino": "0x100000004ab", "tid": 724 }, { "created_ino": "0x100000004ac", "tid": 725 }, { "created_ino": "0x100000004ad", "tid": 726 }, { "created_ino": "0x100000004ae", "tid": 727 }, { "created_ino": "0x100000004af", "tid": 728 }, { "created_ino": "0x100000004b0", "tid": 729 }, { "created_ino": "0x100000004b1", "tid": 730 }, { "created_ino": "0x100000004b2", "tid": 731 }, { "created_ino": "0x100000004b3", "tid": 732 }, { "created_ino": "0x100000004b4", "tid": 733 }, { "created_ino": "0x100000004b5", "tid": 734 }, { "created_ino": "0x100000004b6", "tid": 735 }, { "created_ino": "0x100000004b7", "tid": 736 }, { "created_ino": "0x100000004b8", "tid": 737 }, { "created_ino": "0x100000004b9", "tid": 738 }, { "created_ino": "0x100000004ba", "tid": 739 }, { "created_ino": "0x100000004bb", "tid": 740 }, { "created_ino": "0x100000004bc", "tid": 741 }, { "created_ino": "0x100000004bd", "tid": 742 }, { "created_ino": "0x100000004be", "tid": 743 }, { "created_ino": "0x100000004bf", "tid": 744 }, { "created_ino": "0x100000004c0", "tid": 745 }, { "created_ino": "0x100000004c1", "tid": 746 }, { "created_ino": "0x100000004c2", "tid": 747 }, { "created_ino": "0x100000004c3", "tid": 748 }, { "created_ino": "0x100000004c4", "tid": 749 }, { "created_ino": "0x100000004c5", "tid": 750 }, { "created_ino": "0x100000004c6", "tid": 751 }, { "created_ino": "0x100000004c7", "tid": 752 }, { "created_ino": "0x100000004c8", "tid": 753 }, { "created_ino": "0x100000004c9", "tid": 754 }, { "created_ino": "0x100000004ca", "tid": 755 }, { "created_ino": "0x100000004cb", "tid": 756 }, { "created_ino": "0x100000004cc", "tid": 757 }, { "created_ino": "0x100000004cd", "tid": 758 }, { "created_ino": "0x100000004ce", "tid": 759 }, { "created_ino": "0x100000004cf", "tid": 760 }, { "created_ino": "0x100000004d0", "tid": 761 }, { "created_ino": "0x100000004d1", "tid": 762 }, { "created_ino": "0x100000004d2", "tid": 763 }, { "created_ino": "0x100000004d3", "tid": 764 }, { "created_ino": "0x100000004d4", "tid": 765 }, { "created_ino": "0x100000004d5", "tid": 766 }, { "created_ino": "0x100000004d6", "tid": 767 }, { "created_ino": "0x100000004d7", "tid": 768 }, { "created_ino": "0x100000004d8", "tid": 769 }, { "created_ino": "0x100000004d9", "tid": 770 }, { "created_ino": "0x100000004da", "tid": 771 }, { "created_ino": "0x100000004db", "tid": 772 }, { "created_ino": "0x100000004dc", "tid": 773 }, { "created_ino": "0x100000004dd", "tid": 774 }, { "created_ino": "0x100000004de", "tid": 775 }, { "created_ino": "0x100000004df", "tid": 776 }, { "created_ino": "0x100000004e0", "tid": 777 }, { "created_ino": "0x100000004e1", "tid": 778 }, { "created_ino": "0x100000004e2", "tid": 779 }, { "created_ino": "0x100000004e3", "tid": 780 }, { "created_ino": "0x100000004e4", "tid": 781 }, { "created_ino": "0x100000004e5", "tid": 782 }, { "created_ino": "0x100000004e6", "tid": 783 }, { "created_ino": "0x100000004e7", "tid": 784 }, { "created_ino": "0x100000004e8", "tid": 785 }, { "created_ino": "0x100000004e9", "tid": 786 }, { "created_ino": "0x100000004ea", "tid": 787 }, { "created_ino": "0x100000004eb", "tid": 788 }, { "created_ino": "0x100000004ec", "tid": 789 }, { "created_ino": "0x100000004ed", "tid": 790 }, { "created_ino": "0x100000004ee", "tid": 791 }, { "created_ino": "0x100000004ef", "tid": 792 }, { "created_ino": "0x100000004f0", "tid": 793 }, { "created_ino": "0x100000004f1", "tid": 794 }, { "created_ino": "0x100000004f2", "tid": 795 }, { "created_ino": "0x100000004f3", "tid": 796 }, { "created_ino": "0x100000004f4", "tid": 797 }, { "created_ino": "0x100000004f5", "tid": 798 }, { "created_ino": "0x100000004f6", "tid": 799 }, { "created_ino": "0x100000004f7", "tid": 800 }, { "created_ino": "0x100000004f8", "tid": 801 }, { "created_ino": "0x100000004f9", "tid": 802 }, { "created_ino": "0x100000004fa", "tid": 803 }, { "created_ino": "0x100000004fb", "tid": 804 }, { "created_ino": "0x100000004fc", "tid": 805 }, { "created_ino": "0x100000004fd", "tid": 806 }, { "created_ino": "0x100000004fe", "tid": 807 }, { "created_ino": "0x100000004ff", "tid": 808 }, { "created_ino": "0x10000000500", "tid": 809 }, { "created_ino": "0x10000000501", "tid": 810 }, { "created_ino": "0x10000000502", "tid": 811 }, { "created_ino": "0x10000000503", "tid": 812 }, { "created_ino": "0x10000000504", "tid": 813 }, { "created_ino": "0x10000000505", "tid": 814 }, { "created_ino": "0x10000000506", "tid": 815 }, { "created_ino": "0x10000000507", "tid": 816 }, { "created_ino": "0x10000000508", "tid": 817 }, { "created_ino": "0x10000000509", "tid": 818 }, { "created_ino": "0x1000000050a", "tid": 819 }, { "created_ino": "0x1000000050b", "tid": 820 }, { "created_ino": "0x1000000050c", "tid": 821 }, { "created_ino": "0x1000000050d", "tid": 822 }, { "created_ino": "0x1000000050e", "tid": 823 }, { "created_ino": "0x1000000050f", "tid": 824 }, { "created_ino": "0x10000000510", "tid": 825 }, { "created_ino": "0x10000000511", "tid": 826 }, { "created_ino": "0x10000000512", "tid": 827 }, { "created_ino": "0x10000000513", "tid": 828 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 1939130418, "type": "v1" }, "name": { "num": 6526, "type": "client" } }, "id": 6526, "inst": "client.6526 v1:172.21.15.81:0/1939130418", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 530, "num_caps": 402, "num_completed_flushes": 0, "num_completed_requests": 299, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 203, "start": "0x10000000514" }, { "length": 501, "start": "0x100000005e0" } ], "recall_caps": { "halflife": 60, "value": 4435.084461996425 }, "recall_caps_throttle": { "halflife": 1.5, "value": 895.1988654270853 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 305.4492520701238 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 398.54386489678933 }, "request_load_avg": 712, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1557.6879410683573 }, "state": "open", "uptime": 16.983631915 } ] 2024-09-16T01:22:23.538 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-16T01:22:23.538 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:22:23.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:22:23.589 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:22:23.623 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:22:23.623 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:22:23.624 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 800\nabs_path = "/home/ubuntu/cephtest/mnt.0/subdir"\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi081') 2024-09-16T01:22:23.624 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:22:23.624 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:23.640 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:22:23.640 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:23.696 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:22:23.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.834+0000 7f5827c0a640 1 Processor -- start 2024-09-16T01:22:23.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.834+0000 7f5827c0a640 1 -- start start 2024-09-16T01:22:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f5827c0a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f582015c870 0x7f582015cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f5827c0a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f58200ccf90 0x7f58200cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f5827c0a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58200d01c0 con 0x7f582015c490 2024-09-16T01:22:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f5827c0a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f58200cff70 con 0x7f582015c870 2024-09-16T01:22:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f5827c0a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f58200d0dd0 con 0x7f58200ccf90 2024-09-16T01:22:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f58251a5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f582015c870 0x7f582015cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f58251a5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f582015c870 0x7f582015cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51310/0 (socket says 172.21.15.81:51310) 2024-09-16T01:22:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f58251a5640 1 -- 172.21.15.81:0/2674788555 learned_addr learned my addr 172.21.15.81:0/2674788555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f58261a7640 1 --2- 172.21.15.81:0/2674788555 >> v2:172.21.15.102:3300/0 conn(0x7f58200ccf90 0x7f58200cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f58251a5640 1 -- 172.21.15.81:0/2674788555 >> v2:172.21.15.102:3300/0 conn(0x7f58200ccf90 msgr2=0x7f58200cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f58251a5640 1 --2- 172.21.15.81:0/2674788555 >> v2:172.21.15.102:3300/0 conn(0x7f58200ccf90 0x7f58200cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f58251a5640 1 -- 172.21.15.81:0/2674788555 >> v1:172.21.15.102:6789/0 conn(0x7f582015c490 legacy=0x7f582009b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.835+0000 7f58251a5640 1 -- 172.21.15.81:0/2674788555 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58200d04a0 con 0x7f582015c870 2024-09-16T01:22:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.836+0000 7f58251a5640 1 --2- 172.21.15.81:0/2674788555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f582015c870 0x7f582015cce0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f58200733b0 tx=0x7f581002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8427bf3c0a5b4e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.836+0000 7f58249a4640 1 -- 172.21.15.81:0/2674788555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810037070 con 0x7f582015c870 2024-09-16T01:22:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.836+0000 7f58249a4640 1 -- 172.21.15.81:0/2674788555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5810032440 con 0x7f582015c870 2024-09-16T01:22:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.836+0000 7f58249a4640 1 -- 172.21.15.81:0/2674788555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810032810 con 0x7f582015c870 2024-09-16T01:22:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.837+0000 7f5827c0a640 1 -- 172.21.15.81:0/2674788555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f582015c870 msgr2=0x7f582015cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.837+0000 7f5827c0a640 1 --2- 172.21.15.81:0/2674788555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f582015c870 0x7f582015cce0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f58200733b0 tx=0x7f581002a2c0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.837+0000 7f5827c0a640 1 -- 172.21.15.81:0/2674788555 shutdown_connections 2024-09-16T01:22:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.837+0000 7f5827c0a640 1 --2- 172.21.15.81:0/2674788555 >> v2:172.21.15.102:3300/0 conn(0x7f58200ccf90 0x7f58200cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.837+0000 7f5827c0a640 1 --2- 172.21.15.81:0/2674788555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f582015c870 0x7f582015cce0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.837+0000 7f5827c0a640 1 -- 172.21.15.81:0/2674788555 >> 172.21.15.81:0/2674788555 conn(0x7f58200d23a0 msgr2=0x7f58200d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.837+0000 7f5827c0a640 1 -- 172.21.15.81:0/2674788555 shutdown_connections 2024-09-16T01:22:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.837+0000 7f5827c0a640 1 -- 172.21.15.81:0/2674788555 wait complete. 2024-09-16T01:22:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.838+0000 7f5827c0a640 1 Processor -- start 2024-09-16T01:22:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.838+0000 7f5827c0a640 1 -- start start 2024-09-16T01:22:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.838+0000 7f5827c0a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58200ccf90 0x7f5820151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f5827c0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f582015c490 0x7f58201e7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f5827c0a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f582015c870 0x7f58200cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f5827c0a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f58200d1260 con 0x7f582015c490 2024-09-16T01:22:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f5827c0a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f58200d0a60 con 0x7f582015c870 2024-09-16T01:22:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f5827c0a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f58201516b0 con 0x7f58200ccf90 2024-09-16T01:22:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58251a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f582015c490 0x7f58201e7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58251a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f582015c490 0x7f58201e7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51318/0 (socket says 172.21.15.81:51318) 2024-09-16T01:22:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58251a5640 1 -- 172.21.15.81:0/2681344737 learned_addr learned my addr 172.21.15.81:0/2681344737 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58261a7640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f582015c870 0x7f58200cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58259a6640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58200ccf90 0x7f5820151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58251a5640 1 -- 172.21.15.81:0/2681344737 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58200ccf90 msgr2=0x7f5820151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58251a5640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58200ccf90 0x7f5820151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58251a5640 1 -- 172.21.15.81:0/2681344737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f582015c870 msgr2=0x7f58200cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58251a5640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f582015c870 0x7f58200cb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58251a5640 1 -- 172.21.15.81:0/2681344737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5820152cd0 con 0x7f582015c490 2024-09-16T01:22:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58251a5640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f582015c490 0x7f58201e7170 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f581002a300 tx=0x7f58100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58167fc640 1 -- 172.21.15.81:0/2681344737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810041020 con 0x7f582015c490 2024-09-16T01:22:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58167fc640 1 -- 172.21.15.81:0/2681344737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58100306c0 con 0x7f582015c490 2024-09-16T01:22:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f58167fc640 1 -- 172.21.15.81:0/2681344737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810037040 con 0x7f582015c490 2024-09-16T01:22:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f5827c0a640 1 -- 172.21.15.81:0/2681344737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58200ca5c0 con 0x7f582015c490 2024-09-16T01:22:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.839+0000 7f5827c0a640 1 -- 172.21.15.81:0/2681344737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58200cab80 con 0x7f582015c490 2024-09-16T01:22:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.840+0000 7f5827c0a640 1 -- 172.21.15.81:0/2681344737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f582015cce0 con 0x7f582015c490 2024-09-16T01:22:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.841+0000 7f58167fc640 1 -- 172.21.15.81:0/2681344737 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5810044020 con 0x7f582015c490 2024-09-16T01:22:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.841+0000 7f58167fc640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f580406c2b0 0x7f580406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.841+0000 7f58259a6640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f580406c2b0 0x7f580406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.841+0000 7f58167fc640 1 -- 172.21.15.81:0/2681344737 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f58100abce0 con 0x7f582015c490 2024-09-16T01:22:23.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.842+0000 7f58259a6640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f580406c2b0 0x7f580406e770 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f581c004f60 tx=0x7f581c007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:23.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:23.846+0000 7f58167fc640 1 -- 172.21.15.81:0/2681344737 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f581004b030 con 0x7f582015c490 2024-09-16T01:22:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.021+0000 7f5827c0a640 1 -- 172.21.15.81:0/2681344737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f58200d3190 con 0x7f582015c490 2024-09-16T01:22:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.021+0000 7f58167fc640 1 -- 172.21.15.81:0/2681344737 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v113) ==== 80+0+0 (secure 0 0 0) 0x7f5810079c70 con 0x7f582015c490 2024-09-16T01:22:24.023 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:22:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.023+0000 7f5827c0a640 1 -- 172.21.15.81:0/2681344737 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f580406c2b0 msgr2=0x7f580406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.023+0000 7f5827c0a640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f580406c2b0 0x7f580406e770 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f581c004f60 tx=0x7f581c007e30 comp rx=0 tx=0).stop 2024-09-16T01:22:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.023+0000 7f5827c0a640 1 -- 172.21.15.81:0/2681344737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f582015c490 msgr2=0x7f58201e7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.023+0000 7f5827c0a640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f582015c490 0x7f58201e7170 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f581002a300 tx=0x7f58100046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.023+0000 7f5827c0a640 1 -- 172.21.15.81:0/2681344737 shutdown_connections 2024-09-16T01:22:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.023+0000 7f5827c0a640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f580406c2b0 0x7f580406e770 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.023+0000 7f5827c0a640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f582015c870 0x7f58200cb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.023+0000 7f5827c0a640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f582015c490 0x7f58201e7170 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.023+0000 7f5827c0a640 1 --2- 172.21.15.81:0/2681344737 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f58200ccf90 0x7f5820151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.023+0000 7f5827c0a640 1 -- 172.21.15.81:0/2681344737 >> 172.21.15.81:0/2681344737 conn(0x7f58200d23a0 msgr2=0x7f58201546e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.023+0000 7f5827c0a640 1 -- 172.21.15.81:0/2681344737 shutdown_connections 2024-09-16T01:22:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.023+0000 7f5827c0a640 1 -- 172.21.15.81:0/2681344737 wait complete. 2024-09-16T01:22:24.036 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:22:24.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:24.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:22:24.245 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:22:24.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:24.245 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:22:24.260 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:22:24.261 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:22:24.261 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:24.276 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:22:24.276 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:24.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:22:24.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.431+0000 7f4fb2de8640 1 Processor -- start 2024-09-16T01:22:24.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.431+0000 7f4fb2de8640 1 -- start start 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb2de8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4fac0b69d0 0x7f4fac162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb2de8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fac0af280 0x7f4fac0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb2de8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4fac0affb0 0x7f4fac154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb2de8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4fac0b6db0 con 0x7f4fac0b69d0 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb2de8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4fac15eb60 con 0x7f4fac0affb0 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb2de8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4fac15ee40 con 0x7f4fac0af280 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb0b84640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4fac0b69d0 0x7f4fac162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb0b84640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4fac0b69d0 0x7f4fac162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51334/0 (socket says 172.21.15.81:51334) 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb0b84640 1 -- 172.21.15.81:0/1977764053 learned_addr learned my addr 172.21.15.81:0/1977764053 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb0b84640 1 -- 172.21.15.81:0/1977764053 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fac0af280 msgr2=0x7f4fac0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb1385640 1 --2- 172.21.15.81:0/1977764053 >> v2:172.21.15.102:3300/0 conn(0x7f4fac0affb0 0x7f4fac154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fabfff640 1 --2- 172.21.15.81:0/1977764053 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fac0af280 0x7f4fac0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb0b84640 1 --2- 172.21.15.81:0/1977764053 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fac0af280 0x7f4fac0afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb0b84640 1 -- 172.21.15.81:0/1977764053 >> v2:172.21.15.102:3300/0 conn(0x7f4fac0affb0 msgr2=0x7f4fac154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:24.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb0b84640 1 --2- 172.21.15.81:0/1977764053 >> v2:172.21.15.102:3300/0 conn(0x7f4fac0affb0 0x7f4fac154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb0b84640 1 -- 172.21.15.81:0/1977764053 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac15f120 con 0x7f4fac0b69d0 2024-09-16T01:22:24.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.432+0000 7f4fb1385640 1 --2- 172.21.15.81:0/1977764053 >> v2:172.21.15.102:3300/0 conn(0x7f4fac0affb0 0x7f4fac154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:24.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.433+0000 7f4fb0b84640 1 --2- 172.21.15.81:0/1977764053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fac0b69d0 0x7f4fac162a50 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009870 tx=0x7f4fa002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5deacd714d01de3e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:24.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.433+0000 7f4fab7fe640 1 -- 172.21.15.81:0/1977764053 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0037070 con 0x7f4fac0b69d0 2024-09-16T01:22:24.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.433+0000 7f4fab7fe640 1 -- 172.21.15.81:0/1977764053 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa002ae10 con 0x7f4fac0b69d0 2024-09-16T01:22:24.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.433+0000 7f4fab7fe640 1 -- 172.21.15.81:0/1977764053 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0032660 con 0x7f4fac0b69d0 2024-09-16T01:22:24.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.433+0000 7f4fb2de8640 1 -- 172.21.15.81:0/1977764053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fac0b69d0 msgr2=0x7f4fac162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.433+0000 7f4fb2de8640 1 --2- 172.21.15.81:0/1977764053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fac0b69d0 0x7f4fac162a50 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009870 tx=0x7f4fa002a100 comp rx=0 tx=0).stop 2024-09-16T01:22:24.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.434+0000 7f4fb2de8640 1 -- 172.21.15.81:0/1977764053 shutdown_connections 2024-09-16T01:22:24.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.434+0000 7f4fb2de8640 1 --2- 172.21.15.81:0/1977764053 >> v2:172.21.15.102:3300/0 conn(0x7f4fac0affb0 0x7f4fac154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.434+0000 7f4fb2de8640 1 --2- 172.21.15.81:0/1977764053 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fac0af280 0x7f4fac0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.434+0000 7f4fb2de8640 1 --2- 172.21.15.81:0/1977764053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fac0b69d0 0x7f4fac162a50 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.434+0000 7f4fb2de8640 1 -- 172.21.15.81:0/1977764053 >> 172.21.15.81:0/1977764053 conn(0x7f4fac06bc10 msgr2=0x7f4fac06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:24.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.434+0000 7f4fb2de8640 1 -- 172.21.15.81:0/1977764053 shutdown_connections 2024-09-16T01:22:24.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.434+0000 7f4fb2de8640 1 -- 172.21.15.81:0/1977764053 wait complete. 2024-09-16T01:22:24.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.435+0000 7f4fb2de8640 1 Processor -- start 2024-09-16T01:22:24.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.435+0000 7f4fb2de8640 1 -- start start 2024-09-16T01:22:24.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb2de8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fac0af280 0x7f4fac151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb2de8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac0affb0 0x7f4fac0cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb2de8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fac0b69d0 0x7f4fac160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb2de8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac155240 con 0x7f4fac0af280 2024-09-16T01:22:24.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb2de8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac0af6e0 con 0x7f4fac0affb0 2024-09-16T01:22:24.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb2de8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4fac1553c0 con 0x7f4fac0b69d0 2024-09-16T01:22:24.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb0b84640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fac0af280 0x7f4fac151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb0b84640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fac0af280 0x7f4fac151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51338/0 (socket says 172.21.15.81:51338) 2024-09-16T01:22:24.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb0b84640 1 -- 172.21.15.81:0/437190131 learned_addr learned my addr 172.21.15.81:0/437190131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:24.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fabfff640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac0affb0 0x7f4fac0cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb1385640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fac0b69d0 0x7f4fac160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb0b84640 1 -- 172.21.15.81:0/437190131 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fac0b69d0 msgr2=0x7f4fac160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb0b84640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fac0b69d0 0x7f4fac160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb0b84640 1 -- 172.21.15.81:0/437190131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac0affb0 msgr2=0x7f4fac0cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb0b84640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac0affb0 0x7f4fac0cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb0b84640 1 -- 172.21.15.81:0/437190131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac1516a0 con 0x7f4fac0af280 2024-09-16T01:22:24.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb0b84640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fac0af280 0x7f4fac151160 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0000c00 tx=0x7f4fa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:24.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fa97fa640 1 -- 172.21.15.81:0/437190131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0041070 con 0x7f4fac0af280 2024-09-16T01:22:24.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fa97fa640 1 -- 172.21.15.81:0/437190131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa003c670 con 0x7f4fac0af280 2024-09-16T01:22:24.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb2de8640 1 -- 172.21.15.81:0/437190131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac1f4790 con 0x7f4fac0af280 2024-09-16T01:22:24.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fa97fa640 1 -- 172.21.15.81:0/437190131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0037040 con 0x7f4fac0af280 2024-09-16T01:22:24.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.436+0000 7f4fb2de8640 1 -- 172.21.15.81:0/437190131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fac1f5030 con 0x7f4fac0af280 2024-09-16T01:22:24.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.437+0000 7f4fb2de8640 1 -- 172.21.15.81:0/437190131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fac1f4960 con 0x7f4fac0af280 2024-09-16T01:22:24.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.438+0000 7f4fa97fa640 1 -- 172.21.15.81:0/437190131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4fa0044070 con 0x7f4fac0af280 2024-09-16T01:22:24.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.438+0000 7f4fa97fa640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4f9006c2b0 0x7f4f9006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.438+0000 7f4fa97fa640 1 -- 172.21.15.81:0/437190131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f4fa00abd50 con 0x7f4fac0af280 2024-09-16T01:22:24.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.438+0000 7f4fabfff640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4f9006c2b0 0x7f4f9006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.439+0000 7f4fabfff640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4f9006c2b0 0x7f4f9006e770 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4fac158fb0 tx=0x7f4f98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:24.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.442+0000 7f4fa97fa640 1 -- 172.21.15.81:0/437190131 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4fa00af030 con 0x7f4fac0af280 2024-09-16T01:22:24.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.620+0000 7f4fb2de8640 1 -- 172.21.15.81:0/437190131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4fac155820 con 0x7f4fac0af280 2024-09-16T01:22:24.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.621+0000 7f4fa97fa640 1 -- 172.21.15.81:0/437190131 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v113) ==== 80+0+0 (secure 0 0 0) 0x7f4fa007a330 con 0x7f4fac0af280 2024-09-16T01:22:24.623 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:22:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.623+0000 7f4fb2de8640 1 -- 172.21.15.81:0/437190131 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4f9006c2b0 msgr2=0x7f4f9006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.623+0000 7f4fb2de8640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4f9006c2b0 0x7f4f9006e770 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4fac158fb0 tx=0x7f4f98008040 comp rx=0 tx=0).stop 2024-09-16T01:22:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.623+0000 7f4fb2de8640 1 -- 172.21.15.81:0/437190131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fac0af280 msgr2=0x7f4fac151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.623+0000 7f4fb2de8640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fac0af280 0x7f4fac151160 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0000c00 tx=0x7f4fa00046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.623+0000 7f4fb2de8640 1 -- 172.21.15.81:0/437190131 shutdown_connections 2024-09-16T01:22:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.623+0000 7f4fb2de8640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4f9006c2b0 0x7f4f9006e770 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.623+0000 7f4fb2de8640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4fac0b69d0 0x7f4fac160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.623+0000 7f4fb2de8640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4fac0affb0 0x7f4fac0cf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.623+0000 7f4fb2de8640 1 --2- 172.21.15.81:0/437190131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fac0af280 0x7f4fac151160 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.623+0000 7f4fb2de8640 1 -- 172.21.15.81:0/437190131 >> 172.21.15.81:0/437190131 conn(0x7f4fac06bc10 msgr2=0x7f4fac06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:24.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.623+0000 7f4fb2de8640 1 -- 172.21.15.81:0/437190131 shutdown_connections 2024-09-16T01:22:24.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.623+0000 7f4fb2de8640 1 -- 172.21.15.81:0/437190131 wait complete. 2024-09-16T01:22:24.636 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:22:24.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:24.636 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T01:22:24.664 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:22:24.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:24.665 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:22:24.720 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:22:24.721 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:22:24.721 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:24.736 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:22:24.737 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:22:24.737 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:22:24.737 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:24.777 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:22:24.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.872+0000 7fd750baf640 1 Processor -- start 2024-09-16T01:22:24.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.872+0000 7fd750baf640 1 -- start start 2024-09-16T01:22:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.873+0000 7fd750baf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd74c15b300 0x7fd74c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.873+0000 7fd750baf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd74c0cd3f0 0x7fd74c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.873+0000 7fd750baf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd74c0cdbe0 con 0x7fd74c072d30 2024-09-16T01:22:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.873+0000 7fd750baf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd74c0728a0 con 0x7fd74c0cd3f0 2024-09-16T01:22:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.873+0000 7fd750baf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd74c0cd900 con 0x7fd74c15b300 2024-09-16T01:22:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.874+0000 7fd749d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd74c0cd3f0 0x7fd74c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.874+0000 7fd749d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd74c0cd3f0 0x7fd74c06f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51354/0 (socket says 172.21.15.81:51354) 2024-09-16T01:22:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.874+0000 7fd749d9b640 1 -- 172.21.15.81:0/3077360147 learned_addr learned my addr 172.21.15.81:0/3077360147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:24.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.874+0000 7fd74ad9d640 1 --1- 172.21.15.81:0/3077360147 >> v1:172.21.15.81:6789/0 conn(0x7fd74c072d30 0x7fd74c0b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60168/0 (socket says 172.21.15.81:60168) 2024-09-16T01:22:24.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.874+0000 7fd74a59c640 1 --2- 172.21.15.81:0/3077360147 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd74c15b300 0x7fd74c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.874+0000 7fd749d9b640 1 -- 172.21.15.81:0/3077360147 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd74c15b300 msgr2=0x7fd74c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:24.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.874+0000 7fd749d9b640 1 --2- 172.21.15.81:0/3077360147 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd74c15b300 0x7fd74c0cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.874+0000 7fd749d9b640 1 -- 172.21.15.81:0/3077360147 >> v1:172.21.15.81:6789/0 conn(0x7fd74c072d30 legacy=0x7fd74c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.874+0000 7fd749d9b640 1 -- 172.21.15.81:0/3077360147 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c072250 con 0x7fd74c0cd3f0 2024-09-16T01:22:24.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.874+0000 7fd74959a640 1 -- 172.21.15.81:0/3077360147 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021310075 0 0) 0x7fd74c0cdbe0 con 0x7fd74c072d30 2024-09-16T01:22:24.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.875+0000 7fd749d9b640 1 --2- 172.21.15.81:0/3077360147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd74c0cd3f0 0x7fd74c06f1c0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fd734009870 tx=0x7fd73402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b6945c6cb34098 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.875+0000 7fd74959a640 1 -- 172.21.15.81:0/3077360147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd734037070 con 0x7fd74c0cd3f0 2024-09-16T01:22:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.875+0000 7fd74959a640 1 -- 172.21.15.81:0/3077360147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd734032440 con 0x7fd74c0cd3f0 2024-09-16T01:22:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.875+0000 7fd74959a640 1 -- 172.21.15.81:0/3077360147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd734032810 con 0x7fd74c0cd3f0 2024-09-16T01:22:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.875+0000 7fd750baf640 1 -- 172.21.15.81:0/3077360147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd74c0cd3f0 msgr2=0x7fd74c06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.875+0000 7fd750baf640 1 --2- 172.21.15.81:0/3077360147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd74c0cd3f0 0x7fd74c06f1c0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fd734009870 tx=0x7fd73402a270 comp rx=0 tx=0).stop 2024-09-16T01:22:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.875+0000 7fd750baf640 1 -- 172.21.15.81:0/3077360147 shutdown_connections 2024-09-16T01:22:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.875+0000 7fd750baf640 1 --2- 172.21.15.81:0/3077360147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd74c0cd3f0 0x7fd74c06f1c0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.875+0000 7fd750baf640 1 --2- 172.21.15.81:0/3077360147 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd74c15b300 0x7fd74c0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.875+0000 7fd750baf640 1 -- 172.21.15.81:0/3077360147 >> 172.21.15.81:0/3077360147 conn(0x7fd74c067d70 msgr2=0x7fd74c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.875+0000 7fd750baf640 1 -- 172.21.15.81:0/3077360147 shutdown_connections 2024-09-16T01:22:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.875+0000 7fd750baf640 1 -- 172.21.15.81:0/3077360147 wait complete. 2024-09-16T01:22:24.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.877+0000 7fd750baf640 1 Processor -- start 2024-09-16T01:22:24.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.877+0000 7fd750baf640 1 -- start start 2024-09-16T01:22:24.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.877+0000 7fd750baf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd74c072d30 0x7fd74c14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.877+0000 7fd750baf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd74c0cd3f0 0x7fd74c14f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.877+0000 7fd750baf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd74c15b300 0x7fd74c14fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.877+0000 7fd750baf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c0d0160 con 0x7fd74c072d30 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.877+0000 7fd750baf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c0cffe0 con 0x7fd74c15b300 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.877+0000 7fd750baf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd74c06f700 con 0x7fd74c0cd3f0 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.877+0000 7fd74a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd74c072d30 0x7fd74c14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd74a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd74c072d30 0x7fd74c14cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51362/0 (socket says 172.21.15.81:51362) 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd74a59c640 1 -- 172.21.15.81:0/3253912707 learned_addr learned my addr 172.21.15.81:0/3253912707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd749d9b640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd74c0cd3f0 0x7fd74c14f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd74ad9d640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd74c15b300 0x7fd74c14fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd74a59c640 1 -- 172.21.15.81:0/3253912707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd74c0cd3f0 msgr2=0x7fd74c14f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd74a59c640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd74c0cd3f0 0x7fd74c14f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd74a59c640 1 -- 172.21.15.81:0/3253912707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd74c15b300 msgr2=0x7fd74c14fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd74a59c640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd74c15b300 0x7fd74c14fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd74a59c640 1 -- 172.21.15.81:0/3253912707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c147490 con 0x7fd74c072d30 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd74a59c640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd74c072d30 0x7fd74c14cba0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fd744007e40 tx=0x7fd74400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd742ffd640 1 -- 172.21.15.81:0/3253912707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744014620 con 0x7fd74c072d30 2024-09-16T01:22:24.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd742ffd640 1 -- 172.21.15.81:0/3253912707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd744019070 con 0x7fd74c072d30 2024-09-16T01:22:24.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd750baf640 1 -- 172.21.15.81:0/3253912707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74c147750 con 0x7fd74c072d30 2024-09-16T01:22:24.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd742ffd640 1 -- 172.21.15.81:0/3253912707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744014a00 con 0x7fd74c072d30 2024-09-16T01:22:24.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.878+0000 7fd750baf640 1 -- 172.21.15.81:0/3253912707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74c14c0c0 con 0x7fd74c072d30 2024-09-16T01:22:24.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.879+0000 7fd750baf640 1 -- 172.21.15.81:0/3253912707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74c0b2fc0 con 0x7fd74c072d30 2024-09-16T01:22:24.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.880+0000 7fd742ffd640 1 -- 172.21.15.81:0/3253912707 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd744014ba0 con 0x7fd74c072d30 2024-09-16T01:22:24.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.880+0000 7fd742ffd640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd72c06c2b0 0x7fd72c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:24.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.880+0000 7fd749d9b640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd72c06c2b0 0x7fd72c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:24.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.880+0000 7fd742ffd640 1 -- 172.21.15.81:0/3253912707 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fd74408bbd0 con 0x7fd74c072d30 2024-09-16T01:22:24.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.881+0000 7fd749d9b640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd72c06c2b0 0x7fd72c06e770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd734034000 tx=0x7fd73402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:24.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:24.885+0000 7fd742ffd640 1 -- 172.21.15.81:0/3253912707 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd744059bf0 con 0x7fd74c072d30 2024-09-16T01:22:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.086+0000 7fd750baf640 1 -- 172.21.15.81:0/3253912707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd74c0b4970 con 0x7fd74c072d30 2024-09-16T01:22:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.086+0000 7fd742ffd640 1 -- 172.21.15.81:0/3253912707 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5228 (secure 0 0 0) 0x7fd74405def0 con 0x7fd74c072d30 2024-09-16T01:22:25.088 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:25.089 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":60,"btime":"2024-09-16T01:22:17:366287+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2485445274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2485445274},{"type":"v1","addr":"172.21.15.81:6835","nonce":2485445274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1320169323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1320169323},{"type":"v1","addr":"172.21.15.81:6837","nonce":1320169323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2539150967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2539150967},{"type":"v1","addr":"172.21.15.102:6834","nonce":2539150967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:00.439163+0000","modified":"2024-09-16T01:22:17.128872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":7,"addr":"172.21.15.102:6835/415655488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":415655488},{"type":"v1","addr":"172.21.15.102:6835","nonce":415655488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7266,"qdb_cluster":[7266]},"id":8}]} 2024-09-16T01:22:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 60 2024-09-16T01:22:25.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.088+0000 7fd750baf640 1 -- 172.21.15.81:0/3253912707 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd72c06c2b0 msgr2=0x7fd72c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.088+0000 7fd750baf640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd72c06c2b0 0x7fd72c06e770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd734034000 tx=0x7fd73402e000 comp rx=0 tx=0).stop 2024-09-16T01:22:25.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.088+0000 7fd750baf640 1 -- 172.21.15.81:0/3253912707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd74c072d30 msgr2=0x7fd74c14cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.089+0000 7fd750baf640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd74c072d30 0x7fd74c14cba0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fd744007e40 tx=0x7fd74400e4b0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.089+0000 7fd750baf640 1 -- 172.21.15.81:0/3253912707 shutdown_connections 2024-09-16T01:22:25.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.089+0000 7fd750baf640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd72c06c2b0 0x7fd72c06e770 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.089+0000 7fd750baf640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd74c15b300 0x7fd74c14fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.089+0000 7fd750baf640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd74c0cd3f0 0x7fd74c14f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.089+0000 7fd750baf640 1 --2- 172.21.15.81:0/3253912707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd74c072d30 0x7fd74c14cba0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.089+0000 7fd750baf640 1 -- 172.21.15.81:0/3253912707 >> 172.21.15.81:0/3253912707 conn(0x7fd74c067d70 msgr2=0x7fd74c15c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:25.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.089+0000 7fd750baf640 1 -- 172.21.15.81:0/3253912707 shutdown_connections 2024-09-16T01:22:25.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.089+0000 7fd750baf640 1 -- 172.21.15.81:0/3253912707 wait complete. 2024-09-16T01:22:25.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:25.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.200+0000 7f32d63c4640 1 Processor -- start 2024-09-16T01:22:25.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.200+0000 7f32d63c4640 1 -- start start 2024-09-16T01:22:25.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.200+0000 7f32d63c4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f32d015fc30 0x7f32d0071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.200+0000 7f32d63c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32d00b17d0 0x7f32d009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.200+0000 7f32d63c4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d009ba30 con 0x7f32d009af70 2024-09-16T01:22:25.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.200+0000 7f32d63c4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f32d00b1590 con 0x7f32d015fc30 2024-09-16T01:22:25.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.200+0000 7f32d63c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f32d0160ab0 con 0x7f32d00b17d0 2024-09-16T01:22:25.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.201+0000 7f32cffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f32d015fc30 0x7f32d0071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.201+0000 7f32cf7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32d00b17d0 0x7f32d009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.201+0000 7f32cffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f32d015fc30 0x7f32d0071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:45806/0 (socket says 172.21.15.81:45806) 2024-09-16T01:22:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.201+0000 7f32cffff640 1 -- 172.21.15.81:0/4220605156 learned_addr learned my addr 172.21.15.81:0/4220605156 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.201+0000 7f32d4961640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f32d009af70 0x7f32d00d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:33480/0 (socket says 172.21.15.81:33480) 2024-09-16T01:22:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.201+0000 7f32cf7fe640 1 -- 172.21.15.81:0/4220605156 >> v2:172.21.15.102:3300/0 conn(0x7f32d015fc30 msgr2=0x7f32d0071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.201+0000 7f32cf7fe640 1 --2- 172.21.15.81:0/4220605156 >> v2:172.21.15.102:3300/0 conn(0x7f32d015fc30 0x7f32d0071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.201+0000 7f32cf7fe640 1 -- 172.21.15.81:0/4220605156 >> v1:172.21.15.102:6789/0 conn(0x7f32d009af70 legacy=0x7f32d00d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.201+0000 7f32cf7fe640 1 -- 172.21.15.81:0/4220605156 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d009bcf0 con 0x7f32d00b17d0 2024-09-16T01:22:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.201+0000 7f32ceffd640 1 -- 172.21.15.81:0/4220605156 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006005988 0 0) 0x7f32d009ba30 con 0x7f32d009af70 2024-09-16T01:22:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.201+0000 7f32cffff640 1 --2- 172.21.15.81:0/4220605156 >> v2:172.21.15.102:3300/0 conn(0x7f32d015fc30 0x7f32d0071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.202+0000 7f32cf7fe640 1 --2- 172.21.15.81:0/4220605156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32d00b17d0 0x7f32d009aa30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f32c40097a0 tx=0x7f32c402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75713d7b6533b8e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.202+0000 7f32ceffd640 1 -- 172.21.15.81:0/4220605156 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4037070 con 0x7f32d00b17d0 2024-09-16T01:22:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.202+0000 7f32ceffd640 1 -- 172.21.15.81:0/4220605156 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c402ae50 con 0x7f32d00b17d0 2024-09-16T01:22:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.202+0000 7f32ceffd640 1 -- 172.21.15.81:0/4220605156 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4032660 con 0x7f32d00b17d0 2024-09-16T01:22:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.202+0000 7f32d63c4640 1 -- 172.21.15.81:0/4220605156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32d00b17d0 msgr2=0x7f32d009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.202+0000 7f32d63c4640 1 --2- 172.21.15.81:0/4220605156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32d00b17d0 0x7f32d009aa30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f32c40097a0 tx=0x7f32c402a100 comp rx=0 tx=0).stop 2024-09-16T01:22:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.203+0000 7f32d63c4640 1 -- 172.21.15.81:0/4220605156 shutdown_connections 2024-09-16T01:22:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.203+0000 7f32d63c4640 1 --2- 172.21.15.81:0/4220605156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32d00b17d0 0x7f32d009aa30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.203+0000 7f32d63c4640 1 --2- 172.21.15.81:0/4220605156 >> v2:172.21.15.102:3300/0 conn(0x7f32d015fc30 0x7f32d0071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.203+0000 7f32d63c4640 1 -- 172.21.15.81:0/4220605156 >> 172.21.15.81:0/4220605156 conn(0x7f32d00d23a0 msgr2=0x7f32d00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.203+0000 7f32d63c4640 1 -- 172.21.15.81:0/4220605156 shutdown_connections 2024-09-16T01:22:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.203+0000 7f32d63c4640 1 -- 172.21.15.81:0/4220605156 wait complete. 2024-09-16T01:22:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.204+0000 7f32d63c4640 1 Processor -- start 2024-09-16T01:22:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.204+0000 7f32d63c4640 1 -- start start 2024-09-16T01:22:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d63c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32d009af70 0x7f32d0153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d63c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32d00b17d0 0x7f32d00c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d63c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32d015fc30 0x7f32d00cf790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d63c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32d00b1bd0 con 0x7f32d015fc30 2024-09-16T01:22:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d63c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f32d0160fe0 con 0x7f32d00b17d0 2024-09-16T01:22:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d63c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f32d0071500 con 0x7f32d009af70 2024-09-16T01:22:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d4961640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32d015fc30 0x7f32d00cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d4961640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32d015fc30 0x7f32d00cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51372/0 (socket says 172.21.15.81:51372) 2024-09-16T01:22:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d4961640 1 -- 172.21.15.81:0/3533473282 learned_addr learned my addr 172.21.15.81:0/3533473282 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:25.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32cffff640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32d009af70 0x7f32d0153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32cf7fe640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32d00b17d0 0x7f32d00c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d4961640 1 -- 172.21.15.81:0/3533473282 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32d009af70 msgr2=0x7f32d0153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d4961640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32d009af70 0x7f32d0153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d4961640 1 -- 172.21.15.81:0/3533473282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32d00b17d0 msgr2=0x7f32d00c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d4961640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32d00b17d0 0x7f32d00c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d4961640 1 -- 172.21.15.81:0/3533473282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d01f59d0 con 0x7f32d015fc30 2024-09-16T01:22:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32cffff640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32d009af70 0x7f32d0153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32cf7fe640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32d00b17d0 0x7f32d00c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d4961640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32d015fc30 0x7f32d00cf790 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f32c800c7a0 tx=0x7f32c800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32ccff9640 1 -- 172.21.15.81:0/3533473282 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8018070 con 0x7f32d015fc30 2024-09-16T01:22:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32ccff9640 1 -- 172.21.15.81:0/3533473282 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c800a640 con 0x7f32d015fc30 2024-09-16T01:22:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32d63c4640 1 -- 172.21.15.81:0/3533473282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d01f5c40 con 0x7f32d015fc30 2024-09-16T01:22:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.205+0000 7f32ccff9640 1 -- 172.21.15.81:0/3533473282 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c800aab0 con 0x7f32d015fc30 2024-09-16T01:22:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.206+0000 7f32d63c4640 1 -- 172.21.15.81:0/3533473282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d01f6200 con 0x7f32d015fc30 2024-09-16T01:22:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.206+0000 7f32d63c4640 1 -- 172.21.15.81:0/3533473282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d009aa30 con 0x7f32d015fc30 2024-09-16T01:22:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.207+0000 7f32ccff9640 1 -- 172.21.15.81:0/3533473282 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f32c801b070 con 0x7f32d015fc30 2024-09-16T01:22:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.207+0000 7f32ccff9640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f32bc06c2e0 0x7f32bc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.207+0000 7f32ccff9640 1 -- 172.21.15.81:0/3533473282 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f32c808abd0 con 0x7f32d015fc30 2024-09-16T01:22:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.208+0000 7f32cffff640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f32bc06c2e0 0x7f32bc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.208+0000 7f32cffff640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f32bc06c2e0 0x7f32bc06e7a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009a20 tx=0x7f32c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:25.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.212+0000 7f32ccff9640 1 -- 172.21.15.81:0/3533473282 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32c80591b0 con 0x7f32d015fc30 2024-09-16T01:22:25.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.413+0000 7f32d63c4640 1 -- 172.21.15.81:0/3533473282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32d00b2120 con 0x7f32d015fc30 2024-09-16T01:22:25.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.413+0000 7f32ccff9640 1 -- 172.21.15.81:0/3533473282 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5228 (secure 0 0 0) 0x7f32c8058ab0 con 0x7f32d015fc30 2024-09-16T01:22:25.415 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:25.415 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":60,"btime":"2024-09-16T01:22:17:366287+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2485445274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2485445274},{"type":"v1","addr":"172.21.15.81:6835","nonce":2485445274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1320169323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1320169323},{"type":"v1","addr":"172.21.15.81:6837","nonce":1320169323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2539150967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2539150967},{"type":"v1","addr":"172.21.15.102:6834","nonce":2539150967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:00.439163+0000","modified":"2024-09-16T01:22:17.128872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":7,"addr":"172.21.15.102:6835/415655488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":415655488},{"type":"v1","addr":"172.21.15.102:6835","nonce":415655488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7266,"qdb_cluster":[7266]},"id":8}]} 2024-09-16T01:22:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 60 2024-09-16T01:22:25.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.415+0000 7f32d63c4640 1 -- 172.21.15.81:0/3533473282 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f32bc06c2e0 msgr2=0x7f32bc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.415+0000 7f32d63c4640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f32bc06c2e0 0x7f32bc06e7a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009a20 tx=0x7f32c0008040 comp rx=0 tx=0).stop 2024-09-16T01:22:25.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.415+0000 7f32d63c4640 1 -- 172.21.15.81:0/3533473282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32d015fc30 msgr2=0x7f32d00cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.415+0000 7f32d63c4640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32d015fc30 0x7f32d00cf790 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f32c800c7a0 tx=0x7f32c800cc60 comp rx=0 tx=0).stop 2024-09-16T01:22:25.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.415+0000 7f32d63c4640 1 -- 172.21.15.81:0/3533473282 shutdown_connections 2024-09-16T01:22:25.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.415+0000 7f32d63c4640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f32bc06c2e0 0x7f32bc06e7a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.415+0000 7f32d63c4640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32d015fc30 0x7f32d00cf790 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.415+0000 7f32d63c4640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32d00b17d0 0x7f32d00c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.415+0000 7f32d63c4640 1 --2- 172.21.15.81:0/3533473282 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32d009af70 0x7f32d0153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.415+0000 7f32d63c4640 1 -- 172.21.15.81:0/3533473282 >> 172.21.15.81:0/3533473282 conn(0x7f32d00d23a0 msgr2=0x7f32d01544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:25.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.415+0000 7f32d63c4640 1 -- 172.21.15.81:0/3533473282 shutdown_connections 2024-09-16T01:22:25.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.415+0000 7f32d63c4640 1 -- 172.21.15.81:0/3533473282 wait complete. 2024-09-16T01:22:25.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:22:25.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.523+0000 7fa7bf111640 1 Processor -- start 2024-09-16T01:22:25.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.523+0000 7fa7bf111640 1 -- start start 2024-09-16T01:22:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.524+0000 7fa7bf111640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa7b80b6b40 0x7fa7b80cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.524+0000 7fa7bf111640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b8140010 0x7fa7b8140480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.524+0000 7fa7bf111640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7b80cf770 con 0x7fa7b80b6760 2024-09-16T01:22:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.524+0000 7fa7bf111640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa7b81409c0 con 0x7fa7b80b6b40 2024-09-16T01:22:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.524+0000 7fa7bf111640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b806f7e0 con 0x7fa7b8140010 2024-09-16T01:22:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.524+0000 7fa7bcead640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa7b80b6760 0x7fa7b815b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60180/0 (socket says 172.21.15.81:60180) 2024-09-16T01:22:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.524+0000 7fa7bcead640 1 -- 172.21.15.81:0/1364052690 learned_addr learned my addr 172.21.15.81:0/1364052690 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.524+0000 7fa7affff640 1 --2- 172.21.15.81:0/1364052690 >> v2:172.21.15.102:3300/0 conn(0x7fa7b80b6b40 0x7fa7b80cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.524+0000 7fa7bd6ae640 1 --2- 172.21.15.81:0/1364052690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b8140010 0x7fa7b8140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.524+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4218176437 0 0) 0x7fa7b80cf770 con 0x7fa7b80b6760 2024-09-16T01:22:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.524+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7a0003520 con 0x7fa7b80b6760 2024-09-16T01:22:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 925402380 0 0) 0x7fa7a0003520 con 0x7fa7b80b6760 2024-09-16T01:22:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b8140010 msgr2=0x7fa7b8140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 --2- 172.21.15.81:0/1364052690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b8140010 0x7fa7b8140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 >> v2:172.21.15.102:3300/0 conn(0x7fa7b80b6b40 msgr2=0x7fa7b80cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 --2- 172.21.15.81:0/1364052690 >> v2:172.21.15.102:3300/0 conn(0x7fa7b80b6b40 0x7fa7b80cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b80cfa50 con 0x7fa7b80b6760 2024-09-16T01:22:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fa7b4001670 con 0x7fa7b80b6760 2024-09-16T01:22:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 >> v1:172.21.15.81:6789/0 conn(0x7fa7b80b6760 legacy=0x7fa7b815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 --2- 172.21.15.81:0/1364052690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b8140010 0x7fa7a00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 --2- 172.21.15.81:0/1364052690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a0003f30 0x7fa7a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 --2- 172.21.15.81:0/1364052690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7a0004d40 0x7fa7a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b81409c0 con 0x7fa7a0003f30 2024-09-16T01:22:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b806f7e0 con 0x7fa7a0004d40 2024-09-16T01:22:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a000b9c0 con 0x7fa7b8140010 2024-09-16T01:22:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7affff640 1 --2- 172.21.15.81:0/1364052690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a0003f30 0x7fa7a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7bcead640 1 --2- 172.21.15.81:0/1364052690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b8140010 0x7fa7a00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7bd6ae640 1 --2- 172.21.15.81:0/1364052690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7a0004d40 0x7fa7a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7affff640 1 -- 172.21.15.81:0/1364052690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b8140010 msgr2=0x7fa7a00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7affff640 1 --2- 172.21.15.81:0/1364052690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b8140010 0x7fa7a00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7affff640 1 -- 172.21.15.81:0/1364052690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7a0004d40 msgr2=0x7fa7a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7affff640 1 --2- 172.21.15.81:0/1364052690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7a0004d40 0x7fa7a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.525+0000 7fa7affff640 1 -- 172.21.15.81:0/1364052690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a0003520 con 0x7fa7a0003f30 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.526+0000 7fa7affff640 1 --2- 172.21.15.81:0/1364052690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a0003f30 0x7fa7a0004800 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009ac0 tx=0x7fa7a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd6f57a73c43be server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.526+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8036070 con 0x7fa7a0003f30 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.526+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a8031400 con 0x7fa7a0003f30 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.526+0000 7fa7af7fe640 1 -- 172.21.15.81:0/1364052690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8009690 con 0x7fa7a0003f30 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.526+0000 7fa7bf111640 1 -- 172.21.15.81:0/1364052690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a0003f30 msgr2=0x7fa7a0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.526+0000 7fa7bf111640 1 --2- 172.21.15.81:0/1364052690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a0003f30 0x7fa7a0004800 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009ac0 tx=0x7fa7a0005830 comp rx=0 tx=0).stop 2024-09-16T01:22:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.526+0000 7fa7bd6ae640 1 -- 172.21.15.81:0/1364052690 reap_dead start 2024-09-16T01:22:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.526+0000 7fa7bf111640 1 -- 172.21.15.81:0/1364052690 shutdown_connections 2024-09-16T01:22:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.526+0000 7fa7bf111640 1 -- 172.21.15.81:0/1364052690 >> 172.21.15.81:0/1364052690 conn(0x7fa7b806bc10 msgr2=0x7fa7b806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.527+0000 7fa7bf111640 1 -- 172.21.15.81:0/1364052690 shutdown_connections 2024-09-16T01:22:25.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.527+0000 7fa7bf111640 1 -- 172.21.15.81:0/1364052690 wait complete. 2024-09-16T01:22:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.528+0000 7fa7bf111640 1 Processor -- start 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.528+0000 7fa7bf111640 1 -- start start 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bf111640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a0003f30 0x7fa7b8143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bf111640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b813a030 0x7fa7b813c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bf111640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b813a4b0 0x7fa7b813ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bf111640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b80d02f0 con 0x7fa7a0003f30 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bf111640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b80d0010 con 0x7fa7b813a4b0 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bf111640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b80d0810 con 0x7fa7b813a030 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bcead640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a0003f30 0x7fa7b8143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bcead640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a0003f30 0x7fa7b8143340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51402/0 (socket says 172.21.15.81:51402) 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bcead640 1 -- 172.21.15.81:0/1724796222 learned_addr learned my addr 172.21.15.81:0/1724796222 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7affff640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b813a030 0x7fa7b813c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bd6ae640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b813a4b0 0x7fa7b813ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bcead640 1 -- 172.21.15.81:0/1724796222 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b813a030 msgr2=0x7fa7b813c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bcead640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b813a030 0x7fa7b813c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bcead640 1 -- 172.21.15.81:0/1724796222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b813a4b0 msgr2=0x7fa7b813ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bcead640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b813a4b0 0x7fa7b813ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bcead640 1 -- 172.21.15.81:0/1724796222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b813aa10 con 0x7fa7a0003f30 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bcead640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a0003f30 0x7fa7b8143340 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400e840 tx=0x7fa7b400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7ad7fa640 1 -- 172.21.15.81:0/1724796222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400c8d0 con 0x7fa7a0003f30 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7ad7fa640 1 -- 172.21.15.81:0/1724796222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b4018070 con 0x7fa7a0003f30 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7ad7fa640 1 -- 172.21.15.81:0/1724796222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400ccf0 con 0x7fa7a0003f30 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bf111640 1 -- 172.21.15.81:0/1724796222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b813acf0 con 0x7fa7a0003f30 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.529+0000 7fa7bf111640 1 -- 172.21.15.81:0/1724796222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b813b2b0 con 0x7fa7a0003f30 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.531+0000 7fa7bf111640 1 -- 172.21.15.81:0/1724796222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b8140480 con 0x7fa7a0003f30 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.531+0000 7fa7ad7fa640 1 -- 172.21.15.81:0/1724796222 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa7b401d460 con 0x7fa7a0003f30 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.531+0000 7fa7ad7fa640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa7a406c2e0 0x7fa7a406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.532+0000 7fa7affff640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa7a406c2e0 0x7fa7a406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.532+0000 7fa7ad7fa640 1 -- 172.21.15.81:0/1724796222 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fa7b408b400 con 0x7fa7a0003f30 2024-09-16T01:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.532+0000 7fa7affff640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa7a406c2e0 0x7fa7a406e7a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8033000 tx=0x7fa7a8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.536+0000 7fa7ad7fa640 1 -- 172.21.15.81:0/1724796222 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7b4059390 con 0x7fa7a0003f30 2024-09-16T01:22:25.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.703+0000 7fa7bf111640 1 -- 172.21.15.81:0/1724796222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7b80ce060 con 0x7fa7a0003f30 2024-09-16T01:22:25.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.704+0000 7fa7ad7fa640 1 -- 172.21.15.81:0/1724796222 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+17012 (secure 0 0 0) 0x7fa7b405d690 con 0x7fa7a0003f30 2024-09-16T01:22:25.706 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:25.706 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":113,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:22:02.101802+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:59.046470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:59.403171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:22:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.706+0000 7fa7bf111640 1 -- 172.21.15.81:0/1724796222 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa7a406c2e0 msgr2=0x7fa7a406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.706+0000 7fa7bf111640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa7a406c2e0 0x7fa7a406e7a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8033000 tx=0x7fa7a8008030 comp rx=0 tx=0).stop 2024-09-16T01:22:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.706+0000 7fa7bf111640 1 -- 172.21.15.81:0/1724796222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a0003f30 msgr2=0x7fa7b8143340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.706+0000 7fa7bf111640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a0003f30 0x7fa7b8143340 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400e840 tx=0x7fa7b400ed00 comp rx=0 tx=0).stop 2024-09-16T01:22:25.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.706+0000 7fa7bf111640 1 -- 172.21.15.81:0/1724796222 shutdown_connections 2024-09-16T01:22:25.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.706+0000 7fa7bf111640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa7a406c2e0 0x7fa7a406e7a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.706+0000 7fa7bf111640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b813a4b0 0x7fa7b813ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.706+0000 7fa7bf111640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7b813a030 0x7fa7b813c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.706+0000 7fa7bf111640 1 --2- 172.21.15.81:0/1724796222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7a0003f30 0x7fa7b8143340 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.706+0000 7fa7bf111640 1 -- 172.21.15.81:0/1724796222 >> 172.21.15.81:0/1724796222 conn(0x7fa7b806bc10 msgr2=0x7fa7b81396e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:25.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.706+0000 7fa7bf111640 1 -- 172.21.15.81:0/1724796222 shutdown_connections 2024-09-16T01:22:25.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.706+0000 7fa7bf111640 1 -- 172.21.15.81:0/1724796222 wait complete. 2024-09-16T01:22:25.719 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:22:25.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:25.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.815+0000 7fc0f1c53640 1 Processor -- start 2024-09-16T01:22:25.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.815+0000 7fc0f1c53640 1 -- start start 2024-09-16T01:22:25.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.816+0000 7fc0f1c53640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec0d06e0 0x7fc0ec0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.816+0000 7fc0f1c53640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc0ec09b510 0x7fc0ec09b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.816+0000 7fc0f1c53640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ec0d00a0 con 0x7fc0ec15d3e0 2024-09-16T01:22:25.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.816+0000 7fc0f1c53640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc0ec09b080 con 0x7fc0ec09b510 2024-09-16T01:22:25.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.816+0000 7fc0f1c53640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc0ec0d0380 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.816+0000 7fc0eb7fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec0d06e0 0x7fc0ec0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.816+0000 7fc0ebfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc0ec09b510 0x7fc0ec09b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.816+0000 7fc0eaffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc0ec15d3e0 0x7fc0ec0d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:33486/0 (socket says 172.21.15.81:33486) 2024-09-16T01:22:25.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.816+0000 7fc0eaffd640 1 -- 172.21.15.81:0/3280138253 learned_addr learned my addr 172.21.15.81:0/3280138253 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:25.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.817+0000 7fc0ea7fc640 1 -- 172.21.15.81:0/3280138253 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3954863640 0 0) 0x7fc0ec0d00a0 con 0x7fc0ec15d3e0 2024-09-16T01:22:25.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.817+0000 7fc0ea7fc640 1 -- 172.21.15.81:0/3280138253 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0d4003520 con 0x7fc0ec15d3e0 2024-09-16T01:22:25.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.817+0000 7fc0eb7fe640 1 -- 172.21.15.81:0/3280138253 >> v2:172.21.15.102:3300/0 conn(0x7fc0ec09b510 msgr2=0x7fc0ec09b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:25.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.817+0000 7fc0eb7fe640 1 --2- 172.21.15.81:0/3280138253 >> v2:172.21.15.102:3300/0 conn(0x7fc0ec09b510 0x7fc0ec09b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.817+0000 7fc0eb7fe640 1 -- 172.21.15.81:0/3280138253 >> v1:172.21.15.102:6789/0 conn(0x7fc0ec15d3e0 legacy=0x7fc0ec0d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.817+0000 7fc0eb7fe640 1 -- 172.21.15.81:0/3280138253 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ec09aa30 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.817+0000 7fc0ebfff640 1 --2- 172.21.15.81:0/3280138253 >> v2:172.21.15.102:3300/0 conn(0x7fc0ec09b510 0x7fc0ec09b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.817+0000 7fc0eb7fe640 1 --2- 172.21.15.81:0/3280138253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec0d06e0 0x7fc0ec0ce8b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009d90 tx=0x7fc0dc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33ada588cbeac0c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:25.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.818+0000 7fc0ea7fc640 1 -- 172.21.15.81:0/3280138253 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc007740 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.818+0000 7fc0ea7fc640 1 -- 172.21.15.81:0/3280138253 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0dc0078e0 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.818+0000 7fc0ea7fc640 1 -- 172.21.15.81:0/3280138253 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc007c90 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.818+0000 7fc0f1c53640 1 -- 172.21.15.81:0/3280138253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec0d06e0 msgr2=0x7fc0ec0ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.818+0000 7fc0f1c53640 1 --2- 172.21.15.81:0/3280138253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec0d06e0 0x7fc0ec0ce8b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc009d90 tx=0x7fc0dc02a660 comp rx=0 tx=0).stop 2024-09-16T01:22:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.818+0000 7fc0f1c53640 1 -- 172.21.15.81:0/3280138253 shutdown_connections 2024-09-16T01:22:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.818+0000 7fc0f1c53640 1 --2- 172.21.15.81:0/3280138253 >> v2:172.21.15.102:3300/0 conn(0x7fc0ec09b510 0x7fc0ec09b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.818+0000 7fc0f1c53640 1 --2- 172.21.15.81:0/3280138253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec0d06e0 0x7fc0ec0ce8b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.818+0000 7fc0f1c53640 1 -- 172.21.15.81:0/3280138253 >> 172.21.15.81:0/3280138253 conn(0x7fc0ec0d23a0 msgr2=0x7fc0ec0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.818+0000 7fc0f1c53640 1 -- 172.21.15.81:0/3280138253 shutdown_connections 2024-09-16T01:22:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.818+0000 7fc0f1c53640 1 -- 172.21.15.81:0/3280138253 wait complete. 2024-09-16T01:22:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.819+0000 7fc0f1c53640 1 Processor -- start 2024-09-16T01:22:25.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.820+0000 7fc0f1c53640 1 -- start start 2024-09-16T01:22:25.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.820+0000 7fc0f1c53640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ec09b510 0x7fc0ec15b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.820+0000 7fc0f1c53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec0d06e0 0x7fc0ec154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.820+0000 7fc0f1c53640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec15d3e0 0x7fc0ec071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.820+0000 7fc0f1c53640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec15c740 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.820+0000 7fc0f1c53640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec15d800 con 0x7fc0ec09b510 2024-09-16T01:22:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.820+0000 7fc0f1c53640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc0ec0ccf90 con 0x7fc0ec15d3e0 2024-09-16T01:22:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.820+0000 7fc0eaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec0d06e0 0x7fc0ec154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.820+0000 7fc0eaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec0d06e0 0x7fc0ec154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51412/0 (socket says 172.21.15.81:51412) 2024-09-16T01:22:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.820+0000 7fc0eaffd640 1 -- 172.21.15.81:0/536269701 learned_addr learned my addr 172.21.15.81:0/536269701 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.820+0000 7fc0ebfff640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec15d3e0 0x7fc0ec071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.820+0000 7fc0eb7fe640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ec09b510 0x7fc0ec15b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.821+0000 7fc0eaffd640 1 -- 172.21.15.81:0/536269701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec15d3e0 msgr2=0x7fc0ec071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.821+0000 7fc0eaffd640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec15d3e0 0x7fc0ec071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.821+0000 7fc0eaffd640 1 -- 172.21.15.81:0/536269701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ec09b510 msgr2=0x7fc0ec15b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.821+0000 7fc0eaffd640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ec09b510 0x7fc0ec15b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:25.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.821+0000 7fc0eaffd640 1 -- 172.21.15.81:0/536269701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ec0c6050 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.821+0000 7fc0eaffd640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec0d06e0 0x7fc0ec154f40 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000c390 tx=0x7fc0e000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.821+0000 7fc0d3fff640 1 -- 172.21.15.81:0/536269701 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0017070 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.821+0000 7fc0d3fff640 1 -- 172.21.15.81:0/536269701 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e0005d00 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.821+0000 7fc0f1c53640 1 -- 172.21.15.81:0/536269701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0ec0b73e0 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.821+0000 7fc0d3fff640 1 -- 172.21.15.81:0/536269701 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0007310 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.821+0000 7fc0f1c53640 1 -- 172.21.15.81:0/536269701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0ec155480 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.822+0000 7fc0f1c53640 1 -- 172.21.15.81:0/536269701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0ec0d00a0 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.823+0000 7fc0d3fff640 1 -- 172.21.15.81:0/536269701 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc0e001a070 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.823+0000 7fc0d3fff640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc0d806c2e0 0x7fc0d806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:25.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.823+0000 7fc0d3fff640 1 -- 172.21.15.81:0/536269701 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fc0e008a810 con 0x7fc0ec0d06e0 2024-09-16T01:22:25.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.823+0000 7fc0eb7fe640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc0d806c2e0 0x7fc0d806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:25.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.824+0000 7fc0eb7fe640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc0d806c2e0 0x7fc0d806e7a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc034000 tx=0x7fc0dc02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:25.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:25.827+0000 7fc0d3fff640 1 -- 172.21.15.81:0/536269701 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc0e00587a0 con 0x7fc0ec0d06e0 2024-09-16T01:22:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.025+0000 7fc0f1c53640 1 -- 172.21.15.81:0/536269701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0ec0d1b20 con 0x7fc0ec0d06e0 2024-09-16T01:22:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.025+0000 7fc0d3fff640 1 -- 172.21.15.81:0/536269701 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5228 (secure 0 0 0) 0x7fc0e005caa0 con 0x7fc0ec0d06e0 2024-09-16T01:22:26.027 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:26.028 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":60,"btime":"2024-09-16T01:22:17:366287+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2485445274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2485445274},{"type":"v1","addr":"172.21.15.81:6835","nonce":2485445274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1320169323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1320169323},{"type":"v1","addr":"172.21.15.81:6837","nonce":1320169323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2539150967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2539150967},{"type":"v1","addr":"172.21.15.102:6834","nonce":2539150967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:00.439163+0000","modified":"2024-09-16T01:22:17.128872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":7,"addr":"172.21.15.102:6835/415655488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":415655488},{"type":"v1","addr":"172.21.15.102:6835","nonce":415655488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7266,"qdb_cluster":[7266]},"id":8}]} 2024-09-16T01:22:26.028 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 60 2024-09-16T01:22:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.027+0000 7fc0f1c53640 1 -- 172.21.15.81:0/536269701 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc0d806c2e0 msgr2=0x7fc0d806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.027+0000 7fc0f1c53640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc0d806c2e0 0x7fc0d806e7a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc034000 tx=0x7fc0dc02f000 comp rx=0 tx=0).stop 2024-09-16T01:22:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.027+0000 7fc0f1c53640 1 -- 172.21.15.81:0/536269701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec0d06e0 msgr2=0x7fc0ec154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.027+0000 7fc0f1c53640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec0d06e0 0x7fc0ec154f40 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000c390 tx=0x7fc0e000c790 comp rx=0 tx=0).stop 2024-09-16T01:22:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.027+0000 7fc0f1c53640 1 -- 172.21.15.81:0/536269701 shutdown_connections 2024-09-16T01:22:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.027+0000 7fc0f1c53640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc0d806c2e0 0x7fc0d806e7a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.027+0000 7fc0f1c53640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0ec15d3e0 0x7fc0ec071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.027+0000 7fc0f1c53640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0ec0d06e0 0x7fc0ec154f40 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.027+0000 7fc0f1c53640 1 --2- 172.21.15.81:0/536269701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ec09b510 0x7fc0ec15b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.027+0000 7fc0f1c53640 1 -- 172.21.15.81:0/536269701 >> 172.21.15.81:0/536269701 conn(0x7fc0ec0d23a0 msgr2=0x7fc0ec0d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.027+0000 7fc0f1c53640 1 -- 172.21.15.81:0/536269701 shutdown_connections 2024-09-16T01:22:26.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.028+0000 7fc0f1c53640 1 -- 172.21.15.81:0/536269701 wait complete. 2024-09-16T01:22:26.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:26.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.137+0000 7fee10f13640 1 Processor -- start 2024-09-16T01:22:26.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.137+0000 7fee10f13640 1 -- start start 2024-09-16T01:22:26.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.138+0000 7fee10f13640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fee0c15e760 0x7fee0c06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.138+0000 7fee10f13640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee0c0d4fd0 0x7fee0c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.138+0000 7fee10f13640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee0c0d2700 con 0x7fee0c0b3650 2024-09-16T01:22:26.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.138+0000 7fee10f13640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fee0c0cedb0 con 0x7fee0c0d4fd0 2024-09-16T01:22:26.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.138+0000 7fee10f13640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fee0c0cf090 con 0x7fee0c15e760 2024-09-16T01:22:26.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.138+0000 7fee09d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee0c0d4fd0 0x7fee0c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.138+0000 7fee0ad9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee0c0b3650 0x7fee0c0d2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60194/0 (socket says 172.21.15.81:60194) 2024-09-16T01:22:26.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.138+0000 7fee0ad9d640 1 -- 172.21.15.81:0/3666805901 learned_addr learned my addr 172.21.15.81:0/3666805901 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:26.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.138+0000 7fee0a59c640 1 --2- 172.21.15.81:0/3666805901 >> v2:172.21.15.102:3300/0 conn(0x7fee0c15e760 0x7fee0c06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.139+0000 7fee09d9b640 1 -- 172.21.15.81:0/3666805901 >> v2:172.21.15.102:3300/0 conn(0x7fee0c15e760 msgr2=0x7fee0c06cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:26.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.139+0000 7fee09d9b640 1 --2- 172.21.15.81:0/3666805901 >> v2:172.21.15.102:3300/0 conn(0x7fee0c15e760 0x7fee0c06cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.139+0000 7fee09d9b640 1 -- 172.21.15.81:0/3666805901 >> v1:172.21.15.81:6789/0 conn(0x7fee0c0b3650 legacy=0x7fee0c0d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.139+0000 7fee0959a640 1 -- 172.21.15.81:0/3666805901 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167739776 0 0) 0x7fee04001110 con 0x7fee0c0b3650 2024-09-16T01:22:26.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.139+0000 7fee09d9b640 1 -- 172.21.15.81:0/3666805901 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c0b3c80 con 0x7fee0c0d4fd0 2024-09-16T01:22:26.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.139+0000 7fee0a59c640 1 --2- 172.21.15.81:0/3666805901 >> v2:172.21.15.102:3300/0 conn(0x7fee0c15e760 0x7fee0c06cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:26.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.139+0000 7fee09d9b640 1 --2- 172.21.15.81:0/3666805901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c0d4fd0 0x7fee0c0cf5b0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fee0c08ca50 tx=0x7fedf402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d3361a59bdeca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.139+0000 7fee0959a640 1 -- 172.21.15.81:0/3666805901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4037070 con 0x7fee0c0d4fd0 2024-09-16T01:22:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.139+0000 7fee0959a640 1 -- 172.21.15.81:0/3666805901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf4032440 con 0x7fee0c0d4fd0 2024-09-16T01:22:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.139+0000 7fee0959a640 1 -- 172.21.15.81:0/3666805901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf402ae60 con 0x7fee0c0d4fd0 2024-09-16T01:22:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.140+0000 7fee10f13640 1 -- 172.21.15.81:0/3666805901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c0d4fd0 msgr2=0x7fee0c0cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.140+0000 7fee10f13640 1 --2- 172.21.15.81:0/3666805901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c0d4fd0 0x7fee0c0cf5b0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fee0c08ca50 tx=0x7fedf402a110 comp rx=0 tx=0).stop 2024-09-16T01:22:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.140+0000 7fee10f13640 1 -- 172.21.15.81:0/3666805901 shutdown_connections 2024-09-16T01:22:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.140+0000 7fee10f13640 1 --2- 172.21.15.81:0/3666805901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c0d4fd0 0x7fee0c0cf5b0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.140+0000 7fee10f13640 1 --2- 172.21.15.81:0/3666805901 >> v2:172.21.15.102:3300/0 conn(0x7fee0c15e760 0x7fee0c06cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.140+0000 7fee10f13640 1 -- 172.21.15.81:0/3666805901 >> 172.21.15.81:0/3666805901 conn(0x7fee0c08bfc0 msgr2=0x7fee0c0d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.140+0000 7fee10f13640 1 -- 172.21.15.81:0/3666805901 shutdown_connections 2024-09-16T01:22:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.140+0000 7fee10f13640 1 -- 172.21.15.81:0/3666805901 wait complete. 2024-09-16T01:22:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.141+0000 7fee10f13640 1 Processor -- start 2024-09-16T01:22:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.141+0000 7fee10f13640 1 -- start start 2024-09-16T01:22:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.142+0000 7fee10f13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee0c0b3650 0x7fee0c0ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.142+0000 7fee10f13640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee0c0d4fd0 0x7fee0c155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.142+0000 7fee10f13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c15e760 0x7fee0c0b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.142+0000 7fee10f13640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c0cff00 con 0x7fee0c15e760 2024-09-16T01:22:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.142+0000 7fee10f13640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c0cfd80 con 0x7fee0c0b3650 2024-09-16T01:22:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.142+0000 7fee10f13640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fee0c0d35b0 con 0x7fee0c0d4fd0 2024-09-16T01:22:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.142+0000 7fee0ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c15e760 0x7fee0c0b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.142+0000 7fee0ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c15e760 0x7fee0c0b9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51420/0 (socket says 172.21.15.81:51420) 2024-09-16T01:22:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.142+0000 7fee0ad9d640 1 -- 172.21.15.81:0/4262622220 learned_addr learned my addr 172.21.15.81:0/4262622220 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.142+0000 7fee0a59c640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee0c0b3650 0x7fee0c0ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee09d9b640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee0c0d4fd0 0x7fee0c155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee0ad9d640 1 -- 172.21.15.81:0/4262622220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee0c0d4fd0 msgr2=0x7fee0c155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee0ad9d640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee0c0d4fd0 0x7fee0c155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee0ad9d640 1 -- 172.21.15.81:0/4262622220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee0c0b3650 msgr2=0x7fee0c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee0ad9d640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee0c0b3650 0x7fee0c0ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee0ad9d640 1 -- 172.21.15.81:0/4262622220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c0b7fa0 con 0x7fee0c15e760 2024-09-16T01:22:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee0a59c640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee0c0b3650 0x7fee0c0ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee0ad9d640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c15e760 0x7fee0c0b9b30 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fee0400c3c0 tx=0x7fee0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee02ffd640 1 -- 172.21.15.81:0/4262622220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee040074e0 con 0x7fee0c15e760 2024-09-16T01:22:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee02ffd640 1 -- 172.21.15.81:0/4262622220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee04007680 con 0x7fee0c15e760 2024-09-16T01:22:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee10f13640 1 -- 172.21.15.81:0/4262622220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0c0b8280 con 0x7fee0c15e760 2024-09-16T01:22:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee02ffd640 1 -- 172.21.15.81:0/4262622220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04004a20 con 0x7fee0c15e760 2024-09-16T01:22:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.143+0000 7fee10f13640 1 -- 172.21.15.81:0/4262622220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee0c0b8840 con 0x7fee0c15e760 2024-09-16T01:22:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.144+0000 7fee10f13640 1 -- 172.21.15.81:0/4262622220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0c0b7d20 con 0x7fee0c15e760 2024-09-16T01:22:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.144+0000 7fee02ffd640 1 -- 172.21.15.81:0/4262622220 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fee04011070 con 0x7fee0c15e760 2024-09-16T01:22:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.145+0000 7fee02ffd640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedec06c2e0 0x7fedec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.145+0000 7fee02ffd640 1 -- 172.21.15.81:0/4262622220 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fee0408b120 con 0x7fee0c15e760 2024-09-16T01:22:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.145+0000 7fee0a59c640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedec06c2e0 0x7fedec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.145+0000 7fee0a59c640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedec06c2e0 0x7fedec06e7a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fee0c15a2a0 tx=0x7fedfc0074b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.149+0000 7fee02ffd640 1 -- 172.21.15.81:0/4262622220 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee0c0b7d20 con 0x7fee0c15e760 2024-09-16T01:22:26.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.348+0000 7fee10f13640 1 -- 172.21.15.81:0/4262622220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee0c0d3880 con 0x7fee0c15e760 2024-09-16T01:22:26.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.349+0000 7fee02ffd640 1 -- 172.21.15.81:0/4262622220 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5228 (secure 0 0 0) 0x7fee0c0d2700 con 0x7fee0c15e760 2024-09-16T01:22:26.351 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:26.351 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":60,"btime":"2024-09-16T01:22:17:366287+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2485445274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2485445274},{"type":"v1","addr":"172.21.15.81:6835","nonce":2485445274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1320169323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1320169323},{"type":"v1","addr":"172.21.15.81:6837","nonce":1320169323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2539150967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2539150967},{"type":"v1","addr":"172.21.15.102:6834","nonce":2539150967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:00.439163+0000","modified":"2024-09-16T01:22:17.128872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7266":{"gid":7266,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":7,"addr":"172.21.15.102:6835/415655488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":415655488},{"type":"v1","addr":"172.21.15.102:6835","nonce":415655488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7266,"qdb_cluster":[7266]},"id":8}]} 2024-09-16T01:22:26.351 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 60 2024-09-16T01:22:26.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.351+0000 7fee10f13640 1 -- 172.21.15.81:0/4262622220 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedec06c2e0 msgr2=0x7fedec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.351+0000 7fee10f13640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedec06c2e0 0x7fedec06e7a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fee0c15a2a0 tx=0x7fedfc0074b0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.351+0000 7fee10f13640 1 -- 172.21.15.81:0/4262622220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c15e760 msgr2=0x7fee0c0b9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.351+0000 7fee10f13640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c15e760 0x7fee0c0b9b30 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fee0400c3c0 tx=0x7fee0400c880 comp rx=0 tx=0).stop 2024-09-16T01:22:26.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.351+0000 7fee10f13640 1 -- 172.21.15.81:0/4262622220 shutdown_connections 2024-09-16T01:22:26.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.351+0000 7fee10f13640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fedec06c2e0 0x7fedec06e7a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.351+0000 7fee10f13640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee0c15e760 0x7fee0c0b9b30 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.351+0000 7fee10f13640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fee0c0d4fd0 0x7fee0c155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.351+0000 7fee10f13640 1 --2- 172.21.15.81:0/4262622220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee0c0b3650 0x7fee0c0ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.351+0000 7fee10f13640 1 -- 172.21.15.81:0/4262622220 >> 172.21.15.81:0/4262622220 conn(0x7fee0c08bfc0 msgr2=0x7fee0c0d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:26.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.351+0000 7fee10f13640 1 -- 172.21.15.81:0/4262622220 shutdown_connections 2024-09-16T01:22:26.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.351+0000 7fee10f13640 1 -- 172.21.15.81:0/4262622220 wait complete. 2024-09-16T01:22:26.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:22:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.461+0000 7f86d7c8d640 1 Processor -- start 2024-09-16T01:22:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.461+0000 7f86d7c8d640 1 -- start start 2024-09-16T01:22:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d7c8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86d0072d30 0x7f86d006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d7c8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86d006f700 0x7f86d015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d7c8d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d00cdbe0 con 0x7f86d015b300 2024-09-16T01:22:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d7c8d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f86d006fb50 con 0x7f86d006f700 2024-09-16T01:22:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d7c8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f86d00728a0 con 0x7f86d0072d30 2024-09-16T01:22:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d622a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86d006f700 0x7f86d015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d622a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86d006f700 0x7f86d015b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51426/0 (socket says 172.21.15.81:51426) 2024-09-16T01:22:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d622a640 1 -- 172.21.15.81:0/3602655439 learned_addr learned my addr 172.21.15.81:0/3602655439 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d5228640 1 --2- 172.21.15.81:0/3602655439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86d0072d30 0x7f86d006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d622a640 1 -- 172.21.15.81:0/3602655439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86d0072d30 msgr2=0x7f86d006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d622a640 1 --2- 172.21.15.81:0/3602655439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86d0072d30 0x7f86d006f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d622a640 1 -- 172.21.15.81:0/3602655439 >> v1:172.21.15.102:6789/0 conn(0x7f86d015b300 legacy=0x7f86d00cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.462+0000 7f86d622a640 1 -- 172.21.15.81:0/3602655439 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d00cd900 con 0x7f86d006f700 2024-09-16T01:22:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.463+0000 7f86d622a640 1 --2- 172.21.15.81:0/3602655439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86d006f700 0x7f86d015b6e0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009e50 tx=0x7f86c802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc51dec554ad4a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.463+0000 7f86d4a27640 1 -- 172.21.15.81:0/3602655439 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8036070 con 0x7f86d006f700 2024-09-16T01:22:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.463+0000 7f86d4a27640 1 -- 172.21.15.81:0/3602655439 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c8031600 con 0x7f86d006f700 2024-09-16T01:22:26.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.463+0000 7f86d4a27640 1 -- 172.21.15.81:0/3602655439 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c80319d0 con 0x7f86d006f700 2024-09-16T01:22:26.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.463+0000 7f86d7c8d640 1 -- 172.21.15.81:0/3602655439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86d006f700 msgr2=0x7f86d015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.463+0000 7f86d7c8d640 1 --2- 172.21.15.81:0/3602655439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86d006f700 0x7f86d015b6e0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009e50 tx=0x7f86c802a710 comp rx=0 tx=0).stop 2024-09-16T01:22:26.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.464+0000 7f86d7c8d640 1 -- 172.21.15.81:0/3602655439 shutdown_connections 2024-09-16T01:22:26.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.464+0000 7f86d7c8d640 1 --2- 172.21.15.81:0/3602655439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86d006f700 0x7f86d015b6e0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.464+0000 7f86d7c8d640 1 --2- 172.21.15.81:0/3602655439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86d0072d30 0x7f86d006f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.464+0000 7f86d7c8d640 1 -- 172.21.15.81:0/3602655439 >> 172.21.15.81:0/3602655439 conn(0x7f86d0067d70 msgr2=0x7f86d006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:26.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.464+0000 7f86d7c8d640 1 -- 172.21.15.81:0/3602655439 shutdown_connections 2024-09-16T01:22:26.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.464+0000 7f86d7c8d640 1 -- 172.21.15.81:0/3602655439 wait complete. 2024-09-16T01:22:26.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.465+0000 7f86d7c8d640 1 Processor -- start 2024-09-16T01:22:26.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.465+0000 7f86d7c8d640 1 -- start start 2024-09-16T01:22:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.465+0000 7f86d7c8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d006f700 0x7f86d0154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.465+0000 7f86d7c8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86d0072d30 0x7f86d01e6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.465+0000 7f86d7c8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86d015b300 0x7f86d0150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.465+0000 7f86d7c8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f86d00cd5c0 con 0x7f86d0072d30 2024-09-16T01:22:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.465+0000 7f86d7c8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f86d0072530 con 0x7f86d006f700 2024-09-16T01:22:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.465+0000 7f86d7c8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f86d00cffe0 con 0x7f86d015b300 2024-09-16T01:22:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d5228640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86d0072d30 0x7f86d01e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d5228640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86d0072d30 0x7f86d01e6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51428/0 (socket says 172.21.15.81:51428) 2024-09-16T01:22:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d5228640 1 -- 172.21.15.81:0/1553739030 learned_addr learned my addr 172.21.15.81:0/1553739030 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d5a29640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d006f700 0x7f86d0154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d622a640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86d015b300 0x7f86d0150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d5228640 1 -- 172.21.15.81:0/1553739030 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86d015b300 msgr2=0x7f86d0150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d5228640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86d015b300 0x7f86d0150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d5228640 1 -- 172.21.15.81:0/1553739030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d006f700 msgr2=0x7f86d0154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d5228640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d006f700 0x7f86d0154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d5228640 1 -- 172.21.15.81:0/1553739030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d01e41a0 con 0x7f86d0072d30 2024-09-16T01:22:26.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d5228640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86d0072d30 0x7f86d01e6dd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f86c000d800 tx=0x7f86c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:26.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86c67fc640 1 -- 172.21.15.81:0/1553739030 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c000b6c0 con 0x7f86d0072d30 2024-09-16T01:22:26.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86c67fc640 1 -- 172.21.15.81:0/1553739030 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c0019070 con 0x7f86d0072d30 2024-09-16T01:22:26.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d7c8d640 1 -- 172.21.15.81:0/1553739030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d01e4480 con 0x7f86d0072d30 2024-09-16T01:22:26.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86c67fc640 1 -- 172.21.15.81:0/1553739030 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c000ba80 con 0x7f86d0072d30 2024-09-16T01:22:26.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.466+0000 7f86d7c8d640 1 -- 172.21.15.81:0/1553739030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d0154570 con 0x7f86d0072d30 2024-09-16T01:22:26.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.467+0000 7f86d7c8d640 1 -- 172.21.15.81:0/1553739030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d006f1c0 con 0x7f86d0072d30 2024-09-16T01:22:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.468+0000 7f86c67fc640 1 -- 172.21.15.81:0/1553739030 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f86c000bc20 con 0x7f86d0072d30 2024-09-16T01:22:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.468+0000 7f86c67fc640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f86b406c2b0 0x7f86b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.468+0000 7f86c67fc640 1 -- 172.21.15.81:0/1553739030 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7f86c008baa0 con 0x7f86d0072d30 2024-09-16T01:22:26.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.468+0000 7f86d5a29640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f86b406c2b0 0x7f86b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.469+0000 7f86d5a29640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f86b406c2b0 0x7f86b406e770 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f86cc007fd0 tx=0x7f86cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:26.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.472+0000 7f86c67fc640 1 -- 172.21.15.81:0/1553739030 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86c005a070 con 0x7f86d0072d30 2024-09-16T01:22:26.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.639+0000 7f86d7c8d640 1 -- 172.21.15.81:0/1553739030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86d00cfd50 con 0x7f86d0072d30 2024-09-16T01:22:26.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.640+0000 7f86c67fc640 1 -- 172.21.15.81:0/1553739030 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+17012 (secure 0 0 0) 0x7f86c0059970 con 0x7f86d0072d30 2024-09-16T01:22:26.642 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:26.643 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":113,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:22:02.101802+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:21:59.046470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-09-16T01:21:59.403171+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:22:26.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.642+0000 7f86d7c8d640 1 -- 172.21.15.81:0/1553739030 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f86b406c2b0 msgr2=0x7f86b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.642+0000 7f86d7c8d640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f86b406c2b0 0x7f86b406e770 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f86cc007fd0 tx=0x7f86cc009040 comp rx=0 tx=0).stop 2024-09-16T01:22:26.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.642+0000 7f86d7c8d640 1 -- 172.21.15.81:0/1553739030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86d0072d30 msgr2=0x7f86d01e6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.642+0000 7f86d7c8d640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86d0072d30 0x7f86d01e6dd0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f86c000d800 tx=0x7f86c000dcc0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.642+0000 7f86d7c8d640 1 -- 172.21.15.81:0/1553739030 shutdown_connections 2024-09-16T01:22:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.642+0000 7f86d7c8d640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f86b406c2b0 0x7f86b406e770 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.642+0000 7f86d7c8d640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f86d015b300 0x7f86d0150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.642+0000 7f86d7c8d640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86d0072d30 0x7f86d01e6dd0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.642+0000 7f86d7c8d640 1 --2- 172.21.15.81:0/1553739030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86d006f700 0x7f86d0154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.642+0000 7f86d7c8d640 1 -- 172.21.15.81:0/1553739030 >> 172.21.15.81:0/1553739030 conn(0x7f86d0067d70 msgr2=0x7f86d00b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.643+0000 7f86d7c8d640 1 -- 172.21.15.81:0/1553739030 shutdown_connections 2024-09-16T01:22:26.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.643+0000 7f86d7c8d640 1 -- 172.21.15.81:0/1553739030 wait complete. 2024-09-16T01:22:26.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:22:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.753+0000 7fe37365e640 1 Processor -- start 2024-09-16T01:22:26.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.753+0000 7fe37365e640 1 -- start start 2024-09-16T01:22:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe37365e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe36c162ad0 0x7fe36c0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe37365e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe36c06f6f0 0x7fe36c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe37365e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe36c0afa20 con 0x7fe36c0720b0 2024-09-16T01:22:26.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe37365e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe36c0afce0 con 0x7fe36c06f6f0 2024-09-16T01:22:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe37365e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe36c0b34d0 con 0x7fe36c162ad0 2024-09-16T01:22:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe371bfb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe36c06f6f0 0x7fe36c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe3713fa640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe36c0720b0 0x7fe36c072490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60204/0 (socket says 172.21.15.81:60204) 2024-09-16T01:22:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe3713fa640 1 -- 172.21.15.81:0/2070054065 learned_addr learned my addr 172.21.15.81:0/2070054065 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe371bfb640 1 --2- 172.21.15.81:0/2070054065 >> v2:172.21.15.81:3300/0 conn(0x7fe36c06f6f0 0x7fe36c0b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51444/0 (socket says 172.21.15.81:51444) 2024-09-16T01:22:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe370bf9640 1 --2- 172.21.15.81:0/2070054065 >> v2:172.21.15.102:3300/0 conn(0x7fe36c162ad0 0x7fe36c0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe371bfb640 1 -- 172.21.15.81:0/2070054065 >> v2:172.21.15.102:3300/0 conn(0x7fe36c162ad0 msgr2=0x7fe36c0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe371bfb640 1 --2- 172.21.15.81:0/2070054065 >> v2:172.21.15.102:3300/0 conn(0x7fe36c162ad0 0x7fe36c0cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe371bfb640 1 -- 172.21.15.81:0/2070054065 >> v1:172.21.15.81:6789/0 conn(0x7fe36c0720b0 legacy=0x7fe36c072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe363fff640 1 -- 172.21.15.81:0/2070054065 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222469665 0 0) 0x7fe36c0afa20 con 0x7fe36c0720b0 2024-09-16T01:22:26.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.754+0000 7fe371bfb640 1 -- 172.21.15.81:0/2070054065 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36c0b37b0 con 0x7fe36c06f6f0 2024-09-16T01:22:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.755+0000 7fe371bfb640 1 --2- 172.21.15.81:0/2070054065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36c06f6f0 0x7fe36c0b4290 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fe36c071e70 tx=0x7fe36402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5add2d73f232e355 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.755+0000 7fe363fff640 1 -- 172.21.15.81:0/2070054065 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe364007740 con 0x7fe36c06f6f0 2024-09-16T01:22:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.755+0000 7fe363fff640 1 -- 172.21.15.81:0/2070054065 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3640078e0 con 0x7fe36c06f6f0 2024-09-16T01:22:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.755+0000 7fe363fff640 1 -- 172.21.15.81:0/2070054065 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe364007cb0 con 0x7fe36c06f6f0 2024-09-16T01:22:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.756+0000 7fe37365e640 1 -- 172.21.15.81:0/2070054065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36c06f6f0 msgr2=0x7fe36c0b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.756+0000 7fe37365e640 1 --2- 172.21.15.81:0/2070054065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36c06f6f0 0x7fe36c0b4290 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fe36c071e70 tx=0x7fe36402a680 comp rx=0 tx=0).stop 2024-09-16T01:22:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.756+0000 7fe37365e640 1 -- 172.21.15.81:0/2070054065 shutdown_connections 2024-09-16T01:22:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.756+0000 7fe37365e640 1 --2- 172.21.15.81:0/2070054065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36c06f6f0 0x7fe36c0b4290 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.756+0000 7fe37365e640 1 --2- 172.21.15.81:0/2070054065 >> v2:172.21.15.102:3300/0 conn(0x7fe36c162ad0 0x7fe36c0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.756+0000 7fe37365e640 1 -- 172.21.15.81:0/2070054065 >> 172.21.15.81:0/2070054065 conn(0x7fe36c067d70 msgr2=0x7fe36c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:26.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.756+0000 7fe37365e640 1 -- 172.21.15.81:0/2070054065 shutdown_connections 2024-09-16T01:22:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.756+0000 7fe37365e640 1 -- 172.21.15.81:0/2070054065 wait complete. 2024-09-16T01:22:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.757+0000 7fe37365e640 1 Processor -- start 2024-09-16T01:22:26.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.757+0000 7fe37365e640 1 -- start start 2024-09-16T01:22:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe37365e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe36c06f6f0 0x7fe36c163f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe37365e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36c0720b0 0x7fe36c1fb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe37365e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe36c162ad0 0x7fe36c1fbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe37365e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c0b47d0 con 0x7fe36c0720b0 2024-09-16T01:22:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe37365e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c0b3d70 con 0x7fe36c162ad0 2024-09-16T01:22:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe37365e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe36c0b4950 con 0x7fe36c06f6f0 2024-09-16T01:22:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe370bf9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36c0720b0 0x7fe36c1fb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe370bf9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36c0720b0 0x7fe36c1fb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51450/0 (socket says 172.21.15.81:51450) 2024-09-16T01:22:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe370bf9640 1 -- 172.21.15.81:0/2554238609 learned_addr learned my addr 172.21.15.81:0/2554238609 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:26.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe371bfb640 1 --2- 172.21.15.81:0/2554238609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe36c162ad0 0x7fe36c1fbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe3713fa640 1 --2- 172.21.15.81:0/2554238609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe36c06f6f0 0x7fe36c163f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe370bf9640 1 -- 172.21.15.81:0/2554238609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe36c06f6f0 msgr2=0x7fe36c163f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe370bf9640 1 --2- 172.21.15.81:0/2554238609 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe36c06f6f0 0x7fe36c163f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe370bf9640 1 -- 172.21.15.81:0/2554238609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe36c162ad0 msgr2=0x7fe36c1fbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe370bf9640 1 --2- 172.21.15.81:0/2554238609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe36c162ad0 0x7fe36c1fbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe370bf9640 1 -- 172.21.15.81:0/2554238609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36c1658a0 con 0x7fe36c0720b0 2024-09-16T01:22:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe370bf9640 1 --2- 172.21.15.81:0/2554238609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe36c0720b0 0x7fe36c1fb670 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00d5f0 tx=0x7fe35c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.758+0000 7fe361ffb640 1 -- 172.21.15.81:0/2554238609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0125f0 con 0x7fe36c0720b0 2024-09-16T01:22:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.759+0000 7fe361ffb640 1 -- 172.21.15.81:0/2554238609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe35c019070 con 0x7fe36c0720b0 2024-09-16T01:22:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.759+0000 7fe37365e640 1 -- 172.21.15.81:0/2554238609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe36c164800 con 0x7fe36c0720b0 2024-09-16T01:22:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.759+0000 7fe361ffb640 1 -- 172.21.15.81:0/2554238609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c0129d0 con 0x7fe36c0720b0 2024-09-16T01:22:26.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.759+0000 7fe37365e640 1 -- 172.21.15.81:0/2554238609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe36c164dc0 con 0x7fe36c0720b0 2024-09-16T01:22:26.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.760+0000 7fe37365e640 1 -- 172.21.15.81:0/2554238609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe36c0b4290 con 0x7fe36c0720b0 2024-09-16T01:22:26.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.760+0000 7fe361ffb640 1 -- 172.21.15.81:0/2554238609 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe35c012b70 con 0x7fe36c0720b0 2024-09-16T01:22:26.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.761+0000 7fe361ffb640 1 --2- 172.21.15.81:0/2554238609 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe35006c2b0 0x7fe35006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:26.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.761+0000 7fe361ffb640 1 -- 172.21.15.81:0/2554238609 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7fe35c08b970 con 0x7fe36c0720b0 2024-09-16T01:22:26.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.761+0000 7fe3713fa640 1 --2- 172.21.15.81:0/2554238609 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe35006c2b0 0x7fe35006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:26.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.761+0000 7fe3713fa640 1 --2- 172.21.15.81:0/2554238609 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe35006c2b0 0x7fe35006e770 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe368000f60 tx=0x7fe368009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:26.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.765+0000 7fe361ffb640 1 -- 172.21.15.81:0/2554238609 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe35c059f50 con 0x7fe36c0720b0 2024-09-16T01:22:26.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.968+0000 7fe37365e640 1 -- 172.21.15.81:0/2554238609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe36c0b2ef0 con 0x7fe36c0720b0 2024-09-16T01:22:26.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:26.968+0000 7fe361ffb640 1 -- 172.21.15.81:0/2554238609 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=-1 MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it v60) ==== 316+0+0 (secure 0 0 0) 0x7fe35c059850 con 0x7fe36c0720b0 2024-09-16T01:22:26.970 INFO:teuthology.orchestra.run.smithi081.stderr:Error EPERM: MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it 2024-09-16T01:22:26.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:22:26.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs --yes-i-really-mean-it 2024-09-16T01:22:27.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.075+0000 7ffb829f1640 1 Processor -- start 2024-09-16T01:22:27.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.075+0000 7ffb829f1640 1 -- start start 2024-09-16T01:22:27.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.075+0000 7ffb829f1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffb7c15fff0 0x7ffb7c0d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.075+0000 7ffb829f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb7c160430 con 0x7ffb7c1621f0 2024-09-16T01:22:27.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.075+0000 7ffb829f1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb7c0d1040 con 0x7ffb7c0d09c0 2024-09-16T01:22:27.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.075+0000 7ffb829f1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ffb7c0702f0 con 0x7ffb7c15fff0 2024-09-16T01:22:27.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffb7c1621f0 0x7ffb7c1625d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60212/0 (socket says 172.21.15.81:60212) 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7bfff640 1 -- 172.21.15.81:0/3759234294 learned_addr learned my addr 172.21.15.81:0/3759234294 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb73fff640 1 --2- 172.21.15.81:0/3759234294 >> v2:172.21.15.102:3300/0 conn(0x7ffb7c15fff0 0x7ffb7c0d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194585924 0 0) 0x7ffb7c160430 con 0x7ffb7c1621f0 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb68003520 con 0x7ffb7c1621f0 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011907488 0 0) 0x7ffb7c0d1040 con 0x7ffb7c0d09c0 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb7c160430 con 0x7ffb7c0d09c0 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1704030624 0 0) 0x7ffb68003520 con 0x7ffb7c1621f0 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 >> v2:172.21.15.102:3300/0 conn(0x7ffb7c15fff0 msgr2=0x7ffb7c0d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 --2- 172.21.15.81:0/3759234294 >> v2:172.21.15.102:3300/0 conn(0x7ffb7c15fff0 0x7ffb7c0d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 >> v1:172.21.15.102:6789/0 conn(0x7ffb7c0d09c0 legacy=0x7ffb7c070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c0d1320 con 0x7ffb7c1621f0 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7ffb6c001670 con 0x7ffb7c1621f0 2024-09-16T01:22:27.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb73fff640 1 --2- 172.21.15.81:0/3759234294 >> v2:172.21.15.102:3300/0 conn(0x7ffb7c15fff0 0x7ffb7c0d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 >> v1:172.21.15.81:6789/0 conn(0x7ffb7c1621f0 legacy=0x7ffb7c1625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 --2- 172.21.15.81:0/3759234294 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb68003b40 0x7ffb68003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 --2- 172.21.15.81:0/3759234294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb68004800 0x7ffb68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 --2- 172.21.15.81:0/3759234294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb680051c0 0x7ffb6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c0702f0 con 0x7ffb68004800 2024-09-16T01:22:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6800bfb0 con 0x7ffb680051c0 2024-09-16T01:22:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6800c1b0 con 0x7ffb68003b40 2024-09-16T01:22:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb73fff640 1 --2- 172.21.15.81:0/3759234294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb68004800 0x7ffb68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb7bfff640 1 --2- 172.21.15.81:0/3759234294 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb68003b40 0x7ffb68003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.076+0000 7ffb80f8e640 1 --2- 172.21.15.81:0/3759234294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb680051c0 0x7ffb6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.077+0000 7ffb73fff640 1 -- 172.21.15.81:0/3759234294 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb68003b40 msgr2=0x7ffb68003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:27.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.077+0000 7ffb73fff640 1 --2- 172.21.15.81:0/3759234294 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb68003b40 0x7ffb68003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.077+0000 7ffb73fff640 1 -- 172.21.15.81:0/3759234294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb680051c0 msgr2=0x7ffb6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.077+0000 7ffb73fff640 1 --2- 172.21.15.81:0/3759234294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb680051c0 0x7ffb6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.077+0000 7ffb73fff640 1 -- 172.21.15.81:0/3759234294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb68003520 con 0x7ffb68004800 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.077+0000 7ffb80f8e640 1 --2- 172.21.15.81:0/3759234294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb680051c0 0x7ffb6800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.077+0000 7ffb80f8e640 1 -- 172.21.15.81:0/3759234294 reap_dead start 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.077+0000 7ffb73fff640 1 --2- 172.21.15.81:0/3759234294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb68004800 0x7ffb68004c80 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009c60 tx=0x7ffb68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8ed71f97643cf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.077+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64036070 con 0x7ffb68004800 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.077+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb64031400 con 0x7ffb68004800 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.077+0000 7ffb7b7fe640 1 -- 172.21.15.81:0/3759234294 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64009860 con 0x7ffb68004800 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.078+0000 7ffb829f1640 1 -- 172.21.15.81:0/3759234294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb68004800 msgr2=0x7ffb68004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.078+0000 7ffb829f1640 1 --2- 172.21.15.81:0/3759234294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb68004800 0x7ffb68004c80 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009c60 tx=0x7ffb68005830 comp rx=0 tx=0).stop 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.078+0000 7ffb829f1640 1 -- 172.21.15.81:0/3759234294 shutdown_connections 2024-09-16T01:22:27.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.078+0000 7ffb829f1640 1 --2- 172.21.15.81:0/3759234294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb68004800 0x7ffb68004c80 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.078+0000 7ffb829f1640 1 -- 172.21.15.81:0/3759234294 >> 172.21.15.81:0/3759234294 conn(0x7ffb7c0b3de0 msgr2=0x7ffb7c0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:27.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.078+0000 7ffb829f1640 1 -- 172.21.15.81:0/3759234294 shutdown_connections 2024-09-16T01:22:27.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.078+0000 7ffb829f1640 1 -- 172.21.15.81:0/3759234294 wait complete. 2024-09-16T01:22:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.079+0000 7ffb829f1640 1 Processor -- start 2024-09-16T01:22:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.079+0000 7ffb829f1640 1 -- start start 2024-09-16T01:22:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb829f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb68004800 0x7ffb7c0afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb829f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb7c0b10a0 0x7ffb7c156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb829f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7c0b7090 0x7ffb7c15f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb829f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c163050 con 0x7ffb7c0b7090 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb829f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c162ed0 con 0x7ffb68004800 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb829f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffb7c0d0480 con 0x7ffb7c0b10a0 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb80f8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7c0b7090 0x7ffb7c15f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb80f8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7c0b7090 0x7ffb7c15f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51482/0 (socket says 172.21.15.81:51482) 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb80f8e640 1 -- 172.21.15.81:0/3415376101 learned_addr learned my addr 172.21.15.81:0/3415376101 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb7bfff640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb68004800 0x7ffb7c0afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb73fff640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb7c0b10a0 0x7ffb7c156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb80f8e640 1 -- 172.21.15.81:0/3415376101 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb7c0b10a0 msgr2=0x7ffb7c156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb80f8e640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb7c0b10a0 0x7ffb7c156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb80f8e640 1 -- 172.21.15.81:0/3415376101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb68004800 msgr2=0x7ffb7c0afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb80f8e640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb68004800 0x7ffb7c0afcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.080+0000 7ffb80f8e640 1 -- 172.21.15.81:0/3415376101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c0b78e0 con 0x7ffb7c0b7090 2024-09-16T01:22:27.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.081+0000 7ffb80f8e640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7c0b7090 0x7ffb7c15f110 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c073cf0 tx=0x7ffb7400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.081+0000 7ffb797fa640 1 -- 172.21.15.81:0/3415376101 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74006b50 con 0x7ffb7c0b7090 2024-09-16T01:22:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.081+0000 7ffb797fa640 1 -- 172.21.15.81:0/3415376101 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb74006cf0 con 0x7ffb7c0b7090 2024-09-16T01:22:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.081+0000 7ffb797fa640 1 -- 172.21.15.81:0/3415376101 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb74003970 con 0x7ffb7c0b7090 2024-09-16T01:22:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.081+0000 7ffb829f1640 1 -- 172.21.15.81:0/3415376101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7c0af1d0 con 0x7ffb7c0b7090 2024-09-16T01:22:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.081+0000 7ffb829f1640 1 -- 172.21.15.81:0/3415376101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7c0b7510 con 0x7ffb7c0b7090 2024-09-16T01:22:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.082+0000 7ffb829f1640 1 -- 172.21.15.81:0/3415376101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb7c0d1040 con 0x7ffb7c0b7090 2024-09-16T01:22:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.082+0000 7ffb797fa640 1 -- 172.21.15.81:0/3415376101 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffb7401a020 con 0x7ffb7c0b7090 2024-09-16T01:22:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.083+0000 7ffb797fa640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffb5c06c2e0 0x7ffb5c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.083+0000 7ffb7bfff640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffb5c06c2e0 0x7ffb5c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.083+0000 7ffb797fa640 1 -- 172.21.15.81:0/3415376101 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 6101+0+0 (secure 0 0 0) 0x7ffb7408aa40 con 0x7ffb7c0b7090 2024-09-16T01:22:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.083+0000 7ffb7bfff640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffb5c06c2e0 0x7ffb5c06e7a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c007dc0 tx=0x7ffb6c001be0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:27.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.087+0000 7ffb797fa640 1 -- 172.21.15.81:0/3415376101 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb74058a60 con 0x7ffb7c0b7090 2024-09-16T01:22:27.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.291+0000 7ffb829f1640 1 -- 172.21.15.81:0/3415376101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ffb7c0b4cf0 con 0x7ffb7c0b7090 2024-09-16T01:22:27.293 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-16T01:22:27.292+0000 7f4e951a0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:22:27.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.293+0000 7ffb797fa640 1 -- 172.21.15.81:0/3415376101 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) ==== 191+0+0 (secure 0 0 0) 0x7ffb7405cd60 con 0x7ffb7c0b7090 2024-09-16T01:22:27.295 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:22:27.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.296+0000 7ffb829f1640 1 -- 172.21.15.81:0/3415376101 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffb5c06c2e0 msgr2=0x7ffb5c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:27.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.296+0000 7ffb829f1640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffb5c06c2e0 0x7ffb5c06e7a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c007dc0 tx=0x7ffb6c001be0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.296+0000 7ffb829f1640 1 -- 172.21.15.81:0/3415376101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7c0b7090 msgr2=0x7ffb7c15f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.296+0000 7ffb829f1640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7c0b7090 0x7ffb7c15f110 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c073cf0 tx=0x7ffb7400ec00 comp rx=0 tx=0).stop 2024-09-16T01:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.296+0000 7ffb829f1640 1 -- 172.21.15.81:0/3415376101 shutdown_connections 2024-09-16T01:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.296+0000 7ffb829f1640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ffb5c06c2e0 0x7ffb5c06e7a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.296+0000 7ffb829f1640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7c0b7090 0x7ffb7c15f110 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.296+0000 7ffb829f1640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb7c0b10a0 0x7ffb7c156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.296+0000 7ffb829f1640 1 --2- 172.21.15.81:0/3415376101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb68004800 0x7ffb7c0afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.296+0000 7ffb829f1640 1 -- 172.21.15.81:0/3415376101 >> 172.21.15.81:0/3415376101 conn(0x7ffb7c0b3de0 msgr2=0x7ffb7c15cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.296+0000 7ffb829f1640 1 -- 172.21.15.81:0/3415376101 shutdown_connections 2024-09-16T01:22:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.296+0000 7ffb829f1640 1 -- 172.21.15.81:0/3415376101 wait complete. 2024-09-16T01:22:27.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:22:27.338 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:22:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.408+0000 7f72c2ca6640 1 Processor -- start 2024-09-16T01:22:27.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.408+0000 7f72c2ca6640 1 -- start start 2024-09-16T01:22:27.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72c2ca6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72bc161dc0 0x7f72bc0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72c2ca6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72bc0b5f40 0x7f72bc15e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72c2ca6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72bc06c970 con 0x7f72bc06be80 2024-09-16T01:22:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72c2ca6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f72bc0b6700 con 0x7f72bc0b5f40 2024-09-16T01:22:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72c2ca6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f72bc0b6420 con 0x7f72bc161dc0 2024-09-16T01:22:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72c1243640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72bc0b5f40 0x7f72bc15e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72c1243640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72bc0b5f40 0x7f72bc15e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51492/0 (socket says 172.21.15.81:51492) 2024-09-16T01:22:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72c1243640 1 -- 172.21.15.81:0/460003395 learned_addr learned my addr 172.21.15.81:0/460003395 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72bbfff640 1 --2- 172.21.15.81:0/460003395 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72bc161dc0 0x7f72bc0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72c1243640 1 -- 172.21.15.81:0/460003395 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72bc161dc0 msgr2=0x7f72bc0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72c1243640 1 --2- 172.21.15.81:0/460003395 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72bc161dc0 0x7f72bc0b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72c1243640 1 -- 172.21.15.81:0/460003395 >> v1:172.21.15.102:6789/0 conn(0x7f72bc06be80 legacy=0x7f72bc06c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:27.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.409+0000 7f72c1243640 1 -- 172.21.15.81:0/460003395 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72bc1602d0 con 0x7f72bc0b5f40 2024-09-16T01:22:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.410+0000 7f72c1243640 1 --2- 172.21.15.81:0/460003395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72bc0b5f40 0x7f72bc15e680 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009e50 tx=0x7f72b402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10613574fa74a546 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.410+0000 7f72bb7fe640 1 -- 172.21.15.81:0/460003395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4036070 con 0x7f72bc0b5f40 2024-09-16T01:22:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.410+0000 7f72bb7fe640 1 -- 172.21.15.81:0/460003395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b4031600 con 0x7f72bc0b5f40 2024-09-16T01:22:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.410+0000 7f72bb7fe640 1 -- 172.21.15.81:0/460003395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b40319d0 con 0x7f72bc0b5f40 2024-09-16T01:22:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.411+0000 7f72c2ca6640 1 -- 172.21.15.81:0/460003395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72bc0b5f40 msgr2=0x7f72bc15e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.411+0000 7f72c2ca6640 1 --2- 172.21.15.81:0/460003395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72bc0b5f40 0x7f72bc15e680 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009e50 tx=0x7f72b402a680 comp rx=0 tx=0).stop 2024-09-16T01:22:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.411+0000 7f72c2ca6640 1 -- 172.21.15.81:0/460003395 shutdown_connections 2024-09-16T01:22:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.411+0000 7f72c2ca6640 1 --2- 172.21.15.81:0/460003395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72bc0b5f40 0x7f72bc15e680 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.411+0000 7f72c2ca6640 1 --2- 172.21.15.81:0/460003395 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72bc161dc0 0x7f72bc0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.411+0000 7f72c2ca6640 1 -- 172.21.15.81:0/460003395 >> 172.21.15.81:0/460003395 conn(0x7f72bc0734b0 msgr2=0x7f72bc0b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.411+0000 7f72c2ca6640 1 -- 172.21.15.81:0/460003395 shutdown_connections 2024-09-16T01:22:27.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.411+0000 7f72c2ca6640 1 -- 172.21.15.81:0/460003395 wait complete. 2024-09-16T01:22:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.412+0000 7f72c2ca6640 1 Processor -- start 2024-09-16T01:22:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.412+0000 7f72c2ca6640 1 -- start start 2024-09-16T01:22:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c2ca6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72bc06be80 0x7f72bc1e7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c2ca6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72bc0b5f40 0x7f72bc1e8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c2ca6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72bc161dc0 0x7f72bc1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c2ca6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc15ebc0 con 0x7f72bc161dc0 2024-09-16T01:22:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c2ca6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc160890 con 0x7f72bc0b5f40 2024-09-16T01:22:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c2ca6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f72bc15ed40 con 0x7f72bc06be80 2024-09-16T01:22:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c1243640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72bc161dc0 0x7f72bc1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c1243640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72bc161dc0 0x7f72bc1531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51504/0 (socket says 172.21.15.81:51504) 2024-09-16T01:22:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c1243640 1 -- 172.21.15.81:0/430671157 learned_addr learned my addr 172.21.15.81:0/430671157 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72bbfff640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72bc0b5f40 0x7f72bc1e8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c1243640 1 -- 172.21.15.81:0/430671157 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72bc06be80 msgr2=0x7f72bc1e7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c0a42640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72bc06be80 0x7f72bc1e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c1243640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72bc06be80 0x7f72bc1e7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c1243640 1 -- 172.21.15.81:0/430671157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72bc0b5f40 msgr2=0x7f72bc1e8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c1243640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72bc0b5f40 0x7f72bc1e8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c1243640 1 -- 172.21.15.81:0/430671157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72bc1e8d40 con 0x7f72bc161dc0 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72bbfff640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72bc0b5f40 0x7f72bc1e8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.413+0000 7f72c1243640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72bc161dc0 0x7f72bc1531d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f72b4034040 tx=0x7f72b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.414+0000 7f72b97fa640 1 -- 172.21.15.81:0/430671157 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4036050 con 0x7f72bc161dc0 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.414+0000 7f72b97fa640 1 -- 172.21.15.81:0/430671157 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b4042070 con 0x7f72bc161dc0 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.414+0000 7f72c2ca6640 1 -- 172.21.15.81:0/430671157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72bc1e7760 con 0x7f72bc161dc0 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.414+0000 7f72b97fa640 1 -- 172.21.15.81:0/430671157 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4009510 con 0x7f72bc161dc0 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.414+0000 7f72c2ca6640 1 -- 172.21.15.81:0/430671157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72bc1e7d20 con 0x7f72bc161dc0 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.415+0000 7f72c2ca6640 1 -- 172.21.15.81:0/430671157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72bc06c5a0 con 0x7f72bc161dc0 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.415+0000 7f72b97fa640 1 -- 172.21.15.81:0/430671157 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f72b4007bd0 con 0x7f72bc161dc0 2024-09-16T01:22:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.415+0000 7f72b97fa640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72a806c2b0 0x7f72a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.416+0000 7f72b97fa640 1 -- 172.21.15.81:0/430671157 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6187+0+0 (secure 0 0 0) 0x7f72b40ac490 con 0x7f72bc161dc0 2024-09-16T01:22:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.416+0000 7f72c0a42640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72a806c2b0 0x7f72a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.416+0000 7f72c0a42640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72a806c2b0 0x7f72a806e770 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0015a0 tx=0x7f72ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.420+0000 7f72b97fa640 1 -- 172.21.15.81:0/430671157 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72b4045360 con 0x7f72bc161dc0 2024-09-16T01:22:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:27.626+0000 7f72c2ca6640 1 -- 172.21.15.81:0/430671157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f72bc0d0f30 con 0x7f72bc161dc0 2024-09-16T01:22:28.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.295+0000 7f72b97fa640 1 -- 172.21.15.81:0/430671157 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v62) ==== 104+0+0 (secure 0 0 0) 0x7f72b407aab0 con 0x7f72bc161dc0 2024-09-16T01:22:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.297+0000 7f72c2ca6640 1 -- 172.21.15.81:0/430671157 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72a806c2b0 msgr2=0x7f72a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.297+0000 7f72c2ca6640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72a806c2b0 0x7f72a806e770 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0015a0 tx=0x7f72ac009040 comp rx=0 tx=0).stop 2024-09-16T01:22:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.297+0000 7f72c2ca6640 1 -- 172.21.15.81:0/430671157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72bc161dc0 msgr2=0x7f72bc1531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.297+0000 7f72c2ca6640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72bc161dc0 0x7f72bc1531d0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f72b4034040 tx=0x7f72b4004a40 comp rx=0 tx=0).stop 2024-09-16T01:22:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.297+0000 7f72c2ca6640 1 -- 172.21.15.81:0/430671157 shutdown_connections 2024-09-16T01:22:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.297+0000 7f72c2ca6640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72a806c2b0 0x7f72a806e770 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.297+0000 7f72c2ca6640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72bc161dc0 0x7f72bc1531d0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.297+0000 7f72c2ca6640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72bc0b5f40 0x7f72bc1e8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.297+0000 7f72c2ca6640 1 --2- 172.21.15.81:0/430671157 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f72bc06be80 0x7f72bc1e7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.297+0000 7f72c2ca6640 1 -- 172.21.15.81:0/430671157 >> 172.21.15.81:0/430671157 conn(0x7f72bc0734b0 msgr2=0x7f72bc06f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:28.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.297+0000 7f72c2ca6640 1 -- 172.21.15.81:0/430671157 shutdown_connections 2024-09-16T01:22:28.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.297+0000 7f72c2ca6640 1 -- 172.21.15.81:0/430671157 wait complete. 2024-09-16T01:22:28.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.414+0000 7fb5cdd9f640 1 Processor -- start 2024-09-16T01:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.414+0000 7fb5cdd9f640 1 -- start start 2024-09-16T01:22:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.415+0000 7fb5cdd9f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb5c815c160 0x7fb5c80b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.415+0000 7fb5cdd9f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c80b1870 0x7fb5c80b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.415+0000 7fb5cdd9f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c80b6610 con 0x7fb5c80b61d0 2024-09-16T01:22:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.415+0000 7fb5cdd9f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c80b1670 con 0x7fb5c815c160 2024-09-16T01:22:28.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.415+0000 7fb5cdd9f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c809b440 con 0x7fb5c80b1870 2024-09-16T01:22:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.415+0000 7fb5c77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb5c815c160 0x7fb5c80b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.415+0000 7fb5c77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb5c815c160 0x7fb5c80b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51512/0 (socket says 172.21.15.81:51512) 2024-09-16T01:22:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.415+0000 7fb5c77fe640 1 -- 172.21.15.81:0/1325799372 learned_addr learned my addr 172.21.15.81:0/1325799372 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.416+0000 7fb5c77fe640 1 -- 172.21.15.81:0/1325799372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c80b1870 msgr2=0x7fb5c80b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.416+0000 7fb5beffd640 1 --2- 172.21.15.81:0/1325799372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c80b1870 0x7fb5c80b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.416+0000 7fb5c77fe640 1 --2- 172.21.15.81:0/1325799372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c80b1870 0x7fb5c80b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.416+0000 7fb5c77fe640 1 -- 172.21.15.81:0/1325799372 >> v1:172.21.15.102:6789/0 conn(0x7fb5c80b61d0 legacy=0x7fb5c815fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.416+0000 7fb5c77fe640 1 -- 172.21.15.81:0/1325799372 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c80b5840 con 0x7fb5c815c160 2024-09-16T01:22:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.416+0000 7fb5c77fe640 1 --2- 172.21.15.81:0/1325799372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c815c160 0x7fb5c80b5260 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009870 tx=0x7fb5b802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d60b9fbfd40178 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.417+0000 7fb5c6ffd640 1 -- 172.21.15.81:0/1325799372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8037070 con 0x7fb5c815c160 2024-09-16T01:22:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.417+0000 7fb5c6ffd640 1 -- 172.21.15.81:0/1325799372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b8032440 con 0x7fb5c815c160 2024-09-16T01:22:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.417+0000 7fb5c6ffd640 1 -- 172.21.15.81:0/1325799372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8032810 con 0x7fb5c815c160 2024-09-16T01:22:28.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.417+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/1325799372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c815c160 msgr2=0x7fb5c80b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.417+0000 7fb5cdd9f640 1 --2- 172.21.15.81:0/1325799372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c815c160 0x7fb5c80b5260 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009870 tx=0x7fb5b802a210 comp rx=0 tx=0).stop 2024-09-16T01:22:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.417+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/1325799372 shutdown_connections 2024-09-16T01:22:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.417+0000 7fb5cdd9f640 1 --2- 172.21.15.81:0/1325799372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c80b1870 0x7fb5c80b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.417+0000 7fb5cdd9f640 1 --2- 172.21.15.81:0/1325799372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c815c160 0x7fb5c80b5260 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.417+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/1325799372 >> 172.21.15.81:0/1325799372 conn(0x7fb5c80b3f60 msgr2=0x7fb5c80b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.417+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/1325799372 shutdown_connections 2024-09-16T01:22:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.417+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/1325799372 wait complete. 2024-09-16T01:22:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.418+0000 7fb5cdd9f640 1 Processor -- start 2024-09-16T01:22:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.419+0000 7fb5cdd9f640 1 -- start start 2024-09-16T01:22:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.419+0000 7fb5cdd9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c80b1870 0x7fb5c8143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.419+0000 7fb5cdd9f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c80b61d0 0x7fb5c809fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.419+0000 7fb5cdd9f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c815c160 0x7fb5c80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.419+0000 7fb5cdd9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c809bc50 con 0x7fb5c80b1870 2024-09-16T01:22:28.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.419+0000 7fb5cdd9f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c809b970 con 0x7fb5c815c160 2024-09-16T01:22:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.419+0000 7fb5cdd9f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c80b1c70 con 0x7fb5c80b61d0 2024-09-16T01:22:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.419+0000 7fb5c77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c80b1870 0x7fb5c8143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.419+0000 7fb5c77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c80b1870 0x7fb5c8143de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51522/0 (socket says 172.21.15.81:51522) 2024-09-16T01:22:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.419+0000 7fb5c77fe640 1 -- 172.21.15.81:0/289528195 learned_addr learned my addr 172.21.15.81:0/289528195 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5beffd640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c80b61d0 0x7fb5c809fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5c7fff640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c815c160 0x7fb5c80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5c77fe640 1 -- 172.21.15.81:0/289528195 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c80b61d0 msgr2=0x7fb5c809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5c77fe640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c80b61d0 0x7fb5c809fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5c77fe640 1 -- 172.21.15.81:0/289528195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c815c160 msgr2=0x7fb5c80710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5c77fe640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c815c160 0x7fb5c80710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:28.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5c77fe640 1 -- 172.21.15.81:0/289528195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c8144320 con 0x7fb5c80b1870 2024-09-16T01:22:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5c77fe640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c80b1870 0x7fb5c8143de0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009870 tx=0x7fb5b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5c4ff9640 1 -- 172.21.15.81:0/289528195 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8041020 con 0x7fb5c80b1870 2024-09-16T01:22:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5c4ff9640 1 -- 172.21.15.81:0/289528195 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b8030970 con 0x7fb5c80b1870 2024-09-16T01:22:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/289528195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c806e230 con 0x7fb5c80b1870 2024-09-16T01:22:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5c4ff9640 1 -- 172.21.15.81:0/289528195 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8037040 con 0x7fb5c80b1870 2024-09-16T01:22:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.420+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/289528195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c806e7f0 con 0x7fb5c80b1870 2024-09-16T01:22:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.421+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/289528195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c809b250 con 0x7fb5c80b1870 2024-09-16T01:22:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.422+0000 7fb5c4ff9640 1 -- 172.21.15.81:0/289528195 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb5b8044020 con 0x7fb5c80b1870 2024-09-16T01:22:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.422+0000 7fb5c4ff9640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5a806c2b0 0x7fb5a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.422+0000 7fb5c4ff9640 1 -- 172.21.15.81:0/289528195 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 6187+0+0 (secure 0 0 0) 0x7fb5b80abea0 con 0x7fb5c80b1870 2024-09-16T01:22:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.422+0000 7fb5beffd640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5a806c2b0 0x7fb5a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:28.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.423+0000 7fb5beffd640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5a806c2b0 0x7fb5a806e770 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb5c81525b0 tx=0x7fb5b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.427+0000 7fb5c4ff9640 1 -- 172.21.15.81:0/289528195 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5b804b030 con 0x7fb5c80b1870 2024-09-16T01:22:28.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:28.591+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/289528195 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb5c815c540 con 0x7fb5c80b1870 2024-09-16T01:22:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.411+0000 7fb5c4ff9640 1 -- 172.21.15.81:0/289528195 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) ==== 181+0+0 (secure 0 0 0) 0x7fb5c8144320 con 0x7fb5c80b1870 2024-09-16T01:22:29.413 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:22:29.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.415+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/289528195 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5a806c2b0 msgr2=0x7fb5a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:29.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.415+0000 7fb5cdd9f640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5a806c2b0 0x7fb5a806e770 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb5c81525b0 tx=0x7fb5b0008040 comp rx=0 tx=0).stop 2024-09-16T01:22:29.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.415+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/289528195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c80b1870 msgr2=0x7fb5c8143de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:29.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.415+0000 7fb5cdd9f640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c80b1870 0x7fb5c8143de0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8009870 tx=0x7fb5b80046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.415+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/289528195 shutdown_connections 2024-09-16T01:22:29.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.415+0000 7fb5cdd9f640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb5a806c2b0 0x7fb5a806e770 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.415+0000 7fb5cdd9f640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5c815c160 0x7fb5c80710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.415+0000 7fb5cdd9f640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5c80b61d0 0x7fb5c809fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.415+0000 7fb5cdd9f640 1 --2- 172.21.15.81:0/289528195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5c80b1870 0x7fb5c8143de0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.415+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/289528195 >> 172.21.15.81:0/289528195 conn(0x7fb5c80b3f60 msgr2=0x7fb5c815b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:29.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.415+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/289528195 shutdown_connections 2024-09-16T01:22:29.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.415+0000 7fb5cdd9f640 1 -- 172.21.15.81:0/289528195 wait complete. 2024-09-16T01:22:29.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:22:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.537+0000 7f2b55186640 1 Processor -- start 2024-09-16T01:22:29.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.537+0000 7f2b55186640 1 -- start start 2024-09-16T01:22:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.538+0000 7f2b55186640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2b50162340 0x7f2b5006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.538+0000 7f2b55186640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b50162e30 0x7f2b500d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.538+0000 7f2b55186640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5015ff70 con 0x7f2b500cf280 2024-09-16T01:22:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.538+0000 7f2b55186640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2b5006de90 con 0x7f2b50162340 2024-09-16T01:22:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.538+0000 7f2b55186640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2b500d4d10 con 0x7f2b50162e30 2024-09-16T01:22:29.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.538+0000 7f2b4ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2b50162340 0x7f2b5006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.538+0000 7f2b4659c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2b500cf280 0x7f2b50162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60214/0 (socket says 172.21.15.81:60214) 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.538+0000 7f2b4659c640 1 -- 172.21.15.81:0/279612404 learned_addr learned my addr 172.21.15.81:0/279612404 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.539+0000 7f2b4ed9d640 1 -- 172.21.15.81:0/279612404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b50162e30 msgr2=0x7f2b500d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.539+0000 7f2b4f59e640 1 --2- 172.21.15.81:0/279612404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b50162e30 0x7f2b500d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.539+0000 7f2b4ed9d640 1 --2- 172.21.15.81:0/279612404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b50162e30 0x7f2b500d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.539+0000 7f2b4ed9d640 1 -- 172.21.15.81:0/279612404 >> v1:172.21.15.81:6789/0 conn(0x7f2b500cf280 legacy=0x7f2b50162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.539+0000 7f2b4ed9d640 1 -- 172.21.15.81:0/279612404 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b500d4ff0 con 0x7f2b50162340 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.539+0000 7f2b4e59c640 1 -- 172.21.15.81:0/279612404 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362497506 0 0) 0x7f2b5015ff70 con 0x7f2b500cf280 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.539+0000 7f2b4f59e640 1 --2- 172.21.15.81:0/279612404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b50162e30 0x7f2b500d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.539+0000 7f2b4ed9d640 1 --2- 172.21.15.81:0/279612404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50162340 0x7f2b5006d740 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2b400097a0 tx=0x7f2b4002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8e9be6d9041e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.540+0000 7f2b4e59c640 1 -- 172.21.15.81:0/279612404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40037070 con 0x7f2b50162340 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.540+0000 7f2b4e59c640 1 -- 172.21.15.81:0/279612404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4002ae50 con 0x7f2b50162340 2024-09-16T01:22:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.540+0000 7f2b4e59c640 1 -- 172.21.15.81:0/279612404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40032660 con 0x7f2b50162340 2024-09-16T01:22:29.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.540+0000 7f2b55186640 1 -- 172.21.15.81:0/279612404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50162340 msgr2=0x7f2b5006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:29.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.540+0000 7f2b55186640 1 --2- 172.21.15.81:0/279612404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50162340 0x7f2b5006d740 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2b400097a0 tx=0x7f2b4002a100 comp rx=0 tx=0).stop 2024-09-16T01:22:29.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.540+0000 7f2b55186640 1 -- 172.21.15.81:0/279612404 shutdown_connections 2024-09-16T01:22:29.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.540+0000 7f2b55186640 1 --2- 172.21.15.81:0/279612404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b50162e30 0x7f2b500d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.540+0000 7f2b55186640 1 --2- 172.21.15.81:0/279612404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50162340 0x7f2b5006d740 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.540+0000 7f2b55186640 1 -- 172.21.15.81:0/279612404 >> 172.21.15.81:0/279612404 conn(0x7f2b5008bfc0 msgr2=0x7f2b500d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:29.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.540+0000 7f2b55186640 1 -- 172.21.15.81:0/279612404 shutdown_connections 2024-09-16T01:22:29.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.540+0000 7f2b55186640 1 -- 172.21.15.81:0/279612404 wait complete. 2024-09-16T01:22:29.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.541+0000 7f2b55186640 1 Processor -- start 2024-09-16T01:22:29.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.542+0000 7f2b55186640 1 -- start start 2024-09-16T01:22:29.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.542+0000 7f2b55186640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b500cf280 0x7f2b500b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:29.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.542+0000 7f2b55186640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b50162340 0x7f2b500b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:29.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.542+0000 7f2b55186640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50162e30 0x7f2b501e9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:29.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.542+0000 7f2b55186640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2b500cf6c0 con 0x7f2b50162e30 2024-09-16T01:22:29.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.542+0000 7f2b55186640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2b500d52d0 con 0x7f2b500cf280 2024-09-16T01:22:29.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.542+0000 7f2b55186640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2b500d2ed0 con 0x7f2b50162340 2024-09-16T01:22:29.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50162e30 0x7f2b501e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:29.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50162e30 0x7f2b501e9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51544/0 (socket says 172.21.15.81:51544) 2024-09-16T01:22:29.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4f59e640 1 -- 172.21.15.81:0/1747407235 learned_addr learned my addr 172.21.15.81:0/1747407235 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:29.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4659c640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b50162340 0x7f2b500b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:29.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4ed9d640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b500cf280 0x7f2b500b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:29.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4f59e640 1 -- 172.21.15.81:0/1747407235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b50162340 msgr2=0x7f2b500b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:29.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4f59e640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b50162340 0x7f2b500b7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4f59e640 1 -- 172.21.15.81:0/1747407235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b500cf280 msgr2=0x7f2b500b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:29.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4f59e640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b500cf280 0x7f2b500b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:29.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4f59e640 1 -- 172.21.15.81:0/1747407235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b500b7d80 con 0x7f2b50162e30 2024-09-16T01:22:29.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4659c640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b50162340 0x7f2b500b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:29.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4ed9d640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b500cf280 0x7f2b500b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:29.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b4f59e640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50162e30 0x7f2b501e9700 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800cd50 tx=0x7f2b4800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:29.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b47fff640 1 -- 172.21.15.81:0/1747407235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800f680 con 0x7f2b50162e30 2024-09-16T01:22:29.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b47fff640 1 -- 172.21.15.81:0/1747407235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4800f840 con 0x7f2b50162e30 2024-09-16T01:22:29.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b47fff640 1 -- 172.21.15.81:0/1747407235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800fc30 con 0x7f2b50162e30 2024-09-16T01:22:29.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b55186640 1 -- 172.21.15.81:0/1747407235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b500b8010 con 0x7f2b50162e30 2024-09-16T01:22:29.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.543+0000 7f2b55186640 1 -- 172.21.15.81:0/1747407235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b500ccc10 con 0x7f2b50162e30 2024-09-16T01:22:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.544+0000 7f2b55186640 1 -- 172.21.15.81:0/1747407235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b500cce10 con 0x7f2b50162e30 2024-09-16T01:22:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.545+0000 7f2b47fff640 1 -- 172.21.15.81:0/1747407235 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2b480213f0 con 0x7f2b50162e30 2024-09-16T01:22:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.545+0000 7f2b47fff640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2b3006c2b0 0x7f2b3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.545+0000 7f2b47fff640 1 -- 172.21.15.81:0/1747407235 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5749+0+0 (secure 0 0 0) 0x7f2b4808c280 con 0x7f2b50162e30 2024-09-16T01:22:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.545+0000 7f2b4ed9d640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2b3006c2b0 0x7f2b3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:29.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.546+0000 7f2b4ed9d640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2b3006c2b0 0x7f2b3006e770 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2b40034000 tx=0x7f2b4002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:29.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.549+0000 7f2b47fff640 1 -- 172.21.15.81:0/1747407235 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2b500cce10 con 0x7f2b50162e30 2024-09-16T01:22:29.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:29.722+0000 7f2b55186640 1 -- 172.21.15.81:0/1747407235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2b5008e640 con 0x7f2b50162e30 2024-09-16T01:22:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.416+0000 7f2b47fff640 1 -- 172.21.15.81:0/1747407235 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v116) ==== 169+0+0 (secure 0 0 0) 0x7f2b48014030 con 0x7f2b50162e30 2024-09-16T01:22:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-16T01:22:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.420+0000 7f2b55186640 1 -- 172.21.15.81:0/1747407235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2b3006c2b0 msgr2=0x7f2b3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.420+0000 7f2b55186640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2b3006c2b0 0x7f2b3006e770 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2b40034000 tx=0x7f2b4002e000 comp rx=0 tx=0).stop 2024-09-16T01:22:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.420+0000 7f2b55186640 1 -- 172.21.15.81:0/1747407235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50162e30 msgr2=0x7f2b501e9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.420+0000 7f2b55186640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50162e30 0x7f2b501e9700 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800cd50 tx=0x7f2b4800a650 comp rx=0 tx=0).stop 2024-09-16T01:22:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.420+0000 7f2b55186640 1 -- 172.21.15.81:0/1747407235 shutdown_connections 2024-09-16T01:22:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.420+0000 7f2b55186640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2b3006c2b0 0x7f2b3006e770 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.420+0000 7f2b55186640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b50162e30 0x7f2b501e9700 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.420+0000 7f2b55186640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b50162340 0x7f2b500b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.420+0000 7f2b55186640 1 --2- 172.21.15.81:0/1747407235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b500cf280 0x7f2b500b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.420+0000 7f2b55186640 1 -- 172.21.15.81:0/1747407235 >> 172.21.15.81:0/1747407235 conn(0x7f2b5008bfc0 msgr2=0x7f2b50160240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.420+0000 7f2b55186640 1 -- 172.21.15.81:0/1747407235 shutdown_connections 2024-09-16T01:22:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.420+0000 7f2b55186640 1 -- 172.21.15.81:0/1747407235 wait complete. 2024-09-16T01:22:30.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_warning_threshold 2024-09-16T01:22:30.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.540+0000 7f5348427640 1 Processor -- start 2024-09-16T01:22:30.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.540+0000 7f5348427640 1 -- start start 2024-09-16T01:22:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.541+0000 7f5348427640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5340162340 0x7f534006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.541+0000 7f5348427640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f534015ff70 con 0x7f53400cf280 2024-09-16T01:22:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.541+0000 7f5348427640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53400d4d10 con 0x7f5340162e30 2024-09-16T01:22:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.541+0000 7f5348427640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f53401632a0 con 0x7f5340162340 2024-09-16T01:22:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53459c2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f53400cf280 0x7f5340162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60220/0 (socket says 172.21.15.81:60220) 2024-09-16T01:22:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53459c2640 1 -- 172.21.15.81:0/612741472 learned_addr learned my addr 172.21.15.81:0/612741472 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2770174869 0 0) 0x7f534015ff70 con 0x7f53400cf280 2024-09-16T01:22:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f532c003520 con 0x7f53400cf280 2024-09-16T01:22:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53461c3640 1 --2- 172.21.15.81:0/612741472 >> v2:172.21.15.102:3300/0 conn(0x7f5340162340 0x7f534006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4246172245 0 0) 0x7f532c003520 con 0x7f53400cf280 2024-09-16T01:22:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 >> v2:172.21.15.102:3300/0 conn(0x7f5340162340 msgr2=0x7f534006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 --2- 172.21.15.81:0/612741472 >> v2:172.21.15.102:3300/0 conn(0x7f5340162340 0x7f534006d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 >> v1:172.21.15.102:6789/0 conn(0x7f5340162e30 legacy=0x7f53400d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53400d4ff0 con 0x7f53400cf280 2024-09-16T01:22:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f53300017f0 con 0x7f53400cf280 2024-09-16T01:22:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 >> v1:172.21.15.81:6789/0 conn(0x7f53400cf280 legacy=0x7f5340162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 --2- 172.21.15.81:0/612741472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f532c0039b0 0x7f532c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 --2- 172.21.15.81:0/612741472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f532c004800 0x7f532c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 --2- 172.21.15.81:0/612741472 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f532c0051c0 0x7f532c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f532c00c130 con 0x7f532c0039b0 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f532c00c2e0 con 0x7f532c004800 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f532c00c4e0 con 0x7f532c0051c0 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53461c3640 1 --2- 172.21.15.81:0/612741472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f532c0039b0 0x7f532c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53459c2640 1 --2- 172.21.15.81:0/612741472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f532c004800 0x7f532c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.542+0000 7f53469c4640 1 --2- 172.21.15.81:0/612741472 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f532c0051c0 0x7f532c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.543+0000 7f53461c3640 1 -- 172.21.15.81:0/612741472 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f532c0051c0 msgr2=0x7f532c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.543+0000 7f53461c3640 1 --2- 172.21.15.81:0/612741472 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f532c0051c0 0x7f532c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.543+0000 7f53461c3640 1 -- 172.21.15.81:0/612741472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f532c004800 msgr2=0x7f532c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.543+0000 7f53461c3640 1 --2- 172.21.15.81:0/612741472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f532c004800 0x7f532c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.543+0000 7f53469c4640 1 -- 172.21.15.81:0/612741472 reap_dead start 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.543+0000 7f53461c3640 1 -- 172.21.15.81:0/612741472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532c003520 con 0x7f532c0039b0 2024-09-16T01:22:30.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.543+0000 7f53459c2640 1 --2- 172.21.15.81:0/612741472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f532c004800 0x7f532c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.543+0000 7f53461c3640 1 --2- 172.21.15.81:0/612741472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f532c0039b0 0x7f532c003dd0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f533c009ac0 tx=0x7f532c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed9f2c1123baf55 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.543+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c036070 con 0x7f532c0039b0 2024-09-16T01:22:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.543+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533c031400 con 0x7f532c0039b0 2024-09-16T01:22:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.543+0000 7f53451c1640 1 -- 172.21.15.81:0/612741472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c009690 con 0x7f532c0039b0 2024-09-16T01:22:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.544+0000 7f5348427640 1 -- 172.21.15.81:0/612741472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f532c0039b0 msgr2=0x7f532c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.544+0000 7f5348427640 1 --2- 172.21.15.81:0/612741472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f532c0039b0 0x7f532c003dd0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f533c009ac0 tx=0x7f532c005830 comp rx=0 tx=0).stop 2024-09-16T01:22:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.544+0000 7f5348427640 1 -- 172.21.15.81:0/612741472 shutdown_connections 2024-09-16T01:22:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.544+0000 7f5348427640 1 --2- 172.21.15.81:0/612741472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f532c0039b0 0x7f532c003dd0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.544+0000 7f5348427640 1 -- 172.21.15.81:0/612741472 >> 172.21.15.81:0/612741472 conn(0x7f534008bfc0 msgr2=0x7f53400d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.544+0000 7f5348427640 1 -- 172.21.15.81:0/612741472 shutdown_connections 2024-09-16T01:22:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.544+0000 7f5348427640 1 -- 172.21.15.81:0/612741472 wait complete. 2024-09-16T01:22:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.545+0000 7f5348427640 1 Processor -- start 2024-09-16T01:22:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.545+0000 7f5348427640 1 -- start start 2024-09-16T01:22:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f5348427640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f532c0039b0 0x7f53400b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f5348427640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f534015c350 0x7f534015b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f5348427640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400b9700 0x7f534014d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f5348427640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53400d52d0 con 0x7f53400b9700 2024-09-16T01:22:30.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f5348427640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f534006de90 con 0x7f532c0039b0 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f5348427640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f53400cf6c0 con 0x7f534015c350 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f53469c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400b9700 0x7f534014d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f53469c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400b9700 0x7f534014d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51560/0 (socket says 172.21.15.81:51560) 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f53469c4640 1 -- 172.21.15.81:0/1229157435 learned_addr learned my addr 172.21.15.81:0/1229157435 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f53461c3640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f532c0039b0 0x7f53400b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f53459c2640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f534015c350 0x7f534015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f53469c4640 1 -- 172.21.15.81:0/1229157435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f534015c350 msgr2=0x7f534015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f53469c4640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f534015c350 0x7f534015b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f53469c4640 1 -- 172.21.15.81:0/1229157435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f532c0039b0 msgr2=0x7f53400b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f53469c4640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f532c0039b0 0x7f53400b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f53469c4640 1 -- 172.21.15.81:0/1229157435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53400b6ee0 con 0x7f53400b9700 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.546+0000 7f53469c4640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400b9700 0x7f534014d660 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f5338007fd0 tx=0x7f533800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.547+0000 7f5336ffd640 1 -- 172.21.15.81:0/1229157435 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338003970 con 0x7f53400b9700 2024-09-16T01:22:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.547+0000 7f5336ffd640 1 -- 172.21.15.81:0/1229157435 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5338018070 con 0x7f53400b9700 2024-09-16T01:22:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.547+0000 7f5348427640 1 -- 172.21.15.81:0/1229157435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534015ee10 con 0x7f53400b9700 2024-09-16T01:22:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.547+0000 7f5336ffd640 1 -- 172.21.15.81:0/1229157435 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338003d70 con 0x7f53400b9700 2024-09-16T01:22:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.547+0000 7f5348427640 1 -- 172.21.15.81:0/1229157435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53400b8f00 con 0x7f53400b9700 2024-09-16T01:22:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.548+0000 7f5348427640 1 -- 172.21.15.81:0/1229157435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53400b8d30 con 0x7f53400b9700 2024-09-16T01:22:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.548+0000 7f5336ffd640 1 -- 172.21.15.81:0/1229157435 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f53380050d0 con 0x7f53400b9700 2024-09-16T01:22:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.549+0000 7f5336ffd640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f532406c2b0 0x7f532406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.549+0000 7f5336ffd640 1 -- 172.21.15.81:0/1229157435 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f533808b020 con 0x7f53400b9700 2024-09-16T01:22:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.549+0000 7f53461c3640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f532406c2b0 0x7f532406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.549+0000 7f53461c3640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f532406c2b0 0x7f532406e770 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f533c033000 tx=0x7f533c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:30.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.553+0000 7f5336ffd640 1 -- 172.21.15.81:0/1229157435 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5338059850 con 0x7f53400b9700 2024-09-16T01:22:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.721+0000 7f5348427640 1 -- 172.21.15.81:0/1229157435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"} v 0) -- 0x7f5340073710 con 0x7f53400b9700 2024-09-16T01:22:30.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.724+0000 7f5336ffd640 1 -- 172.21.15.81:0/1229157435 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"}]=0 v41) ==== 111+0+0 (secure 0 0 0) 0x7f5340073710 con 0x7f53400b9700 2024-09-16T01:22:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.727+0000 7f5348427640 1 -- 172.21.15.81:0/1229157435 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f532406c2b0 msgr2=0x7f532406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.727+0000 7f5348427640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f532406c2b0 0x7f532406e770 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f533c033000 tx=0x7f533c008030 comp rx=0 tx=0).stop 2024-09-16T01:22:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.727+0000 7f5348427640 1 -- 172.21.15.81:0/1229157435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400b9700 msgr2=0x7f534014d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.727+0000 7f5348427640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400b9700 0x7f534014d660 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f5338007fd0 tx=0x7f533800ec10 comp rx=0 tx=0).stop 2024-09-16T01:22:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.727+0000 7f5348427640 1 -- 172.21.15.81:0/1229157435 shutdown_connections 2024-09-16T01:22:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.727+0000 7f5348427640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f532406c2b0 0x7f532406e770 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.727+0000 7f5348427640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53400b9700 0x7f534014d660 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.727+0000 7f5348427640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f534015c350 0x7f534015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.727+0000 7f5348427640 1 --2- 172.21.15.81:0/1229157435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f532c0039b0 0x7f53400b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.727+0000 7f5348427640 1 -- 172.21.15.81:0/1229157435 >> 172.21.15.81:0/1229157435 conn(0x7f534008bfc0 msgr2=0x7f53400d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.727+0000 7f5348427640 1 -- 172.21.15.81:0/1229157435 shutdown_connections 2024-09-16T01:22:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.727+0000 7f5348427640 1 -- 172.21.15.81:0/1229157435 wait complete. 2024-09-16T01:22:30.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_memory_limit 2024-09-16T01:22:30.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.839+0000 7f5e3939f640 1 Processor -- start 2024-09-16T01:22:30.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.839+0000 7f5e3939f640 1 -- start start 2024-09-16T01:22:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e3939f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e34158ba0 0x7f5e340732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e3939f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5e3406f420 0x7f5e340b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e3939f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e34071cd0 con 0x7f5e34073d10 2024-09-16T01:22:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e3939f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5e3415b4b0 con 0x7f5e3406f420 2024-09-16T01:22:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e3939f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5e3415b710 con 0x7f5e34158ba0 2024-09-16T01:22:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e337fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5e34073d10 0x7f5e3406ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60228/0 (socket says 172.21.15.81:60228) 2024-09-16T01:22:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e337fe640 1 -- 172.21.15.81:0/662115599 learned_addr learned my addr 172.21.15.81:0/662115599 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231325594 0 0) 0x7f5e34071cd0 con 0x7f5e34073d10 2024-09-16T01:22:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e20003520 con 0x7f5e34073d10 2024-09-16T01:22:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e38b9e640 1 --2- 172.21.15.81:0/662115599 >> v2:172.21.15.102:3300/0 conn(0x7f5e3406f420 0x7f5e340b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e33fff640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e34158ba0 0x7f5e340732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4207559334 0 0) 0x7f5e20003520 con 0x7f5e34073d10 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e34158ba0 msgr2=0x7f5e340732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e34158ba0 0x7f5e340732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 >> v2:172.21.15.102:3300/0 conn(0x7f5e3406f420 msgr2=0x7f5e340b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 --2- 172.21.15.81:0/662115599 >> v2:172.21.15.102:3300/0 conn(0x7f5e3406f420 0x7f5e340b2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3415b9f0 con 0x7f5e34073d10 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f5e1c001670 con 0x7f5e34073d10 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 >> v1:172.21.15.81:6789/0 conn(0x7f5e34073d10 legacy=0x7f5e3406ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e200039b0 0x7f5e20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e20004800 0x7f5e20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e34158ba0 0x7f5e200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3415b4b0 con 0x7f5e200039b0 2024-09-16T01:22:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3415b710 con 0x7f5e20004800 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2000b9c0 con 0x7f5e34158ba0 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.840+0000 7f5e33fff640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e200039b0 0x7f5e20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.841+0000 7f5e337fe640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e20004800 0x7f5e20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.841+0000 7f5e38b9e640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e34158ba0 0x7f5e200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.841+0000 7f5e33fff640 1 -- 172.21.15.81:0/662115599 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e34158ba0 msgr2=0x7f5e200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.841+0000 7f5e33fff640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e34158ba0 0x7f5e200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.841+0000 7f5e33fff640 1 -- 172.21.15.81:0/662115599 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e20004800 msgr2=0x7f5e20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.841+0000 7f5e33fff640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e20004800 0x7f5e20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.841+0000 7f5e33fff640 1 -- 172.21.15.81:0/662115599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e20003520 con 0x7f5e200039b0 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.841+0000 7f5e38b9e640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e34158ba0 0x7f5e200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.841+0000 7f5e33fff640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e200039b0 0x7f5e20003dd0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009ac0 tx=0x7f5e20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb20620e49b14d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.842+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24036070 con 0x7f5e200039b0 2024-09-16T01:22:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.842+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e24031400 con 0x7f5e200039b0 2024-09-16T01:22:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.842+0000 7f5e32ffd640 1 -- 172.21.15.81:0/662115599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24009690 con 0x7f5e200039b0 2024-09-16T01:22:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.842+0000 7f5e3939f640 1 -- 172.21.15.81:0/662115599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e200039b0 msgr2=0x7f5e20003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.842+0000 7f5e3939f640 1 --2- 172.21.15.81:0/662115599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e200039b0 0x7f5e20003dd0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5e24009ac0 tx=0x7f5e20005830 comp rx=0 tx=0).stop 2024-09-16T01:22:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.842+0000 7f5e38b9e640 1 -- 172.21.15.81:0/662115599 reap_dead start 2024-09-16T01:22:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.842+0000 7f5e3939f640 1 -- 172.21.15.81:0/662115599 shutdown_connections 2024-09-16T01:22:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.842+0000 7f5e3939f640 1 -- 172.21.15.81:0/662115599 >> 172.21.15.81:0/662115599 conn(0x7f5e3406c240 msgr2=0x7f5e340b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.842+0000 7f5e3939f640 1 -- 172.21.15.81:0/662115599 shutdown_connections 2024-09-16T01:22:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.842+0000 7f5e3939f640 1 -- 172.21.15.81:0/662115599 wait complete. 2024-09-16T01:22:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.843+0000 7f5e3939f640 1 Processor -- start 2024-09-16T01:22:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.844+0000 7f5e3939f640 1 -- start start 2024-09-16T01:22:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.844+0000 7f5e3939f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e200039b0 0x7f5e34150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.844+0000 7f5e3939f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e341548c0 0x7f5e3415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.844+0000 7f5e3939f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e34155550 0x7f5e3415cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.844+0000 7f5e3939f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5e340732d0 con 0x7f5e200039b0 2024-09-16T01:22:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.844+0000 7f5e3939f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3415bfb0 con 0x7f5e34155550 2024-09-16T01:22:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.844+0000 7f5e3939f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5e34073450 con 0x7f5e341548c0 2024-09-16T01:22:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.844+0000 7f5e33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e200039b0 0x7f5e34150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.844+0000 7f5e33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e200039b0 0x7f5e34150650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51578/0 (socket says 172.21.15.81:51578) 2024-09-16T01:22:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.844+0000 7f5e33fff640 1 -- 172.21.15.81:0/4250128893 learned_addr learned my addr 172.21.15.81:0/4250128893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:30.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e38b9e640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e34155550 0x7f5e3415cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e33fff640 1 -- 172.21.15.81:0/4250128893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e341548c0 msgr2=0x7f5e3415c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e33fff640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e341548c0 0x7f5e3415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e33fff640 1 -- 172.21.15.81:0/4250128893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e34155550 msgr2=0x7f5e3415cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e33fff640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e34155550 0x7f5e3415cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e33fff640 1 -- 172.21.15.81:0/4250128893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e34155130 con 0x7f5e200039b0 2024-09-16T01:22:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e38b9e640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e34155550 0x7f5e3415cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e33fff640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e200039b0 0x7f5e34150650 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f5e24034040 tx=0x7f5e24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e30ff9640 1 -- 172.21.15.81:0/4250128893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24040020 con 0x7f5e200039b0 2024-09-16T01:22:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e30ff9640 1 -- 172.21.15.81:0/4250128893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e24003bc0 con 0x7f5e200039b0 2024-09-16T01:22:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e30ff9640 1 -- 172.21.15.81:0/4250128893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24036040 con 0x7f5e200039b0 2024-09-16T01:22:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e3939f640 1 -- 172.21.15.81:0/4250128893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e340cc840 con 0x7f5e200039b0 2024-09-16T01:22:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.845+0000 7f5e3939f640 1 -- 172.21.15.81:0/4250128893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e340cce00 con 0x7f5e200039b0 2024-09-16T01:22:30.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.846+0000 7f5e3939f640 1 -- 172.21.15.81:0/4250128893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e340737e0 con 0x7f5e200039b0 2024-09-16T01:22:30.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.846+0000 7f5e30ff9640 1 -- 172.21.15.81:0/4250128893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5e24043020 con 0x7f5e200039b0 2024-09-16T01:22:30.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.847+0000 7f5e30ff9640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5e1406c2b0 0x7f5e1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:30.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.847+0000 7f5e30ff9640 1 -- 172.21.15.81:0/4250128893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f5e240ab430 con 0x7f5e200039b0 2024-09-16T01:22:30.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.847+0000 7f5e337fe640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5e1406c2b0 0x7f5e1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:30.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.847+0000 7f5e337fe640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5e1406c2b0 0x7f5e1406e770 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c001be0 tx=0x7f5e1c001b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:30.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:30.851+0000 7f5e30ff9640 1 -- 172.21.15.81:0/4250128893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e2404a070 con 0x7f5e200039b0 2024-09-16T01:22:31.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.020+0000 7f5e3939f640 1 -- 172.21.15.81:0/4250128893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"} v 0) -- 0x7f5e3415e680 con 0x7f5e200039b0 2024-09-16T01:22:31.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.023+0000 7f5e30ff9640 1 -- 172.21.15.81:0/4250128893 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"}]=0 v42) ==== 105+0+0 (secure 0 0 0) 0x7f5e240044e0 con 0x7f5e200039b0 2024-09-16T01:22:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.025+0000 7f5e3939f640 1 -- 172.21.15.81:0/4250128893 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5e1406c2b0 msgr2=0x7f5e1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.025+0000 7f5e3939f640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5e1406c2b0 0x7f5e1406e770 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c001be0 tx=0x7f5e1c001b70 comp rx=0 tx=0).stop 2024-09-16T01:22:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.025+0000 7f5e3939f640 1 -- 172.21.15.81:0/4250128893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e200039b0 msgr2=0x7f5e34150650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.025+0000 7f5e3939f640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e200039b0 0x7f5e34150650 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f5e24034040 tx=0x7f5e24004730 comp rx=0 tx=0).stop 2024-09-16T01:22:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.025+0000 7f5e3939f640 1 -- 172.21.15.81:0/4250128893 shutdown_connections 2024-09-16T01:22:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.025+0000 7f5e3939f640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5e1406c2b0 0x7f5e1406e770 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.025+0000 7f5e3939f640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e34155550 0x7f5e3415cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.025+0000 7f5e3939f640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e341548c0 0x7f5e3415c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.025+0000 7f5e3939f640 1 --2- 172.21.15.81:0/4250128893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e200039b0 0x7f5e34150650 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.025+0000 7f5e3939f640 1 -- 172.21.15.81:0/4250128893 >> 172.21.15.81:0/4250128893 conn(0x7f5e3406c240 msgr2=0x7f5e340ae790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.025+0000 7f5e3939f640 1 -- 172.21.15.81:0/4250128893 shutdown_connections 2024-09-16T01:22:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.025+0000 7f5e3939f640 1 -- 172.21.15.81:0/4250128893 wait complete. 2024-09-16T01:22:31.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-16T01:22:31.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.138+0000 7fa36656d640 1 Processor -- start 2024-09-16T01:22:31.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.138+0000 7fa36656d640 1 -- start start 2024-09-16T01:22:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.139+0000 7fa36656d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa360155930 0x7fa3600addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.139+0000 7fa36656d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36015c1e0 con 0x7fa3600d0a80 2024-09-16T01:22:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.139+0000 7fa36656d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa36015c4c0 con 0x7fa36015b720 2024-09-16T01:22:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.139+0000 7fa36656d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa3600b3340 con 0x7fa360155930 2024-09-16T01:22:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.139+0000 7fa35ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa360155930 0x7fa3600addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.139+0000 7fa364b0a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa3600d0a80 0x7fa3600b3b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42142/0 (socket says 172.21.15.81:42142) 2024-09-16T01:22:31.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.139+0000 7fa364b0a640 1 -- 172.21.15.81:0/812013638 learned_addr learned my addr 172.21.15.81:0/812013638 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:31.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.140+0000 7fa35ffff640 1 -- 172.21.15.81:0/812013638 >> v1:172.21.15.102:6789/0 conn(0x7fa36015b720 legacy=0x7fa3600d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:31.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.140+0000 7fa35ffff640 1 -- 172.21.15.81:0/812013638 >> v1:172.21.15.81:6789/0 conn(0x7fa3600d0a80 legacy=0x7fa3600b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.140+0000 7fa35effd640 1 -- 172.21.15.81:0/812013638 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468271022 0 0) 0x7fa36015c1e0 con 0x7fa3600d0a80 2024-09-16T01:22:31.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.140+0000 7fa35ffff640 1 -- 172.21.15.81:0/812013638 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3600b3620 con 0x7fa360155930 2024-09-16T01:22:31.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.140+0000 7fa35ffff640 1 --2- 172.21.15.81:0/812013638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa360155930 0x7fa3600addd0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fa3500097a0 tx=0x7fa35002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b478a5ffea26ad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:31.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.140+0000 7fa35effd640 1 -- 172.21.15.81:0/812013638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350037070 con 0x7fa360155930 2024-09-16T01:22:31.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.140+0000 7fa35effd640 1 -- 172.21.15.81:0/812013638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa350032440 con 0x7fa360155930 2024-09-16T01:22:31.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.140+0000 7fa35effd640 1 -- 172.21.15.81:0/812013638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350032810 con 0x7fa360155930 2024-09-16T01:22:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.141+0000 7fa36656d640 1 -- 172.21.15.81:0/812013638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa360155930 msgr2=0x7fa3600addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.141+0000 7fa36656d640 1 --2- 172.21.15.81:0/812013638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa360155930 0x7fa3600addd0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fa3500097a0 tx=0x7fa35002a230 comp rx=0 tx=0).stop 2024-09-16T01:22:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.141+0000 7fa36656d640 1 -- 172.21.15.81:0/812013638 shutdown_connections 2024-09-16T01:22:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.141+0000 7fa36656d640 1 --2- 172.21.15.81:0/812013638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa360155930 0x7fa3600addd0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.141+0000 7fa36656d640 1 -- 172.21.15.81:0/812013638 >> 172.21.15.81:0/812013638 conn(0x7fa36006bdf0 msgr2=0x7fa36006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:31.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.141+0000 7fa36656d640 1 -- 172.21.15.81:0/812013638 shutdown_connections 2024-09-16T01:22:31.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.141+0000 7fa36656d640 1 -- 172.21.15.81:0/812013638 wait complete. 2024-09-16T01:22:31.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.142+0000 7fa36656d640 1 Processor -- start 2024-09-16T01:22:31.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.142+0000 7fa36656d640 1 -- start start 2024-09-16T01:22:31.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa36656d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3600d0a80 0x7fa360152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa36656d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa360155930 0x7fa3600cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa36656d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa36015b720 0x7fa360154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa36656d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa3600ae490 con 0x7fa3600d0a80 2024-09-16T01:22:31.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa36656d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa3600ae310 con 0x7fa36015b720 2024-09-16T01:22:31.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa36656d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa36015bbb0 con 0x7fa360155930 2024-09-16T01:22:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa35ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3600d0a80 0x7fa360152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa35ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3600d0a80 0x7fa360152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43300/0 (socket says 172.21.15.81:43300) 2024-09-16T01:22:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa35ffff640 1 -- 172.21.15.81:0/2268903306 learned_addr learned my addr 172.21.15.81:0/2268903306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa35ffff640 1 -- 172.21.15.81:0/2268903306 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa360155930 msgr2=0x7fa3600cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa35ffff640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa360155930 0x7fa3600cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa35ffff640 1 -- 172.21.15.81:0/2268903306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa36015b720 msgr2=0x7fa360154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa364b0a640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa36015b720 0x7fa360154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa35ffff640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa36015b720 0x7fa360154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.143+0000 7fa35ffff640 1 -- 172.21.15.81:0/2268903306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3600ce460 con 0x7fa3600d0a80 2024-09-16T01:22:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.144+0000 7fa364b0a640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa36015b720 0x7fa360154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:31.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.144+0000 7fa35ffff640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3600d0a80 0x7fa360152b30 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa350035040 tx=0x7fa3500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.144+0000 7fa35cff9640 1 -- 172.21.15.81:0/2268903306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350037050 con 0x7fa3600d0a80 2024-09-16T01:22:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.144+0000 7fa35cff9640 1 -- 172.21.15.81:0/2268903306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa350038040 con 0x7fa3600d0a80 2024-09-16T01:22:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.144+0000 7fa35cff9640 1 -- 172.21.15.81:0/2268903306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350004490 con 0x7fa3600d0a80 2024-09-16T01:22:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.144+0000 7fa36656d640 1 -- 172.21.15.81:0/2268903306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3600ccba0 con 0x7fa3600d0a80 2024-09-16T01:22:31.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.144+0000 7fa36656d640 1 -- 172.21.15.81:0/2268903306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3600cd160 con 0x7fa3600d0a80 2024-09-16T01:22:31.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.145+0000 7fa36656d640 1 -- 172.21.15.81:0/2268903306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3600addd0 con 0x7fa3600d0a80 2024-09-16T01:22:31.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.145+0000 7fa35cff9640 1 -- 172.21.15.81:0/2268903306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa350030900 con 0x7fa3600d0a80 2024-09-16T01:22:31.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.146+0000 7fa35cff9640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa34c06c2b0 0x7fa34c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.146+0000 7fa35cff9640 1 -- 172.21.15.81:0/2268903306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7fa3500abe20 con 0x7fa3600d0a80 2024-09-16T01:22:31.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.146+0000 7fa35f7fe640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa34c06c2b0 0x7fa34c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.146+0000 7fa35f7fe640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa34c06c2b0 0x7fa34c06e770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa354000f60 tx=0x7fa3540079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:31.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.150+0000 7fa35cff9640 1 -- 172.21.15.81:0/2268903306 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa35007a8b0 con 0x7fa3600d0a80 2024-09-16T01:22:31.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.324+0000 7fa36656d640 1 -- 172.21.15.81:0/2268903306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fa360071f70 con 0x7fa3600d0a80 2024-09-16T01:22:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.327+0000 7fa35cff9640 1 -- 172.21.15.81:0/2268903306 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7fa35007a1b0 con 0x7fa3600d0a80 2024-09-16T01:22:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.329+0000 7fa36656d640 1 -- 172.21.15.81:0/2268903306 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa34c06c2b0 msgr2=0x7fa34c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.329+0000 7fa36656d640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa34c06c2b0 0x7fa34c06e770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa354000f60 tx=0x7fa3540079b0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.329+0000 7fa36656d640 1 -- 172.21.15.81:0/2268903306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3600d0a80 msgr2=0x7fa360152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.329+0000 7fa36656d640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3600d0a80 0x7fa360152b30 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa350035040 tx=0x7fa3500046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.329+0000 7fa36656d640 1 -- 172.21.15.81:0/2268903306 shutdown_connections 2024-09-16T01:22:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.329+0000 7fa36656d640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa34c06c2b0 0x7fa34c06e770 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.329+0000 7fa36656d640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa36015b720 0x7fa360154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.329+0000 7fa36656d640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa360155930 0x7fa3600cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.329+0000 7fa36656d640 1 --2- 172.21.15.81:0/2268903306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3600d0a80 0x7fa360152b30 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.329+0000 7fa36656d640 1 -- 172.21.15.81:0/2268903306 >> 172.21.15.81:0/2268903306 conn(0x7fa36006bdf0 msgr2=0x7fa360072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.329+0000 7fa36656d640 1 -- 172.21.15.81:0/2268903306 shutdown_connections 2024-09-16T01:22:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.329+0000 7fa36656d640 1 -- 172.21.15.81:0/2268903306 wait complete. 2024-09-16T01:22:31.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_max_caps 2024-09-16T01:22:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.442+0000 7fdc2936d640 1 Processor -- start 2024-09-16T01:22:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.442+0000 7fdc2936d640 1 -- start start 2024-09-16T01:22:31.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.443+0000 7fdc2936d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdc24155930 0x7fdc240addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.443+0000 7fdc2936d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc240d0a80 0x7fdc2415bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.443+0000 7fdc2936d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc2415c1e0 con 0x7fdc2415b720 2024-09-16T01:22:31.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.443+0000 7fdc2936d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fdc2415c4c0 con 0x7fdc24155930 2024-09-16T01:22:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.443+0000 7fdc2936d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdc240b3340 con 0x7fdc240d0a80 2024-09-16T01:22:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.443+0000 7fdc22ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdc24155930 0x7fdc240addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.443+0000 7fdc22ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdc24155930 0x7fdc240addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43302/0 (socket says 172.21.15.81:43302) 2024-09-16T01:22:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.443+0000 7fdc22ffd640 1 -- 172.21.15.81:0/2375053084 learned_addr learned my addr 172.21.15.81:0/2375053084 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.443+0000 7fdc22ffd640 1 -- 172.21.15.81:0/2375053084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc240d0a80 msgr2=0x7fdc2415bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.443+0000 7fdc22ffd640 1 --2- 172.21.15.81:0/2375053084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc240d0a80 0x7fdc2415bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.443+0000 7fdc22ffd640 1 -- 172.21.15.81:0/2375053084 >> v1:172.21.15.102:6789/0 conn(0x7fdc2415b720 legacy=0x7fdc240d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:31.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.443+0000 7fdc22ffd640 1 -- 172.21.15.81:0/2375053084 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc240b3620 con 0x7fdc24155930 2024-09-16T01:22:31.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.444+0000 7fdc22ffd640 1 --2- 172.21.15.81:0/2375053084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc24155930 0x7fdc240addd0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400bb10 tx=0x7fdc1402c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545b17bfff7d7aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:31.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.444+0000 7fdc227fc640 1 -- 172.21.15.81:0/2375053084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14032790 con 0x7fdc24155930 2024-09-16T01:22:31.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.444+0000 7fdc227fc640 1 -- 172.21.15.81:0/2375053084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc14038070 con 0x7fdc24155930 2024-09-16T01:22:31.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.444+0000 7fdc227fc640 1 -- 172.21.15.81:0/2375053084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14032b50 con 0x7fdc24155930 2024-09-16T01:22:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.445+0000 7fdc2936d640 1 -- 172.21.15.81:0/2375053084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc24155930 msgr2=0x7fdc240addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.445+0000 7fdc2936d640 1 --2- 172.21.15.81:0/2375053084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc24155930 0x7fdc240addd0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400bb10 tx=0x7fdc1402c8d0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.445+0000 7fdc2936d640 1 -- 172.21.15.81:0/2375053084 shutdown_connections 2024-09-16T01:22:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.445+0000 7fdc2936d640 1 --2- 172.21.15.81:0/2375053084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc240d0a80 0x7fdc2415bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.445+0000 7fdc2936d640 1 --2- 172.21.15.81:0/2375053084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc24155930 0x7fdc240addd0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.445+0000 7fdc2936d640 1 -- 172.21.15.81:0/2375053084 >> 172.21.15.81:0/2375053084 conn(0x7fdc2406bdf0 msgr2=0x7fdc2406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.445+0000 7fdc2936d640 1 -- 172.21.15.81:0/2375053084 shutdown_connections 2024-09-16T01:22:31.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.445+0000 7fdc2936d640 1 -- 172.21.15.81:0/2375053084 wait complete. 2024-09-16T01:22:31.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.446+0000 7fdc2936d640 1 Processor -- start 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.446+0000 7fdc2936d640 1 -- start start 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc2936d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc240d0a80 0x7fdc2409b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc2936d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc24155930 0x7fdc24149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc2936d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2415b720 0x7fdc2409cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc2936d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc240ae490 con 0x7fdc2415b720 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc2936d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdc240ae310 con 0x7fdc24155930 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc2936d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdc240b3b40 con 0x7fdc240d0a80 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2415b720 0x7fdc2409cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2415b720 0x7fdc2409cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43304/0 (socket says 172.21.15.81:43304) 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc237fe640 1 -- 172.21.15.81:0/3219746606 learned_addr learned my addr 172.21.15.81:0/3219746606 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc22ffd640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc240d0a80 0x7fdc2409b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc1a7fc640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc24155930 0x7fdc24149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc237fe640 1 -- 172.21.15.81:0/3219746606 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc240d0a80 msgr2=0x7fdc2409b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc237fe640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc240d0a80 0x7fdc2409b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc237fe640 1 -- 172.21.15.81:0/3219746606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc24155930 msgr2=0x7fdc24149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc237fe640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc24155930 0x7fdc24149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc237fe640 1 -- 172.21.15.81:0/3219746606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2409d8c0 con 0x7fdc2415b720 2024-09-16T01:22:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.447+0000 7fdc1a7fc640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc24155930 0x7fdc24149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.448+0000 7fdc237fe640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2415b720 0x7fdc2409cf90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00b9a0 tx=0x7fdc1c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.448+0000 7fdc1bfff640 1 -- 172.21.15.81:0/3219746606 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c019070 con 0x7fdc2415b720 2024-09-16T01:22:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.448+0000 7fdc1bfff640 1 -- 172.21.15.81:0/3219746606 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1c00cbc0 con 0x7fdc2415b720 2024-09-16T01:22:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.448+0000 7fdc1bfff640 1 -- 172.21.15.81:0/3219746606 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c014440 con 0x7fdc2415b720 2024-09-16T01:22:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.448+0000 7fdc2936d640 1 -- 172.21.15.81:0/3219746606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2409dba0 con 0x7fdc2415b720 2024-09-16T01:22:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.448+0000 7fdc2936d640 1 -- 172.21.15.81:0/3219746606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc2409e160 con 0x7fdc2415b720 2024-09-16T01:22:31.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.449+0000 7fdc2936d640 1 -- 172.21.15.81:0/3219746606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2415bb90 con 0x7fdc2415b720 2024-09-16T01:22:31.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.449+0000 7fdc1bfff640 1 -- 172.21.15.81:0/3219746606 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdc1c01c070 con 0x7fdc2415b720 2024-09-16T01:22:31.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.450+0000 7fdc1bfff640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc0406c2b0 0x7fdc0406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.450+0000 7fdc1bfff640 1 -- 172.21.15.81:0/3219746606 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7fdc1c08af60 con 0x7fdc2415b720 2024-09-16T01:22:31.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.450+0000 7fdc22ffd640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc0406c2b0 0x7fdc0406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.450+0000 7fdc22ffd640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc0406c2b0 0x7fdc0406e770 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdc14037000 tx=0x7fdc14032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.454+0000 7fdc1bfff640 1 -- 172.21.15.81:0/3219746606 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc1c0591f0 con 0x7fdc2415b720 2024-09-16T01:22:31.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.619+0000 7fdc2936d640 1 -- 172.21.15.81:0/3219746606 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"} v 0) -- 0x7fdc2409e330 con 0x7fdc2415b720 2024-09-16T01:22:31.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.624+0000 7fdc1bfff640 1 -- 172.21.15.81:0/3219746606 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"}]=0 v44) ==== 102+0+0 (secure 0 0 0) 0x7fdc1c05d4f0 con 0x7fdc2415b720 2024-09-16T01:22:31.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.626+0000 7fdc2936d640 1 -- 172.21.15.81:0/3219746606 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc0406c2b0 msgr2=0x7fdc0406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.626+0000 7fdc2936d640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc0406c2b0 0x7fdc0406e770 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdc14037000 tx=0x7fdc14032000 comp rx=0 tx=0).stop 2024-09-16T01:22:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.626+0000 7fdc2936d640 1 -- 172.21.15.81:0/3219746606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2415b720 msgr2=0x7fdc2409cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.626+0000 7fdc2936d640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2415b720 0x7fdc2409cf90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c00b9a0 tx=0x7fdc1c00be60 comp rx=0 tx=0).stop 2024-09-16T01:22:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.626+0000 7fdc2936d640 1 -- 172.21.15.81:0/3219746606 shutdown_connections 2024-09-16T01:22:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.626+0000 7fdc2936d640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc0406c2b0 0x7fdc0406e770 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.626+0000 7fdc2936d640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2415b720 0x7fdc2409cf90 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.626+0000 7fdc2936d640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc24155930 0x7fdc24149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.626+0000 7fdc2936d640 1 --2- 172.21.15.81:0/3219746606 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc240d0a80 0x7fdc2409b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.626+0000 7fdc2936d640 1 -- 172.21.15.81:0/3219746606 >> 172.21.15.81:0/3219746606 conn(0x7fdc2406bdf0 msgr2=0x7fdc24154790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.627+0000 7fdc2936d640 1 -- 172.21.15.81:0/3219746606 shutdown_connections 2024-09-16T01:22:31.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.627+0000 7fdc2936d640 1 -- 172.21.15.81:0/3219746606 wait complete. 2024-09-16T01:22:31.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_min_caps_working_set 2024-09-16T01:22:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.737+0000 7ff0666e4640 1 Processor -- start 2024-09-16T01:22:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.737+0000 7ff0666e4640 1 -- start start 2024-09-16T01:22:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff0666e4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff060155930 0x7ff0600addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff0666e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff06015b720 0x7ff06015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff0666e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0600d0370 0x7ff0600d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff0666e4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff0600d0d00 con 0x7ff0600d0370 2024-09-16T01:22:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff0666e4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff06015c1e0 con 0x7ff060155930 2024-09-16T01:22:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff0666e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff06015c4c0 con 0x7ff06015b720 2024-09-16T01:22:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff064c81640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0600d0370 0x7ff0600d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff064c81640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0600d0370 0x7ff0600d07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43320/0 (socket says 172.21.15.81:43320) 2024-09-16T01:22:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff064c81640 1 -- 172.21.15.81:0/2332170068 learned_addr learned my addr 172.21.15.81:0/2332170068 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff05ffff640 1 --2- 172.21.15.81:0/2332170068 >> v2:172.21.15.102:3300/0 conn(0x7ff060155930 0x7ff0600addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff05f7fe640 1 --2- 172.21.15.81:0/2332170068 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff06015b720 0x7ff06015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff064c81640 1 -- 172.21.15.81:0/2332170068 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff06015b720 msgr2=0x7ff06015bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff064c81640 1 --2- 172.21.15.81:0/2332170068 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff06015b720 0x7ff06015bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff064c81640 1 -- 172.21.15.81:0/2332170068 >> v2:172.21.15.102:3300/0 conn(0x7ff060155930 msgr2=0x7ff0600addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff064c81640 1 --2- 172.21.15.81:0/2332170068 >> v2:172.21.15.102:3300/0 conn(0x7ff060155930 0x7ff0600addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff064c81640 1 -- 172.21.15.81:0/2332170068 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0600b3340 con 0x7ff0600d0370 2024-09-16T01:22:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff05ffff640 1 --2- 172.21.15.81:0/2332170068 >> v2:172.21.15.102:3300/0 conn(0x7ff060155930 0x7ff0600addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.738+0000 7ff05f7fe640 1 --2- 172.21.15.81:0/2332170068 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff06015b720 0x7ff06015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.739+0000 7ff064c81640 1 --2- 172.21.15.81:0/2332170068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0600d0370 0x7ff0600d07c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7ff060071740 tx=0x7ff05802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd02b36aa49abf10 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.739+0000 7ff05effd640 1 -- 172.21.15.81:0/2332170068 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058036070 con 0x7ff0600d0370 2024-09-16T01:22:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.739+0000 7ff05effd640 1 -- 172.21.15.81:0/2332170068 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff058031600 con 0x7ff0600d0370 2024-09-16T01:22:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.739+0000 7ff05effd640 1 -- 172.21.15.81:0/2332170068 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0580319d0 con 0x7ff0600d0370 2024-09-16T01:22:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.740+0000 7ff0666e4640 1 -- 172.21.15.81:0/2332170068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0600d0370 msgr2=0x7ff0600d07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.740+0000 7ff0666e4640 1 --2- 172.21.15.81:0/2332170068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0600d0370 0x7ff0600d07c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7ff060071740 tx=0x7ff05802a6a0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.740+0000 7ff0666e4640 1 -- 172.21.15.81:0/2332170068 shutdown_connections 2024-09-16T01:22:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.740+0000 7ff0666e4640 1 --2- 172.21.15.81:0/2332170068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0600d0370 0x7ff0600d07c0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.740+0000 7ff0666e4640 1 --2- 172.21.15.81:0/2332170068 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff06015b720 0x7ff06015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.740+0000 7ff0666e4640 1 --2- 172.21.15.81:0/2332170068 >> v2:172.21.15.102:3300/0 conn(0x7ff060155930 0x7ff0600addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.740+0000 7ff0666e4640 1 -- 172.21.15.81:0/2332170068 >> 172.21.15.81:0/2332170068 conn(0x7ff06006bdf0 msgr2=0x7ff06006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:31.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.740+0000 7ff0666e4640 1 -- 172.21.15.81:0/2332170068 shutdown_connections 2024-09-16T01:22:31.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.740+0000 7ff0666e4640 1 -- 172.21.15.81:0/2332170068 wait complete. 2024-09-16T01:22:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.741+0000 7ff0666e4640 1 Processor -- start 2024-09-16T01:22:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.741+0000 7ff0666e4640 1 -- start start 2024-09-16T01:22:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff0666e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0600d0370 0x7ff0601414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff0666e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff060155930 0x7ff0600cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff0666e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff06015b720 0x7ff06014e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff0666e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff06006fa30 con 0x7ff0600d0370 2024-09-16T01:22:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff0666e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff06006f8b0 con 0x7ff060155930 2024-09-16T01:22:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff0666e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff0600ae310 con 0x7ff06015b720 2024-09-16T01:22:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff05ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0600d0370 0x7ff0601414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff05ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0600d0370 0x7ff0601414d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43332/0 (socket says 172.21.15.81:43332) 2024-09-16T01:22:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff05ffff640 1 -- 172.21.15.81:0/3662338218 learned_addr learned my addr 172.21.15.81:0/3662338218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff05f7fe640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff060155930 0x7ff0600cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff064c81640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff06015b720 0x7ff06014e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff05ffff640 1 -- 172.21.15.81:0/3662338218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff06015b720 msgr2=0x7ff06014e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff05ffff640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff06015b720 0x7ff06014e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff05ffff640 1 -- 172.21.15.81:0/3662338218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff060155930 msgr2=0x7ff0600cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff05ffff640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff060155930 0x7ff0600cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff05ffff640 1 -- 172.21.15.81:0/3662338218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0600cfb20 con 0x7ff0600d0370 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff05ffff640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0600d0370 0x7ff0601414d0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff05000c7f0 tx=0x7ff05000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.742+0000 7ff05cff9640 1 -- 172.21.15.81:0/3662338218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050015070 con 0x7ff0600d0370 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.743+0000 7ff05cff9640 1 -- 172.21.15.81:0/3662338218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff050007a30 con 0x7ff0600d0370 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.743+0000 7ff0666e4640 1 -- 172.21.15.81:0/3662338218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0601e5590 con 0x7ff0600d0370 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.743+0000 7ff05cff9640 1 -- 172.21.15.81:0/3662338218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff050007e00 con 0x7ff0600d0370 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.743+0000 7ff0666e4640 1 -- 172.21.15.81:0/3662338218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0601e5b50 con 0x7ff0600d0370 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.744+0000 7ff0666e4640 1 -- 172.21.15.81:0/3662338218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0600addd0 con 0x7ff0600d0370 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.744+0000 7ff05cff9640 1 -- 172.21.15.81:0/3662338218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff050018070 con 0x7ff0600d0370 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.745+0000 7ff05cff9640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff04c06c2b0 0x7ff04c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.745+0000 7ff05cff9640 1 -- 172.21.15.81:0/3662338218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7ff05008b200 con 0x7ff0600d0370 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.745+0000 7ff05f7fe640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff04c06c2b0 0x7ff04c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:31.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.745+0000 7ff05f7fe640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff04c06c2b0 0x7ff04c06e770 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff0600cc650 tx=0x7ff054008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.749+0000 7ff05cff9640 1 -- 172.21.15.81:0/3662338218 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff050059ae0 con 0x7ff0600d0370 2024-09-16T01:22:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.915+0000 7ff0666e4640 1 -- 172.21.15.81:0/3662338218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"} v 0) -- 0x7ff0600b2790 con 0x7ff0600d0370 2024-09-16T01:22:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.920+0000 7ff05cff9640 1 -- 172.21.15.81:0/3662338218 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"}]=0 v45) ==== 107+0+0 (secure 0 0 0) 0x7ff0500593e0 con 0x7ff0600d0370 2024-09-16T01:22:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.923+0000 7ff0666e4640 1 -- 172.21.15.81:0/3662338218 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff04c06c2b0 msgr2=0x7ff04c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.923+0000 7ff0666e4640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff04c06c2b0 0x7ff04c06e770 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff0600cc650 tx=0x7ff054008040 comp rx=0 tx=0).stop 2024-09-16T01:22:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.923+0000 7ff0666e4640 1 -- 172.21.15.81:0/3662338218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0600d0370 msgr2=0x7ff0601414d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.923+0000 7ff0666e4640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0600d0370 0x7ff0601414d0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff05000c7f0 tx=0x7ff05000ccb0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.923+0000 7ff0666e4640 1 -- 172.21.15.81:0/3662338218 shutdown_connections 2024-09-16T01:22:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.923+0000 7ff0666e4640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff04c06c2b0 0x7ff04c06e770 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.923+0000 7ff0666e4640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff06015b720 0x7ff06014e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.923+0000 7ff0666e4640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff060155930 0x7ff0600cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.923+0000 7ff0666e4640 1 --2- 172.21.15.81:0/3662338218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0600d0370 0x7ff0601414d0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:31.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.923+0000 7ff0666e4640 1 -- 172.21.15.81:0/3662338218 >> 172.21.15.81:0/3662338218 conn(0x7ff06006bdf0 msgr2=0x7ff060154940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:31.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.923+0000 7ff0666e4640 1 -- 172.21.15.81:0/3662338218 shutdown_connections 2024-09-16T01:22:31.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:31.923+0000 7ff0666e4640 1 -- 172.21.15.81:0/3662338218 wait complete. 2024-09-16T01:22:31.935 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin' 2024-09-16T01:22:32.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.031+0000 7f36574d2640 1 Processor -- start 2024-09-16T01:22:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.031+0000 7f36574d2640 1 -- start start 2024-09-16T01:22:32.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.032+0000 7f36574d2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3650071750 0x7f36500d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.032+0000 7f36574d2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36500d0b20 0x7f36501680c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.032+0000 7f36574d2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36500d12c0 con 0x7f365009aca0 2024-09-16T01:22:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.032+0000 7f36574d2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f365006d040 con 0x7f36500d0b20 2024-09-16T01:22:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.032+0000 7f36574d2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f36500d15a0 con 0x7f3650071750 2024-09-16T01:22:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.032+0000 7f3655a6f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36500d0b20 0x7f36501680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.032+0000 7f3655a6f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36500d0b20 0x7f36501680c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43348/0 (socket says 172.21.15.81:43348) 2024-09-16T01:22:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.032+0000 7f3655a6f640 1 -- 172.21.15.81:0/553428734 learned_addr learned my addr 172.21.15.81:0/553428734 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.033+0000 7f3654a6d640 1 --2- 172.21.15.81:0/553428734 >> v2:172.21.15.102:3300/0 conn(0x7f3650071750 0x7f36500d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.033+0000 7f3655a6f640 1 -- 172.21.15.81:0/553428734 >> v2:172.21.15.102:3300/0 conn(0x7f3650071750 msgr2=0x7f36500d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:32.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.033+0000 7f3655a6f640 1 --2- 172.21.15.81:0/553428734 >> v2:172.21.15.102:3300/0 conn(0x7f3650071750 0x7f36500d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.033+0000 7f3655a6f640 1 -- 172.21.15.81:0/553428734 >> v1:172.21.15.102:6789/0 conn(0x7f365009aca0 legacy=0x7f365009b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:32.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.033+0000 7f3655a6f640 1 -- 172.21.15.81:0/553428734 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36500d1880 con 0x7f36500d0b20 2024-09-16T01:22:32.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.033+0000 7f3654a6d640 1 --2- 172.21.15.81:0/553428734 >> v2:172.21.15.102:3300/0 conn(0x7f3650071750 0x7f36500d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:32.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.033+0000 7f3655a6f640 1 --2- 172.21.15.81:0/553428734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36500d0b20 0x7f36501680c0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f36500b1e10 tx=0x7f364802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e20163fa0bf199 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:32.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.034+0000 7f364ffff640 1 -- 172.21.15.81:0/553428734 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648036070 con 0x7f36500d0b20 2024-09-16T01:22:32.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.034+0000 7f364ffff640 1 -- 172.21.15.81:0/553428734 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3648031600 con 0x7f36500d0b20 2024-09-16T01:22:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.034+0000 7f364ffff640 1 -- 172.21.15.81:0/553428734 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36480319d0 con 0x7f36500d0b20 2024-09-16T01:22:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.034+0000 7f36574d2640 1 -- 172.21.15.81:0/553428734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36500d0b20 msgr2=0x7f36501680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.034+0000 7f36574d2640 1 --2- 172.21.15.81:0/553428734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36500d0b20 0x7f36501680c0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f36500b1e10 tx=0x7f364802a6f0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.034+0000 7f36574d2640 1 -- 172.21.15.81:0/553428734 shutdown_connections 2024-09-16T01:22:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.034+0000 7f36574d2640 1 --2- 172.21.15.81:0/553428734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36500d0b20 0x7f36501680c0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.034+0000 7f36574d2640 1 --2- 172.21.15.81:0/553428734 >> v2:172.21.15.102:3300/0 conn(0x7f3650071750 0x7f36500d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.034+0000 7f36574d2640 1 -- 172.21.15.81:0/553428734 >> 172.21.15.81:0/553428734 conn(0x7f36500d23a0 msgr2=0x7f36500d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.034+0000 7f36574d2640 1 -- 172.21.15.81:0/553428734 shutdown_connections 2024-09-16T01:22:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.034+0000 7f36574d2640 1 -- 172.21.15.81:0/553428734 wait complete. 2024-09-16T01:22:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.035+0000 7f36574d2640 1 Processor -- start 2024-09-16T01:22:32.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.035+0000 7f36574d2640 1 -- start start 2024-09-16T01:22:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.036+0000 7f36574d2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3650071750 0x7f36500cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.036+0000 7f36574d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f365009aca0 0x7f36501597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.036+0000 7f36574d2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36500d0b20 0x7f36500c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.036+0000 7f36574d2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f365009b790 con 0x7f365009aca0 2024-09-16T01:22:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.036+0000 7f36574d2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3650070220 con 0x7f36500d0b20 2024-09-16T01:22:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.036+0000 7f36574d2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f36500d0f70 con 0x7f3650071750 2024-09-16T01:22:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.036+0000 7f3654a6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f365009aca0 0x7f36501597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.036+0000 7f3654a6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f365009aca0 0x7f36501597b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43364/0 (socket says 172.21.15.81:43364) 2024-09-16T01:22:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.036+0000 7f3654a6d640 1 -- 172.21.15.81:0/2909515421 learned_addr learned my addr 172.21.15.81:0/2909515421 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.036+0000 7f3655a6f640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36500d0b20 0x7f36500c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.036+0000 7f365526e640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3650071750 0x7f36500cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.037+0000 7f3654a6d640 1 -- 172.21.15.81:0/2909515421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3650071750 msgr2=0x7f36500cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.037+0000 7f3654a6d640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3650071750 0x7f36500cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.037+0000 7f3654a6d640 1 -- 172.21.15.81:0/2909515421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36500d0b20 msgr2=0x7f36500c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.037+0000 7f3654a6d640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36500d0b20 0x7f36500c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.037+0000 7f3654a6d640 1 -- 172.21.15.81:0/2909515421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36500c9e50 con 0x7f365009aca0 2024-09-16T01:22:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.037+0000 7f3655a6f640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36500d0b20 0x7f36500c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.037+0000 7f3654a6d640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f365009aca0 0x7f36501597b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f364400c7f0 tx=0x7f364400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.037+0000 7f364dffb640 1 -- 172.21.15.81:0/2909515421 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644015070 con 0x7f365009aca0 2024-09-16T01:22:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.037+0000 7f364dffb640 1 -- 172.21.15.81:0/2909515421 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3644007a30 con 0x7f365009aca0 2024-09-16T01:22:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.037+0000 7f36574d2640 1 -- 172.21.15.81:0/2909515421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36500ca130 con 0x7f365009aca0 2024-09-16T01:22:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.037+0000 7f364dffb640 1 -- 172.21.15.81:0/2909515421 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644007e00 con 0x7f365009aca0 2024-09-16T01:22:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.037+0000 7f36574d2640 1 -- 172.21.15.81:0/2909515421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36500af4c0 con 0x7f365009aca0 2024-09-16T01:22:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.038+0000 7f36574d2640 1 -- 172.21.15.81:0/2909515421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36500d05e0 con 0x7f365009aca0 2024-09-16T01:22:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.038+0000 7f364dffb640 1 -- 172.21.15.81:0/2909515421 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3644018070 con 0x7f365009aca0 2024-09-16T01:22:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.039+0000 7f364dffb640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f363c06c2e0 0x7f363c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.039+0000 7f364dffb640 1 -- 172.21.15.81:0/2909515421 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f364408b220 con 0x7f365009aca0 2024-09-16T01:22:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.039+0000 7f365526e640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f363c06c2e0 0x7f363c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.039+0000 7f365526e640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f363c06c2e0 0x7f363c06e7a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3640004ea0 tx=0x7f3640009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:32.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.043+0000 7f364dffb640 1 -- 172.21.15.81:0/2909515421 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3644059b90 con 0x7f365009aca0 2024-09-16T01:22:32.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.273+0000 7f36574d2640 1 -- 172.21.15.81:0/2909515421 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]} v 0) -- 0x7f365015bfe0 con 0x7f365009aca0 2024-09-16T01:22:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.421+0000 7f364dffb640 1 -- 172.21.15.81:0/2909515421 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]}]=0 v346) ==== 143+0+0 (secure 0 0 0) 0x7f3644059490 con 0x7f365009aca0 2024-09-16T01:22:32.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.423+0000 7f36574d2640 1 -- 172.21.15.81:0/2909515421 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f363c06c2e0 msgr2=0x7f363c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.423+0000 7f36574d2640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f363c06c2e0 0x7f363c06e7a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3640004ea0 tx=0x7f3640009040 comp rx=0 tx=0).stop 2024-09-16T01:22:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.423+0000 7f36574d2640 1 -- 172.21.15.81:0/2909515421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f365009aca0 msgr2=0x7f36501597b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.423+0000 7f36574d2640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f365009aca0 0x7f36501597b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f364400c7f0 tx=0x7f364400cbf0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.423+0000 7f36574d2640 1 -- 172.21.15.81:0/2909515421 shutdown_connections 2024-09-16T01:22:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.423+0000 7f36574d2640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f363c06c2e0 0x7f363c06e7a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.423+0000 7f36574d2640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f36500d0b20 0x7f36500c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.423+0000 7f36574d2640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f365009aca0 0x7f36501597b0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.423+0000 7f36574d2640 1 --2- 172.21.15.81:0/2909515421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3650071750 0x7f36500cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.423+0000 7f36574d2640 1 -- 172.21.15.81:0/2909515421 >> 172.21.15.81:0/2909515421 conn(0x7f36500d23a0 msgr2=0x7f365015d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.423+0000 7f36574d2640 1 -- 172.21.15.81:0/2909515421 shutdown_connections 2024-09-16T01:22:32.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.423+0000 7f36574d2640 1 -- 172.21.15.81:0/2909515421 wait complete. 2024-09-16T01:22:32.436 INFO:tasks.cephfs_test_runner:test_client_pin (tasks.cephfs.test_client_limits.TestClientLimits) ... ok 2024-09-16T01:22:32.437 INFO:tasks.cephfs_test_runner:Starting test: test_client_pin_mincaps (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-16T01:22:32.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:22:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.534+0000 7f3871d6d640 1 Processor -- start 2024-09-16T01:22:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.534+0000 7f3871d6d640 1 -- start start 2024-09-16T01:22:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f3871d6d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f386c15b300 0x7f386c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f3871d6d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f386c0cd3f0 0x7f386c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f3871d6d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f386c072d30 0x7f386c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f3871d6d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f386c0728a0 con 0x7f386c072d30 2024-09-16T01:22:32.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f3871d6d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f386c0cdbe0 con 0x7f386c15b300 2024-09-16T01:22:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f3871d6d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f386c0cd900 con 0x7f386c0cd3f0 2024-09-16T01:22:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f386bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f386c072d30 0x7f386c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f386bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f386c072d30 0x7f386c06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43368/0 (socket says 172.21.15.81:43368) 2024-09-16T01:22:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f386bfff640 1 -- 172.21.15.81:0/1858528245 learned_addr learned my addr 172.21.15.81:0/1858528245 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f386b7fe640 1 --2- 172.21.15.81:0/1858528245 >> v2:172.21.15.102:3300/0 conn(0x7f386c15b300 0x7f386c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f386affd640 1 --2- 172.21.15.81:0/1858528245 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f386c0cd3f0 0x7f386c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f386bfff640 1 -- 172.21.15.81:0/1858528245 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f386c0cd3f0 msgr2=0x7f386c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f386bfff640 1 --2- 172.21.15.81:0/1858528245 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f386c0cd3f0 0x7f386c06f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f386bfff640 1 -- 172.21.15.81:0/1858528245 >> v2:172.21.15.102:3300/0 conn(0x7f386c15b300 msgr2=0x7f386c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f386bfff640 1 --2- 172.21.15.81:0/1858528245 >> v2:172.21.15.102:3300/0 conn(0x7f386c15b300 0x7f386c0cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f386bfff640 1 -- 172.21.15.81:0/1858528245 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c072250 con 0x7f386c072d30 2024-09-16T01:22:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.535+0000 7f386b7fe640 1 --2- 172.21.15.81:0/1858528245 >> v2:172.21.15.102:3300/0 conn(0x7f386c15b300 0x7f386c0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.536+0000 7f386bfff640 1 --2- 172.21.15.81:0/1858528245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f386c072d30 0x7f386c06f700 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f386c070250 tx=0x7f386402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87018db5d1f92cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.536+0000 7f386a7fc640 1 -- 172.21.15.81:0/1858528245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864036070 con 0x7f386c072d30 2024-09-16T01:22:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.536+0000 7f386a7fc640 1 -- 172.21.15.81:0/1858528245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3864031600 con 0x7f386c072d30 2024-09-16T01:22:32.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.536+0000 7f386a7fc640 1 -- 172.21.15.81:0/1858528245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38640319d0 con 0x7f386c072d30 2024-09-16T01:22:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.537+0000 7f3871d6d640 1 -- 172.21.15.81:0/1858528245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f386c072d30 msgr2=0x7f386c06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.537+0000 7f3871d6d640 1 --2- 172.21.15.81:0/1858528245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f386c072d30 0x7f386c06f700 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f386c070250 tx=0x7f386402a6a0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.537+0000 7f3871d6d640 1 -- 172.21.15.81:0/1858528245 shutdown_connections 2024-09-16T01:22:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.537+0000 7f3871d6d640 1 --2- 172.21.15.81:0/1858528245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f386c072d30 0x7f386c06f700 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.537+0000 7f3871d6d640 1 --2- 172.21.15.81:0/1858528245 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f386c0cd3f0 0x7f386c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.537+0000 7f3871d6d640 1 --2- 172.21.15.81:0/1858528245 >> v2:172.21.15.102:3300/0 conn(0x7f386c15b300 0x7f386c0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.537+0000 7f3871d6d640 1 -- 172.21.15.81:0/1858528245 >> 172.21.15.81:0/1858528245 conn(0x7f386c067d70 msgr2=0x7f386c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.537+0000 7f3871d6d640 1 -- 172.21.15.81:0/1858528245 shutdown_connections 2024-09-16T01:22:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.537+0000 7f3871d6d640 1 -- 172.21.15.81:0/1858528245 wait complete. 2024-09-16T01:22:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.538+0000 7f3871d6d640 1 Processor -- start 2024-09-16T01:22:32.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.538+0000 7f3871d6d640 1 -- start start 2024-09-16T01:22:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f3871d6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f386c072d30 0x7f386c1f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f3871d6d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f386c0cd3f0 0x7f386c14bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f3871d6d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f386c15b300 0x7f386c151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f3871d6d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f386c0d0160 con 0x7f386c0cd3f0 2024-09-16T01:22:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f3871d6d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f386c0cffe0 con 0x7f386c072d30 2024-09-16T01:22:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f3871d6d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f386c0b3c40 con 0x7f386c15b300 2024-09-16T01:22:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f386affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f386c0cd3f0 0x7f386c14bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f386affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f386c0cd3f0 0x7f386c14bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43374/0 (socket says 172.21.15.81:43374) 2024-09-16T01:22:32.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f386affd640 1 -- 172.21.15.81:0/2228475614 learned_addr learned my addr 172.21.15.81:0/2228475614 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:32.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f386bfff640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f386c15b300 0x7f386c151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f386b7fe640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f386c072d30 0x7f386c1f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f386affd640 1 -- 172.21.15.81:0/2228475614 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f386c15b300 msgr2=0x7f386c151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f386affd640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f386c15b300 0x7f386c151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f386affd640 1 -- 172.21.15.81:0/2228475614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f386c072d30 msgr2=0x7f386c1f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f386affd640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f386c072d30 0x7f386c1f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f386affd640 1 -- 172.21.15.81:0/2228475614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c14cf10 con 0x7f386c0cd3f0 2024-09-16T01:22:32.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f386b7fe640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f386c072d30 0x7f386c1f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:32.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f386affd640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f386c0cd3f0 0x7f386c14bdf0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f386000d800 tx=0x7f386000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:32.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f3853fff640 1 -- 172.21.15.81:0/2228475614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860018030 con 0x7f386c0cd3f0 2024-09-16T01:22:32.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f3853fff640 1 -- 172.21.15.81:0/2228475614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3860004020 con 0x7f386c0cd3f0 2024-09-16T01:22:32.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.539+0000 7f3871d6d640 1 -- 172.21.15.81:0/2228475614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c14d1f0 con 0x7f386c0cd3f0 2024-09-16T01:22:32.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.540+0000 7f3853fff640 1 -- 172.21.15.81:0/2228475614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38600041f0 con 0x7f386c0cd3f0 2024-09-16T01:22:32.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.540+0000 7f3871d6d640 1 -- 172.21.15.81:0/2228475614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c14d7b0 con 0x7f386c0cd3f0 2024-09-16T01:22:32.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.540+0000 7f3871d6d640 1 -- 172.21.15.81:0/2228475614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f386c15dfb0 con 0x7f386c0cd3f0 2024-09-16T01:22:32.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.541+0000 7f3853fff640 1 -- 172.21.15.81:0/2228475614 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f386001b070 con 0x7f386c0cd3f0 2024-09-16T01:22:32.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.541+0000 7f3853fff640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f385806c2b0 0x7f385806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.541+0000 7f3853fff640 1 -- 172.21.15.81:0/2228475614 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f386008b320 con 0x7f386c0cd3f0 2024-09-16T01:22:32.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.541+0000 7f386b7fe640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f385806c2b0 0x7f385806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.542+0000 7f386b7fe640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f385806c2b0 0x7f385806e770 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f385c006fd0 tx=0x7f385c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:32.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.546+0000 7f3853fff640 1 -- 172.21.15.81:0/2228475614 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3860059c90 con 0x7f386c0cd3f0 2024-09-16T01:22:32.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.713+0000 7f3871d6d640 1 -- 172.21.15.81:0/2228475614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f386c15bf80 con 0x7f386c0cd3f0 2024-09-16T01:22:32.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.714+0000 7f3853fff640 1 -- 172.21.15.81:0/2228475614 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+13315 (secure 0 0 0) 0x7f3860059590 con 0x7f386c0cd3f0 2024-09-16T01:22:32.715 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:32.715 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":116,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:22:30.413198+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:6835/415655488":"2024-09-17T01:22:27.293255+0000","172.21.15.102:6833/415655488":"2024-09-17T01:22:27.293255+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:22:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.716+0000 7f3871d6d640 1 -- 172.21.15.81:0/2228475614 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f385806c2b0 msgr2=0x7f385806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.716+0000 7f3871d6d640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f385806c2b0 0x7f385806e770 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f385c006fd0 tx=0x7f385c008040 comp rx=0 tx=0).stop 2024-09-16T01:22:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.716+0000 7f3871d6d640 1 -- 172.21.15.81:0/2228475614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f386c0cd3f0 msgr2=0x7f386c14bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.716+0000 7f3871d6d640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f386c0cd3f0 0x7f386c14bdf0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f386000d800 tx=0x7f386000dcc0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.716+0000 7f3871d6d640 1 -- 172.21.15.81:0/2228475614 shutdown_connections 2024-09-16T01:22:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.716+0000 7f3871d6d640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f385806c2b0 0x7f385806e770 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.716+0000 7f3871d6d640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f386c15b300 0x7f386c151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.716+0000 7f3871d6d640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f386c0cd3f0 0x7f386c14bdf0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.716+0000 7f3871d6d640 1 --2- 172.21.15.81:0/2228475614 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f386c072d30 0x7f386c1f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.716+0000 7f3871d6d640 1 -- 172.21.15.81:0/2228475614 >> 172.21.15.81:0/2228475614 conn(0x7f386c067d70 msgr2=0x7f386c155640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.716+0000 7f3871d6d640 1 -- 172.21.15.81:0/2228475614 shutdown_connections 2024-09-16T01:22:32.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.716+0000 7f3871d6d640 1 -- 172.21.15.81:0/2228475614 wait complete. 2024-09-16T01:22:32.728 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:15:28.088452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:22:32.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:22:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.828+0000 7f47280d0640 1 Processor -- start 2024-09-16T01:22:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.828+0000 7f47280d0640 1 -- start start 2024-09-16T01:22:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f47280d0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47200af210 0x7f4720070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f47280d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4720070fb0 0x7f472006de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f47280d0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472006cdc0 con 0x7f472015e7f0 2024-09-16T01:22:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f47280d0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4720071420 con 0x7f47200af210 2024-09-16T01:22:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f47280d0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f472006d0a0 con 0x7f4720070fb0 2024-09-16T01:22:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f472566b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47200af210 0x7f4720070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f4725e6c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f472015e7f0 0x7f47200b6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42150/0 (socket says 172.21.15.81:42150) 2024-09-16T01:22:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f472566b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47200af210 0x7f4720070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43380/0 (socket says 172.21.15.81:43380) 2024-09-16T01:22:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f4725e6c640 1 -- 172.21.15.81:0/2988581680 learned_addr learned my addr 172.21.15.81:0/2988581680 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f472566b640 1 -- 172.21.15.81:0/2988581680 >> v2:172.21.15.102:3300/0 conn(0x7f4720070fb0 msgr2=0x7f472006de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f472666d640 1 --2- 172.21.15.81:0/2988581680 >> v2:172.21.15.102:3300/0 conn(0x7f4720070fb0 0x7f472006de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f472566b640 1 --2- 172.21.15.81:0/2988581680 >> v2:172.21.15.102:3300/0 conn(0x7f4720070fb0 0x7f472006de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f4724e6a640 1 -- 172.21.15.81:0/2988581680 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1167711389 0 0) 0x7f472006cdc0 con 0x7f472015e7f0 2024-09-16T01:22:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f472566b640 1 -- 172.21.15.81:0/2988581680 >> v1:172.21.15.81:6789/0 conn(0x7f472015e7f0 legacy=0x7f47200b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.829+0000 7f472566b640 1 -- 172.21.15.81:0/2988581680 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472006d380 con 0x7f47200af210 2024-09-16T01:22:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.830+0000 7f472566b640 1 --2- 172.21.15.81:0/2988581680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47200af210 0x7f4720070a70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f47200736b0 tx=0x7f471002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd542ec54e7d3f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.830+0000 7f4724e6a640 1 -- 172.21.15.81:0/2988581680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710037070 con 0x7f47200af210 2024-09-16T01:22:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.830+0000 7f4724e6a640 1 -- 172.21.15.81:0/2988581680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4710032440 con 0x7f47200af210 2024-09-16T01:22:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.830+0000 7f4724e6a640 1 -- 172.21.15.81:0/2988581680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710032810 con 0x7f47200af210 2024-09-16T01:22:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.831+0000 7f47280d0640 1 -- 172.21.15.81:0/2988581680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47200af210 msgr2=0x7f4720070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.831+0000 7f47280d0640 1 --2- 172.21.15.81:0/2988581680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47200af210 0x7f4720070a70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f47200736b0 tx=0x7f471002a1a0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.831+0000 7f47280d0640 1 -- 172.21.15.81:0/2988581680 shutdown_connections 2024-09-16T01:22:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.831+0000 7f47280d0640 1 --2- 172.21.15.81:0/2988581680 >> v2:172.21.15.102:3300/0 conn(0x7f4720070fb0 0x7f472006de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.831+0000 7f47280d0640 1 --2- 172.21.15.81:0/2988581680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47200af210 0x7f4720070a70 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.831+0000 7f47280d0640 1 -- 172.21.15.81:0/2988581680 >> 172.21.15.81:0/2988581680 conn(0x7f47200b3f30 msgr2=0x7f47200b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.831+0000 7f47280d0640 1 -- 172.21.15.81:0/2988581680 shutdown_connections 2024-09-16T01:22:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.831+0000 7f47280d0640 1 -- 172.21.15.81:0/2988581680 wait complete. 2024-09-16T01:22:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.832+0000 7f47280d0640 1 Processor -- start 2024-09-16T01:22:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.832+0000 7f47280d0640 1 -- start start 2024-09-16T01:22:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f47280d0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4720070fb0 0x7f47201523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f47280d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47200af210 0x7f47200ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f47280d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f472015e7f0 0x7f47200b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f47280d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f47200b5f40 con 0x7f47200af210 2024-09-16T01:22:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f47280d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f47200b7420 con 0x7f472015e7f0 2024-09-16T01:22:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f47280d0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f47200b60c0 con 0x7f4720070fb0 2024-09-16T01:22:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f472566b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47200af210 0x7f47200ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f472566b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47200af210 0x7f47200ccef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43392/0 (socket says 172.21.15.81:43392) 2024-09-16T01:22:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f472566b640 1 -- 172.21.15.81:0/1253482197 learned_addr learned my addr 172.21.15.81:0/1253482197 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f4725e6c640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4720070fb0 0x7f47201523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f472666d640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f472015e7f0 0x7f47200b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f472566b640 1 -- 172.21.15.81:0/1253482197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4720070fb0 msgr2=0x7f47201523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f472566b640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4720070fb0 0x7f47201523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f472566b640 1 -- 172.21.15.81:0/1253482197 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f472015e7f0 msgr2=0x7f47200b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f472566b640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f472015e7f0 0x7f47200b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f472566b640 1 -- 172.21.15.81:0/1253482197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472015ed00 con 0x7f47200af210 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f472566b640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47200af210 0x7f47200ccef0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f4710000c00 tx=0x7f47100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f47167fc640 1 -- 172.21.15.81:0/1253482197 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710037050 con 0x7f47200af210 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f47167fc640 1 -- 172.21.15.81:0/1253482197 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4710038040 con 0x7f47200af210 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f47280d0640 1 -- 172.21.15.81:0/1253482197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472015efe0 con 0x7f47200af210 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f47167fc640 1 -- 172.21.15.81:0/1253482197 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4710004450 con 0x7f47200af210 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.833+0000 7f47280d0640 1 -- 172.21.15.81:0/1253482197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f472015f5a0 con 0x7f47200af210 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.834+0000 7f47280d0640 1 -- 172.21.15.81:0/1253482197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4720070a70 con 0x7f47200af210 2024-09-16T01:22:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.835+0000 7f47167fc640 1 -- 172.21.15.81:0/1253482197 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4710030980 con 0x7f47200af210 2024-09-16T01:22:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.835+0000 7f47167fc640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f470406c2b0 0x7f470406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.835+0000 7f47167fc640 1 -- 172.21.15.81:0/1253482197 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f47100abff0 con 0x7f47200af210 2024-09-16T01:22:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.835+0000 7f4725e6c640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f470406c2b0 0x7f470406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.836+0000 7f4725e6c640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f470406c2b0 0x7f470406e770 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f471c000f60 tx=0x7f471c007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:32.839+0000 7f47167fc640 1 -- 172.21.15.81:0/1253482197 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f471007a9f0 con 0x7f47200af210 2024-09-16T01:22:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.005+0000 7f47280d0640 1 -- 172.21.15.81:0/1253482197 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f47200b45f0 con 0x7f47200af210 2024-09-16T01:22:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.005+0000 7f47167fc640 1 -- 172.21.15.81:0/1253482197 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) ==== 93+0+10 (secure 0 0 0) 0x7f471007a2f0 con 0x7f47200af210 2024-09-16T01:22:33.007 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-16T01:22:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.007+0000 7f47280d0640 1 -- 172.21.15.81:0/1253482197 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f470406c2b0 msgr2=0x7f470406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.007+0000 7f47280d0640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f470406c2b0 0x7f470406e770 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f471c000f60 tx=0x7f471c007c00 comp rx=0 tx=0).stop 2024-09-16T01:22:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.007+0000 7f47280d0640 1 -- 172.21.15.81:0/1253482197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47200af210 msgr2=0x7f47200ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.007+0000 7f47280d0640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47200af210 0x7f47200ccef0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f4710000c00 tx=0x7f47100046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.007+0000 7f47280d0640 1 -- 172.21.15.81:0/1253482197 shutdown_connections 2024-09-16T01:22:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.007+0000 7f47280d0640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f470406c2b0 0x7f470406e770 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.007+0000 7f47280d0640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f472015e7f0 0x7f47200b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.007+0000 7f47280d0640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47200af210 0x7f47200ccef0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.007+0000 7f47280d0640 1 --2- 172.21.15.81:0/1253482197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4720070fb0 0x7f47201523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.007+0000 7f47280d0640 1 -- 172.21.15.81:0/1253482197 >> 172.21.15.81:0/1253482197 conn(0x7f47200b3f30 msgr2=0x7f47200b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.007+0000 7f47280d0640 1 -- 172.21.15.81:0/1253482197 shutdown_connections 2024-09-16T01:22:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.008+0000 7f47280d0640 1 -- 172.21.15.81:0/1253482197 wait complete. 2024-09-16T01:22:33.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps' 2024-09-16T01:22:33.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.117+0000 7f73a9e53640 1 Processor -- start 2024-09-16T01:22:33.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.117+0000 7f73a9e53640 1 -- start start 2024-09-16T01:22:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.118+0000 7f73a9e53640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73a415f930 0x7f73a409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.118+0000 7f73a9e53640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73a40cdcd0 0x7f73a40ce160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.118+0000 7f73a9e53640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73a40ceb00 con 0x7f73a409af70 2024-09-16T01:22:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.118+0000 7f73a9e53640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f73a409b3c0 con 0x7f73a415f930 2024-09-16T01:22:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.118+0000 7f73a9e53640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f73a40af140 con 0x7f73a40cdcd0 2024-09-16T01:22:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.118+0000 7f73a37fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73a415f930 0x7f73a409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.118+0000 7f739bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f73a409af70 0x7f73a40aff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42156/0 (socket says 172.21.15.81:42156) 2024-09-16T01:22:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.118+0000 7f739bfff640 1 -- 172.21.15.81:0/2741664283 learned_addr learned my addr 172.21.15.81:0/2741664283 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.118+0000 7f73a3fff640 1 --2- 172.21.15.81:0/2741664283 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73a40cdcd0 0x7f73a40ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.118+0000 7f73a2ffd640 1 -- 172.21.15.81:0/2741664283 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886989094 0 0) 0x7f73a40ceb00 con 0x7f73a409af70 2024-09-16T01:22:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.118+0000 7f73a2ffd640 1 -- 172.21.15.81:0/2741664283 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7390003520 con 0x7f73a409af70 2024-09-16T01:22:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.119+0000 7f73a37fe640 1 -- 172.21.15.81:0/2741664283 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73a40cdcd0 msgr2=0x7f73a40ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.119+0000 7f73a37fe640 1 --2- 172.21.15.81:0/2741664283 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73a40cdcd0 0x7f73a40ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.119+0000 7f73a37fe640 1 -- 172.21.15.81:0/2741664283 >> v1:172.21.15.81:6789/0 conn(0x7f73a409af70 legacy=0x7f73a40aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.119+0000 7f73a37fe640 1 -- 172.21.15.81:0/2741664283 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a40af420 con 0x7f73a415f930 2024-09-16T01:22:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.119+0000 7f73a37fe640 1 --2- 172.21.15.81:0/2741664283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a415f930 0x7f73a409aa30 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f73940097a0 tx=0x7f739402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caae9a2f6f62409f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.119+0000 7f73a2ffd640 1 -- 172.21.15.81:0/2741664283 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394037070 con 0x7f73a415f930 2024-09-16T01:22:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.119+0000 7f73a2ffd640 1 -- 172.21.15.81:0/2741664283 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7394032440 con 0x7f73a415f930 2024-09-16T01:22:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.119+0000 7f73a2ffd640 1 -- 172.21.15.81:0/2741664283 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394032810 con 0x7f73a415f930 2024-09-16T01:22:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.120+0000 7f73a9e53640 1 -- 172.21.15.81:0/2741664283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a415f930 msgr2=0x7f73a409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.120+0000 7f73a9e53640 1 --2- 172.21.15.81:0/2741664283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a415f930 0x7f73a409aa30 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f73940097a0 tx=0x7f739402a180 comp rx=0 tx=0).stop 2024-09-16T01:22:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.120+0000 7f73a9e53640 1 -- 172.21.15.81:0/2741664283 shutdown_connections 2024-09-16T01:22:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.120+0000 7f73a9e53640 1 --2- 172.21.15.81:0/2741664283 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73a40cdcd0 0x7f73a40ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.120+0000 7f73a9e53640 1 --2- 172.21.15.81:0/2741664283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a415f930 0x7f73a409aa30 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.120+0000 7f73a9e53640 1 -- 172.21.15.81:0/2741664283 >> 172.21.15.81:0/2741664283 conn(0x7f73a40b3e40 msgr2=0x7f73a40b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:33.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.120+0000 7f73a9e53640 1 -- 172.21.15.81:0/2741664283 shutdown_connections 2024-09-16T01:22:33.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.120+0000 7f73a9e53640 1 -- 172.21.15.81:0/2741664283 wait complete. 2024-09-16T01:22:33.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.121+0000 7f73a9e53640 1 Processor -- start 2024-09-16T01:22:33.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.121+0000 7f73a9e53640 1 -- start start 2024-09-16T01:22:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f73a9e53640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73a409af70 0x7f73a41589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f73a9e53640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73a40cdcd0 0x7f73a406d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f73a9e53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a415f930 0x7f73a40b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f73a9e53640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f73a415fd10 con 0x7f73a415f930 2024-09-16T01:22:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f73a9e53640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f73a40af9e0 con 0x7f73a409af70 2024-09-16T01:22:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f73a9e53640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f73a40ce6a0 con 0x7f73a40cdcd0 2024-09-16T01:22:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f73a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a415f930 0x7f73a40b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f73a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a415f930 0x7f73a40b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43402/0 (socket says 172.21.15.81:43402) 2024-09-16T01:22:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f73a3fff640 1 -- 172.21.15.81:0/3473753460 learned_addr learned my addr 172.21.15.81:0/3473753460 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f73a37fe640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73a409af70 0x7f73a41589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f739bfff640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73a40cdcd0 0x7f73a406d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f73a3fff640 1 -- 172.21.15.81:0/3473753460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73a40cdcd0 msgr2=0x7f73a406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.122+0000 7f73a3fff640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73a40cdcd0 0x7f73a406d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.123+0000 7f73a3fff640 1 -- 172.21.15.81:0/3473753460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73a409af70 msgr2=0x7f73a41589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.123+0000 7f73a3fff640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73a409af70 0x7f73a41589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.123+0000 7f73a3fff640 1 -- 172.21.15.81:0/3473753460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a4158f20 con 0x7f73a415f930 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.123+0000 7f739bfff640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73a40cdcd0 0x7f73a406d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.123+0000 7f73a3fff640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a415f930 0x7f73a40b2760 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f739c00efc0 tx=0x7f739c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.123+0000 7f73a0ff9640 1 -- 172.21.15.81:0/3473753460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c018020 con 0x7f73a415f930 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.123+0000 7f73a0ff9640 1 -- 172.21.15.81:0/3473753460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739c014480 con 0x7f73a415f930 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.123+0000 7f73a9e53640 1 -- 172.21.15.81:0/3473753460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a40b5d50 con 0x7f73a415f930 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.123+0000 7f73a0ff9640 1 -- 172.21.15.81:0/3473753460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c014870 con 0x7f73a415f930 2024-09-16T01:22:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.123+0000 7f73a9e53640 1 -- 172.21.15.81:0/3473753460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a40b6310 con 0x7f73a415f930 2024-09-16T01:22:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.124+0000 7f73a9e53640 1 -- 172.21.15.81:0/3473753460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a40ce160 con 0x7f73a415f930 2024-09-16T01:22:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.124+0000 7f73a0ff9640 1 -- 172.21.15.81:0/3473753460 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f739c005d10 con 0x7f73a415f930 2024-09-16T01:22:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.125+0000 7f73a0ff9640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f738406c2b0 0x7f738406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.125+0000 7f73a37fe640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f738406c2b0 0x7f738406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.125+0000 7f73a0ff9640 1 -- 172.21.15.81:0/3473753460 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f739c08bda0 con 0x7f73a415f930 2024-09-16T01:22:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.125+0000 7f73a37fe640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f738406c2b0 0x7f738406e770 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7394034000 tx=0x7f739402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:33.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.129+0000 7f73a0ff9640 1 -- 172.21.15.81:0/3473753460 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f739c022070 con 0x7f73a415f930 2024-09-16T01:22:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.357+0000 7f73a9e53640 1 -- 172.21.15.81:0/3473753460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]} v 0) -- 0x7f73a40cf910 con 0x7f73a415f930 2024-09-16T01:22:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.424+0000 7f73a0ff9640 1 -- 172.21.15.81:0/3473753460 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]}]=0 v347) ==== 154+0+0 (secure 0 0 0) 0x7f73a4158f20 con 0x7f73a415f930 2024-09-16T01:22:33.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.426+0000 7f73a9e53640 1 -- 172.21.15.81:0/3473753460 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f738406c2b0 msgr2=0x7f738406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.426+0000 7f73a9e53640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f738406c2b0 0x7f738406e770 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7394034000 tx=0x7f739402e000 comp rx=0 tx=0).stop 2024-09-16T01:22:33.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.426+0000 7f73a9e53640 1 -- 172.21.15.81:0/3473753460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a415f930 msgr2=0x7f73a40b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.426+0000 7f73a9e53640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a415f930 0x7f73a40b2760 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f739c00efc0 tx=0x7f739c00c490 comp rx=0 tx=0).stop 2024-09-16T01:22:33.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.426+0000 7f73a9e53640 1 -- 172.21.15.81:0/3473753460 shutdown_connections 2024-09-16T01:22:33.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.426+0000 7f73a9e53640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f738406c2b0 0x7f738406e770 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.426+0000 7f73a9e53640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73a415f930 0x7f73a40b2760 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.426+0000 7f73a9e53640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73a40cdcd0 0x7f73a406d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.426+0000 7f73a9e53640 1 --2- 172.21.15.81:0/3473753460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73a409af70 0x7f73a41589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.426+0000 7f73a9e53640 1 -- 172.21.15.81:0/3473753460 >> 172.21.15.81:0/3473753460 conn(0x7f73a40b3e40 msgr2=0x7f73a40afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:33.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.427+0000 7f73a9e53640 1 -- 172.21.15.81:0/3473753460 shutdown_connections 2024-09-16T01:22:33.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.427+0000 7f73a9e53640 1 -- 172.21.15.81:0/3473753460 wait complete. 2024-09-16T01:22:33.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T01:22:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.538+0000 7fd18fbf6640 1 Processor -- start 2024-09-16T01:22:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.538+0000 7fd18fbf6640 1 -- start start 2024-09-16T01:22:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.539+0000 7fd18fbf6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd18815b410 0x7fd188072050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.539+0000 7fd18fbf6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd18815b7f0 0x7fd188072590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.539+0000 7fd18fbf6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1880cdfd0 0x7fd1880ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.539+0000 7fd18fbf6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd1880ce9c0 con 0x7fd18815b410 2024-09-16T01:22:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.539+0000 7fd18fbf6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd1880cec90 con 0x7fd18815b7f0 2024-09-16T01:22:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.539+0000 7fd18fbf6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd1880cef70 con 0x7fd1880cdfd0 2024-09-16T01:22:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.539+0000 7fd18d992640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd18815b410 0x7fd188072050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.539+0000 7fd18d992640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd18815b410 0x7fd188072050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43410/0 (socket says 172.21.15.81:43410) 2024-09-16T01:22:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.539+0000 7fd18d992640 1 -- 172.21.15.81:0/1185793316 learned_addr learned my addr 172.21.15.81:0/1185793316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.540+0000 7fd18d992640 1 -- 172.21.15.81:0/1185793316 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1880cdfd0 msgr2=0x7fd1880ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.540+0000 7fd18d992640 1 --2- 172.21.15.81:0/1185793316 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1880cdfd0 0x7fd1880ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.540+0000 7fd18d992640 1 -- 172.21.15.81:0/1185793316 >> v2:172.21.15.102:3300/0 conn(0x7fd18815b7f0 msgr2=0x7fd188072590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.540+0000 7fd18d992640 1 --2- 172.21.15.81:0/1185793316 >> v2:172.21.15.102:3300/0 conn(0x7fd18815b7f0 0x7fd188072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.540+0000 7fd18d992640 1 -- 172.21.15.81:0/1185793316 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1880cf250 con 0x7fd18815b410 2024-09-16T01:22:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.540+0000 7fd18d992640 1 --2- 172.21.15.81:0/1185793316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18815b410 0x7fd188072050 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd18815c850 tx=0x7fd18402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7983127b3291b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.540+0000 7fd18c990640 1 -- 172.21.15.81:0/1185793316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184037070 con 0x7fd18815b410 2024-09-16T01:22:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.540+0000 7fd18c990640 1 -- 172.21.15.81:0/1185793316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd184032440 con 0x7fd18815b410 2024-09-16T01:22:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.540+0000 7fd18c990640 1 -- 172.21.15.81:0/1185793316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184032810 con 0x7fd18815b410 2024-09-16T01:22:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.541+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1185793316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18815b410 msgr2=0x7fd188072050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.541+0000 7fd18fbf6640 1 --2- 172.21.15.81:0/1185793316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18815b410 0x7fd188072050 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fd18815c850 tx=0x7fd18402a140 comp rx=0 tx=0).stop 2024-09-16T01:22:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.541+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1185793316 shutdown_connections 2024-09-16T01:22:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.541+0000 7fd18fbf6640 1 --2- 172.21.15.81:0/1185793316 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1880cdfd0 0x7fd1880ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.541+0000 7fd18fbf6640 1 --2- 172.21.15.81:0/1185793316 >> v2:172.21.15.102:3300/0 conn(0x7fd18815b7f0 0x7fd188072590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.541+0000 7fd18fbf6640 1 --2- 172.21.15.81:0/1185793316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18815b410 0x7fd188072050 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.541+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1185793316 >> 172.21.15.81:0/1185793316 conn(0x7fd18806bdf0 msgr2=0x7fd18806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.541+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1185793316 shutdown_connections 2024-09-16T01:22:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.541+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1185793316 wait complete. 2024-09-16T01:22:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.542+0000 7fd18fbf6640 1 Processor -- start 2024-09-16T01:22:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.542+0000 7fd18fbf6640 1 -- start start 2024-09-16T01:22:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18fbf6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1880cdfd0 0x7fd1880c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18fbf6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18815b410 0x7fd1880c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18fbf6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18815b7f0 0x7fd18814f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18fbf6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd18815ed80 con 0x7fd18815b7f0 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18fbf6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd1880cf810 con 0x7fd1880cdfd0 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18fbf6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd18815ef00 con 0x7fd18815b410 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18e193640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18815b7f0 0x7fd18814f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18e193640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18815b7f0 0x7fd18814f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43412/0 (socket says 172.21.15.81:43412) 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18e193640 1 -- 172.21.15.81:0/1653621823 learned_addr learned my addr 172.21.15.81:0/1653621823 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18d992640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1880cdfd0 0x7fd1880c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18d191640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18815b410 0x7fd1880c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18e193640 1 -- 172.21.15.81:0/1653621823 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18815b410 msgr2=0x7fd1880c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18e193640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18815b410 0x7fd1880c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18e193640 1 -- 172.21.15.81:0/1653621823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1880cdfd0 msgr2=0x7fd1880c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18e193640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1880cdfd0 0x7fd1880c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18e193640 1 -- 172.21.15.81:0/1653621823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1880ca1d0 con 0x7fd18815b7f0 2024-09-16T01:22:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.543+0000 7fd18d191640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18815b410 0x7fd1880c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.544+0000 7fd18e193640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18815b7f0 0x7fd18814f840 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fd18000b9a0 tx=0x7fd18000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.544+0000 7fd17e7fc640 1 -- 172.21.15.81:0/1653621823 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180019070 con 0x7fd18815b7f0 2024-09-16T01:22:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.544+0000 7fd17e7fc640 1 -- 172.21.15.81:0/1653621823 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd18000cbc0 con 0x7fd18815b7f0 2024-09-16T01:22:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.544+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1653621823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1880ca4b0 con 0x7fd18815b7f0 2024-09-16T01:22:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.544+0000 7fd17e7fc640 1 -- 172.21.15.81:0/1653621823 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180014440 con 0x7fd18815b7f0 2024-09-16T01:22:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.544+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1653621823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1880caa70 con 0x7fd18815b7f0 2024-09-16T01:22:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.545+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1653621823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1880cac70 con 0x7fd18815b7f0 2024-09-16T01:22:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.545+0000 7fd17e7fc640 1 -- 172.21.15.81:0/1653621823 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd18001c070 con 0x7fd18815b7f0 2024-09-16T01:22:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.546+0000 7fd17e7fc640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd16c06c2e0 0x7fd16c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.546+0000 7fd17e7fc640 1 -- 172.21.15.81:0/1653621823 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7fd18008aef0 con 0x7fd18815b7f0 2024-09-16T01:22:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.546+0000 7fd18d992640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd16c06c2e0 0x7fd16c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.546+0000 7fd18d992640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd16c06c2e0 0x7fd16c06e7a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd184034000 tx=0x7fd18402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:33.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.550+0000 7fd17e7fc640 1 -- 172.21.15.81:0/1653621823 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd180059180 con 0x7fd18815b7f0 2024-09-16T01:22:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.713+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1653621823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd1880ce480 con 0x7fd18815b7f0 2024-09-16T01:22:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.719+0000 7fd17e7fc640 1 -- 172.21.15.81:0/1653621823 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7fd18005d480 con 0x7fd18815b7f0 2024-09-16T01:22:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.721+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1653621823 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd16c06c2e0 msgr2=0x7fd16c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.721+0000 7fd18fbf6640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd16c06c2e0 0x7fd16c06e7a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd184034000 tx=0x7fd18402e000 comp rx=0 tx=0).stop 2024-09-16T01:22:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.721+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1653621823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18815b7f0 msgr2=0x7fd18814f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.721+0000 7fd18fbf6640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18815b7f0 0x7fd18814f840 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fd18000b9a0 tx=0x7fd18000be60 comp rx=0 tx=0).stop 2024-09-16T01:22:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.721+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1653621823 shutdown_connections 2024-09-16T01:22:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.721+0000 7fd18fbf6640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd16c06c2e0 0x7fd16c06e7a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.721+0000 7fd18fbf6640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd18815b7f0 0x7fd18814f840 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.721+0000 7fd18fbf6640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18815b410 0x7fd1880c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.721+0000 7fd18fbf6640 1 --2- 172.21.15.81:0/1653621823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1880cdfd0 0x7fd1880c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.721+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1653621823 >> 172.21.15.81:0/1653621823 conn(0x7fd18806bdf0 msgr2=0x7fd18815ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.721+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1653621823 shutdown_connections 2024-09-16T01:22:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:33.721+0000 7fd18fbf6640 1 -- 172.21.15.81:0/1653621823 wait complete. 2024-09-16T01:22:33.734 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:22:33.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:22:33.774 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:22:33.819 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:22:33.819 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:22:33.819 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:33.835 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:22:33.835 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:22:33.835 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:33.877 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:22:33.877 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:22:33.877 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:33.893 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:22:33.893 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:22:33.893 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:33.935 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:22:33.935 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T01:22:33.935 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.031+0000 7f3876677640 1 Processor -- start 2024-09-16T01:22:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.031+0000 7f3876677640 1 -- start start 2024-09-16T01:22:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.032+0000 7f3876677640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3870161c80 0x7f387006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.032+0000 7f3876677640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3870162060 0x7f38700b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.032+0000 7f3876677640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387006e870 con 0x7f38700b64b0 2024-09-16T01:22:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.032+0000 7f3876677640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f387006d9f0 con 0x7f3870161c80 2024-09-16T01:22:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.032+0000 7f3876677640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f387006dcd0 con 0x7f3870162060 2024-09-16T01:22:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.032+0000 7f386ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3870161c80 0x7f387006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.032+0000 7f386ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3870161c80 0x7f387006e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43420/0 (socket says 172.21.15.81:43420) 2024-09-16T01:22:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.032+0000 7f386ffff640 1 -- 172.21.15.81:0/3945445586 learned_addr learned my addr 172.21.15.81:0/3945445586 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.033+0000 7f386f7fe640 1 --2- 172.21.15.81:0/3945445586 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3870162060 0x7f38700b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.033+0000 7f386ffff640 1 -- 172.21.15.81:0/3945445586 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3870162060 msgr2=0x7f38700b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.033+0000 7f386ffff640 1 --2- 172.21.15.81:0/3945445586 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3870162060 0x7f38700b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.033+0000 7f386ffff640 1 -- 172.21.15.81:0/3945445586 >> v1:172.21.15.102:6789/0 conn(0x7f38700b64b0 legacy=0x7f3870162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.033+0000 7f386ffff640 1 -- 172.21.15.81:0/3945445586 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387006dfb0 con 0x7f3870161c80 2024-09-16T01:22:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.033+0000 7f386ffff640 1 --2- 172.21.15.81:0/3945445586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3870161c80 0x7f387006e330 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f3860009870 tx=0x7f386002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8014e84eb8eda11d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.034+0000 7f386effd640 1 -- 172.21.15.81:0/3945445586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860037070 con 0x7f3870161c80 2024-09-16T01:22:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.034+0000 7f386effd640 1 -- 172.21.15.81:0/3945445586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3860032440 con 0x7f3870161c80 2024-09-16T01:22:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.034+0000 7f386effd640 1 -- 172.21.15.81:0/3945445586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3860032810 con 0x7f3870161c80 2024-09-16T01:22:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.034+0000 7f3876677640 1 -- 172.21.15.81:0/3945445586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3870161c80 msgr2=0x7f387006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.034+0000 7f3876677640 1 --2- 172.21.15.81:0/3945445586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3870161c80 0x7f387006e330 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f3860009870 tx=0x7f386002a210 comp rx=0 tx=0).stop 2024-09-16T01:22:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.034+0000 7f3876677640 1 -- 172.21.15.81:0/3945445586 shutdown_connections 2024-09-16T01:22:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.034+0000 7f3876677640 1 --2- 172.21.15.81:0/3945445586 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3870162060 0x7f38700b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.034+0000 7f3876677640 1 --2- 172.21.15.81:0/3945445586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3870161c80 0x7f387006e330 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.034+0000 7f3876677640 1 -- 172.21.15.81:0/3945445586 >> 172.21.15.81:0/3945445586 conn(0x7f38700d44f0 msgr2=0x7f38700d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.034+0000 7f3876677640 1 -- 172.21.15.81:0/3945445586 shutdown_connections 2024-09-16T01:22:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.034+0000 7f3876677640 1 -- 172.21.15.81:0/3945445586 wait complete. 2024-09-16T01:22:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.035+0000 7f3876677640 1 Processor -- start 2024-09-16T01:22:34.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.036+0000 7f3876677640 1 -- start start 2024-09-16T01:22:34.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.036+0000 7f3876677640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38700b64b0 0x7f3870155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:34.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.036+0000 7f3876677640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3870161c80 0x7f38700ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:34.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.036+0000 7f3876677640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3870162060 0x7f38700cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:34.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.036+0000 7f3876677640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38700d2a10 con 0x7f3870162060 2024-09-16T01:22:34.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.036+0000 7f3876677640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f38700d2890 con 0x7f38700b64b0 2024-09-16T01:22:34.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.036+0000 7f3876677640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f38700b6960 con 0x7f3870161c80 2024-09-16T01:22:34.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.036+0000 7f3874c14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3870162060 0x7f38700cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:34.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.036+0000 7f3874c14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3870162060 0x7f38700cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43426/0 (socket says 172.21.15.81:43426) 2024-09-16T01:22:34.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.036+0000 7f3874c14640 1 -- 172.21.15.81:0/4178328257 learned_addr learned my addr 172.21.15.81:0/4178328257 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:34.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.036+0000 7f386f7fe640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3870161c80 0x7f38700ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:34.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.037+0000 7f386ffff640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38700b64b0 0x7f3870155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:34.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.037+0000 7f3874c14640 1 -- 172.21.15.81:0/4178328257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3870161c80 msgr2=0x7f38700ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:34.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.037+0000 7f3874c14640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3870161c80 0x7f38700ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.037+0000 7f3874c14640 1 -- 172.21.15.81:0/4178328257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38700b64b0 msgr2=0x7f3870155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:34.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.037+0000 7f3874c14640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38700b64b0 0x7f3870155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.037+0000 7f3874c14640 1 -- 172.21.15.81:0/4178328257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38700b3190 con 0x7f3870162060 2024-09-16T01:22:34.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.037+0000 7f3874c14640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3870162060 0x7f38700cbeb0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f386800c780 tx=0x7f386800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:34.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.037+0000 7f386cff9640 1 -- 172.21.15.81:0/4178328257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868004b60 con 0x7f3870162060 2024-09-16T01:22:34.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.037+0000 7f386cff9640 1 -- 172.21.15.81:0/4178328257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3868004d00 con 0x7f3870162060 2024-09-16T01:22:34.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.037+0000 7f3876677640 1 -- 172.21.15.81:0/4178328257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38700b3470 con 0x7f3870162060 2024-09-16T01:22:34.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.037+0000 7f386cff9640 1 -- 172.21.15.81:0/4178328257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386800aa90 con 0x7f3870162060 2024-09-16T01:22:34.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.037+0000 7f3876677640 1 -- 172.21.15.81:0/4178328257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38700b8380 con 0x7f3870162060 2024-09-16T01:22:34.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.038+0000 7f3876677640 1 -- 172.21.15.81:0/4178328257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38700b3640 con 0x7f3870162060 2024-09-16T01:22:34.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.038+0000 7f386cff9640 1 -- 172.21.15.81:0/4178328257 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f386800ac30 con 0x7f3870162060 2024-09-16T01:22:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.039+0000 7f386cff9640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f385c06c2b0 0x7f385c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.039+0000 7f386ffff640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f385c06c2b0 0x7f385c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.039+0000 7f386cff9640 1 -- 172.21.15.81:0/4178328257 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f386808b400 con 0x7f3870162060 2024-09-16T01:22:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.039+0000 7f386ffff640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f385c06c2b0 0x7f385c06e770 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3860034000 tx=0x7f386002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.043+0000 7f386cff9640 1 -- 172.21.15.81:0/4178328257 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3868020070 con 0x7f3870162060 2024-09-16T01:22:34.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.242+0000 7f3876677640 1 -- 172.21.15.81:0/4178328257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38700ba470 con 0x7f3870162060 2024-09-16T01:22:34.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.243+0000 7f386cff9640 1 -- 172.21.15.81:0/4178328257 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+3914 (secure 0 0 0) 0x7f3868059720 con 0x7f3870162060 2024-09-16T01:22:34.245 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:34.245 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":62,"btime":"2024-09-16T01:22:28:294889+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/665872000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":665872000},{"type":"v1","addr":"172.21.15.102:6835","nonce":665872000}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2485445274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2485445274},{"type":"v1","addr":"172.21.15.81:6835","nonce":2485445274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1320169323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1320169323},{"type":"v1","addr":"172.21.15.81:6837","nonce":1320169323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":7263,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/2539150967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2539150967},{"type":"v1","addr":"172.21.15.102:6834","nonce":2539150967}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[]} 2024-09-16T01:22:34.246 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 62 2024-09-16T01:22:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.245+0000 7f3876677640 1 -- 172.21.15.81:0/4178328257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f385c06c2b0 msgr2=0x7f385c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.245+0000 7f3876677640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f385c06c2b0 0x7f385c06e770 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f3860034000 tx=0x7f386002e000 comp rx=0 tx=0).stop 2024-09-16T01:22:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.245+0000 7f3876677640 1 -- 172.21.15.81:0/4178328257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3870162060 msgr2=0x7f38700cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.245+0000 7f3876677640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3870162060 0x7f38700cbeb0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f386800c780 tx=0x7f386800cc40 comp rx=0 tx=0).stop 2024-09-16T01:22:34.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.245+0000 7f3876677640 1 -- 172.21.15.81:0/4178328257 shutdown_connections 2024-09-16T01:22:34.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.245+0000 7f3876677640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f385c06c2b0 0x7f385c06e770 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.245+0000 7f3876677640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3870162060 0x7f38700cbeb0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.245+0000 7f3876677640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3870161c80 0x7f38700ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.245+0000 7f3876677640 1 --2- 172.21.15.81:0/4178328257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38700b64b0 0x7f3870155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.245+0000 7f3876677640 1 -- 172.21.15.81:0/4178328257 >> 172.21.15.81:0/4178328257 conn(0x7f38700d44f0 msgr2=0x7f38700cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:34.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.245+0000 7f3876677640 1 -- 172.21.15.81:0/4178328257 shutdown_connections 2024-09-16T01:22:34.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.245+0000 7f3876677640 1 -- 172.21.15.81:0/4178328257 wait complete. 2024-09-16T01:22:34.258 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:22:34.258 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T01:22:34.258 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:22:34.258 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:22:34.258 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:22:34.258 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T01:22:34.259 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:22:34.259 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:22:34.259 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:22:34.259 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T01:22:34.259 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:22:34.259 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:22:34.259 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:22:34.259 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T01:22:34.260 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:22:34.260 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:22:34.267 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:22:34.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:22:34.268 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:22:34.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:22:34.270 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:22:34.270 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:22:34.271 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:22:34.271 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:22:34.311 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:22:34.311 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:22:34.312 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:34.312 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:34.314 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:22:34.314 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:34.315 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:22:34.315 DEBUG:teuthology.parallel:result is None 2024-09-16T01:22:34.316 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T01:22:34.385 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:22:34.385 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:22:34.395 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:22:34.396 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-16T01:22:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.418+0000 7f6202e23640 1 Processor -- start 2024-09-16T01:22:34.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.418+0000 7f6202e23640 1 -- start start 2024-09-16T01:22:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.419+0000 7f6202e23640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f61fc161c80 0x7f61fc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.419+0000 7f6202e23640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61fc06e870 con 0x7f61fc0b6680 2024-09-16T01:22:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.419+0000 7f6202e23640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61fc06d9f0 con 0x7f61fc162060 2024-09-16T01:22:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.419+0000 7f6202e23640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f61fc06dcd0 con 0x7f61fc161c80 2024-09-16T01:22:34.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.419+0000 7f62013c0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f61fc0b6680 0x7f61fc0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42188/0 (socket says 172.21.15.81:42188) 2024-09-16T01:22:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.419+0000 7f62013c0640 1 -- 172.21.15.81:0/1822900786 learned_addr learned my addr 172.21.15.81:0/1822900786 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.419+0000 7f6200bbf640 1 --2- 172.21.15.81:0/1822900786 >> v2:172.21.15.102:3300/0 conn(0x7f61fc161c80 0x7f61fc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.419+0000 7f61fb7fe640 1 -- 172.21.15.81:0/1822900786 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911217179 0 0) 0x7f61f4001490 con 0x7f61fc0b6680 2024-09-16T01:22:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.419+0000 7f61fb7fe640 1 -- 172.21.15.81:0/1822900786 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61ec003520 con 0x7f61fc0b6680 2024-09-16T01:22:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.419+0000 7f6200bbf640 1 -- 172.21.15.81:0/1822900786 >> v1:172.21.15.102:6789/0 conn(0x7f61fc162060 legacy=0x7f61fc0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.419+0000 7f6200bbf640 1 -- 172.21.15.81:0/1822900786 >> v1:172.21.15.81:6789/0 conn(0x7f61fc0b6680 legacy=0x7f61fc0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:34.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.419+0000 7f6200bbf640 1 -- 172.21.15.81:0/1822900786 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc06dfb0 con 0x7f61fc161c80 2024-09-16T01:22:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.420+0000 7f6200bbf640 1 --2- 172.21.15.81:0/1822900786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc161c80 0x7f61fc06e330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f61f00097a0 tx=0x7f61f002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5da7912351b6856d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.420+0000 7f61fb7fe640 1 -- 172.21.15.81:0/1822900786 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0037070 con 0x7f61fc161c80 2024-09-16T01:22:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.420+0000 7f61fb7fe640 1 -- 172.21.15.81:0/1822900786 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f0032440 con 0x7f61fc161c80 2024-09-16T01:22:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.420+0000 7f61fb7fe640 1 -- 172.21.15.81:0/1822900786 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0032810 con 0x7f61fc161c80 2024-09-16T01:22:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.421+0000 7f6202e23640 1 -- 172.21.15.81:0/1822900786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc161c80 msgr2=0x7f61fc06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.421+0000 7f6202e23640 1 --2- 172.21.15.81:0/1822900786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc161c80 0x7f61fc06e330 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f61f00097a0 tx=0x7f61f002a230 comp rx=0 tx=0).stop 2024-09-16T01:22:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.421+0000 7f6202e23640 1 -- 172.21.15.81:0/1822900786 shutdown_connections 2024-09-16T01:22:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.421+0000 7f6202e23640 1 --2- 172.21.15.81:0/1822900786 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc161c80 0x7f61fc06e330 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.421+0000 7f6202e23640 1 -- 172.21.15.81:0/1822900786 >> 172.21.15.81:0/1822900786 conn(0x7f61fc0d44f0 msgr2=0x7f61fc0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:34.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.421+0000 7f6202e23640 1 -- 172.21.15.81:0/1822900786 shutdown_connections 2024-09-16T01:22:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.421+0000 7f6202e23640 1 -- 172.21.15.81:0/1822900786 wait complete. 2024-09-16T01:22:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.422+0000 7f6202e23640 1 Processor -- start 2024-09-16T01:22:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.422+0000 7f6202e23640 1 -- start start 2024-09-16T01:22:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f6202e23640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0b6680 0x7f61fc0b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f6202e23640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61fc161c80 0x7f61fc0b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f6202e23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc162060 0x7f61fc155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f6202e23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc0b6b30 con 0x7f61fc162060 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f6202e23640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc0d2aa0 con 0x7f61fc0b6680 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f6202e23640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f61fc0b6cb0 con 0x7f61fc161c80 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f62013c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc162060 0x7f61fc155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f62013c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc162060 0x7f61fc155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43466/0 (socket says 172.21.15.81:43466) 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f62013c0640 1 -- 172.21.15.81:0/861204257 learned_addr learned my addr 172.21.15.81:0/861204257 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f6200bbf640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0b6680 0x7f61fc0b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f61fbfff640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61fc161c80 0x7f61fc0b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f62013c0640 1 -- 172.21.15.81:0/861204257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61fc161c80 msgr2=0x7f61fc0b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f62013c0640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61fc161c80 0x7f61fc0b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f62013c0640 1 -- 172.21.15.81:0/861204257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0b6680 msgr2=0x7f61fc0b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:34.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f62013c0640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0b6680 0x7f61fc0b7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:34.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.423+0000 7f62013c0640 1 -- 172.21.15.81:0/861204257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc0b8d30 con 0x7f61fc162060 2024-09-16T01:22:34.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.424+0000 7f62013c0640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc162060 0x7f61fc155b30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f61f400cb40 tx=0x7f61f400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:34.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.424+0000 7f61f97fa640 1 -- 172.21.15.81:0/861204257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4017070 con 0x7f61fc162060 2024-09-16T01:22:34.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.424+0000 7f61f97fa640 1 -- 172.21.15.81:0/861204257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f400ac40 con 0x7f61fc162060 2024-09-16T01:22:34.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.424+0000 7f61f97fa640 1 -- 172.21.15.81:0/861204257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f4012400 con 0x7f61fc162060 2024-09-16T01:22:34.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.424+0000 7f6202e23640 1 -- 172.21.15.81:0/861204257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61fc0b9010 con 0x7f61fc162060 2024-09-16T01:22:34.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.424+0000 7f6202e23640 1 -- 172.21.15.81:0/861204257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61fc0b95d0 con 0x7f61fc162060 2024-09-16T01:22:34.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.425+0000 7f6202e23640 1 -- 172.21.15.81:0/861204257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61fc06e330 con 0x7f61fc162060 2024-09-16T01:22:34.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.425+0000 7f61f97fa640 1 -- 172.21.15.81:0/861204257 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f61f401a070 con 0x7f61fc162060 2024-09-16T01:22:34.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.426+0000 7f61f97fa640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61e006c2b0 0x7f61e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:34.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.426+0000 7f61f97fa640 1 -- 172.21.15.81:0/861204257 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5335+0+0 (secure 0 0 0) 0x7f61f408b030 con 0x7f61fc162060 2024-09-16T01:22:34.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.426+0000 7f6200bbf640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61e006c2b0 0x7f61e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:34.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.426+0000 7f6200bbf640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61e006c2b0 0x7f61e006e770 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f61f0034000 tx=0x7f61f002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:34.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.435+0000 7f61f97fa640 1 -- 172.21.15.81:0/861204257 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61fc06e870 con 0x7f61fc162060 2024-09-16T01:22:34.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:34.614+0000 7f6202e23640 1 -- 172.21.15.81:0/861204257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f61fc0b97d0 con 0x7f61fc162060 2024-09-16T01:22:35.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.444+0000 7f61f97fa640 1 -- 172.21.15.81:0/861204257 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v121) ==== 97+0+0 (secure 0 0 0) 0x7f61f40592c0 con 0x7f61fc162060 2024-09-16T01:22:35.446 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-16T01:22:35.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.446+0000 7f6202e23640 1 -- 172.21.15.81:0/861204257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61e006c2b0 msgr2=0x7f61e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.446+0000 7f6202e23640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61e006c2b0 0x7f61e006e770 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f61f0034000 tx=0x7f61f002e000 comp rx=0 tx=0).stop 2024-09-16T01:22:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.446+0000 7f6202e23640 1 -- 172.21.15.81:0/861204257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc162060 msgr2=0x7f61fc155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.446+0000 7f6202e23640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc162060 0x7f61fc155b30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f61f400cb40 tx=0x7f61f400a060 comp rx=0 tx=0).stop 2024-09-16T01:22:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.447+0000 7f6202e23640 1 -- 172.21.15.81:0/861204257 shutdown_connections 2024-09-16T01:22:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.447+0000 7f6202e23640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61e006c2b0 0x7f61e006e770 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.447+0000 7f6202e23640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc162060 0x7f61fc155b30 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.447+0000 7f6202e23640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61fc161c80 0x7f61fc0b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.447+0000 7f6202e23640 1 --2- 172.21.15.81:0/861204257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61fc0b6680 0x7f61fc0b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.447+0000 7f6202e23640 1 -- 172.21.15.81:0/861204257 >> 172.21.15.81:0/861204257 conn(0x7f61fc0d44f0 msgr2=0x7f61fc06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.447+0000 7f6202e23640 1 -- 172.21.15.81:0/861204257 shutdown_connections 2024-09-16T01:22:35.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.447+0000 7f6202e23640 1 -- 172.21.15.81:0/861204257 wait complete. 2024-09-16T01:22:35.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T01:22:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.561+0000 7fb766bb9640 1 Processor -- start 2024-09-16T01:22:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.561+0000 7fb766bb9640 1 -- start start 2024-09-16T01:22:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb766bb9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb76015e740 0x7fb7600d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb766bb9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb76009b690 0x7fb76006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb766bb9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76006e020 con 0x7fb76006d4c0 2024-09-16T01:22:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb766bb9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb76015eb20 con 0x7fb76009b690 2024-09-16T01:22:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb766bb9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb76006d260 con 0x7fb76015e740 2024-09-16T01:22:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb757fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb76009b690 0x7fb76006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb757fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb76009b690 0x7fb76006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:35772/0 (socket says 172.21.15.81:35772) 2024-09-16T01:22:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb757fff640 1 -- 172.21.15.81:0/1925366233 learned_addr learned my addr 172.21.15.81:0/1925366233 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb764955640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb76015e740 0x7fb7600d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb757fff640 1 -- 172.21.15.81:0/1925366233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb76015e740 msgr2=0x7fb7600d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb757fff640 1 --2- 172.21.15.81:0/1925366233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb76015e740 0x7fb7600d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb757fff640 1 -- 172.21.15.81:0/1925366233 >> v1:172.21.15.102:6789/0 conn(0x7fb76006d4c0 legacy=0x7fb76006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.562+0000 7fb757fff640 1 -- 172.21.15.81:0/1925366233 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7600d0780 con 0x7fb76009b690 2024-09-16T01:22:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.563+0000 7fb757fff640 1 --2- 172.21.15.81:0/1925366233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76009b690 0x7fb76006cd20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb7500098a0 tx=0x7fb75002a320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de0cd2d03f991607 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.563+0000 7fb7577fe640 1 -- 172.21.15.81:0/1925366233 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750037070 con 0x7fb76009b690 2024-09-16T01:22:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.563+0000 7fb7577fe640 1 -- 172.21.15.81:0/1925366233 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb750032640 con 0x7fb76009b690 2024-09-16T01:22:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.563+0000 7fb7577fe640 1 -- 172.21.15.81:0/1925366233 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb750032a10 con 0x7fb76009b690 2024-09-16T01:22:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.564+0000 7fb766bb9640 1 -- 172.21.15.81:0/1925366233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76009b690 msgr2=0x7fb76006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.564+0000 7fb766bb9640 1 --2- 172.21.15.81:0/1925366233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76009b690 0x7fb76006cd20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb7500098a0 tx=0x7fb75002a320 comp rx=0 tx=0).stop 2024-09-16T01:22:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.564+0000 7fb766bb9640 1 -- 172.21.15.81:0/1925366233 shutdown_connections 2024-09-16T01:22:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.564+0000 7fb766bb9640 1 --2- 172.21.15.81:0/1925366233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76009b690 0x7fb76006cd20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.564+0000 7fb766bb9640 1 --2- 172.21.15.81:0/1925366233 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb76015e740 0x7fb7600d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.564+0000 7fb766bb9640 1 -- 172.21.15.81:0/1925366233 >> 172.21.15.81:0/1925366233 conn(0x7fb7600d23a0 msgr2=0x7fb7600d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.564+0000 7fb766bb9640 1 -- 172.21.15.81:0/1925366233 shutdown_connections 2024-09-16T01:22:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.564+0000 7fb766bb9640 1 -- 172.21.15.81:0/1925366233 wait complete. 2024-09-16T01:22:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.565+0000 7fb766bb9640 1 Processor -- start 2024-09-16T01:22:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.565+0000 7fb766bb9640 1 -- start start 2024-09-16T01:22:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb766bb9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76006d4c0 0x7fb7600b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb766bb9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb76009b690 0x7fb76009cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb766bb9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb76015e740 0x7fb7601f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb766bb9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7600d1020 con 0x7fb76015e740 2024-09-16T01:22:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb766bb9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb7600d0d40 con 0x7fb76006d4c0 2024-09-16T01:22:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb766bb9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb76009ba90 con 0x7fb76009b690 2024-09-16T01:22:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb765156640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb76015e740 0x7fb7601f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb765156640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb76015e740 0x7fb7601f7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43472/0 (socket says 172.21.15.81:43472) 2024-09-16T01:22:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb765156640 1 -- 172.21.15.81:0/4072811083 learned_addr learned my addr 172.21.15.81:0/4072811083 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb757fff640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb76009b690 0x7fb76009cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb764955640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76006d4c0 0x7fb7600b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb765156640 1 -- 172.21.15.81:0/4072811083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb76009b690 msgr2=0x7fb76009cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb765156640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb76009b690 0x7fb76009cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb765156640 1 -- 172.21.15.81:0/4072811083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76006d4c0 msgr2=0x7fb7600b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb765156640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76006d4c0 0x7fb7600b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.566+0000 7fb765156640 1 -- 172.21.15.81:0/4072811083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7600b7fb0 con 0x7fb76015e740 2024-09-16T01:22:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.567+0000 7fb765156640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb76015e740 0x7fb7601f7d00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c6b0 tx=0x7fb75800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.567+0000 7fb7557fa640 1 -- 172.21.15.81:0/4072811083 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758003b70 con 0x7fb76015e740 2024-09-16T01:22:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.567+0000 7fb7557fa640 1 -- 172.21.15.81:0/4072811083 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb758003d30 con 0x7fb76015e740 2024-09-16T01:22:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.567+0000 7fb7557fa640 1 -- 172.21.15.81:0/4072811083 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758005310 con 0x7fb76015e740 2024-09-16T01:22:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.567+0000 7fb766bb9640 1 -- 172.21.15.81:0/4072811083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7600ca840 con 0x7fb76015e740 2024-09-16T01:22:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.567+0000 7fb766bb9640 1 -- 172.21.15.81:0/4072811083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7600caae0 con 0x7fb76015e740 2024-09-16T01:22:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.568+0000 7fb766bb9640 1 -- 172.21.15.81:0/4072811083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb76006cd20 con 0x7fb76015e740 2024-09-16T01:22:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.568+0000 7fb7557fa640 1 -- 172.21.15.81:0/4072811083 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb7580054b0 con 0x7fb76015e740 2024-09-16T01:22:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.569+0000 7fb7557fa640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb74c06c2b0 0x7fb74c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.569+0000 7fb764955640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb74c06c2b0 0x7fb74c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.569+0000 7fb7557fa640 1 -- 172.21.15.81:0/4072811083 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5249+0+0 (secure 0 0 0) 0x7fb75808b090 con 0x7fb76015e740 2024-09-16T01:22:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.569+0000 7fb764955640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb74c06c2b0 0x7fb74c06e770 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb7600b5260 tx=0x7fb75c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.573+0000 7fb7557fa640 1 -- 172.21.15.81:0/4072811083 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb758059a50 con 0x7fb76015e740 2024-09-16T01:22:35.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.803+0000 7fb766bb9640 1 -- 172.21.15.81:0/4072811083 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb7600d1cb0 con 0x7fb76015e740 2024-09-16T01:22:35.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.803+0000 7fb7557fa640 1 -- 172.21.15.81:0/4072811083 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7fb758059350 con 0x7fb76015e740 2024-09-16T01:22:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:35.805 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:22:35.805 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmx4OgCRAAkmpWDpuwqbDuz0taNg8bag==", 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-16T01:22:35.806 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmSNpLFRAAzc9Sr8b65zH9VZFYvqsYpA==", 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmcCavEBAA0CuddD0zPcjqrMSOD5c6OA==", 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:22:35.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmVeRcHBAANIL7HFYSc43qv7Zg0llkYQ==", 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.808 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDhudmUtTqORAAkZKChid+qoa+0nIgpuun7g==", 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-16T01:22:35.809 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCHhudmUhtiABAA2vDoACv8RJ2KD9p1cdKClA==", 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCKhudmhOmRHxAAbGjJkUZLras/b6omekdz7A==", 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCNhudmA+csIRAAW1kenpimaWIak/qgG+UeXw==", 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-16T01:22:35.811 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCThudmvgQBLxAAWLto5pG0iyiQPSnxldWYwg==", 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCXhudmKfyiIhAALbJHvDeQtVgSCKjD1X3OYg==", 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:22:35.812 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCahudmPG/9JBAA6d/gK0K/5c9Gp4uKOLCCOw==", 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-16T01:22:35.813 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCdhudmVdY3NhAAXlOaeE0XidHVCaeQrirBAg==", 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg==", 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T01:22:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmMgEhKRAAUD2kJ9eOFJscZ6ATlO5PmQ==", 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.815 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmwfD5JRAAPhdVLFZD07Uy75g3zStblg==", 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudm8/qzLhAAVFRbGhXH00h2LS9ZC9rraA==", 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:22:35.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/hudmBWr2KRAA/hELsRHNpxj3KqJbOSY74g==", 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmRdtyBhAAMQngXCuTHg6AjACCw/SmCg==", 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmqULCAhAAMbYmGXWGiINwif20O1JG3g==", 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:22:35.818 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:22:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:22:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:22:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:35.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-16T01:22:35.819 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:22:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.805+0000 7fb766bb9640 1 -- 172.21.15.81:0/4072811083 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb74c06c2b0 msgr2=0x7fb74c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.806+0000 7fb766bb9640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb74c06c2b0 0x7fb74c06e770 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb7600b5260 tx=0x7fb75c008040 comp rx=0 tx=0).stop 2024-09-16T01:22:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.806+0000 7fb766bb9640 1 -- 172.21.15.81:0/4072811083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb76015e740 msgr2=0x7fb7601f7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.806+0000 7fb766bb9640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb76015e740 0x7fb7601f7d00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c6b0 tx=0x7fb75800cb70 comp rx=0 tx=0).stop 2024-09-16T01:22:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.806+0000 7fb766bb9640 1 -- 172.21.15.81:0/4072811083 shutdown_connections 2024-09-16T01:22:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.806+0000 7fb766bb9640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb74c06c2b0 0x7fb74c06e770 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.806+0000 7fb766bb9640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb76015e740 0x7fb7601f7d00 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.806+0000 7fb766bb9640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb76009b690 0x7fb76009cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.806+0000 7fb766bb9640 1 --2- 172.21.15.81:0/4072811083 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76006d4c0 0x7fb7600b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.806+0000 7fb766bb9640 1 -- 172.21.15.81:0/4072811083 >> 172.21.15.81:0/4072811083 conn(0x7fb7600d23a0 msgr2=0x7fb7600b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.806+0000 7fb766bb9640 1 -- 172.21.15.81:0/4072811083 shutdown_connections 2024-09-16T01:22:35.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.806+0000 7fb766bb9640 1 -- 172.21.15.81:0/4072811083 wait complete. 2024-09-16T01:22:35.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:22:35.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.918+0000 7f1c47166640 1 Processor -- start 2024-09-16T01:22:35.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.919+0000 7f1c47166640 1 -- start start 2024-09-16T01:22:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.919+0000 7f1c47166640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4015fc30 0x7f1c40071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.919+0000 7f1c47166640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c400b17d0 0x7f1c4009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.919+0000 7f1c47166640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c4009af70 0x7f1c400d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.919+0000 7f1c47166640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1c400b1590 con 0x7f1c400b17d0 2024-09-16T01:22:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.919+0000 7f1c47166640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1c40160ab0 con 0x7f1c4009af70 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.919+0000 7f1c47166640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1c40160fe0 con 0x7f1c4015fc30 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.919+0000 7f1c3ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c400b17d0 0x7f1c4009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.920+0000 7f1c3ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1c400b17d0 0x7f1c4009aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43478/0 (socket says 172.21.15.81:43478) 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.920+0000 7f1c3ffff640 1 -- 172.21.15.81:0/1024535919 learned_addr learned my addr 172.21.15.81:0/1024535919 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.920+0000 7f1c45703640 1 --2- 172.21.15.81:0/1024535919 >> v2:172.21.15.102:3300/0 conn(0x7f1c4009af70 0x7f1c400d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.920+0000 7f1c44f02640 1 --2- 172.21.15.81:0/1024535919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4015fc30 0x7f1c40071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.920+0000 7f1c3ffff640 1 -- 172.21.15.81:0/1024535919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4015fc30 msgr2=0x7f1c40071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.920+0000 7f1c3ffff640 1 --2- 172.21.15.81:0/1024535919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4015fc30 0x7f1c40071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.920+0000 7f1c3ffff640 1 -- 172.21.15.81:0/1024535919 >> v2:172.21.15.102:3300/0 conn(0x7f1c4009af70 msgr2=0x7f1c400d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.920+0000 7f1c3ffff640 1 --2- 172.21.15.81:0/1024535919 >> v2:172.21.15.102:3300/0 conn(0x7f1c4009af70 0x7f1c400d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.920+0000 7f1c3ffff640 1 -- 172.21.15.81:0/1024535919 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4009ba30 con 0x7f1c400b17d0 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.920+0000 7f1c44f02640 1 --2- 172.21.15.81:0/1024535919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4015fc30 0x7f1c40071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.920+0000 7f1c3ffff640 1 --2- 172.21.15.81:0/1024535919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c400b17d0 0x7f1c4009aa30 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f1c400b1210 tx=0x7f1c3402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360a1d574bf0fc86 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.921+0000 7f1c3f7fe640 1 -- 172.21.15.81:0/1024535919 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c34036070 con 0x7f1c400b17d0 2024-09-16T01:22:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.921+0000 7f1c3f7fe640 1 -- 172.21.15.81:0/1024535919 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c34031600 con 0x7f1c400b17d0 2024-09-16T01:22:35.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.921+0000 7f1c3f7fe640 1 -- 172.21.15.81:0/1024535919 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c340319d0 con 0x7f1c400b17d0 2024-09-16T01:22:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.921+0000 7f1c47166640 1 -- 172.21.15.81:0/1024535919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c400b17d0 msgr2=0x7f1c4009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.921+0000 7f1c47166640 1 --2- 172.21.15.81:0/1024535919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c400b17d0 0x7f1c4009aa30 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f1c400b1210 tx=0x7f1c3402a610 comp rx=0 tx=0).stop 2024-09-16T01:22:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.921+0000 7f1c47166640 1 -- 172.21.15.81:0/1024535919 shutdown_connections 2024-09-16T01:22:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.921+0000 7f1c47166640 1 --2- 172.21.15.81:0/1024535919 >> v2:172.21.15.102:3300/0 conn(0x7f1c4009af70 0x7f1c400d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.921+0000 7f1c47166640 1 --2- 172.21.15.81:0/1024535919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c400b17d0 0x7f1c4009aa30 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.921+0000 7f1c47166640 1 --2- 172.21.15.81:0/1024535919 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c4015fc30 0x7f1c40071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.921+0000 7f1c47166640 1 -- 172.21.15.81:0/1024535919 >> 172.21.15.81:0/1024535919 conn(0x7f1c400d23a0 msgr2=0x7f1c400d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.921+0000 7f1c47166640 1 -- 172.21.15.81:0/1024535919 shutdown_connections 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.921+0000 7f1c47166640 1 -- 172.21.15.81:0/1024535919 wait complete. 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.922+0000 7f1c47166640 1 Processor -- start 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.922+0000 7f1c47166640 1 -- start start 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.923+0000 7f1c47166640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4009af70 0x7f1c4014c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.923+0000 7f1c47166640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c400b17d0 0x7f1c4014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.923+0000 7f1c47166640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4015fc30 0x7f1c401f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.923+0000 7f1c47166640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1c40160d00 con 0x7f1c4015fc30 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.923+0000 7f1c47166640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1c400b1bd0 con 0x7f1c4009af70 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.923+0000 7f1c47166640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1c400d0850 con 0x7f1c400b17d0 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.923+0000 7f1c45703640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4015fc30 0x7f1c401f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.923+0000 7f1c45703640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4015fc30 0x7f1c401f5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43480/0 (socket says 172.21.15.81:43480) 2024-09-16T01:22:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.923+0000 7f1c45703640 1 -- 172.21.15.81:0/1380289814 learned_addr learned my addr 172.21.15.81:0/1380289814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.923+0000 7f1c44f02640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4009af70 0x7f1c4014c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.924+0000 7f1c3ffff640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c400b17d0 0x7f1c4014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.924+0000 7f1c45703640 1 -- 172.21.15.81:0/1380289814 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c400b17d0 msgr2=0x7f1c4014ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.924+0000 7f1c45703640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c400b17d0 0x7f1c4014ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.924+0000 7f1c45703640 1 -- 172.21.15.81:0/1380289814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4009af70 msgr2=0x7f1c4014c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.924+0000 7f1c45703640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4009af70 0x7f1c4014c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.924+0000 7f1c45703640 1 -- 172.21.15.81:0/1380289814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c401f6e30 con 0x7f1c4015fc30 2024-09-16T01:22:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.924+0000 7f1c45703640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4015fc30 0x7f1c401f5fe0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800e860 tx=0x7f1c3800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.924+0000 7f1c3d7fa640 1 -- 172.21.15.81:0/1380289814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38017070 con 0x7f1c4015fc30 2024-09-16T01:22:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.924+0000 7f1c3d7fa640 1 -- 172.21.15.81:0/1380289814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c3800c940 con 0x7f1c4015fc30 2024-09-16T01:22:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.924+0000 7f1c3d7fa640 1 -- 172.21.15.81:0/1380289814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3800cd30 con 0x7f1c4015fc30 2024-09-16T01:22:35.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.924+0000 7f1c47166640 1 -- 172.21.15.81:0/1380289814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c401f6b50 con 0x7f1c4015fc30 2024-09-16T01:22:35.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.924+0000 7f1c47166640 1 -- 172.21.15.81:0/1380289814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c4014bb00 con 0x7f1c4015fc30 2024-09-16T01:22:35.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.925+0000 7f1c47166640 1 -- 172.21.15.81:0/1380289814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4009aa30 con 0x7f1c4015fc30 2024-09-16T01:22:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.925+0000 7f1c3d7fa640 1 -- 172.21.15.81:0/1380289814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1c3801a070 con 0x7f1c4015fc30 2024-09-16T01:22:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.926+0000 7f1c3d7fa640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c2c06c2b0 0x7f1c2c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.926+0000 7f1c3d7fa640 1 -- 172.21.15.81:0/1380289814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5249+0+0 (secure 0 0 0) 0x7f1c3808b180 con 0x7f1c4015fc30 2024-09-16T01:22:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.926+0000 7f1c44f02640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c2c06c2b0 0x7f1c2c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.926+0000 7f1c44f02640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c2c06c2b0 0x7f1c2c06e770 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1c400b0b30 tx=0x7f1c30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:35.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:35.930+0000 7f1c3d7fa640 1 -- 172.21.15.81:0/1380289814 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c38059460 con 0x7f1c4015fc30 2024-09-16T01:22:36.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.100+0000 7f1c47166640 1 -- 172.21.15.81:0/1380289814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1c400d02a0 con 0x7f1c4015fc30 2024-09-16T01:22:36.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.100+0000 7f1c3d7fa640 1 -- 172.21.15.81:0/1380289814 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v121) ==== 84+0+65 (secure 0 0 0) 0x7f1c3805d760 con 0x7f1c4015fc30 2024-09-16T01:22:36.102 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:36.102 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-16T01:22:36.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:22:36.102 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-16T01:22:36.102 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-16T01:22:36.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:22:36.102 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-16T01:22:36.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.102+0000 7f1c47166640 1 -- 172.21.15.81:0/1380289814 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c2c06c2b0 msgr2=0x7f1c2c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.102+0000 7f1c47166640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c2c06c2b0 0x7f1c2c06e770 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1c400b0b30 tx=0x7f1c30008040 comp rx=0 tx=0).stop 2024-09-16T01:22:36.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.102+0000 7f1c47166640 1 -- 172.21.15.81:0/1380289814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4015fc30 msgr2=0x7f1c401f5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.102+0000 7f1c47166640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4015fc30 0x7f1c401f5fe0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800e860 tx=0x7f1c3800ed20 comp rx=0 tx=0).stop 2024-09-16T01:22:36.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.102+0000 7f1c47166640 1 -- 172.21.15.81:0/1380289814 shutdown_connections 2024-09-16T01:22:36.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.102+0000 7f1c47166640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1c2c06c2b0 0x7f1c2c06e770 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.102+0000 7f1c47166640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c4015fc30 0x7f1c401f5fe0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.102+0000 7f1c47166640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c400b17d0 0x7f1c4014ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.102+0000 7f1c47166640 1 --2- 172.21.15.81:0/1380289814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c4009af70 0x7f1c4014c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.102+0000 7f1c47166640 1 -- 172.21.15.81:0/1380289814 >> 172.21.15.81:0/1380289814 conn(0x7f1c400d23a0 msgr2=0x7f1c400ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:36.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.102+0000 7f1c47166640 1 -- 172.21.15.81:0/1380289814 shutdown_connections 2024-09-16T01:22:36.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.102+0000 7f1c47166640 1 -- 172.21.15.81:0/1380289814 wait complete. 2024-09-16T01:22:36.115 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:22:36.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:22:36.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.215+0000 7f13ff75f640 1 Processor -- start 2024-09-16T01:22:36.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.216+0000 7f13ff75f640 1 -- start start 2024-09-16T01:22:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.216+0000 7f13ff75f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13f815e410 0x7f13f80b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.216+0000 7f13ff75f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f13f806bc10 0x7f13f806c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.216+0000 7f13ff75f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13f80ae240 con 0x7f13f80b40c0 2024-09-16T01:22:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.216+0000 7f13ff75f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f13f806c580 con 0x7f13f806bc10 2024-09-16T01:22:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.216+0000 7f13ff75f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f13f80ae520 con 0x7f13f815e410 2024-09-16T01:22:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.217+0000 7f13fd4fb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13f815e410 0x7f13f80b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:36.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.217+0000 7f13fdcfc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f13f806bc10 0x7f13f806c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.217+0000 7f13fd4fb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13f815e410 0x7f13f80b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:40806/0 (socket says 172.21.15.81:40806) 2024-09-16T01:22:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.217+0000 7f13fd4fb640 1 -- 172.21.15.81:0/4074803135 learned_addr learned my addr 172.21.15.81:0/4074803135 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.217+0000 7f13fdcfc640 1 -- 172.21.15.81:0/4074803135 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13f815e410 msgr2=0x7f13f80b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.217+0000 7f13fdcfc640 1 --2- 172.21.15.81:0/4074803135 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13f815e410 0x7f13f80b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.217+0000 7f13fdcfc640 1 -- 172.21.15.81:0/4074803135 >> v1:172.21.15.102:6789/0 conn(0x7f13f80b40c0 legacy=0x7f13f80aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.217+0000 7f13fdcfc640 1 -- 172.21.15.81:0/4074803135 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f80ae800 con 0x7f13f806bc10 2024-09-16T01:22:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.217+0000 7f13fd4fb640 1 --2- 172.21.15.81:0/4074803135 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13f815e410 0x7f13f80b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.218+0000 7f13fdcfc640 1 --2- 172.21.15.81:0/4074803135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13f806bc10 0x7f13f806c040 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009d90 tx=0x7f13f002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc279ca0a89c77bb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.218+0000 7f13effff640 1 -- 172.21.15.81:0/4074803135 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0031600 con 0x7f13f806bc10 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.218+0000 7f13effff640 1 -- 172.21.15.81:0/4074803135 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f00317a0 con 0x7f13f806bc10 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.218+0000 7f13effff640 1 -- 172.21.15.81:0/4074803135 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0031b70 con 0x7f13f806bc10 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.219+0000 7f13ff75f640 1 -- 172.21.15.81:0/4074803135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13f806bc10 msgr2=0x7f13f806c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.219+0000 7f13ff75f640 1 --2- 172.21.15.81:0/4074803135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13f806bc10 0x7f13f806c040 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009d90 tx=0x7f13f002a5d0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.219+0000 7f13ff75f640 1 -- 172.21.15.81:0/4074803135 shutdown_connections 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.219+0000 7f13ff75f640 1 --2- 172.21.15.81:0/4074803135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13f806bc10 0x7f13f806c040 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.219+0000 7f13ff75f640 1 --2- 172.21.15.81:0/4074803135 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13f815e410 0x7f13f80b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.219+0000 7f13ff75f640 1 -- 172.21.15.81:0/4074803135 >> 172.21.15.81:0/4074803135 conn(0x7f13f809aa30 msgr2=0x7f13f80b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.219+0000 7f13ff75f640 1 -- 172.21.15.81:0/4074803135 shutdown_connections 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.219+0000 7f13ff75f640 1 -- 172.21.15.81:0/4074803135 wait complete. 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.220+0000 7f13ff75f640 1 Processor -- start 2024-09-16T01:22:36.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.220+0000 7f13ff75f640 1 -- start start 2024-09-16T01:22:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13ff75f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13f806bc10 0x7f13f814fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13ff75f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80b40c0 0x7f13f815cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:36.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13ff75f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13f815e410 0x7f13f8153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13ff75f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13f815e7f0 con 0x7f13f80b40c0 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13ff75f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f13f80b4510 con 0x7f13f815e410 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13ff75f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f13f815e970 con 0x7f13f806bc10 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13fccfa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80b40c0 0x7f13f815cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13fccfa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80b40c0 0x7f13f815cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43488/0 (socket says 172.21.15.81:43488) 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13fccfa640 1 -- 172.21.15.81:0/3609029221 learned_addr learned my addr 172.21.15.81:0/3609029221 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13fdcfc640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13f815e410 0x7f13f8153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13fd4fb640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13f806bc10 0x7f13f814fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13fccfa640 1 -- 172.21.15.81:0/3609029221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13f806bc10 msgr2=0x7f13f814fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13fccfa640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13f806bc10 0x7f13f814fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13fccfa640 1 -- 172.21.15.81:0/3609029221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13f815e410 msgr2=0x7f13f8153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13fccfa640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13f815e410 0x7f13f8153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13fccfa640 1 -- 172.21.15.81:0/3609029221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f815bb50 con 0x7f13f80b40c0 2024-09-16T01:22:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13fccfa640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80b40c0 0x7f13f815cbf0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f13e800c3f0 tx=0x7f13e800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13edffb640 1 -- 172.21.15.81:0/3609029221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e80052d0 con 0x7f13f80b40c0 2024-09-16T01:22:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13edffb640 1 -- 172.21.15.81:0/3609029221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e8005490 con 0x7f13f80b40c0 2024-09-16T01:22:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13ff75f640 1 -- 172.21.15.81:0/3609029221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f815be30 con 0x7f13f80b40c0 2024-09-16T01:22:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.221+0000 7f13edffb640 1 -- 172.21.15.81:0/3609029221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8007260 con 0x7f13f80b40c0 2024-09-16T01:22:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.222+0000 7f13ff75f640 1 -- 172.21.15.81:0/3609029221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f815c3f0 con 0x7f13f80b40c0 2024-09-16T01:22:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.222+0000 7f13ff75f640 1 -- 172.21.15.81:0/3609029221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f806c040 con 0x7f13f80b40c0 2024-09-16T01:22:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.223+0000 7f13edffb640 1 -- 172.21.15.81:0/3609029221 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f13e8007400 con 0x7f13f80b40c0 2024-09-16T01:22:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.223+0000 7f13edffb640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f13dc06c2b0 0x7f13dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.223+0000 7f13edffb640 1 -- 172.21.15.81:0/3609029221 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5249+0+0 (secure 0 0 0) 0x7f13e808a600 con 0x7f13f80b40c0 2024-09-16T01:22:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.223+0000 7f13fd4fb640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f13dc06c2b0 0x7f13dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.224+0000 7f13fd4fb640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f13dc06c2b0 0x7f13dc06e770 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f13f4006ca0 tx=0x7f13f4009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:36.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.228+0000 7f13edffb640 1 -- 172.21.15.81:0/3609029221 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f13e8058970 con 0x7f13f80b40c0 2024-09-16T01:22:36.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.393+0000 7f13ff75f640 1 -- 172.21.15.81:0/3609029221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f13f806f540 con 0x7f13f80b40c0 2024-09-16T01:22:36.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.448+0000 7f13edffb640 1 -- 172.21.15.81:0/3609029221 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v122) ==== 138+0+0 (secure 0 0 0) 0x7f13e805cc70 con 0x7f13f80b40c0 2024-09-16T01:22:36.450 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-16T01:22:36.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.450+0000 7f13ff75f640 1 -- 172.21.15.81:0/3609029221 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f13dc06c2b0 msgr2=0x7f13dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.450+0000 7f13ff75f640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f13dc06c2b0 0x7f13dc06e770 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f13f4006ca0 tx=0x7f13f4009240 comp rx=0 tx=0).stop 2024-09-16T01:22:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.450+0000 7f13ff75f640 1 -- 172.21.15.81:0/3609029221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80b40c0 msgr2=0x7f13f815cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.450+0000 7f13ff75f640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80b40c0 0x7f13f815cbf0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f13e800c3f0 tx=0x7f13e800c8b0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.450+0000 7f13ff75f640 1 -- 172.21.15.81:0/3609029221 shutdown_connections 2024-09-16T01:22:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.450+0000 7f13ff75f640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f13dc06c2b0 0x7f13dc06e770 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.450+0000 7f13ff75f640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13f815e410 0x7f13f8153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.450+0000 7f13ff75f640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80b40c0 0x7f13f815cbf0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.450+0000 7f13ff75f640 1 --2- 172.21.15.81:0/3609029221 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13f806bc10 0x7f13f814fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.450+0000 7f13ff75f640 1 -- 172.21.15.81:0/3609029221 >> 172.21.15.81:0/3609029221 conn(0x7f13f809aa30 msgr2=0x7f13f8161e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.451+0000 7f13ff75f640 1 -- 172.21.15.81:0/3609029221 shutdown_connections 2024-09-16T01:22:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.451+0000 7f13ff75f640 1 -- 172.21.15.81:0/3609029221 wait complete. 2024-09-16T01:22:36.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:22:36.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.569+0000 7fdfad3c4640 1 Processor -- start 2024-09-16T01:22:36.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.569+0000 7fdfad3c4640 1 -- start start 2024-09-16T01:22:36.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.570+0000 7fdfad3c4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdfa806d740 0x7fdfa80cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:36.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.570+0000 7fdfad3c4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfa815ff70 con 0x7fdfa8162e30 2024-09-16T01:22:36.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.570+0000 7fdfad3c4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfa80d4d10 con 0x7fdfa8162340 2024-09-16T01:22:36.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.570+0000 7fdfad3c4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa806de90 con 0x7fdfa806d740 2024-09-16T01:22:36.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.570+0000 7fdfa67fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdfa8162e30 0x7fdfa80d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42190/0 (socket says 172.21.15.81:42190) 2024-09-16T01:22:36.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.570+0000 7fdfa67fc640 1 -- 172.21.15.81:0/3830393127 learned_addr learned my addr 172.21.15.81:0/3830393127 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:36.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.570+0000 7fdfa77fe640 1 --2- 172.21.15.81:0/3830393127 >> v2:172.21.15.81:3300/0 conn(0x7fdfa806d740 0x7fdfa80cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:36.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.570+0000 7fdfa5ffb640 1 -- 172.21.15.81:0/3830393127 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2265580678 0 0) 0x7fdfa815ff70 con 0x7fdfa8162e30 2024-09-16T01:22:36.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.570+0000 7fdfa5ffb640 1 -- 172.21.15.81:0/3830393127 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf90003520 con 0x7fdfa8162e30 2024-09-16T01:22:36.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.570+0000 7fdfa77fe640 1 -- 172.21.15.81:0/3830393127 >> v1:172.21.15.102:6789/0 conn(0x7fdfa8162340 legacy=0x7fdfa8162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.570+0000 7fdfa77fe640 1 -- 172.21.15.81:0/3830393127 >> v1:172.21.15.81:6789/0 conn(0x7fdfa8162e30 legacy=0x7fdfa80d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.570+0000 7fdfa77fe640 1 -- 172.21.15.81:0/3830393127 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa80d4ff0 con 0x7fdfa806d740 2024-09-16T01:22:36.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.571+0000 7fdfa77fe640 1 --2- 172.21.15.81:0/3830393127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa806d740 0x7fdfa80cf280 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00097a0 tx=0x7fdfa002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b0cc38eb9d9d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:36.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.571+0000 7fdfa5ffb640 1 -- 172.21.15.81:0/3830393127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0037070 con 0x7fdfa806d740 2024-09-16T01:22:36.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.571+0000 7fdfa5ffb640 1 -- 172.21.15.81:0/3830393127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa0032440 con 0x7fdfa806d740 2024-09-16T01:22:36.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.571+0000 7fdfa5ffb640 1 -- 172.21.15.81:0/3830393127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0032810 con 0x7fdfa806d740 2024-09-16T01:22:36.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.572+0000 7fdfad3c4640 1 -- 172.21.15.81:0/3830393127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa806d740 msgr2=0x7fdfa80cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.572+0000 7fdfad3c4640 1 --2- 172.21.15.81:0/3830393127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa806d740 0x7fdfa80cf280 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00097a0 tx=0x7fdfa002a1a0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.572+0000 7fdfad3c4640 1 -- 172.21.15.81:0/3830393127 shutdown_connections 2024-09-16T01:22:36.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.572+0000 7fdfad3c4640 1 --2- 172.21.15.81:0/3830393127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa806d740 0x7fdfa80cf280 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.572+0000 7fdfad3c4640 1 -- 172.21.15.81:0/3830393127 >> 172.21.15.81:0/3830393127 conn(0x7fdfa808bfc0 msgr2=0x7fdfa80d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:36.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.572+0000 7fdfad3c4640 1 -- 172.21.15.81:0/3830393127 shutdown_connections 2024-09-16T01:22:36.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.572+0000 7fdfad3c4640 1 -- 172.21.15.81:0/3830393127 wait complete. 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.573+0000 7fdfad3c4640 1 Processor -- start 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.573+0000 7fdfad3c4640 1 -- start start 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfad3c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfa806d740 0x7fdfa80ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfad3c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8162340 0x7fdfa80cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfad3c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfa8162e30 0x7fdfa8156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfad3c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa8163270 con 0x7fdfa8162340 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfad3c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa80cf7c0 con 0x7fdfa8162e30 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfad3c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa806dbb0 con 0x7fdfa806d740 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfa67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8162340 0x7fdfa80cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfa67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8162340 0x7fdfa80cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43512/0 (socket says 172.21.15.81:43512) 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfa67fc640 1 -- 172.21.15.81:0/2321737777 learned_addr learned my addr 172.21.15.81:0/2321737777 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfa77fe640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfa8162e30 0x7fdfa8156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:36.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfa6ffd640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfa806d740 0x7fdfa80ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfa67fc640 1 -- 172.21.15.81:0/2321737777 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfa806d740 msgr2=0x7fdfa80ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfa67fc640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfa806d740 0x7fdfa80ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfa67fc640 1 -- 172.21.15.81:0/2321737777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfa8162e30 msgr2=0x7fdfa8156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfa67fc640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfa8162e30 0x7fdfa8156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfa67fc640 1 -- 172.21.15.81:0/2321737777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa81e8920 con 0x7fdfa8162340 2024-09-16T01:22:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfa77fe640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfa8162e30 0x7fdfa8156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.574+0000 7fdfa67fc640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8162340 0x7fdfa80cdf40 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c001260 tx=0x7fdf9c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.575+0000 7fdf8f7fe640 1 -- 172.21.15.81:0/2321737777 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c017070 con 0x7fdfa8162340 2024-09-16T01:22:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.575+0000 7fdf8f7fe640 1 -- 172.21.15.81:0/2321737777 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf9c0074e0 con 0x7fdfa8162340 2024-09-16T01:22:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.575+0000 7fdfad3c4640 1 -- 172.21.15.81:0/2321737777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa8156a80 con 0x7fdfa8162340 2024-09-16T01:22:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.575+0000 7fdf8f7fe640 1 -- 172.21.15.81:0/2321737777 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c0059a0 con 0x7fdfa8162340 2024-09-16T01:22:36.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.575+0000 7fdfad3c4640 1 -- 172.21.15.81:0/2321737777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa81e8ea0 con 0x7fdfa8162340 2024-09-16T01:22:36.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.576+0000 7fdfad3c4640 1 -- 172.21.15.81:0/2321737777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa80d52d0 con 0x7fdfa8162340 2024-09-16T01:22:36.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.576+0000 7fdf8f7fe640 1 -- 172.21.15.81:0/2321737777 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdf9c01a070 con 0x7fdfa8162340 2024-09-16T01:22:36.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.576+0000 7fdf8f7fe640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdf9406c2b0 0x7fdf9406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:36.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.577+0000 7fdf8f7fe640 1 -- 172.21.15.81:0/2321737777 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5619+0+0 (secure 0 0 0) 0x7fdf9c08a6b0 con 0x7fdfa8162340 2024-09-16T01:22:36.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.577+0000 7fdfa6ffd640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdf9406c2b0 0x7fdf9406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:36.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.577+0000 7fdfa6ffd640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdf9406c2b0 0x7fdf9406e770 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdf98007fd0 tx=0x7fdf98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:36.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.581+0000 7fdf8f7fe640 1 -- 172.21.15.81:0/2321737777 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdf9c058820 con 0x7fdfa8162340 2024-09-16T01:22:36.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:36.748+0000 7fdfad3c4640 1 -- 172.21.15.81:0/2321737777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdfa808e640 con 0x7fdfa8162340 2024-09-16T01:22:37.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.451+0000 7fdf8f7fe640 1 -- 172.21.15.81:0/2321737777 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v123) ==== 170+0+0 (secure 0 0 0) 0x7fdf9c05cb20 con 0x7fdfa8162340 2024-09-16T01:22:37.453 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-16T01:22:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.454+0000 7fdfad3c4640 1 -- 172.21.15.81:0/2321737777 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdf9406c2b0 msgr2=0x7fdf9406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.454+0000 7fdfad3c4640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdf9406c2b0 0x7fdf9406e770 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fdf98007fd0 tx=0x7fdf98009040 comp rx=0 tx=0).stop 2024-09-16T01:22:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.454+0000 7fdfad3c4640 1 -- 172.21.15.81:0/2321737777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8162340 msgr2=0x7fdfa80cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.454+0000 7fdfad3c4640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8162340 0x7fdfa80cdf40 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c001260 tx=0x7fdf9c00c960 comp rx=0 tx=0).stop 2024-09-16T01:22:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.454+0000 7fdfad3c4640 1 -- 172.21.15.81:0/2321737777 shutdown_connections 2024-09-16T01:22:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.454+0000 7fdfad3c4640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdf9406c2b0 0x7fdf9406e770 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.454+0000 7fdfad3c4640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdfa8162e30 0x7fdfa8156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.454+0000 7fdfad3c4640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8162340 0x7fdfa80cdf40 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.454+0000 7fdfad3c4640 1 --2- 172.21.15.81:0/2321737777 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdfa806d740 0x7fdfa80ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.454+0000 7fdfad3c4640 1 -- 172.21.15.81:0/2321737777 >> 172.21.15.81:0/2321737777 conn(0x7fdfa808bfc0 msgr2=0x7fdfa80d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:37.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.454+0000 7fdfad3c4640 1 -- 172.21.15.81:0/2321737777 shutdown_connections 2024-09-16T01:22:37.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.454+0000 7fdfad3c4640 1 -- 172.21.15.81:0/2321737777 wait complete. 2024-09-16T01:22:37.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:22:37.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.580+0000 7fc2986ba640 1 Processor -- start 2024-09-16T01:22:37.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.580+0000 7fc2986ba640 1 -- start start 2024-09-16T01:22:37.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc2986ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc290161a20 0x7fc2900d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:37.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc2986ba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2900cf330 0x7fc29006d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:37.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc2986ba640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2900cf980 con 0x7fc2900d1420 2024-09-16T01:22:37.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc2986ba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc290161e00 con 0x7fc2900cf330 2024-09-16T01:22:37.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc2986ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc29006d050 con 0x7fc290161a20 2024-09-16T01:22:37.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc296c57640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2900cf330 0x7fc29006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:37.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc296c57640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2900cf330 0x7fc29006d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43528/0 (socket says 172.21.15.81:43528) 2024-09-16T01:22:37.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc296c57640 1 -- 172.21.15.81:0/4277589914 learned_addr learned my addr 172.21.15.81:0/4277589914 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc295c55640 1 --1- 172.21.15.81:0/4277589914 >> v1:172.21.15.81:6789/0 conn(0x7fc2900d1420 0x7fc2900cec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42198/0 (socket says 172.21.15.81:42198) 2024-09-16T01:22:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc296456640 1 --2- 172.21.15.81:0/4277589914 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc290161a20 0x7fc2900d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc296c57640 1 -- 172.21.15.81:0/4277589914 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc290161a20 msgr2=0x7fc2900d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc296c57640 1 --2- 172.21.15.81:0/4277589914 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc290161a20 0x7fc2900d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.581+0000 7fc296c57640 1 -- 172.21.15.81:0/4277589914 >> v1:172.21.15.81:6789/0 conn(0x7fc2900d1420 legacy=0x7fc2900cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.582+0000 7fc295454640 1 -- 172.21.15.81:0/4277589914 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2083074075 0 0) 0x7fc2900cf980 con 0x7fc2900d1420 2024-09-16T01:22:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.582+0000 7fc296c57640 1 -- 172.21.15.81:0/4277589914 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2900d1800 con 0x7fc2900cf330 2024-09-16T01:22:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.582+0000 7fc296c57640 1 --2- 172.21.15.81:0/4277589914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900cf330 0x7fc29006d810 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fc2900cfb50 tx=0x7fc28802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645c12982025a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.582+0000 7fc295454640 1 -- 172.21.15.81:0/4277589914 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288036070 con 0x7fc2900cf330 2024-09-16T01:22:37.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.582+0000 7fc295454640 1 -- 172.21.15.81:0/4277589914 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc288031600 con 0x7fc2900cf330 2024-09-16T01:22:37.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.582+0000 7fc295454640 1 -- 172.21.15.81:0/4277589914 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2880319d0 con 0x7fc2900cf330 2024-09-16T01:22:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.583+0000 7fc2986ba640 1 -- 172.21.15.81:0/4277589914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900cf330 msgr2=0x7fc29006d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.583+0000 7fc2986ba640 1 --2- 172.21.15.81:0/4277589914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900cf330 0x7fc29006d810 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fc2900cfb50 tx=0x7fc28802a710 comp rx=0 tx=0).stop 2024-09-16T01:22:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.583+0000 7fc2986ba640 1 -- 172.21.15.81:0/4277589914 shutdown_connections 2024-09-16T01:22:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.583+0000 7fc2986ba640 1 --2- 172.21.15.81:0/4277589914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900cf330 0x7fc29006d810 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.583+0000 7fc2986ba640 1 --2- 172.21.15.81:0/4277589914 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc290161a20 0x7fc2900d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.583+0000 7fc2986ba640 1 -- 172.21.15.81:0/4277589914 >> 172.21.15.81:0/4277589914 conn(0x7fc29009d850 msgr2=0x7fc29008bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.583+0000 7fc2986ba640 1 -- 172.21.15.81:0/4277589914 shutdown_connections 2024-09-16T01:22:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.583+0000 7fc2986ba640 1 -- 172.21.15.81:0/4277589914 wait complete. 2024-09-16T01:22:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.584+0000 7fc2986ba640 1 Processor -- start 2024-09-16T01:22:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.584+0000 7fc2986ba640 1 -- start start 2024-09-16T01:22:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc2986ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2900cf330 0x7fc29015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc2986ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900d1420 0x7fc2900b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc2986ba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc290161a20 0x7fc2900b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc2986ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc29006d2f0 con 0x7fc2900d1420 2024-09-16T01:22:37.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc2986ba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc2900cff00 con 0x7fc290161a20 2024-09-16T01:22:37.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc2986ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc2900b1040 con 0x7fc2900cf330 2024-09-16T01:22:37.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc295c55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900d1420 0x7fc2900b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:37.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc295c55640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900d1420 0x7fc2900b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43542/0 (socket says 172.21.15.81:43542) 2024-09-16T01:22:37.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc295c55640 1 -- 172.21.15.81:0/3977385907 learned_addr learned my addr 172.21.15.81:0/3977385907 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:37.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc295c55640 1 -- 172.21.15.81:0/3977385907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2900cf330 msgr2=0x7fc29015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:37.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc295c55640 1 --2- 172.21.15.81:0/3977385907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2900cf330 0x7fc29015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc295c55640 1 -- 172.21.15.81:0/3977385907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc290161a20 msgr2=0x7fc2900b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:37.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc295c55640 1 --2- 172.21.15.81:0/3977385907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc290161a20 0x7fc2900b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:37.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc295c55640 1 -- 172.21.15.81:0/3977385907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2900b7c90 con 0x7fc2900d1420 2024-09-16T01:22:37.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.585+0000 7fc295c55640 1 --2- 172.21.15.81:0/3977385907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900d1420 0x7fc2900b7320 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fc28000c500 tx=0x7fc28000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:37.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.586+0000 7fc286ffd640 1 -- 172.21.15.81:0/3977385907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280018070 con 0x7fc2900d1420 2024-09-16T01:22:37.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.586+0000 7fc286ffd640 1 -- 172.21.15.81:0/3977385907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc280007580 con 0x7fc2900d1420 2024-09-16T01:22:37.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.586+0000 7fc286ffd640 1 -- 172.21.15.81:0/3977385907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc280004a20 con 0x7fc2900d1420 2024-09-16T01:22:37.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.586+0000 7fc2986ba640 1 -- 172.21.15.81:0/3977385907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2900b7f70 con 0x7fc2900d1420 2024-09-16T01:22:37.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.586+0000 7fc2986ba640 1 -- 172.21.15.81:0/3977385907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29015bf70 con 0x7fc2900d1420 2024-09-16T01:22:37.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.587+0000 7fc2986ba640 1 -- 172.21.15.81:0/3977385907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2900d0ee0 con 0x7fc2900d1420 2024-09-16T01:22:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.587+0000 7fc286ffd640 1 -- 172.21.15.81:0/3977385907 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc280004bc0 con 0x7fc2900d1420 2024-09-16T01:22:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.588+0000 7fc286ffd640 1 --2- 172.21.15.81:0/3977385907 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc27406c2b0 0x7fc27406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.588+0000 7fc286ffd640 1 -- 172.21.15.81:0/3977385907 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 6001+0+0 (secure 0 0 0) 0x7fc28008a7c0 con 0x7fc2900d1420 2024-09-16T01:22:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.588+0000 7fc296456640 1 --2- 172.21.15.81:0/3977385907 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc27406c2b0 0x7fc27406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.588+0000 7fc296456640 1 --2- 172.21.15.81:0/3977385907 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc27406c2b0 0x7fc27406e770 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc28c006fd0 tx=0x7fc28c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:37.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.592+0000 7fc286ffd640 1 -- 172.21.15.81:0/3977385907 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc280058e90 con 0x7fc2900d1420 2024-09-16T01:22:37.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:37.792+0000 7fc2986ba640 1 -- 172.21.15.81:0/3977385907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc2900b8fd0 con 0x7fc2900d1420 2024-09-16T01:22:38.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.477+0000 7fc286ffd640 1 -- 172.21.15.81:0/3977385907 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v64) ==== 174+0+0 (secure 0 0 0) 0x7fc280058790 con 0x7fc2900d1420 2024-09-16T01:22:38.479 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 19 and data pool 20 2024-09-16T01:22:38.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.490+0000 7fc2986ba640 1 -- 172.21.15.81:0/3977385907 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc27406c2b0 msgr2=0x7fc27406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:38.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.491+0000 7fc2986ba640 1 --2- 172.21.15.81:0/3977385907 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc27406c2b0 0x7fc27406e770 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc28c006fd0 tx=0x7fc28c008040 comp rx=0 tx=0).stop 2024-09-16T01:22:38.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.491+0000 7fc2986ba640 1 -- 172.21.15.81:0/3977385907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900d1420 msgr2=0x7fc2900b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:38.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.491+0000 7fc2986ba640 1 --2- 172.21.15.81:0/3977385907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900d1420 0x7fc2900b7320 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fc28000c500 tx=0x7fc28000c9c0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.493+0000 7fc2986ba640 1 -- 172.21.15.81:0/3977385907 shutdown_connections 2024-09-16T01:22:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.493+0000 7fc2986ba640 1 --2- 172.21.15.81:0/3977385907 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc27406c2b0 0x7fc27406e770 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.493+0000 7fc2986ba640 1 --2- 172.21.15.81:0/3977385907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc290161a20 0x7fc2900b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.493+0000 7fc2986ba640 1 --2- 172.21.15.81:0/3977385907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2900d1420 0x7fc2900b7320 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.493+0000 7fc2986ba640 1 --2- 172.21.15.81:0/3977385907 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2900cf330 0x7fc29015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.493+0000 7fc2986ba640 1 -- 172.21.15.81:0/3977385907 >> 172.21.15.81:0/3977385907 conn(0x7fc29009d850 msgr2=0x7fc29015f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.493+0000 7fc2986ba640 1 -- 172.21.15.81:0/3977385907 shutdown_connections 2024-09-16T01:22:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.493+0000 7fc2986ba640 1 -- 172.21.15.81:0/3977385907 wait complete. 2024-09-16T01:22:38.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:22:38.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.608+0000 7fd3c932a640 1 Processor -- start 2024-09-16T01:22:38.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.608+0000 7fd3c932a640 1 -- start start 2024-09-16T01:22:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.609+0000 7fd3c932a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd3c4145bc0 0x7fd3c415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.609+0000 7fd3c932a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3c40ae140 0x7fd3c406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.609+0000 7fd3c932a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd3c409aa30 0x7fd3c406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.609+0000 7fd3c932a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c40b3570 con 0x7fd3c4145bc0 2024-09-16T01:22:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.609+0000 7fd3c932a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c40b3850 con 0x7fd3c409aa30 2024-09-16T01:22:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.609+0000 7fd3c932a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c40b3b30 con 0x7fd3c40ae140 2024-09-16T01:22:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.609+0000 7fd3c2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd3c4145bc0 0x7fd3c415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.609+0000 7fd3c2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd3c4145bc0 0x7fd3c415ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43550/0 (socket says 172.21.15.81:43550) 2024-09-16T01:22:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.609+0000 7fd3c2ffd640 1 -- 172.21.15.81:0/3508690140 learned_addr learned my addr 172.21.15.81:0/3508690140 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.610+0000 7fd3c27fc640 1 --2- 172.21.15.81:0/3508690140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3c40ae140 0x7fd3c406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.610+0000 7fd3c37fe640 1 --2- 172.21.15.81:0/3508690140 >> v2:172.21.15.102:3300/0 conn(0x7fd3c409aa30 0x7fd3c406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.610+0000 7fd3c2ffd640 1 -- 172.21.15.81:0/3508690140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3c40ae140 msgr2=0x7fd3c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.610+0000 7fd3c2ffd640 1 --2- 172.21.15.81:0/3508690140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3c40ae140 0x7fd3c406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.610+0000 7fd3c2ffd640 1 -- 172.21.15.81:0/3508690140 >> v2:172.21.15.102:3300/0 conn(0x7fd3c409aa30 msgr2=0x7fd3c406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.610+0000 7fd3c2ffd640 1 --2- 172.21.15.81:0/3508690140 >> v2:172.21.15.102:3300/0 conn(0x7fd3c409aa30 0x7fd3c406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.610+0000 7fd3c2ffd640 1 -- 172.21.15.81:0/3508690140 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c40b1610 con 0x7fd3c4145bc0 2024-09-16T01:22:38.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.610+0000 7fd3c2ffd640 1 --2- 172.21.15.81:0/3508690140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c4145bc0 0x7fd3c415ca70 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40ae560 tx=0x7fd3b402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd872d7375591414 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:38.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.611+0000 7fd3c1ffb640 1 -- 172.21.15.81:0/3508690140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4036070 con 0x7fd3c4145bc0 2024-09-16T01:22:38.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.611+0000 7fd3c1ffb640 1 -- 172.21.15.81:0/3508690140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b4031600 con 0x7fd3c4145bc0 2024-09-16T01:22:38.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.611+0000 7fd3c1ffb640 1 -- 172.21.15.81:0/3508690140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40319d0 con 0x7fd3c4145bc0 2024-09-16T01:22:38.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.611+0000 7fd3c932a640 1 -- 172.21.15.81:0/3508690140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c4145bc0 msgr2=0x7fd3c415ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:38.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.611+0000 7fd3c932a640 1 --2- 172.21.15.81:0/3508690140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c4145bc0 0x7fd3c415ca70 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40ae560 tx=0x7fd3b402a730 comp rx=0 tx=0).stop 2024-09-16T01:22:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.611+0000 7fd3c932a640 1 -- 172.21.15.81:0/3508690140 shutdown_connections 2024-09-16T01:22:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.611+0000 7fd3c932a640 1 --2- 172.21.15.81:0/3508690140 >> v2:172.21.15.102:3300/0 conn(0x7fd3c409aa30 0x7fd3c406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.611+0000 7fd3c932a640 1 --2- 172.21.15.81:0/3508690140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3c40ae140 0x7fd3c406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.611+0000 7fd3c932a640 1 --2- 172.21.15.81:0/3508690140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c4145bc0 0x7fd3c415ca70 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.611+0000 7fd3c932a640 1 -- 172.21.15.81:0/3508690140 >> 172.21.15.81:0/3508690140 conn(0x7fd3c4073490 msgr2=0x7fd3c40b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.611+0000 7fd3c932a640 1 -- 172.21.15.81:0/3508690140 shutdown_connections 2024-09-16T01:22:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.611+0000 7fd3c932a640 1 -- 172.21.15.81:0/3508690140 wait complete. 2024-09-16T01:22:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.612+0000 7fd3c932a640 1 Processor -- start 2024-09-16T01:22:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.612+0000 7fd3c932a640 1 -- start start 2024-09-16T01:22:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.613+0000 7fd3c932a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c409aa30 0x7fd3c40cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.613+0000 7fd3c932a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3c40ae140 0x7fd3c40c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.613+0000 7fd3c932a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c4145bc0 0x7fd3c40c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.613+0000 7fd3c932a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c4145fa0 con 0x7fd3c4145bc0 2024-09-16T01:22:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.613+0000 7fd3c932a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c40b1e10 con 0x7fd3c409aa30 2024-09-16T01:22:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.613+0000 7fd3c932a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd3c41f21d0 con 0x7fd3c40ae140 2024-09-16T01:22:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.613+0000 7fd3c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c4145bc0 0x7fd3c40c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.613+0000 7fd3c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c4145bc0 0x7fd3c40c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43562/0 (socket says 172.21.15.81:43562) 2024-09-16T01:22:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.613+0000 7fd3c37fe640 1 -- 172.21.15.81:0/1769739410 learned_addr learned my addr 172.21.15.81:0/1769739410 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.613+0000 7fd3c2ffd640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c409aa30 0x7fd3c40cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.613+0000 7fd3c27fc640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3c40ae140 0x7fd3c40c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.614+0000 7fd3c37fe640 1 -- 172.21.15.81:0/1769739410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3c40ae140 msgr2=0x7fd3c40c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.614+0000 7fd3c37fe640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3c40ae140 0x7fd3c40c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.614+0000 7fd3c37fe640 1 -- 172.21.15.81:0/1769739410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c409aa30 msgr2=0x7fd3c40cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.614+0000 7fd3c37fe640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c409aa30 0x7fd3c40cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.614+0000 7fd3c37fe640 1 -- 172.21.15.81:0/1769739410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c40c6c40 con 0x7fd3c4145bc0 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.614+0000 7fd3c37fe640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c4145bc0 0x7fd3c40c6610 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00d800 tx=0x7fd3bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.614+0000 7fd3bb7fe640 1 -- 172.21.15.81:0/1769739410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00b6c0 con 0x7fd3c4145bc0 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.614+0000 7fd3bb7fe640 1 -- 172.21.15.81:0/1769739410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3bc019070 con 0x7fd3c4145bc0 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.614+0000 7fd3c932a640 1 -- 172.21.15.81:0/1769739410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c40c6f20 con 0x7fd3c4145bc0 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.614+0000 7fd3bb7fe640 1 -- 172.21.15.81:0/1769739410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc00bac0 con 0x7fd3c4145bc0 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.614+0000 7fd3c932a640 1 -- 172.21.15.81:0/1769739410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c40c74e0 con 0x7fd3c4145bc0 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.615+0000 7fd3c932a640 1 -- 172.21.15.81:0/1769739410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c415ca70 con 0x7fd3c4145bc0 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.615+0000 7fd3bb7fe640 1 -- 172.21.15.81:0/1769739410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd3bc00bc60 con 0x7fd3c4145bc0 2024-09-16T01:22:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.616+0000 7fd3bb7fe640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd3a406c2b0 0x7fd3a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.616+0000 7fd3bb7fe640 1 -- 172.21.15.81:0/1769739410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 6101+0+0 (secure 0 0 0) 0x7fd3bc08b8f0 con 0x7fd3c4145bc0 2024-09-16T01:22:38.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.616+0000 7fd3c2ffd640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd3a406c2b0 0x7fd3a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.616+0000 7fd3c2ffd640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd3a406c2b0 0x7fd3a406e770 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4033000 tx=0x7fd3b4009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:38.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.620+0000 7fd3bb7fe640 1 -- 172.21.15.81:0/1769739410 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3bc059880 con 0x7fd3c4145bc0 2024-09-16T01:22:38.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.789+0000 7fd3c932a640 1 -- 172.21.15.81:0/1769739410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3c406f590 con 0x7fd3c4145bc0 2024-09-16T01:22:38.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.790+0000 7fd3bb7fe640 1 -- 172.21.15.81:0/1769739410 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+16973 (secure 0 0 0) 0x7fd3bc05db80 con 0x7fd3c4145bc0 2024-09-16T01:22:38.793 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:38.793 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":124,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:22:37.794259+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:22:36.412957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-16T01:22:36.768111+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:22:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.792+0000 7fd3c932a640 1 -- 172.21.15.81:0/1769739410 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd3a406c2b0 msgr2=0x7fd3a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.792+0000 7fd3c932a640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd3a406c2b0 0x7fd3a406e770 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4033000 tx=0x7fd3b4009000 comp rx=0 tx=0).stop 2024-09-16T01:22:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.792+0000 7fd3c932a640 1 -- 172.21.15.81:0/1769739410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c4145bc0 msgr2=0x7fd3c40c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:38.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.792+0000 7fd3c932a640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c4145bc0 0x7fd3c40c6610 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00d800 tx=0x7fd3bc00dcc0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.792+0000 7fd3c932a640 1 -- 172.21.15.81:0/1769739410 shutdown_connections 2024-09-16T01:22:38.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.792+0000 7fd3c932a640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd3a406c2b0 0x7fd3a406e770 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.792+0000 7fd3c932a640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3c4145bc0 0x7fd3c40c6610 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.792+0000 7fd3c932a640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd3c40ae140 0x7fd3c40c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.792+0000 7fd3c932a640 1 --2- 172.21.15.81:0/1769739410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd3c409aa30 0x7fd3c40cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.792+0000 7fd3c932a640 1 -- 172.21.15.81:0/1769739410 >> 172.21.15.81:0/1769739410 conn(0x7fd3c4073490 msgr2=0x7fd3c415d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:38.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.792+0000 7fd3c932a640 1 -- 172.21.15.81:0/1769739410 shutdown_connections 2024-09-16T01:22:38.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.793+0000 7fd3c932a640 1 -- 172.21.15.81:0/1769739410 wait complete. 2024-09-16T01:22:38.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:22:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.901+0000 7f9764277640 1 Processor -- start 2024-09-16T01:22:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.901+0000 7f9764277640 1 -- start start 2024-09-16T01:22:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9764277640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f975c15b300 0x7f975c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9764277640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f975c06f8d0 0x7f975c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9764277640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f975c0cdbe0 con 0x7f975c0cd3f0 2024-09-16T01:22:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9764277640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f975c0728a0 con 0x7f975c15b300 2024-09-16T01:22:38.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9764277640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f975c0cd900 con 0x7f975c06f8d0 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9761812640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f975c0cd3f0 0x7f975c06f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42214/0 (socket says 172.21.15.81:42214) 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9761812640 1 -- 172.21.15.81:0/1304573198 learned_addr learned my addr 172.21.15.81:0/1304573198 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9762013640 1 --2- 172.21.15.81:0/1304573198 >> v2:172.21.15.102:3300/0 conn(0x7f975c15b300 0x7f975c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9762814640 1 --2- 172.21.15.81:0/1304573198 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f975c06f8d0 0x7f975c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9761011640 1 -- 172.21.15.81:0/1304573198 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 696164397 0 0) 0x7f975c0cdbe0 con 0x7f975c0cd3f0 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9761011640 1 -- 172.21.15.81:0/1304573198 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9748003520 con 0x7f975c0cd3f0 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9762013640 1 -- 172.21.15.81:0/1304573198 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f975c06f8d0 msgr2=0x7f975c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9762013640 1 --2- 172.21.15.81:0/1304573198 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f975c06f8d0 0x7f975c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.902+0000 7f9762013640 1 -- 172.21.15.81:0/1304573198 >> v1:172.21.15.81:6789/0 conn(0x7f975c0cd3f0 legacy=0x7f975c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.903+0000 7f9762013640 1 -- 172.21.15.81:0/1304573198 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c072250 con 0x7f975c15b300 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.903+0000 7f9762013640 1 --2- 172.21.15.81:0/1304573198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c15b300 0x7f975c0cceb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f97580097a0 tx=0x7f975802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49f2369551f35884 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.903+0000 7f9761011640 1 -- 172.21.15.81:0/1304573198 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758037070 con 0x7f975c15b300 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.904+0000 7f9761011640 1 -- 172.21.15.81:0/1304573198 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9758032440 con 0x7f975c15b300 2024-09-16T01:22:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.904+0000 7f9761011640 1 -- 172.21.15.81:0/1304573198 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97580327f0 con 0x7f975c15b300 2024-09-16T01:22:38.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.904+0000 7f9764277640 1 -- 172.21.15.81:0/1304573198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c15b300 msgr2=0x7f975c0cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:38.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.904+0000 7f9764277640 1 --2- 172.21.15.81:0/1304573198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c15b300 0x7f975c0cceb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f97580097a0 tx=0x7f975802a180 comp rx=0 tx=0).stop 2024-09-16T01:22:38.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.904+0000 7f9764277640 1 -- 172.21.15.81:0/1304573198 shutdown_connections 2024-09-16T01:22:38.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.904+0000 7f9764277640 1 --2- 172.21.15.81:0/1304573198 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f975c06f8d0 0x7f975c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.904+0000 7f9764277640 1 --2- 172.21.15.81:0/1304573198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c15b300 0x7f975c0cceb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.904+0000 7f9764277640 1 -- 172.21.15.81:0/1304573198 >> 172.21.15.81:0/1304573198 conn(0x7f975c067d70 msgr2=0x7f975c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.904+0000 7f9764277640 1 -- 172.21.15.81:0/1304573198 shutdown_connections 2024-09-16T01:22:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.904+0000 7f9764277640 1 -- 172.21.15.81:0/1304573198 wait complete. 2024-09-16T01:22:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.905+0000 7f9764277640 1 Processor -- start 2024-09-16T01:22:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.905+0000 7f9764277640 1 -- start start 2024-09-16T01:22:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9764277640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f975c06f8d0 0x7f975c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9764277640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c0cd3f0 0x7f975c156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9764277640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f975c15b300 0x7f975c1573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9764277640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f975c0d0160 con 0x7f975c15b300 2024-09-16T01:22:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9764277640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f975c0cffe0 con 0x7f975c0cd3f0 2024-09-16T01:22:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9764277640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f975c072d30 con 0x7f975c06f8d0 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9762814640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f975c15b300 0x7f975c1573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9762814640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f975c15b300 0x7f975c1573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43566/0 (socket says 172.21.15.81:43566) 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9762814640 1 -- 172.21.15.81:0/623063032 learned_addr learned my addr 172.21.15.81:0/623063032 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9761812640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c0cd3f0 0x7f975c156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9762013640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f975c06f8d0 0x7f975c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9762814640 1 -- 172.21.15.81:0/623063032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f975c06f8d0 msgr2=0x7f975c150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9762814640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f975c06f8d0 0x7f975c150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9762814640 1 -- 172.21.15.81:0/623063032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c0cd3f0 msgr2=0x7f975c156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9762814640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c0cd3f0 0x7f975c156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9762814640 1 -- 172.21.15.81:0/623063032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f975c157a10 con 0x7f975c15b300 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9761812640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c0cd3f0 0x7f975c156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.906+0000 7f9762814640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f975c15b300 0x7f975c1573b0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f975400e5b0 tx=0x7f975400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.907+0000 7f9752ffd640 1 -- 172.21.15.81:0/623063032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754012840 con 0x7f975c15b300 2024-09-16T01:22:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.907+0000 7f9752ffd640 1 -- 172.21.15.81:0/623063032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9754012a00 con 0x7f975c15b300 2024-09-16T01:22:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.907+0000 7f9764277640 1 -- 172.21.15.81:0/623063032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f975c157cf0 con 0x7f975c15b300 2024-09-16T01:22:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.907+0000 7f9752ffd640 1 -- 172.21.15.81:0/623063032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754012df0 con 0x7f975c15b300 2024-09-16T01:22:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.907+0000 7f9764277640 1 -- 172.21.15.81:0/623063032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f975c06bf30 con 0x7f975c15b300 2024-09-16T01:22:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.908+0000 7f9764277640 1 -- 172.21.15.81:0/623063032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f975c0cfca0 con 0x7f975c15b300 2024-09-16T01:22:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.908+0000 7f9752ffd640 1 -- 172.21.15.81:0/623063032 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f975401a420 con 0x7f975c15b300 2024-09-16T01:22:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.909+0000 7f9752ffd640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f974006c2b0 0x7f974006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.909+0000 7f9762013640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f974006c2b0 0x7f974006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.909+0000 7f9752ffd640 1 -- 172.21.15.81:0/623063032 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 6101+0+0 (secure 0 0 0) 0x7f975408e3f0 con 0x7f975c15b300 2024-09-16T01:22:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.909+0000 7f9762013640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f974006c2b0 0x7f974006e770 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9758034000 tx=0x7f975802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:38.913+0000 7f9752ffd640 1 -- 172.21.15.81:0/623063032 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f975405cb20 con 0x7f975c15b300 2024-09-16T01:22:39.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.081+0000 7f9764277640 1 -- 172.21.15.81:0/623063032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f975c15d6a0 con 0x7f975c15b300 2024-09-16T01:22:39.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.082+0000 7f9752ffd640 1 -- 172.21.15.81:0/623063032 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) ==== 74+0+16973 (secure 0 0 0) 0x7f975405c420 con 0x7f975c15b300 2024-09-16T01:22:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:39.084 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":124,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:22:37.794259+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:22:36.412957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-16T01:22:36.768111+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:22:39.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.084+0000 7f9764277640 1 -- 172.21.15.81:0/623063032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f974006c2b0 msgr2=0x7f974006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.084+0000 7f9764277640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f974006c2b0 0x7f974006e770 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9758034000 tx=0x7f975802e000 comp rx=0 tx=0).stop 2024-09-16T01:22:39.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.084+0000 7f9764277640 1 -- 172.21.15.81:0/623063032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f975c15b300 msgr2=0x7f975c1573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.084+0000 7f9764277640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f975c15b300 0x7f975c1573b0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f975400e5b0 tx=0x7f975400ea70 comp rx=0 tx=0).stop 2024-09-16T01:22:39.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.084+0000 7f9764277640 1 -- 172.21.15.81:0/623063032 shutdown_connections 2024-09-16T01:22:39.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.084+0000 7f9764277640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f974006c2b0 0x7f974006e770 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.084+0000 7f9764277640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f975c15b300 0x7f975c1573b0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.084+0000 7f9764277640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f975c0cd3f0 0x7f975c156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.084+0000 7f9764277640 1 --2- 172.21.15.81:0/623063032 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f975c06f8d0 0x7f975c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.084+0000 7f9764277640 1 -- 172.21.15.81:0/623063032 >> 172.21.15.81:0/623063032 conn(0x7f975c067d70 msgr2=0x7f975c15c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:39.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.084+0000 7f9764277640 1 -- 172.21.15.81:0/623063032 shutdown_connections 2024-09-16T01:22:39.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.084+0000 7f9764277640 1 -- 172.21.15.81:0/623063032 wait complete. 2024-09-16T01:22:39.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:22:39.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.197+0000 7fb24447b640 1 Processor -- start 2024-09-16T01:22:39.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.197+0000 7fb24447b640 1 -- start start 2024-09-16T01:22:39.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.197+0000 7fb24447b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb23c071160 0x7fb23c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.197+0000 7fb24447b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c0cdd20 0x7fb23c0700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.197+0000 7fb24447b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23c0ce720 con 0x7fb23c0b1920 2024-09-16T01:22:39.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.197+0000 7fb24447b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb23c0cea00 con 0x7fb23c071160 2024-09-16T01:22:39.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.197+0000 7fb24447b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb23c0ccfe0 con 0x7fb23c0cdd20 2024-09-16T01:22:39.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.197+0000 7fb241a16640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb23c071160 0x7fb23c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.197+0000 7fb241a16640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb23c071160 0x7fb23c0cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43578/0 (socket says 172.21.15.81:43578) 2024-09-16T01:22:39.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.197+0000 7fb241a16640 1 -- 172.21.15.81:0/3415889237 learned_addr learned my addr 172.21.15.81:0/3415889237 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:39.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.198+0000 7fb241a16640 1 -- 172.21.15.81:0/3415889237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c0cdd20 msgr2=0x7fb23c0700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:39.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.198+0000 7fb242a18640 1 --2- 172.21.15.81:0/3415889237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c0cdd20 0x7fb23c0700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.198+0000 7fb241a16640 1 --2- 172.21.15.81:0/3415889237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c0cdd20 0x7fb23c0700c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.198+0000 7fb241a16640 1 -- 172.21.15.81:0/3415889237 >> v1:172.21.15.102:6789/0 conn(0x7fb23c0b1920 legacy=0x7fb23c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:39.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.198+0000 7fb241a16640 1 -- 172.21.15.81:0/3415889237 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c0cd2c0 con 0x7fb23c071160 2024-09-16T01:22:39.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.198+0000 7fb242a18640 1 --2- 172.21.15.81:0/3415889237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c0cdd20 0x7fb23c0700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:39.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.198+0000 7fb241a16640 1 --2- 172.21.15.81:0/3415889237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c071160 0x7fb23c0cd7e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009870 tx=0x7fb22c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ac558d019a41b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:39.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.199+0000 7fb241215640 1 -- 172.21.15.81:0/3415889237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c037070 con 0x7fb23c071160 2024-09-16T01:22:39.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.199+0000 7fb241215640 1 -- 172.21.15.81:0/3415889237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c032440 con 0x7fb23c071160 2024-09-16T01:22:39.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.199+0000 7fb241215640 1 -- 172.21.15.81:0/3415889237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c032810 con 0x7fb23c071160 2024-09-16T01:22:39.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.199+0000 7fb24447b640 1 -- 172.21.15.81:0/3415889237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c071160 msgr2=0x7fb23c0cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.199+0000 7fb24447b640 1 --2- 172.21.15.81:0/3415889237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c071160 0x7fb23c0cd7e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009870 tx=0x7fb22c02a180 comp rx=0 tx=0).stop 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.199+0000 7fb24447b640 1 -- 172.21.15.81:0/3415889237 shutdown_connections 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.199+0000 7fb24447b640 1 --2- 172.21.15.81:0/3415889237 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c0cdd20 0x7fb23c0700c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.199+0000 7fb24447b640 1 --2- 172.21.15.81:0/3415889237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c071160 0x7fb23c0cd7e0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.199+0000 7fb24447b640 1 -- 172.21.15.81:0/3415889237 >> 172.21.15.81:0/3415889237 conn(0x7fb23c0b3de0 msgr2=0x7fb23c0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.199+0000 7fb24447b640 1 -- 172.21.15.81:0/3415889237 shutdown_connections 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.199+0000 7fb24447b640 1 -- 172.21.15.81:0/3415889237 wait complete. 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.200+0000 7fb24447b640 1 Processor -- start 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.200+0000 7fb24447b640 1 -- start start 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb24447b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c071160 0x7fb23c1f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb24447b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c0b1920 0x7fb23c0b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb24447b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb23c0cdd20 0x7fb23c0b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb24447b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c0d01f0 con 0x7fb23c071160 2024-09-16T01:22:39.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb24447b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c0d0070 con 0x7fb23c0cdd20 2024-09-16T01:22:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb24447b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb23c09b140 con 0x7fb23c0b1920 2024-09-16T01:22:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb242217640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c071160 0x7fb23c1f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb242217640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c071160 0x7fb23c1f1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43582/0 (socket says 172.21.15.81:43582) 2024-09-16T01:22:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb242217640 1 -- 172.21.15.81:0/3077655420 learned_addr learned my addr 172.21.15.81:0/3077655420 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb242a18640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb23c0cdd20 0x7fb23c0b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb241a16640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c0b1920 0x7fb23c0b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb242217640 1 -- 172.21.15.81:0/3077655420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c0b1920 msgr2=0x7fb23c0b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb242217640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c0b1920 0x7fb23c0b73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb242217640 1 -- 172.21.15.81:0/3077655420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb23c0cdd20 msgr2=0x7fb23c0b7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb242217640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb23c0cdd20 0x7fb23c0b7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.201+0000 7fb242217640 1 -- 172.21.15.81:0/3077655420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c0cb950 con 0x7fb23c071160 2024-09-16T01:22:39.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.202+0000 7fb242217640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c071160 0x7fb23c1f1aa0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fb23800b3f0 tx=0x7fb23800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.202+0000 7fb232ffd640 1 -- 172.21.15.81:0/3077655420 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238015020 con 0x7fb23c071160 2024-09-16T01:22:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.202+0000 7fb232ffd640 1 -- 172.21.15.81:0/3077655420 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb238011830 con 0x7fb23c071160 2024-09-16T01:22:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.202+0000 7fb24447b640 1 -- 172.21.15.81:0/3077655420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23c0c9dd0 con 0x7fb23c071160 2024-09-16T01:22:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.202+0000 7fb232ffd640 1 -- 172.21.15.81:0/3077655420 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238011c20 con 0x7fb23c071160 2024-09-16T01:22:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.202+0000 7fb24447b640 1 -- 172.21.15.81:0/3077655420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23c0ca390 con 0x7fb23c071160 2024-09-16T01:22:39.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.203+0000 7fb24447b640 1 -- 172.21.15.81:0/3077655420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23c0cd7e0 con 0x7fb23c071160 2024-09-16T01:22:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.203+0000 7fb232ffd640 1 -- 172.21.15.81:0/3077655420 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb238018020 con 0x7fb23c071160 2024-09-16T01:22:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.204+0000 7fb232ffd640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb22006c2b0 0x7fb22006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.204+0000 7fb232ffd640 1 -- 172.21.15.81:0/3077655420 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 6101+0+0 (secure 0 0 0) 0x7fb23808b100 con 0x7fb23c071160 2024-09-16T01:22:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.204+0000 7fb241a16640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb22006c2b0 0x7fb22006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.204+0000 7fb241a16640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb22006c2b0 0x7fb22006e770 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb22c034000 tx=0x7fb22c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:39.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.208+0000 7fb232ffd640 1 -- 172.21.15.81:0/3077655420 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb23801f030 con 0x7fb23c071160 2024-09-16T01:22:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.411+0000 7fb24447b640 1 -- 172.21.15.81:0/3077655420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb23c0b4cf0 con 0x7fb23c071160 2024-09-16T01:22:39.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.478+0000 7fb232ffd640 1 -- 172.21.15.81:0/3077655420 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v65) ==== 118+0+0 (secure 0 0 0) 0x7fb2380590a0 con 0x7fb23c071160 2024-09-16T01:22:39.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.480+0000 7fb24447b640 1 -- 172.21.15.81:0/3077655420 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb22006c2b0 msgr2=0x7fb22006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.480+0000 7fb24447b640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb22006c2b0 0x7fb22006e770 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb22c034000 tx=0x7fb22c02e000 comp rx=0 tx=0).stop 2024-09-16T01:22:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.480+0000 7fb24447b640 1 -- 172.21.15.81:0/3077655420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c071160 msgr2=0x7fb23c1f1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.480+0000 7fb24447b640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c071160 0x7fb23c1f1aa0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fb23800b3f0 tx=0x7fb23800b8b0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.481+0000 7fb24447b640 1 -- 172.21.15.81:0/3077655420 shutdown_connections 2024-09-16T01:22:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.481+0000 7fb24447b640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb22006c2b0 0x7fb22006e770 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.481+0000 7fb24447b640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb23c0cdd20 0x7fb23c0b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.481+0000 7fb24447b640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb23c0b1920 0x7fb23c0b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.481+0000 7fb24447b640 1 --2- 172.21.15.81:0/3077655420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb23c071160 0x7fb23c1f1aa0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.481+0000 7fb24447b640 1 -- 172.21.15.81:0/3077655420 >> 172.21.15.81:0/3077655420 conn(0x7fb23c0b3de0 msgr2=0x7fb23c0b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.481+0000 7fb24447b640 1 -- 172.21.15.81:0/3077655420 shutdown_connections 2024-09-16T01:22:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.481+0000 7fb24447b640 1 -- 172.21.15.81:0/3077655420 wait complete. 2024-09-16T01:22:39.492 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T01:22:39.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:22:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.593+0000 7f6ef18ba640 1 Processor -- start 2024-09-16T01:22:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.593+0000 7f6ef18ba640 1 -- start start 2024-09-16T01:22:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ef18ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eec06d740 0x7f6eec0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ef18ba640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eec15ff70 con 0x7f6eec162e30 2024-09-16T01:22:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ef18ba640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eec06dbd0 con 0x7f6eec162340 2024-09-16T01:22:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ef18ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6eec06de90 con 0x7f6eec06d740 2024-09-16T01:22:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6eea7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6eec162e30 0x7f6eec0d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42226/0 (socket says 172.21.15.81:42226) 2024-09-16T01:22:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6eea7fc640 1 -- 172.21.15.81:0/2792752602 learned_addr learned my addr 172.21.15.81:0/2792752602 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6eeb7fe640 1 --2- 172.21.15.81:0/2792752602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eec06d740 0x7f6eec0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155298497 0 0) 0x7f6eec15ff70 con 0x7f6eec162e30 2024-09-16T01:22:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ed4003520 con 0x7f6eec162e30 2024-09-16T01:22:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1744913162 0 0) 0x7f6ed4003520 con 0x7f6eec162e30 2024-09-16T01:22:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eec06d740 msgr2=0x7f6eec0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 --2- 172.21.15.81:0/2792752602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eec06d740 0x7f6eec0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 >> v1:172.21.15.102:6789/0 conn(0x7f6eec162340 legacy=0x7f6eec162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eec0d4d10 con 0x7f6eec162e30 2024-09-16T01:22:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f6ee00017f0 con 0x7f6eec162e30 2024-09-16T01:22:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 >> v1:172.21.15.81:6789/0 conn(0x7f6eec162e30 legacy=0x7f6eec0d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 --2- 172.21.15.81:0/2792752602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ed40039e0 0x7f6ed4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 --2- 172.21.15.81:0/2792752602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed4004390 0x7f6ed4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 --2- 172.21.15.81:0/2792752602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eec06d740 0x7f6ed4005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec06de90 con 0x7f6ed4004390 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed400ba70 con 0x7f6ed40039e0 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.594+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed400bc70 con 0x7f6eec06d740 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.595+0000 7f6eea7fc640 1 --2- 172.21.15.81:0/2792752602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed4004390 0x7f6ed4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.595+0000 7f6eeaffd640 1 --2- 172.21.15.81:0/2792752602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ed40039e0 0x7f6ed4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.595+0000 7f6eeb7fe640 1 --2- 172.21.15.81:0/2792752602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eec06d740 0x7f6ed4005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.595+0000 7f6eea7fc640 1 -- 172.21.15.81:0/2792752602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eec06d740 msgr2=0x7f6ed4005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.595+0000 7f6eea7fc640 1 --2- 172.21.15.81:0/2792752602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eec06d740 0x7f6ed4005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.595+0000 7f6eea7fc640 1 -- 172.21.15.81:0/2792752602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ed40039e0 msgr2=0x7f6ed4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.595+0000 7f6eea7fc640 1 --2- 172.21.15.81:0/2792752602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ed40039e0 0x7f6ed4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.595+0000 7f6eea7fc640 1 -- 172.21.15.81:0/2792752602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed4003520 con 0x7f6ed4004390 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.596+0000 7f6eea7fc640 1 --2- 172.21.15.81:0/2792752602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed4004390 0x7f6ed4004860 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c240 tx=0x7f6ed4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82287635d431dd04 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.596+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee002e070 con 0x7f6ed4004390 2024-09-16T01:22:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.596+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee0007270 con 0x7f6ed4004390 2024-09-16T01:22:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.596+0000 7f6ee9ffb640 1 -- 172.21.15.81:0/2792752602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0007d40 con 0x7f6ed4004390 2024-09-16T01:22:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.596+0000 7f6ef18ba640 1 -- 172.21.15.81:0/2792752602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed4004390 msgr2=0x7f6ed4004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.596+0000 7f6ef18ba640 1 --2- 172.21.15.81:0/2792752602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed4004390 0x7f6ed4004860 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000c240 tx=0x7f6ed4005830 comp rx=0 tx=0).stop 2024-09-16T01:22:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.596+0000 7f6eeb7fe640 1 -- 172.21.15.81:0/2792752602 reap_dead start 2024-09-16T01:22:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.596+0000 7f6ef18ba640 1 -- 172.21.15.81:0/2792752602 shutdown_connections 2024-09-16T01:22:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.596+0000 7f6ef18ba640 1 -- 172.21.15.81:0/2792752602 >> 172.21.15.81:0/2792752602 conn(0x7f6eec08bfc0 msgr2=0x7f6eec0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.596+0000 7f6ef18ba640 1 -- 172.21.15.81:0/2792752602 shutdown_connections 2024-09-16T01:22:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.596+0000 7f6ef18ba640 1 -- 172.21.15.81:0/2792752602 wait complete. 2024-09-16T01:22:39.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.598+0000 7f6ef18ba640 1 Processor -- start 2024-09-16T01:22:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.598+0000 7f6ef18ba640 1 -- start start 2024-09-16T01:22:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.598+0000 7f6ef18ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed4004390 0x7f6eec15bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.598+0000 7f6ef18ba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eec0b9090 0x7f6eec0cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.598+0000 7f6ef18ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec15d560 0x7f6eec15da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.598+0000 7f6ef18ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec0d2470 con 0x7f6eec15d560 2024-09-16T01:22:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.598+0000 7f6ef18ba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec163270 con 0x7f6eec0b9090 2024-09-16T01:22:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.598+0000 7f6ef18ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6eec0d52d0 con 0x7f6ed4004390 2024-09-16T01:22:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6eeb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec15d560 0x7f6eec15da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6eeb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec15d560 0x7f6eec15da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43596/0 (socket says 172.21.15.81:43596) 2024-09-16T01:22:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6eeb7fe640 1 -- 172.21.15.81:0/812632363 learned_addr learned my addr 172.21.15.81:0/812632363 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6eeaffd640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed4004390 0x7f6eec15bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6eea7fc640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eec0b9090 0x7f6eec0cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6eeb7fe640 1 -- 172.21.15.81:0/812632363 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed4004390 msgr2=0x7f6eec15bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6eeb7fe640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed4004390 0x7f6eec15bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6eeb7fe640 1 -- 172.21.15.81:0/812632363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eec0b9090 msgr2=0x7f6eec0cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6eeb7fe640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eec0b9090 0x7f6eec0cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6eeb7fe640 1 -- 172.21.15.81:0/812632363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eec0d17b0 con 0x7f6eec15d560 2024-09-16T01:22:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6eeb7fe640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec15d560 0x7f6eec15da10 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6eec08e190 tx=0x7f6ee400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6ed3fff640 1 -- 172.21.15.81:0/812632363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4015430 con 0x7f6eec15d560 2024-09-16T01:22:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6ed3fff640 1 -- 172.21.15.81:0/812632363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee401d070 con 0x7f6eec15d560 2024-09-16T01:22:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6ed3fff640 1 -- 172.21.15.81:0/812632363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4015830 con 0x7f6eec15d560 2024-09-16T01:22:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6ef18ba640 1 -- 172.21.15.81:0/812632363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eec0ce380 con 0x7f6eec15d560 2024-09-16T01:22:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.599+0000 7f6ef18ba640 1 -- 172.21.15.81:0/812632363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eec0b9800 con 0x7f6eec15d560 2024-09-16T01:22:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.601+0000 7f6ef18ba640 1 -- 172.21.15.81:0/812632363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eec0cf280 con 0x7f6eec15d560 2024-09-16T01:22:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.601+0000 7f6ed3fff640 1 -- 172.21.15.81:0/812632363 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6ee40159d0 con 0x7f6eec15d560 2024-09-16T01:22:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.601+0000 7f6ed3fff640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6ed806c2b0 0x7f6ed806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.601+0000 7f6ed3fff640 1 -- 172.21.15.81:0/812632363 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f6ee408be30 con 0x7f6eec15d560 2024-09-16T01:22:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.601+0000 7f6eeaffd640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6ed806c2b0 0x7f6ed806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.602+0000 7f6eeaffd640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6ed806c2b0 0x7f6ed806e770 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6eec15e390 tx=0x7f6edc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.605+0000 7f6ed3fff640 1 -- 172.21.15.81:0/812632363 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ee4010040 con 0x7f6eec15d560 2024-09-16T01:22:39.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:22:39.653 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:22:39.728 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-16T01:22:39.727+0000 7fa01fe43640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:22:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:39.813+0000 7f6ef18ba640 1 -- 172.21.15.81:0/812632363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6eec15f720 con 0x7f6eec15d560 2024-09-16T01:22:40.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.484+0000 7f6ed3fff640 1 -- 172.21.15.81:0/812632363 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v66) ==== 122+0+0 (secure 0 0 0) 0x7f6ee4059dc0 con 0x7f6eec15d560 2024-09-16T01:22:40.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.487+0000 7f6ef18ba640 1 -- 172.21.15.81:0/812632363 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6ed806c2b0 msgr2=0x7f6ed806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.487+0000 7f6ef18ba640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6ed806c2b0 0x7f6ed806e770 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f6eec15e390 tx=0x7f6edc009040 comp rx=0 tx=0).stop 2024-09-16T01:22:40.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.487+0000 7f6ef18ba640 1 -- 172.21.15.81:0/812632363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec15d560 msgr2=0x7f6eec15da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.487+0000 7f6ef18ba640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec15d560 0x7f6eec15da10 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6eec08e190 tx=0x7f6ee400f580 comp rx=0 tx=0).stop 2024-09-16T01:22:40.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.487+0000 7f6ef18ba640 1 -- 172.21.15.81:0/812632363 shutdown_connections 2024-09-16T01:22:40.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.487+0000 7f6ef18ba640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6ed806c2b0 0x7f6ed806e770 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.487+0000 7f6ef18ba640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eec15d560 0x7f6eec15da10 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.487+0000 7f6ef18ba640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eec0b9090 0x7f6eec0cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.487+0000 7f6ef18ba640 1 --2- 172.21.15.81:0/812632363 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ed4004390 0x7f6eec15bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.487+0000 7f6ef18ba640 1 -- 172.21.15.81:0/812632363 >> 172.21.15.81:0/812632363 conn(0x7f6eec08bfc0 msgr2=0x7f6eec162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:40.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.487+0000 7f6ef18ba640 1 -- 172.21.15.81:0/812632363 shutdown_connections 2024-09-16T01:22:40.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.487+0000 7f6ef18ba640 1 -- 172.21.15.81:0/812632363 wait complete. 2024-09-16T01:22:40.500 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:22:40.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:40.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.641+0000 7f599c10a640 1 Processor -- start 2024-09-16T01:22:40.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.642+0000 7f599c10a640 1 -- start start 2024-09-16T01:22:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.642+0000 7f599c10a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5994162060 0x7f59940b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.642+0000 7f599c10a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599406d9f0 con 0x7f59940b64b0 2024-09-16T01:22:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.642+0000 7f599c10a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599406dcd0 con 0x7f5994161c80 2024-09-16T01:22:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.642+0000 7f599c10a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f599406dfb0 con 0x7f5994162060 2024-09-16T01:22:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.643+0000 7f599a6a7640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f59940b64b0 0x7f59940cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42232/0 (socket says 172.21.15.81:42232) 2024-09-16T01:22:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.643+0000 7f599a6a7640 1 -- 172.21.15.81:0/1330617433 learned_addr learned my addr 172.21.15.81:0/1330617433 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.643+0000 7f59996a5640 1 --2- 172.21.15.81:0/1330617433 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5994162060 0x7f59940b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.643+0000 7f5998ea4640 1 -- 172.21.15.81:0/1330617433 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 86853884 0 0) 0x7f599406d9f0 con 0x7f59940b64b0 2024-09-16T01:22:40.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.643+0000 7f5998ea4640 1 -- 172.21.15.81:0/1330617433 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5980003520 con 0x7f59940b64b0 2024-09-16T01:22:40.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.643+0000 7f5998ea4640 1 -- 172.21.15.81:0/1330617433 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 859159087 0 0) 0x7f599406dcd0 con 0x7f5994161c80 2024-09-16T01:22:40.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.643+0000 7f5998ea4640 1 -- 172.21.15.81:0/1330617433 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f599406d9f0 con 0x7f5994161c80 2024-09-16T01:22:40.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.643+0000 7f59996a5640 1 -- 172.21.15.81:0/1330617433 >> v1:172.21.15.102:6789/0 conn(0x7f5994161c80 legacy=0x7f599406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.643+0000 7f59996a5640 1 -- 172.21.15.81:0/1330617433 >> v1:172.21.15.81:6789/0 conn(0x7f59940b64b0 legacy=0x7f59940cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.643+0000 7f5998ea4640 1 -- 172.21.15.81:0/1330617433 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1150305554 0 0) 0x7f5980003520 con 0x7f59940b64b0 2024-09-16T01:22:40.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.643+0000 7f59996a5640 1 -- 172.21.15.81:0/1330617433 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59940d2890 con 0x7f5994162060 2024-09-16T01:22:40.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.644+0000 7f59996a5640 1 --2- 172.21.15.81:0/1330617433 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5994162060 0x7f59940b5f70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f59840097d0 tx=0x7f598402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61f859be67d86a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:40.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.644+0000 7f5998ea4640 1 -- 172.21.15.81:0/1330617433 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5984037070 con 0x7f5994162060 2024-09-16T01:22:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.644+0000 7f5998ea4640 1 -- 172.21.15.81:0/1330617433 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598402ac30 con 0x7f5994162060 2024-09-16T01:22:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.644+0000 7f5998ea4640 1 -- 172.21.15.81:0/1330617433 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c0019f0 con 0x7f5994162060 2024-09-16T01:22:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.645+0000 7f599c10a640 1 -- 172.21.15.81:0/1330617433 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5994162060 msgr2=0x7f59940b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.645+0000 7f599c10a640 1 --2- 172.21.15.81:0/1330617433 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5994162060 0x7f59940b5f70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f59840097d0 tx=0x7f598402a1a0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.645+0000 7f599c10a640 1 -- 172.21.15.81:0/1330617433 shutdown_connections 2024-09-16T01:22:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.645+0000 7f599c10a640 1 --2- 172.21.15.81:0/1330617433 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5994162060 0x7f59940b5f70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.645+0000 7f599c10a640 1 -- 172.21.15.81:0/1330617433 >> 172.21.15.81:0/1330617433 conn(0x7f59940d44f0 msgr2=0x7f59940d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.645+0000 7f599c10a640 1 -- 172.21.15.81:0/1330617433 shutdown_connections 2024-09-16T01:22:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.645+0000 7f599c10a640 1 -- 172.21.15.81:0/1330617433 wait complete. 2024-09-16T01:22:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.646+0000 7f599c10a640 1 Processor -- start 2024-09-16T01:22:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.646+0000 7f599c10a640 1 -- start start 2024-09-16T01:22:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f599c10a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59940b64b0 0x7f59940ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f599c10a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5994161c80 0x7f59941f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f599c10a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5994162060 0x7f59940cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f599c10a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59940b6cf0 con 0x7f59940b64b0 2024-09-16T01:22:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f599c10a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f59940b6b70 con 0x7f5994162060 2024-09-16T01:22:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f599c10a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f59940cf8f0 con 0x7f5994161c80 2024-09-16T01:22:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f5999ea6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59940b64b0 0x7f59940ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f5999ea6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59940b64b0 0x7f59940ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43598/0 (socket says 172.21.15.81:43598) 2024-09-16T01:22:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f5999ea6640 1 -- 172.21.15.81:0/2963194877 learned_addr learned my addr 172.21.15.81:0/2963194877 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f59996a5640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5994161c80 0x7f59941f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f599a6a7640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5994162060 0x7f59940cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f5999ea6640 1 -- 172.21.15.81:0/2963194877 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5994161c80 msgr2=0x7f59941f3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f5999ea6640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5994161c80 0x7f59941f3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f5999ea6640 1 -- 172.21.15.81:0/2963194877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5994162060 msgr2=0x7f59940cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f5999ea6640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5994162060 0x7f59940cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f5999ea6640 1 -- 172.21.15.81:0/2963194877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5994159d30 con 0x7f59940b64b0 2024-09-16T01:22:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f599a6a7640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5994162060 0x7f59940cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f5999ea6640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59940b64b0 0x7f59940ce4b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f599000c490 tx=0x7f599000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f598a7fc640 1 -- 172.21.15.81:0/2963194877 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59900052d0 con 0x7f59940b64b0 2024-09-16T01:22:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f598a7fc640 1 -- 172.21.15.81:0/2963194877 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5990005470 con 0x7f59940b64b0 2024-09-16T01:22:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f599c10a640 1 -- 172.21.15.81:0/2963194877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59941f7930 con 0x7f59940b64b0 2024-09-16T01:22:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f598a7fc640 1 -- 172.21.15.81:0/2963194877 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990012850 con 0x7f59940b64b0 2024-09-16T01:22:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.647+0000 7f599c10a640 1 -- 172.21.15.81:0/2963194877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59941f7ef0 con 0x7f59940b64b0 2024-09-16T01:22:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.648+0000 7f599c10a640 1 -- 172.21.15.81:0/2963194877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599406dcd0 con 0x7f59940b64b0 2024-09-16T01:22:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.649+0000 7f598a7fc640 1 -- 172.21.15.81:0/2963194877 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f59900129f0 con 0x7f59940b64b0 2024-09-16T01:22:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.649+0000 7f598a7fc640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f597806c2e0 0x7f597806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.649+0000 7f598a7fc640 1 -- 172.21.15.81:0/2963194877 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f599008b1b0 con 0x7f59940b64b0 2024-09-16T01:22:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.649+0000 7f59996a5640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f597806c2e0 0x7f597806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.650+0000 7f59996a5640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f597806c2e0 0x7f597806e7a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5984034000 tx=0x7f598402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:40.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.653+0000 7f598a7fc640 1 -- 172.21.15.81:0/2963194877 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5990059790 con 0x7f59940b64b0 2024-09-16T01:22:40.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.852+0000 7f599c10a640 1 -- 172.21.15.81:0/2963194877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59940ba470 con 0x7f59940b64b0 2024-09-16T01:22:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.853+0000 7f598a7fc640 1 -- 172.21.15.81:0/2963194877 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7f5990059090 con 0x7f59940b64b0 2024-09-16T01:22:40.854 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:40.854 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"btime":"2024-09-16T01:22:40:479014+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3471922615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3471922615},{"type":"v1","addr":"172.21.15.102:6834","nonce":3471922615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6697,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/749780612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":749780612},{"type":"v1","addr":"172.21.15.81:6837","nonce":749780612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2257484883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":2257484883},{"type":"v1","addr":"172.21.15.102:6835","nonce":2257484883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:37.794648+0000","modified":"2024-09-16T01:22:39.814024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7674},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7674":{"gid":7674,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2398957156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2398957156},{"type":"v1","addr":"172.21.15.81:6835","nonce":2398957156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7674,"qdb_cluster":[7674]},"id":9}]} 2024-09-16T01:22:40.854 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2024-09-16T01:22:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.855+0000 7f599c10a640 1 -- 172.21.15.81:0/2963194877 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f597806c2e0 msgr2=0x7f597806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.855+0000 7f599c10a640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f597806c2e0 0x7f597806e7a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5984034000 tx=0x7f598402e000 comp rx=0 tx=0).stop 2024-09-16T01:22:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.855+0000 7f599c10a640 1 -- 172.21.15.81:0/2963194877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59940b64b0 msgr2=0x7f59940ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.855+0000 7f599c10a640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59940b64b0 0x7f59940ce4b0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f599000c490 tx=0x7f599000c950 comp rx=0 tx=0).stop 2024-09-16T01:22:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.855+0000 7f599c10a640 1 -- 172.21.15.81:0/2963194877 shutdown_connections 2024-09-16T01:22:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.855+0000 7f599c10a640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f597806c2e0 0x7f597806e7a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.855+0000 7f599c10a640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5994162060 0x7f59940cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.855+0000 7f599c10a640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5994161c80 0x7f59941f3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.855+0000 7f599c10a640 1 --2- 172.21.15.81:0/2963194877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59940b64b0 0x7f59940ce4b0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.855+0000 7f599c10a640 1 -- 172.21.15.81:0/2963194877 >> 172.21.15.81:0/2963194877 conn(0x7f59940d44f0 msgr2=0x7f59941562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:40.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.855+0000 7f599c10a640 1 -- 172.21.15.81:0/2963194877 shutdown_connections 2024-09-16T01:22:40.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.855+0000 7f599c10a640 1 -- 172.21.15.81:0/2963194877 wait complete. 2024-09-16T01:22:40.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:22:40.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.965+0000 7f9350027640 1 Processor -- start 2024-09-16T01:22:40.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.965+0000 7f9350027640 1 -- start start 2024-09-16T01:22:40.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f9350027640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9348161c80 0x7f934806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f9350027640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f93480b6680 0x7f93480cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f9350027640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934806e870 con 0x7f9348162060 2024-09-16T01:22:40.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f9350027640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f934806d9f0 con 0x7f93480b6680 2024-09-16T01:22:40.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f9350027640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f934806dcd0 con 0x7f9348161c80 2024-09-16T01:22:40.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934d5c2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9348162060 0x7f93480b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42248/0 (socket says 172.21.15.81:42248) 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934d5c2640 1 -- 172.21.15.81:0/3281107696 learned_addr learned my addr 172.21.15.81:0/3281107696 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934e5c4640 1 --2- 172.21.15.81:0/3281107696 >> v2:172.21.15.102:3300/0 conn(0x7f93480b6680 0x7f93480cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934ddc3640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9348161c80 0x7f934806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493567937 0 0) 0x7f9344001110 con 0x7f9348162060 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9334003520 con 0x7f9348162060 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 194034997 0 0) 0x7f9334003520 con 0x7f9348162060 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9348161c80 msgr2=0x7f934806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9348161c80 0x7f934806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 >> v2:172.21.15.102:3300/0 conn(0x7f93480b6680 msgr2=0x7f93480cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 --2- 172.21.15.81:0/3281107696 >> v2:172.21.15.102:3300/0 conn(0x7f93480b6680 0x7f93480cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934806dfb0 con 0x7f9348162060 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f9344001840 con 0x7f9348162060 2024-09-16T01:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 >> v1:172.21.15.81:6789/0 conn(0x7f9348162060 legacy=0x7f93480b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93340039b0 0x7f9334003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9348161c80 0x7f9334004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9334004d40 0x7f93340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f934806d9f0 con 0x7f93340039b0 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f934806dcd0 con 0x7f9334004d40 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f933400b9c0 con 0x7f9348161c80 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934e5c4640 1 --2- 172.21.15.81:0/3281107696 >> v2:172.21.15.102:3300/0 conn(0x7f93480b6680 0x7f93480cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.966+0000 7f934ddc3640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93340039b0 0x7f9334003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.967+0000 7f934d5c2640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9348161c80 0x7f9334004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.967+0000 7f934e5c4640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9334004d40 0x7f93340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.967+0000 7f934ddc3640 1 -- 172.21.15.81:0/3281107696 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9348161c80 msgr2=0x7f9334004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.967+0000 7f934ddc3640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9348161c80 0x7f9334004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.967+0000 7f934ddc3640 1 -- 172.21.15.81:0/3281107696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9334004d40 msgr2=0x7f93340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.967+0000 7f934ddc3640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9334004d40 0x7f93340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.967+0000 7f934ddc3640 1 -- 172.21.15.81:0/3281107696 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9334003520 con 0x7f93340039b0 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.967+0000 7f934e5c4640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9334004d40 0x7f93340051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.967+0000 7f934ddc3640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93340039b0 0x7f9334003dd0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f933c009ac0 tx=0x7f9334005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1aa197886375d79 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.968+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c036070 con 0x7f93340039b0 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.968+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933c031400 con 0x7f93340039b0 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.968+0000 7f934cdc1640 1 -- 172.21.15.81:0/3281107696 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c009690 con 0x7f93340039b0 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.968+0000 7f9350027640 1 -- 172.21.15.81:0/3281107696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93340039b0 msgr2=0x7f9334003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.968+0000 7f9350027640 1 --2- 172.21.15.81:0/3281107696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93340039b0 0x7f9334003dd0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f933c009ac0 tx=0x7f9334005830 comp rx=0 tx=0).stop 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.968+0000 7f934e5c4640 1 -- 172.21.15.81:0/3281107696 reap_dead start 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.968+0000 7f9350027640 1 -- 172.21.15.81:0/3281107696 shutdown_connections 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.968+0000 7f9350027640 1 -- 172.21.15.81:0/3281107696 >> 172.21.15.81:0/3281107696 conn(0x7f93480d44f0 msgr2=0x7f93480d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.968+0000 7f9350027640 1 -- 172.21.15.81:0/3281107696 shutdown_connections 2024-09-16T01:22:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.968+0000 7f9350027640 1 -- 172.21.15.81:0/3281107696 wait complete. 2024-09-16T01:22:40.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.969+0000 7f9350027640 1 Processor -- start 2024-09-16T01:22:40.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.969+0000 7f9350027640 1 -- start start 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.970+0000 7f9350027640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93340039b0 0x7f93480b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.970+0000 7f9350027640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93480b8fa0 0x7f93481562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.970+0000 7f9350027640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9348156830 0x7f934815e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.970+0000 7f9350027640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93480b6b30 con 0x7f9348156830 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.970+0000 7f9350027640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f93480d2aa0 con 0x7f93340039b0 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.970+0000 7f9350027640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f93480b6cb0 con 0x7f93480b8fa0 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.970+0000 7f934e5c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9348156830 0x7f934815e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.970+0000 7f934e5c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9348156830 0x7f934815e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43620/0 (socket says 172.21.15.81:43620) 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.970+0000 7f934e5c4640 1 -- 172.21.15.81:0/508158878 learned_addr learned my addr 172.21.15.81:0/508158878 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.970+0000 7f934d5c2640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93480b8fa0 0x7f93481562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.970+0000 7f934e5c4640 1 -- 172.21.15.81:0/508158878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93480b8fa0 msgr2=0x7f93481562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.970+0000 7f934ddc3640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93340039b0 0x7f93480b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.971+0000 7f934e5c4640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93480b8fa0 0x7f93481562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.971+0000 7f934e5c4640 1 -- 172.21.15.81:0/508158878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93340039b0 msgr2=0x7f93480b8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.971+0000 7f934e5c4640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93340039b0 0x7f93480b8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.971+0000 7f934e5c4640 1 -- 172.21.15.81:0/508158878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93480b9470 con 0x7f9348156830 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.971+0000 7f934e5c4640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9348156830 0x7f934815e590 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f9348162460 tx=0x7f93400115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.971+0000 7f933a7fc640 1 -- 172.21.15.81:0/508158878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340003990 con 0x7f9348156830 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.971+0000 7f933a7fc640 1 -- 172.21.15.81:0/508158878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f934001b070 con 0x7f9348156830 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.971+0000 7f9350027640 1 -- 172.21.15.81:0/508158878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93480b9750 con 0x7f9348156830 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.971+0000 7f933a7fc640 1 -- 172.21.15.81:0/508158878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340003b30 con 0x7f9348156830 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.971+0000 7f9350027640 1 -- 172.21.15.81:0/508158878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93480b9d10 con 0x7f9348156830 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.972+0000 7f9350027640 1 -- 172.21.15.81:0/508158878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934806e330 con 0x7f9348156830 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.972+0000 7f933a7fc640 1 -- 172.21.15.81:0/508158878 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9340005d10 con 0x7f9348156830 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.973+0000 7f933a7fc640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f932c06c2b0 0x7f932c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:40.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.973+0000 7f933a7fc640 1 -- 172.21.15.81:0/508158878 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f934008bce0 con 0x7f9348156830 2024-09-16T01:22:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.973+0000 7f934ddc3640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f932c06c2b0 0x7f932c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.973+0000 7f934ddc3640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f932c06c2b0 0x7f932c06e770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f933c033000 tx=0x7f933c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:40.977+0000 7f933a7fc640 1 -- 172.21.15.81:0/508158878 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9340025020 con 0x7f9348156830 2024-09-16T01:22:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.145+0000 7f9350027640 1 -- 172.21.15.81:0/508158878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93480b5ed0 con 0x7f9348156830 2024-09-16T01:22:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.146+0000 7f933a7fc640 1 -- 172.21.15.81:0/508158878 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+16960 (secure 0 0 0) 0x7f934005a2c0 con 0x7f9348156830 2024-09-16T01:22:41.147 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:41.147 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":125,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:22:39.466201+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:22:36.412957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-16T01:22:36.768111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:22:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.148+0000 7f9350027640 1 -- 172.21.15.81:0/508158878 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f932c06c2b0 msgr2=0x7f932c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.148+0000 7f9350027640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f932c06c2b0 0x7f932c06e770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f933c033000 tx=0x7f933c008030 comp rx=0 tx=0).stop 2024-09-16T01:22:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.148+0000 7f9350027640 1 -- 172.21.15.81:0/508158878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9348156830 msgr2=0x7f934815e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.148+0000 7f9350027640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9348156830 0x7f934815e590 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f9348162460 tx=0x7f93400115a0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.148+0000 7f9350027640 1 -- 172.21.15.81:0/508158878 shutdown_connections 2024-09-16T01:22:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.148+0000 7f9350027640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f932c06c2b0 0x7f932c06e770 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.148+0000 7f9350027640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9348156830 0x7f934815e590 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.148+0000 7f9350027640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f93480b8fa0 0x7f93481562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.148+0000 7f9350027640 1 --2- 172.21.15.81:0/508158878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f93340039b0 0x7f93480b8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.148+0000 7f9350027640 1 -- 172.21.15.81:0/508158878 >> 172.21.15.81:0/508158878 conn(0x7f93480d44f0 msgr2=0x7f93480cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.148+0000 7f9350027640 1 -- 172.21.15.81:0/508158878 shutdown_connections 2024-09-16T01:22:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.148+0000 7f9350027640 1 -- 172.21.15.81:0/508158878 wait complete. 2024-09-16T01:22:41.160 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:22:41.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:22:41.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.256+0000 7f06130eb640 1 Processor -- start 2024-09-16T01:22:41.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.256+0000 7f06130eb640 1 -- start start 2024-09-16T01:22:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.257+0000 7f06130eb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f060c15ba30 0x7f060c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.257+0000 7f06130eb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f060c06fd50 0x7f060c072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.257+0000 7f06130eb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f060c0b3570 con 0x7f060c072e80 2024-09-16T01:22:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.257+0000 7f06130eb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f060c0b4180 con 0x7f060c06fd50 2024-09-16T01:22:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.257+0000 7f06130eb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f060c0b3850 con 0x7f060c15ba30 2024-09-16T01:22:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.257+0000 7f060bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f060c06fd50 0x7f060c072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.257+0000 7f0611688640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f060c072e80 0x7f060c06e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51478/0 (socket says 172.21.15.81:51478) 2024-09-16T01:22:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.257+0000 7f060bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f060c06fd50 0x7f060c072940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37286/0 (socket says 172.21.15.81:37286) 2024-09-16T01:22:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.257+0000 7f0611688640 1 -- 172.21.15.81:0/2520307084 learned_addr learned my addr 172.21.15.81:0/2520307084 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.257+0000 7f0610e87640 1 --2- 172.21.15.81:0/2520307084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f060c15ba30 0x7f060c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.258+0000 7f060bfff640 1 -- 172.21.15.81:0/2520307084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f060c15ba30 msgr2=0x7f060c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.258+0000 7f060bfff640 1 --2- 172.21.15.81:0/2520307084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f060c15ba30 0x7f060c06f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.258+0000 7f060bfff640 1 -- 172.21.15.81:0/2520307084 >> v1:172.21.15.81:6789/0 conn(0x7f060c072e80 legacy=0x7f060c06e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.258+0000 7f060bfff640 1 -- 172.21.15.81:0/2520307084 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060c0b3b30 con 0x7f060c06fd50 2024-09-16T01:22:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.258+0000 7f060b7fe640 1 -- 172.21.15.81:0/2520307084 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2272706779 0 0) 0x7f060c0b3570 con 0x7f060c072e80 2024-09-16T01:22:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.258+0000 7f060bfff640 1 --2- 172.21.15.81:0/2520307084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c06fd50 0x7f060c072940 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f06000097a0 tx=0x7f060002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df97c7514cfe3ee server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.258+0000 7f060b7fe640 1 -- 172.21.15.81:0/2520307084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0600037070 con 0x7f060c06fd50 2024-09-16T01:22:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.258+0000 7f060b7fe640 1 -- 172.21.15.81:0/2520307084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0600032440 con 0x7f060c06fd50 2024-09-16T01:22:41.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.258+0000 7f060b7fe640 1 -- 172.21.15.81:0/2520307084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0600032810 con 0x7f060c06fd50 2024-09-16T01:22:41.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.259+0000 7f06130eb640 1 -- 172.21.15.81:0/2520307084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c06fd50 msgr2=0x7f060c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.259+0000 7f06130eb640 1 --2- 172.21.15.81:0/2520307084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c06fd50 0x7f060c072940 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f06000097a0 tx=0x7f060002a180 comp rx=0 tx=0).stop 2024-09-16T01:22:41.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.259+0000 7f06130eb640 1 -- 172.21.15.81:0/2520307084 shutdown_connections 2024-09-16T01:22:41.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.259+0000 7f06130eb640 1 --2- 172.21.15.81:0/2520307084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c06fd50 0x7f060c072940 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.259+0000 7f06130eb640 1 --2- 172.21.15.81:0/2520307084 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f060c15ba30 0x7f060c06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.259+0000 7f06130eb640 1 -- 172.21.15.81:0/2520307084 >> 172.21.15.81:0/2520307084 conn(0x7f060c067d70 msgr2=0x7f060c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:41.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.259+0000 7f06130eb640 1 -- 172.21.15.81:0/2520307084 shutdown_connections 2024-09-16T01:22:41.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.259+0000 7f06130eb640 1 -- 172.21.15.81:0/2520307084 wait complete. 2024-09-16T01:22:41.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.260+0000 7f06130eb640 1 Processor -- start 2024-09-16T01:22:41.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.260+0000 7f06130eb640 1 -- start start 2024-09-16T01:22:41.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f06130eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c06fd50 0x7f060c14d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f06130eb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f060c072e80 0x7f060c154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f06130eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f060c15ba30 0x7f060c156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f06130eb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f060c0b5890 con 0x7f060c06fd50 2024-09-16T01:22:41.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f06130eb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f060c0ce810 con 0x7f060c15ba30 2024-09-16T01:22:41.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f06130eb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f060c0b5a10 con 0x7f060c072e80 2024-09-16T01:22:41.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f0610e87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c06fd50 0x7f060c14d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f0610e87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c06fd50 0x7f060c14d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37292/0 (socket says 172.21.15.81:37292) 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f0610e87640 1 -- 172.21.15.81:0/1985533604 learned_addr learned my addr 172.21.15.81:0/1985533604 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f060bfff640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f060c072e80 0x7f060c154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f0611688640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f060c15ba30 0x7f060c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f0610e87640 1 -- 172.21.15.81:0/1985533604 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f060c072e80 msgr2=0x7f060c154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f0610e87640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f060c072e80 0x7f060c154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f0610e87640 1 -- 172.21.15.81:0/1985533604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f060c15ba30 msgr2=0x7f060c156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f0610e87640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f060c15ba30 0x7f060c156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.261+0000 7f0610e87640 1 -- 172.21.15.81:0/1985533604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060c14bf80 con 0x7f060c06fd50 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.262+0000 7f0610e87640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c06fd50 0x7f060c14d360 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00d5f0 tx=0x7f05fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.262+0000 7f06097fa640 1 -- 172.21.15.81:0/1985533604 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc0125f0 con 0x7f060c06fd50 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.262+0000 7f06097fa640 1 -- 172.21.15.81:0/1985533604 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05fc019070 con 0x7f060c06fd50 2024-09-16T01:22:41.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.262+0000 7f06130eb640 1 -- 172.21.15.81:0/1985533604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060c14b0b0 con 0x7f060c06fd50 2024-09-16T01:22:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.262+0000 7f06097fa640 1 -- 172.21.15.81:0/1985533604 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc0129d0 con 0x7f060c06fd50 2024-09-16T01:22:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.262+0000 7f06130eb640 1 -- 172.21.15.81:0/1985533604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f060c158fa0 con 0x7f060c06fd50 2024-09-16T01:22:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.263+0000 7f06130eb640 1 -- 172.21.15.81:0/1985533604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f060c1566a0 con 0x7f060c06fd50 2024-09-16T01:22:41.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.263+0000 7f06097fa640 1 -- 172.21.15.81:0/1985533604 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f05fc012b70 con 0x7f060c06fd50 2024-09-16T01:22:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.264+0000 7f06097fa640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f05f806c2b0 0x7f05f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.264+0000 7f06097fa640 1 -- 172.21.15.81:0/1985533604 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f05fc08b830 con 0x7f060c06fd50 2024-09-16T01:22:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.264+0000 7f060bfff640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f05f806c2b0 0x7f05f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.264+0000 7f060bfff640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f05f806c2b0 0x7f05f806e770 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0600034000 tx=0x7f060002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:41.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.268+0000 7f06097fa640 1 -- 172.21.15.81:0/1985533604 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f060c1566a0 con 0x7f060c06fd50 2024-09-16T01:22:41.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.431+0000 7f06130eb640 1 -- 172.21.15.81:0/1985533604 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f060c14af00 con 0x7f05f806c2b0 2024-09-16T01:22:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.437+0000 7f06097fa640 1 -- 172.21.15.81:0/1985533604 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247090 (secure 0 0 0) 0x7f060c14af00 con 0x7f05f806c2b0 2024-09-16T01:22:41.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:41.442 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:22:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.440+0000 7f06130eb640 1 -- 172.21.15.81:0/1985533604 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f05f806c2b0 msgr2=0x7f05f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.440+0000 7f06130eb640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f05f806c2b0 0x7f05f806e770 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0600034000 tx=0x7f060002e000 comp rx=0 tx=0).stop 2024-09-16T01:22:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.440+0000 7f06130eb640 1 -- 172.21.15.81:0/1985533604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c06fd50 msgr2=0x7f060c14d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.440+0000 7f06130eb640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c06fd50 0x7f060c14d360 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00d5f0 tx=0x7f05fc00dab0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.440+0000 7f06130eb640 1 -- 172.21.15.81:0/1985533604 shutdown_connections 2024-09-16T01:22:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.440+0000 7f06130eb640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f05f806c2b0 0x7f05f806e770 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.440+0000 7f06130eb640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f060c15ba30 0x7f060c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.440+0000 7f06130eb640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f060c072e80 0x7f060c154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.440+0000 7f06130eb640 1 --2- 172.21.15.81:0/1985533604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c06fd50 0x7f060c14d360 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.440+0000 7f06130eb640 1 -- 172.21.15.81:0/1985533604 >> 172.21.15.81:0/1985533604 conn(0x7f060c067d70 msgr2=0x7f060c0cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.440+0000 7f06130eb640 1 -- 172.21.15.81:0/1985533604 shutdown_connections 2024-09-16T01:22:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.440+0000 7f06130eb640 1 -- 172.21.15.81:0/1985533604 wait complete. 2024-09-16T01:22:41.452 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-16T01:22:40.151258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266868,"kb_used_data":13168,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754707852,"statfs":{"total":773094113280,"available":772820840448,"internally_reserved":0,"allocated":13484032,"data_stored":6830794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000886"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459930+0000","last_change":"2024-09-16T01:22:37.459930+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459930+0000","last_undegraded":"2024-09-16T01:22:37.459930+0000","last_fullsized":"2024-09-16T01:22:37.459930+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462073+0000","last_change":"2024-09-16T01:22:37.462073+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462073+0000","last_undegraded":"2024-09-16T01:22:37.462073+0000","last_fullsized":"2024-09-16T01:22:37.462073+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458082+0000","last_change":"2024-09-16T01:22:37.458082+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458082+0000","last_undegraded":"2024-09-16T01:22:37.458082+0000","last_fullsized":"2024-09-16T01:22:37.458082+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458453+0000","last_change":"2024-09-16T01:22:37.458453+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458453+0000","last_undegraded":"2024-09-16T01:22:37.458453+0000","last_fullsized":"2024-09-16T01:22:37.458453+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.464247+0000","last_change":"2024-09-16T01:22:37.464247+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.464247+0000","last_undegraded":"2024-09-16T01:22:37.464247+0000","last_fullsized":"2024-09-16T01:22:37.464247+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462671+0000","last_change":"2024-09-16T01:22:37.462671+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462671+0000","last_undegraded":"2024-09-16T01:22:37.462671+0000","last_fullsized":"2024-09-16T01:22:37.462671+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461888+0000","last_change":"2024-09-16T01:22:37.461888+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461888+0000","last_undegraded":"2024-09-16T01:22:37.461888+0000","last_fullsized":"2024-09-16T01:22:37.461888+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459698+0000","last_change":"2024-09-16T01:22:37.459698+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459698+0000","last_undegraded":"2024-09-16T01:22:37.459698+0000","last_fullsized":"2024-09-16T01:22:37.459698+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462682+0000","last_change":"2024-09-16T01:22:37.462682+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462682+0000","last_undegraded":"2024-09-16T01:22:37.462682+0000","last_fullsized":"2024-09-16T01:22:37.462682+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462998+0000","last_change":"2024-09-16T01:22:37.462998+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462998+0000","last_undegraded":"2024-09-16T01:22:37.462998+0000","last_fullsized":"2024-09-16T01:22:37.462998+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460346+0000","last_change":"2024-09-16T01:22:37.460346+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460346+0000","last_undegraded":"2024-09-16T01:22:37.460346+0000","last_fullsized":"2024-09-16T01:22:37.460346+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458937+0000","last_change":"2024-09-16T01:22:37.458937+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458937+0000","last_undegraded":"2024-09-16T01:22:37.458937+0000","last_fullsized":"2024-09-16T01:22:37.458937+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462620+0000","last_change":"2024-09-16T01:22:37.462620+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462620+0000","last_undegraded":"2024-09-16T01:22:37.462620+0000","last_fullsized":"2024-09-16T01:22:37.462620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458722+0000","last_change":"2024-09-16T01:22:37.458722+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458722+0000","last_undegraded":"2024-09-16T01:22:37.458722+0000","last_fullsized":"2024-09-16T01:22:37.458722+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459852+0000","last_change":"2024-09-16T01:22:37.459852+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459852+0000","last_undegraded":"2024-09-16T01:22:37.459852+0000","last_fullsized":"2024-09-16T01:22:37.459852+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.464088+0000","last_change":"2024-09-16T01:22:37.464088+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.464088+0000","last_undegraded":"2024-09-16T01:22:37.464088+0000","last_fullsized":"2024-09-16T01:22:37.464088+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462170+0000","last_change":"2024-09-16T01:22:37.462170+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462170+0000","last_undegraded":"2024-09-16T01:22:37.462170+0000","last_fullsized":"2024-09-16T01:22:37.462170+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463680+0000","last_change":"2024-09-16T01:22:37.463680+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463680+0000","last_undegraded":"2024-09-16T01:22:37.463680+0000","last_fullsized":"2024-09-16T01:22:37.463680+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462447+0000","last_change":"2024-09-16T01:22:37.462447+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462447+0000","last_undegraded":"2024-09-16T01:22:37.462447+0000","last_fullsized":"2024-09-16T01:22:37.462447+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462824+0000","last_change":"2024-09-16T01:22:37.462824+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462824+0000","last_undegraded":"2024-09-16T01:22:37.462824+0000","last_fullsized":"2024-09-16T01:22:37.462824+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456629+0000","last_change":"2024-09-16T01:22:37.456629+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456629+0000","last_undegraded":"2024-09-16T01:22:37.456629+0000","last_fullsized":"2024-09-16T01:22:37.456629+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.467780+0000","last_change":"2024-09-16T01:22:37.467780+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.467780+0000","last_undegraded":"2024-09-16T01:22:37.467780+0000","last_fullsized":"2024-09-16T01:22:37.467780+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456664+0000","last_change":"2024-09-16T01:22:37.456664+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456664+0000","last_undegraded":"2024-09-16T01:22:37.456664+0000","last_fullsized":"2024-09-16T01:22:37.456664+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460799+0000","last_change":"2024-09-16T01:22:37.460799+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460799+0000","last_undegraded":"2024-09-16T01:22:37.460799+0000","last_fullsized":"2024-09-16T01:22:37.460799+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458477+0000","last_change":"2024-09-16T01:22:37.458477+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458477+0000","last_undegraded":"2024-09-16T01:22:37.458477+0000","last_fullsized":"2024-09-16T01:22:37.458477+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.457611+0000","last_change":"2024-09-16T01:22:37.457611+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.457611+0000","last_undegraded":"2024-09-16T01:22:37.457611+0000","last_fullsized":"2024-09-16T01:22:37.457611+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460523+0000","last_change":"2024-09-16T01:22:37.460523+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460523+0000","last_undegraded":"2024-09-16T01:22:37.460523+0000","last_fullsized":"2024-09-16T01:22:37.460523+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463848+0000","last_change":"2024-09-16T01:22:37.463848+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463848+0000","last_undegraded":"2024-09-16T01:22:37.463848+0000","last_fullsized":"2024-09-16T01:22:37.463848+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459671+0000","last_change":"2024-09-16T01:22:37.459671+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459671+0000","last_undegraded":"2024-09-16T01:22:37.459671+0000","last_fullsized":"2024-09-16T01:22:37.459671+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456725+0000","last_change":"2024-09-16T01:22:37.456725+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456725+0000","last_undegraded":"2024-09-16T01:22:37.456725+0000","last_fullsized":"2024-09-16T01:22:37.456725+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461713+0000","last_change":"2024-09-16T01:22:37.461713+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461713+0000","last_undegraded":"2024-09-16T01:22:37.461713+0000","last_fullsized":"2024-09-16T01:22:37.461713+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461958+0000","last_change":"2024-09-16T01:22:37.461958+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461958+0000","last_undegraded":"2024-09-16T01:22:37.461958+0000","last_fullsized":"2024-09-16T01:22:37.461958+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459229+0000","last_change":"2024-09-16T01:22:37.459229+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459229+0000","last_undegraded":"2024-09-16T01:22:37.459229+0000","last_fullsized":"2024-09-16T01:22:37.459229+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476726+0000","last_change":"2024-09-16T01:22:37.473828+0000","last_active":"2024-09-16T01:22:37.476726+0000","last_peered":"2024-09-16T01:22:37.476726+0000","last_clean":"2024-09-16T01:22:37.476726+0000","last_became_active":"2024-09-16T01:22:37.473523+0000","last_became_peered":"2024-09-16T01:22:37.473523+0000","last_unstale":"2024-09-16T01:22:37.476726+0000","last_undegraded":"2024-09-16T01:22:37.476726+0000","last_fullsized":"2024-09-16T01:22:37.476726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:47.484184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458521+0000","last_change":"2024-09-16T01:22:37.458521+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458521+0000","last_undegraded":"2024-09-16T01:22:37.458521+0000","last_fullsized":"2024-09-16T01:22:37.458521+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471465+0000","last_change":"2024-09-16T01:22:37.469361+0000","last_active":"2024-09-16T01:22:37.471465+0000","last_peered":"2024-09-16T01:22:37.471465+0000","last_clean":"2024-09-16T01:22:37.471465+0000","last_became_active":"2024-09-16T01:22:37.469091+0000","last_became_peered":"2024-09-16T01:22:37.469091+0000","last_unstale":"2024-09-16T01:22:37.471465+0000","last_undegraded":"2024-09-16T01:22:37.471465+0000","last_fullsized":"2024-09-16T01:22:37.471465+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:06.683640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456135+0000","last_change":"2024-09-16T01:22:37.456135+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456135+0000","last_undegraded":"2024-09-16T01:22:37.456135+0000","last_fullsized":"2024-09-16T01:22:37.456135+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477095+0000","last_change":"2024-09-16T01:22:37.472329+0000","last_active":"2024-09-16T01:22:37.477095+0000","last_peered":"2024-09-16T01:22:37.477095+0000","last_clean":"2024-09-16T01:22:37.477095+0000","last_became_active":"2024-09-16T01:22:37.471993+0000","last_became_peered":"2024-09-16T01:22:37.471993+0000","last_unstale":"2024-09-16T01:22:37.477095+0000","last_undegraded":"2024-09-16T01:22:37.477095+0000","last_fullsized":"2024-09-16T01:22:37.477095+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:41.536663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.467144+0000","last_change":"2024-09-16T01:22:37.467144+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.467144+0000","last_undegraded":"2024-09-16T01:22:37.467144+0000","last_fullsized":"2024-09-16T01:22:37.467144+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477115+0000","last_change":"2024-09-16T01:22:37.472495+0000","last_active":"2024-09-16T01:22:37.477115+0000","last_peered":"2024-09-16T01:22:37.477115+0000","last_clean":"2024-09-16T01:22:37.477115+0000","last_became_active":"2024-09-16T01:22:37.472218+0000","last_became_peered":"2024-09-16T01:22:37.472218+0000","last_unstale":"2024-09-16T01:22:37.477115+0000","last_undegraded":"2024-09-16T01:22:37.477115+0000","last_fullsized":"2024-09-16T01:22:37.477115+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:11.681815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462726+0000","last_change":"2024-09-16T01:22:37.462726+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462726+0000","last_undegraded":"2024-09-16T01:22:37.462726+0000","last_fullsized":"2024-09-16T01:22:37.462726+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474208+0000","last_change":"2024-09-16T01:22:37.469230+0000","last_active":"2024-09-16T01:22:37.474208+0000","last_peered":"2024-09-16T01:22:37.474208+0000","last_clean":"2024-09-16T01:22:37.474208+0000","last_became_active":"2024-09-16T01:22:37.468906+0000","last_became_peered":"2024-09-16T01:22:37.468906+0000","last_unstale":"2024-09-16T01:22:37.474208+0000","last_undegraded":"2024-09-16T01:22:37.474208+0000","last_fullsized":"2024-09-16T01:22:37.474208+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462376+0000","last_change":"2024-09-16T01:22:37.462376+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462376+0000","last_undegraded":"2024-09-16T01:22:37.462376+0000","last_fullsized":"2024-09-16T01:22:37.462376+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.473368+0000","last_change":"2024-09-16T01:22:37.472506+0000","last_active":"2024-09-16T01:22:37.473368+0000","last_peered":"2024-09-16T01:22:37.473368+0000","last_clean":"2024-09-16T01:22:37.473368+0000","last_became_active":"2024-09-16T01:22:37.472177+0000","last_became_peered":"2024-09-16T01:22:37.472177+0000","last_unstale":"2024-09-16T01:22:37.473368+0000","last_undegraded":"2024-09-16T01:22:37.473368+0000","last_fullsized":"2024-09-16T01:22:37.473368+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:21.137299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463249+0000","last_change":"2024-09-16T01:22:37.463249+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463249+0000","last_undegraded":"2024-09-16T01:22:37.463249+0000","last_fullsized":"2024-09-16T01:22:37.463249+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472887+0000","last_change":"2024-09-16T01:22:37.464769+0000","last_active":"2024-09-16T01:22:37.472887+0000","last_peered":"2024-09-16T01:22:37.472887+0000","last_clean":"2024-09-16T01:22:37.472887+0000","last_became_active":"2024-09-16T01:22:37.464432+0000","last_became_peered":"2024-09-16T01:22:37.464432+0000","last_unstale":"2024-09-16T01:22:37.472887+0000","last_undegraded":"2024-09-16T01:22:37.472887+0000","last_fullsized":"2024-09-16T01:22:37.472887+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:24.269797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461252+0000","last_change":"2024-09-16T01:22:37.461252+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461252+0000","last_undegraded":"2024-09-16T01:22:37.461252+0000","last_fullsized":"2024-09-16T01:22:37.461252+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.466893+0000","last_change":"2024-09-16T01:22:37.466155+0000","last_active":"2024-09-16T01:22:37.466893+0000","last_peered":"2024-09-16T01:22:37.466893+0000","last_clean":"2024-09-16T01:22:37.466893+0000","last_became_active":"2024-09-16T01:22:37.465891+0000","last_became_peered":"2024-09-16T01:22:37.465891+0000","last_unstale":"2024-09-16T01:22:37.466893+0000","last_undegraded":"2024-09-16T01:22:37.466893+0000","last_fullsized":"2024-09-16T01:22:37.466893+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:58.533695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458512+0000","last_change":"2024-09-16T01:22:37.458512+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458512+0000","last_undegraded":"2024-09-16T01:22:37.458512+0000","last_fullsized":"2024-09-16T01:22:37.458512+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.468786+0000","last_change":"2024-09-16T01:22:37.466248+0000","last_active":"2024-09-16T01:22:37.468786+0000","last_peered":"2024-09-16T01:22:37.468786+0000","last_clean":"2024-09-16T01:22:37.468786+0000","last_became_active":"2024-09-16T01:22:37.465956+0000","last_became_peered":"2024-09-16T01:22:37.465956+0000","last_unstale":"2024-09-16T01:22:37.468786+0000","last_undegraded":"2024-09-16T01:22:37.468786+0000","last_fullsized":"2024-09-16T01:22:37.468786+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:24.269797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460932+0000","last_change":"2024-09-16T01:22:37.460932+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460932+0000","last_undegraded":"2024-09-16T01:22:37.460932+0000","last_fullsized":"2024-09-16T01:22:37.460932+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477316+0000","last_change":"2024-09-16T01:22:37.476174+0000","last_active":"2024-09-16T01:22:37.477316+0000","last_peered":"2024-09-16T01:22:37.477316+0000","last_clean":"2024-09-16T01:22:37.477316+0000","last_became_active":"2024-09-16T01:22:37.475897+0000","last_became_peered":"2024-09-16T01:22:37.475897+0000","last_unstale":"2024-09-16T01:22:37.477316+0000","last_undegraded":"2024-09-16T01:22:37.477316+0000","last_fullsized":"2024-09-16T01:22:37.477316+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:58.401908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456287+0000","last_change":"2024-09-16T01:22:37.456287+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456287+0000","last_undegraded":"2024-09-16T01:22:37.456287+0000","last_fullsized":"2024-09-16T01:22:37.456287+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477054+0000","last_change":"2024-09-16T01:22:37.471374+0000","last_active":"2024-09-16T01:22:37.477054+0000","last_peered":"2024-09-16T01:22:37.477054+0000","last_clean":"2024-09-16T01:22:37.477054+0000","last_became_active":"2024-09-16T01:22:37.471086+0000","last_became_peered":"2024-09-16T01:22:37.471086+0000","last_unstale":"2024-09-16T01:22:37.477054+0000","last_undegraded":"2024-09-16T01:22:37.477054+0000","last_fullsized":"2024-09-16T01:22:37.477054+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:57.246038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456859+0000","last_change":"2024-09-16T01:22:37.456859+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456859+0000","last_undegraded":"2024-09-16T01:22:37.456859+0000","last_fullsized":"2024-09-16T01:22:37.456859+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476726+0000","last_change":"2024-09-16T01:22:37.469445+0000","last_active":"2024-09-16T01:22:37.476726+0000","last_peered":"2024-09-16T01:22:37.476726+0000","last_clean":"2024-09-16T01:22:37.476726+0000","last_became_active":"2024-09-16T01:22:37.469160+0000","last_became_peered":"2024-09-16T01:22:37.469160+0000","last_unstale":"2024-09-16T01:22:37.476726+0000","last_undegraded":"2024-09-16T01:22:37.476726+0000","last_fullsized":"2024-09-16T01:22:37.476726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:38.021847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463436+0000","last_change":"2024-09-16T01:22:37.463436+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463436+0000","last_undegraded":"2024-09-16T01:22:37.463436+0000","last_fullsized":"2024-09-16T01:22:37.463436+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477298+0000","last_change":"2024-09-16T01:22:37.476008+0000","last_active":"2024-09-16T01:22:37.477298+0000","last_peered":"2024-09-16T01:22:37.477298+0000","last_clean":"2024-09-16T01:22:37.477298+0000","last_became_active":"2024-09-16T01:22:37.475720+0000","last_became_peered":"2024-09-16T01:22:37.475720+0000","last_unstale":"2024-09-16T01:22:37.477298+0000","last_undegraded":"2024-09-16T01:22:37.477298+0000","last_fullsized":"2024-09-16T01:22:37.477298+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:24.873727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460709+0000","last_change":"2024-09-16T01:22:37.460709+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460709+0000","last_undegraded":"2024-09-16T01:22:37.460709+0000","last_fullsized":"2024-09-16T01:22:37.460709+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.464358+0000","last_change":"2024-09-16T01:22:37.459504+0000","last_active":"2024-09-16T01:22:37.464358+0000","last_peered":"2024-09-16T01:22:37.464358+0000","last_clean":"2024-09-16T01:22:37.464358+0000","last_became_active":"2024-09-16T01:22:37.459226+0000","last_became_peered":"2024-09-16T01:22:37.459226+0000","last_unstale":"2024-09-16T01:22:37.464358+0000","last_undegraded":"2024-09-16T01:22:37.464358+0000","last_fullsized":"2024-09-16T01:22:37.464358+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:45.701573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462831+0000","last_change":"2024-09-16T01:22:37.462831+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462831+0000","last_undegraded":"2024-09-16T01:22:37.462831+0000","last_fullsized":"2024-09-16T01:22:37.462831+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.470912+0000","last_change":"2024-09-16T01:22:37.460411+0000","last_active":"2024-09-16T01:22:37.470912+0000","last_peered":"2024-09-16T01:22:37.470912+0000","last_clean":"2024-09-16T01:22:37.470912+0000","last_became_active":"2024-09-16T01:22:37.460106+0000","last_became_peered":"2024-09-16T01:22:37.460106+0000","last_unstale":"2024-09-16T01:22:37.470912+0000","last_undegraded":"2024-09-16T01:22:37.470912+0000","last_fullsized":"2024-09-16T01:22:37.470912+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:01.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.455702+0000","last_change":"2024-09-16T01:22:37.455702+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.455702+0000","last_undegraded":"2024-09-16T01:22:37.455702+0000","last_fullsized":"2024-09-16T01:22:37.455702+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.467229+0000","last_change":"2024-09-16T01:22:37.465535+0000","last_active":"2024-09-16T01:22:37.467229+0000","last_peered":"2024-09-16T01:22:37.467229+0000","last_clean":"2024-09-16T01:22:37.467229+0000","last_became_active":"2024-09-16T01:22:37.465233+0000","last_became_peered":"2024-09-16T01:22:37.465233+0000","last_unstale":"2024-09-16T01:22:37.467229+0000","last_undegraded":"2024-09-16T01:22:37.467229+0000","last_fullsized":"2024-09-16T01:22:37.467229+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461436+0000","last_change":"2024-09-16T01:22:37.461436+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461436+0000","last_undegraded":"2024-09-16T01:22:37.461436+0000","last_fullsized":"2024-09-16T01:22:37.461436+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476664+0000","last_change":"2024-09-16T01:22:37.473710+0000","last_active":"2024-09-16T01:22:37.476664+0000","last_peered":"2024-09-16T01:22:37.476664+0000","last_clean":"2024-09-16T01:22:37.476664+0000","last_became_active":"2024-09-16T01:22:37.473344+0000","last_became_peered":"2024-09-16T01:22:37.473344+0000","last_unstale":"2024-09-16T01:22:37.476664+0000","last_undegraded":"2024-09-16T01:22:37.476664+0000","last_fullsized":"2024-09-16T01:22:37.476664+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:21:36.959019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461037+0000","last_change":"2024-09-16T01:22:37.461037+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461037+0000","last_undegraded":"2024-09-16T01:22:37.461037+0000","last_fullsized":"2024-09-16T01:22:37.461037+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471266+0000","last_change":"2024-09-16T01:22:37.463887+0000","last_active":"2024-09-16T01:22:37.471266+0000","last_peered":"2024-09-16T01:22:37.471266+0000","last_clean":"2024-09-16T01:22:37.471266+0000","last_became_active":"2024-09-16T01:22:37.463631+0000","last_became_peered":"2024-09-16T01:22:37.463631+0000","last_unstale":"2024-09-16T01:22:37.471266+0000","last_undegraded":"2024-09-16T01:22:37.471266+0000","last_fullsized":"2024-09-16T01:22:37.471266+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462038+0000","last_change":"2024-09-16T01:22:37.462038+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462038+0000","last_undegraded":"2024-09-16T01:22:37.462038+0000","last_fullsized":"2024-09-16T01:22:37.462038+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.475270+0000","last_change":"2024-09-16T01:22:37.474218+0000","last_active":"2024-09-16T01:22:37.475270+0000","last_peered":"2024-09-16T01:22:37.475270+0000","last_clean":"2024-09-16T01:22:37.475270+0000","last_became_active":"2024-09-16T01:22:37.473947+0000","last_became_peered":"2024-09-16T01:22:37.473947+0000","last_unstale":"2024-09-16T01:22:37.475270+0000","last_undegraded":"2024-09-16T01:22:37.475270+0000","last_fullsized":"2024-09-16T01:22:37.475270+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:19.356499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459557+0000","last_change":"2024-09-16T01:22:37.459557+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459557+0000","last_undegraded":"2024-09-16T01:22:37.459557+0000","last_fullsized":"2024-09-16T01:22:37.459557+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474230+0000","last_change":"2024-09-16T01:22:37.469517+0000","last_active":"2024-09-16T01:22:37.474230+0000","last_peered":"2024-09-16T01:22:37.474230+0000","last_clean":"2024-09-16T01:22:37.474230+0000","last_became_active":"2024-09-16T01:22:37.469256+0000","last_became_peered":"2024-09-16T01:22:37.469256+0000","last_unstale":"2024-09-16T01:22:37.474230+0000","last_undegraded":"2024-09-16T01:22:37.474230+0000","last_fullsized":"2024-09-16T01:22:37.474230+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:24.269797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459485+0000","last_change":"2024-09-16T01:22:37.459485+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459485+0000","last_undegraded":"2024-09-16T01:22:37.459485+0000","last_fullsized":"2024-09-16T01:22:37.459485+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472403+0000","last_change":"2024-09-16T01:22:37.469806+0000","last_active":"2024-09-16T01:22:37.472403+0000","last_peered":"2024-09-16T01:22:37.472403+0000","last_clean":"2024-09-16T01:22:37.472403+0000","last_became_active":"2024-09-16T01:22:37.469516+0000","last_became_peered":"2024-09-16T01:22:37.469516+0000","last_unstale":"2024-09-16T01:22:37.472403+0000","last_undegraded":"2024-09-16T01:22:37.472403+0000","last_fullsized":"2024-09-16T01:22:37.472403+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:37.113423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461311+0000","last_change":"2024-09-16T01:22:37.461311+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461311+0000","last_undegraded":"2024-09-16T01:22:37.461311+0000","last_fullsized":"2024-09-16T01:22:37.461311+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477145+0000","last_change":"2024-09-16T01:22:37.473724+0000","last_active":"2024-09-16T01:22:37.477145+0000","last_peered":"2024-09-16T01:22:37.477145+0000","last_clean":"2024-09-16T01:22:37.477145+0000","last_became_active":"2024-09-16T01:22:37.473345+0000","last_became_peered":"2024-09-16T01:22:37.473345+0000","last_unstale":"2024-09-16T01:22:37.477145+0000","last_undegraded":"2024-09-16T01:22:37.477145+0000","last_fullsized":"2024-09-16T01:22:37.477145+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.792365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459140+0000","last_change":"2024-09-16T01:22:37.459140+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459140+0000","last_undegraded":"2024-09-16T01:22:37.459140+0000","last_fullsized":"2024-09-16T01:22:37.459140+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472895+0000","last_change":"2024-09-16T01:22:37.466054+0000","last_active":"2024-09-16T01:22:37.472895+0000","last_peered":"2024-09-16T01:22:37.472895+0000","last_clean":"2024-09-16T01:22:37.472895+0000","last_became_active":"2024-09-16T01:22:37.465813+0000","last_became_peered":"2024-09-16T01:22:37.465813+0000","last_unstale":"2024-09-16T01:22:37.472895+0000","last_undegraded":"2024-09-16T01:22:37.472895+0000","last_fullsized":"2024-09-16T01:22:37.472895+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:15.378906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460661+0000","last_change":"2024-09-16T01:22:37.460661+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460661+0000","last_undegraded":"2024-09-16T01:22:37.460661+0000","last_fullsized":"2024-09-16T01:22:37.460661+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.475508+0000","last_change":"2024-09-16T01:22:37.473626+0000","last_active":"2024-09-16T01:22:37.475508+0000","last_peered":"2024-09-16T01:22:37.475508+0000","last_clean":"2024-09-16T01:22:37.475508+0000","last_became_active":"2024-09-16T01:22:37.473256+0000","last_became_peered":"2024-09-16T01:22:37.473256+0000","last_unstale":"2024-09-16T01:22:37.475508+0000","last_undegraded":"2024-09-16T01:22:37.475508+0000","last_fullsized":"2024-09-16T01:22:37.475508+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:33.276036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.455778+0000","last_change":"2024-09-16T01:22:37.455778+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.455778+0000","last_undegraded":"2024-09-16T01:22:37.455778+0000","last_fullsized":"2024-09-16T01:22:37.455778+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471786+0000","last_change":"2024-09-16T01:22:37.467923+0000","last_active":"2024-09-16T01:22:37.471786+0000","last_peered":"2024-09-16T01:22:37.471786+0000","last_clean":"2024-09-16T01:22:37.471786+0000","last_became_active":"2024-09-16T01:22:37.467632+0000","last_became_peered":"2024-09-16T01:22:37.467632+0000","last_unstale":"2024-09-16T01:22:37.471786+0000","last_undegraded":"2024-09-16T01:22:37.471786+0000","last_fullsized":"2024-09-16T01:22:37.471786+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:01.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461657+0000","last_change":"2024-09-16T01:22:37.461657+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461657+0000","last_undegraded":"2024-09-16T01:22:37.461657+0000","last_fullsized":"2024-09-16T01:22:37.461657+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476830+0000","last_change":"2024-09-16T01:22:37.473120+0000","last_active":"2024-09-16T01:22:37.476830+0000","last_peered":"2024-09-16T01:22:37.476830+0000","last_clean":"2024-09-16T01:22:37.476830+0000","last_became_active":"2024-09-16T01:22:37.472799+0000","last_became_peered":"2024-09-16T01:22:37.472799+0000","last_unstale":"2024-09-16T01:22:37.476830+0000","last_undegraded":"2024-09-16T01:22:37.476830+0000","last_fullsized":"2024-09-16T01:22:37.476830+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:17.563539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461546+0000","last_change":"2024-09-16T01:22:37.461546+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461546+0000","last_undegraded":"2024-09-16T01:22:37.461546+0000","last_fullsized":"2024-09-16T01:22:37.461546+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472812+0000","last_change":"2024-09-16T01:22:37.465487+0000","last_active":"2024-09-16T01:22:37.472812+0000","last_peered":"2024-09-16T01:22:37.472812+0000","last_clean":"2024-09-16T01:22:37.472812+0000","last_became_active":"2024-09-16T01:22:37.465154+0000","last_became_peered":"2024-09-16T01:22:37.465154+0000","last_unstale":"2024-09-16T01:22:37.472812+0000","last_undegraded":"2024-09-16T01:22:37.472812+0000","last_fullsized":"2024-09-16T01:22:37.472812+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:17.563539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459189+0000","last_change":"2024-09-16T01:22:37.459189+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459189+0000","last_undegraded":"2024-09-16T01:22:37.459189+0000","last_fullsized":"2024-09-16T01:22:37.459189+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474485+0000","last_change":"2024-09-16T01:22:37.470174+0000","last_active":"2024-09-16T01:22:37.474485+0000","last_peered":"2024-09-16T01:22:37.474485+0000","last_clean":"2024-09-16T01:22:37.474485+0000","last_became_active":"2024-09-16T01:22:37.469905+0000","last_became_peered":"2024-09-16T01:22:37.469905+0000","last_unstale":"2024-09-16T01:22:37.474485+0000","last_undegraded":"2024-09-16T01:22:37.474485+0000","last_fullsized":"2024-09-16T01:22:37.474485+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:17.563539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460407+0000","last_change":"2024-09-16T01:22:37.460407+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460407+0000","last_undegraded":"2024-09-16T01:22:37.460407+0000","last_fullsized":"2024-09-16T01:22:37.460407+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477128+0000","last_change":"2024-09-16T01:22:37.473265+0000","last_active":"2024-09-16T01:22:37.477128+0000","last_peered":"2024-09-16T01:22:37.477128+0000","last_clean":"2024-09-16T01:22:37.477128+0000","last_became_active":"2024-09-16T01:22:37.472881+0000","last_became_peered":"2024-09-16T01:22:37.472881+0000","last_unstale":"2024-09-16T01:22:37.477128+0000","last_undegraded":"2024-09-16T01:22:37.477128+0000","last_fullsized":"2024-09-16T01:22:37.477128+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:35.803129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459981+0000","last_change":"2024-09-16T01:22:37.459981+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459981+0000","last_undegraded":"2024-09-16T01:22:37.459981+0000","last_fullsized":"2024-09-16T01:22:37.459981+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474471+0000","last_change":"2024-09-16T01:22:37.470596+0000","last_active":"2024-09-16T01:22:37.474471+0000","last_peered":"2024-09-16T01:22:37.474471+0000","last_clean":"2024-09-16T01:22:37.474471+0000","last_became_active":"2024-09-16T01:22:37.470270+0000","last_became_peered":"2024-09-16T01:22:37.470270+0000","last_unstale":"2024-09-16T01:22:37.474471+0000","last_undegraded":"2024-09-16T01:22:37.474471+0000","last_fullsized":"2024-09-16T01:22:37.474471+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:06.423099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460687+0000","last_change":"2024-09-16T01:22:37.460687+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460687+0000","last_undegraded":"2024-09-16T01:22:37.460687+0000","last_fullsized":"2024-09-16T01:22:37.460687+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471324+0000","last_change":"2024-09-16T01:22:37.467778+0000","last_active":"2024-09-16T01:22:37.471324+0000","last_peered":"2024-09-16T01:22:37.471324+0000","last_clean":"2024-09-16T01:22:37.471324+0000","last_became_active":"2024-09-16T01:22:37.467524+0000","last_became_peered":"2024-09-16T01:22:37.467524+0000","last_unstale":"2024-09-16T01:22:37.471324+0000","last_undegraded":"2024-09-16T01:22:37.471324+0000","last_fullsized":"2024-09-16T01:22:37.471324+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:52.586042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.457619+0000","last_change":"2024-09-16T01:22:37.457619+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.457619+0000","last_undegraded":"2024-09-16T01:22:37.457619+0000","last_fullsized":"2024-09-16T01:22:37.457619+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477162+0000","last_change":"2024-09-16T01:22:37.474591+0000","last_active":"2024-09-16T01:22:37.477162+0000","last_peered":"2024-09-16T01:22:37.477162+0000","last_clean":"2024-09-16T01:22:37.477162+0000","last_became_active":"2024-09-16T01:22:37.474286+0000","last_became_peered":"2024-09-16T01:22:37.474286+0000","last_unstale":"2024-09-16T01:22:37.477162+0000","last_undegraded":"2024-09-16T01:22:37.477162+0000","last_fullsized":"2024-09-16T01:22:37.477162+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:33.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":357,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.463374+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:22:37.463374+0000","last_peered":"2024-09-16T01:22:37.463374+0000","last_clean":"2024-09-16T01:22:37.463374+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:22:37.463374+0000","last_undegraded":"2024-09-16T01:22:37.463374+0000","last_fullsized":"2024-09-16T01:22:37.463374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2134016,"data_stored":1298290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36844,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334996,"statfs":{"total":96636764160,"available":96599035904,"internally_reserved":0,"allocated":1527808,"data_stored":701263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574937,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1527808,"data_stored":701263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2134016,"data_stored":1298290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:22:41.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:22:41.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.589+0000 7f25eaffd640 1 Processor -- start 2024-09-16T01:22:41.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.589+0000 7f25eaffd640 1 -- start start 2024-09-16T01:22:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.590+0000 7f25eaffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25e4147360 0x7f25e4070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.590+0000 7f25eaffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f25e4070dd0 0x7f25e40d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.590+0000 7f25eaffd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e406cb30 con 0x7f25e40d09e0 2024-09-16T01:22:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.590+0000 7f25eaffd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f25e40d0e30 con 0x7f25e4070dd0 2024-09-16T01:22:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.590+0000 7f25eaffd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f25e406bfb0 con 0x7f25e4147360 2024-09-16T01:22:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.590+0000 7f25e3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f25e4070dd0 0x7f25e40d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.590+0000 7f25e8d99640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25e4147360 0x7f25e4070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.591+0000 7f25e3fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f25e4070dd0 0x7f25e40d04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:46670/0 (socket says 172.21.15.81:46670) 2024-09-16T01:22:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.591+0000 7f25e3fff640 1 -- 172.21.15.81:0/891126355 learned_addr learned my addr 172.21.15.81:0/891126355 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:41.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.591+0000 7f25e8d99640 1 -- 172.21.15.81:0/891126355 >> v2:172.21.15.102:3300/0 conn(0x7f25e4070dd0 msgr2=0x7f25e40d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:41.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.591+0000 7f25e8d99640 1 --2- 172.21.15.81:0/891126355 >> v2:172.21.15.102:3300/0 conn(0x7f25e4070dd0 0x7f25e40d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.591+0000 7f25e8d99640 1 -- 172.21.15.81:0/891126355 >> v1:172.21.15.102:6789/0 conn(0x7f25e40d09e0 legacy=0x7f25e406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.591+0000 7f25e8d99640 1 -- 172.21.15.81:0/891126355 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e406c290 con 0x7f25e4147360 2024-09-16T01:22:41.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.591+0000 7f25e3fff640 1 --2- 172.21.15.81:0/891126355 >> v2:172.21.15.102:3300/0 conn(0x7f25e4070dd0 0x7f25e40d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:41.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.592+0000 7f25e8d99640 1 --2- 172.21.15.81:0/891126355 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25e4147360 0x7f25e4070890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f25d40097a0 tx=0x7f25d402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c49fbd8e142fcf39 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:41.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.592+0000 7f25e37fe640 1 -- 172.21.15.81:0/891126355 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4037070 con 0x7f25e4147360 2024-09-16T01:22:41.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.592+0000 7f25e37fe640 1 -- 172.21.15.81:0/891126355 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d402ae50 con 0x7f25e4147360 2024-09-16T01:22:41.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.592+0000 7f25e37fe640 1 -- 172.21.15.81:0/891126355 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4032660 con 0x7f25e4147360 2024-09-16T01:22:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.593+0000 7f25eaffd640 1 -- 172.21.15.81:0/891126355 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25e4147360 msgr2=0x7f25e4070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.593+0000 7f25eaffd640 1 --2- 172.21.15.81:0/891126355 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25e4147360 0x7f25e4070890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f25d40097a0 tx=0x7f25d402a100 comp rx=0 tx=0).stop 2024-09-16T01:22:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.593+0000 7f25eaffd640 1 -- 172.21.15.81:0/891126355 shutdown_connections 2024-09-16T01:22:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.593+0000 7f25eaffd640 1 --2- 172.21.15.81:0/891126355 >> v2:172.21.15.102:3300/0 conn(0x7f25e4070dd0 0x7f25e40d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.593+0000 7f25eaffd640 1 --2- 172.21.15.81:0/891126355 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25e4147360 0x7f25e4070890 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.593+0000 7f25eaffd640 1 -- 172.21.15.81:0/891126355 >> 172.21.15.81:0/891126355 conn(0x7f25e40b2f40 msgr2=0x7f25e40b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.593+0000 7f25eaffd640 1 -- 172.21.15.81:0/891126355 shutdown_connections 2024-09-16T01:22:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.593+0000 7f25eaffd640 1 -- 172.21.15.81:0/891126355 wait complete. 2024-09-16T01:22:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.594+0000 7f25eaffd640 1 Processor -- start 2024-09-16T01:22:41.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.594+0000 7f25eaffd640 1 -- start start 2024-09-16T01:22:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25eaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4070dd0 0x7f25e4161820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25eaffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25e40d09e0 0x7f25e4141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25eaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25e4147360 0x7f25e41419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25eaffd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25e406bc10 con 0x7f25e4070dd0 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25eaffd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f25e406c850 con 0x7f25e4147360 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25eaffd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f25e406bd90 con 0x7f25e40d09e0 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e8d99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4070dd0 0x7f25e4161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e8d99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4070dd0 0x7f25e4161820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37296/0 (socket says 172.21.15.81:37296) 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e8d99640 1 -- 172.21.15.81:0/2733728465 learned_addr learned my addr 172.21.15.81:0/2733728465 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e3fff640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25e40d09e0 0x7f25e4141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e8d99640 1 -- 172.21.15.81:0/2733728465 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25e40d09e0 msgr2=0x7f25e4141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e8d99640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25e40d09e0 0x7f25e4141470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e8d99640 1 -- 172.21.15.81:0/2733728465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25e4147360 msgr2=0x7f25e41419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e959a640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25e4147360 0x7f25e41419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e8d99640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25e4147360 0x7f25e41419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e8d99640 1 -- 172.21.15.81:0/2733728465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e4140430 con 0x7f25e4070dd0 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e959a640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25e4147360 0x7f25e41419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e8d99640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4070dd0 0x7f25e4161820 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f25d40098c0 tx=0x7f25d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.595+0000 7f25e17fa640 1 -- 172.21.15.81:0/2733728465 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4041030 con 0x7f25e4070dd0 2024-09-16T01:22:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.596+0000 7f25e17fa640 1 -- 172.21.15.81:0/2733728465 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d402ac50 con 0x7f25e4070dd0 2024-09-16T01:22:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.596+0000 7f25eaffd640 1 -- 172.21.15.81:0/2733728465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e4140710 con 0x7f25e4070dd0 2024-09-16T01:22:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.596+0000 7f25e17fa640 1 -- 172.21.15.81:0/2733728465 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d4037040 con 0x7f25e4070dd0 2024-09-16T01:22:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.596+0000 7f25eaffd640 1 -- 172.21.15.81:0/2733728465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e4140cd0 con 0x7f25e4070dd0 2024-09-16T01:22:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.596+0000 7f25eaffd640 1 -- 172.21.15.81:0/2733728465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e41459c0 con 0x7f25e4070dd0 2024-09-16T01:22:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.597+0000 7f25e17fa640 1 -- 172.21.15.81:0/2733728465 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f25d4044070 con 0x7f25e4070dd0 2024-09-16T01:22:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.597+0000 7f25e17fa640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f25d006c2b0 0x7f25d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.598+0000 7f25e3fff640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f25d006c2b0 0x7f25d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.598+0000 7f25e17fa640 1 -- 172.21.15.81:0/2733728465 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f25d40abc90 con 0x7f25e4070dd0 2024-09-16T01:22:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.598+0000 7f25e3fff640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f25d006c2b0 0x7f25d006e770 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f25e4070460 tx=0x7f25d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.602+0000 7f25e17fa640 1 -- 172.21.15.81:0/2733728465 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f25e41459c0 con 0x7f25e4070dd0 2024-09-16T01:22:41.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.763+0000 7f25eaffd640 1 -- 172.21.15.81:0/2733728465 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f25e40d04a0 con 0x7f25d006c2b0 2024-09-16T01:22:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.769+0000 7f25e17fa640 1 -- 172.21.15.81:0/2733728465 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247090 (secure 0 0 0) 0x7f25e40d04a0 con 0x7f25d006c2b0 2024-09-16T01:22:41.775 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:22:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.772+0000 7f25eaffd640 1 -- 172.21.15.81:0/2733728465 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f25d006c2b0 msgr2=0x7f25d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.772+0000 7f25eaffd640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f25d006c2b0 0x7f25d006e770 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f25e4070460 tx=0x7f25d8008040 comp rx=0 tx=0).stop 2024-09-16T01:22:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.772+0000 7f25eaffd640 1 -- 172.21.15.81:0/2733728465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4070dd0 msgr2=0x7f25e4161820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.772+0000 7f25eaffd640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4070dd0 0x7f25e4161820 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f25d40098c0 tx=0x7f25d40046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.772+0000 7f25eaffd640 1 -- 172.21.15.81:0/2733728465 shutdown_connections 2024-09-16T01:22:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.772+0000 7f25eaffd640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f25d006c2b0 0x7f25d006e770 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.772+0000 7f25eaffd640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25e4147360 0x7f25e41419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.772+0000 7f25eaffd640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25e40d09e0 0x7f25e4141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.772+0000 7f25eaffd640 1 --2- 172.21.15.81:0/2733728465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25e4070dd0 0x7f25e4161820 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.772+0000 7f25eaffd640 1 -- 172.21.15.81:0/2733728465 >> 172.21.15.81:0/2733728465 conn(0x7f25e40b2f40 msgr2=0x7f25e41451d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.772+0000 7f25eaffd640 1 -- 172.21.15.81:0/2733728465 shutdown_connections 2024-09-16T01:22:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.772+0000 7f25eaffd640 1 -- 172.21.15.81:0/2733728465 wait complete. 2024-09-16T01:22:41.783 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-16T01:22:40.151258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266868,"kb_used_data":13168,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754707852,"statfs":{"total":773094113280,"available":772820840448,"internally_reserved":0,"allocated":13484032,"data_stored":6830794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000886"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459930+0000","last_change":"2024-09-16T01:22:37.459930+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459930+0000","last_undegraded":"2024-09-16T01:22:37.459930+0000","last_fullsized":"2024-09-16T01:22:37.459930+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462073+0000","last_change":"2024-09-16T01:22:37.462073+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462073+0000","last_undegraded":"2024-09-16T01:22:37.462073+0000","last_fullsized":"2024-09-16T01:22:37.462073+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458082+0000","last_change":"2024-09-16T01:22:37.458082+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458082+0000","last_undegraded":"2024-09-16T01:22:37.458082+0000","last_fullsized":"2024-09-16T01:22:37.458082+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458453+0000","last_change":"2024-09-16T01:22:37.458453+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458453+0000","last_undegraded":"2024-09-16T01:22:37.458453+0000","last_fullsized":"2024-09-16T01:22:37.458453+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.464247+0000","last_change":"2024-09-16T01:22:37.464247+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.464247+0000","last_undegraded":"2024-09-16T01:22:37.464247+0000","last_fullsized":"2024-09-16T01:22:37.464247+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462671+0000","last_change":"2024-09-16T01:22:37.462671+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462671+0000","last_undegraded":"2024-09-16T01:22:37.462671+0000","last_fullsized":"2024-09-16T01:22:37.462671+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461888+0000","last_change":"2024-09-16T01:22:37.461888+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461888+0000","last_undegraded":"2024-09-16T01:22:37.461888+0000","last_fullsized":"2024-09-16T01:22:37.461888+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459698+0000","last_change":"2024-09-16T01:22:37.459698+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459698+0000","last_undegraded":"2024-09-16T01:22:37.459698+0000","last_fullsized":"2024-09-16T01:22:37.459698+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462682+0000","last_change":"2024-09-16T01:22:37.462682+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462682+0000","last_undegraded":"2024-09-16T01:22:37.462682+0000","last_fullsized":"2024-09-16T01:22:37.462682+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462998+0000","last_change":"2024-09-16T01:22:37.462998+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462998+0000","last_undegraded":"2024-09-16T01:22:37.462998+0000","last_fullsized":"2024-09-16T01:22:37.462998+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460346+0000","last_change":"2024-09-16T01:22:37.460346+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460346+0000","last_undegraded":"2024-09-16T01:22:37.460346+0000","last_fullsized":"2024-09-16T01:22:37.460346+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458937+0000","last_change":"2024-09-16T01:22:37.458937+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458937+0000","last_undegraded":"2024-09-16T01:22:37.458937+0000","last_fullsized":"2024-09-16T01:22:37.458937+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462620+0000","last_change":"2024-09-16T01:22:37.462620+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462620+0000","last_undegraded":"2024-09-16T01:22:37.462620+0000","last_fullsized":"2024-09-16T01:22:37.462620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458722+0000","last_change":"2024-09-16T01:22:37.458722+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458722+0000","last_undegraded":"2024-09-16T01:22:37.458722+0000","last_fullsized":"2024-09-16T01:22:37.458722+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459852+0000","last_change":"2024-09-16T01:22:37.459852+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459852+0000","last_undegraded":"2024-09-16T01:22:37.459852+0000","last_fullsized":"2024-09-16T01:22:37.459852+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.464088+0000","last_change":"2024-09-16T01:22:37.464088+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.464088+0000","last_undegraded":"2024-09-16T01:22:37.464088+0000","last_fullsized":"2024-09-16T01:22:37.464088+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462170+0000","last_change":"2024-09-16T01:22:37.462170+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462170+0000","last_undegraded":"2024-09-16T01:22:37.462170+0000","last_fullsized":"2024-09-16T01:22:37.462170+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463680+0000","last_change":"2024-09-16T01:22:37.463680+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463680+0000","last_undegraded":"2024-09-16T01:22:37.463680+0000","last_fullsized":"2024-09-16T01:22:37.463680+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462447+0000","last_change":"2024-09-16T01:22:37.462447+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462447+0000","last_undegraded":"2024-09-16T01:22:37.462447+0000","last_fullsized":"2024-09-16T01:22:37.462447+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462824+0000","last_change":"2024-09-16T01:22:37.462824+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462824+0000","last_undegraded":"2024-09-16T01:22:37.462824+0000","last_fullsized":"2024-09-16T01:22:37.462824+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456629+0000","last_change":"2024-09-16T01:22:37.456629+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456629+0000","last_undegraded":"2024-09-16T01:22:37.456629+0000","last_fullsized":"2024-09-16T01:22:37.456629+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.467780+0000","last_change":"2024-09-16T01:22:37.467780+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.467780+0000","last_undegraded":"2024-09-16T01:22:37.467780+0000","last_fullsized":"2024-09-16T01:22:37.467780+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456664+0000","last_change":"2024-09-16T01:22:37.456664+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456664+0000","last_undegraded":"2024-09-16T01:22:37.456664+0000","last_fullsized":"2024-09-16T01:22:37.456664+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460799+0000","last_change":"2024-09-16T01:22:37.460799+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460799+0000","last_undegraded":"2024-09-16T01:22:37.460799+0000","last_fullsized":"2024-09-16T01:22:37.460799+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458477+0000","last_change":"2024-09-16T01:22:37.458477+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458477+0000","last_undegraded":"2024-09-16T01:22:37.458477+0000","last_fullsized":"2024-09-16T01:22:37.458477+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.457611+0000","last_change":"2024-09-16T01:22:37.457611+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.457611+0000","last_undegraded":"2024-09-16T01:22:37.457611+0000","last_fullsized":"2024-09-16T01:22:37.457611+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460523+0000","last_change":"2024-09-16T01:22:37.460523+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460523+0000","last_undegraded":"2024-09-16T01:22:37.460523+0000","last_fullsized":"2024-09-16T01:22:37.460523+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463848+0000","last_change":"2024-09-16T01:22:37.463848+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463848+0000","last_undegraded":"2024-09-16T01:22:37.463848+0000","last_fullsized":"2024-09-16T01:22:37.463848+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459671+0000","last_change":"2024-09-16T01:22:37.459671+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459671+0000","last_undegraded":"2024-09-16T01:22:37.459671+0000","last_fullsized":"2024-09-16T01:22:37.459671+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456725+0000","last_change":"2024-09-16T01:22:37.456725+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456725+0000","last_undegraded":"2024-09-16T01:22:37.456725+0000","last_fullsized":"2024-09-16T01:22:37.456725+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461713+0000","last_change":"2024-09-16T01:22:37.461713+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461713+0000","last_undegraded":"2024-09-16T01:22:37.461713+0000","last_fullsized":"2024-09-16T01:22:37.461713+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461958+0000","last_change":"2024-09-16T01:22:37.461958+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461958+0000","last_undegraded":"2024-09-16T01:22:37.461958+0000","last_fullsized":"2024-09-16T01:22:37.461958+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459229+0000","last_change":"2024-09-16T01:22:37.459229+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459229+0000","last_undegraded":"2024-09-16T01:22:37.459229+0000","last_fullsized":"2024-09-16T01:22:37.459229+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476726+0000","last_change":"2024-09-16T01:22:37.473828+0000","last_active":"2024-09-16T01:22:37.476726+0000","last_peered":"2024-09-16T01:22:37.476726+0000","last_clean":"2024-09-16T01:22:37.476726+0000","last_became_active":"2024-09-16T01:22:37.473523+0000","last_became_peered":"2024-09-16T01:22:37.473523+0000","last_unstale":"2024-09-16T01:22:37.476726+0000","last_undegraded":"2024-09-16T01:22:37.476726+0000","last_fullsized":"2024-09-16T01:22:37.476726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:47.484184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458521+0000","last_change":"2024-09-16T01:22:37.458521+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458521+0000","last_undegraded":"2024-09-16T01:22:37.458521+0000","last_fullsized":"2024-09-16T01:22:37.458521+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471465+0000","last_change":"2024-09-16T01:22:37.469361+0000","last_active":"2024-09-16T01:22:37.471465+0000","last_peered":"2024-09-16T01:22:37.471465+0000","last_clean":"2024-09-16T01:22:37.471465+0000","last_became_active":"2024-09-16T01:22:37.469091+0000","last_became_peered":"2024-09-16T01:22:37.469091+0000","last_unstale":"2024-09-16T01:22:37.471465+0000","last_undegraded":"2024-09-16T01:22:37.471465+0000","last_fullsized":"2024-09-16T01:22:37.471465+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:06.683640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456135+0000","last_change":"2024-09-16T01:22:37.456135+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456135+0000","last_undegraded":"2024-09-16T01:22:37.456135+0000","last_fullsized":"2024-09-16T01:22:37.456135+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477095+0000","last_change":"2024-09-16T01:22:37.472329+0000","last_active":"2024-09-16T01:22:37.477095+0000","last_peered":"2024-09-16T01:22:37.477095+0000","last_clean":"2024-09-16T01:22:37.477095+0000","last_became_active":"2024-09-16T01:22:37.471993+0000","last_became_peered":"2024-09-16T01:22:37.471993+0000","last_unstale":"2024-09-16T01:22:37.477095+0000","last_undegraded":"2024-09-16T01:22:37.477095+0000","last_fullsized":"2024-09-16T01:22:37.477095+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:41.536663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.467144+0000","last_change":"2024-09-16T01:22:37.467144+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.467144+0000","last_undegraded":"2024-09-16T01:22:37.467144+0000","last_fullsized":"2024-09-16T01:22:37.467144+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477115+0000","last_change":"2024-09-16T01:22:37.472495+0000","last_active":"2024-09-16T01:22:37.477115+0000","last_peered":"2024-09-16T01:22:37.477115+0000","last_clean":"2024-09-16T01:22:37.477115+0000","last_became_active":"2024-09-16T01:22:37.472218+0000","last_became_peered":"2024-09-16T01:22:37.472218+0000","last_unstale":"2024-09-16T01:22:37.477115+0000","last_undegraded":"2024-09-16T01:22:37.477115+0000","last_fullsized":"2024-09-16T01:22:37.477115+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:11.681815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462726+0000","last_change":"2024-09-16T01:22:37.462726+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462726+0000","last_undegraded":"2024-09-16T01:22:37.462726+0000","last_fullsized":"2024-09-16T01:22:37.462726+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474208+0000","last_change":"2024-09-16T01:22:37.469230+0000","last_active":"2024-09-16T01:22:37.474208+0000","last_peered":"2024-09-16T01:22:37.474208+0000","last_clean":"2024-09-16T01:22:37.474208+0000","last_became_active":"2024-09-16T01:22:37.468906+0000","last_became_peered":"2024-09-16T01:22:37.468906+0000","last_unstale":"2024-09-16T01:22:37.474208+0000","last_undegraded":"2024-09-16T01:22:37.474208+0000","last_fullsized":"2024-09-16T01:22:37.474208+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462376+0000","last_change":"2024-09-16T01:22:37.462376+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462376+0000","last_undegraded":"2024-09-16T01:22:37.462376+0000","last_fullsized":"2024-09-16T01:22:37.462376+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.473368+0000","last_change":"2024-09-16T01:22:37.472506+0000","last_active":"2024-09-16T01:22:37.473368+0000","last_peered":"2024-09-16T01:22:37.473368+0000","last_clean":"2024-09-16T01:22:37.473368+0000","last_became_active":"2024-09-16T01:22:37.472177+0000","last_became_peered":"2024-09-16T01:22:37.472177+0000","last_unstale":"2024-09-16T01:22:37.473368+0000","last_undegraded":"2024-09-16T01:22:37.473368+0000","last_fullsized":"2024-09-16T01:22:37.473368+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:21.137299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463249+0000","last_change":"2024-09-16T01:22:37.463249+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463249+0000","last_undegraded":"2024-09-16T01:22:37.463249+0000","last_fullsized":"2024-09-16T01:22:37.463249+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472887+0000","last_change":"2024-09-16T01:22:37.464769+0000","last_active":"2024-09-16T01:22:37.472887+0000","last_peered":"2024-09-16T01:22:37.472887+0000","last_clean":"2024-09-16T01:22:37.472887+0000","last_became_active":"2024-09-16T01:22:37.464432+0000","last_became_peered":"2024-09-16T01:22:37.464432+0000","last_unstale":"2024-09-16T01:22:37.472887+0000","last_undegraded":"2024-09-16T01:22:37.472887+0000","last_fullsized":"2024-09-16T01:22:37.472887+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:24.269797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461252+0000","last_change":"2024-09-16T01:22:37.461252+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461252+0000","last_undegraded":"2024-09-16T01:22:37.461252+0000","last_fullsized":"2024-09-16T01:22:37.461252+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.466893+0000","last_change":"2024-09-16T01:22:37.466155+0000","last_active":"2024-09-16T01:22:37.466893+0000","last_peered":"2024-09-16T01:22:37.466893+0000","last_clean":"2024-09-16T01:22:37.466893+0000","last_became_active":"2024-09-16T01:22:37.465891+0000","last_became_peered":"2024-09-16T01:22:37.465891+0000","last_unstale":"2024-09-16T01:22:37.466893+0000","last_undegraded":"2024-09-16T01:22:37.466893+0000","last_fullsized":"2024-09-16T01:22:37.466893+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:58.533695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458512+0000","last_change":"2024-09-16T01:22:37.458512+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458512+0000","last_undegraded":"2024-09-16T01:22:37.458512+0000","last_fullsized":"2024-09-16T01:22:37.458512+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.468786+0000","last_change":"2024-09-16T01:22:37.466248+0000","last_active":"2024-09-16T01:22:37.468786+0000","last_peered":"2024-09-16T01:22:37.468786+0000","last_clean":"2024-09-16T01:22:37.468786+0000","last_became_active":"2024-09-16T01:22:37.465956+0000","last_became_peered":"2024-09-16T01:22:37.465956+0000","last_unstale":"2024-09-16T01:22:37.468786+0000","last_undegraded":"2024-09-16T01:22:37.468786+0000","last_fullsized":"2024-09-16T01:22:37.468786+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:24.269797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460932+0000","last_change":"2024-09-16T01:22:37.460932+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460932+0000","last_undegraded":"2024-09-16T01:22:37.460932+0000","last_fullsized":"2024-09-16T01:22:37.460932+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477316+0000","last_change":"2024-09-16T01:22:37.476174+0000","last_active":"2024-09-16T01:22:37.477316+0000","last_peered":"2024-09-16T01:22:37.477316+0000","last_clean":"2024-09-16T01:22:37.477316+0000","last_became_active":"2024-09-16T01:22:37.475897+0000","last_became_peered":"2024-09-16T01:22:37.475897+0000","last_unstale":"2024-09-16T01:22:37.477316+0000","last_undegraded":"2024-09-16T01:22:37.477316+0000","last_fullsized":"2024-09-16T01:22:37.477316+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:58.401908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456287+0000","last_change":"2024-09-16T01:22:37.456287+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456287+0000","last_undegraded":"2024-09-16T01:22:37.456287+0000","last_fullsized":"2024-09-16T01:22:37.456287+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477054+0000","last_change":"2024-09-16T01:22:37.471374+0000","last_active":"2024-09-16T01:22:37.477054+0000","last_peered":"2024-09-16T01:22:37.477054+0000","last_clean":"2024-09-16T01:22:37.477054+0000","last_became_active":"2024-09-16T01:22:37.471086+0000","last_became_peered":"2024-09-16T01:22:37.471086+0000","last_unstale":"2024-09-16T01:22:37.477054+0000","last_undegraded":"2024-09-16T01:22:37.477054+0000","last_fullsized":"2024-09-16T01:22:37.477054+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:57.246038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456859+0000","last_change":"2024-09-16T01:22:37.456859+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456859+0000","last_undegraded":"2024-09-16T01:22:37.456859+0000","last_fullsized":"2024-09-16T01:22:37.456859+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476726+0000","last_change":"2024-09-16T01:22:37.469445+0000","last_active":"2024-09-16T01:22:37.476726+0000","last_peered":"2024-09-16T01:22:37.476726+0000","last_clean":"2024-09-16T01:22:37.476726+0000","last_became_active":"2024-09-16T01:22:37.469160+0000","last_became_peered":"2024-09-16T01:22:37.469160+0000","last_unstale":"2024-09-16T01:22:37.476726+0000","last_undegraded":"2024-09-16T01:22:37.476726+0000","last_fullsized":"2024-09-16T01:22:37.476726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:38.021847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463436+0000","last_change":"2024-09-16T01:22:37.463436+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463436+0000","last_undegraded":"2024-09-16T01:22:37.463436+0000","last_fullsized":"2024-09-16T01:22:37.463436+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477298+0000","last_change":"2024-09-16T01:22:37.476008+0000","last_active":"2024-09-16T01:22:37.477298+0000","last_peered":"2024-09-16T01:22:37.477298+0000","last_clean":"2024-09-16T01:22:37.477298+0000","last_became_active":"2024-09-16T01:22:37.475720+0000","last_became_peered":"2024-09-16T01:22:37.475720+0000","last_unstale":"2024-09-16T01:22:37.477298+0000","last_undegraded":"2024-09-16T01:22:37.477298+0000","last_fullsized":"2024-09-16T01:22:37.477298+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:24.873727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460709+0000","last_change":"2024-09-16T01:22:37.460709+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460709+0000","last_undegraded":"2024-09-16T01:22:37.460709+0000","last_fullsized":"2024-09-16T01:22:37.460709+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.464358+0000","last_change":"2024-09-16T01:22:37.459504+0000","last_active":"2024-09-16T01:22:37.464358+0000","last_peered":"2024-09-16T01:22:37.464358+0000","last_clean":"2024-09-16T01:22:37.464358+0000","last_became_active":"2024-09-16T01:22:37.459226+0000","last_became_peered":"2024-09-16T01:22:37.459226+0000","last_unstale":"2024-09-16T01:22:37.464358+0000","last_undegraded":"2024-09-16T01:22:37.464358+0000","last_fullsized":"2024-09-16T01:22:37.464358+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:45.701573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462831+0000","last_change":"2024-09-16T01:22:37.462831+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462831+0000","last_undegraded":"2024-09-16T01:22:37.462831+0000","last_fullsized":"2024-09-16T01:22:37.462831+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.470912+0000","last_change":"2024-09-16T01:22:37.460411+0000","last_active":"2024-09-16T01:22:37.470912+0000","last_peered":"2024-09-16T01:22:37.470912+0000","last_clean":"2024-09-16T01:22:37.470912+0000","last_became_active":"2024-09-16T01:22:37.460106+0000","last_became_peered":"2024-09-16T01:22:37.460106+0000","last_unstale":"2024-09-16T01:22:37.470912+0000","last_undegraded":"2024-09-16T01:22:37.470912+0000","last_fullsized":"2024-09-16T01:22:37.470912+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:01.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.455702+0000","last_change":"2024-09-16T01:22:37.455702+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.455702+0000","last_undegraded":"2024-09-16T01:22:37.455702+0000","last_fullsized":"2024-09-16T01:22:37.455702+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.467229+0000","last_change":"2024-09-16T01:22:37.465535+0000","last_active":"2024-09-16T01:22:37.467229+0000","last_peered":"2024-09-16T01:22:37.467229+0000","last_clean":"2024-09-16T01:22:37.467229+0000","last_became_active":"2024-09-16T01:22:37.465233+0000","last_became_peered":"2024-09-16T01:22:37.465233+0000","last_unstale":"2024-09-16T01:22:37.467229+0000","last_undegraded":"2024-09-16T01:22:37.467229+0000","last_fullsized":"2024-09-16T01:22:37.467229+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461436+0000","last_change":"2024-09-16T01:22:37.461436+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461436+0000","last_undegraded":"2024-09-16T01:22:37.461436+0000","last_fullsized":"2024-09-16T01:22:37.461436+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476664+0000","last_change":"2024-09-16T01:22:37.473710+0000","last_active":"2024-09-16T01:22:37.476664+0000","last_peered":"2024-09-16T01:22:37.476664+0000","last_clean":"2024-09-16T01:22:37.476664+0000","last_became_active":"2024-09-16T01:22:37.473344+0000","last_became_peered":"2024-09-16T01:22:37.473344+0000","last_unstale":"2024-09-16T01:22:37.476664+0000","last_undegraded":"2024-09-16T01:22:37.476664+0000","last_fullsized":"2024-09-16T01:22:37.476664+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:21:36.959019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461037+0000","last_change":"2024-09-16T01:22:37.461037+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461037+0000","last_undegraded":"2024-09-16T01:22:37.461037+0000","last_fullsized":"2024-09-16T01:22:37.461037+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471266+0000","last_change":"2024-09-16T01:22:37.463887+0000","last_active":"2024-09-16T01:22:37.471266+0000","last_peered":"2024-09-16T01:22:37.471266+0000","last_clean":"2024-09-16T01:22:37.471266+0000","last_became_active":"2024-09-16T01:22:37.463631+0000","last_became_peered":"2024-09-16T01:22:37.463631+0000","last_unstale":"2024-09-16T01:22:37.471266+0000","last_undegraded":"2024-09-16T01:22:37.471266+0000","last_fullsized":"2024-09-16T01:22:37.471266+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462038+0000","last_change":"2024-09-16T01:22:37.462038+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462038+0000","last_undegraded":"2024-09-16T01:22:37.462038+0000","last_fullsized":"2024-09-16T01:22:37.462038+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.475270+0000","last_change":"2024-09-16T01:22:37.474218+0000","last_active":"2024-09-16T01:22:37.475270+0000","last_peered":"2024-09-16T01:22:37.475270+0000","last_clean":"2024-09-16T01:22:37.475270+0000","last_became_active":"2024-09-16T01:22:37.473947+0000","last_became_peered":"2024-09-16T01:22:37.473947+0000","last_unstale":"2024-09-16T01:22:37.475270+0000","last_undegraded":"2024-09-16T01:22:37.475270+0000","last_fullsized":"2024-09-16T01:22:37.475270+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:19.356499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459557+0000","last_change":"2024-09-16T01:22:37.459557+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459557+0000","last_undegraded":"2024-09-16T01:22:37.459557+0000","last_fullsized":"2024-09-16T01:22:37.459557+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474230+0000","last_change":"2024-09-16T01:22:37.469517+0000","last_active":"2024-09-16T01:22:37.474230+0000","last_peered":"2024-09-16T01:22:37.474230+0000","last_clean":"2024-09-16T01:22:37.474230+0000","last_became_active":"2024-09-16T01:22:37.469256+0000","last_became_peered":"2024-09-16T01:22:37.469256+0000","last_unstale":"2024-09-16T01:22:37.474230+0000","last_undegraded":"2024-09-16T01:22:37.474230+0000","last_fullsized":"2024-09-16T01:22:37.474230+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:24.269797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459485+0000","last_change":"2024-09-16T01:22:37.459485+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459485+0000","last_undegraded":"2024-09-16T01:22:37.459485+0000","last_fullsized":"2024-09-16T01:22:37.459485+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472403+0000","last_change":"2024-09-16T01:22:37.469806+0000","last_active":"2024-09-16T01:22:37.472403+0000","last_peered":"2024-09-16T01:22:37.472403+0000","last_clean":"2024-09-16T01:22:37.472403+0000","last_became_active":"2024-09-16T01:22:37.469516+0000","last_became_peered":"2024-09-16T01:22:37.469516+0000","last_unstale":"2024-09-16T01:22:37.472403+0000","last_undegraded":"2024-09-16T01:22:37.472403+0000","last_fullsized":"2024-09-16T01:22:37.472403+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:37.113423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461311+0000","last_change":"2024-09-16T01:22:37.461311+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461311+0000","last_undegraded":"2024-09-16T01:22:37.461311+0000","last_fullsized":"2024-09-16T01:22:37.461311+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477145+0000","last_change":"2024-09-16T01:22:37.473724+0000","last_active":"2024-09-16T01:22:37.477145+0000","last_peered":"2024-09-16T01:22:37.477145+0000","last_clean":"2024-09-16T01:22:37.477145+0000","last_became_active":"2024-09-16T01:22:37.473345+0000","last_became_peered":"2024-09-16T01:22:37.473345+0000","last_unstale":"2024-09-16T01:22:37.477145+0000","last_undegraded":"2024-09-16T01:22:37.477145+0000","last_fullsized":"2024-09-16T01:22:37.477145+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.792365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459140+0000","last_change":"2024-09-16T01:22:37.459140+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459140+0000","last_undegraded":"2024-09-16T01:22:37.459140+0000","last_fullsized":"2024-09-16T01:22:37.459140+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472895+0000","last_change":"2024-09-16T01:22:37.466054+0000","last_active":"2024-09-16T01:22:37.472895+0000","last_peered":"2024-09-16T01:22:37.472895+0000","last_clean":"2024-09-16T01:22:37.472895+0000","last_became_active":"2024-09-16T01:22:37.465813+0000","last_became_peered":"2024-09-16T01:22:37.465813+0000","last_unstale":"2024-09-16T01:22:37.472895+0000","last_undegraded":"2024-09-16T01:22:37.472895+0000","last_fullsized":"2024-09-16T01:22:37.472895+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:15.378906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460661+0000","last_change":"2024-09-16T01:22:37.460661+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460661+0000","last_undegraded":"2024-09-16T01:22:37.460661+0000","last_fullsized":"2024-09-16T01:22:37.460661+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.475508+0000","last_change":"2024-09-16T01:22:37.473626+0000","last_active":"2024-09-16T01:22:37.475508+0000","last_peered":"2024-09-16T01:22:37.475508+0000","last_clean":"2024-09-16T01:22:37.475508+0000","last_became_active":"2024-09-16T01:22:37.473256+0000","last_became_peered":"2024-09-16T01:22:37.473256+0000","last_unstale":"2024-09-16T01:22:37.475508+0000","last_undegraded":"2024-09-16T01:22:37.475508+0000","last_fullsized":"2024-09-16T01:22:37.475508+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:33.276036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.455778+0000","last_change":"2024-09-16T01:22:37.455778+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.455778+0000","last_undegraded":"2024-09-16T01:22:37.455778+0000","last_fullsized":"2024-09-16T01:22:37.455778+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471786+0000","last_change":"2024-09-16T01:22:37.467923+0000","last_active":"2024-09-16T01:22:37.471786+0000","last_peered":"2024-09-16T01:22:37.471786+0000","last_clean":"2024-09-16T01:22:37.471786+0000","last_became_active":"2024-09-16T01:22:37.467632+0000","last_became_peered":"2024-09-16T01:22:37.467632+0000","last_unstale":"2024-09-16T01:22:37.471786+0000","last_undegraded":"2024-09-16T01:22:37.471786+0000","last_fullsized":"2024-09-16T01:22:37.471786+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:01.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461657+0000","last_change":"2024-09-16T01:22:37.461657+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461657+0000","last_undegraded":"2024-09-16T01:22:37.461657+0000","last_fullsized":"2024-09-16T01:22:37.461657+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476830+0000","last_change":"2024-09-16T01:22:37.473120+0000","last_active":"2024-09-16T01:22:37.476830+0000","last_peered":"2024-09-16T01:22:37.476830+0000","last_clean":"2024-09-16T01:22:37.476830+0000","last_became_active":"2024-09-16T01:22:37.472799+0000","last_became_peered":"2024-09-16T01:22:37.472799+0000","last_unstale":"2024-09-16T01:22:37.476830+0000","last_undegraded":"2024-09-16T01:22:37.476830+0000","last_fullsized":"2024-09-16T01:22:37.476830+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:17.563539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461546+0000","last_change":"2024-09-16T01:22:37.461546+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461546+0000","last_undegraded":"2024-09-16T01:22:37.461546+0000","last_fullsized":"2024-09-16T01:22:37.461546+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472812+0000","last_change":"2024-09-16T01:22:37.465487+0000","last_active":"2024-09-16T01:22:37.472812+0000","last_peered":"2024-09-16T01:22:37.472812+0000","last_clean":"2024-09-16T01:22:37.472812+0000","last_became_active":"2024-09-16T01:22:37.465154+0000","last_became_peered":"2024-09-16T01:22:37.465154+0000","last_unstale":"2024-09-16T01:22:37.472812+0000","last_undegraded":"2024-09-16T01:22:37.472812+0000","last_fullsized":"2024-09-16T01:22:37.472812+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:17.563539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459189+0000","last_change":"2024-09-16T01:22:37.459189+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459189+0000","last_undegraded":"2024-09-16T01:22:37.459189+0000","last_fullsized":"2024-09-16T01:22:37.459189+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474485+0000","last_change":"2024-09-16T01:22:37.470174+0000","last_active":"2024-09-16T01:22:37.474485+0000","last_peered":"2024-09-16T01:22:37.474485+0000","last_clean":"2024-09-16T01:22:37.474485+0000","last_became_active":"2024-09-16T01:22:37.469905+0000","last_became_peered":"2024-09-16T01:22:37.469905+0000","last_unstale":"2024-09-16T01:22:37.474485+0000","last_undegraded":"2024-09-16T01:22:37.474485+0000","last_fullsized":"2024-09-16T01:22:37.474485+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:17.563539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460407+0000","last_change":"2024-09-16T01:22:37.460407+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460407+0000","last_undegraded":"2024-09-16T01:22:37.460407+0000","last_fullsized":"2024-09-16T01:22:37.460407+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477128+0000","last_change":"2024-09-16T01:22:37.473265+0000","last_active":"2024-09-16T01:22:37.477128+0000","last_peered":"2024-09-16T01:22:37.477128+0000","last_clean":"2024-09-16T01:22:37.477128+0000","last_became_active":"2024-09-16T01:22:37.472881+0000","last_became_peered":"2024-09-16T01:22:37.472881+0000","last_unstale":"2024-09-16T01:22:37.477128+0000","last_undegraded":"2024-09-16T01:22:37.477128+0000","last_fullsized":"2024-09-16T01:22:37.477128+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:35.803129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459981+0000","last_change":"2024-09-16T01:22:37.459981+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459981+0000","last_undegraded":"2024-09-16T01:22:37.459981+0000","last_fullsized":"2024-09-16T01:22:37.459981+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474471+0000","last_change":"2024-09-16T01:22:37.470596+0000","last_active":"2024-09-16T01:22:37.474471+0000","last_peered":"2024-09-16T01:22:37.474471+0000","last_clean":"2024-09-16T01:22:37.474471+0000","last_became_active":"2024-09-16T01:22:37.470270+0000","last_became_peered":"2024-09-16T01:22:37.470270+0000","last_unstale":"2024-09-16T01:22:37.474471+0000","last_undegraded":"2024-09-16T01:22:37.474471+0000","last_fullsized":"2024-09-16T01:22:37.474471+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:06.423099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460687+0000","last_change":"2024-09-16T01:22:37.460687+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460687+0000","last_undegraded":"2024-09-16T01:22:37.460687+0000","last_fullsized":"2024-09-16T01:22:37.460687+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471324+0000","last_change":"2024-09-16T01:22:37.467778+0000","last_active":"2024-09-16T01:22:37.471324+0000","last_peered":"2024-09-16T01:22:37.471324+0000","last_clean":"2024-09-16T01:22:37.471324+0000","last_became_active":"2024-09-16T01:22:37.467524+0000","last_became_peered":"2024-09-16T01:22:37.467524+0000","last_unstale":"2024-09-16T01:22:37.471324+0000","last_undegraded":"2024-09-16T01:22:37.471324+0000","last_fullsized":"2024-09-16T01:22:37.471324+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:52.586042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.457619+0000","last_change":"2024-09-16T01:22:37.457619+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.457619+0000","last_undegraded":"2024-09-16T01:22:37.457619+0000","last_fullsized":"2024-09-16T01:22:37.457619+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477162+0000","last_change":"2024-09-16T01:22:37.474591+0000","last_active":"2024-09-16T01:22:37.477162+0000","last_peered":"2024-09-16T01:22:37.477162+0000","last_clean":"2024-09-16T01:22:37.477162+0000","last_became_active":"2024-09-16T01:22:37.474286+0000","last_became_peered":"2024-09-16T01:22:37.474286+0000","last_unstale":"2024-09-16T01:22:37.477162+0000","last_undegraded":"2024-09-16T01:22:37.477162+0000","last_fullsized":"2024-09-16T01:22:37.477162+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:33.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":357,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.463374+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:22:37.463374+0000","last_peered":"2024-09-16T01:22:37.463374+0000","last_clean":"2024-09-16T01:22:37.463374+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:22:37.463374+0000","last_undegraded":"2024-09-16T01:22:37.463374+0000","last_fullsized":"2024-09-16T01:22:37.463374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2134016,"data_stored":1298290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36844,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334996,"statfs":{"total":96636764160,"available":96599035904,"internally_reserved":0,"allocated":1527808,"data_stored":701263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574937,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1527808,"data_stored":701263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2134016,"data_stored":1298290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:22:41.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:22:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.920+0000 7fd20fffd640 1 Processor -- start 2024-09-16T01:22:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.920+0000 7fd20fffd640 1 -- start start 2024-09-16T01:22:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.921+0000 7fd20fffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd2080b5050 0x7fd20809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.921+0000 7fd20fffd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2080b3830 con 0x7fd2080b43f0 2024-09-16T01:22:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.921+0000 7fd20fffd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2080b5610 con 0x7fd20815b340 2024-09-16T01:22:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.921+0000 7fd20fffd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd2080b5bd0 con 0x7fd2080b5050 2024-09-16T01:22:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.921+0000 7fd20d598640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd2080b43f0 0x7fd20815b720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51480/0 (socket says 172.21.15.81:51480) 2024-09-16T01:22:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.921+0000 7fd20d598640 1 -- 172.21.15.81:0/4217986450 learned_addr learned my addr 172.21.15.81:0/4217986450 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20e59a640 1 --2- 172.21.15.81:0/4217986450 >> v2:172.21.15.102:3300/0 conn(0x7fd2080b5050 0x7fd20809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636107638 0 0) 0x7fd2080b3830 con 0x7fd2080b43f0 2024-09-16T01:22:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1f4003520 con 0x7fd2080b43f0 2024-09-16T01:22:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 128907077 0 0) 0x7fd1f4003520 con 0x7fd2080b43f0 2024-09-16T01:22:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 >> v2:172.21.15.102:3300/0 conn(0x7fd2080b5050 msgr2=0x7fd20809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 --2- 172.21.15.81:0/4217986450 >> v2:172.21.15.102:3300/0 conn(0x7fd2080b5050 0x7fd20809aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 >> v1:172.21.15.102:6789/0 conn(0x7fd20815b340 legacy=0x7fd2080b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2080b58f0 con 0x7fd2080b43f0 2024-09-16T01:22:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fd1f8001670 con 0x7fd2080b43f0 2024-09-16T01:22:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 >> v1:172.21.15.81:6789/0 conn(0x7fd2080b43f0 legacy=0x7fd20815b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 --2- 172.21.15.81:0/4217986450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1f40039b0 0x7fd1f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 --2- 172.21.15.81:0/4217986450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 0x7fd1f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 --2- 172.21.15.81:0/4217986450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1f40051c0 0x7fd1f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2080b5bd0 con 0x7fd1f4004800 2024-09-16T01:22:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f400c060 con 0x7fd1f40051c0 2024-09-16T01:22:41.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd1f400c260 con 0x7fd1f40039b0 2024-09-16T01:22:41.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20d598640 1 --2- 172.21.15.81:0/4217986450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 0x7fd1f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20e59a640 1 --2- 172.21.15.81:0/4217986450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1f40051c0 0x7fd1f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20dd99640 1 --2- 172.21.15.81:0/4217986450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1f40039b0 0x7fd1f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20d598640 1 -- 172.21.15.81:0/4217986450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1f40039b0 msgr2=0x7fd1f4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:41.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20d598640 1 --2- 172.21.15.81:0/4217986450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1f40039b0 0x7fd1f4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20d598640 1 -- 172.21.15.81:0/4217986450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1f40051c0 msgr2=0x7fd1f400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:41.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20d598640 1 --2- 172.21.15.81:0/4217986450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1f40051c0 0x7fd1f400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20d598640 1 -- 172.21.15.81:0/4217986450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f4003520 con 0x7fd1f4004800 2024-09-16T01:22:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20e59a640 1 --2- 172.21.15.81:0/4217986450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1f40051c0 0x7fd1f400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.922+0000 7fd20e59a640 1 -- 172.21.15.81:0/4217986450 reap_dead start 2024-09-16T01:22:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.923+0000 7fd20d598640 1 --2- 172.21.15.81:0/4217986450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 0x7fd1f4004c80 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800c240 tx=0x7fd1f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2430d63573e8d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.923+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8007d10 con 0x7fd1f4004800 2024-09-16T01:22:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.923+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f80058d0 con 0x7fd1f4004800 2024-09-16T01:22:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.923+0000 7fd20cd97640 1 -- 172.21.15.81:0/4217986450 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8005d40 con 0x7fd1f4004800 2024-09-16T01:22:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.924+0000 7fd20fffd640 1 -- 172.21.15.81:0/4217986450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 msgr2=0x7fd1f4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.924+0000 7fd20fffd640 1 --2- 172.21.15.81:0/4217986450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 0x7fd1f4004c80 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800c240 tx=0x7fd1f4005830 comp rx=0 tx=0).stop 2024-09-16T01:22:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.924+0000 7fd20fffd640 1 -- 172.21.15.81:0/4217986450 shutdown_connections 2024-09-16T01:22:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.924+0000 7fd20fffd640 1 --2- 172.21.15.81:0/4217986450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 0x7fd1f4004c80 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.924+0000 7fd20fffd640 1 -- 172.21.15.81:0/4217986450 >> 172.21.15.81:0/4217986450 conn(0x7fd208073490 msgr2=0x7fd2080b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:41.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.924+0000 7fd20fffd640 1 -- 172.21.15.81:0/4217986450 shutdown_connections 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.924+0000 7fd20fffd640 1 -- 172.21.15.81:0/4217986450 wait complete. 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.925+0000 7fd20fffd640 1 Processor -- start 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.925+0000 7fd20fffd640 1 -- start start 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20fffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 0x7fd2080cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20fffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2080d0b90 0x7fd2081500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20fffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2081505e0 0x7fd20814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20fffd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2080cdb30 con 0x7fd1f4004800 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20fffd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd20815d8f0 con 0x7fd2081505e0 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20fffd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd2080cdcb0 con 0x7fd2080d0b90 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20dd99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 0x7fd2080cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20dd99640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 0x7fd2080cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37304/0 (socket says 172.21.15.81:37304) 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20dd99640 1 -- 172.21.15.81:0/1024025982 learned_addr learned my addr 172.21.15.81:0/1024025982 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20d598640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2080d0b90 0x7fd2081500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20e59a640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2081505e0 0x7fd20814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20dd99640 1 -- 172.21.15.81:0/1024025982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2080d0b90 msgr2=0x7fd2081500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20dd99640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2080d0b90 0x7fd2081500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20dd99640 1 -- 172.21.15.81:0/1024025982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2081505e0 msgr2=0x7fd20814ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20dd99640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2081505e0 0x7fd20814ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20dd99640 1 -- 172.21.15.81:0/1024025982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2080cde90 con 0x7fd1f4004800 2024-09-16T01:22:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20dd99640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 0x7fd2080cf210 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fd204010740 tx=0x7fd204010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd1fe7fc640 1 -- 172.21.15.81:0/1024025982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20400e8d0 con 0x7fd1f4004800 2024-09-16T01:22:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd1fe7fc640 1 -- 172.21.15.81:0/1024025982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20400ea70 con 0x7fd1f4004800 2024-09-16T01:22:41.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd1fe7fc640 1 -- 172.21.15.81:0/1024025982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20400ee40 con 0x7fd1f4004800 2024-09-16T01:22:41.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.926+0000 7fd20fffd640 1 -- 172.21.15.81:0/1024025982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2080ce170 con 0x7fd1f4004800 2024-09-16T01:22:41.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.927+0000 7fd20fffd640 1 -- 172.21.15.81:0/1024025982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2080ce730 con 0x7fd1f4004800 2024-09-16T01:22:41.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.927+0000 7fd20fffd640 1 -- 172.21.15.81:0/1024025982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2081509f0 con 0x7fd1f4004800 2024-09-16T01:22:41.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.928+0000 7fd1fe7fc640 1 -- 172.21.15.81:0/1024025982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd2040035f0 con 0x7fd1f4004800 2024-09-16T01:22:41.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.928+0000 7fd1fe7fc640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd1ec06c2e0 0x7fd1ec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:41.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.928+0000 7fd1fe7fc640 1 -- 172.21.15.81:0/1024025982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fd20408d890 con 0x7fd1f4004800 2024-09-16T01:22:41.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.928+0000 7fd20d598640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd1ec06c2e0 0x7fd1ec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:41.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.929+0000 7fd20d598640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd1ec06c2e0 0x7fd1ec06e7a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8033000 tx=0x7fd1f8035040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:41.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:41.932+0000 7fd1fe7fc640 1 -- 172.21.15.81:0/1024025982 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2081509f0 con 0x7fd1f4004800 2024-09-16T01:22:42.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.094+0000 7fd20fffd640 1 -- 172.21.15.81:0/1024025982 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd20806f650 con 0x7fd1ec06c2e0 2024-09-16T01:22:42.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.100+0000 7fd1fe7fc640 1 -- 172.21.15.81:0/1024025982 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247090 (secure 0 0 0) 0x7fd20806f650 con 0x7fd1ec06c2e0 2024-09-16T01:22:42.103 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:42.105 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:22:42.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.103+0000 7fd20fffd640 1 -- 172.21.15.81:0/1024025982 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd1ec06c2e0 msgr2=0x7fd1ec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.103+0000 7fd20fffd640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd1ec06c2e0 0x7fd1ec06e7a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8033000 tx=0x7fd1f8035040 comp rx=0 tx=0).stop 2024-09-16T01:22:42.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.103+0000 7fd20fffd640 1 -- 172.21.15.81:0/1024025982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 msgr2=0x7fd2080cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.103+0000 7fd20fffd640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 0x7fd2080cf210 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fd204010740 tx=0x7fd204010c00 comp rx=0 tx=0).stop 2024-09-16T01:22:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.103+0000 7fd20fffd640 1 -- 172.21.15.81:0/1024025982 shutdown_connections 2024-09-16T01:22:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.103+0000 7fd20fffd640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd1ec06c2e0 0x7fd1ec06e7a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.103+0000 7fd20fffd640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2081505e0 0x7fd20814ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.103+0000 7fd20fffd640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2080d0b90 0x7fd2081500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.103+0000 7fd20fffd640 1 --2- 172.21.15.81:0/1024025982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1f4004800 0x7fd2080cf210 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.103+0000 7fd20fffd640 1 -- 172.21.15.81:0/1024025982 >> 172.21.15.81:0/1024025982 conn(0x7fd208073490 msgr2=0x7fd2081593a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.103+0000 7fd20fffd640 1 -- 172.21.15.81:0/1024025982 shutdown_connections 2024-09-16T01:22:42.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.103+0000 7fd20fffd640 1 -- 172.21.15.81:0/1024025982 wait complete. 2024-09-16T01:22:42.115 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-16T01:22:40.151258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266868,"kb_used_data":13168,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754707852,"statfs":{"total":773094113280,"available":772820840448,"internally_reserved":0,"allocated":13484032,"data_stored":6830794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000886"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459930+0000","last_change":"2024-09-16T01:22:37.459930+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459930+0000","last_undegraded":"2024-09-16T01:22:37.459930+0000","last_fullsized":"2024-09-16T01:22:37.459930+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462073+0000","last_change":"2024-09-16T01:22:37.462073+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462073+0000","last_undegraded":"2024-09-16T01:22:37.462073+0000","last_fullsized":"2024-09-16T01:22:37.462073+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458082+0000","last_change":"2024-09-16T01:22:37.458082+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458082+0000","last_undegraded":"2024-09-16T01:22:37.458082+0000","last_fullsized":"2024-09-16T01:22:37.458082+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458453+0000","last_change":"2024-09-16T01:22:37.458453+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458453+0000","last_undegraded":"2024-09-16T01:22:37.458453+0000","last_fullsized":"2024-09-16T01:22:37.458453+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.464247+0000","last_change":"2024-09-16T01:22:37.464247+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.464247+0000","last_undegraded":"2024-09-16T01:22:37.464247+0000","last_fullsized":"2024-09-16T01:22:37.464247+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462671+0000","last_change":"2024-09-16T01:22:37.462671+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462671+0000","last_undegraded":"2024-09-16T01:22:37.462671+0000","last_fullsized":"2024-09-16T01:22:37.462671+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461888+0000","last_change":"2024-09-16T01:22:37.461888+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461888+0000","last_undegraded":"2024-09-16T01:22:37.461888+0000","last_fullsized":"2024-09-16T01:22:37.461888+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459698+0000","last_change":"2024-09-16T01:22:37.459698+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459698+0000","last_undegraded":"2024-09-16T01:22:37.459698+0000","last_fullsized":"2024-09-16T01:22:37.459698+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462682+0000","last_change":"2024-09-16T01:22:37.462682+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462682+0000","last_undegraded":"2024-09-16T01:22:37.462682+0000","last_fullsized":"2024-09-16T01:22:37.462682+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462998+0000","last_change":"2024-09-16T01:22:37.462998+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462998+0000","last_undegraded":"2024-09-16T01:22:37.462998+0000","last_fullsized":"2024-09-16T01:22:37.462998+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460346+0000","last_change":"2024-09-16T01:22:37.460346+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460346+0000","last_undegraded":"2024-09-16T01:22:37.460346+0000","last_fullsized":"2024-09-16T01:22:37.460346+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458937+0000","last_change":"2024-09-16T01:22:37.458937+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458937+0000","last_undegraded":"2024-09-16T01:22:37.458937+0000","last_fullsized":"2024-09-16T01:22:37.458937+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462620+0000","last_change":"2024-09-16T01:22:37.462620+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462620+0000","last_undegraded":"2024-09-16T01:22:37.462620+0000","last_fullsized":"2024-09-16T01:22:37.462620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458722+0000","last_change":"2024-09-16T01:22:37.458722+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458722+0000","last_undegraded":"2024-09-16T01:22:37.458722+0000","last_fullsized":"2024-09-16T01:22:37.458722+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459852+0000","last_change":"2024-09-16T01:22:37.459852+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459852+0000","last_undegraded":"2024-09-16T01:22:37.459852+0000","last_fullsized":"2024-09-16T01:22:37.459852+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.464088+0000","last_change":"2024-09-16T01:22:37.464088+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.464088+0000","last_undegraded":"2024-09-16T01:22:37.464088+0000","last_fullsized":"2024-09-16T01:22:37.464088+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462170+0000","last_change":"2024-09-16T01:22:37.462170+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462170+0000","last_undegraded":"2024-09-16T01:22:37.462170+0000","last_fullsized":"2024-09-16T01:22:37.462170+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463680+0000","last_change":"2024-09-16T01:22:37.463680+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463680+0000","last_undegraded":"2024-09-16T01:22:37.463680+0000","last_fullsized":"2024-09-16T01:22:37.463680+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462447+0000","last_change":"2024-09-16T01:22:37.462447+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462447+0000","last_undegraded":"2024-09-16T01:22:37.462447+0000","last_fullsized":"2024-09-16T01:22:37.462447+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462824+0000","last_change":"2024-09-16T01:22:37.462824+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462824+0000","last_undegraded":"2024-09-16T01:22:37.462824+0000","last_fullsized":"2024-09-16T01:22:37.462824+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456629+0000","last_change":"2024-09-16T01:22:37.456629+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456629+0000","last_undegraded":"2024-09-16T01:22:37.456629+0000","last_fullsized":"2024-09-16T01:22:37.456629+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.467780+0000","last_change":"2024-09-16T01:22:37.467780+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.467780+0000","last_undegraded":"2024-09-16T01:22:37.467780+0000","last_fullsized":"2024-09-16T01:22:37.467780+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456664+0000","last_change":"2024-09-16T01:22:37.456664+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456664+0000","last_undegraded":"2024-09-16T01:22:37.456664+0000","last_fullsized":"2024-09-16T01:22:37.456664+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460799+0000","last_change":"2024-09-16T01:22:37.460799+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460799+0000","last_undegraded":"2024-09-16T01:22:37.460799+0000","last_fullsized":"2024-09-16T01:22:37.460799+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458477+0000","last_change":"2024-09-16T01:22:37.458477+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458477+0000","last_undegraded":"2024-09-16T01:22:37.458477+0000","last_fullsized":"2024-09-16T01:22:37.458477+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.457611+0000","last_change":"2024-09-16T01:22:37.457611+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.457611+0000","last_undegraded":"2024-09-16T01:22:37.457611+0000","last_fullsized":"2024-09-16T01:22:37.457611+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460523+0000","last_change":"2024-09-16T01:22:37.460523+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460523+0000","last_undegraded":"2024-09-16T01:22:37.460523+0000","last_fullsized":"2024-09-16T01:22:37.460523+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463848+0000","last_change":"2024-09-16T01:22:37.463848+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463848+0000","last_undegraded":"2024-09-16T01:22:37.463848+0000","last_fullsized":"2024-09-16T01:22:37.463848+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459671+0000","last_change":"2024-09-16T01:22:37.459671+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459671+0000","last_undegraded":"2024-09-16T01:22:37.459671+0000","last_fullsized":"2024-09-16T01:22:37.459671+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456725+0000","last_change":"2024-09-16T01:22:37.456725+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456725+0000","last_undegraded":"2024-09-16T01:22:37.456725+0000","last_fullsized":"2024-09-16T01:22:37.456725+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461713+0000","last_change":"2024-09-16T01:22:37.461713+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461713+0000","last_undegraded":"2024-09-16T01:22:37.461713+0000","last_fullsized":"2024-09-16T01:22:37.461713+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461958+0000","last_change":"2024-09-16T01:22:37.461958+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461958+0000","last_undegraded":"2024-09-16T01:22:37.461958+0000","last_fullsized":"2024-09-16T01:22:37.461958+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459229+0000","last_change":"2024-09-16T01:22:37.459229+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459229+0000","last_undegraded":"2024-09-16T01:22:37.459229+0000","last_fullsized":"2024-09-16T01:22:37.459229+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476726+0000","last_change":"2024-09-16T01:22:37.473828+0000","last_active":"2024-09-16T01:22:37.476726+0000","last_peered":"2024-09-16T01:22:37.476726+0000","last_clean":"2024-09-16T01:22:37.476726+0000","last_became_active":"2024-09-16T01:22:37.473523+0000","last_became_peered":"2024-09-16T01:22:37.473523+0000","last_unstale":"2024-09-16T01:22:37.476726+0000","last_undegraded":"2024-09-16T01:22:37.476726+0000","last_fullsized":"2024-09-16T01:22:37.476726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:47.484184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458521+0000","last_change":"2024-09-16T01:22:37.458521+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458521+0000","last_undegraded":"2024-09-16T01:22:37.458521+0000","last_fullsized":"2024-09-16T01:22:37.458521+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471465+0000","last_change":"2024-09-16T01:22:37.469361+0000","last_active":"2024-09-16T01:22:37.471465+0000","last_peered":"2024-09-16T01:22:37.471465+0000","last_clean":"2024-09-16T01:22:37.471465+0000","last_became_active":"2024-09-16T01:22:37.469091+0000","last_became_peered":"2024-09-16T01:22:37.469091+0000","last_unstale":"2024-09-16T01:22:37.471465+0000","last_undegraded":"2024-09-16T01:22:37.471465+0000","last_fullsized":"2024-09-16T01:22:37.471465+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:06.683640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456135+0000","last_change":"2024-09-16T01:22:37.456135+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456135+0000","last_undegraded":"2024-09-16T01:22:37.456135+0000","last_fullsized":"2024-09-16T01:22:37.456135+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477095+0000","last_change":"2024-09-16T01:22:37.472329+0000","last_active":"2024-09-16T01:22:37.477095+0000","last_peered":"2024-09-16T01:22:37.477095+0000","last_clean":"2024-09-16T01:22:37.477095+0000","last_became_active":"2024-09-16T01:22:37.471993+0000","last_became_peered":"2024-09-16T01:22:37.471993+0000","last_unstale":"2024-09-16T01:22:37.477095+0000","last_undegraded":"2024-09-16T01:22:37.477095+0000","last_fullsized":"2024-09-16T01:22:37.477095+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:41.536663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.467144+0000","last_change":"2024-09-16T01:22:37.467144+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.467144+0000","last_undegraded":"2024-09-16T01:22:37.467144+0000","last_fullsized":"2024-09-16T01:22:37.467144+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477115+0000","last_change":"2024-09-16T01:22:37.472495+0000","last_active":"2024-09-16T01:22:37.477115+0000","last_peered":"2024-09-16T01:22:37.477115+0000","last_clean":"2024-09-16T01:22:37.477115+0000","last_became_active":"2024-09-16T01:22:37.472218+0000","last_became_peered":"2024-09-16T01:22:37.472218+0000","last_unstale":"2024-09-16T01:22:37.477115+0000","last_undegraded":"2024-09-16T01:22:37.477115+0000","last_fullsized":"2024-09-16T01:22:37.477115+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:11.681815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462726+0000","last_change":"2024-09-16T01:22:37.462726+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462726+0000","last_undegraded":"2024-09-16T01:22:37.462726+0000","last_fullsized":"2024-09-16T01:22:37.462726+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474208+0000","last_change":"2024-09-16T01:22:37.469230+0000","last_active":"2024-09-16T01:22:37.474208+0000","last_peered":"2024-09-16T01:22:37.474208+0000","last_clean":"2024-09-16T01:22:37.474208+0000","last_became_active":"2024-09-16T01:22:37.468906+0000","last_became_peered":"2024-09-16T01:22:37.468906+0000","last_unstale":"2024-09-16T01:22:37.474208+0000","last_undegraded":"2024-09-16T01:22:37.474208+0000","last_fullsized":"2024-09-16T01:22:37.474208+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462376+0000","last_change":"2024-09-16T01:22:37.462376+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462376+0000","last_undegraded":"2024-09-16T01:22:37.462376+0000","last_fullsized":"2024-09-16T01:22:37.462376+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.473368+0000","last_change":"2024-09-16T01:22:37.472506+0000","last_active":"2024-09-16T01:22:37.473368+0000","last_peered":"2024-09-16T01:22:37.473368+0000","last_clean":"2024-09-16T01:22:37.473368+0000","last_became_active":"2024-09-16T01:22:37.472177+0000","last_became_peered":"2024-09-16T01:22:37.472177+0000","last_unstale":"2024-09-16T01:22:37.473368+0000","last_undegraded":"2024-09-16T01:22:37.473368+0000","last_fullsized":"2024-09-16T01:22:37.473368+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:21.137299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463249+0000","last_change":"2024-09-16T01:22:37.463249+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463249+0000","last_undegraded":"2024-09-16T01:22:37.463249+0000","last_fullsized":"2024-09-16T01:22:37.463249+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472887+0000","last_change":"2024-09-16T01:22:37.464769+0000","last_active":"2024-09-16T01:22:37.472887+0000","last_peered":"2024-09-16T01:22:37.472887+0000","last_clean":"2024-09-16T01:22:37.472887+0000","last_became_active":"2024-09-16T01:22:37.464432+0000","last_became_peered":"2024-09-16T01:22:37.464432+0000","last_unstale":"2024-09-16T01:22:37.472887+0000","last_undegraded":"2024-09-16T01:22:37.472887+0000","last_fullsized":"2024-09-16T01:22:37.472887+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:24.269797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461252+0000","last_change":"2024-09-16T01:22:37.461252+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461252+0000","last_undegraded":"2024-09-16T01:22:37.461252+0000","last_fullsized":"2024-09-16T01:22:37.461252+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.466893+0000","last_change":"2024-09-16T01:22:37.466155+0000","last_active":"2024-09-16T01:22:37.466893+0000","last_peered":"2024-09-16T01:22:37.466893+0000","last_clean":"2024-09-16T01:22:37.466893+0000","last_became_active":"2024-09-16T01:22:37.465891+0000","last_became_peered":"2024-09-16T01:22:37.465891+0000","last_unstale":"2024-09-16T01:22:37.466893+0000","last_undegraded":"2024-09-16T01:22:37.466893+0000","last_fullsized":"2024-09-16T01:22:37.466893+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:58.533695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458512+0000","last_change":"2024-09-16T01:22:37.458512+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458512+0000","last_undegraded":"2024-09-16T01:22:37.458512+0000","last_fullsized":"2024-09-16T01:22:37.458512+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.468786+0000","last_change":"2024-09-16T01:22:37.466248+0000","last_active":"2024-09-16T01:22:37.468786+0000","last_peered":"2024-09-16T01:22:37.468786+0000","last_clean":"2024-09-16T01:22:37.468786+0000","last_became_active":"2024-09-16T01:22:37.465956+0000","last_became_peered":"2024-09-16T01:22:37.465956+0000","last_unstale":"2024-09-16T01:22:37.468786+0000","last_undegraded":"2024-09-16T01:22:37.468786+0000","last_fullsized":"2024-09-16T01:22:37.468786+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:24.269797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460932+0000","last_change":"2024-09-16T01:22:37.460932+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460932+0000","last_undegraded":"2024-09-16T01:22:37.460932+0000","last_fullsized":"2024-09-16T01:22:37.460932+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477316+0000","last_change":"2024-09-16T01:22:37.476174+0000","last_active":"2024-09-16T01:22:37.477316+0000","last_peered":"2024-09-16T01:22:37.477316+0000","last_clean":"2024-09-16T01:22:37.477316+0000","last_became_active":"2024-09-16T01:22:37.475897+0000","last_became_peered":"2024-09-16T01:22:37.475897+0000","last_unstale":"2024-09-16T01:22:37.477316+0000","last_undegraded":"2024-09-16T01:22:37.477316+0000","last_fullsized":"2024-09-16T01:22:37.477316+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:58.401908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456287+0000","last_change":"2024-09-16T01:22:37.456287+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456287+0000","last_undegraded":"2024-09-16T01:22:37.456287+0000","last_fullsized":"2024-09-16T01:22:37.456287+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477054+0000","last_change":"2024-09-16T01:22:37.471374+0000","last_active":"2024-09-16T01:22:37.477054+0000","last_peered":"2024-09-16T01:22:37.477054+0000","last_clean":"2024-09-16T01:22:37.477054+0000","last_became_active":"2024-09-16T01:22:37.471086+0000","last_became_peered":"2024-09-16T01:22:37.471086+0000","last_unstale":"2024-09-16T01:22:37.477054+0000","last_undegraded":"2024-09-16T01:22:37.477054+0000","last_fullsized":"2024-09-16T01:22:37.477054+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:57.246038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456859+0000","last_change":"2024-09-16T01:22:37.456859+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456859+0000","last_undegraded":"2024-09-16T01:22:37.456859+0000","last_fullsized":"2024-09-16T01:22:37.456859+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476726+0000","last_change":"2024-09-16T01:22:37.469445+0000","last_active":"2024-09-16T01:22:37.476726+0000","last_peered":"2024-09-16T01:22:37.476726+0000","last_clean":"2024-09-16T01:22:37.476726+0000","last_became_active":"2024-09-16T01:22:37.469160+0000","last_became_peered":"2024-09-16T01:22:37.469160+0000","last_unstale":"2024-09-16T01:22:37.476726+0000","last_undegraded":"2024-09-16T01:22:37.476726+0000","last_fullsized":"2024-09-16T01:22:37.476726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:38.021847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463436+0000","last_change":"2024-09-16T01:22:37.463436+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463436+0000","last_undegraded":"2024-09-16T01:22:37.463436+0000","last_fullsized":"2024-09-16T01:22:37.463436+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477298+0000","last_change":"2024-09-16T01:22:37.476008+0000","last_active":"2024-09-16T01:22:37.477298+0000","last_peered":"2024-09-16T01:22:37.477298+0000","last_clean":"2024-09-16T01:22:37.477298+0000","last_became_active":"2024-09-16T01:22:37.475720+0000","last_became_peered":"2024-09-16T01:22:37.475720+0000","last_unstale":"2024-09-16T01:22:37.477298+0000","last_undegraded":"2024-09-16T01:22:37.477298+0000","last_fullsized":"2024-09-16T01:22:37.477298+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:24.873727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460709+0000","last_change":"2024-09-16T01:22:37.460709+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460709+0000","last_undegraded":"2024-09-16T01:22:37.460709+0000","last_fullsized":"2024-09-16T01:22:37.460709+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.464358+0000","last_change":"2024-09-16T01:22:37.459504+0000","last_active":"2024-09-16T01:22:37.464358+0000","last_peered":"2024-09-16T01:22:37.464358+0000","last_clean":"2024-09-16T01:22:37.464358+0000","last_became_active":"2024-09-16T01:22:37.459226+0000","last_became_peered":"2024-09-16T01:22:37.459226+0000","last_unstale":"2024-09-16T01:22:37.464358+0000","last_undegraded":"2024-09-16T01:22:37.464358+0000","last_fullsized":"2024-09-16T01:22:37.464358+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:45.701573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462831+0000","last_change":"2024-09-16T01:22:37.462831+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462831+0000","last_undegraded":"2024-09-16T01:22:37.462831+0000","last_fullsized":"2024-09-16T01:22:37.462831+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.470912+0000","last_change":"2024-09-16T01:22:37.460411+0000","last_active":"2024-09-16T01:22:37.470912+0000","last_peered":"2024-09-16T01:22:37.470912+0000","last_clean":"2024-09-16T01:22:37.470912+0000","last_became_active":"2024-09-16T01:22:37.460106+0000","last_became_peered":"2024-09-16T01:22:37.460106+0000","last_unstale":"2024-09-16T01:22:37.470912+0000","last_undegraded":"2024-09-16T01:22:37.470912+0000","last_fullsized":"2024-09-16T01:22:37.470912+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:01.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.455702+0000","last_change":"2024-09-16T01:22:37.455702+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.455702+0000","last_undegraded":"2024-09-16T01:22:37.455702+0000","last_fullsized":"2024-09-16T01:22:37.455702+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.467229+0000","last_change":"2024-09-16T01:22:37.465535+0000","last_active":"2024-09-16T01:22:37.467229+0000","last_peered":"2024-09-16T01:22:37.467229+0000","last_clean":"2024-09-16T01:22:37.467229+0000","last_became_active":"2024-09-16T01:22:37.465233+0000","last_became_peered":"2024-09-16T01:22:37.465233+0000","last_unstale":"2024-09-16T01:22:37.467229+0000","last_undegraded":"2024-09-16T01:22:37.467229+0000","last_fullsized":"2024-09-16T01:22:37.467229+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461436+0000","last_change":"2024-09-16T01:22:37.461436+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461436+0000","last_undegraded":"2024-09-16T01:22:37.461436+0000","last_fullsized":"2024-09-16T01:22:37.461436+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476664+0000","last_change":"2024-09-16T01:22:37.473710+0000","last_active":"2024-09-16T01:22:37.476664+0000","last_peered":"2024-09-16T01:22:37.476664+0000","last_clean":"2024-09-16T01:22:37.476664+0000","last_became_active":"2024-09-16T01:22:37.473344+0000","last_became_peered":"2024-09-16T01:22:37.473344+0000","last_unstale":"2024-09-16T01:22:37.476664+0000","last_undegraded":"2024-09-16T01:22:37.476664+0000","last_fullsized":"2024-09-16T01:22:37.476664+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:21:36.959019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461037+0000","last_change":"2024-09-16T01:22:37.461037+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461037+0000","last_undegraded":"2024-09-16T01:22:37.461037+0000","last_fullsized":"2024-09-16T01:22:37.461037+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471266+0000","last_change":"2024-09-16T01:22:37.463887+0000","last_active":"2024-09-16T01:22:37.471266+0000","last_peered":"2024-09-16T01:22:37.471266+0000","last_clean":"2024-09-16T01:22:37.471266+0000","last_became_active":"2024-09-16T01:22:37.463631+0000","last_became_peered":"2024-09-16T01:22:37.463631+0000","last_unstale":"2024-09-16T01:22:37.471266+0000","last_undegraded":"2024-09-16T01:22:37.471266+0000","last_fullsized":"2024-09-16T01:22:37.471266+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462038+0000","last_change":"2024-09-16T01:22:37.462038+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462038+0000","last_undegraded":"2024-09-16T01:22:37.462038+0000","last_fullsized":"2024-09-16T01:22:37.462038+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.475270+0000","last_change":"2024-09-16T01:22:37.474218+0000","last_active":"2024-09-16T01:22:37.475270+0000","last_peered":"2024-09-16T01:22:37.475270+0000","last_clean":"2024-09-16T01:22:37.475270+0000","last_became_active":"2024-09-16T01:22:37.473947+0000","last_became_peered":"2024-09-16T01:22:37.473947+0000","last_unstale":"2024-09-16T01:22:37.475270+0000","last_undegraded":"2024-09-16T01:22:37.475270+0000","last_fullsized":"2024-09-16T01:22:37.475270+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:19.356499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459557+0000","last_change":"2024-09-16T01:22:37.459557+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459557+0000","last_undegraded":"2024-09-16T01:22:37.459557+0000","last_fullsized":"2024-09-16T01:22:37.459557+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474230+0000","last_change":"2024-09-16T01:22:37.469517+0000","last_active":"2024-09-16T01:22:37.474230+0000","last_peered":"2024-09-16T01:22:37.474230+0000","last_clean":"2024-09-16T01:22:37.474230+0000","last_became_active":"2024-09-16T01:22:37.469256+0000","last_became_peered":"2024-09-16T01:22:37.469256+0000","last_unstale":"2024-09-16T01:22:37.474230+0000","last_undegraded":"2024-09-16T01:22:37.474230+0000","last_fullsized":"2024-09-16T01:22:37.474230+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:24.269797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459485+0000","last_change":"2024-09-16T01:22:37.459485+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459485+0000","last_undegraded":"2024-09-16T01:22:37.459485+0000","last_fullsized":"2024-09-16T01:22:37.459485+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472403+0000","last_change":"2024-09-16T01:22:37.469806+0000","last_active":"2024-09-16T01:22:37.472403+0000","last_peered":"2024-09-16T01:22:37.472403+0000","last_clean":"2024-09-16T01:22:37.472403+0000","last_became_active":"2024-09-16T01:22:37.469516+0000","last_became_peered":"2024-09-16T01:22:37.469516+0000","last_unstale":"2024-09-16T01:22:37.472403+0000","last_undegraded":"2024-09-16T01:22:37.472403+0000","last_fullsized":"2024-09-16T01:22:37.472403+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:37.113423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461311+0000","last_change":"2024-09-16T01:22:37.461311+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461311+0000","last_undegraded":"2024-09-16T01:22:37.461311+0000","last_fullsized":"2024-09-16T01:22:37.461311+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477145+0000","last_change":"2024-09-16T01:22:37.473724+0000","last_active":"2024-09-16T01:22:37.477145+0000","last_peered":"2024-09-16T01:22:37.477145+0000","last_clean":"2024-09-16T01:22:37.477145+0000","last_became_active":"2024-09-16T01:22:37.473345+0000","last_became_peered":"2024-09-16T01:22:37.473345+0000","last_unstale":"2024-09-16T01:22:37.477145+0000","last_undegraded":"2024-09-16T01:22:37.477145+0000","last_fullsized":"2024-09-16T01:22:37.477145+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.792365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459140+0000","last_change":"2024-09-16T01:22:37.459140+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459140+0000","last_undegraded":"2024-09-16T01:22:37.459140+0000","last_fullsized":"2024-09-16T01:22:37.459140+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472895+0000","last_change":"2024-09-16T01:22:37.466054+0000","last_active":"2024-09-16T01:22:37.472895+0000","last_peered":"2024-09-16T01:22:37.472895+0000","last_clean":"2024-09-16T01:22:37.472895+0000","last_became_active":"2024-09-16T01:22:37.465813+0000","last_became_peered":"2024-09-16T01:22:37.465813+0000","last_unstale":"2024-09-16T01:22:37.472895+0000","last_undegraded":"2024-09-16T01:22:37.472895+0000","last_fullsized":"2024-09-16T01:22:37.472895+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:15.378906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460661+0000","last_change":"2024-09-16T01:22:37.460661+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460661+0000","last_undegraded":"2024-09-16T01:22:37.460661+0000","last_fullsized":"2024-09-16T01:22:37.460661+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.475508+0000","last_change":"2024-09-16T01:22:37.473626+0000","last_active":"2024-09-16T01:22:37.475508+0000","last_peered":"2024-09-16T01:22:37.475508+0000","last_clean":"2024-09-16T01:22:37.475508+0000","last_became_active":"2024-09-16T01:22:37.473256+0000","last_became_peered":"2024-09-16T01:22:37.473256+0000","last_unstale":"2024-09-16T01:22:37.475508+0000","last_undegraded":"2024-09-16T01:22:37.475508+0000","last_fullsized":"2024-09-16T01:22:37.475508+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:33.276036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.455778+0000","last_change":"2024-09-16T01:22:37.455778+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.455778+0000","last_undegraded":"2024-09-16T01:22:37.455778+0000","last_fullsized":"2024-09-16T01:22:37.455778+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471786+0000","last_change":"2024-09-16T01:22:37.467923+0000","last_active":"2024-09-16T01:22:37.471786+0000","last_peered":"2024-09-16T01:22:37.471786+0000","last_clean":"2024-09-16T01:22:37.471786+0000","last_became_active":"2024-09-16T01:22:37.467632+0000","last_became_peered":"2024-09-16T01:22:37.467632+0000","last_unstale":"2024-09-16T01:22:37.471786+0000","last_undegraded":"2024-09-16T01:22:37.471786+0000","last_fullsized":"2024-09-16T01:22:37.471786+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:01.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461657+0000","last_change":"2024-09-16T01:22:37.461657+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461657+0000","last_undegraded":"2024-09-16T01:22:37.461657+0000","last_fullsized":"2024-09-16T01:22:37.461657+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476830+0000","last_change":"2024-09-16T01:22:37.473120+0000","last_active":"2024-09-16T01:22:37.476830+0000","last_peered":"2024-09-16T01:22:37.476830+0000","last_clean":"2024-09-16T01:22:37.476830+0000","last_became_active":"2024-09-16T01:22:37.472799+0000","last_became_peered":"2024-09-16T01:22:37.472799+0000","last_unstale":"2024-09-16T01:22:37.476830+0000","last_undegraded":"2024-09-16T01:22:37.476830+0000","last_fullsized":"2024-09-16T01:22:37.476830+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:17.563539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461546+0000","last_change":"2024-09-16T01:22:37.461546+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461546+0000","last_undegraded":"2024-09-16T01:22:37.461546+0000","last_fullsized":"2024-09-16T01:22:37.461546+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472812+0000","last_change":"2024-09-16T01:22:37.465487+0000","last_active":"2024-09-16T01:22:37.472812+0000","last_peered":"2024-09-16T01:22:37.472812+0000","last_clean":"2024-09-16T01:22:37.472812+0000","last_became_active":"2024-09-16T01:22:37.465154+0000","last_became_peered":"2024-09-16T01:22:37.465154+0000","last_unstale":"2024-09-16T01:22:37.472812+0000","last_undegraded":"2024-09-16T01:22:37.472812+0000","last_fullsized":"2024-09-16T01:22:37.472812+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:17.563539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459189+0000","last_change":"2024-09-16T01:22:37.459189+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459189+0000","last_undegraded":"2024-09-16T01:22:37.459189+0000","last_fullsized":"2024-09-16T01:22:37.459189+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474485+0000","last_change":"2024-09-16T01:22:37.470174+0000","last_active":"2024-09-16T01:22:37.474485+0000","last_peered":"2024-09-16T01:22:37.474485+0000","last_clean":"2024-09-16T01:22:37.474485+0000","last_became_active":"2024-09-16T01:22:37.469905+0000","last_became_peered":"2024-09-16T01:22:37.469905+0000","last_unstale":"2024-09-16T01:22:37.474485+0000","last_undegraded":"2024-09-16T01:22:37.474485+0000","last_fullsized":"2024-09-16T01:22:37.474485+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:17.563539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460407+0000","last_change":"2024-09-16T01:22:37.460407+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460407+0000","last_undegraded":"2024-09-16T01:22:37.460407+0000","last_fullsized":"2024-09-16T01:22:37.460407+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477128+0000","last_change":"2024-09-16T01:22:37.473265+0000","last_active":"2024-09-16T01:22:37.477128+0000","last_peered":"2024-09-16T01:22:37.477128+0000","last_clean":"2024-09-16T01:22:37.477128+0000","last_became_active":"2024-09-16T01:22:37.472881+0000","last_became_peered":"2024-09-16T01:22:37.472881+0000","last_unstale":"2024-09-16T01:22:37.477128+0000","last_undegraded":"2024-09-16T01:22:37.477128+0000","last_fullsized":"2024-09-16T01:22:37.477128+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:35.803129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459981+0000","last_change":"2024-09-16T01:22:37.459981+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459981+0000","last_undegraded":"2024-09-16T01:22:37.459981+0000","last_fullsized":"2024-09-16T01:22:37.459981+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474471+0000","last_change":"2024-09-16T01:22:37.470596+0000","last_active":"2024-09-16T01:22:37.474471+0000","last_peered":"2024-09-16T01:22:37.474471+0000","last_clean":"2024-09-16T01:22:37.474471+0000","last_became_active":"2024-09-16T01:22:37.470270+0000","last_became_peered":"2024-09-16T01:22:37.470270+0000","last_unstale":"2024-09-16T01:22:37.474471+0000","last_undegraded":"2024-09-16T01:22:37.474471+0000","last_fullsized":"2024-09-16T01:22:37.474471+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:06.423099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460687+0000","last_change":"2024-09-16T01:22:37.460687+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460687+0000","last_undegraded":"2024-09-16T01:22:37.460687+0000","last_fullsized":"2024-09-16T01:22:37.460687+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471324+0000","last_change":"2024-09-16T01:22:37.467778+0000","last_active":"2024-09-16T01:22:37.471324+0000","last_peered":"2024-09-16T01:22:37.471324+0000","last_clean":"2024-09-16T01:22:37.471324+0000","last_became_active":"2024-09-16T01:22:37.467524+0000","last_became_peered":"2024-09-16T01:22:37.467524+0000","last_unstale":"2024-09-16T01:22:37.471324+0000","last_undegraded":"2024-09-16T01:22:37.471324+0000","last_fullsized":"2024-09-16T01:22:37.471324+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:52.586042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.457619+0000","last_change":"2024-09-16T01:22:37.457619+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.457619+0000","last_undegraded":"2024-09-16T01:22:37.457619+0000","last_fullsized":"2024-09-16T01:22:37.457619+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477162+0000","last_change":"2024-09-16T01:22:37.474591+0000","last_active":"2024-09-16T01:22:37.477162+0000","last_peered":"2024-09-16T01:22:37.477162+0000","last_clean":"2024-09-16T01:22:37.477162+0000","last_became_active":"2024-09-16T01:22:37.474286+0000","last_became_peered":"2024-09-16T01:22:37.474286+0000","last_unstale":"2024-09-16T01:22:37.477162+0000","last_undegraded":"2024-09-16T01:22:37.477162+0000","last_fullsized":"2024-09-16T01:22:37.477162+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:33.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":357,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.463374+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:22:37.463374+0000","last_peered":"2024-09-16T01:22:37.463374+0000","last_clean":"2024-09-16T01:22:37.463374+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:22:37.463374+0000","last_undegraded":"2024-09-16T01:22:37.463374+0000","last_fullsized":"2024-09-16T01:22:37.463374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2134016,"data_stored":1298290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36844,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334996,"statfs":{"total":96636764160,"available":96599035904,"internally_reserved":0,"allocated":1527808,"data_stored":701263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574937,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1527808,"data_stored":701263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2134016,"data_stored":1298290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:22:42.120 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3f is not active+clean 2024-09-16T01:22:42.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.459930+0000', 'last_change': '2024-09-16T01:22:37.459930+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.459930+0000', 'last_undegraded': '2024-09-16T01:22:37.459930+0000', 'last_fullsized': '2024-09-16T01:22:37.459930+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:22:42.120 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3e is not active+clean 2024-09-16T01:22:42.120 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.462073+0000', 'last_change': '2024-09-16T01:22:37.462073+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.462073+0000', 'last_undegraded': '2024-09-16T01:22:37.462073+0000', 'last_fullsized': '2024-09-16T01:22:37.462073+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:22:42.120 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3d is not active+clean 2024-09-16T01:22:42.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.458082+0000', 'last_change': '2024-09-16T01:22:37.458082+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.458082+0000', 'last_undegraded': '2024-09-16T01:22:37.458082+0000', 'last_fullsized': '2024-09-16T01:22:37.458082+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:22:42.121 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3c is not active+clean 2024-09-16T01:22:42.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.458453+0000', 'last_change': '2024-09-16T01:22:37.458453+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.458453+0000', 'last_undegraded': '2024-09-16T01:22:37.458453+0000', 'last_fullsized': '2024-09-16T01:22:37.458453+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:22:42.121 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3b is not active+clean 2024-09-16T01:22:42.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.464247+0000', 'last_change': '2024-09-16T01:22:37.464247+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.464247+0000', 'last_undegraded': '2024-09-16T01:22:37.464247+0000', 'last_fullsized': '2024-09-16T01:22:37.464247+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:22:42.121 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3a is not active+clean 2024-09-16T01:22:42.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.462671+0000', 'last_change': '2024-09-16T01:22:37.462671+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.462671+0000', 'last_undegraded': '2024-09-16T01:22:37.462671+0000', 'last_fullsized': '2024-09-16T01:22:37.462671+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:22:42.121 INFO:tasks.ceph.ceph_manager.ceph:PG 20.39 is not active+clean 2024-09-16T01:22:42.121 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.461888+0000', 'last_change': '2024-09-16T01:22:37.461888+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.461888+0000', 'last_undegraded': '2024-09-16T01:22:37.461888+0000', 'last_fullsized': '2024-09-16T01:22:37.461888+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:22:42.122 INFO:tasks.ceph.ceph_manager.ceph:PG 20.38 is not active+clean 2024-09-16T01:22:42.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.459698+0000', 'last_change': '2024-09-16T01:22:37.459698+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.459698+0000', 'last_undegraded': '2024-09-16T01:22:37.459698+0000', 'last_fullsized': '2024-09-16T01:22:37.459698+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T01:22:42.122 INFO:tasks.ceph.ceph_manager.ceph:PG 20.37 is not active+clean 2024-09-16T01:22:42.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.462682+0000', 'last_change': '2024-09-16T01:22:37.462682+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.462682+0000', 'last_undegraded': '2024-09-16T01:22:37.462682+0000', 'last_fullsized': '2024-09-16T01:22:37.462682+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:22:42.122 INFO:tasks.ceph.ceph_manager.ceph:PG 20.36 is not active+clean 2024-09-16T01:22:42.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.462998+0000', 'last_change': '2024-09-16T01:22:37.462998+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.462998+0000', 'last_undegraded': '2024-09-16T01:22:37.462998+0000', 'last_fullsized': '2024-09-16T01:22:37.462998+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T01:22:42.122 INFO:tasks.ceph.ceph_manager.ceph:PG 20.35 is not active+clean 2024-09-16T01:22:42.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.460346+0000', 'last_change': '2024-09-16T01:22:37.460346+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.460346+0000', 'last_undegraded': '2024-09-16T01:22:37.460346+0000', 'last_fullsized': '2024-09-16T01:22:37.460346+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:22:42.122 INFO:tasks.ceph.ceph_manager.ceph:PG 20.34 is not active+clean 2024-09-16T01:22:42.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.458937+0000', 'last_change': '2024-09-16T01:22:37.458937+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.458937+0000', 'last_undegraded': '2024-09-16T01:22:37.458937+0000', 'last_fullsized': '2024-09-16T01:22:37.458937+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:22:42.122 INFO:tasks.ceph.ceph_manager.ceph:PG 20.33 is not active+clean 2024-09-16T01:22:42.122 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.462620+0000', 'last_change': '2024-09-16T01:22:37.462620+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.462620+0000', 'last_undegraded': '2024-09-16T01:22:37.462620+0000', 'last_fullsized': '2024-09-16T01:22:37.462620+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:22:42.123 INFO:tasks.ceph.ceph_manager.ceph:PG 20.32 is not active+clean 2024-09-16T01:22:42.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.458722+0000', 'last_change': '2024-09-16T01:22:37.458722+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.458722+0000', 'last_undegraded': '2024-09-16T01:22:37.458722+0000', 'last_fullsized': '2024-09-16T01:22:37.458722+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:22:42.123 INFO:tasks.ceph.ceph_manager.ceph:PG 20.31 is not active+clean 2024-09-16T01:22:42.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.459852+0000', 'last_change': '2024-09-16T01:22:37.459852+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.459852+0000', 'last_undegraded': '2024-09-16T01:22:37.459852+0000', 'last_fullsized': '2024-09-16T01:22:37.459852+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:22:42.123 INFO:tasks.ceph.ceph_manager.ceph:PG 20.30 is not active+clean 2024-09-16T01:22:42.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.464088+0000', 'last_change': '2024-09-16T01:22:37.464088+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.464088+0000', 'last_undegraded': '2024-09-16T01:22:37.464088+0000', 'last_fullsized': '2024-09-16T01:22:37.464088+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:22:42.123 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2f is not active+clean 2024-09-16T01:22:42.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.462170+0000', 'last_change': '2024-09-16T01:22:37.462170+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.462170+0000', 'last_undegraded': '2024-09-16T01:22:37.462170+0000', 'last_fullsized': '2024-09-16T01:22:37.462170+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:22:42.123 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2e is not active+clean 2024-09-16T01:22:42.123 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.463680+0000', 'last_change': '2024-09-16T01:22:37.463680+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.463680+0000', 'last_undegraded': '2024-09-16T01:22:37.463680+0000', 'last_fullsized': '2024-09-16T01:22:37.463680+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:22:42.123 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2d is not active+clean 2024-09-16T01:22:42.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.462447+0000', 'last_change': '2024-09-16T01:22:37.462447+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.462447+0000', 'last_undegraded': '2024-09-16T01:22:37.462447+0000', 'last_fullsized': '2024-09-16T01:22:37.462447+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:22:42.124 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2c is not active+clean 2024-09-16T01:22:42.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.462824+0000', 'last_change': '2024-09-16T01:22:37.462824+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.462824+0000', 'last_undegraded': '2024-09-16T01:22:37.462824+0000', 'last_fullsized': '2024-09-16T01:22:37.462824+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:22:42.124 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2b is not active+clean 2024-09-16T01:22:42.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.456629+0000', 'last_change': '2024-09-16T01:22:37.456629+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.456629+0000', 'last_undegraded': '2024-09-16T01:22:37.456629+0000', 'last_fullsized': '2024-09-16T01:22:37.456629+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:22:42.124 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2a is not active+clean 2024-09-16T01:22:42.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.467780+0000', 'last_change': '2024-09-16T01:22:37.467780+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.467780+0000', 'last_undegraded': '2024-09-16T01:22:37.467780+0000', 'last_fullsized': '2024-09-16T01:22:37.467780+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:22:42.124 INFO:tasks.ceph.ceph_manager.ceph:PG 20.29 is not active+clean 2024-09-16T01:22:42.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.456664+0000', 'last_change': '2024-09-16T01:22:37.456664+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.456664+0000', 'last_undegraded': '2024-09-16T01:22:37.456664+0000', 'last_fullsized': '2024-09-16T01:22:37.456664+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:22:42.124 INFO:tasks.ceph.ceph_manager.ceph:PG 20.28 is not active+clean 2024-09-16T01:22:42.124 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.460799+0000', 'last_change': '2024-09-16T01:22:37.460799+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.460799+0000', 'last_undegraded': '2024-09-16T01:22:37.460799+0000', 'last_fullsized': '2024-09-16T01:22:37.460799+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:22:42.125 INFO:tasks.ceph.ceph_manager.ceph:PG 20.27 is not active+clean 2024-09-16T01:22:42.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.458477+0000', 'last_change': '2024-09-16T01:22:37.458477+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.458477+0000', 'last_undegraded': '2024-09-16T01:22:37.458477+0000', 'last_fullsized': '2024-09-16T01:22:37.458477+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:22:42.125 INFO:tasks.ceph.ceph_manager.ceph:PG 20.26 is not active+clean 2024-09-16T01:22:42.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.457611+0000', 'last_change': '2024-09-16T01:22:37.457611+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.457611+0000', 'last_undegraded': '2024-09-16T01:22:37.457611+0000', 'last_fullsized': '2024-09-16T01:22:37.457611+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:22:42.125 INFO:tasks.ceph.ceph_manager.ceph:PG 20.25 is not active+clean 2024-09-16T01:22:42.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.460523+0000', 'last_change': '2024-09-16T01:22:37.460523+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.460523+0000', 'last_undegraded': '2024-09-16T01:22:37.460523+0000', 'last_fullsized': '2024-09-16T01:22:37.460523+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:22:42.125 INFO:tasks.ceph.ceph_manager.ceph:PG 20.24 is not active+clean 2024-09-16T01:22:42.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.463848+0000', 'last_change': '2024-09-16T01:22:37.463848+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.463848+0000', 'last_undegraded': '2024-09-16T01:22:37.463848+0000', 'last_fullsized': '2024-09-16T01:22:37.463848+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T01:22:42.125 INFO:tasks.ceph.ceph_manager.ceph:PG 20.23 is not active+clean 2024-09-16T01:22:42.125 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.459671+0000', 'last_change': '2024-09-16T01:22:37.459671+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.459671+0000', 'last_undegraded': '2024-09-16T01:22:37.459671+0000', 'last_fullsized': '2024-09-16T01:22:37.459671+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:22:42.125 INFO:tasks.ceph.ceph_manager.ceph:PG 20.22 is not active+clean 2024-09-16T01:22:42.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.456725+0000', 'last_change': '2024-09-16T01:22:37.456725+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.456725+0000', 'last_undegraded': '2024-09-16T01:22:37.456725+0000', 'last_fullsized': '2024-09-16T01:22:37.456725+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:22:42.126 INFO:tasks.ceph.ceph_manager.ceph:PG 20.21 is not active+clean 2024-09-16T01:22:42.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.461713+0000', 'last_change': '2024-09-16T01:22:37.461713+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.461713+0000', 'last_undegraded': '2024-09-16T01:22:37.461713+0000', 'last_fullsized': '2024-09-16T01:22:37.461713+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T01:22:42.126 INFO:tasks.ceph.ceph_manager.ceph:PG 20.20 is not active+clean 2024-09-16T01:22:42.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.461958+0000', 'last_change': '2024-09-16T01:22:37.461958+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.461958+0000', 'last_undegraded': '2024-09-16T01:22:37.461958+0000', 'last_fullsized': '2024-09-16T01:22:37.461958+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T01:22:42.126 INFO:tasks.ceph.ceph_manager.ceph:PG 20.18 is not active+clean 2024-09-16T01:22:42.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.459229+0000', 'last_change': '2024-09-16T01:22:37.459229+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.459229+0000', 'last_undegraded': '2024-09-16T01:22:37.459229+0000', 'last_fullsized': '2024-09-16T01:22:37.459229+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T01:22:42.126 INFO:tasks.ceph.ceph_manager.ceph:PG 20.19 is not active+clean 2024-09-16T01:22:42.126 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.458521+0000', 'last_change': '2024-09-16T01:22:37.458521+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.458521+0000', 'last_undegraded': '2024-09-16T01:22:37.458521+0000', 'last_fullsized': '2024-09-16T01:22:37.458521+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:22:42.126 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1a is not active+clean 2024-09-16T01:22:42.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.456135+0000', 'last_change': '2024-09-16T01:22:37.456135+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.456135+0000', 'last_undegraded': '2024-09-16T01:22:37.456135+0000', 'last_fullsized': '2024-09-16T01:22:37.456135+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:22:42.127 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1b is not active+clean 2024-09-16T01:22:42.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.467144+0000', 'last_change': '2024-09-16T01:22:37.467144+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.467144+0000', 'last_undegraded': '2024-09-16T01:22:37.467144+0000', 'last_fullsized': '2024-09-16T01:22:37.467144+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:22:42.127 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1c is not active+clean 2024-09-16T01:22:42.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.462726+0000', 'last_change': '2024-09-16T01:22:37.462726+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.462726+0000', 'last_undegraded': '2024-09-16T01:22:37.462726+0000', 'last_fullsized': '2024-09-16T01:22:37.462726+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T01:22:42.127 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1d is not active+clean 2024-09-16T01:22:42.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.462376+0000', 'last_change': '2024-09-16T01:22:37.462376+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.462376+0000', 'last_undegraded': '2024-09-16T01:22:37.462376+0000', 'last_fullsized': '2024-09-16T01:22:37.462376+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T01:22:42.127 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1e is not active+clean 2024-09-16T01:22:42.127 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.463249+0000', 'last_change': '2024-09-16T01:22:37.463249+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.463249+0000', 'last_undegraded': '2024-09-16T01:22:37.463249+0000', 'last_fullsized': '2024-09-16T01:22:37.463249+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:22:42.127 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1f is not active+clean 2024-09-16T01:22:42.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.461252+0000', 'last_change': '2024-09-16T01:22:37.461252+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.461252+0000', 'last_undegraded': '2024-09-16T01:22:37.461252+0000', 'last_fullsized': '2024-09-16T01:22:37.461252+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:22:42.128 INFO:tasks.ceph.ceph_manager.ceph:PG 20.10 is not active+clean 2024-09-16T01:22:42.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.458512+0000', 'last_change': '2024-09-16T01:22:37.458512+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.458512+0000', 'last_undegraded': '2024-09-16T01:22:37.458512+0000', 'last_fullsized': '2024-09-16T01:22:37.458512+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:22:42.128 INFO:tasks.ceph.ceph_manager.ceph:PG 20.11 is not active+clean 2024-09-16T01:22:42.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.460932+0000', 'last_change': '2024-09-16T01:22:37.460932+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.460932+0000', 'last_undegraded': '2024-09-16T01:22:37.460932+0000', 'last_fullsized': '2024-09-16T01:22:37.460932+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:22:42.128 INFO:tasks.ceph.ceph_manager.ceph:PG 20.12 is not active+clean 2024-09-16T01:22:42.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.456287+0000', 'last_change': '2024-09-16T01:22:37.456287+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.456287+0000', 'last_undegraded': '2024-09-16T01:22:37.456287+0000', 'last_fullsized': '2024-09-16T01:22:37.456287+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:22:42.128 INFO:tasks.ceph.ceph_manager.ceph:PG 20.13 is not active+clean 2024-09-16T01:22:42.128 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.456859+0000', 'last_change': '2024-09-16T01:22:37.456859+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.456859+0000', 'last_undegraded': '2024-09-16T01:22:37.456859+0000', 'last_fullsized': '2024-09-16T01:22:37.456859+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:22:42.128 INFO:tasks.ceph.ceph_manager.ceph:PG 20.14 is not active+clean 2024-09-16T01:22:42.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.463436+0000', 'last_change': '2024-09-16T01:22:37.463436+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.463436+0000', 'last_undegraded': '2024-09-16T01:22:37.463436+0000', 'last_fullsized': '2024-09-16T01:22:37.463436+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T01:22:42.129 INFO:tasks.ceph.ceph_manager.ceph:PG 20.16 is not active+clean 2024-09-16T01:22:42.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.460709+0000', 'last_change': '2024-09-16T01:22:37.460709+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.460709+0000', 'last_undegraded': '2024-09-16T01:22:37.460709+0000', 'last_fullsized': '2024-09-16T01:22:37.460709+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:22:42.129 INFO:tasks.ceph.ceph_manager.ceph:PG 20.17 is not active+clean 2024-09-16T01:22:42.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.462831+0000', 'last_change': '2024-09-16T01:22:37.462831+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.462831+0000', 'last_undegraded': '2024-09-16T01:22:37.462831+0000', 'last_fullsized': '2024-09-16T01:22:37.462831+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:22:42.129 INFO:tasks.ceph.ceph_manager.ceph:PG 20.8 is not active+clean 2024-09-16T01:22:42.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.455702+0000', 'last_change': '2024-09-16T01:22:37.455702+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.455702+0000', 'last_undegraded': '2024-09-16T01:22:37.455702+0000', 'last_fullsized': '2024-09-16T01:22:37.455702+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:22:42.129 INFO:tasks.ceph.ceph_manager.ceph:PG 20.9 is not active+clean 2024-09-16T01:22:42.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.461436+0000', 'last_change': '2024-09-16T01:22:37.461436+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.461436+0000', 'last_undegraded': '2024-09-16T01:22:37.461436+0000', 'last_fullsized': '2024-09-16T01:22:37.461436+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:22:42.129 INFO:tasks.ceph.ceph_manager.ceph:PG 20.a is not active+clean 2024-09-16T01:22:42.129 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.461037+0000', 'last_change': '2024-09-16T01:22:37.461037+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.461037+0000', 'last_undegraded': '2024-09-16T01:22:37.461037+0000', 'last_fullsized': '2024-09-16T01:22:37.461037+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:22:42.130 INFO:tasks.ceph.ceph_manager.ceph:PG 20.b is not active+clean 2024-09-16T01:22:42.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.462038+0000', 'last_change': '2024-09-16T01:22:37.462038+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.462038+0000', 'last_undegraded': '2024-09-16T01:22:37.462038+0000', 'last_fullsized': '2024-09-16T01:22:37.462038+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T01:22:42.130 INFO:tasks.ceph.ceph_manager.ceph:PG 20.c is not active+clean 2024-09-16T01:22:42.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.459557+0000', 'last_change': '2024-09-16T01:22:37.459557+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.459557+0000', 'last_undegraded': '2024-09-16T01:22:37.459557+0000', 'last_fullsized': '2024-09-16T01:22:37.459557+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:22:42.130 INFO:tasks.ceph.ceph_manager.ceph:PG 20.d is not active+clean 2024-09-16T01:22:42.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.459485+0000', 'last_change': '2024-09-16T01:22:37.459485+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.459485+0000', 'last_undegraded': '2024-09-16T01:22:37.459485+0000', 'last_fullsized': '2024-09-16T01:22:37.459485+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:22:42.130 INFO:tasks.ceph.ceph_manager.ceph:PG 20.e is not active+clean 2024-09-16T01:22:42.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.461311+0000', 'last_change': '2024-09-16T01:22:37.461311+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.461311+0000', 'last_undegraded': '2024-09-16T01:22:37.461311+0000', 'last_fullsized': '2024-09-16T01:22:37.461311+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:22:42.130 INFO:tasks.ceph.ceph_manager.ceph:PG 20.f is not active+clean 2024-09-16T01:22:42.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.459140+0000', 'last_change': '2024-09-16T01:22:37.459140+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.459140+0000', 'last_undegraded': '2024-09-16T01:22:37.459140+0000', 'last_fullsized': '2024-09-16T01:22:37.459140+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:22:42.130 INFO:tasks.ceph.ceph_manager.ceph:PG 20.0 is not active+clean 2024-09-16T01:22:42.130 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.460661+0000', 'last_change': '2024-09-16T01:22:37.460661+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.460661+0000', 'last_undegraded': '2024-09-16T01:22:37.460661+0000', 'last_fullsized': '2024-09-16T01:22:37.460661+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:22:42.131 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1 is not active+clean 2024-09-16T01:22:42.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.455778+0000', 'last_change': '2024-09-16T01:22:37.455778+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.455778+0000', 'last_undegraded': '2024-09-16T01:22:37.455778+0000', 'last_fullsized': '2024-09-16T01:22:37.455778+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:22:42.131 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2 is not active+clean 2024-09-16T01:22:42.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.461657+0000', 'last_change': '2024-09-16T01:22:37.461657+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.461657+0000', 'last_undegraded': '2024-09-16T01:22:37.461657+0000', 'last_fullsized': '2024-09-16T01:22:37.461657+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:22:42.131 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3 is not active+clean 2024-09-16T01:22:42.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.461546+0000', 'last_change': '2024-09-16T01:22:37.461546+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.461546+0000', 'last_undegraded': '2024-09-16T01:22:37.461546+0000', 'last_fullsized': '2024-09-16T01:22:37.461546+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T01:22:42.131 INFO:tasks.ceph.ceph_manager.ceph:PG 20.4 is not active+clean 2024-09-16T01:22:42.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.459189+0000', 'last_change': '2024-09-16T01:22:37.459189+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.459189+0000', 'last_undegraded': '2024-09-16T01:22:37.459189+0000', 'last_fullsized': '2024-09-16T01:22:37.459189+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:22:42.131 INFO:tasks.ceph.ceph_manager.ceph:PG 20.5 is not active+clean 2024-09-16T01:22:42.131 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.460407+0000', 'last_change': '2024-09-16T01:22:37.460407+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.460407+0000', 'last_undegraded': '2024-09-16T01:22:37.460407+0000', 'last_fullsized': '2024-09-16T01:22:37.460407+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:22:42.131 INFO:tasks.ceph.ceph_manager.ceph:PG 20.6 is not active+clean 2024-09-16T01:22:42.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.459981+0000', 'last_change': '2024-09-16T01:22:37.459981+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.459981+0000', 'last_undegraded': '2024-09-16T01:22:37.459981+0000', 'last_fullsized': '2024-09-16T01:22:37.459981+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:22:42.132 INFO:tasks.ceph.ceph_manager.ceph:PG 20.7 is not active+clean 2024-09-16T01:22:42.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.460687+0000', 'last_change': '2024-09-16T01:22:37.460687+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.460687+0000', 'last_undegraded': '2024-09-16T01:22:37.460687+0000', 'last_fullsized': '2024-09-16T01:22:37.460687+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:22:42.132 INFO:tasks.ceph.ceph_manager.ceph:PG 20.15 is not active+clean 2024-09-16T01:22:42.132 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 123, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:22:37.457619+0000', 'last_change': '2024-09-16T01:22:37.457619+0000', 'last_active': '2024-09-16T01:22:37.449954+0000', 'last_peered': '2024-09-16T01:22:37.449954+0000', 'last_clean': '2024-09-16T01:22:37.449954+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:22:37.457619+0000', 'last_undegraded': '2024-09-16T01:22:37.457619+0000', 'last_fullsized': '2024-09-16T01:22:37.457619+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'last_clean_scrub_stamp': '2024-09-16T01:22:37.449954+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:22:42.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T01:22:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.251+0000 7fc1fb39f640 1 Processor -- start 2024-09-16T01:22:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.251+0000 7fc1fb39f640 1 -- start start 2024-09-16T01:22:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.252+0000 7fc1fb39f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1f415b2c0 0x7fc1f40b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.252+0000 7fc1fb39f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1f40b3d90 0x7fc1f406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.252+0000 7fc1fb39f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1f406e7a0 con 0x7fc1f406d260 2024-09-16T01:22:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.252+0000 7fc1fb39f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc1f406d690 con 0x7fc1f415b2c0 2024-09-16T01:22:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.252+0000 7fc1fb39f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f40b43c0 con 0x7fc1f40b3d90 2024-09-16T01:22:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.253+0000 7fc1f9b9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1f40b3d90 0x7fc1f406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.253+0000 7fc1fa39d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1f415b2c0 0x7fc1f40b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.253+0000 7fc1fa39d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1f415b2c0 0x7fc1f40b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:46720/0 (socket says 172.21.15.81:46720) 2024-09-16T01:22:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.253+0000 7fc1f9b9c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1f40b3d90 0x7fc1f406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:55744/0 (socket says 172.21.15.81:55744) 2024-09-16T01:22:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.253+0000 7fc1fa39d640 1 -- 172.21.15.81:0/1331331421 learned_addr learned my addr 172.21.15.81:0/1331331421 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.253+0000 7fc1f9b9c640 1 -- 172.21.15.81:0/1331331421 >> v2:172.21.15.102:3300/0 conn(0x7fc1f415b2c0 msgr2=0x7fc1f40b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.253+0000 7fc1f9b9c640 1 --2- 172.21.15.81:0/1331331421 >> v2:172.21.15.102:3300/0 conn(0x7fc1f415b2c0 0x7fc1f40b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.253+0000 7fc1f9b9c640 1 -- 172.21.15.81:0/1331331421 >> v1:172.21.15.102:6789/0 conn(0x7fc1f406d260 legacy=0x7fc1f40b4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.253+0000 7fc1f9b9c640 1 -- 172.21.15.81:0/1331331421 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f40b46a0 con 0x7fc1f40b3d90 2024-09-16T01:22:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.254+0000 7fc1f9b9c640 1 --2- 172.21.15.81:0/1331331421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1f40b3d90 0x7fc1f406cd20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009d90 tx=0x7fc1e802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5448e363296ec0ab server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.254+0000 7fc1f939b640 1 -- 172.21.15.81:0/1331331421 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8007740 con 0x7fc1f40b3d90 2024-09-16T01:22:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.254+0000 7fc1f939b640 1 -- 172.21.15.81:0/1331331421 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e80078e0 con 0x7fc1f40b3d90 2024-09-16T01:22:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.254+0000 7fc1f939b640 1 -- 172.21.15.81:0/1331331421 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8007cb0 con 0x7fc1f40b3d90 2024-09-16T01:22:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.254+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1331331421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1f40b3d90 msgr2=0x7fc1f406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.254+0000 7fc1fb39f640 1 --2- 172.21.15.81:0/1331331421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1f40b3d90 0x7fc1f406cd20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009d90 tx=0x7fc1e802a660 comp rx=0 tx=0).stop 2024-09-16T01:22:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.255+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1331331421 shutdown_connections 2024-09-16T01:22:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.255+0000 7fc1fb39f640 1 --2- 172.21.15.81:0/1331331421 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1f40b3d90 0x7fc1f406cd20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.255+0000 7fc1fb39f640 1 --2- 172.21.15.81:0/1331331421 >> v2:172.21.15.102:3300/0 conn(0x7fc1f415b2c0 0x7fc1f40b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.255+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1331331421 >> 172.21.15.81:0/1331331421 conn(0x7fc1f40b2df0 msgr2=0x7fc1f40d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.255+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1331331421 shutdown_connections 2024-09-16T01:22:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.255+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1331331421 wait complete. 2024-09-16T01:22:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.256+0000 7fc1fb39f640 1 Processor -- start 2024-09-16T01:22:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.256+0000 7fc1fb39f640 1 -- start start 2024-09-16T01:22:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.256+0000 7fc1fb39f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1f406d260 0x7fc1f4148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.256+0000 7fc1fb39f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1f40b3d90 0x7fc1f406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.256+0000 7fc1fb39f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f415b2c0 0x7fc1f406c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.256+0000 7fc1fb39f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f40b4980 con 0x7fc1f415b2c0 2024-09-16T01:22:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.256+0000 7fc1fb39f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f40cea80 con 0x7fc1f40b3d90 2024-09-16T01:22:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.256+0000 7fc1fb39f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f415b6a0 con 0x7fc1f406d260 2024-09-16T01:22:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1fab9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f415b2c0 0x7fc1f406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1fab9e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f415b2c0 0x7fc1f406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37318/0 (socket says 172.21.15.81:37318) 2024-09-16T01:22:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1fa39d640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1f406d260 0x7fc1f4148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1fab9e640 1 -- 172.21.15.81:0/1197160080 learned_addr learned my addr 172.21.15.81:0/1197160080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1f9b9c640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1f40b3d90 0x7fc1f406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1fab9e640 1 -- 172.21.15.81:0/1197160080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1f406d260 msgr2=0x7fc1f4148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1fab9e640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1f406d260 0x7fc1f4148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1fab9e640 1 -- 172.21.15.81:0/1197160080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1f40b3d90 msgr2=0x7fc1f406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1fab9e640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1f40b3d90 0x7fc1f406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1fab9e640 1 -- 172.21.15.81:0/1197160080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f4156f40 con 0x7fc1f415b2c0 2024-09-16T01:22:42.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1fab9e640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f415b2c0 0x7fc1f406c150 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400c390 tx=0x7fc1e400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:42.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1f2ffd640 1 -- 172.21.15.81:0/1197160080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4017070 con 0x7fc1f415b2c0 2024-09-16T01:22:42.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1f2ffd640 1 -- 172.21.15.81:0/1197160080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1e40052d0 con 0x7fc1f415b2c0 2024-09-16T01:22:42.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1f2ffd640 1 -- 172.21.15.81:0/1197160080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4003810 con 0x7fc1f415b2c0 2024-09-16T01:22:42.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1197160080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f41f7b80 con 0x7fc1f415b2c0 2024-09-16T01:22:42.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.257+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1197160080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f4148770 con 0x7fc1f415b2c0 2024-09-16T01:22:42.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.258+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1197160080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f406f510 con 0x7fc1f415b2c0 2024-09-16T01:22:42.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.259+0000 7fc1f2ffd640 1 -- 172.21.15.81:0/1197160080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc1e401a070 con 0x7fc1f415b2c0 2024-09-16T01:22:42.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.259+0000 7fc1f2ffd640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc1e006c2b0 0x7fc1e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.259+0000 7fc1f2ffd640 1 -- 172.21.15.81:0/1197160080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fc1e408a850 con 0x7fc1f415b2c0 2024-09-16T01:22:42.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.259+0000 7fc1fa39d640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc1e006c2b0 0x7fc1e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.260+0000 7fc1fa39d640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc1e006c2b0 0x7fc1e006e770 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009bd0 tx=0x7fc1ec009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:42.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.264+0000 7fc1f2ffd640 1 -- 172.21.15.81:0/1197160080 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1e40587e0 con 0x7fc1f415b2c0 2024-09-16T01:22:42.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.498+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1197160080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc1f40cfcc0 con 0x7fc1f415b2c0 2024-09-16T01:22:42.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.498+0000 7fc1f2ffd640 1 -- 172.21.15.81:0/1197160080 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1497 (secure 0 0 0) 0x7fc1e405cae0 con 0x7fc1f415b2c0 2024-09-16T01:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":446,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":125,"num_osds":8,"num_up_osds":8,"osd_up_since":1726449328,"num_in_osds":8,"osd_in_since":1726449318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":273272832,"bytes_avail":772820840448,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":66,"btime":"2024-09-16T01:22:40:479014+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":7674}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-16T01:22:28.148961+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T01:22:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.500+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1197160080 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc1e006c2b0 msgr2=0x7fc1e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.500+0000 7fc1fb39f640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc1e006c2b0 0x7fc1e006e770 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009bd0 tx=0x7fc1ec009240 comp rx=0 tx=0).stop 2024-09-16T01:22:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.500+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1197160080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f415b2c0 msgr2=0x7fc1f406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.500+0000 7fc1fb39f640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f415b2c0 0x7fc1f406c150 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fc1e400c390 tx=0x7fc1e400c850 comp rx=0 tx=0).stop 2024-09-16T01:22:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.500+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1197160080 shutdown_connections 2024-09-16T01:22:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.500+0000 7fc1fb39f640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc1e006c2b0 0x7fc1e006e770 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.500+0000 7fc1fb39f640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f415b2c0 0x7fc1f406c150 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.500+0000 7fc1fb39f640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1f40b3d90 0x7fc1f406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.500+0000 7fc1fb39f640 1 --2- 172.21.15.81:0/1197160080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1f406d260 0x7fc1f4148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.500+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1197160080 >> 172.21.15.81:0/1197160080 conn(0x7fc1f40b2df0 msgr2=0x7fc1f40ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:42.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.500+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1197160080 shutdown_connections 2024-09-16T01:22:42.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.500+0000 7fc1fb39f640 1 -- 172.21.15.81:0/1197160080 wait complete. 2024-09-16T01:22:42.511 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T01:22:42.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:22:42.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.609+0000 7fe629482640 1 Processor -- start 2024-09-16T01:22:42.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.610+0000 7fe629482640 1 -- start start 2024-09-16T01:22:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.610+0000 7fe629482640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6240b43f0 0x7fe62409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.610+0000 7fe629482640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe6240b5050 0x7fe62415b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.610+0000 7fe629482640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6240b3830 con 0x7fe62415b340 2024-09-16T01:22:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.610+0000 7fe629482640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe6240b5bd0 con 0x7fe6240b43f0 2024-09-16T01:22:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.610+0000 7fe629482640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe6240b5610 con 0x7fe6240b5050 2024-09-16T01:22:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.610+0000 7fe61a7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6240b43f0 0x7fe62409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.610+0000 7fe622ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe62415b340 0x7fe6240b4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51482/0 (socket says 172.21.15.81:51482) 2024-09-16T01:22:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.611+0000 7fe61a7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6240b43f0 0x7fe62409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37324/0 (socket says 172.21.15.81:37324) 2024-09-16T01:22:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.611+0000 7fe622ffd640 1 -- 172.21.15.81:0/3631103297 learned_addr learned my addr 172.21.15.81:0/3631103297 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.611+0000 7fe6237fe640 1 --2- 172.21.15.81:0/3631103297 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe6240b5050 0x7fe62415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.611+0000 7fe61a7fc640 1 -- 172.21.15.81:0/3631103297 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe6240b5050 msgr2=0x7fe62415b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.611+0000 7fe61a7fc640 1 --2- 172.21.15.81:0/3631103297 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe6240b5050 0x7fe62415b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.611+0000 7fe61a7fc640 1 -- 172.21.15.81:0/3631103297 >> v1:172.21.15.81:6789/0 conn(0x7fe62415b340 legacy=0x7fe6240b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.611+0000 7fe6227fc640 1 -- 172.21.15.81:0/3631103297 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1067245614 0 0) 0x7fe6240b3830 con 0x7fe62415b340 2024-09-16T01:22:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.611+0000 7fe61a7fc640 1 -- 172.21.15.81:0/3631103297 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6240b58f0 con 0x7fe6240b43f0 2024-09-16T01:22:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.612+0000 7fe61a7fc640 1 --2- 172.21.15.81:0/3631103297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240b43f0 0x7fe62409aa30 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0097a0 tx=0x7fe60c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09870c36dc819e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:42.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.612+0000 7fe6227fc640 1 -- 172.21.15.81:0/3631103297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c037070 con 0x7fe6240b43f0 2024-09-16T01:22:42.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.612+0000 7fe6227fc640 1 -- 172.21.15.81:0/3631103297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60c02ae50 con 0x7fe6240b43f0 2024-09-16T01:22:42.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.612+0000 7fe6227fc640 1 -- 172.21.15.81:0/3631103297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c032660 con 0x7fe6240b43f0 2024-09-16T01:22:42.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.612+0000 7fe629482640 1 -- 172.21.15.81:0/3631103297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240b43f0 msgr2=0x7fe62409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.612+0000 7fe629482640 1 --2- 172.21.15.81:0/3631103297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240b43f0 0x7fe62409aa30 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0097a0 tx=0x7fe60c02a100 comp rx=0 tx=0).stop 2024-09-16T01:22:42.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.612+0000 7fe629482640 1 -- 172.21.15.81:0/3631103297 shutdown_connections 2024-09-16T01:22:42.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.612+0000 7fe629482640 1 --2- 172.21.15.81:0/3631103297 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe6240b5050 0x7fe62415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.612+0000 7fe629482640 1 --2- 172.21.15.81:0/3631103297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240b43f0 0x7fe62409aa30 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.612+0000 7fe629482640 1 -- 172.21.15.81:0/3631103297 >> 172.21.15.81:0/3631103297 conn(0x7fe624073490 msgr2=0x7fe6240b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:42.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.612+0000 7fe629482640 1 -- 172.21.15.81:0/3631103297 shutdown_connections 2024-09-16T01:22:42.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.612+0000 7fe629482640 1 -- 172.21.15.81:0/3631103297 wait complete. 2024-09-16T01:22:42.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.614+0000 7fe629482640 1 Processor -- start 2024-09-16T01:22:42.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.614+0000 7fe629482640 1 -- start start 2024-09-16T01:22:42.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.614+0000 7fe629482640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6240b43f0 0x7fe624151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.614+0000 7fe629482640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240b5050 0x7fe62414bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.614+0000 7fe629482640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe62415b340 0x7fe624147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.614+0000 7fe629482640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6240cdb30 con 0x7fe6240b5050 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.614+0000 7fe629482640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe62415d8f0 con 0x7fe6240b43f0 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.614+0000 7fe629482640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe6240cdcb0 con 0x7fe62415b340 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe61a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240b5050 0x7fe62414bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe61a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240b5050 0x7fe62414bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37340/0 (socket says 172.21.15.81:37340) 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe61a7fc640 1 -- 172.21.15.81:0/685160236 learned_addr learned my addr 172.21.15.81:0/685160236 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe622ffd640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6240b43f0 0x7fe624151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe6237fe640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe62415b340 0x7fe624147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe61a7fc640 1 -- 172.21.15.81:0/685160236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe62415b340 msgr2=0x7fe624147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe61a7fc640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe62415b340 0x7fe624147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe61a7fc640 1 -- 172.21.15.81:0/685160236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6240b43f0 msgr2=0x7fe624151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe61a7fc640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6240b43f0 0x7fe624151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe61a7fc640 1 -- 172.21.15.81:0/685160236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe624152aa0 con 0x7fe6240b5050 2024-09-16T01:22:42.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe622ffd640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6240b43f0 0x7fe624151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:42.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe61a7fc640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240b5050 0x7fe62414bba0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0097a0 tx=0x7fe60c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:42.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe61bfff640 1 -- 172.21.15.81:0/685160236 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c037040 con 0x7fe6240b5050 2024-09-16T01:22:42.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe61bfff640 1 -- 172.21.15.81:0/685160236 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60c004030 con 0x7fe6240b5050 2024-09-16T01:22:42.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe61bfff640 1 -- 172.21.15.81:0/685160236 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c004420 con 0x7fe6240b5050 2024-09-16T01:22:42.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe629482640 1 -- 172.21.15.81:0/685160236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62414c280 con 0x7fe6240b5050 2024-09-16T01:22:42.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.615+0000 7fe629482640 1 -- 172.21.15.81:0/685160236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62414c840 con 0x7fe6240b5050 2024-09-16T01:22:42.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.616+0000 7fe629482640 1 -- 172.21.15.81:0/685160236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62409aa30 con 0x7fe6240b5050 2024-09-16T01:22:42.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.616+0000 7fe61bfff640 1 -- 172.21.15.81:0/685160236 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe60c003610 con 0x7fe6240b5050 2024-09-16T01:22:42.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.617+0000 7fe61bfff640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe60406c2b0 0x7fe60406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:42.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.617+0000 7fe61bfff640 1 -- 172.21.15.81:0/685160236 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fe60c0ac3d0 con 0x7fe6240b5050 2024-09-16T01:22:42.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.617+0000 7fe622ffd640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe60406c2b0 0x7fe60406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:42.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.617+0000 7fe622ffd640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe60406c2b0 0x7fe60406e770 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe614000f60 tx=0x7fe614009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:42.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.621+0000 7fe61bfff640 1 -- 172.21.15.81:0/685160236 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe60c07aad0 con 0x7fe6240b5050 2024-09-16T01:22:42.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.787+0000 7fe629482640 1 -- 172.21.15.81:0/685160236 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe62406c070 con 0x7fe60406c2b0 2024-09-16T01:22:42.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.792+0000 7fe61bfff640 1 -- 172.21.15.81:0/685160236 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247090 (secure 0 0 0) 0x7fe62406c070 con 0x7fe60406c2b0 2024-09-16T01:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:42.797 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:22:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.795+0000 7fe629482640 1 -- 172.21.15.81:0/685160236 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe60406c2b0 msgr2=0x7fe60406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.795+0000 7fe629482640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe60406c2b0 0x7fe60406e770 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe614000f60 tx=0x7fe614009040 comp rx=0 tx=0).stop 2024-09-16T01:22:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.795+0000 7fe629482640 1 -- 172.21.15.81:0/685160236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240b5050 msgr2=0x7fe62414bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.795+0000 7fe629482640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240b5050 0x7fe62414bba0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0097a0 tx=0x7fe60c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.795+0000 7fe629482640 1 -- 172.21.15.81:0/685160236 shutdown_connections 2024-09-16T01:22:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.795+0000 7fe629482640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe60406c2b0 0x7fe60406e770 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.795+0000 7fe629482640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe62415b340 0x7fe624147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.795+0000 7fe629482640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6240b5050 0x7fe62414bba0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.795+0000 7fe629482640 1 --2- 172.21.15.81:0/685160236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6240b43f0 0x7fe624151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.795+0000 7fe629482640 1 -- 172.21.15.81:0/685160236 >> 172.21.15.81:0/685160236 conn(0x7fe624073490 msgr2=0x7fe62415a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.795+0000 7fe629482640 1 -- 172.21.15.81:0/685160236 shutdown_connections 2024-09-16T01:22:42.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:42.795+0000 7fe629482640 1 -- 172.21.15.81:0/685160236 wait complete. 2024-09-16T01:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-16T01:22:42.151758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266868,"kb_used_data":13168,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754707852,"statfs":{"total":773094113280,"available":772820840448,"internally_reserved":0,"allocated":13484032,"data_stored":6830794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.701015"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459930+0000","last_change":"2024-09-16T01:22:37.459930+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459930+0000","last_undegraded":"2024-09-16T01:22:37.459930+0000","last_fullsized":"2024-09-16T01:22:37.459930+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462073+0000","last_change":"2024-09-16T01:22:37.462073+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462073+0000","last_undegraded":"2024-09-16T01:22:37.462073+0000","last_fullsized":"2024-09-16T01:22:37.462073+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458082+0000","last_change":"2024-09-16T01:22:37.458082+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458082+0000","last_undegraded":"2024-09-16T01:22:37.458082+0000","last_fullsized":"2024-09-16T01:22:37.458082+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458453+0000","last_change":"2024-09-16T01:22:37.458453+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458453+0000","last_undegraded":"2024-09-16T01:22:37.458453+0000","last_fullsized":"2024-09-16T01:22:37.458453+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.464247+0000","last_change":"2024-09-16T01:22:37.464247+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.464247+0000","last_undegraded":"2024-09-16T01:22:37.464247+0000","last_fullsized":"2024-09-16T01:22:37.464247+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462671+0000","last_change":"2024-09-16T01:22:37.462671+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462671+0000","last_undegraded":"2024-09-16T01:22:37.462671+0000","last_fullsized":"2024-09-16T01:22:37.462671+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461888+0000","last_change":"2024-09-16T01:22:37.461888+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461888+0000","last_undegraded":"2024-09-16T01:22:37.461888+0000","last_fullsized":"2024-09-16T01:22:37.461888+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459698+0000","last_change":"2024-09-16T01:22:37.459698+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459698+0000","last_undegraded":"2024-09-16T01:22:37.459698+0000","last_fullsized":"2024-09-16T01:22:37.459698+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462682+0000","last_change":"2024-09-16T01:22:37.462682+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462682+0000","last_undegraded":"2024-09-16T01:22:37.462682+0000","last_fullsized":"2024-09-16T01:22:37.462682+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462998+0000","last_change":"2024-09-16T01:22:37.462998+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462998+0000","last_undegraded":"2024-09-16T01:22:37.462998+0000","last_fullsized":"2024-09-16T01:22:37.462998+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460346+0000","last_change":"2024-09-16T01:22:37.460346+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460346+0000","last_undegraded":"2024-09-16T01:22:37.460346+0000","last_fullsized":"2024-09-16T01:22:37.460346+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458937+0000","last_change":"2024-09-16T01:22:37.458937+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458937+0000","last_undegraded":"2024-09-16T01:22:37.458937+0000","last_fullsized":"2024-09-16T01:22:37.458937+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462620+0000","last_change":"2024-09-16T01:22:37.462620+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462620+0000","last_undegraded":"2024-09-16T01:22:37.462620+0000","last_fullsized":"2024-09-16T01:22:37.462620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458722+0000","last_change":"2024-09-16T01:22:37.458722+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458722+0000","last_undegraded":"2024-09-16T01:22:37.458722+0000","last_fullsized":"2024-09-16T01:22:37.458722+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459852+0000","last_change":"2024-09-16T01:22:37.459852+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459852+0000","last_undegraded":"2024-09-16T01:22:37.459852+0000","last_fullsized":"2024-09-16T01:22:37.459852+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.464088+0000","last_change":"2024-09-16T01:22:37.464088+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.464088+0000","last_undegraded":"2024-09-16T01:22:37.464088+0000","last_fullsized":"2024-09-16T01:22:37.464088+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462170+0000","last_change":"2024-09-16T01:22:37.462170+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462170+0000","last_undegraded":"2024-09-16T01:22:37.462170+0000","last_fullsized":"2024-09-16T01:22:37.462170+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463680+0000","last_change":"2024-09-16T01:22:37.463680+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463680+0000","last_undegraded":"2024-09-16T01:22:37.463680+0000","last_fullsized":"2024-09-16T01:22:37.463680+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462447+0000","last_change":"2024-09-16T01:22:37.462447+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462447+0000","last_undegraded":"2024-09-16T01:22:37.462447+0000","last_fullsized":"2024-09-16T01:22:37.462447+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462824+0000","last_change":"2024-09-16T01:22:37.462824+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462824+0000","last_undegraded":"2024-09-16T01:22:37.462824+0000","last_fullsized":"2024-09-16T01:22:37.462824+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456629+0000","last_change":"2024-09-16T01:22:37.456629+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456629+0000","last_undegraded":"2024-09-16T01:22:37.456629+0000","last_fullsized":"2024-09-16T01:22:37.456629+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.467780+0000","last_change":"2024-09-16T01:22:37.467780+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.467780+0000","last_undegraded":"2024-09-16T01:22:37.467780+0000","last_fullsized":"2024-09-16T01:22:37.467780+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456664+0000","last_change":"2024-09-16T01:22:37.456664+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456664+0000","last_undegraded":"2024-09-16T01:22:37.456664+0000","last_fullsized":"2024-09-16T01:22:37.456664+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460799+0000","last_change":"2024-09-16T01:22:37.460799+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460799+0000","last_undegraded":"2024-09-16T01:22:37.460799+0000","last_fullsized":"2024-09-16T01:22:37.460799+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458477+0000","last_change":"2024-09-16T01:22:37.458477+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458477+0000","last_undegraded":"2024-09-16T01:22:37.458477+0000","last_fullsized":"2024-09-16T01:22:37.458477+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.457611+0000","last_change":"2024-09-16T01:22:37.457611+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.457611+0000","last_undegraded":"2024-09-16T01:22:37.457611+0000","last_fullsized":"2024-09-16T01:22:37.457611+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460523+0000","last_change":"2024-09-16T01:22:37.460523+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460523+0000","last_undegraded":"2024-09-16T01:22:37.460523+0000","last_fullsized":"2024-09-16T01:22:37.460523+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463848+0000","last_change":"2024-09-16T01:22:37.463848+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463848+0000","last_undegraded":"2024-09-16T01:22:37.463848+0000","last_fullsized":"2024-09-16T01:22:37.463848+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459671+0000","last_change":"2024-09-16T01:22:37.459671+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459671+0000","last_undegraded":"2024-09-16T01:22:37.459671+0000","last_fullsized":"2024-09-16T01:22:37.459671+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456725+0000","last_change":"2024-09-16T01:22:37.456725+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456725+0000","last_undegraded":"2024-09-16T01:22:37.456725+0000","last_fullsized":"2024-09-16T01:22:37.456725+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461713+0000","last_change":"2024-09-16T01:22:37.461713+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461713+0000","last_undegraded":"2024-09-16T01:22:37.461713+0000","last_fullsized":"2024-09-16T01:22:37.461713+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461958+0000","last_change":"2024-09-16T01:22:37.461958+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461958+0000","last_undegraded":"2024-09-16T01:22:37.461958+0000","last_fullsized":"2024-09-16T01:22:37.461958+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459229+0000","last_change":"2024-09-16T01:22:37.459229+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459229+0000","last_undegraded":"2024-09-16T01:22:37.459229+0000","last_fullsized":"2024-09-16T01:22:37.459229+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476726+0000","last_change":"2024-09-16T01:22:37.473828+0000","last_active":"2024-09-16T01:22:37.476726+0000","last_peered":"2024-09-16T01:22:37.476726+0000","last_clean":"2024-09-16T01:22:37.476726+0000","last_became_active":"2024-09-16T01:22:37.473523+0000","last_became_peered":"2024-09-16T01:22:37.473523+0000","last_unstale":"2024-09-16T01:22:37.476726+0000","last_undegraded":"2024-09-16T01:22:37.476726+0000","last_fullsized":"2024-09-16T01:22:37.476726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:47.484184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458521+0000","last_change":"2024-09-16T01:22:37.458521+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458521+0000","last_undegraded":"2024-09-16T01:22:37.458521+0000","last_fullsized":"2024-09-16T01:22:37.458521+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471465+0000","last_change":"2024-09-16T01:22:37.469361+0000","last_active":"2024-09-16T01:22:37.471465+0000","last_peered":"2024-09-16T01:22:37.471465+0000","last_clean":"2024-09-16T01:22:37.471465+0000","last_became_active":"2024-09-16T01:22:37.469091+0000","last_became_peered":"2024-09-16T01:22:37.469091+0000","last_unstale":"2024-09-16T01:22:37.471465+0000","last_undegraded":"2024-09-16T01:22:37.471465+0000","last_fullsized":"2024-09-16T01:22:37.471465+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:06.683640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456135+0000","last_change":"2024-09-16T01:22:37.456135+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456135+0000","last_undegraded":"2024-09-16T01:22:37.456135+0000","last_fullsized":"2024-09-16T01:22:37.456135+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477095+0000","last_change":"2024-09-16T01:22:37.472329+0000","last_active":"2024-09-16T01:22:37.477095+0000","last_peered":"2024-09-16T01:22:37.477095+0000","last_clean":"2024-09-16T01:22:37.477095+0000","last_became_active":"2024-09-16T01:22:37.471993+0000","last_became_peered":"2024-09-16T01:22:37.471993+0000","last_unstale":"2024-09-16T01:22:37.477095+0000","last_undegraded":"2024-09-16T01:22:37.477095+0000","last_fullsized":"2024-09-16T01:22:37.477095+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:41.536663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.467144+0000","last_change":"2024-09-16T01:22:37.467144+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.467144+0000","last_undegraded":"2024-09-16T01:22:37.467144+0000","last_fullsized":"2024-09-16T01:22:37.467144+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477115+0000","last_change":"2024-09-16T01:22:37.472495+0000","last_active":"2024-09-16T01:22:37.477115+0000","last_peered":"2024-09-16T01:22:37.477115+0000","last_clean":"2024-09-16T01:22:37.477115+0000","last_became_active":"2024-09-16T01:22:37.472218+0000","last_became_peered":"2024-09-16T01:22:37.472218+0000","last_unstale":"2024-09-16T01:22:37.477115+0000","last_undegraded":"2024-09-16T01:22:37.477115+0000","last_fullsized":"2024-09-16T01:22:37.477115+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:11.681815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462726+0000","last_change":"2024-09-16T01:22:37.462726+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462726+0000","last_undegraded":"2024-09-16T01:22:37.462726+0000","last_fullsized":"2024-09-16T01:22:37.462726+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474208+0000","last_change":"2024-09-16T01:22:37.469230+0000","last_active":"2024-09-16T01:22:37.474208+0000","last_peered":"2024-09-16T01:22:37.474208+0000","last_clean":"2024-09-16T01:22:37.474208+0000","last_became_active":"2024-09-16T01:22:37.468906+0000","last_became_peered":"2024-09-16T01:22:37.468906+0000","last_unstale":"2024-09-16T01:22:37.474208+0000","last_undegraded":"2024-09-16T01:22:37.474208+0000","last_fullsized":"2024-09-16T01:22:37.474208+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462376+0000","last_change":"2024-09-16T01:22:37.462376+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462376+0000","last_undegraded":"2024-09-16T01:22:37.462376+0000","last_fullsized":"2024-09-16T01:22:37.462376+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.473368+0000","last_change":"2024-09-16T01:22:37.472506+0000","last_active":"2024-09-16T01:22:37.473368+0000","last_peered":"2024-09-16T01:22:37.473368+0000","last_clean":"2024-09-16T01:22:37.473368+0000","last_became_active":"2024-09-16T01:22:37.472177+0000","last_became_peered":"2024-09-16T01:22:37.472177+0000","last_unstale":"2024-09-16T01:22:37.473368+0000","last_undegraded":"2024-09-16T01:22:37.473368+0000","last_fullsized":"2024-09-16T01:22:37.473368+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:21.137299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463249+0000","last_change":"2024-09-16T01:22:37.463249+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463249+0000","last_undegraded":"2024-09-16T01:22:37.463249+0000","last_fullsized":"2024-09-16T01:22:37.463249+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472887+0000","last_change":"2024-09-16T01:22:37.464769+0000","last_active":"2024-09-16T01:22:37.472887+0000","last_peered":"2024-09-16T01:22:37.472887+0000","last_clean":"2024-09-16T01:22:37.472887+0000","last_became_active":"2024-09-16T01:22:37.464432+0000","last_became_peered":"2024-09-16T01:22:37.464432+0000","last_unstale":"2024-09-16T01:22:37.472887+0000","last_undegraded":"2024-09-16T01:22:37.472887+0000","last_fullsized":"2024-09-16T01:22:37.472887+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:24.269797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461252+0000","last_change":"2024-09-16T01:22:37.461252+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461252+0000","last_undegraded":"2024-09-16T01:22:37.461252+0000","last_fullsized":"2024-09-16T01:22:37.461252+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.466893+0000","last_change":"2024-09-16T01:22:37.466155+0000","last_active":"2024-09-16T01:22:37.466893+0000","last_peered":"2024-09-16T01:22:37.466893+0000","last_clean":"2024-09-16T01:22:37.466893+0000","last_became_active":"2024-09-16T01:22:37.465891+0000","last_became_peered":"2024-09-16T01:22:37.465891+0000","last_unstale":"2024-09-16T01:22:37.466893+0000","last_undegraded":"2024-09-16T01:22:37.466893+0000","last_fullsized":"2024-09-16T01:22:37.466893+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:58.533695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.458512+0000","last_change":"2024-09-16T01:22:37.458512+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.458512+0000","last_undegraded":"2024-09-16T01:22:37.458512+0000","last_fullsized":"2024-09-16T01:22:37.458512+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.468786+0000","last_change":"2024-09-16T01:22:37.466248+0000","last_active":"2024-09-16T01:22:37.468786+0000","last_peered":"2024-09-16T01:22:37.468786+0000","last_clean":"2024-09-16T01:22:37.468786+0000","last_became_active":"2024-09-16T01:22:37.465956+0000","last_became_peered":"2024-09-16T01:22:37.465956+0000","last_unstale":"2024-09-16T01:22:37.468786+0000","last_undegraded":"2024-09-16T01:22:37.468786+0000","last_fullsized":"2024-09-16T01:22:37.468786+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:24.269797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460932+0000","last_change":"2024-09-16T01:22:37.460932+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460932+0000","last_undegraded":"2024-09-16T01:22:37.460932+0000","last_fullsized":"2024-09-16T01:22:37.460932+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477316+0000","last_change":"2024-09-16T01:22:37.476174+0000","last_active":"2024-09-16T01:22:37.477316+0000","last_peered":"2024-09-16T01:22:37.477316+0000","last_clean":"2024-09-16T01:22:37.477316+0000","last_became_active":"2024-09-16T01:22:37.475897+0000","last_became_peered":"2024-09-16T01:22:37.475897+0000","last_unstale":"2024-09-16T01:22:37.477316+0000","last_undegraded":"2024-09-16T01:22:37.477316+0000","last_fullsized":"2024-09-16T01:22:37.477316+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:58.401908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456287+0000","last_change":"2024-09-16T01:22:37.456287+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456287+0000","last_undegraded":"2024-09-16T01:22:37.456287+0000","last_fullsized":"2024-09-16T01:22:37.456287+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477054+0000","last_change":"2024-09-16T01:22:37.471374+0000","last_active":"2024-09-16T01:22:37.477054+0000","last_peered":"2024-09-16T01:22:37.477054+0000","last_clean":"2024-09-16T01:22:37.477054+0000","last_became_active":"2024-09-16T01:22:37.471086+0000","last_became_peered":"2024-09-16T01:22:37.471086+0000","last_unstale":"2024-09-16T01:22:37.477054+0000","last_undegraded":"2024-09-16T01:22:37.477054+0000","last_fullsized":"2024-09-16T01:22:37.477054+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:57.246038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.456859+0000","last_change":"2024-09-16T01:22:37.456859+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.456859+0000","last_undegraded":"2024-09-16T01:22:37.456859+0000","last_fullsized":"2024-09-16T01:22:37.456859+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476726+0000","last_change":"2024-09-16T01:22:37.469445+0000","last_active":"2024-09-16T01:22:37.476726+0000","last_peered":"2024-09-16T01:22:37.476726+0000","last_clean":"2024-09-16T01:22:37.476726+0000","last_became_active":"2024-09-16T01:22:37.469160+0000","last_became_peered":"2024-09-16T01:22:37.469160+0000","last_unstale":"2024-09-16T01:22:37.476726+0000","last_undegraded":"2024-09-16T01:22:37.476726+0000","last_fullsized":"2024-09-16T01:22:37.476726+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:38.021847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.463436+0000","last_change":"2024-09-16T01:22:37.463436+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.463436+0000","last_undegraded":"2024-09-16T01:22:37.463436+0000","last_fullsized":"2024-09-16T01:22:37.463436+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477298+0000","last_change":"2024-09-16T01:22:37.476008+0000","last_active":"2024-09-16T01:22:37.477298+0000","last_peered":"2024-09-16T01:22:37.477298+0000","last_clean":"2024-09-16T01:22:37.477298+0000","last_became_active":"2024-09-16T01:22:37.475720+0000","last_became_peered":"2024-09-16T01:22:37.475720+0000","last_unstale":"2024-09-16T01:22:37.477298+0000","last_undegraded":"2024-09-16T01:22:37.477298+0000","last_fullsized":"2024-09-16T01:22:37.477298+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:16:24.873727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460709+0000","last_change":"2024-09-16T01:22:37.460709+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460709+0000","last_undegraded":"2024-09-16T01:22:37.460709+0000","last_fullsized":"2024-09-16T01:22:37.460709+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.464358+0000","last_change":"2024-09-16T01:22:37.459504+0000","last_active":"2024-09-16T01:22:37.464358+0000","last_peered":"2024-09-16T01:22:37.464358+0000","last_clean":"2024-09-16T01:22:37.464358+0000","last_became_active":"2024-09-16T01:22:37.459226+0000","last_became_peered":"2024-09-16T01:22:37.459226+0000","last_unstale":"2024-09-16T01:22:37.464358+0000","last_undegraded":"2024-09-16T01:22:37.464358+0000","last_fullsized":"2024-09-16T01:22:37.464358+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:45.701573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462831+0000","last_change":"2024-09-16T01:22:37.462831+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462831+0000","last_undegraded":"2024-09-16T01:22:37.462831+0000","last_fullsized":"2024-09-16T01:22:37.462831+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.470912+0000","last_change":"2024-09-16T01:22:37.460411+0000","last_active":"2024-09-16T01:22:37.470912+0000","last_peered":"2024-09-16T01:22:37.470912+0000","last_clean":"2024-09-16T01:22:37.470912+0000","last_became_active":"2024-09-16T01:22:37.460106+0000","last_became_peered":"2024-09-16T01:22:37.460106+0000","last_unstale":"2024-09-16T01:22:37.470912+0000","last_undegraded":"2024-09-16T01:22:37.470912+0000","last_fullsized":"2024-09-16T01:22:37.470912+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:01.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.455702+0000","last_change":"2024-09-16T01:22:37.455702+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.455702+0000","last_undegraded":"2024-09-16T01:22:37.455702+0000","last_fullsized":"2024-09-16T01:22:37.455702+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.467229+0000","last_change":"2024-09-16T01:22:37.465535+0000","last_active":"2024-09-16T01:22:37.467229+0000","last_peered":"2024-09-16T01:22:37.467229+0000","last_clean":"2024-09-16T01:22:37.467229+0000","last_became_active":"2024-09-16T01:22:37.465233+0000","last_became_peered":"2024-09-16T01:22:37.465233+0000","last_unstale":"2024-09-16T01:22:37.467229+0000","last_undegraded":"2024-09-16T01:22:37.467229+0000","last_fullsized":"2024-09-16T01:22:37.467229+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461436+0000","last_change":"2024-09-16T01:22:37.461436+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461436+0000","last_undegraded":"2024-09-16T01:22:37.461436+0000","last_fullsized":"2024-09-16T01:22:37.461436+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476664+0000","last_change":"2024-09-16T01:22:37.473710+0000","last_active":"2024-09-16T01:22:37.476664+0000","last_peered":"2024-09-16T01:22:37.476664+0000","last_clean":"2024-09-16T01:22:37.476664+0000","last_became_active":"2024-09-16T01:22:37.473344+0000","last_became_peered":"2024-09-16T01:22:37.473344+0000","last_unstale":"2024-09-16T01:22:37.476664+0000","last_undegraded":"2024-09-16T01:22:37.476664+0000","last_fullsized":"2024-09-16T01:22:37.476664+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:21:36.959019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461037+0000","last_change":"2024-09-16T01:22:37.461037+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461037+0000","last_undegraded":"2024-09-16T01:22:37.461037+0000","last_fullsized":"2024-09-16T01:22:37.461037+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471266+0000","last_change":"2024-09-16T01:22:37.463887+0000","last_active":"2024-09-16T01:22:37.471266+0000","last_peered":"2024-09-16T01:22:37.471266+0000","last_clean":"2024-09-16T01:22:37.471266+0000","last_became_active":"2024-09-16T01:22:37.463631+0000","last_became_peered":"2024-09-16T01:22:37.463631+0000","last_unstale":"2024-09-16T01:22:37.471266+0000","last_undegraded":"2024-09-16T01:22:37.471266+0000","last_fullsized":"2024-09-16T01:22:37.471266+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.462038+0000","last_change":"2024-09-16T01:22:37.462038+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.462038+0000","last_undegraded":"2024-09-16T01:22:37.462038+0000","last_fullsized":"2024-09-16T01:22:37.462038+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.475270+0000","last_change":"2024-09-16T01:22:37.474218+0000","last_active":"2024-09-16T01:22:37.475270+0000","last_peered":"2024-09-16T01:22:37.475270+0000","last_clean":"2024-09-16T01:22:37.475270+0000","last_became_active":"2024-09-16T01:22:37.473947+0000","last_became_peered":"2024-09-16T01:22:37.473947+0000","last_unstale":"2024-09-16T01:22:37.475270+0000","last_undegraded":"2024-09-16T01:22:37.475270+0000","last_fullsized":"2024-09-16T01:22:37.475270+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:19.356499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459557+0000","last_change":"2024-09-16T01:22:37.459557+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459557+0000","last_undegraded":"2024-09-16T01:22:37.459557+0000","last_fullsized":"2024-09-16T01:22:37.459557+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474230+0000","last_change":"2024-09-16T01:22:37.469517+0000","last_active":"2024-09-16T01:22:37.474230+0000","last_peered":"2024-09-16T01:22:37.474230+0000","last_clean":"2024-09-16T01:22:37.474230+0000","last_became_active":"2024-09-16T01:22:37.469256+0000","last_became_peered":"2024-09-16T01:22:37.469256+0000","last_unstale":"2024-09-16T01:22:37.474230+0000","last_undegraded":"2024-09-16T01:22:37.474230+0000","last_fullsized":"2024-09-16T01:22:37.474230+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:24.269797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459485+0000","last_change":"2024-09-16T01:22:37.459485+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459485+0000","last_undegraded":"2024-09-16T01:22:37.459485+0000","last_fullsized":"2024-09-16T01:22:37.459485+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472403+0000","last_change":"2024-09-16T01:22:37.469806+0000","last_active":"2024-09-16T01:22:37.472403+0000","last_peered":"2024-09-16T01:22:37.472403+0000","last_clean":"2024-09-16T01:22:37.472403+0000","last_became_active":"2024-09-16T01:22:37.469516+0000","last_became_peered":"2024-09-16T01:22:37.469516+0000","last_unstale":"2024-09-16T01:22:37.472403+0000","last_undegraded":"2024-09-16T01:22:37.472403+0000","last_fullsized":"2024-09-16T01:22:37.472403+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:37.113423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461311+0000","last_change":"2024-09-16T01:22:37.461311+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461311+0000","last_undegraded":"2024-09-16T01:22:37.461311+0000","last_fullsized":"2024-09-16T01:22:37.461311+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477145+0000","last_change":"2024-09-16T01:22:37.473724+0000","last_active":"2024-09-16T01:22:37.477145+0000","last_peered":"2024-09-16T01:22:37.477145+0000","last_clean":"2024-09-16T01:22:37.477145+0000","last_became_active":"2024-09-16T01:22:37.473345+0000","last_became_peered":"2024-09-16T01:22:37.473345+0000","last_unstale":"2024-09-16T01:22:37.477145+0000","last_undegraded":"2024-09-16T01:22:37.477145+0000","last_fullsized":"2024-09-16T01:22:37.477145+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:50.792365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459140+0000","last_change":"2024-09-16T01:22:37.459140+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459140+0000","last_undegraded":"2024-09-16T01:22:37.459140+0000","last_fullsized":"2024-09-16T01:22:37.459140+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472895+0000","last_change":"2024-09-16T01:22:37.466054+0000","last_active":"2024-09-16T01:22:37.472895+0000","last_peered":"2024-09-16T01:22:37.472895+0000","last_clean":"2024-09-16T01:22:37.472895+0000","last_became_active":"2024-09-16T01:22:37.465813+0000","last_became_peered":"2024-09-16T01:22:37.465813+0000","last_unstale":"2024-09-16T01:22:37.472895+0000","last_undegraded":"2024-09-16T01:22:37.472895+0000","last_fullsized":"2024-09-16T01:22:37.472895+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:15.378906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460661+0000","last_change":"2024-09-16T01:22:37.460661+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460661+0000","last_undegraded":"2024-09-16T01:22:37.460661+0000","last_fullsized":"2024-09-16T01:22:37.460661+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.475508+0000","last_change":"2024-09-16T01:22:37.473626+0000","last_active":"2024-09-16T01:22:37.475508+0000","last_peered":"2024-09-16T01:22:37.475508+0000","last_clean":"2024-09-16T01:22:37.475508+0000","last_became_active":"2024-09-16T01:22:37.473256+0000","last_became_peered":"2024-09-16T01:22:37.473256+0000","last_unstale":"2024-09-16T01:22:37.475508+0000","last_undegraded":"2024-09-16T01:22:37.475508+0000","last_fullsized":"2024-09-16T01:22:37.475508+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:33.276036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.455778+0000","last_change":"2024-09-16T01:22:37.455778+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.455778+0000","last_undegraded":"2024-09-16T01:22:37.455778+0000","last_fullsized":"2024-09-16T01:22:37.455778+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471786+0000","last_change":"2024-09-16T01:22:37.467923+0000","last_active":"2024-09-16T01:22:37.471786+0000","last_peered":"2024-09-16T01:22:37.471786+0000","last_clean":"2024-09-16T01:22:37.471786+0000","last_became_active":"2024-09-16T01:22:37.467632+0000","last_became_peered":"2024-09-16T01:22:37.467632+0000","last_unstale":"2024-09-16T01:22:37.471786+0000","last_undegraded":"2024-09-16T01:22:37.471786+0000","last_fullsized":"2024-09-16T01:22:37.471786+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:01.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461657+0000","last_change":"2024-09-16T01:22:37.461657+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461657+0000","last_undegraded":"2024-09-16T01:22:37.461657+0000","last_fullsized":"2024-09-16T01:22:37.461657+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.476830+0000","last_change":"2024-09-16T01:22:37.473120+0000","last_active":"2024-09-16T01:22:37.476830+0000","last_peered":"2024-09-16T01:22:37.476830+0000","last_clean":"2024-09-16T01:22:37.476830+0000","last_became_active":"2024-09-16T01:22:37.472799+0000","last_became_peered":"2024-09-16T01:22:37.472799+0000","last_unstale":"2024-09-16T01:22:37.476830+0000","last_undegraded":"2024-09-16T01:22:37.476830+0000","last_fullsized":"2024-09-16T01:22:37.476830+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:17.563539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.461546+0000","last_change":"2024-09-16T01:22:37.461546+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.461546+0000","last_undegraded":"2024-09-16T01:22:37.461546+0000","last_fullsized":"2024-09-16T01:22:37.461546+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.472812+0000","last_change":"2024-09-16T01:22:37.465487+0000","last_active":"2024-09-16T01:22:37.472812+0000","last_peered":"2024-09-16T01:22:37.472812+0000","last_clean":"2024-09-16T01:22:37.472812+0000","last_became_active":"2024-09-16T01:22:37.465154+0000","last_became_peered":"2024-09-16T01:22:37.465154+0000","last_unstale":"2024-09-16T01:22:37.472812+0000","last_undegraded":"2024-09-16T01:22:37.472812+0000","last_fullsized":"2024-09-16T01:22:37.472812+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:17.563539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459189+0000","last_change":"2024-09-16T01:22:37.459189+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459189+0000","last_undegraded":"2024-09-16T01:22:37.459189+0000","last_fullsized":"2024-09-16T01:22:37.459189+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474485+0000","last_change":"2024-09-16T01:22:37.470174+0000","last_active":"2024-09-16T01:22:37.474485+0000","last_peered":"2024-09-16T01:22:37.474485+0000","last_clean":"2024-09-16T01:22:37.474485+0000","last_became_active":"2024-09-16T01:22:37.469905+0000","last_became_peered":"2024-09-16T01:22:37.469905+0000","last_unstale":"2024-09-16T01:22:37.474485+0000","last_undegraded":"2024-09-16T01:22:37.474485+0000","last_fullsized":"2024-09-16T01:22:37.474485+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:17.563539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460407+0000","last_change":"2024-09-16T01:22:37.460407+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460407+0000","last_undegraded":"2024-09-16T01:22:37.460407+0000","last_fullsized":"2024-09-16T01:22:37.460407+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477128+0000","last_change":"2024-09-16T01:22:37.473265+0000","last_active":"2024-09-16T01:22:37.477128+0000","last_peered":"2024-09-16T01:22:37.477128+0000","last_clean":"2024-09-16T01:22:37.477128+0000","last_became_active":"2024-09-16T01:22:37.472881+0000","last_became_peered":"2024-09-16T01:22:37.472881+0000","last_unstale":"2024-09-16T01:22:37.477128+0000","last_undegraded":"2024-09-16T01:22:37.477128+0000","last_fullsized":"2024-09-16T01:22:37.477128+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:35.803129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.459981+0000","last_change":"2024-09-16T01:22:37.459981+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.459981+0000","last_undegraded":"2024-09-16T01:22:37.459981+0000","last_fullsized":"2024-09-16T01:22:37.459981+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.474471+0000","last_change":"2024-09-16T01:22:37.470596+0000","last_active":"2024-09-16T01:22:37.474471+0000","last_peered":"2024-09-16T01:22:37.474471+0000","last_clean":"2024-09-16T01:22:37.474471+0000","last_became_active":"2024-09-16T01:22:37.470270+0000","last_became_peered":"2024-09-16T01:22:37.470270+0000","last_unstale":"2024-09-16T01:22:37.474471+0000","last_undegraded":"2024-09-16T01:22:37.474471+0000","last_fullsized":"2024-09-16T01:22:37.474471+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:06.423099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.460687+0000","last_change":"2024-09-16T01:22:37.460687+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.460687+0000","last_undegraded":"2024-09-16T01:22:37.460687+0000","last_fullsized":"2024-09-16T01:22:37.460687+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.471324+0000","last_change":"2024-09-16T01:22:37.467778+0000","last_active":"2024-09-16T01:22:37.471324+0000","last_peered":"2024-09-16T01:22:37.471324+0000","last_clean":"2024-09-16T01:22:37.471324+0000","last_became_active":"2024-09-16T01:22:37.467524+0000","last_became_peered":"2024-09-16T01:22:37.467524+0000","last_unstale":"2024-09-16T01:22:37.471324+0000","last_undegraded":"2024-09-16T01:22:37.471324+0000","last_fullsized":"2024-09-16T01:22:37.471324+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:52.586042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-09-16T01:22:37.457619+0000","last_change":"2024-09-16T01:22:37.457619+0000","last_active":"2024-09-16T01:22:37.449954+0000","last_peered":"2024-09-16T01:22:37.449954+0000","last_clean":"2024-09-16T01:22:37.449954+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:22:37.457619+0000","last_undegraded":"2024-09-16T01:22:37.457619+0000","last_fullsized":"2024-09-16T01:22:37.457619+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.477162+0000","last_change":"2024-09-16T01:22:37.474591+0000","last_active":"2024-09-16T01:22:37.477162+0000","last_peered":"2024-09-16T01:22:37.477162+0000","last_clean":"2024-09-16T01:22:37.477162+0000","last_became_active":"2024-09-16T01:22:37.474286+0000","last_became_peered":"2024-09-16T01:22:37.474286+0000","last_unstale":"2024-09-16T01:22:37.477162+0000","last_undegraded":"2024-09-16T01:22:37.477162+0000","last_fullsized":"2024-09-16T01:22:37.477162+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:33.769660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":357,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-16T01:22:37.463374+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:22:37.463374+0000","last_peered":"2024-09-16T01:22:37.463374+0000","last_clean":"2024-09-16T01:22:37.463374+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:22:37.463374+0000","last_undegraded":"2024-09-16T01:22:37.463374+0000","last_fullsized":"2024-09-16T01:22:37.463374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2134016,"data_stored":1298290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36844,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334996,"statfs":{"total":96636764160,"available":96599035904,"internally_reserved":0,"allocated":1527808,"data_stored":701263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574937,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1540096,"data_stored":707922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1527808,"data_stored":701263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33280,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338560,"statfs":{"total":96636764160,"available":96602685440,"internally_reserved":0,"allocated":2134016,"data_stored":1298290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:22:45.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:22:45.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.923+0000 7faaeba9b640 1 Processor -- start 2024-09-16T01:22:45.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.923+0000 7faaeba9b640 1 -- start start 2024-09-16T01:22:45.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faaeba9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faae415e740 0x7faae40d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faaeba9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faae409b690 0x7faae406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faaeba9b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae40d0780 con 0x7faae406d4c0 2024-09-16T01:22:45.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faaeba9b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7faae415eb20 con 0x7faae415e740 2024-09-16T01:22:45.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faaeba9b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7faae406d260 con 0x7faae409b690 2024-09-16T01:22:45.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faae9837640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faae415e740 0x7faae40d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faaea038640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faae406d4c0 0x7faae406d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51486/0 (socket says 172.21.15.81:51486) 2024-09-16T01:22:45.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faae9837640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faae415e740 0x7faae40d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37348/0 (socket says 172.21.15.81:37348) 2024-09-16T01:22:45.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faaea038640 1 -- 172.21.15.81:0/1866625103 learned_addr learned my addr 172.21.15.81:0/1866625103 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:45.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faae9837640 1 -- 172.21.15.81:0/1866625103 >> v2:172.21.15.102:3300/0 conn(0x7faae409b690 msgr2=0x7faae406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:45.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faae9837640 1 --2- 172.21.15.81:0/1866625103 >> v2:172.21.15.102:3300/0 conn(0x7faae409b690 0x7faae406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faae9837640 1 -- 172.21.15.81:0/1866625103 >> v1:172.21.15.81:6789/0 conn(0x7faae406d4c0 legacy=0x7faae406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faae9837640 1 -- 172.21.15.81:0/1866625103 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae40d0a60 con 0x7faae415e740 2024-09-16T01:22:45.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.924+0000 7faae8835640 1 -- 172.21.15.81:0/1866625103 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708474986 0 0) 0x7faae40d0780 con 0x7faae406d4c0 2024-09-16T01:22:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.925+0000 7faae9837640 1 --2- 172.21.15.81:0/1866625103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae415e740 0x7faae40d1540 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7faae40691b0 tx=0x7faae002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6936b6b9698ce39 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.925+0000 7faae8835640 1 -- 172.21.15.81:0/1866625103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0037070 con 0x7faae415e740 2024-09-16T01:22:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.925+0000 7faae8835640 1 -- 172.21.15.81:0/1866625103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae0032440 con 0x7faae415e740 2024-09-16T01:22:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.925+0000 7faae8835640 1 -- 172.21.15.81:0/1866625103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0032810 con 0x7faae415e740 2024-09-16T01:22:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.925+0000 7faaeba9b640 1 -- 172.21.15.81:0/1866625103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae415e740 msgr2=0x7faae40d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.925+0000 7faaeba9b640 1 --2- 172.21.15.81:0/1866625103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae415e740 0x7faae40d1540 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7faae40691b0 tx=0x7faae002a230 comp rx=0 tx=0).stop 2024-09-16T01:22:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.926+0000 7faaeba9b640 1 -- 172.21.15.81:0/1866625103 shutdown_connections 2024-09-16T01:22:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.926+0000 7faaeba9b640 1 --2- 172.21.15.81:0/1866625103 >> v2:172.21.15.102:3300/0 conn(0x7faae409b690 0x7faae406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.926+0000 7faaeba9b640 1 --2- 172.21.15.81:0/1866625103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae415e740 0x7faae40d1540 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.926+0000 7faaeba9b640 1 -- 172.21.15.81:0/1866625103 >> 172.21.15.81:0/1866625103 conn(0x7faae40d23a0 msgr2=0x7faae40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.926+0000 7faaeba9b640 1 -- 172.21.15.81:0/1866625103 shutdown_connections 2024-09-16T01:22:45.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.926+0000 7faaeba9b640 1 -- 172.21.15.81:0/1866625103 wait complete. 2024-09-16T01:22:45.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.927+0000 7faaeba9b640 1 Processor -- start 2024-09-16T01:22:45.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.927+0000 7faaeba9b640 1 -- start start 2024-09-16T01:22:45.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faaeba9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae406d4c0 0x7faae40b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faaeba9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faae409b690 0x7faae41e9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faaeba9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faae415e740 0x7faae415c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faaeba9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faae409bac0 con 0x7faae406d4c0 2024-09-16T01:22:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faaeba9b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faae40d1020 con 0x7faae415e740 2024-09-16T01:22:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faaeba9b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7faae406dfe0 con 0x7faae409b690 2024-09-16T01:22:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faae9837640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae406d4c0 0x7faae40b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faae9837640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae406d4c0 0x7faae40b7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37360/0 (socket says 172.21.15.81:37360) 2024-09-16T01:22:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faae9837640 1 -- 172.21.15.81:0/2223874481 learned_addr learned my addr 172.21.15.81:0/2223874481 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faaea038640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faae415e740 0x7faae415c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faae9036640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faae409b690 0x7faae41e9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faae9837640 1 -- 172.21.15.81:0/2223874481 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faae409b690 msgr2=0x7faae41e9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faae9837640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faae409b690 0x7faae41e9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faae9837640 1 -- 172.21.15.81:0/2223874481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faae415e740 msgr2=0x7faae415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faae9837640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faae415e740 0x7faae415c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faae9837640 1 -- 172.21.15.81:0/2223874481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae40ca260 con 0x7faae406d4c0 2024-09-16T01:22:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faae9837640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae406d4c0 0x7faae40b7a60 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7faae0000c00 tx=0x7faae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faad67fc640 1 -- 172.21.15.81:0/2223874481 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0041070 con 0x7faae406d4c0 2024-09-16T01:22:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faad67fc640 1 -- 172.21.15.81:0/2223874481 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae003c950 con 0x7faae406d4c0 2024-09-16T01:22:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faaeba9b640 1 -- 172.21.15.81:0/2223874481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae40ca540 con 0x7faae406d4c0 2024-09-16T01:22:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faad67fc640 1 -- 172.21.15.81:0/2223874481 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0037040 con 0x7faae406d4c0 2024-09-16T01:22:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.928+0000 7faaeba9b640 1 -- 172.21.15.81:0/2223874481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae40cab00 con 0x7faae406d4c0 2024-09-16T01:22:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.929+0000 7faaeba9b640 1 -- 172.21.15.81:0/2223874481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae40d0780 con 0x7faae406d4c0 2024-09-16T01:22:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.930+0000 7faad67fc640 1 -- 172.21.15.81:0/2223874481 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faae0044070 con 0x7faae406d4c0 2024-09-16T01:22:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.930+0000 7faad67fc640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faac806c2b0 0x7faac806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.930+0000 7faad67fc640 1 -- 172.21.15.81:0/2223874481 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7faae00ac490 con 0x7faae406d4c0 2024-09-16T01:22:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.930+0000 7faae9036640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faac806c2b0 0x7faac806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:45.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.931+0000 7faae9036640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faac806c2b0 0x7faac806e770 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faae41e9d10 tx=0x7faad8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:45.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:45.935+0000 7faad67fc640 1 -- 172.21.15.81:0/2223874481 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faae007ab00 con 0x7faae406d4c0 2024-09-16T01:22:46.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.097+0000 7faaeba9b640 1 -- 172.21.15.81:0/2223874481 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faae40b8320 con 0x7faac806c2b0 2024-09-16T01:22:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.103+0000 7faad67fc640 1 -- 172.21.15.81:0/2223874481 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252486 (secure 0 0 0) 0x7faae40b8320 con 0x7faac806c2b0 2024-09-16T01:22:46.107 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:46.108 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:22:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.106+0000 7faaeba9b640 1 -- 172.21.15.81:0/2223874481 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faac806c2b0 msgr2=0x7faac806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.106+0000 7faaeba9b640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faac806c2b0 0x7faac806e770 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faae41e9d10 tx=0x7faad8008040 comp rx=0 tx=0).stop 2024-09-16T01:22:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.106+0000 7faaeba9b640 1 -- 172.21.15.81:0/2223874481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae406d4c0 msgr2=0x7faae40b7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.106+0000 7faaeba9b640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae406d4c0 0x7faae40b7a60 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7faae0000c00 tx=0x7faae00046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.106+0000 7faaeba9b640 1 -- 172.21.15.81:0/2223874481 shutdown_connections 2024-09-16T01:22:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.106+0000 7faaeba9b640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faac806c2b0 0x7faac806e770 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.106+0000 7faaeba9b640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faae415e740 0x7faae415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.106+0000 7faaeba9b640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faae409b690 0x7faae41e9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.106+0000 7faaeba9b640 1 --2- 172.21.15.81:0/2223874481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faae406d4c0 0x7faae40b7a60 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.106+0000 7faaeba9b640 1 -- 172.21.15.81:0/2223874481 >> 172.21.15.81:0/2223874481 conn(0x7faae40d23a0 msgr2=0x7faae4070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.106+0000 7faaeba9b640 1 -- 172.21.15.81:0/2223874481 shutdown_connections 2024-09-16T01:22:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.106+0000 7faaeba9b640 1 -- 172.21.15.81:0/2223874481 wait complete. 2024-09-16T01:22:46.118 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-09-16T01:22:44.152266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":267120,"kb_used_data":13448,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754707600,"statfs":{"total":773094113280,"available":772820582400,"internally_reserved":0,"allocated":13770752,"data_stored":6959804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":259575345},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.699013"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.373964+0000","last_change":"2024-09-16T01:22:38.491114+0000","last_active":"2024-09-16T01:22:40.373964+0000","last_peered":"2024-09-16T01:22:40.373964+0000","last_clean":"2024-09-16T01:22:40.373964+0000","last_became_active":"2024-09-16T01:22:38.490854+0000","last_became_peered":"2024-09-16T01:22:38.490854+0000","last_unstale":"2024-09-16T01:22:40.373964+0000","last_undegraded":"2024-09-16T01:22:40.373964+0000","last_fullsized":"2024-09-16T01:22:40.373964+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:38.532017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.472241+0000","last_change":"2024-09-16T01:22:38.481895+0000","last_active":"2024-09-16T01:22:39.472241+0000","last_peered":"2024-09-16T01:22:39.472241+0000","last_clean":"2024-09-16T01:22:39.472241+0000","last_became_active":"2024-09-16T01:22:38.481552+0000","last_became_peered":"2024-09-16T01:22:38.481552+0000","last_unstale":"2024-09-16T01:22:39.472241+0000","last_undegraded":"2024-09-16T01:22:39.472241+0000","last_fullsized":"2024-09-16T01:22:39.472241+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:42.540766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471141+0000","last_change":"2024-09-16T01:22:38.485715+0000","last_active":"2024-09-16T01:22:39.471141+0000","last_peered":"2024-09-16T01:22:39.471141+0000","last_clean":"2024-09-16T01:22:39.471141+0000","last_became_active":"2024-09-16T01:22:38.485439+0000","last_became_peered":"2024-09-16T01:22:38.485439+0000","last_unstale":"2024-09-16T01:22:39.471141+0000","last_undegraded":"2024-09-16T01:22:39.471141+0000","last_fullsized":"2024-09-16T01:22:39.471141+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:53.590145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471694+0000","last_change":"2024-09-16T01:22:38.487186+0000","last_active":"2024-09-16T01:22:39.471694+0000","last_peered":"2024-09-16T01:22:39.471694+0000","last_clean":"2024-09-16T01:22:39.471694+0000","last_became_active":"2024-09-16T01:22:38.486833+0000","last_became_peered":"2024-09-16T01:22:38.486833+0000","last_unstale":"2024-09-16T01:22:39.471694+0000","last_undegraded":"2024-09-16T01:22:39.471694+0000","last_fullsized":"2024-09-16T01:22:39.471694+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:30.115229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.872947+0000","last_change":"2024-09-16T01:22:38.487024+0000","last_active":"2024-09-16T01:22:39.872947+0000","last_peered":"2024-09-16T01:22:39.872947+0000","last_clean":"2024-09-16T01:22:39.872947+0000","last_became_active":"2024-09-16T01:22:38.486738+0000","last_became_peered":"2024-09-16T01:22:38.486738+0000","last_unstale":"2024-09-16T01:22:39.872947+0000","last_undegraded":"2024-09-16T01:22:39.872947+0000","last_fullsized":"2024-09-16T01:22:39.872947+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:54.773897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374387+0000","last_change":"2024-09-16T01:22:38.477465+0000","last_active":"2024-09-16T01:22:40.374387+0000","last_peered":"2024-09-16T01:22:40.374387+0000","last_clean":"2024-09-16T01:22:40.374387+0000","last_became_active":"2024-09-16T01:22:38.477191+0000","last_became_peered":"2024-09-16T01:22:38.477191+0000","last_unstale":"2024-09-16T01:22:40.374387+0000","last_undegraded":"2024-09-16T01:22:40.374387+0000","last_fullsized":"2024-09-16T01:22:40.374387+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:29.290136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374431+0000","last_change":"2024-09-16T01:22:38.488633+0000","last_active":"2024-09-16T01:22:40.374431+0000","last_peered":"2024-09-16T01:22:40.374431+0000","last_clean":"2024-09-16T01:22:40.374431+0000","last_became_active":"2024-09-16T01:22:38.488363+0000","last_became_peered":"2024-09-16T01:22:38.488363+0000","last_unstale":"2024-09-16T01:22:40.374431+0000","last_undegraded":"2024-09-16T01:22:40.374431+0000","last_fullsized":"2024-09-16T01:22:40.374431+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:57.444337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.486854+0000","last_change":"2024-09-16T01:22:38.490745+0000","last_active":"2024-09-16T01:22:39.486854+0000","last_peered":"2024-09-16T01:22:39.486854+0000","last_clean":"2024-09-16T01:22:39.486854+0000","last_became_active":"2024-09-16T01:22:38.490451+0000","last_became_peered":"2024-09-16T01:22:38.490451+0000","last_unstale":"2024-09-16T01:22:39.486854+0000","last_undegraded":"2024-09-16T01:22:39.486854+0000","last_fullsized":"2024-09-16T01:22:39.486854+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:53.590145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374584+0000","last_change":"2024-09-16T01:22:38.482347+0000","last_active":"2024-09-16T01:22:40.374584+0000","last_peered":"2024-09-16T01:22:40.374584+0000","last_clean":"2024-09-16T01:22:40.374584+0000","last_became_active":"2024-09-16T01:22:38.482054+0000","last_became_peered":"2024-09-16T01:22:38.482054+0000","last_unstale":"2024-09-16T01:22:40.374584+0000","last_undegraded":"2024-09-16T01:22:40.374584+0000","last_fullsized":"2024-09-16T01:22:40.374584+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:20:01.332345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.469247+0000","last_change":"2024-09-16T01:22:38.486008+0000","last_active":"2024-09-16T01:22:39.469247+0000","last_peered":"2024-09-16T01:22:39.469247+0000","last_clean":"2024-09-16T01:22:39.469247+0000","last_became_active":"2024-09-16T01:22:38.485722+0000","last_became_peered":"2024-09-16T01:22:38.485722+0000","last_unstale":"2024-09-16T01:22:39.469247+0000","last_undegraded":"2024-09-16T01:22:39.469247+0000","last_fullsized":"2024-09-16T01:22:39.469247+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:29.580656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471871+0000","last_change":"2024-09-16T01:22:38.477825+0000","last_active":"2024-09-16T01:22:39.471871+0000","last_peered":"2024-09-16T01:22:39.471871+0000","last_clean":"2024-09-16T01:22:39.471871+0000","last_became_active":"2024-09-16T01:22:38.476712+0000","last_became_peered":"2024-09-16T01:22:38.476712+0000","last_unstale":"2024-09-16T01:22:39.471871+0000","last_undegraded":"2024-09-16T01:22:39.471871+0000","last_fullsized":"2024-09-16T01:22:39.471871+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:39.025950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374149+0000","last_change":"2024-09-16T01:22:38.491916+0000","last_active":"2024-09-16T01:22:40.374149+0000","last_peered":"2024-09-16T01:22:40.374149+0000","last_clean":"2024-09-16T01:22:40.374149+0000","last_became_active":"2024-09-16T01:22:38.491463+0000","last_became_peered":"2024-09-16T01:22:38.491463+0000","last_unstale":"2024-09-16T01:22:40.374149+0000","last_undegraded":"2024-09-16T01:22:40.374149+0000","last_fullsized":"2024-09-16T01:22:40.374149+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:29:49.028252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374193+0000","last_change":"2024-09-16T01:22:38.478029+0000","last_active":"2024-09-16T01:22:40.374193+0000","last_peered":"2024-09-16T01:22:40.374193+0000","last_clean":"2024-09-16T01:22:40.374193+0000","last_became_active":"2024-09-16T01:22:38.477793+0000","last_became_peered":"2024-09-16T01:22:38.477793+0000","last_unstale":"2024-09-16T01:22:40.374193+0000","last_undegraded":"2024-09-16T01:22:40.374193+0000","last_fullsized":"2024-09-16T01:22:40.374193+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:37.320381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374339+0000","last_change":"2024-09-16T01:22:38.492836+0000","last_active":"2024-09-16T01:22:40.374339+0000","last_peered":"2024-09-16T01:22:40.374339+0000","last_clean":"2024-09-16T01:22:40.374339+0000","last_became_active":"2024-09-16T01:22:38.492554+0000","last_became_peered":"2024-09-16T01:22:38.492554+0000","last_unstale":"2024-09-16T01:22:40.374339+0000","last_undegraded":"2024-09-16T01:22:40.374339+0000","last_fullsized":"2024-09-16T01:22:40.374339+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:59.819623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.373762+0000","last_change":"2024-09-16T01:22:38.493870+0000","last_active":"2024-09-16T01:22:40.373762+0000","last_peered":"2024-09-16T01:22:40.373762+0000","last_clean":"2024-09-16T01:22:40.373762+0000","last_became_active":"2024-09-16T01:22:38.493583+0000","last_became_peered":"2024-09-16T01:22:38.493583+0000","last_unstale":"2024-09-16T01:22:40.373762+0000","last_undegraded":"2024-09-16T01:22:40.373762+0000","last_fullsized":"2024-09-16T01:22:40.373762+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:38.880415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.373733+0000","last_change":"2024-09-16T01:22:38.484225+0000","last_active":"2024-09-16T01:22:40.373733+0000","last_peered":"2024-09-16T01:22:40.373733+0000","last_clean":"2024-09-16T01:22:40.373733+0000","last_became_active":"2024-09-16T01:22:38.482904+0000","last_became_peered":"2024-09-16T01:22:38.482904+0000","last_unstale":"2024-09-16T01:22:40.373733+0000","last_undegraded":"2024-09-16T01:22:40.373733+0000","last_fullsized":"2024-09-16T01:22:40.373733+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:12.685918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374670+0000","last_change":"2024-09-16T01:22:38.487959+0000","last_active":"2024-09-16T01:22:40.374670+0000","last_peered":"2024-09-16T01:22:40.374670+0000","last_clean":"2024-09-16T01:22:40.374670+0000","last_became_active":"2024-09-16T01:22:38.487624+0000","last_became_peered":"2024-09-16T01:22:38.487624+0000","last_unstale":"2024-09-16T01:22:40.374670+0000","last_undegraded":"2024-09-16T01:22:40.374670+0000","last_fullsized":"2024-09-16T01:22:40.374670+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:54.773897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.873085+0000","last_change":"2024-09-16T01:22:38.483140+0000","last_active":"2024-09-16T01:22:39.873085+0000","last_peered":"2024-09-16T01:22:39.873085+0000","last_clean":"2024-09-16T01:22:39.873085+0000","last_became_active":"2024-09-16T01:22:38.482895+0000","last_became_peered":"2024-09-16T01:22:38.482895+0000","last_unstale":"2024-09-16T01:22:39.873085+0000","last_undegraded":"2024-09-16T01:22:39.873085+0000","last_fullsized":"2024-09-16T01:22:39.873085+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:46:23.240776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374675+0000","last_change":"2024-09-16T01:22:38.489959+0000","last_active":"2024-09-16T01:22:40.374675+0000","last_peered":"2024-09-16T01:22:40.374675+0000","last_clean":"2024-09-16T01:22:40.374675+0000","last_became_active":"2024-09-16T01:22:38.489671+0000","last_became_peered":"2024-09-16T01:22:38.489671+0000","last_unstale":"2024-09-16T01:22:40.374675+0000","last_undegraded":"2024-09-16T01:22:40.374675+0000","last_fullsized":"2024-09-16T01:22:40.374675+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:42.135786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.873103+0000","last_change":"2024-09-16T01:22:38.493696+0000","last_active":"2024-09-16T01:22:39.873103+0000","last_peered":"2024-09-16T01:22:39.873103+0000","last_clean":"2024-09-16T01:22:39.873103+0000","last_became_active":"2024-09-16T01:22:38.493458+0000","last_became_peered":"2024-09-16T01:22:38.493458+0000","last_unstale":"2024-09-16T01:22:39.873103+0000","last_undegraded":"2024-09-16T01:22:39.873103+0000","last_fullsized":"2024-09-16T01:22:39.873103+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:35.891586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471327+0000","last_change":"2024-09-16T01:22:38.474745+0000","last_active":"2024-09-16T01:22:39.471327+0000","last_peered":"2024-09-16T01:22:39.471327+0000","last_clean":"2024-09-16T01:22:39.471327+0000","last_became_active":"2024-09-16T01:22:38.474424+0000","last_became_peered":"2024-09-16T01:22:38.474424+0000","last_unstale":"2024-09-16T01:22:39.471327+0000","last_undegraded":"2024-09-16T01:22:39.471327+0000","last_fullsized":"2024-09-16T01:22:39.471327+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:20.360602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374191+0000","last_change":"2024-09-16T01:22:38.490348+0000","last_active":"2024-09-16T01:22:40.374191+0000","last_peered":"2024-09-16T01:22:40.374191+0000","last_clean":"2024-09-16T01:22:40.374191+0000","last_became_active":"2024-09-16T01:22:38.490065+0000","last_became_peered":"2024-09-16T01:22:38.490065+0000","last_unstale":"2024-09-16T01:22:40.374191+0000","last_undegraded":"2024-09-16T01:22:40.374191+0000","last_fullsized":"2024-09-16T01:22:40.374191+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:19:48.136882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.470899+0000","last_change":"2024-09-16T01:22:38.487347+0000","last_active":"2024-09-16T01:22:39.470899+0000","last_peered":"2024-09-16T01:22:39.470899+0000","last_clean":"2024-09-16T01:22:39.470899+0000","last_became_active":"2024-09-16T01:22:38.486485+0000","last_became_peered":"2024-09-16T01:22:38.486485+0000","last_unstale":"2024-09-16T01:22:39.470899+0000","last_undegraded":"2024-09-16T01:22:39.470899+0000","last_fullsized":"2024-09-16T01:22:39.470899+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:07.687743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.373797+0000","last_change":"2024-09-16T01:22:38.475131+0000","last_active":"2024-09-16T01:22:40.373797+0000","last_peered":"2024-09-16T01:22:40.373797+0000","last_clean":"2024-09-16T01:22:40.373797+0000","last_became_active":"2024-09-16T01:22:38.474842+0000","last_became_peered":"2024-09-16T01:22:38.474842+0000","last_unstale":"2024-09-16T01:22:40.373797+0000","last_undegraded":"2024-09-16T01:22:40.373797+0000","last_fullsized":"2024-09-16T01:22:40.373797+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:36.807232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.472437+0000","last_change":"2024-09-16T01:22:38.482878+0000","last_active":"2024-09-16T01:22:39.472437+0000","last_peered":"2024-09-16T01:22:39.472437+0000","last_clean":"2024-09-16T01:22:39.472437+0000","last_became_active":"2024-09-16T01:22:38.482612+0000","last_became_peered":"2024-09-16T01:22:38.482612+0000","last_unstale":"2024-09-16T01:22:39.472437+0000","last_undegraded":"2024-09-16T01:22:39.472437+0000","last_fullsized":"2024-09-16T01:22:39.472437+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:42.540766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.472064+0000","last_change":"2024-09-16T01:22:38.486469+0000","last_active":"2024-09-16T01:22:39.472064+0000","last_peered":"2024-09-16T01:22:39.472064+0000","last_clean":"2024-09-16T01:22:39.472064+0000","last_became_active":"2024-09-16T01:22:38.485914+0000","last_became_peered":"2024-09-16T01:22:38.485914+0000","last_unstale":"2024-09-16T01:22:39.472064+0000","last_undegraded":"2024-09-16T01:22:39.472064+0000","last_fullsized":"2024-09-16T01:22:39.472064+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:58.250141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374687+0000","last_change":"2024-09-16T01:22:38.496511+0000","last_active":"2024-09-16T01:22:40.374687+0000","last_peered":"2024-09-16T01:22:40.374687+0000","last_clean":"2024-09-16T01:22:40.374687+0000","last_became_active":"2024-09-16T01:22:38.496129+0000","last_became_peered":"2024-09-16T01:22:38.496129+0000","last_unstale":"2024-09-16T01:22:40.374687+0000","last_undegraded":"2024-09-16T01:22:40.374687+0000","last_fullsized":"2024-09-16T01:22:40.374687+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:06.584864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.469176+0000","last_change":"2024-09-16T01:22:38.486555+0000","last_active":"2024-09-16T01:22:39.469176+0000","last_peered":"2024-09-16T01:22:39.469176+0000","last_clean":"2024-09-16T01:22:39.469176+0000","last_became_active":"2024-09-16T01:22:38.486273+0000","last_became_peered":"2024-09-16T01:22:38.486273+0000","last_unstale":"2024-09-16T01:22:39.469176+0000","last_undegraded":"2024-09-16T01:22:39.469176+0000","last_fullsized":"2024-09-16T01:22:39.469176+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:40:23.877275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471756+0000","last_change":"2024-09-16T01:22:38.475254+0000","last_active":"2024-09-16T01:22:39.471756+0000","last_peered":"2024-09-16T01:22:39.471756+0000","last_clean":"2024-09-16T01:22:39.471756+0000","last_became_active":"2024-09-16T01:22:38.474988+0000","last_became_peered":"2024-09-16T01:22:38.474988+0000","last_unstale":"2024-09-16T01:22:39.471756+0000","last_undegraded":"2024-09-16T01:22:39.471756+0000","last_fullsized":"2024-09-16T01:22:39.471756+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:20.360602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471000+0000","last_change":"2024-09-16T01:22:38.483405+0000","last_active":"2024-09-16T01:22:39.471000+0000","last_peered":"2024-09-16T01:22:39.471000+0000","last_clean":"2024-09-16T01:22:39.471000+0000","last_became_active":"2024-09-16T01:22:38.483038+0000","last_became_peered":"2024-09-16T01:22:38.483038+0000","last_unstale":"2024-09-16T01:22:39.471000+0000","last_undegraded":"2024-09-16T01:22:39.471000+0000","last_fullsized":"2024-09-16T01:22:39.471000+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:07.158064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.486860+0000","last_change":"2024-09-16T01:22:38.496928+0000","last_active":"2024-09-16T01:22:39.486860+0000","last_peered":"2024-09-16T01:22:39.486860+0000","last_clean":"2024-09-16T01:22:39.486860+0000","last_became_active":"2024-09-16T01:22:38.496663+0000","last_became_peered":"2024-09-16T01:22:38.496663+0000","last_unstale":"2024-09-16T01:22:39.486860+0000","last_undegraded":"2024-09-16T01:22:39.486860+0000","last_fullsized":"2024-09-16T01:22:39.486860+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:07.158064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.468968+0000","last_change":"2024-09-16T01:22:38.491953+0000","last_active":"2024-09-16T01:22:39.468968+0000","last_peered":"2024-09-16T01:22:39.468968+0000","last_clean":"2024-09-16T01:22:39.468968+0000","last_became_active":"2024-09-16T01:22:38.491651+0000","last_became_peered":"2024-09-16T01:22:38.491651+0000","last_unstale":"2024-09-16T01:22:39.468968+0000","last_undegraded":"2024-09-16T01:22:39.468968+0000","last_fullsized":"2024-09-16T01:22:39.468968+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:36.285930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.486874+0000","last_change":"2024-09-16T01:22:38.485597+0000","last_active":"2024-09-16T01:22:39.486874+0000","last_peered":"2024-09-16T01:22:39.486874+0000","last_clean":"2024-09-16T01:22:39.486874+0000","last_became_active":"2024-09-16T01:22:38.485329+0000","last_became_peered":"2024-09-16T01:22:38.485329+0000","last_unstale":"2024-09-16T01:22:39.486874+0000","last_undegraded":"2024-09-16T01:22:39.486874+0000","last_fullsized":"2024-09-16T01:22:39.486874+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:07.687743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"124'4","reported_seq":18,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.472491+0000","last_change":"2024-09-16T01:22:37.473828+0000","last_active":"2024-09-16T01:22:39.472491+0000","last_peered":"2024-09-16T01:22:39.472491+0000","last_clean":"2024-09-16T01:22:39.472491+0000","last_became_active":"2024-09-16T01:22:37.473523+0000","last_became_peered":"2024-09-16T01:22:37.473523+0000","last_unstale":"2024-09-16T01:22:39.472491+0000","last_undegraded":"2024-09-16T01:22:39.472491+0000","last_fullsized":"2024-09-16T01:22:39.472491+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:48:58.354301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374372+0000","last_change":"2024-09-16T01:22:38.490375+0000","last_active":"2024-09-16T01:22:40.374372+0000","last_peered":"2024-09-16T01:22:40.374372+0000","last_clean":"2024-09-16T01:22:40.374372+0000","last_became_active":"2024-09-16T01:22:38.490134+0000","last_became_peered":"2024-09-16T01:22:38.490134+0000","last_unstale":"2024-09-16T01:22:40.374372+0000","last_undegraded":"2024-09-16T01:22:40.374372+0000","last_fullsized":"2024-09-16T01:22:40.374372+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:09.247303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.873247+0000","last_change":"2024-09-16T01:22:37.469361+0000","last_active":"2024-09-16T01:22:39.873247+0000","last_peered":"2024-09-16T01:22:39.873247+0000","last_clean":"2024-09-16T01:22:39.873247+0000","last_became_active":"2024-09-16T01:22:37.469091+0000","last_became_peered":"2024-09-16T01:22:37.469091+0000","last_unstale":"2024-09-16T01:22:39.873247+0000","last_undegraded":"2024-09-16T01:22:39.873247+0000","last_fullsized":"2024-09-16T01:22:39.873247+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:38.021847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471277+0000","last_change":"2024-09-16T01:22:38.492780+0000","last_active":"2024-09-16T01:22:39.471277+0000","last_peered":"2024-09-16T01:22:39.471277+0000","last_clean":"2024-09-16T01:22:39.471277+0000","last_became_active":"2024-09-16T01:22:38.492445+0000","last_became_peered":"2024-09-16T01:22:38.492445+0000","last_unstale":"2024-09-16T01:22:39.471277+0000","last_undegraded":"2024-09-16T01:22:39.471277+0000","last_fullsized":"2024-09-16T01:22:39.471277+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:22.141402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374792+0000","last_change":"2024-09-16T01:22:37.472329+0000","last_active":"2024-09-16T01:22:40.374792+0000","last_peered":"2024-09-16T01:22:40.374792+0000","last_clean":"2024-09-16T01:22:40.374792+0000","last_became_active":"2024-09-16T01:22:37.471993+0000","last_became_peered":"2024-09-16T01:22:37.471993+0000","last_unstale":"2024-09-16T01:22:40.374792+0000","last_undegraded":"2024-09-16T01:22:40.374792+0000","last_fullsized":"2024-09-16T01:22:40.374792+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:01.830677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374505+0000","last_change":"2024-09-16T01:22:38.493298+0000","last_active":"2024-09-16T01:22:40.374505+0000","last_peered":"2024-09-16T01:22:40.374505+0000","last_clean":"2024-09-16T01:22:40.374505+0000","last_became_active":"2024-09-16T01:22:38.493033+0000","last_became_peered":"2024-09-16T01:22:38.493033+0000","last_unstale":"2024-09-16T01:22:40.374505+0000","last_undegraded":"2024-09-16T01:22:40.374505+0000","last_fullsized":"2024-09-16T01:22:40.374505+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:04.220411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374419+0000","last_change":"2024-09-16T01:22:37.472495+0000","last_active":"2024-09-16T01:22:40.374419+0000","last_peered":"2024-09-16T01:22:40.374419+0000","last_clean":"2024-09-16T01:22:40.374419+0000","last_became_active":"2024-09-16T01:22:37.472218+0000","last_became_peered":"2024-09-16T01:22:37.472218+0000","last_unstale":"2024-09-16T01:22:40.374419+0000","last_undegraded":"2024-09-16T01:22:40.374419+0000","last_fullsized":"2024-09-16T01:22:40.374419+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:00.589909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.487136+0000","last_change":"2024-09-16T01:22:38.496240+0000","last_active":"2024-09-16T01:22:39.487136+0000","last_peered":"2024-09-16T01:22:39.487136+0000","last_clean":"2024-09-16T01:22:39.487136+0000","last_became_active":"2024-09-16T01:22:38.495962+0000","last_became_peered":"2024-09-16T01:22:38.495962+0000","last_unstale":"2024-09-16T01:22:39.487136+0000","last_undegraded":"2024-09-16T01:22:39.487136+0000","last_fullsized":"2024-09-16T01:22:39.487136+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:20.360602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.486965+0000","last_change":"2024-09-16T01:22:37.469230+0000","last_active":"2024-09-16T01:22:39.486965+0000","last_peered":"2024-09-16T01:22:39.486965+0000","last_clean":"2024-09-16T01:22:39.486965+0000","last_became_active":"2024-09-16T01:22:37.468906+0000","last_became_peered":"2024-09-16T01:22:37.468906+0000","last_unstale":"2024-09-16T01:22:39.486965+0000","last_undegraded":"2024-09-16T01:22:39.486965+0000","last_fullsized":"2024-09-16T01:22:39.486965+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:06.423099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.487107+0000","last_change":"2024-09-16T01:22:38.489025+0000","last_active":"2024-09-16T01:22:39.487107+0000","last_peered":"2024-09-16T01:22:39.487107+0000","last_clean":"2024-09-16T01:22:39.487107+0000","last_became_active":"2024-09-16T01:22:38.488754+0000","last_became_peered":"2024-09-16T01:22:38.488754+0000","last_unstale":"2024-09-16T01:22:39.487107+0000","last_undegraded":"2024-09-16T01:22:39.487107+0000","last_fullsized":"2024-09-16T01:22:39.487107+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:22.141402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.872892+0000","last_change":"2024-09-16T01:22:37.472506+0000","last_active":"2024-09-16T01:22:39.872892+0000","last_peered":"2024-09-16T01:22:39.872892+0000","last_clean":"2024-09-16T01:22:39.872892+0000","last_became_active":"2024-09-16T01:22:37.472177+0000","last_became_peered":"2024-09-16T01:22:37.472177+0000","last_unstale":"2024-09-16T01:22:39.872892+0000","last_undegraded":"2024-09-16T01:22:39.872892+0000","last_fullsized":"2024-09-16T01:22:39.872892+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:11.681815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.873137+0000","last_change":"2024-09-16T01:22:38.494872+0000","last_active":"2024-09-16T01:22:39.873137+0000","last_peered":"2024-09-16T01:22:39.873137+0000","last_clean":"2024-09-16T01:22:39.873137+0000","last_became_active":"2024-09-16T01:22:38.493126+0000","last_became_peered":"2024-09-16T01:22:38.493126+0000","last_unstale":"2024-09-16T01:22:39.873137+0000","last_undegraded":"2024-09-16T01:22:39.873137+0000","last_fullsized":"2024-09-16T01:22:39.873137+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:31.571260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.373715+0000","last_change":"2024-09-16T01:22:37.464769+0000","last_active":"2024-09-16T01:22:40.373715+0000","last_peered":"2024-09-16T01:22:40.373715+0000","last_clean":"2024-09-16T01:22:40.373715+0000","last_became_active":"2024-09-16T01:22:37.464432+0000","last_became_peered":"2024-09-16T01:22:37.464432+0000","last_unstale":"2024-09-16T01:22:40.373715+0000","last_undegraded":"2024-09-16T01:22:40.373715+0000","last_fullsized":"2024-09-16T01:22:40.373715+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:33.455829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374800+0000","last_change":"2024-09-16T01:22:38.496520+0000","last_active":"2024-09-16T01:22:40.374800+0000","last_peered":"2024-09-16T01:22:40.374800+0000","last_clean":"2024-09-16T01:22:40.374800+0000","last_became_active":"2024-09-16T01:22:38.496129+0000","last_became_peered":"2024-09-16T01:22:38.496129+0000","last_unstale":"2024-09-16T01:22:40.374800+0000","last_undegraded":"2024-09-16T01:22:40.374800+0000","last_fullsized":"2024-09-16T01:22:40.374800+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:43.711762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471045+0000","last_change":"2024-09-16T01:22:37.466155+0000","last_active":"2024-09-16T01:22:39.471045+0000","last_peered":"2024-09-16T01:22:39.471045+0000","last_clean":"2024-09-16T01:22:39.471045+0000","last_became_active":"2024-09-16T01:22:37.465891+0000","last_became_peered":"2024-09-16T01:22:37.465891+0000","last_unstale":"2024-09-16T01:22:39.471045+0000","last_undegraded":"2024-09-16T01:22:39.471045+0000","last_fullsized":"2024-09-16T01:22:39.471045+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:47.381156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.373753+0000","last_change":"2024-09-16T01:22:38.493992+0000","last_active":"2024-09-16T01:22:40.373753+0000","last_peered":"2024-09-16T01:22:40.373753+0000","last_clean":"2024-09-16T01:22:40.373753+0000","last_became_active":"2024-09-16T01:22:38.493656+0000","last_became_peered":"2024-09-16T01:22:38.493656+0000","last_unstale":"2024-09-16T01:22:40.373753+0000","last_undegraded":"2024-09-16T01:22:40.373753+0000","last_fullsized":"2024-09-16T01:22:40.373753+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:49.929920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.472210+0000","last_change":"2024-09-16T01:22:37.466248+0000","last_active":"2024-09-16T01:22:39.472210+0000","last_peered":"2024-09-16T01:22:39.472210+0000","last_clean":"2024-09-16T01:22:39.472210+0000","last_became_active":"2024-09-16T01:22:37.465956+0000","last_became_peered":"2024-09-16T01:22:37.465956+0000","last_unstale":"2024-09-16T01:22:39.472210+0000","last_undegraded":"2024-09-16T01:22:39.472210+0000","last_fullsized":"2024-09-16T01:22:39.472210+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:06.423099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.373979+0000","last_change":"2024-09-16T01:22:38.488320+0000","last_active":"2024-09-16T01:22:40.373979+0000","last_peered":"2024-09-16T01:22:40.373979+0000","last_clean":"2024-09-16T01:22:40.373979+0000","last_became_active":"2024-09-16T01:22:38.488080+0000","last_became_peered":"2024-09-16T01:22:38.488080+0000","last_unstale":"2024-09-16T01:22:40.373979+0000","last_undegraded":"2024-09-16T01:22:40.373979+0000","last_fullsized":"2024-09-16T01:22:40.373979+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:51.796468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.373928+0000","last_change":"2024-09-16T01:22:37.476174+0000","last_active":"2024-09-16T01:22:40.373928+0000","last_peered":"2024-09-16T01:22:40.373928+0000","last_clean":"2024-09-16T01:22:40.373928+0000","last_became_active":"2024-09-16T01:22:37.475897+0000","last_became_peered":"2024-09-16T01:22:37.475897+0000","last_unstale":"2024-09-16T01:22:40.373928+0000","last_undegraded":"2024-09-16T01:22:40.373928+0000","last_fullsized":"2024-09-16T01:22:40.373928+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:08.874378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471164+0000","last_change":"2024-09-16T01:22:38.474502+0000","last_active":"2024-09-16T01:22:39.471164+0000","last_peered":"2024-09-16T01:22:39.471164+0000","last_clean":"2024-09-16T01:22:39.471164+0000","last_became_active":"2024-09-16T01:22:38.474075+0000","last_became_peered":"2024-09-16T01:22:38.474075+0000","last_unstale":"2024-09-16T01:22:39.471164+0000","last_undegraded":"2024-09-16T01:22:39.471164+0000","last_fullsized":"2024-09-16T01:22:39.471164+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:30.115229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"124'3","reported_seq":17,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374824+0000","last_change":"2024-09-16T01:22:37.471374+0000","last_active":"2024-09-16T01:22:40.374824+0000","last_peered":"2024-09-16T01:22:40.374824+0000","last_clean":"2024-09-16T01:22:40.374824+0000","last_became_active":"2024-09-16T01:22:37.471086+0000","last_became_peered":"2024-09-16T01:22:37.471086+0000","last_unstale":"2024-09-16T01:22:40.374824+0000","last_undegraded":"2024-09-16T01:22:40.374824+0000","last_fullsized":"2024-09-16T01:22:40.374824+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:28.286033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471925+0000","last_change":"2024-09-16T01:22:38.487251+0000","last_active":"2024-09-16T01:22:39.471925+0000","last_peered":"2024-09-16T01:22:39.471925+0000","last_clean":"2024-09-16T01:22:39.471925+0000","last_became_active":"2024-09-16T01:22:38.486901+0000","last_became_peered":"2024-09-16T01:22:38.486901+0000","last_unstale":"2024-09-16T01:22:39.471925+0000","last_undegraded":"2024-09-16T01:22:39.471925+0000","last_fullsized":"2024-09-16T01:22:39.471925+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:33:39.025950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"124'6","reported_seq":20,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374498+0000","last_change":"2024-09-16T01:22:37.469445+0000","last_active":"2024-09-16T01:22:40.374498+0000","last_peered":"2024-09-16T01:22:40.374498+0000","last_clean":"2024-09-16T01:22:40.374498+0000","last_became_active":"2024-09-16T01:22:37.469160+0000","last_became_peered":"2024-09-16T01:22:37.469160+0000","last_unstale":"2024-09-16T01:22:40.374498+0000","last_undegraded":"2024-09-16T01:22:40.374498+0000","last_fullsized":"2024-09-16T01:22:40.374498+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:34.887483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.469242+0000","last_change":"2024-09-16T01:22:38.494250+0000","last_active":"2024-09-16T01:22:39.469242+0000","last_peered":"2024-09-16T01:22:39.469242+0000","last_clean":"2024-09-16T01:22:39.469242+0000","last_became_active":"2024-09-16T01:22:38.493958+0000","last_became_peered":"2024-09-16T01:22:38.493958+0000","last_unstale":"2024-09-16T01:22:39.469242+0000","last_undegraded":"2024-09-16T01:22:39.469242+0000","last_fullsized":"2024-09-16T01:22:39.469242+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:18.246823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374570+0000","last_change":"2024-09-16T01:22:37.476008+0000","last_active":"2024-09-16T01:22:40.374570+0000","last_peered":"2024-09-16T01:22:40.374570+0000","last_clean":"2024-09-16T01:22:40.374570+0000","last_became_active":"2024-09-16T01:22:37.475720+0000","last_became_peered":"2024-09-16T01:22:37.475720+0000","last_unstale":"2024-09-16T01:22:40.374570+0000","last_undegraded":"2024-09-16T01:22:40.374570+0000","last_fullsized":"2024-09-16T01:22:40.374570+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:59.944646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374905+0000","last_change":"2024-09-16T01:22:38.485124+0000","last_active":"2024-09-16T01:22:40.374905+0000","last_peered":"2024-09-16T01:22:40.374905+0000","last_clean":"2024-09-16T01:22:40.374905+0000","last_became_active":"2024-09-16T01:22:38.483844+0000","last_became_peered":"2024-09-16T01:22:38.483844+0000","last_unstale":"2024-09-16T01:22:40.374905+0000","last_undegraded":"2024-09-16T01:22:40.374905+0000","last_fullsized":"2024-09-16T01:22:40.374905+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:14:27.385051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471634+0000","last_change":"2024-09-16T01:22:37.459504+0000","last_active":"2024-09-16T01:22:39.471634+0000","last_peered":"2024-09-16T01:22:39.471634+0000","last_clean":"2024-09-16T01:22:39.471634+0000","last_became_active":"2024-09-16T01:22:37.459226+0000","last_became_peered":"2024-09-16T01:22:37.459226+0000","last_unstale":"2024-09-16T01:22:39.471634+0000","last_undegraded":"2024-09-16T01:22:39.471634+0000","last_fullsized":"2024-09-16T01:22:39.471634+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:01.929612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.873147+0000","last_change":"2024-09-16T01:22:38.496249+0000","last_active":"2024-09-16T01:22:39.873147+0000","last_peered":"2024-09-16T01:22:39.873147+0000","last_clean":"2024-09-16T01:22:39.873147+0000","last_became_active":"2024-09-16T01:22:38.495996+0000","last_became_peered":"2024-09-16T01:22:38.495996+0000","last_unstale":"2024-09-16T01:22:39.873147+0000","last_undegraded":"2024-09-16T01:22:39.873147+0000","last_fullsized":"2024-09-16T01:22:39.873147+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:02.173832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"124'8","reported_seq":22,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.373837+0000","last_change":"2024-09-16T01:22:37.460411+0000","last_active":"2024-09-16T01:22:40.373837+0000","last_peered":"2024-09-16T01:22:40.373837+0000","last_clean":"2024-09-16T01:22:40.373837+0000","last_became_active":"2024-09-16T01:22:37.460106+0000","last_became_peered":"2024-09-16T01:22:37.460106+0000","last_unstale":"2024-09-16T01:22:40.373837+0000","last_undegraded":"2024-09-16T01:22:40.373837+0000","last_fullsized":"2024-09-16T01:22:40.373837+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:42.987085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.470935+0000","last_change":"2024-09-16T01:22:38.486153+0000","last_active":"2024-09-16T01:22:39.470935+0000","last_peered":"2024-09-16T01:22:39.470935+0000","last_clean":"2024-09-16T01:22:39.470935+0000","last_became_active":"2024-09-16T01:22:38.485090+0000","last_became_peered":"2024-09-16T01:22:38.485090+0000","last_unstale":"2024-09-16T01:22:39.470935+0000","last_undegraded":"2024-09-16T01:22:39.470935+0000","last_fullsized":"2024-09-16T01:22:39.470935+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:35.890414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.472267+0000","last_change":"2024-09-16T01:22:37.465535+0000","last_active":"2024-09-16T01:22:39.472267+0000","last_peered":"2024-09-16T01:22:39.472267+0000","last_clean":"2024-09-16T01:22:39.472267+0000","last_became_active":"2024-09-16T01:22:37.465233+0000","last_became_peered":"2024-09-16T01:22:37.465233+0000","last_unstale":"2024-09-16T01:22:39.472267+0000","last_undegraded":"2024-09-16T01:22:39.472267+0000","last_fullsized":"2024-09-16T01:22:39.472267+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:32.373786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374417+0000","last_change":"2024-09-16T01:22:38.488457+0000","last_active":"2024-09-16T01:22:40.374417+0000","last_peered":"2024-09-16T01:22:40.374417+0000","last_clean":"2024-09-16T01:22:40.374417+0000","last_became_active":"2024-09-16T01:22:38.487888+0000","last_became_peered":"2024-09-16T01:22:38.487888+0000","last_unstale":"2024-09-16T01:22:40.374417+0000","last_undegraded":"2024-09-16T01:22:40.374417+0000","last_fullsized":"2024-09-16T01:22:40.374417+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:23.674215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.472066+0000","last_change":"2024-09-16T01:22:37.473710+0000","last_active":"2024-09-16T01:22:39.472066+0000","last_peered":"2024-09-16T01:22:39.472066+0000","last_clean":"2024-09-16T01:22:39.472066+0000","last_became_active":"2024-09-16T01:22:37.473344+0000","last_became_peered":"2024-09-16T01:22:37.473344+0000","last_unstale":"2024-09-16T01:22:39.472066+0000","last_undegraded":"2024-09-16T01:22:39.472066+0000","last_fullsized":"2024-09-16T01:22:39.472066+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:00.457815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374579+0000","last_change":"2024-09-16T01:22:38.498696+0000","last_active":"2024-09-16T01:22:40.374579+0000","last_peered":"2024-09-16T01:22:40.374579+0000","last_clean":"2024-09-16T01:22:40.374579+0000","last_became_active":"2024-09-16T01:22:38.498436+0000","last_became_peered":"2024-09-16T01:22:38.498436+0000","last_unstale":"2024-09-16T01:22:40.374579+0000","last_undegraded":"2024-09-16T01:22:40.374579+0000","last_fullsized":"2024-09-16T01:22:40.374579+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:57.507730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"124'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374619+0000","last_change":"2024-09-16T01:22:37.463887+0000","last_active":"2024-09-16T01:22:40.374619+0000","last_peered":"2024-09-16T01:22:40.374619+0000","last_clean":"2024-09-16T01:22:40.374619+0000","last_became_active":"2024-09-16T01:22:37.463631+0000","last_became_peered":"2024-09-16T01:22:37.463631+0000","last_unstale":"2024-09-16T01:22:40.374619+0000","last_undegraded":"2024-09-16T01:22:40.374619+0000","last_fullsized":"2024-09-16T01:22:40.374619+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:30.216392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.469168+0000","last_change":"2024-09-16T01:22:38.486123+0000","last_active":"2024-09-16T01:22:39.469168+0000","last_peered":"2024-09-16T01:22:39.469168+0000","last_clean":"2024-09-16T01:22:39.469168+0000","last_became_active":"2024-09-16T01:22:38.485876+0000","last_became_peered":"2024-09-16T01:22:38.485876+0000","last_unstale":"2024-09-16T01:22:39.469168+0000","last_undegraded":"2024-09-16T01:22:39.469168+0000","last_fullsized":"2024-09-16T01:22:39.469168+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:35.459329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.873220+0000","last_change":"2024-09-16T01:22:37.474218+0000","last_active":"2024-09-16T01:22:39.873220+0000","last_peered":"2024-09-16T01:22:39.873220+0000","last_clean":"2024-09-16T01:22:39.873220+0000","last_became_active":"2024-09-16T01:22:37.473947+0000","last_became_peered":"2024-09-16T01:22:37.473947+0000","last_unstale":"2024-09-16T01:22:39.873220+0000","last_undegraded":"2024-09-16T01:22:39.873220+0000","last_fullsized":"2024-09-16T01:22:39.873220+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:54:29.111126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.873226+0000","last_change":"2024-09-16T01:22:38.494389+0000","last_active":"2024-09-16T01:22:39.873226+0000","last_peered":"2024-09-16T01:22:39.873226+0000","last_clean":"2024-09-16T01:22:39.873226+0000","last_became_active":"2024-09-16T01:22:38.494118+0000","last_became_peered":"2024-09-16T01:22:38.494118+0000","last_unstale":"2024-09-16T01:22:39.873226+0000","last_undegraded":"2024-09-16T01:22:39.873226+0000","last_fullsized":"2024-09-16T01:22:39.873226+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:36:31.819521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.487062+0000","last_change":"2024-09-16T01:22:37.469517+0000","last_active":"2024-09-16T01:22:39.487062+0000","last_peered":"2024-09-16T01:22:39.487062+0000","last_clean":"2024-09-16T01:22:39.487062+0000","last_became_active":"2024-09-16T01:22:37.469256+0000","last_became_peered":"2024-09-16T01:22:37.469256+0000","last_unstale":"2024-09-16T01:22:39.487062+0000","last_undegraded":"2024-09-16T01:22:39.487062+0000","last_fullsized":"2024-09-16T01:22:39.487062+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:32.373786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374418+0000","last_change":"2024-09-16T01:22:38.493092+0000","last_active":"2024-09-16T01:22:40.374418+0000","last_peered":"2024-09-16T01:22:40.374418+0000","last_clean":"2024-09-16T01:22:40.374418+0000","last_became_active":"2024-09-16T01:22:38.492826+0000","last_became_peered":"2024-09-16T01:22:38.492826+0000","last_unstale":"2024-09-16T01:22:40.374418+0000","last_undegraded":"2024-09-16T01:22:40.374418+0000","last_fullsized":"2024-09-16T01:22:40.374418+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:52.433312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374400+0000","last_change":"2024-09-16T01:22:37.469806+0000","last_active":"2024-09-16T01:22:40.374400+0000","last_peered":"2024-09-16T01:22:40.374400+0000","last_clean":"2024-09-16T01:22:40.374400+0000","last_became_active":"2024-09-16T01:22:37.469516+0000","last_became_peered":"2024-09-16T01:22:37.469516+0000","last_unstale":"2024-09-16T01:22:40.374400+0000","last_undegraded":"2024-09-16T01:22:40.374400+0000","last_fullsized":"2024-09-16T01:22:40.374400+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:38.228441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.873249+0000","last_change":"2024-09-16T01:22:38.492371+0000","last_active":"2024-09-16T01:22:39.873249+0000","last_peered":"2024-09-16T01:22:39.873249+0000","last_clean":"2024-09-16T01:22:39.873249+0000","last_became_active":"2024-09-16T01:22:38.492114+0000","last_became_peered":"2024-09-16T01:22:38.492114+0000","last_unstale":"2024-09-16T01:22:39.873249+0000","last_undegraded":"2024-09-16T01:22:39.873249+0000","last_fullsized":"2024-09-16T01:22:39.873249+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:08.715046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374683+0000","last_change":"2024-09-16T01:22:37.473724+0000","last_active":"2024-09-16T01:22:40.374683+0000","last_peered":"2024-09-16T01:22:40.374683+0000","last_clean":"2024-09-16T01:22:40.374683+0000","last_became_active":"2024-09-16T01:22:37.473345+0000","last_became_peered":"2024-09-16T01:22:37.473345+0000","last_unstale":"2024-09-16T01:22:40.374683+0000","last_undegraded":"2024-09-16T01:22:40.374683+0000","last_fullsized":"2024-09-16T01:22:40.374683+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:20:00.328242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.472117+0000","last_change":"2024-09-16T01:22:38.477934+0000","last_active":"2024-09-16T01:22:39.472117+0000","last_peered":"2024-09-16T01:22:39.472117+0000","last_clean":"2024-09-16T01:22:39.472117+0000","last_became_active":"2024-09-16T01:22:38.477644+0000","last_became_peered":"2024-09-16T01:22:38.477644+0000","last_unstale":"2024-09-16T01:22:39.472117+0000","last_undegraded":"2024-09-16T01:22:39.472117+0000","last_fullsized":"2024-09-16T01:22:39.472117+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:58.250141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.373956+0000","last_change":"2024-09-16T01:22:37.466054+0000","last_active":"2024-09-16T01:22:40.373956+0000","last_peered":"2024-09-16T01:22:40.373956+0000","last_clean":"2024-09-16T01:22:40.373956+0000","last_became_active":"2024-09-16T01:22:37.465813+0000","last_became_peered":"2024-09-16T01:22:37.465813+0000","last_unstale":"2024-09-16T01:22:40.373956+0000","last_undegraded":"2024-09-16T01:22:40.373956+0000","last_fullsized":"2024-09-16T01:22:40.373956+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:22:18.638113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.873038+0000","last_change":"2024-09-16T01:22:38.493386+0000","last_active":"2024-09-16T01:22:39.873038+0000","last_peered":"2024-09-16T01:22:39.873038+0000","last_clean":"2024-09-16T01:22:39.873038+0000","last_became_active":"2024-09-16T01:22:38.493105+0000","last_became_peered":"2024-09-16T01:22:38.493105+0000","last_unstale":"2024-09-16T01:22:39.873038+0000","last_undegraded":"2024-09-16T01:22:39.873038+0000","last_fullsized":"2024-09-16T01:22:39.873038+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:01.594012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"124'2","reported_seq":16,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374071+0000","last_change":"2024-09-16T01:22:37.473626+0000","last_active":"2024-09-16T01:22:40.374071+0000","last_peered":"2024-09-16T01:22:40.374071+0000","last_clean":"2024-09-16T01:22:40.374071+0000","last_became_active":"2024-09-16T01:22:37.473256+0000","last_became_peered":"2024-09-16T01:22:37.473256+0000","last_unstale":"2024-09-16T01:22:40.374071+0000","last_undegraded":"2024-09-16T01:22:40.374071+0000","last_fullsized":"2024-09-16T01:22:40.374071+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:36.342843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471531+0000","last_change":"2024-09-16T01:22:38.489789+0000","last_active":"2024-09-16T01:22:39.471531+0000","last_peered":"2024-09-16T01:22:39.471531+0000","last_clean":"2024-09-16T01:22:39.471531+0000","last_became_active":"2024-09-16T01:22:38.486924+0000","last_became_peered":"2024-09-16T01:22:38.486924+0000","last_unstale":"2024-09-16T01:22:39.471531+0000","last_undegraded":"2024-09-16T01:22:39.471531+0000","last_fullsized":"2024-09-16T01:22:39.471531+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:22.141402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"125'1","reported_seq":15,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.487306+0000","last_change":"2024-09-16T01:22:37.467923+0000","last_active":"2024-09-16T01:22:39.487306+0000","last_peered":"2024-09-16T01:22:39.487306+0000","last_clean":"2024-09-16T01:22:39.487306+0000","last_became_active":"2024-09-16T01:22:37.467632+0000","last_became_peered":"2024-09-16T01:22:37.467632+0000","last_unstale":"2024-09-16T01:22:39.487306+0000","last_undegraded":"2024-09-16T01:22:39.487306+0000","last_fullsized":"2024-09-16T01:22:39.487306+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:42.987085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374351+0000","last_change":"2024-09-16T01:22:38.492626+0000","last_active":"2024-09-16T01:22:40.374351+0000","last_peered":"2024-09-16T01:22:40.374351+0000","last_clean":"2024-09-16T01:22:40.374351+0000","last_became_active":"2024-09-16T01:22:38.492353+0000","last_became_peered":"2024-09-16T01:22:38.492353+0000","last_unstale":"2024-09-16T01:22:40.374351+0000","last_undegraded":"2024-09-16T01:22:40.374351+0000","last_fullsized":"2024-09-16T01:22:40.374351+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:27.269961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.487101+0000","last_change":"2024-09-16T01:22:37.473120+0000","last_active":"2024-09-16T01:22:39.487101+0000","last_peered":"2024-09-16T01:22:39.487101+0000","last_clean":"2024-09-16T01:22:39.487101+0000","last_became_active":"2024-09-16T01:22:37.472799+0000","last_became_peered":"2024-09-16T01:22:37.472799+0000","last_unstale":"2024-09-16T01:22:39.487101+0000","last_undegraded":"2024-09-16T01:22:39.487101+0000","last_fullsized":"2024-09-16T01:22:39.487101+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:15.378906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.469183+0000","last_change":"2024-09-16T01:22:38.485969+0000","last_active":"2024-09-16T01:22:39.469183+0000","last_peered":"2024-09-16T01:22:39.469183+0000","last_clean":"2024-09-16T01:22:39.469183+0000","last_became_active":"2024-09-16T01:22:38.485597+0000","last_became_peered":"2024-09-16T01:22:38.485597+0000","last_unstale":"2024-09-16T01:22:39.469183+0000","last_undegraded":"2024-09-16T01:22:39.469183+0000","last_fullsized":"2024-09-16T01:22:39.469183+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:01.009788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374204+0000","last_change":"2024-09-16T01:22:37.465487+0000","last_active":"2024-09-16T01:22:40.374204+0000","last_peered":"2024-09-16T01:22:40.374204+0000","last_clean":"2024-09-16T01:22:40.374204+0000","last_became_active":"2024-09-16T01:22:37.465154+0000","last_became_peered":"2024-09-16T01:22:37.465154+0000","last_unstale":"2024-09-16T01:22:40.374204+0000","last_undegraded":"2024-09-16T01:22:40.374204+0000","last_fullsized":"2024-09-16T01:22:40.374204+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:32.373786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374117+0000","last_change":"2024-09-16T01:22:38.487969+0000","last_active":"2024-09-16T01:22:40.374117+0000","last_peered":"2024-09-16T01:22:40.374117+0000","last_clean":"2024-09-16T01:22:40.374117+0000","last_became_active":"2024-09-16T01:22:38.487693+0000","last_became_peered":"2024-09-16T01:22:38.487693+0000","last_unstale":"2024-09-16T01:22:40.374117+0000","last_undegraded":"2024-09-16T01:22:40.374117+0000","last_fullsized":"2024-09-16T01:22:40.374117+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:34.773763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471476+0000","last_change":"2024-09-16T01:22:37.470174+0000","last_active":"2024-09-16T01:22:39.471476+0000","last_peered":"2024-09-16T01:22:39.471476+0000","last_clean":"2024-09-16T01:22:39.471476+0000","last_became_active":"2024-09-16T01:22:37.469905+0000","last_became_peered":"2024-09-16T01:22:37.469905+0000","last_unstale":"2024-09-16T01:22:39.471476+0000","last_undegraded":"2024-09-16T01:22:39.471476+0000","last_fullsized":"2024-09-16T01:22:39.471476+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:15.378906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374667+0000","last_change":"2024-09-16T01:22:38.491097+0000","last_active":"2024-09-16T01:22:40.374667+0000","last_peered":"2024-09-16T01:22:40.374667+0000","last_clean":"2024-09-16T01:22:40.374667+0000","last_became_active":"2024-09-16T01:22:38.487605+0000","last_became_peered":"2024-09-16T01:22:38.487605+0000","last_unstale":"2024-09-16T01:22:40.374667+0000","last_undegraded":"2024-09-16T01:22:40.374667+0000","last_fullsized":"2024-09-16T01:22:40.374667+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:13.770086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374555+0000","last_change":"2024-09-16T01:22:37.473265+0000","last_active":"2024-09-16T01:22:40.374555+0000","last_peered":"2024-09-16T01:22:40.374555+0000","last_clean":"2024-09-16T01:22:40.374555+0000","last_became_active":"2024-09-16T01:22:37.472881+0000","last_became_peered":"2024-09-16T01:22:37.472881+0000","last_unstale":"2024-09-16T01:22:40.374555+0000","last_undegraded":"2024-09-16T01:22:40.374555+0000","last_fullsized":"2024-09-16T01:22:40.374555+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:53.769794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374358+0000","last_change":"2024-09-16T01:22:38.484884+0000","last_active":"2024-09-16T01:22:40.374358+0000","last_peered":"2024-09-16T01:22:40.374358+0000","last_clean":"2024-09-16T01:22:40.374358+0000","last_became_active":"2024-09-16T01:22:38.484626+0000","last_became_peered":"2024-09-16T01:22:38.484626+0000","last_unstale":"2024-09-16T01:22:40.374358+0000","last_undegraded":"2024-09-16T01:22:40.374358+0000","last_fullsized":"2024-09-16T01:22:40.374358+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:02.834780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374070+0000","last_change":"2024-09-16T01:22:37.470596+0000","last_active":"2024-09-16T01:22:40.374070+0000","last_peered":"2024-09-16T01:22:40.374070+0000","last_clean":"2024-09-16T01:22:40.374070+0000","last_became_active":"2024-09-16T01:22:37.470270+0000","last_became_peered":"2024-09-16T01:22:37.470270+0000","last_unstale":"2024-09-16T01:22:40.374070+0000","last_undegraded":"2024-09-16T01:22:40.374070+0000","last_fullsized":"2024-09-16T01:22:40.374070+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:55.467052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374794+0000","last_change":"2024-09-16T01:22:38.493172+0000","last_active":"2024-09-16T01:22:40.374794+0000","last_peered":"2024-09-16T01:22:40.374794+0000","last_clean":"2024-09-16T01:22:40.374794+0000","last_became_active":"2024-09-16T01:22:38.492882+0000","last_became_peered":"2024-09-16T01:22:38.492882+0000","last_unstale":"2024-09-16T01:22:40.374794+0000","last_undegraded":"2024-09-16T01:22:40.374794+0000","last_fullsized":"2024-09-16T01:22:40.374794+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:50.172986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.873097+0000","last_change":"2024-09-16T01:22:37.467778+0000","last_active":"2024-09-16T01:22:39.873097+0000","last_peered":"2024-09-16T01:22:39.873097+0000","last_clean":"2024-09-16T01:22:39.873097+0000","last_became_active":"2024-09-16T01:22:37.467524+0000","last_became_peered":"2024-09-16T01:22:37.467524+0000","last_unstale":"2024-09-16T01:22:39.873097+0000","last_undegraded":"2024-09-16T01:22:39.873097+0000","last_fullsized":"2024-09-16T01:22:39.873097+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:57.246038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:39.471213+0000","last_change":"2024-09-16T01:22:38.484789+0000","last_active":"2024-09-16T01:22:39.471213+0000","last_peered":"2024-09-16T01:22:39.471213+0000","last_clean":"2024-09-16T01:22:39.471213+0000","last_became_active":"2024-09-16T01:22:38.484258+0000","last_became_peered":"2024-09-16T01:22:38.484258+0000","last_unstale":"2024-09-16T01:22:39.471213+0000","last_undegraded":"2024-09-16T01:22:39.471213+0000","last_fullsized":"2024-09-16T01:22:39.471213+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:37.449954+0000","last_clean_scrub_stamp":"2024-09-16T01:22:37.449954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:07.687743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374397+0000","last_change":"2024-09-16T01:22:37.474591+0000","last_active":"2024-09-16T01:22:40.374397+0000","last_peered":"2024-09-16T01:22:40.374397+0000","last_clean":"2024-09-16T01:22:40.374397+0000","last_became_active":"2024-09-16T01:22:37.474286+0000","last_became_peered":"2024-09-16T01:22:37.474286+0000","last_unstale":"2024-09-16T01:22:40.374397+0000","last_undegraded":"2024-09-16T01:22:40.374397+0000","last_fullsized":"2024-09-16T01:22:40.374397+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:22:36.445851+0000","last_clean_scrub_stamp":"2024-09-16T01:22:36.445851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:12.765983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":361,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-16T01:22:40.374288+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:22:40.374288+0000","last_peered":"2024-09-16T01:22:40.374288+0000","last_clean":"2024-09-16T01:22:40.374288+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:22:40.374288+0000","last_undegraded":"2024-09-16T01:22:40.374288+0000","last_fullsized":"2024-09-16T01:22:40.374288+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33312,"kb_used_data":2124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338528,"statfs":{"total":96636764160,"available":96602652672,"internally_reserved":0,"allocated":2174976,"data_stored":1313851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36888,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334952,"statfs":{"total":96636764160,"available":96598990848,"internally_reserved":0,"allocated":1572864,"data_stored":722453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1568768,"data_stored":721803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1564672,"data_stored":721781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1581056,"data_stored":723463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574939,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1572864,"data_stored":722397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1568768,"data_stored":721851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33304,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2166784,"data_stored":1312205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:22:46.122 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:22:46.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T01:22:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.264+0000 7f5199b8d640 1 Processor -- start 2024-09-16T01:22:46.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.264+0000 7f5199b8d640 1 -- start start 2024-09-16T01:22:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.264+0000 7f5199b8d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f51941621f0 0x7f519415fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.264+0000 7f5199b8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f51941625d0 0x7f51940d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.264+0000 7f5199b8d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51940d1040 con 0x7f51940d09c0 2024-09-16T01:22:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.264+0000 7f5199b8d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f51940702f0 con 0x7f51941625d0 2024-09-16T01:22:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.264+0000 7f5199b8d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f51940d1320 con 0x7f51941621f0 2024-09-16T01:22:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.264+0000 7f5192ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f51941625d0 0x7f51940d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.265+0000 7f5192ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f51941625d0 0x7f51940d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37364/0 (socket says 172.21.15.81:37364) 2024-09-16T01:22:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.265+0000 7f5193fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f51940d09c0 0x7f5194070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51502/0 (socket says 172.21.15.81:51502) 2024-09-16T01:22:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.265+0000 7f5192ffd640 1 -- 172.21.15.81:0/2692226208 learned_addr learned my addr 172.21.15.81:0/2692226208 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.265+0000 7f51937fe640 1 --2- 172.21.15.81:0/2692226208 >> v2:172.21.15.102:3300/0 conn(0x7f51941621f0 0x7f519415fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.265+0000 7f5192ffd640 1 -- 172.21.15.81:0/2692226208 >> v2:172.21.15.102:3300/0 conn(0x7f51941621f0 msgr2=0x7f519415fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.265+0000 7f5192ffd640 1 --2- 172.21.15.81:0/2692226208 >> v2:172.21.15.102:3300/0 conn(0x7f51941621f0 0x7f519415fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.265+0000 7f5192ffd640 1 -- 172.21.15.81:0/2692226208 >> v1:172.21.15.81:6789/0 conn(0x7f51940d09c0 legacy=0x7f5194070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.265+0000 7f51927fc640 1 -- 172.21.15.81:0/2692226208 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280697795 0 0) 0x7f51940d1040 con 0x7f51940d09c0 2024-09-16T01:22:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.265+0000 7f5192ffd640 1 -- 172.21.15.81:0/2692226208 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51940d1600 con 0x7f51941625d0 2024-09-16T01:22:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.266+0000 7f5192ffd640 1 --2- 172.21.15.81:0/2692226208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51941625d0 0x7f51940d0480 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f519406c9e0 tx=0x7f518802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c154f9105e197f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.266+0000 7f51927fc640 1 -- 172.21.15.81:0/2692226208 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5188037070 con 0x7f51941625d0 2024-09-16T01:22:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.266+0000 7f51927fc640 1 -- 172.21.15.81:0/2692226208 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f518802ae50 con 0x7f51941625d0 2024-09-16T01:22:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.266+0000 7f51927fc640 1 -- 172.21.15.81:0/2692226208 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5188032860 con 0x7f51941625d0 2024-09-16T01:22:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.266+0000 7f5199b8d640 1 -- 172.21.15.81:0/2692226208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51941625d0 msgr2=0x7f51940d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.266+0000 7f5199b8d640 1 --2- 172.21.15.81:0/2692226208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51941625d0 0x7f51940d0480 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f519406c9e0 tx=0x7f518802a300 comp rx=0 tx=0).stop 2024-09-16T01:22:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.266+0000 7f5199b8d640 1 -- 172.21.15.81:0/2692226208 shutdown_connections 2024-09-16T01:22:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.266+0000 7f5199b8d640 1 --2- 172.21.15.81:0/2692226208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51941625d0 0x7f51940d0480 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.266+0000 7f5199b8d640 1 --2- 172.21.15.81:0/2692226208 >> v2:172.21.15.102:3300/0 conn(0x7f51941621f0 0x7f519415fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.266+0000 7f5199b8d640 1 -- 172.21.15.81:0/2692226208 >> 172.21.15.81:0/2692226208 conn(0x7f51940b3de0 msgr2=0x7f51940b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.266+0000 7f5199b8d640 1 -- 172.21.15.81:0/2692226208 shutdown_connections 2024-09-16T01:22:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.266+0000 7f5199b8d640 1 -- 172.21.15.81:0/2692226208 wait complete. 2024-09-16T01:22:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.267+0000 7f5199b8d640 1 Processor -- start 2024-09-16T01:22:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.268+0000 7f5199b8d640 1 -- start start 2024-09-16T01:22:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.268+0000 7f5199b8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51940d09c0 0x7f5194161850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.268+0000 7f5199b8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51941621f0 0x7f519415b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.268+0000 7f5199b8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f51941625d0 0x7f519415be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.268+0000 7f5199b8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5194162a10 con 0x7f51940d09c0 2024-09-16T01:22:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.268+0000 7f5199b8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f519415f960 con 0x7f51941621f0 2024-09-16T01:22:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.268+0000 7f5199b8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5194160940 con 0x7f51941625d0 2024-09-16T01:22:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.268+0000 7f51937fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51940d09c0 0x7f5194161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.268+0000 7f51937fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51940d09c0 0x7f5194161850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37370/0 (socket says 172.21.15.81:37370) 2024-09-16T01:22:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.268+0000 7f51937fe640 1 -- 172.21.15.81:0/1732035550 learned_addr learned my addr 172.21.15.81:0/1732035550 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f5193fff640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f51941625d0 0x7f519415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f5192ffd640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51941621f0 0x7f519415b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f51937fe640 1 -- 172.21.15.81:0/1732035550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f51941625d0 msgr2=0x7f519415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f51937fe640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f51941625d0 0x7f519415be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f51937fe640 1 -- 172.21.15.81:0/1732035550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51941621f0 msgr2=0x7f519415b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f51937fe640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51941621f0 0x7f519415b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f51937fe640 1 -- 172.21.15.81:0/1732035550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f519415fd30 con 0x7f51940d09c0 2024-09-16T01:22:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f51937fe640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51940d09c0 0x7f5194161850 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f518400d800 tx=0x7f518400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f517bfff640 1 -- 172.21.15.81:0/1732035550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518400b6c0 con 0x7f51940d09c0 2024-09-16T01:22:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f517bfff640 1 -- 172.21.15.81:0/1732035550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5184019070 con 0x7f51940d09c0 2024-09-16T01:22:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f5199b8d640 1 -- 172.21.15.81:0/1732035550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5194160010 con 0x7f51940d09c0 2024-09-16T01:22:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f517bfff640 1 -- 172.21.15.81:0/1732035550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518400ba80 con 0x7f51940d09c0 2024-09-16T01:22:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.269+0000 7f5199b8d640 1 -- 172.21.15.81:0/1732035550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51941605d0 con 0x7f51940d09c0 2024-09-16T01:22:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.270+0000 7f5199b8d640 1 -- 172.21.15.81:0/1732035550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51940d1040 con 0x7f51940d09c0 2024-09-16T01:22:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.270+0000 7f517bfff640 1 -- 172.21.15.81:0/1732035550 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f518400bc20 con 0x7f51940d09c0 2024-09-16T01:22:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.271+0000 7f517bfff640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f518006c2b0 0x7f518006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.271+0000 7f517bfff640 1 -- 172.21.15.81:0/1732035550 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f518408bab0 con 0x7f51940d09c0 2024-09-16T01:22:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.271+0000 7f5192ffd640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f518006c2b0 0x7f518006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:46.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.271+0000 7f5192ffd640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f518006c2b0 0x7f518006e770 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5188034000 tx=0x7f518802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:46.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.275+0000 7f517bfff640 1 -- 172.21.15.81:0/1732035550 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f518405a0a0 con 0x7f51940d09c0 2024-09-16T01:22:46.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.511+0000 7f5199b8d640 1 -- 172.21.15.81:0/1732035550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f51940b4cf0 con 0x7f51940d09c0 2024-09-16T01:22:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.513+0000 7f517bfff640 1 -- 172.21.15.81:0/1732035550 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f51840599a0 con 0x7f51940d09c0 2024-09-16T01:22:46.514 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-16T01:22:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg== 2024-09-16T01:22:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-16T01:22:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-16T01:22:46.514 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T01:22:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-16T01:22:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.515+0000 7f5199b8d640 1 -- 172.21.15.81:0/1732035550 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f518006c2b0 msgr2=0x7f518006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.515+0000 7f5199b8d640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f518006c2b0 0x7f518006e770 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5188034000 tx=0x7f518802e000 comp rx=0 tx=0).stop 2024-09-16T01:22:46.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.515+0000 7f5199b8d640 1 -- 172.21.15.81:0/1732035550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51940d09c0 msgr2=0x7f5194161850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.515+0000 7f5199b8d640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51940d09c0 0x7f5194161850 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f518400d800 tx=0x7f518400dcc0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.515+0000 7f5199b8d640 1 -- 172.21.15.81:0/1732035550 shutdown_connections 2024-09-16T01:22:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.515+0000 7f5199b8d640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f518006c2b0 0x7f518006e770 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.515+0000 7f5199b8d640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f51941625d0 0x7f519415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.515+0000 7f5199b8d640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f51941621f0 0x7f519415b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.515+0000 7f5199b8d640 1 --2- 172.21.15.81:0/1732035550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51940d09c0 0x7f5194161850 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.515+0000 7f5199b8d640 1 -- 172.21.15.81:0/1732035550 >> 172.21.15.81:0/1732035550 conn(0x7f51940b3de0 msgr2=0x7f519415e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.516+0000 7f5199b8d640 1 -- 172.21.15.81:0/1732035550 shutdown_connections 2024-09-16T01:22:46.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.516+0000 7f5199b8d640 1 -- 172.21.15.81:0/1732035550 wait complete. 2024-09-16T01:22:46.527 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:46.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.624+0000 7fa4c4623640 1 Processor -- start 2024-09-16T01:22:46.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.624+0000 7fa4c4623640 1 -- start start 2024-09-16T01:22:46.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.625+0000 7fa4c4623640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa4bc15e740 0x7fa4bc0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.625+0000 7fa4c4623640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4bc06dbd0 0x7fa4bc06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.625+0000 7fa4c4623640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4bc06e000 con 0x7fa4bc09b690 2024-09-16T01:22:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.625+0000 7fa4c4623640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa4bc15eb20 con 0x7fa4bc15e740 2024-09-16T01:22:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.625+0000 7fa4c4623640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa4bc06d260 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.625+0000 7fa4c23bf640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa4bc15e740 0x7fa4bc0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.625+0000 7fa4c2bc0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4bc06dbd0 0x7fa4bc06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.625+0000 7fa4c23bf640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa4bc15e740 0x7fa4bc0d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:46768/0 (socket says 172.21.15.81:46768) 2024-09-16T01:22:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.625+0000 7fa4c2bc0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4bc06dbd0 0x7fa4bc06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:55818/0 (socket says 172.21.15.81:55818) 2024-09-16T01:22:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.626+0000 7fa4c23bf640 1 -- 172.21.15.81:0/2535166119 learned_addr learned my addr 172.21.15.81:0/2535166119 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.626+0000 7fa4c23bf640 1 -- 172.21.15.81:0/2535166119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4bc06dbd0 msgr2=0x7fa4bc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.626+0000 7fa4c23bf640 1 --2- 172.21.15.81:0/2535166119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4bc06dbd0 0x7fa4bc06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.626+0000 7fa4c23bf640 1 -- 172.21.15.81:0/2535166119 >> v1:172.21.15.102:6789/0 conn(0x7fa4bc09b690 legacy=0x7fa4bc06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.626+0000 7fa4c23bf640 1 -- 172.21.15.81:0/2535166119 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4bc0d0780 con 0x7fa4bc15e740 2024-09-16T01:22:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.627+0000 7fa4c23bf640 1 --2- 172.21.15.81:0/2535166119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4bc15e740 0x7fa4bc0d1540 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009870 tx=0x7fa4b802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44cf98329ee52347 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.627+0000 7fa4c13bd640 1 -- 172.21.15.81:0/2535166119 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8037070 con 0x7fa4bc15e740 2024-09-16T01:22:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.627+0000 7fa4c13bd640 1 -- 172.21.15.81:0/2535166119 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b802ae50 con 0x7fa4bc15e740 2024-09-16T01:22:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.627+0000 7fa4c13bd640 1 -- 172.21.15.81:0/2535166119 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8032860 con 0x7fa4bc15e740 2024-09-16T01:22:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.627+0000 7fa4c4623640 1 -- 172.21.15.81:0/2535166119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4bc15e740 msgr2=0x7fa4bc0d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.627+0000 7fa4c4623640 1 --2- 172.21.15.81:0/2535166119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4bc15e740 0x7fa4bc0d1540 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009870 tx=0x7fa4b802a300 comp rx=0 tx=0).stop 2024-09-16T01:22:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.627+0000 7fa4c4623640 1 -- 172.21.15.81:0/2535166119 shutdown_connections 2024-09-16T01:22:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.627+0000 7fa4c4623640 1 --2- 172.21.15.81:0/2535166119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4bc06dbd0 0x7fa4bc06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.627+0000 7fa4c4623640 1 --2- 172.21.15.81:0/2535166119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4bc15e740 0x7fa4bc0d1540 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.627+0000 7fa4c4623640 1 -- 172.21.15.81:0/2535166119 >> 172.21.15.81:0/2535166119 conn(0x7fa4bc0d23a0 msgr2=0x7fa4bc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.627+0000 7fa4c4623640 1 -- 172.21.15.81:0/2535166119 shutdown_connections 2024-09-16T01:22:46.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.627+0000 7fa4c4623640 1 -- 172.21.15.81:0/2535166119 wait complete. 2024-09-16T01:22:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.629+0000 7fa4c4623640 1 Processor -- start 2024-09-16T01:22:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.629+0000 7fa4c4623640 1 -- start start 2024-09-16T01:22:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.629+0000 7fa4c4623640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dbd0 0x7fa4bc0ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.629+0000 7fa4c4623640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4bc09b690 0x7fa4bc0b7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.629+0000 7fa4c4623640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4bc15e740 0x7fa4bc15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.629+0000 7fa4c4623640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc0d1020 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.629+0000 7fa4c4623640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc0d0d40 con 0x7fa4bc09b690 2024-09-16T01:22:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.629+0000 7fa4c4623640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa4bc09bac0 con 0x7fa4bc15e740 2024-09-16T01:22:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.629+0000 7fa4c23bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dbd0 0x7fa4bc0ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c23bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dbd0 0x7fa4bc0ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37378/0 (socket says 172.21.15.81:37378) 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c23bf640 1 -- 172.21.15.81:0/1589397821 learned_addr learned my addr 172.21.15.81:0/1589397821 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c1bbe640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4bc09b690 0x7fa4bc0b7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c2bc0640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4bc15e740 0x7fa4bc15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c23bf640 1 -- 172.21.15.81:0/1589397821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4bc15e740 msgr2=0x7fa4bc15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c23bf640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4bc15e740 0x7fa4bc15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c23bf640 1 -- 172.21.15.81:0/1589397821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4bc09b690 msgr2=0x7fa4bc0b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c23bf640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4bc09b690 0x7fa4bc0b7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c23bf640 1 -- 172.21.15.81:0/1589397821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4bc0caf20 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c1bbe640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4bc09b690 0x7fa4bc0b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c2bc0640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4bc15e740 0x7fa4bc15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c23bf640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dbd0 0x7fa4bc0ca9e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8000c00 tx=0x7fa4b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4b2ffd640 1 -- 172.21.15.81:0/1589397821 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8041070 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4b2ffd640 1 -- 172.21.15.81:0/1589397821 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b803c660 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4b2ffd640 1 -- 172.21.15.81:0/1589397821 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8037040 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c4623640 1 -- 172.21.15.81:0/1589397821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4bc0c9940 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.630+0000 7fa4c4623640 1 -- 172.21.15.81:0/1589397821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4bc0c9f00 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.631+0000 7fa4c4623640 1 -- 172.21.15.81:0/1589397821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4bc06cd20 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.632+0000 7fa4b2ffd640 1 -- 172.21.15.81:0/1589397821 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa4b8044070 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.632+0000 7fa4b2ffd640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa4a006c2e0 0x7fa4a006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.632+0000 7fa4b2ffd640 1 -- 172.21.15.81:0/1589397821 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fa4b80abcf0 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.632+0000 7fa4c1bbe640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa4a006c2e0 0x7fa4a006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:46.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.632+0000 7fa4c1bbe640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa4a006c2e0 0x7fa4a006e7a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0015e0 tx=0x7fa4ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:46.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.636+0000 7fa4b2ffd640 1 -- 172.21.15.81:0/1589397821 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4b80b0070 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.835+0000 7fa4c4623640 1 -- 172.21.15.81:0/1589397821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4bc0d1cb0 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.835+0000 7fa4b2ffd640 1 -- 172.21.15.81:0/1589397821 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7fa4bc0caf20 con 0x7fa4bc06dbd0 2024-09-16T01:22:46.837 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:46.837 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"btime":"2024-09-16T01:22:40:479014+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3471922615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3471922615},{"type":"v1","addr":"172.21.15.102:6834","nonce":3471922615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6697,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/749780612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":749780612},{"type":"v1","addr":"172.21.15.81:6837","nonce":749780612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2257484883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":2257484883},{"type":"v1","addr":"172.21.15.102:6835","nonce":2257484883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:37.794648+0000","modified":"2024-09-16T01:22:39.814024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7674},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7674":{"gid":7674,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2398957156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2398957156},{"type":"v1","addr":"172.21.15.81:6835","nonce":2398957156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7674,"qdb_cluster":[7674]},"id":9}]} 2024-09-16T01:22:46.837 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2024-09-16T01:22:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.837+0000 7fa4c4623640 1 -- 172.21.15.81:0/1589397821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa4a006c2e0 msgr2=0x7fa4a006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.837+0000 7fa4c4623640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa4a006c2e0 0x7fa4a006e7a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0015e0 tx=0x7fa4ac009040 comp rx=0 tx=0).stop 2024-09-16T01:22:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.837+0000 7fa4c4623640 1 -- 172.21.15.81:0/1589397821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dbd0 msgr2=0x7fa4bc0ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.837+0000 7fa4c4623640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dbd0 0x7fa4bc0ca9e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8000c00 tx=0x7fa4b80046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.837+0000 7fa4c4623640 1 -- 172.21.15.81:0/1589397821 shutdown_connections 2024-09-16T01:22:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.838+0000 7fa4c4623640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa4a006c2e0 0x7fa4a006e7a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.838+0000 7fa4c4623640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4bc15e740 0x7fa4bc15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.838+0000 7fa4c4623640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4bc09b690 0x7fa4bc0b7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.838+0000 7fa4c4623640 1 --2- 172.21.15.81:0/1589397821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4bc06dbd0 0x7fa4bc0ca9e0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.838+0000 7fa4c4623640 1 -- 172.21.15.81:0/1589397821 >> 172.21.15.81:0/1589397821 conn(0x7fa4bc0d23a0 msgr2=0x7fa4bc0b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.838+0000 7fa4c4623640 1 -- 172.21.15.81:0/1589397821 shutdown_connections 2024-09-16T01:22:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:46.838+0000 7fa4c4623640 1 -- 172.21.15.81:0/1589397821 wait complete. 2024-09-16T01:22:47.252 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:22:37.794648+0000', 'modified': '2024-09-16T01:22:39.814024+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7674}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7674': {'gid': 7674, 'name': 'c', 'rank': 0, 'incarnation': 64, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/2398957156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 2398957156}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 2398957156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7674, 'qdb_cluster': [7674]} 2024-09-16T01:22:47.252 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:22:47.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-16T01:22:47.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.353+0000 7ff051552640 1 Processor -- start 2024-09-16T01:22:47.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.353+0000 7ff051552640 1 -- start start 2024-09-16T01:22:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff051552640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff04c161c80 0x7ff04c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff051552640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff04c162060 0x7ff04c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff051552640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff04c06e870 con 0x7ff04c0b64b0 2024-09-16T01:22:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff051552640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff04c06d9f0 con 0x7ff04c162060 2024-09-16T01:22:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff051552640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff04c06dcd0 con 0x7ff04c161c80 2024-09-16T01:22:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff0427fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff04c162060 0x7ff04c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff0427fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff04c162060 0x7ff04c0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37386/0 (socket says 172.21.15.81:37386) 2024-09-16T01:22:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff0427fc640 1 -- 172.21.15.81:0/2640993798 learned_addr learned my addr 172.21.15.81:0/2640993798 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff04affd640 1 --2- 172.21.15.81:0/2640993798 >> v2:172.21.15.102:3300/0 conn(0x7ff04c161c80 0x7ff04c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff0427fc640 1 -- 172.21.15.81:0/2640993798 >> v2:172.21.15.102:3300/0 conn(0x7ff04c161c80 msgr2=0x7ff04c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff0427fc640 1 --2- 172.21.15.81:0/2640993798 >> v2:172.21.15.102:3300/0 conn(0x7ff04c161c80 0x7ff04c06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff0427fc640 1 -- 172.21.15.81:0/2640993798 >> v1:172.21.15.102:6789/0 conn(0x7ff04c0b64b0 legacy=0x7ff04c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff0427fc640 1 -- 172.21.15.81:0/2640993798 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c06dfb0 con 0x7ff04c162060 2024-09-16T01:22:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.354+0000 7ff04affd640 1 --2- 172.21.15.81:0/2640993798 >> v2:172.21.15.102:3300/0 conn(0x7ff04c161c80 0x7ff04c06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.355+0000 7ff0427fc640 1 --2- 172.21.15.81:0/2640993798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04c162060 0x7ff04c0b5f70 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7ff04c08d7a0 tx=0x7ff03402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde8c1ad806694a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.355+0000 7ff04a7fc640 1 -- 172.21.15.81:0/2640993798 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034037070 con 0x7ff04c162060 2024-09-16T01:22:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.355+0000 7ff04a7fc640 1 -- 172.21.15.81:0/2640993798 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff034032440 con 0x7ff04c162060 2024-09-16T01:22:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.355+0000 7ff04a7fc640 1 -- 172.21.15.81:0/2640993798 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034032810 con 0x7ff04c162060 2024-09-16T01:22:47.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.355+0000 7ff051552640 1 -- 172.21.15.81:0/2640993798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04c162060 msgr2=0x7ff04c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.355+0000 7ff051552640 1 --2- 172.21.15.81:0/2640993798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04c162060 0x7ff04c0b5f70 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7ff04c08d7a0 tx=0x7ff03402a230 comp rx=0 tx=0).stop 2024-09-16T01:22:47.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.355+0000 7ff051552640 1 -- 172.21.15.81:0/2640993798 shutdown_connections 2024-09-16T01:22:47.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.355+0000 7ff051552640 1 --2- 172.21.15.81:0/2640993798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04c162060 0x7ff04c0b5f70 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.355+0000 7ff051552640 1 --2- 172.21.15.81:0/2640993798 >> v2:172.21.15.102:3300/0 conn(0x7ff04c161c80 0x7ff04c06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.355+0000 7ff051552640 1 -- 172.21.15.81:0/2640993798 >> 172.21.15.81:0/2640993798 conn(0x7ff04c0d44f0 msgr2=0x7ff04c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.356+0000 7ff051552640 1 -- 172.21.15.81:0/2640993798 shutdown_connections 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.356+0000 7ff051552640 1 -- 172.21.15.81:0/2640993798 wait complete. 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.357+0000 7ff051552640 1 Processor -- start 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.357+0000 7ff051552640 1 -- start start 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.357+0000 7ff051552640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04c0b64b0 0x7ff04c0b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.357+0000 7ff051552640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff04c161c80 0x7ff04c1567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff051552640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff04c162060 0x7ff04c0b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff051552640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c0d2a10 con 0x7ff04c0b64b0 2024-09-16T01:22:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff051552640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c0d2890 con 0x7ff04c162060 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff051552640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff04c0b6960 con 0x7ff04c161c80 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff04affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04c0b64b0 0x7ff04c0b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff04affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04c0b64b0 0x7ff04c0b7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37394/0 (socket says 172.21.15.81:37394) 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff04affd640 1 -- 172.21.15.81:0/732755690 learned_addr learned my addr 172.21.15.81:0/732755690 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff0427fc640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff04c161c80 0x7ff04c1567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff04b7fe640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff04c162060 0x7ff04c0b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff04affd640 1 -- 172.21.15.81:0/732755690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff04c161c80 msgr2=0x7ff04c1567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff04affd640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff04c161c80 0x7ff04c1567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff04affd640 1 -- 172.21.15.81:0/732755690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff04c162060 msgr2=0x7ff04c0b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff04affd640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff04c162060 0x7ff04c0b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff04affd640 1 -- 172.21.15.81:0/732755690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04c156d30 con 0x7ff04c0b64b0 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff04b7fe640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff04c162060 0x7ff04c0b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff04affd640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04c0b64b0 0x7ff04c0b7c70 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00e7e0 tx=0x7ff03c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff043fff640 1 -- 172.21.15.81:0/732755690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00f040 con 0x7ff04c0b64b0 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff043fff640 1 -- 172.21.15.81:0/732755690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03c004030 con 0x7ff04c0b64b0 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff043fff640 1 -- 172.21.15.81:0/732755690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c004400 con 0x7ff04c0b64b0 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff051552640 1 -- 172.21.15.81:0/732755690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04c0b9270 con 0x7ff04c0b64b0 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.358+0000 7ff051552640 1 -- 172.21.15.81:0/732755690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04c0b7470 con 0x7ff04c0b64b0 2024-09-16T01:22:47.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.360+0000 7ff043fff640 1 -- 172.21.15.81:0/732755690 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff03c00c6d0 con 0x7ff04c0b64b0 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.360+0000 7ff043fff640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff02c06c2b0 0x7ff02c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.360+0000 7ff043fff640 1 -- 172.21.15.81:0/732755690 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7ff03c08b2d0 con 0x7ff04c0b64b0 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.360+0000 7ff0427fc640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff02c06c2b0 0x7ff02c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.361+0000 7ff0427fc640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff02c06c2b0 0x7ff02c06e770 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff034034000 tx=0x7ff03402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.361+0000 7ff0543cd740 1 Processor -- start 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.361+0000 7ff0543cd740 1 -- start start 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff0543cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a052c0 0x55bac8a4aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff0543cd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a02a80 0x55bac8a056a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff0543cd740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a06a50 0x55bac89ff8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff0543cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bac8967520 con 0x55bac8a052c0 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff0543cd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bac890f3e0 con 0x55bac8a02a80 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff0543cd740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55bac89634e0 con 0x55bac8a06a50 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff04affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a052c0 0x55bac8a4aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff04affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a052c0 0x55bac8a4aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37402/0 (socket says 172.21.15.81:37402) 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff04affd640 1 -- 172.21.15.81:0/326912434 learned_addr learned my addr 172.21.15.81:0/326912434 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff0427fc640 1 --2- 172.21.15.81:0/326912434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a02a80 0x55bac8a056a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff04b7fe640 1 --2- 172.21.15.81:0/326912434 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a06a50 0x55bac89ff8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff04affd640 1 -- 172.21.15.81:0/326912434 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a06a50 msgr2=0x55bac89ff8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff04affd640 1 --2- 172.21.15.81:0/326912434 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a06a50 0x55bac89ff8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff04affd640 1 -- 172.21.15.81:0/326912434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a02a80 msgr2=0x55bac8a056a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff04affd640 1 --2- 172.21.15.81:0/326912434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a02a80 0x55bac8a056a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff04affd640 1 -- 172.21.15.81:0/326912434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac892a2f0 con 0x55bac8a052c0 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.362+0000 7ff04b7fe640 1 --2- 172.21.15.81:0/326912434 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a06a50 0x55bac89ff8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.363+0000 7ff04affd640 1 --2- 172.21.15.81:0/326912434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a052c0 0x55bac8a4aa60 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ff03c089640 tx=0x7ff03c059300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2241bd020ab94f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.363+0000 7ff040ff9640 1 -- 172.21.15.81:0/326912434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c020040 con 0x55bac8a052c0 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.363+0000 7ff040ff9640 1 -- 172.21.15.81:0/326912434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03c0572e0 con 0x55bac8a052c0 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.363+0000 7ff040ff9640 1 -- 172.21.15.81:0/326912434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03c071170 con 0x55bac8a052c0 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.363+0000 7ff0543cd740 1 -- 172.21.15.81:0/326912434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a052c0 msgr2=0x55bac8a4aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.363+0000 7ff0543cd740 1 --2- 172.21.15.81:0/326912434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a052c0 0x55bac8a4aa60 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7ff03c089640 tx=0x7ff03c059300 comp rx=0 tx=0).stop 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.363+0000 7ff0543cd740 1 -- 172.21.15.81:0/326912434 shutdown_connections 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.363+0000 7ff0543cd740 1 --2- 172.21.15.81:0/326912434 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a06a50 0x55bac89ff8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.363+0000 7ff0543cd740 1 --2- 172.21.15.81:0/326912434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a02a80 0x55bac8a056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.363+0000 7ff0543cd740 1 --2- 172.21.15.81:0/326912434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a052c0 0x55bac8a4aa60 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.363+0000 7ff0543cd740 1 -- 172.21.15.81:0/326912434 >> 172.21.15.81:0/326912434 conn(0x55bac8a01a80 msgr2=0x55bac8a49f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.364+0000 7ff0543cd740 1 -- 172.21.15.81:0/326912434 shutdown_connections 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.364+0000 7ff0543cd740 1 -- 172.21.15.81:0/326912434 wait complete. 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.364+0000 7ff0543cd740 1 -- start start 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.364+0000 7ff0543cd740 1 Processor -- start 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0543cd740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a052c0 0x55bac8a275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0543cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8a5aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0543cd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a5af80 0x55bac89fe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0543cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bac8a00f20 con 0x55bac8a06a50 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0543cd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bac88f0450 con 0x55bac8a5af80 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0543cd740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55bac8a4b290 con 0x55bac8a052c0 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0543cd740 10 client.0 _ll_register_callbacks cb 0x55bac8679ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:22:47.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8a5aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8a5aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37418/0 (socket says 172.21.15.81:37418) 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0427fc640 1 -- 172.21.15.81:0/1049047060 learned_addr learned my addr 172.21.15.81:0/1049047060 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff04affd640 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a052c0 0x55bac8a275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff04b7fe640 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a5af80 0x55bac89fe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0427fc640 1 -- 172.21.15.81:0/1049047060 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a052c0 msgr2=0x55bac8a275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0427fc640 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a052c0 0x55bac8a275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0427fc640 1 -- 172.21.15.81:0/1049047060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a5af80 msgr2=0x55bac89fe7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0427fc640 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a5af80 0x55bac89fe7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0427fc640 1 -- 172.21.15.81:0/1049047060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bac867a2d0 con 0x55bac8a06a50 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff04b7fe640 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a5af80 0x55bac89fe7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff04affd640 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a052c0 0x55bac8a275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff0427fc640 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8a5aa40 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7ff034009960 tx=0x7ff03402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf7f815e3a1a9c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.365+0000 7ff029ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff029ffb640 1 -- 172.21.15.81:0/1049047060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034050060 con 0x55bac8a06a50 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff0543cd740 1 -- 172.21.15.81:0/1049047060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff03c0572e0 con 0x55bac8a06a50 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff029ffb640 1 -- 172.21.15.81:0/1049047060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7ff03403ed40 con 0x55bac8a06a50 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff029ffb640 1 -- 172.21.15.81:0/1049047060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7ff034056050 con 0x55bac8a06a50 2024-09-16T01:22:47.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff0543cd740 10 client.7824 fetch_fsmap learned FSMap version 66 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff0543cd740 1 -- 172.21.15.81:0/1049047060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55bac87446b0 con 0x55bac8a06a50 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff029ffb640 1 -- 172.21.15.81:0/1049047060 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03c0572e0 con 0x55bac8a06a50 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff029ffb640 1 -- 172.21.15.81:0/1049047060 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) ==== 3502+0+0 (secure 0 0 0) 0x7ff034059020 con 0x55bac8a06a50 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff0543cd740 10 client.7824 fetch_fsmap finished waiting for FSMap version 66 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff0543cd740 10 client.7824 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff0543cd740 20 client.7824 populate_metadata read hostname 'smithi081' 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff0543cd740 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.81:6834/2398957156,v1:172.21.15.81:6835/2398957156] conn(0x55bac8a5e1d0 0x55bac89ff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff0543cd740 4 client.7824 mds_command: new command op to 7674 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff0543cd740 1 -- 172.21.15.81:0/1049047060 --> [v2:172.21.15.81:6834/2398957156,v1:172.21.15.81:6835/2398957156] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bac8974c50 con 0x55bac8a5e1d0 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff04affd640 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.81:6834/2398957156,v1:172.21.15.81:6835/2398957156] conn(0x55bac8a5e1d0 0x55bac89ff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff029ffb640 10 client.7824 ms_handle_connect on v2:172.21.15.81:6834/2398957156 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.366+0000 7ff04affd640 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.81:6834/2398957156,v1:172.21.15.81:6835/2398957156] conn(0x55bac8a5e1d0 0x55bac89ff4f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bbeb18779fa028e server_cookie=7704476897c8e008 in_seq=0 out_seq=0 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff029ffb640 1 -- 172.21.15.81:0/1049047060 <== mds.0 v2:172.21.15.81:6834/2398957156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bac8974c50 con 0x55bac8a5e1d0 2024-09-16T01:22:47.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff029ffb640 10 client.7824 handle_command_reply: tid=0 2024-09-16T01:22:47.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff0543cd740 1 client.7824 shutdown 2024-09-16T01:22:47.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff0543cd740 1 -- 172.21.15.81:0/1049047060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 msgr2=0x55bac8a5aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff0543cd740 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8a5aa40 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7ff034009960 tx=0x7ff03402c000 comp rx=0 tx=0).stop 2024-09-16T01:22:47.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff0543cd740 1 -- 172.21.15.81:0/1049047060 shutdown_connections 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff0543cd740 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.81:6834/2398957156,v1:172.21.15.81:6835/2398957156] conn(0x55bac8a5e1d0 0x55bac89ff4f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff0543cd740 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a5af80 0x55bac89fe7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff0543cd740 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8a5aa40 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff029ffb640 0 client.7824 ms_handle_reset on v2:172.21.15.81:6834/2398957156 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff0543cd740 1 --2- 172.21.15.81:0/1049047060 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a052c0 0x55bac8a275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff0543cd740 1 -- 172.21.15.81:0/1049047060 >> 172.21.15.81:0/1049047060 conn(0x55bac8a02a80 msgr2=0x55bac8a03020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff0543cd740 1 -- 172.21.15.81:0/1049047060 shutdown_connections 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff0543cd740 1 -- 172.21.15.81:0/1049047060 wait complete. 2024-09-16T01:22:47.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.367+0000 7ff0543cd740 20 client.7824 trim_cache size 0 max 16384 2024-09-16T01:22:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.385+0000 7ff0543cd740 1 Processor -- start 2024-09-16T01:22:47.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.385+0000 7ff0543cd740 1 -- start start 2024-09-16T01:22:47.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0543cd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a052c0 0x55bac8a2bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0543cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8a6f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0543cd740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a5af80 0x55bac8ac2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0543cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c200150 con 0x55bac8a06a50 2024-09-16T01:22:47.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0543cd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff04c0c8ca0 con 0x55bac8a052c0 2024-09-16T01:22:47.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0543cd740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff04c0cc1d0 con 0x55bac8a5af80 2024-09-16T01:22:47.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8a6f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8a6f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37432/0 (socket says 172.21.15.81:37432) 2024-09-16T01:22:47.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0427fc640 1 -- 172.21.15.81:0/2653045164 learned_addr learned my addr 172.21.15.81:0/2653045164 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:47.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff04affd640 1 --2- 172.21.15.81:0/2653045164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a052c0 0x55bac8a2bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff04b7fe640 1 --2- 172.21.15.81:0/2653045164 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a5af80 0x55bac8ac2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0427fc640 1 -- 172.21.15.81:0/2653045164 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a5af80 msgr2=0x55bac8ac2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0427fc640 1 --2- 172.21.15.81:0/2653045164 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a5af80 0x55bac8ac2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0427fc640 1 -- 172.21.15.81:0/2653045164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a052c0 msgr2=0x55bac8a2bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0427fc640 1 --2- 172.21.15.81:0/2653045164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a052c0 0x55bac8a2bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0427fc640 1 -- 172.21.15.81:0/2653045164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bac8a00860 con 0x55bac8a06a50 2024-09-16T01:22:47.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff04affd640 1 --2- 172.21.15.81:0/2653045164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a052c0 0x55bac8a2bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:47.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff0427fc640 1 --2- 172.21.15.81:0/2653045164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8a6f280 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff034009630 tx=0x7ff034009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29600eb81d4d16ed server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff02bfff640 1 -- 172.21.15.81:0/2653045164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034037040 con 0x55bac8a06a50 2024-09-16T01:22:47.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff02bfff640 1 -- 172.21.15.81:0/2653045164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03403eb40 con 0x55bac8a06a50 2024-09-16T01:22:47.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.386+0000 7ff02bfff640 1 -- 172.21.15.81:0/2653045164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03404b710 con 0x55bac8a06a50 2024-09-16T01:22:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.387+0000 7ff0543cd740 1 -- 172.21.15.81:0/2653045164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 msgr2=0x55bac8a6f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.387+0000 7ff0543cd740 1 --2- 172.21.15.81:0/2653045164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8a6f280 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7ff034009630 tx=0x7ff034009240 comp rx=0 tx=0).stop 2024-09-16T01:22:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.387+0000 7ff0543cd740 1 -- 172.21.15.81:0/2653045164 shutdown_connections 2024-09-16T01:22:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.387+0000 7ff0543cd740 1 --2- 172.21.15.81:0/2653045164 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a5af80 0x55bac8ac2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.387+0000 7ff0543cd740 1 --2- 172.21.15.81:0/2653045164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8a6f280 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.387+0000 7ff0543cd740 1 --2- 172.21.15.81:0/2653045164 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a052c0 0x55bac8a2bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.387+0000 7ff0543cd740 1 -- 172.21.15.81:0/2653045164 >> 172.21.15.81:0/2653045164 conn(0x55bac8a02a80 msgr2=0x55bac8a2b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.387+0000 7ff0543cd740 1 -- 172.21.15.81:0/2653045164 shutdown_connections 2024-09-16T01:22:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.387+0000 7ff0543cd740 1 -- 172.21.15.81:0/2653045164 wait complete. 2024-09-16T01:22:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.388+0000 7ff0543cd740 1 -- start start 2024-09-16T01:22:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.388+0000 7ff0543cd740 1 Processor -- start 2024-09-16T01:22:47.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.388+0000 7ff0543cd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a052c0 0x55bac8a22f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.388+0000 7ff0543cd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8ab19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.388+0000 7ff0543cd740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a5af80 0x55bac8a6f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.388+0000 7ff0543cd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55bac8a5e050 con 0x55bac8a06a50 2024-09-16T01:22:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.388+0000 7ff0543cd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bac8a5dc00 con 0x55bac8a052c0 2024-09-16T01:22:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.388+0000 7ff0543cd740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55bac8a2f400 con 0x55bac8a5af80 2024-09-16T01:22:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.388+0000 7ff0543cd740 10 client.0 _ll_register_callbacks cb 0x7ff0340096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:22:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.388+0000 7ff0427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8ab19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff0427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8ab19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37444/0 (socket says 172.21.15.81:37444) 2024-09-16T01:22:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff0427fc640 1 -- 172.21.15.81:0/2928566966 learned_addr learned my addr 172.21.15.81:0/2928566966 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:47.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff04affd640 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a052c0 0x55bac8a22f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff04b7fe640 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a5af80 0x55bac8a6f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff0427fc640 1 -- 172.21.15.81:0/2928566966 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a5af80 msgr2=0x55bac8a6f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff0427fc640 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a5af80 0x55bac8a6f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff0427fc640 1 -- 172.21.15.81:0/2928566966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a052c0 msgr2=0x55bac8a22f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff0427fc640 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a052c0 0x55bac8a22f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff0427fc640 1 -- 172.21.15.81:0/2928566966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bac8a5ab50 con 0x55bac8a06a50 2024-09-16T01:22:47.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff04affd640 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a052c0 0x55bac8a22f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:47.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff0427fc640 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8ab19a0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7ff03402a820 tx=0x7ff03402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b66af84f7812fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff029ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:22:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff029ffb640 1 -- 172.21.15.81:0/2928566966 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034037070 con 0x55bac8a06a50 2024-09-16T01:22:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff029ffb640 1 -- 172.21.15.81:0/2928566966 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7ff03403c430 con 0x55bac8a06a50 2024-09-16T01:22:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff0543cd740 1 -- 172.21.15.81:0/2928566966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff03403eb40 con 0x55bac8a06a50 2024-09-16T01:22:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff029ffb640 1 -- 172.21.15.81:0/2928566966 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7ff034065050 con 0x55bac8a06a50 2024-09-16T01:22:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff0543cd740 10 client.7830 fetch_fsmap learned FSMap version 66 2024-09-16T01:22:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff0543cd740 1 -- 172.21.15.81:0/2928566966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55bac8a47fb0 con 0x55bac8a06a50 2024-09-16T01:22:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff029ffb640 1 -- 172.21.15.81:0/2928566966 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03403eb40 con 0x55bac8a06a50 2024-09-16T01:22:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff029ffb640 1 -- 172.21.15.81:0/2928566966 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 66) ==== 3502+0+0 (secure 0 0 0) 0x7ff034068020 con 0x55bac8a06a50 2024-09-16T01:22:47.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.389+0000 7ff0543cd740 10 client.7830 fetch_fsmap finished waiting for FSMap version 66 2024-09-16T01:22:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 10 client.7830 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-16T01:22:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 20 client.7830 populate_metadata read hostname 'smithi081' 2024-09-16T01:22:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.81:6834/2398957156,v1:172.21.15.81:6835/2398957156] conn(0x55bac8a250f0 0x55bac8ac8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 4 client.7830 mds_command: new command op to 7674 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:22:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 -- 172.21.15.81:0/2928566966 --> [v2:172.21.15.81:6834/2398957156,v1:172.21.15.81:6835/2398957156] -- command(tid 0: {"prefix": "status"}) -- 0x55bac8a260d0 con 0x55bac8a250f0 2024-09-16T01:22:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff04affd640 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.81:6834/2398957156,v1:172.21.15.81:6835/2398957156] conn(0x55bac8a250f0 0x55bac8ac8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff029ffb640 10 client.7830 ms_handle_connect on v2:172.21.15.81:6834/2398957156 2024-09-16T01:22:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff04affd640 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.81:6834/2398957156,v1:172.21.15.81:6835/2398957156] conn(0x55bac8a250f0 0x55bac8ac8c50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7e26f4ca66baf22 server_cookie=d61d4184dcff6b90 in_seq=0 out_seq=0 2024-09-16T01:22:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff029ffb640 1 -- 172.21.15.81:0/2928566966 <== mds.0 v2:172.21.15.81:6834/2398957156 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bac8a260d0 con 0x55bac8a250f0 2024-09-16T01:22:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff029ffb640 10 client.7830 handle_command_reply: tid=0 2024-09-16T01:22:47.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 client.7830 shutdown 2024-09-16T01:22:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 -- 172.21.15.81:0/2928566966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 msgr2=0x55bac8ab19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8ab19a0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7ff03402a820 tx=0x7ff03402c070 comp rx=0 tx=0).stop 2024-09-16T01:22:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 -- 172.21.15.81:0/2928566966 shutdown_connections 2024-09-16T01:22:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.81:6834/2398957156,v1:172.21.15.81:6835/2398957156] conn(0x55bac8a250f0 0x55bac8ac8c50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55bac8a5af80 0x55bac8a6f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bac8a06a50 0x55bac8ab19a0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 --2- 172.21.15.81:0/2928566966 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bac8a052c0 0x55bac8a22f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff029ffb640 0 client.7830 ms_handle_reset on v2:172.21.15.81:6834/2398957156 2024-09-16T01:22:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 -- 172.21.15.81:0/2928566966 >> 172.21.15.81:0/2928566966 conn(0x55bac8a02a80 msgr2=0x55bac8a4bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 -- 172.21.15.81:0/2928566966 shutdown_connections 2024-09-16T01:22:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 1 -- 172.21.15.81:0/2928566966 wait complete. 2024-09-16T01:22:47.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.390+0000 7ff0543cd740 20 client.7830 trim_cache size 0 max 16384 2024-09-16T01:22:47.406 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:22:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973", 2024-09-16T01:22:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-16T01:22:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7674, 2024-09-16T01:22:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-16T01:22:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-16T01:22:47.406 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-16T01:22:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 8.9113142140000008, 2024-09-16T01:22:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 66, 2024-09-16T01:22:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 125, 2024-09-16T01:22:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 125, 2024-09-16T01:22:47.407 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.004376202 2024-09-16T01:22:47.407 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:22:47.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.391+0000 7ff051552640 1 -- 172.21.15.81:0/732755690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff02c06c2b0 msgr2=0x7ff02c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.391+0000 7ff051552640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff02c06c2b0 0x7ff02c06e770 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff034034000 tx=0x7ff03402e000 comp rx=0 tx=0).stop 2024-09-16T01:22:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.391+0000 7ff051552640 1 -- 172.21.15.81:0/732755690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04c0b64b0 msgr2=0x7ff04c0b7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.391+0000 7ff051552640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04c0b64b0 0x7ff04c0b7c70 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00e7e0 tx=0x7ff03c00eca0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.391+0000 7ff051552640 1 -- 172.21.15.81:0/732755690 shutdown_connections 2024-09-16T01:22:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.391+0000 7ff051552640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff02c06c2b0 0x7ff02c06e770 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.391+0000 7ff051552640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff04c162060 0x7ff04c0b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.391+0000 7ff051552640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff04c161c80 0x7ff04c1567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.391+0000 7ff051552640 1 --2- 172.21.15.81:0/732755690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04c0b64b0 0x7ff04c0b7c70 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.391+0000 7ff051552640 1 -- 172.21.15.81:0/732755690 >> 172.21.15.81:0/732755690 conn(0x7ff04c0d44f0 msgr2=0x7ff04c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.391+0000 7ff051552640 1 -- 172.21.15.81:0/732755690 shutdown_connections 2024-09-16T01:22:47.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.391+0000 7ff051552640 1 -- 172.21.15.81:0/732755690 wait complete. 2024-09-16T01:22:47.410 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:22:47.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.509+0000 7fb10df52640 1 Processor -- start 2024-09-16T01:22:47.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.509+0000 7fb10df52640 1 -- start start 2024-09-16T01:22:47.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb10df52640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb10815e5d0 0x7fb1080d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb10df52640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb10806df60 0x7fb10809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb10df52640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1080d1630 0x7fb10809af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb10df52640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb10806dad0 con 0x7fb10815e5d0 2024-09-16T01:22:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb10df52640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb10806cec0 con 0x7fb10806df60 2024-09-16T01:22:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb10df52640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb10806d1a0 con 0x7fb1080d1630 2024-09-16T01:22:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb1077fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb10815e5d0 0x7fb1080d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb1077fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb10815e5d0 0x7fb1080d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37454/0 (socket says 172.21.15.81:37454) 2024-09-16T01:22:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb1077fe640 1 -- 172.21.15.81:0/2263336300 learned_addr learned my addr 172.21.15.81:0/2263336300 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:47.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb106ffd640 1 --2- 172.21.15.81:0/2263336300 >> v2:172.21.15.102:3300/0 conn(0x7fb10806df60 0x7fb10809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb107fff640 1 --2- 172.21.15.81:0/2263336300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1080d1630 0x7fb10809af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb1077fe640 1 -- 172.21.15.81:0/2263336300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1080d1630 msgr2=0x7fb10809af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb1077fe640 1 --2- 172.21.15.81:0/2263336300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1080d1630 0x7fb10809af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb1077fe640 1 -- 172.21.15.81:0/2263336300 >> v2:172.21.15.102:3300/0 conn(0x7fb10806df60 msgr2=0x7fb10809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb1077fe640 1 --2- 172.21.15.81:0/2263336300 >> v2:172.21.15.102:3300/0 conn(0x7fb10806df60 0x7fb10809aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.510+0000 7fb1077fe640 1 -- 172.21.15.81:0/2263336300 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10806d480 con 0x7fb10815e5d0 2024-09-16T01:22:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.511+0000 7fb1077fe640 1 --2- 172.21.15.81:0/2263336300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10815e5d0 0x7fb1080d10f0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fb1080a0490 tx=0x7fb0f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a183c73f208880 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.511+0000 7fb1067fc640 1 -- 172.21.15.81:0/2263336300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8037070 con 0x7fb10815e5d0 2024-09-16T01:22:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.511+0000 7fb1067fc640 1 -- 172.21.15.81:0/2263336300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8032440 con 0x7fb10815e5d0 2024-09-16T01:22:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.511+0000 7fb1067fc640 1 -- 172.21.15.81:0/2263336300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8032810 con 0x7fb10815e5d0 2024-09-16T01:22:47.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.512+0000 7fb10df52640 1 -- 172.21.15.81:0/2263336300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10815e5d0 msgr2=0x7fb1080d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.512+0000 7fb10df52640 1 --2- 172.21.15.81:0/2263336300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10815e5d0 0x7fb1080d10f0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fb1080a0490 tx=0x7fb0f802a270 comp rx=0 tx=0).stop 2024-09-16T01:22:47.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.512+0000 7fb10df52640 1 -- 172.21.15.81:0/2263336300 shutdown_connections 2024-09-16T01:22:47.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.512+0000 7fb10df52640 1 --2- 172.21.15.81:0/2263336300 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1080d1630 0x7fb10809af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.512+0000 7fb10df52640 1 --2- 172.21.15.81:0/2263336300 >> v2:172.21.15.102:3300/0 conn(0x7fb10806df60 0x7fb10809aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.512+0000 7fb10df52640 1 --2- 172.21.15.81:0/2263336300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10815e5d0 0x7fb1080d10f0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.512+0000 7fb10df52640 1 -- 172.21.15.81:0/2263336300 >> 172.21.15.81:0/2263336300 conn(0x7fb1080d23a0 msgr2=0x7fb1080d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.512+0000 7fb10df52640 1 -- 172.21.15.81:0/2263336300 shutdown_connections 2024-09-16T01:22:47.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.512+0000 7fb10df52640 1 -- 172.21.15.81:0/2263336300 wait complete. 2024-09-16T01:22:47.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.513+0000 7fb10df52640 1 Processor -- start 2024-09-16T01:22:47.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.513+0000 7fb10df52640 1 -- start start 2024-09-16T01:22:47.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb10df52640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb10806df60 0x7fb108153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb10df52640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1080d1630 0x7fb10815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb10df52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10815e5d0 0x7fb10815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb10df52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb10815eb30 con 0x7fb10815e5d0 2024-09-16T01:22:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb10df52640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb10815e9b0 con 0x7fb10806df60 2024-09-16T01:22:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb10df52640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb108162230 con 0x7fb1080d1630 2024-09-16T01:22:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb107fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10815e5d0 0x7fb10815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb107fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10815e5d0 0x7fb10815bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37456/0 (socket says 172.21.15.81:37456) 2024-09-16T01:22:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb107fff640 1 -- 172.21.15.81:0/1425032465 learned_addr learned my addr 172.21.15.81:0/1425032465 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb1077fe640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb10806df60 0x7fb108153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb106ffd640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1080d1630 0x7fb10815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb107fff640 1 -- 172.21.15.81:0/1425032465 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1080d1630 msgr2=0x7fb10815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb107fff640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1080d1630 0x7fb10815b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb107fff640 1 -- 172.21.15.81:0/1425032465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb10806df60 msgr2=0x7fb108153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb107fff640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb10806df60 0x7fb108153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.514+0000 7fb107fff640 1 -- 172.21.15.81:0/1425032465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1080b5c80 con 0x7fb10815e5d0 2024-09-16T01:22:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.515+0000 7fb107fff640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10815e5d0 0x7fb10815bcb0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fb10000cd70 tx=0x7fb10000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.515+0000 7fb0effff640 1 -- 172.21.15.81:0/1425032465 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100003b90 con 0x7fb10815e5d0 2024-09-16T01:22:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.515+0000 7fb0effff640 1 -- 172.21.15.81:0/1425032465 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb100003d30 con 0x7fb10815e5d0 2024-09-16T01:22:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.515+0000 7fb10df52640 1 -- 172.21.15.81:0/1425032465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1080b5f60 con 0x7fb10815e5d0 2024-09-16T01:22:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.515+0000 7fb0effff640 1 -- 172.21.15.81:0/1425032465 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100004240 con 0x7fb10815e5d0 2024-09-16T01:22:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.515+0000 7fb10df52640 1 -- 172.21.15.81:0/1425032465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1080b6520 con 0x7fb10815e5d0 2024-09-16T01:22:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.516+0000 7fb10df52640 1 -- 172.21.15.81:0/1425032465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1080d10f0 con 0x7fb10815e5d0 2024-09-16T01:22:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.516+0000 7fb0effff640 1 -- 172.21.15.81:0/1425032465 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb1000043e0 con 0x7fb10815e5d0 2024-09-16T01:22:47.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.516+0000 7fb0effff640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb0f406c2b0 0x7fb0f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:47.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.517+0000 7fb0effff640 1 -- 172.21.15.81:0/1425032465 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fb10008c030 con 0x7fb10815e5d0 2024-09-16T01:22:47.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.517+0000 7fb1077fe640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb0f406c2b0 0x7fb0f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:47.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.517+0000 7fb1077fe640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb0f406c2b0 0x7fb0f406e770 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8034000 tx=0x7fb0f802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:47.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.521+0000 7fb0effff640 1 -- 172.21.15.81:0/1425032465 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb10005a6a0 con 0x7fb10815e5d0 2024-09-16T01:22:47.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.723+0000 7fb10df52640 1 -- 172.21.15.81:0/1425032465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb1080b8320 con 0x7fb10815e5d0 2024-09-16T01:22:47.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.723+0000 7fb0effff640 1 -- 172.21.15.81:0/1425032465 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) ==== 53+0+73 (secure 0 0 0) 0x7fb100059fa0 con 0x7fb10815e5d0 2024-09-16T01:22:47.724 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:22:47.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.725+0000 7fb10df52640 1 -- 172.21.15.81:0/1425032465 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb0f406c2b0 msgr2=0x7fb0f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.725+0000 7fb10df52640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb0f406c2b0 0x7fb0f406e770 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8034000 tx=0x7fb0f802e000 comp rx=0 tx=0).stop 2024-09-16T01:22:47.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.725+0000 7fb10df52640 1 -- 172.21.15.81:0/1425032465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10815e5d0 msgr2=0x7fb10815bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:47.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.725+0000 7fb10df52640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10815e5d0 0x7fb10815bcb0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fb10000cd70 tx=0x7fb10000a660 comp rx=0 tx=0).stop 2024-09-16T01:22:47.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.725+0000 7fb10df52640 1 -- 172.21.15.81:0/1425032465 shutdown_connections 2024-09-16T01:22:47.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.725+0000 7fb10df52640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb0f406c2b0 0x7fb0f406e770 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.725+0000 7fb10df52640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10815e5d0 0x7fb10815bcb0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.725+0000 7fb10df52640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1080d1630 0x7fb10815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.725+0000 7fb10df52640 1 --2- 172.21.15.81:0/1425032465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb10806df60 0x7fb108153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:47.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.725+0000 7fb10df52640 1 -- 172.21.15.81:0/1425032465 >> 172.21.15.81:0/1425032465 conn(0x7fb1080d23a0 msgr2=0x7fb108162680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:47.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.725+0000 7fb10df52640 1 -- 172.21.15.81:0/1425032465 shutdown_connections 2024-09-16T01:22:47.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47.725+0000 7fb10df52640 1 -- 172.21.15.81:0/1425032465 wait complete. 2024-09-16T01:22:47.737 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:22:47.737 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:22:47.737 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:22:47.737 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:22:47.737 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:22:47.737 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:22:47.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:22:47.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:22:47.737 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:22:47.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:47.738 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:22:47.753 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:22:47.753 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:22:47.754 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:22:47.754 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:47.754 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:22:47.754 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:47.754 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:22:47.754 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:47.754 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:22:47.754 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:22:47.754 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:47.754 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:22:47.754 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:22:47.755 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:47.755 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:22:47.755 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:47.755 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:22:47.755 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42370sec preferred_lft 42370sec 2024-09-16T01:22:47.755 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:22:47.755 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:47.755 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:22:47.755 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:47.755 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:22:47.755 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:47.755 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::bc22:19ff:fe0c:8fb1/64 scope link 2024-09-16T01:22:47.756 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:47.756 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:22:47.756 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 86:bb:d8:38:80:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:22:47.756 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::84bb:d8ff:fe38:80af/64 scope link 2024-09-16T01:22:47.756 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:47.756 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:22:47.756 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:22:47.756 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::828:dff:febd:ee39/64 scope link 2024-09-16T01:22:47.756 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:47.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:47.757 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:22:47.817 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:22:47.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:47.819 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:22:47.876 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:22:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:22:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:22:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:22:47.877 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:22:47.878 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:22:47.878 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:22:47.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:22:47.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:22:47.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:22:47.879 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:22:47.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:22:47.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:22:48.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:48.003 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:22:48.018 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:22:48.018 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:22:48.018 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:22:48.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:48.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-16T01:22:48.083 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:22:48.083 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:22:48.139 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:22:48.139 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:22:48.139 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:22:48.195 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:22:48.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:48.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:22:48.277 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:22:48.277 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:22:48.277 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:22:48.286 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:22:48.286 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:22:48.286 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:22:48.286 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:22:48.286 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:22:48.291 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:22:48.291 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:22:48.291 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:22:48.291 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:22:48.291 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:22:48.291 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:22:48.291 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:22:48.291 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:22:48.292 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:22:48.292 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:22:48.292 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:22:48.292 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:22:48.292 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:22:48.293 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:22:48.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:48.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:22:48.359 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:22:48.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:22:48.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:22:48.459 INFO:teuthology.orchestra.run.smithi081.stdout:client6832 2024-09-16T01:22:48.459 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:22:48.459 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:48.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:22:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.612+0000 7fd8ae76d640 1 Processor -- start 2024-09-16T01:22:48.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.612+0000 7fd8ae76d640 1 -- start start 2024-09-16T01:22:48.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.613+0000 7fd8ae76d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8a815fc30 0x7fd8a8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.613+0000 7fd8ae76d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8a809b140 0x7fd8a80704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.613+0000 7fd8ae76d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a809ba30 con 0x7fd8a80b17d0 2024-09-16T01:22:48.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.613+0000 7fd8ae76d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a80b1590 con 0x7fd8a815fc30 2024-09-16T01:22:48.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.613+0000 7fd8ae76d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a8160ab0 con 0x7fd8a809b140 2024-09-16T01:22:48.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.613+0000 7fd8a7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8a815fc30 0x7fd8a8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.613+0000 7fd8a7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8a815fc30 0x7fd8a8071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37464/0 (socket says 172.21.15.81:37464) 2024-09-16T01:22:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.613+0000 7fd8a7fff640 1 -- 172.21.15.81:0/2169054428 learned_addr learned my addr 172.21.15.81:0/2169054428 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.614+0000 7fd8a7fff640 1 -- 172.21.15.81:0/2169054428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8a809b140 msgr2=0x7fd8a80704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.614+0000 7fd8acd0a640 1 --2- 172.21.15.81:0/2169054428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8a809b140 0x7fd8a80704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.614+0000 7fd8a7fff640 1 --2- 172.21.15.81:0/2169054428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8a809b140 0x7fd8a80704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.614+0000 7fd8a7fff640 1 -- 172.21.15.81:0/2169054428 >> v1:172.21.15.102:6789/0 conn(0x7fd8a80b17d0 legacy=0x7fd8a809aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.614+0000 7fd8a7fff640 1 -- 172.21.15.81:0/2169054428 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a809bcf0 con 0x7fd8a815fc30 2024-09-16T01:22:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.614+0000 7fd8acd0a640 1 --2- 172.21.15.81:0/2169054428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8a809b140 0x7fd8a80704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.614+0000 7fd8a7fff640 1 --2- 172.21.15.81:0/2169054428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a815fc30 0x7fd8a8071e40 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fd898009870 tx=0x7fd89802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37861327a88fbdd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.614+0000 7fd8a6ffd640 1 -- 172.21.15.81:0/2169054428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898037070 con 0x7fd8a815fc30 2024-09-16T01:22:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.615+0000 7fd8a6ffd640 1 -- 172.21.15.81:0/2169054428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd898032440 con 0x7fd8a815fc30 2024-09-16T01:22:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.615+0000 7fd8a6ffd640 1 -- 172.21.15.81:0/2169054428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898032810 con 0x7fd8a815fc30 2024-09-16T01:22:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.615+0000 7fd8ae76d640 1 -- 172.21.15.81:0/2169054428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a815fc30 msgr2=0x7fd8a8071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.615+0000 7fd8ae76d640 1 --2- 172.21.15.81:0/2169054428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a815fc30 0x7fd8a8071e40 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fd898009870 tx=0x7fd89802a180 comp rx=0 tx=0).stop 2024-09-16T01:22:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.615+0000 7fd8ae76d640 1 -- 172.21.15.81:0/2169054428 shutdown_connections 2024-09-16T01:22:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.615+0000 7fd8ae76d640 1 --2- 172.21.15.81:0/2169054428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8a809b140 0x7fd8a80704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.615+0000 7fd8ae76d640 1 --2- 172.21.15.81:0/2169054428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a815fc30 0x7fd8a8071e40 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.615+0000 7fd8ae76d640 1 -- 172.21.15.81:0/2169054428 >> 172.21.15.81:0/2169054428 conn(0x7fd8a80d23a0 msgr2=0x7fd8a80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.615+0000 7fd8ae76d640 1 -- 172.21.15.81:0/2169054428 shutdown_connections 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.615+0000 7fd8ae76d640 1 -- 172.21.15.81:0/2169054428 wait complete. 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.616+0000 7fd8ae76d640 1 Processor -- start 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.616+0000 7fd8ae76d640 1 -- start start 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.617+0000 7fd8ae76d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a809b140 0x7fd8a81538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.617+0000 7fd8ae76d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8a80b17d0 0x7fd8a80c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.617+0000 7fd8ae76d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8a815fc30 0x7fd8a80c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.617+0000 7fd8ae76d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a80b1bd0 con 0x7fd8a809b140 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.617+0000 7fd8ae76d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a8160fe0 con 0x7fd8a80b17d0 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.617+0000 7fd8ae76d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a8070a30 con 0x7fd8a815fc30 2024-09-16T01:22:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.617+0000 7fd8a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a809b140 0x7fd8a81538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.617+0000 7fd8a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a809b140 0x7fd8a81538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37476/0 (socket says 172.21.15.81:37476) 2024-09-16T01:22:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.617+0000 7fd8a7fff640 1 -- 172.21.15.81:0/3566299330 learned_addr learned my addr 172.21.15.81:0/3566299330 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.617+0000 7fd8a77fe640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8a80b17d0 0x7fd8a80c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.617+0000 7fd8acd0a640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8a815fc30 0x7fd8a80c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.618+0000 7fd8a7fff640 1 -- 172.21.15.81:0/3566299330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8a815fc30 msgr2=0x7fd8a80c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.618+0000 7fd8a7fff640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8a815fc30 0x7fd8a80c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.618+0000 7fd8a7fff640 1 -- 172.21.15.81:0/3566299330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8a80b17d0 msgr2=0x7fd8a80c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.618+0000 7fd8a7fff640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8a80b17d0 0x7fd8a80c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.618+0000 7fd8a7fff640 1 -- 172.21.15.81:0/3566299330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a80b64d0 con 0x7fd8a809b140 2024-09-16T01:22:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.618+0000 7fd8acd0a640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8a815fc30 0x7fd8a80c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.618+0000 7fd8a7fff640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a809b140 0x7fd8a81538e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fd898000c00 tx=0x7fd8980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:48.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.618+0000 7fd8a4ff9640 1 -- 172.21.15.81:0/3566299330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898041070 con 0x7fd8a809b140 2024-09-16T01:22:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.618+0000 7fd8a4ff9640 1 -- 172.21.15.81:0/3566299330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd89803c870 con 0x7fd8a809b140 2024-09-16T01:22:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.618+0000 7fd8ae76d640 1 -- 172.21.15.81:0/3566299330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a80b67b0 con 0x7fd8a809b140 2024-09-16T01:22:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.618+0000 7fd8a4ff9640 1 -- 172.21.15.81:0/3566299330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898037040 con 0x7fd8a809b140 2024-09-16T01:22:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.618+0000 7fd8ae76d640 1 -- 172.21.15.81:0/3566299330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a80b6d70 con 0x7fd8a809b140 2024-09-16T01:22:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.619+0000 7fd8ae76d640 1 -- 172.21.15.81:0/3566299330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a80704f0 con 0x7fd8a809b140 2024-09-16T01:22:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.619+0000 7fd8a4ff9640 1 -- 172.21.15.81:0/3566299330 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd898044070 con 0x7fd8a809b140 2024-09-16T01:22:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.620+0000 7fd8a4ff9640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd89406c2b0 0x7fd89406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.620+0000 7fd8a77fe640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd89406c2b0 0x7fd89406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.620+0000 7fd8a4ff9640 1 -- 172.21.15.81:0/3566299330 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fd8980ac0d0 con 0x7fd8a809b140 2024-09-16T01:22:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.620+0000 7fd8a77fe640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd89406c2b0 0x7fd89406e770 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80c9340 tx=0x7fd89c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.624+0000 7fd8a4ff9640 1 -- 172.21.15.81:0/3566299330 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd89807a740 con 0x7fd8a809b140 2024-09-16T01:22:48.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.824+0000 7fd8ae76d640 1 -- 172.21.15.81:0/3566299330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd8a80b8320 con 0x7fd8a809b140 2024-09-16T01:22:48.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.825+0000 7fd8a4ff9640 1 -- 172.21.15.81:0/3566299330 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) ==== 53+0+73 (secure 0 0 0) 0x7fd89807a040 con 0x7fd8a809b140 2024-09-16T01:22:48.825 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:22:48.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.826+0000 7fd8ae76d640 1 -- 172.21.15.81:0/3566299330 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd89406c2b0 msgr2=0x7fd89406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.826+0000 7fd8ae76d640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd89406c2b0 0x7fd89406e770 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80c9340 tx=0x7fd89c009040 comp rx=0 tx=0).stop 2024-09-16T01:22:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.826+0000 7fd8ae76d640 1 -- 172.21.15.81:0/3566299330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a809b140 msgr2=0x7fd8a81538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.826+0000 7fd8ae76d640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a809b140 0x7fd8a81538e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fd898000c00 tx=0x7fd8980046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.827+0000 7fd8ae76d640 1 -- 172.21.15.81:0/3566299330 shutdown_connections 2024-09-16T01:22:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.827+0000 7fd8ae76d640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd89406c2b0 0x7fd89406e770 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.827+0000 7fd8ae76d640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8a815fc30 0x7fd8a80c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.827+0000 7fd8ae76d640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8a80b17d0 0x7fd8a80c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.827+0000 7fd8ae76d640 1 --2- 172.21.15.81:0/3566299330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a809b140 0x7fd8a81538e0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.827+0000 7fd8ae76d640 1 -- 172.21.15.81:0/3566299330 >> 172.21.15.81:0/3566299330 conn(0x7fd8a80d23a0 msgr2=0x7fd8a8160030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.827+0000 7fd8ae76d640 1 -- 172.21.15.81:0/3566299330 shutdown_connections 2024-09-16T01:22:48.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:48.827+0000 7fd8ae76d640 1 -- 172.21.15.81:0/3566299330 wait complete. 2024-09-16T01:22:48.838 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:22:48.839 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:22:48.839 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-16T01:22:48.839 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T01:22:48.839 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:22:48.839 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:22:48.839 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:22:48.839 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:22:48.839 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:22:48.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:48.839 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:48.860 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42371sec preferred_lft 42371sec 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:22:48.861 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:22:48.862 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:22:48.862 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:48.862 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::fc48:18ff:fedc:b80f/64 scope link 2024-09-16T01:22:48.862 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:48.862 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:22:48.862 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 2e:4a:65:c9:20:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:22:48.862 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::2c4a:65ff:fec9:204f/64 scope link 2024-09-16T01:22:48.862 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:48.862 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:22:48.862 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:22:48.862 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::1072:70ff:fefd:f9f1/64 scope link 2024-09-16T01:22:48.862 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:22:48.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:48.863 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:22:48.928 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:22:48.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:48.930 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-16T01:22:48.989 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-16T01:22:48.989 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:22:48.989 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:22:48.989 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:22:48.989 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:22:48.990 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:22:48.990 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:22:48.990 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:22:48.990 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:22:48.990 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:22:48.990 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:22:49.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:22:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:22:49.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:22:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:22:49.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:49.129 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:22:49.145 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T01:22:49.146 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:22:49.146 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:22:49.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:49.146 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-16T01:22:49.212 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:22:49.212 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T01:22:49.268 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:22:49.268 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:22:49.268 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:22:49.323 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:22:49.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:49.324 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:22:49.408 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:22:49.408 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:22:49.408 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:22:49.416 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:22:49.416 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:22:49.416 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:22:49.417 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:22:49.417 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:22:49.421 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:22:49.421 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:22:49.421 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:22:49.421 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:22:49.421 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:22:49.421 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:22:49.421 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:22:49.422 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:22:49.422 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T01:22:49.422 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:22:49.422 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:22:49.422 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:22:49.423 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:22:49.424 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:22:49.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:22:49.424 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:22:49.496 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:22:49.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:22:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:22:49.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:22:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:22:49.592 INFO:teuthology.orchestra.run.smithi102.stdout:client7845 2024-09-16T01:22:49.592 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:22:49.592 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:49.608 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-09-16T01:22:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.710+0000 7f7466103640 1 Processor -- start 2024-09-16T01:22:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.710+0000 7f7466103640 1 -- start start 2024-09-16T01:22:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.711+0000 7f7466103640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f746015e410 0x7f74600b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.711+0000 7f7466103640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74600b40c0 0x7f74600aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.711+0000 7f7466103640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74600ae240 con 0x7f746006bc10 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.711+0000 7f7466103640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f74600ae520 con 0x7f746015e410 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.711+0000 7f7466103640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f74600ae800 con 0x7f74600b40c0 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.711+0000 7f745ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f746006bc10 0x7f74600aefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51516/0 (socket says 172.21.15.81:51516) 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.711+0000 7f745ffff640 1 -- 172.21.15.81:0/1040851551 learned_addr learned my addr 172.21.15.81:0/1040851551 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.711+0000 7f745f7fe640 1 --2- 172.21.15.81:0/1040851551 >> v2:172.21.15.102:3300/0 conn(0x7f746015e410 0x7f74600b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.711+0000 7f745effd640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74600b40c0 0x7f74600aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.711+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014753085 0 0) 0x7f74600ae240 con 0x7f746006bc10 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.711+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7448003520 con 0x7f746006bc10 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1567008977 0 0) 0x7f7448003520 con 0x7f746006bc10 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74600b40c0 msgr2=0x7f74600aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74600b40c0 0x7f74600aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 >> v2:172.21.15.102:3300/0 conn(0x7f746015e410 msgr2=0x7f74600b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 --2- 172.21.15.81:0/1040851551 >> v2:172.21.15.102:3300/0 conn(0x7f746015e410 0x7f74600b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74600aeae0 con 0x7f746006bc10 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f74580019f0 con 0x7f746006bc10 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745f7fe640 1 --2- 172.21.15.81:0/1040851551 >> v2:172.21.15.102:3300/0 conn(0x7f746015e410 0x7f74600b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 >> v1:172.21.15.81:6789/0 conn(0x7f746006bc10 legacy=0x7f74600aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74600b40c0 0x7f74480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7448003f30 0x7f7448004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7448004d40 0x7f74480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f74600ae520 con 0x7f7448003f30 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f74600ae800 con 0x7f7448004d40 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f744800ba10 con 0x7f74600b40c0 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745effd640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7448003f30 0x7f7448004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745f7fe640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74600b40c0 0x7f74480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745ffff640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7448004d40 0x7f74480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745effd640 1 -- 172.21.15.81:0/1040851551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74600b40c0 msgr2=0x7f74480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745effd640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f74600b40c0 0x7f74480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745effd640 1 -- 172.21.15.81:0/1040851551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7448004d40 msgr2=0x7f74480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745effd640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7448004d40 0x7f74480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745effd640 1 -- 172.21.15.81:0/1040851551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7448003520 con 0x7f7448003f30 2024-09-16T01:22:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.712+0000 7f745ffff640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7448004d40 0x7f74480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.713+0000 7f745effd640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7448003f30 0x7f7448004800 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f7454009af0 tx=0x7f7448005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c54ec7985a8bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.713+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454036070 con 0x7f7448003f30 2024-09-16T01:22:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.713+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7454031400 con 0x7f7448003f30 2024-09-16T01:22:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.713+0000 7f745e7fc640 1 -- 172.21.15.81:0/1040851551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454009690 con 0x7f7448003f30 2024-09-16T01:22:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.713+0000 7f7466103640 1 -- 172.21.15.81:0/1040851551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7448003f30 msgr2=0x7f7448004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.713+0000 7f7466103640 1 --2- 172.21.15.81:0/1040851551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7448003f30 0x7f7448004800 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f7454009af0 tx=0x7f7448005830 comp rx=0 tx=0).stop 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.713+0000 7f745ffff640 1 -- 172.21.15.81:0/1040851551 reap_dead start 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.713+0000 7f7466103640 1 -- 172.21.15.81:0/1040851551 shutdown_connections 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.713+0000 7f7466103640 1 -- 172.21.15.81:0/1040851551 >> 172.21.15.81:0/1040851551 conn(0x7f746009aa30 msgr2=0x7f74600b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.713+0000 7f7466103640 1 -- 172.21.15.81:0/1040851551 shutdown_connections 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.713+0000 7f7466103640 1 -- 172.21.15.81:0/1040851551 wait complete. 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.715+0000 7f7466103640 1 Processor -- start 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.715+0000 7f7466103640 1 -- start start 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.715+0000 7f7466103640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7448003f30 0x7f7460142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.715+0000 7f7466103640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74601504b0 0x7f7460144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f7466103640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7460150910 0x7f74601454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f7466103640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f746015e970 con 0x7f74601504b0 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f7466103640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f746015e7f0 con 0x7f7448003f30 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f7466103640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f74600af6f0 con 0x7f7460150910 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f745effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74601504b0 0x7f7460144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f745effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74601504b0 0x7f7460144fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37486/0 (socket says 172.21.15.81:37486) 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f745effd640 1 -- 172.21.15.81:0/1610842871 learned_addr learned my addr 172.21.15.81:0/1610842871 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f745f7fe640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7448003f30 0x7f7460142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f745effd640 1 -- 172.21.15.81:0/1610842871 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7460150910 msgr2=0x7f74601454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f745effd640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7460150910 0x7f74601454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f745effd640 1 -- 172.21.15.81:0/1610842871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7448003f30 msgr2=0x7f7460142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f745effd640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7448003f30 0x7f7460142990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f745effd640 1 -- 172.21.15.81:0/1610842871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74601535a0 con 0x7f74601504b0 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f745effd640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74601504b0 0x7f7460144fa0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f7454034040 tx=0x7f7454004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f7447fff640 1 -- 172.21.15.81:0/1610842871 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454040020 con 0x7f74601504b0 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f7447fff640 1 -- 172.21.15.81:0/1610842871 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74540038d0 con 0x7f74601504b0 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f7466103640 1 -- 172.21.15.81:0/1610842871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74601532c0 con 0x7f74601504b0 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f7447fff640 1 -- 172.21.15.81:0/1610842871 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454036040 con 0x7f74601504b0 2024-09-16T01:22:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.716+0000 7f7466103640 1 -- 172.21.15.81:0/1610842871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7460157130 con 0x7f74601504b0 2024-09-16T01:22:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.717+0000 7f7466103640 1 -- 172.21.15.81:0/1610842871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7460157570 con 0x7f74601504b0 2024-09-16T01:22:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.718+0000 7f7447fff640 1 -- 172.21.15.81:0/1610842871 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7454043020 con 0x7f74601504b0 2024-09-16T01:22:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.718+0000 7f7447fff640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f744c06c2e0 0x7f744c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.718+0000 7f7447fff640 1 -- 172.21.15.81:0/1610842871 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f74540ab500 con 0x7f74601504b0 2024-09-16T01:22:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.718+0000 7f745f7fe640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f744c06c2e0 0x7f744c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.719+0000 7f745f7fe640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f744c06c2e0 0x7f744c06e7a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7450009bf0 tx=0x7f7450008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.723+0000 7f7447fff640 1 -- 172.21.15.81:0/1610842871 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f745404a070 con 0x7f74601504b0 2024-09-16T01:22:49.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.892+0000 7f7466103640 1 -- 172.21.15.81:0/1610842871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7f74600afad0 con 0x7f74601504b0 2024-09-16T01:22:49.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.895+0000 7f7447fff640 1 -- 172.21.15.81:0/1610842871 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v47)=0 v47) ==== 121+0+0 (secure 0 0 0) 0x7f7454079b70 con 0x7f74601504b0 2024-09-16T01:22:49.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.898+0000 7f7466103640 1 -- 172.21.15.81:0/1610842871 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f744c06c2e0 msgr2=0x7f744c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:49.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.898+0000 7f7466103640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f744c06c2e0 0x7f744c06e7a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7450009bf0 tx=0x7f7450008040 comp rx=0 tx=0).stop 2024-09-16T01:22:49.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.898+0000 7f7466103640 1 -- 172.21.15.81:0/1610842871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74601504b0 msgr2=0x7f7460144fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:49.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.898+0000 7f7466103640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74601504b0 0x7f7460144fa0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f7454034040 tx=0x7f7454004730 comp rx=0 tx=0).stop 2024-09-16T01:22:49.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.898+0000 7f7466103640 1 -- 172.21.15.81:0/1610842871 shutdown_connections 2024-09-16T01:22:49.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.898+0000 7f7466103640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f744c06c2e0 0x7f744c06e7a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:49.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.898+0000 7f7466103640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7460150910 0x7f74601454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:49.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.898+0000 7f7466103640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74601504b0 0x7f7460144fa0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:49.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.898+0000 7f7466103640 1 --2- 172.21.15.81:0/1610842871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7448003f30 0x7f7460142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:49.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.898+0000 7f7466103640 1 -- 172.21.15.81:0/1610842871 >> 172.21.15.81:0/1610842871 conn(0x7f746009aa30 msgr2=0x7f74601596e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:49.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.898+0000 7f7466103640 1 -- 172.21.15.81:0/1610842871 shutdown_connections 2024-09-16T01:22:49.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:49.898+0000 7f7466103640 1 -- 172.21.15.81:0/1610842871 wait complete. 2024-09-16T01:22:49.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 100 2024-09-16T01:22:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.010+0000 7f7eec528640 1 Processor -- start 2024-09-16T01:22:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.010+0000 7f7eec528640 1 -- start start 2024-09-16T01:22:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eec528640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7ee4145e50 0x7f7ee40b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eec528640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ee406c320 0x7f7ee4165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eec528640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ee415d8a0 con 0x7f7ee415d350 2024-09-16T01:22:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eec528640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7ee40b7230 con 0x7f7ee406c320 2024-09-16T01:22:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eec528640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7ee40ae420 con 0x7f7ee4145e50 2024-09-16T01:22:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eeaac5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ee406c320 0x7f7ee4165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eeaac5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ee406c320 0x7f7ee4165ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37488/0 (socket says 172.21.15.81:37488) 2024-09-16T01:22:50.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eeaac5640 1 -- 172.21.15.81:0/280709397 learned_addr learned my addr 172.21.15.81:0/280709397 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eea2c4640 1 --2- 172.21.15.81:0/280709397 >> v2:172.21.15.102:3300/0 conn(0x7f7ee4145e50 0x7f7ee40b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eeaac5640 1 -- 172.21.15.81:0/280709397 >> v2:172.21.15.102:3300/0 conn(0x7f7ee4145e50 msgr2=0x7f7ee40b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eeaac5640 1 --2- 172.21.15.81:0/280709397 >> v2:172.21.15.102:3300/0 conn(0x7f7ee4145e50 0x7f7ee40b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eeaac5640 1 -- 172.21.15.81:0/280709397 >> v1:172.21.15.102:6789/0 conn(0x7f7ee415d350 legacy=0x7f7ee406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.011+0000 7f7eeaac5640 1 -- 172.21.15.81:0/280709397 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee415dba0 con 0x7f7ee406c320 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.012+0000 7f7eeaac5640 1 --2- 172.21.15.81:0/280709397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406c320 0x7f7ee4165ef0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40d2270 tx=0x7f7edc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6684fd8db03264ce server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.012+0000 7f7ee92c2640 1 -- 172.21.15.81:0/280709397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc036070 con 0x7f7ee406c320 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.012+0000 7f7ee92c2640 1 -- 172.21.15.81:0/280709397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7edc031600 con 0x7f7ee406c320 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.012+0000 7f7ee92c2640 1 -- 172.21.15.81:0/280709397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0319d0 con 0x7f7ee406c320 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.013+0000 7f7eec528640 1 -- 172.21.15.81:0/280709397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406c320 msgr2=0x7f7ee4165ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.013+0000 7f7eec528640 1 --2- 172.21.15.81:0/280709397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406c320 0x7f7ee4165ef0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40d2270 tx=0x7f7edc02a730 comp rx=0 tx=0).stop 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.013+0000 7f7eec528640 1 -- 172.21.15.81:0/280709397 shutdown_connections 2024-09-16T01:22:50.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.013+0000 7f7eec528640 1 --2- 172.21.15.81:0/280709397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee406c320 0x7f7ee4165ef0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.013+0000 7f7eec528640 1 --2- 172.21.15.81:0/280709397 >> v2:172.21.15.102:3300/0 conn(0x7f7ee4145e50 0x7f7ee40b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.013+0000 7f7eec528640 1 -- 172.21.15.81:0/280709397 >> 172.21.15.81:0/280709397 conn(0x7f7ee409aa30 msgr2=0x7f7ee40b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:50.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.013+0000 7f7eec528640 1 -- 172.21.15.81:0/280709397 shutdown_connections 2024-09-16T01:22:50.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.013+0000 7f7eec528640 1 -- 172.21.15.81:0/280709397 wait complete. 2024-09-16T01:22:50.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.014+0000 7f7eec528640 1 Processor -- start 2024-09-16T01:22:50.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.014+0000 7f7eec528640 1 -- start start 2024-09-16T01:22:50.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eec528640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee406c320 0x7f7ee41e91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eec528640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ee4145e50 0x7f7ee4143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eec528640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee415d350 0x7f7ee4156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eec528640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee415e160 con 0x7f7ee415d350 2024-09-16T01:22:50.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eec528640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee415e4d0 con 0x7f7ee406c320 2024-09-16T01:22:50.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eec528640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee415f970 con 0x7f7ee4145e50 2024-09-16T01:22:50.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eeaac5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee415d350 0x7f7ee4156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eeaac5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee415d350 0x7f7ee4156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37492/0 (socket says 172.21.15.81:37492) 2024-09-16T01:22:50.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eeaac5640 1 -- 172.21.15.81:0/1781824223 learned_addr learned my addr 172.21.15.81:0/1781824223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:50.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eea2c4640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee406c320 0x7f7ee41e91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7ee9ac3640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ee4145e50 0x7f7ee4143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eeaac5640 1 -- 172.21.15.81:0/1781824223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ee4145e50 msgr2=0x7f7ee4143e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eeaac5640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ee4145e50 0x7f7ee4143e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eeaac5640 1 -- 172.21.15.81:0/1781824223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee406c320 msgr2=0x7f7ee41e91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eeaac5640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee406c320 0x7f7ee41e91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eeaac5640 1 -- 172.21.15.81:0/1781824223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee409c200 con 0x7f7ee415d350 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eeaac5640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee415d350 0x7f7ee4156f90 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f7edc034040 tx=0x7f7edc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7edaffd640 1 -- 172.21.15.81:0/1781824223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc036050 con 0x7f7ee415d350 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7edaffd640 1 -- 172.21.15.81:0/1781824223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7edc042070 con 0x7f7ee415d350 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.015+0000 7f7eec528640 1 -- 172.21.15.81:0/1781824223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee409c4e0 con 0x7f7ee415d350 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.016+0000 7f7edaffd640 1 -- 172.21.15.81:0/1781824223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7edc009510 con 0x7f7ee415d350 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.016+0000 7f7eec528640 1 -- 172.21.15.81:0/1781824223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee409caa0 con 0x7f7ee415d350 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.016+0000 7f7eec528640 1 -- 172.21.15.81:0/1781824223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ee40b6cf0 con 0x7f7ee415d350 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.017+0000 7f7edaffd640 1 -- 172.21.15.81:0/1781824223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7edc007bf0 con 0x7f7ee415d350 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.017+0000 7f7edaffd640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7ec806c2b0 0x7f7ec806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.017+0000 7f7eea2c4640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7ec806c2b0 0x7f7ec806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.017+0000 7f7edaffd640 1 -- 172.21.15.81:0/1781824223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f7edc0ac190 con 0x7f7ee415d350 2024-09-16T01:22:50.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.018+0000 7f7eea2c4640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7ec806c2b0 0x7f7ec806e770 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0006fd0 tx=0x7f7ee0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.022+0000 7f7edaffd640 1 -- 172.21.15.81:0/1781824223 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7edc07a1b0 con 0x7f7ee415d350 2024-09-16T01:22:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.190+0000 7f7eec528640 1 -- 172.21.15.81:0/1781824223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7f7ee406bd90 con 0x7f7ee415d350 2024-09-16T01:22:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.193+0000 7f7edaffd640 1 -- 172.21.15.81:0/1781824223 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v48)=0 v48) ==== 119+0+0 (secure 0 0 0) 0x7f7edc07e4b0 con 0x7f7ee415d350 2024-09-16T01:22:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.196+0000 7f7eec528640 1 -- 172.21.15.81:0/1781824223 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7ec806c2b0 msgr2=0x7f7ec806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.196+0000 7f7eec528640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7ec806c2b0 0x7f7ec806e770 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0006fd0 tx=0x7f7ee0008040 comp rx=0 tx=0).stop 2024-09-16T01:22:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.196+0000 7f7eec528640 1 -- 172.21.15.81:0/1781824223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee415d350 msgr2=0x7f7ee4156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.196+0000 7f7eec528640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee415d350 0x7f7ee4156f90 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f7edc034040 tx=0x7f7edc004a40 comp rx=0 tx=0).stop 2024-09-16T01:22:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.196+0000 7f7eec528640 1 -- 172.21.15.81:0/1781824223 shutdown_connections 2024-09-16T01:22:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.196+0000 7f7eec528640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7ec806c2b0 0x7f7ec806e770 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.196+0000 7f7eec528640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee415d350 0x7f7ee4156f90 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.196+0000 7f7eec528640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ee4145e50 0x7f7ee4143e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.196+0000 7f7eec528640 1 --2- 172.21.15.81:0/1781824223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee406c320 0x7f7ee41e91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.196+0000 7f7eec528640 1 -- 172.21.15.81:0/1781824223 >> 172.21.15.81:0/1781824223 conn(0x7f7ee409aa30 msgr2=0x7f7ee40b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.196+0000 7f7eec528640 1 -- 172.21.15.81:0/1781824223 shutdown_connections 2024-09-16T01:22:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.196+0000 7f7eec528640 1 -- 172.21.15.81:0/1781824223 wait complete. 2024-09-16T01:22:50.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 200 2024-09-16T01:22:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.308+0000 7f846959f640 1 Processor -- start 2024-09-16T01:22:50.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.308+0000 7f846959f640 1 -- start start 2024-09-16T01:22:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.309+0000 7f846959f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8464072270 0x7f8464072650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.309+0000 7f846959f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f84640ce6a0 0x7f846406e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.309+0000 7f846959f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8464072b90 con 0x7f846406e2d0 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.309+0000 7f846959f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f84640b00b0 con 0x7f84640ce6a0 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.309+0000 7f846959f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8464156ca0 con 0x7f8464072270 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.309+0000 7f84627fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f846406e2d0 0x7f846415fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51522/0 (socket says 172.21.15.81:51522) 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.309+0000 7f84627fc640 1 -- 172.21.15.81:0/298974538 learned_addr learned my addr 172.21.15.81:0/298974538 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.309+0000 7f8462ffd640 1 --2- 172.21.15.81:0/298974538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8464072270 0x7f8464072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.309+0000 7f84637fe640 1 --2- 172.21.15.81:0/298974538 >> v2:172.21.15.102:3300/0 conn(0x7f84640ce6a0 0x7f846406e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.309+0000 7f8461ffb640 1 -- 172.21.15.81:0/298974538 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2251661226 0 0) 0x7f8464072b90 con 0x7f846406e2d0 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.309+0000 7f8461ffb640 1 -- 172.21.15.81:0/298974538 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f844c003520 con 0x7f846406e2d0 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.310+0000 7f84637fe640 1 -- 172.21.15.81:0/298974538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8464072270 msgr2=0x7f8464072650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.310+0000 7f84637fe640 1 --2- 172.21.15.81:0/298974538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8464072270 0x7f8464072650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.310+0000 7f8461ffb640 1 -- 172.21.15.81:0/298974538 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1687549362 0 0) 0x7f844c003520 con 0x7f846406e2d0 2024-09-16T01:22:50.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.310+0000 7f84637fe640 1 -- 172.21.15.81:0/298974538 >> v1:172.21.15.81:6789/0 conn(0x7f846406e2d0 legacy=0x7f846415fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.310+0000 7f84637fe640 1 -- 172.21.15.81:0/298974538 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846406ed90 con 0x7f84640ce6a0 2024-09-16T01:22:50.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.310+0000 7f8462ffd640 1 --2- 172.21.15.81:0/298974538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8464072270 0x7f8464072650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:22:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.310+0000 7f84637fe640 1 --2- 172.21.15.81:0/298974538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84640ce6a0 0x7f846406e730 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f845c0097a0 tx=0x7f845c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1383d8231bb6b8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.311+0000 7f8461ffb640 1 -- 172.21.15.81:0/298974538 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c037070 con 0x7f84640ce6a0 2024-09-16T01:22:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.311+0000 7f8461ffb640 1 -- 172.21.15.81:0/298974538 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845c02aba0 con 0x7f84640ce6a0 2024-09-16T01:22:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.311+0000 7f8461ffb640 1 -- 172.21.15.81:0/298974538 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458001670 con 0x7f84640ce6a0 2024-09-16T01:22:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.311+0000 7f846959f640 1 -- 172.21.15.81:0/298974538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84640ce6a0 msgr2=0x7f846406e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.311+0000 7f846959f640 1 --2- 172.21.15.81:0/298974538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84640ce6a0 0x7f846406e730 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f845c0097a0 tx=0x7f845c02a110 comp rx=0 tx=0).stop 2024-09-16T01:22:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.311+0000 7f846959f640 1 -- 172.21.15.81:0/298974538 shutdown_connections 2024-09-16T01:22:50.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.311+0000 7f846959f640 1 --2- 172.21.15.81:0/298974538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f84640ce6a0 0x7f846406e730 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.311+0000 7f846959f640 1 --2- 172.21.15.81:0/298974538 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8464072270 0x7f8464072650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.311+0000 7f846959f640 1 -- 172.21.15.81:0/298974538 >> 172.21.15.81:0/298974538 conn(0x7f846406bc10 msgr2=0x7f846406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.311+0000 7f846959f640 1 -- 172.21.15.81:0/298974538 shutdown_connections 2024-09-16T01:22:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.311+0000 7f846959f640 1 -- 172.21.15.81:0/298974538 wait complete. 2024-09-16T01:22:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.312+0000 7f846959f640 1 Processor -- start 2024-09-16T01:22:50.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.313+0000 7f846959f640 1 -- start start 2024-09-16T01:22:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.313+0000 7f846959f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f846406e2d0 0x7f8464151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.313+0000 7f846959f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8464072270 0x7f846414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.313+0000 7f846959f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84640ce6a0 0x7f8464152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.313+0000 7f846959f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f84640cd170 con 0x7f84640ce6a0 2024-09-16T01:22:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.313+0000 7f846959f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f846406f350 con 0x7f846406e2d0 2024-09-16T01:22:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.313+0000 7f846959f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f846415ca20 con 0x7f8464072270 2024-09-16T01:22:50.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.313+0000 7f84637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84640ce6a0 0x7f8464152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.313+0000 7f84637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84640ce6a0 0x7f8464152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37506/0 (socket says 172.21.15.81:37506) 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.313+0000 7f84637fe640 1 -- 172.21.15.81:0/2819975259 learned_addr learned my addr 172.21.15.81:0/2819975259 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f8462ffd640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f846406e2d0 0x7f8464151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f84627fc640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8464072270 0x7f846414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f84637fe640 1 -- 172.21.15.81:0/2819975259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8464072270 msgr2=0x7f846414ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f84637fe640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8464072270 0x7f846414ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f84637fe640 1 -- 172.21.15.81:0/2819975259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f846406e2d0 msgr2=0x7f8464151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f84637fe640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f846406e2d0 0x7f8464151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f84637fe640 1 -- 172.21.15.81:0/2819975259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846414efb0 con 0x7f84640ce6a0 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f8462ffd640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f846406e2d0 0x7f8464151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f84637fe640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84640ce6a0 0x7f8464152530 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f845c0097a0 tx=0x7f845c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f844b7fe640 1 -- 172.21.15.81:0/2819975259 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c041030 con 0x7f84640ce6a0 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f844b7fe640 1 -- 172.21.15.81:0/2819975259 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f845c03d420 con 0x7f84640ce6a0 2024-09-16T01:22:50.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f846959f640 1 -- 172.21.15.81:0/2819975259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8464150080 con 0x7f84640ce6a0 2024-09-16T01:22:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f844b7fe640 1 -- 172.21.15.81:0/2819975259 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845c037040 con 0x7f84640ce6a0 2024-09-16T01:22:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.314+0000 7f846959f640 1 -- 172.21.15.81:0/2819975259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8464150640 con 0x7f84640ce6a0 2024-09-16T01:22:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.315+0000 7f846959f640 1 -- 172.21.15.81:0/2819975259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f846406e730 con 0x7f84640ce6a0 2024-09-16T01:22:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.316+0000 7f844b7fe640 1 -- 172.21.15.81:0/2819975259 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f845c044070 con 0x7f84640ce6a0 2024-09-16T01:22:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.316+0000 7f844b7fe640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f845006c2b0 0x7f845006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.316+0000 7f8462ffd640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f845006c2b0 0x7f845006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.316+0000 7f844b7fe640 1 -- 172.21.15.81:0/2819975259 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f845c0aba50 con 0x7f84640ce6a0 2024-09-16T01:22:50.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.317+0000 7f8462ffd640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f845006c2b0 0x7f845006e770 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f84540074d0 tx=0x7f845400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.321+0000 7f844b7fe640 1 -- 172.21.15.81:0/2819975259 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f845c079fa0 con 0x7f84640ce6a0 2024-09-16T01:22:50.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.486+0000 7f846959f640 1 -- 172.21.15.81:0/2819975259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7f846406d250 con 0x7f84640ce6a0 2024-09-16T01:22:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.492+0000 7f844b7fe640 1 -- 172.21.15.81:0/2819975259 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v49)=0 v49) ==== 128+0+0 (secure 0 0 0) 0x7f845c0798a0 con 0x7f84640ce6a0 2024-09-16T01:22:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.494+0000 7f846959f640 1 -- 172.21.15.81:0/2819975259 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f845006c2b0 msgr2=0x7f845006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.494+0000 7f846959f640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f845006c2b0 0x7f845006e770 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f84540074d0 tx=0x7f845400b040 comp rx=0 tx=0).stop 2024-09-16T01:22:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.494+0000 7f846959f640 1 -- 172.21.15.81:0/2819975259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84640ce6a0 msgr2=0x7f8464152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.494+0000 7f846959f640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84640ce6a0 0x7f8464152530 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f845c0097a0 tx=0x7f845c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.494+0000 7f846959f640 1 -- 172.21.15.81:0/2819975259 shutdown_connections 2024-09-16T01:22:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.494+0000 7f846959f640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f845006c2b0 0x7f845006e770 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.494+0000 7f846959f640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84640ce6a0 0x7f8464152530 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.494+0000 7f846959f640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8464072270 0x7f846414ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.494+0000 7f846959f640 1 --2- 172.21.15.81:0/2819975259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f846406e2d0 0x7f8464151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.494+0000 7f846959f640 1 -- 172.21.15.81:0/2819975259 >> 172.21.15.81:0/2819975259 conn(0x7f846406bc10 msgr2=0x7f84641e8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.494+0000 7f846959f640 1 -- 172.21.15.81:0/2819975259 shutdown_connections 2024-09-16T01:22:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.494+0000 7f846959f640 1 -- 172.21.15.81:0/2819975259 wait complete. 2024-09-16T01:22:50.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-16T01:22:50.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.606+0000 7fe4c5726640 1 Processor -- start 2024-09-16T01:22:50.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.606+0000 7fe4c5726640 1 -- start start 2024-09-16T01:22:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.606+0000 7fe4c5726640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c0162340 0x7fe4c006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.606+0000 7fe4c5726640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4c0162e30 0x7fe4c00d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.606+0000 7fe4c5726640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c015ff70 con 0x7fe4c00cf280 2024-09-16T01:22:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.606+0000 7fe4c5726640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c006de90 con 0x7fe4c0162e30 2024-09-16T01:22:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.606+0000 7fe4c5726640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c00d4d10 con 0x7fe4c0162340 2024-09-16T01:22:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.607+0000 7fe4bf7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4c0162e30 0x7fe4c00d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.607+0000 7fe4bf7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4c0162e30 0x7fe4c00d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37512/0 (socket says 172.21.15.81:37512) 2024-09-16T01:22:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.607+0000 7fe4bf7fe640 1 -- 172.21.15.81:0/2549851043 learned_addr learned my addr 172.21.15.81:0/2549851043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.607+0000 7fe4beffd640 1 --2- 172.21.15.81:0/2549851043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c0162340 0x7fe4c006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.607+0000 7fe4bf7fe640 1 -- 172.21.15.81:0/2549851043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c0162340 msgr2=0x7fe4c006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.607+0000 7fe4bf7fe640 1 --2- 172.21.15.81:0/2549851043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c0162340 0x7fe4c006d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.607+0000 7fe4bf7fe640 1 -- 172.21.15.81:0/2549851043 >> v1:172.21.15.102:6789/0 conn(0x7fe4c00cf280 legacy=0x7fe4c0162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.607+0000 7fe4bf7fe640 1 -- 172.21.15.81:0/2549851043 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c00d4ff0 con 0x7fe4c0162e30 2024-09-16T01:22:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.608+0000 7fe4bf7fe640 1 --2- 172.21.15.81:0/2549851043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0162e30 0x7fe4c00d2990 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009e50 tx=0x7fe4b802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8772cd78e709e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.608+0000 7fe4be7fc640 1 -- 172.21.15.81:0/2549851043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8036070 con 0x7fe4c0162e30 2024-09-16T01:22:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.608+0000 7fe4be7fc640 1 -- 172.21.15.81:0/2549851043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b8031600 con 0x7fe4c0162e30 2024-09-16T01:22:50.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.608+0000 7fe4be7fc640 1 -- 172.21.15.81:0/2549851043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80319d0 con 0x7fe4c0162e30 2024-09-16T01:22:50.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.608+0000 7fe4c5726640 1 -- 172.21.15.81:0/2549851043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0162e30 msgr2=0x7fe4c00d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.608+0000 7fe4c5726640 1 --2- 172.21.15.81:0/2549851043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0162e30 0x7fe4c00d2990 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009e50 tx=0x7fe4b802a680 comp rx=0 tx=0).stop 2024-09-16T01:22:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.608+0000 7fe4c5726640 1 -- 172.21.15.81:0/2549851043 shutdown_connections 2024-09-16T01:22:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.608+0000 7fe4c5726640 1 --2- 172.21.15.81:0/2549851043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0162e30 0x7fe4c00d2990 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.608+0000 7fe4c5726640 1 --2- 172.21.15.81:0/2549851043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c0162340 0x7fe4c006d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.608+0000 7fe4c5726640 1 -- 172.21.15.81:0/2549851043 >> 172.21.15.81:0/2549851043 conn(0x7fe4c008bfc0 msgr2=0x7fe4c00d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.608+0000 7fe4c5726640 1 -- 172.21.15.81:0/2549851043 shutdown_connections 2024-09-16T01:22:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.608+0000 7fe4c5726640 1 -- 172.21.15.81:0/2549851043 wait complete. 2024-09-16T01:22:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.609+0000 7fe4c5726640 1 Processor -- start 2024-09-16T01:22:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.610+0000 7fe4c5726640 1 -- start start 2024-09-16T01:22:50.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.610+0000 7fe4c5726640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00cf280 0x7fe4c01552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.610+0000 7fe4c5726640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c0162340 0x7fe4c00c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.610+0000 7fe4c5726640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c0162e30 0x7fe4c00ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.610+0000 7fe4c5726640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00cf6c0 con 0x7fe4c00cf280 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.610+0000 7fe4c5726640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00d52d0 con 0x7fe4c0162340 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.610+0000 7fe4c5726640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c00d2ed0 con 0x7fe4c0162e30 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.610+0000 7fe4beffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00cf280 0x7fe4c01552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.610+0000 7fe4beffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00cf280 0x7fe4c01552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37518/0 (socket says 172.21.15.81:37518) 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.610+0000 7fe4beffd640 1 -- 172.21.15.81:0/824947008 learned_addr learned my addr 172.21.15.81:0/824947008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4b67fc640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c0162340 0x7fe4c00c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4bf7fe640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c0162e30 0x7fe4c00ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4beffd640 1 -- 172.21.15.81:0/824947008 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c0162e30 msgr2=0x7fe4c00ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4beffd640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c0162e30 0x7fe4c00ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4beffd640 1 -- 172.21.15.81:0/824947008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c0162340 msgr2=0x7fe4c00c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4beffd640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c0162340 0x7fe4c00c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4beffd640 1 -- 172.21.15.81:0/824947008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c0155800 con 0x7fe4c00cf280 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4beffd640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00cf280 0x7fe4c01552c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000e9b0 tx=0x7fe4b000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4b7fff640 1 -- 172.21.15.81:0/824947008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0017070 con 0x7fe4c00cf280 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4b7fff640 1 -- 172.21.15.81:0/824947008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b000c9a0 con 0x7fe4c00cf280 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4c5726640 1 -- 172.21.15.81:0/824947008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c00b95e0 con 0x7fe4c00cf280 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4b7fff640 1 -- 172.21.15.81:0/824947008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b000cd90 con 0x7fe4c00cf280 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.611+0000 7fe4c5726640 1 -- 172.21.15.81:0/824947008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c00b9ba0 con 0x7fe4c00cf280 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.612+0000 7fe4c5726640 1 -- 172.21.15.81:0/824947008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c00d2990 con 0x7fe4c00cf280 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.612+0000 7fe4b7fff640 1 -- 172.21.15.81:0/824947008 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe4b001a070 con 0x7fe4c00cf280 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.613+0000 7fe4b7fff640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a006c2e0 0x7fe4a006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.613+0000 7fe4b7fff640 1 -- 172.21.15.81:0/824947008 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fe4b008b3b0 con 0x7fe4c00cf280 2024-09-16T01:22:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.613+0000 7fe4b67fc640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a006c2e0 0x7fe4a006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.613+0000 7fe4b67fc640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a006c2e0 0x7fe4a006e7a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00a23d0 tx=0x7fe4a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.617+0000 7fe4b7fff640 1 -- 172.21.15.81:0/824947008 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe4b00593d0 con 0x7fe4c00cf280 2024-09-16T01:22:50.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.784+0000 7fe4c5726640 1 -- 172.21.15.81:0/824947008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7fe4c008e640 con 0x7fe4c00cf280 2024-09-16T01:22:50.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.784+0000 7fe4b7fff640 1 -- 172.21.15.81:0/824947008 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v49) ==== 106+0+4 (secure 0 0 0) 0x7fe4b005d6d0 con 0x7fe4c00cf280 2024-09-16T01:22:50.785 INFO:teuthology.orchestra.run.smithi081.stdout:100 2024-09-16T01:22:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.786+0000 7fe4c5726640 1 -- 172.21.15.81:0/824947008 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a006c2e0 msgr2=0x7fe4a006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.786+0000 7fe4c5726640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a006c2e0 0x7fe4a006e7a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00a23d0 tx=0x7fe4a8009040 comp rx=0 tx=0).stop 2024-09-16T01:22:50.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.786+0000 7fe4c5726640 1 -- 172.21.15.81:0/824947008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00cf280 msgr2=0x7fe4c01552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.786+0000 7fe4c5726640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00cf280 0x7fe4c01552c0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000e9b0 tx=0x7fe4b000ee70 comp rx=0 tx=0).stop 2024-09-16T01:22:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.786+0000 7fe4c5726640 1 -- 172.21.15.81:0/824947008 shutdown_connections 2024-09-16T01:22:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.786+0000 7fe4c5726640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe4a006c2e0 0x7fe4a006e7a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.786+0000 7fe4c5726640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c0162e30 0x7fe4c00ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.786+0000 7fe4c5726640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c0162340 0x7fe4c00c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.786+0000 7fe4c5726640 1 --2- 172.21.15.81:0/824947008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c00cf280 0x7fe4c01552c0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.786+0000 7fe4c5726640 1 -- 172.21.15.81:0/824947008 >> 172.21.15.81:0/824947008 conn(0x7fe4c008bfc0 msgr2=0x7fe4c00d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.786+0000 7fe4c5726640 1 -- 172.21.15.81:0/824947008 shutdown_connections 2024-09-16T01:22:50.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.786+0000 7fe4c5726640 1 -- 172.21.15.81:0/824947008 wait complete. 2024-09-16T01:22:50.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 100 2024-09-16T01:22:50.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.900+0000 7f27aeeba640 1 Processor -- start 2024-09-16T01:22:50.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.900+0000 7f27aeeba640 1 -- start start 2024-09-16T01:22:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27aeeba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a815e410 0x7f27a80b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27aeeba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27a806bc10 0x7f27a806c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27aeeba640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27a80ae240 con 0x7f27a80b40c0 2024-09-16T01:22:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27aeeba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f27a806c580 con 0x7f27a806bc10 2024-09-16T01:22:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27aeeba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f27a80ae520 con 0x7f27a815e410 2024-09-16T01:22:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27ad457640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27a806bc10 0x7f27a806c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27a7fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f27a80b40c0 0x7f27a80aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51528/0 (socket says 172.21.15.81:51528) 2024-09-16T01:22:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27a7fff640 1 -- 172.21.15.81:0/4275454469 learned_addr learned my addr 172.21.15.81:0/4275454469 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27acc56640 1 --2- 172.21.15.81:0/4275454469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a815e410 0x7f27a80b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27ad457640 1 -- 172.21.15.81:0/4275454469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a815e410 msgr2=0x7f27a80b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27ad457640 1 --2- 172.21.15.81:0/4275454469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a815e410 0x7f27a80b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27ad457640 1 -- 172.21.15.81:0/4275454469 >> v1:172.21.15.81:6789/0 conn(0x7f27a80b40c0 legacy=0x7f27a80aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27ad457640 1 -- 172.21.15.81:0/4275454469 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a80ae800 con 0x7f27a806bc10 2024-09-16T01:22:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.901+0000 7f27a77fe640 1 -- 172.21.15.81:0/4275454469 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777652394 0 0) 0x7f27a80ae240 con 0x7f27a80b40c0 2024-09-16T01:22:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.902+0000 7f27ad457640 1 --2- 172.21.15.81:0/4275454469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a806bc10 0x7f27a806c040 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009d90 tx=0x7f27a002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5663e3111612b520 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.902+0000 7f27a77fe640 1 -- 172.21.15.81:0/4275454469 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0031600 con 0x7f27a806bc10 2024-09-16T01:22:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.902+0000 7f27a77fe640 1 -- 172.21.15.81:0/4275454469 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a00317a0 con 0x7f27a806bc10 2024-09-16T01:22:50.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.902+0000 7f27a77fe640 1 -- 172.21.15.81:0/4275454469 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0031b70 con 0x7f27a806bc10 2024-09-16T01:22:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.902+0000 7f27aeeba640 1 -- 172.21.15.81:0/4275454469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a806bc10 msgr2=0x7f27a806c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.902+0000 7f27aeeba640 1 --2- 172.21.15.81:0/4275454469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a806bc10 0x7f27a806c040 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009d90 tx=0x7f27a002a5d0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.903+0000 7f27aeeba640 1 -- 172.21.15.81:0/4275454469 shutdown_connections 2024-09-16T01:22:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.903+0000 7f27aeeba640 1 --2- 172.21.15.81:0/4275454469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a806bc10 0x7f27a806c040 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.903+0000 7f27aeeba640 1 --2- 172.21.15.81:0/4275454469 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a815e410 0x7f27a80b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.903+0000 7f27aeeba640 1 -- 172.21.15.81:0/4275454469 >> 172.21.15.81:0/4275454469 conn(0x7f27a809aa30 msgr2=0x7f27a80b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.903+0000 7f27aeeba640 1 -- 172.21.15.81:0/4275454469 shutdown_connections 2024-09-16T01:22:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.903+0000 7f27aeeba640 1 -- 172.21.15.81:0/4275454469 wait complete. 2024-09-16T01:22:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.904+0000 7f27aeeba640 1 Processor -- start 2024-09-16T01:22:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.904+0000 7f27aeeba640 1 -- start start 2024-09-16T01:22:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27aeeba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27a806bc10 0x7f27a81f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27aeeba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a80b40c0 0x7f27a80cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27aeeba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a815e410 0x7f27a80ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27aeeba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27a815e7f0 con 0x7f27a80b40c0 2024-09-16T01:22:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27aeeba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f27a80b4510 con 0x7f27a806bc10 2024-09-16T01:22:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27aeeba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f27a815e970 con 0x7f27a815e410 2024-09-16T01:22:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a80b40c0 0x7f27a80cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a80b40c0 0x7f27a80cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37532/0 (socket says 172.21.15.81:37532) 2024-09-16T01:22:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27a7fff640 1 -- 172.21.15.81:0/1583631848 learned_addr learned my addr 172.21.15.81:0/1583631848 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27ad457640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a815e410 0x7f27a80ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27acc56640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27a806bc10 0x7f27a81f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27a7fff640 1 -- 172.21.15.81:0/1583631848 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a815e410 msgr2=0x7f27a80ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27a7fff640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a815e410 0x7f27a80ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27a7fff640 1 -- 172.21.15.81:0/1583631848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27a806bc10 msgr2=0x7f27a81f7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:50.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27a7fff640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27a806bc10 0x7f27a81f7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27a7fff640 1 -- 172.21.15.81:0/1583631848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a80ccb60 con 0x7f27a80b40c0 2024-09-16T01:22:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27acc56640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27a806bc10 0x7f27a81f7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27ad457640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a815e410 0x7f27a80ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27a7fff640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a80b40c0 0x7f27a80cc3f0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f279400c460 tx=0x7f279400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27a57fa640 1 -- 172.21.15.81:0/1583631848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794018070 con 0x7f27a80b40c0 2024-09-16T01:22:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.905+0000 7f27a57fa640 1 -- 172.21.15.81:0/1583631848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2794007500 con 0x7f27a80b40c0 2024-09-16T01:22:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.906+0000 7f27aeeba640 1 -- 172.21.15.81:0/1583631848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a80cce40 con 0x7f27a80b40c0 2024-09-16T01:22:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.906+0000 7f27a57fa640 1 -- 172.21.15.81:0/1583631848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794004a20 con 0x7f27a80b40c0 2024-09-16T01:22:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.906+0000 7f27aeeba640 1 -- 172.21.15.81:0/1583631848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a80cd400 con 0x7f27a80b40c0 2024-09-16T01:22:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.907+0000 7f27aeeba640 1 -- 172.21.15.81:0/1583631848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a80b4a10 con 0x7f27a80b40c0 2024-09-16T01:22:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.907+0000 7f27a57fa640 1 -- 172.21.15.81:0/1583631848 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2794004bc0 con 0x7f27a80b40c0 2024-09-16T01:22:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.907+0000 7f27a57fa640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f278c06c2b0 0x7f278c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:50.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.908+0000 7f27a57fa640 1 -- 172.21.15.81:0/1583631848 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f279408a8a0 con 0x7f27a80b40c0 2024-09-16T01:22:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.908+0000 7f27acc56640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f278c06c2b0 0x7f278c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.908+0000 7f27acc56640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f278c06c2b0 0x7f278c06e770 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f279c009b90 tx=0x7f279c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:50.912+0000 7f27a57fa640 1 -- 172.21.15.81:0/1583631848 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2794058f10 con 0x7f27a80b40c0 2024-09-16T01:22:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.076+0000 7f27aeeba640 1 -- 172.21.15.81:0/1583631848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7f27a806c040 con 0x7f27a80b40c0 2024-09-16T01:22:51.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.079+0000 7f27a57fa640 1 -- 172.21.15.81:0/1583631848 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v50)=0 v50) ==== 124+0+0 (secure 0 0 0) 0x7f2794058810 con 0x7f27a80b40c0 2024-09-16T01:22:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.081+0000 7f27aeeba640 1 -- 172.21.15.81:0/1583631848 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f278c06c2b0 msgr2=0x7f278c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.081+0000 7f27aeeba640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f278c06c2b0 0x7f278c06e770 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f279c009b90 tx=0x7f279c008040 comp rx=0 tx=0).stop 2024-09-16T01:22:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.081+0000 7f27aeeba640 1 -- 172.21.15.81:0/1583631848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a80b40c0 msgr2=0x7f27a80cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.081+0000 7f27aeeba640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a80b40c0 0x7f27a80cc3f0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f279400c460 tx=0x7f279400c920 comp rx=0 tx=0).stop 2024-09-16T01:22:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.081+0000 7f27aeeba640 1 -- 172.21.15.81:0/1583631848 shutdown_connections 2024-09-16T01:22:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.081+0000 7f27aeeba640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f278c06c2b0 0x7f278c06e770 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.081+0000 7f27aeeba640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27a815e410 0x7f27a80ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.081+0000 7f27aeeba640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27a80b40c0 0x7f27a80cc3f0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.081+0000 7f27aeeba640 1 --2- 172.21.15.81:0/1583631848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27a806bc10 0x7f27a81f7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.081+0000 7f27aeeba640 1 -- 172.21.15.81:0/1583631848 >> 172.21.15.81:0/1583631848 conn(0x7f27a809aa30 msgr2=0x7f27a806ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.081+0000 7f27aeeba640 1 -- 172.21.15.81:0/1583631848 shutdown_connections 2024-09-16T01:22:51.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.081+0000 7f27aeeba640 1 -- 172.21.15.81:0/1583631848 wait complete. 2024-09-16T01:22:51.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_max_caps_per_client 2024-09-16T01:22:51.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.193+0000 7f8097ba6640 1 Processor -- start 2024-09-16T01:22:51.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.193+0000 7f8097ba6640 1 -- start start 2024-09-16T01:22:51.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8097ba6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f809015e640 0x7f80900d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8097ba6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80900d5100 0x7f80900cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8097ba6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80900d3a60 con 0x7f80901621b0 2024-09-16T01:22:51.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8097ba6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f80900cec40 con 0x7f80900d5100 2024-09-16T01:22:51.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8097ba6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f80900cef20 con 0x7f809015e640 2024-09-16T01:22:51.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8095141640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80900d5100 0x7f80900cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8095141640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f80900d5100 0x7f80900cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51690/0 (socket says 172.21.15.81:51690) 2024-09-16T01:22:51.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8095141640 1 -- 172.21.15.81:0/655693817 learned_addr learned my addr 172.21.15.81:0/655693817 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:51.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8095942640 1 --2- 172.21.15.81:0/655693817 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f809015e640 0x7f80900d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8095141640 1 -- 172.21.15.81:0/655693817 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f809015e640 msgr2=0x7f80900d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:51.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8095141640 1 --2- 172.21.15.81:0/655693817 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f809015e640 0x7f80900d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8095141640 1 -- 172.21.15.81:0/655693817 >> v1:172.21.15.102:6789/0 conn(0x7f80901621b0 legacy=0x7f809006ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8095141640 1 -- 172.21.15.81:0/655693817 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80900cf200 con 0x7f80900d5100 2024-09-16T01:22:51.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.194+0000 7f8095942640 1 --2- 172.21.15.81:0/655693817 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f809015e640 0x7f80900d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:51.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.195+0000 7f8095141640 1 --2- 172.21.15.81:0/655693817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80900d5100 0x7f80900cfa00 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f808c009870 tx=0x7f808c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe6e6b5a0d1ab3d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:51.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.195+0000 7f8094940640 1 -- 172.21.15.81:0/655693817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c037070 con 0x7f80900d5100 2024-09-16T01:22:51.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.195+0000 7f8094940640 1 -- 172.21.15.81:0/655693817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f808c02ae50 con 0x7f80900d5100 2024-09-16T01:22:51.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.195+0000 7f8094940640 1 -- 172.21.15.81:0/655693817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c032860 con 0x7f80900d5100 2024-09-16T01:22:51.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.196+0000 7f8097ba6640 1 -- 172.21.15.81:0/655693817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80900d5100 msgr2=0x7f80900cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.196+0000 7f8097ba6640 1 --2- 172.21.15.81:0/655693817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80900d5100 0x7f80900cfa00 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f808c009870 tx=0x7f808c02a300 comp rx=0 tx=0).stop 2024-09-16T01:22:51.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.196+0000 7f8097ba6640 1 -- 172.21.15.81:0/655693817 shutdown_connections 2024-09-16T01:22:51.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.196+0000 7f8097ba6640 1 --2- 172.21.15.81:0/655693817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80900d5100 0x7f80900cfa00 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.196+0000 7f8097ba6640 1 --2- 172.21.15.81:0/655693817 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f809015e640 0x7f80900d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.196+0000 7f8097ba6640 1 -- 172.21.15.81:0/655693817 >> 172.21.15.81:0/655693817 conn(0x7f809008bfc0 msgr2=0x7f80900d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:51.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.196+0000 7f8097ba6640 1 -- 172.21.15.81:0/655693817 shutdown_connections 2024-09-16T01:22:51.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.196+0000 7f8097ba6640 1 -- 172.21.15.81:0/655693817 wait complete. 2024-09-16T01:22:51.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.197+0000 7f8097ba6640 1 Processor -- start 2024-09-16T01:22:51.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.197+0000 7f8097ba6640 1 -- start start 2024-09-16T01:22:51.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8097ba6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80900d5100 0x7f80900b9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8097ba6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f809015e640 0x7f80900b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8097ba6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80901621b0 0x7f8090153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8097ba6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f80900d3720 con 0x7f80900d5100 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8097ba6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f809015ea20 con 0x7f809015e640 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8097ba6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f80900cff40 con 0x7f80901621b0 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8095942640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80900d5100 0x7f80900b9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8095942640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80900d5100 0x7f80900b9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51692/0 (socket says 172.21.15.81:51692) 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8095942640 1 -- 172.21.15.81:0/4022298564 learned_addr learned my addr 172.21.15.81:0/4022298564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8095141640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f809015e640 0x7f80900b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8096143640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80901621b0 0x7f8090153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8095942640 1 -- 172.21.15.81:0/4022298564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80901621b0 msgr2=0x7f8090153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8095942640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80901621b0 0x7f8090153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8095942640 1 -- 172.21.15.81:0/4022298564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f809015e640 msgr2=0x7f80900b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8095942640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f809015e640 0x7f80900b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8095942640 1 -- 172.21.15.81:0/4022298564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80900b60c0 con 0x7f80900d5100 2024-09-16T01:22:51.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8096143640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80901621b0 0x7f8090153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:22:51.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.198+0000 7f8095942640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80900d5100 0x7f80900b9f00 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f808400e810 tx=0x7f808400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:51.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.199+0000 7f80827fc640 1 -- 172.21.15.81:0/4022298564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808400f040 con 0x7f80900d5100 2024-09-16T01:22:51.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.199+0000 7f80827fc640 1 -- 172.21.15.81:0/4022298564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8084004030 con 0x7f80900d5100 2024-09-16T01:22:51.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.199+0000 7f8097ba6640 1 -- 172.21.15.81:0/4022298564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80900cb6c0 con 0x7f80900d5100 2024-09-16T01:22:51.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.199+0000 7f80827fc640 1 -- 172.21.15.81:0/4022298564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084004400 con 0x7f80900d5100 2024-09-16T01:22:51.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.199+0000 7f8097ba6640 1 -- 172.21.15.81:0/4022298564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80900cbc80 con 0x7f80900d5100 2024-09-16T01:22:51.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.200+0000 7f8097ba6640 1 -- 172.21.15.81:0/4022298564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80900cfa00 con 0x7f80900d5100 2024-09-16T01:22:51.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.200+0000 7f80827fc640 1 -- 172.21.15.81:0/4022298564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f808400c6d0 con 0x7f80900d5100 2024-09-16T01:22:51.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.201+0000 7f80827fc640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f807406c2e0 0x7f807406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.201+0000 7f80827fc640 1 -- 172.21.15.81:0/4022298564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f808408b270 con 0x7f80900d5100 2024-09-16T01:22:51.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.201+0000 7f8095141640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f807406c2e0 0x7f807406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.201+0000 7f8095141640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f807406c2e0 0x7f807406e7a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f808c034000 tx=0x7f808c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:51.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.205+0000 7f80827fc640 1 -- 172.21.15.81:0/4022298564 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8084017020 con 0x7f80900d5100 2024-09-16T01:22:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.371+0000 7f8097ba6640 1 -- 172.21.15.81:0/4022298564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"} v 0) -- 0x7f80900ba4d0 con 0x7f80900d5100 2024-09-16T01:22:51.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.371+0000 7f80827fc640 1 -- 172.21.15.81:0/4022298564 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"}]=0 v50) ==== 106+0+8 (secure 0 0 0) 0x7f8084059290 con 0x7f80900d5100 2024-09-16T01:22:51.372 INFO:teuthology.orchestra.run.smithi081.stdout:1048576 2024-09-16T01:22:51.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.373+0000 7f8097ba6640 1 -- 172.21.15.81:0/4022298564 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f807406c2e0 msgr2=0x7f807406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.373+0000 7f8097ba6640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f807406c2e0 0x7f807406e7a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f808c034000 tx=0x7f808c02e000 comp rx=0 tx=0).stop 2024-09-16T01:22:51.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.373+0000 7f8097ba6640 1 -- 172.21.15.81:0/4022298564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80900d5100 msgr2=0x7f80900b9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.373+0000 7f8097ba6640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80900d5100 0x7f80900b9f00 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f808400e810 tx=0x7f808400ecd0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.373+0000 7f8097ba6640 1 -- 172.21.15.81:0/4022298564 shutdown_connections 2024-09-16T01:22:51.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.373+0000 7f8097ba6640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f807406c2e0 0x7f807406e7a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.373+0000 7f8097ba6640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f80901621b0 0x7f8090153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.373+0000 7f8097ba6640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f809015e640 0x7f80900b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.373+0000 7f8097ba6640 1 --2- 172.21.15.81:0/4022298564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80900d5100 0x7f80900b9f00 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.373+0000 7f8097ba6640 1 -- 172.21.15.81:0/4022298564 >> 172.21.15.81:0/4022298564 conn(0x7f809008bfc0 msgr2=0x7f809006db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:51.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.373+0000 7f8097ba6640 1 -- 172.21.15.81:0/4022298564 shutdown_connections 2024-09-16T01:22:51.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.373+0000 7f8097ba6640 1 -- 172.21.15.81:0/4022298564 wait complete. 2024-09-16T01:22:51.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-09-16T01:22:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.484+0000 7f4caece6640 1 Processor -- start 2024-09-16T01:22:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.484+0000 7f4caece6640 1 -- start start 2024-09-16T01:22:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.485+0000 7f4caece6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ca80d5100 0x7f4ca80cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.485+0000 7f4caece6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca80d3a60 con 0x7f4ca815e640 2024-09-16T01:22:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.485+0000 7f4caece6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca80cec40 con 0x7f4ca81621b0 2024-09-16T01:22:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.485+0000 7f4caece6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4ca80cef20 con 0x7f4ca80d5100 2024-09-16T01:22:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.485+0000 7f4caca82640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4ca815e640 0x7f4ca80d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38162/0 (socket says 172.21.15.81:38162) 2024-09-16T01:22:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.485+0000 7f4ca7fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ca80d5100 0x7f4ca80cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.485+0000 7f4caca82640 1 -- 172.21.15.81:0/1136448410 learned_addr learned my addr 172.21.15.81:0/1136448410 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.486+0000 7f4ca7fff640 1 -- 172.21.15.81:0/1136448410 >> v1:172.21.15.102:6789/0 conn(0x7f4ca81621b0 legacy=0x7f4ca806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.486+0000 7f4ca7fff640 1 -- 172.21.15.81:0/1136448410 >> v1:172.21.15.81:6789/0 conn(0x7f4ca815e640 legacy=0x7f4ca80d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.486+0000 7f4ca7fff640 1 -- 172.21.15.81:0/1136448410 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca80cf200 con 0x7f4ca80d5100 2024-09-16T01:22:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.486+0000 7f4ca77fe640 1 -- 172.21.15.81:0/1136448410 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2437548175 0 0) 0x7f4ca80d3a60 con 0x7f4ca815e640 2024-09-16T01:22:51.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.486+0000 7f4ca7fff640 1 --2- 172.21.15.81:0/1136448410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca80d5100 0x7f4ca80cfa00 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009d90 tx=0x7f4c9c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ba676408cb7084 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:51.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.487+0000 7f4ca77fe640 1 -- 172.21.15.81:0/1136448410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c007740 con 0x7f4ca80d5100 2024-09-16T01:22:51.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.487+0000 7f4ca77fe640 1 -- 172.21.15.81:0/1136448410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c9c0078e0 con 0x7f4ca80d5100 2024-09-16T01:22:51.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.487+0000 7f4ca77fe640 1 -- 172.21.15.81:0/1136448410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c007cb0 con 0x7f4ca80d5100 2024-09-16T01:22:51.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.487+0000 7f4caece6640 1 -- 172.21.15.81:0/1136448410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca80d5100 msgr2=0x7f4ca80cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.487+0000 7f4caece6640 1 --2- 172.21.15.81:0/1136448410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca80d5100 0x7f4ca80cfa00 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009d90 tx=0x7f4c9c02a730 comp rx=0 tx=0).stop 2024-09-16T01:22:51.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.487+0000 7f4caece6640 1 -- 172.21.15.81:0/1136448410 shutdown_connections 2024-09-16T01:22:51.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.487+0000 7f4caece6640 1 --2- 172.21.15.81:0/1136448410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca80d5100 0x7f4ca80cfa00 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.487+0000 7f4caece6640 1 -- 172.21.15.81:0/1136448410 >> 172.21.15.81:0/1136448410 conn(0x7f4ca808bfc0 msgr2=0x7f4ca80d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:51.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.487+0000 7f4caece6640 1 -- 172.21.15.81:0/1136448410 shutdown_connections 2024-09-16T01:22:51.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.487+0000 7f4caece6640 1 -- 172.21.15.81:0/1136448410 wait complete. 2024-09-16T01:22:51.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.488+0000 7f4caece6640 1 Processor -- start 2024-09-16T01:22:51.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.488+0000 7f4caece6640 1 -- start start 2024-09-16T01:22:51.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.489+0000 7f4caece6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca80d5100 0x7f4ca8160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.489+0000 7f4caece6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ca815e640 0x7f4ca81f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.489+0000 7f4caece6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ca81621b0 0x7f4ca814d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.489+0000 7f4caece6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca80cff40 con 0x7f4ca80d5100 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.489+0000 7f4caece6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca815ea20 con 0x7f4ca81621b0 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.489+0000 7f4caece6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca80d00c0 con 0x7f4ca815e640 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.489+0000 7f4caca82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca80d5100 0x7f4ca8160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.489+0000 7f4caca82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca80d5100 0x7f4ca8160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51716/0 (socket says 172.21.15.81:51716) 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.489+0000 7f4caca82640 1 -- 172.21.15.81:0/1764335943 learned_addr learned my addr 172.21.15.81:0/1764335943 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.489+0000 7f4cad283640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ca81621b0 0x7f4ca814d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.490+0000 7f4ca7fff640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ca815e640 0x7f4ca81f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.490+0000 7f4caca82640 1 -- 172.21.15.81:0/1764335943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ca815e640 msgr2=0x7f4ca81f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.490+0000 7f4caca82640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ca815e640 0x7f4ca81f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.490+0000 7f4caca82640 1 -- 172.21.15.81:0/1764335943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ca81621b0 msgr2=0x7f4ca814d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.490+0000 7f4caca82640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ca81621b0 0x7f4ca814d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.490+0000 7f4caca82640 1 -- 172.21.15.81:0/1764335943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca8161450 con 0x7f4ca80d5100 2024-09-16T01:22:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.490+0000 7f4caca82640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca80d5100 0x7f4ca8160d70 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800c4d0 tx=0x7f4c9800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.490+0000 7f4ca57fa640 1 -- 172.21.15.81:0/1764335943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98018070 con 0x7f4ca80d5100 2024-09-16T01:22:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.490+0000 7f4ca57fa640 1 -- 172.21.15.81:0/1764335943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c98007500 con 0x7f4ca80d5100 2024-09-16T01:22:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.490+0000 7f4ca57fa640 1 -- 172.21.15.81:0/1764335943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98004a20 con 0x7f4ca80d5100 2024-09-16T01:22:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.490+0000 7f4caece6640 1 -- 172.21.15.81:0/1764335943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca8161730 con 0x7f4ca80d5100 2024-09-16T01:22:51.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.490+0000 7f4caece6640 1 -- 172.21.15.81:0/1764335943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca8161cf0 con 0x7f4ca80d5100 2024-09-16T01:22:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.491+0000 7f4caece6640 1 -- 172.21.15.81:0/1764335943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca80cfa00 con 0x7f4ca80d5100 2024-09-16T01:22:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.491+0000 7f4ca57fa640 1 -- 172.21.15.81:0/1764335943 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4c98004bc0 con 0x7f4ca80d5100 2024-09-16T01:22:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.492+0000 7f4ca57fa640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c9406c2b0 0x7f4c9406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.492+0000 7f4ca57fa640 1 -- 172.21.15.81:0/1764335943 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f4c9808a8c0 con 0x7f4ca80d5100 2024-09-16T01:22:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.492+0000 7f4ca7fff640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c9406c2b0 0x7f4c9406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.492+0000 7f4ca7fff640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c9406c2b0 0x7f4c9406e770 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c034000 tx=0x7f4c9c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:51.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.496+0000 7f4ca57fa640 1 -- 172.21.15.81:0/1764335943 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c98058ea0 con 0x7f4ca80d5100 2024-09-16T01:22:51.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.663+0000 7f4caece6640 1 -- 172.21.15.81:0/1764335943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7f4ca80ba4d0 con 0x7f4ca80d5100 2024-09-16T01:22:51.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.663+0000 7f4ca57fa640 1 -- 172.21.15.81:0/1764335943 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v50) ==== 112+0+10 (secure 0 0 0) 0x7f4c980587a0 con 0x7f4ca80d5100 2024-09-16T01:22:51.664 INFO:teuthology.orchestra.run.smithi081.stdout:60.000000 2024-09-16T01:22:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.665+0000 7f4caece6640 1 -- 172.21.15.81:0/1764335943 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c9406c2b0 msgr2=0x7f4c9406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.665+0000 7f4caece6640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c9406c2b0 0x7f4c9406e770 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c034000 tx=0x7f4c9c02f000 comp rx=0 tx=0).stop 2024-09-16T01:22:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.665+0000 7f4caece6640 1 -- 172.21.15.81:0/1764335943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca80d5100 msgr2=0x7f4ca8160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.665+0000 7f4caece6640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca80d5100 0x7f4ca8160d70 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800c4d0 tx=0x7f4c9800c990 comp rx=0 tx=0).stop 2024-09-16T01:22:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.665+0000 7f4caece6640 1 -- 172.21.15.81:0/1764335943 shutdown_connections 2024-09-16T01:22:51.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.665+0000 7f4caece6640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4c9406c2b0 0x7f4c9406e770 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.665+0000 7f4caece6640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ca81621b0 0x7f4ca814d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.665+0000 7f4caece6640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4ca815e640 0x7f4ca81f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.665+0000 7f4caece6640 1 --2- 172.21.15.81:0/1764335943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ca80d5100 0x7f4ca8160d70 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.665+0000 7f4caece6640 1 -- 172.21.15.81:0/1764335943 >> 172.21.15.81:0/1764335943 conn(0x7f4ca808bfc0 msgr2=0x7f4ca81e7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:51.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.665+0000 7f4caece6640 1 -- 172.21.15.81:0/1764335943 shutdown_connections 2024-09-16T01:22:51.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.665+0000 7f4caece6640 1 -- 172.21.15.81:0/1764335943 wait complete. 2024-09-16T01:22:51.680 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:22:51.681 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:51.696 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:22:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:22:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:22:51.791 INFO:teuthology.orchestra.run.smithi081.stdout:client6832 2024-09-16T01:22:51.791 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:22:51.792 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:22:51.808 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-16T01:22:51.808 DEBUG:teuthology.orchestra.run.smithi081:> import fcntl 2024-09-16T01:22:51.808 DEBUG:teuthology.orchestra.run.smithi081:> import sys 2024-09-16T01:22:51.808 DEBUG:teuthology.orchestra.run.smithi081:> import time 2024-09-16T01:22:51.808 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-16T01:22:51.808 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:22:51.808 DEBUG:teuthology.orchestra.run.smithi081:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-16T01:22:51.808 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:22:51.808 DEBUG:teuthology.orchestra.run.smithi081:> n = 200 2024-09-16T01:22:51.808 DEBUG:teuthology.orchestra.run.smithi081:> abs_path = "/home/ubuntu/cephtest/mnt.0/subdir" 2024-09-16T01:22:51.808 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> if not os.path.exists(abs_path): 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> os.makedirs(abs_path) 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> handles = [] 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> for i in range(0, n): 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> fname = "file_"+str(i) 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> path = os.path.join(abs_path, fname) 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> handles.append(open(path, '"'"'w'"'"')) 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> print("waiting with handles open", file=sys.stderr) 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> while True: 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> print("open_n_background: keeping files open", file=sys.stderr) 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-16T01:22:51.809 DEBUG:teuthology.orchestra.run.smithi081:> if os.read(0, 4096) == b"": 2024-09-16T01:22:51.810 DEBUG:teuthology.orchestra.run.smithi081:> break 2024-09-16T01:22:51.810 DEBUG:teuthology.orchestra.run.smithi081:> except BlockingIOError: 2024-09-16T01:22:51.810 DEBUG:teuthology.orchestra.run.smithi081:> pass 2024-09-16T01:22:51.810 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(2) 2024-09-16T01:22:51.810 DEBUG:teuthology.orchestra.run.smithi081:> print("stdin closed, goodbye!", file=sys.stderr) 2024-09-16T01:22:51.810 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-16T01:22:51.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:22:51.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.950+0000 7f6b49065640 1 Processor -- start 2024-09-16T01:22:51.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.950+0000 7f6b49065640 1 -- start start 2024-09-16T01:22:51.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b49065640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b4415e990 0x7f6b440b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b49065640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6b440ae140 0x7f6b440ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b49065640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b440aeb10 con 0x7f6b4415e5b0 2024-09-16T01:22:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b49065640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6b440b2c30 con 0x7f6b4415e990 2024-09-16T01:22:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b49065640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6b440b17f0 con 0x7f6b440ae140 2024-09-16T01:22:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b4259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b4415e990 0x7f6b440b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b4259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b4415e990 0x7f6b440b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51720/0 (socket says 172.21.15.81:51720) 2024-09-16T01:22:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b42d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6b4415e5b0 0x7f6b440b2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38166/0 (socket says 172.21.15.81:38166) 2024-09-16T01:22:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b4259c640 1 -- 172.21.15.81:0/430263466 learned_addr learned my addr 172.21.15.81:0/430263466 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b4359e640 1 --2- 172.21.15.81:0/430263466 >> v2:172.21.15.102:3300/0 conn(0x7f6b440ae140 0x7f6b440ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b4259c640 1 -- 172.21.15.81:0/430263466 >> v2:172.21.15.102:3300/0 conn(0x7f6b440ae140 msgr2=0x7f6b440ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b4259c640 1 --2- 172.21.15.81:0/430263466 >> v2:172.21.15.102:3300/0 conn(0x7f6b440ae140 0x7f6b440ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b4259c640 1 -- 172.21.15.81:0/430263466 >> v1:172.21.15.81:6789/0 conn(0x7f6b4415e5b0 legacy=0x7f6b440b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b41d9b640 1 -- 172.21.15.81:0/430263466 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 915512878 0 0) 0x7f6b440aeb10 con 0x7f6b4415e5b0 2024-09-16T01:22:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.951+0000 7f6b4259c640 1 -- 172.21.15.81:0/430263466 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b440b6520 con 0x7f6b4415e990 2024-09-16T01:22:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.952+0000 7f6b4259c640 1 --2- 172.21.15.81:0/430263466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4415e990 0x7f6b440b5f40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f6b440b4c20 tx=0x7f6b3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bf657d7843dfff server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.952+0000 7f6b41d9b640 1 -- 172.21.15.81:0/430263466 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38037070 con 0x7f6b4415e990 2024-09-16T01:22:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.952+0000 7f6b41d9b640 1 -- 172.21.15.81:0/430263466 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b38032440 con 0x7f6b4415e990 2024-09-16T01:22:51.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.952+0000 7f6b41d9b640 1 -- 172.21.15.81:0/430263466 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38032810 con 0x7f6b4415e990 2024-09-16T01:22:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.953+0000 7f6b49065640 1 -- 172.21.15.81:0/430263466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4415e990 msgr2=0x7f6b440b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.953+0000 7f6b49065640 1 --2- 172.21.15.81:0/430263466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4415e990 0x7f6b440b5f40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f6b440b4c20 tx=0x7f6b3802a270 comp rx=0 tx=0).stop 2024-09-16T01:22:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.953+0000 7f6b49065640 1 -- 172.21.15.81:0/430263466 shutdown_connections 2024-09-16T01:22:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.953+0000 7f6b49065640 1 --2- 172.21.15.81:0/430263466 >> v2:172.21.15.102:3300/0 conn(0x7f6b440ae140 0x7f6b440ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.953+0000 7f6b49065640 1 --2- 172.21.15.81:0/430263466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4415e990 0x7f6b440b5f40 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.953+0000 7f6b49065640 1 -- 172.21.15.81:0/430263466 >> 172.21.15.81:0/430263466 conn(0x7f6b44073490 msgr2=0x7f6b440b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.953+0000 7f6b49065640 1 -- 172.21.15.81:0/430263466 shutdown_connections 2024-09-16T01:22:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.953+0000 7f6b49065640 1 -- 172.21.15.81:0/430263466 wait complete. 2024-09-16T01:22:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.954+0000 7f6b49065640 1 Processor -- start 2024-09-16T01:22:51.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.954+0000 7f6b49065640 1 -- start start 2024-09-16T01:22:51.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b49065640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b440ae140 0x7f6b44148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b49065640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b4415e5b0 0x7f6b441f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b49065640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4415e990 0x7f6b441f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b49065640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6b440b2000 con 0x7f6b4415e990 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b49065640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6b440b1d20 con 0x7f6b4415e5b0 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b49065640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6b440b0490 con 0x7f6b440ae140 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b4359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4415e990 0x7f6b441f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b4359e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4415e990 0x7f6b441f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51724/0 (socket says 172.21.15.81:51724) 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b4359e640 1 -- 172.21.15.81:0/595297959 learned_addr learned my addr 172.21.15.81:0/595297959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b42d9d640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b440ae140 0x7f6b44148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b4259c640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b4415e5b0 0x7f6b441f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b4359e640 1 -- 172.21.15.81:0/595297959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b440ae140 msgr2=0x7f6b44148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b4359e640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b440ae140 0x7f6b44148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b4359e640 1 -- 172.21.15.81:0/595297959 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b4415e5b0 msgr2=0x7f6b441f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b4359e640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b4415e5b0 0x7f6b441f7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.955+0000 7f6b4359e640 1 -- 172.21.15.81:0/595297959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b44160820 con 0x7f6b4415e990 2024-09-16T01:22:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.956+0000 7f6b4359e640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4415e990 0x7f6b441f7ba0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00cc30 tx=0x7f6b3c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.956+0000 7f6b2b7fe640 1 -- 172.21.15.81:0/595297959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00ce40 con 0x7f6b4415e990 2024-09-16T01:22:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.956+0000 7f6b2b7fe640 1 -- 172.21.15.81:0/595297959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c003990 con 0x7f6b4415e990 2024-09-16T01:22:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.956+0000 7f6b49065640 1 -- 172.21.15.81:0/595297959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4415fc10 con 0x7f6b4415e990 2024-09-16T01:22:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.956+0000 7f6b2b7fe640 1 -- 172.21.15.81:0/595297959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c003d40 con 0x7f6b4415e990 2024-09-16T01:22:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.956+0000 7f6b49065640 1 -- 172.21.15.81:0/595297959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b441604b0 con 0x7f6b4415e990 2024-09-16T01:22:51.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.957+0000 7f6b49065640 1 -- 172.21.15.81:0/595297959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b440b5f40 con 0x7f6b4415e990 2024-09-16T01:22:51.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.958+0000 7f6b2b7fe640 1 -- 172.21.15.81:0/595297959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6b3c004000 con 0x7f6b4415e990 2024-09-16T01:22:51.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.958+0000 7f6b2b7fe640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6b3006c2b0 0x7f6b3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:51.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.958+0000 7f6b2b7fe640 1 -- 172.21.15.81:0/595297959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f6b3c08b9d0 con 0x7f6b4415e990 2024-09-16T01:22:51.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.958+0000 7f6b42d9d640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6b3006c2b0 0x7f6b3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:51.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.959+0000 7f6b42d9d640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6b3006c2b0 0x7f6b3006e770 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6b34000f60 tx=0x7f6b34007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:51.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:51.966+0000 7f6b2b7fe640 1 -- 172.21.15.81:0/595297959 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b3c014030 con 0x7f6b4415e990 2024-09-16T01:22:52.048 INFO:teuthology.orchestra.run.smithi081.stderr:waiting with handles open 2024-09-16T01:22:52.048 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:22:52.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.172+0000 7f6b49065640 1 -- 172.21.15.81:0/595297959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b4415ce50 con 0x7f6b4415e990 2024-09-16T01:22:52.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.172+0000 7f6b2b7fe640 1 -- 172.21.15.81:0/595297959 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5228 (secure 0 0 0) 0x7f6b3c059960 con 0x7f6b4415e990 2024-09-16T01:22:52.174 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:52.174 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"btime":"2024-09-16T01:22:40:479014+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3471922615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3471922615},{"type":"v1","addr":"172.21.15.102:6834","nonce":3471922615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6697,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/749780612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":749780612},{"type":"v1","addr":"172.21.15.81:6837","nonce":749780612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2257484883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":2257484883},{"type":"v1","addr":"172.21.15.102:6835","nonce":2257484883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:37.794648+0000","modified":"2024-09-16T01:22:39.814024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7674},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7674":{"gid":7674,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/2398957156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2398957156},{"type":"v1","addr":"172.21.15.81:6835","nonce":2398957156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7674,"qdb_cluster":[7674]},"id":9}]} 2024-09-16T01:22:52.174 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 66 2024-09-16T01:22:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.175+0000 7f6b49065640 1 -- 172.21.15.81:0/595297959 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6b3006c2b0 msgr2=0x7f6b3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.175+0000 7f6b49065640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6b3006c2b0 0x7f6b3006e770 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6b34000f60 tx=0x7f6b34007d50 comp rx=0 tx=0).stop 2024-09-16T01:22:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.175+0000 7f6b49065640 1 -- 172.21.15.81:0/595297959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4415e990 msgr2=0x7f6b441f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.175+0000 7f6b49065640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4415e990 0x7f6b441f7ba0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00cc30 tx=0x7f6b3c00a5c0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.175+0000 7f6b49065640 1 -- 172.21.15.81:0/595297959 shutdown_connections 2024-09-16T01:22:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.175+0000 7f6b49065640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6b3006c2b0 0x7f6b3006e770 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.175+0000 7f6b49065640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b4415e990 0x7f6b441f7ba0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.175+0000 7f6b49065640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b4415e5b0 0x7f6b441f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.175+0000 7f6b49065640 1 --2- 172.21.15.81:0/595297959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b440ae140 0x7f6b44148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.175+0000 7f6b49065640 1 -- 172.21.15.81:0/595297959 >> 172.21.15.81:0/595297959 conn(0x7f6b44073490 msgr2=0x7f6b440b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:52.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.175+0000 7f6b49065640 1 -- 172.21.15.81:0/595297959 shutdown_connections 2024-09-16T01:22:52.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.175+0000 7f6b49065640 1 -- 172.21.15.81:0/595297959 wait complete. 2024-09-16T01:22:52.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-16T01:22:52.304 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":7845,"entity":{"name":{"type":"client","num":7845},"addr":{"type":"v1","addr":"172.21.15.102:0","nonce":2936403614}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":2.8759419460000002,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9916266147622457,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7845 v1:172.21.15.102:0/2936403614","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi102","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":6832,"entity":{"name":{"type":"client","num":6832},"addr":{"type":"v1","addr":"172.21.15.81:0","nonce":120916560}},"state":"open","num_leases":1,"num_caps":202,"request_load_avg":226,"uptime":4.0069191159999997,"requests_in_flight":200,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":404.69930656080408,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.6832 v1:172.21.15.81:0/120916560","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi081","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-16T01:22:52.304 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi102", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.102:0", "nonce": 2936403614, "type": "v1" }, "name": { "num": 7845, "type": "client" } }, "id": 7845, "inst": "client.7845 v1:172.21.15.102:0/2936403614", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9916266147622457 }, "state": "open", "uptime": 2.875941946 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi081", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 120916560, "type": "v1" }, "name": { "num": 6832, "type": "client" } }, "id": 6832, "inst": "client.6832 v1:172.21.15.81:0/120916560", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 202, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 226, "requests_in_flight": 200, "session_cache_liveness": { "halflife": 300, "value": 404.6993065608041 }, "state": "open", "uptime": 4.006919116 } ] 2024-09-16T01:22:52.305 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-09-16T01:22:52.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:22:52.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.401+0000 7f136948d640 1 Processor -- start 2024-09-16T01:22:52.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.401+0000 7f136948d640 1 -- start start 2024-09-16T01:22:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.402+0000 7f136948d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13640b43f0 0x7f136409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.402+0000 7f136948d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13640b3830 con 0x7f136415b340 2024-09-16T01:22:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.402+0000 7f136948d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13640b5610 con 0x7f13640b5050 2024-09-16T01:22:52.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.402+0000 7f136948d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f13640b5bd0 con 0x7f13640b43f0 2024-09-16T01:22:52.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.402+0000 7f13627fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13640b43f0 0x7f136409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:52.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.403+0000 7f13627fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13640b43f0 0x7f136409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51730/0 (socket says 172.21.15.81:51730) 2024-09-16T01:22:52.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.402+0000 7f1362ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f136415b340 0x7f13640b4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38170/0 (socket says 172.21.15.81:38170) 2024-09-16T01:22:52.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.403+0000 7f13627fc640 1 -- 172.21.15.81:0/76289220 learned_addr learned my addr 172.21.15.81:0/76289220 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:52.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.403+0000 7f13627fc640 1 -- 172.21.15.81:0/76289220 >> v1:172.21.15.102:6789/0 conn(0x7f13640b5050 legacy=0x7f136415b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:52.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.403+0000 7f13627fc640 1 -- 172.21.15.81:0/76289220 >> v1:172.21.15.81:6789/0 conn(0x7f136415b340 legacy=0x7f13640b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.403+0000 7f13627fc640 1 -- 172.21.15.81:0/76289220 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13640b58f0 con 0x7f13640b43f0 2024-09-16T01:22:52.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.403+0000 7f13627fc640 1 --2- 172.21.15.81:0/76289220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13640b43f0 0x7f136409aa30 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f1358009870 tx=0x7f135802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fbe75bf638b4b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:52.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.404+0000 7f1361ffb640 1 -- 172.21.15.81:0/76289220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358037070 con 0x7f13640b43f0 2024-09-16T01:22:52.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.404+0000 7f1361ffb640 1 -- 172.21.15.81:0/76289220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1358032440 con 0x7f13640b43f0 2024-09-16T01:22:52.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.404+0000 7f1361ffb640 1 -- 172.21.15.81:0/76289220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358032810 con 0x7f13640b43f0 2024-09-16T01:22:52.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.404+0000 7f136948d640 1 -- 172.21.15.81:0/76289220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13640b43f0 msgr2=0x7f136409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.404+0000 7f136948d640 1 --2- 172.21.15.81:0/76289220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13640b43f0 0x7f136409aa30 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f1358009870 tx=0x7f135802a210 comp rx=0 tx=0).stop 2024-09-16T01:22:52.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.404+0000 7f136948d640 1 -- 172.21.15.81:0/76289220 shutdown_connections 2024-09-16T01:22:52.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.404+0000 7f136948d640 1 --2- 172.21.15.81:0/76289220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13640b43f0 0x7f136409aa30 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.404+0000 7f136948d640 1 -- 172.21.15.81:0/76289220 >> 172.21.15.81:0/76289220 conn(0x7f1364073490 msgr2=0x7f13640b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:52.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.404+0000 7f136948d640 1 -- 172.21.15.81:0/76289220 shutdown_connections 2024-09-16T01:22:52.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.404+0000 7f136948d640 1 -- 172.21.15.81:0/76289220 wait complete. 2024-09-16T01:22:52.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.406+0000 7f136948d640 1 Processor -- start 2024-09-16T01:22:52.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.406+0000 7f136948d640 1 -- start start 2024-09-16T01:22:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.406+0000 7f136948d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13640b43f0 0x7f1364145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.406+0000 7f136948d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13640b5050 0x7f136414fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.406+0000 7f136948d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f136415b340 0x7f1364155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:52.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.406+0000 7f136948d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13640cdb30 con 0x7f136415b340 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.406+0000 7f136948d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f136415d8f0 con 0x7f13640b43f0 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.406+0000 7f136948d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f13640cdcb0 con 0x7f13640b5050 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f13637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f136415b340 0x7f1364155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f13637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f136415b340 0x7f1364155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51744/0 (socket says 172.21.15.81:51744) 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f13637fe640 1 -- 172.21.15.81:0/4085592912 learned_addr learned my addr 172.21.15.81:0/4085592912 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f1362ffd640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13640b43f0 0x7f1364145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f13627fc640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13640b5050 0x7f136414fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f13637fe640 1 -- 172.21.15.81:0/4085592912 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13640b5050 msgr2=0x7f136414fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f13637fe640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13640b5050 0x7f136414fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f13637fe640 1 -- 172.21.15.81:0/4085592912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13640b43f0 msgr2=0x7f1364145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f13637fe640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13640b43f0 0x7f1364145ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f13637fe640 1 -- 172.21.15.81:0/4085592912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13641503b0 con 0x7f136415b340 2024-09-16T01:22:52.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f13637fe640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f136415b340 0x7f1364155460 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f135c00c780 tx=0x7f135c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f134b7fe640 1 -- 172.21.15.81:0/4085592912 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c004b60 con 0x7f136415b340 2024-09-16T01:22:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f134b7fe640 1 -- 172.21.15.81:0/4085592912 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135c004d00 con 0x7f136415b340 2024-09-16T01:22:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f136948d640 1 -- 172.21.15.81:0/4085592912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1364150690 con 0x7f136415b340 2024-09-16T01:22:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f134b7fe640 1 -- 172.21.15.81:0/4085592912 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135c00aa90 con 0x7f136415b340 2024-09-16T01:22:52.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.407+0000 7f136948d640 1 -- 172.21.15.81:0/4085592912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1364150c50 con 0x7f136415b340 2024-09-16T01:22:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.408+0000 7f136948d640 1 -- 172.21.15.81:0/4085592912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f136409aa30 con 0x7f136415b340 2024-09-16T01:22:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.409+0000 7f134b7fe640 1 -- 172.21.15.81:0/4085592912 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f135c00ac30 con 0x7f136415b340 2024-09-16T01:22:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.409+0000 7f134b7fe640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f135006c2b0 0x7f135006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.409+0000 7f134b7fe640 1 -- 172.21.15.81:0/4085592912 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f135c08b680 con 0x7f136415b340 2024-09-16T01:22:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.409+0000 7f1362ffd640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f135006c2b0 0x7f135006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:52.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.410+0000 7f1362ffd640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f135006c2b0 0x7f135006e770 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1354007fd0 tx=0x7f1354007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:52.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.413+0000 7f134b7fe640 1 -- 172.21.15.81:0/4085592912 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f135c020070 con 0x7f136415b340 2024-09-16T01:22:52.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.617+0000 7f136948d640 1 -- 172.21.15.81:0/4085592912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f136406f750 con 0x7f136415b340 2024-09-16T01:22:52.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.618+0000 7f134b7fe640 1 -- 172.21.15.81:0/4085592912 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f135c0596a0 con 0x7f136415b340 2024-09-16T01:22:52.618 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:52.619 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T01:22:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.620+0000 7f136948d640 1 -- 172.21.15.81:0/4085592912 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f135006c2b0 msgr2=0x7f135006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.620+0000 7f136948d640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f135006c2b0 0x7f135006e770 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1354007fd0 tx=0x7f1354007e80 comp rx=0 tx=0).stop 2024-09-16T01:22:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.620+0000 7f136948d640 1 -- 172.21.15.81:0/4085592912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f136415b340 msgr2=0x7f1364155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.620+0000 7f136948d640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f136415b340 0x7f1364155460 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f135c00c780 tx=0x7f135c00cc40 comp rx=0 tx=0).stop 2024-09-16T01:22:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.620+0000 7f136948d640 1 -- 172.21.15.81:0/4085592912 shutdown_connections 2024-09-16T01:22:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.620+0000 7f136948d640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f135006c2b0 0x7f135006e770 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.620+0000 7f136948d640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f136415b340 0x7f1364155460 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.620+0000 7f136948d640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f13640b5050 0x7f136414fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.620+0000 7f136948d640 1 --2- 172.21.15.81:0/4085592912 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f13640b43f0 0x7f1364145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.620+0000 7f136948d640 1 -- 172.21.15.81:0/4085592912 >> 172.21.15.81:0/4085592912 conn(0x7f1364073490 msgr2=0x7f136406fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.620+0000 7f136948d640 1 -- 172.21.15.81:0/4085592912 shutdown_connections 2024-09-16T01:22:52.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:52.620+0000 7f136948d640 1 -- 172.21.15.81:0/4085592912 wait complete. 2024-09-16T01:22:52.631 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2024-09-16T01:22:52.632 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:22:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:22:56.052 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:22:57.633 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:22:57.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.742+0000 7f482a978640 1 Processor -- start 2024-09-16T01:22:57.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.742+0000 7f482a978640 1 -- start start 2024-09-16T01:22:57.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f482a978640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48240b63d0 0x7f48240cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:57.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f482a978640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f482406fdb0 con 0x7f48240b5f80 2024-09-16T01:22:57.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f482a978640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4824070090 con 0x7f48240afd70 2024-09-16T01:22:57.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f482a978640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4824070370 con 0x7f48240b63d0 2024-09-16T01:22:57.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f48237fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f48240b5f80 0x7f48240cd650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38182/0 (socket says 172.21.15.81:38182) 2024-09-16T01:22:57.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f48237fe640 1 -- 172.21.15.81:0/3634223309 learned_addr learned my addr 172.21.15.81:0/3634223309 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:22:57.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395414079 0 0) 0x7f482406fdb0 con 0x7f48240b5f80 2024-09-16T01:22:57.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f480c003520 con 0x7f48240b5f80 2024-09-16T01:22:57.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4828f15640 1 --2- 172.21.15.81:0/3634223309 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48240b63d0 0x7f48240cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2694048390 0 0) 0x7f480c003520 con 0x7f48240b5f80 2024-09-16T01:22:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48240b63d0 msgr2=0x7f48240cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 --2- 172.21.15.81:0/3634223309 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48240b63d0 0x7f48240cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 >> v1:172.21.15.102:6789/0 conn(0x7f48240afd70 legacy=0x7f4824160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4824070650 con 0x7f48240b5f80 2024-09-16T01:22:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f4818001670 con 0x7f48240b5f80 2024-09-16T01:22:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 >> v1:172.21.15.81:6789/0 conn(0x7f48240b5f80 legacy=0x7f48240cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 --2- 172.21.15.81:0/3634223309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f480c0039e0 0x7f480c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 --2- 172.21.15.81:0/3634223309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480c004800 0x7f480c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:57.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 --2- 172.21.15.81:0/3634223309 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48240b63d0 0x7f480c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:57.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4824070370 con 0x7f480c004800 2024-09-16T01:22:57.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f480c00bb20 con 0x7f480c0039e0 2024-09-16T01:22:57.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f480c00bd20 con 0x7f48240b63d0 2024-09-16T01:22:57.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.743+0000 7f48237fe640 1 --2- 172.21.15.81:0/3634223309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480c004800 0x7f480c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:57.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.744+0000 7f4823fff640 1 --2- 172.21.15.81:0/3634223309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f480c0039e0 0x7f480c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:57.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.744+0000 7f4828f15640 1 --2- 172.21.15.81:0/3634223309 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48240b63d0 0x7f480c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:57.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.744+0000 7f48237fe640 1 -- 172.21.15.81:0/3634223309 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48240b63d0 msgr2=0x7f480c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:57.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.744+0000 7f48237fe640 1 --2- 172.21.15.81:0/3634223309 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f48240b63d0 0x7f480c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.744+0000 7f48237fe640 1 -- 172.21.15.81:0/3634223309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f480c0039e0 msgr2=0x7f480c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:22:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.744+0000 7f48237fe640 1 --2- 172.21.15.81:0/3634223309 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f480c0039e0 0x7f480c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.744+0000 7f48237fe640 1 -- 172.21.15.81:0/3634223309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480c003520 con 0x7f480c004800 2024-09-16T01:22:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.744+0000 7f48237fe640 1 --2- 172.21.15.81:0/3634223309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480c004800 0x7f480c004c80 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f481800c240 tx=0x7f480c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e64a0f387752c6d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.745+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4818007cf0 con 0x7f480c004800 2024-09-16T01:22:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.745+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48180058d0 con 0x7f480c004800 2024-09-16T01:22:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.745+0000 7f4822ffd640 1 -- 172.21.15.81:0/3634223309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4818005ca0 con 0x7f480c004800 2024-09-16T01:22:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.745+0000 7f482a978640 1 -- 172.21.15.81:0/3634223309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480c004800 msgr2=0x7f480c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.745+0000 7f482a978640 1 --2- 172.21.15.81:0/3634223309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480c004800 0x7f480c004c80 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f481800c240 tx=0x7f480c005830 comp rx=0 tx=0).stop 2024-09-16T01:22:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.745+0000 7f4828f15640 1 -- 172.21.15.81:0/3634223309 reap_dead start 2024-09-16T01:22:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.745+0000 7f482a978640 1 -- 172.21.15.81:0/3634223309 shutdown_connections 2024-09-16T01:22:57.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.745+0000 7f482a978640 1 -- 172.21.15.81:0/3634223309 >> 172.21.15.81:0/3634223309 conn(0x7f482406bc10 msgr2=0x7f482406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:57.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.745+0000 7f482a978640 1 -- 172.21.15.81:0/3634223309 shutdown_connections 2024-09-16T01:22:57.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.745+0000 7f482a978640 1 -- 172.21.15.81:0/3634223309 wait complete. 2024-09-16T01:22:57.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.746+0000 7f482a978640 1 Processor -- start 2024-09-16T01:22:57.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.747+0000 7f482a978640 1 -- start start 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.747+0000 7f482a978640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f480c004800 0x7f48240cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.747+0000 7f482a978640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48240ae8f0 0x7f48240aed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.747+0000 7f482a978640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48240c5c90 0x7f48240c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.747+0000 7f482a978640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48240b0150 con 0x7f48240c5c90 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.747+0000 7f482a978640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f482406fa80 con 0x7f48240ae8f0 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.747+0000 7f482a978640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4824160060 con 0x7f480c004800 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.747+0000 7f4828f15640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48240c5c90 0x7f48240c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f4828f15640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48240c5c90 0x7f48240c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51754/0 (socket says 172.21.15.81:51754) 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f4828f15640 1 -- 172.21.15.81:0/1604535988 learned_addr learned my addr 172.21.15.81:0/1604535988 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f48237fe640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48240ae8f0 0x7f48240aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f4823fff640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f480c004800 0x7f48240cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f4828f15640 1 -- 172.21.15.81:0/1604535988 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f480c004800 msgr2=0x7f48240cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f4828f15640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f480c004800 0x7f48240cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f4828f15640 1 -- 172.21.15.81:0/1604535988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48240ae8f0 msgr2=0x7f48240aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f4828f15640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48240ae8f0 0x7f48240aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f4828f15640 1 -- 172.21.15.81:0/1604535988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48240c6a10 con 0x7f48240c5c90 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f48237fe640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48240ae8f0 0x7f48240aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f4828f15640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48240c5c90 0x7f48240c6140 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f48240b6be0 tx=0x7f481c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f4820ff9640 1 -- 172.21.15.81:0/1604535988 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c0046a0 con 0x7f48240c5c90 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f4820ff9640 1 -- 172.21.15.81:0/1604535988 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f481c01a070 con 0x7f48240c5c90 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f482a978640 1 -- 172.21.15.81:0/1604535988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48240b3f10 con 0x7f48240c5c90 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f4820ff9640 1 -- 172.21.15.81:0/1604535988 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f481c015640 con 0x7f48240c5c90 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.748+0000 7f482a978640 1 -- 172.21.15.81:0/1604535988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48240b44d0 con 0x7f48240c5c90 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.749+0000 7f482a978640 1 -- 172.21.15.81:0/1604535988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48240af2b0 con 0x7f48240c5c90 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.750+0000 7f4820ff9640 1 -- 172.21.15.81:0/1604535988 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f481c0157e0 con 0x7f48240c5c90 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.750+0000 7f4820ff9640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f481006c2b0 0x7f481006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:22:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.750+0000 7f4820ff9640 1 -- 172.21.15.81:0/1604535988 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f481c08bc00 con 0x7f48240c5c90 2024-09-16T01:22:57.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.750+0000 7f4823fff640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f481006c2b0 0x7f481006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:22:57.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.751+0000 7f4823fff640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f481006c2b0 0x7f481006e770 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4814005590 tx=0x7f4814009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:22:57.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.755+0000 7f4820ff9640 1 -- 172.21.15.81:0/1604535988 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f481c092080 con 0x7f48240c5c90 2024-09-16T01:22:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.956+0000 7f482a978640 1 -- 172.21.15.81:0/1604535988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f48240b46d0 con 0x7f48240c5c90 2024-09-16T01:22:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.956+0000 7f4820ff9640 1 -- 172.21.15.81:0/1604535988 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f48240b46d0 con 0x7f48240c5c90 2024-09-16T01:22:57.957 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:22:57.957 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:22:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.958+0000 7f482a978640 1 -- 172.21.15.81:0/1604535988 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f481006c2b0 msgr2=0x7f481006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.958+0000 7f482a978640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f481006c2b0 0x7f481006e770 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4814005590 tx=0x7f4814009040 comp rx=0 tx=0).stop 2024-09-16T01:22:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.958+0000 7f482a978640 1 -- 172.21.15.81:0/1604535988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48240c5c90 msgr2=0x7f48240c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:22:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.958+0000 7f482a978640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48240c5c90 0x7f48240c6140 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f48240b6be0 tx=0x7f481c007700 comp rx=0 tx=0).stop 2024-09-16T01:22:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.958+0000 7f482a978640 1 -- 172.21.15.81:0/1604535988 shutdown_connections 2024-09-16T01:22:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.958+0000 7f482a978640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f481006c2b0 0x7f481006e770 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.958+0000 7f482a978640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48240c5c90 0x7f48240c6140 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.958+0000 7f482a978640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48240ae8f0 0x7f48240aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.958+0000 7f482a978640 1 --2- 172.21.15.81:0/1604535988 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f480c004800 0x7f48240cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:22:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.958+0000 7f482a978640 1 -- 172.21.15.81:0/1604535988 >> 172.21.15.81:0/1604535988 conn(0x7f482406bc10 msgr2=0x7f48241524c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:22:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.958+0000 7f482a978640 1 -- 172.21.15.81:0/1604535988 shutdown_connections 2024-09-16T01:22:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:22:57.958+0000 7f482a978640 1 -- 172.21.15.81:0/1604535988 wait complete. 2024-09-16T01:22:57.970 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:22:57.970 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:22:58.054 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:23:00.056 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:23:02.058 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:23:02.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:23:03.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.078+0000 7fc92cdf6640 1 Processor -- start 2024-09-16T01:23:03.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.078+0000 7fc92cdf6640 1 -- start start 2024-09-16T01:23:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.079+0000 7fc92cdf6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc92815b300 0x7fc9280cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.079+0000 7fc92cdf6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9280cdbe0 con 0x7fc92806f8d0 2024-09-16T01:23:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.079+0000 7fc92cdf6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9280cd900 con 0x7fc9280cd3f0 2024-09-16T01:23:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.079+0000 7fc92cdf6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc9280728a0 con 0x7fc92815b300 2024-09-16T01:23:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc926d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc92806f8d0 0x7fc92815b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36700/0 (socket says 172.21.15.81:36700) 2024-09-16T01:23:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc926d9d640 1 -- 172.21.15.81:0/3895158737 learned_addr learned my addr 172.21.15.81:0/3895158737 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92659c640 1 --2- 172.21.15.81:0/3895158737 >> v2:172.21.15.102:3300/0 conn(0x7fc92815b300 0x7fc9280cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3849967703 0 0) 0x7fc9280cdbe0 con 0x7fc92806f8d0 2024-09-16T01:23:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc914003520 con 0x7fc92806f8d0 2024-09-16T01:23:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1209662130 0 0) 0x7fc914003520 con 0x7fc92806f8d0 2024-09-16T01:23:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 >> v2:172.21.15.102:3300/0 conn(0x7fc92815b300 msgr2=0x7fc9280cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 --2- 172.21.15.81:0/3895158737 >> v2:172.21.15.102:3300/0 conn(0x7fc92815b300 0x7fc9280cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 >> v1:172.21.15.102:6789/0 conn(0x7fc9280cd3f0 legacy=0x7fc92806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc928072250 con 0x7fc92806f8d0 2024-09-16T01:23:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fc9200019f0 con 0x7fc92806f8d0 2024-09-16T01:23:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 >> v1:172.21.15.81:6789/0 conn(0x7fc92806f8d0 legacy=0x7fc92815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 --2- 172.21.15.81:0/3895158737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9140039b0 0x7fc914003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 --2- 172.21.15.81:0/3895158737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc914004800 0x7fc914004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 --2- 172.21.15.81:0/3895158737 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc9140051c0 0x7fc91400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc9280728a0 con 0x7fc914004800 2024-09-16T01:23:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc91400c060 con 0x7fc9140039b0 2024-09-16T01:23:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc91400c260 con 0x7fc9140051c0 2024-09-16T01:23:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc925d9b640 1 --2- 172.21.15.81:0/3895158737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc914004800 0x7fc914004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.080+0000 7fc92659c640 1 --2- 172.21.15.81:0/3895158737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9140039b0 0x7fc914003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.081+0000 7fc926d9d640 1 --2- 172.21.15.81:0/3895158737 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc9140051c0 0x7fc91400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.081+0000 7fc925d9b640 1 -- 172.21.15.81:0/3895158737 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc9140051c0 msgr2=0x7fc91400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.081+0000 7fc925d9b640 1 --2- 172.21.15.81:0/3895158737 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc9140051c0 0x7fc91400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.081+0000 7fc925d9b640 1 -- 172.21.15.81:0/3895158737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9140039b0 msgr2=0x7fc914003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:03.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.081+0000 7fc925d9b640 1 --2- 172.21.15.81:0/3895158737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9140039b0 0x7fc914003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.081+0000 7fc926d9d640 1 -- 172.21.15.81:0/3895158737 reap_dead start 2024-09-16T01:23:03.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.081+0000 7fc925d9b640 1 -- 172.21.15.81:0/3895158737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc914003520 con 0x7fc914004800 2024-09-16T01:23:03.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.081+0000 7fc92659c640 1 --2- 172.21.15.81:0/3895158737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9140039b0 0x7fc914003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:03.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.081+0000 7fc925d9b640 1 --2- 172.21.15.81:0/3895158737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc914004800 0x7fc914004c80 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fc910001750 tx=0x7fc914005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd0e95de5cfe597 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:03.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.082+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910001370 con 0x7fc914004800 2024-09-16T01:23:03.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.082+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9100052d0 con 0x7fc914004800 2024-09-16T01:23:03.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.082+0000 7fc92559a640 1 -- 172.21.15.81:0/3895158737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91002abc0 con 0x7fc914004800 2024-09-16T01:23:03.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.082+0000 7fc92cdf6640 1 -- 172.21.15.81:0/3895158737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc914004800 msgr2=0x7fc914004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.082+0000 7fc92cdf6640 1 --2- 172.21.15.81:0/3895158737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc914004800 0x7fc914004c80 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fc910001750 tx=0x7fc914005830 comp rx=0 tx=0).stop 2024-09-16T01:23:03.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.082+0000 7fc92cdf6640 1 -- 172.21.15.81:0/3895158737 shutdown_connections 2024-09-16T01:23:03.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.082+0000 7fc92cdf6640 1 --2- 172.21.15.81:0/3895158737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc914004800 0x7fc914004c80 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.082+0000 7fc92cdf6640 1 -- 172.21.15.81:0/3895158737 >> 172.21.15.81:0/3895158737 conn(0x7fc928067d70 msgr2=0x7fc92806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:03.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.082+0000 7fc92cdf6640 1 -- 172.21.15.81:0/3895158737 shutdown_connections 2024-09-16T01:23:03.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.082+0000 7fc92cdf6640 1 -- 172.21.15.81:0/3895158737 wait complete. 2024-09-16T01:23:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.084+0000 7fc92cdf6640 1 Processor -- start 2024-09-16T01:23:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.084+0000 7fc92cdf6640 1 -- start start 2024-09-16T01:23:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.084+0000 7fc92cdf6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc914004800 0x7fc928145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.084+0000 7fc92cdf6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc928150b80 0x7fc928157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.084+0000 7fc92cdf6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc9281f1ea0 0x7fc9281f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.084+0000 7fc92cdf6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc9280d0160 con 0x7fc928150b80 2024-09-16T01:23:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.084+0000 7fc92cdf6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc9280cffe0 con 0x7fc914004800 2024-09-16T01:23:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.084+0000 7fc92cdf6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc928072d30 con 0x7fc9281f1ea0 2024-09-16T01:23:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc925d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc928150b80 0x7fc928157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc925d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc928150b80 0x7fc928157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35494/0 (socket says 172.21.15.81:35494) 2024-09-16T01:23:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc925d9b640 1 -- 172.21.15.81:0/964783667 learned_addr learned my addr 172.21.15.81:0/964783667 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc926d9d640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc9281f1ea0 0x7fc9281f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc92659c640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc914004800 0x7fc928145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc925d9b640 1 -- 172.21.15.81:0/964783667 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc9281f1ea0 msgr2=0x7fc9281f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc925d9b640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc9281f1ea0 0x7fc9281f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc925d9b640 1 -- 172.21.15.81:0/964783667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc914004800 msgr2=0x7fc928145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc925d9b640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc914004800 0x7fc928145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc925d9b640 1 -- 172.21.15.81:0/964783667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92815bd20 con 0x7fc928150b80 2024-09-16T01:23:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc925d9b640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc928150b80 0x7fc928157e90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fc910005040 tx=0x7fc910001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc91effd640 1 -- 172.21.15.81:0/964783667 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910037040 con 0x7fc928150b80 2024-09-16T01:23:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc91effd640 1 -- 172.21.15.81:0/964783667 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc910005480 con 0x7fc928150b80 2024-09-16T01:23:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc92cdf6640 1 -- 172.21.15.81:0/964783667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92815c000 con 0x7fc928150b80 2024-09-16T01:23:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc91effd640 1 -- 172.21.15.81:0/964783667 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910007a30 con 0x7fc928150b80 2024-09-16T01:23:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.085+0000 7fc92cdf6640 1 -- 172.21.15.81:0/964783667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9281583d0 con 0x7fc928150b80 2024-09-16T01:23:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.086+0000 7fc92cdf6640 1 -- 172.21.15.81:0/964783667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc92815d890 con 0x7fc928150b80 2024-09-16T01:23:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.087+0000 7fc91effd640 1 -- 172.21.15.81:0/964783667 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc910044020 con 0x7fc928150b80 2024-09-16T01:23:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.087+0000 7fc91effd640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc90806c2e0 0x7fc90806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.087+0000 7fc91effd640 1 -- 172.21.15.81:0/964783667 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fc9100ab020 con 0x7fc928150b80 2024-09-16T01:23:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.087+0000 7fc92659c640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc90806c2e0 0x7fc90806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.088+0000 7fc92659c640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc90806c2e0 0x7fc90806e7a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc92806aa80 tx=0x7fc918009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.092+0000 7fc91effd640 1 -- 172.21.15.81:0/964783667 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc910079600 con 0x7fc928150b80 2024-09-16T01:23:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.296+0000 7fc92cdf6640 1 -- 172.21.15.81:0/964783667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc92806d090 con 0x7fc928150b80 2024-09-16T01:23:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.296+0000 7fc91effd640 1 -- 172.21.15.81:0/964783667 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7fc910078f00 con 0x7fc928150b80 2024-09-16T01:23:03.298 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:03.299 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:23:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.299+0000 7fc92cdf6640 1 -- 172.21.15.81:0/964783667 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc90806c2e0 msgr2=0x7fc90806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.299+0000 7fc92cdf6640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc90806c2e0 0x7fc90806e7a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc92806aa80 tx=0x7fc918009190 comp rx=0 tx=0).stop 2024-09-16T01:23:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.299+0000 7fc92cdf6640 1 -- 172.21.15.81:0/964783667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc928150b80 msgr2=0x7fc928157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.299+0000 7fc92cdf6640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc928150b80 0x7fc928157e90 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fc910005040 tx=0x7fc910001120 comp rx=0 tx=0).stop 2024-09-16T01:23:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.299+0000 7fc92cdf6640 1 -- 172.21.15.81:0/964783667 shutdown_connections 2024-09-16T01:23:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.299+0000 7fc92cdf6640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc90806c2e0 0x7fc90806e7a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.299+0000 7fc92cdf6640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc9281f1ea0 0x7fc9281f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.299+0000 7fc92cdf6640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc928150b80 0x7fc928157e90 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.299+0000 7fc92cdf6640 1 --2- 172.21.15.81:0/964783667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc914004800 0x7fc928145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.299+0000 7fc92cdf6640 1 -- 172.21.15.81:0/964783667 >> 172.21.15.81:0/964783667 conn(0x7fc928067d70 msgr2=0x7fc92806f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.299+0000 7fc92cdf6640 1 -- 172.21.15.81:0/964783667 shutdown_connections 2024-09-16T01:23:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.299+0000 7fc92cdf6640 1 -- 172.21.15.81:0/964783667 wait complete. 2024-09-16T01:23:03.311 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-16T01:23:03.312 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-09-16T01:23:03.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:23:03.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.407+0000 7f96cd903640 1 Processor -- start 2024-09-16T01:23:03.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.407+0000 7f96cd903640 1 -- start start 2024-09-16T01:23:03.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96cd903640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96c8162060 0x7f96c80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96cd903640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f96c80b64b0 0x7f96c80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96cd903640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c806d9f0 con 0x7f96c8161c80 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96cd903640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f96c806dcd0 con 0x7f96c8162060 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96cd903640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f96c806dfb0 con 0x7f96c80b64b0 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96bffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96c8162060 0x7f96c80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96c6ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f96c8161c80 0x7f96c806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36702/0 (socket says 172.21.15.81:36702) 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96c6ffd640 1 -- 172.21.15.81:0/1648823492 learned_addr learned my addr 172.21.15.81:0/1648823492 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96bffff640 1 -- 172.21.15.81:0/1648823492 >> v2:172.21.15.102:3300/0 conn(0x7f96c80b64b0 msgr2=0x7f96c80b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96c77fe640 1 --2- 172.21.15.81:0/1648823492 >> v2:172.21.15.102:3300/0 conn(0x7f96c80b64b0 0x7f96c80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96bffff640 1 --2- 172.21.15.81:0/1648823492 >> v2:172.21.15.102:3300/0 conn(0x7f96c80b64b0 0x7f96c80b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96bffff640 1 -- 172.21.15.81:0/1648823492 >> v1:172.21.15.81:6789/0 conn(0x7f96c8161c80 legacy=0x7f96c806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96c67fc640 1 -- 172.21.15.81:0/1648823492 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3456523611 0 0) 0x7f96c806d9f0 con 0x7f96c8161c80 2024-09-16T01:23:03.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96bffff640 1 -- 172.21.15.81:0/1648823492 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c80d01f0 con 0x7f96c8162060 2024-09-16T01:23:03.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.408+0000 7f96c77fe640 1 --2- 172.21.15.81:0/1648823492 >> v2:172.21.15.102:3300/0 conn(0x7f96c80b64b0 0x7f96c80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:03.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.409+0000 7f96bffff640 1 --2- 172.21.15.81:0/1648823492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96c8162060 0x7f96c80b5f70 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f96c808d750 tx=0x7f96b002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2b9d3a94126ebf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:03.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.409+0000 7f96c67fc640 1 -- 172.21.15.81:0/1648823492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0037070 con 0x7f96c8162060 2024-09-16T01:23:03.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.409+0000 7f96c67fc640 1 -- 172.21.15.81:0/1648823492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b0032440 con 0x7f96c8162060 2024-09-16T01:23:03.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.409+0000 7f96c67fc640 1 -- 172.21.15.81:0/1648823492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0032810 con 0x7f96c8162060 2024-09-16T01:23:03.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.410+0000 7f96cd903640 1 -- 172.21.15.81:0/1648823492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96c8162060 msgr2=0x7f96c80b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.410+0000 7f96cd903640 1 --2- 172.21.15.81:0/1648823492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96c8162060 0x7f96c80b5f70 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f96c808d750 tx=0x7f96b002a1a0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.410+0000 7f96cd903640 1 -- 172.21.15.81:0/1648823492 shutdown_connections 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.410+0000 7f96cd903640 1 --2- 172.21.15.81:0/1648823492 >> v2:172.21.15.102:3300/0 conn(0x7f96c80b64b0 0x7f96c80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.410+0000 7f96cd903640 1 --2- 172.21.15.81:0/1648823492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96c8162060 0x7f96c80b5f70 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.410+0000 7f96cd903640 1 -- 172.21.15.81:0/1648823492 >> 172.21.15.81:0/1648823492 conn(0x7f96c80d44f0 msgr2=0x7f96c80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.410+0000 7f96cd903640 1 -- 172.21.15.81:0/1648823492 shutdown_connections 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.410+0000 7f96cd903640 1 -- 172.21.15.81:0/1648823492 wait complete. 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.411+0000 7f96cd903640 1 Processor -- start 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.411+0000 7f96cd903640 1 -- start start 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.411+0000 7f96cd903640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96c80b64b0 0x7f96c815b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.411+0000 7f96cd903640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96c8161c80 0x7f96c80cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.411+0000 7f96cd903640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96c8162060 0x7f96c80ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96cd903640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96c80cf1e0 con 0x7f96c8161c80 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96cd903640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f96c80d2aa0 con 0x7f96c80b64b0 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96cd903640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f96c80cf360 con 0x7f96c8162060 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96c8161c80 0x7f96c80cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96c8161c80 0x7f96c80cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35506/0 (socket says 172.21.15.81:35506) 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96bffff640 1 -- 172.21.15.81:0/3752924005 learned_addr learned my addr 172.21.15.81:0/3752924005 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96c77fe640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96c8162060 0x7f96c80ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96c6ffd640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96c80b64b0 0x7f96c815b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96bffff640 1 -- 172.21.15.81:0/3752924005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96c8162060 msgr2=0x7f96c80ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96bffff640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96c8162060 0x7f96c80ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96bffff640 1 -- 172.21.15.81:0/3752924005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96c80b64b0 msgr2=0x7f96c815b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96bffff640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96c80b64b0 0x7f96c815b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96bffff640 1 -- 172.21.15.81:0/3752924005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c815b830 con 0x7f96c8161c80 2024-09-16T01:23:03.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96c77fe640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96c8162060 0x7f96c80ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:03.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96bffff640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96c8161c80 0x7f96c80cdba0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f96b0035040 tx=0x7f96b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:03.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96c4ff9640 1 -- 172.21.15.81:0/3752924005 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0037050 con 0x7f96c8161c80 2024-09-16T01:23:03.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96c4ff9640 1 -- 172.21.15.81:0/3752924005 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b0038040 con 0x7f96c8161c80 2024-09-16T01:23:03.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96cd903640 1 -- 172.21.15.81:0/3752924005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c80cc220 con 0x7f96c8161c80 2024-09-16T01:23:03.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96c4ff9640 1 -- 172.21.15.81:0/3752924005 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0004450 con 0x7f96c8161c80 2024-09-16T01:23:03.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.412+0000 7f96cd903640 1 -- 172.21.15.81:0/3752924005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c80cc7e0 con 0x7f96c8161c80 2024-09-16T01:23:03.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.413+0000 7f96cd903640 1 -- 172.21.15.81:0/3752924005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c80b5f70 con 0x7f96c8161c80 2024-09-16T01:23:03.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.414+0000 7f96c4ff9640 1 -- 172.21.15.81:0/3752924005 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f96b0030980 con 0x7f96c8161c80 2024-09-16T01:23:03.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.414+0000 7f96c4ff9640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f96a806c2b0 0x7f96a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:03.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.414+0000 7f96c6ffd640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f96a806c2b0 0x7f96a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:03.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.414+0000 7f96c4ff9640 1 -- 172.21.15.81:0/3752924005 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f96b00ac200 con 0x7f96c8161c80 2024-09-16T01:23:03.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.415+0000 7f96c6ffd640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f96a806c2b0 0x7f96a806e770 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f96b8000f60 tx=0x7f96b8007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:03.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.418+0000 7f96c4ff9640 1 -- 172.21.15.81:0/3752924005 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96b007a900 con 0x7f96c8161c80 2024-09-16T01:23:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.616+0000 7f96cd903640 1 -- 172.21.15.81:0/3752924005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f96c80ba470 con 0x7f96c8161c80 2024-09-16T01:23:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.616+0000 7f96c4ff9640 1 -- 172.21.15.81:0/3752924005 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f96b007a200 con 0x7f96c8161c80 2024-09-16T01:23:03.618 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:03.619 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:23:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.618+0000 7f96cd903640 1 -- 172.21.15.81:0/3752924005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f96a806c2b0 msgr2=0x7f96a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.618+0000 7f96cd903640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f96a806c2b0 0x7f96a806e770 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f96b8000f60 tx=0x7f96b8007b50 comp rx=0 tx=0).stop 2024-09-16T01:23:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.618+0000 7f96cd903640 1 -- 172.21.15.81:0/3752924005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96c8161c80 msgr2=0x7f96c80cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.618+0000 7f96cd903640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96c8161c80 0x7f96c80cdba0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f96b0035040 tx=0x7f96b00046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.618+0000 7f96cd903640 1 -- 172.21.15.81:0/3752924005 shutdown_connections 2024-09-16T01:23:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.618+0000 7f96cd903640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f96a806c2b0 0x7f96a806e770 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.618+0000 7f96cd903640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96c8162060 0x7f96c80ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.618+0000 7f96cd903640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96c8161c80 0x7f96c80cdba0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.619+0000 7f96cd903640 1 --2- 172.21.15.81:0/3752924005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96c80b64b0 0x7f96c815b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.619+0000 7f96cd903640 1 -- 172.21.15.81:0/3752924005 >> 172.21.15.81:0/3752924005 conn(0x7f96c80d44f0 msgr2=0x7f96c80b40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.619+0000 7f96cd903640 1 -- 172.21.15.81:0/3752924005 shutdown_connections 2024-09-16T01:23:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03.619+0000 7f96cd903640 1 -- 172.21.15.81:0/3752924005 wait complete. 2024-09-16T01:23:03.631 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-16T01:23:03.631 INFO:tasks.cephfs.test_client_limits:Terminating process holding files open 2024-09-16T01:23:03.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:03 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-16T01:23:04.060 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:23:04.060 INFO:teuthology.orchestra.run.smithi081.stderr:stdin closed, goodbye! 2024-09-16T01:23:04.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:04.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:04.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.211+0000 7efce5749640 1 Processor -- start 2024-09-16T01:23:04.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.211+0000 7efce5749640 1 -- start start 2024-09-16T01:23:04.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.211+0000 7efce5749640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efce0161c80 0x7efce006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.211+0000 7efce5749640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce006e870 con 0x7efce00b6680 2024-09-16T01:23:04.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.211+0000 7efce5749640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce006d9f0 con 0x7efce0162060 2024-09-16T01:23:04.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.211+0000 7efce5749640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efce006dcd0 con 0x7efce0161c80 2024-09-16T01:23:04.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcdf7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efce00b6680 0x7efce00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36714/0 (socket says 172.21.15.81:36714) 2024-09-16T01:23:04.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcdf7fe640 1 -- 172.21.15.81:0/2633660243 learned_addr learned my addr 172.21.15.81:0/2633660243 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:04.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650802951 0 0) 0x7efcd8001490 con 0x7efce00b6680 2024-09-16T01:23:04.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcdeffd640 1 --2- 172.21.15.81:0/2633660243 >> v2:172.21.15.102:3300/0 conn(0x7efce0161c80 0x7efce006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efccc003520 con 0x7efce00b6680 2024-09-16T01:23:04.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3221584602 0 0) 0x7efccc003520 con 0x7efce00b6680 2024-09-16T01:23:04.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 >> v2:172.21.15.102:3300/0 conn(0x7efce0161c80 msgr2=0x7efce006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:04.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 --2- 172.21.15.81:0/2633660243 >> v2:172.21.15.102:3300/0 conn(0x7efce0161c80 0x7efce006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 >> v1:172.21.15.102:6789/0 conn(0x7efce0162060 legacy=0x7efce00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce006dfb0 con 0x7efce00b6680 2024-09-16T01:23:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7efcd8001bc0 con 0x7efce00b6680 2024-09-16T01:23:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 >> v1:172.21.15.81:6789/0 conn(0x7efce00b6680 legacy=0x7efce00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 --2- 172.21.15.81:0/2633660243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efccc0039b0 0x7efccc003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 --2- 172.21.15.81:0/2633660243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efccc004800 0x7efccc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 --2- 172.21.15.81:0/2633660243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efccc0051c0 0x7efccc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efce006dcd0 con 0x7efccc0051c0 2024-09-16T01:23:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efccc00c0f0 con 0x7efccc0039b0 2024-09-16T01:23:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efccc00c2f0 con 0x7efccc004800 2024-09-16T01:23:04.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcdf7fe640 1 --2- 172.21.15.81:0/2633660243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efccc0051c0 0x7efccc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcdeffd640 1 --2- 172.21.15.81:0/2633660243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efccc0039b0 0x7efccc003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.212+0000 7efcd67fc640 1 --2- 172.21.15.81:0/2633660243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efccc004800 0x7efccc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.213+0000 7efcdf7fe640 1 -- 172.21.15.81:0/2633660243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efccc004800 msgr2=0x7efccc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:04.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.213+0000 7efcdf7fe640 1 --2- 172.21.15.81:0/2633660243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efccc004800 0x7efccc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.213+0000 7efcdf7fe640 1 -- 172.21.15.81:0/2633660243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efccc0039b0 msgr2=0x7efccc003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:04.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.213+0000 7efcdf7fe640 1 --2- 172.21.15.81:0/2633660243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efccc0039b0 0x7efccc003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.213+0000 7efcdf7fe640 1 -- 172.21.15.81:0/2633660243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc003520 con 0x7efccc0051c0 2024-09-16T01:23:04.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.213+0000 7efcdf7fe640 1 -- 172.21.15.81:0/2633660243 reap_dead start 2024-09-16T01:23:04.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.213+0000 7efcdf7fe640 1 --2- 172.21.15.81:0/2633660243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efccc0051c0 0x7efccc00b9c0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7efcd800aa00 tx=0x7efccc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae1e3415c99a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:04.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.213+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd800a650 con 0x7efccc0051c0 2024-09-16T01:23:04.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.213+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd802f070 con 0x7efccc0051c0 2024-09-16T01:23:04.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.213+0000 7efcde7fc640 1 -- 172.21.15.81:0/2633660243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd802be40 con 0x7efccc0051c0 2024-09-16T01:23:04.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.214+0000 7efce5749640 1 -- 172.21.15.81:0/2633660243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efccc0051c0 msgr2=0x7efccc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.214+0000 7efce5749640 1 --2- 172.21.15.81:0/2633660243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efccc0051c0 0x7efccc00b9c0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7efcd800aa00 tx=0x7efccc005830 comp rx=0 tx=0).stop 2024-09-16T01:23:04.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.214+0000 7efce5749640 1 -- 172.21.15.81:0/2633660243 shutdown_connections 2024-09-16T01:23:04.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.214+0000 7efce5749640 1 --2- 172.21.15.81:0/2633660243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efccc0051c0 0x7efccc00b9c0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.214+0000 7efce5749640 1 -- 172.21.15.81:0/2633660243 >> 172.21.15.81:0/2633660243 conn(0x7efce00d44f0 msgr2=0x7efce00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:04.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.214+0000 7efce5749640 1 -- 172.21.15.81:0/2633660243 shutdown_connections 2024-09-16T01:23:04.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.214+0000 7efce5749640 1 -- 172.21.15.81:0/2633660243 wait complete. 2024-09-16T01:23:04.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.215+0000 7efce5749640 1 Processor -- start 2024-09-16T01:23:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.215+0000 7efce5749640 1 -- start start 2024-09-16T01:23:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efce5749640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efccc0051c0 0x7efce0156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efce5749640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce00b9d00 0x7efce0157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efce5749640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce0158530 0x7efce00b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efce5749640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efce00b6b30 con 0x7efce0158530 2024-09-16T01:23:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efce5749640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efce00d2aa0 con 0x7efce00b9d00 2024-09-16T01:23:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efce5749640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efce00b6cb0 con 0x7efccc0051c0 2024-09-16T01:23:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efcdf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce0158530 0x7efce00b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efcdf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce0158530 0x7efce00b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35522/0 (socket says 172.21.15.81:35522) 2024-09-16T01:23:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efcdf7fe640 1 -- 172.21.15.81:0/2571501156 learned_addr learned my addr 172.21.15.81:0/2571501156 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efcdeffd640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efccc0051c0 0x7efce0156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efcd67fc640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce00b9d00 0x7efce0157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efcdf7fe640 1 -- 172.21.15.81:0/2571501156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efccc0051c0 msgr2=0x7efce0156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efcdf7fe640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efccc0051c0 0x7efce0156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efcdf7fe640 1 -- 172.21.15.81:0/2571501156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce00b9d00 msgr2=0x7efce0157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efcdf7fe640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce00b9d00 0x7efce0157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.216+0000 7efcdf7fe640 1 -- 172.21.15.81:0/2571501156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce0156a80 con 0x7efce0158530 2024-09-16T01:23:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.217+0000 7efcdf7fe640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce0158530 0x7efce00b47c0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7efcd802b6b0 tx=0x7efce006e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.217+0000 7efcd7fff640 1 -- 172.21.15.81:0/2571501156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd800a650 con 0x7efce0158530 2024-09-16T01:23:04.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.217+0000 7efcd7fff640 1 -- 172.21.15.81:0/2571501156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd8004d70 con 0x7efce0158530 2024-09-16T01:23:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.217+0000 7efce5749640 1 -- 172.21.15.81:0/2571501156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce00b8c60 con 0x7efce0158530 2024-09-16T01:23:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.217+0000 7efcd7fff640 1 -- 172.21.15.81:0/2571501156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd802bc40 con 0x7efce0158530 2024-09-16T01:23:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.217+0000 7efce5749640 1 -- 172.21.15.81:0/2571501156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce00b9220 con 0x7efce0158530 2024-09-16T01:23:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.218+0000 7efce5749640 1 -- 172.21.15.81:0/2571501156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce006e330 con 0x7efce0158530 2024-09-16T01:23:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.218+0000 7efcd7fff640 1 -- 172.21.15.81:0/2571501156 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efcd8034470 con 0x7efce0158530 2024-09-16T01:23:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.219+0000 7efcd7fff640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efcc006c2b0 0x7efcc006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.219+0000 7efcd7fff640 1 -- 172.21.15.81:0/2571501156 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7efcd80ab1d0 con 0x7efce0158530 2024-09-16T01:23:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.219+0000 7efcdeffd640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efcc006c2b0 0x7efcc006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.219+0000 7efcdeffd640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efcc006c2b0 0x7efcc006e770 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efcd0006fd0 tx=0x7efcd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.223+0000 7efcd7fff640 1 -- 172.21.15.81:0/2571501156 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efce0156a80 con 0x7efce0158530 2024-09-16T01:23:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.424+0000 7efce5749640 1 -- 172.21.15.81:0/2571501156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efce006d730 con 0x7efce0158530 2024-09-16T01:23:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.425+0000 7efcd7fff640 1 -- 172.21.15.81:0/2571501156 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5228 (secure 0 0 0) 0x7efce006e870 con 0x7efce0158530 2024-09-16T01:23:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:04.427 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":68,"btime":"2024-09-16T01:23:03:219814+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3471922615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3471922615},{"type":"v1","addr":"172.21.15.102:6834","nonce":3471922615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6697,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/749780612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":749780612},{"type":"v1","addr":"172.21.15.81:6837","nonce":749780612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2257484883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":2257484883},{"type":"v1","addr":"172.21.15.102:6835","nonce":2257484883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:37.794648+0000","modified":"2024-09-16T01:23:02.508109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7674},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7674":{"gid":7674,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2398957156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2398957156},{"type":"v1","addr":"172.21.15.81:6835","nonce":2398957156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7674,"qdb_cluster":[7674]},"id":9}]} 2024-09-16T01:23:04.427 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 68 2024-09-16T01:23:04.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.427+0000 7efce5749640 1 -- 172.21.15.81:0/2571501156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efcc006c2b0 msgr2=0x7efcc006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.427+0000 7efce5749640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efcc006c2b0 0x7efcc006e770 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7efcd0006fd0 tx=0x7efcd0008040 comp rx=0 tx=0).stop 2024-09-16T01:23:04.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.427+0000 7efce5749640 1 -- 172.21.15.81:0/2571501156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce0158530 msgr2=0x7efce00b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.427+0000 7efce5749640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce0158530 0x7efce00b47c0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7efcd802b6b0 tx=0x7efce006e180 comp rx=0 tx=0).stop 2024-09-16T01:23:04.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.427+0000 7efce5749640 1 -- 172.21.15.81:0/2571501156 shutdown_connections 2024-09-16T01:23:04.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.427+0000 7efce5749640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efcc006c2b0 0x7efcc006e770 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.427+0000 7efce5749640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efce0158530 0x7efce00b47c0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.427+0000 7efce5749640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efce00b9d00 0x7efce0157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.427+0000 7efce5749640 1 --2- 172.21.15.81:0/2571501156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efccc0051c0 0x7efce0156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.427+0000 7efce5749640 1 -- 172.21.15.81:0/2571501156 >> 172.21.15.81:0/2571501156 conn(0x7efce00d44f0 msgr2=0x7efce006ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.427+0000 7efce5749640 1 -- 172.21.15.81:0/2571501156 shutdown_connections 2024-09-16T01:23:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.427+0000 7efce5749640 1 -- 172.21.15.81:0/2571501156 wait complete. 2024-09-16T01:23:04.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-16T01:23:04.557 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":7845,"entity":{"name":{"type":"client","num":7845},"addr":{"type":"v1","addr":"172.21.15.102:0","nonce":2936403614}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":15.128694612,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9081216390668931,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7845 v1:172.21.15.102:0/2936403614","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi102","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":6832,"entity":{"name":{"type":"client","num":6832},"addr":{"type":"v1","addr":"172.21.15.81:0","nonce":120916560}},"state":"open","num_leases":1,"num_caps":102,"request_load_avg":196,"uptime":16.259671782000002,"requests_in_flight":0,"num_completed_requests":200,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":1113.3415575536553,"halflife":60},"release_caps":{"value":99.968813870368166,"halflife":60},"recall_caps_throttle":{"value":263.1256978544796,"halflife":1.5},"recall_caps_throttle2o":{"value":124.0583918274414,"halflife":0.5},"session_cache_liveness":{"value":393.40297512976031,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.6832 v1:172.21.15.81:0/120916560","completed_requests":[{"tid":29,"created_ino":"0x10000000001"},{"tid":30,"created_ino":"0x100000001f6"},{"tid":31,"created_ino":"0x100000001f7"},{"tid":32,"created_ino":"0x100000001f8"},{"tid":33,"created_ino":"0x100000001f9"},{"tid":34,"created_ino":"0x100000001fa"},{"tid":35,"created_ino":"0x100000001fb"},{"tid":36,"created_ino":"0x100000001fc"},{"tid":37,"created_ino":"0x100000001fd"},{"tid":38,"created_ino":"0x100000001fe"},{"tid":39,"created_ino":"0x100000001ff"},{"tid":40,"created_ino":"0x10000000200"},{"tid":41,"created_ino":"0x10000000201"},{"tid":42,"created_ino":"0x10000000202"},{"tid":43,"created_ino":"0x10000000203"},{"tid":44,"created_ino":"0x10000000204"},{"tid":45,"created_ino":"0x10000000205"},{"tid":46,"created_ino":"0x10000000206"},{"tid":47,"created_ino":"0x10000000207"},{"tid":48,"created_ino":"0x10000000208"},{"tid":49,"created_ino":"0x10000000209"},{"tid":50,"created_ino":"0x1000000020a"},{"tid":51,"created_ino":"0x1000000020b"},{"tid":52,"created_ino":"0x1000000020c"},{"tid":53,"created_ino":"0x1000000020d"},{"tid":54,"created_ino":"0x1000000020e"},{"tid":55,"created_ino":"0x1000000020f"},{"tid":56,"created_ino":"0x10000000210"},{"tid":57,"created_ino":"0x10000000211"},{"tid":58,"created_ino":"0x10000000212"},{"tid":59,"created_ino":"0x10000000213"},{"tid":60,"created_ino":"0x10000000214"},{"tid":61,"created_ino":"0x10000000215"},{"tid":62,"created_ino":"0x10000000216"},{"tid":63,"created_ino":"0x10000000217"},{"tid":64,"created_ino":"0x10000000218"},{"tid":65,"created_ino":"0x10000000219"},{"tid":66,"created_ino":"0x1000000021a"},{"tid":67,"created_ino":"0x1000000021b"},{"tid":68,"created_ino":"0x1000000021c"},{"tid":69,"created_ino":"0x1000000021d"},{"tid":70,"created_ino":"0x1000000021e"},{"tid":71,"created_ino":"0x1000000021f"},{"tid":72,"created_ino":"0x10000000220"},{"tid":73,"created_ino":"0x10000000221"},{"tid":74,"created_ino":"0x10000000222"},{"tid":75,"created_ino":"0x10000000223"},{"tid":76,"created_ino":"0x10000000224"},{"tid":77,"created_ino":"0x10000000225"},{"tid":78,"created_ino":"0x10000000226"},{"tid":79,"created_ino":"0x10000000227"},{"tid":80,"created_ino":"0x10000000228"},{"tid":81,"created_ino":"0x10000000229"},{"tid":82,"created_ino":"0x1000000022a"},{"tid":83,"created_ino":"0x1000000022b"},{"tid":84,"created_ino":"0x1000000022c"},{"tid":85,"created_ino":"0x1000000022d"},{"tid":86,"created_ino":"0x1000000022e"},{"tid":87,"created_ino":"0x1000000022f"},{"tid":88,"created_ino":"0x10000000230"},{"tid":89,"created_ino":"0x10000000231"},{"tid":90,"created_ino":"0x10000000232"},{"tid":91,"created_ino":"0x10000000233"},{"tid":92,"created_ino":"0x10000000234"},{"tid":93,"created_ino":"0x10000000235"},{"tid":94,"created_ino":"0x10000000236"},{"tid":95,"created_ino":"0x10000000237"},{"tid":96,"created_ino":"0x10000000238"},{"tid":97,"created_ino":"0x10000000239"},{"tid":98,"created_ino":"0x1000000023a"},{"tid":99,"created_ino":"0x1000000023b"},{"tid":100,"created_ino":"0x1000000023c"},{"tid":101,"created_ino":"0x1000000023d"},{"tid":102,"created_ino":"0x1000000023e"},{"tid":103,"created_ino":"0x1000000023f"},{"tid":104,"created_ino":"0x10000000240"},{"tid":105,"created_ino":"0x10000000241"},{"tid":106,"created_ino":"0x10000000242"},{"tid":107,"created_ino":"0x10000000243"},{"tid":108,"created_ino":"0x10000000244"},{"tid":109,"created_ino":"0x10000000245"},{"tid":110,"created_ino":"0x10000000246"},{"tid":111,"created_ino":"0x10000000247"},{"tid":112,"created_ino":"0x10000000248"},{"tid":113,"created_ino":"0x10000000249"},{"tid":114,"created_ino":"0x1000000024a"},{"tid":115,"created_ino":"0x1000000024b"},{"tid":116,"created_ino":"0x1000000024c"},{"tid":117,"created_ino":"0x1000000024d"},{"tid":118,"created_ino":"0x1000000024e"},{"tid":119,"created_ino":"0x1000000024f"},{"tid":120,"created_ino":"0x10000000250"},{"tid":121,"created_ino":"0x10000000251"},{"tid":122,"created_ino":"0x10000000252"},{"tid":123,"created_ino":"0x10000000253"},{"tid":124,"created_ino":"0x10000000254"},{"tid":125,"created_ino":"0x10000000255"},{"tid":126,"created_ino":"0x10000000256"},{"tid":127,"created_ino":"0x10000000257"},{"tid":128,"created_ino":"0x10000000258"},{"tid":129,"created_ino":"0x10000000259"},{"tid":130,"created_ino":"0x1000000025a"},{"tid":131,"created_ino":"0x1000000025b"},{"tid":132,"created_ino":"0x1000000025c"},{"tid":133,"created_ino":"0x1000000025d"},{"tid":134,"created_ino":"0x1000000025e"},{"tid":135,"created_ino":"0x1000000025f"},{"tid":136,"created_ino":"0x10000000260"},{"tid":137,"created_ino":"0x10000000261"},{"tid":138,"created_ino":"0x10000000262"},{"tid":139,"created_ino":"0x10000000263"},{"tid":140,"created_ino":"0x10000000264"},{"tid":141,"created_ino":"0x10000000265"},{"tid":142,"created_ino":"0x10000000266"},{"tid":143,"created_ino":"0x10000000267"},{"tid":144,"created_ino":"0x10000000268"},{"tid":145,"created_ino":"0x10000000269"},{"tid":146,"created_ino":"0x1000000026a"},{"tid":147,"created_ino":"0x1000000026b"},{"tid":148,"created_ino":"0x1000000026c"},{"tid":149,"created_ino":"0x1000000026d"},{"tid":150,"created_ino":"0x1000000026e"},{"tid":151,"created_ino":"0x1000000026f"},{"tid":152,"created_ino":"0x10000000270"},{"tid":153,"created_ino":"0x10000000271"},{"tid":154,"created_ino":"0x10000000272"},{"tid":155,"created_ino":"0x10000000273"},{"tid":156,"created_ino":"0x10000000274"},{"tid":157,"created_ino":"0x10000000275"},{"tid":158,"created_ino":"0x10000000276"},{"tid":159,"created_ino":"0x10000000277"},{"tid":160,"created_ino":"0x10000000278"},{"tid":161,"created_ino":"0x10000000279"},{"tid":162,"created_ino":"0x1000000027a"},{"tid":163,"created_ino":"0x1000000027b"},{"tid":164,"created_ino":"0x1000000027c"},{"tid":165,"created_ino":"0x1000000027d"},{"tid":166,"created_ino":"0x1000000027e"},{"tid":167,"created_ino":"0x1000000027f"},{"tid":168,"created_ino":"0x10000000280"},{"tid":169,"created_ino":"0x10000000281"},{"tid":170,"created_ino":"0x10000000282"},{"tid":171,"created_ino":"0x10000000283"},{"tid":172,"created_ino":"0x10000000284"},{"tid":173,"created_ino":"0x10000000285"},{"tid":174,"created_ino":"0x10000000286"},{"tid":175,"created_ino":"0x10000000287"},{"tid":176,"created_ino":"0x10000000288"},{"tid":177,"created_ino":"0x10000000289"},{"tid":178,"created_ino":"0x1000000028a"},{"tid":179,"created_ino":"0x1000000028b"},{"tid":180,"created_ino":"0x1000000028c"},{"tid":181,"created_ino":"0x1000000028d"},{"tid":182,"created_ino":"0x1000000028e"},{"tid":183,"created_ino":"0x1000000028f"},{"tid":184,"created_ino":"0x10000000290"},{"tid":185,"created_ino":"0x10000000291"},{"tid":186,"created_ino":"0x10000000292"},{"tid":187,"created_ino":"0x10000000293"},{"tid":188,"created_ino":"0x10000000294"},{"tid":189,"created_ino":"0x10000000295"},{"tid":190,"created_ino":"0x10000000296"},{"tid":191,"created_ino":"0x10000000297"},{"tid":192,"created_ino":"0x10000000298"},{"tid":193,"created_ino":"0x10000000299"},{"tid":194,"created_ino":"0x1000000029a"},{"tid":195,"created_ino":"0x1000000029b"},{"tid":196,"created_ino":"0x1000000029c"},{"tid":197,"created_ino":"0x1000000029d"},{"tid":198,"created_ino":"0x1000000029e"},{"tid":199,"created_ino":"0x1000000029f"},{"tid":200,"created_ino":"0x100000002a0"},{"tid":201,"created_ino":"0x100000002a1"},{"tid":202,"created_ino":"0x100000002a2"},{"tid":203,"created_ino":"0x100000002a3"},{"tid":204,"created_ino":"0x100000002a4"},{"tid":205,"created_ino":"0x100000002a5"},{"tid":206,"created_ino":"0x100000002a6"},{"tid":207,"created_ino":"0x100000002a7"},{"tid":208,"created_ino":"0x100000002a8"},{"tid":209,"created_ino":"0x100000002a9"},{"tid":210,"created_ino":"0x100000002aa"},{"tid":211,"created_ino":"0x100000002ab"},{"tid":212,"created_ino":"0x100000002ac"},{"tid":213,"created_ino":"0x100000002ad"},{"tid":214,"created_ino":"0x100000002ae"},{"tid":215,"created_ino":"0x100000002af"},{"tid":216,"created_ino":"0x100000002b0"},{"tid":217,"created_ino":"0x100000002b1"},{"tid":218,"created_ino":"0x100000002b2"},{"tid":219,"created_ino":"0x100000002b3"},{"tid":220,"created_ino":"0x100000002b4"},{"tid":221,"created_ino":"0x100000002b5"},{"tid":222,"created_ino":"0x100000002b6"},{"tid":223,"created_ino":"0x100000002b7"},{"tid":224,"created_ino":"0x100000002b8"},{"tid":225,"created_ino":"0x100000002b9"},{"tid":226,"created_ino":"0x100000002ba"},{"tid":227,"created_ino":"0x100000002bb"},{"tid":228,"created_ino":"0x100000002bc"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x100000002bd","length":802}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi081","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-16T01:23:04.559 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi102", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.102:0", "nonce": 2936403614, "type": "v1" }, "name": { "num": 7845, "type": "client" } }, "id": 7845, "inst": "client.7845 v1:172.21.15.102:0/2936403614", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.908121639066893 }, "state": "open", "uptime": 15.128694612 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi081", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x10000000001", "tid": 29 }, { "created_ino": "0x100000001f6", "tid": 30 }, { "created_ino": "0x100000001f7", "tid": 31 }, { "created_ino": "0x100000001f8", "tid": 32 }, { "created_ino": "0x100000001f9", "tid": 33 }, { "created_ino": "0x100000001fa", "tid": 34 }, { "created_ino": "0x100000001fb", "tid": 35 }, { "created_ino": "0x100000001fc", "tid": 36 }, { "created_ino": "0x100000001fd", "tid": 37 }, { "created_ino": "0x100000001fe", "tid": 38 }, { "created_ino": "0x100000001ff", "tid": 39 }, { "created_ino": "0x10000000200", "tid": 40 }, { "created_ino": "0x10000000201", "tid": 41 }, { "created_ino": "0x10000000202", "tid": 42 }, { "created_ino": "0x10000000203", "tid": 43 }, { "created_ino": "0x10000000204", "tid": 44 }, { "created_ino": "0x10000000205", "tid": 45 }, { "created_ino": "0x10000000206", "tid": 46 }, { "created_ino": "0x10000000207", "tid": 47 }, { "created_ino": "0x10000000208", "tid": 48 }, { "created_ino": "0x10000000209", "tid": 49 }, { "created_ino": "0x1000000020a", "tid": 50 }, { "created_ino": "0x1000000020b", "tid": 51 }, { "created_ino": "0x1000000020c", "tid": 52 }, { "created_ino": "0x1000000020d", "tid": 53 }, { "created_ino": "0x1000000020e", "tid": 54 }, { "created_ino": "0x1000000020f", "tid": 55 }, { "created_ino": "0x10000000210", "tid": 56 }, { "created_ino": "0x10000000211", "tid": 57 }, { "created_ino": "0x10000000212", "tid": 58 }, { "created_ino": "0x10000000213", "tid": 59 }, { "created_ino": "0x10000000214", "tid": 60 }, { "created_ino": "0x10000000215", "tid": 61 }, { "created_ino": "0x10000000216", "tid": 62 }, { "created_ino": "0x10000000217", "tid": 63 }, { "created_ino": "0x10000000218", "tid": 64 }, { "created_ino": "0x10000000219", "tid": 65 }, { "created_ino": "0x1000000021a", "tid": 66 }, { "created_ino": "0x1000000021b", "tid": 67 }, { "created_ino": "0x1000000021c", "tid": 68 }, { "created_ino": "0x1000000021d", "tid": 69 }, { "created_ino": "0x1000000021e", "tid": 70 }, { "created_ino": "0x1000000021f", "tid": 71 }, { "created_ino": "0x10000000220", "tid": 72 }, { "created_ino": "0x10000000221", "tid": 73 }, { "created_ino": "0x10000000222", "tid": 74 }, { "created_ino": "0x10000000223", "tid": 75 }, { "created_ino": "0x10000000224", "tid": 76 }, { "created_ino": "0x10000000225", "tid": 77 }, { "created_ino": "0x10000000226", "tid": 78 }, { "created_ino": "0x10000000227", "tid": 79 }, { "created_ino": "0x10000000228", "tid": 80 }, { "created_ino": "0x10000000229", "tid": 81 }, { "created_ino": "0x1000000022a", "tid": 82 }, { "created_ino": "0x1000000022b", "tid": 83 }, { "created_ino": "0x1000000022c", "tid": 84 }, { "created_ino": "0x1000000022d", "tid": 85 }, { "created_ino": "0x1000000022e", "tid": 86 }, { "created_ino": "0x1000000022f", "tid": 87 }, { "created_ino": "0x10000000230", "tid": 88 }, { "created_ino": "0x10000000231", "tid": 89 }, { "created_ino": "0x10000000232", "tid": 90 }, { "created_ino": "0x10000000233", "tid": 91 }, { "created_ino": "0x10000000234", "tid": 92 }, { "created_ino": "0x10000000235", "tid": 93 }, { "created_ino": "0x10000000236", "tid": 94 }, { "created_ino": "0x10000000237", "tid": 95 }, { "created_ino": "0x10000000238", "tid": 96 }, { "created_ino": "0x10000000239", "tid": 97 }, { "created_ino": "0x1000000023a", "tid": 98 }, { "created_ino": "0x1000000023b", "tid": 99 }, { "created_ino": "0x1000000023c", "tid": 100 }, { "created_ino": "0x1000000023d", "tid": 101 }, { "created_ino": "0x1000000023e", "tid": 102 }, { "created_ino": "0x1000000023f", "tid": 103 }, { "created_ino": "0x10000000240", "tid": 104 }, { "created_ino": "0x10000000241", "tid": 105 }, { "created_ino": "0x10000000242", "tid": 106 }, { "created_ino": "0x10000000243", "tid": 107 }, { "created_ino": "0x10000000244", "tid": 108 }, { "created_ino": "0x10000000245", "tid": 109 }, { "created_ino": "0x10000000246", "tid": 110 }, { "created_ino": "0x10000000247", "tid": 111 }, { "created_ino": "0x10000000248", "tid": 112 }, { "created_ino": "0x10000000249", "tid": 113 }, { "created_ino": "0x1000000024a", "tid": 114 }, { "created_ino": "0x1000000024b", "tid": 115 }, { "created_ino": "0x1000000024c", "tid": 116 }, { "created_ino": "0x1000000024d", "tid": 117 }, { "created_ino": "0x1000000024e", "tid": 118 }, { "created_ino": "0x1000000024f", "tid": 119 }, { "created_ino": "0x10000000250", "tid": 120 }, { "created_ino": "0x10000000251", "tid": 121 }, { "created_ino": "0x10000000252", "tid": 122 }, { "created_ino": "0x10000000253", "tid": 123 }, { "created_ino": "0x10000000254", "tid": 124 }, { "created_ino": "0x10000000255", "tid": 125 }, { "created_ino": "0x10000000256", "tid": 126 }, { "created_ino": "0x10000000257", "tid": 127 }, { "created_ino": "0x10000000258", "tid": 128 }, { "created_ino": "0x10000000259", "tid": 129 }, { "created_ino": "0x1000000025a", "tid": 130 }, { "created_ino": "0x1000000025b", "tid": 131 }, { "created_ino": "0x1000000025c", "tid": 132 }, { "created_ino": "0x1000000025d", "tid": 133 }, { "created_ino": "0x1000000025e", "tid": 134 }, { "created_ino": "0x1000000025f", "tid": 135 }, { "created_ino": "0x10000000260", "tid": 136 }, { "created_ino": "0x10000000261", "tid": 137 }, { "created_ino": "0x10000000262", "tid": 138 }, { "created_ino": "0x10000000263", "tid": 139 }, { "created_ino": "0x10000000264", "tid": 140 }, { "created_ino": "0x10000000265", "tid": 141 }, { "created_ino": "0x10000000266", "tid": 142 }, { "created_ino": "0x10000000267", "tid": 143 }, { "created_ino": "0x10000000268", "tid": 144 }, { "created_ino": "0x10000000269", "tid": 145 }, { "created_ino": "0x1000000026a", "tid": 146 }, { "created_ino": "0x1000000026b", "tid": 147 }, { "created_ino": "0x1000000026c", "tid": 148 }, { "created_ino": "0x1000000026d", "tid": 149 }, { "created_ino": "0x1000000026e", "tid": 150 }, { "created_ino": "0x1000000026f", "tid": 151 }, { "created_ino": "0x10000000270", "tid": 152 }, { "created_ino": "0x10000000271", "tid": 153 }, { "created_ino": "0x10000000272", "tid": 154 }, { "created_ino": "0x10000000273", "tid": 155 }, { "created_ino": "0x10000000274", "tid": 156 }, { "created_ino": "0x10000000275", "tid": 157 }, { "created_ino": "0x10000000276", "tid": 158 }, { "created_ino": "0x10000000277", "tid": 159 }, { "created_ino": "0x10000000278", "tid": 160 }, { "created_ino": "0x10000000279", "tid": 161 }, { "created_ino": "0x1000000027a", "tid": 162 }, { "created_ino": "0x1000000027b", "tid": 163 }, { "created_ino": "0x1000000027c", "tid": 164 }, { "created_ino": "0x1000000027d", "tid": 165 }, { "created_ino": "0x1000000027e", "tid": 166 }, { "created_ino": "0x1000000027f", "tid": 167 }, { "created_ino": "0x10000000280", "tid": 168 }, { "created_ino": "0x10000000281", "tid": 169 }, { "created_ino": "0x10000000282", "tid": 170 }, { "created_ino": "0x10000000283", "tid": 171 }, { "created_ino": "0x10000000284", "tid": 172 }, { "created_ino": "0x10000000285", "tid": 173 }, { "created_ino": "0x10000000286", "tid": 174 }, { "created_ino": "0x10000000287", "tid": 175 }, { "created_ino": "0x10000000288", "tid": 176 }, { "created_ino": "0x10000000289", "tid": 177 }, { "created_ino": "0x1000000028a", "tid": 178 }, { "created_ino": "0x1000000028b", "tid": 179 }, { "created_ino": "0x1000000028c", "tid": 180 }, { "created_ino": "0x1000000028d", "tid": 181 }, { "created_ino": "0x1000000028e", "tid": 182 }, { "created_ino": "0x1000000028f", "tid": 183 }, { "created_ino": "0x10000000290", "tid": 184 }, { "created_ino": "0x10000000291", "tid": 185 }, { "created_ino": "0x10000000292", "tid": 186 }, { "created_ino": "0x10000000293", "tid": 187 }, { "created_ino": "0x10000000294", "tid": 188 }, { "created_ino": "0x10000000295", "tid": 189 }, { "created_ino": "0x10000000296", "tid": 190 }, { "created_ino": "0x10000000297", "tid": 191 }, { "created_ino": "0x10000000298", "tid": 192 }, { "created_ino": "0x10000000299", "tid": 193 }, { "created_ino": "0x1000000029a", "tid": 194 }, { "created_ino": "0x1000000029b", "tid": 195 }, { "created_ino": "0x1000000029c", "tid": 196 }, { "created_ino": "0x1000000029d", "tid": 197 }, { "created_ino": "0x1000000029e", "tid": 198 }, { "created_ino": "0x1000000029f", "tid": 199 }, { "created_ino": "0x100000002a0", "tid": 200 }, { "created_ino": "0x100000002a1", "tid": 201 }, { "created_ino": "0x100000002a2", "tid": 202 }, { "created_ino": "0x100000002a3", "tid": 203 }, { "created_ino": "0x100000002a4", "tid": 204 }, { "created_ino": "0x100000002a5", "tid": 205 }, { "created_ino": "0x100000002a6", "tid": 206 }, { "created_ino": "0x100000002a7", "tid": 207 }, { "created_ino": "0x100000002a8", "tid": 208 }, { "created_ino": "0x100000002a9", "tid": 209 }, { "created_ino": "0x100000002aa", "tid": 210 }, { "created_ino": "0x100000002ab", "tid": 211 }, { "created_ino": "0x100000002ac", "tid": 212 }, { "created_ino": "0x100000002ad", "tid": 213 }, { "created_ino": "0x100000002ae", "tid": 214 }, { "created_ino": "0x100000002af", "tid": 215 }, { "created_ino": "0x100000002b0", "tid": 216 }, { "created_ino": "0x100000002b1", "tid": 217 }, { "created_ino": "0x100000002b2", "tid": 218 }, { "created_ino": "0x100000002b3", "tid": 219 }, { "created_ino": "0x100000002b4", "tid": 220 }, { "created_ino": "0x100000002b5", "tid": 221 }, { "created_ino": "0x100000002b6", "tid": 222 }, { "created_ino": "0x100000002b7", "tid": 223 }, { "created_ino": "0x100000002b8", "tid": 224 }, { "created_ino": "0x100000002b9", "tid": 225 }, { "created_ino": "0x100000002ba", "tid": 226 }, { "created_ino": "0x100000002bb", "tid": 227 }, { "created_ino": "0x100000002bc", "tid": 228 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 120916560, "type": "v1" }, "name": { "num": 6832, "type": "client" } }, "id": 6832, "inst": "client.6832 v1:172.21.15.81:0/120916560", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 102, "num_completed_flushes": 0, "num_completed_requests": 200, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 802, "start": "0x100000002bd" } ], "recall_caps": { "halflife": 60, "value": 1113.3415575536553 }, "recall_caps_throttle": { "halflife": 1.5, "value": 263.1256978544796 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 124.0583918274414 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 99.96881387036817 }, "request_load_avg": 196, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 393.4029751297603 }, "state": "open", "uptime": 16.259671782 } ] 2024-09-16T01:23:04.559 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-16T01:23:04.559 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:23:04.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:23:04.605 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:23:04.658 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:23:04.658 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:23:04.658 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 200\nabs_path = "/home/ubuntu/cephtest/mnt.0/subdir"\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi081') 2024-09-16T01:23:04.658 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:04.658 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:04.675 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:04.675 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:04.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:23:04.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.867+0000 7fe55e442640 1 Processor -- start 2024-09-16T01:23:04.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.867+0000 7fe55e442640 1 -- start start 2024-09-16T01:23:04.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.868+0000 7fe55e442640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe55806f8d0 0x7fe558165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.868+0000 7fe55e442640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5580cdbe0 con 0x7fe55815b300 2024-09-16T01:23:04.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.868+0000 7fe55e442640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5580cd900 con 0x7fe558072d30 2024-09-16T01:23:04.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.868+0000 7fe55e442640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe5580728a0 con 0x7fe55806f8d0 2024-09-16T01:23:04.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.868+0000 7fe557fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe55815b300 0x7fe5580cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36718/0 (socket says 172.21.15.81:36718) 2024-09-16T01:23:04.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.868+0000 7fe557fff640 1 -- 172.21.15.81:0/291360562 learned_addr learned my addr 172.21.15.81:0/291360562 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:04.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.868+0000 7fe55c9df640 1 --2- 172.21.15.81:0/291360562 >> v2:172.21.15.102:3300/0 conn(0x7fe55806f8d0 0x7fe558165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.868+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4201781923 0 0) 0x7fe5580cdbe0 con 0x7fe55815b300 2024-09-16T01:23:04.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.868+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe540003520 con 0x7fe55815b300 2024-09-16T01:23:04.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2256909118 0 0) 0x7fe540003520 con 0x7fe55815b300 2024-09-16T01:23:04.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 >> v2:172.21.15.102:3300/0 conn(0x7fe55806f8d0 msgr2=0x7fe558165de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:04.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 --2- 172.21.15.81:0/291360562 >> v2:172.21.15.102:3300/0 conn(0x7fe55806f8d0 0x7fe558165de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 >> v1:172.21.15.102:6789/0 conn(0x7fe558072d30 legacy=0x7fe55806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe558072250 con 0x7fe55815b300 2024-09-16T01:23:04.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fe548001670 con 0x7fe55815b300 2024-09-16T01:23:04.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 >> v1:172.21.15.81:6789/0 conn(0x7fe55815b300 legacy=0x7fe5580cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 --2- 172.21.15.81:0/291360562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5400039b0 0x7fe540003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 --2- 172.21.15.81:0/291360562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540004800 0x7fe540004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 --2- 172.21.15.81:0/291360562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5400051c0 0x7fe54000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5580728a0 con 0x7fe5400039b0 2024-09-16T01:23:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe54000c160 con 0x7fe540004800 2024-09-16T01:23:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe54000c360 con 0x7fe5400051c0 2024-09-16T01:23:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe557fff640 1 --2- 172.21.15.81:0/291360562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5400039b0 0x7fe540003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe5577fe640 1 --2- 172.21.15.81:0/291360562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540004800 0x7fe540004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe55c9df640 1 --2- 172.21.15.81:0/291360562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5400051c0 0x7fe54000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe557fff640 1 -- 172.21.15.81:0/291360562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5400051c0 msgr2=0x7fe54000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe557fff640 1 --2- 172.21.15.81:0/291360562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5400051c0 0x7fe54000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe557fff640 1 -- 172.21.15.81:0/291360562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540004800 msgr2=0x7fe540004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe557fff640 1 --2- 172.21.15.81:0/291360562 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe540004800 0x7fe540004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe55c9df640 1 -- 172.21.15.81:0/291360562 reap_dead start 2024-09-16T01:23:04.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.869+0000 7fe557fff640 1 -- 172.21.15.81:0/291360562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe540003520 con 0x7fe5400039b0 2024-09-16T01:23:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.870+0000 7fe557fff640 1 --2- 172.21.15.81:0/291360562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5400039b0 0x7fe540003dd0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fe54800c210 tx=0x7fe540005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222fa0a7c0facd48 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.870+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548007d30 con 0x7fe5400039b0 2024-09-16T01:23:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.870+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe548005ad0 con 0x7fe5400039b0 2024-09-16T01:23:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.870+0000 7fe556ffd640 1 -- 172.21.15.81:0/291360562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe548007070 con 0x7fe5400039b0 2024-09-16T01:23:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.870+0000 7fe55e442640 1 -- 172.21.15.81:0/291360562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5400039b0 msgr2=0x7fe540003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.870+0000 7fe55e442640 1 --2- 172.21.15.81:0/291360562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5400039b0 0x7fe540003dd0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fe54800c210 tx=0x7fe540005830 comp rx=0 tx=0).stop 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.871+0000 7fe55e442640 1 -- 172.21.15.81:0/291360562 shutdown_connections 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.871+0000 7fe55e442640 1 --2- 172.21.15.81:0/291360562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5400039b0 0x7fe540003dd0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.871+0000 7fe55e442640 1 -- 172.21.15.81:0/291360562 >> 172.21.15.81:0/291360562 conn(0x7fe558067d70 msgr2=0x7fe55806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.871+0000 7fe55e442640 1 -- 172.21.15.81:0/291360562 shutdown_connections 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.871+0000 7fe55e442640 1 -- 172.21.15.81:0/291360562 wait complete. 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.872+0000 7fe55e442640 1 Processor -- start 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.872+0000 7fe55e442640 1 -- start start 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe55e442640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5400039b0 0x7fe55815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe55e442640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe558154040 0x7fe5581f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe55e442640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5581544c0 0x7fe5581f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe55e442640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5580d0160 con 0x7fe558154040 2024-09-16T01:23:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe55e442640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe5580cffe0 con 0x7fe5581544c0 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe55e442640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe55806f1c0 con 0x7fe5400039b0 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe5577fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe558154040 0x7fe5581f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe5577fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe558154040 0x7fe5581f59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35546/0 (socket says 172.21.15.81:35546) 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe5577fe640 1 -- 172.21.15.81:0/1222628224 learned_addr learned my addr 172.21.15.81:0/1222628224 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe5577fe640 1 -- 172.21.15.81:0/1222628224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5400039b0 msgr2=0x7fe55815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe5577fe640 1 --2- 172.21.15.81:0/1222628224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5400039b0 0x7fe55815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe5577fe640 1 -- 172.21.15.81:0/1222628224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5581544c0 msgr2=0x7fe5581f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe5577fe640 1 --2- 172.21.15.81:0/1222628224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5581544c0 0x7fe5581f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe5577fe640 1 -- 172.21.15.81:0/1222628224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5581f6940 con 0x7fe558154040 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe5577fe640 1 --2- 172.21.15.81:0/1222628224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe558154040 0x7fe5581f59e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00f5f0 tx=0x7fe54c00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe554ff9640 1 -- 172.21.15.81:0/1222628224 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c0052e0 con 0x7fe558154040 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe554ff9640 1 -- 172.21.15.81:0/1222628224 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54c018070 con 0x7fe558154040 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe554ff9640 1 -- 172.21.15.81:0/1222628224 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe54c003810 con 0x7fe558154040 2024-09-16T01:23:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe55e442640 1 -- 172.21.15.81:0/1222628224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5581f6660 con 0x7fe558154040 2024-09-16T01:23:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.873+0000 7fe55e442640 1 -- 172.21.15.81:0/1222628224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe558159c00 con 0x7fe558154040 2024-09-16T01:23:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.874+0000 7fe55e442640 1 -- 172.21.15.81:0/1222628224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55806f550 con 0x7fe558154040 2024-09-16T01:23:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.875+0000 7fe554ff9640 1 -- 172.21.15.81:0/1222628224 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe54c0039b0 con 0x7fe558154040 2024-09-16T01:23:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.875+0000 7fe554ff9640 1 --2- 172.21.15.81:0/1222628224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe54406c2b0 0x7fe54406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.875+0000 7fe554ff9640 1 -- 172.21.15.81:0/1222628224 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fe54c08b370 con 0x7fe558154040 2024-09-16T01:23:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.875+0000 7fe557fff640 1 --2- 172.21.15.81:0/1222628224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe54406c2b0 0x7fe54406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.876+0000 7fe557fff640 1 --2- 172.21.15.81:0/1222628224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe54406c2b0 0x7fe54406e770 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe548032000 tx=0x7fe548009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:04.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:04.880+0000 7fe554ff9640 1 -- 172.21.15.81:0/1222628224 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe54c059950 con 0x7fe558154040 2024-09-16T01:23:05.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.055+0000 7fe55e442640 1 -- 172.21.15.81:0/1222628224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe55815db60 con 0x7fe558154040 2024-09-16T01:23:05.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.056+0000 7fe554ff9640 1 -- 172.21.15.81:0/1222628224 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v125) ==== 80+0+0 (secure 0 0 0) 0x7fe54c059250 con 0x7fe558154040 2024-09-16T01:23:05.057 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:23:05.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.058+0000 7fe55e442640 1 -- 172.21.15.81:0/1222628224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe54406c2b0 msgr2=0x7fe54406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:05.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.058+0000 7fe55e442640 1 --2- 172.21.15.81:0/1222628224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe54406c2b0 0x7fe54406e770 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe548032000 tx=0x7fe548009030 comp rx=0 tx=0).stop 2024-09-16T01:23:05.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.058+0000 7fe55e442640 1 -- 172.21.15.81:0/1222628224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe558154040 msgr2=0x7fe5581f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:05.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.058+0000 7fe55e442640 1 --2- 172.21.15.81:0/1222628224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe558154040 0x7fe5581f59e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00f5f0 tx=0x7fe54c00fab0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.058+0000 7fe55e442640 1 -- 172.21.15.81:0/1222628224 shutdown_connections 2024-09-16T01:23:05.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.058+0000 7fe55e442640 1 --2- 172.21.15.81:0/1222628224 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe54406c2b0 0x7fe54406e770 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.058+0000 7fe55e442640 1 --2- 172.21.15.81:0/1222628224 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5581544c0 0x7fe5581f5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.058+0000 7fe55e442640 1 --2- 172.21.15.81:0/1222628224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe558154040 0x7fe5581f59e0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.058+0000 7fe55e442640 1 --2- 172.21.15.81:0/1222628224 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5400039b0 0x7fe55815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.058+0000 7fe55e442640 1 -- 172.21.15.81:0/1222628224 >> 172.21.15.81:0/1222628224 conn(0x7fe558067d70 msgr2=0x7fe55806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:05.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.058+0000 7fe55e442640 1 -- 172.21.15.81:0/1222628224 shutdown_connections 2024-09-16T01:23:05.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.058+0000 7fe55e442640 1 -- 172.21.15.81:0/1222628224 wait complete. 2024-09-16T01:23:05.071 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:23:05.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:05.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:05.164 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:23:05.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:05.165 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:23:05.180 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:23:05.180 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:23:05.180 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:05.198 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:23:05.198 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:05.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:23:05.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.354+0000 7f448b6f1640 1 Processor -- start 2024-09-16T01:23:05.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.355+0000 7f448b6f1640 1 -- start start 2024-09-16T01:23:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.355+0000 7f448b6f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f448415ba30 0x7f448406f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.355+0000 7f448b6f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f448406fd50 0x7f4484072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.355+0000 7f448b6f1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4484072e80 0x7f448406e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.355+0000 7f448b6f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f44840b4180 con 0x7f448415ba30 2024-09-16T01:23:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.355+0000 7f448b6f1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f44840b3570 con 0x7f4484072e80 2024-09-16T01:23:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.355+0000 7f448b6f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f44840b3850 con 0x7f448406fd50 2024-09-16T01:23:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.355+0000 7f448948d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f448415ba30 0x7f448406f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.355+0000 7f448948d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f448415ba30 0x7f448406f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35556/0 (socket says 172.21.15.81:35556) 2024-09-16T01:23:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.355+0000 7f448948d640 1 -- 172.21.15.81:0/3739051804 learned_addr learned my addr 172.21.15.81:0/3739051804 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.356+0000 7f448948d640 1 -- 172.21.15.81:0/3739051804 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f448406fd50 msgr2=0x7f4484072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:05.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.356+0000 7f448948d640 1 --2- 172.21.15.81:0/3739051804 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f448406fd50 0x7f4484072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.356+0000 7f448948d640 1 -- 172.21.15.81:0/3739051804 >> v2:172.21.15.102:3300/0 conn(0x7f4484072e80 msgr2=0x7f448406e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.356+0000 7f448948d640 1 --2- 172.21.15.81:0/3739051804 >> v2:172.21.15.102:3300/0 conn(0x7f4484072e80 0x7f448406e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.356+0000 7f448948d640 1 -- 172.21.15.81:0/3739051804 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44840b3b30 con 0x7f448415ba30 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.356+0000 7f448948d640 1 --2- 172.21.15.81:0/3739051804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448415ba30 0x7f448406f810 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f44840b4610 tx=0x7f447c02b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42db7df1a4e6477c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.357+0000 7f4483fff640 1 -- 172.21.15.81:0/3739051804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c00b040 con 0x7f448415ba30 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.357+0000 7f4483fff640 1 -- 172.21.15.81:0/3739051804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447c030710 con 0x7f448415ba30 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.357+0000 7f4483fff640 1 -- 172.21.15.81:0/3739051804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447c030ae0 con 0x7f448415ba30 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.357+0000 7f448b6f1640 1 -- 172.21.15.81:0/3739051804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448415ba30 msgr2=0x7f448406f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.357+0000 7f448b6f1640 1 --2- 172.21.15.81:0/3739051804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448415ba30 0x7f448406f810 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f44840b4610 tx=0x7f447c02b5b0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.357+0000 7f448b6f1640 1 -- 172.21.15.81:0/3739051804 shutdown_connections 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.357+0000 7f448b6f1640 1 --2- 172.21.15.81:0/3739051804 >> v2:172.21.15.102:3300/0 conn(0x7f4484072e80 0x7f448406e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.357+0000 7f448b6f1640 1 --2- 172.21.15.81:0/3739051804 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f448406fd50 0x7f4484072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.357+0000 7f448b6f1640 1 --2- 172.21.15.81:0/3739051804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448415ba30 0x7f448406f810 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.357+0000 7f448b6f1640 1 -- 172.21.15.81:0/3739051804 >> 172.21.15.81:0/3739051804 conn(0x7f4484067d70 msgr2=0x7f448406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.357+0000 7f448b6f1640 1 -- 172.21.15.81:0/3739051804 shutdown_connections 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.357+0000 7f448b6f1640 1 -- 172.21.15.81:0/3739051804 wait complete. 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.358+0000 7f448b6f1640 1 Processor -- start 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.358+0000 7f448b6f1640 1 -- start start 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f448b6f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448406fd50 0x7f44841f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f448b6f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4484072e80 0x7f4484153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f448b6f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448415ba30 0x7f44840aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f448b6f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44840ccfe0 con 0x7f448415ba30 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f448b6f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f44840ce810 con 0x7f448406fd50 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f448b6f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f44840cd160 con 0x7f4484072e80 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f4489c8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448415ba30 0x7f44840aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f4489c8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448415ba30 0x7f44840aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35570/0 (socket says 172.21.15.81:35570) 2024-09-16T01:23:05.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f4489c8e640 1 -- 172.21.15.81:0/2786634934 learned_addr learned my addr 172.21.15.81:0/2786634934 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f448948d640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448406fd50 0x7f44841f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f4488c8c640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4484072e80 0x7f4484153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f4489c8e640 1 -- 172.21.15.81:0/2786634934 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4484072e80 msgr2=0x7f4484153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f4489c8e640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4484072e80 0x7f4484153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f4489c8e640 1 -- 172.21.15.81:0/2786634934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448406fd50 msgr2=0x7f44841f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f4489c8e640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448406fd50 0x7f44841f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.359+0000 7f4489c8e640 1 -- 172.21.15.81:0/2786634934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44840a9490 con 0x7f448415ba30 2024-09-16T01:23:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.360+0000 7f4489c8e640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448415ba30 0x7f44840aac40 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f447400b970 tx=0x7f447400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.360+0000 7f4481ffb640 1 -- 172.21.15.81:0/2786634934 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474019070 con 0x7f448415ba30 2024-09-16T01:23:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.360+0000 7f4481ffb640 1 -- 172.21.15.81:0/2786634934 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f447400cb60 con 0x7f448415ba30 2024-09-16T01:23:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.360+0000 7f448b6f1640 1 -- 172.21.15.81:0/2786634934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44840a9770 con 0x7f448415ba30 2024-09-16T01:23:05.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.360+0000 7f4481ffb640 1 -- 172.21.15.81:0/2786634934 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474014440 con 0x7f448415ba30 2024-09-16T01:23:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.360+0000 7f448b6f1640 1 -- 172.21.15.81:0/2786634934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44840a9d30 con 0x7f448415ba30 2024-09-16T01:23:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.361+0000 7f448b6f1640 1 -- 172.21.15.81:0/2786634934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448406f810 con 0x7f448415ba30 2024-09-16T01:23:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.361+0000 7f4481ffb640 1 -- 172.21.15.81:0/2786634934 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f447401c070 con 0x7f448415ba30 2024-09-16T01:23:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.362+0000 7f4481ffb640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f447006c2b0 0x7f447006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.362+0000 7f4481ffb640 1 -- 172.21.15.81:0/2786634934 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f447408b280 con 0x7f448415ba30 2024-09-16T01:23:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.362+0000 7f448948d640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f447006c2b0 0x7f447006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.362+0000 7f448948d640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f447006c2b0 0x7f447006e770 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f447c035000 tx=0x7f447c00c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:05.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.366+0000 7f4481ffb640 1 -- 172.21.15.81:0/2786634934 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4474059210 con 0x7f448415ba30 2024-09-16T01:23:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.544+0000 7f448b6f1640 1 -- 172.21.15.81:0/2786634934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f44840cf740 con 0x7f448415ba30 2024-09-16T01:23:05.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.545+0000 7f4481ffb640 1 -- 172.21.15.81:0/2786634934 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v125) ==== 80+0+0 (secure 0 0 0) 0x7f447405d510 con 0x7f448415ba30 2024-09-16T01:23:05.547 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:23:05.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.547+0000 7f448b6f1640 1 -- 172.21.15.81:0/2786634934 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f447006c2b0 msgr2=0x7f447006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:05.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.547+0000 7f448b6f1640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f447006c2b0 0x7f447006e770 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f447c035000 tx=0x7f447c00c040 comp rx=0 tx=0).stop 2024-09-16T01:23:05.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.547+0000 7f448b6f1640 1 -- 172.21.15.81:0/2786634934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448415ba30 msgr2=0x7f44840aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:05.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.547+0000 7f448b6f1640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448415ba30 0x7f44840aac40 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f447400b970 tx=0x7f447400be30 comp rx=0 tx=0).stop 2024-09-16T01:23:05.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.547+0000 7f448b6f1640 1 -- 172.21.15.81:0/2786634934 shutdown_connections 2024-09-16T01:23:05.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.547+0000 7f448b6f1640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f447006c2b0 0x7f447006e770 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.547+0000 7f448b6f1640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f448415ba30 0x7f44840aac40 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.547+0000 7f448b6f1640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4484072e80 0x7f4484153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.547+0000 7f448b6f1640 1 --2- 172.21.15.81:0/2786634934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448406fd50 0x7f44841f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.547+0000 7f448b6f1640 1 -- 172.21.15.81:0/2786634934 >> 172.21.15.81:0/2786634934 conn(0x7f4484067d70 msgr2=0x7f44840cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:05.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.547+0000 7f448b6f1640 1 -- 172.21.15.81:0/2786634934 shutdown_connections 2024-09-16T01:23:05.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.547+0000 7f448b6f1640 1 -- 172.21.15.81:0/2786634934 wait complete. 2024-09-16T01:23:05.560 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:23:05.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:05.560 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T01:23:05.591 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:23:05.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:05.592 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:23:05.650 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:23:05.650 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:05.650 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:05.668 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:23:05.668 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:23:05.668 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:23:05.668 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:05.708 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:23:05.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:05.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.805+0000 7fcc6ac1e640 1 Processor -- start 2024-09-16T01:23:05.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.805+0000 7fcc6ac1e640 1 -- start start 2024-09-16T01:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc6ac1e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcc640d0be0 0x7fcc640cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc6ac1e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcc6415d460 0x7fcc640afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc6ac1e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc640af720 con 0x7fcc64145e00 2024-09-16T01:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc6ac1e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fcc641461e0 con 0x7fcc6415d460 2024-09-16T01:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc6ac1e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fcc640cdf90 con 0x7fcc640d0be0 2024-09-16T01:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc691bb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcc6415d460 0x7fcc640afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc691bb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcc6415d460 0x7fcc640afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35586/0 (socket says 172.21.15.81:35586) 2024-09-16T01:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc689ba640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcc64145e00 0x7fcc640d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36732/0 (socket says 172.21.15.81:36732) 2024-09-16T01:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc691bb640 1 -- 172.21.15.81:0/1956532398 learned_addr learned my addr 172.21.15.81:0/1956532398 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc5bfff640 1 --2- 172.21.15.81:0/1956532398 >> v2:172.21.15.102:3300/0 conn(0x7fcc640d0be0 0x7fcc640cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc691bb640 1 -- 172.21.15.81:0/1956532398 >> v2:172.21.15.102:3300/0 conn(0x7fcc640d0be0 msgr2=0x7fcc640cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc691bb640 1 --2- 172.21.15.81:0/1956532398 >> v2:172.21.15.102:3300/0 conn(0x7fcc640d0be0 0x7fcc640cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc691bb640 1 -- 172.21.15.81:0/1956532398 >> v1:172.21.15.81:6789/0 conn(0x7fcc64145e00 legacy=0x7fcc640d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc691bb640 1 -- 172.21.15.81:0/1956532398 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc640ce270 con 0x7fcc6415d460 2024-09-16T01:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.806+0000 7fcc5b7fe640 1 -- 172.21.15.81:0/1956532398 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034134595 0 0) 0x7fcc640af720 con 0x7fcc64145e00 2024-09-16T01:23:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.807+0000 7fcc691bb640 1 --2- 172.21.15.81:0/1956532398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc6415d460 0x7fcc640afc00 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fcc64156fe0 tx=0x7fcc5c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73d92e939fd6145 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.807+0000 7fcc5b7fe640 1 -- 172.21.15.81:0/1956532398 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c036070 con 0x7fcc6415d460 2024-09-16T01:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.807+0000 7fcc5b7fe640 1 -- 172.21.15.81:0/1956532398 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5c031600 con 0x7fcc6415d460 2024-09-16T01:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.807+0000 7fcc5b7fe640 1 -- 172.21.15.81:0/1956532398 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0319d0 con 0x7fcc6415d460 2024-09-16T01:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.808+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1956532398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc6415d460 msgr2=0x7fcc640afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.808+0000 7fcc6ac1e640 1 --2- 172.21.15.81:0/1956532398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc6415d460 0x7fcc640afc00 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fcc64156fe0 tx=0x7fcc5c02a730 comp rx=0 tx=0).stop 2024-09-16T01:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.808+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1956532398 shutdown_connections 2024-09-16T01:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.808+0000 7fcc6ac1e640 1 --2- 172.21.15.81:0/1956532398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc6415d460 0x7fcc640afc00 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.808+0000 7fcc6ac1e640 1 --2- 172.21.15.81:0/1956532398 >> v2:172.21.15.102:3300/0 conn(0x7fcc640d0be0 0x7fcc640cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.808+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1956532398 >> 172.21.15.81:0/1956532398 conn(0x7fcc640b2f40 msgr2=0x7fcc640b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.808+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1956532398 shutdown_connections 2024-09-16T01:23:05.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.808+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1956532398 wait complete. 2024-09-16T01:23:05.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.809+0000 7fcc6ac1e640 1 Processor -- start 2024-09-16T01:23:05.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.809+0000 7fcc6ac1e640 1 -- start start 2024-09-16T01:23:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc6ac1e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc640d0be0 0x7fcc6409ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc6ac1e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc64145e00 0x7fcc640b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc6ac1e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc6415d460 0x7fcc641f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc6ac1e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6415d8b0 con 0x7fcc640d0be0 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc6ac1e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcc640ce830 con 0x7fcc6415d460 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc6ac1e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcc640cede0 con 0x7fcc64145e00 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc689ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc640d0be0 0x7fcc6409ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc689ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc640d0be0 0x7fcc6409ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35588/0 (socket says 172.21.15.81:35588) 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc689ba640 1 -- 172.21.15.81:0/1566432875 learned_addr learned my addr 172.21.15.81:0/1566432875 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc691bb640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc6415d460 0x7fcc641f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc5bfff640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc64145e00 0x7fcc640b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc689ba640 1 -- 172.21.15.81:0/1566432875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc64145e00 msgr2=0x7fcc640b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc689ba640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc64145e00 0x7fcc640b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc689ba640 1 -- 172.21.15.81:0/1566432875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc6415d460 msgr2=0x7fcc641f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc689ba640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc6415d460 0x7fcc641f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc689ba640 1 -- 172.21.15.81:0/1566432875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc640b55c0 con 0x7fcc640d0be0 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc5bfff640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc64145e00 0x7fcc640b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc691bb640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc6415d460 0x7fcc641f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc689ba640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc640d0be0 0x7fcc6409ecc0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000c4d0 tx=0x7fcc6000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc597fa640 1 -- 172.21.15.81:0/1566432875 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60018070 con 0x7fcc640d0be0 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc597fa640 1 -- 172.21.15.81:0/1566432875 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc60007500 con 0x7fcc640d0be0 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1566432875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc640b58a0 con 0x7fcc640d0be0 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc597fa640 1 -- 172.21.15.81:0/1566432875 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc60004a20 con 0x7fcc640d0be0 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.810+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1566432875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc640b5e60 con 0x7fcc640d0be0 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.811+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1566432875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc640cd8a0 con 0x7fcc640d0be0 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.812+0000 7fcc597fa640 1 -- 172.21.15.81:0/1566432875 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcc6001b070 con 0x7fcc640d0be0 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.812+0000 7fcc597fa640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcc5006c2b0 0x7fcc5006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.813+0000 7fcc5bfff640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcc5006c2b0 0x7fcc5006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.813+0000 7fcc597fa640 1 -- 172.21.15.81:0/1566432875 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fcc6008a920 con 0x7fcc640d0be0 2024-09-16T01:23:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.813+0000 7fcc5bfff640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcc5006c2b0 0x7fcc5006e770 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcc640b00e0 tx=0x7fcc54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:05.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:05.817+0000 7fcc597fa640 1 -- 172.21.15.81:0/1566432875 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc60058f00 con 0x7fcc640d0be0 2024-09-16T01:23:06.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.018+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1566432875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc640b0110 con 0x7fcc640d0be0 2024-09-16T01:23:06.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.018+0000 7fcc597fa640 1 -- 172.21.15.81:0/1566432875 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5228 (secure 0 0 0) 0x7fcc60058800 con 0x7fcc640d0be0 2024-09-16T01:23:06.020 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:06.020 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":68,"btime":"2024-09-16T01:23:03:219814+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3471922615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3471922615},{"type":"v1","addr":"172.21.15.102:6834","nonce":3471922615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6697,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/749780612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":749780612},{"type":"v1","addr":"172.21.15.81:6837","nonce":749780612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2257484883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":2257484883},{"type":"v1","addr":"172.21.15.102:6835","nonce":2257484883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:37.794648+0000","modified":"2024-09-16T01:23:02.508109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7674},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7674":{"gid":7674,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2398957156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2398957156},{"type":"v1","addr":"172.21.15.81:6835","nonce":2398957156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7674,"qdb_cluster":[7674]},"id":9}]} 2024-09-16T01:23:06.020 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 68 2024-09-16T01:23:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.020+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1566432875 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcc5006c2b0 msgr2=0x7fcc5006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.020+0000 7fcc6ac1e640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcc5006c2b0 0x7fcc5006e770 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fcc640b00e0 tx=0x7fcc54008040 comp rx=0 tx=0).stop 2024-09-16T01:23:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.020+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1566432875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc640d0be0 msgr2=0x7fcc6409ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.020+0000 7fcc6ac1e640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc640d0be0 0x7fcc6409ecc0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fcc6000c4d0 tx=0x7fcc6000c990 comp rx=0 tx=0).stop 2024-09-16T01:23:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.020+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1566432875 shutdown_connections 2024-09-16T01:23:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.020+0000 7fcc6ac1e640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcc5006c2b0 0x7fcc5006e770 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.020+0000 7fcc6ac1e640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc6415d460 0x7fcc641f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.020+0000 7fcc6ac1e640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcc64145e00 0x7fcc640b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.020+0000 7fcc6ac1e640 1 --2- 172.21.15.81:0/1566432875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc640d0be0 0x7fcc6409ecc0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.020+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1566432875 >> 172.21.15.81:0/1566432875 conn(0x7fcc640b2f40 msgr2=0x7fcc640b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.020+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1566432875 shutdown_connections 2024-09-16T01:23:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.020+0000 7fcc6ac1e640 1 -- 172.21.15.81:0/1566432875 wait complete. 2024-09-16T01:23:06.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.130+0000 7fe93efb0640 1 Processor -- start 2024-09-16T01:23:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.130+0000 7fe93efb0640 1 -- start start 2024-09-16T01:23:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.131+0000 7fe93efb0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe938162060 0x7fe9380b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.131+0000 7fe93efb0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe9380b64b0 0x7fe9380b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.131+0000 7fe93efb0640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe93806d9f0 con 0x7fe938161c80 2024-09-16T01:23:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.131+0000 7fe93efb0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe93806dcd0 con 0x7fe9380b64b0 2024-09-16T01:23:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.131+0000 7fe93efb0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe93806dfb0 con 0x7fe938162060 2024-09-16T01:23:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.131+0000 7fe937fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe938162060 0x7fe9380b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.131+0000 7fe93d54d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe9380b64b0 0x7fe9380b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.131+0000 7fe937fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe938162060 0x7fe9380b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:56462/0 (socket says 172.21.15.81:56462) 2024-09-16T01:23:06.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.131+0000 7fe937fff640 1 -- 172.21.15.81:0/3186953707 learned_addr learned my addr 172.21.15.81:0/3186953707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:06.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.132+0000 7fe937fff640 1 -- 172.21.15.81:0/3186953707 >> v2:172.21.15.102:3300/0 conn(0x7fe9380b64b0 msgr2=0x7fe9380b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:06.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.132+0000 7fe937fff640 1 --2- 172.21.15.81:0/3186953707 >> v2:172.21.15.102:3300/0 conn(0x7fe9380b64b0 0x7fe9380b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.132+0000 7fe937fff640 1 -- 172.21.15.81:0/3186953707 >> v1:172.21.15.102:6789/0 conn(0x7fe938161c80 legacy=0x7fe93806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.132+0000 7fe937fff640 1 -- 172.21.15.81:0/3186953707 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9380d01f0 con 0x7fe938162060 2024-09-16T01:23:06.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.132+0000 7fe93d54d640 1 --2- 172.21.15.81:0/3186953707 >> v2:172.21.15.102:3300/0 conn(0x7fe9380b64b0 0x7fe9380b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:06.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.132+0000 7fe937fff640 1 --2- 172.21.15.81:0/3186953707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe938162060 0x7fe9380b5f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe924009870 tx=0x7fe92402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ebce7236ce458b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:06.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.133+0000 7fe9377fe640 1 -- 172.21.15.81:0/3186953707 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924037070 con 0x7fe938162060 2024-09-16T01:23:06.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.133+0000 7fe9377fe640 1 -- 172.21.15.81:0/3186953707 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe924032440 con 0x7fe938162060 2024-09-16T01:23:06.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.133+0000 7fe9377fe640 1 -- 172.21.15.81:0/3186953707 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924032810 con 0x7fe938162060 2024-09-16T01:23:06.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.133+0000 7fe93efb0640 1 -- 172.21.15.81:0/3186953707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe938162060 msgr2=0x7fe9380b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.133+0000 7fe93efb0640 1 --2- 172.21.15.81:0/3186953707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe938162060 0x7fe9380b5f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe924009870 tx=0x7fe92402a270 comp rx=0 tx=0).stop 2024-09-16T01:23:06.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.133+0000 7fe93efb0640 1 -- 172.21.15.81:0/3186953707 shutdown_connections 2024-09-16T01:23:06.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.133+0000 7fe93efb0640 1 --2- 172.21.15.81:0/3186953707 >> v2:172.21.15.102:3300/0 conn(0x7fe9380b64b0 0x7fe9380b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.133+0000 7fe93efb0640 1 --2- 172.21.15.81:0/3186953707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe938162060 0x7fe9380b5f70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.133+0000 7fe93efb0640 1 -- 172.21.15.81:0/3186953707 >> 172.21.15.81:0/3186953707 conn(0x7fe9380d44f0 msgr2=0x7fe9380d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:06.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.133+0000 7fe93efb0640 1 -- 172.21.15.81:0/3186953707 shutdown_connections 2024-09-16T01:23:06.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.133+0000 7fe93efb0640 1 -- 172.21.15.81:0/3186953707 wait complete. 2024-09-16T01:23:06.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.134+0000 7fe93efb0640 1 Processor -- start 2024-09-16T01:23:06.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.134+0000 7fe93efb0640 1 -- start start 2024-09-16T01:23:06.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.135+0000 7fe93efb0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9380b64b0 0x7fe938159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.135+0000 7fe93efb0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe938161c80 0x7fe9380b95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.135+0000 7fe93efb0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe938162060 0x7fe938159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.135+0000 7fe93efb0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9380cf1e0 con 0x7fe938162060 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.135+0000 7fe93efb0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe9380d2aa0 con 0x7fe938161c80 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.135+0000 7fe93efb0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe9380cf360 con 0x7fe9380b64b0 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.135+0000 7fe93d54d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe938162060 0x7fe938159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.135+0000 7fe937fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe938161c80 0x7fe9380b95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.135+0000 7fe93d54d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe938162060 0x7fe938159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35592/0 (socket says 172.21.15.81:35592) 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.135+0000 7fe937fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe938161c80 0x7fe9380b95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:52376/0 (socket says 172.21.15.81:52376) 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.135+0000 7fe93d54d640 1 -- 172.21.15.81:0/615752239 learned_addr learned my addr 172.21.15.81:0/615752239 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.135+0000 7fe93cd4c640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9380b64b0 0x7fe938159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.136+0000 7fe937fff640 1 -- 172.21.15.81:0/615752239 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9380b64b0 msgr2=0x7fe938159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.136+0000 7fe937fff640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9380b64b0 0x7fe938159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.136+0000 7fe937fff640 1 -- 172.21.15.81:0/615752239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe938162060 msgr2=0x7fe938159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.136+0000 7fe937fff640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe938162060 0x7fe938159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.136+0000 7fe937fff640 1 -- 172.21.15.81:0/615752239 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9380b9d40 con 0x7fe938161c80 2024-09-16T01:23:06.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.136+0000 7fe93d54d640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe938162060 0x7fe938159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:06.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.136+0000 7fe937fff640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe938161c80 0x7fe9380b95a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe924031000 tx=0x7fe9240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:06.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.136+0000 7fe9357fa640 1 -- 172.21.15.81:0/615752239 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924041020 con 0x7fe938161c80 2024-09-16T01:23:06.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.136+0000 7fe9357fa640 1 -- 172.21.15.81:0/615752239 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe924030640 con 0x7fe938161c80 2024-09-16T01:23:06.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.136+0000 7fe93efb0640 1 -- 172.21.15.81:0/615752239 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9380ba020 con 0x7fe938161c80 2024-09-16T01:23:06.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.136+0000 7fe9357fa640 1 -- 172.21.15.81:0/615752239 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe924037040 con 0x7fe938161c80 2024-09-16T01:23:06.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.136+0000 7fe93efb0640 1 -- 172.21.15.81:0/615752239 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9380c85c0 con 0x7fe938161c80 2024-09-16T01:23:06.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.137+0000 7fe93efb0640 1 -- 172.21.15.81:0/615752239 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9380d2c50 con 0x7fe938161c80 2024-09-16T01:23:06.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.138+0000 7fe9357fa640 1 -- 172.21.15.81:0/615752239 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe924044020 con 0x7fe938161c80 2024-09-16T01:23:06.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.138+0000 7fe9357fa640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe91c06c2b0 0x7fe91c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.138+0000 7fe9357fa640 1 -- 172.21.15.81:0/615752239 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fe9240abcf0 con 0x7fe938161c80 2024-09-16T01:23:06.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.138+0000 7fe93cd4c640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe91c06c2b0 0x7fe91c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.139+0000 7fe93cd4c640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe91c06c2b0 0x7fe91c06e770 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe9381f7dd0 tx=0x7fe92c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:06.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.143+0000 7fe9357fa640 1 -- 172.21.15.81:0/615752239 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe92404b030 con 0x7fe938161c80 2024-09-16T01:23:06.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.345+0000 7fe93efb0640 1 -- 172.21.15.81:0/615752239 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9380b59a0 con 0x7fe938161c80 2024-09-16T01:23:06.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.346+0000 7fe9357fa640 1 -- 172.21.15.81:0/615752239 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5228 (secure 0 0 0) 0x7fe924079d70 con 0x7fe938161c80 2024-09-16T01:23:06.348 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:06.348 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":68,"btime":"2024-09-16T01:23:03:219814+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3471922615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3471922615},{"type":"v1","addr":"172.21.15.102:6834","nonce":3471922615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6697,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/749780612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":749780612},{"type":"v1","addr":"172.21.15.81:6837","nonce":749780612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2257484883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":2257484883},{"type":"v1","addr":"172.21.15.102:6835","nonce":2257484883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:37.794648+0000","modified":"2024-09-16T01:23:02.508109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7674},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7674":{"gid":7674,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2398957156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2398957156},{"type":"v1","addr":"172.21.15.81:6835","nonce":2398957156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7674,"qdb_cluster":[7674]},"id":9}]} 2024-09-16T01:23:06.349 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 68 2024-09-16T01:23:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.348+0000 7fe93efb0640 1 -- 172.21.15.81:0/615752239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe91c06c2b0 msgr2=0x7fe91c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.348+0000 7fe93efb0640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe91c06c2b0 0x7fe91c06e770 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe9381f7dd0 tx=0x7fe92c009040 comp rx=0 tx=0).stop 2024-09-16T01:23:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.348+0000 7fe93efb0640 1 -- 172.21.15.81:0/615752239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe938161c80 msgr2=0x7fe9380b95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.348+0000 7fe93efb0640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe938161c80 0x7fe9380b95a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe924031000 tx=0x7fe9240046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.348+0000 7fe93efb0640 1 -- 172.21.15.81:0/615752239 shutdown_connections 2024-09-16T01:23:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.348+0000 7fe93efb0640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe91c06c2b0 0x7fe91c06e770 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.348+0000 7fe93efb0640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe938162060 0x7fe938159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.348+0000 7fe93efb0640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe938161c80 0x7fe9380b95a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.348+0000 7fe93efb0640 1 --2- 172.21.15.81:0/615752239 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9380b64b0 0x7fe938159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.348+0000 7fe93efb0640 1 -- 172.21.15.81:0/615752239 >> 172.21.15.81:0/615752239 conn(0x7fe9380d44f0 msgr2=0x7fe9380d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:06.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.348+0000 7fe93efb0640 1 -- 172.21.15.81:0/615752239 shutdown_connections 2024-09-16T01:23:06.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.348+0000 7fe93efb0640 1 -- 172.21.15.81:0/615752239 wait complete. 2024-09-16T01:23:06.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:23:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.457+0000 7f45241be640 1 Processor -- start 2024-09-16T01:23:06.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.457+0000 7f45241be640 1 -- start start 2024-09-16T01:23:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.458+0000 7f45241be640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f451c06f8d0 0x7f451c165de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.458+0000 7f45241be640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f451c0cdbe0 con 0x7f451c072d30 2024-09-16T01:23:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.458+0000 7f45241be640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f451c0cd900 con 0x7f451c15b300 2024-09-16T01:23:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.458+0000 7f45241be640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f451c0728a0 con 0x7f451c06f8d0 2024-09-16T01:23:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.458+0000 7f4521759640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f451c072d30 0x7f451c06f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36734/0 (socket says 172.21.15.81:36734) 2024-09-16T01:23:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.458+0000 7f4521759640 1 -- 172.21.15.81:0/2349999359 learned_addr learned my addr 172.21.15.81:0/2349999359 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.458+0000 7f452275b640 1 --2- 172.21.15.81:0/2349999359 >> v2:172.21.15.81:3300/0 conn(0x7f451c06f8d0 0x7f451c165de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.458+0000 7f452275b640 1 -- 172.21.15.81:0/2349999359 >> v1:172.21.15.102:6789/0 conn(0x7f451c15b300 legacy=0x7f451c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.458+0000 7f452275b640 1 -- 172.21.15.81:0/2349999359 >> v1:172.21.15.81:6789/0 conn(0x7f451c072d30 legacy=0x7f451c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.458+0000 7f452275b640 1 -- 172.21.15.81:0/2349999359 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c072250 con 0x7f451c06f8d0 2024-09-16T01:23:06.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.458+0000 7f4520f58640 1 -- 172.21.15.81:0/2349999359 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1541957969 0 0) 0x7f451c0cdbe0 con 0x7f451c072d30 2024-09-16T01:23:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.459+0000 7f452275b640 1 --2- 172.21.15.81:0/2349999359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451c06f8d0 0x7f451c165de0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4514009d90 tx=0x7f451402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a80fb7ec9fb1cf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.459+0000 7f4520f58640 1 -- 172.21.15.81:0/2349999359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514007740 con 0x7f451c06f8d0 2024-09-16T01:23:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.459+0000 7f4520f58640 1 -- 172.21.15.81:0/2349999359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45140078e0 con 0x7f451c06f8d0 2024-09-16T01:23:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.459+0000 7f4520f58640 1 -- 172.21.15.81:0/2349999359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514007cb0 con 0x7f451c06f8d0 2024-09-16T01:23:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.460+0000 7f45241be640 1 -- 172.21.15.81:0/2349999359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451c06f8d0 msgr2=0x7f451c165de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.460+0000 7f45241be640 1 --2- 172.21.15.81:0/2349999359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451c06f8d0 0x7f451c165de0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4514009d90 tx=0x7f451402a660 comp rx=0 tx=0).stop 2024-09-16T01:23:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.460+0000 7f45241be640 1 -- 172.21.15.81:0/2349999359 shutdown_connections 2024-09-16T01:23:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.460+0000 7f45241be640 1 --2- 172.21.15.81:0/2349999359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451c06f8d0 0x7f451c165de0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.460+0000 7f45241be640 1 -- 172.21.15.81:0/2349999359 >> 172.21.15.81:0/2349999359 conn(0x7f451c067d70 msgr2=0x7f451c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.460+0000 7f45241be640 1 -- 172.21.15.81:0/2349999359 shutdown_connections 2024-09-16T01:23:06.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.460+0000 7f45241be640 1 -- 172.21.15.81:0/2349999359 wait complete. 2024-09-16T01:23:06.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.461+0000 7f45241be640 1 Processor -- start 2024-09-16T01:23:06.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.461+0000 7f45241be640 1 -- start start 2024-09-16T01:23:06.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f45241be640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f451c06f8d0 0x7f451c153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f45241be640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451c072d30 0x7f451c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f45241be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451c15b300 0x7f451c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f45241be640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f451c0cffe0 con 0x7f451c15b300 2024-09-16T01:23:06.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f45241be640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f451c0cd5c0 con 0x7f451c06f8d0 2024-09-16T01:23:06.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f45241be640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f451c0d0160 con 0x7f451c072d30 2024-09-16T01:23:06.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f452275b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451c15b300 0x7f451c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f452275b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451c15b300 0x7f451c154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35620/0 (socket says 172.21.15.81:35620) 2024-09-16T01:23:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f452275b640 1 -- 172.21.15.81:0/3900897123 learned_addr learned my addr 172.21.15.81:0/3900897123 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f4521f5a640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f451c06f8d0 0x7f451c153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f4521759640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451c072d30 0x7f451c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f452275b640 1 -- 172.21.15.81:0/3900897123 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451c072d30 msgr2=0x7f451c150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f452275b640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451c072d30 0x7f451c150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f452275b640 1 -- 172.21.15.81:0/3900897123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f451c06f8d0 msgr2=0x7f451c153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f452275b640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f451c06f8d0 0x7f451c153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f452275b640 1 -- 172.21.15.81:0/3900897123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c151090 con 0x7f451c15b300 2024-09-16T01:23:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f4521f5a640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f451c06f8d0 0x7f451c153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f452275b640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451c15b300 0x7f451c154ab0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4514009d90 tx=0x7f4514004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f45127fc640 1 -- 172.21.15.81:0/3900897123 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4514003990 con 0x7f451c15b300 2024-09-16T01:23:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f45127fc640 1 -- 172.21.15.81:0/3900897123 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4514003b30 con 0x7f451c15b300 2024-09-16T01:23:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f45241be640 1 -- 172.21.15.81:0/3900897123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451c153f40 con 0x7f451c15b300 2024-09-16T01:23:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f45127fc640 1 -- 172.21.15.81:0/3900897123 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451403a880 con 0x7f451c15b300 2024-09-16T01:23:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.462+0000 7f45241be640 1 -- 172.21.15.81:0/3900897123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451c152240 con 0x7f451c15b300 2024-09-16T01:23:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.463+0000 7f45241be640 1 -- 172.21.15.81:0/3900897123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f451c0cd3b0 con 0x7f451c15b300 2024-09-16T01:23:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.464+0000 7f45127fc640 1 -- 172.21.15.81:0/3900897123 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f451403aa20 con 0x7f451c15b300 2024-09-16T01:23:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.464+0000 7f45127fc640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f450006c2b0 0x7f450006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.464+0000 7f45127fc640 1 -- 172.21.15.81:0/3900897123 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f45140ae3d0 con 0x7f451c15b300 2024-09-16T01:23:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.464+0000 7f4521f5a640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f450006c2b0 0x7f450006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.465+0000 7f4521f5a640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f450006c2b0 0x7f450006e770 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4518007fd0 tx=0x7f4518009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:06.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.469+0000 7f45127fc640 1 -- 172.21.15.81:0/3900897123 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f451c0cd3b0 con 0x7f451c15b300 2024-09-16T01:23:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.636+0000 7f45241be640 1 -- 172.21.15.81:0/3900897123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f451c0b19a0 con 0x7f451c15b300 2024-09-16T01:23:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.637+0000 7f45127fc640 1 -- 172.21.15.81:0/3900897123 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+16960 (secure 0 0 0) 0x7f451402f300 con 0x7f451c15b300 2024-09-16T01:23:06.639 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:06.639 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":125,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:22:39.466201+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:22:36.412957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-16T01:22:36.768111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:23:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.639+0000 7f45241be640 1 -- 172.21.15.81:0/3900897123 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f450006c2b0 msgr2=0x7f450006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.639+0000 7f45241be640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f450006c2b0 0x7f450006e770 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4518007fd0 tx=0x7f4518009040 comp rx=0 tx=0).stop 2024-09-16T01:23:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.639+0000 7f45241be640 1 -- 172.21.15.81:0/3900897123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451c15b300 msgr2=0x7f451c154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.639+0000 7f45241be640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451c15b300 0x7f451c154ab0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4514009d90 tx=0x7f4514004a40 comp rx=0 tx=0).stop 2024-09-16T01:23:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.639+0000 7f45241be640 1 -- 172.21.15.81:0/3900897123 shutdown_connections 2024-09-16T01:23:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.639+0000 7f45241be640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f450006c2b0 0x7f450006e770 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.639+0000 7f45241be640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f451c15b300 0x7f451c154ab0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.639+0000 7f45241be640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f451c072d30 0x7f451c150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.639+0000 7f45241be640 1 --2- 172.21.15.81:0/3900897123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f451c06f8d0 0x7f451c153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.639+0000 7f45241be640 1 -- 172.21.15.81:0/3900897123 >> 172.21.15.81:0/3900897123 conn(0x7f451c067d70 msgr2=0x7f451c0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.639+0000 7f45241be640 1 -- 172.21.15.81:0/3900897123 shutdown_connections 2024-09-16T01:23:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.639+0000 7f45241be640 1 -- 172.21.15.81:0/3900897123 wait complete. 2024-09-16T01:23:06.652 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:23:06.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:06.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.748+0000 7fd5d43bd640 1 Processor -- start 2024-09-16T01:23:06.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.748+0000 7fd5d43bd640 1 -- start start 2024-09-16T01:23:06.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.749+0000 7fd5d43bd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5cc0d1540 0x7fd5cc06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.749+0000 7fd5d43bd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5cc09b690 0x7fd5cc06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.749+0000 7fd5d43bd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5cc0d1970 con 0x7fd5cc15e740 2024-09-16T01:23:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.749+0000 7fd5d43bd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd5cc15eb20 con 0x7fd5cc0d1540 2024-09-16T01:23:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.749+0000 7fd5d43bd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd5cc06d260 con 0x7fd5cc09b690 2024-09-16T01:23:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.749+0000 7fd5d1958640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5cc0d1540 0x7fd5cc06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.749+0000 7fd5d1958640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5cc0d1540 0x7fd5cc06dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35634/0 (socket says 172.21.15.81:35634) 2024-09-16T01:23:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.749+0000 7fd5d1958640 1 -- 172.21.15.81:0/1794535396 learned_addr learned my addr 172.21.15.81:0/1794535396 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:06.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.750+0000 7fd5d295a640 1 --2- 172.21.15.81:0/1794535396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5cc09b690 0x7fd5cc06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.750+0000 7fd5d1958640 1 -- 172.21.15.81:0/1794535396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5cc09b690 msgr2=0x7fd5cc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.750+0000 7fd5d1958640 1 --2- 172.21.15.81:0/1794535396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5cc09b690 0x7fd5cc06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.750+0000 7fd5d1958640 1 -- 172.21.15.81:0/1794535396 >> v1:172.21.15.102:6789/0 conn(0x7fd5cc15e740 legacy=0x7fd5cc06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:06.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.750+0000 7fd5d1958640 1 -- 172.21.15.81:0/1794535396 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc0d0780 con 0x7fd5cc0d1540 2024-09-16T01:23:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.750+0000 7fd5d1958640 1 --2- 172.21.15.81:0/1794535396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0d1540 0x7fd5cc06dbd0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fd5c00098a0 tx=0x7fd5c002a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20ce3dff057f084 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.751+0000 7fd5d1157640 1 -- 172.21.15.81:0/1794535396 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0037070 con 0x7fd5cc0d1540 2024-09-16T01:23:06.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.751+0000 7fd5d1157640 1 -- 172.21.15.81:0/1794535396 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c0032640 con 0x7fd5cc0d1540 2024-09-16T01:23:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.751+0000 7fd5d1157640 1 -- 172.21.15.81:0/1794535396 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0032a10 con 0x7fd5cc0d1540 2024-09-16T01:23:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.751+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1794535396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0d1540 msgr2=0x7fd5cc06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.751+0000 7fd5d43bd640 1 --2- 172.21.15.81:0/1794535396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0d1540 0x7fd5cc06dbd0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fd5c00098a0 tx=0x7fd5c002a320 comp rx=0 tx=0).stop 2024-09-16T01:23:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.751+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1794535396 shutdown_connections 2024-09-16T01:23:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.751+0000 7fd5d43bd640 1 --2- 172.21.15.81:0/1794535396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5cc09b690 0x7fd5cc06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.751+0000 7fd5d43bd640 1 --2- 172.21.15.81:0/1794535396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0d1540 0x7fd5cc06dbd0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.751+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1794535396 >> 172.21.15.81:0/1794535396 conn(0x7fd5cc0d23a0 msgr2=0x7fd5cc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.751+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1794535396 shutdown_connections 2024-09-16T01:23:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.751+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1794535396 wait complete. 2024-09-16T01:23:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.752+0000 7fd5d43bd640 1 Processor -- start 2024-09-16T01:23:06.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.753+0000 7fd5d43bd640 1 -- start start 2024-09-16T01:23:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.753+0000 7fd5d43bd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5cc09b690 0x7fd5cc14a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.753+0000 7fd5d43bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0d1540 0x7fd5cc14d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.753+0000 7fd5d43bd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5cc15e740 0x7fd5cc0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.753+0000 7fd5d43bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc0d1020 con 0x7fd5cc0d1540 2024-09-16T01:23:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.753+0000 7fd5d43bd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc0d0d40 con 0x7fd5cc15e740 2024-09-16T01:23:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.753+0000 7fd5d43bd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd5cc09bac0 con 0x7fd5cc09b690 2024-09-16T01:23:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.753+0000 7fd5d1958640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0d1540 0x7fd5cc14d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.753+0000 7fd5d1958640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0d1540 0x7fd5cc14d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35644/0 (socket says 172.21.15.81:35644) 2024-09-16T01:23:06.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.753+0000 7fd5d1958640 1 -- 172.21.15.81:0/1708826381 learned_addr learned my addr 172.21.15.81:0/1708826381 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5d295a640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5cc15e740 0x7fd5cc0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5d2159640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5cc09b690 0x7fd5cc14a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5d1958640 1 -- 172.21.15.81:0/1708826381 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5cc09b690 msgr2=0x7fd5cc14a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5d1958640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5cc09b690 0x7fd5cc14a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5d1958640 1 -- 172.21.15.81:0/1708826381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5cc15e740 msgr2=0x7fd5cc0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5d1958640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5cc15e740 0x7fd5cc0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5d1958640 1 -- 172.21.15.81:0/1708826381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc0c9700 con 0x7fd5cc0d1540 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5d1958640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0d1540 0x7fd5cc14d2c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fd5c00098a0 tx=0x7fd5c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5caffd640 1 -- 172.21.15.81:0/1708826381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0037040 con 0x7fd5cc0d1540 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5caffd640 1 -- 172.21.15.81:0/1708826381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c0042070 con 0x7fd5cc0d1540 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5caffd640 1 -- 172.21.15.81:0/1708826381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00309b0 con 0x7fd5cc0d1540 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1708826381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5cc14d800 con 0x7fd5cc0d1540 2024-09-16T01:23:06.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.754+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1708826381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5cc0cb980 con 0x7fd5cc0d1540 2024-09-16T01:23:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.755+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1708826381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5cc06cd20 con 0x7fd5cc0d1540 2024-09-16T01:23:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.755+0000 7fd5caffd640 1 -- 172.21.15.81:0/1708826381 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd5c0030b50 con 0x7fd5cc0d1540 2024-09-16T01:23:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.756+0000 7fd5caffd640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd5b806c2b0 0x7fd5b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.756+0000 7fd5caffd640 1 -- 172.21.15.81:0/1708826381 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fd5c00abee0 con 0x7fd5cc0d1540 2024-09-16T01:23:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.756+0000 7fd5d2159640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd5b806c2b0 0x7fd5b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:06.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.756+0000 7fd5d2159640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd5b806c2b0 0x7fd5b806e770 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc001d40 tx=0x7fd5bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:06.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.760+0000 7fd5caffd640 1 -- 172.21.15.81:0/1708826381 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5c007a4c0 con 0x7fd5cc0d1540 2024-09-16T01:23:06.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.958+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1708826381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5cc0d1cb0 con 0x7fd5cc0d1540 2024-09-16T01:23:06.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.959+0000 7fd5caffd640 1 -- 172.21.15.81:0/1708826381 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5228 (secure 0 0 0) 0x7fd5c0079dc0 con 0x7fd5cc0d1540 2024-09-16T01:23:06.961 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:06.961 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":68,"btime":"2024-09-16T01:23:03:219814+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3471922615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3471922615},{"type":"v1","addr":"172.21.15.102:6834","nonce":3471922615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6697,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/749780612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":749780612},{"type":"v1","addr":"172.21.15.81:6837","nonce":749780612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2257484883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":2257484883},{"type":"v1","addr":"172.21.15.102:6835","nonce":2257484883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:37.794648+0000","modified":"2024-09-16T01:23:02.508109+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7674},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7674":{"gid":7674,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6835/2398957156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2398957156},{"type":"v1","addr":"172.21.15.81:6835","nonce":2398957156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7674,"qdb_cluster":[7674]},"id":9}]} 2024-09-16T01:23:06.961 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 68 2024-09-16T01:23:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.961+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1708826381 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd5b806c2b0 msgr2=0x7fd5b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.961+0000 7fd5d43bd640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd5b806c2b0 0x7fd5b806e770 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc001d40 tx=0x7fd5bc009040 comp rx=0 tx=0).stop 2024-09-16T01:23:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.961+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1708826381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0d1540 msgr2=0x7fd5cc14d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.961+0000 7fd5d43bd640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0d1540 0x7fd5cc14d2c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fd5c00098a0 tx=0x7fd5c00046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.961+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1708826381 shutdown_connections 2024-09-16T01:23:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.961+0000 7fd5d43bd640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd5b806c2b0 0x7fd5b806e770 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.961+0000 7fd5d43bd640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5cc15e740 0x7fd5cc0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.961+0000 7fd5d43bd640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc0d1540 0x7fd5cc14d2c0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.961+0000 7fd5d43bd640 1 --2- 172.21.15.81:0/1708826381 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd5cc09b690 0x7fd5cc14a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.961+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1708826381 >> 172.21.15.81:0/1708826381 conn(0x7fd5cc0d23a0 msgr2=0x7fd5cc0b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:06.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.961+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1708826381 shutdown_connections 2024-09-16T01:23:06.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:06.961+0000 7fd5d43bd640 1 -- 172.21.15.81:0/1708826381 wait complete. 2024-09-16T01:23:06.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.069+0000 7f493c1e8640 1 Processor -- start 2024-09-16T01:23:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.069+0000 7f493c1e8640 1 -- start start 2024-09-16T01:23:07.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.070+0000 7f493c1e8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f493415b300 0x7f49340cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.070+0000 7f493c1e8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f49340cd3f0 0x7f493406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.070+0000 7f493c1e8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4934072d30 0x7f493406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.070+0000 7f493c1e8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f49340728a0 con 0x7f4934072d30 2024-09-16T01:23:07.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.070+0000 7f493c1e8640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f49340cdbe0 con 0x7f49340cd3f0 2024-09-16T01:23:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.070+0000 7f493c1e8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f49340cd900 con 0x7f493415b300 2024-09-16T01:23:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.070+0000 7f493a785640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4934072d30 0x7f493406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.070+0000 7f493a785640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4934072d30 0x7f493406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35646/0 (socket says 172.21.15.81:35646) 2024-09-16T01:23:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.070+0000 7f493a785640 1 -- 172.21.15.81:0/2381029111 learned_addr learned my addr 172.21.15.81:0/2381029111 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.071+0000 7f4939783640 1 --2- 172.21.15.81:0/2381029111 >> v2:172.21.15.102:3300/0 conn(0x7f49340cd3f0 0x7f493406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.071+0000 7f493a785640 1 -- 172.21.15.81:0/2381029111 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f493415b300 msgr2=0x7f49340cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.071+0000 7f4939f84640 1 --2- 172.21.15.81:0/2381029111 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f493415b300 0x7f49340cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.071+0000 7f493a785640 1 --2- 172.21.15.81:0/2381029111 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f493415b300 0x7f49340cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.071+0000 7f493a785640 1 -- 172.21.15.81:0/2381029111 >> v2:172.21.15.102:3300/0 conn(0x7f49340cd3f0 msgr2=0x7f493406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.071+0000 7f493a785640 1 --2- 172.21.15.81:0/2381029111 >> v2:172.21.15.102:3300/0 conn(0x7f49340cd3f0 0x7f493406f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.071+0000 7f493a785640 1 -- 172.21.15.81:0/2381029111 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4934072250 con 0x7f4934072d30 2024-09-16T01:23:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.071+0000 7f4939783640 1 --2- 172.21.15.81:0/2381029111 >> v2:172.21.15.102:3300/0 conn(0x7f49340cd3f0 0x7f493406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.071+0000 7f493a785640 1 --2- 172.21.15.81:0/2381029111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4934072d30 0x7f493406f700 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f493406fd40 tx=0x7f492c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6eb17f50d5eb00 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.071+0000 7f4938f82640 1 -- 172.21.15.81:0/2381029111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c036070 con 0x7f4934072d30 2024-09-16T01:23:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.072+0000 7f4938f82640 1 -- 172.21.15.81:0/2381029111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492c031600 con 0x7f4934072d30 2024-09-16T01:23:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.072+0000 7f4938f82640 1 -- 172.21.15.81:0/2381029111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c0319d0 con 0x7f4934072d30 2024-09-16T01:23:07.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.072+0000 7f493c1e8640 1 -- 172.21.15.81:0/2381029111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4934072d30 msgr2=0x7f493406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.072+0000 7f493c1e8640 1 --2- 172.21.15.81:0/2381029111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4934072d30 0x7f493406f700 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f493406fd40 tx=0x7f492c02a6a0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.072+0000 7f493c1e8640 1 -- 172.21.15.81:0/2381029111 shutdown_connections 2024-09-16T01:23:07.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.072+0000 7f493c1e8640 1 --2- 172.21.15.81:0/2381029111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4934072d30 0x7f493406f700 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.072+0000 7f493c1e8640 1 --2- 172.21.15.81:0/2381029111 >> v2:172.21.15.102:3300/0 conn(0x7f49340cd3f0 0x7f493406f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.072+0000 7f493c1e8640 1 --2- 172.21.15.81:0/2381029111 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f493415b300 0x7f49340cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.072+0000 7f493c1e8640 1 -- 172.21.15.81:0/2381029111 >> 172.21.15.81:0/2381029111 conn(0x7f4934067d70 msgr2=0x7f493406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:07.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.072+0000 7f493c1e8640 1 -- 172.21.15.81:0/2381029111 shutdown_connections 2024-09-16T01:23:07.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.072+0000 7f493c1e8640 1 -- 172.21.15.81:0/2381029111 wait complete. 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.073+0000 7f493c1e8640 1 Processor -- start 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.073+0000 7f493c1e8640 1 -- start start 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493c1e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4934072d30 0x7f4934145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493c1e8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49340cd3f0 0x7f4934157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493c1e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493415b300 0x7f49340caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493c1e8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f49340d0160 con 0x7f493415b300 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493c1e8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f49340cffe0 con 0x7f4934072d30 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493c1e8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f49340b3c40 con 0x7f49340cd3f0 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493a785640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493415b300 0x7f49340caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493a785640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493415b300 0x7f49340caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35650/0 (socket says 172.21.15.81:35650) 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493a785640 1 -- 172.21.15.81:0/2279978858 learned_addr learned my addr 172.21.15.81:0/2279978858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f4939783640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49340cd3f0 0x7f4934157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f4939f84640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4934072d30 0x7f4934145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493a785640 1 -- 172.21.15.81:0/2279978858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49340cd3f0 msgr2=0x7f4934157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493a785640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49340cd3f0 0x7f4934157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493a785640 1 -- 172.21.15.81:0/2279978858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4934072d30 msgr2=0x7f4934145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493a785640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4934072d30 0x7f4934145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f493a785640 1 -- 172.21.15.81:0/2279978858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4934152fb0 con 0x7f493415b300 2024-09-16T01:23:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.074+0000 7f4939783640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49340cd3f0 0x7f4934157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.075+0000 7f493a785640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493415b300 0x7f49340caa90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f492c02ac90 tx=0x7f492c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.075+0000 7f492a7fc640 1 -- 172.21.15.81:0/2279978858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c03f020 con 0x7f493415b300 2024-09-16T01:23:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.075+0000 7f492a7fc640 1 -- 172.21.15.81:0/2279978858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492c037040 con 0x7f493415b300 2024-09-16T01:23:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.075+0000 7f493c1e8640 1 -- 172.21.15.81:0/2279978858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4934157a20 con 0x7f493415b300 2024-09-16T01:23:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.075+0000 7f492a7fc640 1 -- 172.21.15.81:0/2279978858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c036070 con 0x7f493415b300 2024-09-16T01:23:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.075+0000 7f493c1e8640 1 -- 172.21.15.81:0/2279978858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4934157fe0 con 0x7f493415b300 2024-09-16T01:23:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.076+0000 7f493c1e8640 1 -- 172.21.15.81:0/2279978858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4934153180 con 0x7f493415b300 2024-09-16T01:23:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.076+0000 7f492a7fc640 1 -- 172.21.15.81:0/2279978858 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f492c042020 con 0x7f493415b300 2024-09-16T01:23:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.077+0000 7f492a7fc640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f491806c2b0 0x7f491806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.077+0000 7f492a7fc640 1 -- 172.21.15.81:0/2279978858 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f492c0abde0 con 0x7f493415b300 2024-09-16T01:23:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.077+0000 7f4939f84640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f491806c2b0 0x7f491806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.077+0000 7f4939f84640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f491806c2b0 0x7f491806e770 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f49341510d0 tx=0x7f4930008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.081+0000 7f492a7fc640 1 -- 172.21.15.81:0/2279978858 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f492c049020 con 0x7f493415b300 2024-09-16T01:23:07.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.280+0000 7f493c1e8640 1 -- 172.21.15.81:0/2279978858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f493415d170 con 0x7f493415b300 2024-09-16T01:23:07.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.281+0000 7f492a7fc640 1 -- 172.21.15.81:0/2279978858 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5229 (secure 0 0 0) 0x7f492c07a3c0 con 0x7f493415b300 2024-09-16T01:23:07.283 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:07.283 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"btime":"2024-09-16T01:23:07:241902+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3471922615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3471922615},{"type":"v1","addr":"172.21.15.102:6834","nonce":3471922615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6697,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/749780612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":749780612},{"type":"v1","addr":"172.21.15.81:6837","nonce":749780612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2257484883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":2257484883},{"type":"v1","addr":"172.21.15.102:6835","nonce":2257484883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:22:37.794648+0000","modified":"2024-09-16T01:23:06.508480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7674},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7674":{"gid":7674,"name":"c","rank":0,"incarnation":64,"state":"up:active","state_seq":10,"addr":"172.21.15.81:6835/2398957156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2398957156},{"type":"v1","addr":"172.21.15.81:6835","nonce":2398957156}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7674,"qdb_cluster":[7674]},"id":9}]} 2024-09-16T01:23:07.284 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 69 2024-09-16T01:23:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.283+0000 7f493c1e8640 1 -- 172.21.15.81:0/2279978858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f491806c2b0 msgr2=0x7f491806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.283+0000 7f493c1e8640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f491806c2b0 0x7f491806e770 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f49341510d0 tx=0x7f4930008040 comp rx=0 tx=0).stop 2024-09-16T01:23:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.283+0000 7f493c1e8640 1 -- 172.21.15.81:0/2279978858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493415b300 msgr2=0x7f49340caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.283+0000 7f493c1e8640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493415b300 0x7f49340caa90 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f492c02ac90 tx=0x7f492c004a40 comp rx=0 tx=0).stop 2024-09-16T01:23:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.283+0000 7f493c1e8640 1 -- 172.21.15.81:0/2279978858 shutdown_connections 2024-09-16T01:23:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.283+0000 7f493c1e8640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f491806c2b0 0x7f491806e770 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.283+0000 7f493c1e8640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493415b300 0x7f49340caa90 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.283+0000 7f493c1e8640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f49340cd3f0 0x7f4934157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.283+0000 7f493c1e8640 1 --2- 172.21.15.81:0/2279978858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4934072d30 0x7f4934145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.283+0000 7f493c1e8640 1 -- 172.21.15.81:0/2279978858 >> 172.21.15.81:0/2279978858 conn(0x7f4934067d70 msgr2=0x7f493415b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:07.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.283+0000 7f493c1e8640 1 -- 172.21.15.81:0/2279978858 shutdown_connections 2024-09-16T01:23:07.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.283+0000 7f493c1e8640 1 -- 172.21.15.81:0/2279978858 wait complete. 2024-09-16T01:23:07.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:23:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.391+0000 7fdb76ab7640 1 Processor -- start 2024-09-16T01:23:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.391+0000 7fdb76ab7640 1 -- start start 2024-09-16T01:23:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.392+0000 7fdb76ab7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb7015e5d0 0x7fdb700d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.392+0000 7fdb76ab7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdb7009b140 0x7fdb70168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.392+0000 7fdb76ab7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb7006cec0 con 0x7fdb7006df60 2024-09-16T01:23:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.392+0000 7fdb76ab7640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fdb7006dad0 con 0x7fdb7009b140 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.392+0000 7fdb76ab7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdb7006d1a0 con 0x7fdb7015e5d0 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.392+0000 7fdb67fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdb7006df60 0x7fdb7009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36746/0 (socket says 172.21.15.81:36746) 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.392+0000 7fdb67fff640 1 -- 172.21.15.81:0/2649448441 learned_addr learned my addr 172.21.15.81:0/2649448441 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.392+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508313075 0 0) 0x7fdb7006cec0 con 0x7fdb7006df60 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.392+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb58003520 con 0x7fdb7006df60 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.392+0000 7fdb75054640 1 --2- 172.21.15.81:0/2649448441 >> v2:172.21.15.102:3300/0 conn(0x7fdb7009b140 0x7fdb70168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.392+0000 7fdb74853640 1 --2- 172.21.15.81:0/2649448441 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb7015e5d0 0x7fdb700d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2644002407 0 0) 0x7fdb58003520 con 0x7fdb7006df60 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb7015e5d0 msgr2=0x7fdb700d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 --2- 172.21.15.81:0/2649448441 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb7015e5d0 0x7fdb700d10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 >> v2:172.21.15.102:3300/0 conn(0x7fdb7009b140 msgr2=0x7fdb70168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 --2- 172.21.15.81:0/2649448441 >> v2:172.21.15.102:3300/0 conn(0x7fdb7009b140 0x7fdb70168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7006d480 con 0x7fdb7006df60 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fdb60001670 con 0x7fdb7006df60 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 >> v1:172.21.15.81:6789/0 conn(0x7fdb7006df60 legacy=0x7fdb7009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 --2- 172.21.15.81:0/2649448441 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb7015e5d0 0x7fdb580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 --2- 172.21.15.81:0/2649448441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb58003f30 0x7fdb58004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 --2- 172.21.15.81:0/2649448441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58004d40 0x7fdb580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7006dad0 con 0x7fdb58004d40 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7006d1a0 con 0x7fdb58003f30 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdb5800b9f0 con 0x7fdb7015e5d0 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb75054640 1 --2- 172.21.15.81:0/2649448441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58004d40 0x7fdb580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb74853640 1 --2- 172.21.15.81:0/2649448441 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb7015e5d0 0x7fdb580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb67fff640 1 --2- 172.21.15.81:0/2649448441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb58003f30 0x7fdb58004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb75054640 1 -- 172.21.15.81:0/2649448441 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb7015e5d0 msgr2=0x7fdb580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb75054640 1 --2- 172.21.15.81:0/2649448441 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb7015e5d0 0x7fdb580039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb75054640 1 -- 172.21.15.81:0/2649448441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb58003f30 msgr2=0x7fdb58004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb75054640 1 --2- 172.21.15.81:0/2649448441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb58003f30 0x7fdb58004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.393+0000 7fdb75054640 1 -- 172.21.15.81:0/2649448441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb58003520 con 0x7fdb58004d40 2024-09-16T01:23:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.394+0000 7fdb75054640 1 --2- 172.21.15.81:0/2649448441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58004d40 0x7fdb580051c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009fc0 tx=0x7fdb58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c045641d1651378 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.394+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68009c10 con 0x7fdb58004d40 2024-09-16T01:23:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.394+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb68036070 con 0x7fdb58004d40 2024-09-16T01:23:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.394+0000 7fdb677fe640 1 -- 172.21.15.81:0/2649448441 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6802d070 con 0x7fdb58004d40 2024-09-16T01:23:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.394+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2649448441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58004d40 msgr2=0x7fdb580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.394+0000 7fdb76ab7640 1 --2- 172.21.15.81:0/2649448441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb58004d40 0x7fdb580051c0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009fc0 tx=0x7fdb58005830 comp rx=0 tx=0).stop 2024-09-16T01:23:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.394+0000 7fdb75054640 1 -- 172.21.15.81:0/2649448441 reap_dead start 2024-09-16T01:23:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.394+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2649448441 shutdown_connections 2024-09-16T01:23:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.394+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2649448441 >> 172.21.15.81:0/2649448441 conn(0x7fdb700d23a0 msgr2=0x7fdb700d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.395+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2649448441 shutdown_connections 2024-09-16T01:23:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.395+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2649448441 wait complete. 2024-09-16T01:23:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.396+0000 7fdb76ab7640 1 Processor -- start 2024-09-16T01:23:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.396+0000 7fdb76ab7640 1 -- start start 2024-09-16T01:23:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb76ab7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb701588a0 0x7fdb700af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb76ab7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7015a950 0x7fdb700b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb76ab7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb700b12b0 0x7fdb70158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb76ab7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7015eb30 con 0x7fdb7015a950 2024-09-16T01:23:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb76ab7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7015e9b0 con 0x7fdb701588a0 2024-09-16T01:23:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb76ab7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdb700d10f0 con 0x7fdb700b12b0 2024-09-16T01:23:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7015a950 0x7fdb700b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7015a950 0x7fdb700b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35658/0 (socket says 172.21.15.81:35658) 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb67fff640 1 -- 172.21.15.81:0/2839959018 learned_addr learned my addr 172.21.15.81:0/2839959018 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb75054640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb700b12b0 0x7fdb70158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb74853640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb701588a0 0x7fdb700af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb67fff640 1 -- 172.21.15.81:0/2839959018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb700b12b0 msgr2=0x7fdb70158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb67fff640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb700b12b0 0x7fdb70158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb67fff640 1 -- 172.21.15.81:0/2839959018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb701588a0 msgr2=0x7fdb700af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb67fff640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb701588a0 0x7fdb700af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb67fff640 1 -- 172.21.15.81:0/2839959018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb70159950 con 0x7fdb7015a950 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb67fff640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7015a950 0x7fdb700b0d70 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fdb60000fb0 tx=0x7fdb60007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb657fa640 1 -- 172.21.15.81:0/2839959018 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000f990 con 0x7fdb7015a950 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb657fa640 1 -- 172.21.15.81:0/2839959018 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb60018070 con 0x7fdb7015a950 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2839959018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb70159c30 con 0x7fdb7015a950 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb657fa640 1 -- 172.21.15.81:0/2839959018 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000fd90 con 0x7fdb7015a950 2024-09-16T01:23:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.397+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2839959018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7015adb0 con 0x7fdb7015a950 2024-09-16T01:23:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.398+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2839959018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb700d14e0 con 0x7fdb7015a950 2024-09-16T01:23:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.399+0000 7fdb657fa640 1 -- 172.21.15.81:0/2839959018 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdb6001c410 con 0x7fdb7015a950 2024-09-16T01:23:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.399+0000 7fdb657fa640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdb5c06c2e0 0x7fdb5c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.399+0000 7fdb657fa640 1 -- 172.21.15.81:0/2839959018 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7fdb6008b0d0 con 0x7fdb7015a950 2024-09-16T01:23:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.399+0000 7fdb74853640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdb5c06c2e0 0x7fdb5c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.400+0000 7fdb74853640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdb5c06c2e0 0x7fdb5c06e7a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009bc0 tx=0x7fdb6c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.404+0000 7fdb657fa640 1 -- 172.21.15.81:0/2839959018 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb60059820 con 0x7fdb7015a950 2024-09-16T01:23:07.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.571+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2839959018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb7015b010 con 0x7fdb7015a950 2024-09-16T01:23:07.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.572+0000 7fdb657fa640 1 -- 172.21.15.81:0/2839959018 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) ==== 74+0+16960 (secure 0 0 0) 0x7fdb60059120 con 0x7fdb7015a950 2024-09-16T01:23:07.574 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:07.575 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":125,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:22:39.466201+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:22:36.412957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2024-09-16T01:22:36.768111+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:23:07.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.574+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2839959018 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdb5c06c2e0 msgr2=0x7fdb5c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.574+0000 7fdb76ab7640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdb5c06c2e0 0x7fdb5c06e7a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009bc0 tx=0x7fdb6c009190 comp rx=0 tx=0).stop 2024-09-16T01:23:07.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.574+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2839959018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7015a950 msgr2=0x7fdb700b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.574+0000 7fdb76ab7640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7015a950 0x7fdb700b0d70 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fdb60000fb0 tx=0x7fdb60007660 comp rx=0 tx=0).stop 2024-09-16T01:23:07.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.574+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2839959018 shutdown_connections 2024-09-16T01:23:07.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.574+0000 7fdb76ab7640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdb5c06c2e0 0x7fdb5c06e7a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.574+0000 7fdb76ab7640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb700b12b0 0x7fdb70158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.574+0000 7fdb76ab7640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb7015a950 0x7fdb700b0d70 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.574+0000 7fdb76ab7640 1 --2- 172.21.15.81:0/2839959018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb701588a0 0x7fdb700af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.575+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2839959018 >> 172.21.15.81:0/2839959018 conn(0x7fdb700d23a0 msgr2=0x7fdb70157460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:07.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.575+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2839959018 shutdown_connections 2024-09-16T01:23:07.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.575+0000 7fdb76ab7640 1 -- 172.21.15.81:0/2839959018 wait complete. 2024-09-16T01:23:07.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:23:07.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.686+0000 7f3b25b3b640 1 Processor -- start 2024-09-16T01:23:07.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.686+0000 7f3b25b3b640 1 -- start start 2024-09-16T01:23:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.687+0000 7f3b25b3b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b2015c870 0x7f3b2015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.687+0000 7f3b25b3b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3b200ccf90 0x7f3b200cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.687+0000 7f3b25b3b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b200d01c0 con 0x7f3b2015c490 2024-09-16T01:23:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.687+0000 7f3b25b3b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3b200cff70 con 0x7f3b200ccf90 2024-09-16T01:23:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.687+0000 7f3b25b3b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3b200d0dd0 con 0x7f3b2015c870 2024-09-16T01:23:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.687+0000 7f3b1effd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b2015c870 0x7f3b2015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.687+0000 7f3b1ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3b200ccf90 0x7f3b200cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.687+0000 7f3b1ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3b200ccf90 0x7f3b200cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:52446/0 (socket says 172.21.15.81:52446) 2024-09-16T01:23:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.687+0000 7f3b1ffff640 1 -- 172.21.15.81:0/3041773413 learned_addr learned my addr 172.21.15.81:0/3041773413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.688+0000 7f3b1ffff640 1 -- 172.21.15.81:0/3041773413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b2015c870 msgr2=0x7f3b2015ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.688+0000 7f3b1ffff640 1 --2- 172.21.15.81:0/3041773413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b2015c870 0x7f3b2015ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.688+0000 7f3b1ffff640 1 -- 172.21.15.81:0/3041773413 >> v1:172.21.15.102:6789/0 conn(0x7f3b2015c490 legacy=0x7f3b2009b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.688+0000 7f3b1ffff640 1 -- 172.21.15.81:0/3041773413 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b200d04a0 con 0x7f3b200ccf90 2024-09-16T01:23:07.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.688+0000 7f3b1e7fc640 1 -- 172.21.15.81:0/3041773413 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158494209 0 0) 0x7f3b200d01c0 con 0x7f3b2015c490 2024-09-16T01:23:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.688+0000 7f3b1ffff640 1 --2- 172.21.15.81:0/3041773413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b200ccf90 0x7f3b200cd440 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009e50 tx=0x7f3b1802a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9023ff0a95ec77ee server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.689+0000 7f3b1e7fc640 1 -- 172.21.15.81:0/3041773413 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18036070 con 0x7f3b200ccf90 2024-09-16T01:23:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.689+0000 7f3b1e7fc640 1 -- 172.21.15.81:0/3041773413 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b18031600 con 0x7f3b200ccf90 2024-09-16T01:23:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.689+0000 7f3b1e7fc640 1 -- 172.21.15.81:0/3041773413 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b180319d0 con 0x7f3b200ccf90 2024-09-16T01:23:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.689+0000 7f3b25b3b640 1 -- 172.21.15.81:0/3041773413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b200ccf90 msgr2=0x7f3b200cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.689+0000 7f3b25b3b640 1 --2- 172.21.15.81:0/3041773413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b200ccf90 0x7f3b200cd440 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3b18009e50 tx=0x7f3b1802a7a0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.689+0000 7f3b25b3b640 1 -- 172.21.15.81:0/3041773413 shutdown_connections 2024-09-16T01:23:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.689+0000 7f3b25b3b640 1 --2- 172.21.15.81:0/3041773413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b200ccf90 0x7f3b200cd440 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.689+0000 7f3b25b3b640 1 --2- 172.21.15.81:0/3041773413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b2015c870 0x7f3b2015ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.689+0000 7f3b25b3b640 1 -- 172.21.15.81:0/3041773413 >> 172.21.15.81:0/3041773413 conn(0x7f3b200d23a0 msgr2=0x7f3b200d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:07.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.689+0000 7f3b25b3b640 1 -- 172.21.15.81:0/3041773413 shutdown_connections 2024-09-16T01:23:07.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.689+0000 7f3b25b3b640 1 -- 172.21.15.81:0/3041773413 wait complete. 2024-09-16T01:23:07.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.690+0000 7f3b25b3b640 1 Processor -- start 2024-09-16T01:23:07.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.690+0000 7f3b25b3b640 1 -- start start 2024-09-16T01:23:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.691+0000 7f3b25b3b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b200ccf90 0x7f3b2014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.691+0000 7f3b25b3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2015c490 0x7f3b200b7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.691+0000 7f3b25b3b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b2015c870 0x7f3b200b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.691+0000 7f3b25b3b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b200d1260 con 0x7f3b2015c490 2024-09-16T01:23:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.691+0000 7f3b25b3b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3b200d0a60 con 0x7f3b200ccf90 2024-09-16T01:23:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.691+0000 7f3b25b3b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3b2014e6c0 con 0x7f3b2015c870 2024-09-16T01:23:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.691+0000 7f3b1effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2015c490 0x7f3b200b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.691+0000 7f3b1effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2015c490 0x7f3b200b7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35674/0 (socket says 172.21.15.81:35674) 2024-09-16T01:23:07.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.691+0000 7f3b1effd640 1 -- 172.21.15.81:0/2033079275 learned_addr learned my addr 172.21.15.81:0/2033079275 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b1f7fe640 1 --2- 172.21.15.81:0/2033079275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b200ccf90 0x7f3b2014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b1ffff640 1 --2- 172.21.15.81:0/2033079275 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b2015c870 0x7f3b200b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b1effd640 1 -- 172.21.15.81:0/2033079275 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b2015c870 msgr2=0x7f3b200b7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b1effd640 1 --2- 172.21.15.81:0/2033079275 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3b2015c870 0x7f3b200b7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b1effd640 1 -- 172.21.15.81:0/2033079275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b200ccf90 msgr2=0x7f3b2014e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b1effd640 1 --2- 172.21.15.81:0/2033079275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b200ccf90 0x7f3b2014e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b1effd640 1 -- 172.21.15.81:0/2033079275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b201e5f50 con 0x7f3b2015c490 2024-09-16T01:23:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b1f7fe640 1 --2- 172.21.15.81:0/2033079275 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b200ccf90 0x7f3b2014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b1effd640 1 --2- 172.21.15.81:0/2033079275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2015c490 0x7f3b200b7220 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400e870 tx=0x7f3b1400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b07fff640 1 -- 172.21.15.81:0/2033079275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14017020 con 0x7f3b2015c490 2024-09-16T01:23:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b07fff640 1 -- 172.21.15.81:0/2033079275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b14004240 con 0x7f3b2015c490 2024-09-16T01:23:07.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b25b3b640 1 -- 172.21.15.81:0/2033079275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b201e6230 con 0x7f3b2015c490 2024-09-16T01:23:07.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b07fff640 1 -- 172.21.15.81:0/2033079275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1400c730 con 0x7f3b2015c490 2024-09-16T01:23:07.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.692+0000 7f3b25b3b640 1 -- 172.21.15.81:0/2033079275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b201e67f0 con 0x7f3b2015c490 2024-09-16T01:23:07.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.693+0000 7f3b25b3b640 1 -- 172.21.15.81:0/2033079275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b200d01c0 con 0x7f3b2015c490 2024-09-16T01:23:07.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.693+0000 7f3b07fff640 1 -- 172.21.15.81:0/2033079275 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3b1401a020 con 0x7f3b2015c490 2024-09-16T01:23:07.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.694+0000 7f3b07fff640 1 --2- 172.21.15.81:0/2033079275 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3b0c06c2b0 0x7f3b0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:07.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.694+0000 7f3b07fff640 1 -- 172.21.15.81:0/2033079275 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f3b1408b6e0 con 0x7f3b2015c490 2024-09-16T01:23:07.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.694+0000 7f3b1f7fe640 1 --2- 172.21.15.81:0/2033079275 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3b0c06c2b0 0x7f3b0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:07.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.694+0000 7f3b1f7fe640 1 --2- 172.21.15.81:0/2033079275 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3b0c06c2b0 0x7f3b0c06e770 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3b10000f60 tx=0x7f3b10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:07.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.698+0000 7f3b07fff640 1 -- 172.21.15.81:0/2033079275 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b14021030 con 0x7f3b2015c490 2024-09-16T01:23:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.896+0000 7f3b25b3b640 1 -- 172.21.15.81:0/2033079275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3b200d3190 con 0x7f3b2015c490 2024-09-16T01:23:07.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:07.897+0000 7f3b07fff640 1 -- 172.21.15.81:0/2033079275 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=-1 MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it v69) ==== 316+0+0 (secure 0 0 0) 0x7f3b14059cc0 con 0x7f3b2015c490 2024-09-16T01:23:07.899 INFO:teuthology.orchestra.run.smithi081.stderr:Error EPERM: MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it 2024-09-16T01:23:07.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:23:07.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs --yes-i-really-mean-it 2024-09-16T01:23:08.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.002+0000 7f182baf1640 1 Processor -- start 2024-09-16T01:23:08.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.002+0000 7f182baf1640 1 -- start start 2024-09-16T01:23:08.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.003+0000 7f182baf1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415f950 0x7f182409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.003+0000 7f182baf1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f182409af70 0x7f182406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.003+0000 7f182baf1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18240b6820 con 0x7f1824158b50 2024-09-16T01:23:08.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.003+0000 7f182baf1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f182409b3c0 con 0x7f182409af70 2024-09-16T01:23:08.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.003+0000 7f182baf1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f18240b6b00 con 0x7f182415f950 2024-09-16T01:23:08.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.003+0000 7f182a08e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f182409af70 0x7f182406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.003+0000 7f182908c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415f950 0x7f182409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.003+0000 7f182a08e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f182409af70 0x7f182406fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:52470/0 (socket says 172.21.15.81:52470) 2024-09-16T01:23:08.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.003+0000 7f182a08e640 1 -- 172.21.15.81:0/2783785118 learned_addr learned my addr 172.21.15.81:0/2783785118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:08.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.004+0000 7f182908c640 1 -- 172.21.15.81:0/2783785118 >> v2:172.21.15.102:3300/0 conn(0x7f182409af70 msgr2=0x7f182406fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:08.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.004+0000 7f182908c640 1 --2- 172.21.15.81:0/2783785118 >> v2:172.21.15.102:3300/0 conn(0x7f182409af70 0x7f182406fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.004+0000 7f182908c640 1 -- 172.21.15.81:0/2783785118 >> v1:172.21.15.102:6789/0 conn(0x7f1824158b50 legacy=0x7f18240b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:08.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.004+0000 7f182908c640 1 -- 172.21.15.81:0/2783785118 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18240b6de0 con 0x7f182415f950 2024-09-16T01:23:08.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.004+0000 7f182a08e640 1 --2- 172.21.15.81:0/2783785118 >> v2:172.21.15.102:3300/0 conn(0x7f182409af70 0x7f182406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:08.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.004+0000 7f182908c640 1 --2- 172.21.15.81:0/2783785118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415f950 0x7f182409aa30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18140097a0 tx=0x7f181402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e93895a75efb6bc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:08.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.004+0000 7f182888b640 1 -- 172.21.15.81:0/2783785118 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814037070 con 0x7f182415f950 2024-09-16T01:23:08.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.005+0000 7f182888b640 1 -- 172.21.15.81:0/2783785118 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1814032440 con 0x7f182415f950 2024-09-16T01:23:08.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.005+0000 7f182888b640 1 -- 172.21.15.81:0/2783785118 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814032810 con 0x7f182415f950 2024-09-16T01:23:08.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.005+0000 7f182baf1640 1 -- 172.21.15.81:0/2783785118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415f950 msgr2=0x7f182409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:08.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.005+0000 7f182baf1640 1 --2- 172.21.15.81:0/2783785118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415f950 0x7f182409aa30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18140097a0 tx=0x7f181402a180 comp rx=0 tx=0).stop 2024-09-16T01:23:08.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.005+0000 7f182baf1640 1 -- 172.21.15.81:0/2783785118 shutdown_connections 2024-09-16T01:23:08.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.005+0000 7f182baf1640 1 --2- 172.21.15.81:0/2783785118 >> v2:172.21.15.102:3300/0 conn(0x7f182409af70 0x7f182406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.005+0000 7f182baf1640 1 --2- 172.21.15.81:0/2783785118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415f950 0x7f182409aa30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.005+0000 7f182baf1640 1 -- 172.21.15.81:0/2783785118 >> 172.21.15.81:0/2783785118 conn(0x7f18240b79e0 msgr2=0x7f18240b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:08.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.005+0000 7f182baf1640 1 -- 172.21.15.81:0/2783785118 shutdown_connections 2024-09-16T01:23:08.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.005+0000 7f182baf1640 1 -- 172.21.15.81:0/2783785118 wait complete. 2024-09-16T01:23:08.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.006+0000 7f182baf1640 1 Processor -- start 2024-09-16T01:23:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.006+0000 7f182baf1640 1 -- start start 2024-09-16T01:23:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182baf1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f182409af70 0x7f1824157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182baf1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1824158b50 0x7f18241f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182baf1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415f950 0x7f18240cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182baf1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18240b6530 con 0x7f1824158b50 2024-09-16T01:23:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182baf1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f18240b73a0 con 0x7f182409af70 2024-09-16T01:23:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182baf1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1824158f30 con 0x7f182415f950 2024-09-16T01:23:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182908c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1824158b50 0x7f18241f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182908c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1824158b50 0x7f18241f45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35678/0 (socket says 172.21.15.81:35678) 2024-09-16T01:23:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182908c640 1 -- 172.21.15.81:0/1543807395 learned_addr learned my addr 172.21.15.81:0/1543807395 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182988d640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f182409af70 0x7f1824157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182a08e640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415f950 0x7f18240cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182908c640 1 -- 172.21.15.81:0/1543807395 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415f950 msgr2=0x7f18240cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182908c640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415f950 0x7f18240cc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182908c640 1 -- 172.21.15.81:0/1543807395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f182409af70 msgr2=0x7f1824157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182908c640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f182409af70 0x7f1824157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.007+0000 7f182908c640 1 -- 172.21.15.81:0/1543807395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18240cdd70 con 0x7f1824158b50 2024-09-16T01:23:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.008+0000 7f182908c640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1824158b50 0x7f18241f45f0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1814000c00 tx=0x7f18140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.008+0000 7f181a7fc640 1 -- 172.21.15.81:0/1543807395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814037040 con 0x7f1824158b50 2024-09-16T01:23:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.008+0000 7f181a7fc640 1 -- 172.21.15.81:0/1543807395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1814042070 con 0x7f1824158b50 2024-09-16T01:23:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.008+0000 7f181a7fc640 1 -- 172.21.15.81:0/1543807395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814030920 con 0x7f1824158b50 2024-09-16T01:23:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.008+0000 7f182baf1640 1 -- 172.21.15.81:0/1543807395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18240cc0d0 con 0x7f1824158b50 2024-09-16T01:23:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.008+0000 7f182baf1640 1 -- 172.21.15.81:0/1543807395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1824158010 con 0x7f1824158b50 2024-09-16T01:23:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.009+0000 7f182baf1640 1 -- 172.21.15.81:0/1543807395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1824162d00 con 0x7f1824158b50 2024-09-16T01:23:08.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.009+0000 7f181a7fc640 1 -- 172.21.15.81:0/1543807395 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1814030ac0 con 0x7f1824158b50 2024-09-16T01:23:08.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.010+0000 7f181a7fc640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f180806c2b0 0x7f180806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.010+0000 7f181a7fc640 1 -- 172.21.15.81:0/1543807395 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 6101+0+0 (secure 0 0 0) 0x7f18140abdd0 con 0x7f1824158b50 2024-09-16T01:23:08.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.010+0000 7f182988d640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f180806c2b0 0x7f180806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.010+0000 7f182988d640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f180806c2b0 0x7f180806e770 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1820001780 tx=0x7f1820009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:08.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.014+0000 7f181a7fc640 1 -- 172.21.15.81:0/1543807395 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1824162d00 con 0x7f1824158b50 2024-09-16T01:23:08.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.215+0000 7f182baf1640 1 -- 172.21.15.81:0/1543807395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f18240b77a0 con 0x7f1824158b50 2024-09-16T01:23:08.217 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-16T01:23:08.216+0000 7f4e951a0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:23:08.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.217+0000 7f181a7fc640 1 -- 172.21.15.81:0/1543807395 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) ==== 191+0+0 (secure 0 0 0) 0x7f18140ad020 con 0x7f1824158b50 2024-09-16T01:23:08.219 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:23:08.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.220+0000 7f182baf1640 1 -- 172.21.15.81:0/1543807395 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f180806c2b0 msgr2=0x7f180806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:08.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.220+0000 7f182baf1640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f180806c2b0 0x7f180806e770 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1820001780 tx=0x7f1820009040 comp rx=0 tx=0).stop 2024-09-16T01:23:08.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.220+0000 7f182baf1640 1 -- 172.21.15.81:0/1543807395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1824158b50 msgr2=0x7f18241f45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:08.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.220+0000 7f182baf1640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1824158b50 0x7f18241f45f0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1814000c00 tx=0x7f18140046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.220+0000 7f182baf1640 1 -- 172.21.15.81:0/1543807395 shutdown_connections 2024-09-16T01:23:08.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.220+0000 7f182baf1640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f180806c2b0 0x7f180806e770 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.220+0000 7f182baf1640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f182415f950 0x7f18240cc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.220+0000 7f182baf1640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1824158b50 0x7f18241f45f0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.220+0000 7f182baf1640 1 --2- 172.21.15.81:0/1543807395 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f182409af70 0x7f1824157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.220+0000 7f182baf1640 1 -- 172.21.15.81:0/1543807395 >> 172.21.15.81:0/1543807395 conn(0x7f18240b79e0 msgr2=0x7f18241612c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:08.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.220+0000 7f182baf1640 1 -- 172.21.15.81:0/1543807395 shutdown_connections 2024-09-16T01:23:08.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.220+0000 7f182baf1640 1 -- 172.21.15.81:0/1543807395 wait complete. 2024-09-16T01:23:08.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:23:08.259 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:23:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.333+0000 7fed9ab8f640 1 Processor -- start 2024-09-16T01:23:08.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.333+0000 7fed9ab8f640 1 -- start start 2024-09-16T01:23:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.334+0000 7fed9ab8f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fed9409b9c0 0x7fed940b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.334+0000 7fed9ab8f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed940afcd0 con 0x7fed9415c620 2024-09-16T01:23:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.334+0000 7fed9ab8f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed940affb0 con 0x7fed9409aa30 2024-09-16T01:23:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.334+0000 7fed9ab8f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fed940b0600 con 0x7fed9409b9c0 2024-09-16T01:23:08.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.334+0000 7fed9892b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fed9415c620 0x7fed940b0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36766/0 (socket says 172.21.15.81:36766) 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.334+0000 7fed9892b640 1 -- 172.21.15.81:0/597989106 learned_addr learned my addr 172.21.15.81:0/597989106 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.334+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150612014 0 0) 0x7fed940afcd0 con 0x7fed9415c620 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.334+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed7c003520 con 0x7fed9415c620 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.334+0000 7fed8bfff640 1 --2- 172.21.15.81:0/597989106 >> v2:172.21.15.102:3300/0 conn(0x7fed9409b9c0 0x7fed940b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2622357119 0 0) 0x7fed7c003520 con 0x7fed9415c620 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 >> v2:172.21.15.102:3300/0 conn(0x7fed9409b9c0 msgr2=0x7fed940b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 --2- 172.21.15.81:0/597989106 >> v2:172.21.15.102:3300/0 conn(0x7fed9409b9c0 0x7fed940b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 >> v1:172.21.15.102:6789/0 conn(0x7fed9409aa30 legacy=0x7fed9409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed940b0290 con 0x7fed9415c620 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fed90001670 con 0x7fed9415c620 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 >> v1:172.21.15.81:6789/0 conn(0x7fed9415c620 legacy=0x7fed940b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 --2- 172.21.15.81:0/597989106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c0039b0 0x7fed7c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 --2- 172.21.15.81:0/597989106 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed7c004800 0x7fed7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 --2- 172.21.15.81:0/597989106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0051c0 0x7fed7c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed940b0600 con 0x7fed7c0051c0 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c00c090 con 0x7fed7c0039b0 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fed7c00c290 con 0x7fed7c004800 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed9912c640 1 --2- 172.21.15.81:0/597989106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0051c0 0x7fed7c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed9892b640 1 --2- 172.21.15.81:0/597989106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c0039b0 0x7fed7c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed8bfff640 1 --2- 172.21.15.81:0/597989106 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed7c004800 0x7fed7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed9912c640 1 -- 172.21.15.81:0/597989106 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed7c004800 msgr2=0x7fed7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed9912c640 1 --2- 172.21.15.81:0/597989106 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed7c004800 0x7fed7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed9912c640 1 -- 172.21.15.81:0/597989106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c0039b0 msgr2=0x7fed7c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed9912c640 1 --2- 172.21.15.81:0/597989106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c0039b0 0x7fed7c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.335+0000 7fed9912c640 1 -- 172.21.15.81:0/597989106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c003520 con 0x7fed7c0051c0 2024-09-16T01:23:08.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.336+0000 7fed9912c640 1 -- 172.21.15.81:0/597989106 reap_dead start 2024-09-16T01:23:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.336+0000 7fed9912c640 1 --2- 172.21.15.81:0/597989106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0051c0 0x7fed7c00b9c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fed8c001e50 tx=0x7fed7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9d71af34b32118 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.336+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c001a70 con 0x7fed7c0051c0 2024-09-16T01:23:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.336+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8c003970 con 0x7fed7c0051c0 2024-09-16T01:23:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.336+0000 7fed8b7fe640 1 -- 172.21.15.81:0/597989106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c003d60 con 0x7fed7c0051c0 2024-09-16T01:23:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.336+0000 7fed9ab8f640 1 -- 172.21.15.81:0/597989106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0051c0 msgr2=0x7fed7c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.336+0000 7fed9ab8f640 1 --2- 172.21.15.81:0/597989106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0051c0 0x7fed7c00b9c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fed8c001e50 tx=0x7fed7c005830 comp rx=0 tx=0).stop 2024-09-16T01:23:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.336+0000 7fed9ab8f640 1 -- 172.21.15.81:0/597989106 shutdown_connections 2024-09-16T01:23:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.336+0000 7fed9ab8f640 1 --2- 172.21.15.81:0/597989106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed7c0051c0 0x7fed7c00b9c0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.336+0000 7fed9ab8f640 1 -- 172.21.15.81:0/597989106 >> 172.21.15.81:0/597989106 conn(0x7fed940b79e0 msgr2=0x7fed940b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.337+0000 7fed9ab8f640 1 -- 172.21.15.81:0/597989106 shutdown_connections 2024-09-16T01:23:08.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.337+0000 7fed9ab8f640 1 -- 172.21.15.81:0/597989106 wait complete. 2024-09-16T01:23:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.338+0000 7fed9ab8f640 1 Processor -- start 2024-09-16T01:23:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.338+0000 7fed9ab8f640 1 -- start start 2024-09-16T01:23:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed9ab8f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c0051c0 0x7fed941e41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed9ab8f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed94150a40 0x7fed94155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed9ab8f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed941e1790 0x7fed941e1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed9ab8f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed940b67a0 con 0x7fed94150a40 2024-09-16T01:23:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed9ab8f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fed940af980 con 0x7fed7c0051c0 2024-09-16T01:23:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed9ab8f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fed940b6920 con 0x7fed941e1790 2024-09-16T01:23:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed8bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed94150a40 0x7fed94155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed8bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed94150a40 0x7fed94155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35706/0 (socket says 172.21.15.81:35706) 2024-09-16T01:23:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed8bfff640 1 -- 172.21.15.81:0/709149066 learned_addr learned my addr 172.21.15.81:0/709149066 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:08.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed9912c640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed941e1790 0x7fed941e1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed9892b640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c0051c0 0x7fed941e41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed8bfff640 1 -- 172.21.15.81:0/709149066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed941e1790 msgr2=0x7fed941e1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed8bfff640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed941e1790 0x7fed941e1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed8bfff640 1 -- 172.21.15.81:0/709149066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c0051c0 msgr2=0x7fed941e41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed8bfff640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c0051c0 0x7fed941e41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed8bfff640 1 -- 172.21.15.81:0/709149066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed94155880 con 0x7fed94150a40 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed8bfff640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed94150a40 0x7fed94155340 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fed84011570 tx=0x7fed84011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed897fa640 1 -- 172.21.15.81:0/709149066 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed84015930 con 0x7fed94150a40 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed897fa640 1 -- 172.21.15.81:0/709149066 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed84015ad0 con 0x7fed94150a40 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed9ab8f640 1 -- 172.21.15.81:0/709149066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed941e71a0 con 0x7fed94150a40 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed897fa640 1 -- 172.21.15.81:0/709149066 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8401d400 con 0x7fed94150a40 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.339+0000 7fed9ab8f640 1 -- 172.21.15.81:0/709149066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed94154b40 con 0x7fed94150a40 2024-09-16T01:23:08.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.340+0000 7fed9ab8f640 1 -- 172.21.15.81:0/709149066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed9409ae10 con 0x7fed94150a40 2024-09-16T01:23:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.341+0000 7fed897fa640 1 -- 172.21.15.81:0/709149066 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fed8401d5a0 con 0x7fed94150a40 2024-09-16T01:23:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.341+0000 7fed897fa640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed8006c2b0 0x7fed8006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.341+0000 7fed897fa640 1 -- 172.21.15.81:0/709149066 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 6187+0+0 (secure 0 0 0) 0x7fed8408bdb0 con 0x7fed94150a40 2024-09-16T01:23:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.342+0000 7fed9892b640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed8006c2b0 0x7fed8006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:08.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.342+0000 7fed9892b640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed8006c2b0 0x7fed8006e770 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fed90000fb0 tx=0x7fed900078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:08.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.346+0000 7fed897fa640 1 -- 172.21.15.81:0/709149066 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed94155880 con 0x7fed94150a40 2024-09-16T01:23:08.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:08.545+0000 7fed9ab8f640 1 -- 172.21.15.81:0/709149066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fed940ceb80 con 0x7fed94150a40 2024-09-16T01:23:09.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.255+0000 7fed897fa640 1 -- 172.21.15.81:0/709149066 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) ==== 104+0+0 (secure 0 0 0) 0x7fed84019030 con 0x7fed94150a40 2024-09-16T01:23:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.258+0000 7fed9ab8f640 1 -- 172.21.15.81:0/709149066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed8006c2b0 msgr2=0x7fed8006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.258+0000 7fed9ab8f640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed8006c2b0 0x7fed8006e770 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fed90000fb0 tx=0x7fed900078f0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.258+0000 7fed9ab8f640 1 -- 172.21.15.81:0/709149066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed94150a40 msgr2=0x7fed94155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.258+0000 7fed9ab8f640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed94150a40 0x7fed94155340 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fed84011570 tx=0x7fed84011970 comp rx=0 tx=0).stop 2024-09-16T01:23:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.258+0000 7fed9ab8f640 1 -- 172.21.15.81:0/709149066 shutdown_connections 2024-09-16T01:23:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.258+0000 7fed9ab8f640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fed8006c2b0 0x7fed8006e770 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.258+0000 7fed9ab8f640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fed941e1790 0x7fed941e1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.258+0000 7fed9ab8f640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed94150a40 0x7fed94155340 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.258+0000 7fed9ab8f640 1 --2- 172.21.15.81:0/709149066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fed7c0051c0 0x7fed941e41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.258+0000 7fed9ab8f640 1 -- 172.21.15.81:0/709149066 >> 172.21.15.81:0/709149066 conn(0x7fed940b79e0 msgr2=0x7fed94158fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.258+0000 7fed9ab8f640 1 -- 172.21.15.81:0/709149066 shutdown_connections 2024-09-16T01:23:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.258+0000 7fed9ab8f640 1 -- 172.21.15.81:0/709149066 wait complete. 2024-09-16T01:23:09.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:23:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.422+0000 7f9a948eb640 1 Processor -- start 2024-09-16T01:23:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.422+0000 7f9a948eb640 1 -- start start 2024-09-16T01:23:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.423+0000 7f9a948eb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a900cf790 0x7f9a900cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.423+0000 7f9a948eb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a900ce060 0x7f9a900ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.423+0000 7f9a948eb640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a900b30e0 con 0x7f9a90156740 2024-09-16T01:23:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.423+0000 7f9a948eb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9a900d0140 con 0x7f9a900cf790 2024-09-16T01:23:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.423+0000 7f9a948eb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9006edc0 con 0x7f9a900ce060 2024-09-16T01:23:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.423+0000 7f9a8dd9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a900cf790 0x7f9a900cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.423+0000 7f9a8dd9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a900cf790 0x7f9a900cfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35708/0 (socket says 172.21.15.81:35708) 2024-09-16T01:23:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.423+0000 7f9a8dd9b640 1 -- 172.21.15.81:0/4215932602 learned_addr learned my addr 172.21.15.81:0/4215932602 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.423+0000 7f9a8ed9d640 1 --2- 172.21.15.81:0/4215932602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a900ce060 0x7f9a900ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.424+0000 7f9a8dd9b640 1 -- 172.21.15.81:0/4215932602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a900ce060 msgr2=0x7f9a900ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.424+0000 7f9a8dd9b640 1 --2- 172.21.15.81:0/4215932602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a900ce060 0x7f9a900ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.424+0000 7f9a8dd9b640 1 -- 172.21.15.81:0/4215932602 >> v1:172.21.15.102:6789/0 conn(0x7f9a90156740 legacy=0x7f9a900b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.424+0000 7f9a8dd9b640 1 -- 172.21.15.81:0/4215932602 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a900b33c0 con 0x7f9a900cf790 2024-09-16T01:23:09.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.424+0000 7f9a8dd9b640 1 --2- 172.21.15.81:0/4215932602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900cf790 0x7f9a900cfc00 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f9a840098a0 tx=0x7f9a8402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573381198ff4bdea server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:09.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.424+0000 7f9a8d59a640 1 -- 172.21.15.81:0/4215932602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84037070 con 0x7f9a900cf790 2024-09-16T01:23:09.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.424+0000 7f9a8d59a640 1 -- 172.21.15.81:0/4215932602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a84032440 con 0x7f9a900cf790 2024-09-16T01:23:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.424+0000 7f9a8d59a640 1 -- 172.21.15.81:0/4215932602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84032810 con 0x7f9a900cf790 2024-09-16T01:23:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.425+0000 7f9a948eb640 1 -- 172.21.15.81:0/4215932602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900cf790 msgr2=0x7f9a900cfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.425+0000 7f9a948eb640 1 --2- 172.21.15.81:0/4215932602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900cf790 0x7f9a900cfc00 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f9a840098a0 tx=0x7f9a8402a290 comp rx=0 tx=0).stop 2024-09-16T01:23:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.425+0000 7f9a948eb640 1 -- 172.21.15.81:0/4215932602 shutdown_connections 2024-09-16T01:23:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.425+0000 7f9a948eb640 1 --2- 172.21.15.81:0/4215932602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a900ce060 0x7f9a900ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.425+0000 7f9a948eb640 1 --2- 172.21.15.81:0/4215932602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900cf790 0x7f9a900cfc00 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.425+0000 7f9a948eb640 1 -- 172.21.15.81:0/4215932602 >> 172.21.15.81:0/4215932602 conn(0x7f9a9006bdf0 msgr2=0x7f9a9006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.425+0000 7f9a948eb640 1 -- 172.21.15.81:0/4215932602 shutdown_connections 2024-09-16T01:23:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.425+0000 7f9a948eb640 1 -- 172.21.15.81:0/4215932602 wait complete. 2024-09-16T01:23:09.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.426+0000 7f9a948eb640 1 Processor -- start 2024-09-16T01:23:09.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.426+0000 7f9a948eb640 1 -- start start 2024-09-16T01:23:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.427+0000 7f9a948eb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a900ce060 0x7f9a90155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.427+0000 7f9a948eb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900cf790 0x7f9a9014fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.427+0000 7f9a948eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a90156740 0x7f9a901f5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.427+0000 7f9a948eb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a900b3c60 con 0x7f9a900cf790 2024-09-16T01:23:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.427+0000 7f9a948eb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9a900b3980 con 0x7f9a90156740 2024-09-16T01:23:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.427+0000 7f9a948eb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a900b4cc0 con 0x7f9a900ce060 2024-09-16T01:23:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.427+0000 7f9a8dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900cf790 0x7f9a9014fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.427+0000 7f9a8dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900cf790 0x7f9a9014fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35710/0 (socket says 172.21.15.81:35710) 2024-09-16T01:23:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.427+0000 7f9a8dd9b640 1 -- 172.21.15.81:0/1235971641 learned_addr learned my addr 172.21.15.81:0/1235971641 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.427+0000 7f9a8ed9d640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a90156740 0x7f9a901f5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.427+0000 7f9a8e59c640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a900ce060 0x7f9a90155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.428+0000 7f9a8dd9b640 1 -- 172.21.15.81:0/1235971641 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a900ce060 msgr2=0x7f9a90155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.428+0000 7f9a8dd9b640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a900ce060 0x7f9a90155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.428+0000 7f9a8dd9b640 1 -- 172.21.15.81:0/1235971641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a90156740 msgr2=0x7f9a901f5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.428+0000 7f9a8dd9b640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a90156740 0x7f9a901f5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.428+0000 7f9a8dd9b640 1 -- 172.21.15.81:0/1235971641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a90150160 con 0x7f9a900cf790 2024-09-16T01:23:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.428+0000 7f9a8dd9b640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900cf790 0x7f9a9014fc20 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f9a840098a0 tx=0x7f9a840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.428+0000 7f9a7effd640 1 -- 172.21.15.81:0/1235971641 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84037040 con 0x7f9a900cf790 2024-09-16T01:23:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.428+0000 7f9a7effd640 1 -- 172.21.15.81:0/1235971641 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a84030440 con 0x7f9a900cf790 2024-09-16T01:23:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.428+0000 7f9a948eb640 1 -- 172.21.15.81:0/1235971641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9014a980 con 0x7f9a900cf790 2024-09-16T01:23:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.428+0000 7f9a7effd640 1 -- 172.21.15.81:0/1235971641 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84030830 con 0x7f9a900cf790 2024-09-16T01:23:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.428+0000 7f9a948eb640 1 -- 172.21.15.81:0/1235971641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a9014af40 con 0x7f9a900cf790 2024-09-16T01:23:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.429+0000 7f9a948eb640 1 -- 172.21.15.81:0/1235971641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a900d0920 con 0x7f9a900cf790 2024-09-16T01:23:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.429+0000 7f9a7effd640 1 -- 172.21.15.81:0/1235971641 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a84044030 con 0x7f9a900cf790 2024-09-16T01:23:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.430+0000 7f9a7effd640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a7006c2b0 0x7f9a7006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.430+0000 7f9a7effd640 1 -- 172.21.15.81:0/1235971641 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 6187+0+0 (secure 0 0 0) 0x7f9a840ab330 con 0x7f9a900cf790 2024-09-16T01:23:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.430+0000 7f9a8e59c640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a7006c2b0 0x7f9a7006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.430+0000 7f9a8e59c640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a7006c2b0 0x7f9a7006e770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9a80000f60 tx=0x7f9a80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.434+0000 7f9a7effd640 1 -- 172.21.15.81:0/1235971641 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a8404b060 con 0x7f9a900cf790 2024-09-16T01:23:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:09.602+0000 7f9a948eb640 1 -- 172.21.15.81:0/1235971641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9a90152120 con 0x7f9a900cf790 2024-09-16T01:23:09.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:23:09.710 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:23:10.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.260+0000 7f9a7effd640 1 -- 172.21.15.81:0/1235971641 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v127) ==== 181+0+0 (secure 0 0 0) 0x7f9a84079300 con 0x7f9a900cf790 2024-09-16T01:23:10.262 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:23:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.263+0000 7f9a948eb640 1 -- 172.21.15.81:0/1235971641 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a7006c2b0 msgr2=0x7f9a7006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.263+0000 7f9a948eb640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a7006c2b0 0x7f9a7006e770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9a80000f60 tx=0x7f9a80009040 comp rx=0 tx=0).stop 2024-09-16T01:23:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.263+0000 7f9a948eb640 1 -- 172.21.15.81:0/1235971641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900cf790 msgr2=0x7f9a9014fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.263+0000 7f9a948eb640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900cf790 0x7f9a9014fc20 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f9a840098a0 tx=0x7f9a840046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.263+0000 7f9a948eb640 1 -- 172.21.15.81:0/1235971641 shutdown_connections 2024-09-16T01:23:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.263+0000 7f9a948eb640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9a7006c2b0 0x7f9a7006e770 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.263+0000 7f9a948eb640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a90156740 0x7f9a901f5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.263+0000 7f9a948eb640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a900cf790 0x7f9a9014fc20 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.263+0000 7f9a948eb640 1 --2- 172.21.15.81:0/1235971641 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a900ce060 0x7f9a90155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.263+0000 7f9a948eb640 1 -- 172.21.15.81:0/1235971641 >> 172.21.15.81:0/1235971641 conn(0x7f9a9006bdf0 msgr2=0x7f9a900ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.264+0000 7f9a948eb640 1 -- 172.21.15.81:0/1235971641 shutdown_connections 2024-09-16T01:23:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.264+0000 7f9a948eb640 1 -- 172.21.15.81:0/1235971641 wait complete. 2024-09-16T01:23:10.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:23:10.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.380+0000 7fdc90bed640 1 Processor -- start 2024-09-16T01:23:10.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.380+0000 7fdc90bed640 1 -- start start 2024-09-16T01:23:10.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.381+0000 7fdc90bed640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c15c490 0x7fdc8c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.381+0000 7fdc90bed640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdc8c071100 0x7fdc8c0715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.381+0000 7fdc90bed640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8c072180 con 0x7fdc8c09af70 2024-09-16T01:23:10.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.381+0000 7fdc90bed640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fdc8c09b3b0 con 0x7fdc8c071100 2024-09-16T01:23:10.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.381+0000 7fdc90bed640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdc8c15c870 con 0x7fdc8c15c490 2024-09-16T01:23:10.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.382+0000 7fdc8ad9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdc8c071100 0x7fdc8c0715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.382+0000 7fdc8a59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c15c490 0x7fdc8c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.382+0000 7fdc8ad9d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdc8c071100 0x7fdc8c0715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:52544/0 (socket says 172.21.15.81:52544) 2024-09-16T01:23:10.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.382+0000 7fdc8a59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c15c490 0x7fdc8c09aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:56658/0 (socket says 172.21.15.81:56658) 2024-09-16T01:23:10.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.382+0000 7fdc8ad9d640 1 -- 172.21.15.81:0/433644120 learned_addr learned my addr 172.21.15.81:0/433644120 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:10.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.382+0000 7fdc8ad9d640 1 -- 172.21.15.81:0/433644120 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c15c490 msgr2=0x7fdc8c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:10.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.382+0000 7fdc8ad9d640 1 --2- 172.21.15.81:0/433644120 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c15c490 0x7fdc8c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.382+0000 7fdc8ad9d640 1 -- 172.21.15.81:0/433644120 >> v1:172.21.15.102:6789/0 conn(0x7fdc8c09af70 legacy=0x7fdc8c0b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.382+0000 7fdc8ad9d640 1 -- 172.21.15.81:0/433644120 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c071bc0 con 0x7fdc8c071100 2024-09-16T01:23:10.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.382+0000 7fdc8a59c640 1 --2- 172.21.15.81:0/433644120 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c15c490 0x7fdc8c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:10.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.383+0000 7fdc8ad9d640 1 --2- 172.21.15.81:0/433644120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c071100 0x7fdc8c0715b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009e50 tx=0x7fdc8402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7330ad2734e97a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:10.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.383+0000 7fdc8959a640 1 -- 172.21.15.81:0/433644120 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84036070 con 0x7fdc8c071100 2024-09-16T01:23:10.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.383+0000 7fdc8959a640 1 -- 172.21.15.81:0/433644120 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc84031600 con 0x7fdc8c071100 2024-09-16T01:23:10.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.383+0000 7fdc8959a640 1 -- 172.21.15.81:0/433644120 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc840319d0 con 0x7fdc8c071100 2024-09-16T01:23:10.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.383+0000 7fdc90bed640 1 -- 172.21.15.81:0/433644120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c071100 msgr2=0x7fdc8c0715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.383+0000 7fdc90bed640 1 --2- 172.21.15.81:0/433644120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c071100 0x7fdc8c0715b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009e50 tx=0x7fdc8402a710 comp rx=0 tx=0).stop 2024-09-16T01:23:10.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.384+0000 7fdc90bed640 1 -- 172.21.15.81:0/433644120 shutdown_connections 2024-09-16T01:23:10.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.384+0000 7fdc90bed640 1 --2- 172.21.15.81:0/433644120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c071100 0x7fdc8c0715b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.384+0000 7fdc90bed640 1 --2- 172.21.15.81:0/433644120 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c15c490 0x7fdc8c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.384+0000 7fdc90bed640 1 -- 172.21.15.81:0/433644120 >> 172.21.15.81:0/433644120 conn(0x7fdc8c0b3f30 msgr2=0x7fdc8c0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:10.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.384+0000 7fdc90bed640 1 -- 172.21.15.81:0/433644120 shutdown_connections 2024-09-16T01:23:10.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.384+0000 7fdc90bed640 1 -- 172.21.15.81:0/433644120 wait complete. 2024-09-16T01:23:10.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.385+0000 7fdc90bed640 1 Processor -- start 2024-09-16T01:23:10.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.385+0000 7fdc90bed640 1 -- start start 2024-09-16T01:23:10.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc90bed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c071100 0x7fdc8c14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc90bed640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c09af70 0x7fdc8c14a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc90bed640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c15c490 0x7fdc8c15ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc90bed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c0affa0 con 0x7fdc8c071100 2024-09-16T01:23:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc90bed640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdc8c0afcc0 con 0x7fdc8c09af70 2024-09-16T01:23:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc90bed640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdc8c09b8f0 con 0x7fdc8c15c490 2024-09-16T01:23:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc8a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c071100 0x7fdc8c14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc8a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c071100 0x7fdc8c14e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35712/0 (socket says 172.21.15.81:35712) 2024-09-16T01:23:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc8a59c640 1 -- 172.21.15.81:0/2695041156 learned_addr learned my addr 172.21.15.81:0/2695041156 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc8ad9d640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c15c490 0x7fdc8c15ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc89d9b640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c09af70 0x7fdc8c14a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc8a59c640 1 -- 172.21.15.81:0/2695041156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c15c490 msgr2=0x7fdc8c15ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc8a59c640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c15c490 0x7fdc8c15ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc8a59c640 1 -- 172.21.15.81:0/2695041156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c09af70 msgr2=0x7fdc8c14a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:10.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc8a59c640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c09af70 0x7fdc8c14a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:10.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc8a59c640 1 -- 172.21.15.81:0/2695041156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc8c14eb00 con 0x7fdc8c071100 2024-09-16T01:23:10.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc8a59c640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c071100 0x7fdc8c14e2b0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c00e960 tx=0x7fdc7c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc7affd640 1 -- 172.21.15.81:0/2695041156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c017070 con 0x7fdc8c071100 2024-09-16T01:23:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc7affd640 1 -- 172.21.15.81:0/2695041156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc7c00ca00 con 0x7fdc8c071100 2024-09-16T01:23:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc90bed640 1 -- 172.21.15.81:0/2695041156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8c14bb60 con 0x7fdc8c071100 2024-09-16T01:23:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc7affd640 1 -- 172.21.15.81:0/2695041156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c00cdd0 con 0x7fdc8c071100 2024-09-16T01:23:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.386+0000 7fdc90bed640 1 -- 172.21.15.81:0/2695041156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc8c14c120 con 0x7fdc8c071100 2024-09-16T01:23:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.387+0000 7fdc90bed640 1 -- 172.21.15.81:0/2695041156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc8c0715b0 con 0x7fdc8c071100 2024-09-16T01:23:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.388+0000 7fdc7affd640 1 -- 172.21.15.81:0/2695041156 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdc7c01a070 con 0x7fdc8c071100 2024-09-16T01:23:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.388+0000 7fdc7affd640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc6c06c2b0 0x7fdc6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.388+0000 7fdc7affd640 1 -- 172.21.15.81:0/2695041156 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5749+0+0 (secure 0 0 0) 0x7fdc7c08b640 con 0x7fdc8c071100 2024-09-16T01:23:10.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.388+0000 7fdc89d9b640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc6c06c2b0 0x7fdc6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.389+0000 7fdc89d9b640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc6c06c2b0 0x7fdc6c06e770 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdc80007fd0 tx=0x7fdc80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.393+0000 7fdc7affd640 1 -- 172.21.15.81:0/2695041156 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc7c059e10 con 0x7fdc8c071100 2024-09-16T01:23:10.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:10.569+0000 7fdc90bed640 1 -- 172.21.15.81:0/2695041156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdc8c0b6040 con 0x7fdc8c071100 2024-09-16T01:23:11.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.262+0000 7fdc7affd640 1 -- 172.21.15.81:0/2695041156 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v128) ==== 169+0+0 (secure 0 0 0) 0x7fdc7c059710 con 0x7fdc8c071100 2024-09-16T01:23:11.264 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-16T01:23:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.266+0000 7fdc90bed640 1 -- 172.21.15.81:0/2695041156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc6c06c2b0 msgr2=0x7fdc6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.266+0000 7fdc90bed640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc6c06c2b0 0x7fdc6c06e770 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdc80007fd0 tx=0x7fdc80009040 comp rx=0 tx=0).stop 2024-09-16T01:23:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.266+0000 7fdc90bed640 1 -- 172.21.15.81:0/2695041156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c071100 msgr2=0x7fdc8c14e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.266+0000 7fdc90bed640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c071100 0x7fdc8c14e2b0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c00e960 tx=0x7fdc7c00ee20 comp rx=0 tx=0).stop 2024-09-16T01:23:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.266+0000 7fdc90bed640 1 -- 172.21.15.81:0/2695041156 shutdown_connections 2024-09-16T01:23:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.266+0000 7fdc90bed640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdc6c06c2b0 0x7fdc6c06e770 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.266+0000 7fdc90bed640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc8c15c490 0x7fdc8c15ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.266+0000 7fdc90bed640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc8c09af70 0x7fdc8c14a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.266+0000 7fdc90bed640 1 --2- 172.21.15.81:0/2695041156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc8c071100 0x7fdc8c14e2b0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.266+0000 7fdc90bed640 1 -- 172.21.15.81:0/2695041156 >> 172.21.15.81:0/2695041156 conn(0x7fdc8c0b3f30 msgr2=0x7fdc8c159e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:11.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.266+0000 7fdc90bed640 1 -- 172.21.15.81:0/2695041156 shutdown_connections 2024-09-16T01:23:11.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.266+0000 7fdc90bed640 1 -- 172.21.15.81:0/2695041156 wait complete. 2024-09-16T01:23:11.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_warning_threshold 2024-09-16T01:23:11.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.386+0000 7fb85ab9f640 1 Processor -- start 2024-09-16T01:23:11.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.386+0000 7fb85ab9f640 1 -- start start 2024-09-16T01:23:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.387+0000 7fb85ab9f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb85415e630 0x7fb8540cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.387+0000 7fb85ab9f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb8540d4cd0 0x7fb85406d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.387+0000 7fb85ab9f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8540d00c0 con 0x7fb85406de40 2024-09-16T01:23:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.387+0000 7fb85ab9f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb8540d03a0 con 0x7fb8540d4cd0 2024-09-16T01:23:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.387+0000 7fb85ab9f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb85406ce20 con 0x7fb85415e630 2024-09-16T01:23:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.387+0000 7fb85a39e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb85406de40 0x7fb8540d2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58882/0 (socket says 172.21.15.81:58882) 2024-09-16T01:23:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.387+0000 7fb85a39e640 1 -- 172.21.15.81:0/3474821639 learned_addr learned my addr 172.21.15.81:0/3474821639 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.387+0000 7fb85939c640 1 --2- 172.21.15.81:0/3474821639 >> v2:172.21.15.102:3300/0 conn(0x7fb8540d4cd0 0x7fb85406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.387+0000 7fb859b9d640 1 --2- 172.21.15.81:0/3474821639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb85415e630 0x7fb8540cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.387+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2259982759 0 0) 0x7fb8540d00c0 con 0x7fb85406de40 2024-09-16T01:23:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.387+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb840003520 con 0x7fb85406de40 2024-09-16T01:23:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2760776225 0 0) 0x7fb840003520 con 0x7fb85406de40 2024-09-16T01:23:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb85415e630 msgr2=0x7fb8540cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 --2- 172.21.15.81:0/3474821639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb85415e630 0x7fb8540cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 >> v2:172.21.15.102:3300/0 conn(0x7fb8540d4cd0 msgr2=0x7fb85406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 --2- 172.21.15.81:0/3474821639 >> v2:172.21.15.102:3300/0 conn(0x7fb8540d4cd0 0x7fb85406d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85406d100 con 0x7fb85406de40 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fb84c0019f0 con 0x7fb85406de40 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 >> v1:172.21.15.81:6789/0 conn(0x7fb85406de40 legacy=0x7fb8540d2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 --2- 172.21.15.81:0/3474821639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400039b0 0x7fb840003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 --2- 172.21.15.81:0/3474821639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb85415e630 0x7fb840004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 --2- 172.21.15.81:0/3474821639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb840004d40 0x7fb8400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8540d03a0 con 0x7fb8400039b0 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb85406ce20 con 0x7fb840004d40 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb84000b9c0 con 0x7fb85415e630 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb859b9d640 1 --2- 172.21.15.81:0/3474821639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400039b0 0x7fb840003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb85939c640 1 --2- 172.21.15.81:0/3474821639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb85415e630 0x7fb840004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb85a39e640 1 --2- 172.21.15.81:0/3474821639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb840004d40 0x7fb8400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb859b9d640 1 -- 172.21.15.81:0/3474821639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb85415e630 msgr2=0x7fb840004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb859b9d640 1 --2- 172.21.15.81:0/3474821639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb85415e630 0x7fb840004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb859b9d640 1 -- 172.21.15.81:0/3474821639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb840004d40 msgr2=0x7fb8400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb859b9d640 1 --2- 172.21.15.81:0/3474821639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb840004d40 0x7fb8400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.388+0000 7fb859b9d640 1 -- 172.21.15.81:0/3474821639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb840003520 con 0x7fb8400039b0 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.389+0000 7fb859b9d640 1 --2- 172.21.15.81:0/3474821639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400039b0 0x7fb840003dd0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fb850009ac0 tx=0x7fb840005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5d404f76defad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.389+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850036070 con 0x7fb8400039b0 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.389+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb850031400 con 0x7fb8400039b0 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.389+0000 7fb858b9b640 1 -- 172.21.15.81:0/3474821639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850009690 con 0x7fb8400039b0 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.390+0000 7fb85ab9f640 1 -- 172.21.15.81:0/3474821639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400039b0 msgr2=0x7fb840003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.390+0000 7fb85ab9f640 1 --2- 172.21.15.81:0/3474821639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400039b0 0x7fb840003dd0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fb850009ac0 tx=0x7fb840005830 comp rx=0 tx=0).stop 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.390+0000 7fb85a39e640 1 -- 172.21.15.81:0/3474821639 reap_dead start 2024-09-16T01:23:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.390+0000 7fb85ab9f640 1 -- 172.21.15.81:0/3474821639 shutdown_connections 2024-09-16T01:23:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.390+0000 7fb85ab9f640 1 -- 172.21.15.81:0/3474821639 >> 172.21.15.81:0/3474821639 conn(0x7fb85408bfc0 msgr2=0x7fb8540d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.390+0000 7fb85ab9f640 1 -- 172.21.15.81:0/3474821639 shutdown_connections 2024-09-16T01:23:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.390+0000 7fb85ab9f640 1 -- 172.21.15.81:0/3474821639 wait complete. 2024-09-16T01:23:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.391+0000 7fb85ab9f640 1 Processor -- start 2024-09-16T01:23:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.391+0000 7fb85ab9f640 1 -- start start 2024-09-16T01:23:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb85ab9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400039b0 0x7fb8541f4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb85ab9f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8541553b0 0x7fb854155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb85ab9f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8540b7160 0x7fb8540b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb85ab9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb85415eb90 con 0x7fb8400039b0 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb85ab9f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb85415ea10 con 0x7fb8541553b0 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb85ab9f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb8540d5110 con 0x7fb8540b7160 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb859b9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400039b0 0x7fb8541f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb859b9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400039b0 0x7fb8541f4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43810/0 (socket says 172.21.15.81:43810) 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb859b9d640 1 -- 172.21.15.81:0/254578630 learned_addr learned my addr 172.21.15.81:0/254578630 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb85a39e640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8540b7160 0x7fb8540b75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb85939c640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8541553b0 0x7fb854155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb859b9d640 1 -- 172.21.15.81:0/254578630 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8540b7160 msgr2=0x7fb8540b75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb859b9d640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8540b7160 0x7fb8540b75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb859b9d640 1 -- 172.21.15.81:0/254578630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8541553b0 msgr2=0x7fb854155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb859b9d640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8541553b0 0x7fb854155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb859b9d640 1 -- 172.21.15.81:0/254578630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8540b5a70 con 0x7fb8400039b0 2024-09-16T01:23:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb859b9d640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400039b0 0x7fb8541f4400 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fb850034040 tx=0x7fb850004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb84a7fc640 1 -- 172.21.15.81:0/254578630 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850040020 con 0x7fb8400039b0 2024-09-16T01:23:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb84a7fc640 1 -- 172.21.15.81:0/254578630 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb850003bc0 con 0x7fb8400039b0 2024-09-16T01:23:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb84a7fc640 1 -- 172.21.15.81:0/254578630 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850036040 con 0x7fb8400039b0 2024-09-16T01:23:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb85ab9f640 1 -- 172.21.15.81:0/254578630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8541f8c50 con 0x7fb8400039b0 2024-09-16T01:23:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.392+0000 7fb85ab9f640 1 -- 172.21.15.81:0/254578630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8541548d0 con 0x7fb8400039b0 2024-09-16T01:23:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.393+0000 7fb85ab9f640 1 -- 172.21.15.81:0/254578630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85406d900 con 0x7fb8400039b0 2024-09-16T01:23:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.394+0000 7fb84a7fc640 1 -- 172.21.15.81:0/254578630 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb850043020 con 0x7fb8400039b0 2024-09-16T01:23:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.394+0000 7fb84a7fc640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb83806c2e0 0x7fb83806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.394+0000 7fb84a7fc640 1 -- 172.21.15.81:0/254578630 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7fb8500ab660 con 0x7fb8400039b0 2024-09-16T01:23:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.394+0000 7fb85939c640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb83806c2e0 0x7fb83806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.395+0000 7fb85939c640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb83806c2e0 0x7fb83806e7a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb854161420 tx=0x7fb844008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.399+0000 7fb84a7fc640 1 -- 172.21.15.81:0/254578630 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb85004a030 con 0x7fb8400039b0 2024-09-16T01:23:11.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.565+0000 7fb85ab9f640 1 -- 172.21.15.81:0/254578630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"} v 0) -- 0x7fb8540b3a70 con 0x7fb8400039b0 2024-09-16T01:23:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.570+0000 7fb84a7fc640 1 -- 172.21.15.81:0/254578630 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"}]=0 v51) ==== 111+0+0 (secure 0 0 0) 0x7fb8500044e0 con 0x7fb8400039b0 2024-09-16T01:23:11.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.573+0000 7fb85ab9f640 1 -- 172.21.15.81:0/254578630 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb83806c2e0 msgr2=0x7fb83806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.573+0000 7fb85ab9f640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb83806c2e0 0x7fb83806e7a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb854161420 tx=0x7fb844008040 comp rx=0 tx=0).stop 2024-09-16T01:23:11.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.573+0000 7fb85ab9f640 1 -- 172.21.15.81:0/254578630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400039b0 msgr2=0x7fb8541f4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.573+0000 7fb85ab9f640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400039b0 0x7fb8541f4400 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fb850034040 tx=0x7fb850004730 comp rx=0 tx=0).stop 2024-09-16T01:23:11.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.573+0000 7fb85ab9f640 1 -- 172.21.15.81:0/254578630 shutdown_connections 2024-09-16T01:23:11.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.573+0000 7fb85ab9f640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb83806c2e0 0x7fb83806e7a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.573+0000 7fb85ab9f640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8540b7160 0x7fb8540b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.573+0000 7fb85ab9f640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8541553b0 0x7fb854155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.573+0000 7fb85ab9f640 1 --2- 172.21.15.81:0/254578630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400039b0 0x7fb8541f4400 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.573+0000 7fb85ab9f640 1 -- 172.21.15.81:0/254578630 >> 172.21.15.81:0/254578630 conn(0x7fb85408bfc0 msgr2=0x7fb85415ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:11.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.573+0000 7fb85ab9f640 1 -- 172.21.15.81:0/254578630 shutdown_connections 2024-09-16T01:23:11.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.573+0000 7fb85ab9f640 1 -- 172.21.15.81:0/254578630 wait complete. 2024-09-16T01:23:11.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_memory_limit 2024-09-16T01:23:11.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.691+0000 7f0da9c2e640 1 Processor -- start 2024-09-16T01:23:11.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.691+0000 7f0da9c2e640 1 -- start start 2024-09-16T01:23:11.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.692+0000 7f0da9c2e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da415f950 0x7f0da409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.692+0000 7f0da9c2e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0da409af70 0x7f0da406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.692+0000 7f0da9c2e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da40b6820 con 0x7f0da4158b50 2024-09-16T01:23:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.692+0000 7f0da9c2e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0da409b3c0 con 0x7f0da409af70 2024-09-16T01:23:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.692+0000 7f0da9c2e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0da40b6b00 con 0x7f0da415f950 2024-09-16T01:23:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.692+0000 7f0da3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0da409af70 0x7f0da406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.692+0000 7f0da37fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0da4158b50 0x7f0da40b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58892/0 (socket says 172.21.15.81:58892) 2024-09-16T01:23:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.692+0000 7f0da37fe640 1 -- 172.21.15.81:0/3028373851 learned_addr learned my addr 172.21.15.81:0/3028373851 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.693+0000 7f0da3fff640 1 -- 172.21.15.81:0/3028373851 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da415f950 msgr2=0x7f0da409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.693+0000 7f0da3fff640 1 --2- 172.21.15.81:0/3028373851 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da415f950 0x7f0da409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.693+0000 7f0da3fff640 1 -- 172.21.15.81:0/3028373851 >> v1:172.21.15.81:6789/0 conn(0x7f0da4158b50 legacy=0x7f0da40b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.693+0000 7f0da3fff640 1 -- 172.21.15.81:0/3028373851 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da40b6de0 con 0x7f0da409af70 2024-09-16T01:23:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.693+0000 7f0da3fff640 1 --2- 172.21.15.81:0/3028373851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da409af70 0x7f0da406fe90 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009d90 tx=0x7f0d9c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b239c85119b50b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:11.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.693+0000 7f0da27fc640 1 -- 172.21.15.81:0/3028373851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c007740 con 0x7f0da409af70 2024-09-16T01:23:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.693+0000 7f0da27fc640 1 -- 172.21.15.81:0/3028373851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9c0078e0 con 0x7f0da409af70 2024-09-16T01:23:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.693+0000 7f0da27fc640 1 -- 172.21.15.81:0/3028373851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c007cb0 con 0x7f0da409af70 2024-09-16T01:23:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.694+0000 7f0da9c2e640 1 -- 172.21.15.81:0/3028373851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da409af70 msgr2=0x7f0da406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.694+0000 7f0da9c2e640 1 --2- 172.21.15.81:0/3028373851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da409af70 0x7f0da406fe90 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c009d90 tx=0x7f0d9c02a660 comp rx=0 tx=0).stop 2024-09-16T01:23:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.694+0000 7f0da9c2e640 1 -- 172.21.15.81:0/3028373851 shutdown_connections 2024-09-16T01:23:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.694+0000 7f0da9c2e640 1 --2- 172.21.15.81:0/3028373851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da409af70 0x7f0da406fe90 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.694+0000 7f0da9c2e640 1 --2- 172.21.15.81:0/3028373851 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da415f950 0x7f0da409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.694+0000 7f0da9c2e640 1 -- 172.21.15.81:0/3028373851 >> 172.21.15.81:0/3028373851 conn(0x7f0da40b79e0 msgr2=0x7f0da40b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.694+0000 7f0da9c2e640 1 -- 172.21.15.81:0/3028373851 shutdown_connections 2024-09-16T01:23:11.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.694+0000 7f0da9c2e640 1 -- 172.21.15.81:0/3028373851 wait complete. 2024-09-16T01:23:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.695+0000 7f0da9c2e640 1 Processor -- start 2024-09-16T01:23:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.695+0000 7f0da9c2e640 1 -- start start 2024-09-16T01:23:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da9c2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da409af70 0x7f0da40cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da9c2e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0da4158b50 0x7f0da40d1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da9c2e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da415f950 0x7f0da40d16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da9c2e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0da40b6530 con 0x7f0da409af70 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da9c2e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0da40b73a0 con 0x7f0da4158b50 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da9c2e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0da4158f30 con 0x7f0da415f950 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da409af70 0x7f0da40cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da409af70 0x7f0da40cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43824/0 (socket says 172.21.15.81:43824) 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da37fe640 1 -- 172.21.15.81:0/2935665927 learned_addr learned my addr 172.21.15.81:0/2935665927 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da3fff640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da415f950 0x7f0da40d16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da2ffd640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0da4158b50 0x7f0da40d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da37fe640 1 -- 172.21.15.81:0/2935665927 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da415f950 msgr2=0x7f0da40d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da37fe640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da415f950 0x7f0da40d16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da37fe640 1 -- 172.21.15.81:0/2935665927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0da4158b50 msgr2=0x7f0da40d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da37fe640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0da4158b50 0x7f0da40d1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.696+0000 7f0da37fe640 1 -- 172.21.15.81:0/2935665927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da40d0550 con 0x7f0da409af70 2024-09-16T01:23:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.697+0000 7f0da37fe640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da409af70 0x7f0da40cdef0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c400 tx=0x7f0d9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.697+0000 7f0d8bfff640 1 -- 172.21.15.81:0/2935665927 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94017070 con 0x7f0da409af70 2024-09-16T01:23:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.697+0000 7f0d8bfff640 1 -- 172.21.15.81:0/2935665927 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d94005ce0 con 0x7f0da409af70 2024-09-16T01:23:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.697+0000 7f0da9c2e640 1 -- 172.21.15.81:0/2935665927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da40cb7c0 con 0x7f0da409af70 2024-09-16T01:23:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.697+0000 7f0d8bfff640 1 -- 172.21.15.81:0/2935665927 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d940072f0 con 0x7f0da409af70 2024-09-16T01:23:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.697+0000 7f0da9c2e640 1 -- 172.21.15.81:0/2935665927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da40cbd80 con 0x7f0da409af70 2024-09-16T01:23:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.698+0000 7f0da9c2e640 1 -- 172.21.15.81:0/2935665927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da40cc0b0 con 0x7f0da409af70 2024-09-16T01:23:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.698+0000 7f0d8bfff640 1 -- 172.21.15.81:0/2935665927 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0d9401a070 con 0x7f0da409af70 2024-09-16T01:23:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.699+0000 7f0d8bfff640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d9006c2b0 0x7f0d9006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.699+0000 7f0d8bfff640 1 -- 172.21.15.81:0/2935665927 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f0d9408a770 con 0x7f0da409af70 2024-09-16T01:23:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.699+0000 7f0da2ffd640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d9006c2b0 0x7f0d9006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.699+0000 7f0da2ffd640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d9006c2b0 0x7f0d9006e770 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0da406c100 tx=0x7f0d98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.703+0000 7f0d8bfff640 1 -- 172.21.15.81:0/2935665927 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d94058fd0 con 0x7f0da409af70 2024-09-16T01:23:11.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.870+0000 7f0da9c2e640 1 -- 172.21.15.81:0/2935665927 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"} v 0) -- 0x7f0da409aa30 con 0x7f0da409af70 2024-09-16T01:23:11.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.873+0000 7f0d8bfff640 1 -- 172.21.15.81:0/2935665927 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"}]=0 v52) ==== 105+0+0 (secure 0 0 0) 0x7f0d940588d0 con 0x7f0da409af70 2024-09-16T01:23:11.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.875+0000 7f0da9c2e640 1 -- 172.21.15.81:0/2935665927 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d9006c2b0 msgr2=0x7f0d9006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.875+0000 7f0da9c2e640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d9006c2b0 0x7f0d9006e770 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0da406c100 tx=0x7f0d98008040 comp rx=0 tx=0).stop 2024-09-16T01:23:11.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.875+0000 7f0da9c2e640 1 -- 172.21.15.81:0/2935665927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da409af70 msgr2=0x7f0da40cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.875+0000 7f0da9c2e640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da409af70 0x7f0da40cdef0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c400 tx=0x7f0d9400c8c0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.876+0000 7f0da9c2e640 1 -- 172.21.15.81:0/2935665927 shutdown_connections 2024-09-16T01:23:11.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.876+0000 7f0da9c2e640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0d9006c2b0 0x7f0d9006e770 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.876+0000 7f0da9c2e640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0da415f950 0x7f0da40d16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.876+0000 7f0da9c2e640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0da4158b50 0x7f0da40d1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.876+0000 7f0da9c2e640 1 --2- 172.21.15.81:0/2935665927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da409af70 0x7f0da40cdef0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.876+0000 7f0da9c2e640 1 -- 172.21.15.81:0/2935665927 >> 172.21.15.81:0/2935665927 conn(0x7f0da40b79e0 msgr2=0x7f0da4157c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:11.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.876+0000 7f0da9c2e640 1 -- 172.21.15.81:0/2935665927 shutdown_connections 2024-09-16T01:23:11.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.876+0000 7f0da9c2e640 1 -- 172.21.15.81:0/2935665927 wait complete. 2024-09-16T01:23:11.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-16T01:23:11.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.987+0000 7fc096149640 1 Processor -- start 2024-09-16T01:23:11.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.987+0000 7fc096149640 1 -- start start 2024-09-16T01:23:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc096149640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc09015f950 0x7fc09009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc096149640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0900b6820 con 0x7fc090158b50 2024-09-16T01:23:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc096149640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0900b6b00 con 0x7fc09009af70 2024-09-16T01:23:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc096149640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc0900b6de0 con 0x7fc09015f950 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc08f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc090158b50 0x7fc0900b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58894/0 (socket says 172.21.15.81:58894) 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc08f7fe640 1 -- 172.21.15.81:0/3555183900 learned_addr learned my addr 172.21.15.81:0/3555183900 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc08effd640 1 --2- 172.21.15.81:0/3555183900 >> v2:172.21.15.102:3300/0 conn(0x7fc09015f950 0x7fc09009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92362878 0 0) 0x7fc0900b6820 con 0x7fc090158b50 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc078003520 con 0x7fc090158b50 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1537014038 0 0) 0x7fc078003520 con 0x7fc090158b50 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 >> v2:172.21.15.102:3300/0 conn(0x7fc09015f950 msgr2=0x7fc09009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc08e7fc640 1 --2- 172.21.15.81:0/3555183900 >> v2:172.21.15.102:3300/0 conn(0x7fc09015f950 0x7fc09009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 >> v1:172.21.15.102:6789/0 conn(0x7fc09009af70 legacy=0x7fc09006fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.988+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0900b70c0 con 0x7fc090158b50 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fc0800019f0 con 0x7fc090158b50 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 >> v1:172.21.15.81:6789/0 conn(0x7fc090158b50 legacy=0x7fc0900b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08e7fc640 1 --2- 172.21.15.81:0/3555183900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0780039b0 0x7fc078003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08e7fc640 1 --2- 172.21.15.81:0/3555183900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc078004800 0x7fc078004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08e7fc640 1 --2- 172.21.15.81:0/3555183900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0780051c0 0x7fc07800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0900b6de0 con 0x7fc078004800 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc07800c060 con 0x7fc0780039b0 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc07800c260 con 0x7fc0780051c0 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08effd640 1 --2- 172.21.15.81:0/3555183900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc078004800 0x7fc078004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08f7fe640 1 --2- 172.21.15.81:0/3555183900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0780039b0 0x7fc078003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08ffff640 1 --2- 172.21.15.81:0/3555183900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0780051c0 0x7fc07800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08effd640 1 -- 172.21.15.81:0/3555183900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0780051c0 msgr2=0x7fc07800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08effd640 1 --2- 172.21.15.81:0/3555183900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0780051c0 0x7fc07800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08effd640 1 -- 172.21.15.81:0/3555183900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0780039b0 msgr2=0x7fc078003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08effd640 1 --2- 172.21.15.81:0/3555183900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0780039b0 0x7fc078003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08effd640 1 -- 172.21.15.81:0/3555183900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc078003520 con 0x7fc078004800 2024-09-16T01:23:11.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08ffff640 1 --2- 172.21.15.81:0/3555183900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc0780051c0 0x7fc07800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.989+0000 7fc08ffff640 1 -- 172.21.15.81:0/3555183900 reap_dead start 2024-09-16T01:23:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.990+0000 7fc08effd640 1 --2- 172.21.15.81:0/3555183900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc078004800 0x7fc078004c80 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc084009a90 tx=0x7fc078005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f588a67266b08297 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.990+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc084036070 con 0x7fc078004800 2024-09-16T01:23:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.990+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc084031400 con 0x7fc078004800 2024-09-16T01:23:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.990+0000 7fc08e7fc640 1 -- 172.21.15.81:0/3555183900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc084009690 con 0x7fc078004800 2024-09-16T01:23:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.990+0000 7fc096149640 1 -- 172.21.15.81:0/3555183900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc078004800 msgr2=0x7fc078004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.990+0000 7fc096149640 1 --2- 172.21.15.81:0/3555183900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc078004800 0x7fc078004c80 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc084009a90 tx=0x7fc078005830 comp rx=0 tx=0).stop 2024-09-16T01:23:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.990+0000 7fc096149640 1 -- 172.21.15.81:0/3555183900 shutdown_connections 2024-09-16T01:23:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.990+0000 7fc096149640 1 --2- 172.21.15.81:0/3555183900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc078004800 0x7fc078004c80 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.990+0000 7fc096149640 1 -- 172.21.15.81:0/3555183900 >> 172.21.15.81:0/3555183900 conn(0x7fc0900b79e0 msgr2=0x7fc0900b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.990+0000 7fc096149640 1 -- 172.21.15.81:0/3555183900 shutdown_connections 2024-09-16T01:23:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.990+0000 7fc096149640 1 -- 172.21.15.81:0/3555183900 wait complete. 2024-09-16T01:23:11.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.991+0000 7fc096149640 1 Processor -- start 2024-09-16T01:23:11.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.992+0000 7fc096149640 1 -- start start 2024-09-16T01:23:11.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.992+0000 7fc096149640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc078004800 0x7fc090147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.992+0000 7fc096149640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc090151030 0x7fc090152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.992+0000 7fc096149640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc09009d9c0 0x7fc090160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:11.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.992+0000 7fc096149640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0901590b0 con 0x7fc090151030 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.992+0000 7fc096149640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc090158f30 con 0x7fc09009d9c0 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.992+0000 7fc096149640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc09009aa30 con 0x7fc078004800 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.992+0000 7fc08effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc090151030 0x7fc090152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.992+0000 7fc08effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc090151030 0x7fc090152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43848/0 (socket says 172.21.15.81:43848) 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.993+0000 7fc08effd640 1 -- 172.21.15.81:0/2576279239 learned_addr learned my addr 172.21.15.81:0/2576279239 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.993+0000 7fc08effd640 1 -- 172.21.15.81:0/2576279239 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc078004800 msgr2=0x7fc090147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.993+0000 7fc08effd640 1 --2- 172.21.15.81:0/2576279239 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc078004800 0x7fc090147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.993+0000 7fc08effd640 1 -- 172.21.15.81:0/2576279239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc09009d9c0 msgr2=0x7fc090160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.993+0000 7fc08effd640 1 --2- 172.21.15.81:0/2576279239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc09009d9c0 0x7fc090160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.993+0000 7fc08effd640 1 -- 172.21.15.81:0/2576279239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0901484d0 con 0x7fc090151030 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.993+0000 7fc08effd640 1 --2- 172.21.15.81:0/2576279239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc090151030 0x7fc090152ca0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc084009bb0 tx=0x7fc084004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.993+0000 7fc077fff640 1 -- 172.21.15.81:0/2576279239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08403f020 con 0x7fc090151030 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.993+0000 7fc077fff640 1 -- 172.21.15.81:0/2576279239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc084037040 con 0x7fc090151030 2024-09-16T01:23:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.993+0000 7fc077fff640 1 -- 172.21.15.81:0/2576279239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc084036070 con 0x7fc090151030 2024-09-16T01:23:12.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.993+0000 7fc096149640 1 -- 172.21.15.81:0/2576279239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0901531e0 con 0x7fc090151030 2024-09-16T01:23:12.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.993+0000 7fc096149640 1 -- 172.21.15.81:0/2576279239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc090154180 con 0x7fc090151030 2024-09-16T01:23:12.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.994+0000 7fc096149640 1 -- 172.21.15.81:0/2576279239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc09009ad60 con 0x7fc090151030 2024-09-16T01:23:12.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.994+0000 7fc077fff640 1 -- 172.21.15.81:0/2576279239 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc084042020 con 0x7fc090151030 2024-09-16T01:23:12.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.995+0000 7fc077fff640 1 --2- 172.21.15.81:0/2576279239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc07c06c2b0 0x7fc07c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.995+0000 7fc077fff640 1 -- 172.21.15.81:0/2576279239 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7fc0840ab2e0 con 0x7fc090151030 2024-09-16T01:23:12.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.995+0000 7fc08f7fe640 1 --2- 172.21.15.81:0/2576279239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc07c06c2b0 0x7fc07c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.995+0000 7fc08f7fe640 1 --2- 172.21.15.81:0/2576279239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc07c06c2b0 0x7fc07c06e770 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc0800012e0 tx=0x7fc080001250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:12.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:11.999+0000 7fc077fff640 1 -- 172.21.15.81:0/2576279239 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc084049030 con 0x7fc090151030 2024-09-16T01:23:12.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.166+0000 7fc096149640 1 -- 172.21.15.81:0/2576279239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc0900b77a0 con 0x7fc090151030 2024-09-16T01:23:12.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.169+0000 7fc077fff640 1 -- 172.21.15.81:0/2576279239 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v53) ==== 104+0+0 (secure 0 0 0) 0x7fc0901484d0 con 0x7fc090151030 2024-09-16T01:23:12.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.171+0000 7fc096149640 1 -- 172.21.15.81:0/2576279239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc07c06c2b0 msgr2=0x7fc07c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.171+0000 7fc096149640 1 --2- 172.21.15.81:0/2576279239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc07c06c2b0 0x7fc07c06e770 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc0800012e0 tx=0x7fc080001250 comp rx=0 tx=0).stop 2024-09-16T01:23:12.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.171+0000 7fc096149640 1 -- 172.21.15.81:0/2576279239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc090151030 msgr2=0x7fc090152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.171+0000 7fc096149640 1 --2- 172.21.15.81:0/2576279239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc090151030 0x7fc090152ca0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc084009bb0 tx=0x7fc084004730 comp rx=0 tx=0).stop 2024-09-16T01:23:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.171+0000 7fc096149640 1 -- 172.21.15.81:0/2576279239 shutdown_connections 2024-09-16T01:23:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.171+0000 7fc096149640 1 --2- 172.21.15.81:0/2576279239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc07c06c2b0 0x7fc07c06e770 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.171+0000 7fc096149640 1 --2- 172.21.15.81:0/2576279239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc09009d9c0 0x7fc090160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.171+0000 7fc096149640 1 --2- 172.21.15.81:0/2576279239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc090151030 0x7fc090152ca0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.171+0000 7fc096149640 1 --2- 172.21.15.81:0/2576279239 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc078004800 0x7fc090147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.171+0000 7fc096149640 1 -- 172.21.15.81:0/2576279239 >> 172.21.15.81:0/2576279239 conn(0x7fc0900b79e0 msgr2=0x7fc09006fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.171+0000 7fc096149640 1 -- 172.21.15.81:0/2576279239 shutdown_connections 2024-09-16T01:23:12.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.171+0000 7fc096149640 1 -- 172.21.15.81:0/2576279239 wait complete. 2024-09-16T01:23:12.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_max_caps 2024-09-16T01:23:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.283+0000 7f62ec874640 1 Processor -- start 2024-09-16T01:23:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.283+0000 7f62ec874640 1 -- start start 2024-09-16T01:23:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.284+0000 7f62ec874640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e8162340 0x7f62e806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.284+0000 7f62ec874640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f62e80cf280 0x7f62e8162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.284+0000 7f62ec874640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62e8162c60 0x7f62e80d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.284+0000 7f62ec874640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f62e806de90 con 0x7f62e8162c60 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.284+0000 7f62ec874640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f62e815ff70 con 0x7f62e80cf280 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.284+0000 7f62ec874640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f62e80d4d10 con 0x7f62e8162340 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.284+0000 7f62e6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62e8162c60 0x7f62e80d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.284+0000 7f62e6d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62e8162c60 0x7f62e80d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43858/0 (socket says 172.21.15.81:43858) 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.284+0000 7f62e6d9d640 1 -- 172.21.15.81:0/123135775 learned_addr learned my addr 172.21.15.81:0/123135775 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.285+0000 7f62e5d9b640 1 --2- 172.21.15.81:0/123135775 >> v2:172.21.15.102:3300/0 conn(0x7f62e80cf280 0x7f62e8162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.285+0000 7f62e659c640 1 --2- 172.21.15.81:0/123135775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e8162340 0x7f62e806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.285+0000 7f62e6d9d640 1 -- 172.21.15.81:0/123135775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e8162340 msgr2=0x7f62e806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.285+0000 7f62e6d9d640 1 --2- 172.21.15.81:0/123135775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e8162340 0x7f62e806d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.285+0000 7f62e6d9d640 1 -- 172.21.15.81:0/123135775 >> v2:172.21.15.102:3300/0 conn(0x7f62e80cf280 msgr2=0x7f62e8162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.285+0000 7f62e6d9d640 1 --2- 172.21.15.81:0/123135775 >> v2:172.21.15.102:3300/0 conn(0x7f62e80cf280 0x7f62e8162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.285+0000 7f62e6d9d640 1 -- 172.21.15.81:0/123135775 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e80d4ff0 con 0x7f62e8162c60 2024-09-16T01:23:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.285+0000 7f62e6d9d640 1 --2- 172.21.15.81:0/123135775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8162c60 0x7f62e80d2990 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f62e808d200 tx=0x7f62e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b00103ab66c509 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.285+0000 7f62e559a640 1 -- 172.21.15.81:0/123135775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0037070 con 0x7f62e8162c60 2024-09-16T01:23:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.285+0000 7f62e559a640 1 -- 172.21.15.81:0/123135775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e0032440 con 0x7f62e8162c60 2024-09-16T01:23:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.286+0000 7f62e559a640 1 -- 172.21.15.81:0/123135775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e0032810 con 0x7f62e8162c60 2024-09-16T01:23:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.286+0000 7f62ec874640 1 -- 172.21.15.81:0/123135775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8162c60 msgr2=0x7f62e80d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.286+0000 7f62ec874640 1 --2- 172.21.15.81:0/123135775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8162c60 0x7f62e80d2990 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f62e808d200 tx=0x7f62e002a140 comp rx=0 tx=0).stop 2024-09-16T01:23:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.286+0000 7f62ec874640 1 -- 172.21.15.81:0/123135775 shutdown_connections 2024-09-16T01:23:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.286+0000 7f62ec874640 1 --2- 172.21.15.81:0/123135775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8162c60 0x7f62e80d2990 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.286+0000 7f62ec874640 1 --2- 172.21.15.81:0/123135775 >> v2:172.21.15.102:3300/0 conn(0x7f62e80cf280 0x7f62e8162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.286+0000 7f62ec874640 1 --2- 172.21.15.81:0/123135775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e8162340 0x7f62e806d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.286+0000 7f62ec874640 1 -- 172.21.15.81:0/123135775 >> 172.21.15.81:0/123135775 conn(0x7f62e808bfc0 msgr2=0x7f62e80d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.286+0000 7f62ec874640 1 -- 172.21.15.81:0/123135775 shutdown_connections 2024-09-16T01:23:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.286+0000 7f62ec874640 1 -- 172.21.15.81:0/123135775 wait complete. 2024-09-16T01:23:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.287+0000 7f62ec874640 1 Processor -- start 2024-09-16T01:23:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.287+0000 7f62ec874640 1 -- start start 2024-09-16T01:23:12.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.288+0000 7f62ec874640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80cf280 0x7f62e80b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.288+0000 7f62ec874640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8162340 0x7f62e815dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.288+0000 7f62ec874640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e8162c60 0x7f62e80cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.288+0000 7f62ec874640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62e80cf6c0 con 0x7f62e8162340 2024-09-16T01:23:12.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.288+0000 7f62ec874640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f62e80d52d0 con 0x7f62e8162c60 2024-09-16T01:23:12.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.288+0000 7f62ec874640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f62e8163110 con 0x7f62e80cf280 2024-09-16T01:23:12.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.288+0000 7f62e5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8162340 0x7f62e815dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.288+0000 7f62e5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8162340 0x7f62e815dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43864/0 (socket says 172.21.15.81:43864) 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.288+0000 7f62e5d9b640 1 -- 172.21.15.81:0/257141700 learned_addr learned my addr 172.21.15.81:0/257141700 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.288+0000 7f62e659c640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80cf280 0x7f62e80b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.288+0000 7f62e6d9d640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e8162c60 0x7f62e80cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.289+0000 7f62e5d9b640 1 -- 172.21.15.81:0/257141700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80cf280 msgr2=0x7f62e80b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.289+0000 7f62e5d9b640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80cf280 0x7f62e80b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.289+0000 7f62e5d9b640 1 -- 172.21.15.81:0/257141700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e8162c60 msgr2=0x7f62e80cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.289+0000 7f62e5d9b640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e8162c60 0x7f62e80cd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.289+0000 7f62e5d9b640 1 -- 172.21.15.81:0/257141700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e80b5b80 con 0x7f62e8162340 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.289+0000 7f62e5d9b640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8162340 0x7f62e815dfe0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00d5f0 tx=0x7f62dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.289+0000 7f62d6ffd640 1 -- 172.21.15.81:0/257141700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc018030 con 0x7f62e8162340 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.289+0000 7f62d6ffd640 1 -- 172.21.15.81:0/257141700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc004020 con 0x7f62e8162340 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.289+0000 7f62d6ffd640 1 -- 172.21.15.81:0/257141700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc004210 con 0x7f62e8162340 2024-09-16T01:23:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.289+0000 7f62ec874640 1 -- 172.21.15.81:0/257141700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e80b5e60 con 0x7f62e8162340 2024-09-16T01:23:12.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.289+0000 7f62ec874640 1 -- 172.21.15.81:0/257141700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e80b6420 con 0x7f62e8162340 2024-09-16T01:23:12.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.290+0000 7f62ec874640 1 -- 172.21.15.81:0/257141700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e8162720 con 0x7f62e8162340 2024-09-16T01:23:12.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.290+0000 7f62d6ffd640 1 -- 172.21.15.81:0/257141700 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f62dc01b070 con 0x7f62e8162340 2024-09-16T01:23:12.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.291+0000 7f62d6ffd640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f62c806c2b0 0x7f62c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.291+0000 7f62d6ffd640 1 -- 172.21.15.81:0/257141700 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f62dc08b410 con 0x7f62e8162340 2024-09-16T01:23:12.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.291+0000 7f62e659c640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f62c806c2b0 0x7f62c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.291+0000 7f62e659c640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f62c806c2b0 0x7f62c806e770 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f62d80099c0 tx=0x7f62d8003990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.295+0000 7f62d6ffd640 1 -- 172.21.15.81:0/257141700 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62dc059c60 con 0x7f62e8162340 2024-09-16T01:23:12.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.464+0000 7f62ec874640 1 -- 172.21.15.81:0/257141700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"} v 0) -- 0x7f62e808e640 con 0x7f62e8162340 2024-09-16T01:23:12.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.467+0000 7f62d6ffd640 1 -- 172.21.15.81:0/257141700 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"}]=0 v54) ==== 102+0+0 (secure 0 0 0) 0x7f62dc059560 con 0x7f62e8162340 2024-09-16T01:23:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.470+0000 7f62ec874640 1 -- 172.21.15.81:0/257141700 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f62c806c2b0 msgr2=0x7f62c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.470+0000 7f62ec874640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f62c806c2b0 0x7f62c806e770 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f62d80099c0 tx=0x7f62d8003990 comp rx=0 tx=0).stop 2024-09-16T01:23:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.470+0000 7f62ec874640 1 -- 172.21.15.81:0/257141700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8162340 msgr2=0x7f62e815dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.470+0000 7f62ec874640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8162340 0x7f62e815dfe0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00d5f0 tx=0x7f62dc00dab0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.470+0000 7f62ec874640 1 -- 172.21.15.81:0/257141700 shutdown_connections 2024-09-16T01:23:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.470+0000 7f62ec874640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f62c806c2b0 0x7f62c806e770 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.470+0000 7f62ec874640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e8162c60 0x7f62e80cd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.470+0000 7f62ec874640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62e8162340 0x7f62e815dfe0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.470+0000 7f62ec874640 1 --2- 172.21.15.81:0/257141700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80cf280 0x7f62e80b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.470+0000 7f62ec874640 1 -- 172.21.15.81:0/257141700 >> 172.21.15.81:0/257141700 conn(0x7f62e808bfc0 msgr2=0x7f62e80b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.470+0000 7f62ec874640 1 -- 172.21.15.81:0/257141700 shutdown_connections 2024-09-16T01:23:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.470+0000 7f62ec874640 1 -- 172.21.15.81:0/257141700 wait complete. 2024-09-16T01:23:12.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_min_caps_working_set 2024-09-16T01:23:12.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.581+0000 7f6a386dd640 1 Processor -- start 2024-09-16T01:23:12.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.581+0000 7f6a386dd640 1 -- start start 2024-09-16T01:23:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a386dd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a301519f0 0x7f6a300726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a386dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a30072be0 0x7f6a300b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a386dd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a300b4800 con 0x7f6a300b3fd0 2024-09-16T01:23:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a386dd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6a30073020 con 0x7f6a301519f0 2024-09-16T01:23:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a386dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6a300b4ae0 con 0x7f6a30072be0 2024-09-16T01:23:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a36479640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a301519f0 0x7f6a300726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a36c7a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6a300b3fd0 0x7f6a3015e4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58896/0 (socket says 172.21.15.81:58896) 2024-09-16T01:23:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a36479640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a301519f0 0x7f6a300726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43866/0 (socket says 172.21.15.81:43866) 2024-09-16T01:23:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a36c7a640 1 -- 172.21.15.81:0/1534236189 learned_addr learned my addr 172.21.15.81:0/1534236189 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a35c78640 1 --2- 172.21.15.81:0/1534236189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a30072be0 0x7f6a300b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a36479640 1 -- 172.21.15.81:0/1534236189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a30072be0 msgr2=0x7f6a300b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a36479640 1 --2- 172.21.15.81:0/1534236189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a30072be0 0x7f6a300b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a36479640 1 -- 172.21.15.81:0/1534236189 >> v1:172.21.15.81:6789/0 conn(0x7f6a300b3fd0 legacy=0x7f6a3015e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a36479640 1 -- 172.21.15.81:0/1534236189 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a300b4dc0 con 0x7f6a301519f0 2024-09-16T01:23:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a35477640 1 -- 172.21.15.81:0/1534236189 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 720879961 0 0) 0x7f6a300b4800 con 0x7f6a300b3fd0 2024-09-16T01:23:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.582+0000 7f6a35c78640 1 --2- 172.21.15.81:0/1534236189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a30072be0 0x7f6a300b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.583+0000 7f6a36479640 1 --2- 172.21.15.81:0/1534236189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a301519f0 0x7f6a300726a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400ba40 tx=0x7f6a2402c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7550ae2e32fabc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.583+0000 7f6a35477640 1 -- 172.21.15.81:0/1534236189 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24031710 con 0x7f6a301519f0 2024-09-16T01:23:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.583+0000 7f6a35477640 1 -- 172.21.15.81:0/1534236189 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a240318b0 con 0x7f6a301519f0 2024-09-16T01:23:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.583+0000 7f6a35477640 1 -- 172.21.15.81:0/1534236189 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24031c80 con 0x7f6a301519f0 2024-09-16T01:23:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.584+0000 7f6a386dd640 1 -- 172.21.15.81:0/1534236189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a301519f0 msgr2=0x7f6a300726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.584+0000 7f6a386dd640 1 --2- 172.21.15.81:0/1534236189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a301519f0 0x7f6a300726a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400ba40 tx=0x7f6a2402c7b0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.584+0000 7f6a386dd640 1 -- 172.21.15.81:0/1534236189 shutdown_connections 2024-09-16T01:23:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.584+0000 7f6a386dd640 1 --2- 172.21.15.81:0/1534236189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a30072be0 0x7f6a300b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.584+0000 7f6a386dd640 1 --2- 172.21.15.81:0/1534236189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a301519f0 0x7f6a300726a0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.584+0000 7f6a386dd640 1 -- 172.21.15.81:0/1534236189 >> 172.21.15.81:0/1534236189 conn(0x7f6a3006bdf0 msgr2=0x7f6a3006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.584+0000 7f6a386dd640 1 -- 172.21.15.81:0/1534236189 shutdown_connections 2024-09-16T01:23:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.584+0000 7f6a386dd640 1 -- 172.21.15.81:0/1534236189 wait complete. 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.585+0000 7f6a386dd640 1 Processor -- start 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.585+0000 7f6a386dd640 1 -- start start 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a386dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a30072be0 0x7f6a30150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a386dd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a300b3fd0 0x7f6a3014fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a386dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a301519f0 0x7f6a300d0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a386dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a300b4480 con 0x7f6a30072be0 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a386dd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6a30151dd0 con 0x7f6a300b3fd0 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a386dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6a3006f370 con 0x7f6a301519f0 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a36479640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a30072be0 0x7f6a30150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a36479640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a30072be0 0x7f6a30150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43874/0 (socket says 172.21.15.81:43874) 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a36479640 1 -- 172.21.15.81:0/2484680619 learned_addr learned my addr 172.21.15.81:0/2484680619 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a35c78640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a300b3fd0 0x7f6a3014fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a36c7a640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a301519f0 0x7f6a300d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a36479640 1 -- 172.21.15.81:0/2484680619 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a301519f0 msgr2=0x7f6a300d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a36479640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a301519f0 0x7f6a300d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a36479640 1 -- 172.21.15.81:0/2484680619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a300b3fd0 msgr2=0x7f6a3014fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a36479640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a300b3fd0 0x7f6a3014fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a36479640 1 -- 172.21.15.81:0/2484680619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a301f4c30 con 0x7f6a30072be0 2024-09-16T01:23:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a36479640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a30072be0 0x7f6a30150400 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f6a2402cda0 tx=0x7f6a240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a22ffd640 1 -- 172.21.15.81:0/2484680619 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24033c00 con 0x7f6a30072be0 2024-09-16T01:23:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a22ffd640 1 -- 172.21.15.81:0/2484680619 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a24041070 con 0x7f6a30072be0 2024-09-16T01:23:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a22ffd640 1 -- 172.21.15.81:0/2484680619 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2403c460 con 0x7f6a30072be0 2024-09-16T01:23:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.586+0000 7f6a386dd640 1 -- 172.21.15.81:0/2484680619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a30157930 con 0x7f6a30072be0 2024-09-16T01:23:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.587+0000 7f6a386dd640 1 -- 172.21.15.81:0/2484680619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a301509e0 con 0x7f6a30072be0 2024-09-16T01:23:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.587+0000 7f6a386dd640 1 -- 172.21.15.81:0/2484680619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a300b3a90 con 0x7f6a30072be0 2024-09-16T01:23:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.588+0000 7f6a22ffd640 1 -- 172.21.15.81:0/2484680619 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6a2403c600 con 0x7f6a30072be0 2024-09-16T01:23:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.588+0000 7f6a22ffd640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6a1406c2b0 0x7f6a1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.588+0000 7f6a22ffd640 1 -- 172.21.15.81:0/2484680619 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f6a240abed0 con 0x7f6a30072be0 2024-09-16T01:23:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.588+0000 7f6a35c78640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6a1406c2b0 0x7f6a1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.589+0000 7f6a35c78640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6a1406c2b0 0x7f6a1406e770 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6a3015ba60 tx=0x7f6a2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.593+0000 7f6a22ffd640 1 -- 172.21.15.81:0/2484680619 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a2407a840 con 0x7f6a30072be0 2024-09-16T01:23:12.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.757+0000 7f6a386dd640 1 -- 172.21.15.81:0/2484680619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"} v 0) -- 0x7f6a3015a910 con 0x7f6a30072be0 2024-09-16T01:23:12.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.760+0000 7f6a22ffd640 1 -- 172.21.15.81:0/2484680619 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"}]=0 v55) ==== 107+0+0 (secure 0 0 0) 0x7f6a2407a140 con 0x7f6a30072be0 2024-09-16T01:23:12.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.762+0000 7f6a386dd640 1 -- 172.21.15.81:0/2484680619 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6a1406c2b0 msgr2=0x7f6a1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.762+0000 7f6a386dd640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6a1406c2b0 0x7f6a1406e770 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6a3015ba60 tx=0x7f6a2c008040 comp rx=0 tx=0).stop 2024-09-16T01:23:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.762+0000 7f6a386dd640 1 -- 172.21.15.81:0/2484680619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a30072be0 msgr2=0x7f6a30150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.762+0000 7f6a386dd640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a30072be0 0x7f6a30150400 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f6a2402cda0 tx=0x7f6a240046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.763+0000 7f6a386dd640 1 -- 172.21.15.81:0/2484680619 shutdown_connections 2024-09-16T01:23:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.763+0000 7f6a386dd640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6a1406c2b0 0x7f6a1406e770 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.763+0000 7f6a386dd640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a301519f0 0x7f6a300d0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.763+0000 7f6a386dd640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a300b3fd0 0x7f6a3014fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.763+0000 7f6a386dd640 1 --2- 172.21.15.81:0/2484680619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a30072be0 0x7f6a30150400 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.763+0000 7f6a386dd640 1 -- 172.21.15.81:0/2484680619 >> 172.21.15.81:0/2484680619 conn(0x7f6a3006bdf0 msgr2=0x7f6a3015ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.763+0000 7f6a386dd640 1 -- 172.21.15.81:0/2484680619 shutdown_connections 2024-09-16T01:23:12.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.763+0000 7f6a386dd640 1 -- 172.21.15.81:0/2484680619 wait complete. 2024-09-16T01:23:12.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps' 2024-09-16T01:23:12.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.872+0000 7fc606181640 1 Processor -- start 2024-09-16T01:23:12.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.872+0000 7fc606181640 1 -- start start 2024-09-16T01:23:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc606181640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc600147360 0x7fc600070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc606181640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc600070dd0 0x7fc6000d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc606181640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc60006cb30 con 0x7fc6000d09e0 2024-09-16T01:23:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc606181640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc60006bfb0 con 0x7fc600147360 2024-09-16T01:23:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc606181640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc60006c290 con 0x7fc600070dd0 2024-09-16T01:23:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc5ff7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc600147360 0x7fc600070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc5ff7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc600147360 0x7fc600070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43886/0 (socket says 172.21.15.81:43886) 2024-09-16T01:23:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc5fffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc6000d09e0 0x7fc60006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58912/0 (socket says 172.21.15.81:58912) 2024-09-16T01:23:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc5ff7fe640 1 -- 172.21.15.81:0/2712455265 learned_addr learned my addr 172.21.15.81:0/2712455265 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc5feffd640 1 --2- 172.21.15.81:0/2712455265 >> v2:172.21.15.102:3300/0 conn(0x7fc600070dd0 0x7fc6000d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc5ff7fe640 1 -- 172.21.15.81:0/2712455265 >> v2:172.21.15.102:3300/0 conn(0x7fc600070dd0 msgr2=0x7fc6000d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc5ff7fe640 1 --2- 172.21.15.81:0/2712455265 >> v2:172.21.15.102:3300/0 conn(0x7fc600070dd0 0x7fc6000d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc5ff7fe640 1 -- 172.21.15.81:0/2712455265 >> v1:172.21.15.81:6789/0 conn(0x7fc6000d09e0 legacy=0x7fc60006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.873+0000 7fc5ff7fe640 1 -- 172.21.15.81:0/2712455265 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60006c570 con 0x7fc600147360 2024-09-16T01:23:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.874+0000 7fc5ff7fe640 1 --2- 172.21.15.81:0/2712455265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc600147360 0x7fc600070890 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fc6000cec70 tx=0x7fc5f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d95bbc4ac8c1b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.875+0000 7fc5fe7fc640 1 -- 172.21.15.81:0/2712455265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0037070 con 0x7fc600147360 2024-09-16T01:23:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.875+0000 7fc5fe7fc640 1 -- 172.21.15.81:0/2712455265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f0032440 con 0x7fc600147360 2024-09-16T01:23:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.875+0000 7fc5fe7fc640 1 -- 172.21.15.81:0/2712455265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0032810 con 0x7fc600147360 2024-09-16T01:23:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.875+0000 7fc606181640 1 -- 172.21.15.81:0/2712455265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc600147360 msgr2=0x7fc600070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.875+0000 7fc606181640 1 --2- 172.21.15.81:0/2712455265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc600147360 0x7fc600070890 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fc6000cec70 tx=0x7fc5f002a1e0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.875+0000 7fc606181640 1 -- 172.21.15.81:0/2712455265 shutdown_connections 2024-09-16T01:23:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.875+0000 7fc606181640 1 --2- 172.21.15.81:0/2712455265 >> v2:172.21.15.102:3300/0 conn(0x7fc600070dd0 0x7fc6000d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.875+0000 7fc606181640 1 --2- 172.21.15.81:0/2712455265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc600147360 0x7fc600070890 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.875+0000 7fc606181640 1 -- 172.21.15.81:0/2712455265 >> 172.21.15.81:0/2712455265 conn(0x7fc6000b2f40 msgr2=0x7fc6000b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.875+0000 7fc606181640 1 -- 172.21.15.81:0/2712455265 shutdown_connections 2024-09-16T01:23:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.875+0000 7fc606181640 1 -- 172.21.15.81:0/2712455265 wait complete. 2024-09-16T01:23:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.877+0000 7fc606181640 1 Processor -- start 2024-09-16T01:23:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.877+0000 7fc606181640 1 -- start start 2024-09-16T01:23:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.877+0000 7fc606181640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc600070dd0 0x7fc60013d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.877+0000 7fc606181640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6000d09e0 0x7fc6000b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.877+0000 7fc606181640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc600147360 0x7fc6000b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc606181640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc60006bc10 con 0x7fc600147360 2024-09-16T01:23:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc606181640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc6000d0e00 con 0x7fc6000d09e0 2024-09-16T01:23:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc606181640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc60006bd90 con 0x7fc600070dd0 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5fffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc600147360 0x7fc6000b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5fffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc600147360 0x7fc6000b45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43896/0 (socket says 172.21.15.81:43896) 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5fffff640 1 -- 172.21.15.81:0/2396289831 learned_addr learned my addr 172.21.15.81:0/2396289831 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5feffd640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6000d09e0 0x7fc6000b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5ff7fe640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc600070dd0 0x7fc60013d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5fffff640 1 -- 172.21.15.81:0/2396289831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc600070dd0 msgr2=0x7fc60013d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5fffff640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc600070dd0 0x7fc60013d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5fffff640 1 -- 172.21.15.81:0/2396289831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6000d09e0 msgr2=0x7fc6000b6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5fffff640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6000d09e0 0x7fc6000b6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5fffff640 1 -- 172.21.15.81:0/2396289831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60013ce70 con 0x7fc600147360 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5fffff640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc600147360 0x7fc6000b45c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800c780 tx=0x7fc5f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5e7fff640 1 -- 172.21.15.81:0/2396289831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8017070 con 0x7fc600147360 2024-09-16T01:23:12.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5e7fff640 1 -- 172.21.15.81:0/2396289831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f800a640 con 0x7fc600147360 2024-09-16T01:23:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc5e7fff640 1 -- 172.21.15.81:0/2396289831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f800aa30 con 0x7fc600147360 2024-09-16T01:23:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc606181640 1 -- 172.21.15.81:0/2396289831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60015c200 con 0x7fc600147360 2024-09-16T01:23:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.878+0000 7fc606181640 1 -- 172.21.15.81:0/2396289831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60013d110 con 0x7fc600147360 2024-09-16T01:23:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.879+0000 7fc606181640 1 -- 172.21.15.81:0/2396289831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6000d04a0 con 0x7fc600147360 2024-09-16T01:23:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.880+0000 7fc5e7fff640 1 -- 172.21.15.81:0/2396289831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc5f801a070 con 0x7fc600147360 2024-09-16T01:23:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.880+0000 7fc5e7fff640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc5ec06c2b0 0x7fc5ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.880+0000 7fc5e7fff640 1 -- 172.21.15.81:0/2396289831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7fc5f808a7a0 con 0x7fc600147360 2024-09-16T01:23:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.880+0000 7fc5ff7fe640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc5ec06c2b0 0x7fc5ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:12.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.880+0000 7fc5ff7fe640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc5ec06c2b0 0x7fc5ec06e770 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0034000 tx=0x7fc5f002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:12.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:12.884+0000 7fc5e7fff640 1 -- 172.21.15.81:0/2396289831 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5f8058a60 con 0x7fc600147360 2024-09-16T01:23:13.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.112+0000 7fc606181640 1 -- 172.21.15.81:0/2396289831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]} v 0) -- 0x7fc600141f10 con 0x7fc600147360 2024-09-16T01:23:13.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.274+0000 7fc5e7fff640 1 -- 172.21.15.81:0/2396289831 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]}]=0 v382) ==== 151+0+0 (secure 0 0 0) 0x7fc5f805cd60 con 0x7fc600147360 2024-09-16T01:23:13.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.276+0000 7fc606181640 1 -- 172.21.15.81:0/2396289831 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc5ec06c2b0 msgr2=0x7fc5ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.276+0000 7fc606181640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc5ec06c2b0 0x7fc5ec06e770 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc5f0034000 tx=0x7fc5f002e000 comp rx=0 tx=0).stop 2024-09-16T01:23:13.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.276+0000 7fc606181640 1 -- 172.21.15.81:0/2396289831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc600147360 msgr2=0x7fc6000b45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.276+0000 7fc606181640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc600147360 0x7fc6000b45c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800c780 tx=0x7fc5f800cc40 comp rx=0 tx=0).stop 2024-09-16T01:23:13.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.277+0000 7fc606181640 1 -- 172.21.15.81:0/2396289831 shutdown_connections 2024-09-16T01:23:13.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.277+0000 7fc606181640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc5ec06c2b0 0x7fc5ec06e770 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.277+0000 7fc606181640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc600147360 0x7fc6000b45c0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.277+0000 7fc606181640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6000d09e0 0x7fc6000b6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.277+0000 7fc606181640 1 --2- 172.21.15.81:0/2396289831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc600070dd0 0x7fc60013d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.277+0000 7fc606181640 1 -- 172.21.15.81:0/2396289831 >> 172.21.15.81:0/2396289831 conn(0x7fc6000b2f40 msgr2=0x7fc6000b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:13.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.277+0000 7fc606181640 1 -- 172.21.15.81:0/2396289831 shutdown_connections 2024-09-16T01:23:13.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.277+0000 7fc606181640 1 -- 172.21.15.81:0/2396289831 wait complete. 2024-09-16T01:23:13.289 INFO:tasks.cephfs_test_runner:test_client_pin_mincaps (tasks.cephfs.test_client_limits.TestClientLimits) ... ok 2024-09-16T01:23:13.289 INFO:tasks.cephfs_test_runner:Starting test: test_client_pin_root (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-16T01:23:13.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:23:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.385+0000 7f6150ee4640 1 Processor -- start 2024-09-16T01:23:13.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.385+0000 7f6150ee4640 1 -- start start 2024-09-16T01:23:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.386+0000 7f6150ee4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f614c0b69d0 0x7f614c162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.386+0000 7f6150ee4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0af280 0x7f614c0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.386+0000 7f6150ee4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614c15eb60 con 0x7f614c0affb0 2024-09-16T01:23:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.386+0000 7f6150ee4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f614c0b6db0 con 0x7f614c0b69d0 2024-09-16T01:23:13.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.386+0000 7f6150ee4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f614c15ee40 con 0x7f614c0af280 2024-09-16T01:23:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.386+0000 7f614a59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f614c0b69d0 0x7f614c162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.387+0000 7f6149d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0af280 0x7f614c0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.387+0000 7f614a59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f614c0b69d0 0x7f614c162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:43786/0 (socket says 172.21.15.81:43786) 2024-09-16T01:23:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.387+0000 7f614a59c640 1 -- 172.21.15.81:0/3328268540 learned_addr learned my addr 172.21.15.81:0/3328268540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.387+0000 7f614a59c640 1 -- 172.21.15.81:0/3328268540 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0af280 msgr2=0x7f614c0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.387+0000 7f614a59c640 1 --2- 172.21.15.81:0/3328268540 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0af280 0x7f614c0afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.387+0000 7f614a59c640 1 -- 172.21.15.81:0/3328268540 >> v1:172.21.15.102:6789/0 conn(0x7f614c0affb0 legacy=0x7f614c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.387+0000 7f614a59c640 1 -- 172.21.15.81:0/3328268540 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c15f120 con 0x7f614c0b69d0 2024-09-16T01:23:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.388+0000 7f614a59c640 1 --2- 172.21.15.81:0/3328268540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c0b69d0 0x7f614c162a50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f613c009e80 tx=0x7f613c02a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f5f01b30f566ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.388+0000 7f614959a640 1 -- 172.21.15.81:0/3328268540 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c036070 con 0x7f614c0b69d0 2024-09-16T01:23:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.388+0000 7f614959a640 1 -- 172.21.15.81:0/3328268540 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f613c031600 con 0x7f614c0b69d0 2024-09-16T01:23:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.388+0000 7f614959a640 1 -- 172.21.15.81:0/3328268540 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c0319d0 con 0x7f614c0b69d0 2024-09-16T01:23:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.388+0000 7f6150ee4640 1 -- 172.21.15.81:0/3328268540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c0b69d0 msgr2=0x7f614c162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.388+0000 7f6150ee4640 1 --2- 172.21.15.81:0/3328268540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c0b69d0 0x7f614c162a50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f613c009e80 tx=0x7f613c02a630 comp rx=0 tx=0).stop 2024-09-16T01:23:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.388+0000 7f6150ee4640 1 -- 172.21.15.81:0/3328268540 shutdown_connections 2024-09-16T01:23:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.388+0000 7f6150ee4640 1 --2- 172.21.15.81:0/3328268540 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0af280 0x7f614c0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.388+0000 7f6150ee4640 1 --2- 172.21.15.81:0/3328268540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c0b69d0 0x7f614c162a50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.388+0000 7f6150ee4640 1 -- 172.21.15.81:0/3328268540 >> 172.21.15.81:0/3328268540 conn(0x7f614c06bc10 msgr2=0x7f614c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.388+0000 7f6150ee4640 1 -- 172.21.15.81:0/3328268540 shutdown_connections 2024-09-16T01:23:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.389+0000 7f6150ee4640 1 -- 172.21.15.81:0/3328268540 wait complete. 2024-09-16T01:23:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.390+0000 7f6150ee4640 1 Processor -- start 2024-09-16T01:23:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.390+0000 7f6150ee4640 1 -- start start 2024-09-16T01:23:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.390+0000 7f6150ee4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0af280 0x7f614c1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f6150ee4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c0affb0 0x7f614c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f6150ee4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f614c0b69d0 0x7f614c0cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f6150ee4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f614c155410 con 0x7f614c0b69d0 2024-09-16T01:23:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f6150ee4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f614c0af6e0 con 0x7f614c0affb0 2024-09-16T01:23:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f6150ee4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f614c155590 con 0x7f614c0af280 2024-09-16T01:23:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f614ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f614c0b69d0 0x7f614c0cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f614ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f614c0b69d0 0x7f614c0cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43910/0 (socket says 172.21.15.81:43910) 2024-09-16T01:23:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f614ad9d640 1 -- 172.21.15.81:0/3634107482 learned_addr learned my addr 172.21.15.81:0/3634107482 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f6149d9b640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c0affb0 0x7f614c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f614a59c640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0af280 0x7f614c1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f614ad9d640 1 -- 172.21.15.81:0/3634107482 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0af280 msgr2=0x7f614c1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f614ad9d640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0af280 0x7f614c1537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f614ad9d640 1 -- 172.21.15.81:0/3634107482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c0affb0 msgr2=0x7f614c159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f614ad9d640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c0affb0 0x7f614c159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f614ad9d640 1 -- 172.21.15.81:0/3634107482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c15aef0 con 0x7f614c0b69d0 2024-09-16T01:23:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f614ad9d640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f614c0b69d0 0x7f614c0cf430 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f614400c3f0 tx=0x7f614400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f6142ffd640 1 -- 172.21.15.81:0/3634107482 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61440052d0 con 0x7f614c0b69d0 2024-09-16T01:23:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f6142ffd640 1 -- 172.21.15.81:0/3634107482 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6144005490 con 0x7f614c0b69d0 2024-09-16T01:23:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f6150ee4640 1 -- 172.21.15.81:0/3634107482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614c15a2e0 con 0x7f614c0b69d0 2024-09-16T01:23:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f6142ffd640 1 -- 172.21.15.81:0/3634107482 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6144007260 con 0x7f614c0b69d0 2024-09-16T01:23:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.391+0000 7f6150ee4640 1 -- 172.21.15.81:0/3634107482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614c15a8a0 con 0x7f614c0b69d0 2024-09-16T01:23:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.392+0000 7f6150ee4640 1 -- 172.21.15.81:0/3634107482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614c06f430 con 0x7f614c0b69d0 2024-09-16T01:23:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.393+0000 7f6142ffd640 1 -- 172.21.15.81:0/3634107482 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6144007400 con 0x7f614c0b69d0 2024-09-16T01:23:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.393+0000 7f6142ffd640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f612c06c2b0 0x7f612c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.393+0000 7f6142ffd640 1 -- 172.21.15.81:0/3634107482 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f614408a670 con 0x7f614c0b69d0 2024-09-16T01:23:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.393+0000 7f614a59c640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f612c06c2b0 0x7f612c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.394+0000 7f614a59c640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f612c06c2b0 0x7f612c06e770 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f613c033000 tx=0x7f613c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:13.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.398+0000 7f6142ffd640 1 -- 172.21.15.81:0/3634107482 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6144058990 con 0x7f614c0b69d0 2024-09-16T01:23:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.562+0000 7f6150ee4640 1 -- 172.21.15.81:0/3634107482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f614c0ae290 con 0x7f614c0b69d0 2024-09-16T01:23:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.563+0000 7f6142ffd640 1 -- 172.21.15.81:0/3634107482 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+13315 (secure 0 0 0) 0x7f614405de20 con 0x7f614c0b69d0 2024-09-16T01:23:13.565 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:13.565 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":128,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:23:11.262243+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/2398957156":"2024-09-17T01:23:08.217397+0000","172.21.15.81:6834/2398957156":"2024-09-17T01:23:08.217397+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:23:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.565+0000 7f6150ee4640 1 -- 172.21.15.81:0/3634107482 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f612c06c2b0 msgr2=0x7f612c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.565+0000 7f6150ee4640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f612c06c2b0 0x7f612c06e770 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f613c033000 tx=0x7f613c009000 comp rx=0 tx=0).stop 2024-09-16T01:23:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.565+0000 7f6150ee4640 1 -- 172.21.15.81:0/3634107482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f614c0b69d0 msgr2=0x7f614c0cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.565+0000 7f6150ee4640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f614c0b69d0 0x7f614c0cf430 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f614400c3f0 tx=0x7f614400c8b0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.566+0000 7f6150ee4640 1 -- 172.21.15.81:0/3634107482 shutdown_connections 2024-09-16T01:23:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.566+0000 7f6150ee4640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f612c06c2b0 0x7f612c06e770 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.566+0000 7f6150ee4640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f614c0b69d0 0x7f614c0cf430 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.566+0000 7f6150ee4640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f614c0affb0 0x7f614c159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.566+0000 7f6150ee4640 1 --2- 172.21.15.81:0/3634107482 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f614c0af280 0x7f614c1537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.566+0000 7f6150ee4640 1 -- 172.21.15.81:0/3634107482 >> 172.21.15.81:0/3634107482 conn(0x7f614c06bc10 msgr2=0x7f614c154460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.566+0000 7f6150ee4640 1 -- 172.21.15.81:0/3634107482 shutdown_connections 2024-09-16T01:23:13.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.566+0000 7f6150ee4640 1 -- 172.21.15.81:0/3634107482 wait complete. 2024-09-16T01:23:13.579 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:15:28.088452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:23:13.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:23:13.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.678+0000 7faf4884c640 1 Processor -- start 2024-09-16T01:23:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.678+0000 7faf4884c640 1 -- start start 2024-09-16T01:23:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.678+0000 7faf4884c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7faf4415b570 0x7faf44071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.678+0000 7faf4884c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf440cd120 0x7faf4415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.678+0000 7faf4884c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf44073b20 con 0x7faf4415b950 2024-09-16T01:23:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.678+0000 7faf4884c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7faf440740e0 con 0x7faf440cd120 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.678+0000 7faf4884c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7faf44073e00 con 0x7faf4415b570 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.678+0000 7faf42d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf440cd120 0x7faf4415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.679+0000 7faf42d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf440cd120 0x7faf4415e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43912/0 (socket says 172.21.15.81:43912) 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.679+0000 7faf42d9d640 1 -- 172.21.15.81:0/3373574992 learned_addr learned my addr 172.21.15.81:0/3373574992 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.679+0000 7faf4259c640 1 --2- 172.21.15.81:0/3373574992 >> v2:172.21.15.102:3300/0 conn(0x7faf4415b570 0x7faf44071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.679+0000 7faf42d9d640 1 -- 172.21.15.81:0/3373574992 >> v2:172.21.15.102:3300/0 conn(0x7faf4415b570 msgr2=0x7faf44071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.679+0000 7faf42d9d640 1 --2- 172.21.15.81:0/3373574992 >> v2:172.21.15.102:3300/0 conn(0x7faf4415b570 0x7faf44071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.679+0000 7faf42d9d640 1 -- 172.21.15.81:0/3373574992 >> v1:172.21.15.102:6789/0 conn(0x7faf4415b950 legacy=0x7faf440cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.679+0000 7faf42d9d640 1 -- 172.21.15.81:0/3373574992 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf440cf320 con 0x7faf440cd120 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.679+0000 7faf42d9d640 1 --2- 172.21.15.81:0/3373574992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf440cd120 0x7faf4415e4e0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7faf440b1cd0 tx=0x7faf3c02c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ce84284753f7b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.680+0000 7faf41d9b640 1 -- 172.21.15.81:0/3373574992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c03b070 con 0x7faf440cd120 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.680+0000 7faf41d9b640 1 -- 172.21.15.81:0/3373574992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c036620 con 0x7faf440cd120 2024-09-16T01:23:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.680+0000 7faf41d9b640 1 -- 172.21.15.81:0/3373574992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0369f0 con 0x7faf440cd120 2024-09-16T01:23:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.680+0000 7faf4884c640 1 -- 172.21.15.81:0/3373574992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf440cd120 msgr2=0x7faf4415e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.680+0000 7faf4884c640 1 --2- 172.21.15.81:0/3373574992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf440cd120 0x7faf4415e4e0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7faf440b1cd0 tx=0x7faf3c02c860 comp rx=0 tx=0).stop 2024-09-16T01:23:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.680+0000 7faf4884c640 1 -- 172.21.15.81:0/3373574992 shutdown_connections 2024-09-16T01:23:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.680+0000 7faf4884c640 1 --2- 172.21.15.81:0/3373574992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf440cd120 0x7faf4415e4e0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.680+0000 7faf4884c640 1 --2- 172.21.15.81:0/3373574992 >> v2:172.21.15.102:3300/0 conn(0x7faf4415b570 0x7faf44071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.680+0000 7faf4884c640 1 -- 172.21.15.81:0/3373574992 >> 172.21.15.81:0/3373574992 conn(0x7faf4406bdf0 msgr2=0x7faf4406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.680+0000 7faf4884c640 1 -- 172.21.15.81:0/3373574992 shutdown_connections 2024-09-16T01:23:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.680+0000 7faf4884c640 1 -- 172.21.15.81:0/3373574992 wait complete. 2024-09-16T01:23:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.682+0000 7faf4884c640 1 Processor -- start 2024-09-16T01:23:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.682+0000 7faf4884c640 1 -- start start 2024-09-16T01:23:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.682+0000 7faf4884c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf440cd120 0x7faf4414d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.682+0000 7faf4884c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf4415b570 0x7faf4406f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.682+0000 7faf4884c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf4415b950 0x7faf4406fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.682+0000 7faf4884c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faf440cf840 con 0x7faf440cd120 2024-09-16T01:23:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.682+0000 7faf4884c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faf44072450 con 0x7faf4415b950 2024-09-16T01:23:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.682+0000 7faf4884c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7faf440cf9c0 con 0x7faf4415b570 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.682+0000 7faf4259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf440cd120 0x7faf4414d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.682+0000 7faf4259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf440cd120 0x7faf4414d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43928/0 (socket says 172.21.15.81:43928) 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.682+0000 7faf4259c640 1 -- 172.21.15.81:0/479347183 learned_addr learned my addr 172.21.15.81:0/479347183 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf3bfff640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf4415b570 0x7faf4406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf42d9d640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf4415b950 0x7faf4406fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf4259c640 1 -- 172.21.15.81:0/479347183 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf4415b570 msgr2=0x7faf4406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf4259c640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf4415b570 0x7faf4406f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf4259c640 1 -- 172.21.15.81:0/479347183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf4415b950 msgr2=0x7faf4406fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf4259c640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf4415b950 0x7faf4406fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf4259c640 1 -- 172.21.15.81:0/479347183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf440ad020 con 0x7faf440cd120 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf4259c640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf440cd120 0x7faf4414d2a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7faf3400d800 tx=0x7faf3400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf3affd640 1 -- 172.21.15.81:0/479347183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3400b660 con 0x7faf440cd120 2024-09-16T01:23:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf3affd640 1 -- 172.21.15.81:0/479347183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf34019070 con 0x7faf440cd120 2024-09-16T01:23:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf4884c640 1 -- 172.21.15.81:0/479347183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf441f34e0 con 0x7faf440cd120 2024-09-16T01:23:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf3affd640 1 -- 172.21.15.81:0/479347183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3400ba20 con 0x7faf440cd120 2024-09-16T01:23:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.683+0000 7faf4884c640 1 -- 172.21.15.81:0/479347183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf441f3a60 con 0x7faf440cd120 2024-09-16T01:23:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.684+0000 7faf4884c640 1 -- 172.21.15.81:0/479347183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf44071e40 con 0x7faf440cd120 2024-09-16T01:23:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.685+0000 7faf3affd640 1 -- 172.21.15.81:0/479347183 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faf3400bbc0 con 0x7faf440cd120 2024-09-16T01:23:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.685+0000 7faf3affd640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faf2406c2b0 0x7faf2406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.685+0000 7faf3bfff640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faf2406c2b0 0x7faf2406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.685+0000 7faf3affd640 1 -- 172.21.15.81:0/479347183 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7faf3408b750 con 0x7faf440cd120 2024-09-16T01:23:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.686+0000 7faf3bfff640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faf2406c2b0 0x7faf2406e770 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7faf4409e470 tx=0x7faf2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.690+0000 7faf3affd640 1 -- 172.21.15.81:0/479347183 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf3401c360 con 0x7faf440cd120 2024-09-16T01:23:13.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.855+0000 7faf4884c640 1 -- 172.21.15.81:0/479347183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faf440b4590 con 0x7faf440cd120 2024-09-16T01:23:13.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.856+0000 7faf3affd640 1 -- 172.21.15.81:0/479347183 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v128) ==== 93+0+10 (secure 0 0 0) 0x7faf3405a030 con 0x7faf440cd120 2024-09-16T01:23:13.858 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-16T01:23:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.858+0000 7faf4884c640 1 -- 172.21.15.81:0/479347183 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faf2406c2b0 msgr2=0x7faf2406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.858+0000 7faf4884c640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faf2406c2b0 0x7faf2406e770 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7faf4409e470 tx=0x7faf2c009040 comp rx=0 tx=0).stop 2024-09-16T01:23:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.858+0000 7faf4884c640 1 -- 172.21.15.81:0/479347183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf440cd120 msgr2=0x7faf4414d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.858+0000 7faf4884c640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf440cd120 0x7faf4414d2a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7faf3400d800 tx=0x7faf3400dcc0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.858+0000 7faf4884c640 1 -- 172.21.15.81:0/479347183 shutdown_connections 2024-09-16T01:23:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.858+0000 7faf4884c640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faf2406c2b0 0x7faf2406e770 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.858+0000 7faf4884c640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf4415b950 0x7faf4406fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.858+0000 7faf4884c640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf4415b570 0x7faf4406f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.858+0000 7faf4884c640 1 --2- 172.21.15.81:0/479347183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf440cd120 0x7faf4414d2a0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.858+0000 7faf4884c640 1 -- 172.21.15.81:0/479347183 >> 172.21.15.81:0/479347183 conn(0x7faf4406bdf0 msgr2=0x7faf441581e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:13.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.858+0000 7faf4884c640 1 -- 172.21.15.81:0/479347183 shutdown_connections 2024-09-16T01:23:13.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.858+0000 7faf4884c640 1 -- 172.21.15.81:0/479347183 wait complete. 2024-09-16T01:23:13.870 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root' 2024-09-16T01:23:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.966+0000 7fa7324e4640 1 Processor -- start 2024-09-16T01:23:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.966+0000 7fa7324e4640 1 -- start start 2024-09-16T01:23:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.967+0000 7fa7324e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa72c15fc30 0x7fa72c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.967+0000 7fa7324e4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa72c0b17d0 0x7fa72c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.967+0000 7fa7324e4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa72c09ba30 con 0x7fa72c09af70 2024-09-16T01:23:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.967+0000 7fa7324e4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa72c0b1590 con 0x7fa72c15fc30 2024-09-16T01:23:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.967+0000 7fa7324e4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa72c09b3c0 con 0x7fa72c0b17d0 2024-09-16T01:23:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.967+0000 7fa72bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa72c15fc30 0x7fa72c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.967+0000 7fa72bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa72c15fc30 0x7fa72c071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43944/0 (socket says 172.21.15.81:43944) 2024-09-16T01:23:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.967+0000 7fa72bfff640 1 -- 172.21.15.81:0/1399178057 learned_addr learned my addr 172.21.15.81:0/1399178057 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.968+0000 7fa72b7fe640 1 --2- 172.21.15.81:0/1399178057 >> v2:172.21.15.102:3300/0 conn(0x7fa72c0b17d0 0x7fa72c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.968+0000 7fa72bfff640 1 -- 172.21.15.81:0/1399178057 >> v2:172.21.15.102:3300/0 conn(0x7fa72c0b17d0 msgr2=0x7fa72c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.968+0000 7fa72bfff640 1 --2- 172.21.15.81:0/1399178057 >> v2:172.21.15.102:3300/0 conn(0x7fa72c0b17d0 0x7fa72c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.968+0000 7fa72bfff640 1 -- 172.21.15.81:0/1399178057 >> v1:172.21.15.102:6789/0 conn(0x7fa72c09af70 legacy=0x7fa72c0d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:13.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.968+0000 7fa72bfff640 1 -- 172.21.15.81:0/1399178057 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72c09bcf0 con 0x7fa72c15fc30 2024-09-16T01:23:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.968+0000 7fa72bfff640 1 --2- 172.21.15.81:0/1399178057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c15fc30 0x7fa72c071e40 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fa72c06cbf0 tx=0x7fa71c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cc5e49b7569aa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.968+0000 7fa72affd640 1 -- 172.21.15.81:0/1399178057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c037070 con 0x7fa72c15fc30 2024-09-16T01:23:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.969+0000 7fa72affd640 1 -- 172.21.15.81:0/1399178057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71c032440 con 0x7fa72c15fc30 2024-09-16T01:23:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.969+0000 7fa72affd640 1 -- 172.21.15.81:0/1399178057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c032810 con 0x7fa72c15fc30 2024-09-16T01:23:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.969+0000 7fa7324e4640 1 -- 172.21.15.81:0/1399178057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c15fc30 msgr2=0x7fa72c071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.969+0000 7fa7324e4640 1 --2- 172.21.15.81:0/1399178057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c15fc30 0x7fa72c071e40 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fa72c06cbf0 tx=0x7fa71c02a1a0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.969+0000 7fa7324e4640 1 -- 172.21.15.81:0/1399178057 shutdown_connections 2024-09-16T01:23:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.969+0000 7fa7324e4640 1 --2- 172.21.15.81:0/1399178057 >> v2:172.21.15.102:3300/0 conn(0x7fa72c0b17d0 0x7fa72c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.969+0000 7fa7324e4640 1 --2- 172.21.15.81:0/1399178057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c15fc30 0x7fa72c071e40 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.969+0000 7fa7324e4640 1 -- 172.21.15.81:0/1399178057 >> 172.21.15.81:0/1399178057 conn(0x7fa72c0d23a0 msgr2=0x7fa72c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:13.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.969+0000 7fa7324e4640 1 -- 172.21.15.81:0/1399178057 shutdown_connections 2024-09-16T01:23:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.969+0000 7fa7324e4640 1 -- 172.21.15.81:0/1399178057 wait complete. 2024-09-16T01:23:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.970+0000 7fa7324e4640 1 Processor -- start 2024-09-16T01:23:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.970+0000 7fa7324e4640 1 -- start start 2024-09-16T01:23:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.971+0000 7fa7324e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c09af70 0x7fa72c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.971+0000 7fa7324e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa72c0b17d0 0x7fa72c0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.971+0000 7fa7324e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c15fc30 0x7fa72c0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.971+0000 7fa7324e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c160fe0 con 0x7fa72c09af70 2024-09-16T01:23:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.971+0000 7fa7324e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c160ab0 con 0x7fa72c15fc30 2024-09-16T01:23:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.971+0000 7fa7324e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa72c0b1bd0 con 0x7fa72c0b17d0 2024-09-16T01:23:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.971+0000 7fa72bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c09af70 0x7fa72c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.971+0000 7fa72bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c09af70 0x7fa72c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43956/0 (socket says 172.21.15.81:43956) 2024-09-16T01:23:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.971+0000 7fa72bfff640 1 -- 172.21.15.81:0/1695822644 learned_addr learned my addr 172.21.15.81:0/1695822644 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.971+0000 7fa730a81640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c15fc30 0x7fa72c0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.971+0000 7fa72b7fe640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa72c0b17d0 0x7fa72c0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.971+0000 7fa72bfff640 1 -- 172.21.15.81:0/1695822644 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa72c0b17d0 msgr2=0x7fa72c0c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.972+0000 7fa72bfff640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa72c0b17d0 0x7fa72c0c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.972+0000 7fa72bfff640 1 -- 172.21.15.81:0/1695822644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c15fc30 msgr2=0x7fa72c0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.972+0000 7fa72bfff640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c15fc30 0x7fa72c0c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.972+0000 7fa72bfff640 1 -- 172.21.15.81:0/1695822644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72c06d6e0 con 0x7fa72c09af70 2024-09-16T01:23:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.972+0000 7fa730a81640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c15fc30 0x7fa72c0c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.972+0000 7fa72bfff640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c09af70 0x7fa72c06cd20 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fa71c000c00 tx=0x7fa71c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.972+0000 7fa728ff9640 1 -- 172.21.15.81:0/1695822644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c041020 con 0x7fa72c09af70 2024-09-16T01:23:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.972+0000 7fa728ff9640 1 -- 172.21.15.81:0/1695822644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71c0306c0 con 0x7fa72c09af70 2024-09-16T01:23:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.972+0000 7fa7324e4640 1 -- 172.21.15.81:0/1695822644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa72c06d9c0 con 0x7fa72c09af70 2024-09-16T01:23:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.972+0000 7fa728ff9640 1 -- 172.21.15.81:0/1695822644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c037040 con 0x7fa72c09af70 2024-09-16T01:23:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.972+0000 7fa7324e4640 1 -- 172.21.15.81:0/1695822644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa72c06df80 con 0x7fa72c09af70 2024-09-16T01:23:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.973+0000 7fa7324e4640 1 -- 172.21.15.81:0/1695822644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa72c09aa30 con 0x7fa72c09af70 2024-09-16T01:23:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.973+0000 7fa728ff9640 1 -- 172.21.15.81:0/1695822644 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa71c044020 con 0x7fa72c09af70 2024-09-16T01:23:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.974+0000 7fa728ff9640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa71806c2b0 0x7fa71806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.974+0000 7fa72b7fe640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa71806c2b0 0x7fa71806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.974+0000 7fa728ff9640 1 -- 172.21.15.81:0/1695822644 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7fa71c0ab9f0 con 0x7fa72c09af70 2024-09-16T01:23:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.974+0000 7fa72b7fe640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa71806c2b0 0x7fa71806e770 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0c6180 tx=0x7fa720008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:13.978+0000 7fa728ff9640 1 -- 172.21.15.81:0/1695822644 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa71c04b030 con 0x7fa72c09af70 2024-09-16T01:23:14.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.209+0000 7fa7324e4640 1 -- 172.21.15.81:0/1695822644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]} v 0) -- 0x7fa72c1e6150 con 0x7fa72c09af70 2024-09-16T01:23:14.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.280+0000 7fa728ff9640 1 -- 172.21.15.81:0/1695822644 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]}]=0 v383) ==== 151+0+0 (secure 0 0 0) 0x7fa71c07a360 con 0x7fa72c09af70 2024-09-16T01:23:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.283+0000 7fa7324e4640 1 -- 172.21.15.81:0/1695822644 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa71806c2b0 msgr2=0x7fa71806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.283+0000 7fa7324e4640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa71806c2b0 0x7fa71806e770 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0c6180 tx=0x7fa720008040 comp rx=0 tx=0).stop 2024-09-16T01:23:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.283+0000 7fa7324e4640 1 -- 172.21.15.81:0/1695822644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c09af70 msgr2=0x7fa72c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.283+0000 7fa7324e4640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c09af70 0x7fa72c06cd20 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fa71c000c00 tx=0x7fa71c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.283+0000 7fa7324e4640 1 -- 172.21.15.81:0/1695822644 shutdown_connections 2024-09-16T01:23:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.283+0000 7fa7324e4640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa71806c2b0 0x7fa71806e770 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.283+0000 7fa7324e4640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa72c15fc30 0x7fa72c0c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.283+0000 7fa7324e4640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa72c0b17d0 0x7fa72c0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.283+0000 7fa7324e4640 1 --2- 172.21.15.81:0/1695822644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa72c09af70 0x7fa72c06cd20 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.283+0000 7fa7324e4640 1 -- 172.21.15.81:0/1695822644 >> 172.21.15.81:0/1695822644 conn(0x7fa72c0d23a0 msgr2=0x7fa72c0cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.283+0000 7fa7324e4640 1 -- 172.21.15.81:0/1695822644 shutdown_connections 2024-09-16T01:23:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.283+0000 7fa7324e4640 1 -- 172.21.15.81:0/1695822644 wait complete. 2024-09-16T01:23:14.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T01:23:14.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.394+0000 7fa9134af640 1 Processor -- start 2024-09-16T01:23:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.395+0000 7fa9134af640 1 -- start start 2024-09-16T01:23:14.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.395+0000 7fa9134af640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa90c15e410 0x7fa90c0b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.395+0000 7fa9134af640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa90c0b40c0 0x7fa90c0aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.395+0000 7fa9134af640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa90c0ae240 con 0x7fa90c06bc10 2024-09-16T01:23:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.395+0000 7fa9134af640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa90c0ae520 con 0x7fa90c0b40c0 2024-09-16T01:23:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.395+0000 7fa9134af640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa90c0ae800 con 0x7fa90c15e410 2024-09-16T01:23:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.396+0000 7fa910a4a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa90c0b40c0 0x7fa90c0aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.396+0000 7fa911a4c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa90c06bc10 0x7fa90c0aefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58926/0 (socket says 172.21.15.81:58926) 2024-09-16T01:23:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.396+0000 7fa911a4c640 1 -- 172.21.15.81:0/3059449111 learned_addr learned my addr 172.21.15.81:0/3059449111 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.396+0000 7fa910a4a640 1 --2- 172.21.15.81:0/3059449111 >> v2:172.21.15.81:3300/0 conn(0x7fa90c0b40c0 0x7fa90c0aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43972/0 (socket says 172.21.15.81:43972) 2024-09-16T01:23:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.396+0000 7fa910a4a640 1 -- 172.21.15.81:0/3059449111 >> v2:172.21.15.102:3300/0 conn(0x7fa90c15e410 msgr2=0x7fa90c0b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:14.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.396+0000 7fa91124b640 1 --2- 172.21.15.81:0/3059449111 >> v2:172.21.15.102:3300/0 conn(0x7fa90c15e410 0x7fa90c0b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.396+0000 7fa910a4a640 1 --2- 172.21.15.81:0/3059449111 >> v2:172.21.15.102:3300/0 conn(0x7fa90c15e410 0x7fa90c0b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.396+0000 7fa910a4a640 1 -- 172.21.15.81:0/3059449111 >> v1:172.21.15.81:6789/0 conn(0x7fa90c06bc10 legacy=0x7fa90c0aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.396+0000 7fa8fffff640 1 -- 172.21.15.81:0/3059449111 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732308807 0 0) 0x7fa90c0ae240 con 0x7fa90c06bc10 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.396+0000 7fa910a4a640 1 -- 172.21.15.81:0/3059449111 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c0aeae0 con 0x7fa90c0b40c0 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.397+0000 7fa910a4a640 1 --2- 172.21.15.81:0/3059449111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa90c0b40c0 0x7fa90c0aff40 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0b3e10 tx=0x7fa90002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a53925160121b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.397+0000 7fa8fffff640 1 -- 172.21.15.81:0/3059449111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900037070 con 0x7fa90c0b40c0 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.397+0000 7fa8fffff640 1 -- 172.21.15.81:0/3059449111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa900032440 con 0x7fa90c0b40c0 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.397+0000 7fa8fffff640 1 -- 172.21.15.81:0/3059449111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90002ae60 con 0x7fa90c0b40c0 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.397+0000 7fa9134af640 1 -- 172.21.15.81:0/3059449111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa90c0b40c0 msgr2=0x7fa90c0aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.397+0000 7fa9134af640 1 --2- 172.21.15.81:0/3059449111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa90c0b40c0 0x7fa90c0aff40 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0b3e10 tx=0x7fa90002a110 comp rx=0 tx=0).stop 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.397+0000 7fa9134af640 1 -- 172.21.15.81:0/3059449111 shutdown_connections 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.397+0000 7fa9134af640 1 --2- 172.21.15.81:0/3059449111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa90c0b40c0 0x7fa90c0aff40 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.397+0000 7fa9134af640 1 --2- 172.21.15.81:0/3059449111 >> v2:172.21.15.102:3300/0 conn(0x7fa90c15e410 0x7fa90c0b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.397+0000 7fa9134af640 1 -- 172.21.15.81:0/3059449111 >> 172.21.15.81:0/3059449111 conn(0x7fa90c09aa30 msgr2=0x7fa90c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.397+0000 7fa9134af640 1 -- 172.21.15.81:0/3059449111 shutdown_connections 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.397+0000 7fa9134af640 1 -- 172.21.15.81:0/3059449111 wait complete. 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.399+0000 7fa9134af640 1 Processor -- start 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.399+0000 7fa9134af640 1 -- start start 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.399+0000 7fa9134af640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa90c06bc10 0x7fa90c148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.399+0000 7fa9134af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa90c0b40c0 0x7fa90c157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.399+0000 7fa9134af640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90c15e410 0x7fa90c0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.399+0000 7fa9134af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c15e7f0 con 0x7fa90c0b40c0 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.399+0000 7fa9134af640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c0b4510 con 0x7fa90c15e410 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.399+0000 7fa9134af640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa90c15e970 con 0x7fa90c06bc10 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.399+0000 7fa910a4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa90c0b40c0 0x7fa90c157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.399+0000 7fa910a4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa90c0b40c0 0x7fa90c157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43982/0 (socket says 172.21.15.81:43982) 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.399+0000 7fa910a4a640 1 -- 172.21.15.81:0/2028952072 learned_addr learned my addr 172.21.15.81:0/2028952072 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa91124b640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa90c06bc10 0x7fa90c148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa911a4c640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90c15e410 0x7fa90c0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa910a4a640 1 -- 172.21.15.81:0/2028952072 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa90c06bc10 msgr2=0x7fa90c148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa910a4a640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa90c06bc10 0x7fa90c148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa910a4a640 1 -- 172.21.15.81:0/2028952072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90c15e410 msgr2=0x7fa90c0ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa910a4a640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90c15e410 0x7fa90c0ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa910a4a640 1 -- 172.21.15.81:0/2028952072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c158310 con 0x7fa90c0b40c0 2024-09-16T01:23:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa911a4c640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90c15e410 0x7fa90c0ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa910a4a640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa90c0b40c0 0x7fa90c157a90 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fa900000c00 tx=0x7fa9000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa8fdffb640 1 -- 172.21.15.81:0/2028952072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900037040 con 0x7fa90c0b40c0 2024-09-16T01:23:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa8fdffb640 1 -- 172.21.15.81:0/2028952072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa900042070 con 0x7fa90c0b40c0 2024-09-16T01:23:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa8fdffb640 1 -- 172.21.15.81:0/2028952072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa900030a50 con 0x7fa90c0b40c0 2024-09-16T01:23:14.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa9134af640 1 -- 172.21.15.81:0/2028952072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90c1585f0 con 0x7fa90c0b40c0 2024-09-16T01:23:14.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.400+0000 7fa9134af640 1 -- 172.21.15.81:0/2028952072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa90c157fd0 con 0x7fa90c0b40c0 2024-09-16T01:23:14.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.401+0000 7fa9134af640 1 -- 172.21.15.81:0/2028952072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa90c0aff40 con 0x7fa90c0b40c0 2024-09-16T01:23:14.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.402+0000 7fa8fdffb640 1 -- 172.21.15.81:0/2028952072 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa900030bf0 con 0x7fa90c0b40c0 2024-09-16T01:23:14.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.402+0000 7fa8fdffb640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa8f006c2b0 0x7fa8f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:14.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.402+0000 7fa8fdffb640 1 -- 172.21.15.81:0/2028952072 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7fa9000abd70 con 0x7fa90c0b40c0 2024-09-16T01:23:14.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.402+0000 7fa91124b640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa8f006c2b0 0x7fa8f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:14.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.403+0000 7fa91124b640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa8f006c2b0 0x7fa8f006e770 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa90800a970 tx=0x7fa908008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:14.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.406+0000 7fa8fdffb640 1 -- 172.21.15.81:0/2028952072 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa900045360 con 0x7fa90c0b40c0 2024-09-16T01:23:14.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.574+0000 7fa9134af640 1 -- 172.21.15.81:0/2028952072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa90c158b10 con 0x7fa90c0b40c0 2024-09-16T01:23:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.577+0000 7fa8fdffb640 1 -- 172.21.15.81:0/2028952072 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v56)=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7fa90007a650 con 0x7fa90c0b40c0 2024-09-16T01:23:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.579+0000 7fa9134af640 1 -- 172.21.15.81:0/2028952072 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa8f006c2b0 msgr2=0x7fa8f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.579+0000 7fa9134af640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa8f006c2b0 0x7fa8f006e770 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa90800a970 tx=0x7fa908008040 comp rx=0 tx=0).stop 2024-09-16T01:23:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.579+0000 7fa9134af640 1 -- 172.21.15.81:0/2028952072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa90c0b40c0 msgr2=0x7fa90c157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.579+0000 7fa9134af640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa90c0b40c0 0x7fa90c157a90 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fa900000c00 tx=0x7fa9000046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.579+0000 7fa9134af640 1 -- 172.21.15.81:0/2028952072 shutdown_connections 2024-09-16T01:23:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.579+0000 7fa9134af640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa8f006c2b0 0x7fa8f006e770 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.579+0000 7fa9134af640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa90c15e410 0x7fa90c0ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.579+0000 7fa9134af640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa90c0b40c0 0x7fa90c157a90 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.579+0000 7fa9134af640 1 --2- 172.21.15.81:0/2028952072 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa90c06bc10 0x7fa90c148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.579+0000 7fa9134af640 1 -- 172.21.15.81:0/2028952072 >> 172.21.15.81:0/2028952072 conn(0x7fa90c09aa30 msgr2=0x7fa90c0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.580+0000 7fa9134af640 1 -- 172.21.15.81:0/2028952072 shutdown_connections 2024-09-16T01:23:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.580+0000 7fa9134af640 1 -- 172.21.15.81:0/2028952072 wait complete. 2024-09-16T01:23:14.592 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:23:14.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:23:14.636 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:23:14.679 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:23:14.679 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:14.679 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:14.696 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:23:14.696 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:23:14.696 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:14.738 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:23:14.738 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:14.738 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:14.754 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:23:14.754 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:23:14.754 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:14.796 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:23:14.796 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T01:23:14.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:14.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.893+0000 7f9016af8640 1 Processor -- start 2024-09-16T01:23:14.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.893+0000 7f9016af8640 1 -- start start 2024-09-16T01:23:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f9016af8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90100afd70 0x7f9010160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f9016af8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90100cd650 0x7f90100cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f9016af8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9010160d60 con 0x7f90100b5f80 2024-09-16T01:23:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f9016af8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f901006fdb0 con 0x7f90100cd650 2024-09-16T01:23:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f9016af8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9010070090 con 0x7f90100afd70 2024-09-16T01:23:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f9015095640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f90100cd650 0x7f90100cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f900ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f90100b5f80 0x7f90100b63a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58932/0 (socket says 172.21.15.81:58932) 2024-09-16T01:23:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f900ffff640 1 -- 172.21.15.81:0/4106690058 learned_addr learned my addr 172.21.15.81:0/4106690058 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f9015095640 1 --2- 172.21.15.81:0/4106690058 >> v2:172.21.15.81:3300/0 conn(0x7f90100cd650 0x7f90100cdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43990/0 (socket says 172.21.15.81:43990) 2024-09-16T01:23:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f9014894640 1 --2- 172.21.15.81:0/4106690058 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90100afd70 0x7f9010160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f9015095640 1 -- 172.21.15.81:0/4106690058 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90100afd70 msgr2=0x7f9010160820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f9015095640 1 --2- 172.21.15.81:0/4106690058 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90100afd70 0x7f9010160820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f9015095640 1 -- 172.21.15.81:0/4106690058 >> v1:172.21.15.81:6789/0 conn(0x7f90100b5f80 legacy=0x7f90100b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.895+0000 7f9015095640 1 -- 172.21.15.81:0/4106690058 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9010070370 con 0x7f90100cd650 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.894+0000 7f900f7fe640 1 -- 172.21.15.81:0/4106690058 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3956301732 0 0) 0x7f9004001110 con 0x7f90100b5f80 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.895+0000 7f9015095640 1 --2- 172.21.15.81:0/4106690058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90100cd650 0x7f90100cdad0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f9008009d90 tx=0x7f900802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6385a1b5a6624d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.895+0000 7f900f7fe640 1 -- 172.21.15.81:0/4106690058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9008007740 con 0x7f90100cd650 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.895+0000 7f900f7fe640 1 -- 172.21.15.81:0/4106690058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90080078e0 con 0x7f90100cd650 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.895+0000 7f900f7fe640 1 -- 172.21.15.81:0/4106690058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9008007cb0 con 0x7f90100cd650 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.896+0000 7f9016af8640 1 -- 172.21.15.81:0/4106690058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90100cd650 msgr2=0x7f90100cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.896+0000 7f9016af8640 1 --2- 172.21.15.81:0/4106690058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90100cd650 0x7f90100cdad0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f9008009d90 tx=0x7f900802a660 comp rx=0 tx=0).stop 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.896+0000 7f9016af8640 1 -- 172.21.15.81:0/4106690058 shutdown_connections 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.896+0000 7f9016af8640 1 --2- 172.21.15.81:0/4106690058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90100cd650 0x7f90100cdad0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.896+0000 7f9016af8640 1 --2- 172.21.15.81:0/4106690058 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90100afd70 0x7f9010160820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.896+0000 7f9016af8640 1 -- 172.21.15.81:0/4106690058 >> 172.21.15.81:0/4106690058 conn(0x7f901006bc10 msgr2=0x7f901006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.896+0000 7f9016af8640 1 -- 172.21.15.81:0/4106690058 shutdown_connections 2024-09-16T01:23:14.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.896+0000 7f9016af8640 1 -- 172.21.15.81:0/4106690058 wait complete. 2024-09-16T01:23:14.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.897+0000 7f9016af8640 1 Processor -- start 2024-09-16T01:23:14.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.897+0000 7f9016af8640 1 -- start start 2024-09-16T01:23:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9016af8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90100afd70 0x7f901014bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9016af8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90100b5f80 0x7f90101f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9016af8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90100cd650 0x7f90101545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9016af8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90100b0150 con 0x7f90100afd70 2024-09-16T01:23:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9016af8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f901006fa80 con 0x7f90100cd650 2024-09-16T01:23:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9016af8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9010160060 con 0x7f90100b5f80 2024-09-16T01:23:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9014894640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90100afd70 0x7f901014bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9014894640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90100afd70 0x7f901014bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43992/0 (socket says 172.21.15.81:43992) 2024-09-16T01:23:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9014894640 1 -- 172.21.15.81:0/3023245533 learned_addr learned my addr 172.21.15.81:0/3023245533 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f900ffff640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90100b5f80 0x7f90101f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9014894640 1 -- 172.21.15.81:0/3023245533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90100b5f80 msgr2=0x7f90101f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9015095640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90100cd650 0x7f90101545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9014894640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90100b5f80 0x7f90101f5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9014894640 1 -- 172.21.15.81:0/3023245533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90100cd650 msgr2=0x7f90101545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9014894640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90100cd650 0x7f90101545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f9014894640 1 -- 172.21.15.81:0/3023245533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9010156ee0 con 0x7f90100afd70 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.898+0000 7f900ffff640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90100b5f80 0x7f90101f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.899+0000 7f9014894640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90100afd70 0x7f901014bee0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f900000d800 tx=0x7f900000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.899+0000 7f900d7fa640 1 -- 172.21.15.81:0/3023245533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900000b6c0 con 0x7f90100afd70 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.899+0000 7f900d7fa640 1 -- 172.21.15.81:0/3023245533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9000019070 con 0x7f90100afd70 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.899+0000 7f900d7fa640 1 -- 172.21.15.81:0/3023245533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900000ba80 con 0x7f90100afd70 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.899+0000 7f9016af8640 1 -- 172.21.15.81:0/3023245533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90101571c0 con 0x7f90100afd70 2024-09-16T01:23:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.899+0000 7f9016af8640 1 -- 172.21.15.81:0/3023245533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9010157780 con 0x7f90100afd70 2024-09-16T01:23:14.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.900+0000 7f9016af8640 1 -- 172.21.15.81:0/3023245533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9010160820 con 0x7f90100afd70 2024-09-16T01:23:14.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.900+0000 7f900d7fa640 1 -- 172.21.15.81:0/3023245533 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f900000bc20 con 0x7f90100afd70 2024-09-16T01:23:14.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.901+0000 7f900d7fa640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ffc06c2b0 0x7f8ffc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:14.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.901+0000 7f900ffff640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ffc06c2b0 0x7f8ffc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:14.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.901+0000 7f900d7fa640 1 -- 172.21.15.81:0/3023245533 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5335+0+0 (secure 0 0 0) 0x7f900008b7f0 con 0x7f90100afd70 2024-09-16T01:23:14.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.901+0000 7f900ffff640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ffc06c2b0 0x7f8ffc06e770 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f90101553a0 tx=0x7f9004009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:14.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:14.905+0000 7f900d7fa640 1 -- 172.21.15.81:0/3023245533 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f900005a050 con 0x7f90100afd70 2024-09-16T01:23:15.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.105+0000 7f9016af8640 1 -- 172.21.15.81:0/3023245533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9010067fc0 con 0x7f90100afd70 2024-09-16T01:23:15.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.105+0000 7f900d7fa640 1 -- 172.21.15.81:0/3023245533 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+3914 (secure 0 0 0) 0x7f9000059950 con 0x7f90100afd70 2024-09-16T01:23:15.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:15.108 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":71,"btime":"2024-09-16T01:23:09:251942+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/3471922615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":3471922615},{"type":"v1","addr":"172.21.15.102:6834","nonce":3471922615}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6697,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/749780612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":749780612},{"type":"v1","addr":"172.21.15.81:6837","nonce":749780612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/2257484883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":2257484883},{"type":"v1","addr":"172.21.15.102:6835","nonce":2257484883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":8001,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1371966888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1371966888},{"type":"v1","addr":"172.21.15.81:6835","nonce":1371966888}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[]} 2024-09-16T01:23:15.108 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 71 2024-09-16T01:23:15.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.108+0000 7f9016af8640 1 -- 172.21.15.81:0/3023245533 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ffc06c2b0 msgr2=0x7f8ffc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:15.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.108+0000 7f9016af8640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ffc06c2b0 0x7f8ffc06e770 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f90101553a0 tx=0x7f9004009040 comp rx=0 tx=0).stop 2024-09-16T01:23:15.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.108+0000 7f9016af8640 1 -- 172.21.15.81:0/3023245533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90100afd70 msgr2=0x7f901014bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:15.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.108+0000 7f9016af8640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90100afd70 0x7f901014bee0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f900000d800 tx=0x7f900000dcc0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.108+0000 7f9016af8640 1 -- 172.21.15.81:0/3023245533 shutdown_connections 2024-09-16T01:23:15.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.108+0000 7f9016af8640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8ffc06c2b0 0x7f8ffc06e770 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.108+0000 7f9016af8640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f90100cd650 0x7f90101545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.108+0000 7f9016af8640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f90100b5f80 0x7f90101f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.108+0000 7f9016af8640 1 --2- 172.21.15.81:0/3023245533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90100afd70 0x7f901014bee0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.108+0000 7f9016af8640 1 -- 172.21.15.81:0/3023245533 >> 172.21.15.81:0/3023245533 conn(0x7f901006bc10 msgr2=0x7f9010155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:15.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.108+0000 7f9016af8640 1 -- 172.21.15.81:0/3023245533 shutdown_connections 2024-09-16T01:23:15.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.108+0000 7f9016af8640 1 -- 172.21.15.81:0/3023245533 wait complete. 2024-09-16T01:23:15.121 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:23:15.122 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T01:23:15.122 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:23:15.122 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:23:15.122 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:23:15.122 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T01:23:15.123 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:23:15.123 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:23:15.123 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:23:15.123 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T01:23:15.123 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:23:15.124 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:23:15.124 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:23:15.124 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T01:23:15.124 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:23:15.124 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:23:15.131 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:23:15.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:23:15.133 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:23:15.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:23:15.135 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:23:15.135 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:23:15.136 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:23:15.137 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:23:15.174 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:23:15.174 DEBUG:teuthology.parallel:result is None 2024-09-16T01:23:15.175 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:23:15.175 DEBUG:teuthology.parallel:result is None 2024-09-16T01:23:15.178 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:23:15.178 DEBUG:teuthology.parallel:result is None 2024-09-16T01:23:15.178 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:23:15.179 DEBUG:teuthology.parallel:result is None 2024-09-16T01:23:15.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T01:23:15.250 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:23:15.250 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:23:15.259 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-16T01:23:15.260 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:23:15.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.280+0000 7fe9dfbd6640 1 Processor -- start 2024-09-16T01:23:15.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.280+0000 7fe9dfbd6640 1 -- start start 2024-09-16T01:23:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.281+0000 7fe9dfbd6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9d8162060 0x7fe9d80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.281+0000 7fe9dfbd6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe9d80b64b0 0x7fe9d80b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.281+0000 7fe9dfbd6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d806d9f0 con 0x7fe9d8161c80 2024-09-16T01:23:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.281+0000 7fe9dfbd6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d806dcd0 con 0x7fe9d80b64b0 2024-09-16T01:23:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.281+0000 7fe9dfbd6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d806dfb0 con 0x7fe9d8162060 2024-09-16T01:23:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.281+0000 7fe9dd972640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe9d8161c80 0x7fe9d806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:32952/0 (socket says 172.21.15.81:32952) 2024-09-16T01:23:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.282+0000 7fe9dd972640 1 -- 172.21.15.81:0/1608674677 learned_addr learned my addr 172.21.15.81:0/1608674677 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.282+0000 7fe9dd171640 1 --2- 172.21.15.81:0/1608674677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9d8162060 0x7fe9d80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.282+0000 7fe9de173640 1 --2- 172.21.15.81:0/1608674677 >> v2:172.21.15.102:3300/0 conn(0x7fe9d80b64b0 0x7fe9d80b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.282+0000 7fe9dd171640 1 -- 172.21.15.81:0/1608674677 >> v2:172.21.15.102:3300/0 conn(0x7fe9d80b64b0 msgr2=0x7fe9d80b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.282+0000 7fe9dd171640 1 --2- 172.21.15.81:0/1608674677 >> v2:172.21.15.102:3300/0 conn(0x7fe9d80b64b0 0x7fe9d80b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.282+0000 7fe9dd171640 1 -- 172.21.15.81:0/1608674677 >> v1:172.21.15.102:6789/0 conn(0x7fe9d8161c80 legacy=0x7fe9d806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:15.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.282+0000 7fe9dd171640 1 -- 172.21.15.81:0/1608674677 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d80d01f0 con 0x7fe9d8162060 2024-09-16T01:23:15.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.282+0000 7fe9de173640 1 --2- 172.21.15.81:0/1608674677 >> v2:172.21.15.102:3300/0 conn(0x7fe9d80b64b0 0x7fe9d80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:15.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.283+0000 7fe9dd171640 1 --2- 172.21.15.81:0/1608674677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9d8162060 0x7fe9d80b5f70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80097a0 tx=0x7fe9c802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc7fbefa1baad694 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.285+0000 7fe9dc970640 1 -- 172.21.15.81:0/1608674677 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8037070 con 0x7fe9d8162060 2024-09-16T01:23:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.285+0000 7fe9dc970640 1 -- 172.21.15.81:0/1608674677 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c8032440 con 0x7fe9d8162060 2024-09-16T01:23:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.285+0000 7fe9dc970640 1 -- 172.21.15.81:0/1608674677 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8032810 con 0x7fe9d8162060 2024-09-16T01:23:15.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.286+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/1608674677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9d8162060 msgr2=0x7fe9d80b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:15.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.286+0000 7fe9dfbd6640 1 --2- 172.21.15.81:0/1608674677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9d8162060 0x7fe9d80b5f70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80097a0 tx=0x7fe9c802a180 comp rx=0 tx=0).stop 2024-09-16T01:23:15.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.286+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/1608674677 shutdown_connections 2024-09-16T01:23:15.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.286+0000 7fe9dfbd6640 1 --2- 172.21.15.81:0/1608674677 >> v2:172.21.15.102:3300/0 conn(0x7fe9d80b64b0 0x7fe9d80b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.286+0000 7fe9dfbd6640 1 --2- 172.21.15.81:0/1608674677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9d8162060 0x7fe9d80b5f70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.286+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/1608674677 >> 172.21.15.81:0/1608674677 conn(0x7fe9d80d44f0 msgr2=0x7fe9d80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:15.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.286+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/1608674677 shutdown_connections 2024-09-16T01:23:15.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.286+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/1608674677 wait complete. 2024-09-16T01:23:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.288+0000 7fe9dfbd6640 1 Processor -- start 2024-09-16T01:23:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.288+0000 7fe9dfbd6640 1 -- start start 2024-09-16T01:23:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.289+0000 7fe9dfbd6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9d80b64b0 0x7fe9d80cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.289+0000 7fe9dfbd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d8161c80 0x7fe9d81526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.289+0000 7fe9dfbd6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9d8162060 0x7fe9d80b9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.289+0000 7fe9dfbd6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d80cf1e0 con 0x7fe9d8161c80 2024-09-16T01:23:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.289+0000 7fe9dfbd6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d80d2aa0 con 0x7fe9d8162060 2024-09-16T01:23:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.289+0000 7fe9dfbd6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d80cf360 con 0x7fe9d80b64b0 2024-09-16T01:23:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.289+0000 7fe9dd171640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d8161c80 0x7fe9d81526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.289+0000 7fe9de173640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9d8162060 0x7fe9d80b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.289+0000 7fe9dd972640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9d80b64b0 0x7fe9d80cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.289+0000 7fe9de173640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9d8162060 0x7fe9d80b9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:43896/0 (socket says 172.21.15.81:43896) 2024-09-16T01:23:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.289+0000 7fe9dd171640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d8161c80 0x7fe9d81526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44030/0 (socket says 172.21.15.81:44030) 2024-09-16T01:23:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.289+0000 7fe9de173640 1 -- 172.21.15.81:0/2909325042 learned_addr learned my addr 172.21.15.81:0/2909325042 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.290+0000 7fe9dd171640 1 -- 172.21.15.81:0/2909325042 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9d80b64b0 msgr2=0x7fe9d80cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.290+0000 7fe9dd171640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9d80b64b0 0x7fe9d80cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.290+0000 7fe9dd171640 1 -- 172.21.15.81:0/2909325042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9d8162060 msgr2=0x7fe9d80b9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.290+0000 7fe9dd171640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9d8162060 0x7fe9d80b9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.290+0000 7fe9dd171640 1 -- 172.21.15.81:0/2909325042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d80cbe10 con 0x7fe9d8161c80 2024-09-16T01:23:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.290+0000 7fe9de173640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9d8162060 0x7fe9d80b9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.290+0000 7fe9dd171640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d8161c80 0x7fe9d81526d0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8031000 tx=0x7fe9c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.292+0000 7fe9ce7fc640 1 -- 172.21.15.81:0/2909325042 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8041020 con 0x7fe9d8161c80 2024-09-16T01:23:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.292+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/2909325042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d80cc0f0 con 0x7fe9d8161c80 2024-09-16T01:23:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.292+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/2909325042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d80cc6b0 con 0x7fe9d8161c80 2024-09-16T01:23:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.292+0000 7fe9ce7fc640 1 -- 172.21.15.81:0/2909325042 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c8030700 con 0x7fe9d8161c80 2024-09-16T01:23:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.292+0000 7fe9ce7fc640 1 -- 172.21.15.81:0/2909325042 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8037040 con 0x7fe9d8161c80 2024-09-16T01:23:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.293+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/2909325042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d80b5f70 con 0x7fe9d8161c80 2024-09-16T01:23:15.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.293+0000 7fe9ce7fc640 1 -- 172.21.15.81:0/2909325042 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe9c8044020 con 0x7fe9d8161c80 2024-09-16T01:23:15.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.294+0000 7fe9ce7fc640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9bc06c2e0 0x7fe9bc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:15.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.294+0000 7fe9ce7fc640 1 -- 172.21.15.81:0/2909325042 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5335+0+0 (secure 0 0 0) 0x7fe9c80ab5d0 con 0x7fe9d8161c80 2024-09-16T01:23:15.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.294+0000 7fe9dd972640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9bc06c2e0 0x7fe9bc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:15.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.294+0000 7fe9dd972640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9bc06c2e0 0x7fe9bc06e7a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4005880 tx=0x7fe9d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:15.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.299+0000 7fe9ce7fc640 1 -- 172.21.15.81:0/2909325042 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9c804b030 con 0x7fe9d8161c80 2024-09-16T01:23:15.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:15.480+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/2909325042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe9d80ba470 con 0x7fe9d8161c80 2024-09-16T01:23:16.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.294+0000 7fe9ce7fc640 1 -- 172.21.15.81:0/2909325042 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v133) ==== 97+0+0 (secure 0 0 0) 0x7fe9c80797e0 con 0x7fe9d8161c80 2024-09-16T01:23:16.296 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-16T01:23:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.297+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/2909325042 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9bc06c2e0 msgr2=0x7fe9bc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.297+0000 7fe9dfbd6640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9bc06c2e0 0x7fe9bc06e7a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4005880 tx=0x7fe9d4009040 comp rx=0 tx=0).stop 2024-09-16T01:23:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.297+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/2909325042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d8161c80 msgr2=0x7fe9d81526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.297+0000 7fe9dfbd6640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d8161c80 0x7fe9d81526d0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8031000 tx=0x7fe9c80046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.297+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/2909325042 shutdown_connections 2024-09-16T01:23:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.297+0000 7fe9dfbd6640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9bc06c2e0 0x7fe9bc06e7a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.297+0000 7fe9dfbd6640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9d8162060 0x7fe9d80b9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.297+0000 7fe9dfbd6640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d8161c80 0x7fe9d81526d0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.297+0000 7fe9dfbd6640 1 --2- 172.21.15.81:0/2909325042 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9d80b64b0 0x7fe9d80cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.297+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/2909325042 >> 172.21.15.81:0/2909325042 conn(0x7fe9d80d44f0 msgr2=0x7fe9d80d2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.297+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/2909325042 shutdown_connections 2024-09-16T01:23:16.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.297+0000 7fe9dfbd6640 1 -- 172.21.15.81:0/2909325042 wait complete. 2024-09-16T01:23:16.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T01:23:16.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.412+0000 7f5a79b3b640 1 Processor -- start 2024-09-16T01:23:16.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.412+0000 7f5a79b3b640 1 -- start start 2024-09-16T01:23:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a79b3b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5a740d4fd0 0x7f5a7406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a79b3b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a740d2700 con 0x7f5a7415e760 2024-09-16T01:23:16.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a79b3b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a740cedb0 con 0x7f5a740cfcc0 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a79b3b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5a740cf090 con 0x7f5a740d4fd0 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a737fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5a7415e760 0x7f5a740cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58956/0 (socket says 172.21.15.81:58956) 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a737fe640 1 -- 172.21.15.81:0/834341775 learned_addr learned my addr 172.21.15.81:0/834341775 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678661036 0 0) 0x7f5a64001110 con 0x7f5a7415e760 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a73fff640 1 --2- 172.21.15.81:0/834341775 >> v2:172.21.15.102:3300/0 conn(0x7f5a740d4fd0 0x7f5a7406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a5c003520 con 0x7f5a7415e760 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1414805702 0 0) 0x7f5a5c003520 con 0x7f5a7415e760 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 >> v2:172.21.15.102:3300/0 conn(0x7f5a740d4fd0 msgr2=0x7f5a7406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 --2- 172.21.15.81:0/834341775 >> v2:172.21.15.102:3300/0 conn(0x7f5a740d4fd0 0x7f5a7406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 >> v1:172.21.15.102:6789/0 conn(0x7f5a740cfcc0 legacy=0x7f5a740d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a740b3c80 con 0x7f5a7415e760 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f5a64001840 con 0x7f5a7415e760 2024-09-16T01:23:16.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 >> v1:172.21.15.81:6789/0 conn(0x7f5a7415e760 legacy=0x7f5a740cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 --2- 172.21.15.81:0/834341775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a5c0039b0 0x7f5a5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 --2- 172.21.15.81:0/834341775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 0x7f5a5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 --2- 172.21.15.81:0/834341775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a5c0051c0 0x7f5a5c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740cf090 con 0x7f5a5c004800 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5c00c060 con 0x7f5a5c0039b0 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5a5c00c260 con 0x7f5a5c0051c0 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.413+0000 7f5a72ffd640 1 --2- 172.21.15.81:0/834341775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 0x7f5a5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.414+0000 7f5a737fe640 1 --2- 172.21.15.81:0/834341775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a5c0039b0 0x7f5a5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.414+0000 7f5a73fff640 1 --2- 172.21.15.81:0/834341775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a5c0051c0 0x7f5a5c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.414+0000 7f5a72ffd640 1 -- 172.21.15.81:0/834341775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a5c0051c0 msgr2=0x7f5a5c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.414+0000 7f5a72ffd640 1 --2- 172.21.15.81:0/834341775 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a5c0051c0 0x7f5a5c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.414+0000 7f5a72ffd640 1 -- 172.21.15.81:0/834341775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a5c0039b0 msgr2=0x7f5a5c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.414+0000 7f5a72ffd640 1 --2- 172.21.15.81:0/834341775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a5c0039b0 0x7f5a5c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.414+0000 7f5a73fff640 1 -- 172.21.15.81:0/834341775 reap_dead start 2024-09-16T01:23:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.414+0000 7f5a72ffd640 1 -- 172.21.15.81:0/834341775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5c003520 con 0x7f5a5c004800 2024-09-16T01:23:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.414+0000 7f5a72ffd640 1 --2- 172.21.15.81:0/834341775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 0x7f5a5c004c80 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f5a68001770 tx=0x7f5a5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f87d1395d53ab96 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.415+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a680013c0 con 0x7f5a5c004800 2024-09-16T01:23:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.415+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a680052d0 con 0x7f5a5c004800 2024-09-16T01:23:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.415+0000 7f5a727fc640 1 -- 172.21.15.81:0/834341775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6802a8a0 con 0x7f5a5c004800 2024-09-16T01:23:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.415+0000 7f5a79b3b640 1 -- 172.21.15.81:0/834341775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 msgr2=0x7f5a5c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.415+0000 7f5a79b3b640 1 --2- 172.21.15.81:0/834341775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 0x7f5a5c004c80 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f5a68001770 tx=0x7f5a5c005830 comp rx=0 tx=0).stop 2024-09-16T01:23:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.415+0000 7f5a79b3b640 1 -- 172.21.15.81:0/834341775 shutdown_connections 2024-09-16T01:23:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.415+0000 7f5a79b3b640 1 --2- 172.21.15.81:0/834341775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 0x7f5a5c004c80 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.415+0000 7f5a79b3b640 1 -- 172.21.15.81:0/834341775 >> 172.21.15.81:0/834341775 conn(0x7f5a7408bfc0 msgr2=0x7f5a740d4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.415+0000 7f5a79b3b640 1 -- 172.21.15.81:0/834341775 shutdown_connections 2024-09-16T01:23:16.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.415+0000 7f5a79b3b640 1 -- 172.21.15.81:0/834341775 wait complete. 2024-09-16T01:23:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.416+0000 7f5a79b3b640 1 Processor -- start 2024-09-16T01:23:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.417+0000 7f5a79b3b640 1 -- start start 2024-09-16T01:23:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.417+0000 7f5a79b3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 0x7f5a740b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.417+0000 7f5a79b3b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a740b82c0 0x7f5a74156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.417+0000 7f5a79b3b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a741f5900 0x7f5a740b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.417+0000 7f5a79b3b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7406cdd0 con 0x7f5a5c004800 2024-09-16T01:23:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.417+0000 7f5a79b3b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740b3860 con 0x7f5a740b82c0 2024-09-16T01:23:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.417+0000 7f5a79b3b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7406cf50 con 0x7f5a741f5900 2024-09-16T01:23:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.417+0000 7f5a737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 0x7f5a740b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.417+0000 7f5a737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 0x7f5a740b91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44054/0 (socket says 172.21.15.81:44054) 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.417+0000 7f5a737fe640 1 -- 172.21.15.81:0/4073307756 learned_addr learned my addr 172.21.15.81:0/4073307756 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.417+0000 7f5a72ffd640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a740b82c0 0x7f5a74156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.417+0000 7f5a73fff640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a741f5900 0x7f5a740b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.418+0000 7f5a737fe640 1 -- 172.21.15.81:0/4073307756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a741f5900 msgr2=0x7f5a740b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.418+0000 7f5a737fe640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a741f5900 0x7f5a740b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.418+0000 7f5a737fe640 1 -- 172.21.15.81:0/4073307756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a740b82c0 msgr2=0x7f5a74156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.418+0000 7f5a737fe640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a740b82c0 0x7f5a74156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.418+0000 7f5a737fe640 1 -- 172.21.15.81:0/4073307756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a74157050 con 0x7f5a5c004800 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.418+0000 7f5a72ffd640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a740b82c0 0x7f5a74156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.418+0000 7f5a737fe640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 0x7f5a740b91a0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5a640072c0 tx=0x7f5a64007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.418+0000 7f5a5bfff640 1 -- 172.21.15.81:0/4073307756 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a64001230 con 0x7f5a5c004800 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.418+0000 7f5a5bfff640 1 -- 172.21.15.81:0/4073307756 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a64018070 con 0x7f5a5c004800 2024-09-16T01:23:16.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.418+0000 7f5a79b3b640 1 -- 172.21.15.81:0/4073307756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a740b7500 con 0x7f5a5c004800 2024-09-16T01:23:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.418+0000 7f5a5bfff640 1 -- 172.21.15.81:0/4073307756 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400fba0 con 0x7f5a5c004800 2024-09-16T01:23:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.418+0000 7f5a79b3b640 1 -- 172.21.15.81:0/4073307756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a740b7ac0 con 0x7f5a5c004800 2024-09-16T01:23:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.419+0000 7f5a79b3b640 1 -- 172.21.15.81:0/4073307756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a740b6d20 con 0x7f5a5c004800 2024-09-16T01:23:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.419+0000 7f5a5bfff640 1 -- 172.21.15.81:0/4073307756 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5a6400fd40 con 0x7f5a5c004800 2024-09-16T01:23:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.420+0000 7f5a5bfff640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5a6006c2b0 0x7f5a6006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.420+0000 7f5a5bfff640 1 -- 172.21.15.81:0/4073307756 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5249+0+0 (secure 0 0 0) 0x7f5a6408b2e0 con 0x7f5a5c004800 2024-09-16T01:23:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.420+0000 7f5a72ffd640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5a6006c2b0 0x7f5a6006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.420+0000 7f5a72ffd640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5a6006c2b0 0x7f5a6006e770 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5a68032000 tx=0x7f5a6802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:16.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.424+0000 7f5a5bfff640 1 -- 172.21.15.81:0/4073307756 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a74157050 con 0x7f5a5c004800 2024-09-16T01:23:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.652+0000 7f5a79b3b640 1 -- 172.21.15.81:0/4073307756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5a740d1160 con 0x7f5a5c004800 2024-09-16T01:23:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.652+0000 7f5a5bfff640 1 -- 172.21.15.81:0/4073307756 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7f5a740d2700 con 0x7f5a5c004800 2024-09-16T01:23:16.654 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:16.654 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:23:16.654 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmx4OgCRAAkmpWDpuwqbDuz0taNg8bag==", 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-16T01:23:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmSNpLFRAAzc9Sr8b65zH9VZFYvqsYpA==", 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmcCavEBAA0CuddD0zPcjqrMSOD5c6OA==", 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmVeRcHBAANIL7HFYSc43qv7Zg0llkYQ==", 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.657 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.658 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-16T01:23:16.658 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDhudmUtTqORAAkZKChid+qoa+0nIgpuun7g==", 2024-09-16T01:23:16.658 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.658 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:16.658 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:16.658 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-16T01:23:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCHhudmUhtiABAA2vDoACv8RJ2KD9p1cdKClA==", 2024-09-16T01:23:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-16T01:23:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCKhudmhOmRHxAAbGjJkUZLras/b6omekdz7A==", 2024-09-16T01:23:16.659 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.660 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:16.660 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:16.660 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.660 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.660 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-16T01:23:16.660 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCNhudmA+csIRAAW1kenpimaWIak/qgG+UeXw==", 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCThudmvgQBLxAAWLto5pG0iyiQPSnxldWYwg==", 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.662 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-16T01:23:16.662 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCXhudmKfyiIhAALbJHvDeQtVgSCKjD1X3OYg==", 2024-09-16T01:23:16.662 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.662 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:16.662 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:16.662 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.662 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.662 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCahudmPG/9JBAA6d/gK0K/5c9Gp4uKOLCCOw==", 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCdhudmVdY3NhAAXlOaeE0XidHVCaeQrirBAg==", 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:16.664 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.664 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-16T01:23:16.664 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg==", 2024-09-16T01:23:16.664 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.664 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:16.664 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-16T01:23:16.664 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T01:23:16.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.665 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.666 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-16T01:23:16.668 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmMgEhKRAAUD2kJ9eOFJscZ6ATlO5PmQ==", 2024-09-16T01:23:16.668 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:16.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:23:16.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:23:16.669 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:23:16.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.670 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.670 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-16T01:23:16.670 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmwfD5JRAAPhdVLFZD07Uy75g3zStblg==", 2024-09-16T01:23:16.670 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.671 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:16.671 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:23:16.671 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:23:16.671 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:23:16.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.671 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-16T01:23:16.671 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudm8/qzLhAAVFRbGhXH00h2LS9ZC9rraA==", 2024-09-16T01:23:16.671 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.671 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:23:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:23:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:23:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-16T01:23:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/hudmBWr2KRAA/hELsRHNpxj3KqJbOSY74g==", 2024-09-16T01:23:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:23:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:23:16.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:23:16.673 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.673 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-16T01:23:16.673 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmRdtyBhAAMQngXCuTHg6AjACCw/SmCg==", 2024-09-16T01:23:16.673 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:23:16.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:23:16.674 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:16.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.674 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-16T01:23:16.674 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmqULCAhAAMbYmGXWGiINwif20O1JG3g==", 2024-09-16T01:23:16.674 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:16.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:23:16.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:23:16.674 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:16.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.675 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-16T01:23:16.675 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:23:16.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.654+0000 7f5a79b3b640 1 -- 172.21.15.81:0/4073307756 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5a6006c2b0 msgr2=0x7f5a6006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.654+0000 7f5a79b3b640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5a6006c2b0 0x7f5a6006e770 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5a68032000 tx=0x7f5a6802e000 comp rx=0 tx=0).stop 2024-09-16T01:23:16.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.654+0000 7f5a79b3b640 1 -- 172.21.15.81:0/4073307756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 msgr2=0x7f5a740b91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.654+0000 7f5a79b3b640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 0x7f5a740b91a0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5a640072c0 tx=0x7f5a64007780 comp rx=0 tx=0).stop 2024-09-16T01:23:16.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.654+0000 7f5a79b3b640 1 -- 172.21.15.81:0/4073307756 shutdown_connections 2024-09-16T01:23:16.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.654+0000 7f5a79b3b640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5a6006c2b0 0x7f5a6006e770 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.654+0000 7f5a79b3b640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a741f5900 0x7f5a740b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.654+0000 7f5a79b3b640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a740b82c0 0x7f5a74156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.654+0000 7f5a79b3b640 1 --2- 172.21.15.81:0/4073307756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a5c004800 0x7f5a740b91a0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.654+0000 7f5a79b3b640 1 -- 172.21.15.81:0/4073307756 >> 172.21.15.81:0/4073307756 conn(0x7f5a7408bfc0 msgr2=0x7f5a7415d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:16.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.654+0000 7f5a79b3b640 1 -- 172.21.15.81:0/4073307756 shutdown_connections 2024-09-16T01:23:16.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.654+0000 7f5a79b3b640 1 -- 172.21.15.81:0/4073307756 wait complete. 2024-09-16T01:23:16.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:23:16.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.774+0000 7f3ca6cb7640 1 Processor -- start 2024-09-16T01:23:16.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.774+0000 7f3ca6cb7640 1 -- start start 2024-09-16T01:23:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.775+0000 7f3ca6cb7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ca00d04a0 0x7f3ca00d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.775+0000 7f3ca6cb7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ca00ae550 0x7f3ca00ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.775+0000 7f3ca6cb7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ca006cb30 con 0x7f3ca0147360 2024-09-16T01:23:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.775+0000 7f3ca6cb7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3ca006bfb0 con 0x7f3ca00ae550 2024-09-16T01:23:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.775+0000 7f3ca6cb7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca006c290 con 0x7f3ca00d04a0 2024-09-16T01:23:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.775+0000 7f3ca5254640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ca00ae550 0x7f3ca00ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.775+0000 7f3ca5254640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3ca00ae550 0x7f3ca00ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44060/0 (socket says 172.21.15.81:44060) 2024-09-16T01:23:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.775+0000 7f3ca5254640 1 -- 172.21.15.81:0/3596991968 learned_addr learned my addr 172.21.15.81:0/3596991968 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.776+0000 7f3c9ffff640 1 --2- 172.21.15.81:0/3596991968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ca00d04a0 0x7f3ca00d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.776+0000 7f3ca5254640 1 -- 172.21.15.81:0/3596991968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ca00d04a0 msgr2=0x7f3ca00d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.776+0000 7f3ca5254640 1 --2- 172.21.15.81:0/3596991968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ca00d04a0 0x7f3ca00d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.776+0000 7f3ca5254640 1 -- 172.21.15.81:0/3596991968 >> v1:172.21.15.102:6789/0 conn(0x7f3ca0147360 legacy=0x7f3ca0070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.776+0000 7f3ca5254640 1 -- 172.21.15.81:0/3596991968 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca006c570 con 0x7f3ca00ae550 2024-09-16T01:23:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.776+0000 7f3c9ffff640 1 --2- 172.21.15.81:0/3596991968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ca00d04a0 0x7f3ca00d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.776+0000 7f3ca5254640 1 --2- 172.21.15.81:0/3596991968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca00ae550 0x7f3ca00ae980 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009e50 tx=0x7f3c9802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac66d470f471f9b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.776+0000 7f3c9f7fe640 1 -- 172.21.15.81:0/3596991968 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98036070 con 0x7f3ca00ae550 2024-09-16T01:23:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.776+0000 7f3c9f7fe640 1 -- 172.21.15.81:0/3596991968 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c98031600 con 0x7f3ca00ae550 2024-09-16T01:23:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.776+0000 7f3c9f7fe640 1 -- 172.21.15.81:0/3596991968 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c980319d0 con 0x7f3ca00ae550 2024-09-16T01:23:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.777+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/3596991968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca00ae550 msgr2=0x7f3ca00ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.777+0000 7f3ca6cb7640 1 --2- 172.21.15.81:0/3596991968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca00ae550 0x7f3ca00ae980 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009e50 tx=0x7f3c9802a630 comp rx=0 tx=0).stop 2024-09-16T01:23:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.777+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/3596991968 shutdown_connections 2024-09-16T01:23:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.777+0000 7f3ca6cb7640 1 --2- 172.21.15.81:0/3596991968 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca00ae550 0x7f3ca00ae980 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.777+0000 7f3ca6cb7640 1 --2- 172.21.15.81:0/3596991968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ca00d04a0 0x7f3ca00d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.777+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/3596991968 >> 172.21.15.81:0/3596991968 conn(0x7f3ca00b2f40 msgr2=0x7f3ca00b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.777+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/3596991968 shutdown_connections 2024-09-16T01:23:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.777+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/3596991968 wait complete. 2024-09-16T01:23:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.778+0000 7f3ca6cb7640 1 Processor -- start 2024-09-16T01:23:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.778+0000 7f3ca6cb7640 1 -- start start 2024-09-16T01:23:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca6cb7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ca00ae550 0x7f3ca015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca6cb7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ca00d04a0 0x7f3ca0141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca6cb7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0147360 0x7f3ca015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca6cb7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0070fa0 con 0x7f3ca0147360 2024-09-16T01:23:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca6cb7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca00d0e20 con 0x7f3ca00d04a0 2024-09-16T01:23:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca6cb7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca006bc10 con 0x7f3ca00ae550 2024-09-16T01:23:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca5254640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0147360 0x7f3ca015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca5254640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0147360 0x7f3ca015e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44068/0 (socket says 172.21.15.81:44068) 2024-09-16T01:23:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca5254640 1 -- 172.21.15.81:0/1244481413 learned_addr learned my addr 172.21.15.81:0/1244481413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca4a53640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ca00ae550 0x7f3ca015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3c9ffff640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ca00d04a0 0x7f3ca0141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca5254640 1 -- 172.21.15.81:0/1244481413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ca00ae550 msgr2=0x7f3ca015a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca5254640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ca00ae550 0x7f3ca015a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca5254640 1 -- 172.21.15.81:0/1244481413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ca00d04a0 msgr2=0x7f3ca0141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca5254640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ca00d04a0 0x7f3ca0141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3ca5254640 1 -- 172.21.15.81:0/1244481413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca00b59b0 con 0x7f3ca0147360 2024-09-16T01:23:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.779+0000 7f3c9ffff640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ca00d04a0 0x7f3ca0141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.780+0000 7f3ca5254640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0147360 0x7f3ca015e9a0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009e50 tx=0x7f3c98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.780+0000 7f3c9d7fa640 1 -- 172.21.15.81:0/1244481413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98036050 con 0x7f3ca0147360 2024-09-16T01:23:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.780+0000 7f3c9d7fa640 1 -- 172.21.15.81:0/1244481413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c98042070 con 0x7f3ca0147360 2024-09-16T01:23:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.780+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/1244481413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca00b5c90 con 0x7f3ca0147360 2024-09-16T01:23:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.780+0000 7f3c9d7fa640 1 -- 172.21.15.81:0/1244481413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98009510 con 0x7f3ca0147360 2024-09-16T01:23:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.780+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/1244481413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca00b6250 con 0x7f3ca0147360 2024-09-16T01:23:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.781+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/1244481413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca00d08e0 con 0x7f3ca0147360 2024-09-16T01:23:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.781+0000 7f3c9d7fa640 1 -- 172.21.15.81:0/1244481413 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3c98007bd0 con 0x7f3ca0147360 2024-09-16T01:23:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.782+0000 7f3c9d7fa640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3c8406c2b0 0x7f3c8406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.782+0000 7f3c9d7fa640 1 -- 172.21.15.81:0/1244481413 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5249+0+0 (secure 0 0 0) 0x7f3c980ac130 con 0x7f3ca0147360 2024-09-16T01:23:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.782+0000 7f3ca4a53640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3c8406c2b0 0x7f3c8406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.782+0000 7f3ca4a53640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3c8406c2b0 0x7f3c8406e770 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3c94006fd0 tx=0x7f3c94009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.786+0000 7f3c9d7fa640 1 -- 172.21.15.81:0/1244481413 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c9807aa60 con 0x7f3ca0147360 2024-09-16T01:23:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.952+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/1244481413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3ca0146610 con 0x7f3ca0147360 2024-09-16T01:23:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.952+0000 7f3c9d7fa640 1 -- 172.21.15.81:0/1244481413 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v133) ==== 84+0+65 (secure 0 0 0) 0x7f3c9807a360 con 0x7f3ca0147360 2024-09-16T01:23:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:16.955 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-16T01:23:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-16T01:23:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-16T01:23:16.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:16.955 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-16T01:23:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.954+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/1244481413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3c8406c2b0 msgr2=0x7f3c8406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.954+0000 7f3ca6cb7640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3c8406c2b0 0x7f3c8406e770 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f3c94006fd0 tx=0x7f3c94009060 comp rx=0 tx=0).stop 2024-09-16T01:23:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.954+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/1244481413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0147360 msgr2=0x7f3ca015e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.954+0000 7f3ca6cb7640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0147360 0x7f3ca015e9a0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009e50 tx=0x7f3c98004a40 comp rx=0 tx=0).stop 2024-09-16T01:23:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.954+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/1244481413 shutdown_connections 2024-09-16T01:23:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.954+0000 7f3ca6cb7640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3c8406c2b0 0x7f3c8406e770 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.954+0000 7f3ca6cb7640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ca0147360 0x7f3ca015e9a0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.954+0000 7f3ca6cb7640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3ca00d04a0 0x7f3ca0141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.954+0000 7f3ca6cb7640 1 --2- 172.21.15.81:0/1244481413 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3ca00ae550 0x7f3ca015a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.954+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/1244481413 >> 172.21.15.81:0/1244481413 conn(0x7f3ca00b2f40 msgr2=0x7f3ca00b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.955+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/1244481413 shutdown_connections 2024-09-16T01:23:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:16.955+0000 7f3ca6cb7640 1 -- 172.21.15.81:0/1244481413 wait complete. 2024-09-16T01:23:16.968 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:23:16.968 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:23:17.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.068+0000 7fb803b91640 1 Processor -- start 2024-09-16T01:23:17.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.069+0000 7fb803b91640 1 -- start start 2024-09-16T01:23:17.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.069+0000 7fb803b91640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7fc15b360 0x7fb7fc073440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.069+0000 7fb803b91640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb7fc0b4160 0x7fb7fc0b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.069+0000 7fb803b91640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc0b13e0 con 0x7fb7fc0b0440 2024-09-16T01:23:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.069+0000 7fb803b91640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb7fc0b4af0 con 0x7fb7fc15b360 2024-09-16T01:23:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.069+0000 7fb803b91640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb7fc0af310 con 0x7fb7fc0b4160 2024-09-16T01:23:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.070+0000 7fb80192d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7fc15b360 0x7fb7fc073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.070+0000 7fb80192d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7fc15b360 0x7fb7fc073440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44082/0 (socket says 172.21.15.81:44082) 2024-09-16T01:23:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.070+0000 7fb80192d640 1 -- 172.21.15.81:0/3886640327 learned_addr learned my addr 172.21.15.81:0/3886640327 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.070+0000 7fb80192d640 1 -- 172.21.15.81:0/3886640327 >> v2:172.21.15.102:3300/0 conn(0x7fb7fc0b4160 msgr2=0x7fb7fc0b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.070+0000 7fb80212e640 1 --2- 172.21.15.81:0/3886640327 >> v2:172.21.15.102:3300/0 conn(0x7fb7fc0b4160 0x7fb7fc0b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.070+0000 7fb80192d640 1 --2- 172.21.15.81:0/3886640327 >> v2:172.21.15.102:3300/0 conn(0x7fb7fc0b4160 0x7fb7fc0b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.070+0000 7fb80192d640 1 -- 172.21.15.81:0/3886640327 >> v1:172.21.15.102:6789/0 conn(0x7fb7fc0b0440 legacy=0x7fb7fc0b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.070+0000 7fb80192d640 1 -- 172.21.15.81:0/3886640327 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc0ae9e0 con 0x7fb7fc15b360 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.070+0000 7fb80212e640 1 --2- 172.21.15.81:0/3886640327 >> v2:172.21.15.102:3300/0 conn(0x7fb7fc0b4160 0x7fb7fc0b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.071+0000 7fb80192d640 1 --2- 172.21.15.81:0/3886640327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7fc15b360 0x7fb7fc073440 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc072e90 tx=0x7fb7ec02c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1c949dca53a570 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.071+0000 7fb80092b640 1 -- 172.21.15.81:0/3886640327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec009600 con 0x7fb7fc15b360 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.071+0000 7fb80092b640 1 -- 172.21.15.81:0/3886640327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec0097a0 con 0x7fb7fc15b360 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.071+0000 7fb80092b640 1 -- 172.21.15.81:0/3886640327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec009b70 con 0x7fb7fc15b360 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.071+0000 7fb803b91640 1 -- 172.21.15.81:0/3886640327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7fc15b360 msgr2=0x7fb7fc073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.071+0000 7fb803b91640 1 --2- 172.21.15.81:0/3886640327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7fc15b360 0x7fb7fc073440 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc072e90 tx=0x7fb7ec02c900 comp rx=0 tx=0).stop 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.071+0000 7fb803b91640 1 -- 172.21.15.81:0/3886640327 shutdown_connections 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.071+0000 7fb803b91640 1 --2- 172.21.15.81:0/3886640327 >> v2:172.21.15.102:3300/0 conn(0x7fb7fc0b4160 0x7fb7fc0b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.071+0000 7fb803b91640 1 --2- 172.21.15.81:0/3886640327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7fc15b360 0x7fb7fc073440 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.071+0000 7fb803b91640 1 -- 172.21.15.81:0/3886640327 >> 172.21.15.81:0/3886640327 conn(0x7fb7fc0b68a0 msgr2=0x7fb7fc0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.071+0000 7fb803b91640 1 -- 172.21.15.81:0/3886640327 shutdown_connections 2024-09-16T01:23:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.071+0000 7fb803b91640 1 -- 172.21.15.81:0/3886640327 wait complete. 2024-09-16T01:23:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.073+0000 7fb803b91640 1 Processor -- start 2024-09-16T01:23:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.073+0000 7fb803b91640 1 -- start start 2024-09-16T01:23:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.073+0000 7fb803b91640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb7fc0b0440 0x7fb7fc149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.073+0000 7fb803b91640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7fc0b4160 0x7fb7fc15c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.073+0000 7fb803b91640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7fc15b360 0x7fb7fc15cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.073+0000 7fb803b91640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc09ae10 con 0x7fb7fc15b360 2024-09-16T01:23:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.073+0000 7fb803b91640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc0aefa0 con 0x7fb7fc0b4160 2024-09-16T01:23:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.073+0000 7fb803b91640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb7fc15b740 con 0x7fb7fc0b0440 2024-09-16T01:23:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.073+0000 7fb80212e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7fc15b360 0x7fb7fc15cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.073+0000 7fb80212e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7fc15b360 0x7fb7fc15cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44088/0 (socket says 172.21.15.81:44088) 2024-09-16T01:23:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.073+0000 7fb80212e640 1 -- 172.21.15.81:0/3112475066 learned_addr learned my addr 172.21.15.81:0/3112475066 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb80192d640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb7fc0b0440 0x7fb7fc149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb80112c640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7fc0b4160 0x7fb7fc15c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb80212e640 1 -- 172.21.15.81:0/3112475066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb7fc0b0440 msgr2=0x7fb7fc149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb80212e640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb7fc0b0440 0x7fb7fc149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb80212e640 1 -- 172.21.15.81:0/3112475066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7fc0b4160 msgr2=0x7fb7fc15c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb80212e640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7fc0b4160 0x7fb7fc15c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb80212e640 1 -- 172.21.15.81:0/3112475066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc14a2b0 con 0x7fb7fc15b360 2024-09-16T01:23:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb80212e640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7fc15b360 0x7fb7fc15cd20 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400c7f0 tx=0x7fb7f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb7fa7fc640 1 -- 172.21.15.81:0/3112475066 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4015070 con 0x7fb7fc15b360 2024-09-16T01:23:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb7fa7fc640 1 -- 172.21.15.81:0/3112475066 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f4007820 con 0x7fb7fc15b360 2024-09-16T01:23:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb7fa7fc640 1 -- 172.21.15.81:0/3112475066 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4007c50 con 0x7fb7fc15b360 2024-09-16T01:23:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb803b91640 1 -- 172.21.15.81:0/3112475066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7fc15bbd0 con 0x7fb7fc15b360 2024-09-16T01:23:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.074+0000 7fb803b91640 1 -- 172.21.15.81:0/3112475066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7fc09e890 con 0x7fb7fc15b360 2024-09-16T01:23:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.075+0000 7fb803b91640 1 -- 172.21.15.81:0/3112475066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7fc09aa30 con 0x7fb7fc15b360 2024-09-16T01:23:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.075+0000 7fb7fa7fc640 1 -- 172.21.15.81:0/3112475066 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb7f4018070 con 0x7fb7fc15b360 2024-09-16T01:23:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.076+0000 7fb7fa7fc640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb7e806c2e0 0x7fb7e806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.076+0000 7fb80192d640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb7e806c2e0 0x7fb7e806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.076+0000 7fb7fa7fc640 1 -- 172.21.15.81:0/3112475066 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 5249+0+0 (secure 0 0 0) 0x7fb7f408b280 con 0x7fb7fc15b360 2024-09-16T01:23:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.076+0000 7fb80192d640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb7e806c2e0 0x7fb7e806e7a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec036000 tx=0x7fb7ec00b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:17.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.080+0000 7fb7fa7fc640 1 -- 172.21.15.81:0/3112475066 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7f40595f0 con 0x7fb7fc15b360 2024-09-16T01:23:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.249+0000 7fb803b91640 1 -- 172.21.15.81:0/3112475066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb7fc0b46e0 con 0x7fb7fc15b360 2024-09-16T01:23:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.580+0000 7fb7fa7fc640 1 -- 172.21.15.81:0/3112475066 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v134) ==== 138+0+0 (secure 0 0 0) 0x7fb7f405d8f0 con 0x7fb7fc15b360 2024-09-16T01:23:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-16T01:23:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.582+0000 7fb803b91640 1 -- 172.21.15.81:0/3112475066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb7e806c2e0 msgr2=0x7fb7e806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.582+0000 7fb803b91640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb7e806c2e0 0x7fb7e806e7a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec036000 tx=0x7fb7ec00b000 comp rx=0 tx=0).stop 2024-09-16T01:23:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.582+0000 7fb803b91640 1 -- 172.21.15.81:0/3112475066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7fc15b360 msgr2=0x7fb7fc15cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.582+0000 7fb803b91640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7fc15b360 0x7fb7fc15cd20 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400c7f0 tx=0x7fb7f400ccb0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.582+0000 7fb803b91640 1 -- 172.21.15.81:0/3112475066 shutdown_connections 2024-09-16T01:23:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.582+0000 7fb803b91640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb7e806c2e0 0x7fb7e806e7a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.582+0000 7fb803b91640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7fc15b360 0x7fb7fc15cd20 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.582+0000 7fb803b91640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb7fc0b4160 0x7fb7fc15c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.582+0000 7fb803b91640 1 --2- 172.21.15.81:0/3112475066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb7fc0b0440 0x7fb7fc149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.582+0000 7fb803b91640 1 -- 172.21.15.81:0/3112475066 >> 172.21.15.81:0/3112475066 conn(0x7fb7fc0b68a0 msgr2=0x7fb7fc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.582+0000 7fb803b91640 1 -- 172.21.15.81:0/3112475066 shutdown_connections 2024-09-16T01:23:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.583+0000 7fb803b91640 1 -- 172.21.15.81:0/3112475066 wait complete. 2024-09-16T01:23:17.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:23:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.702+0000 7fdcc5282640 1 Processor -- start 2024-09-16T01:23:17.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.703+0000 7fdcc5282640 1 -- start start 2024-09-16T01:23:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.703+0000 7fdcc5282640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdcc006bc10 0x7fdcc006c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.703+0000 7fdcc5282640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdcc015d150 0x7fdcc015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.703+0000 7fdcc5282640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc0146180 con 0x7fdcc0145da0 2024-09-16T01:23:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.703+0000 7fdcc5282640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fdcc006c5c0 con 0x7fdcc015d150 2024-09-16T01:23:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.703+0000 7fdcc5282640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fdcc015c9f0 con 0x7fdcc006bc10 2024-09-16T01:23:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.704+0000 7fdcbf7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdcc015d150 0x7fdcc015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.704+0000 7fdcbf7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdcc015d150 0x7fdcc015d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44092/0 (socket says 172.21.15.81:44092) 2024-09-16T01:23:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.704+0000 7fdcbf7fe640 1 -- 172.21.15.81:0/3979215733 learned_addr learned my addr 172.21.15.81:0/3979215733 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.704+0000 7fdcbe7fc640 1 --2- 172.21.15.81:0/3979215733 >> v2:172.21.15.102:3300/0 conn(0x7fdcc006bc10 0x7fdcc006c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.704+0000 7fdcbf7fe640 1 -- 172.21.15.81:0/3979215733 >> v2:172.21.15.102:3300/0 conn(0x7fdcc006bc10 msgr2=0x7fdcc006c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.704+0000 7fdcbf7fe640 1 --2- 172.21.15.81:0/3979215733 >> v2:172.21.15.102:3300/0 conn(0x7fdcc006bc10 0x7fdcc006c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.704+0000 7fdcbf7fe640 1 -- 172.21.15.81:0/3979215733 >> v1:172.21.15.102:6789/0 conn(0x7fdcc0145da0 legacy=0x7fdcc00b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:17.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.704+0000 7fdcbf7fe640 1 -- 172.21.15.81:0/3979215733 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc00b4c00 con 0x7fdcc015d150 2024-09-16T01:23:17.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.704+0000 7fdcbe7fc640 1 --2- 172.21.15.81:0/3979215733 >> v2:172.21.15.102:3300/0 conn(0x7fdcc006bc10 0x7fdcc006c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:17.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.705+0000 7fdcbf7fe640 1 --2- 172.21.15.81:0/3979215733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc015d150 0x7fdcc015d5a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fdcc015ff10 tx=0x7fdcb802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4716639d017371e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:17.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.705+0000 7fdcbdffb640 1 -- 172.21.15.81:0/3979215733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8037070 con 0x7fdcc015d150 2024-09-16T01:23:17.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.705+0000 7fdcbdffb640 1 -- 172.21.15.81:0/3979215733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcb8032440 con 0x7fdcc015d150 2024-09-16T01:23:17.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.705+0000 7fdcbdffb640 1 -- 172.21.15.81:0/3979215733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8032810 con 0x7fdcc015d150 2024-09-16T01:23:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.705+0000 7fdcc5282640 1 -- 172.21.15.81:0/3979215733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc015d150 msgr2=0x7fdcc015d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.705+0000 7fdcc5282640 1 --2- 172.21.15.81:0/3979215733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc015d150 0x7fdcc015d5a0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fdcc015ff10 tx=0x7fdcb802a230 comp rx=0 tx=0).stop 2024-09-16T01:23:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.705+0000 7fdcc5282640 1 -- 172.21.15.81:0/3979215733 shutdown_connections 2024-09-16T01:23:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.705+0000 7fdcc5282640 1 --2- 172.21.15.81:0/3979215733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc015d150 0x7fdcc015d5a0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.705+0000 7fdcc5282640 1 --2- 172.21.15.81:0/3979215733 >> v2:172.21.15.102:3300/0 conn(0x7fdcc006bc10 0x7fdcc006c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.705+0000 7fdcc5282640 1 -- 172.21.15.81:0/3979215733 >> 172.21.15.81:0/3979215733 conn(0x7fdcc00b6680 msgr2=0x7fdcc00b6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.705+0000 7fdcc5282640 1 -- 172.21.15.81:0/3979215733 shutdown_connections 2024-09-16T01:23:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.705+0000 7fdcc5282640 1 -- 172.21.15.81:0/3979215733 wait complete. 2024-09-16T01:23:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.707+0000 7fdcc5282640 1 Processor -- start 2024-09-16T01:23:17.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.707+0000 7fdcc5282640 1 -- start start 2024-09-16T01:23:17.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.707+0000 7fdcc5282640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdcc006bc10 0x7fdcc009f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.707+0000 7fdcc5282640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc0145da0 0x7fdcc013cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.707+0000 7fdcc5282640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdcc015d150 0x7fdcc013d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.707+0000 7fdcc5282640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc015cc30 con 0x7fdcc0145da0 2024-09-16T01:23:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.707+0000 7fdcc5282640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc00b51c0 con 0x7fdcc015d150 2024-09-16T01:23:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.707+0000 7fdcc5282640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdcc00ae360 con 0x7fdcc006bc10 2024-09-16T01:23:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.707+0000 7fdcbe7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc0145da0 0x7fdcc013cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcbe7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc0145da0 0x7fdcc013cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44100/0 (socket says 172.21.15.81:44100) 2024-09-16T01:23:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcbe7fc640 1 -- 172.21.15.81:0/3614065698 learned_addr learned my addr 172.21.15.81:0/3614065698 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcbf7fe640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdcc015d150 0x7fdcc013d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcbeffd640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdcc006bc10 0x7fdcc009f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcbe7fc640 1 -- 172.21.15.81:0/3614065698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdcc006bc10 msgr2=0x7fdcc009f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcbe7fc640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdcc006bc10 0x7fdcc009f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcbe7fc640 1 -- 172.21.15.81:0/3614065698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdcc015d150 msgr2=0x7fdcc013d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcbe7fc640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdcc015d150 0x7fdcc013d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcbe7fc640 1 -- 172.21.15.81:0/3614065698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc013b0e0 con 0x7fdcc0145da0 2024-09-16T01:23:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcbe7fc640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc0145da0 0x7fdcc013cc70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fdca800c7f0 tx=0x7fdca800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcb77fe640 1 -- 172.21.15.81:0/3614065698 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8015070 con 0x7fdcc0145da0 2024-09-16T01:23:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcb77fe640 1 -- 172.21.15.81:0/3614065698 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdca8007a30 con 0x7fdcc0145da0 2024-09-16T01:23:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcc5282640 1 -- 172.21.15.81:0/3614065698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc013b3c0 con 0x7fdcc0145da0 2024-09-16T01:23:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcb77fe640 1 -- 172.21.15.81:0/3614065698 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca8007e00 con 0x7fdcc0145da0 2024-09-16T01:23:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.708+0000 7fdcc5282640 1 -- 172.21.15.81:0/3614065698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc013b980 con 0x7fdcc0145da0 2024-09-16T01:23:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.709+0000 7fdcc5282640 1 -- 172.21.15.81:0/3614065698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc00b0dd0 con 0x7fdcc0145da0 2024-09-16T01:23:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.710+0000 7fdcb77fe640 1 -- 172.21.15.81:0/3614065698 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdca8018070 con 0x7fdcc0145da0 2024-09-16T01:23:17.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.710+0000 7fdcb77fe640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdca006c2b0 0x7fdca006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.710+0000 7fdcb77fe640 1 -- 172.21.15.81:0/3614065698 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 5619+0+0 (secure 0 0 0) 0x7fdca808b290 con 0x7fdcc0145da0 2024-09-16T01:23:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.710+0000 7fdcbeffd640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdca006c2b0 0x7fdca006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:17.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.711+0000 7fdcbeffd640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdca006c2b0 0x7fdca006e770 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdcc013cb30 tx=0x7fdcb0003d90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:17.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.715+0000 7fdcb77fe640 1 -- 172.21.15.81:0/3614065698 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdcc00b0dd0 con 0x7fdcc0145da0 2024-09-16T01:23:17.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:17.882+0000 7fdcc5282640 1 -- 172.21.15.81:0/3614065698 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdcc006c080 con 0x7fdcc0145da0 2024-09-16T01:23:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.585+0000 7fdcb77fe640 1 -- 172.21.15.81:0/3614065698 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v135) ==== 170+0+0 (secure 0 0 0) 0x7fdca8059490 con 0x7fdcc0145da0 2024-09-16T01:23:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-16T01:23:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.589+0000 7fdcc5282640 1 -- 172.21.15.81:0/3614065698 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdca006c2b0 msgr2=0x7fdca006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.589+0000 7fdcc5282640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdca006c2b0 0x7fdca006e770 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdcc013cb30 tx=0x7fdcb0003d90 comp rx=0 tx=0).stop 2024-09-16T01:23:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.589+0000 7fdcc5282640 1 -- 172.21.15.81:0/3614065698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc0145da0 msgr2=0x7fdcc013cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.589+0000 7fdcc5282640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc0145da0 0x7fdcc013cc70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fdca800c7f0 tx=0x7fdca800cbf0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.589+0000 7fdcc5282640 1 -- 172.21.15.81:0/3614065698 shutdown_connections 2024-09-16T01:23:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.589+0000 7fdcc5282640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdca006c2b0 0x7fdca006e770 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.589+0000 7fdcc5282640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdcc015d150 0x7fdcc013d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.589+0000 7fdcc5282640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcc0145da0 0x7fdcc013cc70 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.589+0000 7fdcc5282640 1 --2- 172.21.15.81:0/3614065698 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdcc006bc10 0x7fdcc009f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.589+0000 7fdcc5282640 1 -- 172.21.15.81:0/3614065698 >> 172.21.15.81:0/3614065698 conn(0x7fdcc00b6680 msgr2=0x7fdcc00b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.589+0000 7fdcc5282640 1 -- 172.21.15.81:0/3614065698 shutdown_connections 2024-09-16T01:23:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.589+0000 7fdcc5282640 1 -- 172.21.15.81:0/3614065698 wait complete. 2024-09-16T01:23:18.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:23:18.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.720+0000 7fbc7ed03640 1 Processor -- start 2024-09-16T01:23:18.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.720+0000 7fbc7ed03640 1 -- start start 2024-09-16T01:23:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.720+0000 7fbc7ed03640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbc7806d740 0x7fbc780cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.720+0000 7fbc7ed03640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc7815ff70 con 0x7fbc78162e30 2024-09-16T01:23:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.720+0000 7fbc7ed03640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc780d4d10 con 0x7fbc78162340 2024-09-16T01:23:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.720+0000 7fbc7ed03640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbc7806de90 con 0x7fbc7806d740 2024-09-16T01:23:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc77fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbc78162e30 0x7fbc780d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58970/0 (socket says 172.21.15.81:58970) 2024-09-16T01:23:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc77fff640 1 -- 172.21.15.81:0/2599875729 learned_addr learned my addr 172.21.15.81:0/2599875729 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911851101 0 0) 0x7fbc7815ff70 con 0x7fbc78162e30 2024-09-16T01:23:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc68003520 con 0x7fbc78162e30 2024-09-16T01:23:18.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc7d2a0640 1 --2- 172.21.15.81:0/2599875729 >> v2:172.21.15.102:3300/0 conn(0x7fbc7806d740 0x7fbc780cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1843517946 0 0) 0x7fbc68003520 con 0x7fbc78162e30 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 >> v2:172.21.15.102:3300/0 conn(0x7fbc7806d740 msgr2=0x7fbc780cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 --2- 172.21.15.81:0/2599875729 >> v2:172.21.15.102:3300/0 conn(0x7fbc7806d740 0x7fbc780cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 >> v1:172.21.15.102:6789/0 conn(0x7fbc78162340 legacy=0x7fbc78162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc780d4ff0 con 0x7fbc78162e30 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fbc640017f0 con 0x7fbc78162e30 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 >> v1:172.21.15.81:6789/0 conn(0x7fbc78162e30 legacy=0x7fbc780d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 --2- 172.21.15.81:0/2599875729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc680039b0 0x7fbc68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 --2- 172.21.15.81:0/2599875729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc68004800 0x7fbc68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 --2- 172.21.15.81:0/2599875729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc680052e0 0x7fbc6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7806de90 con 0x7fbc680039b0 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6800c1b0 con 0x7fbc680052e0 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6800c3b0 con 0x7fbc68004800 2024-09-16T01:23:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc7ca9f640 1 --2- 172.21.15.81:0/2599875729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc680039b0 0x7fbc68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc7d2a0640 1 --2- 172.21.15.81:0/2599875729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc680052e0 0x7fbc6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.721+0000 7fbc77fff640 1 --2- 172.21.15.81:0/2599875729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc68004800 0x7fbc68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.722+0000 7fbc7ca9f640 1 -- 172.21.15.81:0/2599875729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc68004800 msgr2=0x7fbc68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.722+0000 7fbc7ca9f640 1 --2- 172.21.15.81:0/2599875729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc68004800 0x7fbc68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.722+0000 7fbc7ca9f640 1 -- 172.21.15.81:0/2599875729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc680052e0 msgr2=0x7fbc6800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.722+0000 7fbc7ca9f640 1 --2- 172.21.15.81:0/2599875729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc680052e0 0x7fbc6800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.722+0000 7fbc7d2a0640 1 -- 172.21.15.81:0/2599875729 reap_dead start 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.722+0000 7fbc7ca9f640 1 -- 172.21.15.81:0/2599875729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc68003520 con 0x7fbc680039b0 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.722+0000 7fbc77fff640 1 --2- 172.21.15.81:0/2599875729 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc68004800 0x7fbc68004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.722+0000 7fbc7ca9f640 1 --2- 172.21.15.81:0/2599875729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc680039b0 0x7fbc68003dd0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c001720 tx=0x7fbc68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeaf7ec94c9f89b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.722+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c001370 con 0x7fbc680039b0 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.722+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc6c0052d0 con 0x7fbc680039b0 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.722+0000 7fbc777fe640 1 -- 172.21.15.81:0/2599875729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c02ab90 con 0x7fbc680039b0 2024-09-16T01:23:18.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.723+0000 7fbc7ed03640 1 -- 172.21.15.81:0/2599875729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc680039b0 msgr2=0x7fbc68003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.723+0000 7fbc7ed03640 1 --2- 172.21.15.81:0/2599875729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc680039b0 0x7fbc68003dd0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c001720 tx=0x7fbc68005830 comp rx=0 tx=0).stop 2024-09-16T01:23:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.723+0000 7fbc7ed03640 1 -- 172.21.15.81:0/2599875729 shutdown_connections 2024-09-16T01:23:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.723+0000 7fbc7ed03640 1 --2- 172.21.15.81:0/2599875729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc680039b0 0x7fbc68003dd0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.723+0000 7fbc7ed03640 1 -- 172.21.15.81:0/2599875729 >> 172.21.15.81:0/2599875729 conn(0x7fbc7808bfc0 msgr2=0x7fbc780d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.723+0000 7fbc7ed03640 1 -- 172.21.15.81:0/2599875729 shutdown_connections 2024-09-16T01:23:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.723+0000 7fbc7ed03640 1 -- 172.21.15.81:0/2599875729 wait complete. 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.724+0000 7fbc7ed03640 1 Processor -- start 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.724+0000 7fbc7ed03640 1 -- start start 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc7ed03640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc680039b0 0x7fbc781f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc7ed03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc7815cb80 0x7fbc780b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc7ed03640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc780b47b0 0x7fbc780b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc7ed03640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7806dbb0 con 0x7fbc7815cb80 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc7ed03640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbc78163270 con 0x7fbc780b47b0 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc7ed03640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbc780d52d0 con 0x7fbc680039b0 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc77fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc7815cb80 0x7fbc780b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc77fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc7815cb80 0x7fbc780b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44114/0 (socket says 172.21.15.81:44114) 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc77fff640 1 -- 172.21.15.81:0/3412039364 learned_addr learned my addr 172.21.15.81:0/3412039364 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc7ca9f640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc680039b0 0x7fbc781f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:18.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc7d2a0640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc780b47b0 0x7fbc780b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc77fff640 1 -- 172.21.15.81:0/3412039364 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc680039b0 msgr2=0x7fbc781f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc77fff640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc680039b0 0x7fbc781f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc77fff640 1 -- 172.21.15.81:0/3412039364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc780b47b0 msgr2=0x7fbc780b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc77fff640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc780b47b0 0x7fbc780b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.725+0000 7fbc77fff640 1 -- 172.21.15.81:0/3412039364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc780b2290 con 0x7fbc7815cb80 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.726+0000 7fbc77fff640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc7815cb80 0x7fbc780b3330 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400e7b0 tx=0x7fbc6400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.726+0000 7fbc757fa640 1 -- 172.21.15.81:0/3412039364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6400ee60 con 0x7fbc7815cb80 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.726+0000 7fbc757fa640 1 -- 172.21.15.81:0/3412039364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc64018070 con 0x7fbc7815cb80 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.726+0000 7fbc7ed03640 1 -- 172.21.15.81:0/3412039364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc780b2570 con 0x7fbc7815cb80 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.726+0000 7fbc757fa640 1 -- 172.21.15.81:0/3412039364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc640074e0 con 0x7fbc7815cb80 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.726+0000 7fbc7ed03640 1 -- 172.21.15.81:0/3412039364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc780b2b30 con 0x7fbc7815cb80 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.727+0000 7fbc7ed03640 1 -- 172.21.15.81:0/3412039364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc780d0400 con 0x7fbc7815cb80 2024-09-16T01:23:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.727+0000 7fbc757fa640 1 -- 172.21.15.81:0/3412039364 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbc640057a0 con 0x7fbc7815cb80 2024-09-16T01:23:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.728+0000 7fbc757fa640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbc5c06c2e0 0x7fbc5c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.728+0000 7fbc757fa640 1 -- 172.21.15.81:0/3412039364 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 6001+0+0 (secure 0 0 0) 0x7fbc6408b280 con 0x7fbc7815cb80 2024-09-16T01:23:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.728+0000 7fbc7ca9f640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbc5c06c2e0 0x7fbc5c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.728+0000 7fbc7ca9f640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbc5c06c2e0 0x7fbc5c06e7a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c032000 tx=0x7fbc6c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.732+0000 7fbc757fa640 1 -- 172.21.15.81:0/3412039364 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc64059950 con 0x7fbc7815cb80 2024-09-16T01:23:18.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:18.929+0000 7fbc7ed03640 1 -- 172.21.15.81:0/3412039364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbc7808e640 con 0x7fbc7815cb80 2024-09-16T01:23:19.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.587+0000 7fbc757fa640 1 -- 172.21.15.81:0/3412039364 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v73) ==== 174+0+0 (secure 0 0 0) 0x7fbc64059250 con 0x7fbc7815cb80 2024-09-16T01:23:19.589 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 21 and data pool 22 2024-09-16T01:23:19.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.591+0000 7fbc7ed03640 1 -- 172.21.15.81:0/3412039364 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbc5c06c2e0 msgr2=0x7fbc5c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.591+0000 7fbc7ed03640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbc5c06c2e0 0x7fbc5c06e7a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c032000 tx=0x7fbc6c02e000 comp rx=0 tx=0).stop 2024-09-16T01:23:19.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.592+0000 7fbc7ed03640 1 -- 172.21.15.81:0/3412039364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc7815cb80 msgr2=0x7fbc780b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.592+0000 7fbc7ed03640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc7815cb80 0x7fbc780b3330 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fbc6400e7b0 tx=0x7fbc6400ec70 comp rx=0 tx=0).stop 2024-09-16T01:23:19.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.592+0000 7fbc7ed03640 1 -- 172.21.15.81:0/3412039364 shutdown_connections 2024-09-16T01:23:19.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.592+0000 7fbc7ed03640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbc5c06c2e0 0x7fbc5c06e7a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.592+0000 7fbc7ed03640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc780b47b0 0x7fbc780b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.592+0000 7fbc7ed03640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc7815cb80 0x7fbc780b3330 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.592+0000 7fbc7ed03640 1 --2- 172.21.15.81:0/3412039364 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbc680039b0 0x7fbc781f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.592+0000 7fbc7ed03640 1 -- 172.21.15.81:0/3412039364 >> 172.21.15.81:0/3412039364 conn(0x7fbc7808bfc0 msgr2=0x7fbc780d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:19.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.592+0000 7fbc7ed03640 1 -- 172.21.15.81:0/3412039364 shutdown_connections 2024-09-16T01:23:19.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.593+0000 7fbc7ed03640 1 -- 172.21.15.81:0/3412039364 wait complete. 2024-09-16T01:23:19.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:23:19.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.727+0000 7f033d786640 1 Processor -- start 2024-09-16T01:23:19.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.727+0000 7f033d786640 1 -- start start 2024-09-16T01:23:19.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.728+0000 7f033d786640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0338162060 0x7f03380b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.728+0000 7f033d786640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033806d9f0 con 0x7f0338161c80 2024-09-16T01:23:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.728+0000 7f033d786640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033806dcd0 con 0x7f03380b64b0 2024-09-16T01:23:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.728+0000 7f033d786640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f033806dfb0 con 0x7f0338162060 2024-09-16T01:23:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.728+0000 7f0336ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0338161c80 0x7f033806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58974/0 (socket says 172.21.15.81:58974) 2024-09-16T01:23:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.728+0000 7f0336ffd640 1 -- 172.21.15.81:0/4125435247 learned_addr learned my addr 172.21.15.81:0/4125435247 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.728+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1481562508 0 0) 0x7f033806d9f0 con 0x7f0338161c80 2024-09-16T01:23:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.728+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0320003520 con 0x7f0338161c80 2024-09-16T01:23:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.728+0000 7f03367fc640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0338162060 0x7f03380b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 410969406 0 0) 0x7f0320003520 con 0x7f0338161c80 2024-09-16T01:23:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0338162060 msgr2=0x7f03380b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0338162060 0x7f03380b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 >> v1:172.21.15.102:6789/0 conn(0x7f03380b64b0 legacy=0x7f03380cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03380d2890 con 0x7f0338161c80 2024-09-16T01:23:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f0328001670 con 0x7f0338161c80 2024-09-16T01:23:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 >> v1:172.21.15.81:6789/0 conn(0x7f0338161c80 legacy=0x7f033806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03200039e0 0x7f0320003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0320004800 0x7f0320004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03200051c0 0x7f032000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f033806dfb0 con 0x7f0320004800 2024-09-16T01:23:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f032000c060 con 0x7f03200039e0 2024-09-16T01:23:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f032000c260 con 0x7f03200051c0 2024-09-16T01:23:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f03367fc640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0338162060 0x7f03380b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f03367fc640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0320004800 0x7f0320004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f0336ffd640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03200039e0 0x7f0320003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f03377fe640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03200051c0 0x7f032000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f03367fc640 1 -- 172.21.15.81:0/4125435247 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03200051c0 msgr2=0x7f032000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f03367fc640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03200051c0 0x7f032000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f03367fc640 1 -- 172.21.15.81:0/4125435247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03200039e0 msgr2=0x7f0320003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f03367fc640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03200039e0 0x7f0320003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.729+0000 7f03367fc640 1 -- 172.21.15.81:0/4125435247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0320003520 con 0x7f0320004800 2024-09-16T01:23:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.730+0000 7f03367fc640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0320004800 0x7f0320004c80 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f0338162460 tx=0x7f0320005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aaa0b4b98f1401a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.730+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c037070 con 0x7f0320004800 2024-09-16T01:23:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.730+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032c02aa90 con 0x7f0320004800 2024-09-16T01:23:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.730+0000 7f0335ffb640 1 -- 172.21.15.81:0/4125435247 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c00f040 con 0x7f0320004800 2024-09-16T01:23:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.730+0000 7f033d786640 1 -- 172.21.15.81:0/4125435247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0320004800 msgr2=0x7f0320004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.730+0000 7f033d786640 1 --2- 172.21.15.81:0/4125435247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0320004800 0x7f0320004c80 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f0338162460 tx=0x7f0320005830 comp rx=0 tx=0).stop 2024-09-16T01:23:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.730+0000 7f03377fe640 1 -- 172.21.15.81:0/4125435247 reap_dead start 2024-09-16T01:23:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.730+0000 7f033d786640 1 -- 172.21.15.81:0/4125435247 shutdown_connections 2024-09-16T01:23:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.730+0000 7f033d786640 1 -- 172.21.15.81:0/4125435247 >> 172.21.15.81:0/4125435247 conn(0x7f03380d44f0 msgr2=0x7f03380d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.731+0000 7f033d786640 1 -- 172.21.15.81:0/4125435247 shutdown_connections 2024-09-16T01:23:19.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.731+0000 7f033d786640 1 -- 172.21.15.81:0/4125435247 wait complete. 2024-09-16T01:23:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.732+0000 7f033d786640 1 Processor -- start 2024-09-16T01:23:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.732+0000 7f033d786640 1 -- start start 2024-09-16T01:23:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f033d786640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0320004800 0x7f0338159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f033d786640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03380cb5c0 0x7f03380c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f033d786640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03380cba40 0x7f03380cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f033d786640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f03380b6300 con 0x7f03380cba40 2024-09-16T01:23:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f033d786640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03380b6180 con 0x7f0320004800 2024-09-16T01:23:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f033d786640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f03380b93b0 con 0x7f03380cb5c0 2024-09-16T01:23:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f03377fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03380cba40 0x7f03380cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f03377fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03380cba40 0x7f03380cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44124/0 (socket says 172.21.15.81:44124) 2024-09-16T01:23:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f03377fe640 1 -- 172.21.15.81:0/1535331044 learned_addr learned my addr 172.21.15.81:0/1535331044 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f0336ffd640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0320004800 0x7f0338159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f03367fc640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03380cb5c0 0x7f03380c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f03377fe640 1 -- 172.21.15.81:0/1535331044 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03380cb5c0 msgr2=0x7f03380c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f03377fe640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03380cb5c0 0x7f03380c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f03377fe640 1 -- 172.21.15.81:0/1535331044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0320004800 msgr2=0x7f0338159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f03377fe640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0320004800 0x7f0338159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f03377fe640 1 -- 172.21.15.81:0/1535331044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03380b8ac0 con 0x7f03380cba40 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f03377fe640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03380cba40 0x7f03380cf1e0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f033806ed60 tx=0x7f033000fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f031f7fe640 1 -- 172.21.15.81:0/1535331044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330003b80 con 0x7f03380cba40 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f031f7fe640 1 -- 172.21.15.81:0/1535331044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0330018070 con 0x7f03380cba40 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f033d786640 1 -- 172.21.15.81:0/1535331044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03380b8d60 con 0x7f03380cba40 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f031f7fe640 1 -- 172.21.15.81:0/1535331044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03300050d0 con 0x7f03380cba40 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.733+0000 7f033d786640 1 -- 172.21.15.81:0/1535331044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03380c9a30 con 0x7f03380cba40 2024-09-16T01:23:19.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.734+0000 7f033d786640 1 -- 172.21.15.81:0/1535331044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03380b6960 con 0x7f03380cba40 2024-09-16T01:23:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.735+0000 7f031f7fe640 1 -- 172.21.15.81:0/1535331044 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0330005270 con 0x7f03380cba40 2024-09-16T01:23:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.735+0000 7f031f7fe640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f032406c2b0 0x7f032406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.736+0000 7f031f7fe640 1 -- 172.21.15.81:0/1535331044 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 6101+0+0 (secure 0 0 0) 0x7f033008b2e0 con 0x7f03380cba40 2024-09-16T01:23:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.736+0000 7f0336ffd640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f032406c2b0 0x7f032406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.736+0000 7f0336ffd640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f032406c2b0 0x7f032406e770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0328007fd0 tx=0x7f0328001c30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:19.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.740+0000 7f031f7fe640 1 -- 172.21.15.81:0/1535331044 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0330059300 con 0x7f03380cba40 2024-09-16T01:23:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.906+0000 7f033d786640 1 -- 172.21.15.81:0/1535331044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03380ba470 con 0x7f03380cba40 2024-09-16T01:23:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.907+0000 7f031f7fe640 1 -- 172.21.15.81:0/1535331044 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+16965 (secure 0 0 0) 0x7f033005d600 con 0x7f03380cba40 2024-09-16T01:23:19.909 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:19.909 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":136,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:23:18.931828+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:23:17.268973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-16T01:23:17.902232+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:23:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.909+0000 7f033d786640 1 -- 172.21.15.81:0/1535331044 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f032406c2b0 msgr2=0x7f032406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.909+0000 7f033d786640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f032406c2b0 0x7f032406e770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0328007fd0 tx=0x7f0328001c30 comp rx=0 tx=0).stop 2024-09-16T01:23:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.909+0000 7f033d786640 1 -- 172.21.15.81:0/1535331044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03380cba40 msgr2=0x7f03380cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.909+0000 7f033d786640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03380cba40 0x7f03380cf1e0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f033806ed60 tx=0x7f033000fd40 comp rx=0 tx=0).stop 2024-09-16T01:23:19.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.909+0000 7f033d786640 1 -- 172.21.15.81:0/1535331044 shutdown_connections 2024-09-16T01:23:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.909+0000 7f033d786640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f032406c2b0 0x7f032406e770 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.909+0000 7f033d786640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03380cba40 0x7f03380cf1e0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.909+0000 7f033d786640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03380cb5c0 0x7f03380c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.909+0000 7f033d786640 1 --2- 172.21.15.81:0/1535331044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0320004800 0x7f0338159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.909+0000 7f033d786640 1 -- 172.21.15.81:0/1535331044 >> 172.21.15.81:0/1535331044 conn(0x7f03380d44f0 msgr2=0x7f03380d3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.909+0000 7f033d786640 1 -- 172.21.15.81:0/1535331044 shutdown_connections 2024-09-16T01:23:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:19.909+0000 7f033d786640 1 -- 172.21.15.81:0/1535331044 wait complete. 2024-09-16T01:23:19.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:23:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.019+0000 7f984a04c640 1 Processor -- start 2024-09-16T01:23:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.019+0000 7f984a04c640 1 -- start start 2024-09-16T01:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.019+0000 7f984a04c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f98440b43f0 0x7f984409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f984a04c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f98440b5050 0x7f984415b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f984a04c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98440b3830 con 0x7f984415b340 2024-09-16T01:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f984a04c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f98440b5bd0 con 0x7f98440b5050 2024-09-16T01:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f984a04c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f98440b5610 con 0x7f98440b43f0 2024-09-16T01:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f9842ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f98440b43f0 0x7f984409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f9843fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f98440b5050 0x7f984415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f98437fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f984415b340 0x7f98440b4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:33042/0 (socket says 172.21.15.81:33042) 2024-09-16T01:23:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f9843fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f98440b5050 0x7f984415b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:44014/0 (socket says 172.21.15.81:44014) 2024-09-16T01:23:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f98437fe640 1 -- 172.21.15.81:0/2629931890 learned_addr learned my addr 172.21.15.81:0/2629931890 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f9842ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f98440b43f0 0x7f984409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:57782/0 (socket says 172.21.15.81:57782) 2024-09-16T01:23:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f9842ffd640 1 -- 172.21.15.81:0/2629931890 >> v2:172.21.15.102:3300/0 conn(0x7f98440b5050 msgr2=0x7f984415b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f9842ffd640 1 --2- 172.21.15.81:0/2629931890 >> v2:172.21.15.102:3300/0 conn(0x7f98440b5050 0x7f984415b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f9842ffd640 1 -- 172.21.15.81:0/2629931890 >> v1:172.21.15.102:6789/0 conn(0x7f984415b340 legacy=0x7f98440b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f9842ffd640 1 -- 172.21.15.81:0/2629931890 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98440b58f0 con 0x7f98440b43f0 2024-09-16T01:23:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.020+0000 7f9843fff640 1 --2- 172.21.15.81:0/2629931890 >> v2:172.21.15.102:3300/0 conn(0x7f98440b5050 0x7f984415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.021+0000 7f9842ffd640 1 --2- 172.21.15.81:0/2629931890 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f98440b43f0 0x7f984409aa30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f98380097a0 tx=0x7f983802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61811851bec46851 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.021+0000 7f98427fc640 1 -- 172.21.15.81:0/2629931890 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9838037070 con 0x7f98440b43f0 2024-09-16T01:23:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.021+0000 7f98427fc640 1 -- 172.21.15.81:0/2629931890 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9838032440 con 0x7f98440b43f0 2024-09-16T01:23:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.021+0000 7f98427fc640 1 -- 172.21.15.81:0/2629931890 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9838032810 con 0x7f98440b43f0 2024-09-16T01:23:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.022+0000 7f984a04c640 1 -- 172.21.15.81:0/2629931890 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f98440b43f0 msgr2=0x7f984409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.022+0000 7f984a04c640 1 --2- 172.21.15.81:0/2629931890 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f98440b43f0 0x7f984409aa30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f98380097a0 tx=0x7f983802a210 comp rx=0 tx=0).stop 2024-09-16T01:23:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.022+0000 7f984a04c640 1 -- 172.21.15.81:0/2629931890 shutdown_connections 2024-09-16T01:23:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.022+0000 7f984a04c640 1 --2- 172.21.15.81:0/2629931890 >> v2:172.21.15.102:3300/0 conn(0x7f98440b5050 0x7f984415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.022+0000 7f984a04c640 1 --2- 172.21.15.81:0/2629931890 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f98440b43f0 0x7f984409aa30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.022+0000 7f984a04c640 1 -- 172.21.15.81:0/2629931890 >> 172.21.15.81:0/2629931890 conn(0x7f9844073490 msgr2=0x7f98440b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.022+0000 7f984a04c640 1 -- 172.21.15.81:0/2629931890 shutdown_connections 2024-09-16T01:23:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.022+0000 7f984a04c640 1 -- 172.21.15.81:0/2629931890 wait complete. 2024-09-16T01:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.023+0000 7f984a04c640 1 Processor -- start 2024-09-16T01:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.023+0000 7f984a04c640 1 -- start start 2024-09-16T01:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f984a04c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f98440b43f0 0x7f98441469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f984a04c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98440b5050 0x7f9844149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f984a04c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f984415b340 0x7f984406c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f984a04c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f98440cdb30 con 0x7f98440b5050 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f984a04c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f984415d8f0 con 0x7f984415b340 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f984a04c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f98440cdcb0 con 0x7f98440b43f0 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f9842ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98440b5050 0x7f9844149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f9842ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98440b5050 0x7f9844149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44138/0 (socket says 172.21.15.81:44138) 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f9842ffd640 1 -- 172.21.15.81:0/1156182570 learned_addr learned my addr 172.21.15.81:0/1156182570 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f9843fff640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f984415b340 0x7f984406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f98437fe640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f98440b43f0 0x7f98441469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f9842ffd640 1 -- 172.21.15.81:0/1156182570 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f98440b43f0 msgr2=0x7f98441469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f9842ffd640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f98440b43f0 0x7f98441469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f9842ffd640 1 -- 172.21.15.81:0/1156182570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f984415b340 msgr2=0x7f984406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f9842ffd640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f984415b340 0x7f984406c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f9842ffd640 1 -- 172.21.15.81:0/1156182570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984406c9c0 con 0x7f98440b5050 2024-09-16T01:23:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.024+0000 7f9842ffd640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98440b5050 0x7f9844149780 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f983802a250 tx=0x7f98380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.025+0000 7f982bfff640 1 -- 172.21.15.81:0/1156182570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9838041020 con 0x7f98440b5050 2024-09-16T01:23:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.025+0000 7f982bfff640 1 -- 172.21.15.81:0/1156182570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9838030640 con 0x7f98440b5050 2024-09-16T01:23:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.025+0000 7f982bfff640 1 -- 172.21.15.81:0/1156182570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9838037040 con 0x7f98440b5050 2024-09-16T01:23:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.025+0000 7f984a04c640 1 -- 172.21.15.81:0/1156182570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9844148ca0 con 0x7f98440b5050 2024-09-16T01:23:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.025+0000 7f984a04c640 1 -- 172.21.15.81:0/1156182570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9844146f00 con 0x7f98440b5050 2024-09-16T01:23:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.026+0000 7f984a04c640 1 -- 172.21.15.81:0/1156182570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9844148aa0 con 0x7f98440b5050 2024-09-16T01:23:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.026+0000 7f982bfff640 1 -- 172.21.15.81:0/1156182570 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9838044020 con 0x7f98440b5050 2024-09-16T01:23:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.027+0000 7f982bfff640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f983006c2b0 0x7f983006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.027+0000 7f98437fe640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f983006c2b0 0x7f983006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.027+0000 7f982bfff640 1 -- 172.21.15.81:0/1156182570 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 6101+0+0 (secure 0 0 0) 0x7f98380abc40 con 0x7f98440b5050 2024-09-16T01:23:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.027+0000 7f98437fe640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f983006c2b0 0x7f983006e770 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9834007fd0 tx=0x7f9834007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.031+0000 7f982bfff640 1 -- 172.21.15.81:0/1156182570 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f983804b030 con 0x7f98440b5050 2024-09-16T01:23:20.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.202+0000 7f984a04c640 1 -- 172.21.15.81:0/1156182570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f984406fee0 con 0x7f98440b5050 2024-09-16T01:23:20.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.203+0000 7f982bfff640 1 -- 172.21.15.81:0/1156182570 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) ==== 74+0+16965 (secure 0 0 0) 0x7f983807a230 con 0x7f98440b5050 2024-09-16T01:23:20.205 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:20.205 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":136,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:23:18.931828+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:23:17.268973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-16T01:23:17.902232+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:23:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.205+0000 7f984a04c640 1 -- 172.21.15.81:0/1156182570 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f983006c2b0 msgr2=0x7f983006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.205+0000 7f984a04c640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f983006c2b0 0x7f983006e770 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9834007fd0 tx=0x7f9834007e80 comp rx=0 tx=0).stop 2024-09-16T01:23:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.205+0000 7f984a04c640 1 -- 172.21.15.81:0/1156182570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98440b5050 msgr2=0x7f9844149780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.205+0000 7f984a04c640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98440b5050 0x7f9844149780 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f983802a250 tx=0x7f98380046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.205+0000 7f984a04c640 1 -- 172.21.15.81:0/1156182570 shutdown_connections 2024-09-16T01:23:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.205+0000 7f984a04c640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f983006c2b0 0x7f983006e770 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.205+0000 7f984a04c640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f984415b340 0x7f984406c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.205+0000 7f984a04c640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98440b5050 0x7f9844149780 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.205+0000 7f984a04c640 1 --2- 172.21.15.81:0/1156182570 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f98440b43f0 0x7f98441469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.205+0000 7f984a04c640 1 -- 172.21.15.81:0/1156182570 >> 172.21.15.81:0/1156182570 conn(0x7f9844073490 msgr2=0x7f98440cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:20.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.205+0000 7f984a04c640 1 -- 172.21.15.81:0/1156182570 shutdown_connections 2024-09-16T01:23:20.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.205+0000 7f984a04c640 1 -- 172.21.15.81:0/1156182570 wait complete. 2024-09-16T01:23:20.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:23:20.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.317+0000 7fb0b6a96640 1 Processor -- start 2024-09-16T01:23:20.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.317+0000 7fb0b6a96640 1 -- start start 2024-09-16T01:23:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.317+0000 7fb0b6a96640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0b00b5fe0 0x7fb0b00aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.317+0000 7fb0b6a96640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b00ae240 con 0x7fb0b006bc10 2024-09-16T01:23:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.317+0000 7fb0b6a96640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0b00ae520 con 0x7fb0b015e410 2024-09-16T01:23:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.317+0000 7fb0b6a96640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b00b6430 con 0x7fb0b00b5fe0 2024-09-16T01:23:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0b5033640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb0b006bc10 0x7fb0b00aefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58978/0 (socket says 172.21.15.81:58978) 2024-09-16T01:23:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0b5033640 1 -- 172.21.15.81:0/1290802225 learned_addr learned my addr 172.21.15.81:0/1290802225 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0affff640 1 --2- 172.21.15.81:0/1290802225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0b00b5fe0 0x7fb0b00aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1270463556 0 0) 0x7fb0b00ae240 con 0x7fb0b006bc10 2024-09-16T01:23:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb09c003520 con 0x7fb0b006bc10 2024-09-16T01:23:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2943811103 0 0) 0x7fb09c003520 con 0x7fb0b006bc10 2024-09-16T01:23:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0b00b5fe0 msgr2=0x7fb0b00aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 --2- 172.21.15.81:0/1290802225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0b00b5fe0 0x7fb0b00aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 >> v1:172.21.15.102:6789/0 conn(0x7fb0b015e410 legacy=0x7fb0b00b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b00ae800 con 0x7fb0b006bc10 2024-09-16T01:23:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fb098001670 con 0x7fb0b006bc10 2024-09-16T01:23:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 >> v1:172.21.15.81:6789/0 conn(0x7fb0b006bc10 legacy=0x7fb0b00aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 --2- 172.21.15.81:0/1290802225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c0039e0 0x7fb09c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 --2- 172.21.15.81:0/1290802225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb09c004390 0x7fb09c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 --2- 172.21.15.81:0/1290802225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0b00b5fe0 0x7fb09c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb09c00ba70 con 0x7fb09c0039e0 2024-09-16T01:23:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb09c00bc20 con 0x7fb09c004390 2024-09-16T01:23:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb09c00be20 con 0x7fb0b00b5fe0 2024-09-16T01:23:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0b4832640 1 --2- 172.21.15.81:0/1290802225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c0039e0 0x7fb09c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0affff640 1 --2- 172.21.15.81:0/1290802225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb09c004390 0x7fb09c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.318+0000 7fb0b5033640 1 --2- 172.21.15.81:0/1290802225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0b00b5fe0 0x7fb09c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.319+0000 7fb0b4832640 1 -- 172.21.15.81:0/1290802225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0b00b5fe0 msgr2=0x7fb09c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.319+0000 7fb0b4832640 1 --2- 172.21.15.81:0/1290802225 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0b00b5fe0 0x7fb09c005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.319+0000 7fb0b4832640 1 -- 172.21.15.81:0/1290802225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb09c004390 msgr2=0x7fb09c004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.319+0000 7fb0b4832640 1 --2- 172.21.15.81:0/1290802225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb09c004390 0x7fb09c004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.319+0000 7fb0b4832640 1 -- 172.21.15.81:0/1290802225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb09c003520 con 0x7fb09c0039e0 2024-09-16T01:23:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.319+0000 7fb0b4832640 1 --2- 172.21.15.81:0/1290802225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c0039e0 0x7fb09c003dc0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8002010 tx=0x7fb09c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3173ec6a9f4e79 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.319+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8036070 con 0x7fb09c0039e0 2024-09-16T01:23:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.319+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a8031600 con 0x7fb09c0039e0 2024-09-16T01:23:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.319+0000 7fb0af7fe640 1 -- 172.21.15.81:0/1290802225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8001be0 con 0x7fb09c0039e0 2024-09-16T01:23:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.320+0000 7fb0b6a96640 1 -- 172.21.15.81:0/1290802225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c0039e0 msgr2=0x7fb09c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.320+0000 7fb0b6a96640 1 --2- 172.21.15.81:0/1290802225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb09c0039e0 0x7fb09c003dc0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8002010 tx=0x7fb09c005830 comp rx=0 tx=0).stop 2024-09-16T01:23:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.320+0000 7fb0b5033640 1 -- 172.21.15.81:0/1290802225 reap_dead start 2024-09-16T01:23:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.320+0000 7fb0b6a96640 1 -- 172.21.15.81:0/1290802225 shutdown_connections 2024-09-16T01:23:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.320+0000 7fb0b6a96640 1 -- 172.21.15.81:0/1290802225 >> 172.21.15.81:0/1290802225 conn(0x7fb0b009aa30 msgr2=0x7fb0b00b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.320+0000 7fb0b6a96640 1 -- 172.21.15.81:0/1290802225 shutdown_connections 2024-09-16T01:23:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.320+0000 7fb0b6a96640 1 -- 172.21.15.81:0/1290802225 wait complete. 2024-09-16T01:23:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.321+0000 7fb0b6a96640 1 Processor -- start 2024-09-16T01:23:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.321+0000 7fb0b6a96640 1 -- start start 2024-09-16T01:23:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0b6a96640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb09c0039e0 0x7fb0b015d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0b6a96640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b015ba50 0x7fb0b0144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0b6a96640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0b0145110 0x7fb0b01458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0b6a96640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b015e970 con 0x7fb0b015ba50 2024-09-16T01:23:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0b6a96640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b015e7f0 con 0x7fb0b0145110 2024-09-16T01:23:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0b6a96640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b00af6f0 con 0x7fb09c0039e0 2024-09-16T01:23:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b015ba50 0x7fb0b0144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b015ba50 0x7fb0b0144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44160/0 (socket says 172.21.15.81:44160) 2024-09-16T01:23:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0affff640 1 -- 172.21.15.81:0/3435931171 learned_addr learned my addr 172.21.15.81:0/3435931171 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0b4832640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb09c0039e0 0x7fb0b015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0b5033640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0b0145110 0x7fb0b01458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0affff640 1 -- 172.21.15.81:0/3435931171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb09c0039e0 msgr2=0x7fb0b015d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0affff640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb09c0039e0 0x7fb0b015d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0affff640 1 -- 172.21.15.81:0/3435931171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0b0145110 msgr2=0x7fb0b01458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0affff640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0b0145110 0x7fb0b01458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.322+0000 7fb0affff640 1 -- 172.21.15.81:0/3435931171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b0145590 con 0x7fb0b015ba50 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.323+0000 7fb0affff640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b015ba50 0x7fb0b0144bd0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0011910 tx=0x7fb0a0011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.323+0000 7fb0ad7fa640 1 -- 172.21.15.81:0/3435931171 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000faf0 con 0x7fb0b015ba50 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.323+0000 7fb0ad7fa640 1 -- 172.21.15.81:0/3435931171 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0a000fc90 con 0x7fb0b015ba50 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.323+0000 7fb0b6a96640 1 -- 172.21.15.81:0/3435931171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b015bfe0 con 0x7fb0b015ba50 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.323+0000 7fb0ad7fa640 1 -- 172.21.15.81:0/3435931171 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0014440 con 0x7fb0b015ba50 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.323+0000 7fb0b6a96640 1 -- 172.21.15.81:0/3435931171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b015c5a0 con 0x7fb0b015ba50 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.324+0000 7fb0b6a96640 1 -- 172.21.15.81:0/3435931171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b00afac0 con 0x7fb0b015ba50 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.324+0000 7fb0ad7fa640 1 -- 172.21.15.81:0/3435931171 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb0a0012040 con 0x7fb0b015ba50 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.325+0000 7fb0ad7fa640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb09006c2b0 0x7fb09006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.325+0000 7fb0ad7fa640 1 -- 172.21.15.81:0/3435931171 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 6101+0+0 (secure 0 0 0) 0x7fb0a008b970 con 0x7fb0b015ba50 2024-09-16T01:23:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.325+0000 7fb0b4832640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb09006c2b0 0x7fb09006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.325+0000 7fb0b4832640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb09006c2b0 0x7fb09006e770 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8033000 tx=0x7fb0a8009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:20.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.329+0000 7fb0ad7fa640 1 -- 172.21.15.81:0/3435931171 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0a0019030 con 0x7fb0b015ba50 2024-09-16T01:23:20.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.529+0000 7fb0b6a96640 1 -- 172.21.15.81:0/3435931171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb0b00b6640 con 0x7fb0b015ba50 2024-09-16T01:23:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.603+0000 7fb0ad7fa640 1 -- 172.21.15.81:0/3435931171 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v74) ==== 118+0+0 (secure 0 0 0) 0x7fb0a0059900 con 0x7fb0b015ba50 2024-09-16T01:23:20.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.606+0000 7fb0b6a96640 1 -- 172.21.15.81:0/3435931171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb09006c2b0 msgr2=0x7fb09006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.606+0000 7fb0b6a96640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb09006c2b0 0x7fb09006e770 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8033000 tx=0x7fb0a8009030 comp rx=0 tx=0).stop 2024-09-16T01:23:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.606+0000 7fb0b6a96640 1 -- 172.21.15.81:0/3435931171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b015ba50 msgr2=0x7fb0b0144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.606+0000 7fb0b6a96640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b015ba50 0x7fb0b0144bd0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fb0a0011910 tx=0x7fb0a0011dd0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.606+0000 7fb0b6a96640 1 -- 172.21.15.81:0/3435931171 shutdown_connections 2024-09-16T01:23:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.606+0000 7fb0b6a96640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb09006c2b0 0x7fb09006e770 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.606+0000 7fb0b6a96640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0b0145110 0x7fb0b01458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.606+0000 7fb0b6a96640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0b015ba50 0x7fb0b0144bd0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.606+0000 7fb0b6a96640 1 --2- 172.21.15.81:0/3435931171 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb09c0039e0 0x7fb0b015d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.606+0000 7fb0b6a96640 1 -- 172.21.15.81:0/3435931171 >> 172.21.15.81:0/3435931171 conn(0x7fb0b009aa30 msgr2=0x7fb0b00b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.606+0000 7fb0b6a96640 1 -- 172.21.15.81:0/3435931171 shutdown_connections 2024-09-16T01:23:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.606+0000 7fb0b6a96640 1 -- 172.21.15.81:0/3435931171 wait complete. 2024-09-16T01:23:20.619 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T01:23:20.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:23:20.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.719+0000 7f17231e4640 1 Processor -- start 2024-09-16T01:23:20.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.719+0000 7f17231e4640 1 -- start start 2024-09-16T01:23:20.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.720+0000 7f17231e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c162870 0x7f171c169200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.720+0000 7f17231e4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171c162ed0 con 0x7f171c155460 2024-09-16T01:23:20.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.720+0000 7f17231e4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171c15ede0 con 0x7f171c072980 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.720+0000 7f17231e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f171c15f430 con 0x7f171c162870 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.720+0000 7f1720f80640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f171c155460 0x7f171c072270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58984/0 (socket says 172.21.15.81:58984) 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.720+0000 7f1720f80640 1 -- 172.21.15.81:0/3026729685 learned_addr learned my addr 172.21.15.81:0/3026729685 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.720+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2011061081 0 0) 0x7f171c162ed0 con 0x7f171c155460 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.720+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1704003520 con 0x7f171c155460 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.720+0000 7f1721781640 1 --2- 172.21.15.81:0/3026729685 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c162870 0x7f171c169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3987826950 0 0) 0x7f1704003520 con 0x7f171c155460 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c162870 msgr2=0x7f171c169200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 --2- 172.21.15.81:0/3026729685 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c162870 0x7f171c169200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 >> v1:172.21.15.102:6789/0 conn(0x7f171c072980 legacy=0x7f171c162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171c15f0c0 con 0x7f171c155460 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f1718001670 con 0x7f171c155460 2024-09-16T01:23:20.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 >> v1:172.21.15.81:6789/0 conn(0x7f171c155460 legacy=0x7f171c072270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 --2- 172.21.15.81:0/3026729685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17040039e0 0x7f1704003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 --2- 172.21.15.81:0/3026729685 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c162870 0x7f1704004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 --2- 172.21.15.81:0/3026729685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1704004d40 0x7f17040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f171c15f430 con 0x7f17040039e0 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f170400ba70 con 0x7f1704004d40 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f170400bc70 con 0x7f171c162870 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f1720f80640 1 --2- 172.21.15.81:0/3026729685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17040039e0 0x7f1704003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f1713fff640 1 --2- 172.21.15.81:0/3026729685 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c162870 0x7f1704004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f1721781640 1 --2- 172.21.15.81:0/3026729685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1704004d40 0x7f17040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f1720f80640 1 -- 172.21.15.81:0/3026729685 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c162870 msgr2=0x7f1704004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f1720f80640 1 --2- 172.21.15.81:0/3026729685 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c162870 0x7f1704004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f1720f80640 1 -- 172.21.15.81:0/3026729685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1704004d40 msgr2=0x7f17040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f1720f80640 1 --2- 172.21.15.81:0/3026729685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1704004d40 0x7f17040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.721+0000 7f1720f80640 1 -- 172.21.15.81:0/3026729685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1704003520 con 0x7f17040039e0 2024-09-16T01:23:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.722+0000 7f1720f80640 1 --2- 172.21.15.81:0/3026729685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17040039e0 0x7f1704003e20 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f171800c210 tx=0x7f1704005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a995f971c401ea73 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.722+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718007cf0 con 0x7f17040039e0 2024-09-16T01:23:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.722+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1718005af0 con 0x7f17040039e0 2024-09-16T01:23:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.722+0000 7f17137fe640 1 -- 172.21.15.81:0/3026729685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718007070 con 0x7f17040039e0 2024-09-16T01:23:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.722+0000 7f17231e4640 1 -- 172.21.15.81:0/3026729685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17040039e0 msgr2=0x7f1704003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.722+0000 7f17231e4640 1 --2- 172.21.15.81:0/3026729685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17040039e0 0x7f1704003e20 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f171800c210 tx=0x7f1704005830 comp rx=0 tx=0).stop 2024-09-16T01:23:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.722+0000 7f1721781640 1 -- 172.21.15.81:0/3026729685 reap_dead start 2024-09-16T01:23:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.722+0000 7f17231e4640 1 -- 172.21.15.81:0/3026729685 shutdown_connections 2024-09-16T01:23:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.723+0000 7f17231e4640 1 -- 172.21.15.81:0/3026729685 >> 172.21.15.81:0/3026729685 conn(0x7f171c06bc10 msgr2=0x7f171c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.723+0000 7f17231e4640 1 -- 172.21.15.81:0/3026729685 shutdown_connections 2024-09-16T01:23:20.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.723+0000 7f17231e4640 1 -- 172.21.15.81:0/3026729685 wait complete. 2024-09-16T01:23:20.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.724+0000 7f17231e4640 1 Processor -- start 2024-09-16T01:23:20.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.724+0000 7f17231e4640 1 -- start start 2024-09-16T01:23:20.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f17231e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17040039e0 0x7f171c154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f17231e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c15a7a0 0x7f171c14f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f17231e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c157b50 0x7f171c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f17231e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f171c155840 con 0x7f171c157b50 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f17231e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f171c06f2e0 con 0x7f17040039e0 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f17231e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f171c1559c0 con 0x7f171c15a7a0 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f1721781640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c157b50 0x7f171c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f1721781640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c157b50 0x7f171c157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44180/0 (socket says 172.21.15.81:44180) 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f1721781640 1 -- 172.21.15.81:0/2835721634 learned_addr learned my addr 172.21.15.81:0/2835721634 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f1720f80640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17040039e0 0x7f171c154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f1713fff640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c15a7a0 0x7f171c14f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f1721781640 1 -- 172.21.15.81:0/2835721634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c15a7a0 msgr2=0x7f171c14f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f1721781640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c15a7a0 0x7f171c14f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f1721781640 1 -- 172.21.15.81:0/2835721634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17040039e0 msgr2=0x7f171c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f1721781640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17040039e0 0x7f171c154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:20.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f1721781640 1 -- 172.21.15.81:0/2835721634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171c161b30 con 0x7f171c157b50 2024-09-16T01:23:20.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f1721781640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c157b50 0x7f171c157fd0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f1714007d10 tx=0x7f17140115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:20.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f17117fa640 1 -- 172.21.15.81:0/2835721634 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714011de0 con 0x7f171c157b50 2024-09-16T01:23:20.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f17117fa640 1 -- 172.21.15.81:0/2835721634 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f171401b070 con 0x7f171c157b50 2024-09-16T01:23:20.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f17117fa640 1 -- 172.21.15.81:0/2835721634 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714003990 con 0x7f171c157b50 2024-09-16T01:23:20.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f17231e4640 1 -- 172.21.15.81:0/2835721634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f171c1591f0 con 0x7f171c157b50 2024-09-16T01:23:20.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.725+0000 7f17231e4640 1 -- 172.21.15.81:0/2835721634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f171c159490 con 0x7f171c157b50 2024-09-16T01:23:20.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.726+0000 7f17231e4640 1 -- 172.21.15.81:0/2835721634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f171c06cba0 con 0x7f171c157b50 2024-09-16T01:23:20.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.727+0000 7f17117fa640 1 -- 172.21.15.81:0/2835721634 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1714005d10 con 0x7f171c157b50 2024-09-16T01:23:20.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.727+0000 7f17117fa640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f170806c2e0 0x7f170806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:20.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.727+0000 7f17117fa640 1 -- 172.21.15.81:0/2835721634 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f171408b690 con 0x7f171c157b50 2024-09-16T01:23:20.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.727+0000 7f1720f80640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f170806c2e0 0x7f170806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:20.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.728+0000 7f1720f80640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f170806c2e0 0x7f170806e7a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1718032000 tx=0x7f1718034040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:20.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.731+0000 7f17117fa640 1 -- 172.21.15.81:0/2835721634 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f17140596b0 con 0x7f171c157b50 2024-09-16T01:23:20.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:20.932+0000 7f17231e4640 1 -- 172.21.15.81:0/2835721634 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f171c0b38d0 con 0x7f171c157b50 2024-09-16T01:23:21.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.884+0000 7f17117fa640 1 -- 172.21.15.81:0/2835721634 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v75) ==== 122+0+0 (secure 0 0 0) 0x7f171405d9b0 con 0x7f171c157b50 2024-09-16T01:23:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.886+0000 7f17231e4640 1 -- 172.21.15.81:0/2835721634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f170806c2e0 msgr2=0x7f170806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.886+0000 7f17231e4640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f170806c2e0 0x7f170806e7a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1718032000 tx=0x7f1718034040 comp rx=0 tx=0).stop 2024-09-16T01:23:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.886+0000 7f17231e4640 1 -- 172.21.15.81:0/2835721634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c157b50 msgr2=0x7f171c157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.886+0000 7f17231e4640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c157b50 0x7f171c157fd0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f1714007d10 tx=0x7f17140115a0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.887+0000 7f17231e4640 1 -- 172.21.15.81:0/2835721634 shutdown_connections 2024-09-16T01:23:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.887+0000 7f17231e4640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f170806c2e0 0x7f170806e7a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.887+0000 7f17231e4640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c157b50 0x7f171c157fd0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.887+0000 7f17231e4640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f171c15a7a0 0x7f171c14f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.887+0000 7f17231e4640 1 --2- 172.21.15.81:0/2835721634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f17040039e0 0x7f171c154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.887+0000 7f17231e4640 1 -- 172.21.15.81:0/2835721634 >> 172.21.15.81:0/2835721634 conn(0x7f171c06bc10 msgr2=0x7f171c0b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.887+0000 7f17231e4640 1 -- 172.21.15.81:0/2835721634 shutdown_connections 2024-09-16T01:23:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:21.887+0000 7f17231e4640 1 -- 172.21.15.81:0/2835721634 wait complete. 2024-09-16T01:23:21.901 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:23:21.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.004+0000 7f0cd0118640 1 Processor -- start 2024-09-16T01:23:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.004+0000 7f0cd0118640 1 -- start start 2024-09-16T01:23:22.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.005+0000 7f0cd0118640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0cc809aca0 0x7f0cc809b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.005+0000 7f0cd0118640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc809b5c0 0x7f0cc80d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.005+0000 7f0cd0118640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cc80d0b20 0x7f0cc8070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.005+0000 7f0cd0118640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc806d040 con 0x7f0cc80d0b20 2024-09-16T01:23:22.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.005+0000 7f0cd0118640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc80d12c0 con 0x7f0cc809aca0 2024-09-16T01:23:22.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.005+0000 7f0cd0118640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc80d15a0 con 0x7f0cc809b5c0 2024-09-16T01:23:22.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.005+0000 7f0cce6b5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cc80d0b20 0x7f0cc8070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.005+0000 7f0cce6b5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cc80d0b20 0x7f0cc8070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48788/0 (socket says 172.21.15.81:48788) 2024-09-16T01:23:22.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.005+0000 7f0cce6b5640 1 -- 172.21.15.81:0/3639607108 learned_addr learned my addr 172.21.15.81:0/3639607108 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:22.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.005+0000 7f0ccdeb4640 1 --2- 172.21.15.81:0/3639607108 >> v2:172.21.15.102:3300/0 conn(0x7f0cc809aca0 0x7f0cc809b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.006+0000 7f0ccd6b3640 1 --2- 172.21.15.81:0/3639607108 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc809b5c0 0x7f0cc80d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.006+0000 7f0cce6b5640 1 -- 172.21.15.81:0/3639607108 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc809b5c0 msgr2=0x7f0cc80d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:22.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.006+0000 7f0cce6b5640 1 --2- 172.21.15.81:0/3639607108 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc809b5c0 0x7f0cc80d05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.006+0000 7f0cce6b5640 1 -- 172.21.15.81:0/3639607108 >> v2:172.21.15.102:3300/0 conn(0x7f0cc809aca0 msgr2=0x7f0cc809b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:22.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.006+0000 7f0cce6b5640 1 --2- 172.21.15.81:0/3639607108 >> v2:172.21.15.102:3300/0 conn(0x7f0cc809aca0 0x7f0cc809b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.006+0000 7f0cce6b5640 1 -- 172.21.15.81:0/3639607108 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc80d1880 con 0x7f0cc80d0b20 2024-09-16T01:23:22.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.006+0000 7f0ccdeb4640 1 --2- 172.21.15.81:0/3639607108 >> v2:172.21.15.102:3300/0 conn(0x7f0cc809aca0 0x7f0cc809b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.006+0000 7f0cce6b5640 1 --2- 172.21.15.81:0/3639607108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc80d0b20 0x7f0cc8070740 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80733d0 tx=0x7f0cc002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a8379d41161555 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.006+0000 7f0ccceb2640 1 -- 172.21.15.81:0/3639607108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0037070 con 0x7f0cc80d0b20 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.006+0000 7f0ccceb2640 1 -- 172.21.15.81:0/3639607108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc0032440 con 0x7f0cc80d0b20 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.006+0000 7f0ccceb2640 1 -- 172.21.15.81:0/3639607108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0032810 con 0x7f0cc80d0b20 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.007+0000 7f0cd0118640 1 -- 172.21.15.81:0/3639607108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc80d0b20 msgr2=0x7f0cc8070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.007+0000 7f0cd0118640 1 --2- 172.21.15.81:0/3639607108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc80d0b20 0x7f0cc8070740 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80733d0 tx=0x7f0cc002a1e0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.007+0000 7f0cd0118640 1 -- 172.21.15.81:0/3639607108 shutdown_connections 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.007+0000 7f0cd0118640 1 --2- 172.21.15.81:0/3639607108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc80d0b20 0x7f0cc8070740 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.007+0000 7f0cd0118640 1 --2- 172.21.15.81:0/3639607108 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc809b5c0 0x7f0cc80d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.007+0000 7f0cd0118640 1 --2- 172.21.15.81:0/3639607108 >> v2:172.21.15.102:3300/0 conn(0x7f0cc809aca0 0x7f0cc809b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.007+0000 7f0cd0118640 1 -- 172.21.15.81:0/3639607108 >> 172.21.15.81:0/3639607108 conn(0x7f0cc80d23a0 msgr2=0x7f0cc80d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.007+0000 7f0cd0118640 1 -- 172.21.15.81:0/3639607108 shutdown_connections 2024-09-16T01:23:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.007+0000 7f0cd0118640 1 -- 172.21.15.81:0/3639607108 wait complete. 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.008+0000 7f0cd0118640 1 Processor -- start 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.008+0000 7f0cd0118640 1 -- start start 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0cd0118640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc809aca0 0x7f0cc81e48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0cd0118640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc809b5c0 0x7f0cc80b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0cd0118640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc80d0b20 0x7f0cc81548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0cd0118640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc80d0fd0 con 0x7f0cc809b5c0 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0cd0118640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc8070220 con 0x7f0cc80d0b20 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0cd0118640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc8070c80 con 0x7f0cc809aca0 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0ccd6b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc809b5c0 0x7f0cc80b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0ccd6b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc809b5c0 0x7f0cc80b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48800/0 (socket says 172.21.15.81:48800) 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0ccd6b3640 1 -- 172.21.15.81:0/1721525492 learned_addr learned my addr 172.21.15.81:0/1721525492 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0ccdeb4640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc809aca0 0x7f0cc81e48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0cce6b5640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc80d0b20 0x7f0cc81548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0ccd6b3640 1 -- 172.21.15.81:0/1721525492 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc809aca0 msgr2=0x7f0cc81e48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0ccd6b3640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc809aca0 0x7f0cc81e48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0ccd6b3640 1 -- 172.21.15.81:0/1721525492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc80d0b20 msgr2=0x7f0cc81548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0ccd6b3640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc80d0b20 0x7f0cc81548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.009+0000 7f0ccd6b3640 1 -- 172.21.15.81:0/1721525492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc80b5a00 con 0x7f0cc809b5c0 2024-09-16T01:23:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.010+0000 7f0ccd6b3640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc809b5c0 0x7f0cc80b51d0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400ce10 tx=0x7f0cc400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.010+0000 7f0cbe7fc640 1 -- 172.21.15.81:0/1721525492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4003b90 con 0x7f0cc809b5c0 2024-09-16T01:23:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.010+0000 7f0cbe7fc640 1 -- 172.21.15.81:0/1721525492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc4003d30 con 0x7f0cc809b5c0 2024-09-16T01:23:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.010+0000 7f0cd0118640 1 -- 172.21.15.81:0/1721525492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc80b5ce0 con 0x7f0cc809b5c0 2024-09-16T01:23:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.010+0000 7f0cbe7fc640 1 -- 172.21.15.81:0/1721525492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4004240 con 0x7f0cc809b5c0 2024-09-16T01:23:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.010+0000 7f0cd0118640 1 -- 172.21.15.81:0/1721525492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc80b67b0 con 0x7f0cc809b5c0 2024-09-16T01:23:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.011+0000 7f0cd0118640 1 -- 172.21.15.81:0/1721525492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc80ce8f0 con 0x7f0cc809b5c0 2024-09-16T01:23:22.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.011+0000 7f0cbe7fc640 1 -- 172.21.15.81:0/1721525492 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0cc40043e0 con 0x7f0cc809b5c0 2024-09-16T01:23:22.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.012+0000 7f0cbe7fc640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0cac06c2b0 0x7f0cac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.012+0000 7f0cbe7fc640 1 -- 172.21.15.81:0/1721525492 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f0cc408c000 con 0x7f0cc809b5c0 2024-09-16T01:23:22.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.012+0000 7f0ccdeb4640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0cac06c2b0 0x7f0cac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.012+0000 7f0ccdeb4640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0cac06c2b0 0x7f0cac06e770 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8006b10 tx=0x7f0cb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:22.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.016+0000 7f0cbe7fc640 1 -- 172.21.15.81:0/1721525492 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0cc80ce8f0 con 0x7f0cc809b5c0 2024-09-16T01:23:22.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.216+0000 7f0cd0118640 1 -- 172.21.15.81:0/1721525492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0cc8068ea0 con 0x7f0cc809b5c0 2024-09-16T01:23:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.216+0000 7f0cbe7fc640 1 -- 172.21.15.81:0/1721525492 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5227 (secure 0 0 0) 0x7f0cc8068ea0 con 0x7f0cc809b5c0 2024-09-16T01:23:22.218 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:22.218 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"btime":"2024-09-16T01:23:21:883930+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/350084010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":350084010},{"type":"v1","addr":"172.21.15.81:6837","nonce":350084010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6389,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1730570681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1730570681},{"type":"v1","addr":"172.21.15.102:6834","nonce":1730570681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/755231532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":755231532},{"type":"v1","addr":"172.21.15.102:6835","nonce":755231532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:23:18.932203+0000","modified":"2024-09-16T01:23:20.934317+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6836/1395000865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1395000865},{"type":"v1","addr":"172.21.15.81:6836","nonce":1395000865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8103,"qdb_cluster":[8103]},"id":10}]} 2024-09-16T01:23:22.218 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2024-09-16T01:23:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.218+0000 7f0cd0118640 1 -- 172.21.15.81:0/1721525492 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0cac06c2b0 msgr2=0x7f0cac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.218+0000 7f0cd0118640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0cac06c2b0 0x7f0cac06e770 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8006b10 tx=0x7f0cb8008040 comp rx=0 tx=0).stop 2024-09-16T01:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.218+0000 7f0cd0118640 1 -- 172.21.15.81:0/1721525492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc809b5c0 msgr2=0x7f0cc80b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.218+0000 7f0cd0118640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc809b5c0 0x7f0cc80b51d0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400ce10 tx=0x7f0cc400a660 comp rx=0 tx=0).stop 2024-09-16T01:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.218+0000 7f0cd0118640 1 -- 172.21.15.81:0/1721525492 shutdown_connections 2024-09-16T01:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.218+0000 7f0cd0118640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0cac06c2b0 0x7f0cac06e770 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.218+0000 7f0cd0118640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0cc80d0b20 0x7f0cc81548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.218+0000 7f0cd0118640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cc809b5c0 0x7f0cc80b51d0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.218+0000 7f0cd0118640 1 --2- 172.21.15.81:0/1721525492 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0cc809aca0 0x7f0cc81e48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.218+0000 7f0cd0118640 1 -- 172.21.15.81:0/1721525492 >> 172.21.15.81:0/1721525492 conn(0x7f0cc80d23a0 msgr2=0x7f0cc815d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.218+0000 7f0cd0118640 1 -- 172.21.15.81:0/1721525492 shutdown_connections 2024-09-16T01:23:22.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.218+0000 7f0cd0118640 1 -- 172.21.15.81:0/1721525492 wait complete. 2024-09-16T01:23:22.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:23:22.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.327+0000 7f79140f1640 1 Processor -- start 2024-09-16T01:23:22.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.328+0000 7f79140f1640 1 -- start start 2024-09-16T01:23:22.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.328+0000 7f79140f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f790c15fc30 0x7f790c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.328+0000 7f79140f1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f790c09b140 0x7f790c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.328+0000 7f79140f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790c09ba30 con 0x7f790c0b17d0 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.328+0000 7f79140f1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f790c0b1590 con 0x7f790c09b140 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.328+0000 7f79140f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f790c160ab0 con 0x7f790c15fc30 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.328+0000 7f791168c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f790c0b17d0 0x7f790c09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36540/0 (socket says 172.21.15.81:36540) 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f791168c640 1 -- 172.21.15.81:0/4056376977 learned_addr learned my addr 172.21.15.81:0/4056376977 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 954182850 0 0) 0x7f790c09ba30 con 0x7f790c0b17d0 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f791268e640 1 --2- 172.21.15.81:0/4056376977 >> v2:172.21.15.102:3300/0 conn(0x7f790c09b140 0x7f790c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78f4003520 con 0x7f790c0b17d0 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7911e8d640 1 --2- 172.21.15.81:0/4056376977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f790c15fc30 0x7f790c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 466587929 0 0) 0x7f78f4003520 con 0x7f790c0b17d0 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f790c15fc30 msgr2=0x7f790c071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 --2- 172.21.15.81:0/4056376977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f790c15fc30 0x7f790c071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 >> v2:172.21.15.102:3300/0 conn(0x7f790c09b140 msgr2=0x7f790c0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:22.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 --2- 172.21.15.81:0/4056376977 >> v2:172.21.15.102:3300/0 conn(0x7f790c09b140 0x7f790c0704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c09bcf0 con 0x7f790c0b17d0 2024-09-16T01:23:22.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f7900001670 con 0x7f790c0b17d0 2024-09-16T01:23:22.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 >> v1:172.21.15.81:6789/0 conn(0x7f790c0b17d0 legacy=0x7f790c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 --2- 172.21.15.81:0/4056376977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f790c15fc30 0x7f78f40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 --2- 172.21.15.81:0/4056376977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78f4003f30 0x7f78f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 --2- 172.21.15.81:0/4056376977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f4004d40 0x7f78f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f790c0b1590 con 0x7f78f4004d40 2024-09-16T01:23:22.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f790c160ab0 con 0x7f78f4003f30 2024-09-16T01:23:22.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f78f400ba10 con 0x7f790c15fc30 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f791268e640 1 --2- 172.21.15.81:0/4056376977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f4004d40 0x7f78f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f791168c640 1 --2- 172.21.15.81:0/4056376977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78f4003f30 0x7f78f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f7911e8d640 1 --2- 172.21.15.81:0/4056376977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f790c15fc30 0x7f78f40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f791268e640 1 -- 172.21.15.81:0/4056376977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f790c15fc30 msgr2=0x7f78f40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f791268e640 1 --2- 172.21.15.81:0/4056376977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f790c15fc30 0x7f78f40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f791268e640 1 -- 172.21.15.81:0/4056376977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78f4003f30 msgr2=0x7f78f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f791268e640 1 --2- 172.21.15.81:0/4056376977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f78f4003f30 0x7f78f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.329+0000 7f791268e640 1 -- 172.21.15.81:0/4056376977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f4003520 con 0x7f78f4004d40 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.330+0000 7f791268e640 1 --2- 172.21.15.81:0/4056376977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f4004d40 0x7f78f40051c0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009a90 tx=0x7f78f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b468b602bb6aec1d server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.330+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc036070 con 0x7f78f4004d40 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.330+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78fc031400 con 0x7f78f4004d40 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.330+0000 7f7910e8b640 1 -- 172.21.15.81:0/4056376977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc009690 con 0x7f78f4004d40 2024-09-16T01:23:22.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.331+0000 7f79140f1640 1 -- 172.21.15.81:0/4056376977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f4004d40 msgr2=0x7f78f40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.331+0000 7f79140f1640 1 --2- 172.21.15.81:0/4056376977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f4004d40 0x7f78f40051c0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009a90 tx=0x7f78f4005830 comp rx=0 tx=0).stop 2024-09-16T01:23:22.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.331+0000 7f791268e640 1 -- 172.21.15.81:0/4056376977 reap_dead start 2024-09-16T01:23:22.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.331+0000 7f79140f1640 1 -- 172.21.15.81:0/4056376977 shutdown_connections 2024-09-16T01:23:22.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.331+0000 7f79140f1640 1 -- 172.21.15.81:0/4056376977 >> 172.21.15.81:0/4056376977 conn(0x7f790c0d23a0 msgr2=0x7f790c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:22.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.331+0000 7f79140f1640 1 -- 172.21.15.81:0/4056376977 shutdown_connections 2024-09-16T01:23:22.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.331+0000 7f79140f1640 1 -- 172.21.15.81:0/4056376977 wait complete. 2024-09-16T01:23:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.332+0000 7f79140f1640 1 Processor -- start 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.332+0000 7f79140f1640 1 -- start start 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f79140f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f78f4004d40 0x7f790c154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f79140f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f790c0c8620 0x7f790c0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f79140f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c0cb410 0x7f790c0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f79140f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f790c0b1bd0 con 0x7f790c0cb410 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f79140f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f790c160fe0 con 0x7f790c0c8620 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f79140f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f790c071e40 con 0x7f78f4004d40 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f791268e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c0cb410 0x7f790c0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f791268e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c0cb410 0x7f790c0cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48818/0 (socket says 172.21.15.81:48818) 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f791268e640 1 -- 172.21.15.81:0/1204555218 learned_addr learned my addr 172.21.15.81:0/1204555218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f7911e8d640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f78f4004d40 0x7f790c154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f791168c640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f790c0c8620 0x7f790c0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f791268e640 1 -- 172.21.15.81:0/1204555218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f78f4004d40 msgr2=0x7f790c154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f791268e640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f78f4004d40 0x7f790c154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f791268e640 1 -- 172.21.15.81:0/1204555218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f790c0c8620 msgr2=0x7f790c0ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f791268e640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f790c0c8620 0x7f790c0ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f791268e640 1 -- 172.21.15.81:0/1204555218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c0cbfe0 con 0x7f790c0cb410 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f791168c640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f790c0c8620 0x7f790c0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f7911e8d640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f78f4004d40 0x7f790c154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f791268e640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c0cb410 0x7f790c0cb890 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009b80 tx=0x7f78fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f790a7fc640 1 -- 172.21.15.81:0/1204555218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc036040 con 0x7f790c0cb410 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f790a7fc640 1 -- 172.21.15.81:0/1204555218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78fc042070 con 0x7f790c0cb410 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.333+0000 7f79140f1640 1 -- 172.21.15.81:0/1204555218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790c0cc2c0 con 0x7f790c0cb410 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.334+0000 7f790a7fc640 1 -- 172.21.15.81:0/1204555218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78fc03b6a0 con 0x7f790c0cb410 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.334+0000 7f79140f1640 1 -- 172.21.15.81:0/1204555218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790c0cac50 con 0x7f790c0cb410 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.334+0000 7f79140f1640 1 -- 172.21.15.81:0/1204555218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790c068ea0 con 0x7f790c0cb410 2024-09-16T01:23:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.335+0000 7f790a7fc640 1 -- 172.21.15.81:0/1204555218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f78fc039070 con 0x7f790c0cb410 2024-09-16T01:23:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.335+0000 7f790a7fc640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f78f806c2b0 0x7f78f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.335+0000 7f790a7fc640 1 -- 172.21.15.81:0/1204555218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f78fc0aaf40 con 0x7f790c0cb410 2024-09-16T01:23:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.335+0000 7f7911e8d640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f78f806c2b0 0x7f78f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.336+0000 7f7911e8d640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f78f806c2b0 0x7f78f806e770 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f790c158740 tx=0x7f790400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.340+0000 7f790a7fc640 1 -- 172.21.15.81:0/1204555218 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78fc0795b0 con 0x7f790c0cb410 2024-09-16T01:23:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.505+0000 7f79140f1640 1 -- 172.21.15.81:0/1204555218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f790c0b8320 con 0x7f790c0cb410 2024-09-16T01:23:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.506+0000 7f790a7fc640 1 -- 172.21.15.81:0/1204555218 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16952 (secure 0 0 0) 0x7f78fc078eb0 con 0x7f790c0cb410 2024-09-16T01:23:22.508 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:22.508 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":137,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:23:20.600617+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:23:17.268973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-16T01:23:17.902232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:23:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.508+0000 7f79140f1640 1 -- 172.21.15.81:0/1204555218 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f78f806c2b0 msgr2=0x7f78f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.508+0000 7f79140f1640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f78f806c2b0 0x7f78f806e770 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f790c158740 tx=0x7f790400b040 comp rx=0 tx=0).stop 2024-09-16T01:23:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.508+0000 7f79140f1640 1 -- 172.21.15.81:0/1204555218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c0cb410 msgr2=0x7f790c0cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.508+0000 7f79140f1640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c0cb410 0x7f790c0cb890 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009b80 tx=0x7f78fc004730 comp rx=0 tx=0).stop 2024-09-16T01:23:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.508+0000 7f79140f1640 1 -- 172.21.15.81:0/1204555218 shutdown_connections 2024-09-16T01:23:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.508+0000 7f79140f1640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f78f806c2b0 0x7f78f806e770 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.508+0000 7f79140f1640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790c0cb410 0x7f790c0cb890 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.508+0000 7f79140f1640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f790c0c8620 0x7f790c0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.508+0000 7f79140f1640 1 --2- 172.21.15.81:0/1204555218 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f78f4004d40 0x7f790c154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.508+0000 7f79140f1640 1 -- 172.21.15.81:0/1204555218 >> 172.21.15.81:0/1204555218 conn(0x7f790c0d23a0 msgr2=0x7f790c15abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:22.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.508+0000 7f79140f1640 1 -- 172.21.15.81:0/1204555218 shutdown_connections 2024-09-16T01:23:22.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.508+0000 7f79140f1640 1 -- 172.21.15.81:0/1204555218 wait complete. 2024-09-16T01:23:22.521 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:23:22.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:23:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.619+0000 7ff5559e4640 1 Processor -- start 2024-09-16T01:23:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.619+0000 7ff5559e4640 1 -- start start 2024-09-16T01:23:22.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.620+0000 7ff5559e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff550162060 0x7ff5500b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.620+0000 7ff5559e4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55006d9f0 con 0x7ff550161c80 2024-09-16T01:23:22.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.620+0000 7ff5559e4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55006dcd0 con 0x7ff5500b64b0 2024-09-16T01:23:22.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.620+0000 7ff5559e4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff55006dfb0 con 0x7ff550162060 2024-09-16T01:23:22.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.620+0000 7ff5467fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff550162060 0x7ff5500b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.620+0000 7ff54effd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff550161c80 0x7ff55006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36550/0 (socket says 172.21.15.81:36550) 2024-09-16T01:23:22.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.620+0000 7ff54effd640 1 -- 172.21.15.81:0/2181926869 learned_addr learned my addr 172.21.15.81:0/2181926869 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:22.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.620+0000 7ff5467fc640 1 -- 172.21.15.81:0/2181926869 >> v1:172.21.15.102:6789/0 conn(0x7ff5500b64b0 legacy=0x7ff5500cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.620+0000 7ff5467fc640 1 -- 172.21.15.81:0/2181926869 >> v1:172.21.15.81:6789/0 conn(0x7ff550161c80 legacy=0x7ff55006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.620+0000 7ff5467fc640 1 -- 172.21.15.81:0/2181926869 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5500d2890 con 0x7ff550162060 2024-09-16T01:23:22.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.621+0000 7ff5467fc640 1 --2- 172.21.15.81:0/2181926869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff550162060 0x7ff5500b5f70 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7ff5380097a0 tx=0x7ff53802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99af3b2817eefabf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:22.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.621+0000 7ff54e7fc640 1 -- 172.21.15.81:0/2181926869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538037070 con 0x7ff550162060 2024-09-16T01:23:22.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.621+0000 7ff54e7fc640 1 -- 172.21.15.81:0/2181926869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff538032440 con 0x7ff550162060 2024-09-16T01:23:22.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.621+0000 7ff54e7fc640 1 -- 172.21.15.81:0/2181926869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff538032810 con 0x7ff550162060 2024-09-16T01:23:22.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.621+0000 7ff5559e4640 1 -- 172.21.15.81:0/2181926869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff550162060 msgr2=0x7ff5500b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.621+0000 7ff5559e4640 1 --2- 172.21.15.81:0/2181926869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff550162060 0x7ff5500b5f70 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7ff5380097a0 tx=0x7ff53802a230 comp rx=0 tx=0).stop 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.621+0000 7ff5559e4640 1 -- 172.21.15.81:0/2181926869 shutdown_connections 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.621+0000 7ff5559e4640 1 --2- 172.21.15.81:0/2181926869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff550162060 0x7ff5500b5f70 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.621+0000 7ff5559e4640 1 -- 172.21.15.81:0/2181926869 >> 172.21.15.81:0/2181926869 conn(0x7ff5500d44f0 msgr2=0x7ff5500d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.622+0000 7ff5559e4640 1 -- 172.21.15.81:0/2181926869 shutdown_connections 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.622+0000 7ff5559e4640 1 -- 172.21.15.81:0/2181926869 wait complete. 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.623+0000 7ff5559e4640 1 Processor -- start 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.623+0000 7ff5559e4640 1 -- start start 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.623+0000 7ff5559e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5500b64b0 0x7ff55014ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.623+0000 7ff5559e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff550161c80 0x7ff5500cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.623+0000 7ff5559e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff550162060 0x7ff5500cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.623+0000 7ff5559e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5500b6d30 con 0x7ff550162060 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff5559e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff5500b6bb0 con 0x7ff550161c80 2024-09-16T01:23:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff5559e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff5500cf8f0 con 0x7ff5500b64b0 2024-09-16T01:23:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff550162060 0x7ff5500cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff550162060 0x7ff5500cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48842/0 (socket says 172.21.15.81:48842) 2024-09-16T01:23:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54f7fe640 1 -- 172.21.15.81:0/2889513154 learned_addr learned my addr 172.21.15.81:0/2889513154 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54effd640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5500b64b0 0x7ff55014ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff5467fc640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff550161c80 0x7ff5500cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54f7fe640 1 -- 172.21.15.81:0/2889513154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5500b64b0 msgr2=0x7ff55014ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54f7fe640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5500b64b0 0x7ff55014ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54f7fe640 1 -- 172.21.15.81:0/2889513154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff550161c80 msgr2=0x7ff5500cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54f7fe640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff550161c80 0x7ff5500cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54f7fe640 1 -- 172.21.15.81:0/2889513154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55014f710 con 0x7ff550162060 2024-09-16T01:23:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54f7fe640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff550162060 0x7ff5500cbb00 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7ff54800c7a0 tx=0x7ff54800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54cff9640 1 -- 172.21.15.81:0/2889513154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548003b70 con 0x7ff550162060 2024-09-16T01:23:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54cff9640 1 -- 172.21.15.81:0/2889513154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff548003d30 con 0x7ff550162060 2024-09-16T01:23:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff54cff9640 1 -- 172.21.15.81:0/2889513154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54800aa90 con 0x7ff550162060 2024-09-16T01:23:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff5559e4640 1 -- 172.21.15.81:0/2889513154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5500cc110 con 0x7ff550162060 2024-09-16T01:23:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.624+0000 7ff5559e4640 1 -- 172.21.15.81:0/2889513154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5500b74c0 con 0x7ff550162060 2024-09-16T01:23:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.625+0000 7ff5559e4640 1 -- 172.21.15.81:0/2889513154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5500b5f70 con 0x7ff550162060 2024-09-16T01:23:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.626+0000 7ff54cff9640 1 -- 172.21.15.81:0/2889513154 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff54800ac30 con 0x7ff550162060 2024-09-16T01:23:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.626+0000 7ff54cff9640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff53006c2b0 0x7ff53006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.626+0000 7ff54cff9640 1 -- 172.21.15.81:0/2889513154 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7ff54808b360 con 0x7ff550162060 2024-09-16T01:23:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.626+0000 7ff54effd640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff53006c2b0 0x7ff53006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.626+0000 7ff54effd640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff53006c2b0 0x7ff53006e770 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff540005880 tx=0x7ff540009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.630+0000 7ff54cff9640 1 -- 172.21.15.81:0/2889513154 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff548059380 con 0x7ff550162060 2024-09-16T01:23:22.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.792+0000 7ff5559e4640 1 -- 172.21.15.81:0/2889513154 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5500ba470 con 0x7ff53006c2b0 2024-09-16T01:23:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.797+0000 7ff54cff9640 1 -- 172.21.15.81:0/2889513154 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240222 (secure 0 0 0) 0x7ff5500ba470 con 0x7ff53006c2b0 2024-09-16T01:23:22.801 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:23:22.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.800+0000 7ff5559e4640 1 -- 172.21.15.81:0/2889513154 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff53006c2b0 msgr2=0x7ff53006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.800+0000 7ff5559e4640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff53006c2b0 0x7ff53006e770 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff540005880 tx=0x7ff540009040 comp rx=0 tx=0).stop 2024-09-16T01:23:22.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.800+0000 7ff5559e4640 1 -- 172.21.15.81:0/2889513154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff550162060 msgr2=0x7ff5500cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.800+0000 7ff5559e4640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff550162060 0x7ff5500cbb00 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7ff54800c7a0 tx=0x7ff54800cc60 comp rx=0 tx=0).stop 2024-09-16T01:23:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.800+0000 7ff5559e4640 1 -- 172.21.15.81:0/2889513154 shutdown_connections 2024-09-16T01:23:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.800+0000 7ff5559e4640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff53006c2b0 0x7ff53006e770 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.800+0000 7ff5559e4640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff550162060 0x7ff5500cbb00 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.800+0000 7ff5559e4640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff550161c80 0x7ff5500cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.800+0000 7ff5559e4640 1 --2- 172.21.15.81:0/2889513154 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5500b64b0 0x7ff55014ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.800+0000 7ff5559e4640 1 -- 172.21.15.81:0/2889513154 >> 172.21.15.81:0/2889513154 conn(0x7ff5500d44f0 msgr2=0x7ff5500d3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.800+0000 7ff5559e4640 1 -- 172.21.15.81:0/2889513154 shutdown_connections 2024-09-16T01:23:22.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.800+0000 7ff5559e4640 1 -- 172.21.15.81:0/2889513154 wait complete. 2024-09-16T01:23:22.813 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2024-09-16T01:23:22.160265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272040,"kb_used_data":14156,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754702680,"statfs":{"total":773094113280,"available":772815544320,"internally_reserved":0,"allocated":14495744,"data_stored":7302583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.578064"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611425+0000","last_change":"2024-09-16T01:23:17.611425+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611425+0000","last_undegraded":"2024-09-16T01:23:17.611425+0000","last_fullsized":"2024-09-16T01:23:17.611425+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585184+0000","last_change":"2024-09-16T01:23:17.585184+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585184+0000","last_undegraded":"2024-09-16T01:23:17.585184+0000","last_fullsized":"2024-09-16T01:23:17.585184+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584370+0000","last_change":"2024-09-16T01:23:17.584370+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584370+0000","last_undegraded":"2024-09-16T01:23:17.584370+0000","last_fullsized":"2024-09-16T01:23:17.584370+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585074+0000","last_change":"2024-09-16T01:23:17.585074+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585074+0000","last_undegraded":"2024-09-16T01:23:17.585074+0000","last_fullsized":"2024-09-16T01:23:17.585074+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588506+0000","last_change":"2024-09-16T01:23:17.588506+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588506+0000","last_undegraded":"2024-09-16T01:23:17.588506+0000","last_fullsized":"2024-09-16T01:23:17.588506+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611429+0000","last_change":"2024-09-16T01:23:17.611429+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611429+0000","last_undegraded":"2024-09-16T01:23:17.611429+0000","last_fullsized":"2024-09-16T01:23:17.611429+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585285+0000","last_change":"2024-09-16T01:23:17.585285+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585285+0000","last_undegraded":"2024-09-16T01:23:17.585285+0000","last_fullsized":"2024-09-16T01:23:17.585285+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611414+0000","last_change":"2024-09-16T01:23:17.611414+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611414+0000","last_undegraded":"2024-09-16T01:23:17.611414+0000","last_fullsized":"2024-09-16T01:23:17.611414+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584371+0000","last_change":"2024-09-16T01:23:17.584371+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584371+0000","last_undegraded":"2024-09-16T01:23:17.584371+0000","last_fullsized":"2024-09-16T01:23:17.584371+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585873+0000","last_change":"2024-09-16T01:23:17.585873+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585873+0000","last_undegraded":"2024-09-16T01:23:17.585873+0000","last_fullsized":"2024-09-16T01:23:17.585873+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586521+0000","last_change":"2024-09-16T01:23:17.586521+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586521+0000","last_undegraded":"2024-09-16T01:23:17.586521+0000","last_fullsized":"2024-09-16T01:23:17.586521+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611386+0000","last_change":"2024-09-16T01:23:17.611386+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611386+0000","last_undegraded":"2024-09-16T01:23:17.611386+0000","last_fullsized":"2024-09-16T01:23:17.611386+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588636+0000","last_change":"2024-09-16T01:23:17.588636+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588636+0000","last_undegraded":"2024-09-16T01:23:17.588636+0000","last_fullsized":"2024-09-16T01:23:17.588636+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588901+0000","last_change":"2024-09-16T01:23:17.588901+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588901+0000","last_undegraded":"2024-09-16T01:23:17.588901+0000","last_fullsized":"2024-09-16T01:23:17.588901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584627+0000","last_change":"2024-09-16T01:23:17.584627+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584627+0000","last_undegraded":"2024-09-16T01:23:17.584627+0000","last_fullsized":"2024-09-16T01:23:17.584627+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586788+0000","last_change":"2024-09-16T01:23:17.586788+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586788+0000","last_undegraded":"2024-09-16T01:23:17.586788+0000","last_fullsized":"2024-09-16T01:23:17.586788+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584369+0000","last_change":"2024-09-16T01:23:17.584369+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584369+0000","last_undegraded":"2024-09-16T01:23:17.584369+0000","last_fullsized":"2024-09-16T01:23:17.584369+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585071+0000","last_change":"2024-09-16T01:23:17.585071+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585071+0000","last_undegraded":"2024-09-16T01:23:17.585071+0000","last_fullsized":"2024-09-16T01:23:17.585071+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588141+0000","last_change":"2024-09-16T01:23:17.588141+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588141+0000","last_undegraded":"2024-09-16T01:23:17.588141+0000","last_fullsized":"2024-09-16T01:23:17.588141+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586405+0000","last_change":"2024-09-16T01:23:17.586405+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586405+0000","last_undegraded":"2024-09-16T01:23:17.586405+0000","last_fullsized":"2024-09-16T01:23:17.586405+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588317+0000","last_change":"2024-09-16T01:23:17.588317+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588317+0000","last_undegraded":"2024-09-16T01:23:17.588317+0000","last_fullsized":"2024-09-16T01:23:17.588317+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586399+0000","last_change":"2024-09-16T01:23:17.586399+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586399+0000","last_undegraded":"2024-09-16T01:23:17.586399+0000","last_fullsized":"2024-09-16T01:23:17.586399+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588890+0000","last_change":"2024-09-16T01:23:17.588890+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588890+0000","last_undegraded":"2024-09-16T01:23:17.588890+0000","last_fullsized":"2024-09-16T01:23:17.588890+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.589123+0000","last_change":"2024-09-16T01:23:17.589123+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.589123+0000","last_undegraded":"2024-09-16T01:23:17.589123+0000","last_fullsized":"2024-09-16T01:23:17.589123+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585464+0000","last_change":"2024-09-16T01:23:17.585464+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585464+0000","last_undegraded":"2024-09-16T01:23:17.585464+0000","last_fullsized":"2024-09-16T01:23:17.585464+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584632+0000","last_change":"2024-09-16T01:23:17.584632+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584632+0000","last_undegraded":"2024-09-16T01:23:17.584632+0000","last_fullsized":"2024-09-16T01:23:17.584632+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611421+0000","last_change":"2024-09-16T01:23:17.611421+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611421+0000","last_undegraded":"2024-09-16T01:23:17.611421+0000","last_fullsized":"2024-09-16T01:23:17.611421+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584918+0000","last_change":"2024-09-16T01:23:17.584918+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584918+0000","last_undegraded":"2024-09-16T01:23:17.584918+0000","last_fullsized":"2024-09-16T01:23:17.584918+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586738+0000","last_change":"2024-09-16T01:23:17.586738+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586738+0000","last_undegraded":"2024-09-16T01:23:17.586738+0000","last_fullsized":"2024-09-16T01:23:17.586738+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584693+0000","last_change":"2024-09-16T01:23:17.584693+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584693+0000","last_undegraded":"2024-09-16T01:23:17.584693+0000","last_fullsized":"2024-09-16T01:23:17.584693+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584467+0000","last_change":"2024-09-16T01:23:17.584467+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584467+0000","last_undegraded":"2024-09-16T01:23:17.584467+0000","last_fullsized":"2024-09-16T01:23:17.584467+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586477+0000","last_change":"2024-09-16T01:23:17.586477+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586477+0000","last_undegraded":"2024-09-16T01:23:17.586477+0000","last_fullsized":"2024-09-16T01:23:17.586477+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":375,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-16T01:23:17.586440+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:23:17.586440+0000","last_peered":"2024-09-16T01:23:17.586440+0000","last_clean":"2024-09-16T01:23:17.586440+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:23:17.586440+0000","last_undegraded":"2024-09-16T01:23:17.586440+0000","last_fullsized":"2024-09-16T01:23:17.586440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33416,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338424,"statfs":{"total":96636764160,"available":96602546176,"internally_reserved":0,"allocated":2277376,"data_stored":1364842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36996,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334844,"statfs":{"total":96636764160,"available":96598880256,"internally_reserved":0,"allocated":1671168,"data_stored":768265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32852,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338988,"statfs":{"total":96636764160,"available":96603123712,"internally_reserved":0,"allocated":1683456,"data_stored":774474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36992,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334848,"statfs":{"total":96636764160,"available":96598884352,"internally_reserved":0,"allocated":1683456,"data_stored":774474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1609728,"data_stored":740606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1683456,"data_stored":774474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1609728,"data_stored":740606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33420,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338420,"statfs":{"total":96636764160,"available":96602542080,"internally_reserved":0,"allocated":2277376,"data_stored":1364842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:23:22.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:23:22.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.949+0000 7f66215c0640 1 Processor -- start 2024-09-16T01:23:22.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.949+0000 7f66215c0640 1 -- start start 2024-09-16T01:23:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f66215c0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f661c161c80 0x7f661c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f66215c0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f661c162060 0x7f661c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f66215c0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f661c0b64b0 0x7f661c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f66215c0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f661c06e870 con 0x7f661c161c80 2024-09-16T01:23:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f66215c0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f661c06d9f0 con 0x7f661c0b64b0 2024-09-16T01:23:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f66215c0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f661c06dcd0 con 0x7f661c162060 2024-09-16T01:23:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f661affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f661c161c80 0x7f661c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f661affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f661c161c80 0x7f661c06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48844/0 (socket says 172.21.15.81:48844) 2024-09-16T01:23:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f661affd640 1 -- 172.21.15.81:0/4146218436 learned_addr learned my addr 172.21.15.81:0/4146218436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f661b7fe640 1 --2- 172.21.15.81:0/4146218436 >> v2:172.21.15.102:3300/0 conn(0x7f661c0b64b0 0x7f661c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f6613fff640 1 --2- 172.21.15.81:0/4146218436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f661c162060 0x7f661c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f661affd640 1 -- 172.21.15.81:0/4146218436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f661c162060 msgr2=0x7f661c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f661affd640 1 --2- 172.21.15.81:0/4146218436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f661c162060 0x7f661c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f661affd640 1 -- 172.21.15.81:0/4146218436 >> v2:172.21.15.102:3300/0 conn(0x7f661c0b64b0 msgr2=0x7f661c0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f661affd640 1 --2- 172.21.15.81:0/4146218436 >> v2:172.21.15.102:3300/0 conn(0x7f661c0b64b0 0x7f661c0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f661affd640 1 -- 172.21.15.81:0/4146218436 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661c06dfb0 con 0x7f661c161c80 2024-09-16T01:23:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f661b7fe640 1 --2- 172.21.15.81:0/4146218436 >> v2:172.21.15.102:3300/0 conn(0x7f661c0b64b0 0x7f661c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.950+0000 7f6613fff640 1 --2- 172.21.15.81:0/4146218436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f661c162060 0x7f661c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.951+0000 7f661affd640 1 --2- 172.21.15.81:0/4146218436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661c161c80 0x7f661c06e330 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f661c0687b0 tx=0x7f660c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c97455b8c510d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.951+0000 7f661a7fc640 1 -- 172.21.15.81:0/4146218436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c037070 con 0x7f661c161c80 2024-09-16T01:23:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.951+0000 7f661a7fc640 1 -- 172.21.15.81:0/4146218436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660c032440 con 0x7f661c161c80 2024-09-16T01:23:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.951+0000 7f661a7fc640 1 -- 172.21.15.81:0/4146218436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c032810 con 0x7f661c161c80 2024-09-16T01:23:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.952+0000 7f66215c0640 1 -- 172.21.15.81:0/4146218436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661c161c80 msgr2=0x7f661c06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.952+0000 7f66215c0640 1 --2- 172.21.15.81:0/4146218436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661c161c80 0x7f661c06e330 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f661c0687b0 tx=0x7f660c02a1e0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.952+0000 7f66215c0640 1 -- 172.21.15.81:0/4146218436 shutdown_connections 2024-09-16T01:23:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.952+0000 7f66215c0640 1 --2- 172.21.15.81:0/4146218436 >> v2:172.21.15.102:3300/0 conn(0x7f661c0b64b0 0x7f661c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.952+0000 7f66215c0640 1 --2- 172.21.15.81:0/4146218436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f661c162060 0x7f661c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.952+0000 7f66215c0640 1 --2- 172.21.15.81:0/4146218436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661c161c80 0x7f661c06e330 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.952+0000 7f66215c0640 1 -- 172.21.15.81:0/4146218436 >> 172.21.15.81:0/4146218436 conn(0x7f661c0d44f0 msgr2=0x7f661c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.952+0000 7f66215c0640 1 -- 172.21.15.81:0/4146218436 shutdown_connections 2024-09-16T01:23:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.952+0000 7f66215c0640 1 -- 172.21.15.81:0/4146218436 wait complete. 2024-09-16T01:23:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.953+0000 7f66215c0640 1 Processor -- start 2024-09-16T01:23:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.953+0000 7f66215c0640 1 -- start start 2024-09-16T01:23:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f66215c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f661c0b64b0 0x7f661c156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f66215c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661c161c80 0x7f661c0b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f66215c0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f661c162060 0x7f661c15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f66215c0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f661c162500 con 0x7f661c161c80 2024-09-16T01:23:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f66215c0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f661c0d2aa0 con 0x7f661c0b64b0 2024-09-16T01:23:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f66215c0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f661c162680 con 0x7f661c162060 2024-09-16T01:23:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f6613fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661c161c80 0x7f661c0b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f6613fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661c161c80 0x7f661c0b85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48848/0 (socket says 172.21.15.81:48848) 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f6613fff640 1 -- 172.21.15.81:0/710493156 learned_addr learned my addr 172.21.15.81:0/710493156 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f661affd640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f661c0b64b0 0x7f661c156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f661b7fe640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f661c162060 0x7f661c15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f6613fff640 1 -- 172.21.15.81:0/710493156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f661c162060 msgr2=0x7f661c15a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f6613fff640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f661c162060 0x7f661c15a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f6613fff640 1 -- 172.21.15.81:0/710493156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f661c0b64b0 msgr2=0x7f661c156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f6613fff640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f661c0b64b0 0x7f661c156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f6613fff640 1 -- 172.21.15.81:0/710493156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f661c0b7520 con 0x7f661c161c80 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f661affd640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f661c0b64b0 0x7f661c156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f661b7fe640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f661c162060 0x7f661c15a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f6613fff640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661c161c80 0x7f661c0b85c0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f660400c7f0 tx=0x7f660400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f66137fe640 1 -- 172.21.15.81:0/710493156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604015070 con 0x7f661c161c80 2024-09-16T01:23:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f66137fe640 1 -- 172.21.15.81:0/710493156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6604007820 con 0x7f661c161c80 2024-09-16T01:23:22.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f66215c0640 1 -- 172.21.15.81:0/710493156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f661c0b7800 con 0x7f661c161c80 2024-09-16T01:23:22.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f66137fe640 1 -- 172.21.15.81:0/710493156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604007c10 con 0x7f661c161c80 2024-09-16T01:23:22.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.954+0000 7f66215c0640 1 -- 172.21.15.81:0/710493156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f661c0b7dc0 con 0x7f661c161c80 2024-09-16T01:23:22.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.955+0000 7f66215c0640 1 -- 172.21.15.81:0/710493156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f661c06e330 con 0x7f661c161c80 2024-09-16T01:23:22.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.956+0000 7f66137fe640 1 -- 172.21.15.81:0/710493156 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6604018070 con 0x7f661c161c80 2024-09-16T01:23:22.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.956+0000 7f66137fe640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f65fc06c2b0 0x7f65fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:22.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.956+0000 7f661affd640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f65fc06c2b0 0x7f65fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:22.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.956+0000 7f66137fe640 1 -- 172.21.15.81:0/710493156 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f660408b6c0 con 0x7f661c161c80 2024-09-16T01:23:22.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.957+0000 7f661affd640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f65fc06c2b0 0x7f65fc06e770 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f660c034000 tx=0x7f660c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:22.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:22.960+0000 7f66137fe640 1 -- 172.21.15.81:0/710493156 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6604059cb0 con 0x7f661c161c80 2024-09-16T01:23:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.122+0000 7f66215c0640 1 -- 172.21.15.81:0/710493156 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f661c0b4340 con 0x7f65fc06c2b0 2024-09-16T01:23:23.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.128+0000 7f66137fe640 1 -- 172.21.15.81:0/710493156 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240222 (secure 0 0 0) 0x7f661c0b4340 con 0x7f65fc06c2b0 2024-09-16T01:23:23.132 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:23.133 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:23:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.130+0000 7f66215c0640 1 -- 172.21.15.81:0/710493156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f65fc06c2b0 msgr2=0x7f65fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.130+0000 7f66215c0640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f65fc06c2b0 0x7f65fc06e770 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f660c034000 tx=0x7f660c02e000 comp rx=0 tx=0).stop 2024-09-16T01:23:23.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.130+0000 7f66215c0640 1 -- 172.21.15.81:0/710493156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661c161c80 msgr2=0x7f661c0b85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.130+0000 7f66215c0640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661c161c80 0x7f661c0b85c0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f660400c7f0 tx=0x7f660400ccb0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.131+0000 7f66215c0640 1 -- 172.21.15.81:0/710493156 shutdown_connections 2024-09-16T01:23:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.131+0000 7f66215c0640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f65fc06c2b0 0x7f65fc06e770 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.131+0000 7f66215c0640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f661c162060 0x7f661c15a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.131+0000 7f66215c0640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f661c161c80 0x7f661c0b85c0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.131+0000 7f66215c0640 1 --2- 172.21.15.81:0/710493156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f661c0b64b0 0x7f661c156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.131+0000 7f66215c0640 1 -- 172.21.15.81:0/710493156 >> 172.21.15.81:0/710493156 conn(0x7f661c0d44f0 msgr2=0x7f661c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.131+0000 7f66215c0640 1 -- 172.21.15.81:0/710493156 shutdown_connections 2024-09-16T01:23:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.131+0000 7f66215c0640 1 -- 172.21.15.81:0/710493156 wait complete. 2024-09-16T01:23:23.143 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2024-09-16T01:23:22.160265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272040,"kb_used_data":14156,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754702680,"statfs":{"total":773094113280,"available":772815544320,"internally_reserved":0,"allocated":14495744,"data_stored":7302583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.578064"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611425+0000","last_change":"2024-09-16T01:23:17.611425+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611425+0000","last_undegraded":"2024-09-16T01:23:17.611425+0000","last_fullsized":"2024-09-16T01:23:17.611425+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585184+0000","last_change":"2024-09-16T01:23:17.585184+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585184+0000","last_undegraded":"2024-09-16T01:23:17.585184+0000","last_fullsized":"2024-09-16T01:23:17.585184+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584370+0000","last_change":"2024-09-16T01:23:17.584370+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584370+0000","last_undegraded":"2024-09-16T01:23:17.584370+0000","last_fullsized":"2024-09-16T01:23:17.584370+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585074+0000","last_change":"2024-09-16T01:23:17.585074+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585074+0000","last_undegraded":"2024-09-16T01:23:17.585074+0000","last_fullsized":"2024-09-16T01:23:17.585074+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588506+0000","last_change":"2024-09-16T01:23:17.588506+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588506+0000","last_undegraded":"2024-09-16T01:23:17.588506+0000","last_fullsized":"2024-09-16T01:23:17.588506+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611429+0000","last_change":"2024-09-16T01:23:17.611429+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611429+0000","last_undegraded":"2024-09-16T01:23:17.611429+0000","last_fullsized":"2024-09-16T01:23:17.611429+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585285+0000","last_change":"2024-09-16T01:23:17.585285+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585285+0000","last_undegraded":"2024-09-16T01:23:17.585285+0000","last_fullsized":"2024-09-16T01:23:17.585285+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611414+0000","last_change":"2024-09-16T01:23:17.611414+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611414+0000","last_undegraded":"2024-09-16T01:23:17.611414+0000","last_fullsized":"2024-09-16T01:23:17.611414+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584371+0000","last_change":"2024-09-16T01:23:17.584371+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584371+0000","last_undegraded":"2024-09-16T01:23:17.584371+0000","last_fullsized":"2024-09-16T01:23:17.584371+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585873+0000","last_change":"2024-09-16T01:23:17.585873+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585873+0000","last_undegraded":"2024-09-16T01:23:17.585873+0000","last_fullsized":"2024-09-16T01:23:17.585873+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586521+0000","last_change":"2024-09-16T01:23:17.586521+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586521+0000","last_undegraded":"2024-09-16T01:23:17.586521+0000","last_fullsized":"2024-09-16T01:23:17.586521+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611386+0000","last_change":"2024-09-16T01:23:17.611386+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611386+0000","last_undegraded":"2024-09-16T01:23:17.611386+0000","last_fullsized":"2024-09-16T01:23:17.611386+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588636+0000","last_change":"2024-09-16T01:23:17.588636+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588636+0000","last_undegraded":"2024-09-16T01:23:17.588636+0000","last_fullsized":"2024-09-16T01:23:17.588636+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588901+0000","last_change":"2024-09-16T01:23:17.588901+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588901+0000","last_undegraded":"2024-09-16T01:23:17.588901+0000","last_fullsized":"2024-09-16T01:23:17.588901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584627+0000","last_change":"2024-09-16T01:23:17.584627+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584627+0000","last_undegraded":"2024-09-16T01:23:17.584627+0000","last_fullsized":"2024-09-16T01:23:17.584627+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586788+0000","last_change":"2024-09-16T01:23:17.586788+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586788+0000","last_undegraded":"2024-09-16T01:23:17.586788+0000","last_fullsized":"2024-09-16T01:23:17.586788+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584369+0000","last_change":"2024-09-16T01:23:17.584369+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584369+0000","last_undegraded":"2024-09-16T01:23:17.584369+0000","last_fullsized":"2024-09-16T01:23:17.584369+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585071+0000","last_change":"2024-09-16T01:23:17.585071+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585071+0000","last_undegraded":"2024-09-16T01:23:17.585071+0000","last_fullsized":"2024-09-16T01:23:17.585071+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588141+0000","last_change":"2024-09-16T01:23:17.588141+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588141+0000","last_undegraded":"2024-09-16T01:23:17.588141+0000","last_fullsized":"2024-09-16T01:23:17.588141+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586405+0000","last_change":"2024-09-16T01:23:17.586405+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586405+0000","last_undegraded":"2024-09-16T01:23:17.586405+0000","last_fullsized":"2024-09-16T01:23:17.586405+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588317+0000","last_change":"2024-09-16T01:23:17.588317+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588317+0000","last_undegraded":"2024-09-16T01:23:17.588317+0000","last_fullsized":"2024-09-16T01:23:17.588317+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586399+0000","last_change":"2024-09-16T01:23:17.586399+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586399+0000","last_undegraded":"2024-09-16T01:23:17.586399+0000","last_fullsized":"2024-09-16T01:23:17.586399+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588890+0000","last_change":"2024-09-16T01:23:17.588890+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588890+0000","last_undegraded":"2024-09-16T01:23:17.588890+0000","last_fullsized":"2024-09-16T01:23:17.588890+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.589123+0000","last_change":"2024-09-16T01:23:17.589123+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.589123+0000","last_undegraded":"2024-09-16T01:23:17.589123+0000","last_fullsized":"2024-09-16T01:23:17.589123+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585464+0000","last_change":"2024-09-16T01:23:17.585464+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585464+0000","last_undegraded":"2024-09-16T01:23:17.585464+0000","last_fullsized":"2024-09-16T01:23:17.585464+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584632+0000","last_change":"2024-09-16T01:23:17.584632+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584632+0000","last_undegraded":"2024-09-16T01:23:17.584632+0000","last_fullsized":"2024-09-16T01:23:17.584632+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611421+0000","last_change":"2024-09-16T01:23:17.611421+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611421+0000","last_undegraded":"2024-09-16T01:23:17.611421+0000","last_fullsized":"2024-09-16T01:23:17.611421+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584918+0000","last_change":"2024-09-16T01:23:17.584918+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584918+0000","last_undegraded":"2024-09-16T01:23:17.584918+0000","last_fullsized":"2024-09-16T01:23:17.584918+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586738+0000","last_change":"2024-09-16T01:23:17.586738+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586738+0000","last_undegraded":"2024-09-16T01:23:17.586738+0000","last_fullsized":"2024-09-16T01:23:17.586738+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584693+0000","last_change":"2024-09-16T01:23:17.584693+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584693+0000","last_undegraded":"2024-09-16T01:23:17.584693+0000","last_fullsized":"2024-09-16T01:23:17.584693+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584467+0000","last_change":"2024-09-16T01:23:17.584467+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584467+0000","last_undegraded":"2024-09-16T01:23:17.584467+0000","last_fullsized":"2024-09-16T01:23:17.584467+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586477+0000","last_change":"2024-09-16T01:23:17.586477+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586477+0000","last_undegraded":"2024-09-16T01:23:17.586477+0000","last_fullsized":"2024-09-16T01:23:17.586477+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":375,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-16T01:23:17.586440+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:23:17.586440+0000","last_peered":"2024-09-16T01:23:17.586440+0000","last_clean":"2024-09-16T01:23:17.586440+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:23:17.586440+0000","last_undegraded":"2024-09-16T01:23:17.586440+0000","last_fullsized":"2024-09-16T01:23:17.586440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33416,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338424,"statfs":{"total":96636764160,"available":96602546176,"internally_reserved":0,"allocated":2277376,"data_stored":1364842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36996,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334844,"statfs":{"total":96636764160,"available":96598880256,"internally_reserved":0,"allocated":1671168,"data_stored":768265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32852,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338988,"statfs":{"total":96636764160,"available":96603123712,"internally_reserved":0,"allocated":1683456,"data_stored":774474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36992,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334848,"statfs":{"total":96636764160,"available":96598884352,"internally_reserved":0,"allocated":1683456,"data_stored":774474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1609728,"data_stored":740606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1683456,"data_stored":774474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1609728,"data_stored":740606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33420,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338420,"statfs":{"total":96636764160,"available":96602542080,"internally_reserved":0,"allocated":2277376,"data_stored":1364842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:23:23.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:23:23.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.279+0000 7f8803331640 1 Processor -- start 2024-09-16T01:23:23.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.280+0000 7f8803331640 1 -- start start 2024-09-16T01:23:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.280+0000 7f8803331640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f87fc0b0180 0x7f87fc162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.280+0000 7f8803331640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87fc15eb60 con 0x7f87fc0b69d0 2024-09-16T01:23:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.280+0000 7f8803331640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87fc15ee40 con 0x7f87fc0af280 2024-09-16T01:23:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.280+0000 7f8803331640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f87fc0b6db0 con 0x7f87fc0b0180 2024-09-16T01:23:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.280+0000 7f88010cd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f87fc0b69d0 0x7f87fc0afa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36554/0 (socket says 172.21.15.81:36554) 2024-09-16T01:23:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.280+0000 7f88010cd640 1 -- 172.21.15.81:0/2778418862 learned_addr learned my addr 172.21.15.81:0/2778418862 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1732360831 0 0) 0x7f87fc15eb60 con 0x7f87fc0b69d0 2024-09-16T01:23:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87e4003520 con 0x7f87fc0b69d0 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f88008cc640 1 --2- 172.21.15.81:0/2778418862 >> v2:172.21.15.102:3300/0 conn(0x7f87fc0b0180 0x7f87fc162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3734689011 0 0) 0x7f87e4003520 con 0x7f87fc0b69d0 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 >> v2:172.21.15.102:3300/0 conn(0x7f87fc0b0180 msgr2=0x7f87fc162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 --2- 172.21.15.81:0/2778418862 >> v2:172.21.15.102:3300/0 conn(0x7f87fc0b0180 0x7f87fc162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 >> v1:172.21.15.102:6789/0 conn(0x7f87fc0af280 legacy=0x7f87fc154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc15f120 con 0x7f87fc0b69d0 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f87f4001670 con 0x7f87fc0b69d0 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 >> v1:172.21.15.81:6789/0 conn(0x7f87fc0b69d0 legacy=0x7f87fc0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 --2- 172.21.15.81:0/2778418862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87e40039b0 0x7f87e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 --2- 172.21.15.81:0/2778418862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87e4004800 0x7f87e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 --2- 172.21.15.81:0/2778418862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 0x7f87e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc0b6db0 con 0x7f87e40052e0 2024-09-16T01:23:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f87e400c1b0 con 0x7f87e40039b0 2024-09-16T01:23:23.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f87e400c3b0 con 0x7f87e4004800 2024-09-16T01:23:23.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f88018ce640 1 --2- 172.21.15.81:0/2778418862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 0x7f87e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f88010cd640 1 --2- 172.21.15.81:0/2778418862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87e40039b0 0x7f87e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f88008cc640 1 --2- 172.21.15.81:0/2778418862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87e4004800 0x7f87e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f88018ce640 1 -- 172.21.15.81:0/2778418862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87e4004800 msgr2=0x7f87e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:23.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.281+0000 7f88018ce640 1 --2- 172.21.15.81:0/2778418862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87e4004800 0x7f87e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.282+0000 7f88018ce640 1 -- 172.21.15.81:0/2778418862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87e40039b0 msgr2=0x7f87e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:23.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.282+0000 7f88018ce640 1 --2- 172.21.15.81:0/2778418862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87e40039b0 0x7f87e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.282+0000 7f88018ce640 1 -- 172.21.15.81:0/2778418862 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e4003520 con 0x7f87e40052e0 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.282+0000 7f88008cc640 1 --2- 172.21.15.81:0/2778418862 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87e4004800 0x7f87e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.282+0000 7f88018ce640 1 -- 172.21.15.81:0/2778418862 reap_dead start 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.282+0000 7f88018ce640 1 --2- 172.21.15.81:0/2778418862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 0x7f87e400b9c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f87ec001e20 tx=0x7f87e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e4d682eded702a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.282+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec001a70 con 0x7f87e40052e0 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.282+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ec02ae40 con 0x7f87e40052e0 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.282+0000 7f87fbfff640 1 -- 172.21.15.81:0/2778418862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec003bb0 con 0x7f87e40052e0 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.283+0000 7f8803331640 1 -- 172.21.15.81:0/2778418862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 msgr2=0x7f87e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.283+0000 7f8803331640 1 --2- 172.21.15.81:0/2778418862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 0x7f87e400b9c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f87ec001e20 tx=0x7f87e4005830 comp rx=0 tx=0).stop 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.283+0000 7f8803331640 1 -- 172.21.15.81:0/2778418862 shutdown_connections 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.283+0000 7f8803331640 1 --2- 172.21.15.81:0/2778418862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 0x7f87e400b9c0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.283+0000 7f8803331640 1 -- 172.21.15.81:0/2778418862 >> 172.21.15.81:0/2778418862 conn(0x7f87fc06bc10 msgr2=0x7f87fc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.283+0000 7f8803331640 1 -- 172.21.15.81:0/2778418862 shutdown_connections 2024-09-16T01:23:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.283+0000 7f8803331640 1 -- 172.21.15.81:0/2778418862 wait complete. 2024-09-16T01:23:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.284+0000 7f8803331640 1 Processor -- start 2024-09-16T01:23:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.284+0000 7f8803331640 1 -- start start 2024-09-16T01:23:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f8803331640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 0x7f87fc1f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f8803331640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87fc1f4d60 0x7f87fc0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f8803331640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87fc0cfe50 0x7f87fc06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f8803331640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc162a50 con 0x7f87e40052e0 2024-09-16T01:23:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f8803331640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc0af6d0 con 0x7f87fc0cfe50 2024-09-16T01:23:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f8803331640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f87fc162bd0 con 0x7f87fc1f4d60 2024-09-16T01:23:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f88010cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 0x7f87fc1f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f88010cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 0x7f87fc1f5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48866/0 (socket says 172.21.15.81:48866) 2024-09-16T01:23:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f88010cd640 1 -- 172.21.15.81:0/316649897 learned_addr learned my addr 172.21.15.81:0/316649897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f88010cd640 1 -- 172.21.15.81:0/316649897 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87fc1f4d60 msgr2=0x7f87fc0ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f88010cd640 1 --2- 172.21.15.81:0/316649897 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87fc1f4d60 0x7f87fc0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f88010cd640 1 -- 172.21.15.81:0/316649897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87fc0cfe50 msgr2=0x7f87fc06ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f88010cd640 1 --2- 172.21.15.81:0/316649897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87fc0cfe50 0x7f87fc06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f88010cd640 1 -- 172.21.15.81:0/316649897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc1f57c0 con 0x7f87e40052e0 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f88010cd640 1 --2- 172.21.15.81:0/316649897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 0x7f87fc1f5280 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f87f4004f40 tx=0x7f87f40074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.285+0000 7f87f9ffb640 1 -- 172.21.15.81:0/316649897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f400f7b0 con 0x7f87e40052e0 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.286+0000 7f87f9ffb640 1 -- 172.21.15.81:0/316649897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f4018070 con 0x7f87e40052e0 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.286+0000 7f8803331640 1 -- 172.21.15.81:0/316649897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87fc0cd650 con 0x7f87e40052e0 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.286+0000 7f87f9ffb640 1 -- 172.21.15.81:0/316649897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f400fbd0 con 0x7f87e40052e0 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.286+0000 7f8803331640 1 -- 172.21.15.81:0/316649897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87fc0cdc10 con 0x7f87e40052e0 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.287+0000 7f8803331640 1 -- 172.21.15.81:0/316649897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87fc15a160 con 0x7f87e40052e0 2024-09-16T01:23:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.287+0000 7f87f9ffb640 1 -- 172.21.15.81:0/316649897 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f87f401d460 con 0x7f87e40052e0 2024-09-16T01:23:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.287+0000 7f87f9ffb640 1 --2- 172.21.15.81:0/316649897 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f87e806c2b0 0x7f87e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.288+0000 7f87f9ffb640 1 -- 172.21.15.81:0/316649897 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f87f408b520 con 0x7f87e40052e0 2024-09-16T01:23:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.288+0000 7f88008cc640 1 --2- 172.21.15.81:0/316649897 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f87e806c2b0 0x7f87e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.288+0000 7f88008cc640 1 --2- 172.21.15.81:0/316649897 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f87e806c2b0 0x7f87e806e770 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f87fc1f51e0 tx=0x7f87f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.292+0000 7f87f9ffb640 1 -- 172.21.15.81:0/316649897 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87fc15a160 con 0x7f87e40052e0 2024-09-16T01:23:23.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.457+0000 7f8803331640 1 -- 172.21.15.81:0/316649897 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87fc0adad0 con 0x7f87e806c2b0 2024-09-16T01:23:23.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.462+0000 7f87f9ffb640 1 -- 172.21.15.81:0/316649897 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240222 (secure 0 0 0) 0x7f87fc0adad0 con 0x7f87e806c2b0 2024-09-16T01:23:23.466 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:23.467 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:23:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.465+0000 7f8803331640 1 -- 172.21.15.81:0/316649897 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f87e806c2b0 msgr2=0x7f87e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.465+0000 7f8803331640 1 --2- 172.21.15.81:0/316649897 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f87e806c2b0 0x7f87e806e770 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f87fc1f51e0 tx=0x7f87f0008040 comp rx=0 tx=0).stop 2024-09-16T01:23:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.465+0000 7f8803331640 1 -- 172.21.15.81:0/316649897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 msgr2=0x7f87fc1f5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.465+0000 7f8803331640 1 --2- 172.21.15.81:0/316649897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 0x7f87fc1f5280 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f87f4004f40 tx=0x7f87f40074f0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.465+0000 7f8803331640 1 -- 172.21.15.81:0/316649897 shutdown_connections 2024-09-16T01:23:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.465+0000 7f8803331640 1 --2- 172.21.15.81:0/316649897 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f87e806c2b0 0x7f87e806e770 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.465+0000 7f8803331640 1 --2- 172.21.15.81:0/316649897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87fc0cfe50 0x7f87fc06ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.465+0000 7f8803331640 1 --2- 172.21.15.81:0/316649897 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87fc1f4d60 0x7f87fc0ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.465+0000 7f8803331640 1 --2- 172.21.15.81:0/316649897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87e40052e0 0x7f87fc1f5280 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.465+0000 7f8803331640 1 -- 172.21.15.81:0/316649897 >> 172.21.15.81:0/316649897 conn(0x7f87fc06bc10 msgr2=0x7f87fc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.465+0000 7f8803331640 1 -- 172.21.15.81:0/316649897 shutdown_connections 2024-09-16T01:23:23.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.465+0000 7f8803331640 1 -- 172.21.15.81:0/316649897 wait complete. 2024-09-16T01:23:23.478 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2024-09-16T01:23:22.160265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272040,"kb_used_data":14156,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754702680,"statfs":{"total":773094113280,"available":772815544320,"internally_reserved":0,"allocated":14495744,"data_stored":7302583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.578064"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611425+0000","last_change":"2024-09-16T01:23:17.611425+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611425+0000","last_undegraded":"2024-09-16T01:23:17.611425+0000","last_fullsized":"2024-09-16T01:23:17.611425+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585184+0000","last_change":"2024-09-16T01:23:17.585184+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585184+0000","last_undegraded":"2024-09-16T01:23:17.585184+0000","last_fullsized":"2024-09-16T01:23:17.585184+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584370+0000","last_change":"2024-09-16T01:23:17.584370+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584370+0000","last_undegraded":"2024-09-16T01:23:17.584370+0000","last_fullsized":"2024-09-16T01:23:17.584370+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585074+0000","last_change":"2024-09-16T01:23:17.585074+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585074+0000","last_undegraded":"2024-09-16T01:23:17.585074+0000","last_fullsized":"2024-09-16T01:23:17.585074+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588506+0000","last_change":"2024-09-16T01:23:17.588506+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588506+0000","last_undegraded":"2024-09-16T01:23:17.588506+0000","last_fullsized":"2024-09-16T01:23:17.588506+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611429+0000","last_change":"2024-09-16T01:23:17.611429+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611429+0000","last_undegraded":"2024-09-16T01:23:17.611429+0000","last_fullsized":"2024-09-16T01:23:17.611429+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585285+0000","last_change":"2024-09-16T01:23:17.585285+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585285+0000","last_undegraded":"2024-09-16T01:23:17.585285+0000","last_fullsized":"2024-09-16T01:23:17.585285+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611414+0000","last_change":"2024-09-16T01:23:17.611414+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611414+0000","last_undegraded":"2024-09-16T01:23:17.611414+0000","last_fullsized":"2024-09-16T01:23:17.611414+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584371+0000","last_change":"2024-09-16T01:23:17.584371+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584371+0000","last_undegraded":"2024-09-16T01:23:17.584371+0000","last_fullsized":"2024-09-16T01:23:17.584371+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585873+0000","last_change":"2024-09-16T01:23:17.585873+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585873+0000","last_undegraded":"2024-09-16T01:23:17.585873+0000","last_fullsized":"2024-09-16T01:23:17.585873+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586521+0000","last_change":"2024-09-16T01:23:17.586521+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586521+0000","last_undegraded":"2024-09-16T01:23:17.586521+0000","last_fullsized":"2024-09-16T01:23:17.586521+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611386+0000","last_change":"2024-09-16T01:23:17.611386+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611386+0000","last_undegraded":"2024-09-16T01:23:17.611386+0000","last_fullsized":"2024-09-16T01:23:17.611386+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588636+0000","last_change":"2024-09-16T01:23:17.588636+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588636+0000","last_undegraded":"2024-09-16T01:23:17.588636+0000","last_fullsized":"2024-09-16T01:23:17.588636+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588901+0000","last_change":"2024-09-16T01:23:17.588901+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588901+0000","last_undegraded":"2024-09-16T01:23:17.588901+0000","last_fullsized":"2024-09-16T01:23:17.588901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584627+0000","last_change":"2024-09-16T01:23:17.584627+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584627+0000","last_undegraded":"2024-09-16T01:23:17.584627+0000","last_fullsized":"2024-09-16T01:23:17.584627+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586788+0000","last_change":"2024-09-16T01:23:17.586788+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586788+0000","last_undegraded":"2024-09-16T01:23:17.586788+0000","last_fullsized":"2024-09-16T01:23:17.586788+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584369+0000","last_change":"2024-09-16T01:23:17.584369+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584369+0000","last_undegraded":"2024-09-16T01:23:17.584369+0000","last_fullsized":"2024-09-16T01:23:17.584369+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585071+0000","last_change":"2024-09-16T01:23:17.585071+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585071+0000","last_undegraded":"2024-09-16T01:23:17.585071+0000","last_fullsized":"2024-09-16T01:23:17.585071+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588141+0000","last_change":"2024-09-16T01:23:17.588141+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588141+0000","last_undegraded":"2024-09-16T01:23:17.588141+0000","last_fullsized":"2024-09-16T01:23:17.588141+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586405+0000","last_change":"2024-09-16T01:23:17.586405+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586405+0000","last_undegraded":"2024-09-16T01:23:17.586405+0000","last_fullsized":"2024-09-16T01:23:17.586405+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588317+0000","last_change":"2024-09-16T01:23:17.588317+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588317+0000","last_undegraded":"2024-09-16T01:23:17.588317+0000","last_fullsized":"2024-09-16T01:23:17.588317+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586399+0000","last_change":"2024-09-16T01:23:17.586399+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586399+0000","last_undegraded":"2024-09-16T01:23:17.586399+0000","last_fullsized":"2024-09-16T01:23:17.586399+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588890+0000","last_change":"2024-09-16T01:23:17.588890+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588890+0000","last_undegraded":"2024-09-16T01:23:17.588890+0000","last_fullsized":"2024-09-16T01:23:17.588890+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.589123+0000","last_change":"2024-09-16T01:23:17.589123+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.589123+0000","last_undegraded":"2024-09-16T01:23:17.589123+0000","last_fullsized":"2024-09-16T01:23:17.589123+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585464+0000","last_change":"2024-09-16T01:23:17.585464+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585464+0000","last_undegraded":"2024-09-16T01:23:17.585464+0000","last_fullsized":"2024-09-16T01:23:17.585464+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584632+0000","last_change":"2024-09-16T01:23:17.584632+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584632+0000","last_undegraded":"2024-09-16T01:23:17.584632+0000","last_fullsized":"2024-09-16T01:23:17.584632+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611421+0000","last_change":"2024-09-16T01:23:17.611421+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611421+0000","last_undegraded":"2024-09-16T01:23:17.611421+0000","last_fullsized":"2024-09-16T01:23:17.611421+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584918+0000","last_change":"2024-09-16T01:23:17.584918+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584918+0000","last_undegraded":"2024-09-16T01:23:17.584918+0000","last_fullsized":"2024-09-16T01:23:17.584918+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586738+0000","last_change":"2024-09-16T01:23:17.586738+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586738+0000","last_undegraded":"2024-09-16T01:23:17.586738+0000","last_fullsized":"2024-09-16T01:23:17.586738+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584693+0000","last_change":"2024-09-16T01:23:17.584693+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584693+0000","last_undegraded":"2024-09-16T01:23:17.584693+0000","last_fullsized":"2024-09-16T01:23:17.584693+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584467+0000","last_change":"2024-09-16T01:23:17.584467+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584467+0000","last_undegraded":"2024-09-16T01:23:17.584467+0000","last_fullsized":"2024-09-16T01:23:17.584467+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586477+0000","last_change":"2024-09-16T01:23:17.586477+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586477+0000","last_undegraded":"2024-09-16T01:23:17.586477+0000","last_fullsized":"2024-09-16T01:23:17.586477+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":375,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-16T01:23:17.586440+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:23:17.586440+0000","last_peered":"2024-09-16T01:23:17.586440+0000","last_clean":"2024-09-16T01:23:17.586440+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:23:17.586440+0000","last_undegraded":"2024-09-16T01:23:17.586440+0000","last_fullsized":"2024-09-16T01:23:17.586440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33416,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338424,"statfs":{"total":96636764160,"available":96602546176,"internally_reserved":0,"allocated":2277376,"data_stored":1364842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36996,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334844,"statfs":{"total":96636764160,"available":96598880256,"internally_reserved":0,"allocated":1671168,"data_stored":768265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32852,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338988,"statfs":{"total":96636764160,"available":96603123712,"internally_reserved":0,"allocated":1683456,"data_stored":774474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36992,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334848,"statfs":{"total":96636764160,"available":96598884352,"internally_reserved":0,"allocated":1683456,"data_stored":774474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1609728,"data_stored":740606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1683456,"data_stored":774474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1609728,"data_stored":740606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33420,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338420,"statfs":{"total":96636764160,"available":96602542080,"internally_reserved":0,"allocated":2277376,"data_stored":1364842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:23:23.481 INFO:tasks.ceph.ceph_manager.ceph:PG 22.3f is not active+clean 2024-09-16T01:23:23.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.481 INFO:tasks.ceph.ceph_manager.ceph:PG 22.3e is not active+clean 2024-09-16T01:23:23.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.481 INFO:tasks.ceph.ceph_manager.ceph:PG 22.3d is not active+clean 2024-09-16T01:23:23.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.482 INFO:tasks.ceph.ceph_manager.ceph:PG 22.3c is not active+clean 2024-09-16T01:23:23.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.482 INFO:tasks.ceph.ceph_manager.ceph:PG 22.3b is not active+clean 2024-09-16T01:23:23.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.482 INFO:tasks.ceph.ceph_manager.ceph:PG 22.3a is not active+clean 2024-09-16T01:23:23.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.482 INFO:tasks.ceph.ceph_manager.ceph:PG 22.39 is not active+clean 2024-09-16T01:23:23.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.482 INFO:tasks.ceph.ceph_manager.ceph:PG 22.38 is not active+clean 2024-09-16T01:23:23.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.483 INFO:tasks.ceph.ceph_manager.ceph:PG 22.37 is not active+clean 2024-09-16T01:23:23.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.483 INFO:tasks.ceph.ceph_manager.ceph:PG 22.36 is not active+clean 2024-09-16T01:23:23.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.483 INFO:tasks.ceph.ceph_manager.ceph:PG 22.35 is not active+clean 2024-09-16T01:23:23.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.483 INFO:tasks.ceph.ceph_manager.ceph:PG 22.34 is not active+clean 2024-09-16T01:23:23.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.483 INFO:tasks.ceph.ceph_manager.ceph:PG 22.33 is not active+clean 2024-09-16T01:23:23.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.483 INFO:tasks.ceph.ceph_manager.ceph:PG 22.32 is not active+clean 2024-09-16T01:23:23.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.484 INFO:tasks.ceph.ceph_manager.ceph:PG 22.31 is not active+clean 2024-09-16T01:23:23.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.484 INFO:tasks.ceph.ceph_manager.ceph:PG 22.30 is not active+clean 2024-09-16T01:23:23.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.484 INFO:tasks.ceph.ceph_manager.ceph:PG 22.2f is not active+clean 2024-09-16T01:23:23.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.484 INFO:tasks.ceph.ceph_manager.ceph:PG 22.2e is not active+clean 2024-09-16T01:23:23.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.484 INFO:tasks.ceph.ceph_manager.ceph:PG 22.2d is not active+clean 2024-09-16T01:23:23.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.484 INFO:tasks.ceph.ceph_manager.ceph:PG 22.2c is not active+clean 2024-09-16T01:23:23.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.485 INFO:tasks.ceph.ceph_manager.ceph:PG 22.2b is not active+clean 2024-09-16T01:23:23.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.485 INFO:tasks.ceph.ceph_manager.ceph:PG 22.2a is not active+clean 2024-09-16T01:23:23.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.485 INFO:tasks.ceph.ceph_manager.ceph:PG 22.29 is not active+clean 2024-09-16T01:23:23.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.485 INFO:tasks.ceph.ceph_manager.ceph:PG 22.28 is not active+clean 2024-09-16T01:23:23.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.485 INFO:tasks.ceph.ceph_manager.ceph:PG 22.27 is not active+clean 2024-09-16T01:23:23.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.486 INFO:tasks.ceph.ceph_manager.ceph:PG 22.26 is not active+clean 2024-09-16T01:23:23.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.486 INFO:tasks.ceph.ceph_manager.ceph:PG 22.25 is not active+clean 2024-09-16T01:23:23.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.486 INFO:tasks.ceph.ceph_manager.ceph:PG 22.24 is not active+clean 2024-09-16T01:23:23.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.486 INFO:tasks.ceph.ceph_manager.ceph:PG 22.23 is not active+clean 2024-09-16T01:23:23.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.486 INFO:tasks.ceph.ceph_manager.ceph:PG 22.22 is not active+clean 2024-09-16T01:23:23.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.487 INFO:tasks.ceph.ceph_manager.ceph:PG 22.21 is not active+clean 2024-09-16T01:23:23.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.487 INFO:tasks.ceph.ceph_manager.ceph:PG 22.20 is not active+clean 2024-09-16T01:23:23.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.487 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1c is not active+clean 2024-09-16T01:23:23.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.487 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1f is not active+clean 2024-09-16T01:23:23.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.611425+0000', 'last_change': '2024-09-16T01:23:17.611425+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.611425+0000', 'last_undegraded': '2024-09-16T01:23:17.611425+0000', 'last_fullsized': '2024-09-16T01:23:17.611425+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:23:23.487 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1d is not active+clean 2024-09-16T01:23:23.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.487 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1e is not active+clean 2024-09-16T01:23:23.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.585184+0000', 'last_change': '2024-09-16T01:23:17.585184+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.585184+0000', 'last_undegraded': '2024-09-16T01:23:17.585184+0000', 'last_fullsized': '2024-09-16T01:23:17.585184+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:23:23.488 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1e is not active+clean 2024-09-16T01:23:23.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.488 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1d is not active+clean 2024-09-16T01:23:23.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.584370+0000', 'last_change': '2024-09-16T01:23:17.584370+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.584370+0000', 'last_undegraded': '2024-09-16T01:23:17.584370+0000', 'last_fullsized': '2024-09-16T01:23:17.584370+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:23:23.488 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1f is not active+clean 2024-09-16T01:23:23.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.488 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1c is not active+clean 2024-09-16T01:23:23.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.585074+0000', 'last_change': '2024-09-16T01:23:17.585074+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.585074+0000', 'last_undegraded': '2024-09-16T01:23:17.585074+0000', 'last_fullsized': '2024-09-16T01:23:17.585074+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:23:23.488 INFO:tasks.ceph.ceph_manager.ceph:PG 22.18 is not active+clean 2024-09-16T01:23:23.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.488 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1b is not active+clean 2024-09-16T01:23:23.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.588506+0000', 'last_change': '2024-09-16T01:23:17.588506+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.588506+0000', 'last_undegraded': '2024-09-16T01:23:17.588506+0000', 'last_fullsized': '2024-09-16T01:23:17.588506+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T01:23:23.489 INFO:tasks.ceph.ceph_manager.ceph:PG 22.19 is not active+clean 2024-09-16T01:23:23.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.489 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1a is not active+clean 2024-09-16T01:23:23.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.611429+0000', 'last_change': '2024-09-16T01:23:17.611429+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.611429+0000', 'last_undegraded': '2024-09-16T01:23:17.611429+0000', 'last_fullsized': '2024-09-16T01:23:17.611429+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:23:23.489 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1a is not active+clean 2024-09-16T01:23:23.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.489 INFO:tasks.ceph.ceph_manager.ceph:PG 21.19 is not active+clean 2024-09-16T01:23:23.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.585285+0000', 'last_change': '2024-09-16T01:23:17.585285+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.585285+0000', 'last_undegraded': '2024-09-16T01:23:17.585285+0000', 'last_fullsized': '2024-09-16T01:23:17.585285+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:23:23.489 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1b is not active+clean 2024-09-16T01:23:23.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.489 INFO:tasks.ceph.ceph_manager.ceph:PG 21.18 is not active+clean 2024-09-16T01:23:23.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.611414+0000', 'last_change': '2024-09-16T01:23:17.611414+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.611414+0000', 'last_undegraded': '2024-09-16T01:23:17.611414+0000', 'last_fullsized': '2024-09-16T01:23:17.611414+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:23:23.490 INFO:tasks.ceph.ceph_manager.ceph:PG 22.14 is not active+clean 2024-09-16T01:23:23.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.490 INFO:tasks.ceph.ceph_manager.ceph:PG 21.17 is not active+clean 2024-09-16T01:23:23.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.584371+0000', 'last_change': '2024-09-16T01:23:17.584371+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.584371+0000', 'last_undegraded': '2024-09-16T01:23:17.584371+0000', 'last_fullsized': '2024-09-16T01:23:17.584371+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:23:23.490 INFO:tasks.ceph.ceph_manager.ceph:PG 22.15 is not active+clean 2024-09-16T01:23:23.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.490 INFO:tasks.ceph.ceph_manager.ceph:PG 21.16 is not active+clean 2024-09-16T01:23:23.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.585873+0000', 'last_change': '2024-09-16T01:23:17.585873+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.585873+0000', 'last_undegraded': '2024-09-16T01:23:17.585873+0000', 'last_fullsized': '2024-09-16T01:23:17.585873+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:23:23.490 INFO:tasks.ceph.ceph_manager.ceph:PG 22.16 is not active+clean 2024-09-16T01:23:23.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.491 INFO:tasks.ceph.ceph_manager.ceph:PG 21.15 is not active+clean 2024-09-16T01:23:23.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.586521+0000', 'last_change': '2024-09-16T01:23:17.586521+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.586521+0000', 'last_undegraded': '2024-09-16T01:23:17.586521+0000', 'last_fullsized': '2024-09-16T01:23:17.586521+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:23:23.491 INFO:tasks.ceph.ceph_manager.ceph:PG 22.10 is not active+clean 2024-09-16T01:23:23.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.491 INFO:tasks.ceph.ceph_manager.ceph:PG 21.13 is not active+clean 2024-09-16T01:23:23.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.611386+0000', 'last_change': '2024-09-16T01:23:17.611386+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.611386+0000', 'last_undegraded': '2024-09-16T01:23:17.611386+0000', 'last_fullsized': '2024-09-16T01:23:17.611386+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:23:23.491 INFO:tasks.ceph.ceph_manager.ceph:PG 22.11 is not active+clean 2024-09-16T01:23:23.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.491 INFO:tasks.ceph.ceph_manager.ceph:PG 21.12 is not active+clean 2024-09-16T01:23:23.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.588636+0000', 'last_change': '2024-09-16T01:23:17.588636+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.588636+0000', 'last_undegraded': '2024-09-16T01:23:17.588636+0000', 'last_fullsized': '2024-09-16T01:23:17.588636+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:23:23.492 INFO:tasks.ceph.ceph_manager.ceph:PG 22.12 is not active+clean 2024-09-16T01:23:23.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.492 INFO:tasks.ceph.ceph_manager.ceph:PG 21.11 is not active+clean 2024-09-16T01:23:23.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.588901+0000', 'last_change': '2024-09-16T01:23:17.588901+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.588901+0000', 'last_undegraded': '2024-09-16T01:23:17.588901+0000', 'last_fullsized': '2024-09-16T01:23:17.588901+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:23:23.492 INFO:tasks.ceph.ceph_manager.ceph:PG 22.13 is not active+clean 2024-09-16T01:23:23.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.492 INFO:tasks.ceph.ceph_manager.ceph:PG 21.10 is not active+clean 2024-09-16T01:23:23.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.584627+0000', 'last_change': '2024-09-16T01:23:17.584627+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.584627+0000', 'last_undegraded': '2024-09-16T01:23:17.584627+0000', 'last_fullsized': '2024-09-16T01:23:17.584627+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:23:23.492 INFO:tasks.ceph.ceph_manager.ceph:PG 22.c is not active+clean 2024-09-16T01:23:23.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.492 INFO:tasks.ceph.ceph_manager.ceph:PG 21.f is not active+clean 2024-09-16T01:23:23.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.586788+0000', 'last_change': '2024-09-16T01:23:17.586788+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.586788+0000', 'last_undegraded': '2024-09-16T01:23:17.586788+0000', 'last_fullsized': '2024-09-16T01:23:17.586788+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:23:23.493 INFO:tasks.ceph.ceph_manager.ceph:PG 22.d is not active+clean 2024-09-16T01:23:23.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.493 INFO:tasks.ceph.ceph_manager.ceph:PG 21.e is not active+clean 2024-09-16T01:23:23.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.584369+0000', 'last_change': '2024-09-16T01:23:17.584369+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.584369+0000', 'last_undegraded': '2024-09-16T01:23:17.584369+0000', 'last_fullsized': '2024-09-16T01:23:17.584369+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:23:23.493 INFO:tasks.ceph.ceph_manager.ceph:PG 22.e is not active+clean 2024-09-16T01:23:23.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.493 INFO:tasks.ceph.ceph_manager.ceph:PG 21.d is not active+clean 2024-09-16T01:23:23.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.585071+0000', 'last_change': '2024-09-16T01:23:17.585071+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.585071+0000', 'last_undegraded': '2024-09-16T01:23:17.585071+0000', 'last_fullsized': '2024-09-16T01:23:17.585071+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:23:23.493 INFO:tasks.ceph.ceph_manager.ceph:PG 22.f is not active+clean 2024-09-16T01:23:23.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.494 INFO:tasks.ceph.ceph_manager.ceph:PG 21.c is not active+clean 2024-09-16T01:23:23.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.588141+0000', 'last_change': '2024-09-16T01:23:17.588141+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.588141+0000', 'last_undegraded': '2024-09-16T01:23:17.588141+0000', 'last_fullsized': '2024-09-16T01:23:17.588141+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:23:23.494 INFO:tasks.ceph.ceph_manager.ceph:PG 22.8 is not active+clean 2024-09-16T01:23:23.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.494 INFO:tasks.ceph.ceph_manager.ceph:PG 21.b is not active+clean 2024-09-16T01:23:23.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.586405+0000', 'last_change': '2024-09-16T01:23:17.586405+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.586405+0000', 'last_undegraded': '2024-09-16T01:23:17.586405+0000', 'last_fullsized': '2024-09-16T01:23:17.586405+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T01:23:23.494 INFO:tasks.ceph.ceph_manager.ceph:PG 22.9 is not active+clean 2024-09-16T01:23:23.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.494 INFO:tasks.ceph.ceph_manager.ceph:PG 21.a is not active+clean 2024-09-16T01:23:23.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.588317+0000', 'last_change': '2024-09-16T01:23:17.588317+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.588317+0000', 'last_undegraded': '2024-09-16T01:23:17.588317+0000', 'last_fullsized': '2024-09-16T01:23:17.588317+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T01:23:23.494 INFO:tasks.ceph.ceph_manager.ceph:PG 22.a is not active+clean 2024-09-16T01:23:23.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.495 INFO:tasks.ceph.ceph_manager.ceph:PG 21.9 is not active+clean 2024-09-16T01:23:23.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.586399+0000', 'last_change': '2024-09-16T01:23:17.586399+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.586399+0000', 'last_undegraded': '2024-09-16T01:23:17.586399+0000', 'last_fullsized': '2024-09-16T01:23:17.586399+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T01:23:23.495 INFO:tasks.ceph.ceph_manager.ceph:PG 22.b is not active+clean 2024-09-16T01:23:23.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.495 INFO:tasks.ceph.ceph_manager.ceph:PG 21.8 is not active+clean 2024-09-16T01:23:23.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.588890+0000', 'last_change': '2024-09-16T01:23:17.588890+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.588890+0000', 'last_undegraded': '2024-09-16T01:23:17.588890+0000', 'last_fullsized': '2024-09-16T01:23:17.588890+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-16T01:23:23.495 INFO:tasks.ceph.ceph_manager.ceph:PG 22.4 is not active+clean 2024-09-16T01:23:23.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.495 INFO:tasks.ceph.ceph_manager.ceph:PG 21.7 is not active+clean 2024-09-16T01:23:23.495 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.589123+0000', 'last_change': '2024-09-16T01:23:17.589123+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.589123+0000', 'last_undegraded': '2024-09-16T01:23:17.589123+0000', 'last_fullsized': '2024-09-16T01:23:17.589123+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-16T01:23:23.496 INFO:tasks.ceph.ceph_manager.ceph:PG 22.5 is not active+clean 2024-09-16T01:23:23.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.496 INFO:tasks.ceph.ceph_manager.ceph:PG 21.6 is not active+clean 2024-09-16T01:23:23.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.585464+0000', 'last_change': '2024-09-16T01:23:17.585464+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.585464+0000', 'last_undegraded': '2024-09-16T01:23:17.585464+0000', 'last_fullsized': '2024-09-16T01:23:17.585464+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:23:23.496 INFO:tasks.ceph.ceph_manager.ceph:PG 22.6 is not active+clean 2024-09-16T01:23:23.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.496 INFO:tasks.ceph.ceph_manager.ceph:PG 21.5 is not active+clean 2024-09-16T01:23:23.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.584632+0000', 'last_change': '2024-09-16T01:23:17.584632+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.584632+0000', 'last_undegraded': '2024-09-16T01:23:17.584632+0000', 'last_fullsized': '2024-09-16T01:23:17.584632+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-16T01:23:23.496 INFO:tasks.ceph.ceph_manager.ceph:PG 22.7 is not active+clean 2024-09-16T01:23:23.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.496 INFO:tasks.ceph.ceph_manager.ceph:PG 21.4 is not active+clean 2024-09-16T01:23:23.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.611421+0000', 'last_change': '2024-09-16T01:23:17.611421+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.611421+0000', 'last_undegraded': '2024-09-16T01:23:17.611421+0000', 'last_fullsized': '2024-09-16T01:23:17.611421+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-16T01:23:23.497 INFO:tasks.ceph.ceph_manager.ceph:PG 22.0 is not active+clean 2024-09-16T01:23:23.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.497 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3 is not active+clean 2024-09-16T01:23:23.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.584918+0000', 'last_change': '2024-09-16T01:23:17.584918+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.584918+0000', 'last_undegraded': '2024-09-16T01:23:17.584918+0000', 'last_fullsized': '2024-09-16T01:23:17.584918+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:23:23.497 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1 is not active+clean 2024-09-16T01:23:23.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.497 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2 is not active+clean 2024-09-16T01:23:23.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.586738+0000', 'last_change': '2024-09-16T01:23:17.586738+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.586738+0000', 'last_undegraded': '2024-09-16T01:23:17.586738+0000', 'last_fullsized': '2024-09-16T01:23:17.586738+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-16T01:23:23.497 INFO:tasks.ceph.ceph_manager.ceph:PG 22.2 is not active+clean 2024-09-16T01:23:23.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.497 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1 is not active+clean 2024-09-16T01:23:23.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.584693+0000', 'last_change': '2024-09-16T01:23:17.584693+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.584693+0000', 'last_undegraded': '2024-09-16T01:23:17.584693+0000', 'last_fullsized': '2024-09-16T01:23:17.584693+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-16T01:23:23.498 INFO:tasks.ceph.ceph_manager.ceph:PG 22.3 is not active+clean 2024-09-16T01:23:23.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.498 INFO:tasks.ceph.ceph_manager.ceph:PG 21.0 is not active+clean 2024-09-16T01:23:23.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.584467+0000', 'last_change': '2024-09-16T01:23:17.584467+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.584467+0000', 'last_undegraded': '2024-09-16T01:23:17.584467+0000', 'last_fullsized': '2024-09-16T01:23:17.584467+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-16T01:23:23.498 INFO:tasks.ceph.ceph_manager.ceph:PG 22.17 is not active+clean 2024-09-16T01:23:23.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-16T01:23:18.581786+0000', 'last_change': '2024-09-16T01:23:18.581786+0000', 'last_active': '2024-09-16T01:23:18.581786+0000', 'last_peered': '2024-09-16T01:23:18.581786+0000', 'last_clean': '2024-09-16T01:23:18.581786+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:18.581786+0000', 'last_undegraded': '2024-09-16T01:23:18.581786+0000', 'last_fullsized': '2024-09-16T01:23:18.581786+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:18.581786+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-16T01:23:23.498 INFO:tasks.ceph.ceph_manager.ceph:PG 21.14 is not active+clean 2024-09-16T01:23:23.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2024-09-16T01:23:17.586477+0000', 'last_change': '2024-09-16T01:23:17.586477+0000', 'last_active': '2024-09-16T01:23:17.579645+0000', 'last_peered': '2024-09-16T01:23:17.579645+0000', 'last_clean': '2024-09-16T01:23:17.579645+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-16T01:23:17.586477+0000', 'last_undegraded': '2024-09-16T01:23:17.586477+0000', 'last_fullsized': '2024-09-16T01:23:17.586477+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'last_clean_scrub_stamp': '2024-09-16T01:23:17.579645+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-16T01:23:23.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-16T01:23:23.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.614+0000 7f1e69703640 1 Processor -- start 2024-09-16T01:23:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.614+0000 7f1e69703640 1 -- start start 2024-09-16T01:23:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.614+0000 7f1e69703640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1e64161c80 0x7f1e6406e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.614+0000 7f1e69703640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e640b6680 0x7f1e640cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.614+0000 7f1e69703640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e6406e870 con 0x7f1e64162060 2024-09-16T01:23:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.614+0000 7f1e69703640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1e6406d9f0 con 0x7f1e64161c80 2024-09-16T01:23:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.614+0000 7f1e69703640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1e6406dcd0 con 0x7f1e640b6680 2024-09-16T01:23:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.615+0000 7f1e637fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e640b6680 0x7f1e640cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.615+0000 7f1e62ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1e64161c80 0x7f1e6406e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.615+0000 7f1e627fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1e64162060 0x7f1e640b5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:41750/0 (socket says 172.21.15.81:41750) 2024-09-16T01:23:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.615+0000 7f1e62ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1e64161c80 0x7f1e6406e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:53488/0 (socket says 172.21.15.81:53488) 2024-09-16T01:23:23.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.615+0000 7f1e627fc640 1 -- 172.21.15.81:0/227923707 learned_addr learned my addr 172.21.15.81:0/227923707 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:23.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.615+0000 7f1e637fe640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e640b6680 0x7f1e640cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:38140/0 (socket says 172.21.15.81:38140) 2024-09-16T01:23:23.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.615+0000 7f1e62ffd640 1 -- 172.21.15.81:0/227923707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e640b6680 msgr2=0x7f1e640cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:23.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.615+0000 7f1e62ffd640 1 --2- 172.21.15.81:0/227923707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e640b6680 0x7f1e640cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.615+0000 7f1e62ffd640 1 -- 172.21.15.81:0/227923707 >> v1:172.21.15.102:6789/0 conn(0x7f1e64162060 legacy=0x7f1e640b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.615+0000 7f1e62ffd640 1 -- 172.21.15.81:0/227923707 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6406dfb0 con 0x7f1e64161c80 2024-09-16T01:23:23.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.615+0000 7f1e61ffb640 1 -- 172.21.15.81:0/227923707 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 575928907 0 0) 0x7f1e58001490 con 0x7f1e64162060 2024-09-16T01:23:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.616+0000 7f1e62ffd640 1 --2- 172.21.15.81:0/227923707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e64161c80 0x7f1e6406e330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0097a0 tx=0x7f1e5c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9c9e0b4225a6f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.616+0000 7f1e61ffb640 1 -- 172.21.15.81:0/227923707 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c037070 con 0x7f1e64161c80 2024-09-16T01:23:23.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.616+0000 7f1e61ffb640 1 -- 172.21.15.81:0/227923707 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5c032440 con 0x7f1e64161c80 2024-09-16T01:23:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.616+0000 7f1e61ffb640 1 -- 172.21.15.81:0/227923707 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c032810 con 0x7f1e64161c80 2024-09-16T01:23:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.617+0000 7f1e69703640 1 -- 172.21.15.81:0/227923707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e64161c80 msgr2=0x7f1e6406e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.617+0000 7f1e69703640 1 --2- 172.21.15.81:0/227923707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e64161c80 0x7f1e6406e330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c0097a0 tx=0x7f1e5c02a180 comp rx=0 tx=0).stop 2024-09-16T01:23:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.617+0000 7f1e69703640 1 -- 172.21.15.81:0/227923707 shutdown_connections 2024-09-16T01:23:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.617+0000 7f1e69703640 1 --2- 172.21.15.81:0/227923707 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e640b6680 0x7f1e640cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.617+0000 7f1e69703640 1 --2- 172.21.15.81:0/227923707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e64161c80 0x7f1e6406e330 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.617+0000 7f1e69703640 1 -- 172.21.15.81:0/227923707 >> 172.21.15.81:0/227923707 conn(0x7f1e640d44f0 msgr2=0x7f1e640d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.617+0000 7f1e69703640 1 -- 172.21.15.81:0/227923707 shutdown_connections 2024-09-16T01:23:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.617+0000 7f1e69703640 1 -- 172.21.15.81:0/227923707 wait complete. 2024-09-16T01:23:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.618+0000 7f1e69703640 1 Processor -- start 2024-09-16T01:23:23.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.618+0000 7f1e69703640 1 -- start start 2024-09-16T01:23:23.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e69703640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e640b6680 0x7f1e64155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e69703640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e64161c80 0x7f1e640cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e69703640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e64162060 0x7f1e64155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e69703640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1e640b6cb0 con 0x7f1e640b6680 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e69703640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1e640b6b30 con 0x7f1e64161c80 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e69703640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1e640cf720 con 0x7f1e64162060 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e62ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e640b6680 0x7f1e64155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e62ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e640b6680 0x7f1e64155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48872/0 (socket says 172.21.15.81:48872) 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e62ffd640 1 -- 172.21.15.81:0/1122118780 learned_addr learned my addr 172.21.15.81:0/1122118780 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e627fc640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e64161c80 0x7f1e640cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e62ffd640 1 -- 172.21.15.81:0/1122118780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e64162060 msgr2=0x7f1e64155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e62ffd640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e64162060 0x7f1e64155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e62ffd640 1 -- 172.21.15.81:0/1122118780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e64161c80 msgr2=0x7f1e640cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e62ffd640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e64161c80 0x7f1e640cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e62ffd640 1 -- 172.21.15.81:0/1122118780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e64155c30 con 0x7f1e640b6680 2024-09-16T01:23:23.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e62ffd640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e640b6680 0x7f1e64155e70 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c000c00 tx=0x7f1e5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:23.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e4b7fe640 1 -- 172.21.15.81:0/1122118780 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c037050 con 0x7f1e640b6680 2024-09-16T01:23:23.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e4b7fe640 1 -- 172.21.15.81:0/1122118780 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5c038040 con 0x7f1e640b6680 2024-09-16T01:23:23.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e69703640 1 -- 172.21.15.81:0/1122118780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e640ccab0 con 0x7f1e640b6680 2024-09-16T01:23:23.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e4b7fe640 1 -- 172.21.15.81:0/1122118780 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c004470 con 0x7f1e640b6680 2024-09-16T01:23:23.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.619+0000 7f1e69703640 1 -- 172.21.15.81:0/1122118780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e640b8bc0 con 0x7f1e640b6680 2024-09-16T01:23:23.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.620+0000 7f1e69703640 1 -- 172.21.15.81:0/1122118780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e640cf1e0 con 0x7f1e640b6680 2024-09-16T01:23:23.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.621+0000 7f1e4b7fe640 1 -- 172.21.15.81:0/1122118780 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1e5c03c6d0 con 0x7f1e640b6680 2024-09-16T01:23:23.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.621+0000 7f1e4b7fe640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1e5006c2b0 0x7f1e5006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.621+0000 7f1e4b7fe640 1 -- 172.21.15.81:0/1122118780 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f1e5c0abfb0 con 0x7f1e640b6680 2024-09-16T01:23:23.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.621+0000 7f1e627fc640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1e5006c2b0 0x7f1e5006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.622+0000 7f1e627fc640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1e5006c2b0 0x7f1e5006e770 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1e640b3bd0 tx=0x7f1e58005bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:23.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.626+0000 7f1e4b7fe640 1 -- 172.21.15.81:0/1122118780 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e5c07a590 con 0x7f1e640b6680 2024-09-16T01:23:23.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.851+0000 7f1e69703640 1 -- 172.21.15.81:0/1122118780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1e640ba470 con 0x7f1e640b6680 2024-09-16T01:23:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.851+0000 7f1e4b7fe640 1 -- 172.21.15.81:0/1122118780 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1574 (secure 0 0 0) 0x7f1e5c079e90 con 0x7f1e640b6680 2024-09-16T01:23:23.853 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:23.853 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":487,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":137,"num_osds":8,"num_up_osds":8,"osd_up_since":1726449328,"num_in_osds":8,"osd_in_since":1726449318,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":278568960,"bytes_avail":772815544320,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":75,"btime":"2024-09-16T01:23:21:883930+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":8103}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-16T01:22:28.148961+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-16T01:23:23.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.853+0000 7f1e69703640 1 -- 172.21.15.81:0/1122118780 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1e5006c2b0 msgr2=0x7f1e5006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.853+0000 7f1e69703640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1e5006c2b0 0x7f1e5006e770 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1e640b3bd0 tx=0x7f1e58005bf0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.853+0000 7f1e69703640 1 -- 172.21.15.81:0/1122118780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e640b6680 msgr2=0x7f1e64155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.853+0000 7f1e69703640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e640b6680 0x7f1e64155e70 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c000c00 tx=0x7f1e5c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.853+0000 7f1e69703640 1 -- 172.21.15.81:0/1122118780 shutdown_connections 2024-09-16T01:23:23.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.853+0000 7f1e69703640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1e5006c2b0 0x7f1e5006e770 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.853+0000 7f1e69703640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e64162060 0x7f1e64155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.853+0000 7f1e69703640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e64161c80 0x7f1e640cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.853+0000 7f1e69703640 1 --2- 172.21.15.81:0/1122118780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e640b6680 0x7f1e64155e70 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.853+0000 7f1e69703640 1 -- 172.21.15.81:0/1122118780 >> 172.21.15.81:0/1122118780 conn(0x7f1e640d44f0 msgr2=0x7f1e6415fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:23.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.853+0000 7f1e69703640 1 -- 172.21.15.81:0/1122118780 shutdown_connections 2024-09-16T01:23:23.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.853+0000 7f1e69703640 1 -- 172.21.15.81:0/1122118780 wait complete. 2024-09-16T01:23:23.866 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-16T01:23:23.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:23:23.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.963+0000 7fe9bcad2640 1 Processor -- start 2024-09-16T01:23:23.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.963+0000 7fe9bcad2640 1 -- start start 2024-09-16T01:23:23.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.964+0000 7fe9bcad2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9b8147360 0x7fe9b8070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.964+0000 7fe9bcad2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9b806cb30 con 0x7fe9b80d0bb0 2024-09-16T01:23:23.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.964+0000 7fe9bcad2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9b806bfb0 con 0x7fe9b8070dd0 2024-09-16T01:23:23.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.964+0000 7fe9bcad2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe9b806c290 con 0x7fe9b8147360 2024-09-16T01:23:23.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.964+0000 7fe9b659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9b8147360 0x7fe9b8070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.964+0000 7fe9b659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9b8147360 0x7fe9b8070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48886/0 (socket says 172.21.15.81:48886) 2024-09-16T01:23:23.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.964+0000 7fe9b659c640 1 -- 172.21.15.81:0/1179765605 learned_addr learned my addr 172.21.15.81:0/1179765605 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:23.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.964+0000 7fe9b659c640 1 -- 172.21.15.81:0/1179765605 >> v1:172.21.15.102:6789/0 conn(0x7fe9b8070dd0 legacy=0x7fe9b80d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.964+0000 7fe9b659c640 1 -- 172.21.15.81:0/1179765605 >> v1:172.21.15.81:6789/0 conn(0x7fe9b80d0bb0 legacy=0x7fe9b80ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.964+0000 7fe9b659c640 1 -- 172.21.15.81:0/1179765605 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b806c570 con 0x7fe9b8147360 2024-09-16T01:23:23.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.965+0000 7fe9b659c640 1 --2- 172.21.15.81:0/1179765605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8147360 0x7fe9b8070890 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009870 tx=0x7fe9a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ad7538fd20c6cf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:23.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.965+0000 7fe9b559a640 1 -- 172.21.15.81:0/1179765605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8037070 con 0x7fe9b8147360 2024-09-16T01:23:23.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.965+0000 7fe9b559a640 1 -- 172.21.15.81:0/1179765605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a8032440 con 0x7fe9b8147360 2024-09-16T01:23:23.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.965+0000 7fe9b559a640 1 -- 172.21.15.81:0/1179765605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8032810 con 0x7fe9b8147360 2024-09-16T01:23:23.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.966+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1179765605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8147360 msgr2=0x7fe9b8070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.966+0000 7fe9bcad2640 1 --2- 172.21.15.81:0/1179765605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8147360 0x7fe9b8070890 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8009870 tx=0x7fe9a802a1e0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.966+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1179765605 shutdown_connections 2024-09-16T01:23:23.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.966+0000 7fe9bcad2640 1 --2- 172.21.15.81:0/1179765605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8147360 0x7fe9b8070890 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.966+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1179765605 >> 172.21.15.81:0/1179765605 conn(0x7fe9b80b2f40 msgr2=0x7fe9b80b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:23.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.966+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1179765605 shutdown_connections 2024-09-16T01:23:23.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.966+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1179765605 wait complete. 2024-09-16T01:23:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.967+0000 7fe9bcad2640 1 Processor -- start 2024-09-16T01:23:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.967+0000 7fe9bcad2640 1 -- start start 2024-09-16T01:23:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9bcad2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8070dd0 0x7fe9b80b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9bcad2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9b80d0bb0 0x7fe9b813bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9bcad2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9b8147360 0x7fe9b813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9bcad2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b806bd90 con 0x7fe9b8070dd0 2024-09-16T01:23:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9bcad2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b806bc10 con 0x7fe9b80d0bb0 2024-09-16T01:23:23.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9bcad2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b80aec60 con 0x7fe9b8147360 2024-09-16T01:23:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9b659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8070dd0 0x7fe9b80b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9b659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8070dd0 0x7fe9b80b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48902/0 (socket says 172.21.15.81:48902) 2024-09-16T01:23:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9b659c640 1 -- 172.21.15.81:0/1222847337 learned_addr learned my addr 172.21.15.81:0/1222847337 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9b5d9b640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9b80d0bb0 0x7fe9b813bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9b6d9d640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9b8147360 0x7fe9b813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9b659c640 1 -- 172.21.15.81:0/1222847337 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9b8147360 msgr2=0x7fe9b813c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9b659c640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9b8147360 0x7fe9b813c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9b659c640 1 -- 172.21.15.81:0/1222847337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9b80d0bb0 msgr2=0x7fe9b813bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9b659c640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9b80d0bb0 0x7fe9b813bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9b659c640 1 -- 172.21.15.81:0/1222847337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b813c920 con 0x7fe9b8070dd0 2024-09-16T01:23:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9b6d9d640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9b8147360 0x7fe9b813c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:23.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.968+0000 7fe9b659c640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8070dd0 0x7fe9b80b5520 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8000c00 tx=0x7fe9a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.969+0000 7fe9a6ffd640 1 -- 172.21.15.81:0/1222847337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8037040 con 0x7fe9b8070dd0 2024-09-16T01:23:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.969+0000 7fe9a6ffd640 1 -- 172.21.15.81:0/1222847337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9a8042070 con 0x7fe9b8070dd0 2024-09-16T01:23:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.969+0000 7fe9a6ffd640 1 -- 172.21.15.81:0/1222847337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8030bd0 con 0x7fe9b8070dd0 2024-09-16T01:23:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.969+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1222847337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b813ea00 con 0x7fe9b8070dd0 2024-09-16T01:23:23.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.969+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1222847337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b813efc0 con 0x7fe9b8070dd0 2024-09-16T01:23:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.970+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1222847337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9b8070890 con 0x7fe9b8070dd0 2024-09-16T01:23:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.970+0000 7fe9a6ffd640 1 -- 172.21.15.81:0/1222847337 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe9a8047460 con 0x7fe9b8070dd0 2024-09-16T01:23:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.970+0000 7fe9a6ffd640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe99806c2b0 0x7fe99806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.971+0000 7fe9a6ffd640 1 -- 172.21.15.81:0/1222847337 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fe9a80ac190 con 0x7fe9b8070dd0 2024-09-16T01:23:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.971+0000 7fe9b5d9b640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe99806c2b0 0x7fe99806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:23.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.971+0000 7fe9b5d9b640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe99806c2b0 0x7fe99806e770 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80b7500 tx=0x7fe9ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:23.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:23.975+0000 7fe9a6ffd640 1 -- 172.21.15.81:0/1222847337 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9a8045360 con 0x7fe9b8070dd0 2024-09-16T01:23:24.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.138+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1222847337 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9b80b1330 con 0x7fe99806c2b0 2024-09-16T01:23:24.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.143+0000 7fe9a6ffd640 1 -- 172.21.15.81:0/1222847337 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240222 (secure 0 0 0) 0x7fe9b80b1330 con 0x7fe99806c2b0 2024-09-16T01:23:24.147 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:23:24.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.146+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1222847337 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe99806c2b0 msgr2=0x7fe99806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:24.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.146+0000 7fe9bcad2640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe99806c2b0 0x7fe99806e770 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80b7500 tx=0x7fe9ac009040 comp rx=0 tx=0).stop 2024-09-16T01:23:24.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.146+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1222847337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8070dd0 msgr2=0x7fe9b80b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:24.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.146+0000 7fe9bcad2640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8070dd0 0x7fe9b80b5520 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fe9a8000c00 tx=0x7fe9a80046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:24.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.146+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1222847337 shutdown_connections 2024-09-16T01:23:24.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.146+0000 7fe9bcad2640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe99806c2b0 0x7fe99806e770 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:24.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.146+0000 7fe9bcad2640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe9b8147360 0x7fe9b813c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:24.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.146+0000 7fe9bcad2640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9b80d0bb0 0x7fe9b813bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:24.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.146+0000 7fe9bcad2640 1 --2- 172.21.15.81:0/1222847337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8070dd0 0x7fe9b80b5520 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:24.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.146+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1222847337 >> 172.21.15.81:0/1222847337 conn(0x7fe9b80b2f40 msgr2=0x7fe9b806f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:24.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.146+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1222847337 shutdown_connections 2024-09-16T01:23:24.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:24.146+0000 7fe9bcad2640 1 -- 172.21.15.81:0/1222847337 wait complete. 2024-09-16T01:23:24.159 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2024-09-16T01:23:22.160265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272040,"kb_used_data":14156,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754702680,"statfs":{"total":773094113280,"available":772815544320,"internally_reserved":0,"allocated":14495744,"data_stored":7302583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.578064"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611425+0000","last_change":"2024-09-16T01:23:17.611425+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611425+0000","last_undegraded":"2024-09-16T01:23:17.611425+0000","last_fullsized":"2024-09-16T01:23:17.611425+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585184+0000","last_change":"2024-09-16T01:23:17.585184+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585184+0000","last_undegraded":"2024-09-16T01:23:17.585184+0000","last_fullsized":"2024-09-16T01:23:17.585184+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584370+0000","last_change":"2024-09-16T01:23:17.584370+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584370+0000","last_undegraded":"2024-09-16T01:23:17.584370+0000","last_fullsized":"2024-09-16T01:23:17.584370+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585074+0000","last_change":"2024-09-16T01:23:17.585074+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585074+0000","last_undegraded":"2024-09-16T01:23:17.585074+0000","last_fullsized":"2024-09-16T01:23:17.585074+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588506+0000","last_change":"2024-09-16T01:23:17.588506+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588506+0000","last_undegraded":"2024-09-16T01:23:17.588506+0000","last_fullsized":"2024-09-16T01:23:17.588506+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611429+0000","last_change":"2024-09-16T01:23:17.611429+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611429+0000","last_undegraded":"2024-09-16T01:23:17.611429+0000","last_fullsized":"2024-09-16T01:23:17.611429+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585285+0000","last_change":"2024-09-16T01:23:17.585285+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585285+0000","last_undegraded":"2024-09-16T01:23:17.585285+0000","last_fullsized":"2024-09-16T01:23:17.585285+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611414+0000","last_change":"2024-09-16T01:23:17.611414+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611414+0000","last_undegraded":"2024-09-16T01:23:17.611414+0000","last_fullsized":"2024-09-16T01:23:17.611414+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584371+0000","last_change":"2024-09-16T01:23:17.584371+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584371+0000","last_undegraded":"2024-09-16T01:23:17.584371+0000","last_fullsized":"2024-09-16T01:23:17.584371+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585873+0000","last_change":"2024-09-16T01:23:17.585873+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585873+0000","last_undegraded":"2024-09-16T01:23:17.585873+0000","last_fullsized":"2024-09-16T01:23:17.585873+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586521+0000","last_change":"2024-09-16T01:23:17.586521+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586521+0000","last_undegraded":"2024-09-16T01:23:17.586521+0000","last_fullsized":"2024-09-16T01:23:17.586521+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611386+0000","last_change":"2024-09-16T01:23:17.611386+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611386+0000","last_undegraded":"2024-09-16T01:23:17.611386+0000","last_fullsized":"2024-09-16T01:23:17.611386+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588636+0000","last_change":"2024-09-16T01:23:17.588636+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588636+0000","last_undegraded":"2024-09-16T01:23:17.588636+0000","last_fullsized":"2024-09-16T01:23:17.588636+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588901+0000","last_change":"2024-09-16T01:23:17.588901+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588901+0000","last_undegraded":"2024-09-16T01:23:17.588901+0000","last_fullsized":"2024-09-16T01:23:17.588901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584627+0000","last_change":"2024-09-16T01:23:17.584627+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584627+0000","last_undegraded":"2024-09-16T01:23:17.584627+0000","last_fullsized":"2024-09-16T01:23:17.584627+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586788+0000","last_change":"2024-09-16T01:23:17.586788+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586788+0000","last_undegraded":"2024-09-16T01:23:17.586788+0000","last_fullsized":"2024-09-16T01:23:17.586788+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584369+0000","last_change":"2024-09-16T01:23:17.584369+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584369+0000","last_undegraded":"2024-09-16T01:23:17.584369+0000","last_fullsized":"2024-09-16T01:23:17.584369+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585071+0000","last_change":"2024-09-16T01:23:17.585071+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585071+0000","last_undegraded":"2024-09-16T01:23:17.585071+0000","last_fullsized":"2024-09-16T01:23:17.585071+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588141+0000","last_change":"2024-09-16T01:23:17.588141+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588141+0000","last_undegraded":"2024-09-16T01:23:17.588141+0000","last_fullsized":"2024-09-16T01:23:17.588141+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586405+0000","last_change":"2024-09-16T01:23:17.586405+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586405+0000","last_undegraded":"2024-09-16T01:23:17.586405+0000","last_fullsized":"2024-09-16T01:23:17.586405+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588317+0000","last_change":"2024-09-16T01:23:17.588317+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588317+0000","last_undegraded":"2024-09-16T01:23:17.588317+0000","last_fullsized":"2024-09-16T01:23:17.588317+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586399+0000","last_change":"2024-09-16T01:23:17.586399+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586399+0000","last_undegraded":"2024-09-16T01:23:17.586399+0000","last_fullsized":"2024-09-16T01:23:17.586399+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.588890+0000","last_change":"2024-09-16T01:23:17.588890+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.588890+0000","last_undegraded":"2024-09-16T01:23:17.588890+0000","last_fullsized":"2024-09-16T01:23:17.588890+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.589123+0000","last_change":"2024-09-16T01:23:17.589123+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.589123+0000","last_undegraded":"2024-09-16T01:23:17.589123+0000","last_fullsized":"2024-09-16T01:23:17.589123+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.585464+0000","last_change":"2024-09-16T01:23:17.585464+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.585464+0000","last_undegraded":"2024-09-16T01:23:17.585464+0000","last_fullsized":"2024-09-16T01:23:17.585464+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584632+0000","last_change":"2024-09-16T01:23:17.584632+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584632+0000","last_undegraded":"2024-09-16T01:23:17.584632+0000","last_fullsized":"2024-09-16T01:23:17.584632+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.611421+0000","last_change":"2024-09-16T01:23:17.611421+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.611421+0000","last_undegraded":"2024-09-16T01:23:17.611421+0000","last_fullsized":"2024-09-16T01:23:17.611421+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584918+0000","last_change":"2024-09-16T01:23:17.584918+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584918+0000","last_undegraded":"2024-09-16T01:23:17.584918+0000","last_fullsized":"2024-09-16T01:23:17.584918+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586738+0000","last_change":"2024-09-16T01:23:17.586738+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586738+0000","last_undegraded":"2024-09-16T01:23:17.586738+0000","last_fullsized":"2024-09-16T01:23:17.586738+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584693+0000","last_change":"2024-09-16T01:23:17.584693+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584693+0000","last_undegraded":"2024-09-16T01:23:17.584693+0000","last_fullsized":"2024-09-16T01:23:17.584693+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.584467+0000","last_change":"2024-09-16T01:23:17.584467+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.584467+0000","last_undegraded":"2024-09-16T01:23:17.584467+0000","last_fullsized":"2024-09-16T01:23:17.584467+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:18.581786+0000","last_change":"2024-09-16T01:23:18.581786+0000","last_active":"2024-09-16T01:23:18.581786+0000","last_peered":"2024-09-16T01:23:18.581786+0000","last_clean":"2024-09-16T01:23:18.581786+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:18.581786+0000","last_undegraded":"2024-09-16T01:23:18.581786+0000","last_fullsized":"2024-09-16T01:23:18.581786+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2024-09-16T01:23:17.586477+0000","last_change":"2024-09-16T01:23:17.586477+0000","last_active":"2024-09-16T01:23:17.579645+0000","last_peered":"2024-09-16T01:23:17.579645+0000","last_clean":"2024-09-16T01:23:17.579645+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:17.586477+0000","last_undegraded":"2024-09-16T01:23:17.586477+0000","last_fullsized":"2024-09-16T01:23:17.586477+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":375,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-16T01:23:17.586440+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:23:17.586440+0000","last_peered":"2024-09-16T01:23:17.586440+0000","last_clean":"2024-09-16T01:23:17.586440+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:23:17.586440+0000","last_undegraded":"2024-09-16T01:23:17.586440+0000","last_fullsized":"2024-09-16T01:23:17.586440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33416,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338424,"statfs":{"total":96636764160,"available":96602546176,"internally_reserved":0,"allocated":2277376,"data_stored":1364842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36996,"kb_used_data":1632,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334844,"statfs":{"total":96636764160,"available":96598880256,"internally_reserved":0,"allocated":1671168,"data_stored":768265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32852,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338988,"statfs":{"total":96636764160,"available":96603123712,"internally_reserved":0,"allocated":1683456,"data_stored":774474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36992,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334848,"statfs":{"total":96636764160,"available":96598884352,"internally_reserved":0,"allocated":1683456,"data_stored":774474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1609728,"data_stored":740606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32836,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339004,"statfs":{"total":96636764160,"available":96603140096,"internally_reserved":0,"allocated":1683456,"data_stored":774474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1609728,"data_stored":740606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33420,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338420,"statfs":{"total":96636764160,"available":96602542080,"internally_reserved":0,"allocated":2277376,"data_stored":1364842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:23:25.585 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-16T01:23:25.583+0000 7f9458135640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:23:27.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:23:27.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.273+0000 7fea0c47b640 1 Processor -- start 2024-09-16T01:23:27.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.273+0000 7fea0c47b640 1 -- start start 2024-09-16T01:23:27.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.274+0000 7fea0c47b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea040b6690 0x7fea041691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.274+0000 7fea0c47b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea040d3690 con 0x7fea040d30f0 2024-09-16T01:23:27.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.274+0000 7fea0c47b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea040d3970 con 0x7fea0415e5f0 2024-09-16T01:23:27.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.274+0000 7fea0c47b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fea0406d530 con 0x7fea040b6690 2024-09-16T01:23:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.274+0000 7fea09a16640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fea040d30f0 0x7fea040b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36578/0 (socket says 172.21.15.81:36578) 2024-09-16T01:23:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.274+0000 7fea0aa18640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fea040b6690 0x7fea041691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.274+0000 7fea09a16640 1 -- 172.21.15.81:0/2777808161 learned_addr learned my addr 172.21.15.81:0/2777808161 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.275+0000 7fea0aa18640 1 -- 172.21.15.81:0/2777808161 >> v1:172.21.15.102:6789/0 conn(0x7fea0415e5f0 legacy=0x7fea040d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.275+0000 7fea0aa18640 1 -- 172.21.15.81:0/2777808161 >> v1:172.21.15.81:6789/0 conn(0x7fea040d30f0 legacy=0x7fea040b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.275+0000 7fea0aa18640 1 -- 172.21.15.81:0/2777808161 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0406cee0 con 0x7fea040b6690 2024-09-16T01:23:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.275+0000 7fea0aa18640 1 --2- 172.21.15.81:0/2777808161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea040b6690 0x7fea041691a0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009dc0 tx=0x7fe9fc02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9523bd6766431af1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.276+0000 7fea09215640 1 -- 172.21.15.81:0/2777808161 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc007740 con 0x7fea040b6690 2024-09-16T01:23:27.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.276+0000 7fea09215640 1 -- 172.21.15.81:0/2777808161 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9fc0078e0 con 0x7fea040b6690 2024-09-16T01:23:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.276+0000 7fea09215640 1 -- 172.21.15.81:0/2777808161 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc007cb0 con 0x7fea040b6690 2024-09-16T01:23:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.276+0000 7fea0c47b640 1 -- 172.21.15.81:0/2777808161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea040b6690 msgr2=0x7fea041691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.276+0000 7fea0c47b640 1 --2- 172.21.15.81:0/2777808161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea040b6690 0x7fea041691a0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009dc0 tx=0x7fe9fc02a630 comp rx=0 tx=0).stop 2024-09-16T01:23:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.276+0000 7fea0c47b640 1 -- 172.21.15.81:0/2777808161 shutdown_connections 2024-09-16T01:23:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.276+0000 7fea0c47b640 1 --2- 172.21.15.81:0/2777808161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea040b6690 0x7fea041691a0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.276+0000 7fea0c47b640 1 -- 172.21.15.81:0/2777808161 >> 172.21.15.81:0/2777808161 conn(0x7fea0408bfc0 msgr2=0x7fea040d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.276+0000 7fea0c47b640 1 -- 172.21.15.81:0/2777808161 shutdown_connections 2024-09-16T01:23:27.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.276+0000 7fea0c47b640 1 -- 172.21.15.81:0/2777808161 wait complete. 2024-09-16T01:23:27.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.278+0000 7fea0c47b640 1 Processor -- start 2024-09-16T01:23:27.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.278+0000 7fea0c47b640 1 -- start start 2024-09-16T01:23:27.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.278+0000 7fea0c47b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea040b6690 0x7fea0415bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.278+0000 7fea0c47b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea040d30f0 0x7fea040c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.278+0000 7fea0c47b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0415e5f0 0x7fea0414f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.278+0000 7fea0c47b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea0406e9d0 con 0x7fea0415e5f0 2024-09-16T01:23:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.278+0000 7fea0c47b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fea0415e9d0 con 0x7fea040b6690 2024-09-16T01:23:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.278+0000 7fea0c47b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fea0406eb50 con 0x7fea040d30f0 2024-09-16T01:23:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.278+0000 7fea0aa18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0415e5f0 0x7fea0414f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.278+0000 7fea0aa18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0415e5f0 0x7fea0414f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48914/0 (socket says 172.21.15.81:48914) 2024-09-16T01:23:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fea0aa18640 1 -- 172.21.15.81:0/3003712397 learned_addr learned my addr 172.21.15.81:0/3003712397 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fea0a217640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea040b6690 0x7fea0415bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fea09a16640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea040d30f0 0x7fea040c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fea0aa18640 1 -- 172.21.15.81:0/3003712397 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea040d30f0 msgr2=0x7fea040c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fea0aa18640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea040d30f0 0x7fea040c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fea0aa18640 1 -- 172.21.15.81:0/3003712397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea040b6690 msgr2=0x7fea0415bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fea0aa18640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea040b6690 0x7fea0415bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fea0aa18640 1 -- 172.21.15.81:0/3003712397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea040c9c20 con 0x7fea0415e5f0 2024-09-16T01:23:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fea0aa18640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0415e5f0 0x7fea0414f690 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009ee0 tx=0x7fe9fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fe9faffd640 1 -- 172.21.15.81:0/3003712397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc03f070 con 0x7fea0415e5f0 2024-09-16T01:23:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fe9faffd640 1 -- 172.21.15.81:0/3003712397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9fc031c80 con 0x7fea0415e5f0 2024-09-16T01:23:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fea0c47b640 1 -- 172.21.15.81:0/3003712397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea040c9f00 con 0x7fea0415e5f0 2024-09-16T01:23:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fe9faffd640 1 -- 172.21.15.81:0/3003712397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc044660 con 0x7fea0415e5f0 2024-09-16T01:23:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.279+0000 7fea0c47b640 1 -- 172.21.15.81:0/3003712397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea040ca4c0 con 0x7fea0415e5f0 2024-09-16T01:23:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.280+0000 7fea0c47b640 1 -- 172.21.15.81:0/3003712397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea040b5f80 con 0x7fea0415e5f0 2024-09-16T01:23:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.281+0000 7fe9faffd640 1 -- 172.21.15.81:0/3003712397 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe9fc03b410 con 0x7fea0415e5f0 2024-09-16T01:23:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.281+0000 7fe9faffd640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9e806c2b0 0x7fe9e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.281+0000 7fe9faffd640 1 -- 172.21.15.81:0/3003712397 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fe9fc0acce0 con 0x7fea0415e5f0 2024-09-16T01:23:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.281+0000 7fea0a217640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9e806c2b0 0x7fe9e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.282+0000 7fea0a217640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9e806c2b0 0x7fe9e806e770 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fea00001780 tx=0x7fea00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.286+0000 7fe9faffd640 1 -- 172.21.15.81:0/3003712397 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9fc07ad00 con 0x7fea0415e5f0 2024-09-16T01:23:27.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.450+0000 7fea0c47b640 1 -- 172.21.15.81:0/3003712397 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fea040b4000 con 0x7fe9e806c2b0 2024-09-16T01:23:27.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.456+0000 7fe9faffd640 1 -- 172.21.15.81:0/3003712397 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252483 (secure 0 0 0) 0x7fea040b4000 con 0x7fe9e806c2b0 2024-09-16T01:23:27.461 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:27.462 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:23:27.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.459+0000 7fea0c47b640 1 -- 172.21.15.81:0/3003712397 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9e806c2b0 msgr2=0x7fe9e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.459+0000 7fea0c47b640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9e806c2b0 0x7fe9e806e770 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fea00001780 tx=0x7fea00009040 comp rx=0 tx=0).stop 2024-09-16T01:23:27.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.459+0000 7fea0c47b640 1 -- 172.21.15.81:0/3003712397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0415e5f0 msgr2=0x7fea0414f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.459+0000 7fea0c47b640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0415e5f0 0x7fea0414f690 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc009ee0 tx=0x7fe9fc004a40 comp rx=0 tx=0).stop 2024-09-16T01:23:27.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.459+0000 7fea0c47b640 1 -- 172.21.15.81:0/3003712397 shutdown_connections 2024-09-16T01:23:27.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.459+0000 7fea0c47b640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe9e806c2b0 0x7fe9e806e770 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.459+0000 7fea0c47b640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea0415e5f0 0x7fea0414f690 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.459+0000 7fea0c47b640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fea040d30f0 0x7fea040c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.459+0000 7fea0c47b640 1 --2- 172.21.15.81:0/3003712397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fea040b6690 0x7fea0415bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.459+0000 7fea0c47b640 1 -- 172.21.15.81:0/3003712397 >> 172.21.15.81:0/3003712397 conn(0x7fea0408bfc0 msgr2=0x7fea040b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:27.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.459+0000 7fea0c47b640 1 -- 172.21.15.81:0/3003712397 shutdown_connections 2024-09-16T01:23:27.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.459+0000 7fea0c47b640 1 -- 172.21.15.81:0/3003712397 wait complete. 2024-09-16T01:23:27.472 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-16T01:23:26.161074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":121,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":272528,"kb_used_data":14664,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754702192,"statfs":{"total":773094113280,"available":772815044608,"internally_reserved":0,"allocated":15015936,"data_stored":7545556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.573364"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.613033+0000","last_change":"2024-09-16T01:23:19.601701+0000","last_active":"2024-09-16T01:23:20.613033+0000","last_peered":"2024-09-16T01:23:20.613033+0000","last_clean":"2024-09-16T01:23:20.613033+0000","last_became_active":"2024-09-16T01:23:19.601299+0000","last_became_peered":"2024-09-16T01:23:19.601299+0000","last_unstale":"2024-09-16T01:23:20.613033+0000","last_undegraded":"2024-09-16T01:23:20.613033+0000","last_fullsized":"2024-09-16T01:23:20.613033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:49.243531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606900+0000","last_change":"2024-09-16T01:23:19.610375+0000","last_active":"2024-09-16T01:23:20.606900+0000","last_peered":"2024-09-16T01:23:20.606900+0000","last_clean":"2024-09-16T01:23:20.606900+0000","last_became_active":"2024-09-16T01:23:19.610132+0000","last_became_peered":"2024-09-16T01:23:19.610132+0000","last_unstale":"2024-09-16T01:23:20.606900+0000","last_undegraded":"2024-09-16T01:23:20.606900+0000","last_fullsized":"2024-09-16T01:23:20.606900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:03.692987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606820+0000","last_change":"2024-09-16T01:23:19.606644+0000","last_active":"2024-09-16T01:23:20.606820+0000","last_peered":"2024-09-16T01:23:20.606820+0000","last_clean":"2024-09-16T01:23:20.606820+0000","last_became_active":"2024-09-16T01:23:19.606435+0000","last_became_peered":"2024-09-16T01:23:19.606435+0000","last_unstale":"2024-09-16T01:23:20.606820+0000","last_undegraded":"2024-09-16T01:23:20.606820+0000","last_fullsized":"2024-09-16T01:23:20.606820+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:47.026018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.611762+0000","last_change":"2024-09-16T01:23:19.603967+0000","last_active":"2024-09-16T01:23:20.611762+0000","last_peered":"2024-09-16T01:23:20.611762+0000","last_clean":"2024-09-16T01:23:20.611762+0000","last_became_active":"2024-09-16T01:23:19.603705+0000","last_became_peered":"2024-09-16T01:23:19.603705+0000","last_unstale":"2024-09-16T01:23:20.611762+0000","last_undegraded":"2024-09-16T01:23:20.611762+0000","last_fullsized":"2024-09-16T01:23:20.611762+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:58:36.395630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674026+0000","last_change":"2024-09-16T01:23:19.611618+0000","last_active":"2024-09-16T01:23:20.674026+0000","last_peered":"2024-09-16T01:23:20.674026+0000","last_clean":"2024-09-16T01:23:20.674026+0000","last_became_active":"2024-09-16T01:23:19.610148+0000","last_became_peered":"2024-09-16T01:23:19.610148+0000","last_unstale":"2024-09-16T01:23:20.674026+0000","last_undegraded":"2024-09-16T01:23:20.674026+0000","last_fullsized":"2024-09-16T01:23:20.674026+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:42:11.696694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673494+0000","last_change":"2024-09-16T01:23:19.609628+0000","last_active":"2024-09-16T01:23:20.673494+0000","last_peered":"2024-09-16T01:23:20.673494+0000","last_clean":"2024-09-16T01:23:20.673494+0000","last_became_active":"2024-09-16T01:23:19.609378+0000","last_became_peered":"2024-09-16T01:23:19.609378+0000","last_unstale":"2024-09-16T01:23:20.673494+0000","last_undegraded":"2024-09-16T01:23:20.673494+0000","last_fullsized":"2024-09-16T01:23:20.673494+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:28.373182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.612532+0000","last_change":"2024-09-16T01:23:19.608404+0000","last_active":"2024-09-16T01:23:20.612532+0000","last_peered":"2024-09-16T01:23:20.612532+0000","last_clean":"2024-09-16T01:23:20.612532+0000","last_became_active":"2024-09-16T01:23:19.608133+0000","last_became_peered":"2024-09-16T01:23:19.608133+0000","last_unstale":"2024-09-16T01:23:20.612532+0000","last_undegraded":"2024-09-16T01:23:20.612532+0000","last_fullsized":"2024-09-16T01:23:20.612532+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:57.403349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673947+0000","last_change":"2024-09-16T01:23:19.611035+0000","last_active":"2024-09-16T01:23:20.673947+0000","last_peered":"2024-09-16T01:23:20.673947+0000","last_clean":"2024-09-16T01:23:20.673947+0000","last_became_active":"2024-09-16T01:23:19.610770+0000","last_became_peered":"2024-09-16T01:23:19.610770+0000","last_unstale":"2024-09-16T01:23:20.673947+0000","last_undegraded":"2024-09-16T01:23:20.673947+0000","last_fullsized":"2024-09-16T01:23:20.673947+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:38.639563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673856+0000","last_change":"2024-09-16T01:23:19.609040+0000","last_active":"2024-09-16T01:23:20.673856+0000","last_peered":"2024-09-16T01:23:20.673856+0000","last_clean":"2024-09-16T01:23:20.673856+0000","last_became_active":"2024-09-16T01:23:19.608718+0000","last_became_peered":"2024-09-16T01:23:19.608718+0000","last_unstale":"2024-09-16T01:23:20.673856+0000","last_undegraded":"2024-09-16T01:23:20.673856+0000","last_fullsized":"2024-09-16T01:23:20.673856+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:22.404338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673854+0000","last_change":"2024-09-16T01:23:19.605029+0000","last_active":"2024-09-16T01:23:20.673854+0000","last_peered":"2024-09-16T01:23:20.673854+0000","last_clean":"2024-09-16T01:23:20.673854+0000","last_became_active":"2024-09-16T01:23:19.604732+0000","last_became_peered":"2024-09-16T01:23:19.604732+0000","last_unstale":"2024-09-16T01:23:20.673854+0000","last_undegraded":"2024-09-16T01:23:20.673854+0000","last_fullsized":"2024-09-16T01:23:20.673854+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:13.359018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673932+0000","last_change":"2024-09-16T01:23:19.608556+0000","last_active":"2024-09-16T01:23:20.673932+0000","last_peered":"2024-09-16T01:23:20.673932+0000","last_clean":"2024-09-16T01:23:20.673932+0000","last_became_active":"2024-09-16T01:23:19.608194+0000","last_became_peered":"2024-09-16T01:23:19.608194+0000","last_unstale":"2024-09-16T01:23:20.673932+0000","last_undegraded":"2024-09-16T01:23:20.673932+0000","last_fullsized":"2024-09-16T01:23:20.673932+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:03.273234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.612157+0000","last_change":"2024-09-16T01:23:19.606267+0000","last_active":"2024-09-16T01:23:20.612157+0000","last_peered":"2024-09-16T01:23:20.612157+0000","last_clean":"2024-09-16T01:23:20.612157+0000","last_became_active":"2024-09-16T01:23:19.605968+0000","last_became_peered":"2024-09-16T01:23:19.605968+0000","last_unstale":"2024-09-16T01:23:20.612157+0000","last_undegraded":"2024-09-16T01:23:20.612157+0000","last_fullsized":"2024-09-16T01:23:20.612157+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:07.874142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673852+0000","last_change":"2024-09-16T01:23:19.604198+0000","last_active":"2024-09-16T01:23:20.673852+0000","last_peered":"2024-09-16T01:23:20.673852+0000","last_clean":"2024-09-16T01:23:20.673852+0000","last_became_active":"2024-09-16T01:23:19.603754+0000","last_became_peered":"2024-09-16T01:23:19.603754+0000","last_unstale":"2024-09-16T01:23:20.673852+0000","last_undegraded":"2024-09-16T01:23:20.673852+0000","last_fullsized":"2024-09-16T01:23:20.673852+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:34.634971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.611653+0000","last_change":"2024-09-16T01:23:19.605861+0000","last_active":"2024-09-16T01:23:20.611653+0000","last_peered":"2024-09-16T01:23:20.611653+0000","last_clean":"2024-09-16T01:23:20.611653+0000","last_became_active":"2024-09-16T01:23:19.605259+0000","last_became_peered":"2024-09-16T01:23:19.605259+0000","last_unstale":"2024-09-16T01:23:20.611653+0000","last_undegraded":"2024-09-16T01:23:20.611653+0000","last_fullsized":"2024-09-16T01:23:20.611653+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:08.516883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606560+0000","last_change":"2024-09-16T01:23:19.607279+0000","last_active":"2024-09-16T01:23:20.606560+0000","last_peered":"2024-09-16T01:23:20.606560+0000","last_clean":"2024-09-16T01:23:20.606560+0000","last_became_active":"2024-09-16T01:23:19.607016+0000","last_became_peered":"2024-09-16T01:23:19.607016+0000","last_unstale":"2024-09-16T01:23:20.606560+0000","last_undegraded":"2024-09-16T01:23:20.606560+0000","last_fullsized":"2024-09-16T01:23:20.606560+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:17.417763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673171+0000","last_change":"2024-09-16T01:23:19.612131+0000","last_active":"2024-09-16T01:23:20.673171+0000","last_peered":"2024-09-16T01:23:20.673171+0000","last_clean":"2024-09-16T01:23:20.673171+0000","last_became_active":"2024-09-16T01:23:19.611860+0000","last_became_peered":"2024-09-16T01:23:19.611860+0000","last_unstale":"2024-09-16T01:23:20.673171+0000","last_undegraded":"2024-09-16T01:23:20.673171+0000","last_fullsized":"2024-09-16T01:23:20.673171+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:41:23.687370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.612046+0000","last_change":"2024-09-16T01:23:19.602515+0000","last_active":"2024-09-16T01:23:20.612046+0000","last_peered":"2024-09-16T01:23:20.612046+0000","last_clean":"2024-09-16T01:23:20.612046+0000","last_became_active":"2024-09-16T01:23:19.600653+0000","last_became_peered":"2024-09-16T01:23:19.600653+0000","last_unstale":"2024-09-16T01:23:20.612046+0000","last_undegraded":"2024-09-16T01:23:20.612046+0000","last_fullsized":"2024-09-16T01:23:20.612046+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:00.079559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673484+0000","last_change":"2024-09-16T01:23:19.601069+0000","last_active":"2024-09-16T01:23:20.673484+0000","last_peered":"2024-09-16T01:23:20.673484+0000","last_clean":"2024-09-16T01:23:20.673484+0000","last_became_active":"2024-09-16T01:23:19.600647+0000","last_became_peered":"2024-09-16T01:23:19.600647+0000","last_unstale":"2024-09-16T01:23:20.673484+0000","last_undegraded":"2024-09-16T01:23:20.673484+0000","last_fullsized":"2024-09-16T01:23:20.673484+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:34.721977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674567+0000","last_change":"2024-09-16T01:23:19.612074+0000","last_active":"2024-09-16T01:23:20.674567+0000","last_peered":"2024-09-16T01:23:20.674567+0000","last_clean":"2024-09-16T01:23:20.674567+0000","last_became_active":"2024-09-16T01:23:19.611157+0000","last_became_peered":"2024-09-16T01:23:19.611157+0000","last_unstale":"2024-09-16T01:23:20.674567+0000","last_undegraded":"2024-09-16T01:23:20.674567+0000","last_fullsized":"2024-09-16T01:23:20.674567+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:16.132745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673934+0000","last_change":"2024-09-16T01:23:19.601899+0000","last_active":"2024-09-16T01:23:20.673934+0000","last_peered":"2024-09-16T01:23:20.673934+0000","last_clean":"2024-09-16T01:23:20.673934+0000","last_became_active":"2024-09-16T01:23:19.601651+0000","last_became_peered":"2024-09-16T01:23:19.601651+0000","last_unstale":"2024-09-16T01:23:20.673934+0000","last_undegraded":"2024-09-16T01:23:20.673934+0000","last_fullsized":"2024-09-16T01:23:20.673934+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:13.904632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673966+0000","last_change":"2024-09-16T01:23:19.609361+0000","last_active":"2024-09-16T01:23:20.673966+0000","last_peered":"2024-09-16T01:23:20.673966+0000","last_clean":"2024-09-16T01:23:20.673966+0000","last_became_active":"2024-09-16T01:23:19.608351+0000","last_became_peered":"2024-09-16T01:23:19.608351+0000","last_unstale":"2024-09-16T01:23:20.673966+0000","last_undegraded":"2024-09-16T01:23:20.673966+0000","last_fullsized":"2024-09-16T01:23:20.673966+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:31.172862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.612597+0000","last_change":"2024-09-16T01:23:19.609390+0000","last_active":"2024-09-16T01:23:20.612597+0000","last_peered":"2024-09-16T01:23:20.612597+0000","last_clean":"2024-09-16T01:23:20.612597+0000","last_became_active":"2024-09-16T01:23:19.609138+0000","last_became_peered":"2024-09-16T01:23:19.609138+0000","last_unstale":"2024-09-16T01:23:20.612597+0000","last_undegraded":"2024-09-16T01:23:20.612597+0000","last_fullsized":"2024-09-16T01:23:20.612597+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:07.744569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674006+0000","last_change":"2024-09-16T01:23:19.604783+0000","last_active":"2024-09-16T01:23:20.674006+0000","last_peered":"2024-09-16T01:23:20.674006+0000","last_clean":"2024-09-16T01:23:20.674006+0000","last_became_active":"2024-09-16T01:23:19.604505+0000","last_became_peered":"2024-09-16T01:23:19.604505+0000","last_unstale":"2024-09-16T01:23:20.674006+0000","last_undegraded":"2024-09-16T01:23:20.674006+0000","last_fullsized":"2024-09-16T01:23:20.674006+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:23.267618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674225+0000","last_change":"2024-09-16T01:23:19.607886+0000","last_active":"2024-09-16T01:23:20.674225+0000","last_peered":"2024-09-16T01:23:20.674225+0000","last_clean":"2024-09-16T01:23:20.674225+0000","last_became_active":"2024-09-16T01:23:19.607607+0000","last_became_peered":"2024-09-16T01:23:19.607607+0000","last_unstale":"2024-09-16T01:23:20.674225+0000","last_undegraded":"2024-09-16T01:23:20.674225+0000","last_fullsized":"2024-09-16T01:23:20.674225+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:11.247061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.613183+0000","last_change":"2024-09-16T01:23:19.603421+0000","last_active":"2024-09-16T01:23:20.613183+0000","last_peered":"2024-09-16T01:23:20.613183+0000","last_clean":"2024-09-16T01:23:20.613183+0000","last_became_active":"2024-09-16T01:23:19.602613+0000","last_became_peered":"2024-09-16T01:23:19.602613+0000","last_unstale":"2024-09-16T01:23:20.613183+0000","last_undegraded":"2024-09-16T01:23:20.613183+0000","last_fullsized":"2024-09-16T01:23:20.613183+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:52.447123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.613131+0000","last_change":"2024-09-16T01:23:19.606913+0000","last_active":"2024-09-16T01:23:20.613131+0000","last_peered":"2024-09-16T01:23:20.613131+0000","last_clean":"2024-09-16T01:23:20.613131+0000","last_became_active":"2024-09-16T01:23:19.606390+0000","last_became_peered":"2024-09-16T01:23:19.606390+0000","last_unstale":"2024-09-16T01:23:20.613131+0000","last_undegraded":"2024-09-16T01:23:20.613131+0000","last_fullsized":"2024-09-16T01:23:20.613131+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:31.626961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673329+0000","last_change":"2024-09-16T01:23:19.611690+0000","last_active":"2024-09-16T01:23:20.673329+0000","last_peered":"2024-09-16T01:23:20.673329+0000","last_clean":"2024-09-16T01:23:20.673329+0000","last_became_active":"2024-09-16T01:23:19.609922+0000","last_became_peered":"2024-09-16T01:23:19.609922+0000","last_unstale":"2024-09-16T01:23:20.673329+0000","last_undegraded":"2024-09-16T01:23:20.673329+0000","last_fullsized":"2024-09-16T01:23:20.673329+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:03.334350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673311+0000","last_change":"2024-09-16T01:23:19.601493+0000","last_active":"2024-09-16T01:23:20.673311+0000","last_peered":"2024-09-16T01:23:20.673311+0000","last_clean":"2024-09-16T01:23:20.673311+0000","last_became_active":"2024-09-16T01:23:19.601009+0000","last_became_peered":"2024-09-16T01:23:19.601009+0000","last_unstale":"2024-09-16T01:23:20.673311+0000","last_undegraded":"2024-09-16T01:23:20.673311+0000","last_fullsized":"2024-09-16T01:23:20.673311+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:48.289896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674729+0000","last_change":"2024-09-16T01:23:19.605795+0000","last_active":"2024-09-16T01:23:20.674729+0000","last_peered":"2024-09-16T01:23:20.674729+0000","last_clean":"2024-09-16T01:23:20.674729+0000","last_became_active":"2024-09-16T01:23:19.605149+0000","last_became_peered":"2024-09-16T01:23:19.605149+0000","last_unstale":"2024-09-16T01:23:20.674729+0000","last_undegraded":"2024-09-16T01:23:20.674729+0000","last_fullsized":"2024-09-16T01:23:20.674729+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:58:36.395630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674381+0000","last_change":"2024-09-16T01:23:19.603519+0000","last_active":"2024-09-16T01:23:20.674381+0000","last_peered":"2024-09-16T01:23:20.674381+0000","last_clean":"2024-09-16T01:23:20.674381+0000","last_became_active":"2024-09-16T01:23:19.603228+0000","last_became_peered":"2024-09-16T01:23:19.603228+0000","last_unstale":"2024-09-16T01:23:20.674381+0000","last_undegraded":"2024-09-16T01:23:20.674381+0000","last_fullsized":"2024-09-16T01:23:20.674381+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:34:20.157783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673489+0000","last_change":"2024-09-16T01:23:19.605022+0000","last_active":"2024-09-16T01:23:20.673489+0000","last_peered":"2024-09-16T01:23:20.673489+0000","last_clean":"2024-09-16T01:23:20.673489+0000","last_became_active":"2024-09-16T01:23:19.604753+0000","last_became_peered":"2024-09-16T01:23:19.604753+0000","last_unstale":"2024-09-16T01:23:20.673489+0000","last_undegraded":"2024-09-16T01:23:20.673489+0000","last_fullsized":"2024-09-16T01:23:20.673489+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:00.635986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674118+0000","last_change":"2024-09-16T01:23:19.610585+0000","last_active":"2024-09-16T01:23:20.674118+0000","last_peered":"2024-09-16T01:23:20.674118+0000","last_clean":"2024-09-16T01:23:20.674118+0000","last_became_active":"2024-09-16T01:23:19.610295+0000","last_became_peered":"2024-09-16T01:23:19.610295+0000","last_unstale":"2024-09-16T01:23:20.674118+0000","last_undegraded":"2024-09-16T01:23:20.674118+0000","last_fullsized":"2024-09-16T01:23:20.674118+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:47.716696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606658+0000","last_change":"2024-09-16T01:23:19.604766+0000","last_active":"2024-09-16T01:23:20.606658+0000","last_peered":"2024-09-16T01:23:20.606658+0000","last_clean":"2024-09-16T01:23:20.606658+0000","last_became_active":"2024-09-16T01:23:19.604514+0000","last_became_peered":"2024-09-16T01:23:19.604514+0000","last_unstale":"2024-09-16T01:23:20.606658+0000","last_undegraded":"2024-09-16T01:23:20.606658+0000","last_fullsized":"2024-09-16T01:23:20.606658+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:12:10.712488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"136'4","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674029+0000","last_change":"2024-09-16T01:23:18.606455+0000","last_active":"2024-09-16T01:23:20.674029+0000","last_peered":"2024-09-16T01:23:20.674029+0000","last_clean":"2024-09-16T01:23:20.674029+0000","last_became_active":"2024-09-16T01:23:18.606142+0000","last_became_peered":"2024-09-16T01:23:18.606142+0000","last_unstale":"2024-09-16T01:23:20.674029+0000","last_undegraded":"2024-09-16T01:23:20.674029+0000","last_fullsized":"2024-09-16T01:23:20.674029+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:15.124830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606944+0000","last_change":"2024-09-16T01:23:19.609707+0000","last_active":"2024-09-16T01:23:20.606944+0000","last_peered":"2024-09-16T01:23:20.606944+0000","last_clean":"2024-09-16T01:23:20.606944+0000","last_became_active":"2024-09-16T01:23:19.609417+0000","last_became_peered":"2024-09-16T01:23:19.609417+0000","last_unstale":"2024-09-16T01:23:20.606944+0000","last_undegraded":"2024-09-16T01:23:20.606944+0000","last_fullsized":"2024-09-16T01:23:20.606944+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:17.110108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"136'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674021+0000","last_change":"2024-09-16T01:23:18.605099+0000","last_active":"2024-09-16T01:23:20.674021+0000","last_peered":"2024-09-16T01:23:20.674021+0000","last_clean":"2024-09-16T01:23:20.674021+0000","last_became_active":"2024-09-16T01:23:18.604794+0000","last_became_peered":"2024-09-16T01:23:18.604794+0000","last_unstale":"2024-09-16T01:23:20.674021+0000","last_undegraded":"2024-09-16T01:23:20.674021+0000","last_fullsized":"2024-09-16T01:23:20.674021+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:12.404572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674940+0000","last_change":"2024-09-16T01:23:19.609987+0000","last_active":"2024-09-16T01:23:20.674940+0000","last_peered":"2024-09-16T01:23:20.674940+0000","last_clean":"2024-09-16T01:23:20.674940+0000","last_became_active":"2024-09-16T01:23:19.609589+0000","last_became_peered":"2024-09-16T01:23:19.609589+0000","last_unstale":"2024-09-16T01:23:20.674940+0000","last_undegraded":"2024-09-16T01:23:20.674940+0000","last_fullsized":"2024-09-16T01:23:20.674940+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:07.874142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674650+0000","last_change":"2024-09-16T01:23:18.609173+0000","last_active":"2024-09-16T01:23:20.674650+0000","last_peered":"2024-09-16T01:23:20.674650+0000","last_clean":"2024-09-16T01:23:20.674650+0000","last_became_active":"2024-09-16T01:23:18.608711+0000","last_became_peered":"2024-09-16T01:23:18.608711+0000","last_unstale":"2024-09-16T01:23:20.674650+0000","last_undegraded":"2024-09-16T01:23:20.674650+0000","last_fullsized":"2024-09-16T01:23:20.674650+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:02.690846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674087+0000","last_change":"2024-09-16T01:23:19.610658+0000","last_active":"2024-09-16T01:23:20.674087+0000","last_peered":"2024-09-16T01:23:20.674087+0000","last_clean":"2024-09-16T01:23:20.674087+0000","last_became_active":"2024-09-16T01:23:19.610399+0000","last_became_peered":"2024-09-16T01:23:19.610399+0000","last_unstale":"2024-09-16T01:23:20.674087+0000","last_undegraded":"2024-09-16T01:23:20.674087+0000","last_fullsized":"2024-09-16T01:23:20.674087+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:31.172862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606707+0000","last_change":"2024-09-16T01:23:18.603417+0000","last_active":"2024-09-16T01:23:20.606707+0000","last_peered":"2024-09-16T01:23:20.606707+0000","last_clean":"2024-09-16T01:23:20.606707+0000","last_became_active":"2024-09-16T01:23:18.603107+0000","last_became_peered":"2024-09-16T01:23:18.603107+0000","last_unstale":"2024-09-16T01:23:20.606707+0000","last_undegraded":"2024-09-16T01:23:20.606707+0000","last_fullsized":"2024-09-16T01:23:20.606707+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:30.302677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673221+0000","last_change":"2024-09-16T01:23:19.610176+0000","last_active":"2024-09-16T01:23:20.673221+0000","last_peered":"2024-09-16T01:23:20.673221+0000","last_clean":"2024-09-16T01:23:20.673221+0000","last_became_active":"2024-09-16T01:23:19.609871+0000","last_became_peered":"2024-09-16T01:23:19.609871+0000","last_unstale":"2024-09-16T01:23:20.673221+0000","last_undegraded":"2024-09-16T01:23:20.673221+0000","last_fullsized":"2024-09-16T01:23:20.673221+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:25:25.616053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"136'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674608+0000","last_change":"2024-09-16T01:23:18.606020+0000","last_active":"2024-09-16T01:23:20.674608+0000","last_peered":"2024-09-16T01:23:20.674608+0000","last_clean":"2024-09-16T01:23:20.674608+0000","last_became_active":"2024-09-16T01:23:18.605714+0000","last_became_peered":"2024-09-16T01:23:18.605714+0000","last_unstale":"2024-09-16T01:23:20.674608+0000","last_undegraded":"2024-09-16T01:23:20.674608+0000","last_fullsized":"2024-09-16T01:23:20.674608+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:42.303523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.612247+0000","last_change":"2024-09-16T01:23:19.612709+0000","last_active":"2024-09-16T01:23:20.612247+0000","last_peered":"2024-09-16T01:23:20.612247+0000","last_clean":"2024-09-16T01:23:20.612247+0000","last_became_active":"2024-09-16T01:23:19.612427+0000","last_became_peered":"2024-09-16T01:23:19.612427+0000","last_unstale":"2024-09-16T01:23:20.612247+0000","last_undegraded":"2024-09-16T01:23:20.612247+0000","last_fullsized":"2024-09-16T01:23:20.612247+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:57.403349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"136'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673677+0000","last_change":"2024-09-16T01:23:18.607783+0000","last_active":"2024-09-16T01:23:20.673677+0000","last_peered":"2024-09-16T01:23:20.673677+0000","last_clean":"2024-09-16T01:23:20.673677+0000","last_became_active":"2024-09-16T01:23:18.607495+0000","last_became_peered":"2024-09-16T01:23:18.607495+0000","last_unstale":"2024-09-16T01:23:20.673677+0000","last_undegraded":"2024-09-16T01:23:20.673677+0000","last_fullsized":"2024-09-16T01:23:20.673677+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:30.624820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606594+0000","last_change":"2024-09-16T01:23:19.605328+0000","last_active":"2024-09-16T01:23:20.606594+0000","last_peered":"2024-09-16T01:23:20.606594+0000","last_clean":"2024-09-16T01:23:20.606594+0000","last_became_active":"2024-09-16T01:23:19.605067+0000","last_became_peered":"2024-09-16T01:23:19.605067+0000","last_unstale":"2024-09-16T01:23:20.606594+0000","last_undegraded":"2024-09-16T01:23:20.606594+0000","last_fullsized":"2024-09-16T01:23:20.606594+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:16.591162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.612475+0000","last_change":"2024-09-16T01:23:18.598562+0000","last_active":"2024-09-16T01:23:20.612475+0000","last_peered":"2024-09-16T01:23:20.612475+0000","last_clean":"2024-09-16T01:23:20.612475+0000","last_became_active":"2024-09-16T01:23:18.598204+0000","last_became_peered":"2024-09-16T01:23:18.598204+0000","last_unstale":"2024-09-16T01:23:20.612475+0000","last_undegraded":"2024-09-16T01:23:20.612475+0000","last_fullsized":"2024-09-16T01:23:20.612475+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:47.663715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.612778+0000","last_change":"2024-09-16T01:23:19.606194+0000","last_active":"2024-09-16T01:23:20.612778+0000","last_peered":"2024-09-16T01:23:20.612778+0000","last_clean":"2024-09-16T01:23:20.612778+0000","last_became_active":"2024-09-16T01:23:19.602498+0000","last_became_peered":"2024-09-16T01:23:19.602498+0000","last_unstale":"2024-09-16T01:23:20.612778+0000","last_undegraded":"2024-09-16T01:23:20.612778+0000","last_fullsized":"2024-09-16T01:23:20.612778+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:16.126971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673218+0000","last_change":"2024-09-16T01:23:18.605732+0000","last_active":"2024-09-16T01:23:20.673218+0000","last_peered":"2024-09-16T01:23:20.673218+0000","last_clean":"2024-09-16T01:23:20.673218+0000","last_became_active":"2024-09-16T01:23:18.605409+0000","last_became_peered":"2024-09-16T01:23:18.605409+0000","last_unstale":"2024-09-16T01:23:20.673218+0000","last_undegraded":"2024-09-16T01:23:20.673218+0000","last_fullsized":"2024-09-16T01:23:20.673218+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:51.444982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674757+0000","last_change":"2024-09-16T01:23:19.609609+0000","last_active":"2024-09-16T01:23:20.674757+0000","last_peered":"2024-09-16T01:23:20.674757+0000","last_clean":"2024-09-16T01:23:20.674757+0000","last_became_active":"2024-09-16T01:23:19.609272+0000","last_became_peered":"2024-09-16T01:23:19.609272+0000","last_unstale":"2024-09-16T01:23:20.674757+0000","last_undegraded":"2024-09-16T01:23:20.674757+0000","last_fullsized":"2024-09-16T01:23:20.674757+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:00.079559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674149+0000","last_change":"2024-09-16T01:23:18.607083+0000","last_active":"2024-09-16T01:23:20.674149+0000","last_peered":"2024-09-16T01:23:20.674149+0000","last_clean":"2024-09-16T01:23:20.674149+0000","last_became_active":"2024-09-16T01:23:18.606797+0000","last_became_peered":"2024-09-16T01:23:18.606797+0000","last_unstale":"2024-09-16T01:23:20.674149+0000","last_undegraded":"2024-09-16T01:23:20.674149+0000","last_fullsized":"2024-09-16T01:23:20.674149+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:49.756061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674049+0000","last_change":"2024-09-16T01:23:19.608751+0000","last_active":"2024-09-16T01:23:20.674049+0000","last_peered":"2024-09-16T01:23:20.674049+0000","last_clean":"2024-09-16T01:23:20.674049+0000","last_became_active":"2024-09-16T01:23:19.607861+0000","last_became_peered":"2024-09-16T01:23:19.607861+0000","last_unstale":"2024-09-16T01:23:20.674049+0000","last_undegraded":"2024-09-16T01:23:20.674049+0000","last_fullsized":"2024-09-16T01:23:20.674049+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:01.492434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.613419+0000","last_change":"2024-09-16T01:23:18.597449+0000","last_active":"2024-09-16T01:23:20.613419+0000","last_peered":"2024-09-16T01:23:20.613419+0000","last_clean":"2024-09-16T01:23:20.613419+0000","last_became_active":"2024-09-16T01:23:18.596621+0000","last_became_peered":"2024-09-16T01:23:18.596621+0000","last_unstale":"2024-09-16T01:23:20.613419+0000","last_undegraded":"2024-09-16T01:23:20.613419+0000","last_fullsized":"2024-09-16T01:23:20.613419+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:03.803906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673621+0000","last_change":"2024-09-16T01:23:19.601696+0000","last_active":"2024-09-16T01:23:20.673621+0000","last_peered":"2024-09-16T01:23:20.673621+0000","last_clean":"2024-09-16T01:23:20.673621+0000","last_became_active":"2024-09-16T01:23:19.601070+0000","last_became_peered":"2024-09-16T01:23:19.601070+0000","last_unstale":"2024-09-16T01:23:20.673621+0000","last_undegraded":"2024-09-16T01:23:20.673621+0000","last_fullsized":"2024-09-16T01:23:20.673621+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:48.819576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"136'3","reported_seq":17,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674092+0000","last_change":"2024-09-16T01:23:18.606602+0000","last_active":"2024-09-16T01:23:20.674092+0000","last_peered":"2024-09-16T01:23:20.674092+0000","last_clean":"2024-09-16T01:23:20.674092+0000","last_became_active":"2024-09-16T01:23:18.606315+0000","last_became_peered":"2024-09-16T01:23:18.606315+0000","last_unstale":"2024-09-16T01:23:20.674092+0000","last_undegraded":"2024-09-16T01:23:20.674092+0000","last_fullsized":"2024-09-16T01:23:20.674092+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:19:56.512701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674234+0000","last_change":"2024-09-16T01:23:19.605124+0000","last_active":"2024-09-16T01:23:20.674234+0000","last_peered":"2024-09-16T01:23:20.674234+0000","last_clean":"2024-09-16T01:23:20.674234+0000","last_became_active":"2024-09-16T01:23:19.604852+0000","last_became_peered":"2024-09-16T01:23:19.604852+0000","last_unstale":"2024-09-16T01:23:20.674234+0000","last_undegraded":"2024-09-16T01:23:20.674234+0000","last_fullsized":"2024-09-16T01:23:20.674234+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:31.304818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674024+0000","last_change":"2024-09-16T01:23:18.607124+0000","last_active":"2024-09-16T01:23:20.674024+0000","last_peered":"2024-09-16T01:23:20.674024+0000","last_clean":"2024-09-16T01:23:20.674024+0000","last_became_active":"2024-09-16T01:23:18.606776+0000","last_became_peered":"2024-09-16T01:23:18.606776+0000","last_unstale":"2024-09-16T01:23:20.674024+0000","last_undegraded":"2024-09-16T01:23:20.674024+0000","last_fullsized":"2024-09-16T01:23:20.674024+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:48.241390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606628+0000","last_change":"2024-09-16T01:23:19.606035+0000","last_active":"2024-09-16T01:23:20.606628+0000","last_peered":"2024-09-16T01:23:20.606628+0000","last_clean":"2024-09-16T01:23:20.606628+0000","last_became_active":"2024-09-16T01:23:19.605749+0000","last_became_peered":"2024-09-16T01:23:19.605749+0000","last_unstale":"2024-09-16T01:23:20.606628+0000","last_undegraded":"2024-09-16T01:23:20.606628+0000","last_fullsized":"2024-09-16T01:23:20.606628+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:05.009107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.611707+0000","last_change":"2024-09-16T01:23:18.606500+0000","last_active":"2024-09-16T01:23:20.611707+0000","last_peered":"2024-09-16T01:23:20.611707+0000","last_clean":"2024-09-16T01:23:20.611707+0000","last_became_active":"2024-09-16T01:23:18.606078+0000","last_became_peered":"2024-09-16T01:23:18.606078+0000","last_unstale":"2024-09-16T01:23:20.611707+0000","last_undegraded":"2024-09-16T01:23:20.611707+0000","last_fullsized":"2024-09-16T01:23:20.611707+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:47.663715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673633+0000","last_change":"2024-09-16T01:23:19.608541+0000","last_active":"2024-09-16T01:23:20.673633+0000","last_peered":"2024-09-16T01:23:20.673633+0000","last_clean":"2024-09-16T01:23:20.673633+0000","last_became_active":"2024-09-16T01:23:19.608280+0000","last_became_peered":"2024-09-16T01:23:19.608280+0000","last_unstale":"2024-09-16T01:23:20.673633+0000","last_undegraded":"2024-09-16T01:23:20.673633+0000","last_fullsized":"2024-09-16T01:23:20.673633+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:32.469260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.611680+0000","last_change":"2024-09-16T01:23:18.606855+0000","last_active":"2024-09-16T01:23:20.611680+0000","last_peered":"2024-09-16T01:23:20.611680+0000","last_clean":"2024-09-16T01:23:20.611680+0000","last_became_active":"2024-09-16T01:23:18.606603+0000","last_became_peered":"2024-09-16T01:23:18.606603+0000","last_unstale":"2024-09-16T01:23:20.611680+0000","last_undegraded":"2024-09-16T01:23:20.611680+0000","last_fullsized":"2024-09-16T01:23:20.611680+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:07.865939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606652+0000","last_change":"2024-09-16T01:23:19.609040+0000","last_active":"2024-09-16T01:23:20.606652+0000","last_peered":"2024-09-16T01:23:20.606652+0000","last_clean":"2024-09-16T01:23:20.606652+0000","last_became_active":"2024-09-16T01:23:19.608785+0000","last_became_peered":"2024-09-16T01:23:19.608785+0000","last_unstale":"2024-09-16T01:23:20.606652+0000","last_undegraded":"2024-09-16T01:23:20.606652+0000","last_fullsized":"2024-09-16T01:23:20.606652+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:42.141620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"136'8","reported_seq":22,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.612331+0000","last_change":"2024-09-16T01:23:18.603083+0000","last_active":"2024-09-16T01:23:20.612331+0000","last_peered":"2024-09-16T01:23:20.612331+0000","last_clean":"2024-09-16T01:23:20.612331+0000","last_became_active":"2024-09-16T01:23:18.602766+0000","last_became_peered":"2024-09-16T01:23:18.602766+0000","last_unstale":"2024-09-16T01:23:20.612331+0000","last_undegraded":"2024-09-16T01:23:20.612331+0000","last_fullsized":"2024-09-16T01:23:20.612331+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:07.865939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673962+0000","last_change":"2024-09-16T01:23:19.616541+0000","last_active":"2024-09-16T01:23:20.673962+0000","last_peered":"2024-09-16T01:23:20.673962+0000","last_clean":"2024-09-16T01:23:20.673962+0000","last_became_active":"2024-09-16T01:23:19.616134+0000","last_became_peered":"2024-09-16T01:23:19.616134+0000","last_unstale":"2024-09-16T01:23:20.673962+0000","last_undegraded":"2024-09-16T01:23:20.673962+0000","last_fullsized":"2024-09-16T01:23:20.673962+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:22.404338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"136'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673733+0000","last_change":"2024-09-16T01:23:18.603035+0000","last_active":"2024-09-16T01:23:20.673733+0000","last_peered":"2024-09-16T01:23:20.673733+0000","last_clean":"2024-09-16T01:23:20.673733+0000","last_became_active":"2024-09-16T01:23:18.602712+0000","last_became_peered":"2024-09-16T01:23:18.602712+0000","last_unstale":"2024-09-16T01:23:20.673733+0000","last_undegraded":"2024-09-16T01:23:20.673733+0000","last_fullsized":"2024-09-16T01:23:20.673733+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:47.556893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674566+0000","last_change":"2024-09-16T01:23:19.616421+0000","last_active":"2024-09-16T01:23:20.674566+0000","last_peered":"2024-09-16T01:23:20.674566+0000","last_clean":"2024-09-16T01:23:20.674566+0000","last_became_active":"2024-09-16T01:23:19.616119+0000","last_became_peered":"2024-09-16T01:23:19.616119+0000","last_unstale":"2024-09-16T01:23:20.674566+0000","last_undegraded":"2024-09-16T01:23:20.674566+0000","last_fullsized":"2024-09-16T01:23:20.674566+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:42:11.696694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674142+0000","last_change":"2024-09-16T01:23:18.609541+0000","last_active":"2024-09-16T01:23:20.674142+0000","last_peered":"2024-09-16T01:23:20.674142+0000","last_clean":"2024-09-16T01:23:20.674142+0000","last_became_active":"2024-09-16T01:23:18.609239+0000","last_became_peered":"2024-09-16T01:23:18.609239+0000","last_unstale":"2024-09-16T01:23:20.674142+0000","last_undegraded":"2024-09-16T01:23:20.674142+0000","last_fullsized":"2024-09-16T01:23:20.674142+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:46.023877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.613358+0000","last_change":"2024-09-16T01:23:19.607683+0000","last_active":"2024-09-16T01:23:20.613358+0000","last_peered":"2024-09-16T01:23:20.613358+0000","last_clean":"2024-09-16T01:23:20.613358+0000","last_became_active":"2024-09-16T01:23:19.607165+0000","last_became_peered":"2024-09-16T01:23:19.607165+0000","last_unstale":"2024-09-16T01:23:20.613358+0000","last_undegraded":"2024-09-16T01:23:20.613358+0000","last_fullsized":"2024-09-16T01:23:20.613358+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:17.417763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"136'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606943+0000","last_change":"2024-09-16T01:23:18.606114+0000","last_active":"2024-09-16T01:23:20.606943+0000","last_peered":"2024-09-16T01:23:20.606943+0000","last_clean":"2024-09-16T01:23:20.606943+0000","last_became_active":"2024-09-16T01:23:18.604540+0000","last_became_peered":"2024-09-16T01:23:18.604540+0000","last_unstale":"2024-09-16T01:23:20.606943+0000","last_undegraded":"2024-09-16T01:23:20.606943+0000","last_fullsized":"2024-09-16T01:23:20.606943+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:23.841454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.613335+0000","last_change":"2024-09-16T01:23:19.597378+0000","last_active":"2024-09-16T01:23:20.613335+0000","last_peered":"2024-09-16T01:23:20.613335+0000","last_clean":"2024-09-16T01:23:20.613335+0000","last_became_active":"2024-09-16T01:23:19.597098+0000","last_became_peered":"2024-09-16T01:23:19.597098+0000","last_unstale":"2024-09-16T01:23:20.613335+0000","last_undegraded":"2024-09-16T01:23:20.613335+0000","last_fullsized":"2024-09-16T01:23:20.613335+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:06.567475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.611835+0000","last_change":"2024-09-16T01:23:18.602287+0000","last_active":"2024-09-16T01:23:20.611835+0000","last_peered":"2024-09-16T01:23:20.611835+0000","last_clean":"2024-09-16T01:23:20.611835+0000","last_became_active":"2024-09-16T01:23:18.602004+0000","last_became_peered":"2024-09-16T01:23:18.602004+0000","last_unstale":"2024-09-16T01:23:20.611835+0000","last_undegraded":"2024-09-16T01:23:20.611835+0000","last_fullsized":"2024-09-16T01:23:20.611835+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:53.893194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673673+0000","last_change":"2024-09-16T01:23:19.611239+0000","last_active":"2024-09-16T01:23:20.673673+0000","last_peered":"2024-09-16T01:23:20.673673+0000","last_clean":"2024-09-16T01:23:20.673673+0000","last_became_active":"2024-09-16T01:23:19.610954+0000","last_became_peered":"2024-09-16T01:23:19.610954+0000","last_unstale":"2024-09-16T01:23:20.673673+0000","last_undegraded":"2024-09-16T01:23:20.673673+0000","last_fullsized":"2024-09-16T01:23:20.673673+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:13.359018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673561+0000","last_change":"2024-09-16T01:23:18.606370+0000","last_active":"2024-09-16T01:23:20.673561+0000","last_peered":"2024-09-16T01:23:20.673561+0000","last_clean":"2024-09-16T01:23:20.673561+0000","last_became_active":"2024-09-16T01:23:18.606088+0000","last_became_peered":"2024-09-16T01:23:18.606088+0000","last_unstale":"2024-09-16T01:23:20.673561+0000","last_undegraded":"2024-09-16T01:23:20.673561+0000","last_fullsized":"2024-09-16T01:23:20.673561+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:42:10.694553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606704+0000","last_change":"2024-09-16T01:23:19.607192+0000","last_active":"2024-09-16T01:23:20.606704+0000","last_peered":"2024-09-16T01:23:20.606704+0000","last_clean":"2024-09-16T01:23:20.606704+0000","last_became_active":"2024-09-16T01:23:19.606927+0000","last_became_peered":"2024-09-16T01:23:19.606927+0000","last_unstale":"2024-09-16T01:23:20.606704+0000","last_undegraded":"2024-09-16T01:23:20.606704+0000","last_fullsized":"2024-09-16T01:23:20.606704+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:59.378655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674362+0000","last_change":"2024-09-16T01:23:18.604745+0000","last_active":"2024-09-16T01:23:20.674362+0000","last_peered":"2024-09-16T01:23:20.674362+0000","last_clean":"2024-09-16T01:23:20.674362+0000","last_became_active":"2024-09-16T01:23:18.603614+0000","last_became_peered":"2024-09-16T01:23:18.603614+0000","last_unstale":"2024-09-16T01:23:20.674362+0000","last_undegraded":"2024-09-16T01:23:20.674362+0000","last_fullsized":"2024-09-16T01:23:20.674362+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:41.723703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673855+0000","last_change":"2024-09-16T01:23:19.608742+0000","last_active":"2024-09-16T01:23:20.673855+0000","last_peered":"2024-09-16T01:23:20.673855+0000","last_clean":"2024-09-16T01:23:20.673855+0000","last_became_active":"2024-09-16T01:23:19.608461+0000","last_became_peered":"2024-09-16T01:23:19.608461+0000","last_unstale":"2024-09-16T01:23:20.673855+0000","last_undegraded":"2024-09-16T01:23:20.673855+0000","last_fullsized":"2024-09-16T01:23:20.673855+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:34.634971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674167+0000","last_change":"2024-09-16T01:23:18.607160+0000","last_active":"2024-09-16T01:23:20.674167+0000","last_peered":"2024-09-16T01:23:20.674167+0000","last_clean":"2024-09-16T01:23:20.674167+0000","last_became_active":"2024-09-16T01:23:18.606901+0000","last_became_peered":"2024-09-16T01:23:18.606901+0000","last_unstale":"2024-09-16T01:23:20.674167+0000","last_undegraded":"2024-09-16T01:23:20.674167+0000","last_fullsized":"2024-09-16T01:23:20.674167+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:15.130604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606783+0000","last_change":"2024-09-16T01:23:19.608473+0000","last_active":"2024-09-16T01:23:20.606783+0000","last_peered":"2024-09-16T01:23:20.606783+0000","last_clean":"2024-09-16T01:23:20.606783+0000","last_became_active":"2024-09-16T01:23:19.608212+0000","last_became_peered":"2024-09-16T01:23:19.608212+0000","last_unstale":"2024-09-16T01:23:20.606783+0000","last_undegraded":"2024-09-16T01:23:20.606783+0000","last_fullsized":"2024-09-16T01:23:20.606783+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:13.406713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674283+0000","last_change":"2024-09-16T01:23:18.609056+0000","last_active":"2024-09-16T01:23:20.674283+0000","last_peered":"2024-09-16T01:23:20.674283+0000","last_clean":"2024-09-16T01:23:20.674283+0000","last_became_active":"2024-09-16T01:23:18.608778+0000","last_became_peered":"2024-09-16T01:23:18.608778+0000","last_unstale":"2024-09-16T01:23:20.674283+0000","last_undegraded":"2024-09-16T01:23:20.674283+0000","last_fullsized":"2024-09-16T01:23:20.674283+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:16.021277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674609+0000","last_change":"2024-09-16T01:23:19.614795+0000","last_active":"2024-09-16T01:23:20.674609+0000","last_peered":"2024-09-16T01:23:20.674609+0000","last_clean":"2024-09-16T01:23:20.674609+0000","last_became_active":"2024-09-16T01:23:19.614536+0000","last_became_peered":"2024-09-16T01:23:19.614536+0000","last_unstale":"2024-09-16T01:23:20.674609+0000","last_undegraded":"2024-09-16T01:23:20.674609+0000","last_fullsized":"2024-09-16T01:23:20.674609+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:03.333220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"136'2","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.612114+0000","last_change":"2024-09-16T01:23:18.602464+0000","last_active":"2024-09-16T01:23:20.612114+0000","last_peered":"2024-09-16T01:23:20.612114+0000","last_clean":"2024-09-16T01:23:20.612114+0000","last_became_active":"2024-09-16T01:23:18.602168+0000","last_became_peered":"2024-09-16T01:23:18.602168+0000","last_unstale":"2024-09-16T01:23:20.612114+0000","last_undegraded":"2024-09-16T01:23:20.612114+0000","last_fullsized":"2024-09-16T01:23:20.612114+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:55:08.959211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.612237+0000","last_change":"2024-09-16T01:23:19.611285+0000","last_active":"2024-09-16T01:23:20.612237+0000","last_peered":"2024-09-16T01:23:20.612237+0000","last_clean":"2024-09-16T01:23:20.612237+0000","last_became_active":"2024-09-16T01:23:19.611006+0000","last_became_peered":"2024-09-16T01:23:19.611006+0000","last_unstale":"2024-09-16T01:23:20.612237+0000","last_undegraded":"2024-09-16T01:23:20.612237+0000","last_fullsized":"2024-09-16T01:23:20.612237+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:50.742144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"137'1","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.613567+0000","last_change":"2024-09-16T01:23:18.606327+0000","last_active":"2024-09-16T01:23:20.613567+0000","last_peered":"2024-09-16T01:23:20.613567+0000","last_clean":"2024-09-16T01:23:20.613567+0000","last_became_active":"2024-09-16T01:23:18.606044+0000","last_became_peered":"2024-09-16T01:23:18.606044+0000","last_unstale":"2024-09-16T01:23:20.613567+0000","last_undegraded":"2024-09-16T01:23:20.613567+0000","last_fullsized":"2024-09-16T01:23:20.613567+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:37.637422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.613505+0000","last_change":"2024-09-16T01:23:19.601871+0000","last_active":"2024-09-16T01:23:20.613505+0000","last_peered":"2024-09-16T01:23:20.613505+0000","last_clean":"2024-09-16T01:23:20.613505+0000","last_became_active":"2024-09-16T01:23:19.601597+0000","last_became_peered":"2024-09-16T01:23:19.601597+0000","last_unstale":"2024-09-16T01:23:20.613505+0000","last_undegraded":"2024-09-16T01:23:20.613505+0000","last_fullsized":"2024-09-16T01:23:20.613505+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:16.591162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606989+0000","last_change":"2024-09-16T01:23:18.600493+0000","last_active":"2024-09-16T01:23:20.606989+0000","last_peered":"2024-09-16T01:23:20.606989+0000","last_clean":"2024-09-16T01:23:20.606989+0000","last_became_active":"2024-09-16T01:23:18.600212+0000","last_became_peered":"2024-09-16T01:23:18.600212+0000","last_unstale":"2024-09-16T01:23:20.606989+0000","last_undegraded":"2024-09-16T01:23:20.606989+0000","last_fullsized":"2024-09-16T01:23:20.606989+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:07.514742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673983+0000","last_change":"2024-09-16T01:23:19.611897+0000","last_active":"2024-09-16T01:23:20.673983+0000","last_peered":"2024-09-16T01:23:20.673983+0000","last_clean":"2024-09-16T01:23:20.673983+0000","last_became_active":"2024-09-16T01:23:19.610220+0000","last_became_peered":"2024-09-16T01:23:19.610220+0000","last_unstale":"2024-09-16T01:23:20.673983+0000","last_undegraded":"2024-09-16T01:23:20.673983+0000","last_fullsized":"2024-09-16T01:23:20.673983+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:16.132745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674515+0000","last_change":"2024-09-16T01:23:18.606239+0000","last_active":"2024-09-16T01:23:20.674515+0000","last_peered":"2024-09-16T01:23:20.674515+0000","last_clean":"2024-09-16T01:23:20.674515+0000","last_became_active":"2024-09-16T01:23:18.605970+0000","last_became_peered":"2024-09-16T01:23:18.605970+0000","last_unstale":"2024-09-16T01:23:20.674515+0000","last_undegraded":"2024-09-16T01:23:20.674515+0000","last_fullsized":"2024-09-16T01:23:20.674515+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:06.742428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674280+0000","last_change":"2024-09-16T01:23:19.603731+0000","last_active":"2024-09-16T01:23:20.674280+0000","last_peered":"2024-09-16T01:23:20.674280+0000","last_clean":"2024-09-16T01:23:20.674280+0000","last_became_active":"2024-09-16T01:23:19.603157+0000","last_became_peered":"2024-09-16T01:23:19.603157+0000","last_unstale":"2024-09-16T01:23:20.674280+0000","last_undegraded":"2024-09-16T01:23:20.674280+0000","last_fullsized":"2024-09-16T01:23:20.674280+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:24.843595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.612733+0000","last_change":"2024-09-16T01:23:18.608234+0000","last_active":"2024-09-16T01:23:20.612733+0000","last_peered":"2024-09-16T01:23:20.612733+0000","last_clean":"2024-09-16T01:23:20.612733+0000","last_became_active":"2024-09-16T01:23:18.607910+0000","last_became_peered":"2024-09-16T01:23:18.607910+0000","last_unstale":"2024-09-16T01:23:20.612733+0000","last_undegraded":"2024-09-16T01:23:20.612733+0000","last_fullsized":"2024-09-16T01:23:20.612733+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:37.574028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.611612+0000","last_change":"2024-09-16T01:23:19.605520+0000","last_active":"2024-09-16T01:23:20.611612+0000","last_peered":"2024-09-16T01:23:20.611612+0000","last_clean":"2024-09-16T01:23:20.611612+0000","last_became_active":"2024-09-16T01:23:19.605279+0000","last_became_peered":"2024-09-16T01:23:19.605279+0000","last_unstale":"2024-09-16T01:23:20.611612+0000","last_undegraded":"2024-09-16T01:23:20.611612+0000","last_fullsized":"2024-09-16T01:23:20.611612+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:24.843595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674320+0000","last_change":"2024-09-16T01:23:18.606477+0000","last_active":"2024-09-16T01:23:20.674320+0000","last_peered":"2024-09-16T01:23:20.674320+0000","last_clean":"2024-09-16T01:23:20.674320+0000","last_became_active":"2024-09-16T01:23:18.606181+0000","last_became_peered":"2024-09-16T01:23:18.606181+0000","last_unstale":"2024-09-16T01:23:20.674320+0000","last_undegraded":"2024-09-16T01:23:20.674320+0000","last_fullsized":"2024-09-16T01:23:20.674320+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:58.697333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.606880+0000","last_change":"2024-09-16T01:23:19.605954+0000","last_active":"2024-09-16T01:23:20.606880+0000","last_peered":"2024-09-16T01:23:20.606880+0000","last_clean":"2024-09-16T01:23:20.606880+0000","last_became_active":"2024-09-16T01:23:19.600554+0000","last_became_peered":"2024-09-16T01:23:19.600554+0000","last_unstale":"2024-09-16T01:23:20.606880+0000","last_undegraded":"2024-09-16T01:23:20.606880+0000","last_fullsized":"2024-09-16T01:23:20.606880+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:50.758202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.612582+0000","last_change":"2024-09-16T01:23:18.597387+0000","last_active":"2024-09-16T01:23:20.612582+0000","last_peered":"2024-09-16T01:23:20.612582+0000","last_clean":"2024-09-16T01:23:20.612582+0000","last_became_active":"2024-09-16T01:23:18.596535+0000","last_became_peered":"2024-09-16T01:23:18.596535+0000","last_unstale":"2024-09-16T01:23:20.612582+0000","last_undegraded":"2024-09-16T01:23:20.612582+0000","last_fullsized":"2024-09-16T01:23:20.612582+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:07.399652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.674534+0000","last_change":"2024-09-16T01:23:19.606692+0000","last_active":"2024-09-16T01:23:20.674534+0000","last_peered":"2024-09-16T01:23:20.674534+0000","last_clean":"2024-09-16T01:23:20.674534+0000","last_became_active":"2024-09-16T01:23:19.605471+0000","last_became_peered":"2024-09-16T01:23:19.605471+0000","last_unstale":"2024-09-16T01:23:20.674534+0000","last_undegraded":"2024-09-16T01:23:20.674534+0000","last_fullsized":"2024-09-16T01:23:20.674534+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:08.516883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673750+0000","last_change":"2024-09-16T01:23:18.604234+0000","last_active":"2024-09-16T01:23:20.673750+0000","last_peered":"2024-09-16T01:23:20.673750+0000","last_clean":"2024-09-16T01:23:20.673750+0000","last_became_active":"2024-09-16T01:23:18.603953+0000","last_became_peered":"2024-09-16T01:23:18.603953+0000","last_unstale":"2024-09-16T01:23:20.673750+0000","last_undegraded":"2024-09-16T01:23:20.673750+0000","last_fullsized":"2024-09-16T01:23:20.673750+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:58.376514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.675024+0000","last_change":"2024-09-16T01:23:19.613701+0000","last_active":"2024-09-16T01:23:20.675024+0000","last_peered":"2024-09-16T01:23:20.675024+0000","last_clean":"2024-09-16T01:23:20.675024+0000","last_became_active":"2024-09-16T01:23:19.613366+0000","last_became_peered":"2024-09-16T01:23:19.613366+0000","last_unstale":"2024-09-16T01:23:20.675024+0000","last_undegraded":"2024-09-16T01:23:20.675024+0000","last_fullsized":"2024-09-16T01:23:20.675024+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:18.581786+0000","last_clean_scrub_stamp":"2024-09-16T01:23:18.581786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:24:50.742144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"136'6","reported_seq":20,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673980+0000","last_change":"2024-09-16T01:23:18.607852+0000","last_active":"2024-09-16T01:23:20.673980+0000","last_peered":"2024-09-16T01:23:20.673980+0000","last_clean":"2024-09-16T01:23:20.673980+0000","last_became_active":"2024-09-16T01:23:18.607577+0000","last_became_peered":"2024-09-16T01:23:18.607577+0000","last_unstale":"2024-09-16T01:23:20.673980+0000","last_undegraded":"2024-09-16T01:23:20.673980+0000","last_fullsized":"2024-09-16T01:23:20.673980+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:17.579645+0000","last_clean_scrub_stamp":"2024-09-16T01:23:17.579645+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:02.331079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":381,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-16T01:23:20.673897+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:23:20.673897+0000","last_peered":"2024-09-16T01:23:20.673897+0000","last_clean":"2024-09-16T01:23:20.673897+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:23:20.673897+0000","last_undegraded":"2024-09-16T01:23:20.673897+0000","last_fullsized":"2024-09-16T01:23:20.673897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33456,"kb_used_data":2264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338384,"statfs":{"total":96636764160,"available":96602505216,"internally_reserved":0,"allocated":2318336,"data_stored":1385390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574947,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37032,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334808,"statfs":{"total":96636764160,"available":96598843392,"internally_reserved":0,"allocated":1724416,"data_stored":795070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574946,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32876,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1720320,"data_stored":795000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1732608,"data_stored":796612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1728512,"data_stored":795616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32884,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338956,"statfs":{"total":96636764160,"available":96603090944,"internally_reserved":0,"allocated":1728512,"data_stored":795112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574946,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1724416,"data_stored":795070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33480,"kb_used_data":2284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338360,"statfs":{"total":96636764160,"available":96602480640,"internally_reserved":0,"allocated":2338816,"data_stored":1387686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:23:27.478 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:23:27.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T01:23:27.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.618+0000 7f43be20a640 1 Processor -- start 2024-09-16T01:23:27.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.618+0000 7f43be20a640 1 -- start start 2024-09-16T01:23:27.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43be20a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f43b80b7c30 0x7f43b80cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43be20a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f43b80cd510 0x7f43b80b5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43be20a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b80ce1a0 con 0x7f43b80b4a50 2024-09-16T01:23:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43be20a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f43b80b3010 con 0x7f43b80b7c30 2024-09-16T01:23:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43be20a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f43b80b32f0 con 0x7f43b80cd510 2024-09-16T01:23:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43b77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f43b80b7c30 0x7f43b80cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43b6ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f43b80b4a50 0x7f43b80cce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36580/0 (socket says 172.21.15.81:36580) 2024-09-16T01:23:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43b77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f43b80b7c30 0x7f43b80cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48928/0 (socket says 172.21.15.81:48928) 2024-09-16T01:23:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43b6ffd640 1 -- 172.21.15.81:0/1792681595 learned_addr learned my addr 172.21.15.81:0/1792681595 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43b7fff640 1 --2- 172.21.15.81:0/1792681595 >> v2:172.21.15.102:3300/0 conn(0x7f43b80cd510 0x7f43b80b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43b77fe640 1 -- 172.21.15.81:0/1792681595 >> v2:172.21.15.102:3300/0 conn(0x7f43b80cd510 msgr2=0x7f43b80b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43b77fe640 1 --2- 172.21.15.81:0/1792681595 >> v2:172.21.15.102:3300/0 conn(0x7f43b80cd510 0x7f43b80b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43b77fe640 1 -- 172.21.15.81:0/1792681595 >> v1:172.21.15.81:6789/0 conn(0x7f43b80b4a50 legacy=0x7f43b80cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.619+0000 7f43b77fe640 1 -- 172.21.15.81:0/1792681595 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b80b35d0 con 0x7f43b80b7c30 2024-09-16T01:23:27.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.620+0000 7f43b77fe640 1 --2- 172.21.15.81:0/1792681595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80b7c30 0x7f43b80cfec0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f43b80cc8c0 tx=0x7f43a802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3053df96e3e6209 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:27.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.620+0000 7f43b67fc640 1 -- 172.21.15.81:0/1792681595 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a8037070 con 0x7f43b80b7c30 2024-09-16T01:23:27.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.620+0000 7f43b67fc640 1 -- 172.21.15.81:0/1792681595 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a8032440 con 0x7f43b80b7c30 2024-09-16T01:23:27.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.620+0000 7f43b67fc640 1 -- 172.21.15.81:0/1792681595 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a802ae60 con 0x7f43b80b7c30 2024-09-16T01:23:27.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.620+0000 7f43be20a640 1 -- 172.21.15.81:0/1792681595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80b7c30 msgr2=0x7f43b80cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.620+0000 7f43be20a640 1 --2- 172.21.15.81:0/1792681595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80b7c30 0x7f43b80cfec0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f43b80cc8c0 tx=0x7f43a802a110 comp rx=0 tx=0).stop 2024-09-16T01:23:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.620+0000 7f43be20a640 1 -- 172.21.15.81:0/1792681595 shutdown_connections 2024-09-16T01:23:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.620+0000 7f43be20a640 1 --2- 172.21.15.81:0/1792681595 >> v2:172.21.15.102:3300/0 conn(0x7f43b80cd510 0x7f43b80b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.620+0000 7f43be20a640 1 --2- 172.21.15.81:0/1792681595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80b7c30 0x7f43b80cfec0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.620+0000 7f43be20a640 1 -- 172.21.15.81:0/1792681595 >> 172.21.15.81:0/1792681595 conn(0x7f43b80b3de0 msgr2=0x7f43b80b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.620+0000 7f43be20a640 1 -- 172.21.15.81:0/1792681595 shutdown_connections 2024-09-16T01:23:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.620+0000 7f43be20a640 1 -- 172.21.15.81:0/1792681595 wait complete. 2024-09-16T01:23:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.622+0000 7f43be20a640 1 Processor -- start 2024-09-16T01:23:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.622+0000 7f43be20a640 1 -- start start 2024-09-16T01:23:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.622+0000 7f43be20a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b80b4a50 0x7f43b80ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.622+0000 7f43be20a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80b7c30 0x7f43b8151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.622+0000 7f43be20a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43b80cd510 0x7f43b806e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.622+0000 7f43be20a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43b80d0400 con 0x7f43b80b7c30 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.622+0000 7f43be20a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f43b80cd910 con 0x7f43b80cd510 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.622+0000 7f43be20a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f43b80d0580 con 0x7f43b80b4a50 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43b6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80b7c30 0x7f43b8151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43b6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80b7c30 0x7f43b8151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48932/0 (socket says 172.21.15.81:48932) 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43b6ffd640 1 -- 172.21.15.81:0/3970699928 learned_addr learned my addr 172.21.15.81:0/3970699928 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43b77fe640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b80b4a50 0x7f43b80ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43b7fff640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43b80cd510 0x7f43b806e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43b6ffd640 1 -- 172.21.15.81:0/3970699928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b80b4a50 msgr2=0x7f43b80ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43b6ffd640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b80b4a50 0x7f43b80ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43b6ffd640 1 -- 172.21.15.81:0/3970699928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43b80cd510 msgr2=0x7f43b806e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43b6ffd640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43b80cd510 0x7f43b806e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43b6ffd640 1 -- 172.21.15.81:0/3970699928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b80ca760 con 0x7f43b80b7c30 2024-09-16T01:23:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43b77fe640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b80b4a50 0x7f43b80ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43b6ffd640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80b7c30 0x7f43b8151710 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00c400 tx=0x7f43ac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f439ffff640 1 -- 172.21.15.81:0/3970699928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac017070 con 0x7f43b80b7c30 2024-09-16T01:23:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f439ffff640 1 -- 172.21.15.81:0/3970699928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ac005ce0 con 0x7f43b80b7c30 2024-09-16T01:23:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43be20a640 1 -- 172.21.15.81:0/3970699928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b815dd60 con 0x7f43b80b7c30 2024-09-16T01:23:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f439ffff640 1 -- 172.21.15.81:0/3970699928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac0072f0 con 0x7f43b80b7c30 2024-09-16T01:23:27.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.623+0000 7f43be20a640 1 -- 172.21.15.81:0/3970699928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b80c9a20 con 0x7f43b80b7c30 2024-09-16T01:23:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.624+0000 7f43be20a640 1 -- 172.21.15.81:0/3970699928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b80b8010 con 0x7f43b80b7c30 2024-09-16T01:23:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.625+0000 7f439ffff640 1 -- 172.21.15.81:0/3970699928 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f43ac01a070 con 0x7f43b80b7c30 2024-09-16T01:23:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.625+0000 7f439ffff640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f43a406c2e0 0x7f43a406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.625+0000 7f439ffff640 1 -- 172.21.15.81:0/3970699928 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f43ac08a8f0 con 0x7f43b80b7c30 2024-09-16T01:23:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.625+0000 7f43b77fe640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f43a406c2e0 0x7f43a406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.626+0000 7f43b77fe640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f43a406c2e0 0x7f43a406e7a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f43a8034000 tx=0x7f43a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:27.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.630+0000 7f439ffff640 1 -- 172.21.15.81:0/3970699928 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43b80ca760 con 0x7f43b80b7c30 2024-09-16T01:23:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.858+0000 7f43be20a640 1 -- 172.21.15.81:0/3970699928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f43b809bd30 con 0x7f43b80b7c30 2024-09-16T01:23:27.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.861+0000 7f439ffff640 1 -- 172.21.15.81:0/3970699928 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7f43ac058880 con 0x7f43b80b7c30 2024-09-16T01:23:27.863 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-16T01:23:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg== 2024-09-16T01:23:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-16T01:23:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-16T01:23:27.863 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T01:23:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-16T01:23:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.864+0000 7f43be20a640 1 -- 172.21.15.81:0/3970699928 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f43a406c2e0 msgr2=0x7f43a406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.864+0000 7f43be20a640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f43a406c2e0 0x7f43a406e7a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f43a8034000 tx=0x7f43a802e000 comp rx=0 tx=0).stop 2024-09-16T01:23:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.864+0000 7f43be20a640 1 -- 172.21.15.81:0/3970699928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80b7c30 msgr2=0x7f43b8151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.864+0000 7f43be20a640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80b7c30 0x7f43b8151710 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00c400 tx=0x7f43ac00c8c0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.864+0000 7f43be20a640 1 -- 172.21.15.81:0/3970699928 shutdown_connections 2024-09-16T01:23:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.864+0000 7f43be20a640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f43a406c2e0 0x7f43a406e7a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.864+0000 7f43be20a640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43b80cd510 0x7f43b806e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.864+0000 7f43be20a640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43b80b7c30 0x7f43b8151710 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.864+0000 7f43be20a640 1 --2- 172.21.15.81:0/3970699928 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f43b80b4a50 0x7f43b80ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.864+0000 7f43be20a640 1 -- 172.21.15.81:0/3970699928 >> 172.21.15.81:0/3970699928 conn(0x7f43b80b3de0 msgr2=0x7f43b809aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:27.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.864+0000 7f43be20a640 1 -- 172.21.15.81:0/3970699928 shutdown_connections 2024-09-16T01:23:27.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.864+0000 7f43be20a640 1 -- 172.21.15.81:0/3970699928 wait complete. 2024-09-16T01:23:27.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.972+0000 7f731b065640 1 Processor -- start 2024-09-16T01:23:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.972+0000 7f731b065640 1 -- start start 2024-09-16T01:23:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.973+0000 7f731b065640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7314072dc0 0x7f73140b3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.973+0000 7f731b065640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73140b3c90 0x7f731406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.973+0000 7f731b065640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73140b44c0 con 0x7f73140afd60 2024-09-16T01:23:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.973+0000 7f731b065640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f73140b0140 con 0x7f73140b3c90 2024-09-16T01:23:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.973+0000 7f731b065640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f731415ead0 con 0x7f7314072dc0 2024-09-16T01:23:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.973+0000 7f7319602640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f73140b3c90 0x7f731406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.973+0000 7f7318e01640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f73140afd60 0x7f73140726b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36582/0 (socket says 172.21.15.81:36582) 2024-09-16T01:23:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.973+0000 7f7318e01640 1 -- 172.21.15.81:0/261352466 learned_addr learned my addr 172.21.15.81:0/261352466 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.973+0000 7f7313fff640 1 --2- 172.21.15.81:0/261352466 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7314072dc0 0x7f73140b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.974+0000 7f7319602640 1 -- 172.21.15.81:0/261352466 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7314072dc0 msgr2=0x7f73140b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.974+0000 7f7319602640 1 --2- 172.21.15.81:0/261352466 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7314072dc0 0x7f73140b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.974+0000 7f7319602640 1 -- 172.21.15.81:0/261352466 >> v1:172.21.15.81:6789/0 conn(0x7f73140afd60 legacy=0x7f73140726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.974+0000 7f73137fe640 1 -- 172.21.15.81:0/261352466 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1309957324 0 0) 0x7f73140b44c0 con 0x7f73140afd60 2024-09-16T01:23:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.974+0000 7f7319602640 1 -- 172.21.15.81:0/261352466 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731415edb0 con 0x7f73140b3c90 2024-09-16T01:23:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.974+0000 7f7319602640 1 --2- 172.21.15.81:0/261352466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73140b3c90 0x7f731406f5a0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f730c009d90 tx=0x7f730c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf25fe8db280aa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.974+0000 7f73137fe640 1 -- 172.21.15.81:0/261352466 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c007740 con 0x7f73140b3c90 2024-09-16T01:23:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.974+0000 7f73137fe640 1 -- 172.21.15.81:0/261352466 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730c0078e0 con 0x7f73140b3c90 2024-09-16T01:23:27.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.974+0000 7f73137fe640 1 -- 172.21.15.81:0/261352466 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c007cb0 con 0x7f73140b3c90 2024-09-16T01:23:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.975+0000 7f731b065640 1 -- 172.21.15.81:0/261352466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73140b3c90 msgr2=0x7f731406f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.975+0000 7f731b065640 1 --2- 172.21.15.81:0/261352466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73140b3c90 0x7f731406f5a0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f730c009d90 tx=0x7f730c02a660 comp rx=0 tx=0).stop 2024-09-16T01:23:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.975+0000 7f731b065640 1 -- 172.21.15.81:0/261352466 shutdown_connections 2024-09-16T01:23:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.975+0000 7f731b065640 1 --2- 172.21.15.81:0/261352466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73140b3c90 0x7f731406f5a0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.975+0000 7f731b065640 1 --2- 172.21.15.81:0/261352466 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7314072dc0 0x7f73140b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.975+0000 7f731b065640 1 -- 172.21.15.81:0/261352466 >> 172.21.15.81:0/261352466 conn(0x7f731406c030 msgr2=0x7f731406c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:27.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.975+0000 7f731b065640 1 -- 172.21.15.81:0/261352466 shutdown_connections 2024-09-16T01:23:27.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.975+0000 7f731b065640 1 -- 172.21.15.81:0/261352466 wait complete. 2024-09-16T01:23:27.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.976+0000 7f731b065640 1 Processor -- start 2024-09-16T01:23:27.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.976+0000 7f731b065640 1 -- start start 2024-09-16T01:23:27.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.977+0000 7f731b065640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7314072dc0 0x7f7314143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.977+0000 7f731b065640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73140afd60 0x7f7314156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.977+0000 7f731b065640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73140b3c90 0x7f73140b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.977+0000 7f731b065640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f731415f890 con 0x7f7314072dc0 2024-09-16T01:23:27.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.977+0000 7f731b065640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f731415f370 con 0x7f73140b3c90 2024-09-16T01:23:27.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.977+0000 7f731b065640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f73140b4140 con 0x7f73140afd60 2024-09-16T01:23:27.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.977+0000 7f7318e01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7314072dc0 0x7f7314143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.977+0000 7f7318e01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7314072dc0 0x7f7314143e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48958/0 (socket says 172.21.15.81:48958) 2024-09-16T01:23:27.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.977+0000 7f7318e01640 1 -- 172.21.15.81:0/4239144563 learned_addr learned my addr 172.21.15.81:0/4239144563 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:27.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.977+0000 7f7319602640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73140b3c90 0x7f73140b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.977+0000 7f7313fff640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73140afd60 0x7f7314156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.978+0000 7f7318e01640 1 -- 172.21.15.81:0/4239144563 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73140afd60 msgr2=0x7f7314156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.978+0000 7f7318e01640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73140afd60 0x7f7314156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.978+0000 7f7318e01640 1 -- 172.21.15.81:0/4239144563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73140b3c90 msgr2=0x7f73140b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.978+0000 7f7318e01640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73140b3c90 0x7f73140b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.978+0000 7f7318e01640 1 -- 172.21.15.81:0/4239144563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7314157e20 con 0x7f7314072dc0 2024-09-16T01:23:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.978+0000 7f7313fff640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73140afd60 0x7f7314156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.978+0000 7f7318e01640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7314072dc0 0x7f7314143e70 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f730800c460 tx=0x7f730800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.978+0000 7f73117fa640 1 -- 172.21.15.81:0/4239144563 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308018070 con 0x7f7314072dc0 2024-09-16T01:23:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.978+0000 7f73117fa640 1 -- 172.21.15.81:0/4239144563 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7308007500 con 0x7f7314072dc0 2024-09-16T01:23:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.978+0000 7f73117fa640 1 -- 172.21.15.81:0/4239144563 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308004a20 con 0x7f7314072dc0 2024-09-16T01:23:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.978+0000 7f731b065640 1 -- 172.21.15.81:0/4239144563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7314158100 con 0x7f7314072dc0 2024-09-16T01:23:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.978+0000 7f731b065640 1 -- 172.21.15.81:0/4239144563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7314156850 con 0x7f7314072dc0 2024-09-16T01:23:27.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.979+0000 7f731b065640 1 -- 172.21.15.81:0/4239144563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73141563a0 con 0x7f7314072dc0 2024-09-16T01:23:27.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.980+0000 7f73117fa640 1 -- 172.21.15.81:0/4239144563 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f730801b070 con 0x7f7314072dc0 2024-09-16T01:23:27.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.980+0000 7f73117fa640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72f806c2b0 0x7f72f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:27.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.980+0000 7f73117fa640 1 -- 172.21.15.81:0/4239144563 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f730808a7c0 con 0x7f7314072dc0 2024-09-16T01:23:27.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.980+0000 7f7313fff640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72f806c2b0 0x7f72f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:27.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.980+0000 7f7313fff640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72f806c2b0 0x7f72f806e770 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f73141f75b0 tx=0x7f7300008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:27.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:27.984+0000 7f73117fa640 1 -- 172.21.15.81:0/4239144563 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7308058750 con 0x7f7314072dc0 2024-09-16T01:23:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.185+0000 7f731b065640 1 -- 172.21.15.81:0/4239144563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73141554f0 con 0x7f7314072dc0 2024-09-16T01:23:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.186+0000 7f73117fa640 1 -- 172.21.15.81:0/4239144563 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5227 (secure 0 0 0) 0x7f730805ca50 con 0x7f7314072dc0 2024-09-16T01:23:28.188 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"btime":"2024-09-16T01:23:21:883930+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/350084010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":350084010},{"type":"v1","addr":"172.21.15.81:6837","nonce":350084010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6389,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1730570681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1730570681},{"type":"v1","addr":"172.21.15.102:6834","nonce":1730570681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/755231532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":755231532},{"type":"v1","addr":"172.21.15.102:6835","nonce":755231532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:23:18.932203+0000","modified":"2024-09-16T01:23:20.934317+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6836/1395000865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1395000865},{"type":"v1","addr":"172.21.15.81:6836","nonce":1395000865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8103,"qdb_cluster":[8103]},"id":10}]} 2024-09-16T01:23:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2024-09-16T01:23:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.187+0000 7f731b065640 1 -- 172.21.15.81:0/4239144563 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72f806c2b0 msgr2=0x7f72f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.187+0000 7f731b065640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72f806c2b0 0x7f72f806e770 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f73141f75b0 tx=0x7f7300008040 comp rx=0 tx=0).stop 2024-09-16T01:23:28.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.187+0000 7f731b065640 1 -- 172.21.15.81:0/4239144563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7314072dc0 msgr2=0x7f7314143e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.187+0000 7f731b065640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7314072dc0 0x7f7314143e70 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f730800c460 tx=0x7f730800c920 comp rx=0 tx=0).stop 2024-09-16T01:23:28.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.188+0000 7f731b065640 1 -- 172.21.15.81:0/4239144563 shutdown_connections 2024-09-16T01:23:28.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.188+0000 7f731b065640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f72f806c2b0 0x7f72f806e770 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.188+0000 7f731b065640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73140b3c90 0x7f73140b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.188+0000 7f731b065640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73140afd60 0x7f7314156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.188+0000 7f731b065640 1 --2- 172.21.15.81:0/4239144563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7314072dc0 0x7f7314143e70 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.188+0000 7f731b065640 1 -- 172.21.15.81:0/4239144563 >> 172.21.15.81:0/4239144563 conn(0x7f731406c030 msgr2=0x7f7314161540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:28.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.188+0000 7f731b065640 1 -- 172.21.15.81:0/4239144563 shutdown_connections 2024-09-16T01:23:28.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.188+0000 7f731b065640 1 -- 172.21.15.81:0/4239144563 wait complete. 2024-09-16T01:23:28.603 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:23:18.932203+0000', 'modified': '2024-09-16T01:23:20.934317+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8103': {'gid': 8103, 'name': 'a', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6836/1395000865', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 1395000865}, {'type': 'v1', 'addr': '172.21.15.81:6836', 'nonce': 1395000865}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8103, 'qdb_cluster': [8103]} 2024-09-16T01:23:28.603 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:23:28.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-16T01:23:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.706+0000 7f0c530dd640 1 Processor -- start 2024-09-16T01:23:28.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.706+0000 7f0c530dd640 1 -- start start 2024-09-16T01:23:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c530dd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0c4c15b300 0x7f0c4c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c530dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c4c0cd3f0 0x7f0c4c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c530dd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c4c0cdbe0 con 0x7f0c4c072d30 2024-09-16T01:23:28.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c530dd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0c4c0728a0 con 0x7f0c4c15b300 2024-09-16T01:23:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c530dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0c4c0cd900 con 0x7f0c4c0cd3f0 2024-09-16T01:23:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c5167a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0c4c072d30 0x7f0c4c0b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36584/0 (socket says 172.21.15.81:36584) 2024-09-16T01:23:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c5167a640 1 -- 172.21.15.81:0/3671951144 learned_addr learned my addr 172.21.15.81:0/3671951144 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c43fff640 1 --2- 172.21.15.81:0/3671951144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c4c0cd3f0 0x7f0c4c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c50e79640 1 --2- 172.21.15.81:0/3671951144 >> v2:172.21.15.102:3300/0 conn(0x7f0c4c15b300 0x7f0c4c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c437fe640 1 -- 172.21.15.81:0/3671951144 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4185334545 0 0) 0x7f0c4c0cdbe0 con 0x7f0c4c072d30 2024-09-16T01:23:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c437fe640 1 -- 172.21.15.81:0/3671951144 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c34003520 con 0x7f0c4c072d30 2024-09-16T01:23:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c43fff640 1 -- 172.21.15.81:0/3671951144 >> v2:172.21.15.102:3300/0 conn(0x7f0c4c15b300 msgr2=0x7f0c4c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c43fff640 1 --2- 172.21.15.81:0/3671951144 >> v2:172.21.15.102:3300/0 conn(0x7f0c4c15b300 0x7f0c4c0cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c43fff640 1 -- 172.21.15.81:0/3671951144 >> v1:172.21.15.81:6789/0 conn(0x7f0c4c072d30 legacy=0x7f0c4c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c43fff640 1 -- 172.21.15.81:0/3671951144 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4c072250 con 0x7f0c4c0cd3f0 2024-09-16T01:23:28.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.707+0000 7f0c50e79640 1 --2- 172.21.15.81:0/3671951144 >> v2:172.21.15.102:3300/0 conn(0x7f0c4c15b300 0x7f0c4c0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.708+0000 7f0c43fff640 1 --2- 172.21.15.81:0/3671951144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c4c0cd3f0 0x7f0c4c06f1c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0097a0 tx=0x7f0c3c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff406bf9bfe3fc3a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.708+0000 7f0c437fe640 1 -- 172.21.15.81:0/3671951144 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c037070 con 0x7f0c4c0cd3f0 2024-09-16T01:23:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.708+0000 7f0c437fe640 1 -- 172.21.15.81:0/3671951144 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c032440 con 0x7f0c4c0cd3f0 2024-09-16T01:23:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.708+0000 7f0c437fe640 1 -- 172.21.15.81:0/3671951144 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c032810 con 0x7f0c4c0cd3f0 2024-09-16T01:23:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.709+0000 7f0c530dd640 1 -- 172.21.15.81:0/3671951144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c4c0cd3f0 msgr2=0x7f0c4c06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.709+0000 7f0c530dd640 1 --2- 172.21.15.81:0/3671951144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c4c0cd3f0 0x7f0c4c06f1c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0097a0 tx=0x7f0c3c02a180 comp rx=0 tx=0).stop 2024-09-16T01:23:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.709+0000 7f0c530dd640 1 -- 172.21.15.81:0/3671951144 shutdown_connections 2024-09-16T01:23:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.709+0000 7f0c530dd640 1 --2- 172.21.15.81:0/3671951144 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c4c0cd3f0 0x7f0c4c06f1c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.709+0000 7f0c530dd640 1 --2- 172.21.15.81:0/3671951144 >> v2:172.21.15.102:3300/0 conn(0x7f0c4c15b300 0x7f0c4c0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.709+0000 7f0c530dd640 1 -- 172.21.15.81:0/3671951144 >> 172.21.15.81:0/3671951144 conn(0x7f0c4c067d70 msgr2=0x7f0c4c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.709+0000 7f0c530dd640 1 -- 172.21.15.81:0/3671951144 shutdown_connections 2024-09-16T01:23:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.709+0000 7f0c530dd640 1 -- 172.21.15.81:0/3671951144 wait complete. 2024-09-16T01:23:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.710+0000 7f0c530dd640 1 Processor -- start 2024-09-16T01:23:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.710+0000 7f0c530dd640 1 -- start start 2024-09-16T01:23:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c530dd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c4c072d30 0x7f0c4c156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c530dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c4c0cd3f0 0x7f0c4c142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c530dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c4c15b300 0x7f0c4c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c530dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c0d0160 con 0x7f0c4c15b300 2024-09-16T01:23:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c530dd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c0cffe0 con 0x7f0c4c072d30 2024-09-16T01:23:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c530dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0c4c06f700 con 0x7f0c4c0cd3f0 2024-09-16T01:23:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c5167a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c4c15b300 0x7f0c4c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c5167a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c4c15b300 0x7f0c4c156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48968/0 (socket says 172.21.15.81:48968) 2024-09-16T01:23:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c5167a640 1 -- 172.21.15.81:0/4251426823 learned_addr learned my addr 172.21.15.81:0/4251426823 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c43fff640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c4c0cd3f0 0x7f0c4c142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c50e79640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c4c072d30 0x7f0c4c156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c5167a640 1 -- 172.21.15.81:0/4251426823 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c4c0cd3f0 msgr2=0x7f0c4c142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c5167a640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c4c0cd3f0 0x7f0c4c142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c5167a640 1 -- 172.21.15.81:0/4251426823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c4c072d30 msgr2=0x7f0c4c156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c5167a640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c4c072d30 0x7f0c4c156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c5167a640 1 -- 172.21.15.81:0/4251426823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c4c1552b0 con 0x7f0c4c15b300 2024-09-16T01:23:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.711+0000 7f0c5167a640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c4c15b300 0x7f0c4c156d80 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400cb40 tx=0x7f0c4400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.712+0000 7f0c417fa640 1 -- 172.21.15.81:0/4251426823 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c44017070 con 0x7f0c4c15b300 2024-09-16T01:23:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.712+0000 7f0c417fa640 1 -- 172.21.15.81:0/4251426823 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c4400aca0 con 0x7f0c4c15b300 2024-09-16T01:23:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.712+0000 7f0c417fa640 1 -- 172.21.15.81:0/4251426823 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c44012620 con 0x7f0c4c15b300 2024-09-16T01:23:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.712+0000 7f0c530dd640 1 -- 172.21.15.81:0/4251426823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c4c155590 con 0x7f0c4c15b300 2024-09-16T01:23:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.712+0000 7f0c530dd640 1 -- 172.21.15.81:0/4251426823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c4c155b50 con 0x7f0c4c15b300 2024-09-16T01:23:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.713+0000 7f0c417fa640 1 -- 172.21.15.81:0/4251426823 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0c4401a070 con 0x7f0c4c15b300 2024-09-16T01:23:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.714+0000 7f0c417fa640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c3806c2b0 0x7f0c3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.714+0000 7f0c417fa640 1 -- 172.21.15.81:0/4251426823 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f0c4408b430 con 0x7f0c4c15b300 2024-09-16T01:23:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.714+0000 7f0c50e79640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c3806c2b0 0x7f0c3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.714+0000 7f0c50e79640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c3806c2b0 0x7f0c3806e770 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009a30 tx=0x7f0c48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.715+0000 7f0c55e7a740 1 Processor -- start 2024-09-16T01:23:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.715+0000 7f0c55e7a740 1 -- start start 2024-09-16T01:23:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c55e7a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 0x5562c3b94500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c55e7a740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3baeae0 0x5562c3bb0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c55e7a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b67a80 0x5562c3bb07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c55e7a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5562c3acc520 con 0x5562c3b94120 2024-09-16T01:23:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c55e7a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5562c3a743e0 con 0x5562c3b67a80 2024-09-16T01:23:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c55e7a740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5562c3ac84e0 con 0x5562c3baeae0 2024-09-16T01:23:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c50e79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 0x5562c3b94500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c50e79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 0x5562c3b94500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48976/0 (socket says 172.21.15.81:48976) 2024-09-16T01:23:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c50e79640 1 -- 172.21.15.81:0/1740884135 learned_addr learned my addr 172.21.15.81:0/1740884135 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c5167a640 1 --2- 172.21.15.81:0/1740884135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b67a80 0x5562c3bb07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c43fff640 1 --2- 172.21.15.81:0/1740884135 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3baeae0 0x5562c3bb0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c50e79640 1 -- 172.21.15.81:0/1740884135 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3baeae0 msgr2=0x5562c3bb0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c50e79640 1 --2- 172.21.15.81:0/1740884135 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3baeae0 0x5562c3bb0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c50e79640 1 -- 172.21.15.81:0/1740884135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b67a80 msgr2=0x5562c3bb07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c50e79640 1 --2- 172.21.15.81:0/1740884135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b67a80 0x5562c3bb07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c50e79640 1 -- 172.21.15.81:0/1740884135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562c3a8f2f0 con 0x5562c3b94120 2024-09-16T01:23:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c5167a640 1 --2- 172.21.15.81:0/1740884135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b67a80 0x5562c3bb07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c50e79640 1 --2- 172.21.15.81:0/1740884135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 0x5562c3b94500 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0c48011d20 tx=0x7f0c48014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff3626c67b82a0cc server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c32ffd640 1 -- 172.21.15.81:0/1740884135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48011d50 con 0x5562c3b94120 2024-09-16T01:23:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c32ffd640 1 -- 172.21.15.81:0/1740884135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c48026070 con 0x5562c3b94120 2024-09-16T01:23:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.716+0000 7f0c32ffd640 1 -- 172.21.15.81:0/1740884135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48021640 con 0x5562c3b94120 2024-09-16T01:23:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.717+0000 7f0c55e7a740 1 -- 172.21.15.81:0/1740884135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 msgr2=0x5562c3b94500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.717+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/1740884135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 0x5562c3b94500 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0c48011d20 tx=0x7f0c48014000 comp rx=0 tx=0).stop 2024-09-16T01:23:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.717+0000 7f0c55e7a740 1 -- 172.21.15.81:0/1740884135 shutdown_connections 2024-09-16T01:23:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.717+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/1740884135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b67a80 0x5562c3bb07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.717+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/1740884135 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3baeae0 0x5562c3bb0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.717+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/1740884135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 0x5562c3b94500 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.717+0000 7f0c55e7a740 1 -- 172.21.15.81:0/1740884135 >> 172.21.15.81:0/1740884135 conn(0x5562c3b66a80 msgr2=0x5562c3baef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.717+0000 7f0c55e7a740 1 -- 172.21.15.81:0/1740884135 shutdown_connections 2024-09-16T01:23:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.717+0000 7f0c55e7a740 1 -- 172.21.15.81:0/1740884135 wait complete. 2024-09-16T01:23:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.717+0000 7f0c55e7a740 1 -- start start 2024-09-16T01:23:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c55e7a740 1 Processor -- start 2024-09-16T01:23:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c55e7a740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3b94120 0x5562c3b90b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c55e7a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3baeae0 0x5562c3b95cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c55e7a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b96200 0x5562c3bc6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c55e7a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5562c3b94ee0 con 0x5562c3b96200 2024-09-16T01:23:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c55e7a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5562c3a55450 con 0x5562c3baeae0 2024-09-16T01:23:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c55e7a740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5562c3baf770 con 0x5562c3b94120 2024-09-16T01:23:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c55e7a740 10 client.0 _ll_register_callbacks cb 0x5562c37deac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c5167a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b96200 0x5562c3bc6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c5167a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b96200 0x5562c3bc6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48978/0 (socket says 172.21.15.81:48978) 2024-09-16T01:23:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c5167a640 1 -- 172.21.15.81:0/423622911 learned_addr learned my addr 172.21.15.81:0/423622911 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c43fff640 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3baeae0 0x5562c3b95cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.718+0000 7f0c50e79640 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3b94120 0x5562c3b90b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c5167a640 1 -- 172.21.15.81:0/423622911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3b94120 msgr2=0x5562c3b90b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c5167a640 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3b94120 0x5562c3b90b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c5167a640 1 -- 172.21.15.81:0/423622911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3baeae0 msgr2=0x5562c3b95cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c5167a640 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3baeae0 0x5562c3b95cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c5167a640 1 -- 172.21.15.81:0/423622911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562c37df2d0 con 0x5562c3b96200 2024-09-16T01:23:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c5167a640 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b96200 0x5562c3bc6c40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0c440012e0 tx=0x7f0c440593d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deaf05b3eeaaa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:23:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c2b7fe640 1 -- 172.21.15.81:0/423622911 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c44071370 con 0x5562c3b96200 2024-09-16T01:23:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c2b7fe640 1 -- 172.21.15.81:0/423622911 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f0c4408b070 con 0x5562c3b96200 2024-09-16T01:23:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c55e7a740 1 -- 172.21.15.81:0/423622911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c48026070 con 0x5562c3b96200 2024-09-16T01:23:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c2b7fe640 1 -- 172.21.15.81:0/423622911 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f0c4408b270 con 0x5562c3b96200 2024-09-16T01:23:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c55e7a740 10 client.8259 fetch_fsmap learned FSMap version 75 2024-09-16T01:23:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c55e7a740 1 -- 172.21.15.81:0/423622911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x5562c38a96b0 con 0x5562c3b96200 2024-09-16T01:23:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c2b7fe640 1 -- 172.21.15.81:0/423622911 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c48026070 con 0x5562c3b96200 2024-09-16T01:23:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c2b7fe640 1 -- 172.21.15.81:0/423622911 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f0c44061a60 con 0x5562c3b96200 2024-09-16T01:23:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c55e7a740 10 client.8259 fetch_fsmap finished waiting for FSMap version 75 2024-09-16T01:23:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c55e7a740 10 client.8259 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:23:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c55e7a740 20 client.8259 populate_metadata read hostname 'smithi081' 2024-09-16T01:23:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.81:6834/1395000865,v1:172.21.15.81:6836/1395000865] conn(0x5562c3bc3800 0x5562c3bc3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c55e7a740 4 client.8259 mds_command: new command op to 8103 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:23:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.719+0000 7f0c55e7a740 1 -- 172.21.15.81:0/423622911 --> [v2:172.21.15.81:6834/1395000865,v1:172.21.15.81:6836/1395000865] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562c3ad9c50 con 0x5562c3bc3800 2024-09-16T01:23:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.720+0000 7f0c50e79640 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.81:6834/1395000865,v1:172.21.15.81:6836/1395000865] conn(0x5562c3bc3800 0x5562c3bc3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.720+0000 7f0c2b7fe640 10 client.8259 ms_handle_connect on v2:172.21.15.81:6834/1395000865 2024-09-16T01:23:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.720+0000 7f0c50e79640 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.81:6834/1395000865,v1:172.21.15.81:6836/1395000865] conn(0x5562c3bc3800 0x5562c3bc3be0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3920396300aefd83 server_cookie=f115db0ddf6d457a in_seq=0 out_seq=0 2024-09-16T01:23:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.720+0000 7f0c2b7fe640 1 -- 172.21.15.81:0/423622911 <== mds.0 v2:172.21.15.81:6834/1395000865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5562c3ad9c50 con 0x5562c3bc3800 2024-09-16T01:23:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.720+0000 7f0c2b7fe640 10 client.8259 handle_command_reply: tid=0 2024-09-16T01:23:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.720+0000 7f0c55e7a740 1 client.8259 shutdown 2024-09-16T01:23:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.721+0000 7f0c55e7a740 1 -- 172.21.15.81:0/423622911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b96200 msgr2=0x5562c3bc6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.721+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b96200 0x5562c3bc6c40 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0c440012e0 tx=0x7f0c440593d0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.721+0000 7f0c55e7a740 1 -- 172.21.15.81:0/423622911 shutdown_connections 2024-09-16T01:23:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.721+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.81:6834/1395000865,v1:172.21.15.81:6836/1395000865] conn(0x5562c3bc3800 0x5562c3bc3be0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.721+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b96200 0x5562c3bc6c40 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.721+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3baeae0 0x5562c3b95cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.721+0000 7f0c2b7fe640 0 client.8259 ms_handle_reset on v2:172.21.15.81:6834/1395000865 2024-09-16T01:23:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.721+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/423622911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3b94120 0x5562c3b90b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.721+0000 7f0c55e7a740 1 -- 172.21.15.81:0/423622911 >> 172.21.15.81:0/423622911 conn(0x5562c3b67a80 msgr2=0x5562c3bb88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.721+0000 7f0c55e7a740 1 -- 172.21.15.81:0/423622911 shutdown_connections 2024-09-16T01:23:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.721+0000 7f0c55e7a740 1 -- 172.21.15.81:0/423622911 wait complete. 2024-09-16T01:23:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.721+0000 7f0c55e7a740 20 client.8259 trim_cache size 0 max 16384 2024-09-16T01:23:28.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.738+0000 7f0c55e7a740 1 Processor -- start 2024-09-16T01:23:28.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.738+0000 7f0c55e7a740 1 -- start start 2024-09-16T01:23:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c55e7a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 0x5562c3b97690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c55e7a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b96200 0x5562c3bb2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c55e7a740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3baeae0 0x5562c3bb2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c55e7a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c1fbb50 con 0x5562c3b94120 2024-09-16T01:23:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c55e7a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4c15d960 con 0x5562c3b96200 2024-09-16T01:23:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c55e7a740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0c4c1fb5b0 con 0x5562c3baeae0 2024-09-16T01:23:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c50e79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 0x5562c3b97690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c50e79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 0x5562c3b97690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48992/0 (socket says 172.21.15.81:48992) 2024-09-16T01:23:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c50e79640 1 -- 172.21.15.81:0/810302006 learned_addr learned my addr 172.21.15.81:0/810302006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c50e79640 1 -- 172.21.15.81:0/810302006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3baeae0 msgr2=0x5562c3bb2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c50e79640 1 --2- 172.21.15.81:0/810302006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3baeae0 0x5562c3bb2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c50e79640 1 -- 172.21.15.81:0/810302006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b96200 msgr2=0x5562c3bb2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c50e79640 1 --2- 172.21.15.81:0/810302006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b96200 0x5562c3bb2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.739+0000 7f0c50e79640 1 -- 172.21.15.81:0/810302006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562c3b94870 con 0x5562c3b94120 2024-09-16T01:23:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c50e79640 1 --2- 172.21.15.81:0/810302006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 0x5562c3b97690 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f0c48023040 tx=0x7f0c48018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253953e2987fd074 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c327fc640 1 -- 172.21.15.81:0/810302006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480383c0 con 0x5562c3b94120 2024-09-16T01:23:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c327fc640 1 -- 172.21.15.81:0/810302006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c4803f070 con 0x5562c3b94120 2024-09-16T01:23:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c327fc640 1 -- 172.21.15.81:0/810302006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48038780 con 0x5562c3b94120 2024-09-16T01:23:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c55e7a740 1 -- 172.21.15.81:0/810302006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 msgr2=0x5562c3b97690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/810302006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 0x5562c3b97690 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f0c48023040 tx=0x7f0c48018000 comp rx=0 tx=0).stop 2024-09-16T01:23:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c55e7a740 1 -- 172.21.15.81:0/810302006 shutdown_connections 2024-09-16T01:23:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/810302006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3baeae0 0x5562c3bb2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/810302006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b96200 0x5562c3bb2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/810302006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3b94120 0x5562c3b97690 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c55e7a740 1 -- 172.21.15.81:0/810302006 >> 172.21.15.81:0/810302006 conn(0x5562c3b67a80 msgr2=0x5562c3baf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c55e7a740 1 -- 172.21.15.81:0/810302006 shutdown_connections 2024-09-16T01:23:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.740+0000 7f0c55e7a740 1 -- 172.21.15.81:0/810302006 wait complete. 2024-09-16T01:23:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.741+0000 7f0c55e7a740 1 -- start start 2024-09-16T01:23:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.741+0000 7f0c55e7a740 1 Processor -- start 2024-09-16T01:23:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c55e7a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b94120 0x5562c3c30e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c55e7a740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3b96200 0x5562c3bc3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c55e7a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3baeae0 0x5562c3bc4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c55e7a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5562c3b67f20 con 0x5562c3baeae0 2024-09-16T01:23:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c55e7a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5562c3b68250 con 0x5562c3b94120 2024-09-16T01:23:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c55e7a740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5562c3b96680 con 0x5562c3b96200 2024-09-16T01:23:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c55e7a740 10 client.0 _ll_register_callbacks cb 0x7f0c4400af10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:23:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c5167a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3baeae0 0x5562c3bc4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c5167a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3baeae0 0x5562c3bc4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48998/0 (socket says 172.21.15.81:48998) 2024-09-16T01:23:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c5167a640 1 -- 172.21.15.81:0/3882008560 learned_addr learned my addr 172.21.15.81:0/3882008560 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c50e79640 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b94120 0x5562c3c30e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c43fff640 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3b96200 0x5562c3bc3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c5167a640 1 -- 172.21.15.81:0/3882008560 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3b96200 msgr2=0x5562c3bc3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c5167a640 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3b96200 0x5562c3bc3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c5167a640 1 -- 172.21.15.81:0/3882008560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b94120 msgr2=0x5562c3c30e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c5167a640 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b94120 0x5562c3c30e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c5167a640 1 -- 172.21.15.81:0/3882008560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562c3bd7a70 con 0x5562c3baeae0 2024-09-16T01:23:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c50e79640 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b94120 0x5562c3c30e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c43fff640 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3b96200 0x5562c3bc3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c5167a640 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3baeae0 0x5562c3bc4120 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400a560 tx=0x7f0c44001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460e09ffef2e3275 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:23:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c2b7fe640 1 -- 172.21.15.81:0/3882008560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c440555b0 con 0x5562c3baeae0 2024-09-16T01:23:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c2b7fe640 1 -- 172.21.15.81:0/3882008560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f0c44058760 con 0x5562c3baeae0 2024-09-16T01:23:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c55e7a740 1 -- 172.21.15.81:0/3882008560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c4803f070 con 0x5562c3baeae0 2024-09-16T01:23:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c2b7fe640 1 -- 172.21.15.81:0/3882008560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) ==== 24+0+0 (secure 0 0 0) 0x7f0c440783a0 con 0x5562c3baeae0 2024-09-16T01:23:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.742+0000 7f0c55e7a740 10 client.8265 fetch_fsmap learned FSMap version 75 2024-09-16T01:23:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c55e7a740 1 -- 172.21.15.81:0/3882008560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) -- 0x5562c3b6b840 con 0x5562c3baeae0 2024-09-16T01:23:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c2b7fe640 1 -- 172.21.15.81:0/3882008560 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c4803f070 con 0x5562c3baeae0 2024-09-16T01:23:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c2b7fe640 1 -- 172.21.15.81:0/3882008560 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 75) ==== 3502+0+0 (secure 0 0 0) 0x7f0c4405d170 con 0x5562c3baeae0 2024-09-16T01:23:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c55e7a740 10 client.8265 fetch_fsmap finished waiting for FSMap version 75 2024-09-16T01:23:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c55e7a740 10 client.8265 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:23:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c55e7a740 20 client.8265 populate_metadata read hostname 'smithi081' 2024-09-16T01:23:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.81:6834/1395000865,v1:172.21.15.81:6836/1395000865] conn(0x5562c3bc27d0 0x5562c3b90260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c55e7a740 4 client.8265 mds_command: new command op to 8103 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:23:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c55e7a740 1 -- 172.21.15.81:0/3882008560 --> [v2:172.21.15.81:6834/1395000865,v1:172.21.15.81:6836/1395000865] -- command(tid 0: {"prefix": "status"}) -- 0x5562c3ad3fa0 con 0x5562c3bc27d0 2024-09-16T01:23:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c50e79640 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.81:6834/1395000865,v1:172.21.15.81:6836/1395000865] conn(0x5562c3bc27d0 0x5562c3b90260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c50e79640 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.81:6834/1395000865,v1:172.21.15.81:6836/1395000865] conn(0x5562c3bc27d0 0x5562c3b90260 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5b5def717ad9ffa server_cookie=abd2a49f7523f20b in_seq=0 out_seq=0 2024-09-16T01:23:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c2b7fe640 10 client.8265 ms_handle_connect on v2:172.21.15.81:6834/1395000865 2024-09-16T01:23:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c2b7fe640 1 -- 172.21.15.81:0/3882008560 <== mds.0 v2:172.21.15.81:6834/1395000865 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5562c3ad3fa0 con 0x5562c3bc27d0 2024-09-16T01:23:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c2b7fe640 10 client.8265 handle_command_reply: tid=0 2024-09-16T01:23:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c55e7a740 1 client.8265 shutdown 2024-09-16T01:23:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c55e7a740 1 -- 172.21.15.81:0/3882008560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3baeae0 msgr2=0x5562c3bc4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3baeae0 0x5562c3bc4120 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400a560 tx=0x7f0c44001250 comp rx=0 tx=0).stop 2024-09-16T01:23:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.743+0000 7f0c55e7a740 1 -- 172.21.15.81:0/3882008560 shutdown_connections 2024-09-16T01:23:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.81:6834/1395000865,v1:172.21.15.81:6836/1395000865] conn(0x5562c3bc27d0 0x5562c3b90260 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562c3baeae0 0x5562c3bc4120 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5562c3b96200 0x5562c3bc3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c2b7fe640 0 client.8265 ms_handle_reset on v2:172.21.15.81:6834/1395000865 2024-09-16T01:23:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c55e7a740 1 --2- 172.21.15.81:0/3882008560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562c3b94120 0x5562c3c30e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c55e7a740 1 -- 172.21.15.81:0/3882008560 >> 172.21.15.81:0/3882008560 conn(0x5562c3b67a80 msgr2=0x5562c3bacee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c55e7a740 1 -- 172.21.15.81:0/3882008560 shutdown_connections 2024-09-16T01:23:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c55e7a740 1 -- 172.21.15.81:0/3882008560 wait complete. 2024-09-16T01:23:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c55e7a740 20 client.8265 trim_cache size 0 max 16384 2024-09-16T01:23:28.755 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:23:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973", 2024-09-16T01:23:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-16T01:23:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8103, 2024-09-16T01:23:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-16T01:23:28.755 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-16T01:23:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-16T01:23:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 9.1558877929999998, 2024-09-16T01:23:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 75, 2024-09-16T01:23:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 137, 2024-09-16T01:23:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 137, 2024-09-16T01:23:28.756 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.494555356999999 2024-09-16T01:23:28.756 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:23:28.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c530dd640 1 -- 172.21.15.81:0/4251426823 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c3806c2b0 msgr2=0x7f0c3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c530dd640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c3806c2b0 0x7f0c3806e770 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009a30 tx=0x7f0c48008040 comp rx=0 tx=0).stop 2024-09-16T01:23:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c530dd640 1 -- 172.21.15.81:0/4251426823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c4c15b300 msgr2=0x7f0c4c156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c530dd640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c4c15b300 0x7f0c4c156d80 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0c4400cb40 tx=0x7f0c4400a060 comp rx=0 tx=0).stop 2024-09-16T01:23:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c530dd640 1 -- 172.21.15.81:0/4251426823 shutdown_connections 2024-09-16T01:23:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c530dd640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c3806c2b0 0x7f0c3806e770 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c530dd640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c4c15b300 0x7f0c4c156d80 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c530dd640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c4c0cd3f0 0x7f0c4c142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c530dd640 1 --2- 172.21.15.81:0/4251426823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c4c072d30 0x7f0c4c156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c530dd640 1 -- 172.21.15.81:0/4251426823 >> 172.21.15.81:0/4251426823 conn(0x7f0c4c067d70 msgr2=0x7f0c4c158c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c530dd640 1 -- 172.21.15.81:0/4251426823 shutdown_connections 2024-09-16T01:23:28.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.744+0000 7f0c530dd640 1 -- 172.21.15.81:0/4251426823 wait complete. 2024-09-16T01:23:28.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:23:28.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.856+0000 7f4b1452c640 1 Processor -- start 2024-09-16T01:23:28.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.856+0000 7f4b1452c640 1 -- start start 2024-09-16T01:23:28.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.857+0000 7f4b1452c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b0c15fc30 0x7f4b0c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.857+0000 7f4b1452c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b0c09ba30 con 0x7f4b0c09b140 2024-09-16T01:23:28.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.857+0000 7f4b1452c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b0c09bcf0 con 0x7f4b0c0b17d0 2024-09-16T01:23:28.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.857+0000 7f4b1452c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4b0c0b1590 con 0x7f4b0c15fc30 2024-09-16T01:23:28.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.857+0000 7f4b122c8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b0c15fc30 0x7f4b0c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.858+0000 7f4b122c8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b0c15fc30 0x7f4b0c071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49014/0 (socket says 172.21.15.81:49014) 2024-09-16T01:23:28.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.858+0000 7f4b122c8640 1 -- 172.21.15.81:0/631086035 learned_addr learned my addr 172.21.15.81:0/631086035 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:28.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.858+0000 7f4b12ac9640 1 --1- 172.21.15.81:0/631086035 >> v1:172.21.15.81:6789/0 conn(0x7f4b0c09b140 0x7f4b0c0704f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36598/0 (socket says 172.21.15.81:36598) 2024-09-16T01:23:28.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.858+0000 7f4b122c8640 1 -- 172.21.15.81:0/631086035 >> v1:172.21.15.102:6789/0 conn(0x7f4b0c0b17d0 legacy=0x7f4b0c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.858+0000 7f4b122c8640 1 -- 172.21.15.81:0/631086035 >> v1:172.21.15.81:6789/0 conn(0x7f4b0c09b140 legacy=0x7f4b0c0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.858+0000 7f4b122c8640 1 -- 172.21.15.81:0/631086035 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0c160d00 con 0x7f4b0c15fc30 2024-09-16T01:23:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.858+0000 7f4b122c8640 1 --2- 172.21.15.81:0/631086035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b0c15fc30 0x7f4b0c071e40 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009870 tx=0x7f4afc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64b6efa8b9bb036 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.859+0000 7f4b112c6640 1 -- 172.21.15.81:0/631086035 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc037070 con 0x7f4b0c15fc30 2024-09-16T01:23:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.859+0000 7f4b112c6640 1 -- 172.21.15.81:0/631086035 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4afc032440 con 0x7f4b0c15fc30 2024-09-16T01:23:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.859+0000 7f4b112c6640 1 -- 172.21.15.81:0/631086035 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc032810 con 0x7f4b0c15fc30 2024-09-16T01:23:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.859+0000 7f4b1452c640 1 -- 172.21.15.81:0/631086035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b0c15fc30 msgr2=0x7f4b0c071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.859+0000 7f4b1452c640 1 --2- 172.21.15.81:0/631086035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b0c15fc30 0x7f4b0c071e40 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009870 tx=0x7f4afc02a270 comp rx=0 tx=0).stop 2024-09-16T01:23:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.859+0000 7f4b1452c640 1 -- 172.21.15.81:0/631086035 shutdown_connections 2024-09-16T01:23:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.859+0000 7f4b1452c640 1 --2- 172.21.15.81:0/631086035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b0c15fc30 0x7f4b0c071e40 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.859+0000 7f4b1452c640 1 -- 172.21.15.81:0/631086035 >> 172.21.15.81:0/631086035 conn(0x7f4b0c0d23a0 msgr2=0x7f4b0c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.859+0000 7f4b1452c640 1 -- 172.21.15.81:0/631086035 shutdown_connections 2024-09-16T01:23:28.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.859+0000 7f4b1452c640 1 -- 172.21.15.81:0/631086035 wait complete. 2024-09-16T01:23:28.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b1452c640 1 Processor -- start 2024-09-16T01:23:28.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b1452c640 1 -- start start 2024-09-16T01:23:28.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b1452c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b0c09b140 0x7f4b0c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b1452c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b0c0b17d0 0x7f4b0c0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b1452c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b0c15fc30 0x7f4b0c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b1452c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c071010 con 0x7f4b0c0b17d0 2024-09-16T01:23:28.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b1452c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c070e90 con 0x7f4b0c09b140 2024-09-16T01:23:28.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b1452c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4b0c071190 con 0x7f4b0c15fc30 2024-09-16T01:23:28.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b11ac7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b0c0b17d0 0x7f4b0c0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b11ac7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b0c0b17d0 0x7f4b0c0c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49016/0 (socket says 172.21.15.81:49016) 2024-09-16T01:23:28.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b11ac7640 1 -- 172.21.15.81:0/2262064141 learned_addr learned my addr 172.21.15.81:0/2262064141 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:28.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b122c8640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b0c09b140 0x7f4b0c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.861+0000 7f4b12ac9640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b0c15fc30 0x7f4b0c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.862+0000 7f4b11ac7640 1 -- 172.21.15.81:0/2262064141 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b0c15fc30 msgr2=0x7f4b0c0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.862+0000 7f4b11ac7640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b0c15fc30 0x7f4b0c0b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.862+0000 7f4b11ac7640 1 -- 172.21.15.81:0/2262064141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b0c09b140 msgr2=0x7f4b0c153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.862+0000 7f4b11ac7640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b0c09b140 0x7f4b0c153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.862+0000 7f4b11ac7640 1 -- 172.21.15.81:0/2262064141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0c0c6dc0 con 0x7f4b0c0b17d0 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.862+0000 7f4b11ac7640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b0c0b17d0 0x7f4b0c0c8a20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000c480 tx=0x7f4b0000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.862+0000 7f4b0affd640 1 -- 172.21.15.81:0/2262064141 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b000052d0 con 0x7f4b0c0b17d0 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.862+0000 7f4b0affd640 1 -- 172.21.15.81:0/2262064141 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b00005470 con 0x7f4b0c0b17d0 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.862+0000 7f4b1452c640 1 -- 172.21.15.81:0/2262064141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0c0c70a0 con 0x7f4b0c0b17d0 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.862+0000 7f4b0affd640 1 -- 172.21.15.81:0/2262064141 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b00012870 con 0x7f4b0c0b17d0 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.862+0000 7f4b1452c640 1 -- 172.21.15.81:0/2262064141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b0c153dc0 con 0x7f4b0c0b17d0 2024-09-16T01:23:28.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.863+0000 7f4b1452c640 1 -- 172.21.15.81:0/2262064141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b0c0c75c0 con 0x7f4b0c0b17d0 2024-09-16T01:23:28.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.863+0000 7f4b0affd640 1 -- 172.21.15.81:0/2262064141 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4b00012a10 con 0x7f4b0c0b17d0 2024-09-16T01:23:28.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.864+0000 7f4b0affd640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4af806c2b0 0x7f4af806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:28.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.864+0000 7f4b0affd640 1 -- 172.21.15.81:0/2262064141 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f4b0008b040 con 0x7f4b0c0b17d0 2024-09-16T01:23:28.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.864+0000 7f4b122c8640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4af806c2b0 0x7f4af806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:28.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.864+0000 7f4b122c8640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4af806c2b0 0x7f4af806e770 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4afc034000 tx=0x7f4afc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:28.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:28.868+0000 7f4b0affd640 1 -- 172.21.15.81:0/2262064141 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b0c0c75c0 con 0x7f4b0c0b17d0 2024-09-16T01:23:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.072+0000 7f4b1452c640 1 -- 172.21.15.81:0/2262064141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4b0c071580 con 0x7f4b0c0b17d0 2024-09-16T01:23:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.072+0000 7f4b0affd640 1 -- 172.21.15.81:0/2262064141 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) ==== 53+0+73 (secure 0 0 0) 0x7f4b00059060 con 0x7f4b0c0b17d0 2024-09-16T01:23:29.073 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:23:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.074+0000 7f4b1452c640 1 -- 172.21.15.81:0/2262064141 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4af806c2b0 msgr2=0x7f4af806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.074+0000 7f4b1452c640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4af806c2b0 0x7f4af806e770 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4afc034000 tx=0x7f4afc02e000 comp rx=0 tx=0).stop 2024-09-16T01:23:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.074+0000 7f4b1452c640 1 -- 172.21.15.81:0/2262064141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b0c0b17d0 msgr2=0x7f4b0c0c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.074+0000 7f4b1452c640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b0c0b17d0 0x7f4b0c0c8a20 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000c480 tx=0x7f4b0000c940 comp rx=0 tx=0).stop 2024-09-16T01:23:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.074+0000 7f4b1452c640 1 -- 172.21.15.81:0/2262064141 shutdown_connections 2024-09-16T01:23:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.074+0000 7f4b1452c640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4af806c2b0 0x7f4af806e770 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.074+0000 7f4b1452c640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b0c15fc30 0x7f4b0c0b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.074+0000 7f4b1452c640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b0c0b17d0 0x7f4b0c0c8a20 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.074+0000 7f4b1452c640 1 --2- 172.21.15.81:0/2262064141 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b0c09b140 0x7f4b0c153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.074+0000 7f4b1452c640 1 -- 172.21.15.81:0/2262064141 >> 172.21.15.81:0/2262064141 conn(0x7f4b0c0d23a0 msgr2=0x7f4b0c0cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.074+0000 7f4b1452c640 1 -- 172.21.15.81:0/2262064141 shutdown_connections 2024-09-16T01:23:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.074+0000 7f4b1452c640 1 -- 172.21.15.81:0/2262064141 wait complete. 2024-09-16T01:23:29.086 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:23:29.086 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:23:29.086 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:23:29.086 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:23:29.086 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:29.086 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:23:29.086 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:23:29.086 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:23:29.086 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:23:29.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:29.087 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:23:29.103 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:23:29.103 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:23:29.103 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:23:29.103 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:29.103 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:23:29.103 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:29.103 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:23:29.103 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:29.103 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:23:29.104 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:23:29.104 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:29.104 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:23:29.104 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:23:29.104 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:29.104 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:23:29.104 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:29.104 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:23:29.104 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42329sec preferred_lft 42329sec 2024-09-16T01:23:29.104 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:23:29.104 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:29.105 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:23:29.105 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:29.105 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:23:29.105 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:29.105 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::bc22:19ff:fe0c:8fb1/64 scope link 2024-09-16T01:23:29.105 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:29.105 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:23:29.105 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 86:bb:d8:38:80:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:23:29.105 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::84bb:d8ff:fe38:80af/64 scope link 2024-09-16T01:23:29.105 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:29.105 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:23:29.106 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:23:29.106 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::828:dff:febd:ee39/64 scope link 2024-09-16T01:23:29.106 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:29.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:29.106 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:23:29.166 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:23:29.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:29.168 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:23:29.225 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:23:29.225 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:23:29.225 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:23:29.225 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:23:29.225 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:23:29.225 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:23:29.226 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:23:29.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:23:29.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:23:29.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:23:29.226 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:23:29.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:23:29.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:29.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:29.351 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:23:29.365 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:23:29.365 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:23:29.368 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:23:29.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:29.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-16T01:23:29.430 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:23:29.430 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:29.486 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:23:29.486 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:23:29.486 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:29.541 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:23:29.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:29.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:23:29.624 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:23:29.625 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:23:29.625 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:23:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:23:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:23:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:23:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:23:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:23:29.639 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:23:29.639 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:23:29.639 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:23:29.639 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:23:29.639 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:23:29.639 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:23:29.639 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:23:29.639 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:23:29.640 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:23:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:23:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:23:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:23:29.640 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:23:29.641 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:23:29.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:29.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:29.708 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:23:29.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:23:29.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:29.809 INFO:teuthology.orchestra.run.smithi081.stdout:client7183 2024-09-16T01:23:29.809 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:29.809 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:29.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:23:29.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.963+0000 7f0901d6f640 1 Processor -- start 2024-09-16T01:23:29.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.963+0000 7f0901d6f640 1 -- start start 2024-09-16T01:23:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f0901d6f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08fc15b300 0x7f08fc0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f0901d6f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08fc06f8d0 0x7f08fc15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f0901d6f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08fc0cdbe0 con 0x7f08fc0cd3f0 2024-09-16T01:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f0901d6f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f08fc0728a0 con 0x7f08fc06f8d0 2024-09-16T01:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f0901d6f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f08fc0cd900 con 0x7f08fc15b300 2024-09-16T01:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f08fbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08fc06f8d0 0x7f08fc15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f08faffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f08fc0cd3f0 0x7f08fc06f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:36602/0 (socket says 172.21.15.81:36602) 2024-09-16T01:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f08fbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08fc06f8d0 0x7f08fc15b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49026/0 (socket says 172.21.15.81:49026) 2024-09-16T01:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f08faffd640 1 -- 172.21.15.81:0/749874314 learned_addr learned my addr 172.21.15.81:0/749874314 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f08fbfff640 1 -- 172.21.15.81:0/749874314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08fc15b300 msgr2=0x7f08fc0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f08fbfff640 1 --2- 172.21.15.81:0/749874314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08fc15b300 0x7f08fc0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f08fbfff640 1 -- 172.21.15.81:0/749874314 >> v1:172.21.15.81:6789/0 conn(0x7f08fc0cd3f0 legacy=0x7f08fc06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f08fbfff640 1 -- 172.21.15.81:0/749874314 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08fc072250 con 0x7f08fc06f8d0 2024-09-16T01:23:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.964+0000 7f08fa7fc640 1 -- 172.21.15.81:0/749874314 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790060390 0 0) 0x7f08fc0cdbe0 con 0x7f08fc0cd3f0 2024-09-16T01:23:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.965+0000 7f08fbfff640 1 --2- 172.21.15.81:0/749874314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08fc06f8d0 0x7f08fc15b6e0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009d90 tx=0x7f08f402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12690f5b153a55d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.965+0000 7f08fa7fc640 1 -- 172.21.15.81:0/749874314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4007740 con 0x7f08fc06f8d0 2024-09-16T01:23:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.965+0000 7f08fa7fc640 1 -- 172.21.15.81:0/749874314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f40078e0 con 0x7f08fc06f8d0 2024-09-16T01:23:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.965+0000 7f08fa7fc640 1 -- 172.21.15.81:0/749874314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4007cb0 con 0x7f08fc06f8d0 2024-09-16T01:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.965+0000 7f0901d6f640 1 -- 172.21.15.81:0/749874314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08fc06f8d0 msgr2=0x7f08fc15b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.966+0000 7f0901d6f640 1 --2- 172.21.15.81:0/749874314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08fc06f8d0 0x7f08fc15b6e0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009d90 tx=0x7f08f402a660 comp rx=0 tx=0).stop 2024-09-16T01:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.966+0000 7f0901d6f640 1 -- 172.21.15.81:0/749874314 shutdown_connections 2024-09-16T01:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.966+0000 7f0901d6f640 1 --2- 172.21.15.81:0/749874314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08fc06f8d0 0x7f08fc15b6e0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.966+0000 7f0901d6f640 1 --2- 172.21.15.81:0/749874314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08fc15b300 0x7f08fc0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.966+0000 7f0901d6f640 1 -- 172.21.15.81:0/749874314 >> 172.21.15.81:0/749874314 conn(0x7f08fc067d70 msgr2=0x7f08fc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.966+0000 7f0901d6f640 1 -- 172.21.15.81:0/749874314 shutdown_connections 2024-09-16T01:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.966+0000 7f0901d6f640 1 -- 172.21.15.81:0/749874314 wait complete. 2024-09-16T01:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.967+0000 7f0901d6f640 1 Processor -- start 2024-09-16T01:23:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.967+0000 7f0901d6f640 1 -- start start 2024-09-16T01:23:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f0901d6f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08fc06f8d0 0x7f08fc1f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f0901d6f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08fc0cd3f0 0x7f08fc1e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f0901d6f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08fc15b300 0x7f08fc1e6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f0901d6f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc0d0160 con 0x7f08fc06f8d0 2024-09-16T01:23:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f0901d6f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc0cffe0 con 0x7f08fc15b300 2024-09-16T01:23:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f0901d6f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f08fc072d30 con 0x7f08fc0cd3f0 2024-09-16T01:23:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08fc06f8d0 0x7f08fc1f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08fc06f8d0 0x7f08fc1f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49032/0 (socket says 172.21.15.81:49032) 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08fb7fe640 1 -- 172.21.15.81:0/4180624255 learned_addr learned my addr 172.21.15.81:0/4180624255 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08fb7fe640 1 -- 172.21.15.81:0/4180624255 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08fc0cd3f0 msgr2=0x7f08fc1e36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08fbfff640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08fc15b300 0x7f08fc1e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08faffd640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08fc0cd3f0 0x7f08fc1e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08fb7fe640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08fc0cd3f0 0x7f08fc1e36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08fb7fe640 1 -- 172.21.15.81:0/4180624255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08fc15b300 msgr2=0x7f08fc1e6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08fb7fe640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08fc15b300 0x7f08fc1e6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08fb7fe640 1 -- 172.21.15.81:0/4180624255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08fc1e3c30 con 0x7f08fc06f8d0 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08faffd640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08fc0cd3f0 0x7f08fc1e36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08fbfff640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08fc15b300 0x7f08fc1e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08fb7fe640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08fc06f8d0 0x7f08fc1f1e50 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00b410 tx=0x7f08ec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08e3fff640 1 -- 172.21.15.81:0/4180624255 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec015020 con 0x7f08fc06f8d0 2024-09-16T01:23:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08e3fff640 1 -- 172.21.15.81:0/4180624255 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08ec011850 con 0x7f08fc06f8d0 2024-09-16T01:23:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f08e3fff640 1 -- 172.21.15.81:0/4180624255 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec011c40 con 0x7f08fc06f8d0 2024-09-16T01:23:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.968+0000 7f0901d6f640 1 -- 172.21.15.81:0/4180624255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08fc1e3f00 con 0x7f08fc06f8d0 2024-09-16T01:23:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.969+0000 7f0901d6f640 1 -- 172.21.15.81:0/4180624255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08fc1e44c0 con 0x7f08fc06f8d0 2024-09-16T01:23:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.970+0000 7f0901d6f640 1 -- 172.21.15.81:0/4180624255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08fc0cc670 con 0x7f08fc06f8d0 2024-09-16T01:23:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.970+0000 7f08e3fff640 1 -- 172.21.15.81:0/4180624255 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f08ec018020 con 0x7f08fc06f8d0 2024-09-16T01:23:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.970+0000 7f08e3fff640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08e806c2b0 0x7f08e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.971+0000 7f08e3fff640 1 -- 172.21.15.81:0/4180624255 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f08ec08b450 con 0x7f08fc06f8d0 2024-09-16T01:23:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.971+0000 7f08faffd640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08e806c2b0 0x7f08e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.971+0000 7f08faffd640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08e806c2b0 0x7f08e806e770 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f08fc151e00 tx=0x7f08f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:29.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:29.975+0000 7f08e3fff640 1 -- 172.21.15.81:0/4180624255 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f08ec01f020 con 0x7f08fc06f8d0 2024-09-16T01:23:30.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.180+0000 7f0901d6f640 1 -- 172.21.15.81:0/4180624255 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f08fc1e65d0 con 0x7f08fc06f8d0 2024-09-16T01:23:30.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.180+0000 7f08e3fff640 1 -- 172.21.15.81:0/4180624255 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) ==== 53+0+73 (secure 0 0 0) 0x7f08ec0172c0 con 0x7f08fc06f8d0 2024-09-16T01:23:30.181 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:23:30.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.182+0000 7f0901d6f640 1 -- 172.21.15.81:0/4180624255 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08e806c2b0 msgr2=0x7f08e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:30.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.182+0000 7f0901d6f640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08e806c2b0 0x7f08e806e770 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f08fc151e00 tx=0x7f08f0009040 comp rx=0 tx=0).stop 2024-09-16T01:23:30.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.182+0000 7f0901d6f640 1 -- 172.21.15.81:0/4180624255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08fc06f8d0 msgr2=0x7f08fc1f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:30.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.182+0000 7f0901d6f640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08fc06f8d0 0x7f08fc1f1e50 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00b410 tx=0x7f08ec00b8d0 comp rx=0 tx=0).stop 2024-09-16T01:23:30.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.182+0000 7f0901d6f640 1 -- 172.21.15.81:0/4180624255 shutdown_connections 2024-09-16T01:23:30.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.182+0000 7f0901d6f640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08e806c2b0 0x7f08e806e770 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.182+0000 7f0901d6f640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08fc15b300 0x7f08fc1e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.182+0000 7f0901d6f640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08fc0cd3f0 0x7f08fc1e36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.182+0000 7f0901d6f640 1 --2- 172.21.15.81:0/4180624255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08fc06f8d0 0x7f08fc1f1e50 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.182+0000 7f0901d6f640 1 -- 172.21.15.81:0/4180624255 >> 172.21.15.81:0/4180624255 conn(0x7f08fc067d70 msgr2=0x7f08fc06f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.182+0000 7f0901d6f640 1 -- 172.21.15.81:0/4180624255 shutdown_connections 2024-09-16T01:23:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:30.182+0000 7f0901d6f640 1 -- 172.21.15.81:0/4180624255 wait complete. 2024-09-16T01:23:30.194 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:23:30.194 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:23:30.194 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-16T01:23:30.195 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T01:23:30.195 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:23:30.195 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:23:30.195 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:23:30.195 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:23:30.195 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:23:30.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:30.195 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-16T01:23:30.214 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:23:30.214 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:23:30.214 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:23:30.214 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:30.214 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:23:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:30.215 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:23:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-16T01:23:30.215 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:23:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-16T01:23:30.215 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:23:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:30.215 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:23:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:30.215 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42330sec preferred_lft 42330sec 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::fc48:18ff:fedc:b80f/64 scope link 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 2e:4a:65:c9:20:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::2c4a:65ff:fec9:204f/64 scope link 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:30.216 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:23:30.217 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:23:30.217 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::1072:70ff:fefd:f9f1/64 scope link 2024-09-16T01:23:30.217 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:23:30.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:30.217 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:23:30.281 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:23:30.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:30.283 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-16T01:23:30.341 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-16T01:23:30.341 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:23:30.341 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:23:30.341 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:23:30.341 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:23:30.341 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:23:30.341 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:23:30.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:23:30.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:23:30.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:23:30.342 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:23:30.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:23:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:23:30.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:23:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:30.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:30.471 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:23:30.487 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T01:23:30.487 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:23:30.487 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:23:30.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:30.487 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-16T01:23:30.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:23:30.552 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T01:23:30.607 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:23:30.607 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:23:30.607 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:23:30.662 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:23:30.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:30.662 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:23:30.745 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:23:30.745 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:23:30.745 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:23:30.753 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:23:30.753 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:23:30.753 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:23:30.754 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:23:30.754 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:23:30.758 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:23:30.758 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:23:30.758 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:23:30.758 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:23:30.758 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:23:30.758 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:23:30.758 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:23:30.758 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:23:30.759 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T01:23:30.759 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:23:30.759 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:23:30.759 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:23:30.759 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:23:30.760 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:23:30.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:30.761 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:23:30.826 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:23:30.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:23:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:23:30.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:23:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:30.924 INFO:teuthology.orchestra.run.smithi102.stdout:client7186 2024-09-16T01:23:30.924 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:23:30.924 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:30.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-09-16T01:23:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.047+0000 7fc20a7f1640 1 Processor -- start 2024-09-16T01:23:31.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.048+0000 7fc20a7f1640 1 -- start start 2024-09-16T01:23:31.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.048+0000 7fc20a7f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2040b2880 0x7fc2040b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.048+0000 7fc20a7f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2040afa60 con 0x7fc204145f20 2024-09-16T01:23:31.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.048+0000 7fc20a7f1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2040d1a40 con 0x7fc2040b2420 2024-09-16T01:23:31.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.048+0000 7fc20a7f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc2040d1d20 con 0x7fc2040b2880 2024-09-16T01:23:31.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.049+0000 7fc208d8e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2040b2880 0x7fc2040b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.049+0000 7fc208d8e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2040b2880 0x7fc2040b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55020/0 (socket says 172.21.15.81:55020) 2024-09-16T01:23:31.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.049+0000 7fc208d8e640 1 -- 172.21.15.81:0/1839952218 learned_addr learned my addr 172.21.15.81:0/1839952218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:31.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.049+0000 7fc203fff640 1 --1- 172.21.15.81:0/1839952218 >> v1:172.21.15.81:6789/0 conn(0x7fc204145f20 0x7fc2040d0f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35368/0 (socket says 172.21.15.81:35368) 2024-09-16T01:23:31.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.049+0000 7fc208d8e640 1 -- 172.21.15.81:0/1839952218 >> v1:172.21.15.102:6789/0 conn(0x7fc2040b2420 legacy=0x7fc2040b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:31.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.049+0000 7fc208d8e640 1 -- 172.21.15.81:0/1839952218 >> v1:172.21.15.81:6789/0 conn(0x7fc204145f20 legacy=0x7fc2040d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.049+0000 7fc202ffd640 1 -- 172.21.15.81:0/1839952218 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692810194 0 0) 0x7fc2040afa60 con 0x7fc204145f20 2024-09-16T01:23:31.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.049+0000 7fc208d8e640 1 -- 172.21.15.81:0/1839952218 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2040afcd0 con 0x7fc2040b2880 2024-09-16T01:23:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.050+0000 7fc208d8e640 1 --2- 172.21.15.81:0/1839952218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2040b2880 0x7fc2040b0900 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc009e50 tx=0x7fc1fc02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259cd80221e2b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.050+0000 7fc202ffd640 1 -- 172.21.15.81:0/1839952218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc036070 con 0x7fc2040b2880 2024-09-16T01:23:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.050+0000 7fc202ffd640 1 -- 172.21.15.81:0/1839952218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc031600 con 0x7fc2040b2880 2024-09-16T01:23:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.050+0000 7fc202ffd640 1 -- 172.21.15.81:0/1839952218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0319d0 con 0x7fc2040b2880 2024-09-16T01:23:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.050+0000 7fc20a7f1640 1 -- 172.21.15.81:0/1839952218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2040b2880 msgr2=0x7fc2040b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.050+0000 7fc20a7f1640 1 --2- 172.21.15.81:0/1839952218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2040b2880 0x7fc2040b0900 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc009e50 tx=0x7fc1fc02a6d0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.050+0000 7fc20a7f1640 1 -- 172.21.15.81:0/1839952218 shutdown_connections 2024-09-16T01:23:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.050+0000 7fc20a7f1640 1 --2- 172.21.15.81:0/1839952218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2040b2880 0x7fc2040b0900 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.050+0000 7fc20a7f1640 1 -- 172.21.15.81:0/1839952218 >> 172.21.15.81:0/1839952218 conn(0x7fc20409aa30 msgr2=0x7fc2040b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.050+0000 7fc20a7f1640 1 -- 172.21.15.81:0/1839952218 shutdown_connections 2024-09-16T01:23:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.050+0000 7fc20a7f1640 1 -- 172.21.15.81:0/1839952218 wait complete. 2024-09-16T01:23:31.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.052+0000 7fc20a7f1640 1 Processor -- start 2024-09-16T01:23:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.052+0000 7fc20a7f1640 1 -- start start 2024-09-16T01:23:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.052+0000 7fc20a7f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2040b2420 0x7fc2041f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.052+0000 7fc20a7f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2040b2880 0x7fc2041ee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.052+0000 7fc20a7f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204145f20 0x7fc2040cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.052+0000 7fc20a7f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc20406bde0 con 0x7fc204145f20 2024-09-16T01:23:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.052+0000 7fc20a7f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc2040d2000 con 0x7fc2040b2420 2024-09-16T01:23:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.052+0000 7fc20a7f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc20406bf60 con 0x7fc2040b2880 2024-09-16T01:23:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc208d8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204145f20 0x7fc2040cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc208d8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204145f20 0x7fc2040cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55030/0 (socket says 172.21.15.81:55030) 2024-09-16T01:23:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc208d8e640 1 -- 172.21.15.81:0/2086761590 learned_addr learned my addr 172.21.15.81:0/2086761590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc203fff640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2040b2420 0x7fc2041f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc2037fe640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2040b2880 0x7fc2041ee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc208d8e640 1 -- 172.21.15.81:0/2086761590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2040b2880 msgr2=0x7fc2041ee0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc208d8e640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2040b2880 0x7fc2041ee0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc208d8e640 1 -- 172.21.15.81:0/2086761590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2040b2420 msgr2=0x7fc2041f4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc208d8e640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2040b2420 0x7fc2041f4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc208d8e640 1 -- 172.21.15.81:0/2086761590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2040b5e40 con 0x7fc204145f20 2024-09-16T01:23:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc2037fe640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2040b2880 0x7fc2041ee0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc208d8e640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204145f20 0x7fc2040cba00 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc009e50 tx=0x7fc1fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc200ff9640 1 -- 172.21.15.81:0/2086761590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc041020 con 0x7fc204145f20 2024-09-16T01:23:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc200ff9640 1 -- 172.21.15.81:0/2086761590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc0077a0 con 0x7fc204145f20 2024-09-16T01:23:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc20a7f1640 1 -- 172.21.15.81:0/2086761590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2040b48b0 con 0x7fc204145f20 2024-09-16T01:23:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc200ff9640 1 -- 172.21.15.81:0/2086761590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc036040 con 0x7fc204145f20 2024-09-16T01:23:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.053+0000 7fc20a7f1640 1 -- 172.21.15.81:0/2086761590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2040b4e70 con 0x7fc204145f20 2024-09-16T01:23:31.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.054+0000 7fc20a7f1640 1 -- 172.21.15.81:0/2086761590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2040d0f40 con 0x7fc204145f20 2024-09-16T01:23:31.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.055+0000 7fc200ff9640 1 -- 172.21.15.81:0/2086761590 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc1fc044020 con 0x7fc204145f20 2024-09-16T01:23:31.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.055+0000 7fc200ff9640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc1f006c2b0 0x7fc1f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.055+0000 7fc200ff9640 1 -- 172.21.15.81:0/2086761590 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fc1fc0ac340 con 0x7fc204145f20 2024-09-16T01:23:31.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.055+0000 7fc203fff640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc1f006c2b0 0x7fc1f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.056+0000 7fc203fff640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc1f006c2b0 0x7fc1f006e770 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4007fd0 tx=0x7fc1f4007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:31.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.060+0000 7fc200ff9640 1 -- 172.21.15.81:0/2086761590 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1fc04b030 con 0x7fc204145f20 2024-09-16T01:23:31.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.227+0000 7fc20a7f1640 1 -- 172.21.15.81:0/2086761590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7fc2041ee5f0 con 0x7fc204145f20 2024-09-16T01:23:31.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.230+0000 7fc200ff9640 1 -- 172.21.15.81:0/2086761590 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v57)=0 v57) ==== 121+0+0 (secure 0 0 0) 0x7fc1fc07aa70 con 0x7fc204145f20 2024-09-16T01:23:31.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.232+0000 7fc20a7f1640 1 -- 172.21.15.81:0/2086761590 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc1f006c2b0 msgr2=0x7fc1f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.232+0000 7fc20a7f1640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc1f006c2b0 0x7fc1f006e770 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4007fd0 tx=0x7fc1f4007de0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.232+0000 7fc20a7f1640 1 -- 172.21.15.81:0/2086761590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204145f20 msgr2=0x7fc2040cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.232+0000 7fc20a7f1640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204145f20 0x7fc2040cba00 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc009e50 tx=0x7fc1fc004a40 comp rx=0 tx=0).stop 2024-09-16T01:23:31.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.233+0000 7fc20a7f1640 1 -- 172.21.15.81:0/2086761590 shutdown_connections 2024-09-16T01:23:31.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.233+0000 7fc20a7f1640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc1f006c2b0 0x7fc1f006e770 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.233+0000 7fc20a7f1640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc204145f20 0x7fc2040cba00 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.233+0000 7fc20a7f1640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2040b2880 0x7fc2041ee0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.233+0000 7fc20a7f1640 1 --2- 172.21.15.81:0/2086761590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2040b2420 0x7fc2041f4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.233+0000 7fc20a7f1640 1 -- 172.21.15.81:0/2086761590 >> 172.21.15.81:0/2086761590 conn(0x7fc20409aa30 msgr2=0x7fc2040b67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:31.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.233+0000 7fc20a7f1640 1 -- 172.21.15.81:0/2086761590 shutdown_connections 2024-09-16T01:23:31.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.233+0000 7fc20a7f1640 1 -- 172.21.15.81:0/2086761590 wait complete. 2024-09-16T01:23:31.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 200 2024-09-16T01:23:31.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.344+0000 7f2ceb2ba640 1 Processor -- start 2024-09-16T01:23:31.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.345+0000 7f2ceb2ba640 1 -- start start 2024-09-16T01:23:31.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.345+0000 7f2ceb2ba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ce4162340 0x7f2ce406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.345+0000 7f2ceb2ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ce40cf280 0x7f2ce4162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.345+0000 7f2ceb2ba640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ce415ff70 con 0x7f2ce4162c60 2024-09-16T01:23:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.345+0000 7f2ceb2ba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2ce406de90 con 0x7f2ce4162340 2024-09-16T01:23:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.345+0000 7f2ceb2ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce40d4d10 con 0x7f2ce40cf280 2024-09-16T01:23:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.346+0000 7f2ce9056640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ce4162340 0x7f2ce406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.346+0000 7f2ce9056640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ce4162340 0x7f2ce406d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55046/0 (socket says 172.21.15.81:55046) 2024-09-16T01:23:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.346+0000 7f2ce9056640 1 -- 172.21.15.81:0/168588837 learned_addr learned my addr 172.21.15.81:0/168588837 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.346+0000 7f2ce8855640 1 --2- 172.21.15.81:0/168588837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ce40cf280 0x7f2ce4162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.346+0000 7f2ce9056640 1 -- 172.21.15.81:0/168588837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ce40cf280 msgr2=0x7f2ce4162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.346+0000 7f2ce9056640 1 --2- 172.21.15.81:0/168588837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ce40cf280 0x7f2ce4162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.346+0000 7f2ce9056640 1 -- 172.21.15.81:0/168588837 >> v1:172.21.15.102:6789/0 conn(0x7f2ce4162c60 legacy=0x7f2ce40d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.346+0000 7f2ce9056640 1 -- 172.21.15.81:0/168588837 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce40d4ff0 con 0x7f2ce4162340 2024-09-16T01:23:31.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.347+0000 7f2ce9056640 1 --2- 172.21.15.81:0/168588837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4162340 0x7f2ce406d740 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009870 tx=0x7f2cd802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53bfbdf153db925 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:31.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.347+0000 7f2cd7fff640 1 -- 172.21.15.81:0/168588837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8037070 con 0x7f2ce4162340 2024-09-16T01:23:31.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.347+0000 7f2cd7fff640 1 -- 172.21.15.81:0/168588837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cd8032440 con 0x7f2ce4162340 2024-09-16T01:23:31.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.347+0000 7f2cd7fff640 1 -- 172.21.15.81:0/168588837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8032810 con 0x7f2ce4162340 2024-09-16T01:23:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.347+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/168588837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4162340 msgr2=0x7f2ce406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.347+0000 7f2ceb2ba640 1 --2- 172.21.15.81:0/168588837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4162340 0x7f2ce406d740 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009870 tx=0x7f2cd802a1c0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.347+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/168588837 shutdown_connections 2024-09-16T01:23:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.347+0000 7f2ceb2ba640 1 --2- 172.21.15.81:0/168588837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ce40cf280 0x7f2ce4162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.347+0000 7f2ceb2ba640 1 --2- 172.21.15.81:0/168588837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4162340 0x7f2ce406d740 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.347+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/168588837 >> 172.21.15.81:0/168588837 conn(0x7f2ce408bfc0 msgr2=0x7f2ce40d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.347+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/168588837 shutdown_connections 2024-09-16T01:23:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.347+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/168588837 wait complete. 2024-09-16T01:23:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ceb2ba640 1 Processor -- start 2024-09-16T01:23:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ceb2ba640 1 -- start start 2024-09-16T01:23:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ceb2ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ce40cf280 0x7f2ce40c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ceb2ba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce4162340 0x7f2ce40cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ceb2ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4162c60 0x7f2ce41532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ceb2ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce40cf6c0 con 0x7f2ce4162c60 2024-09-16T01:23:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ceb2ba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce40d52d0 con 0x7f2ce4162340 2024-09-16T01:23:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ceb2ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce41630f0 con 0x7f2ce40cf280 2024-09-16T01:23:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ce9857640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4162c60 0x7f2ce41532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ce9857640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4162c60 0x7f2ce41532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55052/0 (socket says 172.21.15.81:55052) 2024-09-16T01:23:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ce9857640 1 -- 172.21.15.81:0/3697632539 learned_addr learned my addr 172.21.15.81:0/3697632539 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ce9056640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ce40cf280 0x7f2ce40c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.349+0000 7f2ce8855640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce4162340 0x7f2ce40cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.350+0000 7f2ce9857640 1 -- 172.21.15.81:0/3697632539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ce40cf280 msgr2=0x7f2ce40c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.350+0000 7f2ce9857640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ce40cf280 0x7f2ce40c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.350+0000 7f2ce9857640 1 -- 172.21.15.81:0/3697632539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce4162340 msgr2=0x7f2ce40cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.350+0000 7f2ce9857640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce4162340 0x7f2ce40cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.350+0000 7f2ce9857640 1 -- 172.21.15.81:0/3697632539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce40c8700 con 0x7f2ce4162c60 2024-09-16T01:23:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.350+0000 7f2ce9857640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4162c60 0x7f2ce41532e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c6b0 tx=0x7f2cdc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.350+0000 7f2cd5ffb640 1 -- 172.21.15.81:0/3697632539 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc003b70 con 0x7f2ce4162c60 2024-09-16T01:23:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.350+0000 7f2cd5ffb640 1 -- 172.21.15.81:0/3697632539 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cdc003d30 con 0x7f2ce4162c60 2024-09-16T01:23:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.350+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/3697632539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce40c89e0 con 0x7f2ce4162c60 2024-09-16T01:23:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.350+0000 7f2cd5ffb640 1 -- 172.21.15.81:0/3697632539 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc005310 con 0x7f2ce4162c60 2024-09-16T01:23:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.350+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/3697632539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce4153820 con 0x7f2ce4162c60 2024-09-16T01:23:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.351+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/3697632539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce40c93d0 con 0x7f2ce4162c60 2024-09-16T01:23:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.352+0000 7f2cd5ffb640 1 -- 172.21.15.81:0/3697632539 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2cdc0054b0 con 0x7f2ce4162c60 2024-09-16T01:23:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.352+0000 7f2cd5ffb640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2cc806c2e0 0x7f2cc806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.352+0000 7f2cd5ffb640 1 -- 172.21.15.81:0/3697632539 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f2cdc08b320 con 0x7f2ce4162c60 2024-09-16T01:23:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.352+0000 7f2ce9056640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2cc806c2e0 0x7f2cc806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.353+0000 7f2ce9056640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2cc806c2e0 0x7f2cc806e7a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8034000 tx=0x7f2cd802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.356+0000 7f2cd5ffb640 1 -- 172.21.15.81:0/3697632539 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ce40c93d0 con 0x7f2ce4162c60 2024-09-16T01:23:31.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.522+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/3697632539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7f2ce4162720 con 0x7f2ce4162c60 2024-09-16T01:23:31.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.525+0000 7f2cd5ffb640 1 -- 172.21.15.81:0/3697632539 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v58)=0 v58) ==== 119+0+0 (secure 0 0 0) 0x7f2cdc059220 con 0x7f2ce4162c60 2024-09-16T01:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.528+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/3697632539 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2cc806c2e0 msgr2=0x7f2cc806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.528+0000 7f2ceb2ba640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2cc806c2e0 0x7f2cc806e7a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8034000 tx=0x7f2cd802e000 comp rx=0 tx=0).stop 2024-09-16T01:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.528+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/3697632539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4162c60 msgr2=0x7f2ce41532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.528+0000 7f2ceb2ba640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4162c60 0x7f2ce41532e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc00c6b0 tx=0x7f2cdc00cb70 comp rx=0 tx=0).stop 2024-09-16T01:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.528+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/3697632539 shutdown_connections 2024-09-16T01:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.528+0000 7f2ceb2ba640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f2cc806c2e0 0x7f2cc806e7a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.528+0000 7f2ceb2ba640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce4162c60 0x7f2ce41532e0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.528+0000 7f2ceb2ba640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ce4162340 0x7f2ce40cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.528+0000 7f2ceb2ba640 1 --2- 172.21.15.81:0/3697632539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ce40cf280 0x7f2ce40c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.528+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/3697632539 >> 172.21.15.81:0/3697632539 conn(0x7f2ce408bfc0 msgr2=0x7f2ce41613f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.528+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/3697632539 shutdown_connections 2024-09-16T01:23:31.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.528+0000 7f2ceb2ba640 1 -- 172.21.15.81:0/3697632539 wait complete. 2024-09-16T01:23:31.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 400 2024-09-16T01:23:31.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.640+0000 7f34df386640 1 Processor -- start 2024-09-16T01:23:31.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.640+0000 7f34df386640 1 -- start start 2024-09-16T01:23:31.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.641+0000 7f34df386640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f34d815c490 0x7f34d809aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.641+0000 7f34df386640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34d8071100 0x7f34d8071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.641+0000 7f34df386640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d8072180 con 0x7f34d809af70 2024-09-16T01:23:31.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.641+0000 7f34df386640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f34d809b3b0 con 0x7f34d815c490 2024-09-16T01:23:31.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.641+0000 7f34df386640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f34d815c870 con 0x7f34d8071100 2024-09-16T01:23:31.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.641+0000 7f34dd923640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34d8071100 0x7f34d8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.641+0000 7f34dd122640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f34d815c490 0x7f34d809aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.641+0000 7f34dd923640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34d8071100 0x7f34d8071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:58980/0 (socket says 172.21.15.81:58980) 2024-09-16T01:23:31.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.641+0000 7f34dc921640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f34d809af70 0x7f34d80b04c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:43082/0 (socket says 172.21.15.81:43082) 2024-09-16T01:23:31.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.641+0000 7f34dd122640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f34d815c490 0x7f34d809aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:46248/0 (socket says 172.21.15.81:46248) 2024-09-16T01:23:31.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.641+0000 7f34dd923640 1 -- 172.21.15.81:0/4207980049 learned_addr learned my addr 172.21.15.81:0/4207980049 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:31.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.642+0000 7f34dd122640 1 -- 172.21.15.81:0/4207980049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34d8071100 msgr2=0x7f34d8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:31.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.642+0000 7f34dd122640 1 --2- 172.21.15.81:0/4207980049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34d8071100 0x7f34d8071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.642+0000 7f34dd122640 1 -- 172.21.15.81:0/4207980049 >> v1:172.21.15.102:6789/0 conn(0x7f34d809af70 legacy=0x7f34d80b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.642+0000 7f34dd122640 1 -- 172.21.15.81:0/4207980049 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d8071bc0 con 0x7f34d815c490 2024-09-16T01:23:31.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.642+0000 7f34cffff640 1 -- 172.21.15.81:0/4207980049 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2376433415 0 0) 0x7f34d8072180 con 0x7f34d809af70 2024-09-16T01:23:31.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.642+0000 7f34dd923640 1 --2- 172.21.15.81:0/4207980049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34d8071100 0x7f34d8071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:31.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.642+0000 7f34dd122640 1 --2- 172.21.15.81:0/4207980049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d815c490 0x7f34d809aa30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f34d40097a0 tx=0x7f34d402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2d060b6f1bcb092 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:31.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.642+0000 7f34cffff640 1 -- 172.21.15.81:0/4207980049 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4037070 con 0x7f34d815c490 2024-09-16T01:23:31.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.642+0000 7f34cffff640 1 -- 172.21.15.81:0/4207980049 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d4032440 con 0x7f34d815c490 2024-09-16T01:23:31.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.642+0000 7f34cffff640 1 -- 172.21.15.81:0/4207980049 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4032810 con 0x7f34d815c490 2024-09-16T01:23:31.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.643+0000 7f34df386640 1 -- 172.21.15.81:0/4207980049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d815c490 msgr2=0x7f34d809aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.643+0000 7f34df386640 1 --2- 172.21.15.81:0/4207980049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d815c490 0x7f34d809aa30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f34d40097a0 tx=0x7f34d402a180 comp rx=0 tx=0).stop 2024-09-16T01:23:31.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.643+0000 7f34df386640 1 -- 172.21.15.81:0/4207980049 shutdown_connections 2024-09-16T01:23:31.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.643+0000 7f34df386640 1 --2- 172.21.15.81:0/4207980049 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34d8071100 0x7f34d8071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.643+0000 7f34df386640 1 --2- 172.21.15.81:0/4207980049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d815c490 0x7f34d809aa30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.643+0000 7f34df386640 1 -- 172.21.15.81:0/4207980049 >> 172.21.15.81:0/4207980049 conn(0x7f34d80b3f30 msgr2=0x7f34d80b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:31.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.643+0000 7f34df386640 1 -- 172.21.15.81:0/4207980049 shutdown_connections 2024-09-16T01:23:31.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.643+0000 7f34df386640 1 -- 172.21.15.81:0/4207980049 wait complete. 2024-09-16T01:23:31.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.644+0000 7f34df386640 1 Processor -- start 2024-09-16T01:23:31.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.644+0000 7f34df386640 1 -- start start 2024-09-16T01:23:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34df386640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8071100 0x7f34d8145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34df386640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34d809af70 0x7f34d81f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34df386640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d815c490 0x7f34d81f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34df386640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34d80affa0 con 0x7f34d8071100 2024-09-16T01:23:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34df386640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f34d80afcc0 con 0x7f34d815c490 2024-09-16T01:23:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34df386640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f34d809b8f0 con 0x7f34d809af70 2024-09-16T01:23:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34dd122640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8071100 0x7f34d8145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34dd122640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8071100 0x7f34d8145bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55064/0 (socket says 172.21.15.81:55064) 2024-09-16T01:23:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34dd122640 1 -- 172.21.15.81:0/2695609656 learned_addr learned my addr 172.21.15.81:0/2695609656 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34dd923640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d815c490 0x7f34d81f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34dc921640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34d809af70 0x7f34d81f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34dd122640 1 -- 172.21.15.81:0/2695609656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34d809af70 msgr2=0x7f34d81f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34dd122640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34d809af70 0x7f34d81f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34dd122640 1 -- 172.21.15.81:0/2695609656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d815c490 msgr2=0x7f34d81f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34dd122640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d815c490 0x7f34d81f5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.645+0000 7f34dd122640 1 -- 172.21.15.81:0/2695609656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d809ddd0 con 0x7f34d8071100 2024-09-16T01:23:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.646+0000 7f34dd122640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8071100 0x7f34d8145bd0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f34d4035040 tx=0x7f34d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:31.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.646+0000 7f34cdffb640 1 -- 172.21.15.81:0/2695609656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4037040 con 0x7f34d8071100 2024-09-16T01:23:31.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.646+0000 7f34cdffb640 1 -- 172.21.15.81:0/2695609656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d4030500 con 0x7f34d8071100 2024-09-16T01:23:31.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.646+0000 7f34df386640 1 -- 172.21.15.81:0/2695609656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d809e0b0 con 0x7f34d8071100 2024-09-16T01:23:31.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.646+0000 7f34cdffb640 1 -- 172.21.15.81:0/2695609656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d4030910 con 0x7f34d8071100 2024-09-16T01:23:31.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.646+0000 7f34df386640 1 -- 172.21.15.81:0/2695609656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d815cee0 con 0x7f34d8071100 2024-09-16T01:23:31.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.647+0000 7f34df386640 1 -- 172.21.15.81:0/2695609656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d815c9f0 con 0x7f34d8071100 2024-09-16T01:23:31.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.648+0000 7f34cdffb640 1 -- 172.21.15.81:0/2695609656 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f34d4044020 con 0x7f34d8071100 2024-09-16T01:23:31.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.648+0000 7f34cdffb640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f34bc06c2b0 0x7f34bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.648+0000 7f34dc921640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f34bc06c2b0 0x7f34bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.648+0000 7f34cdffb640 1 -- 172.21.15.81:0/2695609656 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f34d40ab6e0 con 0x7f34d8071100 2024-09-16T01:23:31.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.649+0000 7f34dc921640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f34bc06c2b0 0x7f34bc06e770 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f34d80b2730 tx=0x7f34c8007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:31.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.652+0000 7f34cdffb640 1 -- 172.21.15.81:0/2695609656 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34d4079670 con 0x7f34d8071100 2024-09-16T01:23:31.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.820+0000 7f34df386640 1 -- 172.21.15.81:0/2695609656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7f34d815f8a0 con 0x7f34d8071100 2024-09-16T01:23:31.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.823+0000 7f34cdffb640 1 -- 172.21.15.81:0/2695609656 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v59)=0 v59) ==== 128+0+0 (secure 0 0 0) 0x7f34d407d970 con 0x7f34d8071100 2024-09-16T01:23:31.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.825+0000 7f34df386640 1 -- 172.21.15.81:0/2695609656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f34bc06c2b0 msgr2=0x7f34bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.825+0000 7f34df386640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f34bc06c2b0 0x7f34bc06e770 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f34d80b2730 tx=0x7f34c8007de0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.825+0000 7f34df386640 1 -- 172.21.15.81:0/2695609656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8071100 msgr2=0x7f34d8145bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.825+0000 7f34df386640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8071100 0x7f34d8145bd0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f34d4035040 tx=0x7f34d40046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.825+0000 7f34df386640 1 -- 172.21.15.81:0/2695609656 shutdown_connections 2024-09-16T01:23:31.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.825+0000 7f34df386640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f34bc06c2b0 0x7f34bc06e770 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.825+0000 7f34df386640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f34d815c490 0x7f34d81f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.825+0000 7f34df386640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f34d809af70 0x7f34d81f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.825+0000 7f34df386640 1 --2- 172.21.15.81:0/2695609656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34d8071100 0x7f34d8145bd0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.825+0000 7f34df386640 1 -- 172.21.15.81:0/2695609656 >> 172.21.15.81:0/2695609656 conn(0x7f34d80b3f30 msgr2=0x7f34d80b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:31.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.825+0000 7f34df386640 1 -- 172.21.15.81:0/2695609656 shutdown_connections 2024-09-16T01:23:31.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.825+0000 7f34df386640 1 -- 172.21.15.81:0/2695609656 wait complete. 2024-09-16T01:23:31.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-16T01:23:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.939+0000 7fbd1738d640 1 Processor -- start 2024-09-16T01:23:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.939+0000 7fbd1738d640 1 -- start start 2024-09-16T01:23:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd1738d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbd10070110 0x7fbd100b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd1738d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd100705c0 0x7fbd1006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd1738d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd100b4a50 con 0x7fbd1015e760 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd1738d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fbd100b5ea0 con 0x7fbd100705c0 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd1738d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbd100710d0 con 0x7fbd10070110 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd1592a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd100705c0 0x7fbd1006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd1592a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd100705c0 0x7fbd1006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55066/0 (socket says 172.21.15.81:55066) 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd1592a640 1 -- 172.21.15.81:0/3132425374 learned_addr learned my addr 172.21.15.81:0/3132425374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd15129640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbd1015e760 0x7fbd1006fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35378/0 (socket says 172.21.15.81:35378) 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd14928640 1 --2- 172.21.15.81:0/3132425374 >> v2:172.21.15.102:3300/0 conn(0x7fbd10070110 0x7fbd100b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd1592a640 1 -- 172.21.15.81:0/3132425374 >> v2:172.21.15.102:3300/0 conn(0x7fbd10070110 msgr2=0x7fbd100b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd1592a640 1 --2- 172.21.15.81:0/3132425374 >> v2:172.21.15.102:3300/0 conn(0x7fbd10070110 0x7fbd100b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd07fff640 1 -- 172.21.15.81:0/3132425374 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1101777536 0 0) 0x7fbd100b4a50 con 0x7fbd1015e760 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd1592a640 1 -- 172.21.15.81:0/3132425374 >> v1:172.21.15.81:6789/0 conn(0x7fbd1015e760 legacy=0x7fbd1006fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd1592a640 1 -- 172.21.15.81:0/3132425374 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd10070b10 con 0x7fbd100705c0 2024-09-16T01:23:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.940+0000 7fbd14928640 1 --2- 172.21.15.81:0/3132425374 >> v2:172.21.15.102:3300/0 conn(0x7fbd10070110 0x7fbd100b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:31.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.941+0000 7fbd1592a640 1 --2- 172.21.15.81:0/3132425374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd100705c0 0x7fbd1006bc10 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fbd100b0ea0 tx=0x7fbd0802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e645977e2e6786 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:31.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.941+0000 7fbd07fff640 1 -- 172.21.15.81:0/3132425374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08036070 con 0x7fbd100705c0 2024-09-16T01:23:31.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.941+0000 7fbd07fff640 1 -- 172.21.15.81:0/3132425374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd08031600 con 0x7fbd100705c0 2024-09-16T01:23:31.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.941+0000 7fbd07fff640 1 -- 172.21.15.81:0/3132425374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd080319d0 con 0x7fbd100705c0 2024-09-16T01:23:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.942+0000 7fbd1738d640 1 -- 172.21.15.81:0/3132425374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd100705c0 msgr2=0x7fbd1006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.942+0000 7fbd1738d640 1 --2- 172.21.15.81:0/3132425374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd100705c0 0x7fbd1006bc10 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fbd100b0ea0 tx=0x7fbd0802a730 comp rx=0 tx=0).stop 2024-09-16T01:23:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.942+0000 7fbd1738d640 1 -- 172.21.15.81:0/3132425374 shutdown_connections 2024-09-16T01:23:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.942+0000 7fbd1738d640 1 --2- 172.21.15.81:0/3132425374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd100705c0 0x7fbd1006bc10 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.942+0000 7fbd1738d640 1 --2- 172.21.15.81:0/3132425374 >> v2:172.21.15.102:3300/0 conn(0x7fbd10070110 0x7fbd100b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.942+0000 7fbd1738d640 1 -- 172.21.15.81:0/3132425374 >> 172.21.15.81:0/3132425374 conn(0x7fbd10073490 msgr2=0x7fbd100b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.942+0000 7fbd1738d640 1 -- 172.21.15.81:0/3132425374 shutdown_connections 2024-09-16T01:23:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.942+0000 7fbd1738d640 1 -- 172.21.15.81:0/3132425374 wait complete. 2024-09-16T01:23:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.943+0000 7fbd1738d640 1 Processor -- start 2024-09-16T01:23:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.943+0000 7fbd1738d640 1 -- start start 2024-09-16T01:23:31.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd1738d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd10070110 0x7fbd101f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd1738d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd100705c0 0x7fbd1009c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd1738d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd1015e760 0x7fbd10142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd1738d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbd100b46e0 con 0x7fbd10070110 2024-09-16T01:23:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd1738d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbd100b4400 con 0x7fbd100705c0 2024-09-16T01:23:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd1738d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbd100ae240 con 0x7fbd1015e760 2024-09-16T01:23:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd15129640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd10070110 0x7fbd101f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd15129640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd10070110 0x7fbd101f8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55076/0 (socket says 172.21.15.81:55076) 2024-09-16T01:23:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd15129640 1 -- 172.21.15.81:0/1897263811 learned_addr learned my addr 172.21.15.81:0/1897263811 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd14928640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd100705c0 0x7fbd1009c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd15129640 1 -- 172.21.15.81:0/1897263811 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd1015e760 msgr2=0x7fbd10142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd15129640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd1015e760 0x7fbd10142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd15129640 1 -- 172.21.15.81:0/1897263811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd100705c0 msgr2=0x7fbd1009c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd15129640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd100705c0 0x7fbd1009c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd15129640 1 -- 172.21.15.81:0/1897263811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1009ca90 con 0x7fbd10070110 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd14928640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd100705c0 0x7fbd1009c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.944+0000 7fbd15129640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd10070110 0x7fbd101f8160 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c4d0 tx=0x7fbd0c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.945+0000 7fbd05ffb640 1 -- 172.21.15.81:0/1897263811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c018070 con 0x7fbd10070110 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.945+0000 7fbd05ffb640 1 -- 172.21.15.81:0/1897263811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0c007500 con 0x7fbd10070110 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.945+0000 7fbd1738d640 1 -- 172.21.15.81:0/1897263811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1009cd70 con 0x7fbd10070110 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.945+0000 7fbd05ffb640 1 -- 172.21.15.81:0/1897263811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd0c004a20 con 0x7fbd10070110 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.945+0000 7fbd1738d640 1 -- 172.21.15.81:0/1897263811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd1009d330 con 0x7fbd10070110 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.946+0000 7fbd1738d640 1 -- 172.21.15.81:0/1897263811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd100b62f0 con 0x7fbd10070110 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.946+0000 7fbd05ffb640 1 -- 172.21.15.81:0/1897263811 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd0c01b070 con 0x7fbd10070110 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.947+0000 7fbd05ffb640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbcf406c2b0 0x7fbcf406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.947+0000 7fbd05ffb640 1 -- 172.21.15.81:0/1897263811 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fbd0c08a8b0 con 0x7fbd10070110 2024-09-16T01:23:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.947+0000 7fbd14928640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbcf406c2b0 0x7fbcf406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.947+0000 7fbd14928640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbcf406c2b0 0x7fbcf406e770 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbd00006fd0 tx=0x7fbd00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:31.951+0000 7fbd05ffb640 1 -- 172.21.15.81:0/1897263811 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd0c058f20 con 0x7fbd10070110 2024-09-16T01:23:32.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.118+0000 7fbd1738d640 1 -- 172.21.15.81:0/1897263811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7fbd1015b8b0 con 0x7fbd10070110 2024-09-16T01:23:32.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.119+0000 7fbd05ffb640 1 -- 172.21.15.81:0/1897263811 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v59) ==== 106+0+4 (secure 0 0 0) 0x7fbd0c058820 con 0x7fbd10070110 2024-09-16T01:23:32.120 INFO:teuthology.orchestra.run.smithi081.stdout:100 2024-09-16T01:23:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.121+0000 7fbd1738d640 1 -- 172.21.15.81:0/1897263811 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbcf406c2b0 msgr2=0x7fbcf406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.121+0000 7fbd1738d640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbcf406c2b0 0x7fbcf406e770 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbd00006fd0 tx=0x7fbd00008040 comp rx=0 tx=0).stop 2024-09-16T01:23:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.121+0000 7fbd1738d640 1 -- 172.21.15.81:0/1897263811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd10070110 msgr2=0x7fbd101f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.121+0000 7fbd1738d640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd10070110 0x7fbd101f8160 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c00c4d0 tx=0x7fbd0c00c990 comp rx=0 tx=0).stop 2024-09-16T01:23:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.121+0000 7fbd1738d640 1 -- 172.21.15.81:0/1897263811 shutdown_connections 2024-09-16T01:23:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.121+0000 7fbd1738d640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbcf406c2b0 0x7fbcf406e770 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.121+0000 7fbd1738d640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd1015e760 0x7fbd10142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.121+0000 7fbd1738d640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd100705c0 0x7fbd1009c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.121+0000 7fbd1738d640 1 --2- 172.21.15.81:0/1897263811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd10070110 0x7fbd101f8160 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.121+0000 7fbd1738d640 1 -- 172.21.15.81:0/1897263811 >> 172.21.15.81:0/1897263811 conn(0x7fbd10073490 msgr2=0x7fbd1006eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.121+0000 7fbd1738d640 1 -- 172.21.15.81:0/1897263811 shutdown_connections 2024-09-16T01:23:32.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.121+0000 7fbd1738d640 1 -- 172.21.15.81:0/1897263811 wait complete. 2024-09-16T01:23:32.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 100 2024-09-16T01:23:32.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.233+0000 7fb766c0e640 1 Processor -- start 2024-09-16T01:23:32.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.233+0000 7fb766c0e640 1 -- start start 2024-09-16T01:23:32.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb766c0e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb760159ce0 0x7fb76015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb766c0e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb76015dce0 0x7fb76015e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb766c0e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76015d730 con 0x7fb7600b5f10 2024-09-16T01:23:32.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb766c0e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb7600700b0 con 0x7fb76015dce0 2024-09-16T01:23:32.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb766c0e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb7601601b0 con 0x7fb760159ce0 2024-09-16T01:23:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb7651ab640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb76015dce0 0x7fb76015e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb7651ab640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb76015dce0 0x7fb76015e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55086/0 (socket says 172.21.15.81:55086) 2024-09-16T01:23:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb7651ab640 1 -- 172.21.15.81:0/3817400160 learned_addr learned my addr 172.21.15.81:0/3817400160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb7649aa640 1 --2- 172.21.15.81:0/3817400160 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb760159ce0 0x7fb76015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb7651ab640 1 -- 172.21.15.81:0/3817400160 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb760159ce0 msgr2=0x7fb76015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb7651ab640 1 --2- 172.21.15.81:0/3817400160 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb760159ce0 0x7fb76015d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb7651ab640 1 -- 172.21.15.81:0/3817400160 >> v1:172.21.15.102:6789/0 conn(0x7fb7600b5f10 legacy=0x7fb7600b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.234+0000 7fb7651ab640 1 -- 172.21.15.81:0/3817400160 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb760160490 con 0x7fb76015dce0 2024-09-16T01:23:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.235+0000 7fb7651ab640 1 --2- 172.21.15.81:0/3817400160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb76015dce0 0x7fb76015e170 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fb758009e50 tx=0x7fb75802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf7ad9f5d739da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.235+0000 7fb7577fe640 1 -- 172.21.15.81:0/3817400160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758036070 con 0x7fb76015dce0 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.235+0000 7fb7577fe640 1 -- 172.21.15.81:0/3817400160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb758031600 con 0x7fb76015dce0 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.235+0000 7fb7577fe640 1 -- 172.21.15.81:0/3817400160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7580319d0 con 0x7fb76015dce0 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.236+0000 7fb766c0e640 1 -- 172.21.15.81:0/3817400160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb76015dce0 msgr2=0x7fb76015e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.236+0000 7fb766c0e640 1 --2- 172.21.15.81:0/3817400160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb76015dce0 0x7fb76015e170 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fb758009e50 tx=0x7fb75802a5f0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.236+0000 7fb766c0e640 1 -- 172.21.15.81:0/3817400160 shutdown_connections 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.236+0000 7fb766c0e640 1 --2- 172.21.15.81:0/3817400160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb76015dce0 0x7fb76015e170 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.236+0000 7fb766c0e640 1 --2- 172.21.15.81:0/3817400160 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb760159ce0 0x7fb76015d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.236+0000 7fb766c0e640 1 -- 172.21.15.81:0/3817400160 >> 172.21.15.81:0/3817400160 conn(0x7fb760073590 msgr2=0x7fb76006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.236+0000 7fb766c0e640 1 -- 172.21.15.81:0/3817400160 shutdown_connections 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.236+0000 7fb766c0e640 1 -- 172.21.15.81:0/3817400160 wait complete. 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.237+0000 7fb766c0e640 1 Processor -- start 2024-09-16T01:23:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.237+0000 7fb766c0e640 1 -- start start 2024-09-16T01:23:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb766c0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7600b5f10 0x7fb760151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb766c0e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb760159ce0 0x7fb760149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb766c0e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76015dce0 0x7fb76006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb766c0e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb76015a0c0 con 0x7fb7600b5f10 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb766c0e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb760160a50 con 0x7fb76015dce0 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb766c0e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb7601539f0 con 0x7fb760159ce0 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb7649aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7600b5f10 0x7fb760151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb7649aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7600b5f10 0x7fb760151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55090/0 (socket says 172.21.15.81:55090) 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb7649aa640 1 -- 172.21.15.81:0/1239861345 learned_addr learned my addr 172.21.15.81:0/1239861345 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb7649aa640 1 -- 172.21.15.81:0/1239861345 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb760159ce0 msgr2=0x7fb760149450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb7649aa640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb760159ce0 0x7fb760149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb7651ab640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76015dce0 0x7fb76006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb7649aa640 1 -- 172.21.15.81:0/1239861345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76015dce0 msgr2=0x7fb76006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb7649aa640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76015dce0 0x7fb76006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb7649aa640 1 -- 172.21.15.81:0/1239861345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7600b4ab0 con 0x7fb7600b5f10 2024-09-16T01:23:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb7651ab640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76015dce0 0x7fb76006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.238+0000 7fb7649aa640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7600b5f10 0x7fb760151d80 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00e9b0 tx=0x7fb75c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.239+0000 7fb7557fa640 1 -- 172.21.15.81:0/1239861345 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c017070 con 0x7fb7600b5f10 2024-09-16T01:23:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.239+0000 7fb7557fa640 1 -- 172.21.15.81:0/1239861345 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75c00c9a0 con 0x7fb7600b5f10 2024-09-16T01:23:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.239+0000 7fb7557fa640 1 -- 172.21.15.81:0/1239861345 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c00cd90 con 0x7fb7600b5f10 2024-09-16T01:23:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.239+0000 7fb766c0e640 1 -- 172.21.15.81:0/1239861345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7600b4d90 con 0x7fb7600b5f10 2024-09-16T01:23:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.239+0000 7fb766c0e640 1 -- 172.21.15.81:0/1239861345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7600b5070 con 0x7fb7600b5f10 2024-09-16T01:23:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.240+0000 7fb766c0e640 1 -- 172.21.15.81:0/1239861345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb760070b10 con 0x7fb7600b5f10 2024-09-16T01:23:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.240+0000 7fb7557fa640 1 -- 172.21.15.81:0/1239861345 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb75c01a070 con 0x7fb7600b5f10 2024-09-16T01:23:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.241+0000 7fb7557fa640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb74c06c2b0 0x7fb74c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.241+0000 7fb7557fa640 1 -- 172.21.15.81:0/1239861345 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fb75c08b930 con 0x7fb7600b5f10 2024-09-16T01:23:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.241+0000 7fb757fff640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb74c06c2b0 0x7fb74c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.241+0000 7fb757fff640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb74c06c2b0 0x7fb74c06e770 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb750000f60 tx=0x7fb7500079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.245+0000 7fb7557fa640 1 -- 172.21.15.81:0/1239861345 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb760070b10 con 0x7fb7600b5f10 2024-09-16T01:23:32.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.410+0000 7fb766c0e640 1 -- 172.21.15.81:0/1239861345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7fb760153e00 con 0x7fb7600b5f10 2024-09-16T01:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.414+0000 7fb7557fa640 1 -- 172.21.15.81:0/1239861345 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v60)=0 v60) ==== 124+0+0 (secure 0 0 0) 0x7fb760153e00 con 0x7fb7600b5f10 2024-09-16T01:23:32.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.416+0000 7fb766c0e640 1 -- 172.21.15.81:0/1239861345 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb74c06c2b0 msgr2=0x7fb74c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.416+0000 7fb766c0e640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb74c06c2b0 0x7fb74c06e770 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb750000f60 tx=0x7fb7500079d0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.416+0000 7fb766c0e640 1 -- 172.21.15.81:0/1239861345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7600b5f10 msgr2=0x7fb760151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.416+0000 7fb766c0e640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7600b5f10 0x7fb760151d80 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00e9b0 tx=0x7fb75c00ee70 comp rx=0 tx=0).stop 2024-09-16T01:23:32.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.416+0000 7fb766c0e640 1 -- 172.21.15.81:0/1239861345 shutdown_connections 2024-09-16T01:23:32.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.416+0000 7fb766c0e640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb74c06c2b0 0x7fb74c06e770 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.416+0000 7fb766c0e640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb76015dce0 0x7fb76006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.416+0000 7fb766c0e640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb760159ce0 0x7fb760149450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.416+0000 7fb766c0e640 1 --2- 172.21.15.81:0/1239861345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7600b5f10 0x7fb760151d80 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.416+0000 7fb766c0e640 1 -- 172.21.15.81:0/1239861345 >> 172.21.15.81:0/1239861345 conn(0x7fb760073590 msgr2=0x7fb76015a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:32.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.416+0000 7fb766c0e640 1 -- 172.21.15.81:0/1239861345 shutdown_connections 2024-09-16T01:23:32.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.416+0000 7fb766c0e640 1 -- 172.21.15.81:0/1239861345 wait complete. 2024-09-16T01:23:32.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_max_caps_per_client 2024-09-16T01:23:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.527+0000 7fb4698ba640 1 Processor -- start 2024-09-16T01:23:32.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.527+0000 7fb4698ba640 1 -- start start 2024-09-16T01:23:32.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb4698ba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb464162340 0x7fb46406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb4698ba640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb4640cf280 0x7fb464162720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb4698ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb464162c60 0x7fb4640d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb4698ba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb46406de90 con 0x7fb464162340 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb4698ba640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb46415ff70 con 0x7fb4640cf280 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb4698ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb4640d4d10 con 0x7fb464162c60 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb462ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb464162340 0x7fb46406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb462ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb464162340 0x7fb46406d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55104/0 (socket says 172.21.15.81:55104) 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb462ffd640 1 -- 172.21.15.81:0/1749706109 learned_addr learned my addr 172.21.15.81:0/1749706109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb4627fc640 1 --2- 172.21.15.81:0/1749706109 >> v2:172.21.15.102:3300/0 conn(0x7fb4640cf280 0x7fb464162720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb4637fe640 1 --2- 172.21.15.81:0/1749706109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb464162c60 0x7fb4640d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb462ffd640 1 -- 172.21.15.81:0/1749706109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb464162c60 msgr2=0x7fb4640d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb462ffd640 1 --2- 172.21.15.81:0/1749706109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb464162c60 0x7fb4640d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb462ffd640 1 -- 172.21.15.81:0/1749706109 >> v2:172.21.15.102:3300/0 conn(0x7fb4640cf280 msgr2=0x7fb464162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb462ffd640 1 --2- 172.21.15.81:0/1749706109 >> v2:172.21.15.102:3300/0 conn(0x7fb4640cf280 0x7fb464162720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb462ffd640 1 -- 172.21.15.81:0/1749706109 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4640d4ff0 con 0x7fb464162340 2024-09-16T01:23:32.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.528+0000 7fb4627fc640 1 --2- 172.21.15.81:0/1749706109 >> v2:172.21.15.102:3300/0 conn(0x7fb4640cf280 0x7fb464162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:32.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.529+0000 7fb462ffd640 1 --2- 172.21.15.81:0/1749706109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb464162340 0x7fb46406d740 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb4640a23d0 tx=0x7fb45402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da55f98b1bb5a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:32.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.529+0000 7fb461ffb640 1 -- 172.21.15.81:0/1749706109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb454037070 con 0x7fb464162340 2024-09-16T01:23:32.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.529+0000 7fb461ffb640 1 -- 172.21.15.81:0/1749706109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb454032440 con 0x7fb464162340 2024-09-16T01:23:32.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.529+0000 7fb461ffb640 1 -- 172.21.15.81:0/1749706109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb454032810 con 0x7fb464162340 2024-09-16T01:23:32.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.530+0000 7fb4698ba640 1 -- 172.21.15.81:0/1749706109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb464162340 msgr2=0x7fb46406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.530+0000 7fb4698ba640 1 --2- 172.21.15.81:0/1749706109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb464162340 0x7fb46406d740 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fb4640a23d0 tx=0x7fb45402a140 comp rx=0 tx=0).stop 2024-09-16T01:23:32.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.530+0000 7fb4698ba640 1 -- 172.21.15.81:0/1749706109 shutdown_connections 2024-09-16T01:23:32.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.530+0000 7fb4698ba640 1 --2- 172.21.15.81:0/1749706109 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb464162c60 0x7fb4640d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.530+0000 7fb4698ba640 1 --2- 172.21.15.81:0/1749706109 >> v2:172.21.15.102:3300/0 conn(0x7fb4640cf280 0x7fb464162720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.530+0000 7fb4698ba640 1 --2- 172.21.15.81:0/1749706109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb464162340 0x7fb46406d740 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.530+0000 7fb4698ba640 1 -- 172.21.15.81:0/1749706109 >> 172.21.15.81:0/1749706109 conn(0x7fb46408bfc0 msgr2=0x7fb4640d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.530+0000 7fb4698ba640 1 -- 172.21.15.81:0/1749706109 shutdown_connections 2024-09-16T01:23:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.530+0000 7fb4698ba640 1 -- 172.21.15.81:0/1749706109 wait complete. 2024-09-16T01:23:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.531+0000 7fb4698ba640 1 Processor -- start 2024-09-16T01:23:32.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.531+0000 7fb4698ba640 1 -- start start 2024-09-16T01:23:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4698ba640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb4640cf280 0x7fb4641f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4698ba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb464162340 0x7fb46415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4698ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb464162c60 0x7fb46415bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4698ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4640cf6c0 con 0x7fb464162c60 2024-09-16T01:23:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4698ba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb4640d52d0 con 0x7fb464162340 2024-09-16T01:23:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4698ba640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb4641630f0 con 0x7fb4640cf280 2024-09-16T01:23:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb464162c60 0x7fb46415bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb464162c60 0x7fb46415bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55120/0 (socket says 172.21.15.81:55120) 2024-09-16T01:23:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4637fe640 1 -- 172.21.15.81:0/3659163957 learned_addr learned my addr 172.21.15.81:0/3659163957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4627fc640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb464162340 0x7fb46415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb462ffd640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb4640cf280 0x7fb4641f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4637fe640 1 -- 172.21.15.81:0/3659163957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb4640cf280 msgr2=0x7fb4641f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4637fe640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb4640cf280 0x7fb4641f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4637fe640 1 -- 172.21.15.81:0/3659163957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb464162340 msgr2=0x7fb46415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4637fe640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb464162340 0x7fb46415b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4637fe640 1 -- 172.21.15.81:0/3659163957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4640cc6e0 con 0x7fb464162c60 2024-09-16T01:23:32.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.532+0000 7fb4637fe640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb464162c60 0x7fb46415bcd0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00cd70 tx=0x7fb45c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.533+0000 7fb44bfff640 1 -- 172.21.15.81:0/3659163957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c003b90 con 0x7fb464162c60 2024-09-16T01:23:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.533+0000 7fb44bfff640 1 -- 172.21.15.81:0/3659163957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb45c003d30 con 0x7fb464162c60 2024-09-16T01:23:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.533+0000 7fb4698ba640 1 -- 172.21.15.81:0/3659163957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4640cb640 con 0x7fb464162c60 2024-09-16T01:23:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.533+0000 7fb44bfff640 1 -- 172.21.15.81:0/3659163957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c004240 con 0x7fb464162c60 2024-09-16T01:23:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.533+0000 7fb4698ba640 1 -- 172.21.15.81:0/3659163957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4640cbc00 con 0x7fb464162c60 2024-09-16T01:23:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.534+0000 7fb4698ba640 1 -- 172.21.15.81:0/3659163957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb464162720 con 0x7fb464162c60 2024-09-16T01:23:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.534+0000 7fb44bfff640 1 -- 172.21.15.81:0/3659163957 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb45c0043e0 con 0x7fb464162c60 2024-09-16T01:23:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.535+0000 7fb44bfff640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb45006c2b0 0x7fb45006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.535+0000 7fb44bfff640 1 -- 172.21.15.81:0/3659163957 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fb45c08be40 con 0x7fb464162c60 2024-09-16T01:23:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.535+0000 7fb462ffd640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb45006c2b0 0x7fb45006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.535+0000 7fb462ffd640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb45006c2b0 0x7fb45006e770 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb454034000 tx=0x7fb45402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:32.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.539+0000 7fb44bfff640 1 -- 172.21.15.81:0/3659163957 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb45c059e60 con 0x7fb464162c60 2024-09-16T01:23:32.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.705+0000 7fb4698ba640 1 -- 172.21.15.81:0/3659163957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"} v 0) -- 0x7fb46408e640 con 0x7fb464162c60 2024-09-16T01:23:32.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.705+0000 7fb44bfff640 1 -- 172.21.15.81:0/3659163957 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"}]=0 v60) ==== 106+0+8 (secure 0 0 0) 0x7fb45c05e160 con 0x7fb464162c60 2024-09-16T01:23:32.706 INFO:teuthology.orchestra.run.smithi081.stdout:1048576 2024-09-16T01:23:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.707+0000 7fb4698ba640 1 -- 172.21.15.81:0/3659163957 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb45006c2b0 msgr2=0x7fb45006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.707+0000 7fb4698ba640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb45006c2b0 0x7fb45006e770 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb454034000 tx=0x7fb45402e000 comp rx=0 tx=0).stop 2024-09-16T01:23:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.707+0000 7fb4698ba640 1 -- 172.21.15.81:0/3659163957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb464162c60 msgr2=0x7fb46415bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.707+0000 7fb4698ba640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb464162c60 0x7fb46415bcd0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fb45c00cd70 tx=0x7fb45c00a660 comp rx=0 tx=0).stop 2024-09-16T01:23:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.707+0000 7fb4698ba640 1 -- 172.21.15.81:0/3659163957 shutdown_connections 2024-09-16T01:23:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.707+0000 7fb4698ba640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb45006c2b0 0x7fb45006e770 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.707+0000 7fb4698ba640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb464162c60 0x7fb46415bcd0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.707+0000 7fb4698ba640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb464162340 0x7fb46415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.707+0000 7fb4698ba640 1 --2- 172.21.15.81:0/3659163957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb4640cf280 0x7fb4641f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.707+0000 7fb4698ba640 1 -- 172.21.15.81:0/3659163957 >> 172.21.15.81:0/3659163957 conn(0x7fb46408bfc0 msgr2=0x7fb4640cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.707+0000 7fb4698ba640 1 -- 172.21.15.81:0/3659163957 shutdown_connections 2024-09-16T01:23:32.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.707+0000 7fb4698ba640 1 -- 172.21.15.81:0/3659163957 wait complete. 2024-09-16T01:23:32.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-09-16T01:23:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.817+0000 7fe6b3b42640 1 Processor -- start 2024-09-16T01:23:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.818+0000 7fe6b3b42640 1 -- start start 2024-09-16T01:23:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.818+0000 7fe6b3b42640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6ac06d740 0x7fe6ac0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.818+0000 7fe6b3b42640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ac15ff70 con 0x7fe6ac162e30 2024-09-16T01:23:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.818+0000 7fe6b3b42640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ac0d4d10 con 0x7fe6ac162340 2024-09-16T01:23:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.818+0000 7fe6b3b42640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ac06de90 con 0x7fe6ac06d740 2024-09-16T01:23:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.819+0000 7fe6b20df640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6ac06d740 0x7fe6ac0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.819+0000 7fe6b20df640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6ac06d740 0x7fe6ac0cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55124/0 (socket says 172.21.15.81:55124) 2024-09-16T01:23:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.819+0000 7fe6b20df640 1 -- 172.21.15.81:0/3057025861 learned_addr learned my addr 172.21.15.81:0/3057025861 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.819+0000 7fe6b10dd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe6ac162e30 0x7fe6ac0d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35386/0 (socket says 172.21.15.81:35386) 2024-09-16T01:23:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.819+0000 7fe6b20df640 1 -- 172.21.15.81:0/3057025861 >> v1:172.21.15.102:6789/0 conn(0x7fe6ac162340 legacy=0x7fe6ac162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.819+0000 7fe6b20df640 1 -- 172.21.15.81:0/3057025861 >> v1:172.21.15.81:6789/0 conn(0x7fe6ac162e30 legacy=0x7fe6ac0d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.819+0000 7fe6b20df640 1 -- 172.21.15.81:0/3057025861 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac0d4ff0 con 0x7fe6ac06d740 2024-09-16T01:23:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.819+0000 7fe6b08dc640 1 -- 172.21.15.81:0/3057025861 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3505298772 0 0) 0x7fe6ac15ff70 con 0x7fe6ac162e30 2024-09-16T01:23:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.820+0000 7fe6b20df640 1 --2- 172.21.15.81:0/3057025861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac06d740 0x7fe6ac0cf280 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009e50 tx=0x7fe6a402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad46fdb56a9087e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.820+0000 7fe6b08dc640 1 -- 172.21.15.81:0/3057025861 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4036070 con 0x7fe6ac06d740 2024-09-16T01:23:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.820+0000 7fe6b08dc640 1 -- 172.21.15.81:0/3057025861 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a4031600 con 0x7fe6ac06d740 2024-09-16T01:23:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.820+0000 7fe6b08dc640 1 -- 172.21.15.81:0/3057025861 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a40319d0 con 0x7fe6ac06d740 2024-09-16T01:23:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.820+0000 7fe6b3b42640 1 -- 172.21.15.81:0/3057025861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac06d740 msgr2=0x7fe6ac0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.820+0000 7fe6b3b42640 1 --2- 172.21.15.81:0/3057025861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac06d740 0x7fe6ac0cf280 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009e50 tx=0x7fe6a402a730 comp rx=0 tx=0).stop 2024-09-16T01:23:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.820+0000 7fe6b3b42640 1 -- 172.21.15.81:0/3057025861 shutdown_connections 2024-09-16T01:23:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.820+0000 7fe6b3b42640 1 --2- 172.21.15.81:0/3057025861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac06d740 0x7fe6ac0cf280 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.820+0000 7fe6b3b42640 1 -- 172.21.15.81:0/3057025861 >> 172.21.15.81:0/3057025861 conn(0x7fe6ac08bfc0 msgr2=0x7fe6ac0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.820+0000 7fe6b3b42640 1 -- 172.21.15.81:0/3057025861 shutdown_connections 2024-09-16T01:23:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.820+0000 7fe6b3b42640 1 -- 172.21.15.81:0/3057025861 wait complete. 2024-09-16T01:23:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.822+0000 7fe6b3b42640 1 Processor -- start 2024-09-16T01:23:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.822+0000 7fe6b3b42640 1 -- start start 2024-09-16T01:23:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.822+0000 7fe6b3b42640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6ac06d740 0x7fe6ac0b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.822+0000 7fe6b3b42640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe6ac162340 0x7fe6ac0d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.822+0000 7fe6b3b42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac162e30 0x7fe6ac0d0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.822+0000 7fe6b3b42640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac163270 con 0x7fe6ac162e30 2024-09-16T01:23:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.822+0000 7fe6b3b42640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac0cf7c0 con 0x7fe6ac06d740 2024-09-16T01:23:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.822+0000 7fe6b3b42640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ac06dbb0 con 0x7fe6ac162340 2024-09-16T01:23:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.822+0000 7fe6b20df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac162e30 0x7fe6ac0d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.822+0000 7fe6b20df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac162e30 0x7fe6ac0d0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55126/0 (socket says 172.21.15.81:55126) 2024-09-16T01:23:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.822+0000 7fe6b20df640 1 -- 172.21.15.81:0/843183464 learned_addr learned my addr 172.21.15.81:0/843183464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6b18de640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6ac06d740 0x7fe6ac0b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6b10dd640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe6ac162340 0x7fe6ac0d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6b20df640 1 -- 172.21.15.81:0/843183464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe6ac162340 msgr2=0x7fe6ac0d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6b20df640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe6ac162340 0x7fe6ac0d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6b20df640 1 -- 172.21.15.81:0/843183464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6ac06d740 msgr2=0x7fe6ac0b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6b20df640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6ac06d740 0x7fe6ac0b6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6b20df640 1 -- 172.21.15.81:0/843183464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac0cbd50 con 0x7fe6ac162e30 2024-09-16T01:23:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6b18de640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6ac06d740 0x7fe6ac0b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6b20df640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac162e30 0x7fe6ac0d0620 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4034040 tx=0x7fe6a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6a27fc640 1 -- 172.21.15.81:0/843183464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4036050 con 0x7fe6ac162e30 2024-09-16T01:23:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6a27fc640 1 -- 172.21.15.81:0/843183464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a4042070 con 0x7fe6ac162e30 2024-09-16T01:23:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6b3b42640 1 -- 172.21.15.81:0/843183464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ac0b6c80 con 0x7fe6ac162e30 2024-09-16T01:23:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6a27fc640 1 -- 172.21.15.81:0/843183464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4009510 con 0x7fe6ac162e30 2024-09-16T01:23:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.823+0000 7fe6b3b42640 1 -- 172.21.15.81:0/843183464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ac0cc2d0 con 0x7fe6ac162e30 2024-09-16T01:23:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.824+0000 7fe6b3b42640 1 -- 172.21.15.81:0/843183464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ac0d52d0 con 0x7fe6ac162e30 2024-09-16T01:23:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.824+0000 7fe6a27fc640 1 -- 172.21.15.81:0/843183464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe6a4007bf0 con 0x7fe6ac162e30 2024-09-16T01:23:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.825+0000 7fe6a27fc640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe69006c2b0 0x7fe69006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.825+0000 7fe6a27fc640 1 -- 172.21.15.81:0/843183464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fe6a40ac420 con 0x7fe6ac162e30 2024-09-16T01:23:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.825+0000 7fe6b18de640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe69006c2b0 0x7fe69006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.825+0000 7fe6b18de640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe69006c2b0 0x7fe69006e770 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8007fd0 tx=0x7fe6a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.829+0000 7fe6a27fc640 1 -- 172.21.15.81:0/843183464 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6a4045360 con 0x7fe6ac162e30 2024-09-16T01:23:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.995+0000 7fe6b3b42640 1 -- 172.21.15.81:0/843183464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7fe6ac08e640 con 0x7fe6ac162e30 2024-09-16T01:23:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.996+0000 7fe6a27fc640 1 -- 172.21.15.81:0/843183464 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v60) ==== 112+0+10 (secure 0 0 0) 0x7fe6a407aa90 con 0x7fe6ac162e30 2024-09-16T01:23:32.997 INFO:teuthology.orchestra.run.smithi081.stdout:60.000000 2024-09-16T01:23:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.998+0000 7fe6b3b42640 1 -- 172.21.15.81:0/843183464 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe69006c2b0 msgr2=0x7fe69006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.998+0000 7fe6b3b42640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe69006c2b0 0x7fe69006e770 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8007fd0 tx=0x7fe6a8009040 comp rx=0 tx=0).stop 2024-09-16T01:23:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.998+0000 7fe6b3b42640 1 -- 172.21.15.81:0/843183464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac162e30 msgr2=0x7fe6ac0d0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.998+0000 7fe6b3b42640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac162e30 0x7fe6ac0d0620 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4034040 tx=0x7fe6a4004a40 comp rx=0 tx=0).stop 2024-09-16T01:23:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.998+0000 7fe6b3b42640 1 -- 172.21.15.81:0/843183464 shutdown_connections 2024-09-16T01:23:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.998+0000 7fe6b3b42640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe69006c2b0 0x7fe69006e770 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.998+0000 7fe6b3b42640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6ac162e30 0x7fe6ac0d0620 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.998+0000 7fe6b3b42640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe6ac162340 0x7fe6ac0d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.998+0000 7fe6b3b42640 1 --2- 172.21.15.81:0/843183464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6ac06d740 0x7fe6ac0b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.998+0000 7fe6b3b42640 1 -- 172.21.15.81:0/843183464 >> 172.21.15.81:0/843183464 conn(0x7fe6ac08bfc0 msgr2=0x7fe6ac162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:33.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.998+0000 7fe6b3b42640 1 -- 172.21.15.81:0/843183464 shutdown_connections 2024-09-16T01:23:33.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:32.998+0000 7fe6b3b42640 1 -- 172.21.15.81:0/843183464 wait complete. 2024-09-16T01:23:33.010 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:33.010 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:33.026 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:23:33.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:23:33.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:33.122 INFO:teuthology.orchestra.run.smithi081.stdout:client7183 2024-09-16T01:23:33.123 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:33.123 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:33.138 DEBUG:teuthology.orchestra.run.smithi081:> stdin-killer -- python3 -c ' 2024-09-16T01:23:33.138 DEBUG:teuthology.orchestra.run.smithi081:> import fcntl 2024-09-16T01:23:33.139 DEBUG:teuthology.orchestra.run.smithi081:> import sys 2024-09-16T01:23:33.139 DEBUG:teuthology.orchestra.run.smithi081:> import time 2024-09-16T01:23:33.139 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-16T01:23:33.139 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:23:33.139 DEBUG:teuthology.orchestra.run.smithi081:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-16T01:23:33.139 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:23:33.139 DEBUG:teuthology.orchestra.run.smithi081:> n = 400 2024-09-16T01:23:33.139 DEBUG:teuthology.orchestra.run.smithi081:> abs_path = "/home/ubuntu/cephtest/mnt.0/." 2024-09-16T01:23:33.139 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:23:33.139 DEBUG:teuthology.orchestra.run.smithi081:> if not os.path.exists(abs_path): 2024-09-16T01:23:33.139 DEBUG:teuthology.orchestra.run.smithi081:> os.makedirs(abs_path) 2024-09-16T01:23:33.140 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:23:33.140 DEBUG:teuthology.orchestra.run.smithi081:> handles = [] 2024-09-16T01:23:33.140 DEBUG:teuthology.orchestra.run.smithi081:> for i in range(0, n): 2024-09-16T01:23:33.140 DEBUG:teuthology.orchestra.run.smithi081:> fname = "file_"+str(i) 2024-09-16T01:23:33.140 DEBUG:teuthology.orchestra.run.smithi081:> path = os.path.join(abs_path, fname) 2024-09-16T01:23:33.140 DEBUG:teuthology.orchestra.run.smithi081:> handles.append(open(path, '"'"'w'"'"')) 2024-09-16T01:23:33.140 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-16T01:23:33.140 DEBUG:teuthology.orchestra.run.smithi081:> print("waiting with handles open", file=sys.stderr) 2024-09-16T01:23:33.140 DEBUG:teuthology.orchestra.run.smithi081:> while True: 2024-09-16T01:23:33.140 DEBUG:teuthology.orchestra.run.smithi081:> print("open_n_background: keeping files open", file=sys.stderr) 2024-09-16T01:23:33.140 DEBUG:teuthology.orchestra.run.smithi081:> try: 2024-09-16T01:23:33.141 DEBUG:teuthology.orchestra.run.smithi081:> if os.read(0, 4096) == b"": 2024-09-16T01:23:33.141 DEBUG:teuthology.orchestra.run.smithi081:> break 2024-09-16T01:23:33.141 DEBUG:teuthology.orchestra.run.smithi081:> except BlockingIOError: 2024-09-16T01:23:33.141 DEBUG:teuthology.orchestra.run.smithi081:> pass 2024-09-16T01:23:33.141 DEBUG:teuthology.orchestra.run.smithi081:> time.sleep(2) 2024-09-16T01:23:33.141 DEBUG:teuthology.orchestra.run.smithi081:> print("stdin closed, goodbye!", file=sys.stderr) 2024-09-16T01:23:33.141 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-16T01:23:33.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.292+0000 7fe392dcf640 1 Processor -- start 2024-09-16T01:23:33.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.292+0000 7fe392dcf640 1 -- start start 2024-09-16T01:23:33.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe392dcf640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe38c161c80 0x7fe38c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:33.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe392dcf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe38c162060 0x7fe38c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:33.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe392dcf640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38c06e870 con 0x7fe38c0b64b0 2024-09-16T01:23:33.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe392dcf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe38c06d9f0 con 0x7fe38c162060 2024-09-16T01:23:33.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe392dcf640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe38c06dcd0 con 0x7fe38c161c80 2024-09-16T01:23:33.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe383fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe38c162060 0x7fe38c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:33.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe383fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe38c162060 0x7fe38c0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55140/0 (socket says 172.21.15.81:55140) 2024-09-16T01:23:33.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe383fff640 1 -- 172.21.15.81:0/1043874212 learned_addr learned my addr 172.21.15.81:0/1043874212 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:33.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe390b6b640 1 --2- 172.21.15.81:0/1043874212 >> v2:172.21.15.102:3300/0 conn(0x7fe38c161c80 0x7fe38c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:33.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe383fff640 1 -- 172.21.15.81:0/1043874212 >> v2:172.21.15.102:3300/0 conn(0x7fe38c161c80 msgr2=0x7fe38c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:33.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe383fff640 1 --2- 172.21.15.81:0/1043874212 >> v2:172.21.15.102:3300/0 conn(0x7fe38c161c80 0x7fe38c06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe383fff640 1 -- 172.21.15.81:0/1043874212 >> v1:172.21.15.102:6789/0 conn(0x7fe38c0b64b0 legacy=0x7fe38c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.293+0000 7fe383fff640 1 -- 172.21.15.81:0/1043874212 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38c06dfb0 con 0x7fe38c162060 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.294+0000 7fe383fff640 1 --2- 172.21.15.81:0/1043874212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe38c162060 0x7fe38c0b5f70 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fe38c08d7a0 tx=0x7fe37c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fbf27c15eb47fb server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.294+0000 7fe3837fe640 1 -- 172.21.15.81:0/1043874212 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c037070 con 0x7fe38c162060 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.294+0000 7fe3837fe640 1 -- 172.21.15.81:0/1043874212 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe37c032440 con 0x7fe38c162060 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.294+0000 7fe3837fe640 1 -- 172.21.15.81:0/1043874212 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe37c032810 con 0x7fe38c162060 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.295+0000 7fe392dcf640 1 -- 172.21.15.81:0/1043874212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe38c162060 msgr2=0x7fe38c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.295+0000 7fe392dcf640 1 --2- 172.21.15.81:0/1043874212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe38c162060 0x7fe38c0b5f70 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fe38c08d7a0 tx=0x7fe37c02a270 comp rx=0 tx=0).stop 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.295+0000 7fe392dcf640 1 -- 172.21.15.81:0/1043874212 shutdown_connections 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.295+0000 7fe392dcf640 1 --2- 172.21.15.81:0/1043874212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe38c162060 0x7fe38c0b5f70 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.295+0000 7fe392dcf640 1 --2- 172.21.15.81:0/1043874212 >> v2:172.21.15.102:3300/0 conn(0x7fe38c161c80 0x7fe38c06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.295+0000 7fe392dcf640 1 -- 172.21.15.81:0/1043874212 >> 172.21.15.81:0/1043874212 conn(0x7fe38c0d44f0 msgr2=0x7fe38c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:33.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.295+0000 7fe392dcf640 1 -- 172.21.15.81:0/1043874212 shutdown_connections 2024-09-16T01:23:33.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.295+0000 7fe392dcf640 1 -- 172.21.15.81:0/1043874212 wait complete. 2024-09-16T01:23:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.296+0000 7fe392dcf640 1 Processor -- start 2024-09-16T01:23:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.296+0000 7fe392dcf640 1 -- start start 2024-09-16T01:23:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.297+0000 7fe392dcf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe38c0b64b0 0x7fe38c155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.297+0000 7fe392dcf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38c161c80 0x7fe38c0b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.297+0000 7fe392dcf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe38c162060 0x7fe38c0b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.297+0000 7fe392dcf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c0d2a10 con 0x7fe38c162060 2024-09-16T01:23:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.297+0000 7fe392dcf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c0d2890 con 0x7fe38c161c80 2024-09-16T01:23:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.297+0000 7fe392dcf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe38c0b6960 con 0x7fe38c0b64b0 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.297+0000 7fe39136c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe38c162060 0x7fe38c0b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.297+0000 7fe39136c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe38c162060 0x7fe38c0b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55144/0 (socket says 172.21.15.81:55144) 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.297+0000 7fe39136c640 1 -- 172.21.15.81:0/303947339 learned_addr learned my addr 172.21.15.81:0/303947339 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.297+0000 7fe383fff640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38c161c80 0x7fe38c0b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.297+0000 7fe390b6b640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe38c0b64b0 0x7fe38c155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.298+0000 7fe39136c640 1 -- 172.21.15.81:0/303947339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe38c0b64b0 msgr2=0x7fe38c155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.298+0000 7fe39136c640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe38c0b64b0 0x7fe38c155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.298+0000 7fe39136c640 1 -- 172.21.15.81:0/303947339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38c161c80 msgr2=0x7fe38c0b8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.298+0000 7fe39136c640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38c161c80 0x7fe38c0b8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.298+0000 7fe39136c640 1 -- 172.21.15.81:0/303947339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38c156100 con 0x7fe38c162060 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.298+0000 7fe39136c640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe38c162060 0x7fe38c0b21e0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fe38400c400 tx=0x7fe38400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.298+0000 7fe3817fa640 1 -- 172.21.15.81:0/303947339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384017070 con 0x7fe38c162060 2024-09-16T01:23:33.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.298+0000 7fe3817fa640 1 -- 172.21.15.81:0/303947339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3840052d0 con 0x7fe38c162060 2024-09-16T01:23:33.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.298+0000 7fe392dcf640 1 -- 172.21.15.81:0/303947339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38c0c87b0 con 0x7fe38c162060 2024-09-16T01:23:33.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.298+0000 7fe3817fa640 1 -- 172.21.15.81:0/303947339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384003810 con 0x7fe38c162060 2024-09-16T01:23:33.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.298+0000 7fe392dcf640 1 -- 172.21.15.81:0/303947339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38c0c8a70 con 0x7fe38c162060 2024-09-16T01:23:33.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.299+0000 7fe392dcf640 1 -- 172.21.15.81:0/303947339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe38c162690 con 0x7fe38c162060 2024-09-16T01:23:33.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.300+0000 7fe3817fa640 1 -- 172.21.15.81:0/303947339 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe38401a070 con 0x7fe38c162060 2024-09-16T01:23:33.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.300+0000 7fe3817fa640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe37806c2b0 0x7fe37806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:33.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.300+0000 7fe3817fa640 1 -- 172.21.15.81:0/303947339 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fe38408a8c0 con 0x7fe38c162060 2024-09-16T01:23:33.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.300+0000 7fe390b6b640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe37806c2b0 0x7fe37806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:33.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.301+0000 7fe390b6b640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe37806c2b0 0x7fe37806e770 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe388003b80 tx=0x7fe3880098d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:33.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.307+0000 7fe3817fa640 1 -- 172.21.15.81:0/303947339 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe38c06e870 con 0x7fe38c162060 2024-09-16T01:23:33.521 INFO:teuthology.orchestra.run.smithi081.stderr:waiting with handles open 2024-09-16T01:23:33.521 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:23:33.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.554+0000 7fe392dcf640 1 -- 172.21.15.81:0/303947339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe38c0ba450 con 0x7fe38c162060 2024-09-16T01:23:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.555+0000 7fe3817fa640 1 -- 172.21.15.81:0/303947339 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5227 (secure 0 0 0) 0x7fe384058850 con 0x7fe38c162060 2024-09-16T01:23:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:33.556 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"btime":"2024-09-16T01:23:21:883930+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/350084010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":350084010},{"type":"v1","addr":"172.21.15.81:6837","nonce":350084010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6389,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1730570681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1730570681},{"type":"v1","addr":"172.21.15.102:6834","nonce":1730570681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/755231532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":755231532},{"type":"v1","addr":"172.21.15.102:6835","nonce":755231532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:23:18.932203+0000","modified":"2024-09-16T01:23:20.934317+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6836/1395000865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1395000865},{"type":"v1","addr":"172.21.15.81:6836","nonce":1395000865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8103,"qdb_cluster":[8103]},"id":10}]} 2024-09-16T01:23:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2024-09-16T01:23:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.557+0000 7fe392dcf640 1 -- 172.21.15.81:0/303947339 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe37806c2b0 msgr2=0x7fe37806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.557+0000 7fe392dcf640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe37806c2b0 0x7fe37806e770 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe388003b80 tx=0x7fe3880098d0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.557+0000 7fe392dcf640 1 -- 172.21.15.81:0/303947339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe38c162060 msgr2=0x7fe38c0b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.557+0000 7fe392dcf640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe38c162060 0x7fe38c0b21e0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fe38400c400 tx=0x7fe38400c8c0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.557+0000 7fe392dcf640 1 -- 172.21.15.81:0/303947339 shutdown_connections 2024-09-16T01:23:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.557+0000 7fe392dcf640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe37806c2b0 0x7fe37806e770 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.557+0000 7fe392dcf640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe38c162060 0x7fe38c0b21e0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.557+0000 7fe392dcf640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe38c161c80 0x7fe38c0b8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.557+0000 7fe392dcf640 1 --2- 172.21.15.81:0/303947339 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe38c0b64b0 0x7fe38c155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.557+0000 7fe392dcf640 1 -- 172.21.15.81:0/303947339 >> 172.21.15.81:0/303947339 conn(0x7fe38c0d44f0 msgr2=0x7fe38c0b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.557+0000 7fe392dcf640 1 -- 172.21.15.81:0/303947339 shutdown_connections 2024-09-16T01:23:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.557+0000 7fe392dcf640 1 -- 172.21.15.81:0/303947339 wait complete. 2024-09-16T01:23:33.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T01:23:33.684 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":7186,"entity":{"name":{"type":"client","num":7186},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":1901454192}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":2.919941057,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9912901885690846,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7186 v1:192.168.0.1:0/1901454192","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi102","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":7183,"entity":{"name":{"type":"client","num":7183},"addr":{"type":"v1","addr":"172.21.15.81:0","nonce":3404736776}},"state":"open","num_leases":400,"num_caps":401,"request_load_avg":424,"uptime":4.039918449,"requests_in_flight":399,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":199.8221749154512,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":193.0089439188842,"halflife":1.5},"recall_caps_throttle2o":{"value":179.75141256051526,"halflife":0.5},"session_cache_liveness":{"value":1201.2037300652958,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.7183 v1:172.21.15.81:0/3404736776","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi081","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-16T01:23:33.685 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi102", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 1901454192, "type": "v1" }, "name": { "num": 7186, "type": "client" } }, "id": 7186, "inst": "client.7186 v1:192.168.0.1:0/1901454192", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9912901885690846 }, "state": "open", "uptime": 2.919941057 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi081", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 3404736776, "type": "v1" }, "name": { "num": 7183, "type": "client" } }, "id": 7183, "inst": "client.7183 v1:172.21.15.81:0/3404736776", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 401, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 400, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 199.8221749154512 }, "recall_caps_throttle": { "halflife": 1.5, "value": 193.0089439188842 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 179.75141256051526 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 424, "requests_in_flight": 399, "session_cache_liveness": { "halflife": 300, "value": 1201.2037300652958 }, "state": "open", "uptime": 4.039918449 } ] 2024-09-16T01:23:33.685 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-09-16T01:23:33.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:23:33.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.781+0000 7fcd98845640 1 Processor -- start 2024-09-16T01:23:33.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.782+0000 7fcd98845640 1 -- start start 2024-09-16T01:23:33.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.782+0000 7fcd98845640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcd94147360 0x7fcd94070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:33.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.782+0000 7fcd98845640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd94070dd0 0x7fcd940d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:33.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.782+0000 7fcd98845640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd9406cb30 con 0x7fcd940d09e0 2024-09-16T01:23:33.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.782+0000 7fcd98845640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fcd9406bfb0 con 0x7fcd94147360 2024-09-16T01:23:33.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.782+0000 7fcd98845640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcd9406c290 con 0x7fcd94070dd0 2024-09-16T01:23:33.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.783+0000 7fcd91d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd94070dd0 0x7fcd940d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:33.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.783+0000 7fcd9259c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcd94147360 0x7fcd94070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:33.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.783+0000 7fcd92d9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fcd940d09e0 0x7fcd9406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:43110/0 (socket says 172.21.15.81:43110) 2024-09-16T01:23:33.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.783+0000 7fcd92d9d640 1 -- 172.21.15.81:0/2871089426 learned_addr learned my addr 172.21.15.81:0/2871089426 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:33.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.783+0000 7fcd9259c640 1 -- 172.21.15.81:0/2871089426 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd94070dd0 msgr2=0x7fcd940d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:33.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.783+0000 7fcd9259c640 1 --2- 172.21.15.81:0/2871089426 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd94070dd0 0x7fcd940d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.783+0000 7fcd9259c640 1 -- 172.21.15.81:0/2871089426 >> v1:172.21.15.102:6789/0 conn(0x7fcd940d09e0 legacy=0x7fcd9406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:33.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.783+0000 7fcd9259c640 1 -- 172.21.15.81:0/2871089426 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9406c570 con 0x7fcd94147360 2024-09-16T01:23:33.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.783+0000 7fcd9159a640 1 -- 172.21.15.81:0/2871089426 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1950062523 0 0) 0x7fcd9406cb30 con 0x7fcd940d09e0 2024-09-16T01:23:33.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.784+0000 7fcd9259c640 1 --2- 172.21.15.81:0/2871089426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd94147360 0x7fcd94070890 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009d90 tx=0x7fcd8c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adb33d7bee48f935 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:33.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.784+0000 7fcd9159a640 1 -- 172.21.15.81:0/2871089426 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c031600 con 0x7fcd94147360 2024-09-16T01:23:33.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.784+0000 7fcd9159a640 1 -- 172.21.15.81:0/2871089426 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0317a0 con 0x7fcd94147360 2024-09-16T01:23:33.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.784+0000 7fcd9159a640 1 -- 172.21.15.81:0/2871089426 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c031b70 con 0x7fcd94147360 2024-09-16T01:23:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.785+0000 7fcd98845640 1 -- 172.21.15.81:0/2871089426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd94147360 msgr2=0x7fcd94070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.785+0000 7fcd98845640 1 --2- 172.21.15.81:0/2871089426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd94147360 0x7fcd94070890 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009d90 tx=0x7fcd8c02a5d0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.785+0000 7fcd98845640 1 -- 172.21.15.81:0/2871089426 shutdown_connections 2024-09-16T01:23:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.785+0000 7fcd98845640 1 --2- 172.21.15.81:0/2871089426 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd94070dd0 0x7fcd940d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.785+0000 7fcd98845640 1 --2- 172.21.15.81:0/2871089426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd94147360 0x7fcd94070890 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.785+0000 7fcd98845640 1 -- 172.21.15.81:0/2871089426 >> 172.21.15.81:0/2871089426 conn(0x7fcd940b2f40 msgr2=0x7fcd940b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.785+0000 7fcd98845640 1 -- 172.21.15.81:0/2871089426 shutdown_connections 2024-09-16T01:23:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.785+0000 7fcd98845640 1 -- 172.21.15.81:0/2871089426 wait complete. 2024-09-16T01:23:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.786+0000 7fcd98845640 1 Processor -- start 2024-09-16T01:23:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.786+0000 7fcd98845640 1 -- start start 2024-09-16T01:23:33.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.787+0000 7fcd98845640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd94070dd0 0x7fcd940b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:33.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.787+0000 7fcd98845640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd940d09e0 0x7fcd941586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:33.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.787+0000 7fcd98845640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd94147360 0x7fcd9413f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.787+0000 7fcd98845640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9406bc10 con 0x7fcd94147360 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.787+0000 7fcd98845640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcd940d0e10 con 0x7fcd94070dd0 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.787+0000 7fcd98845640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcd9406bd90 con 0x7fcd940d09e0 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.787+0000 7fcd9259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd94070dd0 0x7fcd940b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.787+0000 7fcd92d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd94147360 0x7fcd9413f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.787+0000 7fcd9259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd94070dd0 0x7fcd940b56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:46332/0 (socket says 172.21.15.81:46332) 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.787+0000 7fcd91d9b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd940d09e0 0x7fcd941586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.787+0000 7fcd9259c640 1 -- 172.21.15.81:0/584700464 learned_addr learned my addr 172.21.15.81:0/584700464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.788+0000 7fcd92d9d640 1 -- 172.21.15.81:0/584700464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd940d09e0 msgr2=0x7fcd941586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.788+0000 7fcd92d9d640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd940d09e0 0x7fcd941586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.788+0000 7fcd92d9d640 1 -- 172.21.15.81:0/584700464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd94070dd0 msgr2=0x7fcd940b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.788+0000 7fcd92d9d640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd94070dd0 0x7fcd940b56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:33.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.788+0000 7fcd92d9d640 1 -- 172.21.15.81:0/584700464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd94158be0 con 0x7fcd94147360 2024-09-16T01:23:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.788+0000 7fcd91d9b640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd940d09e0 0x7fcd941586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.788+0000 7fcd92d9d640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd94147360 0x7fcd9413f120 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fcd84007fd0 tx=0x7fcd8400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.788+0000 7fcd8affd640 1 -- 172.21.15.81:0/584700464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd840074e0 con 0x7fcd94147360 2024-09-16T01:23:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.788+0000 7fcd8affd640 1 -- 172.21.15.81:0/584700464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd84007680 con 0x7fcd94147360 2024-09-16T01:23:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.788+0000 7fcd8affd640 1 -- 172.21.15.81:0/584700464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd84004a20 con 0x7fcd94147360 2024-09-16T01:23:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.788+0000 7fcd98845640 1 -- 172.21.15.81:0/584700464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9413d1b0 con 0x7fcd94147360 2024-09-16T01:23:33.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.788+0000 7fcd98845640 1 -- 172.21.15.81:0/584700464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9413d770 con 0x7fcd94147360 2024-09-16T01:23:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.789+0000 7fcd98845640 1 -- 172.21.15.81:0/584700464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd940d04a0 con 0x7fcd94147360 2024-09-16T01:23:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.789+0000 7fcd8affd640 1 -- 172.21.15.81:0/584700464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcd84011070 con 0x7fcd94147360 2024-09-16T01:23:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.790+0000 7fcd8affd640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd7406c2b0 0x7fcd7406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.790+0000 7fcd8affd640 1 -- 172.21.15.81:0/584700464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fcd8408af10 con 0x7fcd94147360 2024-09-16T01:23:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.790+0000 7fcd9259c640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd7406c2b0 0x7fcd7406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:33.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.790+0000 7fcd9259c640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd7406c2b0 0x7fcd7406e770 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009bd0 tx=0x7fcd8c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:33.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.794+0000 7fcd8affd640 1 -- 172.21.15.81:0/584700464 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd84058f30 con 0x7fcd94147360 2024-09-16T01:23:33.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.997+0000 7fcd98845640 1 -- 172.21.15.81:0/584700464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcd9406dfa0 con 0x7fcd94147360 2024-09-16T01:23:33.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:33.998+0000 7fcd8affd640 1 -- 172.21.15.81:0/584700464 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fcd8405d230 con 0x7fcd94147360 2024-09-16T01:23:33.999 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:33.999 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T01:23:34.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:34.000+0000 7fcd98845640 1 -- 172.21.15.81:0/584700464 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd7406c2b0 msgr2=0x7fcd7406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:34.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:34.000+0000 7fcd98845640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd7406c2b0 0x7fcd7406e770 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009bd0 tx=0x7fcd8c02f000 comp rx=0 tx=0).stop 2024-09-16T01:23:34.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:34.000+0000 7fcd98845640 1 -- 172.21.15.81:0/584700464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd94147360 msgr2=0x7fcd9413f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:34.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:34.000+0000 7fcd98845640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd94147360 0x7fcd9413f120 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fcd84007fd0 tx=0x7fcd8400c870 comp rx=0 tx=0).stop 2024-09-16T01:23:34.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:34.000+0000 7fcd98845640 1 -- 172.21.15.81:0/584700464 shutdown_connections 2024-09-16T01:23:34.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:34.000+0000 7fcd98845640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fcd7406c2b0 0x7fcd7406e770 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:34.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:34.000+0000 7fcd98845640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd94147360 0x7fcd9413f120 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:34.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:34.000+0000 7fcd98845640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd940d09e0 0x7fcd941586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:34.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:34.000+0000 7fcd98845640 1 --2- 172.21.15.81:0/584700464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd94070dd0 0x7fcd940b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:34.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:34.000+0000 7fcd98845640 1 -- 172.21.15.81:0/584700464 >> 172.21.15.81:0/584700464 conn(0x7fcd940b2f40 msgr2=0x7fcd9406f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:34.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:34.000+0000 7fcd98845640 1 -- 172.21.15.81:0/584700464 shutdown_connections 2024-09-16T01:23:34.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:34.000+0000 7fcd98845640 1 -- 172.21.15.81:0/584700464 wait complete. 2024-09-16T01:23:34.011 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2024-09-16T01:23:34.011 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:23:35.525 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:23:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:23:39.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:23:39.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.126+0000 7fb13c926640 1 Processor -- start 2024-09-16T01:23:39.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.126+0000 7fb13c926640 1 -- start start 2024-09-16T01:23:39.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb13c926640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1380720b0 0x7fb1380cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:39.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb13c926640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb138162ad0 0x7fb13806f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:39.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb13c926640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1380b49a0 con 0x7fb138072490 2024-09-16T01:23:39.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb13c926640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb1380afa20 con 0x7fb1380720b0 2024-09-16T01:23:39.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb13c926640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb1380afce0 con 0x7fb138162ad0 2024-09-16T01:23:39.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb13659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1380720b0 0x7fb1380cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:39.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb136d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb138072490 0x7fb1380b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35388/0 (socket says 172.21.15.81:35388) 2024-09-16T01:23:39.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb136d9d640 1 -- 172.21.15.81:0/1225589719 learned_addr learned my addr 172.21.15.81:0/1225589719 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:39.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb13659c640 1 --2- 172.21.15.81:0/1225589719 >> v2:172.21.15.81:3300/0 conn(0x7fb1380720b0 0x7fb1380cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55162/0 (socket says 172.21.15.81:55162) 2024-09-16T01:23:39.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb135d9b640 1 --2- 172.21.15.81:0/1225589719 >> v2:172.21.15.102:3300/0 conn(0x7fb138162ad0 0x7fb13806f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:39.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb13659c640 1 -- 172.21.15.81:0/1225589719 >> v2:172.21.15.102:3300/0 conn(0x7fb138162ad0 msgr2=0x7fb13806f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:39.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb13659c640 1 --2- 172.21.15.81:0/1225589719 >> v2:172.21.15.102:3300/0 conn(0x7fb138162ad0 0x7fb13806f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:39.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb13659c640 1 -- 172.21.15.81:0/1225589719 >> v1:172.21.15.81:6789/0 conn(0x7fb138072490 legacy=0x7fb1380b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:39.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb13659c640 1 -- 172.21.15.81:0/1225589719 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1380b34d0 con 0x7fb1380720b0 2024-09-16T01:23:39.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.127+0000 7fb13559a640 1 -- 172.21.15.81:0/1225589719 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4241119154 0 0) 0x7fb1380b49a0 con 0x7fb138072490 2024-09-16T01:23:39.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.128+0000 7fb13659c640 1 --2- 172.21.15.81:0/1225589719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1380720b0 0x7fb1380cfca0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fb138072d20 tx=0x7fb12802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb4fd1f49da63d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:39.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.128+0000 7fb13559a640 1 -- 172.21.15.81:0/1225589719 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128037070 con 0x7fb1380720b0 2024-09-16T01:23:39.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.128+0000 7fb13559a640 1 -- 172.21.15.81:0/1225589719 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb128032440 con 0x7fb1380720b0 2024-09-16T01:23:39.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.128+0000 7fb13559a640 1 -- 172.21.15.81:0/1225589719 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128032810 con 0x7fb1380720b0 2024-09-16T01:23:39.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.129+0000 7fb13c926640 1 -- 172.21.15.81:0/1225589719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1380720b0 msgr2=0x7fb1380cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:39.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.129+0000 7fb13c926640 1 --2- 172.21.15.81:0/1225589719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1380720b0 0x7fb1380cfca0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fb138072d20 tx=0x7fb12802a1a0 comp rx=0 tx=0).stop 2024-09-16T01:23:39.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.129+0000 7fb13c926640 1 -- 172.21.15.81:0/1225589719 shutdown_connections 2024-09-16T01:23:39.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.129+0000 7fb13c926640 1 --2- 172.21.15.81:0/1225589719 >> v2:172.21.15.102:3300/0 conn(0x7fb138162ad0 0x7fb13806f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:39.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.129+0000 7fb13c926640 1 --2- 172.21.15.81:0/1225589719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1380720b0 0x7fb1380cfca0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:39.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.129+0000 7fb13c926640 1 -- 172.21.15.81:0/1225589719 >> 172.21.15.81:0/1225589719 conn(0x7fb138067d70 msgr2=0x7fb13806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:39.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.129+0000 7fb13c926640 1 -- 172.21.15.81:0/1225589719 shutdown_connections 2024-09-16T01:23:39.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.129+0000 7fb13c926640 1 -- 172.21.15.81:0/1225589719 wait complete. 2024-09-16T01:23:39.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.130+0000 7fb13c926640 1 Processor -- start 2024-09-16T01:23:39.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.130+0000 7fb13c926640 1 -- start start 2024-09-16T01:23:39.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.131+0000 7fb13c926640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1380720b0 0x7fb138158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:39.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.131+0000 7fb13c926640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb138072490 0x7fb13815cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:39.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.131+0000 7fb13c926640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb138162ad0 0x7fb13815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:39.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.131+0000 7fb13c926640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1380b3d70 con 0x7fb138072490 2024-09-16T01:23:39.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.131+0000 7fb13c926640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb1380b3a90 con 0x7fb138162ad0 2024-09-16T01:23:39.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.131+0000 7fb13c926640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb138072900 con 0x7fb1380720b0 2024-09-16T01:23:39.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.131+0000 7fb135d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb138072490 0x7fb13815cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.131+0000 7fb135d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb138072490 0x7fb13815cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55166/0 (socket says 172.21.15.81:55166) 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.131+0000 7fb135d9b640 1 -- 172.21.15.81:0/1606983314 learned_addr learned my addr 172.21.15.81:0/1606983314 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb136d9d640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb138162ad0 0x7fb13815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb13659c640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1380720b0 0x7fb138158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb135d9b640 1 -- 172.21.15.81:0/1606983314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1380720b0 msgr2=0x7fb138158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb135d9b640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1380720b0 0x7fb138158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb135d9b640 1 -- 172.21.15.81:0/1606983314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb138162ad0 msgr2=0x7fb13815b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb135d9b640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb138162ad0 0x7fb13815b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb135d9b640 1 -- 172.21.15.81:0/1606983314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13815b100 con 0x7fb138072490 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb136d9d640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb138162ad0 0x7fb13815b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb13659c640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1380720b0 0x7fb138158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb135d9b640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb138072490 0x7fb13815cbe0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fb12c00d5f0 tx=0x7fb12c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:39.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb126ffd640 1 -- 172.21.15.81:0/1606983314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0125f0 con 0x7fb138072490 2024-09-16T01:23:39.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb126ffd640 1 -- 172.21.15.81:0/1606983314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12c019070 con 0x7fb138072490 2024-09-16T01:23:39.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb13c926640 1 -- 172.21.15.81:0/1606983314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1381eb050 con 0x7fb138072490 2024-09-16T01:23:39.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb126ffd640 1 -- 172.21.15.81:0/1606983314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0129d0 con 0x7fb138072490 2024-09-16T01:23:39.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.132+0000 7fb13c926640 1 -- 172.21.15.81:0/1606983314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb13815b3a0 con 0x7fb138072490 2024-09-16T01:23:39.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.133+0000 7fb13c926640 1 -- 172.21.15.81:0/1606983314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1380ced10 con 0x7fb138072490 2024-09-16T01:23:39.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.134+0000 7fb126ffd640 1 -- 172.21.15.81:0/1606983314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb12c012b70 con 0x7fb138072490 2024-09-16T01:23:39.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.134+0000 7fb126ffd640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb11806c2b0 0x7fb11806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:39.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.134+0000 7fb126ffd640 1 -- 172.21.15.81:0/1606983314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fb12c08b920 con 0x7fb138072490 2024-09-16T01:23:39.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.134+0000 7fb13659c640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb11806c2b0 0x7fb11806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:39.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.135+0000 7fb13659c640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb11806c2b0 0x7fb11806e770 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb128034000 tx=0x7fb12802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:39.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.138+0000 7fb126ffd640 1 -- 172.21.15.81:0/1606983314 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb12c059f90 con 0x7fb138072490 2024-09-16T01:23:39.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.341+0000 7fb13c926640 1 -- 172.21.15.81:0/1606983314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb13815d120 con 0x7fb138072490 2024-09-16T01:23:39.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.341+0000 7fb126ffd640 1 -- 172.21.15.81:0/1606983314 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fb12c059890 con 0x7fb138072490 2024-09-16T01:23:39.342 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:39.342 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:23:39.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.343+0000 7fb13c926640 1 -- 172.21.15.81:0/1606983314 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb11806c2b0 msgr2=0x7fb11806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:39.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.343+0000 7fb13c926640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb11806c2b0 0x7fb11806e770 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb128034000 tx=0x7fb12802e000 comp rx=0 tx=0).stop 2024-09-16T01:23:39.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.343+0000 7fb13c926640 1 -- 172.21.15.81:0/1606983314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb138072490 msgr2=0x7fb13815cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.343+0000 7fb13c926640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb138072490 0x7fb13815cbe0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fb12c00d5f0 tx=0x7fb12c00dab0 comp rx=0 tx=0).stop 2024-09-16T01:23:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.343+0000 7fb13c926640 1 -- 172.21.15.81:0/1606983314 shutdown_connections 2024-09-16T01:23:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.343+0000 7fb13c926640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb11806c2b0 0x7fb11806e770 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.343+0000 7fb13c926640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb138162ad0 0x7fb13815b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.343+0000 7fb13c926640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb138072490 0x7fb13815cbe0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.343+0000 7fb13c926640 1 --2- 172.21.15.81:0/1606983314 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1380720b0 0x7fb138158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.343+0000 7fb13c926640 1 -- 172.21.15.81:0/1606983314 >> 172.21.15.81:0/1606983314 conn(0x7fb138067d70 msgr2=0x7fb13806e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.343+0000 7fb13c926640 1 -- 172.21.15.81:0/1606983314 shutdown_connections 2024-09-16T01:23:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:39.344+0000 7fb13c926640 1 -- 172.21.15.81:0/1606983314 wait complete. 2024-09-16T01:23:39.355 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-16T01:23:39.355 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-16T01:23:39.528 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:23:39.832 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:23:39.834 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:23:41.530 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:23:43.532 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:23:44.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:23:44.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.465+0000 7fc46cbc4640 1 Processor -- start 2024-09-16T01:23:44.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.465+0000 7fc46cbc4640 1 -- start start 2024-09-16T01:23:44.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.466+0000 7fc46cbc4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc46815b300 0x7fc4680cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:44.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.466+0000 7fc46cbc4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc4680cd3f0 0x7fc46806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:44.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.466+0000 7fc46cbc4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4680cdbe0 con 0x7fc468072d30 2024-09-16T01:23:44.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.466+0000 7fc46cbc4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc4680728a0 con 0x7fc4680cd3f0 2024-09-16T01:23:44.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.466+0000 7fc46cbc4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc4680cd900 con 0x7fc46815b300 2024-09-16T01:23:44.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.467+0000 7fc46659c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc46815b300 0x7fc4680cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:44.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.467+0000 7fc465d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc4680cd3f0 0x7fc46806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:44.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.467+0000 7fc465d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc4680cd3f0 0x7fc46806f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:43178/0 (socket says 172.21.15.81:43178) 2024-09-16T01:23:44.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.467+0000 7fc466d9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc468072d30 0x7fc4680b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:53576/0 (socket says 172.21.15.81:53576) 2024-09-16T01:23:44.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.467+0000 7fc465d9b640 1 -- 172.21.15.81:0/3658333002 learned_addr learned my addr 172.21.15.81:0/3658333002 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:44.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.467+0000 7fc46659c640 1 -- 172.21.15.81:0/3658333002 >> v2:172.21.15.102:3300/0 conn(0x7fc4680cd3f0 msgr2=0x7fc46806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:44.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.467+0000 7fc46659c640 1 --2- 172.21.15.81:0/3658333002 >> v2:172.21.15.102:3300/0 conn(0x7fc4680cd3f0 0x7fc46806f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.467+0000 7fc46659c640 1 -- 172.21.15.81:0/3658333002 >> v1:172.21.15.102:6789/0 conn(0x7fc468072d30 legacy=0x7fc4680b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:44.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.467+0000 7fc46659c640 1 -- 172.21.15.81:0/3658333002 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc468072250 con 0x7fc46815b300 2024-09-16T01:23:44.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.467+0000 7fc465d9b640 1 --2- 172.21.15.81:0/3658333002 >> v2:172.21.15.102:3300/0 conn(0x7fc4680cd3f0 0x7fc46806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:44.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.468+0000 7fc46659c640 1 --2- 172.21.15.81:0/3658333002 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc46815b300 0x7fc4680cceb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc458009d90 tx=0x7fc45802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=750175e391c13e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:44.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.468+0000 7fc46559a640 1 -- 172.21.15.81:0/3658333002 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458007740 con 0x7fc46815b300 2024-09-16T01:23:44.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.468+0000 7fc46559a640 1 -- 172.21.15.81:0/3658333002 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4580078e0 con 0x7fc46815b300 2024-09-16T01:23:44.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.468+0000 7fc46559a640 1 -- 172.21.15.81:0/3658333002 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458007cb0 con 0x7fc46815b300 2024-09-16T01:23:44.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.469+0000 7fc46cbc4640 1 -- 172.21.15.81:0/3658333002 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc46815b300 msgr2=0x7fc4680cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:44.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.469+0000 7fc46cbc4640 1 --2- 172.21.15.81:0/3658333002 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc46815b300 0x7fc4680cceb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc458009d90 tx=0x7fc45802a660 comp rx=0 tx=0).stop 2024-09-16T01:23:44.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.469+0000 7fc46cbc4640 1 -- 172.21.15.81:0/3658333002 shutdown_connections 2024-09-16T01:23:44.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.469+0000 7fc46cbc4640 1 --2- 172.21.15.81:0/3658333002 >> v2:172.21.15.102:3300/0 conn(0x7fc4680cd3f0 0x7fc46806f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.469+0000 7fc46cbc4640 1 --2- 172.21.15.81:0/3658333002 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc46815b300 0x7fc4680cceb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.469+0000 7fc46cbc4640 1 -- 172.21.15.81:0/3658333002 >> 172.21.15.81:0/3658333002 conn(0x7fc468067d70 msgr2=0x7fc46806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:44.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.469+0000 7fc46cbc4640 1 -- 172.21.15.81:0/3658333002 shutdown_connections 2024-09-16T01:23:44.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.469+0000 7fc46cbc4640 1 -- 172.21.15.81:0/3658333002 wait complete. 2024-09-16T01:23:44.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.470+0000 7fc46cbc4640 1 Processor -- start 2024-09-16T01:23:44.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.470+0000 7fc46cbc4640 1 -- start start 2024-09-16T01:23:44.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46cbc4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc468072d30 0x7fc4680cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:44.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46cbc4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4680cd3f0 0x7fc468150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:44.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46cbc4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc46815b300 0x7fc4681f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46cbc4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4680d0160 con 0x7fc468072d30 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46cbc4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc4680cffe0 con 0x7fc4680cd3f0 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46cbc4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc46806f700 con 0x7fc46815b300 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc468072d30 0x7fc4680cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc468072d30 0x7fc4680cad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36476/0 (socket says 172.21.15.81:36476) 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46659c640 1 -- 172.21.15.81:0/727681931 learned_addr learned my addr 172.21.15.81:0/727681931 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc466d9d640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc46815b300 0x7fc4681f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc465d9b640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4680cd3f0 0x7fc468150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46659c640 1 -- 172.21.15.81:0/727681931 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc46815b300 msgr2=0x7fc4681f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46659c640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc46815b300 0x7fc4681f5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46659c640 1 -- 172.21.15.81:0/727681931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4680cd3f0 msgr2=0x7fc468150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46659c640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4680cd3f0 0x7fc468150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46659c640 1 -- 172.21.15.81:0/727681931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4681f5fa0 con 0x7fc468072d30 2024-09-16T01:23:44.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc466d9d640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc46815b300 0x7fc4681f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:44.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc465d9b640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4680cd3f0 0x7fc468150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:44.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.471+0000 7fc46659c640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc468072d30 0x7fc4680cad30 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fc458009eb0 tx=0x7fc458004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:44.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.472+0000 7fc456ffd640 1 -- 172.21.15.81:0/727681931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45803f070 con 0x7fc468072d30 2024-09-16T01:23:44.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.472+0000 7fc456ffd640 1 -- 172.21.15.81:0/727681931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc458031c40 con 0x7fc468072d30 2024-09-16T01:23:44.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.472+0000 7fc456ffd640 1 -- 172.21.15.81:0/727681931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458009450 con 0x7fc468072d30 2024-09-16T01:23:44.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.472+0000 7fc46cbc4640 1 -- 172.21.15.81:0/727681931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4681f6280 con 0x7fc468072d30 2024-09-16T01:23:44.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.472+0000 7fc46cbc4640 1 -- 172.21.15.81:0/727681931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4681f2270 con 0x7fc468072d30 2024-09-16T01:23:44.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.473+0000 7fc46cbc4640 1 -- 172.21.15.81:0/727681931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc468159ec0 con 0x7fc468072d30 2024-09-16T01:23:44.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.473+0000 7fc456ffd640 1 -- 172.21.15.81:0/727681931 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc45803b410 con 0x7fc468072d30 2024-09-16T01:23:44.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.473+0000 7fc456ffd640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc44806c2b0 0x7fc44806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:44.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.474+0000 7fc456ffd640 1 -- 172.21.15.81:0/727681931 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fc4580aca70 con 0x7fc468072d30 2024-09-16T01:23:44.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.474+0000 7fc465d9b640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc44806c2b0 0x7fc44806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:44.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.474+0000 7fc465d9b640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc44806c2b0 0x7fc44806e770 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009630 tx=0x7fc45c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:44.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.478+0000 7fc456ffd640 1 -- 172.21.15.81:0/727681931 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc45807b050 con 0x7fc468072d30 2024-09-16T01:23:44.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.679+0000 7fc46cbc4640 1 -- 172.21.15.81:0/727681931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc46815c190 con 0x7fc468072d30 2024-09-16T01:23:44.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.679+0000 7fc456ffd640 1 -- 172.21.15.81:0/727681931 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7fc45807a950 con 0x7fc468072d30 2024-09-16T01:23:44.680 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:44.680 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:23:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.681+0000 7fc46cbc4640 1 -- 172.21.15.81:0/727681931 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc44806c2b0 msgr2=0x7fc44806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.681+0000 7fc46cbc4640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc44806c2b0 0x7fc44806e770 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009630 tx=0x7fc45c008040 comp rx=0 tx=0).stop 2024-09-16T01:23:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.681+0000 7fc46cbc4640 1 -- 172.21.15.81:0/727681931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc468072d30 msgr2=0x7fc4680cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.681+0000 7fc46cbc4640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc468072d30 0x7fc4680cad30 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fc458009eb0 tx=0x7fc458004a40 comp rx=0 tx=0).stop 2024-09-16T01:23:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.681+0000 7fc46cbc4640 1 -- 172.21.15.81:0/727681931 shutdown_connections 2024-09-16T01:23:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.681+0000 7fc46cbc4640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc44806c2b0 0x7fc44806e770 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.681+0000 7fc46cbc4640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc46815b300 0x7fc4681f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.681+0000 7fc46cbc4640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4680cd3f0 0x7fc468150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.681+0000 7fc46cbc4640 1 --2- 172.21.15.81:0/727681931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc468072d30 0x7fc4680cad30 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.681+0000 7fc46cbc4640 1 -- 172.21.15.81:0/727681931 >> 172.21.15.81:0/727681931 conn(0x7fc468067d70 msgr2=0x7fc4680b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.681+0000 7fc46cbc4640 1 -- 172.21.15.81:0/727681931 shutdown_connections 2024-09-16T01:23:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.681+0000 7fc46cbc4640 1 -- 172.21.15.81:0/727681931 wait complete. 2024-09-16T01:23:44.693 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-16T01:23:44.693 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-09-16T01:23:44.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-16T01:23:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.790+0000 7f3a246d0640 1 Processor -- start 2024-09-16T01:23:44.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.790+0000 7f3a246d0640 1 -- start start 2024-09-16T01:23:44.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.791+0000 7f3a246d0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3a1c072d30 0x7f3a1c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:44.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.791+0000 7f3a246d0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a1c06f700 0x7f3a1c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.791+0000 7f3a246d0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a1c0cdbe0 con 0x7f3a1c15b300 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.791+0000 7f3a246d0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3a1c0728a0 con 0x7f3a1c072d30 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.791+0000 7f3a246d0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3a1c06fb30 con 0x7f3a1c06f700 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.791+0000 7f3a21c6b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3a1c072d30 0x7f3a1c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.791+0000 7f3a2246c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3a1c15b300 0x7f3a1c0cceb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46012/0 (socket says 172.21.15.81:46012) 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.791+0000 7f3a2246c640 1 -- 172.21.15.81:0/3357484562 learned_addr learned my addr 172.21.15.81:0/3357484562 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.791+0000 7f3a22c6d640 1 --2- 172.21.15.81:0/3357484562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a1c06f700 0x7f3a1c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.792+0000 7f3a21c6b640 1 -- 172.21.15.81:0/3357484562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a1c06f700 msgr2=0x7f3a1c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.792+0000 7f3a21c6b640 1 --2- 172.21.15.81:0/3357484562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a1c06f700 0x7f3a1c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.792+0000 7f3a21c6b640 1 -- 172.21.15.81:0/3357484562 >> v1:172.21.15.81:6789/0 conn(0x7f3a1c15b300 legacy=0x7f3a1c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.792+0000 7f3a21c6b640 1 -- 172.21.15.81:0/3357484562 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1c0cd900 con 0x7f3a1c072d30 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.792+0000 7f3a2146a640 1 -- 172.21.15.81:0/3357484562 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531200812 0 0) 0x7f3a1c0cdbe0 con 0x7f3a1c15b300 2024-09-16T01:23:44.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.792+0000 7f3a22c6d640 1 --2- 172.21.15.81:0/3357484562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a1c06f700 0x7f3a1c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.792+0000 7f3a21c6b640 1 --2- 172.21.15.81:0/3357484562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a1c072d30 0x7f3a1c06f1c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0097a0 tx=0x7f3a0c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883d188d253b970c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.792+0000 7f3a2146a640 1 -- 172.21.15.81:0/3357484562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c037070 con 0x7f3a1c072d30 2024-09-16T01:23:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.792+0000 7f3a2146a640 1 -- 172.21.15.81:0/3357484562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a0c02ae50 con 0x7f3a1c072d30 2024-09-16T01:23:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.792+0000 7f3a2146a640 1 -- 172.21.15.81:0/3357484562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c032660 con 0x7f3a1c072d30 2024-09-16T01:23:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.793+0000 7f3a246d0640 1 -- 172.21.15.81:0/3357484562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a1c072d30 msgr2=0x7f3a1c06f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.793+0000 7f3a246d0640 1 --2- 172.21.15.81:0/3357484562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a1c072d30 0x7f3a1c06f1c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0097a0 tx=0x7f3a0c02a100 comp rx=0 tx=0).stop 2024-09-16T01:23:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.793+0000 7f3a246d0640 1 -- 172.21.15.81:0/3357484562 shutdown_connections 2024-09-16T01:23:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.793+0000 7f3a246d0640 1 --2- 172.21.15.81:0/3357484562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a1c06f700 0x7f3a1c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.793+0000 7f3a246d0640 1 --2- 172.21.15.81:0/3357484562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a1c072d30 0x7f3a1c06f1c0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.793+0000 7f3a246d0640 1 -- 172.21.15.81:0/3357484562 >> 172.21.15.81:0/3357484562 conn(0x7f3a1c067d70 msgr2=0x7f3a1c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:44.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.793+0000 7f3a246d0640 1 -- 172.21.15.81:0/3357484562 shutdown_connections 2024-09-16T01:23:44.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.793+0000 7f3a246d0640 1 -- 172.21.15.81:0/3357484562 wait complete. 2024-09-16T01:23:44.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.794+0000 7f3a246d0640 1 Processor -- start 2024-09-16T01:23:44.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.794+0000 7f3a246d0640 1 -- start start 2024-09-16T01:23:44.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a246d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a1c06f700 0x7f3a1c142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:44.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a246d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a1c072d30 0x7f3a1c1541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:44.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a246d0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a1c15b300 0x7f3a1c154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:44.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a246d0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c0cd5c0 con 0x7f3a1c072d30 2024-09-16T01:23:44.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a246d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c072530 con 0x7f3a1c06f700 2024-09-16T01:23:44.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a246d0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3a1c0cffe0 con 0x7f3a1c15b300 2024-09-16T01:23:44.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a21c6b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a1c072d30 0x7f3a1c1541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a21c6b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a1c072d30 0x7f3a1c1541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36488/0 (socket says 172.21.15.81:36488) 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a21c6b640 1 -- 172.21.15.81:0/4081894369 learned_addr learned my addr 172.21.15.81:0/4081894369 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a22c6d640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a1c15b300 0x7f3a1c154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a2246c640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a1c06f700 0x7f3a1c142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a21c6b640 1 -- 172.21.15.81:0/4081894369 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a1c15b300 msgr2=0x7f3a1c154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a21c6b640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a1c15b300 0x7f3a1c154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a21c6b640 1 -- 172.21.15.81:0/4081894369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a1c06f700 msgr2=0x7f3a1c142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a21c6b640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a1c06f700 0x7f3a1c142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a21c6b640 1 -- 172.21.15.81:0/4081894369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1c145a80 con 0x7f3a1c072d30 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.795+0000 7f3a2246c640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a1c06f700 0x7f3a1c142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.796+0000 7f3a21c6b640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a1c072d30 0x7f3a1c1541c0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0098c0 tx=0x7f3a0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.796+0000 7f3a12ffd640 1 -- 172.21.15.81:0/4081894369 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c041030 con 0x7f3a1c072d30 2024-09-16T01:23:44.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.796+0000 7f3a12ffd640 1 -- 172.21.15.81:0/4081894369 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a0c02ac50 con 0x7f3a1c072d30 2024-09-16T01:23:44.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.796+0000 7f3a246d0640 1 -- 172.21.15.81:0/4081894369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1c1565d0 con 0x7f3a1c072d30 2024-09-16T01:23:44.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.796+0000 7f3a12ffd640 1 -- 172.21.15.81:0/4081894369 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c037040 con 0x7f3a1c072d30 2024-09-16T01:23:44.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.796+0000 7f3a246d0640 1 -- 172.21.15.81:0/4081894369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1c156b90 con 0x7f3a1c072d30 2024-09-16T01:23:44.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.797+0000 7f3a246d0640 1 -- 172.21.15.81:0/4081894369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a1c0b59d0 con 0x7f3a1c072d30 2024-09-16T01:23:44.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.797+0000 7f3a12ffd640 1 -- 172.21.15.81:0/4081894369 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3a0c044070 con 0x7f3a1c072d30 2024-09-16T01:23:44.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.798+0000 7f3a12ffd640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a0006c2b0 0x7f3a0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:44.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.798+0000 7f3a2246c640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a0006c2b0 0x7f3a0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:44.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.798+0000 7f3a12ffd640 1 -- 172.21.15.81:0/4081894369 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f3a0c0abb70 con 0x7f3a1c072d30 2024-09-16T01:23:44.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.798+0000 7f3a2246c640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a0006c2b0 0x7f3a0006e770 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3a180012e0 tx=0x7f3a18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:44.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:44.802+0000 7f3a12ffd640 1 -- 172.21.15.81:0/4081894369 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a0c07a1f0 con 0x7f3a1c072d30 2024-09-16T01:23:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.003+0000 7f3a246d0640 1 -- 172.21.15.81:0/4081894369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3a1c15bf80 con 0x7f3a1c072d30 2024-09-16T01:23:45.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.003+0000 7f3a12ffd640 1 -- 172.21.15.81:0/4081894369 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f3a0c02ae20 con 0x7f3a1c072d30 2024-09-16T01:23:45.004 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:45.005 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-16T01:23:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.005+0000 7f3a246d0640 1 -- 172.21.15.81:0/4081894369 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a0006c2b0 msgr2=0x7f3a0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.005+0000 7f3a246d0640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a0006c2b0 0x7f3a0006e770 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3a180012e0 tx=0x7f3a18009040 comp rx=0 tx=0).stop 2024-09-16T01:23:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.005+0000 7f3a246d0640 1 -- 172.21.15.81:0/4081894369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a1c072d30 msgr2=0x7f3a1c1541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.005+0000 7f3a246d0640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a1c072d30 0x7f3a1c1541c0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c0098c0 tx=0x7f3a0c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.005+0000 7f3a246d0640 1 -- 172.21.15.81:0/4081894369 shutdown_connections 2024-09-16T01:23:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.005+0000 7f3a246d0640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a0006c2b0 0x7f3a0006e770 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.005+0000 7f3a246d0640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a1c15b300 0x7f3a1c154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.005+0000 7f3a246d0640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a1c072d30 0x7f3a1c1541c0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.005+0000 7f3a246d0640 1 --2- 172.21.15.81:0/4081894369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a1c06f700 0x7f3a1c142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.005+0000 7f3a246d0640 1 -- 172.21.15.81:0/4081894369 >> 172.21.15.81:0/4081894369 conn(0x7f3a1c067d70 msgr2=0x7f3a1c0b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.005+0000 7f3a246d0640 1 -- 172.21.15.81:0/4081894369 shutdown_connections 2024-09-16T01:23:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.005+0000 7f3a246d0640 1 -- 172.21.15.81:0/4081894369 wait complete. 2024-09-16T01:23:45.017 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-16T01:23:45.017 INFO:tasks.cephfs.test_client_limits:Terminating process holding files open 2024-09-16T01:23:45.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-16T01:23:45.534 INFO:teuthology.orchestra.run.smithi081.stderr:open_n_background: keeping files open 2024-09-16T01:23:45.534 INFO:teuthology.orchestra.run.smithi081.stderr:stdin closed, goodbye! 2024-09-16T01:23:45.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:23:45.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:45.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.687+0000 7f1b718ac640 1 Processor -- start 2024-09-16T01:23:45.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.687+0000 7f1b718ac640 1 -- start start 2024-09-16T01:23:45.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.688+0000 7f1b718ac640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b6c15b340 0x7f1b6c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.688+0000 7f1b718ac640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6c0b5050 0x7f1b6c15b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.688+0000 7f1b718ac640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b6c0b3830 con 0x7f1b6c0b43f0 2024-09-16T01:23:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.688+0000 7f1b718ac640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1b6c0b5bd0 con 0x7f1b6c15b340 2024-09-16T01:23:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.688+0000 7f1b718ac640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6c0b5610 con 0x7f1b6c0b5050 2024-09-16T01:23:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.688+0000 7f1b6affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b6c15b340 0x7f1b6c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.688+0000 7f1b6affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b6c15b340 0x7f1b6c09aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36504/0 (socket says 172.21.15.81:36504) 2024-09-16T01:23:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.688+0000 7f1b6affd640 1 -- 172.21.15.81:0/4153436903 learned_addr learned my addr 172.21.15.81:0/4153436903 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.689+0000 7f1b6b7fe640 1 --2- 172.21.15.81:0/4153436903 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6c0b5050 0x7f1b6c15b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.689+0000 7f1b6affd640 1 -- 172.21.15.81:0/4153436903 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6c0b5050 msgr2=0x7f1b6c15b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.689+0000 7f1b6affd640 1 --2- 172.21.15.81:0/4153436903 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6c0b5050 0x7f1b6c15b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.689+0000 7f1b6affd640 1 -- 172.21.15.81:0/4153436903 >> v1:172.21.15.102:6789/0 conn(0x7f1b6c0b43f0 legacy=0x7f1b6c0b4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.689+0000 7f1b6affd640 1 -- 172.21.15.81:0/4153436903 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6c0b58f0 con 0x7f1b6c15b340 2024-09-16T01:23:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.689+0000 7f1b6affd640 1 --2- 172.21.15.81:0/4153436903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b6c15b340 0x7f1b6c09aa30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c068830 tx=0x7f1b5c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a6f7aa6703968a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.689+0000 7f1b69ffb640 1 -- 172.21.15.81:0/4153436903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c036070 con 0x7f1b6c15b340 2024-09-16T01:23:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.689+0000 7f1b69ffb640 1 -- 172.21.15.81:0/4153436903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5c031400 con 0x7f1b6c15b340 2024-09-16T01:23:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.690+0000 7f1b69ffb640 1 -- 172.21.15.81:0/4153436903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c0317d0 con 0x7f1b6c15b340 2024-09-16T01:23:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.690+0000 7f1b718ac640 1 -- 172.21.15.81:0/4153436903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b6c15b340 msgr2=0x7f1b6c09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.690+0000 7f1b718ac640 1 --2- 172.21.15.81:0/4153436903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b6c15b340 0x7f1b6c09aa30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c068830 tx=0x7f1b5c02a610 comp rx=0 tx=0).stop 2024-09-16T01:23:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.690+0000 7f1b718ac640 1 -- 172.21.15.81:0/4153436903 shutdown_connections 2024-09-16T01:23:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.690+0000 7f1b718ac640 1 --2- 172.21.15.81:0/4153436903 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6c0b5050 0x7f1b6c15b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.690+0000 7f1b718ac640 1 --2- 172.21.15.81:0/4153436903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b6c15b340 0x7f1b6c09aa30 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.690+0000 7f1b718ac640 1 -- 172.21.15.81:0/4153436903 >> 172.21.15.81:0/4153436903 conn(0x7f1b6c073490 msgr2=0x7f1b6c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.690+0000 7f1b718ac640 1 -- 172.21.15.81:0/4153436903 shutdown_connections 2024-09-16T01:23:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.690+0000 7f1b718ac640 1 -- 172.21.15.81:0/4153436903 wait complete. 2024-09-16T01:23:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.691+0000 7f1b718ac640 1 Processor -- start 2024-09-16T01:23:45.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.691+0000 7f1b718ac640 1 -- start start 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.692+0000 7f1b718ac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b6c0b43f0 0x7f1b6c14a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.692+0000 7f1b718ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b6c0b5050 0x7f1b6c14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.692+0000 7f1b718ac640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6c15b340 0x7f1b6c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.692+0000 7f1b718ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c0cdb30 con 0x7f1b6c0b5050 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.692+0000 7f1b718ac640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c15d8f0 con 0x7f1b6c0b43f0 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.692+0000 7f1b718ac640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1b6c0cdcb0 con 0x7f1b6c15b340 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.692+0000 7f1b6a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b6c0b5050 0x7f1b6c14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.692+0000 7f1b6a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b6c0b5050 0x7f1b6c14aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36514/0 (socket says 172.21.15.81:36514) 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.692+0000 7f1b6a7fc640 1 -- 172.21.15.81:0/113365811 learned_addr learned my addr 172.21.15.81:0/113365811 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.692+0000 7f1b6affd640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b6c0b43f0 0x7f1b6c14a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.692+0000 7f1b6b7fe640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6c15b340 0x7f1b6c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.693+0000 7f1b6a7fc640 1 -- 172.21.15.81:0/113365811 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6c15b340 msgr2=0x7f1b6c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.693+0000 7f1b6a7fc640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6c15b340 0x7f1b6c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.693+0000 7f1b6a7fc640 1 -- 172.21.15.81:0/113365811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b6c0b43f0 msgr2=0x7f1b6c14a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.693+0000 7f1b6a7fc640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b6c0b43f0 0x7f1b6c14a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.693+0000 7f1b6a7fc640 1 -- 172.21.15.81:0/113365811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6c14dbc0 con 0x7f1b6c0b5050 2024-09-16T01:23:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.693+0000 7f1b6a7fc640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b6c0b5050 0x7f1b6c14aea0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400c460 tx=0x7f1b5400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.693+0000 7f1b63fff640 1 -- 172.21.15.81:0/113365811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54016020 con 0x7f1b6c0b5050 2024-09-16T01:23:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.693+0000 7f1b63fff640 1 -- 172.21.15.81:0/113365811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b54012870 con 0x7f1b6c0b5050 2024-09-16T01:23:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.693+0000 7f1b718ac640 1 -- 172.21.15.81:0/113365811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6c14c1f0 con 0x7f1b6c0b5050 2024-09-16T01:23:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.693+0000 7f1b63fff640 1 -- 172.21.15.81:0/113365811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54012c60 con 0x7f1b6c0b5050 2024-09-16T01:23:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.693+0000 7f1b718ac640 1 -- 172.21.15.81:0/113365811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b6c14b3e0 con 0x7f1b6c0b5050 2024-09-16T01:23:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.694+0000 7f1b718ac640 1 -- 172.21.15.81:0/113365811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b6c09aa30 con 0x7f1b6c0b5050 2024-09-16T01:23:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.694+0000 7f1b63fff640 1 -- 172.21.15.81:0/113365811 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1b54019020 con 0x7f1b6c0b5050 2024-09-16T01:23:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.695+0000 7f1b63fff640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1b4c06c2b0 0x7f1b4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.695+0000 7f1b63fff640 1 -- 172.21.15.81:0/113365811 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f1b5408b100 con 0x7f1b6c0b5050 2024-09-16T01:23:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.695+0000 7f1b6affd640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1b4c06c2b0 0x7f1b4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.696+0000 7f1b6affd640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1b4c06c2b0 0x7f1b4c06e770 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c033000 tx=0x7f1b5c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.699+0000 7f1b63fff640 1 -- 172.21.15.81:0/113365811 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b54020030 con 0x7f1b6c0b5050 2024-09-16T01:23:45.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.903+0000 7f1b718ac640 1 -- 172.21.15.81:0/113365811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b6c070350 con 0x7f1b6c0b5050 2024-09-16T01:23:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.903+0000 7f1b63fff640 1 -- 172.21.15.81:0/113365811 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5227 (secure 0 0 0) 0x7f1b54059120 con 0x7f1b6c0b5050 2024-09-16T01:23:45.904 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:45.904 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"btime":"2024-09-16T01:23:43:950504+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/350084010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":350084010},{"type":"v1","addr":"172.21.15.81:6837","nonce":350084010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6389,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1730570681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1730570681},{"type":"v1","addr":"172.21.15.102:6834","nonce":1730570681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/755231532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":755231532},{"type":"v1","addr":"172.21.15.102:6835","nonce":755231532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:23:18.932203+0000","modified":"2024-09-16T01:23:43.627836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6836/1395000865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1395000865},{"type":"v1","addr":"172.21.15.81:6836","nonce":1395000865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8103,"qdb_cluster":[8103]},"id":10}]} 2024-09-16T01:23:45.904 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 77 2024-09-16T01:23:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.905+0000 7f1b718ac640 1 -- 172.21.15.81:0/113365811 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1b4c06c2b0 msgr2=0x7f1b4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:45.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.905+0000 7f1b718ac640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1b4c06c2b0 0x7f1b4c06e770 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c033000 tx=0x7f1b5c009000 comp rx=0 tx=0).stop 2024-09-16T01:23:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.905+0000 7f1b718ac640 1 -- 172.21.15.81:0/113365811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b6c0b5050 msgr2=0x7f1b6c14aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.905+0000 7f1b718ac640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b6c0b5050 0x7f1b6c14aea0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400c460 tx=0x7f1b5400c920 comp rx=0 tx=0).stop 2024-09-16T01:23:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.905+0000 7f1b718ac640 1 -- 172.21.15.81:0/113365811 shutdown_connections 2024-09-16T01:23:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.905+0000 7f1b718ac640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1b4c06c2b0 0x7f1b4c06e770 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.905+0000 7f1b718ac640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1b6c15b340 0x7f1b6c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.905+0000 7f1b718ac640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b6c0b5050 0x7f1b6c14aea0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.905+0000 7f1b718ac640 1 --2- 172.21.15.81:0/113365811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b6c0b43f0 0x7f1b6c14a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.905+0000 7f1b718ac640 1 -- 172.21.15.81:0/113365811 >> 172.21.15.81:0/113365811 conn(0x7f1b6c073490 msgr2=0x7f1b6c06eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.906+0000 7f1b718ac640 1 -- 172.21.15.81:0/113365811 shutdown_connections 2024-09-16T01:23:45.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:45.906+0000 7f1b718ac640 1 -- 172.21.15.81:0/113365811 wait complete. 2024-09-16T01:23:45.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-16T01:23:46.034 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":7186,"entity":{"name":{"type":"client","num":7186},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":1901454192}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":15.268691776000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.90714971862461,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7186 v1:192.168.0.1:0/1901454192","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi102","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":7183,"entity":{"name":{"type":"client","num":7183},"addr":{"type":"v1","addr":"172.21.15.81:0","nonce":3404736776}},"state":"open","num_leases":400,"num_caps":201,"request_load_avg":368,"uptime":16.388669168,"requests_in_flight":0,"num_completed_requests":399,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":2217.2298510937371,"halflife":60},"release_caps":{"value":199.11187926204946,"halflife":60},"recall_caps_throttle":{"value":444.11481204936564,"halflife":1.5},"recall_caps_throttle2o":{"value":149.16762877641486,"halflife":0.5},"session_cache_liveness":{"value":1167.4156854506421,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.7183 v1:172.21.15.81:0/3404736776","completed_requests":[{"tid":29,"created_ino":"0x10000000001"},{"tid":30,"created_ino":"0x100000001f6"},{"tid":31,"created_ino":"0x100000001f7"},{"tid":32,"created_ino":"0x100000001f8"},{"tid":33,"created_ino":"0x100000001f9"},{"tid":34,"created_ino":"0x100000001fa"},{"tid":35,"created_ino":"0x100000001fb"},{"tid":36,"created_ino":"0x100000001fc"},{"tid":37,"created_ino":"0x100000001fd"},{"tid":38,"created_ino":"0x100000001fe"},{"tid":39,"created_ino":"0x100000001ff"},{"tid":40,"created_ino":"0x10000000200"},{"tid":41,"created_ino":"0x10000000201"},{"tid":42,"created_ino":"0x10000000202"},{"tid":43,"created_ino":"0x10000000203"},{"tid":44,"created_ino":"0x10000000204"},{"tid":45,"created_ino":"0x10000000205"},{"tid":46,"created_ino":"0x10000000206"},{"tid":47,"created_ino":"0x10000000207"},{"tid":48,"created_ino":"0x10000000208"},{"tid":49,"created_ino":"0x10000000209"},{"tid":50,"created_ino":"0x1000000020a"},{"tid":51,"created_ino":"0x1000000020b"},{"tid":52,"created_ino":"0x1000000020c"},{"tid":53,"created_ino":"0x1000000020d"},{"tid":54,"created_ino":"0x1000000020e"},{"tid":55,"created_ino":"0x1000000020f"},{"tid":56,"created_ino":"0x10000000210"},{"tid":57,"created_ino":"0x10000000211"},{"tid":58,"created_ino":"0x10000000212"},{"tid":59,"created_ino":"0x10000000213"},{"tid":60,"created_ino":"0x10000000214"},{"tid":61,"created_ino":"0x10000000215"},{"tid":62,"created_ino":"0x10000000216"},{"tid":63,"created_ino":"0x10000000217"},{"tid":64,"created_ino":"0x10000000218"},{"tid":65,"created_ino":"0x10000000219"},{"tid":66,"created_ino":"0x1000000021a"},{"tid":67,"created_ino":"0x1000000021b"},{"tid":68,"created_ino":"0x1000000021c"},{"tid":69,"created_ino":"0x1000000021d"},{"tid":70,"created_ino":"0x1000000021e"},{"tid":71,"created_ino":"0x1000000021f"},{"tid":72,"created_ino":"0x10000000220"},{"tid":73,"created_ino":"0x10000000221"},{"tid":74,"created_ino":"0x10000000222"},{"tid":75,"created_ino":"0x10000000223"},{"tid":76,"created_ino":"0x10000000224"},{"tid":77,"created_ino":"0x10000000225"},{"tid":78,"created_ino":"0x10000000226"},{"tid":79,"created_ino":"0x10000000227"},{"tid":80,"created_ino":"0x10000000228"},{"tid":81,"created_ino":"0x10000000229"},{"tid":82,"created_ino":"0x1000000022a"},{"tid":83,"created_ino":"0x1000000022b"},{"tid":84,"created_ino":"0x1000000022c"},{"tid":85,"created_ino":"0x1000000022d"},{"tid":86,"created_ino":"0x1000000022e"},{"tid":87,"created_ino":"0x1000000022f"},{"tid":88,"created_ino":"0x10000000230"},{"tid":89,"created_ino":"0x10000000231"},{"tid":90,"created_ino":"0x10000000232"},{"tid":91,"created_ino":"0x10000000233"},{"tid":92,"created_ino":"0x10000000234"},{"tid":93,"created_ino":"0x10000000235"},{"tid":94,"created_ino":"0x10000000236"},{"tid":95,"created_ino":"0x10000000237"},{"tid":96,"created_ino":"0x10000000238"},{"tid":97,"created_ino":"0x10000000239"},{"tid":98,"created_ino":"0x1000000023a"},{"tid":99,"created_ino":"0x1000000023b"},{"tid":100,"created_ino":"0x1000000023c"},{"tid":101,"created_ino":"0x1000000023d"},{"tid":102,"created_ino":"0x1000000023e"},{"tid":103,"created_ino":"0x1000000023f"},{"tid":104,"created_ino":"0x10000000240"},{"tid":105,"created_ino":"0x10000000241"},{"tid":106,"created_ino":"0x10000000242"},{"tid":107,"created_ino":"0x10000000243"},{"tid":108,"created_ino":"0x10000000244"},{"tid":109,"created_ino":"0x10000000245"},{"tid":110,"created_ino":"0x10000000246"},{"tid":111,"created_ino":"0x10000000247"},{"tid":112,"created_ino":"0x10000000248"},{"tid":113,"created_ino":"0x10000000249"},{"tid":114,"created_ino":"0x1000000024a"},{"tid":115,"created_ino":"0x1000000024b"},{"tid":116,"created_ino":"0x1000000024c"},{"tid":117,"created_ino":"0x1000000024d"},{"tid":118,"created_ino":"0x1000000024e"},{"tid":119,"created_ino":"0x1000000024f"},{"tid":120,"created_ino":"0x10000000250"},{"tid":121,"created_ino":"0x10000000251"},{"tid":122,"created_ino":"0x10000000252"},{"tid":123,"created_ino":"0x10000000253"},{"tid":124,"created_ino":"0x10000000254"},{"tid":125,"created_ino":"0x10000000255"},{"tid":126,"created_ino":"0x10000000256"},{"tid":127,"created_ino":"0x10000000257"},{"tid":128,"created_ino":"0x10000000258"},{"tid":129,"created_ino":"0x10000000259"},{"tid":130,"created_ino":"0x1000000025a"},{"tid":131,"created_ino":"0x1000000025b"},{"tid":132,"created_ino":"0x1000000025c"},{"tid":133,"created_ino":"0x1000000025d"},{"tid":134,"created_ino":"0x1000000025e"},{"tid":135,"created_ino":"0x1000000025f"},{"tid":136,"created_ino":"0x10000000260"},{"tid":137,"created_ino":"0x10000000261"},{"tid":138,"created_ino":"0x10000000262"},{"tid":139,"created_ino":"0x10000000263"},{"tid":140,"created_ino":"0x10000000264"},{"tid":141,"created_ino":"0x10000000265"},{"tid":142,"created_ino":"0x10000000266"},{"tid":143,"created_ino":"0x10000000267"},{"tid":144,"created_ino":"0x10000000268"},{"tid":145,"created_ino":"0x10000000269"},{"tid":146,"created_ino":"0x1000000026a"},{"tid":147,"created_ino":"0x1000000026b"},{"tid":148,"created_ino":"0x1000000026c"},{"tid":149,"created_ino":"0x1000000026d"},{"tid":150,"created_ino":"0x1000000026e"},{"tid":151,"created_ino":"0x1000000026f"},{"tid":152,"created_ino":"0x10000000270"},{"tid":153,"created_ino":"0x10000000271"},{"tid":154,"created_ino":"0x10000000272"},{"tid":155,"created_ino":"0x10000000273"},{"tid":156,"created_ino":"0x10000000274"},{"tid":157,"created_ino":"0x10000000275"},{"tid":158,"created_ino":"0x10000000276"},{"tid":159,"created_ino":"0x10000000277"},{"tid":160,"created_ino":"0x10000000278"},{"tid":161,"created_ino":"0x10000000279"},{"tid":162,"created_ino":"0x1000000027a"},{"tid":163,"created_ino":"0x1000000027b"},{"tid":164,"created_ino":"0x1000000027c"},{"tid":165,"created_ino":"0x1000000027d"},{"tid":166,"created_ino":"0x1000000027e"},{"tid":167,"created_ino":"0x1000000027f"},{"tid":168,"created_ino":"0x10000000280"},{"tid":169,"created_ino":"0x10000000281"},{"tid":170,"created_ino":"0x10000000282"},{"tid":171,"created_ino":"0x10000000283"},{"tid":172,"created_ino":"0x10000000284"},{"tid":173,"created_ino":"0x10000000285"},{"tid":174,"created_ino":"0x10000000286"},{"tid":175,"created_ino":"0x10000000287"},{"tid":176,"created_ino":"0x10000000288"},{"tid":177,"created_ino":"0x10000000289"},{"tid":178,"created_ino":"0x1000000028a"},{"tid":179,"created_ino":"0x1000000028b"},{"tid":180,"created_ino":"0x1000000028c"},{"tid":181,"created_ino":"0x1000000028d"},{"tid":182,"created_ino":"0x1000000028e"},{"tid":183,"created_ino":"0x1000000028f"},{"tid":184,"created_ino":"0x10000000290"},{"tid":185,"created_ino":"0x10000000291"},{"tid":186,"created_ino":"0x10000000292"},{"tid":187,"created_ino":"0x10000000293"},{"tid":188,"created_ino":"0x10000000294"},{"tid":189,"created_ino":"0x10000000295"},{"tid":190,"created_ino":"0x10000000296"},{"tid":191,"created_ino":"0x10000000297"},{"tid":192,"created_ino":"0x10000000298"},{"tid":193,"created_ino":"0x10000000299"},{"tid":194,"created_ino":"0x1000000029a"},{"tid":195,"created_ino":"0x1000000029b"},{"tid":196,"created_ino":"0x1000000029c"},{"tid":197,"created_ino":"0x1000000029d"},{"tid":198,"created_ino":"0x1000000029e"},{"tid":199,"created_ino":"0x1000000029f"},{"tid":200,"created_ino":"0x100000002a0"},{"tid":201,"created_ino":"0x100000002a1"},{"tid":202,"created_ino":"0x100000002a2"},{"tid":203,"created_ino":"0x100000002a3"},{"tid":204,"created_ino":"0x100000002a4"},{"tid":205,"created_ino":"0x100000002a5"},{"tid":206,"created_ino":"0x100000002a6"},{"tid":207,"created_ino":"0x100000002a7"},{"tid":208,"created_ino":"0x100000002a8"},{"tid":209,"created_ino":"0x100000002a9"},{"tid":210,"created_ino":"0x100000002aa"},{"tid":211,"created_ino":"0x100000002ab"},{"tid":212,"created_ino":"0x100000002ac"},{"tid":213,"created_ino":"0x100000002ad"},{"tid":214,"created_ino":"0x100000002ae"},{"tid":215,"created_ino":"0x100000002af"},{"tid":216,"created_ino":"0x100000002b0"},{"tid":217,"created_ino":"0x100000002b1"},{"tid":218,"created_ino":"0x100000002b2"},{"tid":219,"created_ino":"0x100000002b3"},{"tid":220,"created_ino":"0x100000002b4"},{"tid":221,"created_ino":"0x100000002b5"},{"tid":222,"created_ino":"0x100000002b6"},{"tid":223,"created_ino":"0x100000002b7"},{"tid":224,"created_ino":"0x100000002b8"},{"tid":225,"created_ino":"0x100000002b9"},{"tid":226,"created_ino":"0x100000002ba"},{"tid":227,"created_ino":"0x100000002bb"},{"tid":228,"created_ino":"0x100000002bc"},{"tid":229,"created_ino":"0x100000002bd"},{"tid":230,"created_ino":"0x100000002be"},{"tid":231,"created_ino":"0x100000002bf"},{"tid":232,"created_ino":"0x100000002c0"},{"tid":233,"created_ino":"0x100000002c1"},{"tid":234,"created_ino":"0x100000002c2"},{"tid":235,"created_ino":"0x100000002c3"},{"tid":236,"created_ino":"0x100000002c4"},{"tid":237,"created_ino":"0x100000002c5"},{"tid":238,"created_ino":"0x100000002c6"},{"tid":239,"created_ino":"0x100000002c7"},{"tid":240,"created_ino":"0x100000002c8"},{"tid":241,"created_ino":"0x100000002c9"},{"tid":242,"created_ino":"0x100000002ca"},{"tid":243,"created_ino":"0x100000002cb"},{"tid":244,"created_ino":"0x100000002cc"},{"tid":245,"created_ino":"0x100000002cd"},{"tid":246,"created_ino":"0x100000002ce"},{"tid":247,"created_ino":"0x100000002cf"},{"tid":248,"created_ino":"0x100000002d0"},{"tid":249,"created_ino":"0x100000002d1"},{"tid":250,"created_ino":"0x100000002d2"},{"tid":251,"created_ino":"0x100000002d3"},{"tid":252,"created_ino":"0x100000002d4"},{"tid":253,"created_ino":"0x100000002d5"},{"tid":254,"created_ino":"0x100000002d6"},{"tid":255,"created_ino":"0x100000002d7"},{"tid":256,"created_ino":"0x100000002d8"},{"tid":257,"created_ino":"0x100000002d9"},{"tid":258,"created_ino":"0x100000002da"},{"tid":259,"created_ino":"0x100000002db"},{"tid":260,"created_ino":"0x100000002dc"},{"tid":261,"created_ino":"0x100000002dd"},{"tid":262,"created_ino":"0x100000002de"},{"tid":263,"created_ino":"0x100000002df"},{"tid":264,"created_ino":"0x100000002e0"},{"tid":265,"created_ino":"0x100000002e1"},{"tid":266,"created_ino":"0x100000002e2"},{"tid":267,"created_ino":"0x100000002e3"},{"tid":268,"created_ino":"0x100000002e4"},{"tid":269,"created_ino":"0x100000002e5"},{"tid":270,"created_ino":"0x100000002e6"},{"tid":271,"created_ino":"0x100000002e7"},{"tid":272,"created_ino":"0x100000002e8"},{"tid":273,"created_ino":"0x100000002e9"},{"tid":274,"created_ino":"0x100000002ea"},{"tid":275,"created_ino":"0x100000002eb"},{"tid":276,"created_ino":"0x100000002ec"},{"tid":277,"created_ino":"0x100000002ed"},{"tid":278,"created_ino":"0x100000002ee"},{"tid":279,"created_ino":"0x100000002ef"},{"tid":280,"created_ino":"0x100000002f0"},{"tid":281,"created_ino":"0x100000002f1"},{"tid":282,"created_ino":"0x100000002f2"},{"tid":283,"created_ino":"0x100000002f3"},{"tid":284,"created_ino":"0x100000002f4"},{"tid":285,"created_ino":"0x100000002f5"},{"tid":286,"created_ino":"0x100000002f6"},{"tid":287,"created_ino":"0x100000002f7"},{"tid":288,"created_ino":"0x100000002f8"},{"tid":289,"created_ino":"0x100000002f9"},{"tid":290,"created_ino":"0x100000002fa"},{"tid":291,"created_ino":"0x100000002fb"},{"tid":292,"created_ino":"0x100000002fc"},{"tid":293,"created_ino":"0x100000002fd"},{"tid":294,"created_ino":"0x100000002fe"},{"tid":295,"created_ino":"0x100000002ff"},{"tid":296,"created_ino":"0x10000000300"},{"tid":297,"created_ino":"0x10000000301"},{"tid":298,"created_ino":"0x10000000302"},{"tid":299,"created_ino":"0x10000000303"},{"tid":300,"created_ino":"0x10000000304"},{"tid":301,"created_ino":"0x10000000305"},{"tid":302,"created_ino":"0x10000000306"},{"tid":303,"created_ino":"0x10000000307"},{"tid":304,"created_ino":"0x10000000308"},{"tid":305,"created_ino":"0x10000000309"},{"tid":306,"created_ino":"0x1000000030a"},{"tid":307,"created_ino":"0x1000000030b"},{"tid":308,"created_ino":"0x1000000030c"},{"tid":309,"created_ino":"0x1000000030d"},{"tid":310,"created_ino":"0x1000000030e"},{"tid":311,"created_ino":"0x1000000030f"},{"tid":312,"created_ino":"0x10000000310"},{"tid":313,"created_ino":"0x10000000311"},{"tid":314,"created_ino":"0x10000000312"},{"tid":315,"created_ino":"0x10000000313"},{"tid":316,"created_ino":"0x10000000314"},{"tid":317,"created_ino":"0x10000000315"},{"tid":318,"created_ino":"0x10000000316"},{"tid":319,"created_ino":"0x10000000317"},{"tid":320,"created_ino":"0x10000000318"},{"tid":321,"created_ino":"0x10000000319"},{"tid":322,"created_ino":"0x1000000031a"},{"tid":323,"created_ino":"0x1000000031b"},{"tid":324,"created_ino":"0x1000000031c"},{"tid":325,"created_ino":"0x1000000031d"},{"tid":326,"created_ino":"0x1000000031e"},{"tid":327,"created_ino":"0x1000000031f"},{"tid":328,"created_ino":"0x10000000320"},{"tid":329,"created_ino":"0x10000000321"},{"tid":330,"created_ino":"0x10000000322"},{"tid":331,"created_ino":"0x10000000323"},{"tid":332,"created_ino":"0x10000000324"},{"tid":333,"created_ino":"0x10000000325"},{"tid":334,"created_ino":"0x10000000326"},{"tid":335,"created_ino":"0x10000000327"},{"tid":336,"created_ino":"0x10000000328"},{"tid":337,"created_ino":"0x10000000329"},{"tid":338,"created_ino":"0x1000000032a"},{"tid":339,"created_ino":"0x1000000032b"},{"tid":340,"created_ino":"0x1000000032c"},{"tid":341,"created_ino":"0x1000000032d"},{"tid":342,"created_ino":"0x1000000032e"},{"tid":343,"created_ino":"0x1000000032f"},{"tid":344,"created_ino":"0x10000000330"},{"tid":345,"created_ino":"0x10000000331"},{"tid":346,"created_ino":"0x10000000332"},{"tid":347,"created_ino":"0x10000000333"},{"tid":348,"created_ino":"0x10000000334"},{"tid":349,"created_ino":"0x10000000335"},{"tid":350,"created_ino":"0x10000000336"},{"tid":351,"created_ino":"0x10000000337"},{"tid":352,"created_ino":"0x10000000338"},{"tid":353,"created_ino":"0x10000000339"},{"tid":354,"created_ino":"0x1000000033a"},{"tid":355,"created_ino":"0x1000000033b"},{"tid":356,"created_ino":"0x1000000033c"},{"tid":357,"created_ino":"0x1000000033d"},{"tid":358,"created_ino":"0x1000000033e"},{"tid":359,"created_ino":"0x1000000033f"},{"tid":360,"created_ino":"0x10000000340"},{"tid":361,"created_ino":"0x10000000341"},{"tid":362,"created_ino":"0x10000000342"},{"tid":363,"created_ino":"0x10000000343"},{"tid":364,"created_ino":"0x10000000344"},{"tid":365,"created_ino":"0x10000000345"},{"tid":366,"created_ino":"0x10000000346"},{"tid":367,"created_ino":"0x10000000347"},{"tid":368,"created_ino":"0x10000000348"},{"tid":369,"created_ino":"0x10000000349"},{"tid":370,"created_ino":"0x1000000034a"},{"tid":371,"created_ino":"0x1000000034b"},{"tid":372,"created_ino":"0x1000000034c"},{"tid":373,"created_ino":"0x1000000034d"},{"tid":374,"created_ino":"0x1000000034e"},{"tid":375,"created_ino":"0x1000000034f"},{"tid":376,"created_ino":"0x10000000350"},{"tid":377,"created_ino":"0x10000000351"},{"tid":378,"created_ino":"0x10000000352"},{"tid":379,"created_ino":"0x10000000353"},{"tid":380,"created_ino":"0x10000000354"},{"tid":381,"created_ino":"0x10000000355"},{"tid":382,"created_ino":"0x10000000356"},{"tid":383,"created_ino":"0x10000000357"},{"tid":384,"created_ino":"0x10000000358"},{"tid":385,"created_ino":"0x10000000359"},{"tid":386,"created_ino":"0x1000000035a"},{"tid":387,"created_ino":"0x1000000035b"},{"tid":388,"created_ino":"0x1000000035c"},{"tid":389,"created_ino":"0x1000000035d"},{"tid":390,"created_ino":"0x1000000035e"},{"tid":391,"created_ino":"0x1000000035f"},{"tid":392,"created_ino":"0x10000000360"},{"tid":393,"created_ino":"0x10000000361"},{"tid":394,"created_ino":"0x10000000362"},{"tid":395,"created_ino":"0x10000000363"},{"tid":396,"created_ino":"0x10000000364"},{"tid":397,"created_ino":"0x10000000365"},{"tid":398,"created_ino":"0x10000000366"},{"tid":399,"created_ino":"0x10000000367"},{"tid":400,"created_ino":"0x10000000368"},{"tid":401,"created_ino":"0x10000000369"},{"tid":402,"created_ino":"0x1000000036a"},{"tid":403,"created_ino":"0x1000000036b"},{"tid":404,"created_ino":"0x1000000036c"},{"tid":405,"created_ino":"0x1000000036d"},{"tid":406,"created_ino":"0x1000000036e"},{"tid":407,"created_ino":"0x1000000036f"},{"tid":408,"created_ino":"0x10000000370"},{"tid":409,"created_ino":"0x10000000371"},{"tid":410,"created_ino":"0x10000000372"},{"tid":411,"created_ino":"0x10000000373"},{"tid":412,"created_ino":"0x10000000374"},{"tid":413,"created_ino":"0x10000000375"},{"tid":414,"created_ino":"0x10000000376"},{"tid":415,"created_ino":"0x10000000377"},{"tid":416,"created_ino":"0x10000000378"},{"tid":417,"created_ino":"0x10000000379"},{"tid":418,"created_ino":"0x1000000037a"},{"tid":419,"created_ino":"0x1000000037b"},{"tid":420,"created_ino":"0x1000000037c"},{"tid":421,"created_ino":"0x1000000037d"},{"tid":422,"created_ino":"0x1000000037e"},{"tid":423,"created_ino":"0x1000000037f"},{"tid":424,"created_ino":"0x10000000380"},{"tid":425,"created_ino":"0x10000000381"},{"tid":426,"created_ino":"0x10000000382"},{"tid":427,"created_ino":"0x10000000383"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x10000000384","length":603}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi081","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-16T01:23:46.036 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi102", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 1901454192, "type": "v1" }, "name": { "num": 7186, "type": "client" } }, "id": 7186, "inst": "client.7186 v1:192.168.0.1:0/1901454192", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.90714971862461 }, "state": "open", "uptime": 15.268691776 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi081", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x10000000001", "tid": 29 }, { "created_ino": "0x100000001f6", "tid": 30 }, { "created_ino": "0x100000001f7", "tid": 31 }, { "created_ino": "0x100000001f8", "tid": 32 }, { "created_ino": "0x100000001f9", "tid": 33 }, { "created_ino": "0x100000001fa", "tid": 34 }, { "created_ino": "0x100000001fb", "tid": 35 }, { "created_ino": "0x100000001fc", "tid": 36 }, { "created_ino": "0x100000001fd", "tid": 37 }, { "created_ino": "0x100000001fe", "tid": 38 }, { "created_ino": "0x100000001ff", "tid": 39 }, { "created_ino": "0x10000000200", "tid": 40 }, { "created_ino": "0x10000000201", "tid": 41 }, { "created_ino": "0x10000000202", "tid": 42 }, { "created_ino": "0x10000000203", "tid": 43 }, { "created_ino": "0x10000000204", "tid": 44 }, { "created_ino": "0x10000000205", "tid": 45 }, { "created_ino": "0x10000000206", "tid": 46 }, { "created_ino": "0x10000000207", "tid": 47 }, { "created_ino": "0x10000000208", "tid": 48 }, { "created_ino": "0x10000000209", "tid": 49 }, { "created_ino": "0x1000000020a", "tid": 50 }, { "created_ino": "0x1000000020b", "tid": 51 }, { "created_ino": "0x1000000020c", "tid": 52 }, { "created_ino": "0x1000000020d", "tid": 53 }, { "created_ino": "0x1000000020e", "tid": 54 }, { "created_ino": "0x1000000020f", "tid": 55 }, { "created_ino": "0x10000000210", "tid": 56 }, { "created_ino": "0x10000000211", "tid": 57 }, { "created_ino": "0x10000000212", "tid": 58 }, { "created_ino": "0x10000000213", "tid": 59 }, { "created_ino": "0x10000000214", "tid": 60 }, { "created_ino": "0x10000000215", "tid": 61 }, { "created_ino": "0x10000000216", "tid": 62 }, { "created_ino": "0x10000000217", "tid": 63 }, { "created_ino": "0x10000000218", "tid": 64 }, { "created_ino": "0x10000000219", "tid": 65 }, { "created_ino": "0x1000000021a", "tid": 66 }, { "created_ino": "0x1000000021b", "tid": 67 }, { "created_ino": "0x1000000021c", "tid": 68 }, { "created_ino": "0x1000000021d", "tid": 69 }, { "created_ino": "0x1000000021e", "tid": 70 }, { "created_ino": "0x1000000021f", "tid": 71 }, { "created_ino": "0x10000000220", "tid": 72 }, { "created_ino": "0x10000000221", "tid": 73 }, { "created_ino": "0x10000000222", "tid": 74 }, { "created_ino": "0x10000000223", "tid": 75 }, { "created_ino": "0x10000000224", "tid": 76 }, { "created_ino": "0x10000000225", "tid": 77 }, { "created_ino": "0x10000000226", "tid": 78 }, { "created_ino": "0x10000000227", "tid": 79 }, { "created_ino": "0x10000000228", "tid": 80 }, { "created_ino": "0x10000000229", "tid": 81 }, { "created_ino": "0x1000000022a", "tid": 82 }, { "created_ino": "0x1000000022b", "tid": 83 }, { "created_ino": "0x1000000022c", "tid": 84 }, { "created_ino": "0x1000000022d", "tid": 85 }, { "created_ino": "0x1000000022e", "tid": 86 }, { "created_ino": "0x1000000022f", "tid": 87 }, { "created_ino": "0x10000000230", "tid": 88 }, { "created_ino": "0x10000000231", "tid": 89 }, { "created_ino": "0x10000000232", "tid": 90 }, { "created_ino": "0x10000000233", "tid": 91 }, { "created_ino": "0x10000000234", "tid": 92 }, { "created_ino": "0x10000000235", "tid": 93 }, { "created_ino": "0x10000000236", "tid": 94 }, { "created_ino": "0x10000000237", "tid": 95 }, { "created_ino": "0x10000000238", "tid": 96 }, { "created_ino": "0x10000000239", "tid": 97 }, { "created_ino": "0x1000000023a", "tid": 98 }, { "created_ino": "0x1000000023b", "tid": 99 }, { "created_ino": "0x1000000023c", "tid": 100 }, { "created_ino": "0x1000000023d", "tid": 101 }, { "created_ino": "0x1000000023e", "tid": 102 }, { "created_ino": "0x1000000023f", "tid": 103 }, { "created_ino": "0x10000000240", "tid": 104 }, { "created_ino": "0x10000000241", "tid": 105 }, { "created_ino": "0x10000000242", "tid": 106 }, { "created_ino": "0x10000000243", "tid": 107 }, { "created_ino": "0x10000000244", "tid": 108 }, { "created_ino": "0x10000000245", "tid": 109 }, { "created_ino": "0x10000000246", "tid": 110 }, { "created_ino": "0x10000000247", "tid": 111 }, { "created_ino": "0x10000000248", "tid": 112 }, { "created_ino": "0x10000000249", "tid": 113 }, { "created_ino": "0x1000000024a", "tid": 114 }, { "created_ino": "0x1000000024b", "tid": 115 }, { "created_ino": "0x1000000024c", "tid": 116 }, { "created_ino": "0x1000000024d", "tid": 117 }, { "created_ino": "0x1000000024e", "tid": 118 }, { "created_ino": "0x1000000024f", "tid": 119 }, { "created_ino": "0x10000000250", "tid": 120 }, { "created_ino": "0x10000000251", "tid": 121 }, { "created_ino": "0x10000000252", "tid": 122 }, { "created_ino": "0x10000000253", "tid": 123 }, { "created_ino": "0x10000000254", "tid": 124 }, { "created_ino": "0x10000000255", "tid": 125 }, { "created_ino": "0x10000000256", "tid": 126 }, { "created_ino": "0x10000000257", "tid": 127 }, { "created_ino": "0x10000000258", "tid": 128 }, { "created_ino": "0x10000000259", "tid": 129 }, { "created_ino": "0x1000000025a", "tid": 130 }, { "created_ino": "0x1000000025b", "tid": 131 }, { "created_ino": "0x1000000025c", "tid": 132 }, { "created_ino": "0x1000000025d", "tid": 133 }, { "created_ino": "0x1000000025e", "tid": 134 }, { "created_ino": "0x1000000025f", "tid": 135 }, { "created_ino": "0x10000000260", "tid": 136 }, { "created_ino": "0x10000000261", "tid": 137 }, { "created_ino": "0x10000000262", "tid": 138 }, { "created_ino": "0x10000000263", "tid": 139 }, { "created_ino": "0x10000000264", "tid": 140 }, { "created_ino": "0x10000000265", "tid": 141 }, { "created_ino": "0x10000000266", "tid": 142 }, { "created_ino": "0x10000000267", "tid": 143 }, { "created_ino": "0x10000000268", "tid": 144 }, { "created_ino": "0x10000000269", "tid": 145 }, { "created_ino": "0x1000000026a", "tid": 146 }, { "created_ino": "0x1000000026b", "tid": 147 }, { "created_ino": "0x1000000026c", "tid": 148 }, { "created_ino": "0x1000000026d", "tid": 149 }, { "created_ino": "0x1000000026e", "tid": 150 }, { "created_ino": "0x1000000026f", "tid": 151 }, { "created_ino": "0x10000000270", "tid": 152 }, { "created_ino": "0x10000000271", "tid": 153 }, { "created_ino": "0x10000000272", "tid": 154 }, { "created_ino": "0x10000000273", "tid": 155 }, { "created_ino": "0x10000000274", "tid": 156 }, { "created_ino": "0x10000000275", "tid": 157 }, { "created_ino": "0x10000000276", "tid": 158 }, { "created_ino": "0x10000000277", "tid": 159 }, { "created_ino": "0x10000000278", "tid": 160 }, { "created_ino": "0x10000000279", "tid": 161 }, { "created_ino": "0x1000000027a", "tid": 162 }, { "created_ino": "0x1000000027b", "tid": 163 }, { "created_ino": "0x1000000027c", "tid": 164 }, { "created_ino": "0x1000000027d", "tid": 165 }, { "created_ino": "0x1000000027e", "tid": 166 }, { "created_ino": "0x1000000027f", "tid": 167 }, { "created_ino": "0x10000000280", "tid": 168 }, { "created_ino": "0x10000000281", "tid": 169 }, { "created_ino": "0x10000000282", "tid": 170 }, { "created_ino": "0x10000000283", "tid": 171 }, { "created_ino": "0x10000000284", "tid": 172 }, { "created_ino": "0x10000000285", "tid": 173 }, { "created_ino": "0x10000000286", "tid": 174 }, { "created_ino": "0x10000000287", "tid": 175 }, { "created_ino": "0x10000000288", "tid": 176 }, { "created_ino": "0x10000000289", "tid": 177 }, { "created_ino": "0x1000000028a", "tid": 178 }, { "created_ino": "0x1000000028b", "tid": 179 }, { "created_ino": "0x1000000028c", "tid": 180 }, { "created_ino": "0x1000000028d", "tid": 181 }, { "created_ino": "0x1000000028e", "tid": 182 }, { "created_ino": "0x1000000028f", "tid": 183 }, { "created_ino": "0x10000000290", "tid": 184 }, { "created_ino": "0x10000000291", "tid": 185 }, { "created_ino": "0x10000000292", "tid": 186 }, { "created_ino": "0x10000000293", "tid": 187 }, { "created_ino": "0x10000000294", "tid": 188 }, { "created_ino": "0x10000000295", "tid": 189 }, { "created_ino": "0x10000000296", "tid": 190 }, { "created_ino": "0x10000000297", "tid": 191 }, { "created_ino": "0x10000000298", "tid": 192 }, { "created_ino": "0x10000000299", "tid": 193 }, { "created_ino": "0x1000000029a", "tid": 194 }, { "created_ino": "0x1000000029b", "tid": 195 }, { "created_ino": "0x1000000029c", "tid": 196 }, { "created_ino": "0x1000000029d", "tid": 197 }, { "created_ino": "0x1000000029e", "tid": 198 }, { "created_ino": "0x1000000029f", "tid": 199 }, { "created_ino": "0x100000002a0", "tid": 200 }, { "created_ino": "0x100000002a1", "tid": 201 }, { "created_ino": "0x100000002a2", "tid": 202 }, { "created_ino": "0x100000002a3", "tid": 203 }, { "created_ino": "0x100000002a4", "tid": 204 }, { "created_ino": "0x100000002a5", "tid": 205 }, { "created_ino": "0x100000002a6", "tid": 206 }, { "created_ino": "0x100000002a7", "tid": 207 }, { "created_ino": "0x100000002a8", "tid": 208 }, { "created_ino": "0x100000002a9", "tid": 209 }, { "created_ino": "0x100000002aa", "tid": 210 }, { "created_ino": "0x100000002ab", "tid": 211 }, { "created_ino": "0x100000002ac", "tid": 212 }, { "created_ino": "0x100000002ad", "tid": 213 }, { "created_ino": "0x100000002ae", "tid": 214 }, { "created_ino": "0x100000002af", "tid": 215 }, { "created_ino": "0x100000002b0", "tid": 216 }, { "created_ino": "0x100000002b1", "tid": 217 }, { "created_ino": "0x100000002b2", "tid": 218 }, { "created_ino": "0x100000002b3", "tid": 219 }, { "created_ino": "0x100000002b4", "tid": 220 }, { "created_ino": "0x100000002b5", "tid": 221 }, { "created_ino": "0x100000002b6", "tid": 222 }, { "created_ino": "0x100000002b7", "tid": 223 }, { "created_ino": "0x100000002b8", "tid": 224 }, { "created_ino": "0x100000002b9", "tid": 225 }, { "created_ino": "0x100000002ba", "tid": 226 }, { "created_ino": "0x100000002bb", "tid": 227 }, { "created_ino": "0x100000002bc", "tid": 228 }, { "created_ino": "0x100000002bd", "tid": 229 }, { "created_ino": "0x100000002be", "tid": 230 }, { "created_ino": "0x100000002bf", "tid": 231 }, { "created_ino": "0x100000002c0", "tid": 232 }, { "created_ino": "0x100000002c1", "tid": 233 }, { "created_ino": "0x100000002c2", "tid": 234 }, { "created_ino": "0x100000002c3", "tid": 235 }, { "created_ino": "0x100000002c4", "tid": 236 }, { "created_ino": "0x100000002c5", "tid": 237 }, { "created_ino": "0x100000002c6", "tid": 238 }, { "created_ino": "0x100000002c7", "tid": 239 }, { "created_ino": "0x100000002c8", "tid": 240 }, { "created_ino": "0x100000002c9", "tid": 241 }, { "created_ino": "0x100000002ca", "tid": 242 }, { "created_ino": "0x100000002cb", "tid": 243 }, { "created_ino": "0x100000002cc", "tid": 244 }, { "created_ino": "0x100000002cd", "tid": 245 }, { "created_ino": "0x100000002ce", "tid": 246 }, { "created_ino": "0x100000002cf", "tid": 247 }, { "created_ino": "0x100000002d0", "tid": 248 }, { "created_ino": "0x100000002d1", "tid": 249 }, { "created_ino": "0x100000002d2", "tid": 250 }, { "created_ino": "0x100000002d3", "tid": 251 }, { "created_ino": "0x100000002d4", "tid": 252 }, { "created_ino": "0x100000002d5", "tid": 253 }, { "created_ino": "0x100000002d6", "tid": 254 }, { "created_ino": "0x100000002d7", "tid": 255 }, { "created_ino": "0x100000002d8", "tid": 256 }, { "created_ino": "0x100000002d9", "tid": 257 }, { "created_ino": "0x100000002da", "tid": 258 }, { "created_ino": "0x100000002db", "tid": 259 }, { "created_ino": "0x100000002dc", "tid": 260 }, { "created_ino": "0x100000002dd", "tid": 261 }, { "created_ino": "0x100000002de", "tid": 262 }, { "created_ino": "0x100000002df", "tid": 263 }, { "created_ino": "0x100000002e0", "tid": 264 }, { "created_ino": "0x100000002e1", "tid": 265 }, { "created_ino": "0x100000002e2", "tid": 266 }, { "created_ino": "0x100000002e3", "tid": 267 }, { "created_ino": "0x100000002e4", "tid": 268 }, { "created_ino": "0x100000002e5", "tid": 269 }, { "created_ino": "0x100000002e6", "tid": 270 }, { "created_ino": "0x100000002e7", "tid": 271 }, { "created_ino": "0x100000002e8", "tid": 272 }, { "created_ino": "0x100000002e9", "tid": 273 }, { "created_ino": "0x100000002ea", "tid": 274 }, { "created_ino": "0x100000002eb", "tid": 275 }, { "created_ino": "0x100000002ec", "tid": 276 }, { "created_ino": "0x100000002ed", "tid": 277 }, { "created_ino": "0x100000002ee", "tid": 278 }, { "created_ino": "0x100000002ef", "tid": 279 }, { "created_ino": "0x100000002f0", "tid": 280 }, { "created_ino": "0x100000002f1", "tid": 281 }, { "created_ino": "0x100000002f2", "tid": 282 }, { "created_ino": "0x100000002f3", "tid": 283 }, { "created_ino": "0x100000002f4", "tid": 284 }, { "created_ino": "0x100000002f5", "tid": 285 }, { "created_ino": "0x100000002f6", "tid": 286 }, { "created_ino": "0x100000002f7", "tid": 287 }, { "created_ino": "0x100000002f8", "tid": 288 }, { "created_ino": "0x100000002f9", "tid": 289 }, { "created_ino": "0x100000002fa", "tid": 290 }, { "created_ino": "0x100000002fb", "tid": 291 }, { "created_ino": "0x100000002fc", "tid": 292 }, { "created_ino": "0x100000002fd", "tid": 293 }, { "created_ino": "0x100000002fe", "tid": 294 }, { "created_ino": "0x100000002ff", "tid": 295 }, { "created_ino": "0x10000000300", "tid": 296 }, { "created_ino": "0x10000000301", "tid": 297 }, { "created_ino": "0x10000000302", "tid": 298 }, { "created_ino": "0x10000000303", "tid": 299 }, { "created_ino": "0x10000000304", "tid": 300 }, { "created_ino": "0x10000000305", "tid": 301 }, { "created_ino": "0x10000000306", "tid": 302 }, { "created_ino": "0x10000000307", "tid": 303 }, { "created_ino": "0x10000000308", "tid": 304 }, { "created_ino": "0x10000000309", "tid": 305 }, { "created_ino": "0x1000000030a", "tid": 306 }, { "created_ino": "0x1000000030b", "tid": 307 }, { "created_ino": "0x1000000030c", "tid": 308 }, { "created_ino": "0x1000000030d", "tid": 309 }, { "created_ino": "0x1000000030e", "tid": 310 }, { "created_ino": "0x1000000030f", "tid": 311 }, { "created_ino": "0x10000000310", "tid": 312 }, { "created_ino": "0x10000000311", "tid": 313 }, { "created_ino": "0x10000000312", "tid": 314 }, { "created_ino": "0x10000000313", "tid": 315 }, { "created_ino": "0x10000000314", "tid": 316 }, { "created_ino": "0x10000000315", "tid": 317 }, { "created_ino": "0x10000000316", "tid": 318 }, { "created_ino": "0x10000000317", "tid": 319 }, { "created_ino": "0x10000000318", "tid": 320 }, { "created_ino": "0x10000000319", "tid": 321 }, { "created_ino": "0x1000000031a", "tid": 322 }, { "created_ino": "0x1000000031b", "tid": 323 }, { "created_ino": "0x1000000031c", "tid": 324 }, { "created_ino": "0x1000000031d", "tid": 325 }, { "created_ino": "0x1000000031e", "tid": 326 }, { "created_ino": "0x1000000031f", "tid": 327 }, { "created_ino": "0x10000000320", "tid": 328 }, { "created_ino": "0x10000000321", "tid": 329 }, { "created_ino": "0x10000000322", "tid": 330 }, { "created_ino": "0x10000000323", "tid": 331 }, { "created_ino": "0x10000000324", "tid": 332 }, { "created_ino": "0x10000000325", "tid": 333 }, { "created_ino": "0x10000000326", "tid": 334 }, { "created_ino": "0x10000000327", "tid": 335 }, { "created_ino": "0x10000000328", "tid": 336 }, { "created_ino": "0x10000000329", "tid": 337 }, { "created_ino": "0x1000000032a", "tid": 338 }, { "created_ino": "0x1000000032b", "tid": 339 }, { "created_ino": "0x1000000032c", "tid": 340 }, { "created_ino": "0x1000000032d", "tid": 341 }, { "created_ino": "0x1000000032e", "tid": 342 }, { "created_ino": "0x1000000032f", "tid": 343 }, { "created_ino": "0x10000000330", "tid": 344 }, { "created_ino": "0x10000000331", "tid": 345 }, { "created_ino": "0x10000000332", "tid": 346 }, { "created_ino": "0x10000000333", "tid": 347 }, { "created_ino": "0x10000000334", "tid": 348 }, { "created_ino": "0x10000000335", "tid": 349 }, { "created_ino": "0x10000000336", "tid": 350 }, { "created_ino": "0x10000000337", "tid": 351 }, { "created_ino": "0x10000000338", "tid": 352 }, { "created_ino": "0x10000000339", "tid": 353 }, { "created_ino": "0x1000000033a", "tid": 354 }, { "created_ino": "0x1000000033b", "tid": 355 }, { "created_ino": "0x1000000033c", "tid": 356 }, { "created_ino": "0x1000000033d", "tid": 357 }, { "created_ino": "0x1000000033e", "tid": 358 }, { "created_ino": "0x1000000033f", "tid": 359 }, { "created_ino": "0x10000000340", "tid": 360 }, { "created_ino": "0x10000000341", "tid": 361 }, { "created_ino": "0x10000000342", "tid": 362 }, { "created_ino": "0x10000000343", "tid": 363 }, { "created_ino": "0x10000000344", "tid": 364 }, { "created_ino": "0x10000000345", "tid": 365 }, { "created_ino": "0x10000000346", "tid": 366 }, { "created_ino": "0x10000000347", "tid": 367 }, { "created_ino": "0x10000000348", "tid": 368 }, { "created_ino": "0x10000000349", "tid": 369 }, { "created_ino": "0x1000000034a", "tid": 370 }, { "created_ino": "0x1000000034b", "tid": 371 }, { "created_ino": "0x1000000034c", "tid": 372 }, { "created_ino": "0x1000000034d", "tid": 373 }, { "created_ino": "0x1000000034e", "tid": 374 }, { "created_ino": "0x1000000034f", "tid": 375 }, { "created_ino": "0x10000000350", "tid": 376 }, { "created_ino": "0x10000000351", "tid": 377 }, { "created_ino": "0x10000000352", "tid": 378 }, { "created_ino": "0x10000000353", "tid": 379 }, { "created_ino": "0x10000000354", "tid": 380 }, { "created_ino": "0x10000000355", "tid": 381 }, { "created_ino": "0x10000000356", "tid": 382 }, { "created_ino": "0x10000000357", "tid": 383 }, { "created_ino": "0x10000000358", "tid": 384 }, { "created_ino": "0x10000000359", "tid": 385 }, { "created_ino": "0x1000000035a", "tid": 386 }, { "created_ino": "0x1000000035b", "tid": 387 }, { "created_ino": "0x1000000035c", "tid": 388 }, { "created_ino": "0x1000000035d", "tid": 389 }, { "created_ino": "0x1000000035e", "tid": 390 }, { "created_ino": "0x1000000035f", "tid": 391 }, { "created_ino": "0x10000000360", "tid": 392 }, { "created_ino": "0x10000000361", "tid": 393 }, { "created_ino": "0x10000000362", "tid": 394 }, { "created_ino": "0x10000000363", "tid": 395 }, { "created_ino": "0x10000000364", "tid": 396 }, { "created_ino": "0x10000000365", "tid": 397 }, { "created_ino": "0x10000000366", "tid": 398 }, { "created_ino": "0x10000000367", "tid": 399 }, { "created_ino": "0x10000000368", "tid": 400 }, { "created_ino": "0x10000000369", "tid": 401 }, { "created_ino": "0x1000000036a", "tid": 402 }, { "created_ino": "0x1000000036b", "tid": 403 }, { "created_ino": "0x1000000036c", "tid": 404 }, { "created_ino": "0x1000000036d", "tid": 405 }, { "created_ino": "0x1000000036e", "tid": 406 }, { "created_ino": "0x1000000036f", "tid": 407 }, { "created_ino": "0x10000000370", "tid": 408 }, { "created_ino": "0x10000000371", "tid": 409 }, { "created_ino": "0x10000000372", "tid": 410 }, { "created_ino": "0x10000000373", "tid": 411 }, { "created_ino": "0x10000000374", "tid": 412 }, { "created_ino": "0x10000000375", "tid": 413 }, { "created_ino": "0x10000000376", "tid": 414 }, { "created_ino": "0x10000000377", "tid": 415 }, { "created_ino": "0x10000000378", "tid": 416 }, { "created_ino": "0x10000000379", "tid": 417 }, { "created_ino": "0x1000000037a", "tid": 418 }, { "created_ino": "0x1000000037b", "tid": 419 }, { "created_ino": "0x1000000037c", "tid": 420 }, { "created_ino": "0x1000000037d", "tid": 421 }, { "created_ino": "0x1000000037e", "tid": 422 }, { "created_ino": "0x1000000037f", "tid": 423 }, { "created_ino": "0x10000000380", "tid": 424 }, { "created_ino": "0x10000000381", "tid": 425 }, { "created_ino": "0x10000000382", "tid": 426 }, { "created_ino": "0x10000000383", "tid": 427 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 3404736776, "type": "v1" }, "name": { "num": 7183, "type": "client" } }, "id": 7183, "inst": "client.7183 v1:172.21.15.81:0/3404736776", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 201, "num_completed_flushes": 0, "num_completed_requests": 399, "num_leases": 400, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 603, "start": "0x10000000384" } ], "recall_caps": { "halflife": 60, "value": 2217.229851093737 }, "recall_caps_throttle": { "halflife": 1.5, "value": 444.11481204936564 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 149.16762877641486 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 199.11187926204946 }, "request_load_avg": 368, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1167.415685450642 }, "state": "open", "uptime": 16.388669168 } ] 2024-09-16T01:23:46.037 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-16T01:23:46.037 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:23:46.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:23:46.085 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:23:46.131 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:23:46.131 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:23:46.131 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 400\nabs_path = "/home/ubuntu/cephtest/mnt.0/."\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi081') 2024-09-16T01:23:46.132 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:46.132 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:46.148 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:46.148 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:46.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:23:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.342+0000 7f079af5f640 1 Processor -- start 2024-09-16T01:23:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.342+0000 7f079af5f640 1 -- start start 2024-09-16T01:23:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f079af5f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f079409aca0 0x7f079409b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f079af5f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079409b5c0 0x7f07940d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f079af5f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07940d12c0 con 0x7f07940d0b20 2024-09-16T01:23:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f079af5f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f079406d040 con 0x7f079409aca0 2024-09-16T01:23:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f079af5f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f07940d15a0 con 0x7f079409b5c0 2024-09-16T01:23:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f078bfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079409b5c0 0x7f07940d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f078bfff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079409b5c0 0x7f07940d05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:60730/0 (socket says 172.21.15.81:60730) 2024-09-16T01:23:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f078bfff640 1 -- 172.21.15.81:0/1670977496 learned_addr learned my addr 172.21.15.81:0/1670977496 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f0798cfb640 1 --2- 172.21.15.81:0/1670977496 >> v2:172.21.15.102:3300/0 conn(0x7f079409aca0 0x7f079409b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f078bfff640 1 -- 172.21.15.81:0/1670977496 >> v2:172.21.15.102:3300/0 conn(0x7f079409aca0 msgr2=0x7f079409b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f078bfff640 1 --2- 172.21.15.81:0/1670977496 >> v2:172.21.15.102:3300/0 conn(0x7f079409aca0 0x7f079409b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f078bfff640 1 -- 172.21.15.81:0/1670977496 >> v1:172.21.15.102:6789/0 conn(0x7f07940d0b20 legacy=0x7f0794070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.343+0000 7f078bfff640 1 -- 172.21.15.81:0/1670977496 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07940d1880 con 0x7f079409b5c0 2024-09-16T01:23:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.344+0000 7f078bfff640 1 --2- 172.21.15.81:0/1670977496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079409b5c0 0x7f07940d05e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0784009870 tx=0x7f078402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc602e334b74d5de server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.344+0000 7f078b7fe640 1 -- 172.21.15.81:0/1670977496 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784037070 con 0x7f079409b5c0 2024-09-16T01:23:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.344+0000 7f078b7fe640 1 -- 172.21.15.81:0/1670977496 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0784032440 con 0x7f079409b5c0 2024-09-16T01:23:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.344+0000 7f078b7fe640 1 -- 172.21.15.81:0/1670977496 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0784032810 con 0x7f079409b5c0 2024-09-16T01:23:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.345+0000 7f079af5f640 1 -- 172.21.15.81:0/1670977496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079409b5c0 msgr2=0x7f07940d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.345+0000 7f079af5f640 1 --2- 172.21.15.81:0/1670977496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079409b5c0 0x7f07940d05e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0784009870 tx=0x7f078402a270 comp rx=0 tx=0).stop 2024-09-16T01:23:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.345+0000 7f079af5f640 1 -- 172.21.15.81:0/1670977496 shutdown_connections 2024-09-16T01:23:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.345+0000 7f079af5f640 1 --2- 172.21.15.81:0/1670977496 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079409b5c0 0x7f07940d05e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.345+0000 7f079af5f640 1 --2- 172.21.15.81:0/1670977496 >> v2:172.21.15.102:3300/0 conn(0x7f079409aca0 0x7f079409b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.345+0000 7f079af5f640 1 -- 172.21.15.81:0/1670977496 >> 172.21.15.81:0/1670977496 conn(0x7f07940d23a0 msgr2=0x7f07940d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.345+0000 7f079af5f640 1 -- 172.21.15.81:0/1670977496 shutdown_connections 2024-09-16T01:23:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.345+0000 7f079af5f640 1 -- 172.21.15.81:0/1670977496 wait complete. 2024-09-16T01:23:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.346+0000 7f079af5f640 1 Processor -- start 2024-09-16T01:23:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.346+0000 7f079af5f640 1 -- start start 2024-09-16T01:23:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f079af5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f079409aca0 0x7f07941518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f079af5f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079409b5c0 0x7f07940c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f079af5f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940d0b20 0x7f07940c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f079af5f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f07940d0fd0 con 0x7f07940d0b20 2024-09-16T01:23:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f079af5f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0794070220 con 0x7f079409aca0 2024-09-16T01:23:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f079af5f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0794070e50 con 0x7f079409b5c0 2024-09-16T01:23:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f07994fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940d0b20 0x7f07940c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f07994fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940d0b20 0x7f07940c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36516/0 (socket says 172.21.15.81:36516) 2024-09-16T01:23:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f07994fc640 1 -- 172.21.15.81:0/709347104 learned_addr learned my addr 172.21.15.81:0/709347104 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f0798cfb640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f079409aca0 0x7f07941518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f078bfff640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079409b5c0 0x7f07940c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f07994fc640 1 -- 172.21.15.81:0/709347104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079409b5c0 msgr2=0x7f07940c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f07994fc640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079409b5c0 0x7f07940c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f07994fc640 1 -- 172.21.15.81:0/709347104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f079409aca0 msgr2=0x7f07941518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f07994fc640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f079409aca0 0x7f07941518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.347+0000 7f07994fc640 1 -- 172.21.15.81:0/709347104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07940c6ab0 con 0x7f07940d0b20 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.348+0000 7f07994fc640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940d0b20 0x7f07940c85e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f078c00c6b0 tx=0x7f078c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.348+0000 7f07897fa640 1 -- 172.21.15.81:0/709347104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c003b70 con 0x7f07940d0b20 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.348+0000 7f07897fa640 1 -- 172.21.15.81:0/709347104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f078c003d30 con 0x7f07940d0b20 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.348+0000 7f079af5f640 1 -- 172.21.15.81:0/709347104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07940c6d90 con 0x7f07940d0b20 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.348+0000 7f07897fa640 1 -- 172.21.15.81:0/709347104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078c005310 con 0x7f07940d0b20 2024-09-16T01:23:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.348+0000 7f079af5f640 1 -- 172.21.15.81:0/709347104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07940c7350 con 0x7f07940d0b20 2024-09-16T01:23:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.349+0000 7f079af5f640 1 -- 172.21.15.81:0/709347104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f079409b080 con 0x7f07940d0b20 2024-09-16T01:23:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.349+0000 7f07897fa640 1 -- 172.21.15.81:0/709347104 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f078c0054b0 con 0x7f07940d0b20 2024-09-16T01:23:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.350+0000 7f07897fa640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f078006c2b0 0x7f078006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.350+0000 7f07897fa640 1 -- 172.21.15.81:0/709347104 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f078c08b310 con 0x7f07940d0b20 2024-09-16T01:23:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.350+0000 7f0798cfb640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f078006c2b0 0x7f078006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.350+0000 7f0798cfb640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f078006c2b0 0x7f078006e770 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f07940c7d00 tx=0x7f0790009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.354+0000 7f07897fa640 1 -- 172.21.15.81:0/709347104 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f078c0592a0 con 0x7f07940d0b20 2024-09-16T01:23:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.530+0000 7f079af5f640 1 -- 172.21.15.81:0/709347104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f07940b3cb0 con 0x7f07940d0b20 2024-09-16T01:23:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.531+0000 7f07897fa640 1 -- 172.21.15.81:0/709347104 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v137) ==== 80+0+0 (secure 0 0 0) 0x7f078c05d5a0 con 0x7f07940d0b20 2024-09-16T01:23:46.532 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:23:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.532+0000 7f079af5f640 1 -- 172.21.15.81:0/709347104 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f078006c2b0 msgr2=0x7f078006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.532+0000 7f079af5f640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f078006c2b0 0x7f078006e770 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f07940c7d00 tx=0x7f0790009190 comp rx=0 tx=0).stop 2024-09-16T01:23:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.532+0000 7f079af5f640 1 -- 172.21.15.81:0/709347104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940d0b20 msgr2=0x7f07940c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.532+0000 7f079af5f640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940d0b20 0x7f07940c85e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f078c00c6b0 tx=0x7f078c00cb70 comp rx=0 tx=0).stop 2024-09-16T01:23:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.533+0000 7f079af5f640 1 -- 172.21.15.81:0/709347104 shutdown_connections 2024-09-16T01:23:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.533+0000 7f079af5f640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f078006c2b0 0x7f078006e770 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.533+0000 7f079af5f640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940d0b20 0x7f07940c85e0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.533+0000 7f079af5f640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079409b5c0 0x7f07940c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.533+0000 7f079af5f640 1 --2- 172.21.15.81:0/709347104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f079409aca0 0x7f07941518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.533+0000 7f079af5f640 1 -- 172.21.15.81:0/709347104 >> 172.21.15.81:0/709347104 conn(0x7f07940d23a0 msgr2=0x7f079415d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.533+0000 7f079af5f640 1 -- 172.21.15.81:0/709347104 shutdown_connections 2024-09-16T01:23:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.533+0000 7f079af5f640 1 -- 172.21.15.81:0/709347104 wait complete. 2024-09-16T01:23:46.544 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:23:46.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:46.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:23:46.668 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:23:46.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:46.669 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:23:46.683 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:23:46.683 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:23:46.684 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:46.702 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:23:46.702 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:46.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:23:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.859+0000 7f4026c65640 1 Processor -- start 2024-09-16T01:23:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.859+0000 7f4026c65640 1 -- start start 2024-09-16T01:23:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.860+0000 7f4026c65640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f402015c490 0x7f402009b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.860+0000 7f4026c65640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f402009b980 0x7f402015c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.860+0000 7f4026c65640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f402015cdb0 0x7f402015ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.860+0000 7f4026c65640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f40200cff70 con 0x7f402015cdb0 2024-09-16T01:23:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.860+0000 7f4026c65640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f40200d0dd0 con 0x7f402009b980 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.860+0000 7f4026c65640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f40200d01c0 con 0x7f402015c490 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.860+0000 7f4025202640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f402015cdb0 0x7f402015ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.860+0000 7f4025202640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f402015cdb0 0x7f402015ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36524/0 (socket says 172.21.15.81:36524) 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.860+0000 7f4025202640 1 -- 172.21.15.81:0/447915072 learned_addr learned my addr 172.21.15.81:0/447915072 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.860+0000 7f401ffff640 1 --2- 172.21.15.81:0/447915072 >> v2:172.21.15.102:3300/0 conn(0x7f402009b980 0x7f402015c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.860+0000 7f4024a01640 1 --2- 172.21.15.81:0/447915072 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f402015c490 0x7f402009b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.861+0000 7f4025202640 1 -- 172.21.15.81:0/447915072 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f402015c490 msgr2=0x7f402009b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.861+0000 7f4025202640 1 --2- 172.21.15.81:0/447915072 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f402015c490 0x7f402009b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.861+0000 7f4025202640 1 -- 172.21.15.81:0/447915072 >> v2:172.21.15.102:3300/0 conn(0x7f402009b980 msgr2=0x7f402015c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.861+0000 7f4025202640 1 --2- 172.21.15.81:0/447915072 >> v2:172.21.15.102:3300/0 conn(0x7f402009b980 0x7f402015c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.861+0000 7f4025202640 1 -- 172.21.15.81:0/447915072 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40200d04a0 con 0x7f402015cdb0 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.861+0000 7f4024a01640 1 --2- 172.21.15.81:0/447915072 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f402015c490 0x7f402009b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.861+0000 7f4025202640 1 --2- 172.21.15.81:0/447915072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f402015cdb0 0x7f402015ff00 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f40200738c0 tx=0x7f401802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c02f7eeddcc228 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:46.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.861+0000 7f401f7fe640 1 -- 172.21.15.81:0/447915072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4018036070 con 0x7f402015cdb0 2024-09-16T01:23:46.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.862+0000 7f401f7fe640 1 -- 172.21.15.81:0/447915072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4018031600 con 0x7f402015cdb0 2024-09-16T01:23:46.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.862+0000 7f401f7fe640 1 -- 172.21.15.81:0/447915072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40180319d0 con 0x7f402015cdb0 2024-09-16T01:23:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.862+0000 7f4026c65640 1 -- 172.21.15.81:0/447915072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f402015cdb0 msgr2=0x7f402015ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.862+0000 7f4026c65640 1 --2- 172.21.15.81:0/447915072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f402015cdb0 0x7f402015ff00 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f40200738c0 tx=0x7f401802a730 comp rx=0 tx=0).stop 2024-09-16T01:23:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.862+0000 7f4026c65640 1 -- 172.21.15.81:0/447915072 shutdown_connections 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.862+0000 7f4026c65640 1 --2- 172.21.15.81:0/447915072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f402015cdb0 0x7f402015ff00 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.862+0000 7f4026c65640 1 --2- 172.21.15.81:0/447915072 >> v2:172.21.15.102:3300/0 conn(0x7f402009b980 0x7f402015c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.862+0000 7f4026c65640 1 --2- 172.21.15.81:0/447915072 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f402015c490 0x7f402009b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.862+0000 7f4026c65640 1 -- 172.21.15.81:0/447915072 >> 172.21.15.81:0/447915072 conn(0x7f40200d23a0 msgr2=0x7f40200d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.862+0000 7f4026c65640 1 -- 172.21.15.81:0/447915072 shutdown_connections 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.862+0000 7f4026c65640 1 -- 172.21.15.81:0/447915072 wait complete. 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.863+0000 7f4026c65640 1 Processor -- start 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.863+0000 7f4026c65640 1 -- start start 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.864+0000 7f4026c65640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402009b980 0x7f40201571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.864+0000 7f4026c65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f402015c490 0x7f40200c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.864+0000 7f4026c65640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f402015cdb0 0x7f40200b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.864+0000 7f4026c65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f402015d260 con 0x7f402015c490 2024-09-16T01:23:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.864+0000 7f4026c65640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f40200d0a60 con 0x7f402009b980 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.864+0000 7f4026c65640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f40200d1260 con 0x7f402015cdb0 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.864+0000 7f401ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f402015c490 0x7f40200c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.864+0000 7f401ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f402015c490 0x7f40200c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36532/0 (socket says 172.21.15.81:36532) 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.864+0000 7f401ffff640 1 -- 172.21.15.81:0/3812518372 learned_addr learned my addr 172.21.15.81:0/3812518372 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.864+0000 7f4024a01640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402009b980 0x7f40201571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.864+0000 7f4025202640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f402015cdb0 0x7f40200b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.865+0000 7f401ffff640 1 -- 172.21.15.81:0/3812518372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f402015cdb0 msgr2=0x7f40200b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.865+0000 7f401ffff640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f402015cdb0 0x7f40200b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.865+0000 7f401ffff640 1 -- 172.21.15.81:0/3812518372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402009b980 msgr2=0x7f40201571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.865+0000 7f401ffff640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402009b980 0x7f40201571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.865+0000 7f401ffff640 1 -- 172.21.15.81:0/3812518372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40200c9470 con 0x7f402015c490 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.865+0000 7f4025202640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f402015cdb0 0x7f40200b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.865+0000 7f401ffff640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f402015c490 0x7f40200c76d0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f401400e980 tx=0x7f401400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.865+0000 7f401d7fa640 1 -- 172.21.15.81:0/3812518372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4014017070 con 0x7f402015c490 2024-09-16T01:23:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.865+0000 7f401d7fa640 1 -- 172.21.15.81:0/3812518372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f401400ca00 con 0x7f402015c490 2024-09-16T01:23:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.865+0000 7f4026c65640 1 -- 172.21.15.81:0/3812518372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40200c80b0 con 0x7f402015c490 2024-09-16T01:23:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.865+0000 7f401d7fa640 1 -- 172.21.15.81:0/3812518372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401400cdd0 con 0x7f402015c490 2024-09-16T01:23:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.865+0000 7f4026c65640 1 -- 172.21.15.81:0/3812518372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40200b5390 con 0x7f402015c490 2024-09-16T01:23:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.866+0000 7f4026c65640 1 -- 172.21.15.81:0/3812518372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f402015c870 con 0x7f402015c490 2024-09-16T01:23:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.866+0000 7f401d7fa640 1 -- 172.21.15.81:0/3812518372 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f401401a070 con 0x7f402015c490 2024-09-16T01:23:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.867+0000 7f401d7fa640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f400c06c2b0 0x7f400c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.867+0000 7f401d7fa640 1 -- 172.21.15.81:0/3812518372 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f401408b520 con 0x7f402015c490 2024-09-16T01:23:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.867+0000 7f4024a01640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f400c06c2b0 0x7f400c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.867+0000 7f4024a01640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f400c06c2b0 0x7f400c06e770 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4010006e80 tx=0x7f4010008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:46.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:46.871+0000 7f401d7fa640 1 -- 172.21.15.81:0/3812518372 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40200c9470 con 0x7f402015c490 2024-09-16T01:23:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.050+0000 7f4026c65640 1 -- 172.21.15.81:0/3812518372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f40200d3190 con 0x7f402015c490 2024-09-16T01:23:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.050+0000 7f401d7fa640 1 -- 172.21.15.81:0/3812518372 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v137) ==== 80+0+0 (secure 0 0 0) 0x7f40140594b0 con 0x7f402015c490 2024-09-16T01:23:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:23:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.052+0000 7f4026c65640 1 -- 172.21.15.81:0/3812518372 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f400c06c2b0 msgr2=0x7f400c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.052+0000 7f4026c65640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f400c06c2b0 0x7f400c06e770 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4010006e80 tx=0x7f4010008040 comp rx=0 tx=0).stop 2024-09-16T01:23:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.052+0000 7f4026c65640 1 -- 172.21.15.81:0/3812518372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f402015c490 msgr2=0x7f40200c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.052+0000 7f4026c65640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f402015c490 0x7f40200c76d0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f401400e980 tx=0x7f401400ee40 comp rx=0 tx=0).stop 2024-09-16T01:23:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.052+0000 7f4026c65640 1 -- 172.21.15.81:0/3812518372 shutdown_connections 2024-09-16T01:23:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.052+0000 7f4026c65640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f400c06c2b0 0x7f400c06e770 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.052+0000 7f4026c65640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f402015cdb0 0x7f40200b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.052+0000 7f4026c65640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f402015c490 0x7f40200c76d0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.052+0000 7f4026c65640 1 --2- 172.21.15.81:0/3812518372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f402009b980 0x7f40201571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.053+0000 7f4026c65640 1 -- 172.21.15.81:0/3812518372 >> 172.21.15.81:0/3812518372 conn(0x7f40200d23a0 msgr2=0x7f4020070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.053+0000 7f4026c65640 1 -- 172.21.15.81:0/3812518372 shutdown_connections 2024-09-16T01:23:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.053+0000 7f4026c65640 1 -- 172.21.15.81:0/3812518372 wait complete. 2024-09-16T01:23:47.064 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:23:47.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:47.065 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T01:23:47.098 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:23:47.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:23:47.098 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:23:47.155 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:23:47.155 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:47.156 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:47.171 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:23:47.172 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:23:47.172 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:23:47.172 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:47.212 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:23:47.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.313+0000 7fa186b4b640 1 Processor -- start 2024-09-16T01:23:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.313+0000 7fa186b4b640 1 -- start start 2024-09-16T01:23:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.314+0000 7fa186b4b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1800b69d0 0x7fa180162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.314+0000 7fa186b4b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa1800b0180 0x7fa180154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.314+0000 7fa186b4b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18015eb60 con 0x7fa1800af280 2024-09-16T01:23:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.314+0000 7fa186b4b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa1800b6db0 con 0x7fa1800b69d0 2024-09-16T01:23:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.314+0000 7fa186b4b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa18015ee40 con 0x7fa1800b0180 2024-09-16T01:23:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.314+0000 7fa1848e7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1800b69d0 0x7fa180162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.314+0000 7fa1848e7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1800b69d0 0x7fa180162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36546/0 (socket says 172.21.15.81:36546) 2024-09-16T01:23:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.314+0000 7fa1848e7640 1 -- 172.21.15.81:0/3277524411 learned_addr learned my addr 172.21.15.81:0/3277524411 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.314+0000 7fa1848e7640 1 -- 172.21.15.81:0/3277524411 >> v2:172.21.15.102:3300/0 conn(0x7fa1800b0180 msgr2=0x7fa180154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.314+0000 7fa1848e7640 1 --2- 172.21.15.81:0/3277524411 >> v2:172.21.15.102:3300/0 conn(0x7fa1800b0180 0x7fa180154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.314+0000 7fa1848e7640 1 -- 172.21.15.81:0/3277524411 >> v1:172.21.15.102:6789/0 conn(0x7fa1800af280 legacy=0x7fa1800afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.314+0000 7fa1848e7640 1 -- 172.21.15.81:0/3277524411 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18015f120 con 0x7fa1800b69d0 2024-09-16T01:23:47.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.315+0000 7fa1848e7640 1 --2- 172.21.15.81:0/3277524411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1800b69d0 0x7fa180162a50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fa18015c590 tx=0x7fa17002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587361139c086b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.315+0000 7fa17f7fe640 1 -- 172.21.15.81:0/3277524411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa170037070 con 0x7fa1800b69d0 2024-09-16T01:23:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.315+0000 7fa17f7fe640 1 -- 172.21.15.81:0/3277524411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17002ae20 con 0x7fa1800b69d0 2024-09-16T01:23:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.315+0000 7fa17f7fe640 1 -- 172.21.15.81:0/3277524411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa170032660 con 0x7fa1800b69d0 2024-09-16T01:23:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.315+0000 7fa186b4b640 1 -- 172.21.15.81:0/3277524411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1800b69d0 msgr2=0x7fa180162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.315+0000 7fa186b4b640 1 --2- 172.21.15.81:0/3277524411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1800b69d0 0x7fa180162a50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fa18015c590 tx=0x7fa17002a110 comp rx=0 tx=0).stop 2024-09-16T01:23:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.316+0000 7fa186b4b640 1 -- 172.21.15.81:0/3277524411 shutdown_connections 2024-09-16T01:23:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.316+0000 7fa186b4b640 1 --2- 172.21.15.81:0/3277524411 >> v2:172.21.15.102:3300/0 conn(0x7fa1800b0180 0x7fa180154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.316+0000 7fa186b4b640 1 --2- 172.21.15.81:0/3277524411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1800b69d0 0x7fa180162a50 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.316+0000 7fa186b4b640 1 -- 172.21.15.81:0/3277524411 >> 172.21.15.81:0/3277524411 conn(0x7fa18006bc10 msgr2=0x7fa18006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.316+0000 7fa186b4b640 1 -- 172.21.15.81:0/3277524411 shutdown_connections 2024-09-16T01:23:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.316+0000 7fa186b4b640 1 -- 172.21.15.81:0/3277524411 wait complete. 2024-09-16T01:23:47.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.317+0000 7fa186b4b640 1 Processor -- start 2024-09-16T01:23:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.317+0000 7fa186b4b640 1 -- start start 2024-09-16T01:23:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa186b4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1800af280 0x7fa1801587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa186b4b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1800b0180 0x7fa18015aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa186b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1800b69d0 0x7fa1800ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa186b4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa180155240 con 0x7fa1800b69d0 2024-09-16T01:23:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa186b4b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa1800af710 con 0x7fa1800af280 2024-09-16T01:23:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa186b4b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa1801553c0 con 0x7fa1800b0180 2024-09-16T01:23:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa1850e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1800b69d0 0x7fa1800ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa1850e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1800b69d0 0x7fa1800ce6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36550/0 (socket says 172.21.15.81:36550) 2024-09-16T01:23:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa1850e8640 1 -- 172.21.15.81:0/3191281721 learned_addr learned my addr 172.21.15.81:0/3191281721 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa1848e7640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1800af280 0x7fa1801587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa17ffff640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1800b0180 0x7fa18015aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa1850e8640 1 -- 172.21.15.81:0/3191281721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1800b0180 msgr2=0x7fa18015aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa1850e8640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1800b0180 0x7fa18015aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa1850e8640 1 -- 172.21.15.81:0/3191281721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1800af280 msgr2=0x7fa1801587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa1850e8640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1800af280 0x7fa1801587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa1850e8640 1 -- 172.21.15.81:0/3191281721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1800cd650 con 0x7fa1800b69d0 2024-09-16T01:23:47.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa1850e8640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1800b69d0 0x7fa1800ce6b0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fa17800b9e0 tx=0x7fa17800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:47.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa17d7fa640 1 -- 172.21.15.81:0/3191281721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178019070 con 0x7fa1800b69d0 2024-09-16T01:23:47.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa17d7fa640 1 -- 172.21.15.81:0/3191281721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17800cb20 con 0x7fa1800b69d0 2024-09-16T01:23:47.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa186b4b640 1 -- 172.21.15.81:0/3191281721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa180158d00 con 0x7fa1800b69d0 2024-09-16T01:23:47.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa17d7fa640 1 -- 172.21.15.81:0/3191281721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178014440 con 0x7fa1800b69d0 2024-09-16T01:23:47.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.318+0000 7fa186b4b640 1 -- 172.21.15.81:0/3191281721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1800cdbd0 con 0x7fa1800b69d0 2024-09-16T01:23:47.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.319+0000 7fa186b4b640 1 -- 172.21.15.81:0/3191281721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1800ce390 con 0x7fa1800b69d0 2024-09-16T01:23:47.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.320+0000 7fa17d7fa640 1 -- 172.21.15.81:0/3191281721 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa17801c070 con 0x7fa1800b69d0 2024-09-16T01:23:47.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.320+0000 7fa17d7fa640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa16006c2b0 0x7fa16006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.320+0000 7fa17d7fa640 1 -- 172.21.15.81:0/3191281721 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fa17808b260 con 0x7fa1800b69d0 2024-09-16T01:23:47.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.320+0000 7fa1848e7640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa16006c2b0 0x7fa16006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.321+0000 7fa1848e7640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa16006c2b0 0x7fa16006e770 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa170034000 tx=0x7fa17002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:47.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.324+0000 7fa17d7fa640 1 -- 172.21.15.81:0/3191281721 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1800ce390 con 0x7fa1800b69d0 2024-09-16T01:23:47.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.526+0000 7fa186b4b640 1 -- 172.21.15.81:0/3191281721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa18006c9c0 con 0x7fa1800b69d0 2024-09-16T01:23:47.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.527+0000 7fa17d7fa640 1 -- 172.21.15.81:0/3191281721 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5227 (secure 0 0 0) 0x7fa1780598d0 con 0x7fa1800b69d0 2024-09-16T01:23:47.528 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:47.528 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"btime":"2024-09-16T01:23:43:950504+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/350084010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":350084010},{"type":"v1","addr":"172.21.15.81:6837","nonce":350084010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6389,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1730570681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1730570681},{"type":"v1","addr":"172.21.15.102:6834","nonce":1730570681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/755231532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":755231532},{"type":"v1","addr":"172.21.15.102:6835","nonce":755231532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:23:18.932203+0000","modified":"2024-09-16T01:23:43.627836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6836/1395000865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1395000865},{"type":"v1","addr":"172.21.15.81:6836","nonce":1395000865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8103,"qdb_cluster":[8103]},"id":10}]} 2024-09-16T01:23:47.528 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 77 2024-09-16T01:23:47.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.529+0000 7fa186b4b640 1 -- 172.21.15.81:0/3191281721 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa16006c2b0 msgr2=0x7fa16006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.529+0000 7fa186b4b640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa16006c2b0 0x7fa16006e770 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa170034000 tx=0x7fa17002e000 comp rx=0 tx=0).stop 2024-09-16T01:23:47.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.529+0000 7fa186b4b640 1 -- 172.21.15.81:0/3191281721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1800b69d0 msgr2=0x7fa1800ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.529+0000 7fa186b4b640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1800b69d0 0x7fa1800ce6b0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fa17800b9e0 tx=0x7fa17800bea0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.529+0000 7fa186b4b640 1 -- 172.21.15.81:0/3191281721 shutdown_connections 2024-09-16T01:23:47.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.529+0000 7fa186b4b640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa16006c2b0 0x7fa16006e770 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.529+0000 7fa186b4b640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1800b69d0 0x7fa1800ce6b0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.529+0000 7fa186b4b640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa1800b0180 0x7fa18015aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.529+0000 7fa186b4b640 1 --2- 172.21.15.81:0/3191281721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1800af280 0x7fa1801587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.529+0000 7fa186b4b640 1 -- 172.21.15.81:0/3191281721 >> 172.21.15.81:0/3191281721 conn(0x7fa18006bc10 msgr2=0x7fa1800afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:47.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.529+0000 7fa186b4b640 1 -- 172.21.15.81:0/3191281721 shutdown_connections 2024-09-16T01:23:47.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.529+0000 7fa186b4b640 1 -- 172.21.15.81:0/3191281721 wait complete. 2024-09-16T01:23:47.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.638+0000 7fa593f03640 1 Processor -- start 2024-09-16T01:23:47.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.638+0000 7fa593f03640 1 -- start start 2024-09-16T01:23:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa593f03640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa58c15ba30 0x7fa58c06f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa593f03640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa58c06fd50 0x7fa58c072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa593f03640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa58c072e80 0x7fa58c06e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa593f03640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa58c0b4180 con 0x7fa58c072e80 2024-09-16T01:23:47.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa593f03640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa58c0b3570 con 0x7fa58c15ba30 2024-09-16T01:23:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa593f03640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c0b3850 con 0x7fa58c06fd50 2024-09-16T01:23:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa5924a0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa58c072e80 0x7fa58c06e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa5924a0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa58c072e80 0x7fa58c06e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36552/0 (socket says 172.21.15.81:36552) 2024-09-16T01:23:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa5924a0640 1 -- 172.21.15.81:0/1801338870 learned_addr learned my addr 172.21.15.81:0/1801338870 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa591c9f640 1 --2- 172.21.15.81:0/1801338870 >> v2:172.21.15.102:3300/0 conn(0x7fa58c15ba30 0x7fa58c06f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa59149e640 1 --2- 172.21.15.81:0/1801338870 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa58c06fd50 0x7fa58c072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa5924a0640 1 -- 172.21.15.81:0/1801338870 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa58c06fd50 msgr2=0x7fa58c072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa5924a0640 1 --2- 172.21.15.81:0/1801338870 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa58c06fd50 0x7fa58c072940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa5924a0640 1 -- 172.21.15.81:0/1801338870 >> v2:172.21.15.102:3300/0 conn(0x7fa58c15ba30 msgr2=0x7fa58c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa5924a0640 1 --2- 172.21.15.81:0/1801338870 >> v2:172.21.15.102:3300/0 conn(0x7fa58c15ba30 0x7fa58c06f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.639+0000 7fa5924a0640 1 -- 172.21.15.81:0/1801338870 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c0b3b30 con 0x7fa58c072e80 2024-09-16T01:23:47.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.640+0000 7fa5924a0640 1 --2- 172.21.15.81:0/1801338870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa58c072e80 0x7fa58c06e0b0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa58c06ca90 tx=0x7fa58402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee5b8ccdbf9a9c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:47.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.640+0000 7fa590c9d640 1 -- 172.21.15.81:0/1801338870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584036070 con 0x7fa58c072e80 2024-09-16T01:23:47.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.640+0000 7fa590c9d640 1 -- 172.21.15.81:0/1801338870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa584031600 con 0x7fa58c072e80 2024-09-16T01:23:47.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.640+0000 7fa590c9d640 1 -- 172.21.15.81:0/1801338870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5840319d0 con 0x7fa58c072e80 2024-09-16T01:23:47.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.641+0000 7fa593f03640 1 -- 172.21.15.81:0/1801338870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa58c072e80 msgr2=0x7fa58c06e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.641+0000 7fa593f03640 1 --2- 172.21.15.81:0/1801338870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa58c072e80 0x7fa58c06e0b0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa58c06ca90 tx=0x7fa58402a6a0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.641+0000 7fa593f03640 1 -- 172.21.15.81:0/1801338870 shutdown_connections 2024-09-16T01:23:47.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.641+0000 7fa593f03640 1 --2- 172.21.15.81:0/1801338870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa58c072e80 0x7fa58c06e0b0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.641+0000 7fa593f03640 1 --2- 172.21.15.81:0/1801338870 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa58c06fd50 0x7fa58c072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.641+0000 7fa593f03640 1 --2- 172.21.15.81:0/1801338870 >> v2:172.21.15.102:3300/0 conn(0x7fa58c15ba30 0x7fa58c06f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.641+0000 7fa593f03640 1 -- 172.21.15.81:0/1801338870 >> 172.21.15.81:0/1801338870 conn(0x7fa58c067d70 msgr2=0x7fa58c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:47.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.641+0000 7fa593f03640 1 -- 172.21.15.81:0/1801338870 shutdown_connections 2024-09-16T01:23:47.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.641+0000 7fa593f03640 1 -- 172.21.15.81:0/1801338870 wait complete. 2024-09-16T01:23:47.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.642+0000 7fa593f03640 1 Processor -- start 2024-09-16T01:23:47.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.642+0000 7fa593f03640 1 -- start start 2024-09-16T01:23:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa593f03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa58c06fd50 0x7fa58c1f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa593f03640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa58c072e80 0x7fa58c1f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa593f03640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa58c15ba30 0x7fa58c145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa593f03640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c0ccfe0 con 0x7fa58c06fd50 2024-09-16T01:23:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa593f03640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c0ce810 con 0x7fa58c15ba30 2024-09-16T01:23:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa593f03640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c0cd160 con 0x7fa58c072e80 2024-09-16T01:23:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa591c9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa58c06fd50 0x7fa58c1f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa591c9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa58c06fd50 0x7fa58c1f0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36554/0 (socket says 172.21.15.81:36554) 2024-09-16T01:23:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa591c9f640 1 -- 172.21.15.81:0/3635118267 learned_addr learned my addr 172.21.15.81:0/3635118267 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa59149e640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa58c072e80 0x7fa58c1f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa5924a0640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa58c15ba30 0x7fa58c145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa591c9f640 1 -- 172.21.15.81:0/3635118267 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa58c072e80 msgr2=0x7fa58c1f2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa591c9f640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa58c072e80 0x7fa58c1f2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa591c9f640 1 -- 172.21.15.81:0/3635118267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa58c15ba30 msgr2=0x7fa58c145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa591c9f640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa58c15ba30 0x7fa58c145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa591c9f640 1 -- 172.21.15.81:0/3635118267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c1f1840 con 0x7fa58c06fd50 2024-09-16T01:23:47.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa591c9f640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa58c06fd50 0x7fa58c1f0e50 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa58800c7f0 tx=0x7fa58800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:47.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa5827fc640 1 -- 172.21.15.81:0/3635118267 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588015070 con 0x7fa58c06fd50 2024-09-16T01:23:47.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa5827fc640 1 -- 172.21.15.81:0/3635118267 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa588004220 con 0x7fa58c06fd50 2024-09-16T01:23:47.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa593f03640 1 -- 172.21.15.81:0/3635118267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58c1f1b20 con 0x7fa58c06fd50 2024-09-16T01:23:47.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa5827fc640 1 -- 172.21.15.81:0/3635118267 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588007620 con 0x7fa58c06fd50 2024-09-16T01:23:47.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.643+0000 7fa593f03640 1 -- 172.21.15.81:0/3635118267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa58c1f20e0 con 0x7fa58c06fd50 2024-09-16T01:23:47.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.644+0000 7fa593f03640 1 -- 172.21.15.81:0/3635118267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa58c06f810 con 0x7fa58c06fd50 2024-09-16T01:23:47.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.645+0000 7fa5827fc640 1 -- 172.21.15.81:0/3635118267 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa5880079d0 con 0x7fa58c06fd50 2024-09-16T01:23:47.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.645+0000 7fa5827fc640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa57006c2b0 0x7fa57006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.645+0000 7fa5827fc640 1 -- 172.21.15.81:0/3635118267 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7fa58808b900 con 0x7fa58c06fd50 2024-09-16T01:23:47.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.645+0000 7fa59149e640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa57006c2b0 0x7fa57006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.646+0000 7fa59149e640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa57006c2b0 0x7fa57006e770 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa58c1593d0 tx=0x7fa57c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:47.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.650+0000 7fa5827fc640 1 -- 172.21.15.81:0/3635118267 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa588059ee0 con 0x7fa58c06fd50 2024-09-16T01:23:47.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.848+0000 7fa593f03640 1 -- 172.21.15.81:0/3635118267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa58c0cf310 con 0x7fa58c06fd50 2024-09-16T01:23:47.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.849+0000 7fa5827fc640 1 -- 172.21.15.81:0/3635118267 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5227 (secure 0 0 0) 0x7fa5880597e0 con 0x7fa58c06fd50 2024-09-16T01:23:47.850 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:47.850 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"btime":"2024-09-16T01:23:43:950504+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/350084010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":350084010},{"type":"v1","addr":"172.21.15.81:6837","nonce":350084010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6389,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1730570681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1730570681},{"type":"v1","addr":"172.21.15.102:6834","nonce":1730570681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/755231532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":755231532},{"type":"v1","addr":"172.21.15.102:6835","nonce":755231532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:23:18.932203+0000","modified":"2024-09-16T01:23:43.627836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6836/1395000865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1395000865},{"type":"v1","addr":"172.21.15.81:6836","nonce":1395000865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8103,"qdb_cluster":[8103]},"id":10}]} 2024-09-16T01:23:47.851 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 77 2024-09-16T01:23:47.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.851+0000 7fa593f03640 1 -- 172.21.15.81:0/3635118267 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa57006c2b0 msgr2=0x7fa57006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.851+0000 7fa593f03640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa57006c2b0 0x7fa57006e770 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa58c1593d0 tx=0x7fa57c008040 comp rx=0 tx=0).stop 2024-09-16T01:23:47.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.851+0000 7fa593f03640 1 -- 172.21.15.81:0/3635118267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa58c06fd50 msgr2=0x7fa58c1f0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.851+0000 7fa593f03640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa58c06fd50 0x7fa58c1f0e50 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa58800c7f0 tx=0x7fa58800ccb0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.851+0000 7fa593f03640 1 -- 172.21.15.81:0/3635118267 shutdown_connections 2024-09-16T01:23:47.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.851+0000 7fa593f03640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa57006c2b0 0x7fa57006e770 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.851+0000 7fa593f03640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa58c15ba30 0x7fa58c145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.851+0000 7fa593f03640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa58c072e80 0x7fa58c1f2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.851+0000 7fa593f03640 1 --2- 172.21.15.81:0/3635118267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa58c06fd50 0x7fa58c1f0e50 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.851+0000 7fa593f03640 1 -- 172.21.15.81:0/3635118267 >> 172.21.15.81:0/3635118267 conn(0x7fa58c067d70 msgr2=0x7fa58c0cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:47.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.851+0000 7fa593f03640 1 -- 172.21.15.81:0/3635118267 shutdown_connections 2024-09-16T01:23:47.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.851+0000 7fa593f03640 1 -- 172.21.15.81:0/3635118267 wait complete. 2024-09-16T01:23:47.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:23:47.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.961+0000 7f719ff8d640 1 Processor -- start 2024-09-16T01:23:47.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.961+0000 7f719ff8d640 1 -- start start 2024-09-16T01:23:47.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.962+0000 7f719ff8d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f71980d1540 0x7f719806dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.962+0000 7f719ff8d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71980d1970 con 0x7f719815e740 2024-09-16T01:23:47.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.962+0000 7f719ff8d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71980d0780 con 0x7f719809b690 2024-09-16T01:23:47.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.962+0000 7f719ff8d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f719815eb20 con 0x7f71980d1540 2024-09-16T01:23:47.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.962+0000 7f719dd29640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f719815e740 0x7f719806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46028/0 (socket says 172.21.15.81:46028) 2024-09-16T01:23:47.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.962+0000 7f719dd29640 1 -- 172.21.15.81:0/1884055223 learned_addr learned my addr 172.21.15.81:0/1884055223 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:47.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.962+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609815172 0 0) 0x7f71980d1970 con 0x7f719815e740 2024-09-16T01:23:47.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.962+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7184003520 con 0x7f719815e740 2024-09-16T01:23:47.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.962+0000 7f719d528640 1 --2- 172.21.15.81:0/1884055223 >> v2:172.21.15.102:3300/0 conn(0x7f71980d1540 0x7f719806dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4055235825 0 0) 0x7f7184003520 con 0x7f719815e740 2024-09-16T01:23:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 >> v2:172.21.15.102:3300/0 conn(0x7f71980d1540 msgr2=0x7f719806dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 --2- 172.21.15.81:0/1884055223 >> v2:172.21.15.102:3300/0 conn(0x7f71980d1540 0x7f719806dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 >> v1:172.21.15.102:6789/0 conn(0x7f719809b690 legacy=0x7f7198070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71980d0a60 con 0x7f719815e740 2024-09-16T01:23:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f7194001670 con 0x7f719815e740 2024-09-16T01:23:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 >> v1:172.21.15.81:6789/0 conn(0x7f719815e740 legacy=0x7f719806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 --2- 172.21.15.81:0/1884055223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 0x7f7184003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 --2- 172.21.15.81:0/1884055223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7184004800 0x7f7184004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 --2- 172.21.15.81:0/1884055223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71840051c0 0x7f718400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f719815eb20 con 0x7f71840039b0 2024-09-16T01:23:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f718400c070 con 0x7f7184004800 2024-09-16T01:23:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f718400c270 con 0x7f71840051c0 2024-09-16T01:23:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719dd29640 1 --2- 172.21.15.81:0/1884055223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 0x7f7184003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719d528640 1 --2- 172.21.15.81:0/1884055223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7184004800 0x7f7184004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719e52a640 1 --2- 172.21.15.81:0/1884055223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71840051c0 0x7f718400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719dd29640 1 -- 172.21.15.81:0/1884055223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71840051c0 msgr2=0x7f718400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719dd29640 1 --2- 172.21.15.81:0/1884055223 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71840051c0 0x7f718400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719dd29640 1 -- 172.21.15.81:0/1884055223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7184004800 msgr2=0x7f7184004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719dd29640 1 --2- 172.21.15.81:0/1884055223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7184004800 0x7f7184004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719dd29640 1 -- 172.21.15.81:0/1884055223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7184003520 con 0x7f71840039b0 2024-09-16T01:23:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719e52a640 1 -- 172.21.15.81:0/1884055223 reap_dead start 2024-09-16T01:23:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.963+0000 7f719d528640 1 --2- 172.21.15.81:0/1884055223 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7184004800 0x7f7184004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.964+0000 7f719dd29640 1 --2- 172.21.15.81:0/1884055223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 0x7f7184003dd0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f719400c210 tx=0x7f7184005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4025b885d855313 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.964+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194007d30 con 0x7f71840039b0 2024-09-16T01:23:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.964+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7194005ad0 con 0x7f71840039b0 2024-09-16T01:23:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.964+0000 7f719cd27640 1 -- 172.21.15.81:0/1884055223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194007070 con 0x7f71840039b0 2024-09-16T01:23:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.964+0000 7f719ff8d640 1 -- 172.21.15.81:0/1884055223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 msgr2=0x7f7184003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.964+0000 7f719ff8d640 1 --2- 172.21.15.81:0/1884055223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 0x7f7184003dd0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f719400c210 tx=0x7f7184005830 comp rx=0 tx=0).stop 2024-09-16T01:23:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.964+0000 7f719ff8d640 1 -- 172.21.15.81:0/1884055223 shutdown_connections 2024-09-16T01:23:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.964+0000 7f719ff8d640 1 --2- 172.21.15.81:0/1884055223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 0x7f7184003dd0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.964+0000 7f719ff8d640 1 -- 172.21.15.81:0/1884055223 >> 172.21.15.81:0/1884055223 conn(0x7f71980d23a0 msgr2=0x7f71980d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.965+0000 7f719ff8d640 1 -- 172.21.15.81:0/1884055223 shutdown_connections 2024-09-16T01:23:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.965+0000 7f719ff8d640 1 -- 172.21.15.81:0/1884055223 wait complete. 2024-09-16T01:23:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.966+0000 7f719ff8d640 1 Processor -- start 2024-09-16T01:23:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.966+0000 7f719ff8d640 1 -- start start 2024-09-16T01:23:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719ff8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 0x7f7198156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719ff8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f719815a790 0x7f71980c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719ff8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f719815b5a0 0x7f71980b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719ff8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f719809baa0 con 0x7f71840039b0 2024-09-16T01:23:47.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719ff8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f71980d1020 con 0x7f719815a790 2024-09-16T01:23:47.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719ff8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f719806cd20 con 0x7f719815b5a0 2024-09-16T01:23:47.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719dd29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 0x7f7198156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719dd29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 0x7f7198156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36570/0 (socket says 172.21.15.81:36570) 2024-09-16T01:23:47.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719dd29640 1 -- 172.21.15.81:0/541374089 learned_addr learned my addr 172.21.15.81:0/541374089 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:47.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719e52a640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f719815b5a0 0x7f71980b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719d528640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f719815a790 0x7f71980c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719dd29640 1 -- 172.21.15.81:0/541374089 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f719815b5a0 msgr2=0x7f71980b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719dd29640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f719815b5a0 0x7f71980b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719dd29640 1 -- 172.21.15.81:0/541374089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f719815a790 msgr2=0x7f71980c9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719dd29640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f719815a790 0x7f71980c9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719dd29640 1 -- 172.21.15.81:0/541374089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71980c65e0 con 0x7f71840039b0 2024-09-16T01:23:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.967+0000 7f719dd29640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 0x7f7198156aa0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f719400c210 tx=0x7f7194001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.969+0000 7f718e7fc640 1 -- 172.21.15.81:0/541374089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194007d10 con 0x7f71840039b0 2024-09-16T01:23:47.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.969+0000 7f718e7fc640 1 -- 172.21.15.81:0/541374089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7194042070 con 0x7f71840039b0 2024-09-16T01:23:47.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.969+0000 7f718e7fc640 1 -- 172.21.15.81:0/541374089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194007290 con 0x7f71840039b0 2024-09-16T01:23:47.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.969+0000 7f719ff8d640 1 -- 172.21.15.81:0/541374089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719815bf20 con 0x7f71840039b0 2024-09-16T01:23:47.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.969+0000 7f719ff8d640 1 -- 172.21.15.81:0/541374089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71980c6b60 con 0x7f71840039b0 2024-09-16T01:23:47.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.970+0000 7f719ff8d640 1 -- 172.21.15.81:0/541374089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f719806d050 con 0x7f71840039b0 2024-09-16T01:23:47.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.970+0000 7f718e7fc640 1 -- 172.21.15.81:0/541374089 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f719403b040 con 0x7f71840039b0 2024-09-16T01:23:47.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.971+0000 7f718e7fc640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f717c06c2e0 0x7f717c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.971+0000 7f718e7fc640 1 -- 172.21.15.81:0/541374089 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f71940ab6d0 con 0x7f71840039b0 2024-09-16T01:23:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.971+0000 7f719d528640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f717c06c2e0 0x7f717c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.971+0000 7f719d528640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f717c06c2e0 0x7f717c06e7a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7198156fe0 tx=0x7f7188008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:47.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:47.975+0000 7f718e7fc640 1 -- 172.21.15.81:0/541374089 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7194004e20 con 0x7f71840039b0 2024-09-16T01:23:48.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.143+0000 7f719ff8d640 1 -- 172.21.15.81:0/541374089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71980d1cb0 con 0x7f71840039b0 2024-09-16T01:23:48.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.144+0000 7f718e7fc640 1 -- 172.21.15.81:0/541374089 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16952 (secure 0 0 0) 0x7f7194079810 con 0x7f71840039b0 2024-09-16T01:23:48.145 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:48.146 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":137,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:23:20.600617+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:23:17.268973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-16T01:23:17.902232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:23:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.146+0000 7f719ff8d640 1 -- 172.21.15.81:0/541374089 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f717c06c2e0 msgr2=0x7f717c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.146+0000 7f719ff8d640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f717c06c2e0 0x7f717c06e7a0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7198156fe0 tx=0x7f7188008040 comp rx=0 tx=0).stop 2024-09-16T01:23:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.146+0000 7f719ff8d640 1 -- 172.21.15.81:0/541374089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 msgr2=0x7f7198156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.146+0000 7f719ff8d640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 0x7f7198156aa0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f719400c210 tx=0x7f7194001a40 comp rx=0 tx=0).stop 2024-09-16T01:23:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.146+0000 7f719ff8d640 1 -- 172.21.15.81:0/541374089 shutdown_connections 2024-09-16T01:23:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.146+0000 7f719ff8d640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f717c06c2e0 0x7f717c06e7a0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.146+0000 7f719ff8d640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f719815b5a0 0x7f71980b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.146+0000 7f719ff8d640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f719815a790 0x7f71980c9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.146+0000 7f719ff8d640 1 --2- 172.21.15.81:0/541374089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840039b0 0x7f7198156aa0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.146+0000 7f719ff8d640 1 -- 172.21.15.81:0/541374089 >> 172.21.15.81:0/541374089 conn(0x7f71980d23a0 msgr2=0x7f71980b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.146+0000 7f719ff8d640 1 -- 172.21.15.81:0/541374089 shutdown_connections 2024-09-16T01:23:48.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.146+0000 7f719ff8d640 1 -- 172.21.15.81:0/541374089 wait complete. 2024-09-16T01:23:48.158 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:23:48.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.256+0000 7f58a10f1640 1 Processor -- start 2024-09-16T01:23:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.256+0000 7f58a10f1640 1 -- start start 2024-09-16T01:23:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f58a10f1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f589c0b69d0 0x7f589c162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f58a10f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f589c0b0180 0x7f589c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f58a10f1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589c15eb60 con 0x7f589c0af280 2024-09-16T01:23:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f58a10f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f589c0b6db0 con 0x7f589c0b0180 2024-09-16T01:23:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f58a10f1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f589c15ee40 con 0x7f589c0b69d0 2024-09-16T01:23:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f589b59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f589c0b0180 0x7f589c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f589b59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f589c0b0180 0x7f589c154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36586/0 (socket says 172.21.15.81:36586) 2024-09-16T01:23:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f589b59e640 1 -- 172.21.15.81:0/2371805875 learned_addr learned my addr 172.21.15.81:0/2371805875 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f589b59e640 1 -- 172.21.15.81:0/2371805875 >> v2:172.21.15.102:3300/0 conn(0x7f589c0b69d0 msgr2=0x7f589c162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f589ad9d640 1 --2- 172.21.15.81:0/2371805875 >> v2:172.21.15.102:3300/0 conn(0x7f589c0b69d0 0x7f589c162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f589b59e640 1 --2- 172.21.15.81:0/2371805875 >> v2:172.21.15.102:3300/0 conn(0x7f589c0b69d0 0x7f589c162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f589b59e640 1 -- 172.21.15.81:0/2371805875 >> v1:172.21.15.102:6789/0 conn(0x7f589c0af280 legacy=0x7f589c0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f589b59e640 1 -- 172.21.15.81:0/2371805875 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589c15f120 con 0x7f589c0b0180 2024-09-16T01:23:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.257+0000 7f589ad9d640 1 --2- 172.21.15.81:0/2371805875 >> v2:172.21.15.102:3300/0 conn(0x7f589c0b69d0 0x7f589c162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.258+0000 7f589b59e640 1 --2- 172.21.15.81:0/2371805875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0b0180 0x7f589c154d00 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f589c070980 tx=0x7f589402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa868e1c25d160c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.258+0000 7f589a59c640 1 -- 172.21.15.81:0/2371805875 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5894036070 con 0x7f589c0b0180 2024-09-16T01:23:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.258+0000 7f589a59c640 1 -- 172.21.15.81:0/2371805875 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5894031600 con 0x7f589c0b0180 2024-09-16T01:23:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.258+0000 7f589a59c640 1 -- 172.21.15.81:0/2371805875 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58940319d0 con 0x7f589c0b0180 2024-09-16T01:23:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.259+0000 7f58a10f1640 1 -- 172.21.15.81:0/2371805875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0b0180 msgr2=0x7f589c154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.259+0000 7f58a10f1640 1 --2- 172.21.15.81:0/2371805875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0b0180 0x7f589c154d00 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f589c070980 tx=0x7f589402a5d0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.259+0000 7f58a10f1640 1 -- 172.21.15.81:0/2371805875 shutdown_connections 2024-09-16T01:23:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.259+0000 7f58a10f1640 1 --2- 172.21.15.81:0/2371805875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0b0180 0x7f589c154d00 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.259+0000 7f58a10f1640 1 --2- 172.21.15.81:0/2371805875 >> v2:172.21.15.102:3300/0 conn(0x7f589c0b69d0 0x7f589c162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.259+0000 7f58a10f1640 1 -- 172.21.15.81:0/2371805875 >> 172.21.15.81:0/2371805875 conn(0x7f589c06bc10 msgr2=0x7f589c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.259+0000 7f58a10f1640 1 -- 172.21.15.81:0/2371805875 shutdown_connections 2024-09-16T01:23:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.259+0000 7f58a10f1640 1 -- 172.21.15.81:0/2371805875 wait complete. 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.260+0000 7f58a10f1640 1 Processor -- start 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.260+0000 7f58a10f1640 1 -- start start 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f58a10f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f589c0af280 0x7f589c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f58a10f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0b0180 0x7f589c1513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f58a10f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f589c0b69d0 0x7f589c141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f58a10f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f589c155240 con 0x7f589c0b0180 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f58a10f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f589c0af710 con 0x7f589c0b69d0 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f58a10f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f589c1553c0 con 0x7f589c0af280 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f5893fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0b0180 0x7f589c1513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f5893fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0b0180 0x7f589c1513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36600/0 (socket says 172.21.15.81:36600) 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f5893fff640 1 -- 172.21.15.81:0/63067028 learned_addr learned my addr 172.21.15.81:0/63067028 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f589b59e640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f589c0b69d0 0x7f589c141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f589ad9d640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f589c0af280 0x7f589c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f5893fff640 1 -- 172.21.15.81:0/63067028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f589c0af280 msgr2=0x7f589c0cd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f5893fff640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f589c0af280 0x7f589c0cd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f5893fff640 1 -- 172.21.15.81:0/63067028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f589c0b69d0 msgr2=0x7f589c141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f5893fff640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f589c0b69d0 0x7f589c141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f5893fff640 1 -- 172.21.15.81:0/63067028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589c150330 con 0x7f589c0b0180 2024-09-16T01:23:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f589ad9d640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f589c0af280 0x7f589c0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f5893fff640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0b0180 0x7f589c1513d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f588400c430 tx=0x7f588400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f58937fe640 1 -- 172.21.15.81:0/63067028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884011790 con 0x7f589c0b0180 2024-09-16T01:23:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f58937fe640 1 -- 172.21.15.81:0/63067028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5884017070 con 0x7f589c0b0180 2024-09-16T01:23:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f58a10f1640 1 -- 172.21.15.81:0/63067028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f589c150610 con 0x7f589c0b0180 2024-09-16T01:23:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f58937fe640 1 -- 172.21.15.81:0/63067028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884011bb0 con 0x7f589c0b0180 2024-09-16T01:23:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.261+0000 7f58a10f1640 1 -- 172.21.15.81:0/63067028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f589c150bd0 con 0x7f589c0b0180 2024-09-16T01:23:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.262+0000 7f58a10f1640 1 -- 172.21.15.81:0/63067028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f589c1510c0 con 0x7f589c0b0180 2024-09-16T01:23:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.263+0000 7f58937fe640 1 -- 172.21.15.81:0/63067028 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f588401c460 con 0x7f589c0b0180 2024-09-16T01:23:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.263+0000 7f58937fe640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f587c06c2b0 0x7f587c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.263+0000 7f58937fe640 1 -- 172.21.15.81:0/63067028 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f588408b380 con 0x7f589c0b0180 2024-09-16T01:23:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.263+0000 7f589ad9d640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f587c06c2b0 0x7f587c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.264+0000 7f589ad9d640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f587c06c2b0 0x7f587c06e770 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f589c0b28d0 tx=0x7f588c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.268+0000 7f58937fe640 1 -- 172.21.15.81:0/63067028 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58840599f0 con 0x7f589c0b0180 2024-09-16T01:23:48.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.468+0000 7f58a10f1640 1 -- 172.21.15.81:0/63067028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f589c155780 con 0x7f589c0b0180 2024-09-16T01:23:48.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.469+0000 7f58937fe640 1 -- 172.21.15.81:0/63067028 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5227 (secure 0 0 0) 0x7f58840592f0 con 0x7f589c0b0180 2024-09-16T01:23:48.470 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:48.470 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"btime":"2024-09-16T01:23:43:950504+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/350084010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":350084010},{"type":"v1","addr":"172.21.15.81:6837","nonce":350084010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6389,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1730570681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1730570681},{"type":"v1","addr":"172.21.15.102:6834","nonce":1730570681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/755231532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":755231532},{"type":"v1","addr":"172.21.15.102:6835","nonce":755231532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:23:18.932203+0000","modified":"2024-09-16T01:23:43.627836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6836/1395000865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1395000865},{"type":"v1","addr":"172.21.15.81:6836","nonce":1395000865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8103,"qdb_cluster":[8103]},"id":10}]} 2024-09-16T01:23:48.470 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 77 2024-09-16T01:23:48.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.470+0000 7f58a10f1640 1 -- 172.21.15.81:0/63067028 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f587c06c2b0 msgr2=0x7f587c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.470+0000 7f58a10f1640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f587c06c2b0 0x7f587c06e770 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f589c0b28d0 tx=0x7f588c008040 comp rx=0 tx=0).stop 2024-09-16T01:23:48.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.471+0000 7f58a10f1640 1 -- 172.21.15.81:0/63067028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0b0180 msgr2=0x7f589c1513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.471+0000 7f58a10f1640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0b0180 0x7f589c1513d0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f588400c430 tx=0x7f588400c8f0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.471+0000 7f58a10f1640 1 -- 172.21.15.81:0/63067028 shutdown_connections 2024-09-16T01:23:48.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.471+0000 7f58a10f1640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f587c06c2b0 0x7f587c06e770 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.471+0000 7f58a10f1640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f589c0b69d0 0x7f589c141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.471+0000 7f58a10f1640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f589c0b0180 0x7f589c1513d0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.471+0000 7f58a10f1640 1 --2- 172.21.15.81:0/63067028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f589c0af280 0x7f589c0cd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.471+0000 7f58a10f1640 1 -- 172.21.15.81:0/63067028 >> 172.21.15.81:0/63067028 conn(0x7f589c06bc10 msgr2=0x7f589c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:48.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.471+0000 7f58a10f1640 1 -- 172.21.15.81:0/63067028 shutdown_connections 2024-09-16T01:23:48.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.471+0000 7f58a10f1640 1 -- 172.21.15.81:0/63067028 wait complete. 2024-09-16T01:23:48.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.579+0000 7f47319b7640 1 Processor -- start 2024-09-16T01:23:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.579+0000 7f47319b7640 1 -- start start 2024-09-16T01:23:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.580+0000 7f47319b7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f472c06c320 0x7f472c15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.580+0000 7f47319b7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472c0b3570 con 0x7f472c0ae140 2024-09-16T01:23:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.580+0000 7f47319b7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472c0b3850 con 0x7f472c145bc0 2024-09-16T01:23:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.580+0000 7f47319b7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f472c0b3b30 con 0x7f472c06c320 2024-09-16T01:23:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.580+0000 7f472b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f472c0ae140 0x7f472c0af950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46032/0 (socket says 172.21.15.81:46032) 2024-09-16T01:23:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.580+0000 7f472b7fe640 1 -- 172.21.15.81:0/2825664818 learned_addr learned my addr 172.21.15.81:0/2825664818 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f472a7fc640 1 --2- 172.21.15.81:0/2825664818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f472c06c320 0x7f472c15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3368251972 0 0) 0x7f472c0b3570 con 0x7f472c0ae140 2024-09-16T01:23:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4714003520 con 0x7f472c0ae140 2024-09-16T01:23:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 47227389 0 0) 0x7f4714003520 con 0x7f472c0ae140 2024-09-16T01:23:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f472c06c320 msgr2=0x7f472c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:48.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 --2- 172.21.15.81:0/2825664818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f472c06c320 0x7f472c15ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 >> v1:172.21.15.102:6789/0 conn(0x7f472c145bc0 legacy=0x7f472c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472c0b1610 con 0x7f472c0ae140 2024-09-16T01:23:48.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f4724001670 con 0x7f472c0ae140 2024-09-16T01:23:48.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 >> v1:172.21.15.81:6789/0 conn(0x7f472c0ae140 legacy=0x7f472c0af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 --2- 172.21.15.81:0/2825664818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47140039e0 0x7f4714003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 --2- 172.21.15.81:0/2825664818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4714004390 0x7f4714004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 --2- 172.21.15.81:0/2825664818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f472c06c320 0x7f47140050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f472c0b3b30 con 0x7f4714004390 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f471400b9f0 con 0x7f47140039e0 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f471400bbf0 con 0x7f472c06c320 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f472a7fc640 1 --2- 172.21.15.81:0/2825664818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4714004390 0x7f4714004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f472b7fe640 1 --2- 172.21.15.81:0/2825664818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f472c06c320 0x7f47140050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f472affd640 1 --2- 172.21.15.81:0/2825664818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47140039e0 0x7f4714003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f472a7fc640 1 -- 172.21.15.81:0/2825664818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f472c06c320 msgr2=0x7f47140050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f472a7fc640 1 --2- 172.21.15.81:0/2825664818 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f472c06c320 0x7f47140050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f472a7fc640 1 -- 172.21.15.81:0/2825664818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47140039e0 msgr2=0x7f4714003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f472a7fc640 1 --2- 172.21.15.81:0/2825664818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47140039e0 0x7f4714003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.581+0000 7f472a7fc640 1 -- 172.21.15.81:0/2825664818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4714003520 con 0x7f4714004390 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.582+0000 7f472a7fc640 1 --2- 172.21.15.81:0/2825664818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4714004390 0x7f4714004860 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f4720009ac0 tx=0x7f4714005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2c60af84501d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.582+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720036070 con 0x7f4714004390 2024-09-16T01:23:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.582+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4720031400 con 0x7f4714004390 2024-09-16T01:23:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.582+0000 7f4729ffb640 1 -- 172.21.15.81:0/2825664818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4720009690 con 0x7f4714004390 2024-09-16T01:23:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.583+0000 7f47319b7640 1 -- 172.21.15.81:0/2825664818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4714004390 msgr2=0x7f4714004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.583+0000 7f47319b7640 1 --2- 172.21.15.81:0/2825664818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4714004390 0x7f4714004860 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f4720009ac0 tx=0x7f4714005830 comp rx=0 tx=0).stop 2024-09-16T01:23:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.583+0000 7f472b7fe640 1 -- 172.21.15.81:0/2825664818 reap_dead start 2024-09-16T01:23:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.583+0000 7f47319b7640 1 -- 172.21.15.81:0/2825664818 shutdown_connections 2024-09-16T01:23:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.583+0000 7f47319b7640 1 -- 172.21.15.81:0/2825664818 >> 172.21.15.81:0/2825664818 conn(0x7f472c073490 msgr2=0x7f472c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.583+0000 7f47319b7640 1 -- 172.21.15.81:0/2825664818 shutdown_connections 2024-09-16T01:23:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.583+0000 7f47319b7640 1 -- 172.21.15.81:0/2825664818 wait complete. 2024-09-16T01:23:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.584+0000 7f47319b7640 1 Processor -- start 2024-09-16T01:23:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.584+0000 7f47319b7640 1 -- start start 2024-09-16T01:23:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f47319b7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4714004390 0x7f472c13cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f47319b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f472c15bef0 0x7f472c0b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f47319b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f472c0b47a0 0x7f472c0b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f47319b7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f472c145fa0 con 0x7f472c0b47a0 2024-09-16T01:23:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f47319b7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f472c09aa30 con 0x7f472c15bef0 2024-09-16T01:23:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f47319b7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f472c1401d0 con 0x7f4714004390 2024-09-16T01:23:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f472b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f472c0b47a0 0x7f472c0b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f472b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f472c0b47a0 0x7f472c0b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36622/0 (socket says 172.21.15.81:36622) 2024-09-16T01:23:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f472b7fe640 1 -- 172.21.15.81:0/1998926462 learned_addr learned my addr 172.21.15.81:0/1998926462 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f472affd640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4714004390 0x7f472c13cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f472a7fc640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f472c15bef0 0x7f472c0b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f472b7fe640 1 -- 172.21.15.81:0/1998926462 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4714004390 msgr2=0x7f472c13cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f472b7fe640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4714004390 0x7f472c13cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f472b7fe640 1 -- 172.21.15.81:0/1998926462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f472c15bef0 msgr2=0x7f472c0b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f472b7fe640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f472c15bef0 0x7f472c0b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f472b7fe640 1 -- 172.21.15.81:0/1998926462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472c13d300 con 0x7f472c0b47a0 2024-09-16T01:23:48.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.585+0000 7f472b7fe640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f472c0b47a0 0x7f472c0b4c20 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f472c071940 tx=0x7f472400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:48.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.586+0000 7f4713fff640 1 -- 172.21.15.81:0/1998926462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724019070 con 0x7f472c0b47a0 2024-09-16T01:23:48.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.586+0000 7f4713fff640 1 -- 172.21.15.81:0/1998926462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f472400c5e0 con 0x7f472c0b47a0 2024-09-16T01:23:48.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.586+0000 7f47319b7640 1 -- 172.21.15.81:0/1998926462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472c140440 con 0x7f472c0b47a0 2024-09-16T01:23:48.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.586+0000 7f4713fff640 1 -- 172.21.15.81:0/1998926462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472400c9d0 con 0x7f472c0b47a0 2024-09-16T01:23:48.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.586+0000 7f47319b7640 1 -- 172.21.15.81:0/1998926462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f472c09ce60 con 0x7f472c0b47a0 2024-09-16T01:23:48.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.587+0000 7f47319b7640 1 -- 172.21.15.81:0/1998926462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f472c15f6e0 con 0x7f472c0b47a0 2024-09-16T01:23:48.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.587+0000 7f4713fff640 1 -- 172.21.15.81:0/1998926462 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f472400cb70 con 0x7f472c0b47a0 2024-09-16T01:23:48.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.587+0000 7f4713fff640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f471806c2e0 0x7f471806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.588+0000 7f4713fff640 1 -- 172.21.15.81:0/1998926462 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f472408a930 con 0x7f472c0b47a0 2024-09-16T01:23:48.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.588+0000 7f472affd640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f471806c2e0 0x7f471806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.588+0000 7f472affd640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f471806c2e0 0x7f471806e7a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f471c000f80 tx=0x7f471c0019b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:48.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.592+0000 7f4713fff640 1 -- 172.21.15.81:0/1998926462 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f472c13d300 con 0x7f472c0b47a0 2024-09-16T01:23:48.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.789+0000 7f47319b7640 1 -- 172.21.15.81:0/1998926462 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f472c15f400 con 0x7f472c0b47a0 2024-09-16T01:23:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.789+0000 7f4713fff640 1 -- 172.21.15.81:0/1998926462 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5227 (secure 0 0 0) 0x7f472400ce60 con 0x7f472c0b47a0 2024-09-16T01:23:48.790 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:48.790 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"btime":"2024-09-16T01:23:43:950504+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/350084010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":350084010},{"type":"v1","addr":"172.21.15.81:6837","nonce":350084010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6389,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1730570681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1730570681},{"type":"v1","addr":"172.21.15.102:6834","nonce":1730570681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/755231532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":755231532},{"type":"v1","addr":"172.21.15.102:6835","nonce":755231532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:23:18.932203+0000","modified":"2024-09-16T01:23:43.627836+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"a","rank":0,"incarnation":73,"state":"up:active","state_seq":9,"addr":"172.21.15.81:6836/1395000865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1395000865},{"type":"v1","addr":"172.21.15.81:6836","nonce":1395000865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8103,"qdb_cluster":[8103]},"id":10}]} 2024-09-16T01:23:48.790 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 77 2024-09-16T01:23:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.791+0000 7f47319b7640 1 -- 172.21.15.81:0/1998926462 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f471806c2e0 msgr2=0x7f471806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.791+0000 7f47319b7640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f471806c2e0 0x7f471806e7a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f471c000f80 tx=0x7f471c0019b0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.791+0000 7f47319b7640 1 -- 172.21.15.81:0/1998926462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f472c0b47a0 msgr2=0x7f472c0b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.791+0000 7f47319b7640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f472c0b47a0 0x7f472c0b4c20 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f472c071940 tx=0x7f472400eb90 comp rx=0 tx=0).stop 2024-09-16T01:23:48.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.791+0000 7f47319b7640 1 -- 172.21.15.81:0/1998926462 shutdown_connections 2024-09-16T01:23:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.791+0000 7f47319b7640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f471806c2e0 0x7f471806e7a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.791+0000 7f47319b7640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f472c0b47a0 0x7f472c0b4c20 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.791+0000 7f47319b7640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f472c15bef0 0x7f472c0b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.791+0000 7f47319b7640 1 --2- 172.21.15.81:0/1998926462 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4714004390 0x7f472c13cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.791+0000 7f47319b7640 1 -- 172.21.15.81:0/1998926462 >> 172.21.15.81:0/1998926462 conn(0x7f472c073490 msgr2=0x7f472c15e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.791+0000 7f47319b7640 1 -- 172.21.15.81:0/1998926462 shutdown_connections 2024-09-16T01:23:48.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.791+0000 7f47319b7640 1 -- 172.21.15.81:0/1998926462 wait complete. 2024-09-16T01:23:48.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:23:48.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.900+0000 7f27e93e4640 1 Processor -- start 2024-09-16T01:23:48.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.900+0000 7f27e93e4640 1 -- start start 2024-09-16T01:23:48.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.901+0000 7f27e93e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27e415e5d0 0x7f27e40d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.901+0000 7f27e93e4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f27e406df60 0x7f27e409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.901+0000 7f27e93e4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e406cec0 con 0x7f27e40d1630 2024-09-16T01:23:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.901+0000 7f27e93e4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f27e406dad0 con 0x7f27e406df60 2024-09-16T01:23:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.901+0000 7f27e93e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f27e406d1a0 con 0x7f27e415e5d0 2024-09-16T01:23:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.901+0000 7f27e2ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27e415e5d0 0x7f27e40d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.901+0000 7f27e2ffd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27e415e5d0 0x7f27e40d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:60834/0 (socket says 172.21.15.81:60834) 2024-09-16T01:23:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.901+0000 7f27da7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f27e406df60 0x7f27e409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.901+0000 7f27e2ffd640 1 -- 172.21.15.81:0/1053425487 learned_addr learned my addr 172.21.15.81:0/1053425487 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.902+0000 7f27e2ffd640 1 -- 172.21.15.81:0/1053425487 >> v2:172.21.15.102:3300/0 conn(0x7f27e406df60 msgr2=0x7f27e409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.902+0000 7f27e2ffd640 1 --2- 172.21.15.81:0/1053425487 >> v2:172.21.15.102:3300/0 conn(0x7f27e406df60 0x7f27e409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.902+0000 7f27e2ffd640 1 -- 172.21.15.81:0/1053425487 >> v1:172.21.15.102:6789/0 conn(0x7f27e40d1630 legacy=0x7f27e4162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.902+0000 7f27e2ffd640 1 -- 172.21.15.81:0/1053425487 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e406d480 con 0x7f27e415e5d0 2024-09-16T01:23:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.902+0000 7f27e2ffd640 1 --2- 172.21.15.81:0/1053425487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27e415e5d0 0x7f27e40d10f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009870 tx=0x7f27d402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f0b42f17cb9093 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.903+0000 7f27e27fc640 1 -- 172.21.15.81:0/1053425487 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4037070 con 0x7f27e415e5d0 2024-09-16T01:23:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.903+0000 7f27e27fc640 1 -- 172.21.15.81:0/1053425487 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d402ae50 con 0x7f27e415e5d0 2024-09-16T01:23:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.903+0000 7f27e27fc640 1 -- 172.21.15.81:0/1053425487 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4032860 con 0x7f27e415e5d0 2024-09-16T01:23:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.903+0000 7f27e93e4640 1 -- 172.21.15.81:0/1053425487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27e415e5d0 msgr2=0x7f27e40d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.903+0000 7f27e93e4640 1 --2- 172.21.15.81:0/1053425487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27e415e5d0 0x7f27e40d10f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009870 tx=0x7f27d402a300 comp rx=0 tx=0).stop 2024-09-16T01:23:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.903+0000 7f27e93e4640 1 -- 172.21.15.81:0/1053425487 shutdown_connections 2024-09-16T01:23:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.903+0000 7f27e93e4640 1 --2- 172.21.15.81:0/1053425487 >> v2:172.21.15.102:3300/0 conn(0x7f27e406df60 0x7f27e409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.903+0000 7f27e93e4640 1 --2- 172.21.15.81:0/1053425487 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27e415e5d0 0x7f27e40d10f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.903+0000 7f27e93e4640 1 -- 172.21.15.81:0/1053425487 >> 172.21.15.81:0/1053425487 conn(0x7f27e40d23a0 msgr2=0x7f27e40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.903+0000 7f27e93e4640 1 -- 172.21.15.81:0/1053425487 shutdown_connections 2024-09-16T01:23:48.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.903+0000 7f27e93e4640 1 -- 172.21.15.81:0/1053425487 wait complete. 2024-09-16T01:23:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.904+0000 7f27e93e4640 1 Processor -- start 2024-09-16T01:23:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.905+0000 7f27e93e4640 1 -- start start 2024-09-16T01:23:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.905+0000 7f27e93e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406df60 0x7f27e4155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.905+0000 7f27e93e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27e40d1630 0x7f27e4155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.905+0000 7f27e93e4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27e415e5d0 0x7f27e4156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.905+0000 7f27e93e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27e415eb30 con 0x7f27e406df60 2024-09-16T01:23:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.905+0000 7f27e93e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f27e415e9b0 con 0x7f27e40d1630 2024-09-16T01:23:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.905+0000 7f27e93e4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f27e409af70 con 0x7f27e415e5d0 2024-09-16T01:23:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.905+0000 7f27e2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406df60 0x7f27e4155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.905+0000 7f27e2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406df60 0x7f27e4155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36628/0 (socket says 172.21.15.81:36628) 2024-09-16T01:23:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.905+0000 7f27e2ffd640 1 -- 172.21.15.81:0/2151529821 learned_addr learned my addr 172.21.15.81:0/2151529821 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.905+0000 7f27da7fc640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27e40d1630 0x7f27e4155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.905+0000 7f27e37fe640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27e415e5d0 0x7f27e4156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.906+0000 7f27e2ffd640 1 -- 172.21.15.81:0/2151529821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27e415e5d0 msgr2=0x7f27e4156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.906+0000 7f27e2ffd640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27e415e5d0 0x7f27e4156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.906+0000 7f27e2ffd640 1 -- 172.21.15.81:0/2151529821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27e40d1630 msgr2=0x7f27e4155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.906+0000 7f27e2ffd640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27e40d1630 0x7f27e4155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.906+0000 7f27e2ffd640 1 -- 172.21.15.81:0/2151529821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e40c87a0 con 0x7f27e406df60 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.906+0000 7f27e2ffd640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406df60 0x7f27e4155690 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f27d402a340 tx=0x7f27d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.906+0000 7f27dbfff640 1 -- 172.21.15.81:0/2151529821 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4041070 con 0x7f27e406df60 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.906+0000 7f27dbfff640 1 -- 172.21.15.81:0/2151529821 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27d403c660 con 0x7f27e406df60 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.906+0000 7f27dbfff640 1 -- 172.21.15.81:0/2151529821 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4037040 con 0x7f27e406df60 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.906+0000 7f27e93e4640 1 -- 172.21.15.81:0/2151529821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e40c8a80 con 0x7f27e406df60 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.906+0000 7f27e93e4640 1 -- 172.21.15.81:0/2151529821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e4153dc0 con 0x7f27e406df60 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.907+0000 7f27e93e4640 1 -- 172.21.15.81:0/2151529821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e409aa30 con 0x7f27e406df60 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.908+0000 7f27dbfff640 1 -- 172.21.15.81:0/2151529821 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f27d4044070 con 0x7f27e406df60 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.908+0000 7f27dbfff640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f27c406c2b0 0x7f27c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.908+0000 7f27dbfff640 1 -- 172.21.15.81:0/2151529821 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f27d40abf70 con 0x7f27e406df60 2024-09-16T01:23:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.908+0000 7f27da7fc640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f27c406c2b0 0x7f27c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:48.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.908+0000 7f27da7fc640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f27c406c2b0 0x7f27c406e770 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f27e4163240 tx=0x7f27cc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:48.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:48.912+0000 7f27dbfff640 1 -- 172.21.15.81:0/2151529821 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27d407a030 con 0x7f27e406df60 2024-09-16T01:23:49.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.082+0000 7f27e93e4640 1 -- 172.21.15.81:0/2151529821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27e4153f90 con 0x7f27e406df60 2024-09-16T01:23:49.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.084+0000 7f27dbfff640 1 -- 172.21.15.81:0/2151529821 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16952 (secure 0 0 0) 0x7f27d407e330 con 0x7f27e406df60 2024-09-16T01:23:49.085 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:49.085 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":137,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:23:20.600617+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:23:17.268973+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2024-09-16T01:23:17.902232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:23:49.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.085+0000 7f27e93e4640 1 -- 172.21.15.81:0/2151529821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f27c406c2b0 msgr2=0x7f27c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.085+0000 7f27e93e4640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f27c406c2b0 0x7f27c406e770 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f27e4163240 tx=0x7f27cc009190 comp rx=0 tx=0).stop 2024-09-16T01:23:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.085+0000 7f27e93e4640 1 -- 172.21.15.81:0/2151529821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406df60 msgr2=0x7f27e4155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.086+0000 7f27e93e4640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406df60 0x7f27e4155690 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f27d402a340 tx=0x7f27d40046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.086+0000 7f27e93e4640 1 -- 172.21.15.81:0/2151529821 shutdown_connections 2024-09-16T01:23:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.086+0000 7f27e93e4640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f27c406c2b0 0x7f27c406e770 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.086+0000 7f27e93e4640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27e415e5d0 0x7f27e4156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.086+0000 7f27e93e4640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27e40d1630 0x7f27e4155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.086+0000 7f27e93e4640 1 --2- 172.21.15.81:0/2151529821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e406df60 0x7f27e4155690 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.086+0000 7f27e93e4640 1 -- 172.21.15.81:0/2151529821 >> 172.21.15.81:0/2151529821 conn(0x7f27e40d23a0 msgr2=0x7f27e40b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.086+0000 7f27e93e4640 1 -- 172.21.15.81:0/2151529821 shutdown_connections 2024-09-16T01:23:49.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.086+0000 7f27e93e4640 1 -- 172.21.15.81:0/2151529821 wait complete. 2024-09-16T01:23:49.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:23:49.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.197+0000 7f7e6a16d640 1 Processor -- start 2024-09-16T01:23:49.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.197+0000 7f7e6a16d640 1 -- start start 2024-09-16T01:23:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.197+0000 7f7e6a16d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e6415fc30 0x7f7e64071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.197+0000 7f7e6a16d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7e640b17d0 0x7f7e6409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.197+0000 7f7e6a16d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e6409ba30 con 0x7f7e6409af70 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.197+0000 7f7e6a16d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7e640b1590 con 0x7f7e6415fc30 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.197+0000 7f7e6a16d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7e6409b3c0 con 0x7f7e640b17d0 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.198+0000 7f7e637fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e6415fc30 0x7f7e64071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.198+0000 7f7e637fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e6415fc30 0x7f7e64071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36642/0 (socket says 172.21.15.81:36642) 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.198+0000 7f7e637fe640 1 -- 172.21.15.81:0/867354802 learned_addr learned my addr 172.21.15.81:0/867354802 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.198+0000 7f7e5bfff640 1 --2- 172.21.15.81:0/867354802 >> v2:172.21.15.102:3300/0 conn(0x7f7e640b17d0 0x7f7e6409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.198+0000 7f7e637fe640 1 -- 172.21.15.81:0/867354802 >> v2:172.21.15.102:3300/0 conn(0x7f7e640b17d0 msgr2=0x7f7e6409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.198+0000 7f7e637fe640 1 --2- 172.21.15.81:0/867354802 >> v2:172.21.15.102:3300/0 conn(0x7f7e640b17d0 0x7f7e6409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.198+0000 7f7e637fe640 1 -- 172.21.15.81:0/867354802 >> v1:172.21.15.102:6789/0 conn(0x7f7e6409af70 legacy=0x7f7e640d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.198+0000 7f7e637fe640 1 -- 172.21.15.81:0/867354802 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e6409bcf0 con 0x7f7e6415fc30 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.198+0000 7f7e5bfff640 1 --2- 172.21.15.81:0/867354802 >> v2:172.21.15.102:3300/0 conn(0x7f7e640b17d0 0x7f7e6409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:49.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.199+0000 7f7e637fe640 1 --2- 172.21.15.81:0/867354802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6415fc30 0x7f7e64071e40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f7e6406cbf0 tx=0x7f7e5402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5815ac2a8d88b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:49.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.199+0000 7f7e62ffd640 1 -- 172.21.15.81:0/867354802 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54037070 con 0x7f7e6415fc30 2024-09-16T01:23:49.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.199+0000 7f7e62ffd640 1 -- 172.21.15.81:0/867354802 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e54032440 con 0x7f7e6415fc30 2024-09-16T01:23:49.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.199+0000 7f7e62ffd640 1 -- 172.21.15.81:0/867354802 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54032810 con 0x7f7e6415fc30 2024-09-16T01:23:49.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.199+0000 7f7e6a16d640 1 -- 172.21.15.81:0/867354802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6415fc30 msgr2=0x7f7e64071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.199+0000 7f7e6a16d640 1 --2- 172.21.15.81:0/867354802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6415fc30 0x7f7e64071e40 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f7e6406cbf0 tx=0x7f7e5402a1a0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.199+0000 7f7e6a16d640 1 -- 172.21.15.81:0/867354802 shutdown_connections 2024-09-16T01:23:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.199+0000 7f7e6a16d640 1 --2- 172.21.15.81:0/867354802 >> v2:172.21.15.102:3300/0 conn(0x7f7e640b17d0 0x7f7e6409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.199+0000 7f7e6a16d640 1 --2- 172.21.15.81:0/867354802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6415fc30 0x7f7e64071e40 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.199+0000 7f7e6a16d640 1 -- 172.21.15.81:0/867354802 >> 172.21.15.81:0/867354802 conn(0x7f7e640d23a0 msgr2=0x7f7e640d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.199+0000 7f7e6a16d640 1 -- 172.21.15.81:0/867354802 shutdown_connections 2024-09-16T01:23:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.199+0000 7f7e6a16d640 1 -- 172.21.15.81:0/867354802 wait complete. 2024-09-16T01:23:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.200+0000 7f7e6a16d640 1 Processor -- start 2024-09-16T01:23:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.201+0000 7f7e6a16d640 1 -- start start 2024-09-16T01:23:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.201+0000 7f7e6a16d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e6409af70 0x7f7e640c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.201+0000 7f7e6a16d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e640b17d0 0x7f7e640d0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.201+0000 7f7e6a16d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6415fc30 0x7f7e640d0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.201+0000 7f7e6a16d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e64160fe0 con 0x7f7e6415fc30 2024-09-16T01:23:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.201+0000 7f7e6a16d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7e64160ab0 con 0x7f7e640b17d0 2024-09-16T01:23:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.201+0000 7f7e6a16d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7e640b1bd0 con 0x7f7e6409af70 2024-09-16T01:23:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.201+0000 7f7e63fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6415fc30 0x7f7e640d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.201+0000 7f7e63fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6415fc30 0x7f7e640d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36658/0 (socket says 172.21.15.81:36658) 2024-09-16T01:23:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.201+0000 7f7e63fff640 1 -- 172.21.15.81:0/2338582458 learned_addr learned my addr 172.21.15.81:0/2338582458 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.201+0000 7f7e637fe640 1 --2- 172.21.15.81:0/2338582458 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e6409af70 0x7f7e640c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e5bfff640 1 --2- 172.21.15.81:0/2338582458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e640b17d0 0x7f7e640d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e63fff640 1 -- 172.21.15.81:0/2338582458 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e6409af70 msgr2=0x7f7e640c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e63fff640 1 --2- 172.21.15.81:0/2338582458 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e6409af70 0x7f7e640c53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e63fff640 1 -- 172.21.15.81:0/2338582458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e640b17d0 msgr2=0x7f7e640d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e63fff640 1 --2- 172.21.15.81:0/2338582458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e640b17d0 0x7f7e640d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e63fff640 1 -- 172.21.15.81:0/2338582458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e640b5370 con 0x7f7e6415fc30 2024-09-16T01:23:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e637fe640 1 --2- 172.21.15.81:0/2338582458 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e6409af70 0x7f7e640c53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e63fff640 1 --2- 172.21.15.81:0/2338582458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6415fc30 0x7f7e640d0780 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00c780 tx=0x7f7e5c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e60ff9640 1 -- 172.21.15.81:0/2338582458 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c004b60 con 0x7f7e6415fc30 2024-09-16T01:23:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e60ff9640 1 -- 172.21.15.81:0/2338582458 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5c004d00 con 0x7f7e6415fc30 2024-09-16T01:23:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e6a16d640 1 -- 172.21.15.81:0/2338582458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e640b5650 con 0x7f7e6415fc30 2024-09-16T01:23:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e60ff9640 1 -- 172.21.15.81:0/2338582458 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00aa90 con 0x7f7e6415fc30 2024-09-16T01:23:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.202+0000 7f7e6a16d640 1 -- 172.21.15.81:0/2338582458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e640b5c10 con 0x7f7e6415fc30 2024-09-16T01:23:49.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.203+0000 7f7e6a16d640 1 -- 172.21.15.81:0/2338582458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e6409aa30 con 0x7f7e6415fc30 2024-09-16T01:23:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.203+0000 7f7e60ff9640 1 -- 172.21.15.81:0/2338582458 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7e5c00ac30 con 0x7f7e6415fc30 2024-09-16T01:23:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.204+0000 7f7e60ff9640 1 --2- 172.21.15.81:0/2338582458 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e4406c2b0 0x7f7e4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.204+0000 7f7e637fe640 1 --2- 172.21.15.81:0/2338582458 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e4406c2b0 0x7f7e4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.204+0000 7f7e60ff9640 1 -- 172.21.15.81:0/2338582458 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f7e5c08b8a0 con 0x7f7e6415fc30 2024-09-16T01:23:49.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.205+0000 7f7e637fe640 1 --2- 172.21.15.81:0/2338582458 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e4406c2b0 0x7f7e4406e770 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7e54034000 tx=0x7f7e5402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:49.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.208+0000 7f7e60ff9640 1 -- 172.21.15.81:0/2338582458 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e5c020070 con 0x7f7e6415fc30 2024-09-16T01:23:49.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.410+0000 7f7e6a16d640 1 -- 172.21.15.81:0/2338582458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7e640af670 con 0x7f7e6415fc30 2024-09-16T01:23:49.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.410+0000 7f7e60ff9640 1 -- 172.21.15.81:0/2338582458 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=-1 MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it v77) ==== 316+0+0 (secure 0 0 0) 0x7f7e5c059e80 con 0x7f7e6415fc30 2024-09-16T01:23:49.411 INFO:teuthology.orchestra.run.smithi081.stderr:Error EPERM: MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it 2024-09-16T01:23:49.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:23:49.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs --yes-i-really-mean-it 2024-09-16T01:23:49.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.515+0000 7f67ec3a6640 1 Processor -- start 2024-09-16T01:23:49.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.515+0000 7f67ec3a6640 1 -- start start 2024-09-16T01:23:49.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67ec3a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f67e415e760 0x7f67e40b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67ec3a6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f67e4070110 0x7f67e406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67ec3a6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e40b4a50 con 0x7f67e40705c0 2024-09-16T01:23:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67ec3a6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f67e40b5ea0 con 0x7f67e4070110 2024-09-16T01:23:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67ec3a6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f67e40710d0 con 0x7f67e415e760 2024-09-16T01:23:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67ea943640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f67e4070110 0x7f67e406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67e9941640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f67e40705c0 0x7f67e406fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46036/0 (socket says 172.21.15.81:46036) 2024-09-16T01:23:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67ea943640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f67e4070110 0x7f67e406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36660/0 (socket says 172.21.15.81:36660) 2024-09-16T01:23:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67e9941640 1 -- 172.21.15.81:0/3480662652 learned_addr learned my addr 172.21.15.81:0/3480662652 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67ea142640 1 --2- 172.21.15.81:0/3480662652 >> v2:172.21.15.102:3300/0 conn(0x7f67e415e760 0x7f67e40b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67ea943640 1 -- 172.21.15.81:0/3480662652 >> v2:172.21.15.102:3300/0 conn(0x7f67e415e760 msgr2=0x7f67e40b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67ea943640 1 --2- 172.21.15.81:0/3480662652 >> v2:172.21.15.102:3300/0 conn(0x7f67e415e760 0x7f67e40b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67ea943640 1 -- 172.21.15.81:0/3480662652 >> v1:172.21.15.81:6789/0 conn(0x7f67e40705c0 legacy=0x7f67e406fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67e9140640 1 -- 172.21.15.81:0/3480662652 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2563233464 0 0) 0x7f67e40b4a50 con 0x7f67e40705c0 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.516+0000 7f67ea943640 1 -- 172.21.15.81:0/3480662652 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e4070b10 con 0x7f67e4070110 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.517+0000 7f67ea943640 1 --2- 172.21.15.81:0/3480662652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e4070110 0x7f67e406bc10 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f67e4072c20 tx=0x7f67dc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a997a2331dd7b6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.517+0000 7f67e9140640 1 -- 172.21.15.81:0/3480662652 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc007740 con 0x7f67e4070110 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.517+0000 7f67e9140640 1 -- 172.21.15.81:0/3480662652 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67dc0078e0 con 0x7f67e4070110 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.517+0000 7f67e9140640 1 -- 172.21.15.81:0/3480662652 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc007cb0 con 0x7f67e4070110 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.518+0000 7f67ec3a6640 1 -- 172.21.15.81:0/3480662652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e4070110 msgr2=0x7f67e406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.518+0000 7f67ec3a6640 1 --2- 172.21.15.81:0/3480662652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e4070110 0x7f67e406bc10 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f67e4072c20 tx=0x7f67dc02a6a0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.518+0000 7f67ec3a6640 1 -- 172.21.15.81:0/3480662652 shutdown_connections 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.518+0000 7f67ec3a6640 1 --2- 172.21.15.81:0/3480662652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e4070110 0x7f67e406bc10 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.518+0000 7f67ec3a6640 1 --2- 172.21.15.81:0/3480662652 >> v2:172.21.15.102:3300/0 conn(0x7f67e415e760 0x7f67e40b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.518+0000 7f67ec3a6640 1 -- 172.21.15.81:0/3480662652 >> 172.21.15.81:0/3480662652 conn(0x7f67e4073490 msgr2=0x7f67e40b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.518+0000 7f67ec3a6640 1 -- 172.21.15.81:0/3480662652 shutdown_connections 2024-09-16T01:23:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.518+0000 7f67ec3a6640 1 -- 172.21.15.81:0/3480662652 wait complete. 2024-09-16T01:23:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.519+0000 7f67ec3a6640 1 Processor -- start 2024-09-16T01:23:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.519+0000 7f67ec3a6640 1 -- start start 2024-09-16T01:23:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67ec3a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67e4070110 0x7f67e414ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67ec3a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e40705c0 0x7f67e409c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67ec3a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67e415e760 0x7f67e409c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67ec3a6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67e40b46e0 con 0x7f67e40705c0 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67ec3a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f67e40b4400 con 0x7f67e4070110 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67ec3a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f67e40ae240 con 0x7f67e415e760 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67e9941640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e40705c0 0x7f67e409c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67e9941640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e40705c0 0x7f67e409c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36672/0 (socket says 172.21.15.81:36672) 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67e9941640 1 -- 172.21.15.81:0/1131710269 learned_addr learned my addr 172.21.15.81:0/1131710269 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67ea142640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67e4070110 0x7f67e414ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67ea943640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67e415e760 0x7f67e409c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67e9941640 1 -- 172.21.15.81:0/1131710269 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67e415e760 msgr2=0x7f67e409c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67e9941640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67e415e760 0x7f67e409c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67e9941640 1 -- 172.21.15.81:0/1131710269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67e4070110 msgr2=0x7f67e414ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67e9941640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67e4070110 0x7f67e414ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67e9941640 1 -- 172.21.15.81:0/1131710269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e414e3e0 con 0x7f67e40705c0 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67ea142640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67e4070110 0x7f67e414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67e9941640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e40705c0 0x7f67e409c0a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c3f0 tx=0x7f67d400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67daffd640 1 -- 172.21.15.81:0/1131710269 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d40074e0 con 0x7f67e40705c0 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67daffd640 1 -- 172.21.15.81:0/1131710269 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67d40047e0 con 0x7f67e40705c0 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67ec3a6640 1 -- 172.21.15.81:0/1131710269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e41f7680 con 0x7f67e40705c0 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67daffd640 1 -- 172.21.15.81:0/1131710269 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d4004bd0 con 0x7f67e40705c0 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.520+0000 7f67ec3a6640 1 -- 172.21.15.81:0/1131710269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e41f7c40 con 0x7f67e40705c0 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.521+0000 7f67ec3a6640 1 -- 172.21.15.81:0/1131710269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e40b6310 con 0x7f67e40705c0 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.522+0000 7f67daffd640 1 -- 172.21.15.81:0/1131710269 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f67d4011070 con 0x7f67e40705c0 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.522+0000 7f67daffd640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f67c806c2b0 0x7f67c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.522+0000 7f67daffd640 1 -- 172.21.15.81:0/1131710269 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 6101+0+0 (secure 0 0 0) 0x7f67d408b1f0 con 0x7f67e40705c0 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.522+0000 7f67ea142640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f67c806c2b0 0x7f67c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.523+0000 7f67ea142640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f67c806c2b0 0x7f67c806e770 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009b90 tx=0x7f67e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:49.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.526+0000 7f67daffd640 1 -- 172.21.15.81:0/1131710269 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67d40597d0 con 0x7f67e40705c0 2024-09-16T01:23:49.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.724+0000 7f67ec3a6640 1 -- 172.21.15.81:0/1131710269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f67e41f80d0 con 0x7f67e40705c0 2024-09-16T01:23:49.726 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-16T01:23:49.725+0000 7f4e951a0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:23:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.726+0000 7f67daffd640 1 -- 172.21.15.81:0/1131710269 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) ==== 191+0+0 (secure 0 0 0) 0x7f67d40590d0 con 0x7f67e40705c0 2024-09-16T01:23:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:23:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.729+0000 7f67ec3a6640 1 -- 172.21.15.81:0/1131710269 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f67c806c2b0 msgr2=0x7f67c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.729+0000 7f67ec3a6640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f67c806c2b0 0x7f67c806e770 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009b90 tx=0x7f67e0008040 comp rx=0 tx=0).stop 2024-09-16T01:23:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.729+0000 7f67ec3a6640 1 -- 172.21.15.81:0/1131710269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e40705c0 msgr2=0x7f67e409c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.729+0000 7f67ec3a6640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e40705c0 0x7f67e409c0a0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f67d400c3f0 tx=0x7f67d400c8b0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.730+0000 7f67ec3a6640 1 -- 172.21.15.81:0/1131710269 shutdown_connections 2024-09-16T01:23:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.730+0000 7f67ec3a6640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f67c806c2b0 0x7f67c806e770 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.730+0000 7f67ec3a6640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67e415e760 0x7f67e409c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.730+0000 7f67ec3a6640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e40705c0 0x7f67e409c0a0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.730+0000 7f67ec3a6640 1 --2- 172.21.15.81:0/1131710269 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f67e4070110 0x7f67e414ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.730+0000 7f67ec3a6640 1 -- 172.21.15.81:0/1131710269 >> 172.21.15.81:0/1131710269 conn(0x7f67e4073490 msgr2=0x7f67e415d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.730+0000 7f67ec3a6640 1 -- 172.21.15.81:0/1131710269 shutdown_connections 2024-09-16T01:23:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.730+0000 7f67ec3a6640 1 -- 172.21.15.81:0/1131710269 wait complete. 2024-09-16T01:23:49.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:23:49.767 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:23:49.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.842+0000 7f61f7094640 1 Processor -- start 2024-09-16T01:23:49.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.842+0000 7f61f7094640 1 -- start start 2024-09-16T01:23:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.843+0000 7f61f7094640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f61f009b140 0x7f61f0169380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.843+0000 7f61f7094640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61f00b6820 con 0x7f61f015f950 2024-09-16T01:23:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.843+0000 7f61f7094640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61f00b6b00 con 0x7f61f0158b50 2024-09-16T01:23:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.843+0000 7f61f7094640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f61f00b6de0 con 0x7f61f009b140 2024-09-16T01:23:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.843+0000 7f61effff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f61f015f950 0x7f61f009aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46052/0 (socket says 172.21.15.81:46052) 2024-09-16T01:23:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.843+0000 7f61effff640 1 -- 172.21.15.81:0/3568211033 learned_addr learned my addr 172.21.15.81:0/3568211033 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61f5631640 1 --2- 172.21.15.81:0/3568211033 >> v2:172.21.15.102:3300/0 conn(0x7f61f009b140 0x7f61f0169380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3241244060 0 0) 0x7f61f00b6820 con 0x7f61f015f950 2024-09-16T01:23:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61d8003520 con 0x7f61f015f950 2024-09-16T01:23:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2277602048 0 0) 0x7f61d8003520 con 0x7f61f015f950 2024-09-16T01:23:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 >> v2:172.21.15.102:3300/0 conn(0x7f61f009b140 msgr2=0x7f61f0169380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 --2- 172.21.15.81:0/3568211033 >> v2:172.21.15.102:3300/0 conn(0x7f61f009b140 0x7f61f0169380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 >> v1:172.21.15.102:6789/0 conn(0x7f61f0158b50 legacy=0x7f61f00b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f00b70c0 con 0x7f61f015f950 2024-09-16T01:23:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f61e4001670 con 0x7f61f015f950 2024-09-16T01:23:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 >> v1:172.21.15.81:6789/0 conn(0x7f61f015f950 legacy=0x7f61f009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 --2- 172.21.15.81:0/3568211033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d80039b0 0x7f61d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 --2- 172.21.15.81:0/3568211033 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61d8004800 0x7f61d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 --2- 172.21.15.81:0/3568211033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80051c0 0x7f61d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61f00b6de0 con 0x7f61d80051c0 2024-09-16T01:23:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f61d800c060 con 0x7f61d80039b0 2024-09-16T01:23:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f61d800c260 con 0x7f61d8004800 2024-09-16T01:23:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61f5631640 1 --2- 172.21.15.81:0/3568211033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80051c0 0x7f61d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61f4e30640 1 --2- 172.21.15.81:0/3568211033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d80039b0 0x7f61d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61effff640 1 --2- 172.21.15.81:0/3568211033 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61d8004800 0x7f61d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61f5631640 1 -- 172.21.15.81:0/3568211033 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61d8004800 msgr2=0x7f61d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61f5631640 1 --2- 172.21.15.81:0/3568211033 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61d8004800 0x7f61d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61f5631640 1 -- 172.21.15.81:0/3568211033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d80039b0 msgr2=0x7f61d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61f5631640 1 --2- 172.21.15.81:0/3568211033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d80039b0 0x7f61d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.844+0000 7f61f5631640 1 -- 172.21.15.81:0/3568211033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d8003520 con 0x7f61d80051c0 2024-09-16T01:23:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.845+0000 7f61f5631640 1 -- 172.21.15.81:0/3568211033 reap_dead start 2024-09-16T01:23:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.845+0000 7f61f5631640 1 --2- 172.21.15.81:0/3568211033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80051c0 0x7f61d800b9c0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009fc0 tx=0x7f61d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a2c57080190149 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.845+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e8035020 con 0x7f61d80051c0 2024-09-16T01:23:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.845+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61e8003bd0 con 0x7f61d80051c0 2024-09-16T01:23:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.845+0000 7f61ef7fe640 1 -- 172.21.15.81:0/3568211033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e8009c10 con 0x7f61d80051c0 2024-09-16T01:23:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.846+0000 7f61f7094640 1 -- 172.21.15.81:0/3568211033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80051c0 msgr2=0x7f61d800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.846+0000 7f61f7094640 1 --2- 172.21.15.81:0/3568211033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80051c0 0x7f61d800b9c0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009fc0 tx=0x7f61d8005830 comp rx=0 tx=0).stop 2024-09-16T01:23:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.846+0000 7f61f7094640 1 -- 172.21.15.81:0/3568211033 shutdown_connections 2024-09-16T01:23:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.846+0000 7f61f7094640 1 --2- 172.21.15.81:0/3568211033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80051c0 0x7f61d800b9c0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.846+0000 7f61f7094640 1 -- 172.21.15.81:0/3568211033 >> 172.21.15.81:0/3568211033 conn(0x7f61f00b79e0 msgr2=0x7f61f00b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.846+0000 7f61f7094640 1 -- 172.21.15.81:0/3568211033 shutdown_connections 2024-09-16T01:23:49.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.846+0000 7f61f7094640 1 -- 172.21.15.81:0/3568211033 wait complete. 2024-09-16T01:23:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.847+0000 7f61f7094640 1 Processor -- start 2024-09-16T01:23:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.847+0000 7f61f7094640 1 -- start start 2024-09-16T01:23:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f7094640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d80051c0 0x7f61f0151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f7094640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61f0151990 0x7f61f0151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f7094640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f01529f0 0x7f61f0152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f7094640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61f01590b0 con 0x7f61f01529f0 2024-09-16T01:23:49.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f7094640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f61f0158f30 con 0x7f61d80051c0 2024-09-16T01:23:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f7094640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f61f009aa30 con 0x7f61f0151990 2024-09-16T01:23:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f5631640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f01529f0 0x7f61f0152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f5631640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f01529f0 0x7f61f0152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36706/0 (socket says 172.21.15.81:36706) 2024-09-16T01:23:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f5631640 1 -- 172.21.15.81:0/1966574280 learned_addr learned my addr 172.21.15.81:0/1966574280 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61effff640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61f0151990 0x7f61f0151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f4e30640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d80051c0 0x7f61f0151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f5631640 1 -- 172.21.15.81:0/1966574280 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61f0151990 msgr2=0x7f61f0151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f5631640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61f0151990 0x7f61f0151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f5631640 1 -- 172.21.15.81:0/1966574280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d80051c0 msgr2=0x7f61f0151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f5631640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d80051c0 0x7f61f0151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f5631640 1 -- 172.21.15.81:0/1966574280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f00b0600 con 0x7f61f01529f0 2024-09-16T01:23:49.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61f5631640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f01529f0 0x7f61f0152e70 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f61e800e200 tx=0x7f61e8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.848+0000 7f61ed7fa640 1 -- 172.21.15.81:0/1966574280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e8035030 con 0x7f61f01529f0 2024-09-16T01:23:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.849+0000 7f61ed7fa640 1 -- 172.21.15.81:0/1966574280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61e8043070 con 0x7f61f01529f0 2024-09-16T01:23:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.849+0000 7f61f7094640 1 -- 172.21.15.81:0/1966574280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f01535d0 con 0x7f61f01529f0 2024-09-16T01:23:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.849+0000 7f61ed7fa640 1 -- 172.21.15.81:0/1966574280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e802d070 con 0x7f61f01529f0 2024-09-16T01:23:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.849+0000 7f61f7094640 1 -- 172.21.15.81:0/1966574280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f0153b90 con 0x7f61f01529f0 2024-09-16T01:23:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.850+0000 7f61f7094640 1 -- 172.21.15.81:0/1966574280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f0050050 con 0x7f61f01529f0 2024-09-16T01:23:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.850+0000 7f61ed7fa640 1 -- 172.21.15.81:0/1966574280 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f61e8005d10 con 0x7f61f01529f0 2024-09-16T01:23:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.850+0000 7f61ed7fa640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61dc06c2e0 0x7f61dc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.851+0000 7f61ed7fa640 1 -- 172.21.15.81:0/1966574280 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 6187+0+0 (secure 0 0 0) 0x7f61e80ac3b0 con 0x7f61f01529f0 2024-09-16T01:23:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.851+0000 7f61f4e30640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61dc06c2e0 0x7f61dc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.851+0000 7f61f4e30640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61dc06c2e0 0x7f61dc06e7a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f61e0000c00 tx=0x7f61e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:49.855+0000 7f61ed7fa640 1 -- 172.21.15.81:0/1966574280 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61f0050050 con 0x7f61f01529f0 2024-09-16T01:23:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.056+0000 7f61f7094640 1 -- 172.21.15.81:0/1966574280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f61f009adc0 con 0x7f61f01529f0 2024-09-16T01:23:50.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.727+0000 7f61ed7fa640 1 -- 172.21.15.81:0/1966574280 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) ==== 104+0+0 (secure 0 0 0) 0x7f61f00b0600 con 0x7f61f01529f0 2024-09-16T01:23:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.729+0000 7f61f7094640 1 -- 172.21.15.81:0/1966574280 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61dc06c2e0 msgr2=0x7f61dc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.729+0000 7f61f7094640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61dc06c2e0 0x7f61dc06e7a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f61e0000c00 tx=0x7f61e0009040 comp rx=0 tx=0).stop 2024-09-16T01:23:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.729+0000 7f61f7094640 1 -- 172.21.15.81:0/1966574280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f01529f0 msgr2=0x7f61f0152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.729+0000 7f61f7094640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f01529f0 0x7f61f0152e70 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f61e800e200 tx=0x7f61e8009750 comp rx=0 tx=0).stop 2024-09-16T01:23:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.730+0000 7f61f7094640 1 -- 172.21.15.81:0/1966574280 shutdown_connections 2024-09-16T01:23:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.730+0000 7f61f7094640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f61dc06c2e0 0x7f61dc06e7a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.730+0000 7f61f7094640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f01529f0 0x7f61f0152e70 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.730+0000 7f61f7094640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f61f0151990 0x7f61f0151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.730+0000 7f61f7094640 1 --2- 172.21.15.81:0/1966574280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61d80051c0 0x7f61f0151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.730+0000 7f61f7094640 1 -- 172.21.15.81:0/1966574280 >> 172.21.15.81:0/1966574280 conn(0x7f61f00b79e0 msgr2=0x7f61f006fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.730+0000 7f61f7094640 1 -- 172.21.15.81:0/1966574280 shutdown_connections 2024-09-16T01:23:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.730+0000 7f61f7094640 1 -- 172.21.15.81:0/1966574280 wait complete. 2024-09-16T01:23:50.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:23:50.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.887+0000 7ff3c8aaf640 1 Processor -- start 2024-09-16T01:23:50.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.887+0000 7ff3c8aaf640 1 -- start start 2024-09-16T01:23:50.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.888+0000 7ff3c8aaf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3c409b140 0x7ff3c40b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:50.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.888+0000 7ff3c8aaf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c406cec0 con 0x7ff3c40af240 2024-09-16T01:23:50.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.888+0000 7ff3c8aaf640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c406d160 con 0x7ff3c415e660 2024-09-16T01:23:50.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.888+0000 7ff3c8aaf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c415ea40 con 0x7ff3c409b140 2024-09-16T01:23:50.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.888+0000 7ff3c1d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3c409b140 0x7ff3c40b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:50.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.888+0000 7ff3c2d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff3c40af240 0x7ff3c406df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46064/0 (socket says 172.21.15.81:46064) 2024-09-16T01:23:50.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.888+0000 7ff3c2d9d640 1 -- 172.21.15.81:0/658734943 learned_addr learned my addr 172.21.15.81:0/658734943 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:50.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.889+0000 7ff3c1d9b640 1 -- 172.21.15.81:0/658734943 >> v1:172.21.15.102:6789/0 conn(0x7ff3c415e660 legacy=0x7ff3c409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:50.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.889+0000 7ff3c1d9b640 1 -- 172.21.15.81:0/658734943 >> v1:172.21.15.81:6789/0 conn(0x7ff3c40af240 legacy=0x7ff3c406df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:50.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.889+0000 7ff3c1d9b640 1 -- 172.21.15.81:0/658734943 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c406d440 con 0x7ff3c409b140 2024-09-16T01:23:50.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.889+0000 7ff3c159a640 1 -- 172.21.15.81:0/658734943 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253743343 0 0) 0x7ff3c406cec0 con 0x7ff3c40af240 2024-09-16T01:23:50.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.889+0000 7ff3c1d9b640 1 --2- 172.21.15.81:0/658734943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c409b140 0x7ff3c40b6be0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80097a0 tx=0x7ff3b802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf866252a12bb6a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:50.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.889+0000 7ff3c159a640 1 -- 172.21.15.81:0/658734943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8037070 con 0x7ff3c409b140 2024-09-16T01:23:50.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.889+0000 7ff3c159a640 1 -- 172.21.15.81:0/658734943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b8032440 con 0x7ff3c409b140 2024-09-16T01:23:50.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.889+0000 7ff3c159a640 1 -- 172.21.15.81:0/658734943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8032810 con 0x7ff3c409b140 2024-09-16T01:23:50.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.890+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/658734943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c409b140 msgr2=0x7ff3c40b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:50.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.890+0000 7ff3c8aaf640 1 --2- 172.21.15.81:0/658734943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c409b140 0x7ff3c40b6be0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80097a0 tx=0x7ff3b802a1a0 comp rx=0 tx=0).stop 2024-09-16T01:23:50.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.890+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/658734943 shutdown_connections 2024-09-16T01:23:50.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.890+0000 7ff3c8aaf640 1 --2- 172.21.15.81:0/658734943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c409b140 0x7ff3c40b6be0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:50.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.890+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/658734943 >> 172.21.15.81:0/658734943 conn(0x7ff3c40b3f60 msgr2=0x7ff3c40b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:50.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.890+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/658734943 shutdown_connections 2024-09-16T01:23:50.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.890+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/658734943 wait complete. 2024-09-16T01:23:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.891+0000 7ff3c8aaf640 1 Processor -- start 2024-09-16T01:23:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.891+0000 7ff3c8aaf640 1 -- start start 2024-09-16T01:23:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.892+0000 7ff3c8aaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3c409b140 0x7ff3c41477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.892+0000 7ff3c8aaf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c40af240 0x7ff3c41e8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.892+0000 7ff3c8aaf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3c415e660 0x7ff3c4147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.892+0000 7ff3c8aaf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c40b7120 con 0x7ff3c40af240 2024-09-16T01:23:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.892+0000 7ff3c8aaf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c406da90 con 0x7ff3c409b140 2024-09-16T01:23:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.892+0000 7ff3c8aaf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c40b72a0 con 0x7ff3c415e660 2024-09-16T01:23:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.892+0000 7ff3c1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c40af240 0x7ff3c41e8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.892+0000 7ff3c1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c40af240 0x7ff3c41e8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36724/0 (socket says 172.21.15.81:36724) 2024-09-16T01:23:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.892+0000 7ff3c1d9b640 1 -- 172.21.15.81:0/2867816686 learned_addr learned my addr 172.21.15.81:0/2867816686 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.892+0000 7ff3c259c640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3c409b140 0x7ff3c41477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.892+0000 7ff3c2d9d640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3c415e660 0x7ff3c4147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.893+0000 7ff3c1d9b640 1 -- 172.21.15.81:0/2867816686 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3c415e660 msgr2=0x7ff3c4147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.893+0000 7ff3c1d9b640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3c415e660 0x7ff3c4147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.893+0000 7ff3c1d9b640 1 -- 172.21.15.81:0/2867816686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3c409b140 msgr2=0x7ff3c41477a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.893+0000 7ff3c1d9b640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3c409b140 0x7ff3c41477a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.893+0000 7ff3c1d9b640 1 -- 172.21.15.81:0/2867816686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c4161b60 con 0x7ff3c40af240 2024-09-16T01:23:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.893+0000 7ff3c259c640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3c409b140 0x7ff3c41477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.893+0000 7ff3c1d9b640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c40af240 0x7ff3c41e8ea0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8000c00 tx=0x7ff3b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.893+0000 7ff3b2ffd640 1 -- 172.21.15.81:0/2867816686 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8037040 con 0x7ff3c40af240 2024-09-16T01:23:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.893+0000 7ff3b2ffd640 1 -- 172.21.15.81:0/2867816686 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b8042070 con 0x7ff3c40af240 2024-09-16T01:23:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.893+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/2867816686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c40cb780 con 0x7ff3c40af240 2024-09-16T01:23:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.893+0000 7ff3b2ffd640 1 -- 172.21.15.81:0/2867816686 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8030a70 con 0x7ff3c40af240 2024-09-16T01:23:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.893+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/2867816686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c41e86a0 con 0x7ff3c40af240 2024-09-16T01:23:50.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.894+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/2867816686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c40b6be0 con 0x7ff3c40af240 2024-09-16T01:23:50.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.894+0000 7ff3b2ffd640 1 -- 172.21.15.81:0/2867816686 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff3b8030c10 con 0x7ff3c40af240 2024-09-16T01:23:50.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.895+0000 7ff3b2ffd640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff3a406c2b0 0x7ff3a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:50.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.895+0000 7ff3b2ffd640 1 -- 172.21.15.81:0/2867816686 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 6187+0+0 (secure 0 0 0) 0x7ff3b80ac040 con 0x7ff3c40af240 2024-09-16T01:23:50.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.895+0000 7ff3c259c640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff3a406c2b0 0x7ff3a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:50.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.895+0000 7ff3c259c640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff3a406c2b0 0x7ff3a406e770 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4007fd0 tx=0x7ff3b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:50.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:50.899+0000 7ff3b2ffd640 1 -- 172.21.15.81:0/2867816686 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3b807a660 con 0x7ff3c40af240 2024-09-16T01:23:51.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.067+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/2867816686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff3c40af970 con 0x7ff3c40af240 2024-09-16T01:23:51.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.990+0000 7ff3b2ffd640 1 -- 172.21.15.81:0/2867816686 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v139) ==== 181+0+0 (secure 0 0 0) 0x7ff3b8079f60 con 0x7ff3c40af240 2024-09-16T01:23:51.993 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:23:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.993+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/2867816686 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff3a406c2b0 msgr2=0x7ff3a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.993+0000 7ff3c8aaf640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff3a406c2b0 0x7ff3a406e770 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4007fd0 tx=0x7ff3b4009040 comp rx=0 tx=0).stop 2024-09-16T01:23:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.993+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/2867816686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c40af240 msgr2=0x7ff3c41e8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.993+0000 7ff3c8aaf640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c40af240 0x7ff3c41e8ea0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8000c00 tx=0x7ff3b80046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.993+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/2867816686 shutdown_connections 2024-09-16T01:23:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.993+0000 7ff3c8aaf640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff3a406c2b0 0x7ff3a406e770 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.993+0000 7ff3c8aaf640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff3c415e660 0x7ff3c4147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.993+0000 7ff3c8aaf640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3c40af240 0x7ff3c41e8ea0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.993+0000 7ff3c8aaf640 1 --2- 172.21.15.81:0/2867816686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3c409b140 0x7ff3c41477a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.993+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/2867816686 >> 172.21.15.81:0/2867816686 conn(0x7ff3c40b3f60 msgr2=0x7ff3c4071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.993+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/2867816686 shutdown_connections 2024-09-16T01:23:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:51.993+0000 7ff3c8aaf640 1 -- 172.21.15.81:0/2867816686 wait complete. 2024-09-16T01:23:52.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:23:52.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.120+0000 7fb589911640 1 Processor -- start 2024-09-16T01:23:52.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.121+0000 7fb589911640 1 -- start start 2024-09-16T01:23:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.121+0000 7fb589911640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb5840cda30 0x7fb58409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.121+0000 7fb589911640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5840ce010 con 0x7fb5840b3220 2024-09-16T01:23:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.121+0000 7fb589911640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5840cfff0 con 0x7fb584161e60 2024-09-16T01:23:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.121+0000 7fb589911640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb5840ce2f0 con 0x7fb5840cda30 2024-09-16T01:23:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.121+0000 7fb5837fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb5840cda30 0x7fb58409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.121+0000 7fb5837fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb5840cda30 0x7fb58409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38528/0 (socket says 172.21.15.81:38528) 2024-09-16T01:23:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.121+0000 7fb5827fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb5840b3220 0x7fb58406cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53198/0 (socket says 172.21.15.81:53198) 2024-09-16T01:23:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.121+0000 7fb5837fe640 1 -- 172.21.15.81:0/797971935 learned_addr learned my addr 172.21.15.81:0/797971935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.122+0000 7fb5837fe640 1 -- 172.21.15.81:0/797971935 >> v1:172.21.15.102:6789/0 conn(0x7fb584161e60 legacy=0x7fb5840d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:52.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.122+0000 7fb5837fe640 1 -- 172.21.15.81:0/797971935 >> v1:172.21.15.81:6789/0 conn(0x7fb5840b3220 legacy=0x7fb58406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:52.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.122+0000 7fb5837fe640 1 -- 172.21.15.81:0/797971935 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5840d02d0 con 0x7fb5840cda30 2024-09-16T01:23:52.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.122+0000 7fb581ffb640 1 -- 172.21.15.81:0/797971935 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3378579283 0 0) 0x7fb5840ce010 con 0x7fb5840b3220 2024-09-16T01:23:52.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.122+0000 7fb5837fe640 1 --2- 172.21.15.81:0/797971935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5840cda30 0x7fb58409aa30 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009e80 tx=0x7fb57c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c7aa87a1fcf776 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:52.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.123+0000 7fb581ffb640 1 -- 172.21.15.81:0/797971935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c036070 con 0x7fb5840cda30 2024-09-16T01:23:52.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.123+0000 7fb581ffb640 1 -- 172.21.15.81:0/797971935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb57c031600 con 0x7fb5840cda30 2024-09-16T01:23:52.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.123+0000 7fb581ffb640 1 -- 172.21.15.81:0/797971935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0319d0 con 0x7fb5840cda30 2024-09-16T01:23:52.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.123+0000 7fb589911640 1 -- 172.21.15.81:0/797971935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5840cda30 msgr2=0x7fb58409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:52.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.123+0000 7fb589911640 1 --2- 172.21.15.81:0/797971935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5840cda30 0x7fb58409aa30 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009e80 tx=0x7fb57c02a710 comp rx=0 tx=0).stop 2024-09-16T01:23:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.123+0000 7fb589911640 1 -- 172.21.15.81:0/797971935 shutdown_connections 2024-09-16T01:23:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.123+0000 7fb589911640 1 --2- 172.21.15.81:0/797971935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5840cda30 0x7fb58409aa30 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.123+0000 7fb589911640 1 -- 172.21.15.81:0/797971935 >> 172.21.15.81:0/797971935 conn(0x7fb5840b3de0 msgr2=0x7fb5840b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.123+0000 7fb589911640 1 -- 172.21.15.81:0/797971935 shutdown_connections 2024-09-16T01:23:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.123+0000 7fb589911640 1 -- 172.21.15.81:0/797971935 wait complete. 2024-09-16T01:23:52.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.124+0000 7fb589911640 1 Processor -- start 2024-09-16T01:23:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.125+0000 7fb589911640 1 -- start start 2024-09-16T01:23:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.125+0000 7fb589911640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5840b3220 0x7fb584157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.125+0000 7fb589911640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5840cda30 0x7fb584157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.125+0000 7fb589911640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb584161e60 0x7fb584159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.125+0000 7fb589911640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb58409b940 con 0x7fb584161e60 2024-09-16T01:23:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.125+0000 7fb589911640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb5840d0640 con 0x7fb5840cda30 2024-09-16T01:23:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.125+0000 7fb589911640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb58409bac0 con 0x7fb5840b3220 2024-09-16T01:23:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.125+0000 7fb5837fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb584161e60 0x7fb584159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.125+0000 7fb5837fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb584161e60 0x7fb584159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38538/0 (socket says 172.21.15.81:38538) 2024-09-16T01:23:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.125+0000 7fb5837fe640 1 -- 172.21.15.81:0/594549298 learned_addr learned my addr 172.21.15.81:0/594549298 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb5827fc640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5840cda30 0x7fb584157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb582ffd640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5840b3220 0x7fb584157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb5837fe640 1 -- 172.21.15.81:0/594549298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5840b3220 msgr2=0x7fb584157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb5837fe640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5840b3220 0x7fb584157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb5837fe640 1 -- 172.21.15.81:0/594549298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5840cda30 msgr2=0x7fb584157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb5837fe640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5840cda30 0x7fb584157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb5837fe640 1 -- 172.21.15.81:0/594549298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5840cc6f0 con 0x7fb584161e60 2024-09-16T01:23:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb582ffd640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5840b3220 0x7fb584157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb5837fe640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb584161e60 0x7fb584159200 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fb57c034040 tx=0x7fb57c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:52.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb56bfff640 1 -- 172.21.15.81:0/594549298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c036040 con 0x7fb584161e60 2024-09-16T01:23:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb56bfff640 1 -- 172.21.15.81:0/594549298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb57c003990 con 0x7fb584161e60 2024-09-16T01:23:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb56bfff640 1 -- 172.21.15.81:0/594549298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57c009510 con 0x7fb584161e60 2024-09-16T01:23:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb589911640 1 -- 172.21.15.81:0/594549298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58415f6b0 con 0x7fb584161e60 2024-09-16T01:23:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.126+0000 7fb589911640 1 -- 172.21.15.81:0/594549298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb58415fc70 con 0x7fb584161e60 2024-09-16T01:23:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.127+0000 7fb589911640 1 -- 172.21.15.81:0/594549298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5840d0ad0 con 0x7fb584161e60 2024-09-16T01:23:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.128+0000 7fb56bfff640 1 -- 172.21.15.81:0/594549298 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb57c007780 con 0x7fb584161e60 2024-09-16T01:23:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.128+0000 7fb56bfff640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb57006c2b0 0x7fb57006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.128+0000 7fb56bfff640 1 -- 172.21.15.81:0/594549298 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5749+0+0 (secure 0 0 0) 0x7fb57c0ac880 con 0x7fb584161e60 2024-09-16T01:23:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.128+0000 7fb582ffd640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb57006c2b0 0x7fb57006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:52.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.129+0000 7fb582ffd640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb57006c2b0 0x7fb57006e770 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb57400a830 tx=0x7fb574008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:52.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.133+0000 7fb56bfff640 1 -- 172.21.15.81:0/594549298 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb57c07b0e0 con 0x7fb584161e60 2024-09-16T01:23:52.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.299+0000 7fb589911640 1 -- 172.21.15.81:0/594549298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb5840b4a70 con 0x7fb584161e60 2024-09-16T01:23:52.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.995+0000 7fb56bfff640 1 -- 172.21.15.81:0/594549298 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v140) ==== 169+0+0 (secure 0 0 0) 0x7fb57c07a9e0 con 0x7fb584161e60 2024-09-16T01:23:52.997 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-16T01:23:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.997+0000 7fb589911640 1 -- 172.21.15.81:0/594549298 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb57006c2b0 msgr2=0x7fb57006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.997+0000 7fb589911640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb57006c2b0 0x7fb57006e770 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb57400a830 tx=0x7fb574008040 comp rx=0 tx=0).stop 2024-09-16T01:23:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.998+0000 7fb589911640 1 -- 172.21.15.81:0/594549298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb584161e60 msgr2=0x7fb584159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.998+0000 7fb589911640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb584161e60 0x7fb584159200 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fb57c034040 tx=0x7fb57c004a40 comp rx=0 tx=0).stop 2024-09-16T01:23:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.998+0000 7fb589911640 1 -- 172.21.15.81:0/594549298 shutdown_connections 2024-09-16T01:23:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.998+0000 7fb589911640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb57006c2b0 0x7fb57006e770 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.998+0000 7fb589911640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb584161e60 0x7fb584159200 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.998+0000 7fb589911640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5840cda30 0x7fb584157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.998+0000 7fb589911640 1 --2- 172.21.15.81:0/594549298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb5840b3220 0x7fb584157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.998+0000 7fb589911640 1 -- 172.21.15.81:0/594549298 >> 172.21.15.81:0/594549298 conn(0x7fb5840b3de0 msgr2=0x7fb58409aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:53.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.998+0000 7fb589911640 1 -- 172.21.15.81:0/594549298 shutdown_connections 2024-09-16T01:23:53.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:52.998+0000 7fb589911640 1 -- 172.21.15.81:0/594549298 wait complete. 2024-09-16T01:23:53.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_warning_threshold 2024-09-16T01:23:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.117+0000 7f3fa47a6640 1 Processor -- start 2024-09-16T01:23:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.117+0000 7f3fa47a6640 1 -- start start 2024-09-16T01:23:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa47a6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f9c15e760 0x7f3f9c0b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa47a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f9c070110 0x7f3f9c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa47a6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f9c0b4a50 con 0x7f3f9c0705c0 2024-09-16T01:23:53.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa47a6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3f9c0b5ea0 con 0x7f3f9c15e760 2024-09-16T01:23:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa47a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9c0710d0 con 0x7f3f9c070110 2024-09-16T01:23:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa2542640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f9c15e760 0x7f3f9c0b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa1d41640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3f9c0705c0 0x7f3f9c06fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53206/0 (socket says 172.21.15.81:53206) 2024-09-16T01:23:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa1d41640 1 -- 172.21.15.81:0/3896606047 learned_addr learned my addr 172.21.15.81:0/3896606047 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa2542640 1 -- 172.21.15.81:0/3896606047 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f9c070110 msgr2=0x7f3f9c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa2542640 1 --2- 172.21.15.81:0/3896606047 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f9c070110 0x7f3f9c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa2542640 1 -- 172.21.15.81:0/3896606047 >> v1:172.21.15.81:6789/0 conn(0x7f3f9c0705c0 legacy=0x7f3f9c06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa2542640 1 -- 172.21.15.81:0/3896606047 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9c070b10 con 0x7f3f9c15e760 2024-09-16T01:23:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.118+0000 7f3fa1540640 1 -- 172.21.15.81:0/3896606047 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293142239 0 0) 0x7f3f9c0b4a50 con 0x7f3f9c0705c0 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.119+0000 7f3fa2542640 1 --2- 172.21.15.81:0/3896606047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f9c15e760 0x7f3f9c0b6310 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f3f980097a0 tx=0x7f3f9802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fa41acbdf33fba server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.119+0000 7f3fa1540640 1 -- 172.21.15.81:0/3896606047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98037070 con 0x7f3f9c15e760 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.119+0000 7f3fa1540640 1 -- 172.21.15.81:0/3896606047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f98032440 con 0x7f3f9c15e760 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.119+0000 7f3fa1540640 1 -- 172.21.15.81:0/3896606047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98032810 con 0x7f3f9c15e760 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.120+0000 7f3fa47a6640 1 -- 172.21.15.81:0/3896606047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f9c15e760 msgr2=0x7f3f9c0b6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.120+0000 7f3fa47a6640 1 --2- 172.21.15.81:0/3896606047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f9c15e760 0x7f3f9c0b6310 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f3f980097a0 tx=0x7f3f9802a180 comp rx=0 tx=0).stop 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.120+0000 7f3fa47a6640 1 -- 172.21.15.81:0/3896606047 shutdown_connections 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.120+0000 7f3fa47a6640 1 --2- 172.21.15.81:0/3896606047 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f9c070110 0x7f3f9c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.120+0000 7f3fa47a6640 1 --2- 172.21.15.81:0/3896606047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f9c15e760 0x7f3f9c0b6310 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.120+0000 7f3fa47a6640 1 -- 172.21.15.81:0/3896606047 >> 172.21.15.81:0/3896606047 conn(0x7f3f9c073490 msgr2=0x7f3f9c0b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.120+0000 7f3fa47a6640 1 -- 172.21.15.81:0/3896606047 shutdown_connections 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.120+0000 7f3fa47a6640 1 -- 172.21.15.81:0/3896606047 wait complete. 2024-09-16T01:23:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.121+0000 7f3fa47a6640 1 Processor -- start 2024-09-16T01:23:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.121+0000 7f3fa47a6640 1 -- start start 2024-09-16T01:23:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa47a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f9c070110 0x7f3f9c14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa47a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f9c0705c0 0x7f3f9c0b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa47a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f9c15e760 0x7f3f9c1f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa47a6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c0b46e0 con 0x7f3f9c070110 2024-09-16T01:23:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa47a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3f9c0b4400 con 0x7f3f9c0705c0 2024-09-16T01:23:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa47a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3f9c0ae240 con 0x7f3f9c15e760 2024-09-16T01:23:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa2542640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f9c070110 0x7f3f9c14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa2542640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f9c070110 0x7f3f9c14fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38552/0 (socket says 172.21.15.81:38552) 2024-09-16T01:23:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa2542640 1 -- 172.21.15.81:0/2216364779 learned_addr learned my addr 172.21.15.81:0/2216364779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa1d41640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f9c0705c0 0x7f3f9c0b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa2542640 1 -- 172.21.15.81:0/2216364779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f9c15e760 msgr2=0x7f3f9c1f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa2542640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f9c15e760 0x7f3f9c1f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa2542640 1 -- 172.21.15.81:0/2216364779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f9c0705c0 msgr2=0x7f3f9c0b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa2542640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f9c0705c0 0x7f3f9c0b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa2542640 1 -- 172.21.15.81:0/2216364779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f9c150350 con 0x7f3f9c070110 2024-09-16T01:23:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.122+0000 7f3fa1d41640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f9c0705c0 0x7f3f9c0b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.123+0000 7f3fa2542640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f9c070110 0x7f3f9c14fe10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f3f980097a0 tx=0x7f3f980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.123+0000 7f3f92ffd640 1 -- 172.21.15.81:0/2216364779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98041070 con 0x7f3f9c070110 2024-09-16T01:23:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.123+0000 7f3f92ffd640 1 -- 172.21.15.81:0/2216364779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9803c870 con 0x7f3f9c070110 2024-09-16T01:23:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.123+0000 7f3fa47a6640 1 -- 172.21.15.81:0/2216364779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f9c0b2e70 con 0x7f3f9c070110 2024-09-16T01:23:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.123+0000 7f3f92ffd640 1 -- 172.21.15.81:0/2216364779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98037040 con 0x7f3f9c070110 2024-09-16T01:23:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.123+0000 7f3fa47a6640 1 -- 172.21.15.81:0/2216364779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f9c161320 con 0x7f3f9c070110 2024-09-16T01:23:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.124+0000 7f3fa47a6640 1 -- 172.21.15.81:0/2216364779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f9c0b6310 con 0x7f3f9c070110 2024-09-16T01:23:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.124+0000 7f3f92ffd640 1 -- 172.21.15.81:0/2216364779 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3f98044070 con 0x7f3f9c070110 2024-09-16T01:23:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.125+0000 7f3f92ffd640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3f8006c2b0 0x7f3f8006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.125+0000 7f3fa1d41640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3f8006c2b0 0x7f3f8006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.125+0000 7f3f92ffd640 1 -- 172.21.15.81:0/2216364779 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f3f980ac0e0 con 0x7f3f9c070110 2024-09-16T01:23:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.125+0000 7f3fa1d41640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3f8006c2b0 0x7f3f8006e770 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c000f60 tx=0x7f3f8c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.129+0000 7f3f92ffd640 1 -- 172.21.15.81:0/2216364779 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f9c150350 con 0x7f3f9c070110 2024-09-16T01:23:53.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.297+0000 7f3fa47a6640 1 -- 172.21.15.81:0/2216364779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"} v 0) -- 0x7f3f9c1f58f0 con 0x7f3f9c070110 2024-09-16T01:23:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.301+0000 7f3f92ffd640 1 -- 172.21.15.81:0/2216364779 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"}]=0 v61) ==== 111+0+0 (secure 0 0 0) 0x7f3f9807ab70 con 0x7f3f9c070110 2024-09-16T01:23:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.303+0000 7f3fa47a6640 1 -- 172.21.15.81:0/2216364779 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3f8006c2b0 msgr2=0x7f3f8006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.303+0000 7f3fa47a6640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3f8006c2b0 0x7f3f8006e770 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c000f60 tx=0x7f3f8c009040 comp rx=0 tx=0).stop 2024-09-16T01:23:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.303+0000 7f3fa47a6640 1 -- 172.21.15.81:0/2216364779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f9c070110 msgr2=0x7f3f9c14fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.303+0000 7f3fa47a6640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f9c070110 0x7f3f9c14fe10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f3f980097a0 tx=0x7f3f980046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.303+0000 7f3fa47a6640 1 -- 172.21.15.81:0/2216364779 shutdown_connections 2024-09-16T01:23:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.303+0000 7f3fa47a6640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3f8006c2b0 0x7f3f8006e770 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.303+0000 7f3fa47a6640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3f9c15e760 0x7f3f9c1f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.303+0000 7f3fa47a6640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3f9c0705c0 0x7f3f9c0b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.303+0000 7f3fa47a6640 1 --2- 172.21.15.81:0/2216364779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f9c070110 0x7f3f9c14fe10 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.303+0000 7f3fa47a6640 1 -- 172.21.15.81:0/2216364779 >> 172.21.15.81:0/2216364779 conn(0x7f3f9c073490 msgr2=0x7f3f9c15c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.303+0000 7f3fa47a6640 1 -- 172.21.15.81:0/2216364779 shutdown_connections 2024-09-16T01:23:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.303+0000 7f3fa47a6640 1 -- 172.21.15.81:0/2216364779 wait complete. 2024-09-16T01:23:53.316 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_memory_limit 2024-09-16T01:23:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.414+0000 7fbebc152640 1 Processor -- start 2024-09-16T01:23:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.414+0000 7fbebc152640 1 -- start start 2024-09-16T01:23:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbebc152640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbeb4155930 0x7fbeb40addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbebc152640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbeb40d0a80 0x7fbeb415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbebc152640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeb415c1e0 con 0x7fbeb415b720 2024-09-16T01:23:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbebc152640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fbeb415c4c0 con 0x7fbeb40d0a80 2024-09-16T01:23:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbebc152640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb40b3340 con 0x7fbeb4155930 2024-09-16T01:23:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbeba6ef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbeb40d0a80 0x7fbeb415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbeb96ed640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbeb415b720 0x7fbeb40d0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53212/0 (socket says 172.21.15.81:53212) 2024-09-16T01:23:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbeb96ed640 1 -- 172.21.15.81:0/883947978 learned_addr learned my addr 172.21.15.81:0/883947978 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbeb9eee640 1 --2- 172.21.15.81:0/883947978 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbeb4155930 0x7fbeb40addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbeba6ef640 1 -- 172.21.15.81:0/883947978 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbeb4155930 msgr2=0x7fbeb40addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbeba6ef640 1 --2- 172.21.15.81:0/883947978 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbeb4155930 0x7fbeb40addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbeba6ef640 1 -- 172.21.15.81:0/883947978 >> v1:172.21.15.81:6789/0 conn(0x7fbeb415b720 legacy=0x7fbeb40d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbeba6ef640 1 -- 172.21.15.81:0/883947978 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb40b3620 con 0x7fbeb40d0a80 2024-09-16T01:23:53.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbeb8eec640 1 -- 172.21.15.81:0/883947978 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1977760821 0 0) 0x7fbeb415c1e0 con 0x7fbeb415b720 2024-09-16T01:23:53.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.415+0000 7fbeb9eee640 1 --2- 172.21.15.81:0/883947978 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbeb4155930 0x7fbeb40addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:53.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.416+0000 7fbeba6ef640 1 --2- 172.21.15.81:0/883947978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeb40d0a80 0x7fbeb415bb80 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00bfa0 tx=0x7fbeac02c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926a1d589fb326cf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:53.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.416+0000 7fbeb8eec640 1 -- 172.21.15.81:0/883947978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac039070 con 0x7fbeb40d0a80 2024-09-16T01:23:53.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.416+0000 7fbeb8eec640 1 -- 172.21.15.81:0/883947978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeac009540 con 0x7fbeb40d0a80 2024-09-16T01:23:53.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.416+0000 7fbeb8eec640 1 -- 172.21.15.81:0/883947978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeac009910 con 0x7fbeb40d0a80 2024-09-16T01:23:53.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.416+0000 7fbebc152640 1 -- 172.21.15.81:0/883947978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeb40d0a80 msgr2=0x7fbeb415bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.416+0000 7fbebc152640 1 --2- 172.21.15.81:0/883947978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeb40d0a80 0x7fbeb415bb80 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00bfa0 tx=0x7fbeac02c860 comp rx=0 tx=0).stop 2024-09-16T01:23:53.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.417+0000 7fbebc152640 1 -- 172.21.15.81:0/883947978 shutdown_connections 2024-09-16T01:23:53.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.417+0000 7fbebc152640 1 --2- 172.21.15.81:0/883947978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeb40d0a80 0x7fbeb415bb80 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.417+0000 7fbebc152640 1 --2- 172.21.15.81:0/883947978 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbeb4155930 0x7fbeb40addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.417+0000 7fbebc152640 1 -- 172.21.15.81:0/883947978 >> 172.21.15.81:0/883947978 conn(0x7fbeb406bdf0 msgr2=0x7fbeb406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:53.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.417+0000 7fbebc152640 1 -- 172.21.15.81:0/883947978 shutdown_connections 2024-09-16T01:23:53.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.417+0000 7fbebc152640 1 -- 172.21.15.81:0/883947978 wait complete. 2024-09-16T01:23:53.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.418+0000 7fbebc152640 1 Processor -- start 2024-09-16T01:23:53.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.418+0000 7fbebc152640 1 -- start start 2024-09-16T01:23:53.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.418+0000 7fbebc152640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeb40d0a80 0x7fbeb40cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.418+0000 7fbebc152640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbeb4155930 0x7fbeb40ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.418+0000 7fbebc152640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbeb415b720 0x7fbeb41e4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.418+0000 7fbebc152640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb40ae490 con 0x7fbeb40d0a80 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.418+0000 7fbebc152640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb40ae310 con 0x7fbeb415b720 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.418+0000 7fbebc152640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb40b3b40 con 0x7fbeb4155930 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeb9eee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeb40d0a80 0x7fbeb40cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeb9eee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeb40d0a80 0x7fbeb40cfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38574/0 (socket says 172.21.15.81:38574) 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeb9eee640 1 -- 172.21.15.81:0/304649840 learned_addr learned my addr 172.21.15.81:0/304649840 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeb96ed640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbeb4155930 0x7fbeb40ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeba6ef640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbeb415b720 0x7fbeb41e4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeb9eee640 1 -- 172.21.15.81:0/304649840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbeb4155930 msgr2=0x7fbeb40ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeb9eee640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbeb4155930 0x7fbeb40ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeb9eee640 1 -- 172.21.15.81:0/304649840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbeb415b720 msgr2=0x7fbeb41e4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeb9eee640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbeb415b720 0x7fbeb41e4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeb9eee640 1 -- 172.21.15.81:0/304649840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb414fcd0 con 0x7fbeb40d0a80 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeb96ed640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbeb4155930 0x7fbeb40ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeba6ef640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbeb415b720 0x7fbeb41e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeb9eee640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeb40d0a80 0x7fbeb40cfa10 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000c7f0 tx=0x7fbeb000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeaa7fc640 1 -- 172.21.15.81:0/304649840 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0015070 con 0x7fbeb40d0a80 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeaa7fc640 1 -- 172.21.15.81:0/304649840 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb0007a30 con 0x7fbeb40d0a80 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbeaa7fc640 1 -- 172.21.15.81:0/304649840 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0007e00 con 0x7fbeb40d0a80 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbebc152640 1 -- 172.21.15.81:0/304649840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb415de40 con 0x7fbeb40d0a80 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.419+0000 7fbebc152640 1 -- 172.21.15.81:0/304649840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb4150270 con 0x7fbeb40d0a80 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.420+0000 7fbebc152640 1 -- 172.21.15.81:0/304649840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb415c250 con 0x7fbeb40d0a80 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.421+0000 7fbeaa7fc640 1 -- 172.21.15.81:0/304649840 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbeb0018070 con 0x7fbeb40d0a80 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.421+0000 7fbeaa7fc640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbe9806c2b0 0x7fbe9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.421+0000 7fbeaa7fc640 1 -- 172.21.15.81:0/304649840 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7fbeb008b1b0 con 0x7fbeb40d0a80 2024-09-16T01:23:53.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.421+0000 7fbeb96ed640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbe9806c2b0 0x7fbe9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.421+0000 7fbeb96ed640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbe9806c2b0 0x7fbe9806e770 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40af790 tx=0x7fbea4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:53.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.425+0000 7fbeaa7fc640 1 -- 172.21.15.81:0/304649840 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbeb415c250 con 0x7fbeb40d0a80 2024-09-16T01:23:53.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.592+0000 7fbebc152640 1 -- 172.21.15.81:0/304649840 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"} v 0) -- 0x7fbeb4068f90 con 0x7fbeb40d0a80 2024-09-16T01:23:53.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.595+0000 7fbeaa7fc640 1 -- 172.21.15.81:0/304649840 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"}]=0 v62) ==== 105+0+0 (secure 0 0 0) 0x7fbeb4068f90 con 0x7fbeb40d0a80 2024-09-16T01:23:53.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.597+0000 7fbebc152640 1 -- 172.21.15.81:0/304649840 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbe9806c2b0 msgr2=0x7fbe9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.597+0000 7fbebc152640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbe9806c2b0 0x7fbe9806e770 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40af790 tx=0x7fbea4009040 comp rx=0 tx=0).stop 2024-09-16T01:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.597+0000 7fbebc152640 1 -- 172.21.15.81:0/304649840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeb40d0a80 msgr2=0x7fbeb40cfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.597+0000 7fbebc152640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeb40d0a80 0x7fbeb40cfa10 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000c7f0 tx=0x7fbeb000cbf0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.597+0000 7fbebc152640 1 -- 172.21.15.81:0/304649840 shutdown_connections 2024-09-16T01:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.597+0000 7fbebc152640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fbe9806c2b0 0x7fbe9806e770 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.597+0000 7fbebc152640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbeb415b720 0x7fbeb41e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.597+0000 7fbebc152640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbeb4155930 0x7fbeb40ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.597+0000 7fbebc152640 1 --2- 172.21.15.81:0/304649840 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbeb40d0a80 0x7fbeb40cfa10 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.597+0000 7fbebc152640 1 -- 172.21.15.81:0/304649840 >> 172.21.15.81:0/304649840 conn(0x7fbeb406bdf0 msgr2=0x7fbeb40b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.598+0000 7fbebc152640 1 -- 172.21.15.81:0/304649840 shutdown_connections 2024-09-16T01:23:53.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.598+0000 7fbebc152640 1 -- 172.21.15.81:0/304649840 wait complete. 2024-09-16T01:23:53.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-16T01:23:53.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.709+0000 7fe1a2c0e640 1 Processor -- start 2024-09-16T01:23:53.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.709+0000 7fe1a2c0e640 1 -- start start 2024-09-16T01:23:53.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.710+0000 7fe1a2c0e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe19c06f910 0x7fe19c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.710+0000 7fe1a2c0e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19c070050 0x7fe19c0b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.710+0000 7fe1a2c0e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19c0b5df0 con 0x7fe19c0b59e0 2024-09-16T01:23:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.710+0000 7fe1a2c0e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe19c0b4ce0 con 0x7fe19c06f910 2024-09-16T01:23:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.710+0000 7fe1a2c0e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe19c0b3c40 con 0x7fe19c070050 2024-09-16T01:23:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.710+0000 7fe1a09aa640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe19c06f910 0x7fe19c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.710+0000 7fe1a09aa640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe19c06f910 0x7fe19c15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38588/0 (socket says 172.21.15.81:38588) 2024-09-16T01:23:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.710+0000 7fe1a09aa640 1 -- 172.21.15.81:0/551137471 learned_addr learned my addr 172.21.15.81:0/551137471 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.710+0000 7fe1a09aa640 1 -- 172.21.15.81:0/551137471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19c070050 msgr2=0x7fe19c0b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.710+0000 7fe19bfff640 1 --2- 172.21.15.81:0/551137471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19c070050 0x7fe19c0b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.711+0000 7fe1a09aa640 1 --2- 172.21.15.81:0/551137471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19c070050 0x7fe19c0b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.711+0000 7fe1a09aa640 1 -- 172.21.15.81:0/551137471 >> v1:172.21.15.102:6789/0 conn(0x7fe19c0b59e0 legacy=0x7fe19c154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.711+0000 7fe1a09aa640 1 -- 172.21.15.81:0/551137471 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c0b3f20 con 0x7fe19c06f910 2024-09-16T01:23:53.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.711+0000 7fe19bfff640 1 --2- 172.21.15.81:0/551137471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19c070050 0x7fe19c0b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:53.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.711+0000 7fe1a09aa640 1 --2- 172.21.15.81:0/551137471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19c06f910 0x7fe19c15f500 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009870 tx=0x7fe18c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b4b3e2ec4b9901 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.711+0000 7fe19b7fe640 1 -- 172.21.15.81:0/551137471 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c037070 con 0x7fe19c06f910 2024-09-16T01:23:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.711+0000 7fe19b7fe640 1 -- 172.21.15.81:0/551137471 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c02ae10 con 0x7fe19c06f910 2024-09-16T01:23:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.711+0000 7fe19b7fe640 1 -- 172.21.15.81:0/551137471 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c032660 con 0x7fe19c06f910 2024-09-16T01:23:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.712+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/551137471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19c06f910 msgr2=0x7fe19c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.712+0000 7fe1a2c0e640 1 --2- 172.21.15.81:0/551137471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19c06f910 0x7fe19c15f500 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009870 tx=0x7fe18c02a100 comp rx=0 tx=0).stop 2024-09-16T01:23:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.712+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/551137471 shutdown_connections 2024-09-16T01:23:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.712+0000 7fe1a2c0e640 1 --2- 172.21.15.81:0/551137471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19c070050 0x7fe19c0b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.712+0000 7fe1a2c0e640 1 --2- 172.21.15.81:0/551137471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19c06f910 0x7fe19c15f500 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.712+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/551137471 >> 172.21.15.81:0/551137471 conn(0x7fe19c073530 msgr2=0x7fe19c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.712+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/551137471 shutdown_connections 2024-09-16T01:23:53.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.712+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/551137471 wait complete. 2024-09-16T01:23:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.713+0000 7fe1a2c0e640 1 Processor -- start 2024-09-16T01:23:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.713+0000 7fe1a2c0e640 1 -- start start 2024-09-16T01:23:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.714+0000 7fe1a2c0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19c06f910 0x7fe19c15dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.714+0000 7fe1a2c0e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19c070050 0x7fe19c14c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.714+0000 7fe1a2c0e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe19c0b59e0 0x7fe19c15c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.714+0000 7fe1a2c0e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c0b47c0 con 0x7fe19c06f910 2024-09-16T01:23:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.714+0000 7fe1a2c0e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c0b44e0 con 0x7fe19c0b59e0 2024-09-16T01:23:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.714+0000 7fe1a2c0e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe19c0704a0 con 0x7fe19c070050 2024-09-16T01:23:53.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.714+0000 7fe1a09aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19c06f910 0x7fe19c15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.714+0000 7fe1a09aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19c06f910 0x7fe19c15dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38604/0 (socket says 172.21.15.81:38604) 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.714+0000 7fe1a09aa640 1 -- 172.21.15.81:0/3421167924 learned_addr learned my addr 172.21.15.81:0/3421167924 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.715+0000 7fe1a11ab640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe19c0b59e0 0x7fe19c15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.715+0000 7fe1a09aa640 1 -- 172.21.15.81:0/3421167924 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19c070050 msgr2=0x7fe19c14c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.715+0000 7fe1a09aa640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19c070050 0x7fe19c14c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.715+0000 7fe1a09aa640 1 -- 172.21.15.81:0/3421167924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe19c0b59e0 msgr2=0x7fe19c15c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.715+0000 7fe1a09aa640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe19c0b59e0 0x7fe19c15c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.715+0000 7fe1a09aa640 1 -- 172.21.15.81:0/3421167924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c15cb90 con 0x7fe19c06f910 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.715+0000 7fe1a09aa640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19c06f910 0x7fe19c15dc30 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000c00 tx=0x7fe18c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.715+0000 7fe1997fa640 1 -- 172.21.15.81:0/3421167924 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c041070 con 0x7fe19c06f910 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.715+0000 7fe1997fa640 1 -- 172.21.15.81:0/3421167924 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c03c670 con 0x7fe19c06f910 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.715+0000 7fe1997fa640 1 -- 172.21.15.81:0/3421167924 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c037040 con 0x7fe19c06f910 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.715+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/3421167924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c15ce70 con 0x7fe19c06f910 2024-09-16T01:23:53.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.715+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/3421167924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19c15d430 con 0x7fe19c06f910 2024-09-16T01:23:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.716+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/3421167924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19c06fcf0 con 0x7fe19c06f910 2024-09-16T01:23:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.717+0000 7fe1997fa640 1 -- 172.21.15.81:0/3421167924 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe18c044070 con 0x7fe19c06f910 2024-09-16T01:23:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.717+0000 7fe1997fa640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe18806c2b0 0x7fe18806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.717+0000 7fe1997fa640 1 -- 172.21.15.81:0/3421167924 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7fe18c0abae0 con 0x7fe19c06f910 2024-09-16T01:23:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.717+0000 7fe19bfff640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe18806c2b0 0x7fe18806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:53.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.717+0000 7fe19bfff640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe18806c2b0 0x7fe18806e770 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe190006fd0 tx=0x7fe190008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:53.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.721+0000 7fe1997fa640 1 -- 172.21.15.81:0/3421167924 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe19c0b5df0 con 0x7fe19c06f910 2024-09-16T01:23:53.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.887+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/3421167924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe19c158d90 con 0x7fe19c06f910 2024-09-16T01:23:53.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.890+0000 7fe1997fa640 1 -- 172.21.15.81:0/3421167924 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v63) ==== 104+0+0 (secure 0 0 0) 0x7fe18c07a570 con 0x7fe19c06f910 2024-09-16T01:23:53.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.893+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/3421167924 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe18806c2b0 msgr2=0x7fe18806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.893+0000 7fe1a2c0e640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe18806c2b0 0x7fe18806e770 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe190006fd0 tx=0x7fe190008040 comp rx=0 tx=0).stop 2024-09-16T01:23:53.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.893+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/3421167924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19c06f910 msgr2=0x7fe19c15dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:53.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.893+0000 7fe1a2c0e640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19c06f910 0x7fe19c15dc30 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fe18c000c00 tx=0x7fe18c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.893+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/3421167924 shutdown_connections 2024-09-16T01:23:53.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.893+0000 7fe1a2c0e640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe18806c2b0 0x7fe18806e770 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.893+0000 7fe1a2c0e640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe19c0b59e0 0x7fe19c15c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.893+0000 7fe1a2c0e640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe19c070050 0x7fe19c14c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.893+0000 7fe1a2c0e640 1 --2- 172.21.15.81:0/3421167924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe19c06f910 0x7fe19c15dc30 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:53.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.893+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/3421167924 >> 172.21.15.81:0/3421167924 conn(0x7fe19c073530 msgr2=0x7fe19c0b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:53.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.893+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/3421167924 shutdown_connections 2024-09-16T01:23:53.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:53.893+0000 7fe1a2c0e640 1 -- 172.21.15.81:0/3421167924 wait complete. 2024-09-16T01:23:53.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_max_caps 2024-09-16T01:23:54.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.003+0000 7f76338af640 1 Processor -- start 2024-09-16T01:23:54.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.003+0000 7f76338af640 1 -- start start 2024-09-16T01:23:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f76338af640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f762c15e980 0x7f762c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f76338af640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f762c0d1330 0x7f762c1685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f76338af640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f762c0d53f0 con 0x7f762c15e5a0 2024-09-16T01:23:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f76338af640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f762c0d1780 con 0x7f762c15e980 2024-09-16T01:23:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f76338af640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f762c06cd90 con 0x7f762c0d1330 2024-09-16T01:23:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f7630e4a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f762c15e980 0x7f762c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f7630e4a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f762c15e980 0x7f762c0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38618/0 (socket says 172.21.15.81:38618) 2024-09-16T01:23:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f7630e4a640 1 -- 172.21.15.81:0/592369655 learned_addr learned my addr 172.21.15.81:0/592369655 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f763164b640 1 --1- 172.21.15.81:0/592369655 >> v1:172.21.15.81:6789/0 conn(0x7f762c15e5a0 0x7f762c0cfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53218/0 (socket says 172.21.15.81:53218) 2024-09-16T01:23:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f7631e4c640 1 --2- 172.21.15.81:0/592369655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f762c0d1330 0x7f762c1685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f7630e4a640 1 -- 172.21.15.81:0/592369655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f762c0d1330 msgr2=0x7f762c1685c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f7630e4a640 1 --2- 172.21.15.81:0/592369655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f762c0d1330 0x7f762c1685c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f7630e4a640 1 -- 172.21.15.81:0/592369655 >> v1:172.21.15.81:6789/0 conn(0x7f762c15e5a0 legacy=0x7f762c0cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f7630e4a640 1 -- 172.21.15.81:0/592369655 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c06d070 con 0x7f762c15e980 2024-09-16T01:23:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f7623fff640 1 -- 172.21.15.81:0/592369655 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3320725995 0 0) 0x7f762c0d53f0 con 0x7f762c15e5a0 2024-09-16T01:23:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.004+0000 7f7631e4c640 1 --2- 172.21.15.81:0/592369655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f762c0d1330 0x7f762c1685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:54.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.005+0000 7f7630e4a640 1 --2- 172.21.15.81:0/592369655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c15e980 0x7f762c0d0df0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f761c009870 tx=0x7f761c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3fe04ea440aa16 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:54.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.005+0000 7f7623fff640 1 -- 172.21.15.81:0/592369655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c037070 con 0x7f762c15e980 2024-09-16T01:23:54.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.005+0000 7f7623fff640 1 -- 172.21.15.81:0/592369655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761c032440 con 0x7f762c15e980 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.005+0000 7f7623fff640 1 -- 172.21.15.81:0/592369655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c032810 con 0x7f762c15e980 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.006+0000 7f76338af640 1 -- 172.21.15.81:0/592369655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c15e980 msgr2=0x7f762c0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.006+0000 7f76338af640 1 --2- 172.21.15.81:0/592369655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c15e980 0x7f762c0d0df0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f761c009870 tx=0x7f761c02a1c0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.006+0000 7f76338af640 1 -- 172.21.15.81:0/592369655 shutdown_connections 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.006+0000 7f76338af640 1 --2- 172.21.15.81:0/592369655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f762c0d1330 0x7f762c1685c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.006+0000 7f76338af640 1 --2- 172.21.15.81:0/592369655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c15e980 0x7f762c0d0df0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.006+0000 7f76338af640 1 -- 172.21.15.81:0/592369655 >> 172.21.15.81:0/592369655 conn(0x7f762c08bfc0 msgr2=0x7f762c0d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.006+0000 7f76338af640 1 -- 172.21.15.81:0/592369655 shutdown_connections 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.006+0000 7f76338af640 1 -- 172.21.15.81:0/592369655 wait complete. 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.007+0000 7f76338af640 1 Processor -- start 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.007+0000 7f76338af640 1 -- start start 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f76338af640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f762c0d1330 0x7f762c0b6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f76338af640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f762c15e5a0 0x7f762c155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f76338af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c15e980 0x7f762c0c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f76338af640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f762c06d910 con 0x7f762c15e980 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f76338af640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f762c06d630 con 0x7f762c15e5a0 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f76338af640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f762c0d03e0 con 0x7f762c0d1330 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7631e4c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c15e980 0x7f762c0c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7631e4c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c15e980 0x7f762c0c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38630/0 (socket says 172.21.15.81:38630) 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7631e4c640 1 -- 172.21.15.81:0/3106036952 learned_addr learned my addr 172.21.15.81:0/3106036952 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f763164b640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f762c0d1330 0x7f762c0b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7630e4a640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f762c15e5a0 0x7f762c155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7631e4c640 1 -- 172.21.15.81:0/3106036952 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f762c0d1330 msgr2=0x7f762c0b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7631e4c640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f762c0d1330 0x7f762c0b6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7631e4c640 1 -- 172.21.15.81:0/3106036952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f762c15e5a0 msgr2=0x7f762c155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7631e4c640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f762c15e5a0 0x7f762c155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7631e4c640 1 -- 172.21.15.81:0/3106036952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c155da0 con 0x7f762c15e980 2024-09-16T01:23:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7630e4a640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f762c15e5a0 0x7f762c155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7631e4c640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c15e980 0x7f762c0c9130 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f7624009fa0 tx=0x7f762400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7621ffb640 1 -- 172.21.15.81:0/3106036952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762401a070 con 0x7f762c15e980 2024-09-16T01:23:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7621ffb640 1 -- 172.21.15.81:0/3106036952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7624003bb0 con 0x7f762c15e980 2024-09-16T01:23:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f76338af640 1 -- 172.21.15.81:0/3106036952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762c0c8090 con 0x7f762c15e980 2024-09-16T01:23:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.008+0000 7f7621ffb640 1 -- 172.21.15.81:0/3106036952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7624004030 con 0x7f762c15e980 2024-09-16T01:23:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.009+0000 7f76338af640 1 -- 172.21.15.81:0/3106036952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762c0c8650 con 0x7f762c15e980 2024-09-16T01:23:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.010+0000 7f76338af640 1 -- 172.21.15.81:0/3106036952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f762c06de30 con 0x7f762c15e980 2024-09-16T01:23:54.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.010+0000 7f7621ffb640 1 -- 172.21.15.81:0/3106036952 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f762401d070 con 0x7f762c15e980 2024-09-16T01:23:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.010+0000 7f7621ffb640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f761006c2b0 0x7f761006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.010+0000 7f7621ffb640 1 -- 172.21.15.81:0/3106036952 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f762408b580 con 0x7f762c15e980 2024-09-16T01:23:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.010+0000 7f763164b640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f761006c2b0 0x7f761006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.011+0000 7f763164b640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f761006c2b0 0x7f761006e770 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7628000f60 tx=0x7f7628007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.014+0000 7f7621ffb640 1 -- 172.21.15.81:0/3106036952 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7624010070 con 0x7f762c15e980 2024-09-16T01:23:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.180+0000 7f76338af640 1 -- 172.21.15.81:0/3106036952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"} v 0) -- 0x7f762c0d1ba0 con 0x7f762c15e980 2024-09-16T01:23:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.185+0000 7f7621ffb640 1 -- 172.21.15.81:0/3106036952 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"}]=0 v64) ==== 102+0+0 (secure 0 0 0) 0x7f7624059e60 con 0x7f762c15e980 2024-09-16T01:23:54.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.187+0000 7f76338af640 1 -- 172.21.15.81:0/3106036952 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f761006c2b0 msgr2=0x7f761006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.187+0000 7f76338af640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f761006c2b0 0x7f761006e770 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7628000f60 tx=0x7f7628007b50 comp rx=0 tx=0).stop 2024-09-16T01:23:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.187+0000 7f76338af640 1 -- 172.21.15.81:0/3106036952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c15e980 msgr2=0x7f762c0c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.187+0000 7f76338af640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c15e980 0x7f762c0c9130 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f7624009fa0 tx=0x7f762400d560 comp rx=0 tx=0).stop 2024-09-16T01:23:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.188+0000 7f76338af640 1 -- 172.21.15.81:0/3106036952 shutdown_connections 2024-09-16T01:23:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.188+0000 7f76338af640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f761006c2b0 0x7f761006e770 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.188+0000 7f76338af640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c15e980 0x7f762c0c9130 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.188+0000 7f76338af640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f762c15e5a0 0x7f762c155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.188+0000 7f76338af640 1 --2- 172.21.15.81:0/3106036952 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f762c0d1330 0x7f762c0b6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.188+0000 7f76338af640 1 -- 172.21.15.81:0/3106036952 >> 172.21.15.81:0/3106036952 conn(0x7f762c08bfc0 msgr2=0x7f762c0b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.188+0000 7f76338af640 1 -- 172.21.15.81:0/3106036952 shutdown_connections 2024-09-16T01:23:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.188+0000 7f76338af640 1 -- 172.21.15.81:0/3106036952 wait complete. 2024-09-16T01:23:54.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_min_caps_working_set 2024-09-16T01:23:54.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.298+0000 7f672c3b9640 1 Processor -- start 2024-09-16T01:23:54.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.298+0000 7f672c3b9640 1 -- start start 2024-09-16T01:23:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.299+0000 7f672c3b9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6724162e30 0x7f672406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.299+0000 7f672c3b9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f672415ff70 con 0x7f67240cf280 2024-09-16T01:23:54.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.299+0000 7f672c3b9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67240d4d10 con 0x7f6724162340 2024-09-16T01:23:54.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.299+0000 7f672c3b9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f672406de90 con 0x7f6724162e30 2024-09-16T01:23:54.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.300+0000 7f6729954640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6724162e30 0x7f672406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.300+0000 7f6729954640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6724162e30 0x7f672406d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38634/0 (socket says 172.21.15.81:38634) 2024-09-16T01:23:54.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.300+0000 7f6729954640 1 -- 172.21.15.81:0/1579610742 learned_addr learned my addr 172.21.15.81:0/1579610742 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:54.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.300+0000 7f672a956640 1 --1- 172.21.15.81:0/1579610742 >> v1:172.21.15.81:6789/0 conn(0x7f67240cf280 0x7f67240d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53234/0 (socket says 172.21.15.81:53234) 2024-09-16T01:23:54.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.300+0000 7f6729954640 1 -- 172.21.15.81:0/1579610742 >> v1:172.21.15.102:6789/0 conn(0x7f6724162340 legacy=0x7f6724162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:54.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.300+0000 7f6729954640 1 -- 172.21.15.81:0/1579610742 >> v1:172.21.15.81:6789/0 conn(0x7f67240cf280 legacy=0x7f67240d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.300+0000 7f6729954640 1 -- 172.21.15.81:0/1579610742 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67240d4ff0 con 0x7f6724162e30 2024-09-16T01:23:54.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.300+0000 7f6729153640 1 -- 172.21.15.81:0/1579610742 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 462399591 0 0) 0x7f672415ff70 con 0x7f67240cf280 2024-09-16T01:23:54.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.301+0000 7f6729954640 1 --2- 172.21.15.81:0/1579610742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6724162e30 0x7f672406d740 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f6714009850 tx=0x7f671402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab18a1c10fe7417b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.301+0000 7f6729153640 1 -- 172.21.15.81:0/1579610742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714004030 con 0x7f6724162e30 2024-09-16T01:23:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.301+0000 7f6729153640 1 -- 172.21.15.81:0/1579610742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67140041d0 con 0x7f6724162e30 2024-09-16T01:23:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.301+0000 7f6729153640 1 -- 172.21.15.81:0/1579610742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714003610 con 0x7f6724162e30 2024-09-16T01:23:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.301+0000 7f672c3b9640 1 -- 172.21.15.81:0/1579610742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6724162e30 msgr2=0x7f672406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.301+0000 7f672c3b9640 1 --2- 172.21.15.81:0/1579610742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6724162e30 0x7f672406d740 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f6714009850 tx=0x7f671402a200 comp rx=0 tx=0).stop 2024-09-16T01:23:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.301+0000 7f672c3b9640 1 -- 172.21.15.81:0/1579610742 shutdown_connections 2024-09-16T01:23:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.301+0000 7f672c3b9640 1 --2- 172.21.15.81:0/1579610742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6724162e30 0x7f672406d740 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.301+0000 7f672c3b9640 1 -- 172.21.15.81:0/1579610742 >> 172.21.15.81:0/1579610742 conn(0x7f672408bfc0 msgr2=0x7f67240d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.301+0000 7f672c3b9640 1 -- 172.21.15.81:0/1579610742 shutdown_connections 2024-09-16T01:23:54.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.301+0000 7f672c3b9640 1 -- 172.21.15.81:0/1579610742 wait complete. 2024-09-16T01:23:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.302+0000 7f672c3b9640 1 Processor -- start 2024-09-16T01:23:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.303+0000 7f672c3b9640 1 -- start start 2024-09-16T01:23:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.303+0000 7f672c3b9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67240cf280 0x7f67241f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.303+0000 7f672c3b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6724162340 0x7f67240b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.303+0000 7f672c3b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6724162e30 0x7f67240cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.303+0000 7f672c3b9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67240cf6f0 con 0x7f6724162340 2024-09-16T01:23:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.303+0000 7f672c3b9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6724163270 con 0x7f6724162e30 2024-09-16T01:23:54.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.303+0000 7f672c3b9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f67240d52d0 con 0x7f67240cf280 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.303+0000 7f6729954640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6724162340 0x7f67240b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.303+0000 7f6729954640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6724162340 0x7f67240b42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38642/0 (socket says 172.21.15.81:38642) 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.303+0000 7f6729954640 1 -- 172.21.15.81:0/3927267244 learned_addr learned my addr 172.21.15.81:0/3927267244 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f672a956640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6724162e30 0x7f67240cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.303+0000 7f672a155640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67240cf280 0x7f67241f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f6729954640 1 -- 172.21.15.81:0/3927267244 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67240cf280 msgr2=0x7f67241f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f6729954640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67240cf280 0x7f67241f5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f6729954640 1 -- 172.21.15.81:0/3927267244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6724162e30 msgr2=0x7f67240cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f6729954640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6724162e30 0x7f67240cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f6729954640 1 -- 172.21.15.81:0/3927267244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67240b6ee0 con 0x7f6724162340 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f672a956640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6724162e30 0x7f67240cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f672a155640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67240cf280 0x7f67241f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:54.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f6729954640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6724162340 0x7f67240b42f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f671402a240 tx=0x7f67140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f671affd640 1 -- 172.21.15.81:0/3927267244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714042020 con 0x7f6724162340 2024-09-16T01:23:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f671affd640 1 -- 172.21.15.81:0/3927267244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6714003a20 con 0x7f6724162340 2024-09-16T01:23:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f672c3b9640 1 -- 172.21.15.81:0/3927267244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67240cc700 con 0x7f6724162340 2024-09-16T01:23:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f671affd640 1 -- 172.21.15.81:0/3927267244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714003e10 con 0x7f6724162340 2024-09-16T01:23:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.304+0000 7f672c3b9640 1 -- 172.21.15.81:0/3927267244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67240cccc0 con 0x7f6724162340 2024-09-16T01:23:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.305+0000 7f672c3b9640 1 -- 172.21.15.81:0/3927267244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f672406d740 con 0x7f6724162340 2024-09-16T01:23:54.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.306+0000 7f671affd640 1 -- 172.21.15.81:0/3927267244 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6714045020 con 0x7f6724162340 2024-09-16T01:23:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.306+0000 7f671affd640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f670806c2b0 0x7f670806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.306+0000 7f671affd640 1 -- 172.21.15.81:0/3927267244 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f67140abf80 con 0x7f6724162340 2024-09-16T01:23:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.306+0000 7f672a155640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f670806c2b0 0x7f670806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.306+0000 7f672a155640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f670806c2b0 0x7f670806e770 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6720003eb0 tx=0x7f6720009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.310+0000 7f671affd640 1 -- 172.21.15.81:0/3927267244 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f671404c030 con 0x7f6724162340 2024-09-16T01:23:54.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.483+0000 7f672c3b9640 1 -- 172.21.15.81:0/3927267244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"} v 0) -- 0x7f672408e640 con 0x7f6724162340 2024-09-16T01:23:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.486+0000 7f671affd640 1 -- 172.21.15.81:0/3927267244 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"}]=0 v65) ==== 107+0+0 (secure 0 0 0) 0x7f671407a860 con 0x7f6724162340 2024-09-16T01:23:54.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.488+0000 7f672c3b9640 1 -- 172.21.15.81:0/3927267244 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f670806c2b0 msgr2=0x7f670806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.488+0000 7f672c3b9640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f670806c2b0 0x7f670806e770 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6720003eb0 tx=0x7f6720009040 comp rx=0 tx=0).stop 2024-09-16T01:23:54.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.488+0000 7f672c3b9640 1 -- 172.21.15.81:0/3927267244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6724162340 msgr2=0x7f67240b42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.488+0000 7f672c3b9640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6724162340 0x7f67240b42f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f671402a240 tx=0x7f67140046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.488+0000 7f672c3b9640 1 -- 172.21.15.81:0/3927267244 shutdown_connections 2024-09-16T01:23:54.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.488+0000 7f672c3b9640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f670806c2b0 0x7f670806e770 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.488+0000 7f672c3b9640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6724162e30 0x7f67240cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.488+0000 7f672c3b9640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6724162340 0x7f67240b42f0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.488+0000 7f672c3b9640 1 --2- 172.21.15.81:0/3927267244 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f67240cf280 0x7f67241f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.488+0000 7f672c3b9640 1 -- 172.21.15.81:0/3927267244 >> 172.21.15.81:0/3927267244 conn(0x7f672408bfc0 msgr2=0x7f67240cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.488+0000 7f672c3b9640 1 -- 172.21.15.81:0/3927267244 shutdown_connections 2024-09-16T01:23:54.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.488+0000 7f672c3b9640 1 -- 172.21.15.81:0/3927267244 wait complete. 2024-09-16T01:23:54.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root' 2024-09-16T01:23:54.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.597+0000 7f26d69bd640 1 Processor -- start 2024-09-16T01:23:54.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.598+0000 7f26d69bd640 1 -- start start 2024-09-16T01:23:54.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.598+0000 7f26d69bd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26d0071750 0x7f26d00d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.598+0000 7f26d69bd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f26d00d0b20 0x7f26d01680c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.598+0000 7f26d69bd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26d00d12c0 con 0x7f26d009aca0 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.598+0000 7f26d69bd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f26d006d040 con 0x7f26d00d0b20 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.598+0000 7f26d69bd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f26d00d15a0 con 0x7f26d0071750 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.598+0000 7f26cffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f26d009aca0 0x7f26d009b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53242/0 (socket says 172.21.15.81:53242) 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.598+0000 7f26cffff640 1 -- 172.21.15.81:0/1445097461 learned_addr learned my addr 172.21.15.81:0/1445097461 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.598+0000 7f26d4f5a640 1 --2- 172.21.15.81:0/1445097461 >> v2:172.21.15.81:3300/0 conn(0x7f26d00d0b20 0x7f26d01680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.599+0000 7f26cf7fe640 1 --2- 172.21.15.81:0/1445097461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26d0071750 0x7f26d00d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.599+0000 7f26d4f5a640 1 -- 172.21.15.81:0/1445097461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26d0071750 msgr2=0x7f26d00d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.599+0000 7f26d4f5a640 1 --2- 172.21.15.81:0/1445097461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26d0071750 0x7f26d00d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.599+0000 7f26d4f5a640 1 -- 172.21.15.81:0/1445097461 >> v1:172.21.15.81:6789/0 conn(0x7f26d009aca0 legacy=0x7f26d009b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.599+0000 7f26d4f5a640 1 -- 172.21.15.81:0/1445097461 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d00d1880 con 0x7f26d00d0b20 2024-09-16T01:23:54.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.599+0000 7f26ceffd640 1 -- 172.21.15.81:0/1445097461 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4262304929 0 0) 0x7f26d00d12c0 con 0x7f26d009aca0 2024-09-16T01:23:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.599+0000 7f26d4f5a640 1 --2- 172.21.15.81:0/1445097461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26d00d0b20 0x7f26d01680c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009d90 tx=0x7f26c802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ed930054e9ace server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.600+0000 7f26ceffd640 1 -- 172.21.15.81:0/1445097461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8007740 con 0x7f26d00d0b20 2024-09-16T01:23:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.600+0000 7f26ceffd640 1 -- 172.21.15.81:0/1445097461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c80078e0 con 0x7f26d00d0b20 2024-09-16T01:23:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.600+0000 7f26ceffd640 1 -- 172.21.15.81:0/1445097461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c8007cb0 con 0x7f26d00d0b20 2024-09-16T01:23:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.600+0000 7f26d69bd640 1 -- 172.21.15.81:0/1445097461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26d00d0b20 msgr2=0x7f26d01680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.600+0000 7f26d69bd640 1 --2- 172.21.15.81:0/1445097461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26d00d0b20 0x7f26d01680c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009d90 tx=0x7f26c802a660 comp rx=0 tx=0).stop 2024-09-16T01:23:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.600+0000 7f26d69bd640 1 -- 172.21.15.81:0/1445097461 shutdown_connections 2024-09-16T01:23:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.600+0000 7f26d69bd640 1 --2- 172.21.15.81:0/1445097461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26d00d0b20 0x7f26d01680c0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.600+0000 7f26d69bd640 1 --2- 172.21.15.81:0/1445097461 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26d0071750 0x7f26d00d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.600+0000 7f26d69bd640 1 -- 172.21.15.81:0/1445097461 >> 172.21.15.81:0/1445097461 conn(0x7f26d00d23a0 msgr2=0x7f26d00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.600+0000 7f26d69bd640 1 -- 172.21.15.81:0/1445097461 shutdown_connections 2024-09-16T01:23:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.600+0000 7f26d69bd640 1 -- 172.21.15.81:0/1445097461 wait complete. 2024-09-16T01:23:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.601+0000 7f26d69bd640 1 Processor -- start 2024-09-16T01:23:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.602+0000 7f26d69bd640 1 -- start start 2024-09-16T01:23:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.602+0000 7f26d69bd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26d0071750 0x7f26d0159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.602+0000 7f26d69bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26d009aca0 0x7f26d00b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.602+0000 7f26d69bd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26d00d0b20 0x7f26d00b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.602+0000 7f26d69bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f26d00d0fb0 con 0x7f26d009aca0 2024-09-16T01:23:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.602+0000 7f26d69bd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f26d0070220 con 0x7f26d0071750 2024-09-16T01:23:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.602+0000 7f26d69bd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f26d009b790 con 0x7f26d00d0b20 2024-09-16T01:23:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.602+0000 7f26cf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26d009aca0 0x7f26d00b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.602+0000 7f26cf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26d009aca0 0x7f26d00b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38660/0 (socket says 172.21.15.81:38660) 2024-09-16T01:23:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.602+0000 7f26cf7fe640 1 -- 172.21.15.81:0/618581874 learned_addr learned my addr 172.21.15.81:0/618581874 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.603+0000 7f26cf7fe640 1 -- 172.21.15.81:0/618581874 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26d00d0b20 msgr2=0x7f26d00b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.603+0000 7f26cf7fe640 1 --2- 172.21.15.81:0/618581874 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26d00d0b20 0x7f26d00b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.603+0000 7f26cf7fe640 1 -- 172.21.15.81:0/618581874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26d0071750 msgr2=0x7f26d0159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.603+0000 7f26cf7fe640 1 --2- 172.21.15.81:0/618581874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26d0071750 0x7f26d0159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.603+0000 7f26cf7fe640 1 -- 172.21.15.81:0/618581874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d00b3340 con 0x7f26d009aca0 2024-09-16T01:23:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.603+0000 7f26cf7fe640 1 --2- 172.21.15.81:0/618581874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26d009aca0 0x7f26d00b2670 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f26c400d800 tx=0x7f26c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.603+0000 7f26ccff9640 1 -- 172.21.15.81:0/618581874 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c400b6c0 con 0x7f26d009aca0 2024-09-16T01:23:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.603+0000 7f26ccff9640 1 -- 172.21.15.81:0/618581874 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26c4019070 con 0x7f26d009aca0 2024-09-16T01:23:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.603+0000 7f26ccff9640 1 -- 172.21.15.81:0/618581874 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26c400ba80 con 0x7f26d009aca0 2024-09-16T01:23:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.603+0000 7f26d69bd640 1 -- 172.21.15.81:0/618581874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d00b3620 con 0x7f26d009aca0 2024-09-16T01:23:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.603+0000 7f26d69bd640 1 -- 172.21.15.81:0/618581874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d00ca730 con 0x7f26d009aca0 2024-09-16T01:23:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.604+0000 7f26d69bd640 1 -- 172.21.15.81:0/618581874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d00d05e0 con 0x7f26d009aca0 2024-09-16T01:23:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.605+0000 7f26ccff9640 1 -- 172.21.15.81:0/618581874 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f26c400bc20 con 0x7f26d009aca0 2024-09-16T01:23:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.605+0000 7f26ccff9640 1 --2- 172.21.15.81:0/618581874 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f26bc06c2b0 0x7f26bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.605+0000 7f26ccff9640 1 -- 172.21.15.81:0/618581874 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f26c408b6a0 con 0x7f26d009aca0 2024-09-16T01:23:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.605+0000 7f26cffff640 1 --2- 172.21.15.81:0/618581874 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f26bc06c2b0 0x7f26bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.605+0000 7f26cffff640 1 --2- 172.21.15.81:0/618581874 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f26bc06c2b0 0x7f26bc06e770 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f26c0007fd0 tx=0x7f26c0007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.609+0000 7f26ccff9640 1 -- 172.21.15.81:0/618581874 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26c405a010 con 0x7f26d009aca0 2024-09-16T01:23:54.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:54.838+0000 7f26d69bd640 1 -- 172.21.15.81:0/618581874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]} v 0) -- 0x7f26d01598e0 con 0x7f26d009aca0 2024-09-16T01:23:55.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.003+0000 7f26ccff9640 1 -- 172.21.15.81:0/618581874 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]}]=0 v419) ==== 148+0+0 (secure 0 0 0) 0x7f26c4059910 con 0x7f26d009aca0 2024-09-16T01:23:55.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.005+0000 7f26d69bd640 1 -- 172.21.15.81:0/618581874 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f26bc06c2b0 msgr2=0x7f26bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.005+0000 7f26d69bd640 1 --2- 172.21.15.81:0/618581874 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f26bc06c2b0 0x7f26bc06e770 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f26c0007fd0 tx=0x7f26c0007920 comp rx=0 tx=0).stop 2024-09-16T01:23:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.005+0000 7f26d69bd640 1 -- 172.21.15.81:0/618581874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26d009aca0 msgr2=0x7f26d00b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.005+0000 7f26d69bd640 1 --2- 172.21.15.81:0/618581874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26d009aca0 0x7f26d00b2670 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f26c400d800 tx=0x7f26c400dcc0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.006+0000 7f26d69bd640 1 -- 172.21.15.81:0/618581874 shutdown_connections 2024-09-16T01:23:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.006+0000 7f26d69bd640 1 --2- 172.21.15.81:0/618581874 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f26bc06c2b0 0x7f26bc06e770 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.006+0000 7f26d69bd640 1 --2- 172.21.15.81:0/618581874 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f26d00d0b20 0x7f26d00b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.006+0000 7f26d69bd640 1 --2- 172.21.15.81:0/618581874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26d009aca0 0x7f26d00b2670 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.006+0000 7f26d69bd640 1 --2- 172.21.15.81:0/618581874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26d0071750 0x7f26d0159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.006+0000 7f26d69bd640 1 -- 172.21.15.81:0/618581874 >> 172.21.15.81:0/618581874 conn(0x7f26d00d23a0 msgr2=0x7f26d006d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.006+0000 7f26d69bd640 1 -- 172.21.15.81:0/618581874 shutdown_connections 2024-09-16T01:23:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.006+0000 7f26d69bd640 1 -- 172.21.15.81:0/618581874 wait complete. 2024-09-16T01:23:55.019 INFO:tasks.cephfs_test_runner:test_client_pin_root (tasks.cephfs.test_client_limits.TestClientLimits) ... ok 2024-09-16T01:23:55.019 INFO:tasks.cephfs_test_runner:Starting test: test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits) When a client has a bug (which we will simulate) preventing it from releasing caps, 2024-09-16T01:23:55.019 INFO:tasks.cephfs_test_runner:test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-16T01:23:55.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:23:55.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.117+0000 7fe5721be640 1 Processor -- start 2024-09-16T01:23:55.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.117+0000 7fe5721be640 1 -- start start 2024-09-16T01:23:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.117+0000 7fe5721be640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe56c0b69d0 0x7fe56c162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.117+0000 7fe5721be640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe56c0af280 0x7fe56c0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.117+0000 7fe5721be640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe56c15eb60 con 0x7fe56c0affb0 2024-09-16T01:23:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.117+0000 7fe5721be640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe56c0b0400 con 0x7fe56c0b69d0 2024-09-16T01:23:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.117+0000 7fe5721be640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe56c0b6db0 con 0x7fe56c0af280 2024-09-16T01:23:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.118+0000 7fe56b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe56c0b69d0 0x7fe56c162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.118+0000 7fe56b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe56c0b69d0 0x7fe56c162a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38662/0 (socket says 172.21.15.81:38662) 2024-09-16T01:23:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.118+0000 7fe56b7fe640 1 -- 172.21.15.81:0/1662536412 learned_addr learned my addr 172.21.15.81:0/1662536412 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.118+0000 7fe56b7fe640 1 -- 172.21.15.81:0/1662536412 >> v2:172.21.15.102:3300/0 conn(0x7fe56c0af280 msgr2=0x7fe56c0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.118+0000 7fe56b7fe640 1 --2- 172.21.15.81:0/1662536412 >> v2:172.21.15.102:3300/0 conn(0x7fe56c0af280 0x7fe56c0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.118+0000 7fe56b7fe640 1 -- 172.21.15.81:0/1662536412 >> v1:172.21.15.102:6789/0 conn(0x7fe56c0affb0 legacy=0x7fe56c154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.118+0000 7fe56b7fe640 1 -- 172.21.15.81:0/1662536412 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c15ee40 con 0x7fe56c0b69d0 2024-09-16T01:23:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.119+0000 7fe56b7fe640 1 --2- 172.21.15.81:0/1662536412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe56c0b69d0 0x7fe56c162a50 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fe56c067bf0 tx=0x7fe55c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08a6e249e63ea73 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.119+0000 7fe56affd640 1 -- 172.21.15.81:0/1662536412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c037070 con 0x7fe56c0b69d0 2024-09-16T01:23:55.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.119+0000 7fe56affd640 1 -- 172.21.15.81:0/1662536412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55c02ae20 con 0x7fe56c0b69d0 2024-09-16T01:23:55.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.119+0000 7fe56affd640 1 -- 172.21.15.81:0/1662536412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c032660 con 0x7fe56c0b69d0 2024-09-16T01:23:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.119+0000 7fe5721be640 1 -- 172.21.15.81:0/1662536412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe56c0b69d0 msgr2=0x7fe56c162a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.119+0000 7fe5721be640 1 --2- 172.21.15.81:0/1662536412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe56c0b69d0 0x7fe56c162a50 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fe56c067bf0 tx=0x7fe55c02a110 comp rx=0 tx=0).stop 2024-09-16T01:23:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.119+0000 7fe5721be640 1 -- 172.21.15.81:0/1662536412 shutdown_connections 2024-09-16T01:23:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.119+0000 7fe5721be640 1 --2- 172.21.15.81:0/1662536412 >> v2:172.21.15.102:3300/0 conn(0x7fe56c0af280 0x7fe56c0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.119+0000 7fe5721be640 1 --2- 172.21.15.81:0/1662536412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe56c0b69d0 0x7fe56c162a50 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.119+0000 7fe5721be640 1 -- 172.21.15.81:0/1662536412 >> 172.21.15.81:0/1662536412 conn(0x7fe56c06bc10 msgr2=0x7fe56c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:55.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.119+0000 7fe5721be640 1 -- 172.21.15.81:0/1662536412 shutdown_connections 2024-09-16T01:23:55.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.119+0000 7fe5721be640 1 -- 172.21.15.81:0/1662536412 wait complete. 2024-09-16T01:23:55.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.120+0000 7fe5721be640 1 Processor -- start 2024-09-16T01:23:55.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.121+0000 7fe5721be640 1 -- start start 2024-09-16T01:23:55.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.121+0000 7fe5721be640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe56c0af280 0x7fe56c153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.121+0000 7fe5721be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe56c0affb0 0x7fe56c0cd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.121+0000 7fe5721be640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe56c0b69d0 0x7fe56c0cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.121+0000 7fe5721be640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c0af710 con 0x7fe56c0affb0 2024-09-16T01:23:55.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.121+0000 7fe5721be640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c15f400 con 0x7fe56c0b69d0 2024-09-16T01:23:55.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.121+0000 7fe5721be640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe56c155410 con 0x7fe56c0af280 2024-09-16T01:23:55.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.121+0000 7fe563fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe56c0affb0 0x7fe56c0cd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.121+0000 7fe563fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe56c0affb0 0x7fe56c0cd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38674/0 (socket says 172.21.15.81:38674) 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.121+0000 7fe563fff640 1 -- 172.21.15.81:0/3161542386 learned_addr learned my addr 172.21.15.81:0/3161542386 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.121+0000 7fe56bfff640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe56c0b69d0 0x7fe56c0cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe56b7fe640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe56c0af280 0x7fe56c153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe563fff640 1 -- 172.21.15.81:0/3161542386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe56c0af280 msgr2=0x7fe56c153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe563fff640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe56c0af280 0x7fe56c153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe563fff640 1 -- 172.21.15.81:0/3161542386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe56c0b69d0 msgr2=0x7fe56c0cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe563fff640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe56c0b69d0 0x7fe56c0cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe563fff640 1 -- 172.21.15.81:0/3161542386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c0ce1c0 con 0x7fe56c0affb0 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe56b7fe640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe56c0af280 0x7fe56c153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe563fff640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe56c0affb0 0x7fe56c0cd650 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fe55400b4a0 tx=0x7fe55400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe568ff9640 1 -- 172.21.15.81:0/3161542386 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554014070 con 0x7fe56c0affb0 2024-09-16T01:23:55.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe568ff9640 1 -- 172.21.15.81:0/3161542386 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe554010610 con 0x7fe56c0affb0 2024-09-16T01:23:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe5721be640 1 -- 172.21.15.81:0/3161542386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe56c0ce4a0 con 0x7fe56c0affb0 2024-09-16T01:23:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe568ff9640 1 -- 172.21.15.81:0/3161542386 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554010a00 con 0x7fe56c0affb0 2024-09-16T01:23:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.122+0000 7fe5721be640 1 -- 172.21.15.81:0/3161542386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe56c0cea60 con 0x7fe56c0affb0 2024-09-16T01:23:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.123+0000 7fe5721be640 1 -- 172.21.15.81:0/3161542386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe56c068f80 con 0x7fe56c0affb0 2024-09-16T01:23:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.123+0000 7fe568ff9640 1 -- 172.21.15.81:0/3161542386 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe554017070 con 0x7fe56c0affb0 2024-09-16T01:23:55.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.124+0000 7fe568ff9640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe54c06c2b0 0x7fe54c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.124+0000 7fe568ff9640 1 -- 172.21.15.81:0/3161542386 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7fe55408ac00 con 0x7fe56c0affb0 2024-09-16T01:23:55.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.124+0000 7fe56b7fe640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe54c06c2b0 0x7fe54c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.124+0000 7fe56b7fe640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe54c06c2b0 0x7fe54c06e770 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe55c034000 tx=0x7fe55c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:55.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.128+0000 7fe568ff9640 1 -- 172.21.15.81:0/3161542386 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe56c068f80 con 0x7fe56c0affb0 2024-09-16T01:23:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.295+0000 7fe5721be640 1 -- 172.21.15.81:0/3161542386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe56c1557a0 con 0x7fe56c0affb0 2024-09-16T01:23:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.296+0000 7fe568ff9640 1 -- 172.21.15.81:0/3161542386 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+13315 (secure 0 0 0) 0x7fe554091080 con 0x7fe56c0affb0 2024-09-16T01:23:55.297 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:55.298 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":140,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:23:52.991669+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6836/1395000865":"2024-09-17T01:23:49.725706+0000","172.21.15.81:6834/1395000865":"2024-09-17T01:23:49.725706+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:23:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.298+0000 7fe5721be640 1 -- 172.21.15.81:0/3161542386 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe54c06c2b0 msgr2=0x7fe54c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.298+0000 7fe5721be640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe54c06c2b0 0x7fe54c06e770 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe55c034000 tx=0x7fe55c02e000 comp rx=0 tx=0).stop 2024-09-16T01:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.298+0000 7fe5721be640 1 -- 172.21.15.81:0/3161542386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe56c0affb0 msgr2=0x7fe56c0cd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.298+0000 7fe5721be640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe56c0affb0 0x7fe56c0cd650 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fe55400b4a0 tx=0x7fe55400b960 comp rx=0 tx=0).stop 2024-09-16T01:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.298+0000 7fe5721be640 1 -- 172.21.15.81:0/3161542386 shutdown_connections 2024-09-16T01:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.298+0000 7fe5721be640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe54c06c2b0 0x7fe54c06e770 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.298+0000 7fe5721be640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe56c0b69d0 0x7fe56c0cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.298+0000 7fe5721be640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe56c0affb0 0x7fe56c0cd650 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.298+0000 7fe5721be640 1 --2- 172.21.15.81:0/3161542386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe56c0af280 0x7fe56c153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.298+0000 7fe5721be640 1 -- 172.21.15.81:0/3161542386 >> 172.21.15.81:0/3161542386 conn(0x7fe56c06bc10 msgr2=0x7fe56c06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.298+0000 7fe5721be640 1 -- 172.21.15.81:0/3161542386 shutdown_connections 2024-09-16T01:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.298+0000 7fe5721be640 1 -- 172.21.15.81:0/3161542386 wait complete. 2024-09-16T01:23:55.311 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T01:15:28.088452+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T01:23:55.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-16T01:23:55.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.410+0000 7f0c9cc8d640 1 Processor -- start 2024-09-16T01:23:55.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.410+0000 7f0c9cc8d640 1 -- start start 2024-09-16T01:23:55.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.410+0000 7f0c9cc8d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0c98161a20 0x7f0c980d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.410+0000 7f0c9cc8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c980d1420 0x7f0c980cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.410+0000 7f0c9cc8d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c980cf160 0x7f0c980b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.410+0000 7f0c9cc8d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0c98161e00 con 0x7f0c980cf160 2024-09-16T01:23:55.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.410+0000 7f0c9cc8d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0c980d1830 con 0x7f0c98161a20 2024-09-16T01:23:55.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.410+0000 7f0c9cc8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0c980cf980 con 0x7f0c980d1420 2024-09-16T01:23:55.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.411+0000 7f0c96d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c980cf160 0x7f0c980b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.411+0000 7f0c96d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c980cf160 0x7f0c980b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38684/0 (socket says 172.21.15.81:38684) 2024-09-16T01:23:55.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.411+0000 7f0c96d9d640 1 -- 172.21.15.81:0/1187505692 learned_addr learned my addr 172.21.15.81:0/1187505692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:55.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.411+0000 7f0c96d9d640 1 -- 172.21.15.81:0/1187505692 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c980d1420 msgr2=0x7f0c980cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:55.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.411+0000 7f0c96d9d640 1 --2- 172.21.15.81:0/1187505692 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c980d1420 0x7f0c980cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.411+0000 7f0c96d9d640 1 -- 172.21.15.81:0/1187505692 >> v2:172.21.15.102:3300/0 conn(0x7f0c98161a20 msgr2=0x7f0c980d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:55.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.411+0000 7f0c9659c640 1 --2- 172.21.15.81:0/1187505692 >> v2:172.21.15.102:3300/0 conn(0x7f0c98161a20 0x7f0c980d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.411+0000 7f0c96d9d640 1 --2- 172.21.15.81:0/1187505692 >> v2:172.21.15.102:3300/0 conn(0x7f0c98161a20 0x7f0c980d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.411+0000 7f0c96d9d640 1 -- 172.21.15.81:0/1187505692 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9806d050 con 0x7f0c980cf160 2024-09-16T01:23:55.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.411+0000 7f0c9659c640 1 --2- 172.21.15.81:0/1187505692 >> v2:172.21.15.102:3300/0 conn(0x7f0c98161a20 0x7f0c980d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:55.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.412+0000 7f0c96d9d640 1 --2- 172.21.15.81:0/1187505692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c980cf160 0x7f0c980b5f50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f0c9808c910 tx=0x7f0c9002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d7e107348f3f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:55.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.412+0000 7f0c95d9b640 1 -- 172.21.15.81:0/1187505692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90036070 con 0x7f0c980cf160 2024-09-16T01:23:55.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.412+0000 7f0c95d9b640 1 -- 172.21.15.81:0/1187505692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c90031600 con 0x7f0c980cf160 2024-09-16T01:23:55.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.412+0000 7f0c95d9b640 1 -- 172.21.15.81:0/1187505692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c900319d0 con 0x7f0c980cf160 2024-09-16T01:23:55.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.412+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/1187505692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c980cf160 msgr2=0x7f0c980b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.412+0000 7f0c9cc8d640 1 --2- 172.21.15.81:0/1187505692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c980cf160 0x7f0c980b5f50 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f0c9808c910 tx=0x7f0c9002a6a0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.412+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/1187505692 shutdown_connections 2024-09-16T01:23:55.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.412+0000 7f0c9cc8d640 1 --2- 172.21.15.81:0/1187505692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c980cf160 0x7f0c980b5f50 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.412+0000 7f0c9cc8d640 1 --2- 172.21.15.81:0/1187505692 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c980d1420 0x7f0c980cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.412+0000 7f0c9cc8d640 1 --2- 172.21.15.81:0/1187505692 >> v2:172.21.15.102:3300/0 conn(0x7f0c98161a20 0x7f0c980d0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.412+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/1187505692 >> 172.21.15.81:0/1187505692 conn(0x7f0c9809d850 msgr2=0x7f0c9808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:55.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.412+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/1187505692 shutdown_connections 2024-09-16T01:23:55.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.413+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/1187505692 wait complete. 2024-09-16T01:23:55.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.414+0000 7f0c9cc8d640 1 Processor -- start 2024-09-16T01:23:55.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.414+0000 7f0c9cc8d640 1 -- start start 2024-09-16T01:23:55.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c9cc8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c980cf160 0x7f0c9815c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c9cc8d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c980d1420 0x7f0c980b8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c9cc8d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c98161a20 0x7f0c98159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c9cc8d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9806d2f0 con 0x7f0c980d1420 2024-09-16T01:23:55.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c9cc8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0c980cff00 con 0x7f0c980cf160 2024-09-16T01:23:55.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c9cc8d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0c980b1040 con 0x7f0c98161a20 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c980d1420 0x7f0c980b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c980d1420 0x7f0c980b8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38696/0 (socket says 172.21.15.81:38696) 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c8ffff640 1 -- 172.21.15.81:0/4021231488 learned_addr learned my addr 172.21.15.81:0/4021231488 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c9659c640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c980cf160 0x7f0c9815c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c96d9d640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c98161a20 0x7f0c98159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c8ffff640 1 -- 172.21.15.81:0/4021231488 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c98161a20 msgr2=0x7f0c98159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c8ffff640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c98161a20 0x7f0c98159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c8ffff640 1 -- 172.21.15.81:0/4021231488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c980cf160 msgr2=0x7f0c9815c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c8ffff640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c980cf160 0x7f0c9815c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c8ffff640 1 -- 172.21.15.81:0/4021231488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c980b9340 con 0x7f0c980d1420 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c8ffff640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c980d1420 0x7f0c980b8910 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000b4d0 tx=0x7f0c8000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c8effd640 1 -- 172.21.15.81:0/4021231488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c80014070 con 0x7f0c980d1420 2024-09-16T01:23:55.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c8effd640 1 -- 172.21.15.81:0/4021231488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c80010870 con 0x7f0c980d1420 2024-09-16T01:23:55.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/4021231488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c980b9620 con 0x7f0c980d1420 2024-09-16T01:23:55.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c8effd640 1 -- 172.21.15.81:0/4021231488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c80010c60 con 0x7f0c980d1420 2024-09-16T01:23:55.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.415+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/4021231488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c980b9be0 con 0x7f0c980d1420 2024-09-16T01:23:55.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.417+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/4021231488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c980cf5f0 con 0x7f0c980d1420 2024-09-16T01:23:55.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.417+0000 7f0c8effd640 1 -- 172.21.15.81:0/4021231488 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0c80017070 con 0x7f0c980d1420 2024-09-16T01:23:55.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.417+0000 7f0c8effd640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c7806c2b0 0x7f0c7806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.417+0000 7f0c8effd640 1 -- 172.21.15.81:0/4021231488 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f0c8008b100 con 0x7f0c980d1420 2024-09-16T01:23:55.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.417+0000 7f0c9659c640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c7806c2b0 0x7f0c7806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.418+0000 7f0c9659c640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c7806c2b0 0x7f0c7806e770 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800aac0 tx=0x7f0c88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:55.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.422+0000 7f0c8effd640 1 -- 172.21.15.81:0/4021231488 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c80059300 con 0x7f0c980d1420 2024-09-16T01:23:55.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.586+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/4021231488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0c9808c160 con 0x7f0c980d1420 2024-09-16T01:23:55.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.587+0000 7f0c8effd640 1 -- 172.21.15.81:0/4021231488 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v140) ==== 93+0+10 (secure 0 0 0) 0x7f0c8005d600 con 0x7f0c980d1420 2024-09-16T01:23:55.589 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-16T01:23:55.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.589+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/4021231488 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c7806c2b0 msgr2=0x7f0c7806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.589+0000 7f0c9cc8d640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c7806c2b0 0x7f0c7806e770 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800aac0 tx=0x7f0c88008040 comp rx=0 tx=0).stop 2024-09-16T01:23:55.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.589+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/4021231488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c980d1420 msgr2=0x7f0c980b8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.589+0000 7f0c9cc8d640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c980d1420 0x7f0c980b8910 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000b4d0 tx=0x7f0c8000b990 comp rx=0 tx=0).stop 2024-09-16T01:23:55.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.589+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/4021231488 shutdown_connections 2024-09-16T01:23:55.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.589+0000 7f0c9cc8d640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0c7806c2b0 0x7f0c7806e770 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.589+0000 7f0c9cc8d640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c98161a20 0x7f0c98159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.589+0000 7f0c9cc8d640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c980d1420 0x7f0c980b8910 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.589+0000 7f0c9cc8d640 1 --2- 172.21.15.81:0/4021231488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c980cf160 0x7f0c9815c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.589+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/4021231488 >> 172.21.15.81:0/4021231488 conn(0x7f0c9809d850 msgr2=0x7f0c9815d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.589+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/4021231488 shutdown_connections 2024-09-16T01:23:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.589+0000 7f0c9cc8d640 1 -- 172.21.15.81:0/4021231488 wait complete. 2024-09-16T01:23:55.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug' 2024-09-16T01:23:55.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.698+0000 7f9c576ac640 1 Processor -- start 2024-09-16T01:23:55.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.698+0000 7f9c576ac640 1 -- start start 2024-09-16T01:23:55.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.699+0000 7f9c576ac640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c50162240 0x7f9c500b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.699+0000 7f9c576ac640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9c5006fb00 0x7f9c500ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.699+0000 7f9c576ac640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c500cdb00 con 0x7f9c50073420 2024-09-16T01:23:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.699+0000 7f9c576ac640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9c50073870 con 0x7f9c50162240 2024-09-16T01:23:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.699+0000 7f9c576ac640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9c500cde30 con 0x7f9c5006fb00 2024-09-16T01:23:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.699+0000 7f9c55448640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c50162240 0x7f9c500b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.699+0000 7f9c55448640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c50162240 0x7f9c500b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38704/0 (socket says 172.21.15.81:38704) 2024-09-16T01:23:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.699+0000 7f9c55448640 1 -- 172.21.15.81:0/1934249388 learned_addr learned my addr 172.21.15.81:0/1934249388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.699+0000 7f9c54c47640 1 --1- 172.21.15.81:0/1934249388 >> v1:172.21.15.81:6789/0 conn(0x7f9c50073420 0x7f9c50162620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53246/0 (socket says 172.21.15.81:53246) 2024-09-16T01:23:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.700+0000 7f9c55c49640 1 --2- 172.21.15.81:0/1934249388 >> v2:172.21.15.102:3300/0 conn(0x7f9c5006fb00 0x7f9c500ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.700+0000 7f9c55448640 1 -- 172.21.15.81:0/1934249388 >> v2:172.21.15.102:3300/0 conn(0x7f9c5006fb00 msgr2=0x7f9c500ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.700+0000 7f9c55448640 1 --2- 172.21.15.81:0/1934249388 >> v2:172.21.15.102:3300/0 conn(0x7f9c5006fb00 0x7f9c500ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.700+0000 7f9c55448640 1 -- 172.21.15.81:0/1934249388 >> v1:172.21.15.81:6789/0 conn(0x7f9c50073420 legacy=0x7f9c50162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.700+0000 7f9c47fff640 1 -- 172.21.15.81:0/1934249388 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 643234683 0 0) 0x7f9c500cdb00 con 0x7f9c50073420 2024-09-16T01:23:55.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.700+0000 7f9c55448640 1 -- 172.21.15.81:0/1934249388 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5006c7c0 con 0x7f9c50162240 2024-09-16T01:23:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.700+0000 7f9c55448640 1 --2- 172.21.15.81:0/1934249388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c50162240 0x7f9c500b3810 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f9c50071720 tx=0x7f9c4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a7853583993ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.701+0000 7f9c47fff640 1 -- 172.21.15.81:0/1934249388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c037070 con 0x7f9c50162240 2024-09-16T01:23:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.701+0000 7f9c47fff640 1 -- 172.21.15.81:0/1934249388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4c032440 con 0x7f9c50162240 2024-09-16T01:23:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.701+0000 7f9c47fff640 1 -- 172.21.15.81:0/1934249388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c032810 con 0x7f9c50162240 2024-09-16T01:23:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.701+0000 7f9c576ac640 1 -- 172.21.15.81:0/1934249388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c50162240 msgr2=0x7f9c500b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.701+0000 7f9c576ac640 1 --2- 172.21.15.81:0/1934249388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c50162240 0x7f9c500b3810 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f9c50071720 tx=0x7f9c4c02a270 comp rx=0 tx=0).stop 2024-09-16T01:23:55.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.701+0000 7f9c576ac640 1 -- 172.21.15.81:0/1934249388 shutdown_connections 2024-09-16T01:23:55.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.701+0000 7f9c576ac640 1 --2- 172.21.15.81:0/1934249388 >> v2:172.21.15.102:3300/0 conn(0x7f9c5006fb00 0x7f9c500ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.701+0000 7f9c576ac640 1 --2- 172.21.15.81:0/1934249388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c50162240 0x7f9c500b3810 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.701+0000 7f9c576ac640 1 -- 172.21.15.81:0/1934249388 >> 172.21.15.81:0/1934249388 conn(0x7f9c500b68a0 msgr2=0x7f9c500b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:55.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.701+0000 7f9c576ac640 1 -- 172.21.15.81:0/1934249388 shutdown_connections 2024-09-16T01:23:55.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.701+0000 7f9c576ac640 1 -- 172.21.15.81:0/1934249388 wait complete. 2024-09-16T01:23:55.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.702+0000 7f9c576ac640 1 Processor -- start 2024-09-16T01:23:55.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.702+0000 7f9c576ac640 1 -- start start 2024-09-16T01:23:55.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c576ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5006fb00 0x7f9c5015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c576ac640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c50073420 0x7f9c50153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c576ac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c50162240 0x7f9c500b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c576ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5015f9a0 con 0x7f9c5006fb00 2024-09-16T01:23:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c576ac640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5006caa0 con 0x7f9c50162240 2024-09-16T01:23:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c576ac640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9c5015fb20 con 0x7f9c50073420 2024-09-16T01:23:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c55448640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5006fb00 0x7f9c5015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c55448640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5006fb00 0x7f9c5015b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38708/0 (socket says 172.21.15.81:38708) 2024-09-16T01:23:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c55448640 1 -- 172.21.15.81:0/1628801656 learned_addr learned my addr 172.21.15.81:0/1628801656 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c55448640 1 -- 172.21.15.81:0/1628801656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c50073420 msgr2=0x7f9c50153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c55448640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c50073420 0x7f9c50153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c55c49640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c50162240 0x7f9c500b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c55448640 1 -- 172.21.15.81:0/1628801656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c50162240 msgr2=0x7f9c500b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c55448640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c50162240 0x7f9c500b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c55448640 1 -- 172.21.15.81:0/1628801656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c500cb480 con 0x7f9c5006fb00 2024-09-16T01:23:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.703+0000 7f9c55c49640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c50162240 0x7f9c500b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:23:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.704+0000 7f9c55448640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5006fb00 0x7f9c5015b5e0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0090b0 tx=0x7f9c4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.704+0000 7f9c45ffb640 1 -- 172.21.15.81:0/1628801656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c037040 con 0x7f9c5006fb00 2024-09-16T01:23:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.704+0000 7f9c45ffb640 1 -- 172.21.15.81:0/1628801656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4c004030 con 0x7f9c5006fb00 2024-09-16T01:23:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.704+0000 7f9c576ac640 1 -- 172.21.15.81:0/1628801656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c501f48a0 con 0x7f9c5006fb00 2024-09-16T01:23:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.704+0000 7f9c45ffb640 1 -- 172.21.15.81:0/1628801656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c004400 con 0x7f9c5006fb00 2024-09-16T01:23:55.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.704+0000 7f9c576ac640 1 -- 172.21.15.81:0/1628801656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c501f4e60 con 0x7f9c5006fb00 2024-09-16T01:23:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.705+0000 7f9c576ac640 1 -- 172.21.15.81:0/1628801656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c500706f0 con 0x7f9c5006fb00 2024-09-16T01:23:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.706+0000 7f9c45ffb640 1 -- 172.21.15.81:0/1628801656 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9c4c03a070 con 0x7f9c5006fb00 2024-09-16T01:23:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.706+0000 7f9c45ffb640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9c3406c2b0 0x7f9c3406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.706+0000 7f9c45ffb640 1 -- 172.21.15.81:0/1628801656 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f9c4c0ab910 con 0x7f9c5006fb00 2024-09-16T01:23:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.706+0000 7f9c54c47640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9c3406c2b0 0x7f9c3406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.706+0000 7f9c54c47640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9c3406c2b0 0x7f9c3406e770 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9c40007fd0 tx=0x7f9c40007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:55.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.711+0000 7f9c45ffb640 1 -- 172.21.15.81:0/1628801656 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c500cb480 con 0x7f9c5006fb00 2024-09-16T01:23:55.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:55.940+0000 7f9c576ac640 1 -- 172.21.15.81:0/1628801656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]} v 0) -- 0x7f9c50073af0 con 0x7f9c5006fb00 2024-09-16T01:23:56.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.005+0000 7f9c45ffb640 1 -- 172.21.15.81:0/1628801656 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]}]=0 v420) ==== 154+0+0 (secure 0 0 0) 0x7f9c4c041020 con 0x7f9c5006fb00 2024-09-16T01:23:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.007+0000 7f9c576ac640 1 -- 172.21.15.81:0/1628801656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9c3406c2b0 msgr2=0x7f9c3406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.007+0000 7f9c576ac640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9c3406c2b0 0x7f9c3406e770 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f9c40007fd0 tx=0x7f9c40007900 comp rx=0 tx=0).stop 2024-09-16T01:23:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.007+0000 7f9c576ac640 1 -- 172.21.15.81:0/1628801656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5006fb00 msgr2=0x7f9c5015b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.007+0000 7f9c576ac640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5006fb00 0x7f9c5015b5e0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0090b0 tx=0x7f9c4c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.007+0000 7f9c576ac640 1 -- 172.21.15.81:0/1628801656 shutdown_connections 2024-09-16T01:23:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.007+0000 7f9c576ac640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9c3406c2b0 0x7f9c3406e770 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.007+0000 7f9c576ac640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c50162240 0x7f9c500b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.007+0000 7f9c576ac640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c50073420 0x7f9c50153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.007+0000 7f9c576ac640 1 --2- 172.21.15.81:0/1628801656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5006fb00 0x7f9c5015b5e0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.007+0000 7f9c576ac640 1 -- 172.21.15.81:0/1628801656 >> 172.21.15.81:0/1628801656 conn(0x7f9c500b68a0 msgr2=0x7f9c500aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.007+0000 7f9c576ac640 1 -- 172.21.15.81:0/1628801656 shutdown_connections 2024-09-16T01:23:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.007+0000 7f9c576ac640 1 -- 172.21.15.81:0/1628801656 wait complete. 2024-09-16T01:23:56.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-16T01:23:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.119+0000 7f7f06e37640 1 Processor -- start 2024-09-16T01:23:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.119+0000 7f7f06e37640 1 -- start start 2024-09-16T01:23:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.120+0000 7f7f06e37640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7f0015fff0 0x7f7f000d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.120+0000 7f7f06e37640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f00160430 con 0x7f7f000d09c0 2024-09-16T01:23:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.120+0000 7f7f06e37640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f000d1040 con 0x7f7f001621f0 2024-09-16T01:23:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.120+0000 7f7f06e37640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7f000702f0 con 0x7f7f0015fff0 2024-09-16T01:23:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.120+0000 7f7f053d4640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7f000d09c0 0x7f7f00070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53250/0 (socket says 172.21.15.81:53250) 2024-09-16T01:23:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.120+0000 7f7f053d4640 1 -- 172.21.15.81:0/1749336773 learned_addr learned my addr 172.21.15.81:0/1749336773 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef7fff640 1 --2- 172.21.15.81:0/1749336773 >> v2:172.21.15.102:3300/0 conn(0x7f7f0015fff0 0x7f7f000d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1319929889 0 0) 0x7f7f00160430 con 0x7f7f000d09c0 2024-09-16T01:23:56.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ee8003520 con 0x7f7f000d09c0 2024-09-16T01:23:56.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3892346932 0 0) 0x7f7ee8003520 con 0x7f7f000d09c0 2024-09-16T01:23:56.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 >> v2:172.21.15.102:3300/0 conn(0x7f7f0015fff0 msgr2=0x7f7f000d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:56.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 --2- 172.21.15.81:0/1749336773 >> v2:172.21.15.102:3300/0 conn(0x7f7f0015fff0 0x7f7f000d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 >> v1:172.21.15.102:6789/0 conn(0x7f7f001621f0 legacy=0x7f7f001625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f000d1320 con 0x7f7f000d09c0 2024-09-16T01:23:56.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f7ef80019f0 con 0x7f7f000d09c0 2024-09-16T01:23:56.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 >> v1:172.21.15.81:6789/0 conn(0x7f7f000d09c0 legacy=0x7f7f00070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 --2- 172.21.15.81:0/1749336773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee80039b0 0x7f7ee8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 --2- 172.21.15.81:0/1749336773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 0x7f7ee8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 --2- 172.21.15.81:0/1749336773 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ee80051c0 0x7f7ee800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7f000702f0 con 0x7f7ee8004800 2024-09-16T01:23:56.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee800c070 con 0x7f7ee80039b0 2024-09-16T01:23:56.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee800c270 con 0x7f7ee80051c0 2024-09-16T01:23:56.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef7fff640 1 --2- 172.21.15.81:0/1749336773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 0x7f7ee8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7f04bd3640 1 --2- 172.21.15.81:0/1749336773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee80039b0 0x7f7ee8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7f053d4640 1 --2- 172.21.15.81:0/1749336773 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ee80051c0 0x7f7ee800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef7fff640 1 -- 172.21.15.81:0/1749336773 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ee80051c0 msgr2=0x7f7ee800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:56.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef7fff640 1 --2- 172.21.15.81:0/1749336773 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ee80051c0 0x7f7ee800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef7fff640 1 -- 172.21.15.81:0/1749336773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee80039b0 msgr2=0x7f7ee8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:56.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef7fff640 1 --2- 172.21.15.81:0/1749336773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ee80039b0 0x7f7ee8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7ef7fff640 1 -- 172.21.15.81:0/1749336773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee8003520 con 0x7f7ee8004800 2024-09-16T01:23:56.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7f053d4640 1 --2- 172.21.15.81:0/1749336773 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ee80051c0 0x7f7ee800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:56.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.121+0000 7f7f053d4640 1 -- 172.21.15.81:0/1749336773 reap_dead start 2024-09-16T01:23:56.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.122+0000 7f7ef7fff640 1 --2- 172.21.15.81:0/1749336773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 0x7f7ee8004c80 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009ac0 tx=0x7f7ee8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedb3efc7c9ecf29 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:56.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.122+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0036070 con 0x7f7ee8004800 2024-09-16T01:23:56.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.122+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef0031400 con 0x7f7ee8004800 2024-09-16T01:23:56.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.122+0000 7f7ef77fe640 1 -- 172.21.15.81:0/1749336773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0009690 con 0x7f7ee8004800 2024-09-16T01:23:56.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.123+0000 7f7f06e37640 1 -- 172.21.15.81:0/1749336773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 msgr2=0x7f7ee8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.123+0000 7f7f06e37640 1 --2- 172.21.15.81:0/1749336773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 0x7f7ee8004c80 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009ac0 tx=0x7f7ee8005830 comp rx=0 tx=0).stop 2024-09-16T01:23:56.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.123+0000 7f7f06e37640 1 -- 172.21.15.81:0/1749336773 shutdown_connections 2024-09-16T01:23:56.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.123+0000 7f7f06e37640 1 --2- 172.21.15.81:0/1749336773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 0x7f7ee8004c80 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.123+0000 7f7f06e37640 1 -- 172.21.15.81:0/1749336773 >> 172.21.15.81:0/1749336773 conn(0x7f7f000b3de0 msgr2=0x7f7f000b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:56.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.123+0000 7f7f06e37640 1 -- 172.21.15.81:0/1749336773 shutdown_connections 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.123+0000 7f7f06e37640 1 -- 172.21.15.81:0/1749336773 wait complete. 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.124+0000 7f7f06e37640 1 Processor -- start 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.124+0000 7f7f06e37640 1 -- start start 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f06e37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 0x7f7f000c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f06e37640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f000c66e0 0x7f7f0015a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f06e37640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7f001468d0 0x7f7f00146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f06e37640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7f00163050 con 0x7f7ee8004800 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f06e37640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7f00162ed0 con 0x7f7f000c66e0 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f06e37640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7f000d0480 con 0x7f7f001468d0 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f04bd3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 0x7f7f000c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f04bd3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 0x7f7f000c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38720/0 (socket says 172.21.15.81:38720) 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f04bd3640 1 -- 172.21.15.81:0/3701120942 learned_addr learned my addr 172.21.15.81:0/3701120942 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7ef7fff640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f000c66e0 0x7f7f0015a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f04bd3640 1 -- 172.21.15.81:0/3701120942 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7f001468d0 msgr2=0x7f7f00146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f053d4640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7f001468d0 0x7f7f00146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f04bd3640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7f001468d0 0x7f7f00146d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f04bd3640 1 -- 172.21.15.81:0/3701120942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f000c66e0 msgr2=0x7f7f0015a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f04bd3640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f000c66e0 0x7f7f0015a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f04bd3640 1 -- 172.21.15.81:0/3701120942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f001f4710 con 0x7f7ee8004800 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.125+0000 7f7f04bd3640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 0x7f7f000c7e10 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00f880 tx=0x7f7efc00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.126+0000 7f7ef57fa640 1 -- 172.21.15.81:0/3701120942 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc001d20 con 0x7f7ee8004800 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.126+0000 7f7ef57fa640 1 -- 172.21.15.81:0/3701120942 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7efc018070 con 0x7f7ee8004800 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.126+0000 7f7f06e37640 1 -- 172.21.15.81:0/3701120942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f000c8440 con 0x7f7ee8004800 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.126+0000 7f7ef57fa640 1 -- 172.21.15.81:0/3701120942 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7efc00d730 con 0x7f7ee8004800 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.126+0000 7f7f06e37640 1 -- 172.21.15.81:0/3701120942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f000c8a00 con 0x7f7ee8004800 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.127+0000 7f7f06e37640 1 -- 172.21.15.81:0/3701120942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f00068de0 con 0x7f7ee8004800 2024-09-16T01:23:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.127+0000 7f7ef57fa640 1 -- 172.21.15.81:0/3701120942 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7efc00d8d0 con 0x7f7ee8004800 2024-09-16T01:23:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.127+0000 7f7ef57fa640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7eec06c2b0 0x7f7eec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.128+0000 7f7ef57fa640 1 -- 172.21.15.81:0/3701120942 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7f7efc08b090 con 0x7f7ee8004800 2024-09-16T01:23:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.128+0000 7f7ef7fff640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7eec06c2b0 0x7f7eec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.128+0000 7f7ef7fff640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7eec06c2b0 0x7f7eec06e770 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0033000 tx=0x7f7ef0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.132+0000 7f7ef57fa640 1 -- 172.21.15.81:0/3701120942 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7efc059a00 con 0x7f7ee8004800 2024-09-16T01:23:56.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.298+0000 7f7f06e37640 1 -- 172.21.15.81:0/3701120942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7f00160430 con 0x7f7ee8004800 2024-09-16T01:23:56.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.302+0000 7f7ef57fa640 1 -- 172.21.15.81:0/3701120942 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v66)=0 v66) ==== 122+0+0 (secure 0 0 0) 0x7f7efc059300 con 0x7f7ee8004800 2024-09-16T01:23:56.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.304+0000 7f7f06e37640 1 -- 172.21.15.81:0/3701120942 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7eec06c2b0 msgr2=0x7f7eec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.304+0000 7f7f06e37640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7eec06c2b0 0x7f7eec06e770 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0033000 tx=0x7f7ef0008030 comp rx=0 tx=0).stop 2024-09-16T01:23:56.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.304+0000 7f7f06e37640 1 -- 172.21.15.81:0/3701120942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 msgr2=0x7f7f000c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.304+0000 7f7f06e37640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 0x7f7f000c7e10 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00f880 tx=0x7f7efc00fd40 comp rx=0 tx=0).stop 2024-09-16T01:23:56.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.304+0000 7f7f06e37640 1 -- 172.21.15.81:0/3701120942 shutdown_connections 2024-09-16T01:23:56.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.304+0000 7f7f06e37640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7eec06c2b0 0x7f7eec06e770 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.304+0000 7f7f06e37640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7f001468d0 0x7f7f00146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.304+0000 7f7f06e37640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f000c66e0 0x7f7f0015a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.304+0000 7f7f06e37640 1 --2- 172.21.15.81:0/3701120942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ee8004800 0x7f7f000c7e10 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.304+0000 7f7f06e37640 1 -- 172.21.15.81:0/3701120942 >> 172.21.15.81:0/3701120942 conn(0x7f7f000b3de0 msgr2=0x7f7f000b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:56.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.304+0000 7f7f06e37640 1 -- 172.21.15.81:0/3701120942 shutdown_connections 2024-09-16T01:23:56.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.304+0000 7f7f06e37640 1 -- 172.21.15.81:0/3701120942 wait complete. 2024-09-16T01:23:56.317 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:23:56.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:23:56.359 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:23:56.404 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:23:56.404 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:56.404 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:56.420 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:23:56.420 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:23:56.420 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:56.463 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:23:56.463 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:23:56.463 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:56.480 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:23:56.480 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:23:56.480 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:23:56.522 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:23:56.522 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-16T01:23:56.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:23:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.619+0000 7fb6ba58d640 1 Processor -- start 2024-09-16T01:23:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.619+0000 7fb6ba58d640 1 -- start start 2024-09-16T01:23:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.620+0000 7fb6ba58d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6b40d1540 0x7fb6b406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.620+0000 7fb6ba58d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6b409b690 0x7fb6b406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.620+0000 7fb6ba58d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b40d1940 con 0x7fb6b415e740 2024-09-16T01:23:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.620+0000 7fb6ba58d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb6b415eb20 con 0x7fb6b409b690 2024-09-16T01:23:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.620+0000 7fb6ba58d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b406d260 con 0x7fb6b40d1540 2024-09-16T01:23:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.620+0000 7fb6b8b2a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6b409b690 0x7fb6b406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.620+0000 7fb6b8b2a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6b409b690 0x7fb6b406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38726/0 (socket says 172.21.15.81:38726) 2024-09-16T01:23:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.620+0000 7fb6b8b2a640 1 -- 172.21.15.81:0/2192103445 learned_addr learned my addr 172.21.15.81:0/2192103445 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.620+0000 7fb6b8b2a640 1 -- 172.21.15.81:0/2192103445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6b40d1540 msgr2=0x7fb6b406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.620+0000 7fb6b8b2a640 1 --2- 172.21.15.81:0/2192103445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6b40d1540 0x7fb6b406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.620+0000 7fb6b8b2a640 1 -- 172.21.15.81:0/2192103445 >> v1:172.21.15.102:6789/0 conn(0x7fb6b415e740 legacy=0x7fb6b406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.620+0000 7fb6b8b2a640 1 -- 172.21.15.81:0/2192103445 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b409bae0 con 0x7fb6b409b690 2024-09-16T01:23:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.621+0000 7fb6b8b2a640 1 --2- 172.21.15.81:0/2192103445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b409b690 0x7fb6b406cd20 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009e80 tx=0x7fb6ac02a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63462e329beee02c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.621+0000 7fb6b2ffd640 1 -- 172.21.15.81:0/2192103445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac036070 con 0x7fb6b409b690 2024-09-16T01:23:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.621+0000 7fb6b2ffd640 1 -- 172.21.15.81:0/2192103445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ac031600 con 0x7fb6b409b690 2024-09-16T01:23:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.621+0000 7fb6b2ffd640 1 -- 172.21.15.81:0/2192103445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0319d0 con 0x7fb6b409b690 2024-09-16T01:23:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.621+0000 7fb6ba58d640 1 -- 172.21.15.81:0/2192103445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b409b690 msgr2=0x7fb6b406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.621+0000 7fb6ba58d640 1 --2- 172.21.15.81:0/2192103445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b409b690 0x7fb6b406cd20 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac009e80 tx=0x7fb6ac02a780 comp rx=0 tx=0).stop 2024-09-16T01:23:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.621+0000 7fb6ba58d640 1 -- 172.21.15.81:0/2192103445 shutdown_connections 2024-09-16T01:23:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.621+0000 7fb6ba58d640 1 --2- 172.21.15.81:0/2192103445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b409b690 0x7fb6b406cd20 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.621+0000 7fb6ba58d640 1 --2- 172.21.15.81:0/2192103445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6b40d1540 0x7fb6b406dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.621+0000 7fb6ba58d640 1 -- 172.21.15.81:0/2192103445 >> 172.21.15.81:0/2192103445 conn(0x7fb6b40d23a0 msgr2=0x7fb6b40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.622+0000 7fb6ba58d640 1 -- 172.21.15.81:0/2192103445 shutdown_connections 2024-09-16T01:23:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.622+0000 7fb6ba58d640 1 -- 172.21.15.81:0/2192103445 wait complete. 2024-09-16T01:23:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.623+0000 7fb6ba58d640 1 Processor -- start 2024-09-16T01:23:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.623+0000 7fb6ba58d640 1 -- start start 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.623+0000 7fb6ba58d640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6b409b690 0x7fb6b4154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6ba58d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b40d1540 0x7fb6b40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6ba58d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6b415e740 0x7fb6b415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6ba58d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b40d0d40 con 0x7fb6b40d1540 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6ba58d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b40d0a60 con 0x7fb6b415e740 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6ba58d640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b40d1020 con 0x7fb6b409b690 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b40d1540 0x7fb6b40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b40d1540 0x7fb6b40c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38730/0 (socket says 172.21.15.81:38730) 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b37fe640 1 -- 172.21.15.81:0/570356173 learned_addr learned my addr 172.21.15.81:0/570356173 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b3fff640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6b409b690 0x7fb6b4154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b8b2a640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6b415e740 0x7fb6b415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b37fe640 1 -- 172.21.15.81:0/570356173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6b409b690 msgr2=0x7fb6b4154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b37fe640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6b409b690 0x7fb6b4154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b37fe640 1 -- 172.21.15.81:0/570356173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6b415e740 msgr2=0x7fb6b415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b37fe640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6b415e740 0x7fb6b415d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b37fe640 1 -- 172.21.15.81:0/570356173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b40cb970 con 0x7fb6b40d1540 2024-09-16T01:23:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b37fe640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b40d1540 0x7fb6b40c9e80 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800b4a0 tx=0x7fb6a800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b0ff9640 1 -- 172.21.15.81:0/570356173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8014070 con 0x7fb6b40d1540 2024-09-16T01:23:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b0ff9640 1 -- 172.21.15.81:0/570356173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a8010610 con 0x7fb6b40d1540 2024-09-16T01:23:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6ba58d640 1 -- 172.21.15.81:0/570356173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b40ca8d0 con 0x7fb6b40d1540 2024-09-16T01:23:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6b0ff9640 1 -- 172.21.15.81:0/570356173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8010a00 con 0x7fb6b40d1540 2024-09-16T01:23:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.624+0000 7fb6ba58d640 1 -- 172.21.15.81:0/570356173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b40cae90 con 0x7fb6b40d1540 2024-09-16T01:23:56.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.625+0000 7fb6ba58d640 1 -- 172.21.15.81:0/570356173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b406cd20 con 0x7fb6b40d1540 2024-09-16T01:23:56.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.626+0000 7fb6b0ff9640 1 -- 172.21.15.81:0/570356173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb6a8017070 con 0x7fb6b40d1540 2024-09-16T01:23:56.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.626+0000 7fb6b0ff9640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6a006c2b0 0x7fb6a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:56.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.626+0000 7fb6b3fff640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6a006c2b0 0x7fb6a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:56.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.626+0000 7fb6b0ff9640 1 -- 172.21.15.81:0/570356173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5335+0+0 (secure 0 0 0) 0x7fb6a808abf0 con 0x7fb6b40d1540 2024-09-16T01:23:56.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.627+0000 7fb6b3fff640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6a006c2b0 0x7fb6a006e770 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4004f60 tx=0x7fb6a4007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.630+0000 7fb6b0ff9640 1 -- 172.21.15.81:0/570356173 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6a8058e80 con 0x7fb6b40d1540 2024-09-16T01:23:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.831+0000 7fb6ba58d640 1 -- 172.21.15.81:0/570356173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6b40b8320 con 0x7fb6b40d1540 2024-09-16T01:23:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.831+0000 7fb6b0ff9640 1 -- 172.21.15.81:0/570356173 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+3911 (secure 0 0 0) 0x7fb6a805d180 con 0x7fb6b40d1540 2024-09-16T01:23:56.833 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:56.834 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"btime":"2024-09-16T01:23:50:727274+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/350084010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":350084010},{"type":"v1","addr":"172.21.15.81:6837","nonce":350084010}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6389,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1730570681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1730570681},{"type":"v1","addr":"172.21.15.102:6834","nonce":1730570681}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/755231532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":755231532},{"type":"v1","addr":"172.21.15.102:6835","nonce":755231532}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8427,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1965252865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1965252865},{"type":"v1","addr":"172.21.15.81:6836","nonce":1965252865}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[]} 2024-09-16T01:23:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 79 2024-09-16T01:23:56.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.833+0000 7fb6ba58d640 1 -- 172.21.15.81:0/570356173 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6a006c2b0 msgr2=0x7fb6a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.833+0000 7fb6ba58d640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6a006c2b0 0x7fb6a006e770 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4004f60 tx=0x7fb6a4007e30 comp rx=0 tx=0).stop 2024-09-16T01:23:56.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.833+0000 7fb6ba58d640 1 -- 172.21.15.81:0/570356173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b40d1540 msgr2=0x7fb6b40c9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:56.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.833+0000 7fb6ba58d640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b40d1540 0x7fb6b40c9e80 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800b4a0 tx=0x7fb6a800b960 comp rx=0 tx=0).stop 2024-09-16T01:23:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.833+0000 7fb6ba58d640 1 -- 172.21.15.81:0/570356173 shutdown_connections 2024-09-16T01:23:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.833+0000 7fb6ba58d640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb6a006c2b0 0x7fb6a006e770 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.833+0000 7fb6ba58d640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6b415e740 0x7fb6b415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.833+0000 7fb6ba58d640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b40d1540 0x7fb6b40c9e80 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.833+0000 7fb6ba58d640 1 --2- 172.21.15.81:0/570356173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb6b409b690 0x7fb6b4154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.833+0000 7fb6ba58d640 1 -- 172.21.15.81:0/570356173 >> 172.21.15.81:0/570356173 conn(0x7fb6b40d23a0 msgr2=0x7fb6b40b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.834+0000 7fb6ba58d640 1 -- 172.21.15.81:0/570356173 shutdown_connections 2024-09-16T01:23:56.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:56.834+0000 7fb6ba58d640 1 -- 172.21.15.81:0/570356173 wait complete. 2024-09-16T01:23:56.847 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-16T01:23:56.847 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-16T01:23:56.847 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:23:56.847 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:23:56.847 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-16T01:23:56.848 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-16T01:23:56.848 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:23:56.848 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:23:56.848 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-16T01:23:56.848 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-16T01:23:56.849 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:23:56.849 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:23:56.849 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-16T01:23:56.849 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-16T01:23:56.850 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:23:56.850 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:23:56.857 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:23:56.857 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-16T01:23:56.858 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:23:56.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-16T01:23:56.863 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:23:56.863 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-16T01:23:56.864 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:23:56.864 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-16T01:23:56.899 INFO:tasks.ceph.mds.c:Started 2024-09-16T01:23:56.899 DEBUG:teuthology.parallel:result is None 2024-09-16T01:23:56.900 INFO:tasks.ceph.mds.a:Started 2024-09-16T01:23:56.900 DEBUG:teuthology.parallel:result is None 2024-09-16T01:23:56.906 INFO:tasks.ceph.mds.b:Started 2024-09-16T01:23:56.906 DEBUG:teuthology.parallel:result is None 2024-09-16T01:23:56.907 INFO:tasks.ceph.mds.d:Started 2024-09-16T01:23:56.907 DEBUG:teuthology.parallel:result is None 2024-09-16T01:23:56.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-16T01:23:56.974 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-16T01:23:56.974 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:23:56.996 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-16T01:23:56.996 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-16T01:23:57.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.008+0000 7feeb432a640 1 Processor -- start 2024-09-16T01:23:57.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.008+0000 7feeb432a640 1 -- start start 2024-09-16T01:23:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.009+0000 7feeb432a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feeac09b140 0x7feeac071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.009+0000 7feeb432a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feeac0b17d0 0x7feeac0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.009+0000 7feeb432a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feeac09ba30 con 0x7feeac15fc30 2024-09-16T01:23:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.009+0000 7feeb432a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7feeac0b1590 con 0x7feeac0b17d0 2024-09-16T01:23:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.009+0000 7feeb432a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feeac160ab0 con 0x7feeac09b140 2024-09-16T01:23:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.009+0000 7feeb20c6640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feeac15fc30 0x7feeac09aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53274/0 (socket says 172.21.15.81:53274) 2024-09-16T01:23:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.009+0000 7feeb20c6640 1 -- 172.21.15.81:0/1207697156 learned_addr learned my addr 172.21.15.81:0/1207697156 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.009+0000 7feeb18c5640 1 --2- 172.21.15.81:0/1207697156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feeac09b140 0x7feeac071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.009+0000 7feeb28c7640 1 --2- 172.21.15.81:0/1207697156 >> v2:172.21.15.102:3300/0 conn(0x7feeac0b17d0 0x7feeac0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.009+0000 7feeb10c4640 1 -- 172.21.15.81:0/1207697156 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3001747296 0 0) 0x7feeac09ba30 con 0x7feeac15fc30 2024-09-16T01:23:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.009+0000 7feeb10c4640 1 -- 172.21.15.81:0/1207697156 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee98003520 con 0x7feeac15fc30 2024-09-16T01:23:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.010+0000 7feeb28c7640 1 -- 172.21.15.81:0/1207697156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feeac09b140 msgr2=0x7feeac071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.010+0000 7feeb28c7640 1 --2- 172.21.15.81:0/1207697156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feeac09b140 0x7feeac071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.010+0000 7feeb28c7640 1 -- 172.21.15.81:0/1207697156 >> v1:172.21.15.81:6789/0 conn(0x7feeac15fc30 legacy=0x7feeac09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.010+0000 7feeb28c7640 1 -- 172.21.15.81:0/1207697156 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac09bcf0 con 0x7feeac0b17d0 2024-09-16T01:23:57.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.010+0000 7feeb18c5640 1 --2- 172.21.15.81:0/1207697156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feeac09b140 0x7feeac071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:57.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.010+0000 7feeb28c7640 1 --2- 172.21.15.81:0/1207697156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeac0b17d0 0x7feeac0704f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feea4009d90 tx=0x7feea402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95b69e0f39ae0418 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:57.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.011+0000 7feeb10c4640 1 -- 172.21.15.81:0/1207697156 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4031600 con 0x7feeac0b17d0 2024-09-16T01:23:57.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.011+0000 7feeb10c4640 1 -- 172.21.15.81:0/1207697156 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea40317a0 con 0x7feeac0b17d0 2024-09-16T01:23:57.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.011+0000 7feeb10c4640 1 -- 172.21.15.81:0/1207697156 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4031b50 con 0x7feeac0b17d0 2024-09-16T01:23:57.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.011+0000 7feeb432a640 1 -- 172.21.15.81:0/1207697156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeac0b17d0 msgr2=0x7feeac0704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:57.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.011+0000 7feeb432a640 1 --2- 172.21.15.81:0/1207697156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeac0b17d0 0x7feeac0704f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feea4009d90 tx=0x7feea402a5d0 comp rx=0 tx=0).stop 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.011+0000 7feeb432a640 1 -- 172.21.15.81:0/1207697156 shutdown_connections 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.011+0000 7feeb432a640 1 --2- 172.21.15.81:0/1207697156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeac0b17d0 0x7feeac0704f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.011+0000 7feeb432a640 1 --2- 172.21.15.81:0/1207697156 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feeac09b140 0x7feeac071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.011+0000 7feeb432a640 1 -- 172.21.15.81:0/1207697156 >> 172.21.15.81:0/1207697156 conn(0x7feeac0d23a0 msgr2=0x7feeac0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.011+0000 7feeb432a640 1 -- 172.21.15.81:0/1207697156 shutdown_connections 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.012+0000 7feeb432a640 1 -- 172.21.15.81:0/1207697156 wait complete. 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.013+0000 7feeb432a640 1 Processor -- start 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.013+0000 7feeb432a640 1 -- start start 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.013+0000 7feeb432a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeac09b140 0x7feeac1f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.013+0000 7feeb432a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feeac0b17d0 0x7feeac1f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.013+0000 7feeb432a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeac15fc30 0x7feeac159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.013+0000 7feeb432a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feeac070a30 con 0x7feeac09b140 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.013+0000 7feeb432a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feeac160fe0 con 0x7feeac15fc30 2024-09-16T01:23:57.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.013+0000 7feeb432a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feeac070bb0 con 0x7feeac0b17d0 2024-09-16T01:23:57.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.014+0000 7feeb20c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeac09b140 0x7feeac1f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:57.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.014+0000 7feeb20c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeac09b140 0x7feeac1f1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38780/0 (socket says 172.21.15.81:38780) 2024-09-16T01:23:57.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.014+0000 7feeb20c6640 1 -- 172.21.15.81:0/776845261 learned_addr learned my addr 172.21.15.81:0/776845261 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:57.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.014+0000 7feeb28c7640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeac15fc30 0x7feeac159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:57.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.014+0000 7feeb18c5640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feeac0b17d0 0x7feeac1f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:57.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.014+0000 7feeb20c6640 1 -- 172.21.15.81:0/776845261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feeac0b17d0 msgr2=0x7feeac1f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:57.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.014+0000 7feeb20c6640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feeac0b17d0 0x7feeac1f29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:57.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.014+0000 7feeb20c6640 1 -- 172.21.15.81:0/776845261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeac15fc30 msgr2=0x7feeac159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:57.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.014+0000 7feeb20c6640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeac15fc30 0x7feeac159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:57.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.014+0000 7feeb20c6640 1 -- 172.21.15.81:0/776845261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac1f2ef0 con 0x7feeac09b140 2024-09-16T01:23:57.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.014+0000 7feeb28c7640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeac15fc30 0x7feeac159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:57.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.014+0000 7feeb20c6640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeac09b140 0x7feeac1f1930 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7feea800c390 tx=0x7feea800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:57.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.020+0000 7feea2ffd640 1 -- 172.21.15.81:0/776845261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8017070 con 0x7feeac09b140 2024-09-16T01:23:57.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.020+0000 7feeb432a640 1 -- 172.21.15.81:0/776845261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeac0b5620 con 0x7feeac09b140 2024-09-16T01:23:57.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.020+0000 7feeb432a640 1 -- 172.21.15.81:0/776845261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeac0b5be0 con 0x7feeac09b140 2024-09-16T01:23:57.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.020+0000 7feea2ffd640 1 -- 172.21.15.81:0/776845261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feea8005ce0 con 0x7feeac09b140 2024-09-16T01:23:57.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.020+0000 7feea2ffd640 1 -- 172.21.15.81:0/776845261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea80072d0 con 0x7feeac09b140 2024-09-16T01:23:57.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.021+0000 7feeb432a640 1 -- 172.21.15.81:0/776845261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeac14d4b0 con 0x7feeac09b140 2024-09-16T01:23:57.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.022+0000 7feea2ffd640 1 -- 172.21.15.81:0/776845261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feea801a070 con 0x7feeac09b140 2024-09-16T01:23:57.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.022+0000 7feea2ffd640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fee9006c2b0 0x7fee9006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:57.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.022+0000 7feea2ffd640 1 -- 172.21.15.81:0/776845261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5335+0+0 (secure 0 0 0) 0x7feea808a570 con 0x7feeac09b140 2024-09-16T01:23:57.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.022+0000 7feeb18c5640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fee9006c2b0 0x7fee9006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:57.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.023+0000 7feeb18c5640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fee9006c2b0 0x7fee9006e770 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7feeac15a150 tx=0x7fee9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:57.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.027+0000 7feea2ffd640 1 -- 172.21.15.81:0/776845261 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feeac1f2ef0 con 0x7feeac09b140 2024-09-16T01:23:57.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:57.207+0000 7feeb432a640 1 -- 172.21.15.81:0/776845261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7feeac0b8300 con 0x7feeac09b140 2024-09-16T01:23:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.035+0000 7feea2ffd640 1 -- 172.21.15.81:0/776845261 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v145) ==== 97+0+0 (secure 0 0 0) 0x7feea8058810 con 0x7feeac09b140 2024-09-16T01:23:58.037 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-16T01:23:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.038+0000 7feeb432a640 1 -- 172.21.15.81:0/776845261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fee9006c2b0 msgr2=0x7fee9006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.038+0000 7feeb432a640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fee9006c2b0 0x7fee9006e770 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7feeac15a150 tx=0x7fee9c008040 comp rx=0 tx=0).stop 2024-09-16T01:23:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.038+0000 7feeb432a640 1 -- 172.21.15.81:0/776845261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeac09b140 msgr2=0x7feeac1f1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.038+0000 7feeb432a640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeac09b140 0x7feeac1f1930 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7feea800c390 tx=0x7feea800c850 comp rx=0 tx=0).stop 2024-09-16T01:23:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.038+0000 7feeb432a640 1 -- 172.21.15.81:0/776845261 shutdown_connections 2024-09-16T01:23:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.038+0000 7feeb432a640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fee9006c2b0 0x7fee9006e770 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.038+0000 7feeb432a640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeac15fc30 0x7feeac159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.038+0000 7feeb432a640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feeac0b17d0 0x7feeac1f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.038+0000 7feeb432a640 1 --2- 172.21.15.81:0/776845261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feeac09b140 0x7feeac1f1930 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.038+0000 7feeb432a640 1 -- 172.21.15.81:0/776845261 >> 172.21.15.81:0/776845261 conn(0x7feeac0d23a0 msgr2=0x7feeac0b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:58.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.038+0000 7feeb432a640 1 -- 172.21.15.81:0/776845261 shutdown_connections 2024-09-16T01:23:58.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.038+0000 7feeb432a640 1 -- 172.21.15.81:0/776845261 wait complete. 2024-09-16T01:23:58.053 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-16T01:23:58.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.157+0000 7fd5864a5640 1 Processor -- start 2024-09-16T01:23:58.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.157+0000 7fd5864a5640 1 -- start start 2024-09-16T01:23:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.157+0000 7fd5864a5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5800d0cf0 0x7fd5801690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.157+0000 7fd5864a5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5800d12c0 con 0x7fd58009aca0 2024-09-16T01:23:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.157+0000 7fd5864a5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5800d15a0 con 0x7fd580071750 2024-09-16T01:23:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.157+0000 7fd5864a5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd58006d040 con 0x7fd5800d0cf0 2024-09-16T01:23:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.158+0000 7fd584a42640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5800d0cf0 0x7fd5801690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.158+0000 7fd57ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd58009aca0 0x7fd58009b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53276/0 (socket says 172.21.15.81:53276) 2024-09-16T01:23:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.158+0000 7fd57ffff640 1 -- 172.21.15.81:0/2786666708 learned_addr learned my addr 172.21.15.81:0/2786666708 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:58.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.158+0000 7fd584a42640 1 -- 172.21.15.81:0/2786666708 >> v1:172.21.15.102:6789/0 conn(0x7fd580071750 legacy=0x7fd5800d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.158+0000 7fd584a42640 1 -- 172.21.15.81:0/2786666708 >> v1:172.21.15.81:6789/0 conn(0x7fd58009aca0 legacy=0x7fd58009b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.158+0000 7fd584a42640 1 -- 172.21.15.81:0/2786666708 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5800d1880 con 0x7fd5800d0cf0 2024-09-16T01:23:58.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.158+0000 7fd57effd640 1 -- 172.21.15.81:0/2786666708 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806959028 0 0) 0x7fd5800d12c0 con 0x7fd58009aca0 2024-09-16T01:23:58.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.159+0000 7fd584a42640 1 --2- 172.21.15.81:0/2786666708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5800d0cf0 0x7fd5801690d0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fd578009d90 tx=0x7fd57802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e9e18bd2068bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.159+0000 7fd57effd640 1 -- 172.21.15.81:0/2786666708 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578007740 con 0x7fd5800d0cf0 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.159+0000 7fd57effd640 1 -- 172.21.15.81:0/2786666708 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5780078e0 con 0x7fd5800d0cf0 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.159+0000 7fd57effd640 1 -- 172.21.15.81:0/2786666708 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578007cb0 con 0x7fd5800d0cf0 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.159+0000 7fd5864a5640 1 -- 172.21.15.81:0/2786666708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5800d0cf0 msgr2=0x7fd5801690d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.159+0000 7fd5864a5640 1 --2- 172.21.15.81:0/2786666708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5800d0cf0 0x7fd5801690d0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fd578009d90 tx=0x7fd57802a6a0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.159+0000 7fd5864a5640 1 -- 172.21.15.81:0/2786666708 shutdown_connections 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.159+0000 7fd5864a5640 1 --2- 172.21.15.81:0/2786666708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5800d0cf0 0x7fd5801690d0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.159+0000 7fd5864a5640 1 -- 172.21.15.81:0/2786666708 >> 172.21.15.81:0/2786666708 conn(0x7fd5800d23a0 msgr2=0x7fd5800d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.159+0000 7fd5864a5640 1 -- 172.21.15.81:0/2786666708 shutdown_connections 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.159+0000 7fd5864a5640 1 -- 172.21.15.81:0/2786666708 wait complete. 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.160+0000 7fd5864a5640 1 Processor -- start 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.161+0000 7fd5864a5640 1 -- start start 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.161+0000 7fd5864a5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd580071750 0x7fd5800ce570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.161+0000 7fd5864a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd58009aca0 0x7fd580157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.161+0000 7fd5864a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5800d0cf0 0x7fd5800af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.161+0000 7fd5864a5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd58009b790 con 0x7fd5800d0cf0 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.161+0000 7fd5864a5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd580070220 con 0x7fd58009aca0 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.161+0000 7fd5864a5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd580169610 con 0x7fd580071750 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd584a42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5800d0cf0 0x7fd5800af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd584a42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5800d0cf0 0x7fd5800af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38798/0 (socket says 172.21.15.81:38798) 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd584a42640 1 -- 172.21.15.81:0/2512637617 learned_addr learned my addr 172.21.15.81:0/2512637617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd57f7fe640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd58009aca0 0x7fd580157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd57ffff640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd580071750 0x7fd5800ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd584a42640 1 -- 172.21.15.81:0/2512637617 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd580071750 msgr2=0x7fd5800ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd584a42640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd580071750 0x7fd5800ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd584a42640 1 -- 172.21.15.81:0/2512637617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd58009aca0 msgr2=0x7fd580157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd584a42640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd58009aca0 0x7fd580157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd584a42640 1 -- 172.21.15.81:0/2512637617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58015b160 con 0x7fd5800d0cf0 2024-09-16T01:23:58.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd57f7fe640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd58009aca0 0x7fd580157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:58.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd57ffff640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd580071750 0x7fd5800ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:58.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd584a42640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5800d0cf0 0x7fd5800af140 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fd578009eb0 tx=0x7fd578004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd57cff9640 1 -- 172.21.15.81:0/2512637617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578040070 con 0x7fd5800d0cf0 2024-09-16T01:23:58.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd57cff9640 1 -- 172.21.15.81:0/2512637617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd578031c90 con 0x7fd5800d0cf0 2024-09-16T01:23:58.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd57cff9640 1 -- 172.21.15.81:0/2512637617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd578045680 con 0x7fd5800d0cf0 2024-09-16T01:23:58.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd5864a5640 1 -- 172.21.15.81:0/2512637617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58015b400 con 0x7fd5800d0cf0 2024-09-16T01:23:58.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.162+0000 7fd5864a5640 1 -- 172.21.15.81:0/2512637617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd58015b980 con 0x7fd5800d0cf0 2024-09-16T01:23:58.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.163+0000 7fd5864a5640 1 -- 172.21.15.81:0/2512637617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd580156650 con 0x7fd5800d0cf0 2024-09-16T01:23:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.164+0000 7fd57cff9640 1 -- 172.21.15.81:0/2512637617 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd578039040 con 0x7fd5800d0cf0 2024-09-16T01:23:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.164+0000 7fd57cff9640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd56006c2b0 0x7fd56006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.164+0000 7fd57cff9640 1 -- 172.21.15.81:0/2512637617 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5249+0+0 (secure 0 0 0) 0x7fd5780acc70 con 0x7fd5800d0cf0 2024-09-16T01:23:58.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.164+0000 7fd57ffff640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd56006c2b0 0x7fd56006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.165+0000 7fd57ffff640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd56006c2b0 0x7fd56006e770 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd570000f60 tx=0x7fd570007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.169+0000 7fd57cff9640 1 -- 172.21.15.81:0/2512637617 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd580156650 con 0x7fd5800d0cf0 2024-09-16T01:23:58.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.398+0000 7fd5864a5640 1 -- 172.21.15.81:0/2512637617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd5800d05e0 con 0x7fd5800d0cf0 2024-09-16T01:23:58.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.399+0000 7fd57cff9640 1 -- 172.21.15.81:0/2512637617 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7fd57807b010 con 0x7fd5800d0cf0 2024-09-16T01:23:58.401 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:58.401 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:23:58.401 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-16T01:23:58.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.401 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-16T01:23:58.401 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmx4OgCRAAkmpWDpuwqbDuz0taNg8bag==", 2024-09-16T01:23:58.401 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.401 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:58.401 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:23:58.401 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:23:58.401 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.402 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-16T01:23:58.402 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmSNpLFRAAzc9Sr8b65zH9VZFYvqsYpA==", 2024-09-16T01:23:58.402 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.402 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:58.402 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:23:58.402 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:23:58.402 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmcCavEBAA0CuddD0zPcjqrMSOD5c6OA==", 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-16T01:23:58.403 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmVeRcHBAANIL7HFYSc43qv7Zg0llkYQ==", 2024-09-16T01:23:58.404 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.404 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:58.404 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:23:58.404 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:23:58.404 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.404 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.404 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.404 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-16T01:23:58.404 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCDhudmUtTqORAAkZKChid+qoa+0nIgpuun7g==", 2024-09-16T01:23:58.404 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.404 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCHhudmUhtiABAA2vDoACv8RJ2KD9p1cdKClA==", 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCKhudmhOmRHxAAbGjJkUZLras/b6omekdz7A==", 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCNhudmA+csIRAAW1kenpimaWIak/qgG+UeXw==", 2024-09-16T01:23:58.406 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCThudmvgQBLxAAWLto5pG0iyiQPSnxldWYwg==", 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-16T01:23:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCXhudmKfyiIhAALbJHvDeQtVgSCKjD1X3OYg==", 2024-09-16T01:23:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-16T01:23:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCahudmPG/9JBAA6d/gK0K/5c9Gp4uKOLCCOw==", 2024-09-16T01:23:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-16T01:23:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCdhudmVdY3NhAAXlOaeE0XidHVCaeQrirBAg==", 2024-09-16T01:23:58.409 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg==", 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-16T01:23:58.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmMgEhKRAAUD2kJ9eOFJscZ6ATlO5PmQ==", 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.411 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-16T01:23:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmwfD5JRAAPhdVLFZD07Uy75g3zStblg==", 2024-09-16T01:23:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:23:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:23:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:23:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-16T01:23:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudm8/qzLhAAVFRbGhXH00h2LS9ZC9rraA==", 2024-09-16T01:23:58.412 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB/hudmBWr2KRAA/hELsRHNpxj3KqJbOSY74g==", 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-16T01:23:58.413 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-16T01:23:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-16T01:23:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmRdtyBhAAMQngXCuTHg6AjACCw/SmCg==", 2024-09-16T01:23:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:23:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:23:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-16T01:23:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-16T01:23:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCAhudmqULCAhAAMbYmGXWGiINwif20O1JG3g==", 2024-09-16T01:23:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-16T01:23:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-16T01:23:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-16T01:23:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-16T01:23:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-16T01:23:58.415 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:23:58.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.400+0000 7fd5864a5640 1 -- 172.21.15.81:0/2512637617 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd56006c2b0 msgr2=0x7fd56006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.401+0000 7fd5864a5640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd56006c2b0 0x7fd56006e770 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fd570000f60 tx=0x7fd570007c10 comp rx=0 tx=0).stop 2024-09-16T01:23:58.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.401+0000 7fd5864a5640 1 -- 172.21.15.81:0/2512637617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5800d0cf0 msgr2=0x7fd5800af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.401+0000 7fd5864a5640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5800d0cf0 0x7fd5800af140 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fd578009eb0 tx=0x7fd578004a40 comp rx=0 tx=0).stop 2024-09-16T01:23:58.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.401+0000 7fd5864a5640 1 -- 172.21.15.81:0/2512637617 shutdown_connections 2024-09-16T01:23:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.401+0000 7fd5864a5640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd56006c2b0 0x7fd56006e770 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.401+0000 7fd5864a5640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5800d0cf0 0x7fd5800af140 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.401+0000 7fd5864a5640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd58009aca0 0x7fd580157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.401+0000 7fd5864a5640 1 --2- 172.21.15.81:0/2512637617 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd580071750 0x7fd5800ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.401+0000 7fd5864a5640 1 -- 172.21.15.81:0/2512637617 >> 172.21.15.81:0/2512637617 conn(0x7fd5800d23a0 msgr2=0x7fd58009b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.401+0000 7fd5864a5640 1 -- 172.21.15.81:0/2512637617 shutdown_connections 2024-09-16T01:23:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.401+0000 7fd5864a5640 1 -- 172.21.15.81:0/2512637617 wait complete. 2024-09-16T01:23:58.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-16T01:23:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.516+0000 7f57631bd640 1 Processor -- start 2024-09-16T01:23:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.516+0000 7f57631bd640 1 -- start start 2024-09-16T01:23:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f57631bd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147360 0x7f575c070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f57631bd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f575c0d0bb0 0x7f575c0ae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f57631bd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f575c06cb30 con 0x7f575c070dd0 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f57631bd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f575c06bfb0 con 0x7f575c0d0bb0 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f57631bd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f575c06c290 con 0x7f575c147360 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f5753fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f575c070dd0 0x7f575c0d04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53292/0 (socket says 172.21.15.81:53292) 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f5753fff640 1 -- 172.21.15.81:0/3208086094 learned_addr learned my addr 172.21.15.81:0/3208086094 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f576175a640 1 --2- 172.21.15.81:0/3208086094 >> v2:172.21.15.102:3300/0 conn(0x7f575c0d0bb0 0x7f575c0ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f5760f59640 1 --2- 172.21.15.81:0/3208086094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147360 0x7f575c070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521817468 0 0) 0x7f575c06cb30 con 0x7f575c070dd0 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5744003520 con 0x7f575c070dd0 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1929271595 0 0) 0x7f5744003520 con 0x7f575c070dd0 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.517+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147360 msgr2=0x7f575c070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f57537fe640 1 --2- 172.21.15.81:0/3208086094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147360 0x7f575c070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 >> v2:172.21.15.102:3300/0 conn(0x7f575c0d0bb0 msgr2=0x7f575c0ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f57537fe640 1 --2- 172.21.15.81:0/3208086094 >> v2:172.21.15.102:3300/0 conn(0x7f575c0d0bb0 0x7f575c0ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c06c570 con 0x7f575c070dd0 2024-09-16T01:23:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f574c001670 con 0x7f575c070dd0 2024-09-16T01:23:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f576175a640 1 --2- 172.21.15.81:0/3208086094 >> v2:172.21.15.102:3300/0 conn(0x7f575c0d0bb0 0x7f575c0ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 >> v1:172.21.15.81:6789/0 conn(0x7f575c070dd0 legacy=0x7f575c0d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f57537fe640 1 --2- 172.21.15.81:0/3208086094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57440039b0 0x7f5744003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f57537fe640 1 --2- 172.21.15.81:0/3208086094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147360 0x7f5744004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f57537fe640 1 --2- 172.21.15.81:0/3208086094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5744004d40 0x7f57440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f575c06bfb0 con 0x7f57440039b0 2024-09-16T01:23:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f575c06c290 con 0x7f5744004d40 2024-09-16T01:23:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f574400b9c0 con 0x7f575c147360 2024-09-16T01:23:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f5760f59640 1 --2- 172.21.15.81:0/3208086094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57440039b0 0x7f5744003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f576175a640 1 --2- 172.21.15.81:0/3208086094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5744004d40 0x7f57440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f5753fff640 1 --2- 172.21.15.81:0/3208086094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147360 0x7f5744004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f5760f59640 1 -- 172.21.15.81:0/3208086094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147360 msgr2=0x7f5744004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f5760f59640 1 --2- 172.21.15.81:0/3208086094 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147360 0x7f5744004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f5760f59640 1 -- 172.21.15.81:0/3208086094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5744004d40 msgr2=0x7f57440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f5760f59640 1 --2- 172.21.15.81:0/3208086094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5744004d40 0x7f57440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.518+0000 7f5760f59640 1 -- 172.21.15.81:0/3208086094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5744003520 con 0x7f57440039b0 2024-09-16T01:23:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.519+0000 7f5760f59640 1 --2- 172.21.15.81:0/3208086094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57440039b0 0x7f5744003dd0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f5758009ac0 tx=0x7f5744005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1416b7a5728de5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.519+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758036070 con 0x7f57440039b0 2024-09-16T01:23:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.519+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5758031400 con 0x7f57440039b0 2024-09-16T01:23:58.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.519+0000 7f57537fe640 1 -- 172.21.15.81:0/3208086094 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758009690 con 0x7f57440039b0 2024-09-16T01:23:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.519+0000 7f57631bd640 1 -- 172.21.15.81:0/3208086094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57440039b0 msgr2=0x7f5744003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.519+0000 7f57631bd640 1 --2- 172.21.15.81:0/3208086094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57440039b0 0x7f5744003dd0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f5758009ac0 tx=0x7f5744005830 comp rx=0 tx=0).stop 2024-09-16T01:23:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.519+0000 7f576175a640 1 -- 172.21.15.81:0/3208086094 reap_dead start 2024-09-16T01:23:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.519+0000 7f57631bd640 1 -- 172.21.15.81:0/3208086094 shutdown_connections 2024-09-16T01:23:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.519+0000 7f57631bd640 1 -- 172.21.15.81:0/3208086094 >> 172.21.15.81:0/3208086094 conn(0x7f575c0b2f40 msgr2=0x7f575c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.519+0000 7f57631bd640 1 -- 172.21.15.81:0/3208086094 shutdown_connections 2024-09-16T01:23:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.519+0000 7f57631bd640 1 -- 172.21.15.81:0/3208086094 wait complete. 2024-09-16T01:23:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.521+0000 7f57631bd640 1 Processor -- start 2024-09-16T01:23:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.521+0000 7f57631bd640 1 -- start start 2024-09-16T01:23:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.521+0000 7f57631bd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57440039b0 0x7f575c0b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.521+0000 7f57631bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575c13fdf0 0x7f575c161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.521+0000 7f57631bd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147740 0x7f575c147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.521+0000 7f57631bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f575c06bd90 con 0x7f575c13fdf0 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.521+0000 7f57631bd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f575c06bc10 con 0x7f57440039b0 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.521+0000 7f57631bd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f575c070890 con 0x7f575c147740 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f5753fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575c13fdf0 0x7f575c161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f5753fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575c13fdf0 0x7f575c161020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38814/0 (socket says 172.21.15.81:38814) 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f5753fff640 1 -- 172.21.15.81:0/804484118 learned_addr learned my addr 172.21.15.81:0/804484118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f5760f59640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57440039b0 0x7f575c0b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f576175a640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147740 0x7f575c147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f5753fff640 1 -- 172.21.15.81:0/804484118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147740 msgr2=0x7f575c147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f5753fff640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147740 0x7f575c147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f5753fff640 1 -- 172.21.15.81:0/804484118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57440039b0 msgr2=0x7f575c0b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f5753fff640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57440039b0 0x7f575c0b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f5753fff640 1 -- 172.21.15.81:0/804484118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c13f9b0 con 0x7f575c13fdf0 2024-09-16T01:23:58.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f576175a640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147740 0x7f575c147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f5753fff640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575c13fdf0 0x7f575c161020 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f574c00e8a0 tx=0x7f574c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f57517fa640 1 -- 172.21.15.81:0/804484118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c00c8d0 con 0x7f575c13fdf0 2024-09-16T01:23:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f57517fa640 1 -- 172.21.15.81:0/804484118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574c018070 con 0x7f575c13fdf0 2024-09-16T01:23:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f57631bd640 1 -- 172.21.15.81:0/804484118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c13ebf0 con 0x7f575c13fdf0 2024-09-16T01:23:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f57517fa640 1 -- 172.21.15.81:0/804484118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c00ccb0 con 0x7f575c13fdf0 2024-09-16T01:23:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.522+0000 7f57631bd640 1 -- 172.21.15.81:0/804484118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c13f1b0 con 0x7f575c13fdf0 2024-09-16T01:23:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.523+0000 7f57631bd640 1 -- 172.21.15.81:0/804484118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575c0d04a0 con 0x7f575c13fdf0 2024-09-16T01:23:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.524+0000 7f57517fa640 1 -- 172.21.15.81:0/804484118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f574c01d460 con 0x7f575c13fdf0 2024-09-16T01:23:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.524+0000 7f57517fa640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f574806c2b0 0x7f574806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.524+0000 7f57517fa640 1 -- 172.21.15.81:0/804484118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5249+0+0 (secure 0 0 0) 0x7f574c08b120 con 0x7f575c13fdf0 2024-09-16T01:23:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.524+0000 7f5760f59640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f574806c2b0 0x7f574806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.525+0000 7f5760f59640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f574806c2b0 0x7f574806e770 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5758033000 tx=0x7f5758008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.528+0000 7f57517fa640 1 -- 172.21.15.81:0/804484118 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f574c059ae0 con 0x7f575c13fdf0 2024-09-16T01:23:58.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.697+0000 7f57631bd640 1 -- 172.21.15.81:0/804484118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f575c0b1b10 con 0x7f575c13fdf0 2024-09-16T01:23:58.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.697+0000 7f57517fa640 1 -- 172.21.15.81:0/804484118 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v145) ==== 84+0+65 (secure 0 0 0) 0x7f574c0593e0 con 0x7f575c13fdf0 2024-09-16T01:23:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:23:58.699 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-16T01:23:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-16T01:23:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-16T01:23:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-16T01:23:58.699 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-16T01:23:58.699 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-16T01:23:58.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.699+0000 7f57631bd640 1 -- 172.21.15.81:0/804484118 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f574806c2b0 msgr2=0x7f574806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.699+0000 7f57631bd640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f574806c2b0 0x7f574806e770 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5758033000 tx=0x7f5758008030 comp rx=0 tx=0).stop 2024-09-16T01:23:58.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.699+0000 7f57631bd640 1 -- 172.21.15.81:0/804484118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575c13fdf0 msgr2=0x7f575c161020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.699+0000 7f57631bd640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575c13fdf0 0x7f575c161020 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f574c00e8a0 tx=0x7f574c00ed60 comp rx=0 tx=0).stop 2024-09-16T01:23:58.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.699+0000 7f57631bd640 1 -- 172.21.15.81:0/804484118 shutdown_connections 2024-09-16T01:23:58.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.699+0000 7f57631bd640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f574806c2b0 0x7f574806e770 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.699+0000 7f57631bd640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f575c147740 0x7f575c147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.699+0000 7f57631bd640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f575c13fdf0 0x7f575c161020 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.699+0000 7f57631bd640 1 --2- 172.21.15.81:0/804484118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f57440039b0 0x7f575c0b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.699+0000 7f57631bd640 1 -- 172.21.15.81:0/804484118 >> 172.21.15.81:0/804484118 conn(0x7f575c0b2f40 msgr2=0x7f575c0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:58.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.699+0000 7f57631bd640 1 -- 172.21.15.81:0/804484118 shutdown_connections 2024-09-16T01:23:58.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.699+0000 7f57631bd640 1 -- 172.21.15.81:0/804484118 wait complete. 2024-09-16T01:23:58.712 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-16T01:23:58.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-16T01:23:58.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.813+0000 7f8b3baeb640 1 Processor -- start 2024-09-16T01:23:58.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.813+0000 7f8b3baeb640 1 -- start start 2024-09-16T01:23:58.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b3baeb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b3415e7f0 0x7f8b340b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b3baeb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8b34071180 0x7f8b3406de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b3baeb640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b3406cdc0 con 0x7f8b340af210 2024-09-16T01:23:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b3baeb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8b3406d0a0 con 0x7f8b34071180 2024-09-16T01:23:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b3baeb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8b3406d380 con 0x7f8b3415e7f0 2024-09-16T01:23:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b3a088640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8b34071180 0x7f8b3406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b3a088640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8b34071180 0x7f8b3406de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38826/0 (socket says 172.21.15.81:38826) 2024-09-16T01:23:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b3a088640 1 -- 172.21.15.81:0/3063894897 learned_addr learned my addr 172.21.15.81:0/3063894897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b39887640 1 --2- 172.21.15.81:0/3063894897 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b3415e7f0 0x7f8b340b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b3a088640 1 -- 172.21.15.81:0/3063894897 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b3415e7f0 msgr2=0x7f8b340b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b3a088640 1 --2- 172.21.15.81:0/3063894897 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b3415e7f0 0x7f8b340b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b3a088640 1 -- 172.21.15.81:0/3063894897 >> v1:172.21.15.102:6789/0 conn(0x7f8b340af210 legacy=0x7f8b34070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.814+0000 7f8b3a088640 1 -- 172.21.15.81:0/3063894897 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3406d660 con 0x7f8b34071180 2024-09-16T01:23:58.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.815+0000 7f8b3a088640 1 --2- 172.21.15.81:0/3063894897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b34071180 0x7f8b3406de60 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009e50 tx=0x7f8b2c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6ac6c4a496b0f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.815+0000 7f8b38885640 1 -- 172.21.15.81:0/3063894897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c036070 con 0x7f8b34071180 2024-09-16T01:23:58.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.815+0000 7f8b38885640 1 -- 172.21.15.81:0/3063894897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b2c031600 con 0x7f8b34071180 2024-09-16T01:23:58.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.815+0000 7f8b38885640 1 -- 172.21.15.81:0/3063894897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0319d0 con 0x7f8b34071180 2024-09-16T01:23:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.816+0000 7f8b3baeb640 1 -- 172.21.15.81:0/3063894897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b34071180 msgr2=0x7f8b3406de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.816+0000 7f8b3baeb640 1 --2- 172.21.15.81:0/3063894897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b34071180 0x7f8b3406de60 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c009e50 tx=0x7f8b2c02a710 comp rx=0 tx=0).stop 2024-09-16T01:23:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.816+0000 7f8b3baeb640 1 -- 172.21.15.81:0/3063894897 shutdown_connections 2024-09-16T01:23:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.816+0000 7f8b3baeb640 1 --2- 172.21.15.81:0/3063894897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b34071180 0x7f8b3406de60 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.816+0000 7f8b3baeb640 1 --2- 172.21.15.81:0/3063894897 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b3415e7f0 0x7f8b340b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.816+0000 7f8b3baeb640 1 -- 172.21.15.81:0/3063894897 >> 172.21.15.81:0/3063894897 conn(0x7f8b340b3f30 msgr2=0x7f8b340b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.816+0000 7f8b3baeb640 1 -- 172.21.15.81:0/3063894897 shutdown_connections 2024-09-16T01:23:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.816+0000 7f8b3baeb640 1 -- 172.21.15.81:0/3063894897 wait complete. 2024-09-16T01:23:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.817+0000 7f8b3baeb640 1 Processor -- start 2024-09-16T01:23:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.817+0000 7f8b3baeb640 1 -- start start 2024-09-16T01:23:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b3baeb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b34071180 0x7f8b341599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b3baeb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b340af210 0x7f8b34146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b3baeb640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b3415e7f0 0x7f8b340b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b3baeb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8b340b7250 con 0x7f8b34071180 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b3baeb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8b340b6150 con 0x7f8b340af210 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b3baeb640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8b340b73d0 con 0x7f8b3415e7f0 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b39887640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b34071180 0x7f8b341599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b39887640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b34071180 0x7f8b341599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38834/0 (socket says 172.21.15.81:38834) 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b39887640 1 -- 172.21.15.81:0/1138522589 learned_addr learned my addr 172.21.15.81:0/1138522589 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b39086640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b340af210 0x7f8b34146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b3a088640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b3415e7f0 0x7f8b340b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b39887640 1 -- 172.21.15.81:0/1138522589 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b3415e7f0 msgr2=0x7f8b340b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b39887640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b3415e7f0 0x7f8b340b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b39887640 1 -- 172.21.15.81:0/1138522589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b340af210 msgr2=0x7f8b34146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b39887640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b340af210 0x7f8b34146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b39887640 1 -- 172.21.15.81:0/1138522589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b34159f20 con 0x7f8b34071180 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b3a088640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b3415e7f0 0x7f8b340b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:58.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b39086640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b340af210 0x7f8b34146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b39887640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b34071180 0x7f8b341599e0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000d5f0 tx=0x7f8b3000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b2a7fc640 1 -- 172.21.15.81:0/1138522589 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b300125f0 con 0x7f8b34071180 2024-09-16T01:23:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b2a7fc640 1 -- 172.21.15.81:0/1138522589 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b30019070 con 0x7f8b34071180 2024-09-16T01:23:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b3baeb640 1 -- 172.21.15.81:0/1138522589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3415a1c0 con 0x7f8b34071180 2024-09-16T01:23:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b2a7fc640 1 -- 172.21.15.81:0/1138522589 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b300129d0 con 0x7f8b34071180 2024-09-16T01:23:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.818+0000 7f8b3baeb640 1 -- 172.21.15.81:0/1138522589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b3415a780 con 0x7f8b34071180 2024-09-16T01:23:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.819+0000 7f8b3baeb640 1 -- 172.21.15.81:0/1138522589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b340b6d10 con 0x7f8b34071180 2024-09-16T01:23:58.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.820+0000 7f8b2a7fc640 1 -- 172.21.15.81:0/1138522589 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8b30012b70 con 0x7f8b34071180 2024-09-16T01:23:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.820+0000 7f8b2a7fc640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8b1806c2b0 0x7f8b1806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.820+0000 7f8b39086640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8b1806c2b0 0x7f8b1806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.820+0000 7f8b2a7fc640 1 -- 172.21.15.81:0/1138522589 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 5249+0+0 (secure 0 0 0) 0x7f8b3008b670 con 0x7f8b34071180 2024-09-16T01:23:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.821+0000 7f8b39086640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8b1806c2b0 0x7f8b1806e770 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8b341f7de0 tx=0x7f8b24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:58.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.825+0000 7f8b2a7fc640 1 -- 172.21.15.81:0/1138522589 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b30059fa0 con 0x7f8b34071180 2024-09-16T01:23:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:58.989+0000 7f8b3baeb640 1 -- 172.21.15.81:0/1138522589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8b34070f40 con 0x7f8b34071180 2024-09-16T01:23:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.040+0000 7f8b2a7fc640 1 -- 172.21.15.81:0/1138522589 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v146) ==== 138+0+0 (secure 0 0 0) 0x7f8b300598a0 con 0x7f8b34071180 2024-09-16T01:23:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-16T01:23:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.042+0000 7f8b3baeb640 1 -- 172.21.15.81:0/1138522589 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8b1806c2b0 msgr2=0x7f8b1806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.042+0000 7f8b3baeb640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8b1806c2b0 0x7f8b1806e770 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f8b341f7de0 tx=0x7f8b24009040 comp rx=0 tx=0).stop 2024-09-16T01:23:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.042+0000 7f8b3baeb640 1 -- 172.21.15.81:0/1138522589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b34071180 msgr2=0x7f8b341599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.042+0000 7f8b3baeb640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b34071180 0x7f8b341599e0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000d5f0 tx=0x7f8b3000dab0 comp rx=0 tx=0).stop 2024-09-16T01:23:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.042+0000 7f8b3baeb640 1 -- 172.21.15.81:0/1138522589 shutdown_connections 2024-09-16T01:23:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.042+0000 7f8b3baeb640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f8b1806c2b0 0x7f8b1806e770 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.042+0000 7f8b3baeb640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8b3415e7f0 0x7f8b340b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.042+0000 7f8b3baeb640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b340af210 0x7f8b34146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.042+0000 7f8b3baeb640 1 --2- 172.21.15.81:0/1138522589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b34071180 0x7f8b341599e0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.042+0000 7f8b3baeb640 1 -- 172.21.15.81:0/1138522589 >> 172.21.15.81:0/1138522589 conn(0x7f8b340b3f30 msgr2=0x7f8b340b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.043+0000 7f8b3baeb640 1 -- 172.21.15.81:0/1138522589 shutdown_connections 2024-09-16T01:23:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.043+0000 7f8b3baeb640 1 -- 172.21.15.81:0/1138522589 wait complete. 2024-09-16T01:23:59.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-16T01:23:59.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.163+0000 7f5a01065640 1 Processor -- start 2024-09-16T01:23:59.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.164+0000 7f5a01065640 1 -- start start 2024-09-16T01:23:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.164+0000 7f5a01065640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f59fc15b570 0x7f59fc071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.164+0000 7f5a01065640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc15b950 0x7f59fc0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.164+0000 7f5a01065640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59fc073b20 con 0x7f59fc0ccf50 2024-09-16T01:23:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.164+0000 7f5a01065640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f59fc0740e0 con 0x7f59fc15b570 2024-09-16T01:23:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.164+0000 7f5a01065640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f59fc073e00 con 0x7f59fc15b950 2024-09-16T01:23:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59fb59e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f59fc0ccf50 0x7f59fc0cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53306/0 (socket says 172.21.15.81:53306) 2024-09-16T01:23:59.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59fb59e640 1 -- 172.21.15.81:0/800195730 learned_addr learned my addr 172.21.15.81:0/800195730 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59fa59c640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc15b950 0x7f59fc0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59fad9d640 1 --2- 172.21.15.81:0/800195730 >> v2:172.21.15.102:3300/0 conn(0x7f59fc15b570 0x7f59fc071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1634281655 0 0) 0x7f59fc073b20 con 0x7f59fc0ccf50 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59e4003520 con 0x7f59fc0ccf50 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4254509792 0 0) 0x7f59e4003520 con 0x7f59fc0ccf50 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc15b950 msgr2=0x7f59fc0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc15b950 0x7f59fc0cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 >> v2:172.21.15.102:3300/0 conn(0x7f59fc15b570 msgr2=0x7f59fc071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 --2- 172.21.15.81:0/800195730 >> v2:172.21.15.102:3300/0 conn(0x7f59fc15b570 0x7f59fc071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59fc0cf320 con 0x7f59fc0ccf50 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f59f40019f0 con 0x7f59fc0ccf50 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59fa59c640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc15b950 0x7f59fc0cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:59.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59fad9d640 1 --2- 172.21.15.81:0/800195730 >> v2:172.21.15.102:3300/0 conn(0x7f59fc15b570 0x7f59fc071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 >> v1:172.21.15.81:6789/0 conn(0x7f59fc0ccf50 legacy=0x7f59fc0cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59e40039b0 0x7f59e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59e4004800 0x7f59e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc15b950 0x7f59e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc0740e0 con 0x7f59e40039b0 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc073e00 con 0x7f59e4004800 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f59e400b9c0 con 0x7f59fc15b950 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59fad9d640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59e40039b0 0x7f59e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59fa59c640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59e4004800 0x7f59e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.165+0000 7f59fb59e640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc15b950 0x7f59e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.166+0000 7f59fad9d640 1 -- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc15b950 msgr2=0x7f59e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.166+0000 7f59fad9d640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc15b950 0x7f59e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.166+0000 7f59fad9d640 1 -- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59e4004800 msgr2=0x7f59e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:23:59.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.166+0000 7f59fad9d640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59e4004800 0x7f59e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:59.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.166+0000 7f59fad9d640 1 -- 172.21.15.81:0/800195730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e4003520 con 0x7f59e40039b0 2024-09-16T01:23:59.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.166+0000 7f59fb59e640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc15b950 0x7f59e40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:23:59.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.166+0000 7f59fad9d640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59e40039b0 0x7f59e4003dd0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009c90 tx=0x7f59e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a96c38dd5b31ec server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:59.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.166+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec036070 con 0x7f59e40039b0 2024-09-16T01:23:59.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.166+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ec031400 con 0x7f59e40039b0 2024-09-16T01:23:59.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.166+0000 7f59f9d9b640 1 -- 172.21.15.81:0/800195730 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec009860 con 0x7f59e40039b0 2024-09-16T01:23:59.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.167+0000 7f5a01065640 1 -- 172.21.15.81:0/800195730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59e40039b0 msgr2=0x7f59e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:59.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.167+0000 7f5a01065640 1 --2- 172.21.15.81:0/800195730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59e40039b0 0x7f59e4003dd0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009c90 tx=0x7f59e4005830 comp rx=0 tx=0).stop 2024-09-16T01:23:59.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.167+0000 7f59fb59e640 1 -- 172.21.15.81:0/800195730 reap_dead start 2024-09-16T01:23:59.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.167+0000 7f5a01065640 1 -- 172.21.15.81:0/800195730 shutdown_connections 2024-09-16T01:23:59.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.167+0000 7f5a01065640 1 -- 172.21.15.81:0/800195730 >> 172.21.15.81:0/800195730 conn(0x7f59fc06bdf0 msgr2=0x7f59fc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:23:59.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.167+0000 7f5a01065640 1 -- 172.21.15.81:0/800195730 shutdown_connections 2024-09-16T01:23:59.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.167+0000 7f5a01065640 1 -- 172.21.15.81:0/800195730 wait complete. 2024-09-16T01:23:59.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.168+0000 7f5a01065640 1 Processor -- start 2024-09-16T01:23:59.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.168+0000 7f5a01065640 1 -- start start 2024-09-16T01:23:59.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.169+0000 7f5a01065640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59e40039b0 0x7f59fc1494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:59.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.169+0000 7f5a01065640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc0aea20 0x7f59fc1468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:59.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.169+0000 7f5a01065640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59fc15d9b0 0x7f59fc15de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:59.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.169+0000 7f5a01065640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc0cf840 con 0x7f59e40039b0 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.169+0000 7f5a01065640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f59fc072450 con 0x7f59fc15d9b0 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.169+0000 7f5a01065640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f59fc0cf9c0 con 0x7f59fc0aea20 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.169+0000 7f59fad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59e40039b0 0x7f59fc1494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.169+0000 7f59fad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59e40039b0 0x7f59fc1494a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38850/0 (socket says 172.21.15.81:38850) 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.169+0000 7f59fad9d640 1 -- 172.21.15.81:0/1208755473 learned_addr learned my addr 172.21.15.81:0/1208755473 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f59fa59c640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc0aea20 0x7f59fc1468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f59fb59e640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59fc15d9b0 0x7f59fc15de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f59fad9d640 1 -- 172.21.15.81:0/1208755473 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc0aea20 msgr2=0x7f59fc1468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f59fad9d640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc0aea20 0x7f59fc1468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f59fad9d640 1 -- 172.21.15.81:0/1208755473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59fc15d9b0 msgr2=0x7f59fc15de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f59fad9d640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59fc15d9b0 0x7f59fc15de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f59fad9d640 1 -- 172.21.15.81:0/1208755473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59fc152d80 con 0x7f59e40039b0 2024-09-16T01:23:59.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f59fad9d640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59e40039b0 0x7f59fc1494a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009db0 tx=0x7f59ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:59.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f59e37fe640 1 -- 172.21.15.81:0/1208755473 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec040020 con 0x7f59e40039b0 2024-09-16T01:23:59.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f59e37fe640 1 -- 172.21.15.81:0/1208755473 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ec03b680 con 0x7f59e40039b0 2024-09-16T01:23:59.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f59e37fe640 1 -- 172.21.15.81:0/1208755473 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec036040 con 0x7f59e40039b0 2024-09-16T01:23:59.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f5a01065640 1 -- 172.21.15.81:0/1208755473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59fc152ff0 con 0x7f59e40039b0 2024-09-16T01:23:59.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.170+0000 7f5a01065640 1 -- 172.21.15.81:0/1208755473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59fc14f830 con 0x7f59e40039b0 2024-09-16T01:23:59.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.171+0000 7f5a01065640 1 -- 172.21.15.81:0/1208755473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59fc071e40 con 0x7f59e40039b0 2024-09-16T01:23:59.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.172+0000 7f59e37fe640 1 -- 172.21.15.81:0/1208755473 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f59ec043020 con 0x7f59e40039b0 2024-09-16T01:23:59.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.172+0000 7f59e37fe640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f59e806c2e0 0x7f59e806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:23:59.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.172+0000 7f59e37fe640 1 -- 172.21.15.81:0/1208755473 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(146..146 src has 1..146) ==== 5619+0+0 (secure 0 0 0) 0x7f59ec0ac280 con 0x7f59e40039b0 2024-09-16T01:23:59.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.172+0000 7f59fa59c640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f59e806c2e0 0x7f59e806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:23:59.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.173+0000 7f59fa59c640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f59e806c2e0 0x7f59e806e7a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f59fc15e550 tx=0x7f59f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:23:59.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.176+0000 7f59e37fe640 1 -- 172.21.15.81:0/1208755473 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59ec04a020 con 0x7f59e40039b0 2024-09-16T01:23:59.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:23:59.340+0000 7f5a01065640 1 -- 172.21.15.81:0/1208755473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f59fc14ffc0 con 0x7f59e40039b0 2024-09-16T01:24:00.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.042+0000 7f59e37fe640 1 -- 172.21.15.81:0/1208755473 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v147) ==== 170+0+0 (secure 0 0 0) 0x7f59ec07aa90 con 0x7f59e40039b0 2024-09-16T01:24:00.044 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-16T01:24:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.045+0000 7f5a01065640 1 -- 172.21.15.81:0/1208755473 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f59e806c2e0 msgr2=0x7f59e806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.045+0000 7f5a01065640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f59e806c2e0 0x7f59e806e7a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f59fc15e550 tx=0x7f59f0008040 comp rx=0 tx=0).stop 2024-09-16T01:24:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.045+0000 7f5a01065640 1 -- 172.21.15.81:0/1208755473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59e40039b0 msgr2=0x7f59fc1494a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.045+0000 7f5a01065640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59e40039b0 0x7f59fc1494a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009db0 tx=0x7f59ec004730 comp rx=0 tx=0).stop 2024-09-16T01:24:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.045+0000 7f5a01065640 1 -- 172.21.15.81:0/1208755473 shutdown_connections 2024-09-16T01:24:00.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.045+0000 7f5a01065640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f59e806c2e0 0x7f59e806e7a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.045+0000 7f5a01065640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59fc15d9b0 0x7f59fc15de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.045+0000 7f5a01065640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59fc0aea20 0x7f59fc1468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.045+0000 7f5a01065640 1 --2- 172.21.15.81:0/1208755473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59e40039b0 0x7f59fc1494a0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.045+0000 7f5a01065640 1 -- 172.21.15.81:0/1208755473 >> 172.21.15.81:0/1208755473 conn(0x7f59fc06bdf0 msgr2=0x7f59fc0af780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:00.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.045+0000 7f5a01065640 1 -- 172.21.15.81:0/1208755473 shutdown_connections 2024-09-16T01:24:00.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.045+0000 7f5a01065640 1 -- 172.21.15.81:0/1208755473 wait complete. 2024-09-16T01:24:00.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-16T01:24:00.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.169+0000 7f38b4f98640 1 Processor -- start 2024-09-16T01:24:00.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.169+0000 7f38b4f98640 1 -- start start 2024-09-16T01:24:00.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.170+0000 7f38b4f98640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38b0162340 0x7f38b006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:00.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.170+0000 7f38b4f98640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b015ff70 con 0x7f38b00cf280 2024-09-16T01:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.170+0000 7f38b4f98640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b00d4d10 con 0x7f38b0162e30 2024-09-16T01:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.170+0000 7f38b4f98640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f38b01632a0 con 0x7f38b0162340 2024-09-16T01:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.170+0000 7f38ae59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38b0162340 0x7f38b006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.170+0000 7f38add9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f38b00cf280 0x7f38b0162720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53308/0 (socket says 172.21.15.81:53308) 2024-09-16T01:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.170+0000 7f38add9b640 1 -- 172.21.15.81:0/3973296972 learned_addr learned my addr 172.21.15.81:0/3973296972 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.170+0000 7f38ae59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38b0162340 0x7f38b006d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38858/0 (socket says 172.21.15.81:38858) 2024-09-16T01:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.171+0000 7f38ae59c640 1 -- 172.21.15.81:0/3973296972 >> v1:172.21.15.102:6789/0 conn(0x7f38b0162e30 legacy=0x7f38b00d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.171+0000 7f38ae59c640 1 -- 172.21.15.81:0/3973296972 >> v1:172.21.15.81:6789/0 conn(0x7f38b00cf280 legacy=0x7f38b0162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.171+0000 7f38ad59a640 1 -- 172.21.15.81:0/3973296972 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2212321780 0 0) 0x7f38b015ff70 con 0x7f38b00cf280 2024-09-16T01:24:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.171+0000 7f38ae59c640 1 -- 172.21.15.81:0/3973296972 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b00d4ff0 con 0x7f38b0162340 2024-09-16T01:24:00.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.171+0000 7f38ae59c640 1 --2- 172.21.15.81:0/3973296972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b0162340 0x7f38b006d740 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009d90 tx=0x7f38a802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bac6c93dba9f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.171+0000 7f38ad59a640 1 -- 172.21.15.81:0/3973296972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8031600 con 0x7f38b0162340 2024-09-16T01:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.171+0000 7f38ad59a640 1 -- 172.21.15.81:0/3973296972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a80317a0 con 0x7f38b0162340 2024-09-16T01:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.171+0000 7f38ad59a640 1 -- 172.21.15.81:0/3973296972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8031b70 con 0x7f38b0162340 2024-09-16T01:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.172+0000 7f38b4f98640 1 -- 172.21.15.81:0/3973296972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b0162340 msgr2=0x7f38b006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.172+0000 7f38b4f98640 1 --2- 172.21.15.81:0/3973296972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b0162340 0x7f38b006d740 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009d90 tx=0x7f38a802a610 comp rx=0 tx=0).stop 2024-09-16T01:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.172+0000 7f38b4f98640 1 -- 172.21.15.81:0/3973296972 shutdown_connections 2024-09-16T01:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.172+0000 7f38b4f98640 1 --2- 172.21.15.81:0/3973296972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b0162340 0x7f38b006d740 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.172+0000 7f38b4f98640 1 -- 172.21.15.81:0/3973296972 >> 172.21.15.81:0/3973296972 conn(0x7f38b008bfc0 msgr2=0x7f38b00d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.172+0000 7f38b4f98640 1 -- 172.21.15.81:0/3973296972 shutdown_connections 2024-09-16T01:24:00.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.172+0000 7f38b4f98640 1 -- 172.21.15.81:0/3973296972 wait complete. 2024-09-16T01:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.173+0000 7f38b4f98640 1 Processor -- start 2024-09-16T01:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.173+0000 7f38b4f98640 1 -- start start 2024-09-16T01:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38b4f98640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38b00cf280 0x7f38b01561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38b4f98640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b0162340 0x7f38b00d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38b4f98640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38b0162e30 0x7f38b00d1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38b4f98640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38b00d52d0 con 0x7f38b0162340 2024-09-16T01:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38b4f98640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f38b006de90 con 0x7f38b0162e30 2024-09-16T01:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38b4f98640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f38b00cf6c0 con 0x7f38b00cf280 2024-09-16T01:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38add9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b0162340 0x7f38b00d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38add9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b0162340 0x7f38b00d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38874/0 (socket says 172.21.15.81:38874) 2024-09-16T01:24:00.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38add9b640 1 -- 172.21.15.81:0/3468024529 learned_addr learned my addr 172.21.15.81:0/3468024529 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38aed9d640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38b0162e30 0x7f38b00d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38ae59c640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38b00cf280 0x7f38b01561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38add9b640 1 -- 172.21.15.81:0/3468024529 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38b00cf280 msgr2=0x7f38b01561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38add9b640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38b00cf280 0x7f38b01561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38add9b640 1 -- 172.21.15.81:0/3468024529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38b0162e30 msgr2=0x7f38b00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.174+0000 7f38add9b640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38b0162e30 0x7f38b00d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.175+0000 7f38add9b640 1 -- 172.21.15.81:0/3468024529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b00ce3a0 con 0x7f38b0162340 2024-09-16T01:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.175+0000 7f38add9b640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b0162340 0x7f38b00d0ee0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f389800c4d0 tx=0x7f389800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.175+0000 7f38a6ffd640 1 -- 172.21.15.81:0/3468024529 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898007480 con 0x7f38b0162340 2024-09-16T01:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.175+0000 7f38a6ffd640 1 -- 172.21.15.81:0/3468024529 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38980057a0 con 0x7f38b0162340 2024-09-16T01:24:00.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.175+0000 7f38b4f98640 1 -- 172.21.15.81:0/3468024529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b00ce0c0 con 0x7f38b0162340 2024-09-16T01:24:00.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.175+0000 7f38a6ffd640 1 -- 172.21.15.81:0/3468024529 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898007620 con 0x7f38b0162340 2024-09-16T01:24:00.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.175+0000 7f38b4f98640 1 -- 172.21.15.81:0/3468024529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b00b78f0 con 0x7f38b0162340 2024-09-16T01:24:00.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.176+0000 7f38b4f98640 1 -- 172.21.15.81:0/3468024529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b006d740 con 0x7f38b0162340 2024-09-16T01:24:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.176+0000 7f38a6ffd640 1 -- 172.21.15.81:0/3468024529 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3898005b50 con 0x7f38b0162340 2024-09-16T01:24:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.177+0000 7f38a6ffd640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f389006c2b0 0x7f389006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.177+0000 7f38ae59c640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f389006c2b0 0x7f389006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.177+0000 7f38a6ffd640 1 -- 172.21.15.81:0/3468024529 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 6001+0+0 (secure 0 0 0) 0x7f389808b100 con 0x7f38b0162340 2024-09-16T01:24:00.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.178+0000 7f38ae59c640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f389006c2b0 0x7f389006e770 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f38a8034000 tx=0x7f38a802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:00.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.182+0000 7f38a6ffd640 1 -- 172.21.15.81:0/3468024529 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38980182b0 con 0x7f38b0162340 2024-09-16T01:24:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:00.381+0000 7f38b4f98640 1 -- 172.21.15.81:0/3468024529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f38b00ba450 con 0x7f38b0162340 2024-09-16T01:24:01.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.056+0000 7f38a6ffd640 1 -- 172.21.15.81:0/3468024529 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v81) ==== 174+0+0 (secure 0 0 0) 0x7f38980597d0 con 0x7f38b0162340 2024-09-16T01:24:01.058 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 23 and data pool 24 2024-09-16T01:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.059+0000 7f38b4f98640 1 -- 172.21.15.81:0/3468024529 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f389006c2b0 msgr2=0x7f389006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.059+0000 7f38b4f98640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f389006c2b0 0x7f389006e770 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f38a8034000 tx=0x7f38a802f000 comp rx=0 tx=0).stop 2024-09-16T01:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.060+0000 7f38b4f98640 1 -- 172.21.15.81:0/3468024529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b0162340 msgr2=0x7f38b00d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.060+0000 7f38b4f98640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b0162340 0x7f38b00d0ee0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f389800c4d0 tx=0x7f389800c990 comp rx=0 tx=0).stop 2024-09-16T01:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.060+0000 7f38b4f98640 1 -- 172.21.15.81:0/3468024529 shutdown_connections 2024-09-16T01:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.060+0000 7f38b4f98640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f389006c2b0 0x7f389006e770 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.060+0000 7f38b4f98640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f38b0162e30 0x7f38b00d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.060+0000 7f38b4f98640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b0162340 0x7f38b00d0ee0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.060+0000 7f38b4f98640 1 --2- 172.21.15.81:0/3468024529 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f38b00cf280 0x7f38b01561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.060+0000 7f38b4f98640 1 -- 172.21.15.81:0/3468024529 >> 172.21.15.81:0/3468024529 conn(0x7f38b008bfc0 msgr2=0x7f38b006e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:01.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.060+0000 7f38b4f98640 1 -- 172.21.15.81:0/3468024529 shutdown_connections 2024-09-16T01:24:01.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.060+0000 7f38b4f98640 1 -- 172.21.15.81:0/3468024529 wait complete. 2024-09-16T01:24:01.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:24:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.173+0000 7f21462d2640 1 Processor -- start 2024-09-16T01:24:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.173+0000 7f21462d2640 1 -- start start 2024-09-16T01:24:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.174+0000 7f21462d2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f214015e740 0x7f21400d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.174+0000 7f21462d2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f214006dbd0 0x7f214006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.174+0000 7f21462d2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f214006e040 con 0x7f214009b690 2024-09-16T01:24:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.174+0000 7f21462d2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f214015eb20 con 0x7f214006dbd0 2024-09-16T01:24:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.174+0000 7f21462d2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f214006d260 con 0x7f214015e740 2024-09-16T01:24:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.174+0000 7f214486f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f214006dbd0 0x7f214006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.174+0000 7f214486f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f214006dbd0 0x7f214006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51112/0 (socket says 172.21.15.81:51112) 2024-09-16T01:24:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.174+0000 7f214486f640 1 -- 172.21.15.81:0/3420218117 learned_addr learned my addr 172.21.15.81:0/3420218117 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.174+0000 7f213ffff640 1 --2- 172.21.15.81:0/3420218117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f214015e740 0x7f21400d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.175+0000 7f214486f640 1 -- 172.21.15.81:0/3420218117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f214015e740 msgr2=0x7f21400d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.175+0000 7f214486f640 1 --2- 172.21.15.81:0/3420218117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f214015e740 0x7f21400d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.175+0000 7f214486f640 1 -- 172.21.15.81:0/3420218117 >> v1:172.21.15.102:6789/0 conn(0x7f214009b690 legacy=0x7f214006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.175+0000 7f214486f640 1 -- 172.21.15.81:0/3420218117 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21400d0780 con 0x7f214006dbd0 2024-09-16T01:24:01.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.175+0000 7f213ffff640 1 --2- 172.21.15.81:0/3420218117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f214015e740 0x7f21400d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.175+0000 7f214486f640 1 --2- 172.21.15.81:0/3420218117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214006dbd0 0x7f214006cd20 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f2138009e80 tx=0x7f213802a7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425c4347651a1230 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.175+0000 7f213effd640 1 -- 172.21.15.81:0/3420218117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138036070 con 0x7f214006dbd0 2024-09-16T01:24:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.176+0000 7f213effd640 1 -- 172.21.15.81:0/3420218117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2138031600 con 0x7f214006dbd0 2024-09-16T01:24:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.176+0000 7f213effd640 1 -- 172.21.15.81:0/3420218117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21380319d0 con 0x7f214006dbd0 2024-09-16T01:24:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.176+0000 7f21462d2640 1 -- 172.21.15.81:0/3420218117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214006dbd0 msgr2=0x7f214006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.176+0000 7f21462d2640 1 --2- 172.21.15.81:0/3420218117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214006dbd0 0x7f214006cd20 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f2138009e80 tx=0x7f213802a7e0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.176+0000 7f21462d2640 1 -- 172.21.15.81:0/3420218117 shutdown_connections 2024-09-16T01:24:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.176+0000 7f21462d2640 1 --2- 172.21.15.81:0/3420218117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214006dbd0 0x7f214006cd20 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.176+0000 7f21462d2640 1 --2- 172.21.15.81:0/3420218117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f214015e740 0x7f21400d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.176+0000 7f21462d2640 1 -- 172.21.15.81:0/3420218117 >> 172.21.15.81:0/3420218117 conn(0x7f21400d23a0 msgr2=0x7f21400d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:01.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.176+0000 7f21462d2640 1 -- 172.21.15.81:0/3420218117 shutdown_connections 2024-09-16T01:24:01.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.176+0000 7f21462d2640 1 -- 172.21.15.81:0/3420218117 wait complete. 2024-09-16T01:24:01.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.177+0000 7f21462d2640 1 Processor -- start 2024-09-16T01:24:01.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.177+0000 7f21462d2640 1 -- start start 2024-09-16T01:24:01.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.178+0000 7f21462d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214006dbd0 0x7f214015db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.178+0000 7f21462d2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f214009b690 0x7f21400b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.178+0000 7f21462d2640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f214015e740 0x7f21400b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.178+0000 7f21462d2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f21400d1020 con 0x7f214006dbd0 2024-09-16T01:24:01.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.178+0000 7f21462d2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f21400d0d40 con 0x7f214009b690 2024-09-16T01:24:01.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.178+0000 7f21462d2640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f214009ba90 con 0x7f214015e740 2024-09-16T01:24:01.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.178+0000 7f213ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214006dbd0 0x7f214015db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.178+0000 7f213ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214006dbd0 0x7f214015db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51124/0 (socket says 172.21.15.81:51124) 2024-09-16T01:24:01.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.178+0000 7f213ffff640 1 -- 172.21.15.81:0/393826374 learned_addr learned my addr 172.21.15.81:0/393826374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:01.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.178+0000 7f213f7fe640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f214009b690 0x7f21400b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.178+0000 7f214486f640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f214015e740 0x7f21400b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.179+0000 7f213ffff640 1 -- 172.21.15.81:0/393826374 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f214015e740 msgr2=0x7f21400b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.179+0000 7f213ffff640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f214015e740 0x7f21400b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.179+0000 7f213ffff640 1 -- 172.21.15.81:0/393826374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f214009b690 msgr2=0x7f21400b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.179+0000 7f213ffff640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f214009b690 0x7f21400b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.179+0000 7f213ffff640 1 -- 172.21.15.81:0/393826374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21400b5320 con 0x7f214006dbd0 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.179+0000 7f213ffff640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214006dbd0 0x7f214015db10 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f213000e730 tx=0x7f213000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.179+0000 7f213cff9640 1 -- 172.21.15.81:0/393826374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213000f040 con 0x7f214006dbd0 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.179+0000 7f213cff9640 1 -- 172.21.15.81:0/393826374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2130004230 con 0x7f214006dbd0 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.179+0000 7f21462d2640 1 -- 172.21.15.81:0/393826374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21400b7d30 con 0x7f214006dbd0 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.179+0000 7f213cff9640 1 -- 172.21.15.81:0/393826374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213000ee40 con 0x7f214006dbd0 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.179+0000 7f21462d2640 1 -- 172.21.15.81:0/393826374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21400b58a0 con 0x7f214006dbd0 2024-09-16T01:24:01.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.180+0000 7f21462d2640 1 -- 172.21.15.81:0/393826374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21400d1cb0 con 0x7f214006dbd0 2024-09-16T01:24:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.180+0000 7f213cff9640 1 -- 172.21.15.81:0/393826374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f213000c6d0 con 0x7f214006dbd0 2024-09-16T01:24:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.181+0000 7f213cff9640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f212c06c2b0 0x7f212c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.181+0000 7f213cff9640 1 -- 172.21.15.81:0/393826374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f213008b180 con 0x7f214006dbd0 2024-09-16T01:24:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.181+0000 7f213f7fe640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f212c06c2b0 0x7f212c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.181+0000 7f213f7fe640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f212c06c2b0 0x7f212c06e770 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f214006e4c0 tx=0x7f2134009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:01.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.185+0000 7f213cff9640 1 -- 172.21.15.81:0/393826374 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2130017020 con 0x7f214006dbd0 2024-09-16T01:24:01.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.351+0000 7f21462d2640 1 -- 172.21.15.81:0/393826374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21400b8320 con 0x7f214006dbd0 2024-09-16T01:24:01.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.352+0000 7f213cff9640 1 -- 172.21.15.81:0/393826374 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) ==== 74+0+16957 (secure 0 0 0) 0x7f21300591a0 con 0x7f214006dbd0 2024-09-16T01:24:01.354 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:01.355 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":148,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:24:00.383607+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:23:59.008759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-16T01:23:59.360280+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:24:01.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.354+0000 7f21462d2640 1 -- 172.21.15.81:0/393826374 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f212c06c2b0 msgr2=0x7f212c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.354+0000 7f21462d2640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f212c06c2b0 0x7f212c06e770 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f214006e4c0 tx=0x7f2134009040 comp rx=0 tx=0).stop 2024-09-16T01:24:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.354+0000 7f21462d2640 1 -- 172.21.15.81:0/393826374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214006dbd0 msgr2=0x7f214015db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.354+0000 7f21462d2640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214006dbd0 0x7f214015db10 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f213000e730 tx=0x7f213000ebf0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.355+0000 7f21462d2640 1 -- 172.21.15.81:0/393826374 shutdown_connections 2024-09-16T01:24:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.355+0000 7f21462d2640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f212c06c2b0 0x7f212c06e770 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.355+0000 7f21462d2640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f214015e740 0x7f21400b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.355+0000 7f21462d2640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f214009b690 0x7f21400b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.355+0000 7f21462d2640 1 --2- 172.21.15.81:0/393826374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214006dbd0 0x7f214015db10 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.355+0000 7f21462d2640 1 -- 172.21.15.81:0/393826374 >> 172.21.15.81:0/393826374 conn(0x7f21400d23a0 msgr2=0x7f21400b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.355+0000 7f21462d2640 1 -- 172.21.15.81:0/393826374 shutdown_connections 2024-09-16T01:24:01.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.355+0000 7f21462d2640 1 -- 172.21.15.81:0/393826374 wait complete. 2024-09-16T01:24:01.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:24:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.465+0000 7f4a2832a640 1 Processor -- start 2024-09-16T01:24:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.465+0000 7f4a2832a640 1 -- start start 2024-09-16T01:24:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.466+0000 7f4a2832a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4a200afd70 0x7f4a20160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.466+0000 7f4a2832a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a20160d60 con 0x7f4a200b5f80 2024-09-16T01:24:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.466+0000 7f4a2832a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a2006f5f0 con 0x7f4a200ce660 2024-09-16T01:24:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.466+0000 7f4a2832a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4a2006fdb0 con 0x7f4a200afd70 2024-09-16T01:24:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.466+0000 7f4a258c5640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4a200b5f80 0x7f4a2006e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54116/0 (socket says 172.21.15.81:54116) 2024-09-16T01:24:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.466+0000 7f4a258c5640 1 -- 172.21.15.81:0/2217604745 learned_addr learned my addr 172.21.15.81:0/2217604745 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.466+0000 7f4a260c6640 1 --2- 172.21.15.81:0/2217604745 >> v2:172.21.15.102:3300/0 conn(0x7f4a200afd70 0x7f4a20160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.466+0000 7f4a250c4640 1 -- 172.21.15.81:0/2217604745 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3177794278 0 0) 0x7f4a10001110 con 0x7f4a200b5f80 2024-09-16T01:24:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.466+0000 7f4a250c4640 1 -- 172.21.15.81:0/2217604745 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a0c003520 con 0x7f4a200b5f80 2024-09-16T01:24:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.466+0000 7f4a250c4640 1 -- 172.21.15.81:0/2217604745 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2042872114 0 0) 0x7f4a0c003520 con 0x7f4a200b5f80 2024-09-16T01:24:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.467+0000 7f4a260c6640 1 -- 172.21.15.81:0/2217604745 >> v1:172.21.15.102:6789/0 conn(0x7f4a200ce660 legacy=0x7f4a2006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.467+0000 7f4a260c6640 1 -- 172.21.15.81:0/2217604745 >> v1:172.21.15.81:6789/0 conn(0x7f4a200b5f80 legacy=0x7f4a2006e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.467+0000 7f4a260c6640 1 -- 172.21.15.81:0/2217604745 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a20070090 con 0x7f4a200afd70 2024-09-16T01:24:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.467+0000 7f4a260c6640 1 --2- 172.21.15.81:0/2217604745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a200afd70 0x7f4a20160820 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009d90 tx=0x7f4a1c02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce60bef729b2fc94 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.467+0000 7f4a250c4640 1 -- 172.21.15.81:0/2217604745 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a10001840 con 0x7f4a200afd70 2024-09-16T01:24:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.467+0000 7f4a250c4640 1 -- 172.21.15.81:0/2217604745 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1c007540 con 0x7f4a200afd70 2024-09-16T01:24:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.467+0000 7f4a250c4640 1 -- 172.21.15.81:0/2217604745 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c0078f0 con 0x7f4a200afd70 2024-09-16T01:24:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.468+0000 7f4a2832a640 1 -- 172.21.15.81:0/2217604745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a200afd70 msgr2=0x7f4a20160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.468+0000 7f4a2832a640 1 --2- 172.21.15.81:0/2217604745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a200afd70 0x7f4a20160820 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c009d90 tx=0x7f4a1c02a680 comp rx=0 tx=0).stop 2024-09-16T01:24:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.468+0000 7f4a2832a640 1 -- 172.21.15.81:0/2217604745 shutdown_connections 2024-09-16T01:24:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.468+0000 7f4a2832a640 1 --2- 172.21.15.81:0/2217604745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a200afd70 0x7f4a20160820 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.468+0000 7f4a2832a640 1 -- 172.21.15.81:0/2217604745 >> 172.21.15.81:0/2217604745 conn(0x7f4a2006bc10 msgr2=0x7f4a2006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.468+0000 7f4a2832a640 1 -- 172.21.15.81:0/2217604745 shutdown_connections 2024-09-16T01:24:01.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.468+0000 7f4a2832a640 1 -- 172.21.15.81:0/2217604745 wait complete. 2024-09-16T01:24:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.469+0000 7f4a2832a640 1 Processor -- start 2024-09-16T01:24:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.469+0000 7f4a2832a640 1 -- start start 2024-09-16T01:24:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a2832a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a200afd70 0x7f4a2015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a2832a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200b5f80 0x7f4a200ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a2832a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a200ce660 0x7f4a2006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a2832a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a2006fa80 con 0x7f4a200b5f80 2024-09-16T01:24:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a2832a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4a20070650 con 0x7f4a200ce660 2024-09-16T01:24:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a2832a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4a200b0150 con 0x7f4a200afd70 2024-09-16T01:24:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a258c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200b5f80 0x7f4a200ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a258c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200b5f80 0x7f4a200ae3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51138/0 (socket says 172.21.15.81:51138) 2024-09-16T01:24:01.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a258c5640 1 -- 172.21.15.81:0/3393332405 learned_addr learned my addr 172.21.15.81:0/3393332405 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a268c7640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a200ce660 0x7f4a2006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a260c6640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a200afd70 0x7f4a2015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a258c5640 1 -- 172.21.15.81:0/3393332405 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a200afd70 msgr2=0x7f4a2015cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a258c5640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a200afd70 0x7f4a2015cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a258c5640 1 -- 172.21.15.81:0/3393332405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a200ce660 msgr2=0x7f4a2006e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a258c5640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a200ce660 0x7f4a2006e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a258c5640 1 -- 172.21.15.81:0/3393332405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a200aee60 con 0x7f4a200b5f80 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a268c7640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a200ce660 0x7f4a2006e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.470+0000 7f4a260c6640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a200afd70 0x7f4a2015cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.471+0000 7f4a258c5640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200b5f80 0x7f4a200ae3a0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000c780 tx=0x7f4a1000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.471+0000 7f4a16ffd640 1 -- 172.21.15.81:0/3393332405 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a10017070 con 0x7f4a200b5f80 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.471+0000 7f4a16ffd640 1 -- 172.21.15.81:0/3393332405 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a10005ad0 con 0x7f4a200b5f80 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.471+0000 7f4a2832a640 1 -- 172.21.15.81:0/3393332405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a200af140 con 0x7f4a200b5f80 2024-09-16T01:24:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.471+0000 7f4a16ffd640 1 -- 172.21.15.81:0/3393332405 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a10007070 con 0x7f4a200b5f80 2024-09-16T01:24:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.471+0000 7f4a2832a640 1 -- 172.21.15.81:0/3393332405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a201503c0 con 0x7f4a200b5f80 2024-09-16T01:24:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.472+0000 7f4a2832a640 1 -- 172.21.15.81:0/3393332405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a20160060 con 0x7f4a200b5f80 2024-09-16T01:24:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.472+0000 7f4a16ffd640 1 -- 172.21.15.81:0/3393332405 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4a1001a070 con 0x7f4a200b5f80 2024-09-16T01:24:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.473+0000 7f4a16ffd640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4a0406c2b0 0x7f4a0406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.473+0000 7f4a16ffd640 1 -- 172.21.15.81:0/3393332405 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7f4a1008aaa0 con 0x7f4a200b5f80 2024-09-16T01:24:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.473+0000 7f4a260c6640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4a0406c2b0 0x7f4a0406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.473+0000 7f4a260c6640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4a0406c2b0 0x7f4a0406e770 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c034000 tx=0x7f4a1c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.477+0000 7f4a16ffd640 1 -- 172.21.15.81:0/3393332405 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a20160d60 con 0x7f4a200b5f80 2024-09-16T01:24:01.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.641+0000 7f4a2832a640 1 -- 172.21.15.81:0/3393332405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a20067fc0 con 0x7f4a200b5f80 2024-09-16T01:24:01.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.643+0000 7f4a16ffd640 1 -- 172.21.15.81:0/3393332405 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) ==== 74+0+16957 (secure 0 0 0) 0x7f4a10059110 con 0x7f4a200b5f80 2024-09-16T01:24:01.645 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:01.645 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":148,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:24:00.383607+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:23:59.008759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-16T01:23:59.360280+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:24:01.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.645+0000 7f4a2832a640 1 -- 172.21.15.81:0/3393332405 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4a0406c2b0 msgr2=0x7f4a0406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.645+0000 7f4a2832a640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4a0406c2b0 0x7f4a0406e770 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c034000 tx=0x7f4a1c02f000 comp rx=0 tx=0).stop 2024-09-16T01:24:01.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.645+0000 7f4a2832a640 1 -- 172.21.15.81:0/3393332405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200b5f80 msgr2=0x7f4a200ae3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.645+0000 7f4a2832a640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200b5f80 0x7f4a200ae3a0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f4a1000c780 tx=0x7f4a1000cc40 comp rx=0 tx=0).stop 2024-09-16T01:24:01.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.645+0000 7f4a2832a640 1 -- 172.21.15.81:0/3393332405 shutdown_connections 2024-09-16T01:24:01.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.645+0000 7f4a2832a640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f4a0406c2b0 0x7f4a0406e770 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.645+0000 7f4a2832a640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a200ce660 0x7f4a2006e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.645+0000 7f4a2832a640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a200b5f80 0x7f4a200ae3a0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.645+0000 7f4a2832a640 1 --2- 172.21.15.81:0/3393332405 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a200afd70 0x7f4a2015cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.645+0000 7f4a2832a640 1 -- 172.21.15.81:0/3393332405 >> 172.21.15.81:0/3393332405 conn(0x7f4a2006bc10 msgr2=0x7f4a200b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:01.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.645+0000 7f4a2832a640 1 -- 172.21.15.81:0/3393332405 shutdown_connections 2024-09-16T01:24:01.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.645+0000 7f4a2832a640 1 -- 172.21.15.81:0/3393332405 wait complete. 2024-09-16T01:24:01.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-16T01:24:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.758+0000 7fa0931c4640 1 Processor -- start 2024-09-16T01:24:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.758+0000 7fa0931c4640 1 -- start start 2024-09-16T01:24:01.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.758+0000 7fa0931c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa08c15e410 0x7fa08c0b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa0931c4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa08c06bc10 0x7fa08c06c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa0931c4640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa08c0ae240 con 0x7fa08c0b40c0 2024-09-16T01:24:01.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa0931c4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa08c06c580 con 0x7fa08c06bc10 2024-09-16T01:24:01.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa0931c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa08c0ae520 con 0x7fa08c15e410 2024-09-16T01:24:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa090f60640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa08c15e410 0x7fa08c0b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa091761640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa08c06bc10 0x7fa08c06c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa08bfff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa08c0b40c0 0x7fa08c0aff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:54840/0 (socket says 172.21.15.81:54840) 2024-09-16T01:24:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa08bfff640 1 -- 172.21.15.81:0/1019325774 learned_addr learned my addr 172.21.15.81:0/1019325774 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa08b7fe640 1 -- 172.21.15.81:0/1019325774 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347522357 0 0) 0x7fa08c0ae240 con 0x7fa08c0b40c0 2024-09-16T01:24:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa08b7fe640 1 -- 172.21.15.81:0/1019325774 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa07c003520 con 0x7fa08c0b40c0 2024-09-16T01:24:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa090f60640 1 -- 172.21.15.81:0/1019325774 >> v2:172.21.15.102:3300/0 conn(0x7fa08c06bc10 msgr2=0x7fa08c06c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa090f60640 1 --2- 172.21.15.81:0/1019325774 >> v2:172.21.15.102:3300/0 conn(0x7fa08c06bc10 0x7fa08c06c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa090f60640 1 -- 172.21.15.81:0/1019325774 >> v1:172.21.15.102:6789/0 conn(0x7fa08c0b40c0 legacy=0x7fa08c0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa090f60640 1 -- 172.21.15.81:0/1019325774 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c0ae800 con 0x7fa08c15e410 2024-09-16T01:24:01.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.759+0000 7fa091761640 1 --2- 172.21.15.81:0/1019325774 >> v2:172.21.15.102:3300/0 conn(0x7fa08c06bc10 0x7fa08c06c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.760+0000 7fa090f60640 1 --2- 172.21.15.81:0/1019325774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa08c15e410 0x7fa08c0b5fe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa0800097a0 tx=0x7fa08002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a76b3c2644ee7b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.760+0000 7fa08b7fe640 1 -- 172.21.15.81:0/1019325774 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080037070 con 0x7fa08c15e410 2024-09-16T01:24:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.760+0000 7fa08b7fe640 1 -- 172.21.15.81:0/1019325774 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08002ae50 con 0x7fa08c15e410 2024-09-16T01:24:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.760+0000 7fa08b7fe640 1 -- 172.21.15.81:0/1019325774 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080032640 con 0x7fa08c15e410 2024-09-16T01:24:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.761+0000 7fa0931c4640 1 -- 172.21.15.81:0/1019325774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa08c15e410 msgr2=0x7fa08c0b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.761+0000 7fa0931c4640 1 --2- 172.21.15.81:0/1019325774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa08c15e410 0x7fa08c0b5fe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa0800097a0 tx=0x7fa08002a100 comp rx=0 tx=0).stop 2024-09-16T01:24:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.761+0000 7fa0931c4640 1 -- 172.21.15.81:0/1019325774 shutdown_connections 2024-09-16T01:24:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.761+0000 7fa0931c4640 1 --2- 172.21.15.81:0/1019325774 >> v2:172.21.15.102:3300/0 conn(0x7fa08c06bc10 0x7fa08c06c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.761+0000 7fa0931c4640 1 --2- 172.21.15.81:0/1019325774 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa08c15e410 0x7fa08c0b5fe0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.761+0000 7fa0931c4640 1 -- 172.21.15.81:0/1019325774 >> 172.21.15.81:0/1019325774 conn(0x7fa08c09aa30 msgr2=0x7fa08c0b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.761+0000 7fa0931c4640 1 -- 172.21.15.81:0/1019325774 shutdown_connections 2024-09-16T01:24:01.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.761+0000 7fa0931c4640 1 -- 172.21.15.81:0/1019325774 wait complete. 2024-09-16T01:24:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.762+0000 7fa0931c4640 1 Processor -- start 2024-09-16T01:24:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.762+0000 7fa0931c4640 1 -- start start 2024-09-16T01:24:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa0931c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa08c06bc10 0x7fa08c0cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa0931c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08c0b40c0 0x7fa08c1f4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa0931c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa08c15e410 0x7fa08c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa0931c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c15e7f0 con 0x7fa08c0b40c0 2024-09-16T01:24:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa0931c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c0b4510 con 0x7fa08c06bc10 2024-09-16T01:24:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa0931c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa08c15e970 con 0x7fa08c15e410 2024-09-16T01:24:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa08bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08c0b40c0 0x7fa08c1f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa090f60640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa08c06bc10 0x7fa08c0cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa08bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08c0b40c0 0x7fa08c1f4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51154/0 (socket says 172.21.15.81:51154) 2024-09-16T01:24:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa090f60640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa08c06bc10 0x7fa08c0cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:47470/0 (socket says 172.21.15.81:47470) 2024-09-16T01:24:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa08bfff640 1 -- 172.21.15.81:0/181513324 learned_addr learned my addr 172.21.15.81:0/181513324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa091761640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa08c15e410 0x7fa08c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa08bfff640 1 -- 172.21.15.81:0/181513324 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa08c15e410 msgr2=0x7fa08c0ca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa08bfff640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa08c15e410 0x7fa08c0ca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa08bfff640 1 -- 172.21.15.81:0/181513324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa08c06bc10 msgr2=0x7fa08c0cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa08bfff640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa08c06bc10 0x7fa08c0cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.763+0000 7fa08bfff640 1 -- 172.21.15.81:0/181513324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c1f4e90 con 0x7fa08c0b40c0 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.764+0000 7fa08bfff640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08c0b40c0 0x7fa08c1f4950 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa07800c3c0 tx=0x7fa07800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.764+0000 7fa0897fa640 1 -- 172.21.15.81:0/181513324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa078017070 con 0x7fa08c0b40c0 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.764+0000 7fa0897fa640 1 -- 172.21.15.81:0/181513324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa078005ce0 con 0x7fa08c0b40c0 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.764+0000 7fa0931c4640 1 -- 172.21.15.81:0/181513324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08c0ccc40 con 0x7fa08c0b40c0 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.764+0000 7fa0897fa640 1 -- 172.21.15.81:0/181513324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0780072d0 con 0x7fa08c0b40c0 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.764+0000 7fa0931c4640 1 -- 172.21.15.81:0/181513324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08c0cd480 con 0x7fa08c0b40c0 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.765+0000 7fa0931c4640 1 -- 172.21.15.81:0/181513324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08c06c040 con 0x7fa08c0b40c0 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.765+0000 7fa0897fa640 1 -- 172.21.15.81:0/181513324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa07801a070 con 0x7fa08c0b40c0 2024-09-16T01:24:01.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.766+0000 7fa0897fa640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa07006c2b0 0x7fa07006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.766+0000 7fa0897fa640 1 -- 172.21.15.81:0/181513324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 6101+0+0 (secure 0 0 0) 0x7fa07808a850 con 0x7fa08c0b40c0 2024-09-16T01:24:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.766+0000 7fa090f60640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa07006c2b0 0x7fa07006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:01.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.766+0000 7fa090f60640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa07006c2b0 0x7fa07006e770 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa080034000 tx=0x7fa08002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:01.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.770+0000 7fa0897fa640 1 -- 172.21.15.81:0/181513324 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa08c0ccc40 con 0x7fa08c0b40c0 2024-09-16T01:24:01.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:01.973+0000 7fa0931c4640 1 -- 172.21.15.81:0/181513324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa08c0cd7c0 con 0x7fa08c0b40c0 2024-09-16T01:24:02.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.061+0000 7fa0897fa640 1 -- 172.21.15.81:0/181513324 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) ==== 118+0+0 (secure 0 0 0) 0x7fa08c1f4e90 con 0x7fa08c0b40c0 2024-09-16T01:24:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.063+0000 7fa0931c4640 1 -- 172.21.15.81:0/181513324 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa07006c2b0 msgr2=0x7fa07006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.063+0000 7fa0931c4640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa07006c2b0 0x7fa07006e770 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa080034000 tx=0x7fa08002e000 comp rx=0 tx=0).stop 2024-09-16T01:24:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.063+0000 7fa0931c4640 1 -- 172.21.15.81:0/181513324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08c0b40c0 msgr2=0x7fa08c1f4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.063+0000 7fa0931c4640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08c0b40c0 0x7fa08c1f4950 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa07800c3c0 tx=0x7fa07800c7c0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.063+0000 7fa0931c4640 1 -- 172.21.15.81:0/181513324 shutdown_connections 2024-09-16T01:24:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.063+0000 7fa0931c4640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa07006c2b0 0x7fa07006e770 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.063+0000 7fa0931c4640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa08c15e410 0x7fa08c0ca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.063+0000 7fa0931c4640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa08c0b40c0 0x7fa08c1f4950 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.063+0000 7fa0931c4640 1 --2- 172.21.15.81:0/181513324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa08c06bc10 0x7fa08c0cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.063+0000 7fa0931c4640 1 -- 172.21.15.81:0/181513324 >> 172.21.15.81:0/181513324 conn(0x7fa08c09aa30 msgr2=0x7fa08c0aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:02.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.063+0000 7fa0931c4640 1 -- 172.21.15.81:0/181513324 shutdown_connections 2024-09-16T01:24:02.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.063+0000 7fa0931c4640 1 -- 172.21.15.81:0/181513324 wait complete. 2024-09-16T01:24:02.075 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-16T01:24:02.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-16T01:24:02.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.176+0000 7f825e477640 1 Processor -- start 2024-09-16T01:24:02.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.176+0000 7f825e477640 1 -- start start 2024-09-16T01:24:02.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f825e477640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f82580cf540 0x7f82581621b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f825e477640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82581626f0 0x7f82580b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f825e477640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82580b11f0 con 0x7f825815e5d0 2024-09-16T01:24:02.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f825e477640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8258162b60 con 0x7f82581626f0 2024-09-16T01:24:02.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f825e477640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f82580d0100 con 0x7f82580cf540 2024-09-16T01:24:02.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f825ca14640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f82581626f0 0x7f82580b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f8257fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f825815e5d0 0x7f82580d4df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54124/0 (socket says 172.21.15.81:54124) 2024-09-16T01:24:02.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f8257fff640 1 -- 172.21.15.81:0/1295581936 learned_addr learned my addr 172.21.15.81:0/1295581936 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f825ca14640 1 -- 172.21.15.81:0/1295581936 >> v2:172.21.15.102:3300/0 conn(0x7f82580cf540 msgr2=0x7f82581621b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f824ffff640 1 --2- 172.21.15.81:0/1295581936 >> v2:172.21.15.102:3300/0 conn(0x7f82580cf540 0x7f82581621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f82577fe640 1 -- 172.21.15.81:0/1295581936 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2113541292 0 0) 0x7f82580b11f0 con 0x7f825815e5d0 2024-09-16T01:24:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f825ca14640 1 --2- 172.21.15.81:0/1295581936 >> v2:172.21.15.102:3300/0 conn(0x7f82580cf540 0x7f82581621b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f825ca14640 1 -- 172.21.15.81:0/1295581936 >> v1:172.21.15.81:6789/0 conn(0x7f825815e5d0 legacy=0x7f82580d4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.177+0000 7f825ca14640 1 -- 172.21.15.81:0/1295581936 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82580cfb40 con 0x7f82581626f0 2024-09-16T01:24:02.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.178+0000 7f825ca14640 1 --2- 172.21.15.81:0/1295581936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82581626f0 0x7f82580b19b0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f82580d0760 tx=0x7f825002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8217ce65cbe7d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:02.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.178+0000 7f82577fe640 1 -- 172.21.15.81:0/1295581936 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250007740 con 0x7f82581626f0 2024-09-16T01:24:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.178+0000 7f82577fe640 1 -- 172.21.15.81:0/1295581936 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82500078e0 con 0x7f82581626f0 2024-09-16T01:24:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.178+0000 7f82577fe640 1 -- 172.21.15.81:0/1295581936 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8250007cb0 con 0x7f82581626f0 2024-09-16T01:24:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.178+0000 7f825e477640 1 -- 172.21.15.81:0/1295581936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82581626f0 msgr2=0x7f82580b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.178+0000 7f825e477640 1 --2- 172.21.15.81:0/1295581936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82581626f0 0x7f82580b19b0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f82580d0760 tx=0x7f825002a680 comp rx=0 tx=0).stop 2024-09-16T01:24:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.178+0000 7f825e477640 1 -- 172.21.15.81:0/1295581936 shutdown_connections 2024-09-16T01:24:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.178+0000 7f825e477640 1 --2- 172.21.15.81:0/1295581936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82581626f0 0x7f82580b19b0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.178+0000 7f825e477640 1 --2- 172.21.15.81:0/1295581936 >> v2:172.21.15.102:3300/0 conn(0x7f82580cf540 0x7f82581621b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.178+0000 7f825e477640 1 -- 172.21.15.81:0/1295581936 >> 172.21.15.81:0/1295581936 conn(0x7f825808bfc0 msgr2=0x7f82580d44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:02.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.178+0000 7f825e477640 1 -- 172.21.15.81:0/1295581936 shutdown_connections 2024-09-16T01:24:02.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.179+0000 7f825e477640 1 -- 172.21.15.81:0/1295581936 wait complete. 2024-09-16T01:24:02.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.180+0000 7f825e477640 1 Processor -- start 2024-09-16T01:24:02.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.180+0000 7f825e477640 1 -- start start 2024-09-16T01:24:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.180+0000 7f825e477640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82580cf540 0x7f82581f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.180+0000 7f825e477640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825815e5d0 0x7f82581532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.180+0000 7f825e477640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82581626f0 0x7f82580b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.180+0000 7f825e477640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f825815e9b0 con 0x7f825815e5d0 2024-09-16T01:24:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.180+0000 7f825e477640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f82580b1490 con 0x7f82581626f0 2024-09-16T01:24:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.180+0000 7f825e477640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f825815eb30 con 0x7f82580cf540 2024-09-16T01:24:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.180+0000 7f824ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825815e5d0 0x7f82581532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.180+0000 7f824ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825815e5d0 0x7f82581532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51170/0 (socket says 172.21.15.81:51170) 2024-09-16T01:24:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.180+0000 7f824ffff640 1 -- 172.21.15.81:0/3589031945 learned_addr learned my addr 172.21.15.81:0/3589031945 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f825ca14640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82581626f0 0x7f82580b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f8257fff640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82580cf540 0x7f82581f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f824ffff640 1 -- 172.21.15.81:0/3589031945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82580cf540 msgr2=0x7f82581f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f824ffff640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82580cf540 0x7f82581f4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f824ffff640 1 -- 172.21.15.81:0/3589031945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82581626f0 msgr2=0x7f82580b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f824ffff640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82581626f0 0x7f82580b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f824ffff640 1 -- 172.21.15.81:0/3589031945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8258153ac0 con 0x7f825815e5d0 2024-09-16T01:24:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f825ca14640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82581626f0 0x7f82580b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f8257fff640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82580cf540 0x7f82581f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f824ffff640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825815e5d0 0x7f82581532f0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f824000c820 tx=0x7f824000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f82557fa640 1 -- 172.21.15.81:0/3589031945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240015070 con 0x7f825815e5d0 2024-09-16T01:24:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f82557fa640 1 -- 172.21.15.81:0/3589031945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8240004240 con 0x7f825815e5d0 2024-09-16T01:24:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f825e477640 1 -- 172.21.15.81:0/3589031945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82580b5450 con 0x7f825815e5d0 2024-09-16T01:24:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f82557fa640 1 -- 172.21.15.81:0/3589031945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824000ce10 con 0x7f825815e5d0 2024-09-16T01:24:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.181+0000 7f825e477640 1 -- 172.21.15.81:0/3589031945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82580b5a10 con 0x7f825815e5d0 2024-09-16T01:24:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.182+0000 7f825e477640 1 -- 172.21.15.81:0/3589031945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82580ba460 con 0x7f825815e5d0 2024-09-16T01:24:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.183+0000 7f82557fa640 1 -- 172.21.15.81:0/3589031945 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f82400077d0 con 0x7f825815e5d0 2024-09-16T01:24:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.183+0000 7f82557fa640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f823806c2b0 0x7f823806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.183+0000 7f8257fff640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f823806c2b0 0x7f823806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.183+0000 7f82557fa640 1 -- 172.21.15.81:0/3589031945 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7f824008b450 con 0x7f825815e5d0 2024-09-16T01:24:02.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.184+0000 7f8257fff640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f823806c2b0 0x7f823806e770 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8248007fd0 tx=0x7f8248009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.188+0000 7f82557fa640 1 -- 172.21.15.81:0/3589031945 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8240059a30 con 0x7f825815e5d0 2024-09-16T01:24:02.309 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-16T01:24:02.307+0000 7f6358ce3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:24:02.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:02.387+0000 7f825e477640 1 -- 172.21.15.81:0/3589031945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f82580b2510 con 0x7f825815e5d0 2024-09-16T01:24:03.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.066+0000 7f82557fa640 1 -- 172.21.15.81:0/3589031945 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) ==== 122+0+0 (secure 0 0 0) 0x7f8240059330 con 0x7f825815e5d0 2024-09-16T01:24:03.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.069+0000 7f825e477640 1 -- 172.21.15.81:0/3589031945 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f823806c2b0 msgr2=0x7f823806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.069+0000 7f825e477640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f823806c2b0 0x7f823806e770 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8248007fd0 tx=0x7f8248009040 comp rx=0 tx=0).stop 2024-09-16T01:24:03.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.069+0000 7f825e477640 1 -- 172.21.15.81:0/3589031945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825815e5d0 msgr2=0x7f82581532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.069+0000 7f825e477640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825815e5d0 0x7f82581532f0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f824000c820 tx=0x7f824000cce0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.069+0000 7f825e477640 1 -- 172.21.15.81:0/3589031945 shutdown_connections 2024-09-16T01:24:03.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.069+0000 7f825e477640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f823806c2b0 0x7f823806e770 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.069+0000 7f825e477640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f82581626f0 0x7f82580b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.069+0000 7f825e477640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825815e5d0 0x7f82581532f0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.069+0000 7f825e477640 1 --2- 172.21.15.81:0/3589031945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f82580cf540 0x7f82581f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.069+0000 7f825e477640 1 -- 172.21.15.81:0/3589031945 >> 172.21.15.81:0/3589031945 conn(0x7f825808bfc0 msgr2=0x7f82580d18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.069+0000 7f825e477640 1 -- 172.21.15.81:0/3589031945 shutdown_connections 2024-09-16T01:24:03.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.069+0000 7f825e477640 1 -- 172.21.15.81:0/3589031945 wait complete. 2024-09-16T01:24:03.083 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-16T01:24:03.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:24:03.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.183+0000 7faf220dd640 1 Processor -- start 2024-09-16T01:24:03.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.183+0000 7faf220dd640 1 -- start start 2024-09-16T01:24:03.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.184+0000 7faf220dd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf1c15e5f0 0x7faf1c0d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.184+0000 7faf220dd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf1c0d3690 con 0x7faf1c0d30f0 2024-09-16T01:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.184+0000 7faf220dd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf1c0d3970 con 0x7faf1c0b6690 2024-09-16T01:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.184+0000 7faf220dd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7faf1c06d530 con 0x7faf1c15e5f0 2024-09-16T01:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.184+0000 7faf1b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf1c15e5f0 0x7faf1c0d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.184+0000 7faf13fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faf1c0d30f0 0x7faf1c0b5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54140/0 (socket says 172.21.15.81:54140) 2024-09-16T01:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.184+0000 7faf1b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf1c15e5f0 0x7faf1c0d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51186/0 (socket says 172.21.15.81:51186) 2024-09-16T01:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.184+0000 7faf13fff640 1 -- 172.21.15.81:0/715383681 learned_addr learned my addr 172.21.15.81:0/715383681 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.184+0000 7faf1b7fe640 1 -- 172.21.15.81:0/715383681 >> v1:172.21.15.102:6789/0 conn(0x7faf1c0b6690 legacy=0x7faf1c06d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.184+0000 7faf1b7fe640 1 -- 172.21.15.81:0/715383681 >> v1:172.21.15.81:6789/0 conn(0x7faf1c0d30f0 legacy=0x7faf1c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.184+0000 7faf1b7fe640 1 -- 172.21.15.81:0/715383681 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1c06cee0 con 0x7faf1c15e5f0 2024-09-16T01:24:03.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.185+0000 7faf1b7fe640 1 --2- 172.21.15.81:0/715383681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf1c15e5f0 0x7faf1c0d4dd0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0097d0 tx=0x7faf0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e78a7288c6bb45b server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.185+0000 7faf1affd640 1 -- 172.21.15.81:0/715383681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c037070 con 0x7faf1c15e5f0 2024-09-16T01:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.185+0000 7faf1affd640 1 -- 172.21.15.81:0/715383681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf0c032440 con 0x7faf1c15e5f0 2024-09-16T01:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.185+0000 7faf1affd640 1 -- 172.21.15.81:0/715383681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c032810 con 0x7faf1c15e5f0 2024-09-16T01:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.186+0000 7faf220dd640 1 -- 172.21.15.81:0/715383681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf1c15e5f0 msgr2=0x7faf1c0d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.186+0000 7faf220dd640 1 --2- 172.21.15.81:0/715383681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf1c15e5f0 0x7faf1c0d4dd0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0097d0 tx=0x7faf0c02a270 comp rx=0 tx=0).stop 2024-09-16T01:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.186+0000 7faf220dd640 1 -- 172.21.15.81:0/715383681 shutdown_connections 2024-09-16T01:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.186+0000 7faf220dd640 1 --2- 172.21.15.81:0/715383681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf1c15e5f0 0x7faf1c0d4dd0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.186+0000 7faf220dd640 1 -- 172.21.15.81:0/715383681 >> 172.21.15.81:0/715383681 conn(0x7faf1c08bfc0 msgr2=0x7faf1c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.186+0000 7faf220dd640 1 -- 172.21.15.81:0/715383681 shutdown_connections 2024-09-16T01:24:03.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.186+0000 7faf220dd640 1 -- 172.21.15.81:0/715383681 wait complete. 2024-09-16T01:24:03.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.187+0000 7faf220dd640 1 Processor -- start 2024-09-16T01:24:03.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.187+0000 7faf220dd640 1 -- start start 2024-09-16T01:24:03.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf220dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf1c0b6690 0x7faf1c09e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf220dd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf1c0d30f0 0x7faf1c1618e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf220dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf1c15e5f0 0x7faf1c0a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf220dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c0d5310 con 0x7faf1c15e5f0 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf220dd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c15e9d0 con 0x7faf1c0d30f0 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf220dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7faf1c06e0d0 con 0x7faf1c0b6690 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf1bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf1c15e5f0 0x7faf1c0a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf1bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf1c15e5f0 0x7faf1c0a0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51196/0 (socket says 172.21.15.81:51196) 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf1bfff640 1 -- 172.21.15.81:0/947027490 learned_addr learned my addr 172.21.15.81:0/947027490 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf13fff640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf1c0d30f0 0x7faf1c1618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf1b7fe640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf1c0b6690 0x7faf1c09e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf1bfff640 1 -- 172.21.15.81:0/947027490 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf1c0b6690 msgr2=0x7faf1c09e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf1bfff640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf1c0b6690 0x7faf1c09e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf1bfff640 1 -- 172.21.15.81:0/947027490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf1c0d30f0 msgr2=0x7faf1c1618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf1bfff640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf1c0d30f0 0x7faf1c1618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf1bfff640 1 -- 172.21.15.81:0/947027490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1c0a1530 con 0x7faf1c15e5f0 2024-09-16T01:24:03.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.188+0000 7faf1bfff640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf1c15e5f0 0x7faf1c0a0c70 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7faf1400c730 tx=0x7faf1400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.189+0000 7faf18ff9640 1 -- 172.21.15.81:0/947027490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf14016020 con 0x7faf1c15e5f0 2024-09-16T01:24:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.189+0000 7faf18ff9640 1 -- 172.21.15.81:0/947027490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf14006d50 con 0x7faf1c15e5f0 2024-09-16T01:24:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.189+0000 7faf220dd640 1 -- 172.21.15.81:0/947027490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1c0a1810 con 0x7faf1c15e5f0 2024-09-16T01:24:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.189+0000 7faf18ff9640 1 -- 172.21.15.81:0/947027490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf14003bb0 con 0x7faf1c15e5f0 2024-09-16T01:24:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.189+0000 7faf220dd640 1 -- 172.21.15.81:0/947027490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf1c15f730 con 0x7faf1c15e5f0 2024-09-16T01:24:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.190+0000 7faf220dd640 1 -- 172.21.15.81:0/947027490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf1c0a1d30 con 0x7faf1c15e5f0 2024-09-16T01:24:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.190+0000 7faf18ff9640 1 -- 172.21.15.81:0/947027490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faf1400a7f0 con 0x7faf1c15e5f0 2024-09-16T01:24:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.191+0000 7faf18ff9640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faefc06c2b0 0x7faefc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.191+0000 7faf18ff9640 1 -- 172.21.15.81:0/947027490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7faf1408b020 con 0x7faf1c15e5f0 2024-09-16T01:24:03.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.191+0000 7faf1b7fe640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faefc06c2b0 0x7faefc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.191+0000 7faf1b7fe640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faefc06c2b0 0x7faefc06e770 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7faf0c034000 tx=0x7faf0c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.195+0000 7faf18ff9640 1 -- 172.21.15.81:0/947027490 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faf1c0a1d30 con 0x7faf1c15e5f0 2024-09-16T01:24:03.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.396+0000 7faf220dd640 1 -- 172.21.15.81:0/947027490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf1c15f930 con 0x7faf1c15e5f0 2024-09-16T01:24:03.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.396+0000 7faf18ff9640 1 -- 172.21.15.81:0/947027490 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5233 (secure 0 0 0) 0x7faf1c15f930 con 0x7faf1c15e5f0 2024-09-16T01:24:03.398 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:03.398 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"btime":"2024-09-16T01:24:03:062667+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1526547768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1526547768},{"type":"v1","addr":"172.21.15.102:6834","nonce":1526547768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1390834502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1390834502},{"type":"v1","addr":"172.21.15.102:6835","nonce":1390834502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1449155906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1449155906},{"type":"v1","addr":"172.21.15.81:6836","nonce":1449155906}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:24:00.383912+0000","modified":"2024-09-16T01:24:02.389045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8547":{"gid":8547,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3797465908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3797465908},{"type":"v1","addr":"172.21.15.81:6837","nonce":3797465908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8547,"qdb_cluster":[8547]},"id":11}]} 2024-09-16T01:24:03.398 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2024-09-16T01:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.398+0000 7faf220dd640 1 -- 172.21.15.81:0/947027490 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faefc06c2b0 msgr2=0x7faefc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.398+0000 7faf220dd640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faefc06c2b0 0x7faefc06e770 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7faf0c034000 tx=0x7faf0c02e000 comp rx=0 tx=0).stop 2024-09-16T01:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.398+0000 7faf220dd640 1 -- 172.21.15.81:0/947027490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf1c15e5f0 msgr2=0x7faf1c0a0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.398+0000 7faf220dd640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf1c15e5f0 0x7faf1c0a0c70 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7faf1400c730 tx=0x7faf1400cbf0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.398+0000 7faf220dd640 1 -- 172.21.15.81:0/947027490 shutdown_connections 2024-09-16T01:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.398+0000 7faf220dd640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7faefc06c2b0 0x7faefc06e770 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.398+0000 7faf220dd640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf1c15e5f0 0x7faf1c0a0c70 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.398+0000 7faf220dd640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faf1c0d30f0 0x7faf1c1618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.398+0000 7faf220dd640 1 --2- 172.21.15.81:0/947027490 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7faf1c0b6690 0x7faf1c09e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.398+0000 7faf220dd640 1 -- 172.21.15.81:0/947027490 >> 172.21.15.81:0/947027490 conn(0x7faf1c08bfc0 msgr2=0x7faf1c15d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.398+0000 7faf220dd640 1 -- 172.21.15.81:0/947027490 shutdown_connections 2024-09-16T01:24:03.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.398+0000 7faf220dd640 1 -- 172.21.15.81:0/947027490 wait complete. 2024-09-16T01:24:03.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:24:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.507+0000 7f0e961b9640 1 Processor -- start 2024-09-16T01:24:03.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.507+0000 7f0e961b9640 1 -- start start 2024-09-16T01:24:03.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.508+0000 7f0e961b9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e9015b300 0x7f0e900cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.508+0000 7f0e961b9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e900cd3f0 0x7f0e9006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.508+0000 7f0e961b9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e900cdbe0 con 0x7f0e90072d30 2024-09-16T01:24:03.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.508+0000 7f0e961b9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0e900728a0 con 0x7f0e900cd3f0 2024-09-16T01:24:03.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.508+0000 7f0e961b9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0e900cd900 con 0x7f0e9015b300 2024-09-16T01:24:03.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.508+0000 7f0e8effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e900cd3f0 0x7f0e9006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.508+0000 7f0e8effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e900cd3f0 0x7f0e9006f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51206/0 (socket says 172.21.15.81:51206) 2024-09-16T01:24:03.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.508+0000 7f0e8effd640 1 -- 172.21.15.81:0/4195899891 learned_addr learned my addr 172.21.15.81:0/4195899891 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:03.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.508+0000 7f0e8effd640 1 -- 172.21.15.81:0/4195899891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e9015b300 msgr2=0x7f0e900cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:03.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.508+0000 7f0e8f7fe640 1 --2- 172.21.15.81:0/4195899891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e9015b300 0x7f0e900cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.509+0000 7f0e8effd640 1 --2- 172.21.15.81:0/4195899891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e9015b300 0x7f0e900cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.509+0000 7f0e8effd640 1 -- 172.21.15.81:0/4195899891 >> v1:172.21.15.102:6789/0 conn(0x7f0e90072d30 legacy=0x7f0e900b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:03.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.509+0000 7f0e8effd640 1 -- 172.21.15.81:0/4195899891 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e90072250 con 0x7f0e900cd3f0 2024-09-16T01:24:03.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.509+0000 7f0e8effd640 1 --2- 172.21.15.81:0/4195899891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e900cd3f0 0x7f0e9006f1c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009870 tx=0x7f0e8402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9a1720e860f28e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.509+0000 7f0e8e7fc640 1 -- 172.21.15.81:0/4195899891 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84037070 con 0x7f0e900cd3f0 2024-09-16T01:24:03.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.509+0000 7f0e8e7fc640 1 -- 172.21.15.81:0/4195899891 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e84032440 con 0x7f0e900cd3f0 2024-09-16T01:24:03.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.509+0000 7f0e8e7fc640 1 -- 172.21.15.81:0/4195899891 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e84032810 con 0x7f0e900cd3f0 2024-09-16T01:24:03.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.510+0000 7f0e961b9640 1 -- 172.21.15.81:0/4195899891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e900cd3f0 msgr2=0x7f0e9006f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.510+0000 7f0e961b9640 1 --2- 172.21.15.81:0/4195899891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e900cd3f0 0x7f0e9006f1c0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009870 tx=0x7f0e8402a210 comp rx=0 tx=0).stop 2024-09-16T01:24:03.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.510+0000 7f0e961b9640 1 -- 172.21.15.81:0/4195899891 shutdown_connections 2024-09-16T01:24:03.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.510+0000 7f0e961b9640 1 --2- 172.21.15.81:0/4195899891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e900cd3f0 0x7f0e9006f1c0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.510+0000 7f0e961b9640 1 --2- 172.21.15.81:0/4195899891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e9015b300 0x7f0e900cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.510+0000 7f0e961b9640 1 -- 172.21.15.81:0/4195899891 >> 172.21.15.81:0/4195899891 conn(0x7f0e90067d70 msgr2=0x7f0e9006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.510+0000 7f0e961b9640 1 -- 172.21.15.81:0/4195899891 shutdown_connections 2024-09-16T01:24:03.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.510+0000 7f0e961b9640 1 -- 172.21.15.81:0/4195899891 wait complete. 2024-09-16T01:24:03.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.511+0000 7f0e961b9640 1 Processor -- start 2024-09-16T01:24:03.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.511+0000 7f0e961b9640 1 -- start start 2024-09-16T01:24:03.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.512+0000 7f0e961b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e90072d30 0x7f0e900c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.512+0000 7f0e961b9640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e900cd3f0 0x7f0e90147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.512+0000 7f0e961b9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e9015b300 0x7f0e90154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.512+0000 7f0e961b9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0e900d0160 con 0x7f0e9015b300 2024-09-16T01:24:03.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.512+0000 7f0e961b9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0e900cffe0 con 0x7f0e90072d30 2024-09-16T01:24:03.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.512+0000 7f0e961b9640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9006f700 con 0x7f0e900cd3f0 2024-09-16T01:24:03.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.512+0000 7f0e8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e9015b300 0x7f0e90154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.512+0000 7f0e8ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e9015b300 0x7f0e90154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51218/0 (socket says 172.21.15.81:51218) 2024-09-16T01:24:03.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.512+0000 7f0e8ffff640 1 -- 172.21.15.81:0/3705485743 learned_addr learned my addr 172.21.15.81:0/3705485743 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:03.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.512+0000 7f0e8f7fe640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e90072d30 0x7f0e900c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.512+0000 7f0e8effd640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e900cd3f0 0x7f0e90147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.512+0000 7f0e8ffff640 1 -- 172.21.15.81:0/3705485743 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e900cd3f0 msgr2=0x7f0e90147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.513+0000 7f0e8ffff640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e900cd3f0 0x7f0e90147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.513+0000 7f0e8ffff640 1 -- 172.21.15.81:0/3705485743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e90072d30 msgr2=0x7f0e900c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.513+0000 7f0e8ffff640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e90072d30 0x7f0e900c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.513+0000 7f0e8ffff640 1 -- 172.21.15.81:0/3705485743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e901561f0 con 0x7f0e9015b300 2024-09-16T01:24:03.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.513+0000 7f0e8ffff640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e9015b300 0x7f0e90154140 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800ea50 tx=0x7f0e8800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.513+0000 7f0e77fff640 1 -- 172.21.15.81:0/3705485743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88004730 con 0x7f0e9015b300 2024-09-16T01:24:03.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.513+0000 7f0e77fff640 1 -- 172.21.15.81:0/3705485743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88011470 con 0x7f0e9015b300 2024-09-16T01:24:03.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.513+0000 7f0e961b9640 1 -- 172.21.15.81:0/3705485743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e901564d0 con 0x7f0e9015b300 2024-09-16T01:24:03.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.513+0000 7f0e77fff640 1 -- 172.21.15.81:0/3705485743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88011860 con 0x7f0e9015b300 2024-09-16T01:24:03.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.513+0000 7f0e961b9640 1 -- 172.21.15.81:0/3705485743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e901571f0 con 0x7f0e9015b300 2024-09-16T01:24:03.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.514+0000 7f0e961b9640 1 -- 172.21.15.81:0/3705485743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e9006bfb0 con 0x7f0e9015b300 2024-09-16T01:24:03.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.514+0000 7f0e77fff640 1 -- 172.21.15.81:0/3705485743 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0e88011a00 con 0x7f0e9015b300 2024-09-16T01:24:03.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.515+0000 7f0e77fff640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0e7c06c2b0 0x7f0e7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.515+0000 7f0e77fff640 1 -- 172.21.15.81:0/3705485743 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7f0e8808dea0 con 0x7f0e9015b300 2024-09-16T01:24:03.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.515+0000 7f0e8f7fe640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0e7c06c2b0 0x7f0e7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.515+0000 7f0e8f7fe640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0e7c06c2b0 0x7f0e7c06e770 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000aa20 tx=0x7f0e80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.519+0000 7f0e77fff640 1 -- 172.21.15.81:0/3705485743 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e88016030 con 0x7f0e9015b300 2024-09-16T01:24:03.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.686+0000 7f0e961b9640 1 -- 172.21.15.81:0/3705485743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e900b2cf0 con 0x7f0e9015b300 2024-09-16T01:24:03.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.687+0000 7f0e77fff640 1 -- 172.21.15.81:0/3705485743 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) ==== 74+0+16944 (secure 0 0 0) 0x7f0e8805bec0 con 0x7f0e9015b300 2024-09-16T01:24:03.689 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:03.689 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":149,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:24:01.892632+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:23:59.008759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-16T01:23:59.360280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:24:03.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.689+0000 7f0e961b9640 1 -- 172.21.15.81:0/3705485743 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0e7c06c2b0 msgr2=0x7f0e7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.689+0000 7f0e961b9640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0e7c06c2b0 0x7f0e7c06e770 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000aa20 tx=0x7f0e80008040 comp rx=0 tx=0).stop 2024-09-16T01:24:03.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.689+0000 7f0e961b9640 1 -- 172.21.15.81:0/3705485743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e9015b300 msgr2=0x7f0e90154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.689+0000 7f0e961b9640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e9015b300 0x7f0e90154140 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800ea50 tx=0x7f0e8800ef10 comp rx=0 tx=0).stop 2024-09-16T01:24:03.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.689+0000 7f0e961b9640 1 -- 172.21.15.81:0/3705485743 shutdown_connections 2024-09-16T01:24:03.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.689+0000 7f0e961b9640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f0e7c06c2b0 0x7f0e7c06e770 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.689+0000 7f0e961b9640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e9015b300 0x7f0e90154140 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.689+0000 7f0e961b9640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0e900cd3f0 0x7f0e90147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.689+0000 7f0e961b9640 1 --2- 172.21.15.81:0/3705485743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0e90072d30 0x7f0e900c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.689+0000 7f0e961b9640 1 -- 172.21.15.81:0/3705485743 >> 172.21.15.81:0/3705485743 conn(0x7f0e90067d70 msgr2=0x7f0e9015e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.689+0000 7f0e961b9640 1 -- 172.21.15.81:0/3705485743 shutdown_connections 2024-09-16T01:24:03.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.689+0000 7f0e961b9640 1 -- 172.21.15.81:0/3705485743 wait complete. 2024-09-16T01:24:03.702 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:24:03.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:24:03.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.799+0000 7f5b7b12a640 1 Processor -- start 2024-09-16T01:24:03.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.799+0000 7f5b7b12a640 1 -- start start 2024-09-16T01:24:03.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.800+0000 7f5b7b12a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5b740d06e0 0x7f5b740ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.800+0000 7f5b7b12a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b7409b510 0x7f5b7409b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.800+0000 7f5b7b12a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b740d00a0 con 0x7f5b7415d3e0 2024-09-16T01:24:03.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.800+0000 7f5b7b12a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5b7409b080 con 0x7f5b740d06e0 2024-09-16T01:24:03.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.800+0000 7f5b7b12a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5b740d0380 con 0x7f5b7409b510 2024-09-16T01:24:03.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.800+0000 7f5b78ec6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5b740d06e0 0x7f5b740ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.800+0000 7f5b796c7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b7409b510 0x7f5b7409b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.800+0000 7f5b73fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f5b7415d3e0 0x7f5b740d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:54864/0 (socket says 172.21.15.81:54864) 2024-09-16T01:24:03.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.800+0000 7f5b73fff640 1 -- 172.21.15.81:0/1222926119 learned_addr learned my addr 172.21.15.81:0/1222926119 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:03.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.801+0000 7f5b78ec6640 1 -- 172.21.15.81:0/1222926119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b7409b510 msgr2=0x7f5b7409b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:03.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.801+0000 7f5b78ec6640 1 --2- 172.21.15.81:0/1222926119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b7409b510 0x7f5b7409b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.801+0000 7f5b78ec6640 1 -- 172.21.15.81:0/1222926119 >> v1:172.21.15.102:6789/0 conn(0x7f5b7415d3e0 legacy=0x7f5b740d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.801+0000 7f5b78ec6640 1 -- 172.21.15.81:0/1222926119 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7409aa30 con 0x7f5b740d06e0 2024-09-16T01:24:03.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.801+0000 7f5b737fe640 1 -- 172.21.15.81:0/1222926119 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285537823 0 0) 0x7f5b740d00a0 con 0x7f5b7415d3e0 2024-09-16T01:24:03.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.801+0000 7f5b796c7640 1 --2- 172.21.15.81:0/1222926119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b7409b510 0x7f5b7409b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:03.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.801+0000 7f5b78ec6640 1 --2- 172.21.15.81:0/1222926119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b740d06e0 0x7f5b740ce8b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0097a0 tx=0x7f5b6c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b64014c0f9278aec server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.802+0000 7f5b737fe640 1 -- 172.21.15.81:0/1222926119 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c037070 con 0x7f5b740d06e0 2024-09-16T01:24:03.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.802+0000 7f5b737fe640 1 -- 172.21.15.81:0/1222926119 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6c032440 con 0x7f5b740d06e0 2024-09-16T01:24:03.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.802+0000 7f5b737fe640 1 -- 172.21.15.81:0/1222926119 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c032810 con 0x7f5b740d06e0 2024-09-16T01:24:03.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.802+0000 7f5b7b12a640 1 -- 172.21.15.81:0/1222926119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b740d06e0 msgr2=0x7f5b740ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.802+0000 7f5b7b12a640 1 --2- 172.21.15.81:0/1222926119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b740d06e0 0x7f5b740ce8b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0097a0 tx=0x7f5b6c02a180 comp rx=0 tx=0).stop 2024-09-16T01:24:03.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.802+0000 7f5b7b12a640 1 -- 172.21.15.81:0/1222926119 shutdown_connections 2024-09-16T01:24:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.802+0000 7f5b7b12a640 1 --2- 172.21.15.81:0/1222926119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b7409b510 0x7f5b7409b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.802+0000 7f5b7b12a640 1 --2- 172.21.15.81:0/1222926119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b740d06e0 0x7f5b740ce8b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.802+0000 7f5b7b12a640 1 -- 172.21.15.81:0/1222926119 >> 172.21.15.81:0/1222926119 conn(0x7f5b740d23a0 msgr2=0x7f5b740d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.802+0000 7f5b7b12a640 1 -- 172.21.15.81:0/1222926119 shutdown_connections 2024-09-16T01:24:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.802+0000 7f5b7b12a640 1 -- 172.21.15.81:0/1222926119 wait complete. 2024-09-16T01:24:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.803+0000 7f5b7b12a640 1 Processor -- start 2024-09-16T01:24:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.803+0000 7f5b7b12a640 1 -- start start 2024-09-16T01:24:03.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.804+0000 7f5b7b12a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b7409b510 0x7f5b7415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.804+0000 7f5b7b12a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b740d06e0 0x7f5b740b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.804+0000 7f5b7b12a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b7415d3e0 0x7f5b7414a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.804+0000 7f5b7b12a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7415c740 con 0x7f5b7409b510 2024-09-16T01:24:03.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.804+0000 7f5b7b12a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7415d800 con 0x7f5b7415d3e0 2024-09-16T01:24:03.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.804+0000 7f5b7b12a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5b740ccf90 con 0x7f5b740d06e0 2024-09-16T01:24:03.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.804+0000 7f5b78ec6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b7409b510 0x7f5b7415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.804+0000 7f5b78ec6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b7409b510 0x7f5b7415daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51234/0 (socket says 172.21.15.81:51234) 2024-09-16T01:24:03.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.804+0000 7f5b78ec6640 1 -- 172.21.15.81:0/3461020647 learned_addr learned my addr 172.21.15.81:0/3461020647 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:03.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b796c7640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b7415d3e0 0x7f5b7414a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b73fff640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b740d06e0 0x7f5b740b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b78ec6640 1 -- 172.21.15.81:0/3461020647 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b740d06e0 msgr2=0x7f5b740b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b78ec6640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b740d06e0 0x7f5b740b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b78ec6640 1 -- 172.21.15.81:0/3461020647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b7415d3e0 msgr2=0x7f5b7414a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b78ec6640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b7415d3e0 0x7f5b7414a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b78ec6640 1 -- 172.21.15.81:0/3461020647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b740b80e0 con 0x7f5b7409b510 2024-09-16T01:24:03.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b78ec6640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b7409b510 0x7f5b7415daf0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c000c00 tx=0x7f5b6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b717fa640 1 -- 172.21.15.81:0/3461020647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c037050 con 0x7f5b7409b510 2024-09-16T01:24:03.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b717fa640 1 -- 172.21.15.81:0/3461020647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6c038040 con 0x7f5b7409b510 2024-09-16T01:24:03.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b7b12a640 1 -- 172.21.15.81:0/3461020647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7415e0d0 con 0x7f5b7409b510 2024-09-16T01:24:03.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b717fa640 1 -- 172.21.15.81:0/3461020647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c004470 con 0x7f5b7409b510 2024-09-16T01:24:03.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.805+0000 7f5b7b12a640 1 -- 172.21.15.81:0/3461020647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b7415e970 con 0x7f5b7409b510 2024-09-16T01:24:03.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.806+0000 7f5b7b12a640 1 -- 172.21.15.81:0/3461020647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b740d00a0 con 0x7f5b7409b510 2024-09-16T01:24:03.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.807+0000 7f5b717fa640 1 -- 172.21.15.81:0/3461020647 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5b6c03c6d0 con 0x7f5b7409b510 2024-09-16T01:24:03.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.807+0000 7f5b717fa640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5b5406c2b0 0x7f5b5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:03.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.807+0000 7f5b717fa640 1 -- 172.21.15.81:0/3461020647 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7f5b6c0abfd0 con 0x7f5b7409b510 2024-09-16T01:24:03.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.807+0000 7f5b73fff640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5b5406c2b0 0x7f5b5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:03.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.807+0000 7f5b73fff640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5b5406c2b0 0x7f5b5406e770 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5b64007ed0 tx=0x7f5b64007e60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:03.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.811+0000 7f5b717fa640 1 -- 172.21.15.81:0/3461020647 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b6c07a5b0 con 0x7f5b7409b510 2024-09-16T01:24:03.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.974+0000 7f5b7b12a640 1 -- 172.21.15.81:0/3461020647 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b740d31d0 con 0x7f5b5406c2b0 2024-09-16T01:24:03.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.979+0000 7f5b717fa640 1 -- 172.21.15.81:0/3461020647 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237295 (secure 0 0 0) 0x7f5b740d31d0 con 0x7f5b5406c2b0 2024-09-16T01:24:03.983 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:03.984 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:24:03.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.982+0000 7f5b7b12a640 1 -- 172.21.15.81:0/3461020647 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5b5406c2b0 msgr2=0x7f5b5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.982+0000 7f5b7b12a640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5b5406c2b0 0x7f5b5406e770 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5b64007ed0 tx=0x7f5b64007e60 comp rx=0 tx=0).stop 2024-09-16T01:24:03.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.982+0000 7f5b7b12a640 1 -- 172.21.15.81:0/3461020647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b7409b510 msgr2=0x7f5b7415daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:03.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.982+0000 7f5b7b12a640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b7409b510 0x7f5b7415daf0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c000c00 tx=0x7f5b6c0046c0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.982+0000 7f5b7b12a640 1 -- 172.21.15.81:0/3461020647 shutdown_connections 2024-09-16T01:24:03.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.982+0000 7f5b7b12a640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f5b5406c2b0 0x7f5b5406e770 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.982+0000 7f5b7b12a640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b7415d3e0 0x7f5b7414a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.982+0000 7f5b7b12a640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5b740d06e0 0x7f5b740b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.982+0000 7f5b7b12a640 1 --2- 172.21.15.81:0/3461020647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b7409b510 0x7f5b7415daf0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:03.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.982+0000 7f5b7b12a640 1 -- 172.21.15.81:0/3461020647 >> 172.21.15.81:0/3461020647 conn(0x7f5b740d23a0 msgr2=0x7f5b740b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:03.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.982+0000 7f5b7b12a640 1 -- 172.21.15.81:0/3461020647 shutdown_connections 2024-09-16T01:24:03.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:03.982+0000 7f5b7b12a640 1 -- 172.21.15.81:0/3461020647 wait complete. 2024-09-16T01:24:03.994 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":399,"stamp":"2024-09-16T01:24:02.168437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":273200,"kb_used_data":15336,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754701520,"statfs":{"total":773094113280,"available":772814356480,"internally_reserved":0,"allocated":15704064,"data_stored":7868456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000623"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:24:00.041709+0000","last_change":"2024-09-16T01:24:00.041709+0000","last_active":"2024-09-16T01:24:00.041709+0000","last_peered":"2024-09-16T01:24:00.041709+0000","last_clean":"2024-09-16T01:24:00.041709+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:24:00.041709+0000","last_undegraded":"2024-09-16T01:24:00.041709+0000","last_fullsized":"2024-09-16T01:24:00.041709+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-16T01:23:59.036748+0000","last_change":"2024-09-16T01:23:59.036748+0000","last_active":"2024-09-16T01:23:59.036748+0000","last_peered":"2024-09-16T01:23:59.036748+0000","last_clean":"2024-09-16T01:23:59.036748+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-16T01:23:59.036748+0000","last_undegraded":"2024-09-16T01:23:59.036748+0000","last_fullsized":"2024-09-16T01:23:59.036748+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":395,"reported_epoch":144,"state":"active+clean","last_fresh":"2024-09-16T01:23:57.114619+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:23:57.114619+0000","last_peered":"2024-09-16T01:23:57.114619+0000","last_clean":"2024-09-16T01:23:57.114619+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:23:57.114619+0000","last_undegraded":"2024-09-16T01:23:57.114619+0000","last_fullsized":"2024-09-16T01:23:57.114619+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574953,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33548,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338292,"statfs":{"total":96636764160,"available":96602411008,"internally_reserved":0,"allocated":2408448,"data_stored":1426333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37124,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334716,"statfs":{"total":96636764160,"available":96598749184,"internally_reserved":0,"allocated":1814528,"data_stored":835965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32972,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1814528,"data_stored":835965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37120,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334720,"statfs":{"total":96636764160,"available":96598753280,"internally_reserved":0,"allocated":1814528,"data_stored":835965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32960,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338880,"statfs":{"total":96636764160,"available":96603013120,"internally_reserved":0,"allocated":1814528,"data_stored":835965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32972,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1814528,"data_stored":835965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32964,"kb_used_data":1772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338876,"statfs":{"total":96636764160,"available":96603009024,"internally_reserved":0,"allocated":1814528,"data_stored":835965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574953,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33540,"kb_used_data":2352,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338300,"statfs":{"total":96636764160,"available":96602419200,"internally_reserved":0,"allocated":2408448,"data_stored":1426333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:24:03.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:24:04.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.132+0000 7fef1c08b640 1 Processor -- start 2024-09-16T01:24:04.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.132+0000 7fef1c08b640 1 -- start start 2024-09-16T01:24:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1c08b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef1415e740 0x7fef140d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1c08b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fef1409b690 0x7fef1406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1c08b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef1406d4c0 0x7fef1406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1c08b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fef1415eb20 con 0x7fef1406d4c0 2024-09-16T01:24:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1c08b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fef1406d260 con 0x7fef1409b690 2024-09-16T01:24:04.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1c08b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fef140d0780 con 0x7fef1415e740 2024-09-16T01:24:04.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1a628640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef1406d4c0 0x7fef1406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1a628640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fef1406d4c0 0x7fef1406d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51238/0 (socket says 172.21.15.81:51238) 2024-09-16T01:24:04.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1a628640 1 -- 172.21.15.81:0/2614189008 learned_addr learned my addr 172.21.15.81:0/2614189008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:04.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef19626640 1 --2- 172.21.15.81:0/2614189008 >> v2:172.21.15.102:3300/0 conn(0x7fef1409b690 0x7fef1406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1a628640 1 -- 172.21.15.81:0/2614189008 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef1415e740 msgr2=0x7fef140d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:04.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1a628640 1 --2- 172.21.15.81:0/2614189008 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef1415e740 0x7fef140d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1a628640 1 -- 172.21.15.81:0/2614189008 >> v2:172.21.15.102:3300/0 conn(0x7fef1409b690 msgr2=0x7fef1406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:04.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1a628640 1 --2- 172.21.15.81:0/2614189008 >> v2:172.21.15.102:3300/0 conn(0x7fef1409b690 0x7fef1406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.133+0000 7fef1a628640 1 -- 172.21.15.81:0/2614189008 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef140d0a60 con 0x7fef1406d4c0 2024-09-16T01:24:04.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.134+0000 7fef1a628640 1 --2- 172.21.15.81:0/2614189008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1406d4c0 0x7fef1406d910 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fef140738c0 tx=0x7fef0c02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af39f0514cbbecfd server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.134+0000 7fef18e25640 1 -- 172.21.15.81:0/2614189008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c036070 con 0x7fef1406d4c0 2024-09-16T01:24:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.134+0000 7fef18e25640 1 -- 172.21.15.81:0/2614189008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c031600 con 0x7fef1406d4c0 2024-09-16T01:24:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.134+0000 7fef18e25640 1 -- 172.21.15.81:0/2614189008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0319d0 con 0x7fef1406d4c0 2024-09-16T01:24:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.135+0000 7fef1c08b640 1 -- 172.21.15.81:0/2614189008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1406d4c0 msgr2=0x7fef1406d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.135+0000 7fef1c08b640 1 --2- 172.21.15.81:0/2614189008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1406d4c0 0x7fef1406d910 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fef140738c0 tx=0x7fef0c02a750 comp rx=0 tx=0).stop 2024-09-16T01:24:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.135+0000 7fef1c08b640 1 -- 172.21.15.81:0/2614189008 shutdown_connections 2024-09-16T01:24:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.135+0000 7fef1c08b640 1 --2- 172.21.15.81:0/2614189008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1406d4c0 0x7fef1406d910 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.135+0000 7fef1c08b640 1 --2- 172.21.15.81:0/2614189008 >> v2:172.21.15.102:3300/0 conn(0x7fef1409b690 0x7fef1406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.135+0000 7fef1c08b640 1 --2- 172.21.15.81:0/2614189008 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef1415e740 0x7fef140d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.135+0000 7fef1c08b640 1 -- 172.21.15.81:0/2614189008 >> 172.21.15.81:0/2614189008 conn(0x7fef140d23a0 msgr2=0x7fef140d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.135+0000 7fef1c08b640 1 -- 172.21.15.81:0/2614189008 shutdown_connections 2024-09-16T01:24:04.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.135+0000 7fef1c08b640 1 -- 172.21.15.81:0/2614189008 wait complete. 2024-09-16T01:24:04.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.136+0000 7fef1c08b640 1 Processor -- start 2024-09-16T01:24:04.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.136+0000 7fef1c08b640 1 -- start start 2024-09-16T01:24:04.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1c08b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef1406d4c0 0x7fef14162a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1c08b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef1409b690 0x7fef141517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1c08b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1415e740 0x7fef140c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1c08b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef1409ba90 con 0x7fef1415e740 2024-09-16T01:24:04.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1c08b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fef140d1020 con 0x7fef1406d4c0 2024-09-16T01:24:04.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1c08b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fef1406de50 con 0x7fef1409b690 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1a628640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1415e740 0x7fef140c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1a628640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1415e740 0x7fef140c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51250/0 (socket says 172.21.15.81:51250) 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1a628640 1 -- 172.21.15.81:0/3010210152 learned_addr learned my addr 172.21.15.81:0/3010210152 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef19e27640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef1406d4c0 0x7fef14162a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef19626640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef1409b690 0x7fef141517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1a628640 1 -- 172.21.15.81:0/3010210152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef1409b690 msgr2=0x7fef141517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1a628640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef1409b690 0x7fef141517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1a628640 1 -- 172.21.15.81:0/3010210152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef1406d4c0 msgr2=0x7fef14162a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1a628640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef1406d4c0 0x7fef14162a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1a628640 1 -- 172.21.15.81:0/3010210152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef140c6410 con 0x7fef1415e740 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef19e27640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef1406d4c0 0x7fef14162a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.137+0000 7fef1a628640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1415e740 0x7fef140c5ed0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fef0c009e50 tx=0x7fef0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:04.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.138+0000 7fef0a7fc640 1 -- 172.21.15.81:0/3010210152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c036050 con 0x7fef1415e740 2024-09-16T01:24:04.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.138+0000 7fef0a7fc640 1 -- 172.21.15.81:0/3010210152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0c042070 con 0x7fef1415e740 2024-09-16T01:24:04.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.138+0000 7fef1c08b640 1 -- 172.21.15.81:0/3010210152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef140c66b0 con 0x7fef1415e740 2024-09-16T01:24:04.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.138+0000 7fef0a7fc640 1 -- 172.21.15.81:0/3010210152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c009510 con 0x7fef1415e740 2024-09-16T01:24:04.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.138+0000 7fef1c08b640 1 -- 172.21.15.81:0/3010210152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef140c6c70 con 0x7fef1415e740 2024-09-16T01:24:04.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.139+0000 7fef1c08b640 1 -- 172.21.15.81:0/3010210152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef1406d910 con 0x7fef1415e740 2024-09-16T01:24:04.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.139+0000 7fef0a7fc640 1 -- 172.21.15.81:0/3010210152 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fef0c007bd0 con 0x7fef1415e740 2024-09-16T01:24:04.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.139+0000 7fef0a7fc640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7feef806c2b0 0x7feef806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.140+0000 7fef0a7fc640 1 -- 172.21.15.81:0/3010210152 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7fef0c0ac530 con 0x7fef1415e740 2024-09-16T01:24:04.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.140+0000 7fef19e27640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7feef806c2b0 0x7feef806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.140+0000 7fef19e27640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7feef806c2b0 0x7feef806e770 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fef14071f30 tx=0x7fef10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:04.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.144+0000 7fef0a7fc640 1 -- 172.21.15.81:0/3010210152 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef0c07a4c0 con 0x7fef1415e740 2024-09-16T01:24:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.307+0000 7fef1c08b640 1 -- 172.21.15.81:0/3010210152 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef140b1300 con 0x7feef806c2b0 2024-09-16T01:24:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.313+0000 7fef0a7fc640 1 -- 172.21.15.81:0/3010210152 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252479 (secure 0 0 0) 0x7fef140b1300 con 0x7feef806c2b0 2024-09-16T01:24:04.317 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:24:04.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.316+0000 7fef1c08b640 1 -- 172.21.15.81:0/3010210152 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7feef806c2b0 msgr2=0x7feef806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.316+0000 7fef1c08b640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7feef806c2b0 0x7feef806e770 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fef14071f30 tx=0x7fef10008040 comp rx=0 tx=0).stop 2024-09-16T01:24:04.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.316+0000 7fef1c08b640 1 -- 172.21.15.81:0/3010210152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1415e740 msgr2=0x7fef140c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.316+0000 7fef1c08b640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1415e740 0x7fef140c5ed0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fef0c009e50 tx=0x7fef0c004a40 comp rx=0 tx=0).stop 2024-09-16T01:24:04.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.316+0000 7fef1c08b640 1 -- 172.21.15.81:0/3010210152 shutdown_connections 2024-09-16T01:24:04.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.316+0000 7fef1c08b640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7feef806c2b0 0x7feef806e770 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.316+0000 7fef1c08b640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef1415e740 0x7fef140c5ed0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.316+0000 7fef1c08b640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fef1409b690 0x7fef141517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.316+0000 7fef1c08b640 1 --2- 172.21.15.81:0/3010210152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef1406d4c0 0x7fef14162a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.316+0000 7fef1c08b640 1 -- 172.21.15.81:0/3010210152 >> 172.21.15.81:0/3010210152 conn(0x7fef140d23a0 msgr2=0x7fef140b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:04.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.316+0000 7fef1c08b640 1 -- 172.21.15.81:0/3010210152 shutdown_connections 2024-09-16T01:24:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.316+0000 7fef1c08b640 1 -- 172.21.15.81:0/3010210152 wait complete. 2024-09-16T01:24:04.329 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-09-16T01:24:04.168730+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":273748,"kb_used_data":15880,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754700972,"statfs":{"total":773094113280,"available":772813795328,"internally_reserved":0,"allocated":16261120,"data_stored":8131244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.126256"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.912823+0000","last_change":"2024-09-16T01:24:00.912099+0000","last_active":"2024-09-16T01:24:01.912823+0000","last_peered":"2024-09-16T01:24:01.912823+0000","last_clean":"2024-09-16T01:24:01.912823+0000","last_became_active":"2024-09-16T01:24:00.911791+0000","last_became_peered":"2024-09-16T01:24:00.911791+0000","last_unstale":"2024-09-16T01:24:01.912823+0000","last_undegraded":"2024-09-16T01:24:01.912823+0000","last_fullsized":"2024-09-16T01:24:01.912823+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:42:53.156617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112282+0000","last_change":"2024-09-16T01:24:00.917971+0000","last_active":"2024-09-16T01:24:02.112282+0000","last_peered":"2024-09-16T01:24:02.112282+0000","last_clean":"2024-09-16T01:24:02.112282+0000","last_became_active":"2024-09-16T01:24:00.916644+0000","last_became_peered":"2024-09-16T01:24:00.916644+0000","last_unstale":"2024-09-16T01:24:02.112282+0000","last_undegraded":"2024-09-16T01:24:02.112282+0000","last_fullsized":"2024-09-16T01:24:02.112282+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:02.570143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.912632+0000","last_change":"2024-09-16T01:24:00.919181+0000","last_active":"2024-09-16T01:24:01.912632+0000","last_peered":"2024-09-16T01:24:01.912632+0000","last_clean":"2024-09-16T01:24:01.912632+0000","last_became_active":"2024-09-16T01:24:00.918891+0000","last_became_peered":"2024-09-16T01:24:00.918891+0000","last_unstale":"2024-09-16T01:24:01.912632+0000","last_undegraded":"2024-09-16T01:24:01.912632+0000","last_fullsized":"2024-09-16T01:24:01.912632+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:57.592668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.912838+0000","last_change":"2024-09-16T01:24:00.916030+0000","last_active":"2024-09-16T01:24:01.912838+0000","last_peered":"2024-09-16T01:24:01.912838+0000","last_clean":"2024-09-16T01:24:01.912838+0000","last_became_active":"2024-09-16T01:24:00.915394+0000","last_became_peered":"2024-09-16T01:24:00.915394+0000","last_unstale":"2024-09-16T01:24:01.912838+0000","last_undegraded":"2024-09-16T01:24:01.912838+0000","last_fullsized":"2024-09-16T01:24:01.912838+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:44.793143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.113165+0000","last_change":"2024-09-16T01:24:00.913166+0000","last_active":"2024-09-16T01:24:02.113165+0000","last_peered":"2024-09-16T01:24:02.113165+0000","last_clean":"2024-09-16T01:24:02.113165+0000","last_became_active":"2024-09-16T01:24:00.912911+0000","last_became_peered":"2024-09-16T01:24:00.912911+0000","last_unstale":"2024-09-16T01:24:02.113165+0000","last_undegraded":"2024-09-16T01:24:02.113165+0000","last_fullsized":"2024-09-16T01:24:02.113165+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:30.915282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112079+0000","last_change":"2024-09-16T01:24:00.928830+0000","last_active":"2024-09-16T01:24:02.112079+0000","last_peered":"2024-09-16T01:24:02.112079+0000","last_clean":"2024-09-16T01:24:02.112079+0000","last_became_active":"2024-09-16T01:24:00.928547+0000","last_became_peered":"2024-09-16T01:24:00.928547+0000","last_unstale":"2024-09-16T01:24:02.112079+0000","last_undegraded":"2024-09-16T01:24:02.112079+0000","last_fullsized":"2024-09-16T01:24:02.112079+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:05.881182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112263+0000","last_change":"2024-09-16T01:24:00.911758+0000","last_active":"2024-09-16T01:24:02.112263+0000","last_peered":"2024-09-16T01:24:02.112263+0000","last_clean":"2024-09-16T01:24:02.112263+0000","last_became_active":"2024-09-16T01:24:00.911506+0000","last_became_peered":"2024-09-16T01:24:00.911506+0000","last_unstale":"2024-09-16T01:24:02.112263+0000","last_undegraded":"2024-09-16T01:24:02.112263+0000","last_fullsized":"2024-09-16T01:24:02.112263+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:12.593477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111953+0000","last_change":"2024-09-16T01:24:00.918800+0000","last_active":"2024-09-16T01:24:02.111953+0000","last_peered":"2024-09-16T01:24:02.111953+0000","last_clean":"2024-09-16T01:24:02.111953+0000","last_became_active":"2024-09-16T01:24:00.918538+0000","last_became_peered":"2024-09-16T01:24:00.918538+0000","last_unstale":"2024-09-16T01:24:02.111953+0000","last_undegraded":"2024-09-16T01:24:02.111953+0000","last_fullsized":"2024-09-16T01:24:02.111953+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:02.802060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112539+0000","last_change":"2024-09-16T01:24:00.915577+0000","last_active":"2024-09-16T01:24:02.112539+0000","last_peered":"2024-09-16T01:24:02.112539+0000","last_clean":"2024-09-16T01:24:02.112539+0000","last_became_active":"2024-09-16T01:24:00.915280+0000","last_became_peered":"2024-09-16T01:24:00.915280+0000","last_unstale":"2024-09-16T01:24:02.112539+0000","last_undegraded":"2024-09-16T01:24:02.112539+0000","last_fullsized":"2024-09-16T01:24:02.112539+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:31.956277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112721+0000","last_change":"2024-09-16T01:24:00.919740+0000","last_active":"2024-09-16T01:24:02.112721+0000","last_peered":"2024-09-16T01:24:02.112721+0000","last_clean":"2024-09-16T01:24:02.112721+0000","last_became_active":"2024-09-16T01:24:00.919502+0000","last_became_peered":"2024-09-16T01:24:00.919502+0000","last_unstale":"2024-09-16T01:24:02.112721+0000","last_undegraded":"2024-09-16T01:24:02.112721+0000","last_fullsized":"2024-09-16T01:24:02.112721+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:05.881182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.897263+0000","last_change":"2024-09-16T01:24:00.904395+0000","last_active":"2024-09-16T01:24:01.897263+0000","last_peered":"2024-09-16T01:24:01.897263+0000","last_clean":"2024-09-16T01:24:01.897263+0000","last_became_active":"2024-09-16T01:24:00.904120+0000","last_became_peered":"2024-09-16T01:24:00.904120+0000","last_unstale":"2024-09-16T01:24:01.897263+0000","last_undegraded":"2024-09-16T01:24:01.897263+0000","last_fullsized":"2024-09-16T01:24:01.897263+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:06:12.585274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112193+0000","last_change":"2024-09-16T01:24:00.929671+0000","last_active":"2024-09-16T01:24:02.112193+0000","last_peered":"2024-09-16T01:24:02.112193+0000","last_clean":"2024-09-16T01:24:02.112193+0000","last_became_active":"2024-09-16T01:24:00.929428+0000","last_became_peered":"2024-09-16T01:24:00.929428+0000","last_unstale":"2024-09-16T01:24:02.112193+0000","last_undegraded":"2024-09-16T01:24:02.112193+0000","last_fullsized":"2024-09-16T01:24:02.112193+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:28.893737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896235+0000","last_change":"2024-09-16T01:24:00.918360+0000","last_active":"2024-09-16T01:24:01.896235+0000","last_peered":"2024-09-16T01:24:01.896235+0000","last_clean":"2024-09-16T01:24:01.896235+0000","last_became_active":"2024-09-16T01:24:00.918031+0000","last_became_peered":"2024-09-16T01:24:00.918031+0000","last_unstale":"2024-09-16T01:24:01.896235+0000","last_undegraded":"2024-09-16T01:24:01.896235+0000","last_fullsized":"2024-09-16T01:24:01.896235+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:30.915282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112719+0000","last_change":"2024-09-16T01:24:00.913771+0000","last_active":"2024-09-16T01:24:02.112719+0000","last_peered":"2024-09-16T01:24:02.112719+0000","last_clean":"2024-09-16T01:24:02.112719+0000","last_became_active":"2024-09-16T01:24:00.912759+0000","last_became_peered":"2024-09-16T01:24:00.912759+0000","last_unstale":"2024-09-16T01:24:02.112719+0000","last_undegraded":"2024-09-16T01:24:02.112719+0000","last_fullsized":"2024-09-16T01:24:02.112719+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:09.564459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896791+0000","last_change":"2024-09-16T01:24:00.901505+0000","last_active":"2024-09-16T01:24:01.896791+0000","last_peered":"2024-09-16T01:24:01.896791+0000","last_clean":"2024-09-16T01:24:01.896791+0000","last_became_active":"2024-09-16T01:24:00.901211+0000","last_became_peered":"2024-09-16T01:24:00.901211+0000","last_unstale":"2024-09-16T01:24:01.896791+0000","last_undegraded":"2024-09-16T01:24:01.896791+0000","last_fullsized":"2024-09-16T01:24:01.896791+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:32:14.213042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.912463+0000","last_change":"2024-09-16T01:24:00.915142+0000","last_active":"2024-09-16T01:24:01.912463+0000","last_peered":"2024-09-16T01:24:01.912463+0000","last_clean":"2024-09-16T01:24:01.912463+0000","last_became_active":"2024-09-16T01:24:00.914841+0000","last_became_peered":"2024-09-16T01:24:00.914841+0000","last_unstale":"2024-09-16T01:24:01.912463+0000","last_undegraded":"2024-09-16T01:24:01.912463+0000","last_fullsized":"2024-09-16T01:24:01.912463+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:03.864261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112604+0000","last_change":"2024-09-16T01:24:00.905619+0000","last_active":"2024-09-16T01:24:02.112604+0000","last_peered":"2024-09-16T01:24:02.112604+0000","last_clean":"2024-09-16T01:24:02.112604+0000","last_became_active":"2024-09-16T01:24:00.905372+0000","last_became_peered":"2024-09-16T01:24:00.905372+0000","last_unstale":"2024-09-16T01:24:02.112604+0000","last_undegraded":"2024-09-16T01:24:02.112604+0000","last_fullsized":"2024-09-16T01:24:02.112604+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:28.646662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.897238+0000","last_change":"2024-09-16T01:24:00.909050+0000","last_active":"2024-09-16T01:24:01.897238+0000","last_peered":"2024-09-16T01:24:01.897238+0000","last_clean":"2024-09-16T01:24:01.897238+0000","last_became_active":"2024-09-16T01:24:00.908756+0000","last_became_peered":"2024-09-16T01:24:00.908756+0000","last_unstale":"2024-09-16T01:24:01.897238+0000","last_undegraded":"2024-09-16T01:24:01.897238+0000","last_fullsized":"2024-09-16T01:24:01.897238+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:42.095909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.897391+0000","last_change":"2024-09-16T01:24:00.904967+0000","last_active":"2024-09-16T01:24:01.897391+0000","last_peered":"2024-09-16T01:24:01.897391+0000","last_clean":"2024-09-16T01:24:01.897391+0000","last_became_active":"2024-09-16T01:24:00.904247+0000","last_became_peered":"2024-09-16T01:24:00.904247+0000","last_unstale":"2024-09-16T01:24:01.897391+0000","last_undegraded":"2024-09-16T01:24:01.897391+0000","last_fullsized":"2024-09-16T01:24:01.897391+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:34.787936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111891+0000","last_change":"2024-09-16T01:24:00.915004+0000","last_active":"2024-09-16T01:24:02.111891+0000","last_peered":"2024-09-16T01:24:02.111891+0000","last_clean":"2024-09-16T01:24:02.111891+0000","last_became_active":"2024-09-16T01:24:00.914683+0000","last_became_peered":"2024-09-16T01:24:00.914683+0000","last_unstale":"2024-09-16T01:24:02.111891+0000","last_undegraded":"2024-09-16T01:24:02.111891+0000","last_fullsized":"2024-09-16T01:24:02.111891+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:59:17.855553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896212+0000","last_change":"2024-09-16T01:24:00.918648+0000","last_active":"2024-09-16T01:24:01.896212+0000","last_peered":"2024-09-16T01:24:01.896212+0000","last_clean":"2024-09-16T01:24:01.896212+0000","last_became_active":"2024-09-16T01:24:00.918371+0000","last_became_peered":"2024-09-16T01:24:00.918371+0000","last_unstale":"2024-09-16T01:24:01.896212+0000","last_undegraded":"2024-09-16T01:24:01.896212+0000","last_fullsized":"2024-09-16T01:24:01.896212+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:08.315771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112008+0000","last_change":"2024-09-16T01:24:00.919892+0000","last_active":"2024-09-16T01:24:02.112008+0000","last_peered":"2024-09-16T01:24:02.112008+0000","last_clean":"2024-09-16T01:24:02.112008+0000","last_became_active":"2024-09-16T01:24:00.919613+0000","last_became_peered":"2024-09-16T01:24:00.919613+0000","last_unstale":"2024-09-16T01:24:02.112008+0000","last_undegraded":"2024-09-16T01:24:02.112008+0000","last_fullsized":"2024-09-16T01:24:02.112008+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:35.778849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112327+0000","last_change":"2024-09-16T01:24:00.907672+0000","last_active":"2024-09-16T01:24:02.112327+0000","last_peered":"2024-09-16T01:24:02.112327+0000","last_clean":"2024-09-16T01:24:02.112327+0000","last_became_active":"2024-09-16T01:24:00.907409+0000","last_became_peered":"2024-09-16T01:24:00.907409+0000","last_unstale":"2024-09-16T01:24:02.112327+0000","last_undegraded":"2024-09-16T01:24:02.112327+0000","last_fullsized":"2024-09-16T01:24:02.112327+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:46.071624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.912628+0000","last_change":"2024-09-16T01:24:00.913747+0000","last_active":"2024-09-16T01:24:01.912628+0000","last_peered":"2024-09-16T01:24:01.912628+0000","last_clean":"2024-09-16T01:24:01.912628+0000","last_became_active":"2024-09-16T01:24:00.913440+0000","last_became_peered":"2024-09-16T01:24:00.913440+0000","last_unstale":"2024-09-16T01:24:01.912628+0000","last_undegraded":"2024-09-16T01:24:01.912628+0000","last_fullsized":"2024-09-16T01:24:01.912628+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:12.632785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896288+0000","last_change":"2024-09-16T01:24:00.913596+0000","last_active":"2024-09-16T01:24:01.896288+0000","last_peered":"2024-09-16T01:24:01.896288+0000","last_clean":"2024-09-16T01:24:01.896288+0000","last_became_active":"2024-09-16T01:24:00.913292+0000","last_became_peered":"2024-09-16T01:24:00.913292+0000","last_unstale":"2024-09-16T01:24:01.896288+0000","last_undegraded":"2024-09-16T01:24:01.896288+0000","last_fullsized":"2024-09-16T01:24:01.896288+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:44.310706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111905+0000","last_change":"2024-09-16T01:24:00.914486+0000","last_active":"2024-09-16T01:24:02.111905+0000","last_peered":"2024-09-16T01:24:02.111905+0000","last_clean":"2024-09-16T01:24:02.111905+0000","last_became_active":"2024-09-16T01:24:00.914222+0000","last_became_peered":"2024-09-16T01:24:00.914222+0000","last_unstale":"2024-09-16T01:24:02.111905+0000","last_undegraded":"2024-09-16T01:24:02.111905+0000","last_fullsized":"2024-09-16T01:24:02.111905+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:41.539483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112227+0000","last_change":"2024-09-16T01:24:00.919737+0000","last_active":"2024-09-16T01:24:02.112227+0000","last_peered":"2024-09-16T01:24:02.112227+0000","last_clean":"2024-09-16T01:24:02.112227+0000","last_became_active":"2024-09-16T01:24:00.918691+0000","last_became_peered":"2024-09-16T01:24:00.918691+0000","last_unstale":"2024-09-16T01:24:02.112227+0000","last_undegraded":"2024-09-16T01:24:02.112227+0000","last_fullsized":"2024-09-16T01:24:02.112227+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:18:50.632616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.895946+0000","last_change":"2024-09-16T01:24:00.919383+0000","last_active":"2024-09-16T01:24:01.895946+0000","last_peered":"2024-09-16T01:24:01.895946+0000","last_clean":"2024-09-16T01:24:01.895946+0000","last_became_active":"2024-09-16T01:24:00.919018+0000","last_became_peered":"2024-09-16T01:24:00.919018+0000","last_unstale":"2024-09-16T01:24:01.895946+0000","last_undegraded":"2024-09-16T01:24:01.895946+0000","last_fullsized":"2024-09-16T01:24:01.895946+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:35:46.071624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112163+0000","last_change":"2024-09-16T01:24:00.921223+0000","last_active":"2024-09-16T01:24:02.112163+0000","last_peered":"2024-09-16T01:24:02.112163+0000","last_clean":"2024-09-16T01:24:02.112163+0000","last_became_active":"2024-09-16T01:24:00.920943+0000","last_became_peered":"2024-09-16T01:24:00.920943+0000","last_unstale":"2024-09-16T01:24:02.112163+0000","last_undegraded":"2024-09-16T01:24:02.112163+0000","last_fullsized":"2024-09-16T01:24:02.112163+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:26.197621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896937+0000","last_change":"2024-09-16T01:24:00.908352+0000","last_active":"2024-09-16T01:24:01.896937+0000","last_peered":"2024-09-16T01:24:01.896937+0000","last_clean":"2024-09-16T01:24:01.896937+0000","last_became_active":"2024-09-16T01:24:00.908041+0000","last_became_peered":"2024-09-16T01:24:00.908041+0000","last_unstale":"2024-09-16T01:24:01.896937+0000","last_undegraded":"2024-09-16T01:24:01.896937+0000","last_fullsized":"2024-09-16T01:24:01.896937+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:42:05.147294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.897035+0000","last_change":"2024-09-16T01:24:00.903605+0000","last_active":"2024-09-16T01:24:01.897035+0000","last_peered":"2024-09-16T01:24:01.897035+0000","last_clean":"2024-09-16T01:24:01.897035+0000","last_became_active":"2024-09-16T01:24:00.903332+0000","last_became_peered":"2024-09-16T01:24:00.903332+0000","last_unstale":"2024-09-16T01:24:01.897035+0000","last_undegraded":"2024-09-16T01:24:01.897035+0000","last_fullsized":"2024-09-16T01:24:01.897035+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:17.760367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896901+0000","last_change":"2024-09-16T01:24:00.915210+0000","last_active":"2024-09-16T01:24:01.896901+0000","last_peered":"2024-09-16T01:24:01.896901+0000","last_clean":"2024-09-16T01:24:01.896901+0000","last_became_active":"2024-09-16T01:24:00.914935+0000","last_became_peered":"2024-09-16T01:24:00.914935+0000","last_unstale":"2024-09-16T01:24:01.896901+0000","last_undegraded":"2024-09-16T01:24:01.896901+0000","last_fullsized":"2024-09-16T01:24:01.896901+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:55:22.038132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111974+0000","last_change":"2024-09-16T01:24:00.913671+0000","last_active":"2024-09-16T01:24:02.111974+0000","last_peered":"2024-09-16T01:24:02.111974+0000","last_clean":"2024-09-16T01:24:02.111974+0000","last_became_active":"2024-09-16T01:24:00.913385+0000","last_became_peered":"2024-09-16T01:24:00.913385+0000","last_unstale":"2024-09-16T01:24:02.111974+0000","last_undegraded":"2024-09-16T01:24:02.111974+0000","last_fullsized":"2024-09-16T01:24:02.111974+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:28.646662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"148'4","reported_seq":18,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.912888+0000","last_change":"2024-09-16T01:24:00.068216+0000","last_active":"2024-09-16T01:24:01.912888+0000","last_peered":"2024-09-16T01:24:01.912888+0000","last_clean":"2024-09-16T01:24:01.912888+0000","last_became_active":"2024-09-16T01:24:00.067959+0000","last_became_peered":"2024-09-16T01:24:00.067959+0000","last_unstale":"2024-09-16T01:24:01.912888+0000","last_undegraded":"2024-09-16T01:24:01.912888+0000","last_fullsized":"2024-09-16T01:24:01.912888+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:38:57.565071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.895785+0000","last_change":"2024-09-16T01:24:00.908623+0000","last_active":"2024-09-16T01:24:01.895785+0000","last_peered":"2024-09-16T01:24:01.895785+0000","last_clean":"2024-09-16T01:24:01.895785+0000","last_became_active":"2024-09-16T01:24:00.908354+0000","last_became_peered":"2024-09-16T01:24:00.908354+0000","last_unstale":"2024-09-16T01:24:01.895785+0000","last_undegraded":"2024-09-16T01:24:01.895785+0000","last_fullsized":"2024-09-16T01:24:01.895785+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:05:00.653079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"148'1","reported_seq":15,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112076+0000","last_change":"2024-09-16T01:24:00.059119+0000","last_active":"2024-09-16T01:24:02.112076+0000","last_peered":"2024-09-16T01:24:02.112076+0000","last_clean":"2024-09-16T01:24:02.112076+0000","last_became_active":"2024-09-16T01:24:00.058685+0000","last_became_peered":"2024-09-16T01:24:00.058685+0000","last_unstale":"2024-09-16T01:24:02.112076+0000","last_undegraded":"2024-09-16T01:24:02.112076+0000","last_fullsized":"2024-09-16T01:24:02.112076+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:34.773888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112861+0000","last_change":"2024-09-16T01:24:00.911695+0000","last_active":"2024-09-16T01:24:02.112861+0000","last_peered":"2024-09-16T01:24:02.112861+0000","last_clean":"2024-09-16T01:24:02.112861+0000","last_became_active":"2024-09-16T01:24:00.911459+0000","last_became_peered":"2024-09-16T01:24:00.911459+0000","last_unstale":"2024-09-16T01:24:02.112861+0000","last_undegraded":"2024-09-16T01:24:02.112861+0000","last_fullsized":"2024-09-16T01:24:02.112861+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:08.315771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"148'2","reported_seq":16,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.897455+0000","last_change":"2024-09-16T01:24:00.060032+0000","last_active":"2024-09-16T01:24:01.897455+0000","last_peered":"2024-09-16T01:24:01.897455+0000","last_clean":"2024-09-16T01:24:01.897455+0000","last_became_active":"2024-09-16T01:24:00.059721+0000","last_became_peered":"2024-09-16T01:24:00.059721+0000","last_unstale":"2024-09-16T01:24:01.897455+0000","last_undegraded":"2024-09-16T01:24:01.897455+0000","last_fullsized":"2024-09-16T01:24:01.897455+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:11.627824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112288+0000","last_change":"2024-09-16T01:24:00.917678+0000","last_active":"2024-09-16T01:24:02.112288+0000","last_peered":"2024-09-16T01:24:02.112288+0000","last_clean":"2024-09-16T01:24:02.112288+0000","last_became_active":"2024-09-16T01:24:00.917391+0000","last_became_peered":"2024-09-16T01:24:00.917391+0000","last_unstale":"2024-09-16T01:24:02.112288+0000","last_undegraded":"2024-09-16T01:24:02.112288+0000","last_fullsized":"2024-09-16T01:24:02.112288+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:37:11.171409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"148'2","reported_seq":16,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111984+0000","last_change":"2024-09-16T01:24:00.061987+0000","last_active":"2024-09-16T01:24:02.111984+0000","last_peered":"2024-09-16T01:24:02.111984+0000","last_clean":"2024-09-16T01:24:02.111984+0000","last_became_active":"2024-09-16T01:24:00.061724+0000","last_became_peered":"2024-09-16T01:24:00.061724+0000","last_unstale":"2024-09-16T01:24:02.111984+0000","last_undegraded":"2024-09-16T01:24:02.111984+0000","last_fullsized":"2024-09-16T01:24:02.111984+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:35.350298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112238+0000","last_change":"2024-09-16T01:24:00.919708+0000","last_active":"2024-09-16T01:24:02.112238+0000","last_peered":"2024-09-16T01:24:02.112238+0000","last_clean":"2024-09-16T01:24:02.112238+0000","last_became_active":"2024-09-16T01:24:00.919430+0000","last_became_peered":"2024-09-16T01:24:00.919430+0000","last_unstale":"2024-09-16T01:24:02.112238+0000","last_undegraded":"2024-09-16T01:24:02.112238+0000","last_fullsized":"2024-09-16T01:24:02.112238+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:58.512894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"148'1","reported_seq":15,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111970+0000","last_change":"2024-09-16T01:24:00.064206+0000","last_active":"2024-09-16T01:24:02.111970+0000","last_peered":"2024-09-16T01:24:02.111970+0000","last_clean":"2024-09-16T01:24:02.111970+0000","last_became_active":"2024-09-16T01:24:00.063955+0000","last_became_peered":"2024-09-16T01:24:00.063955+0000","last_unstale":"2024-09-16T01:24:02.111970+0000","last_undegraded":"2024-09-16T01:24:02.111970+0000","last_fullsized":"2024-09-16T01:24:02.111970+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:06.071016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111962+0000","last_change":"2024-09-16T01:24:00.910277+0000","last_active":"2024-09-16T01:24:02.111962+0000","last_peered":"2024-09-16T01:24:02.111962+0000","last_clean":"2024-09-16T01:24:02.111962+0000","last_became_active":"2024-09-16T01:24:00.910004+0000","last_became_peered":"2024-09-16T01:24:00.910004+0000","last_unstale":"2024-09-16T01:24:02.111962+0000","last_undegraded":"2024-09-16T01:24:02.111962+0000","last_fullsized":"2024-09-16T01:24:02.111962+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:49.334065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"148'1","reported_seq":15,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112915+0000","last_change":"2024-09-16T01:24:00.063333+0000","last_active":"2024-09-16T01:24:02.112915+0000","last_peered":"2024-09-16T01:24:02.112915+0000","last_clean":"2024-09-16T01:24:02.112915+0000","last_became_active":"2024-09-16T01:24:00.063073+0000","last_became_peered":"2024-09-16T01:24:00.063073+0000","last_unstale":"2024-09-16T01:24:02.112915+0000","last_undegraded":"2024-09-16T01:24:02.112915+0000","last_fullsized":"2024-09-16T01:24:02.112915+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:25.192661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112030+0000","last_change":"2024-09-16T01:24:00.913996+0000","last_active":"2024-09-16T01:24:02.112030+0000","last_peered":"2024-09-16T01:24:02.112030+0000","last_clean":"2024-09-16T01:24:02.112030+0000","last_became_active":"2024-09-16T01:24:00.913548+0000","last_became_peered":"2024-09-16T01:24:00.913548+0000","last_unstale":"2024-09-16T01:24:02.112030+0000","last_undegraded":"2024-09-16T01:24:02.112030+0000","last_fullsized":"2024-09-16T01:24:02.112030+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:32.202067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111556+0000","last_change":"2024-09-16T01:24:00.063758+0000","last_active":"2024-09-16T01:24:02.111556+0000","last_peered":"2024-09-16T01:24:02.111556+0000","last_clean":"2024-09-16T01:24:02.111556+0000","last_became_active":"2024-09-16T01:24:00.063511+0000","last_became_peered":"2024-09-16T01:24:00.063511+0000","last_unstale":"2024-09-16T01:24:02.111556+0000","last_undegraded":"2024-09-16T01:24:02.111556+0000","last_fullsized":"2024-09-16T01:24:02.111556+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:37:53.406316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.912868+0000","last_change":"2024-09-16T01:24:00.917602+0000","last_active":"2024-09-16T01:24:01.912868+0000","last_peered":"2024-09-16T01:24:01.912868+0000","last_clean":"2024-09-16T01:24:01.912868+0000","last_became_active":"2024-09-16T01:24:00.917322+0000","last_became_peered":"2024-09-16T01:24:00.917322+0000","last_unstale":"2024-09-16T01:24:01.912868+0000","last_undegraded":"2024-09-16T01:24:01.912868+0000","last_fullsized":"2024-09-16T01:24:01.912868+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:42.319401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112132+0000","last_change":"2024-09-16T01:24:00.065180+0000","last_active":"2024-09-16T01:24:02.112132+0000","last_peered":"2024-09-16T01:24:02.112132+0000","last_clean":"2024-09-16T01:24:02.112132+0000","last_became_active":"2024-09-16T01:24:00.064888+0000","last_became_peered":"2024-09-16T01:24:00.064888+0000","last_unstale":"2024-09-16T01:24:02.112132+0000","last_undegraded":"2024-09-16T01:24:02.112132+0000","last_fullsized":"2024-09-16T01:24:02.112132+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:54.359595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112007+0000","last_change":"2024-09-16T01:24:00.914431+0000","last_active":"2024-09-16T01:24:02.112007+0000","last_peered":"2024-09-16T01:24:02.112007+0000","last_clean":"2024-09-16T01:24:02.112007+0000","last_became_active":"2024-09-16T01:24:00.914057+0000","last_became_peered":"2024-09-16T01:24:00.914057+0000","last_unstale":"2024-09-16T01:24:02.112007+0000","last_undegraded":"2024-09-16T01:24:02.112007+0000","last_fullsized":"2024-09-16T01:24:02.112007+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:06:53.290126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896185+0000","last_change":"2024-09-16T01:24:00.067626+0000","last_active":"2024-09-16T01:24:01.896185+0000","last_peered":"2024-09-16T01:24:01.896185+0000","last_clean":"2024-09-16T01:24:01.896185+0000","last_became_active":"2024-09-16T01:24:00.067340+0000","last_became_peered":"2024-09-16T01:24:00.067340+0000","last_unstale":"2024-09-16T01:24:01.896185+0000","last_undegraded":"2024-09-16T01:24:01.896185+0000","last_fullsized":"2024-09-16T01:24:01.896185+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:30.951316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.895994+0000","last_change":"2024-09-16T01:24:00.909533+0000","last_active":"2024-09-16T01:24:01.895994+0000","last_peered":"2024-09-16T01:24:01.895994+0000","last_clean":"2024-09-16T01:24:01.895994+0000","last_became_active":"2024-09-16T01:24:00.909282+0000","last_became_peered":"2024-09-16T01:24:00.909282+0000","last_unstale":"2024-09-16T01:24:01.895994+0000","last_undegraded":"2024-09-16T01:24:01.895994+0000","last_fullsized":"2024-09-16T01:24:01.895994+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:18.371717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"148'3","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.912702+0000","last_change":"2024-09-16T01:24:00.055399+0000","last_active":"2024-09-16T01:24:01.912702+0000","last_peered":"2024-09-16T01:24:01.912702+0000","last_clean":"2024-09-16T01:24:01.912702+0000","last_became_active":"2024-09-16T01:24:00.055144+0000","last_became_peered":"2024-09-16T01:24:00.055144+0000","last_unstale":"2024-09-16T01:24:01.912702+0000","last_undegraded":"2024-09-16T01:24:01.912702+0000","last_fullsized":"2024-09-16T01:24:01.912702+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:44.147949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111698+0000","last_change":"2024-09-16T01:24:00.907785+0000","last_active":"2024-09-16T01:24:02.111698+0000","last_peered":"2024-09-16T01:24:02.111698+0000","last_clean":"2024-09-16T01:24:02.111698+0000","last_became_active":"2024-09-16T01:24:00.907528+0000","last_became_peered":"2024-09-16T01:24:00.907528+0000","last_unstale":"2024-09-16T01:24:02.111698+0000","last_undegraded":"2024-09-16T01:24:02.111698+0000","last_fullsized":"2024-09-16T01:24:02.111698+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:15:49.976807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"148'6","reported_seq":20,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896194+0000","last_change":"2024-09-16T01:24:00.067885+0000","last_active":"2024-09-16T01:24:01.896194+0000","last_peered":"2024-09-16T01:24:01.896194+0000","last_clean":"2024-09-16T01:24:01.896194+0000","last_became_active":"2024-09-16T01:24:00.067630+0000","last_became_peered":"2024-09-16T01:24:00.067630+0000","last_unstale":"2024-09-16T01:24:01.896194+0000","last_undegraded":"2024-09-16T01:24:01.896194+0000","last_fullsized":"2024-09-16T01:24:01.896194+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:04.876222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.897142+0000","last_change":"2024-09-16T01:24:00.920211+0000","last_active":"2024-09-16T01:24:01.897142+0000","last_peered":"2024-09-16T01:24:01.897142+0000","last_clean":"2024-09-16T01:24:01.897142+0000","last_became_active":"2024-09-16T01:24:00.919924+0000","last_became_peered":"2024-09-16T01:24:00.919924+0000","last_unstale":"2024-09-16T01:24:01.897142+0000","last_undegraded":"2024-09-16T01:24:01.897142+0000","last_fullsized":"2024-09-16T01:24:01.897142+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:44.794273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"148'2","reported_seq":16,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.113231+0000","last_change":"2024-09-16T01:24:00.053630+0000","last_active":"2024-09-16T01:24:02.113231+0000","last_peered":"2024-09-16T01:24:02.113231+0000","last_clean":"2024-09-16T01:24:02.113231+0000","last_became_active":"2024-09-16T01:24:00.053340+0000","last_became_peered":"2024-09-16T01:24:00.053340+0000","last_unstale":"2024-09-16T01:24:02.113231+0000","last_undegraded":"2024-09-16T01:24:02.113231+0000","last_fullsized":"2024-09-16T01:24:02.113231+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:01.565183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112566+0000","last_change":"2024-09-16T01:24:00.904753+0000","last_active":"2024-09-16T01:24:02.112566+0000","last_peered":"2024-09-16T01:24:02.112566+0000","last_clean":"2024-09-16T01:24:02.112566+0000","last_became_active":"2024-09-16T01:24:00.904469+0000","last_became_peered":"2024-09-16T01:24:00.904469+0000","last_unstale":"2024-09-16T01:24:02.112566+0000","last_undegraded":"2024-09-16T01:24:02.112566+0000","last_fullsized":"2024-09-16T01:24:02.112566+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:06:53.290126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.895845+0000","last_change":"2024-09-16T01:24:00.065976+0000","last_active":"2024-09-16T01:24:01.895845+0000","last_peered":"2024-09-16T01:24:01.895845+0000","last_clean":"2024-09-16T01:24:01.895845+0000","last_became_active":"2024-09-16T01:24:00.065734+0000","last_became_peered":"2024-09-16T01:24:00.065734+0000","last_unstale":"2024-09-16T01:24:01.895845+0000","last_undegraded":"2024-09-16T01:24:01.895845+0000","last_fullsized":"2024-09-16T01:24:01.895845+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:25.192661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896948+0000","last_change":"2024-09-16T01:24:00.914172+0000","last_active":"2024-09-16T01:24:01.896948+0000","last_peered":"2024-09-16T01:24:01.896948+0000","last_clean":"2024-09-16T01:24:01.896948+0000","last_became_active":"2024-09-16T01:24:00.913640+0000","last_became_peered":"2024-09-16T01:24:00.913640+0000","last_unstale":"2024-09-16T01:24:01.896948+0000","last_undegraded":"2024-09-16T01:24:01.896948+0000","last_fullsized":"2024-09-16T01:24:01.896948+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:06.343724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.897017+0000","last_change":"2024-09-16T01:24:00.053489+0000","last_active":"2024-09-16T01:24:01.897017+0000","last_peered":"2024-09-16T01:24:01.897017+0000","last_clean":"2024-09-16T01:24:01.897017+0000","last_became_active":"2024-09-16T01:24:00.052948+0000","last_became_peered":"2024-09-16T01:24:00.052948+0000","last_unstale":"2024-09-16T01:24:01.897017+0000","last_undegraded":"2024-09-16T01:24:01.897017+0000","last_fullsized":"2024-09-16T01:24:01.897017+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:56.587708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112348+0000","last_change":"2024-09-16T01:24:00.917305+0000","last_active":"2024-09-16T01:24:02.112348+0000","last_peered":"2024-09-16T01:24:02.112348+0000","last_clean":"2024-09-16T01:24:02.112348+0000","last_became_active":"2024-09-16T01:24:00.917009+0000","last_became_peered":"2024-09-16T01:24:00.917009+0000","last_unstale":"2024-09-16T01:24:02.112348+0000","last_undegraded":"2024-09-16T01:24:02.112348+0000","last_fullsized":"2024-09-16T01:24:02.112348+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:38.863272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"148'8","reported_seq":22,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112167+0000","last_change":"2024-09-16T01:24:00.061550+0000","last_active":"2024-09-16T01:24:02.112167+0000","last_peered":"2024-09-16T01:24:02.112167+0000","last_clean":"2024-09-16T01:24:02.112167+0000","last_became_active":"2024-09-16T01:24:00.061227+0000","last_became_peered":"2024-09-16T01:24:00.061227+0000","last_unstale":"2024-09-16T01:24:02.112167+0000","last_undegraded":"2024-09-16T01:24:02.112167+0000","last_fullsized":"2024-09-16T01:24:02.112167+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:15.198685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112077+0000","last_change":"2024-09-16T01:24:00.912378+0000","last_active":"2024-09-16T01:24:02.112077+0000","last_peered":"2024-09-16T01:24:02.112077+0000","last_clean":"2024-09-16T01:24:02.112077+0000","last_became_active":"2024-09-16T01:24:00.912117+0000","last_became_peered":"2024-09-16T01:24:00.912117+0000","last_unstale":"2024-09-16T01:24:02.112077+0000","last_undegraded":"2024-09-16T01:24:02.112077+0000","last_fullsized":"2024-09-16T01:24:02.112077+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:18.068823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"148'1","reported_seq":15,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896314+0000","last_change":"2024-09-16T01:24:00.066790+0000","last_active":"2024-09-16T01:24:01.896314+0000","last_peered":"2024-09-16T01:24:01.896314+0000","last_clean":"2024-09-16T01:24:01.896314+0000","last_became_active":"2024-09-16T01:24:00.066412+0000","last_became_peered":"2024-09-16T01:24:00.066412+0000","last_unstale":"2024-09-16T01:24:01.896314+0000","last_undegraded":"2024-09-16T01:24:01.896314+0000","last_fullsized":"2024-09-16T01:24:01.896314+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:06:52.285166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.897477+0000","last_change":"2024-09-16T01:24:00.907599+0000","last_active":"2024-09-16T01:24:01.897477+0000","last_peered":"2024-09-16T01:24:01.897477+0000","last_clean":"2024-09-16T01:24:01.897477+0000","last_became_active":"2024-09-16T01:24:00.906836+0000","last_became_peered":"2024-09-16T01:24:00.906836+0000","last_unstale":"2024-09-16T01:24:01.897477+0000","last_undegraded":"2024-09-16T01:24:01.897477+0000","last_fullsized":"2024-09-16T01:24:01.897477+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:09.833106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"148'2","reported_seq":16,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112768+0000","last_change":"2024-09-16T01:24:00.064052+0000","last_active":"2024-09-16T01:24:02.112768+0000","last_peered":"2024-09-16T01:24:02.112768+0000","last_clean":"2024-09-16T01:24:02.112768+0000","last_became_active":"2024-09-16T01:24:00.062566+0000","last_became_peered":"2024-09-16T01:24:00.062566+0000","last_unstale":"2024-09-16T01:24:02.112768+0000","last_undegraded":"2024-09-16T01:24:02.112768+0000","last_fullsized":"2024-09-16T01:24:02.112768+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:54.056704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896865+0000","last_change":"2024-09-16T01:24:00.913006+0000","last_active":"2024-09-16T01:24:01.896865+0000","last_peered":"2024-09-16T01:24:01.896865+0000","last_clean":"2024-09-16T01:24:01.896865+0000","last_became_active":"2024-09-16T01:24:00.912394+0000","last_became_peered":"2024-09-16T01:24:00.912394+0000","last_unstale":"2024-09-16T01:24:01.896865+0000","last_undegraded":"2024-09-16T01:24:01.896865+0000","last_fullsized":"2024-09-16T01:24:01.896865+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:41.488987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"148'1","reported_seq":15,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112745+0000","last_change":"2024-09-16T01:24:00.059171+0000","last_active":"2024-09-16T01:24:02.112745+0000","last_peered":"2024-09-16T01:24:02.112745+0000","last_clean":"2024-09-16T01:24:02.112745+0000","last_became_active":"2024-09-16T01:24:00.058943+0000","last_became_peered":"2024-09-16T01:24:00.058943+0000","last_unstale":"2024-09-16T01:24:02.112745+0000","last_undegraded":"2024-09-16T01:24:02.112745+0000","last_fullsized":"2024-09-16T01:24:02.112745+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.897091+0000","last_change":"2024-09-16T01:24:00.907717+0000","last_active":"2024-09-16T01:24:01.897091+0000","last_peered":"2024-09-16T01:24:01.897091+0000","last_clean":"2024-09-16T01:24:01.897091+0000","last_became_active":"2024-09-16T01:24:00.907408+0000","last_became_peered":"2024-09-16T01:24:00.907408+0000","last_unstale":"2024-09-16T01:24:01.897091+0000","last_undegraded":"2024-09-16T01:24:01.897091+0000","last_fullsized":"2024-09-16T01:24:01.897091+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:47:22.285876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112331+0000","last_change":"2024-09-16T01:24:00.063598+0000","last_active":"2024-09-16T01:24:02.112331+0000","last_peered":"2024-09-16T01:24:02.112331+0000","last_clean":"2024-09-16T01:24:02.112331+0000","last_became_active":"2024-09-16T01:24:00.063336+0000","last_became_peered":"2024-09-16T01:24:00.063336+0000","last_unstale":"2024-09-16T01:24:02.112331+0000","last_undegraded":"2024-09-16T01:24:02.112331+0000","last_fullsized":"2024-09-16T01:24:02.112331+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:53.195552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896081+0000","last_change":"2024-09-16T01:24:00.919418+0000","last_active":"2024-09-16T01:24:01.896081+0000","last_peered":"2024-09-16T01:24:01.896081+0000","last_clean":"2024-09-16T01:24:01.896081+0000","last_became_active":"2024-09-16T01:24:00.919068+0000","last_became_peered":"2024-09-16T01:24:00.919068+0000","last_unstale":"2024-09-16T01:24:01.896081+0000","last_undegraded":"2024-09-16T01:24:01.896081+0000","last_fullsized":"2024-09-16T01:24:01.896081+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:09.564459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"148'2","reported_seq":16,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.113139+0000","last_change":"2024-09-16T01:24:00.058339+0000","last_active":"2024-09-16T01:24:02.113139+0000","last_peered":"2024-09-16T01:24:02.113139+0000","last_clean":"2024-09-16T01:24:02.113139+0000","last_became_active":"2024-09-16T01:24:00.058082+0000","last_became_peered":"2024-09-16T01:24:00.058082+0000","last_unstale":"2024-09-16T01:24:02.113139+0000","last_undegraded":"2024-09-16T01:24:02.113139+0000","last_fullsized":"2024-09-16T01:24:02.113139+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:18:49.627656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112647+0000","last_change":"2024-09-16T01:24:00.909656+0000","last_active":"2024-09-16T01:24:02.112647+0000","last_peered":"2024-09-16T01:24:02.112647+0000","last_clean":"2024-09-16T01:24:02.112647+0000","last_became_active":"2024-09-16T01:24:00.909372+0000","last_became_peered":"2024-09-16T01:24:00.909372+0000","last_unstale":"2024-09-16T01:24:02.112647+0000","last_undegraded":"2024-09-16T01:24:02.112647+0000","last_fullsized":"2024-09-16T01:24:02.112647+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:18.371717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896967+0000","last_change":"2024-09-16T01:24:00.062553+0000","last_active":"2024-09-16T01:24:01.896967+0000","last_peered":"2024-09-16T01:24:01.896967+0000","last_clean":"2024-09-16T01:24:01.896967+0000","last_became_active":"2024-09-16T01:24:00.062262+0000","last_became_peered":"2024-09-16T01:24:00.062262+0000","last_unstale":"2024-09-16T01:24:01.896967+0000","last_undegraded":"2024-09-16T01:24:01.896967+0000","last_fullsized":"2024-09-16T01:24:01.896967+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:02.859300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111985+0000","last_change":"2024-09-16T01:24:00.910334+0000","last_active":"2024-09-16T01:24:02.111985+0000","last_peered":"2024-09-16T01:24:02.111985+0000","last_clean":"2024-09-16T01:24:02.111985+0000","last_became_active":"2024-09-16T01:24:00.910075+0000","last_became_peered":"2024-09-16T01:24:00.910075+0000","last_unstale":"2024-09-16T01:24:02.111985+0000","last_undegraded":"2024-09-16T01:24:02.111985+0000","last_fullsized":"2024-09-16T01:24:02.111985+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:03.262464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111725+0000","last_change":"2024-09-16T01:24:00.060351+0000","last_active":"2024-09-16T01:24:02.111725+0000","last_peered":"2024-09-16T01:24:02.111725+0000","last_clean":"2024-09-16T01:24:02.111725+0000","last_became_active":"2024-09-16T01:24:00.060096+0000","last_became_peered":"2024-09-16T01:24:00.060096+0000","last_unstale":"2024-09-16T01:24:02.111725+0000","last_undegraded":"2024-09-16T01:24:02.111725+0000","last_fullsized":"2024-09-16T01:24:02.111725+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:30.301841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112446+0000","last_change":"2024-09-16T01:24:00.915710+0000","last_active":"2024-09-16T01:24:02.112446+0000","last_peered":"2024-09-16T01:24:02.112446+0000","last_clean":"2024-09-16T01:24:02.112446+0000","last_became_active":"2024-09-16T01:24:00.915454+0000","last_became_peered":"2024-09-16T01:24:00.915454+0000","last_unstale":"2024-09-16T01:24:02.112446+0000","last_undegraded":"2024-09-16T01:24:02.112446+0000","last_fullsized":"2024-09-16T01:24:02.112446+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:43:06.494255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112235+0000","last_change":"2024-09-16T01:24:00.061632+0000","last_active":"2024-09-16T01:24:02.112235+0000","last_peered":"2024-09-16T01:24:02.112235+0000","last_clean":"2024-09-16T01:24:02.112235+0000","last_became_active":"2024-09-16T01:24:00.061308+0000","last_became_peered":"2024-09-16T01:24:00.061308+0000","last_unstale":"2024-09-16T01:24:02.112235+0000","last_undegraded":"2024-09-16T01:24:02.112235+0000","last_fullsized":"2024-09-16T01:24:02.112235+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:05.338763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896620+0000","last_change":"2024-09-16T01:24:00.902883+0000","last_active":"2024-09-16T01:24:01.896620+0000","last_peered":"2024-09-16T01:24:01.896620+0000","last_clean":"2024-09-16T01:24:01.896620+0000","last_became_active":"2024-09-16T01:24:00.902565+0000","last_became_peered":"2024-09-16T01:24:00.902565+0000","last_unstale":"2024-09-16T01:24:01.896620+0000","last_undegraded":"2024-09-16T01:24:01.896620+0000","last_fullsized":"2024-09-16T01:24:01.896620+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:54.200512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"148'2","reported_seq":16,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112915+0000","last_change":"2024-09-16T01:24:00.052530+0000","last_active":"2024-09-16T01:24:02.112915+0000","last_peered":"2024-09-16T01:24:02.112915+0000","last_clean":"2024-09-16T01:24:02.112915+0000","last_became_active":"2024-09-16T01:24:00.052276+0000","last_became_peered":"2024-09-16T01:24:00.052276+0000","last_unstale":"2024-09-16T01:24:02.112915+0000","last_undegraded":"2024-09-16T01:24:02.112915+0000","last_fullsized":"2024-09-16T01:24:02.112915+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:04.876222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112661+0000","last_change":"2024-09-16T01:24:00.905408+0000","last_active":"2024-09-16T01:24:02.112661+0000","last_peered":"2024-09-16T01:24:02.112661+0000","last_clean":"2024-09-16T01:24:02.112661+0000","last_became_active":"2024-09-16T01:24:00.905146+0000","last_became_peered":"2024-09-16T01:24:00.905146+0000","last_unstale":"2024-09-16T01:24:02.112661+0000","last_undegraded":"2024-09-16T01:24:02.112661+0000","last_fullsized":"2024-09-16T01:24:02.112661+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:35.778849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"149'1","reported_seq":15,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:03.062463+0000","last_change":"2024-09-16T01:24:00.067991+0000","last_active":"2024-09-16T01:24:03.062463+0000","last_peered":"2024-09-16T01:24:03.062463+0000","last_clean":"2024-09-16T01:24:03.062463+0000","last_became_active":"2024-09-16T01:24:00.067720+0000","last_became_peered":"2024-09-16T01:24:00.067720+0000","last_unstale":"2024-09-16T01:24:03.062463+0000","last_undegraded":"2024-09-16T01:24:03.062463+0000","last_fullsized":"2024-09-16T01:24:03.062463+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:34.773888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111673+0000","last_change":"2024-09-16T01:24:00.913097+0000","last_active":"2024-09-16T01:24:02.111673+0000","last_peered":"2024-09-16T01:24:02.111673+0000","last_clean":"2024-09-16T01:24:02.111673+0000","last_became_active":"2024-09-16T01:24:00.912819+0000","last_became_peered":"2024-09-16T01:24:00.912819+0000","last_unstale":"2024-09-16T01:24:02.111673+0000","last_undegraded":"2024-09-16T01:24:02.111673+0000","last_fullsized":"2024-09-16T01:24:02.111673+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:06.303518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896110+0000","last_change":"2024-09-16T01:24:00.063552+0000","last_active":"2024-09-16T01:24:01.896110+0000","last_peered":"2024-09-16T01:24:01.896110+0000","last_clean":"2024-09-16T01:24:01.896110+0000","last_became_active":"2024-09-16T01:24:00.063196+0000","last_became_peered":"2024-09-16T01:24:00.063196+0000","last_unstale":"2024-09-16T01:24:01.896110+0000","last_undegraded":"2024-09-16T01:24:01.896110+0000","last_fullsized":"2024-09-16T01:24:01.896110+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:23:11.588516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111880+0000","last_change":"2024-09-16T01:24:00.911604+0000","last_active":"2024-09-16T01:24:02.111880+0000","last_peered":"2024-09-16T01:24:02.111880+0000","last_clean":"2024-09-16T01:24:02.111880+0000","last_became_active":"2024-09-16T01:24:00.911346+0000","last_became_peered":"2024-09-16T01:24:00.911346+0000","last_unstale":"2024-09-16T01:24:02.111880+0000","last_undegraded":"2024-09-16T01:24:02.111880+0000","last_fullsized":"2024-09-16T01:24:02.111880+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:16.458694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112068+0000","last_change":"2024-09-16T01:24:00.066250+0000","last_active":"2024-09-16T01:24:02.112068+0000","last_peered":"2024-09-16T01:24:02.112068+0000","last_clean":"2024-09-16T01:24:02.112068+0000","last_became_active":"2024-09-16T01:24:00.066014+0000","last_became_peered":"2024-09-16T01:24:00.066014+0000","last_unstale":"2024-09-16T01:24:02.112068+0000","last_undegraded":"2024-09-16T01:24:02.112068+0000","last_fullsized":"2024-09-16T01:24:02.112068+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:55:50.416315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.912834+0000","last_change":"2024-09-16T01:24:00.915801+0000","last_active":"2024-09-16T01:24:01.912834+0000","last_peered":"2024-09-16T01:24:01.912834+0000","last_clean":"2024-09-16T01:24:01.912834+0000","last_became_active":"2024-09-16T01:24:00.915086+0000","last_became_peered":"2024-09-16T01:24:00.915086+0000","last_unstale":"2024-09-16T01:24:01.912834+0000","last_undegraded":"2024-09-16T01:24:01.912834+0000","last_fullsized":"2024-09-16T01:24:01.912834+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:28:36.414251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.912597+0000","last_change":"2024-09-16T01:24:00.061025+0000","last_active":"2024-09-16T01:24:01.912597+0000","last_peered":"2024-09-16T01:24:01.912597+0000","last_clean":"2024-09-16T01:24:01.912597+0000","last_became_active":"2024-09-16T01:24:00.060620+0000","last_became_peered":"2024-09-16T01:24:00.060620+0000","last_unstale":"2024-09-16T01:24:01.912597+0000","last_undegraded":"2024-09-16T01:24:01.912597+0000","last_fullsized":"2024-09-16T01:24:01.912597+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:31.213164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112406+0000","last_change":"2024-09-16T01:24:00.919307+0000","last_active":"2024-09-16T01:24:02.112406+0000","last_peered":"2024-09-16T01:24:02.112406+0000","last_clean":"2024-09-16T01:24:02.112406+0000","last_became_active":"2024-09-16T01:24:00.918994+0000","last_became_peered":"2024-09-16T01:24:00.918994+0000","last_unstale":"2024-09-16T01:24:02.112406+0000","last_undegraded":"2024-09-16T01:24:02.112406+0000","last_fullsized":"2024-09-16T01:24:02.112406+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T13:10:09.604411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896013+0000","last_change":"2024-09-16T01:24:00.071859+0000","last_active":"2024-09-16T01:24:01.896013+0000","last_peered":"2024-09-16T01:24:01.896013+0000","last_clean":"2024-09-16T01:24:01.896013+0000","last_became_active":"2024-09-16T01:24:00.071620+0000","last_became_peered":"2024-09-16T01:24:00.071620+0000","last_unstale":"2024-09-16T01:24:01.896013+0000","last_undegraded":"2024-09-16T01:24:01.896013+0000","last_fullsized":"2024-09-16T01:24:01.896013+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:27.888776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.895934+0000","last_change":"2024-09-16T01:24:00.918695+0000","last_active":"2024-09-16T01:24:01.895934+0000","last_peered":"2024-09-16T01:24:01.895934+0000","last_clean":"2024-09-16T01:24:01.895934+0000","last_became_active":"2024-09-16T01:24:00.918430+0000","last_became_peered":"2024-09-16T01:24:00.918430+0000","last_unstale":"2024-09-16T01:24:01.895934+0000","last_undegraded":"2024-09-16T01:24:01.895934+0000","last_fullsized":"2024-09-16T01:24:01.895934+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:03.262464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.897124+0000","last_change":"2024-09-16T01:24:00.059472+0000","last_active":"2024-09-16T01:24:01.897124+0000","last_peered":"2024-09-16T01:24:01.897124+0000","last_clean":"2024-09-16T01:24:01.897124+0000","last_became_active":"2024-09-16T01:24:00.059171+0000","last_became_peered":"2024-09-16T01:24:00.059171+0000","last_unstale":"2024-09-16T01:24:01.897124+0000","last_undegraded":"2024-09-16T01:24:01.897124+0000","last_fullsized":"2024-09-16T01:24:01.897124+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:42:52.151657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112405+0000","last_change":"2024-09-16T01:24:00.915102+0000","last_active":"2024-09-16T01:24:02.112405+0000","last_peered":"2024-09-16T01:24:02.112405+0000","last_clean":"2024-09-16T01:24:02.112405+0000","last_became_active":"2024-09-16T01:24:00.914695+0000","last_became_peered":"2024-09-16T01:24:00.914695+0000","last_unstale":"2024-09-16T01:24:02.112405+0000","last_undegraded":"2024-09-16T01:24:02.112405+0000","last_fullsized":"2024-09-16T01:24:02.112405+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:18:49.204493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.111780+0000","last_change":"2024-09-16T01:24:00.056278+0000","last_active":"2024-09-16T01:24:02.111780+0000","last_peered":"2024-09-16T01:24:02.111780+0000","last_clean":"2024-09-16T01:24:02.111780+0000","last_became_active":"2024-09-16T01:24:00.055994+0000","last_became_peered":"2024-09-16T01:24:00.055994+0000","last_unstale":"2024-09-16T01:24:02.111780+0000","last_undegraded":"2024-09-16T01:24:02.111780+0000","last_fullsized":"2024-09-16T01:24:02.111780+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:27.641702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112302+0000","last_change":"2024-09-16T01:24:00.918223+0000","last_active":"2024-09-16T01:24:02.112302+0000","last_peered":"2024-09-16T01:24:02.112302+0000","last_clean":"2024-09-16T01:24:02.112302+0000","last_became_active":"2024-09-16T01:24:00.917816+0000","last_became_peered":"2024-09-16T01:24:00.917816+0000","last_unstale":"2024-09-16T01:24:02.112302+0000","last_undegraded":"2024-09-16T01:24:02.112302+0000","last_fullsized":"2024-09-16T01:24:02.112302+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:24:00.041709+0000","last_clean_scrub_stamp":"2024-09-16T01:24:00.041709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:52:32.929236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:01.896030+0000","last_change":"2024-09-16T01:24:00.068157+0000","last_active":"2024-09-16T01:24:01.896030+0000","last_peered":"2024-09-16T01:24:01.896030+0000","last_clean":"2024-09-16T01:24:01.896030+0000","last_became_active":"2024-09-16T01:24:00.067923+0000","last_became_peered":"2024-09-16T01:24:00.067923+0000","last_unstale":"2024-09-16T01:24:01.896030+0000","last_undegraded":"2024-09-16T01:24:01.896030+0000","last_fullsized":"2024-09-16T01:24:01.896030+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:23:59.036748+0000","last_clean_scrub_stamp":"2024-09-16T01:23:59.036748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T12:56:27.641702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":405,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-16T01:24:02.112388+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:24:02.112388+0000","last_peered":"2024-09-16T01:24:02.112388+0000","last_clean":"2024-09-16T01:24:02.112388+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:24:02.112388+0000","last_undegraded":"2024-09-16T01:24:02.112388+0000","last_fullsized":"2024-09-16T01:24:02.112388+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574954,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33604,"kb_used_data":2412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338236,"statfs":{"total":96636764160,"available":96602353664,"internally_reserved":0,"allocated":2469888,"data_stored":1458579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37188,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334652,"statfs":{"total":96636764160,"available":96598683648,"internally_reserved":0,"allocated":1875968,"data_stored":868211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574954,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1884160,"data_stored":868335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574954,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37204,"kb_used_data":1848,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334636,"statfs":{"total":96636764160,"available":96598667264,"internally_reserved":0,"allocated":1892352,"data_stored":868975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574954,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33040,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338800,"statfs":{"total":96636764160,"available":96602931200,"internally_reserved":0,"allocated":1896448,"data_stored":870427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574955,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1875968,"data_stored":868211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33040,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338800,"statfs":{"total":96636764160,"available":96602931200,"internally_reserved":0,"allocated":1888256,"data_stored":869823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574954,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33616,"kb_used_data":2420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338224,"statfs":{"total":96636764160,"available":96602341376,"internally_reserved":0,"allocated":2478080,"data_stored":1458683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:24:04.333 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:24:04.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-16T01:24:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.472+0000 7f19b40ae640 1 Processor -- start 2024-09-16T01:24:04.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.472+0000 7f19b40ae640 1 -- start start 2024-09-16T01:24:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.473+0000 7f19b40ae640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19ac15e7f0 0x7f19ac0b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.473+0000 7f19b40ae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19ac071180 0x7f19ac06de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.473+0000 7f19b40ae640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19ac06cdc0 con 0x7f19ac0af210 2024-09-16T01:24:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.473+0000 7f19b40ae640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f19ac06d0a0 con 0x7f19ac071180 2024-09-16T01:24:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.473+0000 7f19b40ae640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f19ac06d380 con 0x7f19ac15e7f0 2024-09-16T01:24:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.473+0000 7f19b264b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19ac071180 0x7f19ac06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.473+0000 7f19b1649640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f19ac0af210 0x7f19ac070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54148/0 (socket says 172.21.15.81:54148) 2024-09-16T01:24:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.473+0000 7f19b1649640 1 -- 172.21.15.81:0/3505365020 learned_addr learned my addr 172.21.15.81:0/3505365020 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.473+0000 7f19b1e4a640 1 --2- 172.21.15.81:0/3505365020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19ac15e7f0 0x7f19ac0b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.474+0000 7f19b264b640 1 -- 172.21.15.81:0/3505365020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19ac15e7f0 msgr2=0x7f19ac0b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.474+0000 7f19b264b640 1 --2- 172.21.15.81:0/3505365020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19ac15e7f0 0x7f19ac0b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.474+0000 7f19b264b640 1 -- 172.21.15.81:0/3505365020 >> v1:172.21.15.81:6789/0 conn(0x7f19ac0af210 legacy=0x7f19ac070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.474+0000 7f19b0e48640 1 -- 172.21.15.81:0/3505365020 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029645870 0 0) 0x7f19ac06cdc0 con 0x7f19ac0af210 2024-09-16T01:24:04.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.474+0000 7f19b264b640 1 -- 172.21.15.81:0/3505365020 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac06d660 con 0x7f19ac071180 2024-09-16T01:24:04.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.474+0000 7f19b1e4a640 1 --2- 172.21.15.81:0/3505365020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19ac15e7f0 0x7f19ac0b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:04.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.474+0000 7f19b264b640 1 --2- 172.21.15.81:0/3505365020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19ac071180 0x7f19ac06de60 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009d90 tx=0x7f19a402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a7ac7dbbbd93 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:04.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.474+0000 7f19b0e48640 1 -- 172.21.15.81:0/3505365020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4007740 con 0x7f19ac071180 2024-09-16T01:24:04.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.474+0000 7f19b0e48640 1 -- 172.21.15.81:0/3505365020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a40078e0 con 0x7f19ac071180 2024-09-16T01:24:04.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.474+0000 7f19b0e48640 1 -- 172.21.15.81:0/3505365020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a4007cb0 con 0x7f19ac071180 2024-09-16T01:24:04.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.475+0000 7f19b40ae640 1 -- 172.21.15.81:0/3505365020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19ac071180 msgr2=0x7f19ac06de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.475+0000 7f19b40ae640 1 --2- 172.21.15.81:0/3505365020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19ac071180 0x7f19ac06de60 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f19a4009d90 tx=0x7f19a402a680 comp rx=0 tx=0).stop 2024-09-16T01:24:04.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.475+0000 7f19b40ae640 1 -- 172.21.15.81:0/3505365020 shutdown_connections 2024-09-16T01:24:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.475+0000 7f19b40ae640 1 --2- 172.21.15.81:0/3505365020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19ac071180 0x7f19ac06de60 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.475+0000 7f19b40ae640 1 --2- 172.21.15.81:0/3505365020 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19ac15e7f0 0x7f19ac0b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.475+0000 7f19b40ae640 1 -- 172.21.15.81:0/3505365020 >> 172.21.15.81:0/3505365020 conn(0x7f19ac0b3f30 msgr2=0x7f19ac0b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.475+0000 7f19b40ae640 1 -- 172.21.15.81:0/3505365020 shutdown_connections 2024-09-16T01:24:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.475+0000 7f19b40ae640 1 -- 172.21.15.81:0/3505365020 wait complete. 2024-09-16T01:24:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.476+0000 7f19b40ae640 1 Processor -- start 2024-09-16T01:24:04.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.476+0000 7f19b40ae640 1 -- start start 2024-09-16T01:24:04.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b40ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19ac071180 0x7f19ac160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b40ae640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19ac0af210 0x7f19ac160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b40ae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19ac15e7f0 0x7f19ac158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b40ae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac0b7250 con 0x7f19ac071180 2024-09-16T01:24:04.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b40ae640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f19ac0b6150 con 0x7f19ac15e7f0 2024-09-16T01:24:04.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b40ae640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f19ac0b73d0 con 0x7f19ac0af210 2024-09-16T01:24:04.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b1e4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19ac071180 0x7f19ac160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b1e4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19ac071180 0x7f19ac160220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51272/0 (socket says 172.21.15.81:51272) 2024-09-16T01:24:04.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b1e4a640 1 -- 172.21.15.81:0/174983690 learned_addr learned my addr 172.21.15.81:0/174983690 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:04.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b1e4a640 1 -- 172.21.15.81:0/174983690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19ac0af210 msgr2=0x7f19ac160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b1e4a640 1 --2- 172.21.15.81:0/174983690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19ac0af210 0x7f19ac160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b1e4a640 1 -- 172.21.15.81:0/174983690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19ac15e7f0 msgr2=0x7f19ac158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b1e4a640 1 --2- 172.21.15.81:0/174983690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19ac15e7f0 0x7f19ac158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b1e4a640 1 -- 172.21.15.81:0/174983690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac15abd0 con 0x7f19ac071180 2024-09-16T01:24:04.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.477+0000 7f19b1e4a640 1 --2- 172.21.15.81:0/174983690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19ac071180 0x7f19ac160220 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f19a800d800 tx=0x7f19a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:04.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.478+0000 7f19a27fc640 1 -- 172.21.15.81:0/174983690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a8004030 con 0x7f19ac071180 2024-09-16T01:24:04.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.478+0000 7f19a27fc640 1 -- 172.21.15.81:0/174983690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a80041d0 con 0x7f19ac071180 2024-09-16T01:24:04.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.478+0000 7f19b40ae640 1 -- 172.21.15.81:0/174983690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ac15aeb0 con 0x7f19ac071180 2024-09-16T01:24:04.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.478+0000 7f19a27fc640 1 -- 172.21.15.81:0/174983690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a80096a0 con 0x7f19ac071180 2024-09-16T01:24:04.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.478+0000 7f19b40ae640 1 -- 172.21.15.81:0/174983690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19ac15b470 con 0x7f19ac071180 2024-09-16T01:24:04.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.478+0000 7f19b40ae640 1 -- 172.21.15.81:0/174983690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19ac0b6d10 con 0x7f19ac071180 2024-09-16T01:24:04.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.479+0000 7f19a27fc640 1 -- 172.21.15.81:0/174983690 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f19a8009840 con 0x7f19ac071180 2024-09-16T01:24:04.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.479+0000 7f19a27fc640 1 --2- 172.21.15.81:0/174983690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f199006c2b0 0x7f199006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.480+0000 7f19b1649640 1 --2- 172.21.15.81:0/174983690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f199006c2b0 0x7f199006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.480+0000 7f19a27fc640 1 -- 172.21.15.81:0/174983690 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7f19a808b8c0 con 0x7f19ac071180 2024-09-16T01:24:04.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.480+0000 7f19b1649640 1 --2- 172.21.15.81:0/174983690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f199006c2b0 0x7f199006e770 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f199c007fd0 tx=0x7f199c007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:04.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.484+0000 7f19a27fc640 1 -- 172.21.15.81:0/174983690 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19a8059ea0 con 0x7f19ac071180 2024-09-16T01:24:04.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.714+0000 7f19b40ae640 1 -- 172.21.15.81:0/174983690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f19ac156760 con 0x7f19ac071180 2024-09-16T01:24:04.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.716+0000 7f19a27fc640 1 -- 172.21.15.81:0/174983690 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f19a80597a0 con 0x7f19ac071180 2024-09-16T01:24:04.718 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-16T01:24:04.718 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCAhudmmLRjIBAAinUdoaTi5kq4XIAXN1Q6dg== 2024-09-16T01:24:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-16T01:24:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-16T01:24:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-16T01:24:04.719 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-16T01:24:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.719+0000 7f19b40ae640 1 -- 172.21.15.81:0/174983690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f199006c2b0 msgr2=0x7f199006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.719+0000 7f19b40ae640 1 --2- 172.21.15.81:0/174983690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f199006c2b0 0x7f199006e770 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f199c007fd0 tx=0x7f199c007960 comp rx=0 tx=0).stop 2024-09-16T01:24:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.719+0000 7f19b40ae640 1 -- 172.21.15.81:0/174983690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19ac071180 msgr2=0x7f19ac160220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.719+0000 7f19b40ae640 1 --2- 172.21.15.81:0/174983690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19ac071180 0x7f19ac160220 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f19a800d800 tx=0x7f19a800dcc0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.719+0000 7f19b40ae640 1 -- 172.21.15.81:0/174983690 shutdown_connections 2024-09-16T01:24:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.719+0000 7f19b40ae640 1 --2- 172.21.15.81:0/174983690 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f199006c2b0 0x7f199006e770 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.719+0000 7f19b40ae640 1 --2- 172.21.15.81:0/174983690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19ac15e7f0 0x7f19ac158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.719+0000 7f19b40ae640 1 --2- 172.21.15.81:0/174983690 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f19ac0af210 0x7f19ac160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.719+0000 7f19b40ae640 1 --2- 172.21.15.81:0/174983690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19ac071180 0x7f19ac160220 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.719+0000 7f19b40ae640 1 -- 172.21.15.81:0/174983690 >> 172.21.15.81:0/174983690 conn(0x7f19ac0b3f30 msgr2=0x7f19ac0b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.719+0000 7f19b40ae640 1 -- 172.21.15.81:0/174983690 shutdown_connections 2024-09-16T01:24:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.719+0000 7f19b40ae640 1 -- 172.21.15.81:0/174983690 wait complete. 2024-09-16T01:24:04.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:24:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.828+0000 7f9e9449b640 1 Processor -- start 2024-09-16T01:24:04.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.828+0000 7f9e9449b640 1 -- start start 2024-09-16T01:24:04.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e9449b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e8c15e740 0x7f9e8c0d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e9449b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9e8c09b690 0x7f9e8c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e9449b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e8c0d0780 con 0x7f9e8c06d4c0 2024-09-16T01:24:04.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e9449b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9e8c15eb20 con 0x7f9e8c15e740 2024-09-16T01:24:04.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e9449b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9e8c06d260 con 0x7f9e8c09b690 2024-09-16T01:24:04.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e92237640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e8c15e740 0x7f9e8c0d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e92a38640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9e8c06d4c0 0x7f9e8c06d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54156/0 (socket says 172.21.15.81:54156) 2024-09-16T01:24:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e92a38640 1 -- 172.21.15.81:0/2666129735 learned_addr learned my addr 172.21.15.81:0/2666129735 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e91a36640 1 --2- 172.21.15.81:0/2666129735 >> v2:172.21.15.102:3300/0 conn(0x7f9e8c09b690 0x7f9e8c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e92237640 1 -- 172.21.15.81:0/2666129735 >> v2:172.21.15.102:3300/0 conn(0x7f9e8c09b690 msgr2=0x7f9e8c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e92237640 1 --2- 172.21.15.81:0/2666129735 >> v2:172.21.15.102:3300/0 conn(0x7f9e8c09b690 0x7f9e8c06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e92237640 1 -- 172.21.15.81:0/2666129735 >> v1:172.21.15.81:6789/0 conn(0x7f9e8c06d4c0 legacy=0x7f9e8c06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e92237640 1 -- 172.21.15.81:0/2666129735 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c0d0a60 con 0x7f9e8c15e740 2024-09-16T01:24:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.829+0000 7f9e91a36640 1 --2- 172.21.15.81:0/2666129735 >> v2:172.21.15.102:3300/0 conn(0x7f9e8c09b690 0x7f9e8c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.830+0000 7f9e92237640 1 --2- 172.21.15.81:0/2666129735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e8c15e740 0x7f9e8c0d1540 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0691b0 tx=0x7f9e8802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bc0ff3ba86cf74 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.830+0000 7f9e91235640 1 -- 172.21.15.81:0/2666129735 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88037070 con 0x7f9e8c15e740 2024-09-16T01:24:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.830+0000 7f9e91235640 1 -- 172.21.15.81:0/2666129735 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e88032440 con 0x7f9e8c15e740 2024-09-16T01:24:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.830+0000 7f9e91235640 1 -- 172.21.15.81:0/2666129735 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88032810 con 0x7f9e8c15e740 2024-09-16T01:24:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.830+0000 7f9e9449b640 1 -- 172.21.15.81:0/2666129735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e8c15e740 msgr2=0x7f9e8c0d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.830+0000 7f9e9449b640 1 --2- 172.21.15.81:0/2666129735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e8c15e740 0x7f9e8c0d1540 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0691b0 tx=0x7f9e8802a230 comp rx=0 tx=0).stop 2024-09-16T01:24:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.830+0000 7f9e9449b640 1 -- 172.21.15.81:0/2666129735 shutdown_connections 2024-09-16T01:24:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.830+0000 7f9e9449b640 1 --2- 172.21.15.81:0/2666129735 >> v2:172.21.15.102:3300/0 conn(0x7f9e8c09b690 0x7f9e8c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.830+0000 7f9e9449b640 1 --2- 172.21.15.81:0/2666129735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e8c15e740 0x7f9e8c0d1540 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.831+0000 7f9e9449b640 1 -- 172.21.15.81:0/2666129735 >> 172.21.15.81:0/2666129735 conn(0x7f9e8c0d23a0 msgr2=0x7f9e8c0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.831+0000 7f9e9449b640 1 -- 172.21.15.81:0/2666129735 shutdown_connections 2024-09-16T01:24:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.831+0000 7f9e9449b640 1 -- 172.21.15.81:0/2666129735 wait complete. 2024-09-16T01:24:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.832+0000 7f9e9449b640 1 Processor -- start 2024-09-16T01:24:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.832+0000 7f9e9449b640 1 -- start start 2024-09-16T01:24:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.832+0000 7f9e9449b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e8c06d4c0 0x7f9e8c09c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.832+0000 7f9e9449b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e8c09b690 0x7f9e8c1537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.832+0000 7f9e9449b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8c15e740 0x7f9e8c0b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.832+0000 7f9e9449b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c09bac0 con 0x7f9e8c09b690 2024-09-16T01:24:04.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.832+0000 7f9e9449b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8c0d1020 con 0x7f9e8c15e740 2024-09-16T01:24:04.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.832+0000 7f9e9449b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8c06dfe0 con 0x7f9e8c06d4c0 2024-09-16T01:24:04.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.832+0000 7f9e91a36640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e8c09b690 0x7f9e8c1537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e91a36640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e8c09b690 0x7f9e8c1537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51302/0 (socket says 172.21.15.81:51302) 2024-09-16T01:24:04.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e91a36640 1 -- 172.21.15.81:0/4069055504 learned_addr learned my addr 172.21.15.81:0/4069055504 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:04.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e91a36640 1 -- 172.21.15.81:0/4069055504 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e8c06d4c0 msgr2=0x7f9e8c09c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e91a36640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e8c06d4c0 0x7f9e8c09c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e91a36640 1 -- 172.21.15.81:0/4069055504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8c15e740 msgr2=0x7f9e8c0b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:04.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e92a38640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8c15e740 0x7f9e8c0b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e91a36640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8c15e740 0x7f9e8c0b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:04.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e91a36640 1 -- 172.21.15.81:0/4069055504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8c09f400 con 0x7f9e8c09b690 2024-09-16T01:24:04.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e91a36640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e8c09b690 0x7f9e8c1537e0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00c7f0 tx=0x7f9e7c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:04.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e82ffd640 1 -- 172.21.15.81:0/4069055504 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c015070 con 0x7f9e8c09b690 2024-09-16T01:24:04.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e82ffd640 1 -- 172.21.15.81:0/4069055504 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7c007820 con 0x7f9e8c09b690 2024-09-16T01:24:04.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e82ffd640 1 -- 172.21.15.81:0/4069055504 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c007bd0 con 0x7f9e8c09b690 2024-09-16T01:24:04.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e9449b640 1 -- 172.21.15.81:0/4069055504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8c09f6e0 con 0x7f9e8c09b690 2024-09-16T01:24:04.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.833+0000 7f9e9449b640 1 -- 172.21.15.81:0/4069055504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8c09fca0 con 0x7f9e8c09b690 2024-09-16T01:24:04.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.834+0000 7f9e9449b640 1 -- 172.21.15.81:0/4069055504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8c06cd20 con 0x7f9e8c09b690 2024-09-16T01:24:04.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.835+0000 7f9e82ffd640 1 -- 172.21.15.81:0/4069055504 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9e7c018070 con 0x7f9e8c09b690 2024-09-16T01:24:04.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.835+0000 7f9e82ffd640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e7006c2b0 0x7f9e7006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:04.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.835+0000 7f9e92237640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e7006c2b0 0x7f9e7006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:04.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.835+0000 7f9e82ffd640 1 -- 172.21.15.81:0/4069055504 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7f9e7c08b700 con 0x7f9e8c09b690 2024-09-16T01:24:04.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.836+0000 7f9e92237640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e7006c2b0 0x7f9e7006e770 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9e88034000 tx=0x7f9e8802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:04.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:04.839+0000 7f9e82ffd640 1 -- 172.21.15.81:0/4069055504 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e7c059ce0 con 0x7f9e8c09b690 2024-09-16T01:24:05.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.038+0000 7f9e9449b640 1 -- 172.21.15.81:0/4069055504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e8c0d1cb0 con 0x7f9e8c09b690 2024-09-16T01:24:05.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.038+0000 7f9e82ffd640 1 -- 172.21.15.81:0/4069055504 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5233 (secure 0 0 0) 0x7f9e7c0595e0 con 0x7f9e8c09b690 2024-09-16T01:24:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:05.040 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"btime":"2024-09-16T01:24:03:062667+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1526547768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1526547768},{"type":"v1","addr":"172.21.15.102:6834","nonce":1526547768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1390834502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1390834502},{"type":"v1","addr":"172.21.15.102:6835","nonce":1390834502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1449155906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1449155906},{"type":"v1","addr":"172.21.15.81:6836","nonce":1449155906}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:24:00.383912+0000","modified":"2024-09-16T01:24:02.389045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8547":{"gid":8547,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3797465908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3797465908},{"type":"v1","addr":"172.21.15.81:6837","nonce":3797465908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8547,"qdb_cluster":[8547]},"id":11}]} 2024-09-16T01:24:05.040 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2024-09-16T01:24:05.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.040+0000 7f9e9449b640 1 -- 172.21.15.81:0/4069055504 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e7006c2b0 msgr2=0x7f9e7006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.040+0000 7f9e9449b640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e7006c2b0 0x7f9e7006e770 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9e88034000 tx=0x7f9e8802c000 comp rx=0 tx=0).stop 2024-09-16T01:24:05.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.040+0000 7f9e9449b640 1 -- 172.21.15.81:0/4069055504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e8c09b690 msgr2=0x7f9e8c1537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.040+0000 7f9e9449b640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e8c09b690 0x7f9e8c1537e0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c00c7f0 tx=0x7f9e7c00ccb0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.040+0000 7f9e9449b640 1 -- 172.21.15.81:0/4069055504 shutdown_connections 2024-09-16T01:24:05.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.040+0000 7f9e9449b640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9e7006c2b0 0x7f9e7006e770 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.040+0000 7f9e9449b640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8c15e740 0x7f9e8c0b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.040+0000 7f9e9449b640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e8c09b690 0x7f9e8c1537e0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.040+0000 7f9e9449b640 1 --2- 172.21.15.81:0/4069055504 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e8c06d4c0 0x7f9e8c09c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.040+0000 7f9e9449b640 1 -- 172.21.15.81:0/4069055504 >> 172.21.15.81:0/4069055504 conn(0x7f9e8c0d23a0 msgr2=0x7f9e8c0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.040+0000 7f9e9449b640 1 -- 172.21.15.81:0/4069055504 shutdown_connections 2024-09-16T01:24:05.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.040+0000 7f9e9449b640 1 -- 172.21.15.81:0/4069055504 wait complete. 2024-09-16T01:24:05.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-16T01:24:00.383912+0000', 'modified': '2024-09-16T01:24:02.389045+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8547}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8547': {'gid': 8547, 'name': 'a', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/3797465908', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 3797465908}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3797465908}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8547, 'qdb_cluster': [8547]} 2024-09-16T01:24:05.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-16T01:24:05.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-16T01:24:05.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.558+0000 7ff1c611a640 1 Processor -- start 2024-09-16T01:24:05.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.558+0000 7ff1c611a640 1 -- start start 2024-09-16T01:24:05.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.558+0000 7ff1c611a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff1c009b3c0 0x7ff1c015ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.558+0000 7ff1c611a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c00b54f0 con 0x7ff1c00b3670 2024-09-16T01:24:05.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.558+0000 7ff1c611a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c00b57d0 con 0x7ff1c015b6b0 2024-09-16T01:24:05.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.558+0000 7ff1c611a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff1c00b5ab0 con 0x7ff1c009b3c0 2024-09-16T01:24:05.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1bffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff1c00b3670 0x7ff1c015bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54168/0 (socket says 172.21.15.81:54168) 2024-09-16T01:24:05.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1bffff640 1 -- 172.21.15.81:0/1304853637 learned_addr learned my addr 172.21.15.81:0/1304853637 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:05.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1beffd640 1 --2- 172.21.15.81:0/1304853637 >> v2:172.21.15.102:3300/0 conn(0x7ff1c009b3c0 0x7ff1c015ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1090809056 0 0) 0x7ff1c00b54f0 con 0x7ff1c00b3670 2024-09-16T01:24:05.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1a8003520 con 0x7ff1c00b3670 2024-09-16T01:24:05.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2604113948 0 0) 0x7ff1a8003520 con 0x7ff1c00b3670 2024-09-16T01:24:05.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 >> v2:172.21.15.102:3300/0 conn(0x7ff1c009b3c0 msgr2=0x7ff1c015ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 --2- 172.21.15.81:0/1304853637 >> v2:172.21.15.102:3300/0 conn(0x7ff1c009b3c0 0x7ff1c015ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 >> v1:172.21.15.102:6789/0 conn(0x7ff1c015b6b0 legacy=0x7ff1c00b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c015d760 con 0x7ff1c00b3670 2024-09-16T01:24:05.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7ff1b80019f0 con 0x7ff1c00b3670 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 >> v1:172.21.15.81:6789/0 conn(0x7ff1c00b3670 legacy=0x7ff1c015bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 --2- 172.21.15.81:0/1304853637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1a80039b0 0x7ff1a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 --2- 172.21.15.81:0/1304853637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1a8004800 0x7ff1a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 --2- 172.21.15.81:0/1304853637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1a80051c0 0x7ff1a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c00b5ab0 con 0x7ff1a80051c0 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a800c060 con 0x7ff1a80039b0 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a800c260 con 0x7ff1a8004800 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1bffff640 1 --2- 172.21.15.81:0/1304853637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1a80051c0 0x7ff1a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1bf7fe640 1 --2- 172.21.15.81:0/1304853637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1a80039b0 0x7ff1a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.559+0000 7ff1beffd640 1 --2- 172.21.15.81:0/1304853637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1a8004800 0x7ff1a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.560+0000 7ff1bffff640 1 -- 172.21.15.81:0/1304853637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1a8004800 msgr2=0x7ff1a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.560+0000 7ff1bffff640 1 --2- 172.21.15.81:0/1304853637 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1a8004800 0x7ff1a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.560+0000 7ff1bffff640 1 -- 172.21.15.81:0/1304853637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1a80039b0 msgr2=0x7ff1a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.560+0000 7ff1bffff640 1 --2- 172.21.15.81:0/1304853637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1a80039b0 0x7ff1a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.560+0000 7ff1bffff640 1 -- 172.21.15.81:0/1304853637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a8003520 con 0x7ff1a80051c0 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.560+0000 7ff1bffff640 1 -- 172.21.15.81:0/1304853637 reap_dead start 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.560+0000 7ff1bffff640 1 --2- 172.21.15.81:0/1304853637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1a80051c0 0x7ff1a800b9c0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800a850 tx=0x7ff1a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3bc382ca54006f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.560+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b800a4a0 con 0x7ff1a80051c0 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.560+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b802f070 con 0x7ff1a80051c0 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.560+0000 7ff1be7fc640 1 -- 172.21.15.81:0/1304853637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b802bce0 con 0x7ff1a80051c0 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.561+0000 7ff1c611a640 1 -- 172.21.15.81:0/1304853637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1a80051c0 msgr2=0x7ff1a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.561+0000 7ff1c611a640 1 --2- 172.21.15.81:0/1304853637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1a80051c0 0x7ff1a800b9c0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800a850 tx=0x7ff1a8005830 comp rx=0 tx=0).stop 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.561+0000 7ff1c611a640 1 -- 172.21.15.81:0/1304853637 shutdown_connections 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.561+0000 7ff1c611a640 1 --2- 172.21.15.81:0/1304853637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1a80051c0 0x7ff1a800b9c0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.561+0000 7ff1c611a640 1 -- 172.21.15.81:0/1304853637 >> 172.21.15.81:0/1304853637 conn(0x7ff1c0073490 msgr2=0x7ff1c00b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.561+0000 7ff1c611a640 1 -- 172.21.15.81:0/1304853637 shutdown_connections 2024-09-16T01:24:05.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.561+0000 7ff1c611a640 1 -- 172.21.15.81:0/1304853637 wait complete. 2024-09-16T01:24:05.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.562+0000 7ff1c611a640 1 Processor -- start 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.562+0000 7ff1c611a640 1 -- start start 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.563+0000 7ff1c611a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1a80051c0 0x7ff1c0150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.563+0000 7ff1c611a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1c00ae7c0 0x7ff1c014cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.563+0000 7ff1c611a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c01f76c0 0x7ff1c01f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.563+0000 7ff1c611a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c00b2d40 con 0x7ff1c01f76c0 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.563+0000 7ff1c611a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c00b2bc0 con 0x7ff1a80051c0 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.563+0000 7ff1c611a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c009aa30 con 0x7ff1c00ae7c0 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.563+0000 7ff1bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c01f76c0 0x7ff1c01f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.563+0000 7ff1bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c01f76c0 0x7ff1c01f7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51330/0 (socket says 172.21.15.81:51330) 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.563+0000 7ff1bffff640 1 -- 172.21.15.81:0/481619210 learned_addr learned my addr 172.21.15.81:0/481619210 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.563+0000 7ff1bf7fe640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1a80051c0 0x7ff1c0150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.563+0000 7ff1beffd640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1c00ae7c0 0x7ff1c014cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.564+0000 7ff1bffff640 1 -- 172.21.15.81:0/481619210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1c00ae7c0 msgr2=0x7ff1c014cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.564+0000 7ff1bffff640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1c00ae7c0 0x7ff1c014cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.564+0000 7ff1bffff640 1 -- 172.21.15.81:0/481619210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1a80051c0 msgr2=0x7ff1c0150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.564+0000 7ff1bffff640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1a80051c0 0x7ff1c0150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.564+0000 7ff1bffff640 1 -- 172.21.15.81:0/481619210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c01513a0 con 0x7ff1c01f76c0 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.564+0000 7ff1bffff640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c01f76c0 0x7ff1c01f7b40 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8000f80 tx=0x7ff1b802d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.564+0000 7ff1a7fff640 1 -- 172.21.15.81:0/481619210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8045070 con 0x7ff1c01f76c0 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.564+0000 7ff1a7fff640 1 -- 172.21.15.81:0/481619210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b80406a0 con 0x7ff1c01f76c0 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.564+0000 7ff1c611a640 1 -- 172.21.15.81:0/481619210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c0151680 con 0x7ff1c01f76c0 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.564+0000 7ff1a7fff640 1 -- 172.21.15.81:0/481619210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8040a90 con 0x7ff1c01f76c0 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.564+0000 7ff1c611a640 1 -- 172.21.15.81:0/481619210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c0151c40 con 0x7ff1c01f76c0 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.565+0000 7ff1a7fff640 1 -- 172.21.15.81:0/481619210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff1b8048070 con 0x7ff1c01f76c0 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.566+0000 7ff1a7fff640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1ac06c2e0 0x7ff1ac06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.566+0000 7ff1bf7fe640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1ac06c2e0 0x7ff1ac06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.566+0000 7ff1a7fff640 1 -- 172.21.15.81:0/481619210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7ff1b80ab790 con 0x7ff1c01f76c0 2024-09-16T01:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.566+0000 7ff1bf7fe640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1ac06c2e0 0x7ff1ac06e7a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0000c00 tx=0x7ff1b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.567+0000 7ff1c8eae740 1 Processor -- start 2024-09-16T01:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.567+0000 7ff1c8eae740 1 -- start start 2024-09-16T01:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.567+0000 7ff1c8eae740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3da2c0 0x55b92c41fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.567+0000 7ff1c8eae740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3d7a80 0x55b92c3da6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1c8eae740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3dba50 0x55b92c3d48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1c8eae740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b92c33c520 con 0x55b92c3dba50 2024-09-16T01:24:05.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1c8eae740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b92c2e43e0 con 0x55b92c3d7a80 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1c8eae740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55b92c3384e0 con 0x55b92c3da2c0 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3dba50 0x55b92c3d48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3dba50 0x55b92c3d48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51332/0 (socket says 172.21.15.81:51332) 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1bffff640 1 -- 172.21.15.81:0/2697832308 learned_addr learned my addr 172.21.15.81:0/2697832308 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1bf7fe640 1 --2- 172.21.15.81:0/2697832308 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3da2c0 0x55b92c41fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1beffd640 1 --2- 172.21.15.81:0/2697832308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3d7a80 0x55b92c3da6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1bffff640 1 -- 172.21.15.81:0/2697832308 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3da2c0 msgr2=0x55b92c41fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1bffff640 1 --2- 172.21.15.81:0/2697832308 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3da2c0 0x55b92c41fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1bffff640 1 -- 172.21.15.81:0/2697832308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3d7a80 msgr2=0x55b92c3da6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1bffff640 1 --2- 172.21.15.81:0/2697832308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3d7a80 0x55b92c3da6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1bffff640 1 -- 172.21.15.81:0/2697832308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b92c2ff2f0 con 0x55b92c3dba50 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1bffff640 1 --2- 172.21.15.81:0/2697832308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3dba50 0x55b92c3d48b0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8079740 tx=0x7ff1b8079580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f292d6e544da73 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1a57fa640 1 -- 172.21.15.81:0/2697832308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b802be40 con 0x55b92c3dba50 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1a57fa640 1 -- 172.21.15.81:0/2697832308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b802f040 con 0x55b92c3dba50 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.568+0000 7ff1a57fa640 1 -- 172.21.15.81:0/2697832308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b80797b0 con 0x55b92c3dba50 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.569+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2697832308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3dba50 msgr2=0x55b92c3d48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.569+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2697832308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3dba50 0x55b92c3d48b0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8079740 tx=0x7ff1b8079580 comp rx=0 tx=0).stop 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.569+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2697832308 shutdown_connections 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.569+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2697832308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3dba50 0x55b92c3d48b0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.569+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2697832308 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3d7a80 0x55b92c3da6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.569+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2697832308 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3da2c0 0x55b92c41fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.569+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2697832308 >> 172.21.15.81:0/2697832308 conn(0x55b92c3d6a80 msgr2=0x55b92c41ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.569+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2697832308 shutdown_connections 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.569+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2697832308 wait complete. 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.570+0000 7ff1c8eae740 1 -- start start 2024-09-16T01:24:05.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.570+0000 7ff1c8eae740 1 Processor -- start 2024-09-16T01:24:05.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.570+0000 7ff1c8eae740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3da2c0 0x55b92c3d55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.570+0000 7ff1c8eae740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c3f83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.570+0000 7ff1c8eae740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 0x55b92c3d9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.570+0000 7ff1c8eae740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b92c2e43e0 con 0x55b92c3d91d0 2024-09-16T01:24:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.570+0000 7ff1c8eae740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b92c2c5450 con 0x55b92c3da2c0 2024-09-16T01:24:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.570+0000 7ff1c8eae740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55b92c33c520 con 0x55b92c3dba50 2024-09-16T01:24:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.570+0000 7ff1c8eae740 10 client.0 _ll_register_callbacks cb 0x55b92c04eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.570+0000 7ff1bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 0x55b92c3d9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 0x55b92c3d9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51342/0 (socket says 172.21.15.81:51342) 2024-09-16T01:24:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1bf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3da2c0 0x55b92c3d55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1bffff640 1 -- 172.21.15.81:0/2678440935 learned_addr learned my addr 172.21.15.81:0/2678440935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1beffd640 1 --2- 172.21.15.81:0/2678440935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c3f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1bffff640 1 -- 172.21.15.81:0/2678440935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 msgr2=0x55b92c3f83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1bffff640 1 --2- 172.21.15.81:0/2678440935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c3f83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1bffff640 1 -- 172.21.15.81:0/2678440935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3da2c0 msgr2=0x55b92c3d55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1bffff640 1 --2- 172.21.15.81:0/2678440935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3da2c0 0x55b92c3d55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1bffff640 1 -- 172.21.15.81:0/2678440935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b92c04f2d0 con 0x55b92c3d91d0 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1bffff640 1 --2- 172.21.15.81:0/2678440935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 0x55b92c3d9650 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80a9c10 tx=0x7ff1b8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa04adfdaa671804 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff19e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff19e7fc640 1 -- 172.21.15.81:0/2678440935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b807dab0 con 0x55b92c3d91d0 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff19e7fc640 1 -- 172.21.15.81:0/2678440935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7ff1b8075e20 con 0x55b92c3d91d0 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2678440935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1b802f040 con 0x55b92c3d91d0 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff19e7fc640 1 -- 172.21.15.81:0/2678440935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ff1b80822e0 con 0x55b92c3d91d0 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1c8eae740 10 client.8679 fetch_fsmap learned FSMap version 83 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2678440935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55b92c1196b0 con 0x55b92c3d91d0 2024-09-16T01:24:05.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff19e7fc640 1 -- 172.21.15.81:0/2678440935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b802f040 con 0x55b92c3d91d0 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff19e7fc640 1 -- 172.21.15.81:0/2678440935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 83) ==== 3502+0+0 (secure 0 0 0) 0x7ff1b8081e50 con 0x55b92c3d91d0 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1c8eae740 10 client.8679 fetch_fsmap finished waiting for FSMap version 83 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.571+0000 7ff1c8eae740 10 client.8679 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.572+0000 7ff1c8eae740 20 client.8679 populate_metadata read hostname 'smithi081' 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.572+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2678440935 >> [v2:172.21.15.81:6835/3797465908,v1:172.21.15.81:6837/3797465908] conn(0x55b92c3fb2a0 0x55b92c3d37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.572+0000 7ff1c8eae740 4 client.8679 mds_command: new command op to 8547 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.572+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2678440935 --> [v2:172.21.15.81:6835/3797465908,v1:172.21.15.81:6837/3797465908] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b92c349c50 con 0x55b92c3fb2a0 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.572+0000 7ff1bf7fe640 1 --2- 172.21.15.81:0/2678440935 >> [v2:172.21.15.81:6835/3797465908,v1:172.21.15.81:6837/3797465908] conn(0x55b92c3fb2a0 0x55b92c3d37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.572+0000 7ff19e7fc640 10 client.8679 ms_handle_connect on v2:172.21.15.81:6835/3797465908 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.572+0000 7ff1bf7fe640 1 --2- 172.21.15.81:0/2678440935 >> [v2:172.21.15.81:6835/3797465908,v1:172.21.15.81:6837/3797465908] conn(0x55b92c3fb2a0 0x55b92c3d37d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=848f4fffa75f31df server_cookie=80c3c8be6853908b in_seq=0 out_seq=0 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff19e7fc640 1 -- 172.21.15.81:0/2678440935 <== mds.0 v2:172.21.15.81:6835/3797465908 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b92c349c50 con 0x55b92c3fb2a0 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff19e7fc640 10 client.8679 handle_command_reply: tid=0 2024-09-16T01:24:05.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff1c8eae740 1 client.8679 shutdown 2024-09-16T01:24:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2678440935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 msgr2=0x55b92c3d9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2678440935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 0x55b92c3d9650 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80a9c10 tx=0x7ff1b8037000 comp rx=0 tx=0).stop 2024-09-16T01:24:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2678440935 shutdown_connections 2024-09-16T01:24:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2678440935 >> [v2:172.21.15.81:6835/3797465908,v1:172.21.15.81:6837/3797465908] conn(0x55b92c3fb2a0 0x55b92c3d37d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2678440935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 0x55b92c3d9650 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2678440935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c3f83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff19e7fc640 0 client.8679 ms_handle_reset on v2:172.21.15.81:6835/3797465908 2024-09-16T01:24:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2678440935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3da2c0 0x55b92c3d55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2678440935 >> 172.21.15.81:0/2678440935 conn(0x55b92c3d7a80 msgr2=0x55b92c421100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2678440935 shutdown_connections 2024-09-16T01:24:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2678440935 wait complete. 2024-09-16T01:24:05.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.573+0000 7ff1c8eae740 20 client.8679 trim_cache size 0 max 16384 2024-09-16T01:24:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.591+0000 7ff1c8eae740 1 Processor -- start 2024-09-16T01:24:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.591+0000 7ff1c8eae740 1 -- start start 2024-09-16T01:24:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1c8eae740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3d91d0 0x55b92c4035f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1c8eae740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3da2c0 0x55b92c420210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1c8eae740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c42d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1c8eae740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0200800 con 0x55b92c3da2c0 2024-09-16T01:24:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1c8eae740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c01ffb70 con 0x55b92c3d91d0 2024-09-16T01:24:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1c8eae740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff1c0200190 con 0x55b92c3dba50 2024-09-16T01:24:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1beffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3da2c0 0x55b92c420210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1beffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3da2c0 0x55b92c420210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51346/0 (socket says 172.21.15.81:51346) 2024-09-16T01:24:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1beffd640 1 -- 172.21.15.81:0/2967401054 learned_addr learned my addr 172.21.15.81:0/2967401054 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1bf7fe640 1 --2- 172.21.15.81:0/2967401054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3d91d0 0x55b92c4035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1bffff640 1 --2- 172.21.15.81:0/2967401054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c42d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1beffd640 1 -- 172.21.15.81:0/2967401054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 msgr2=0x55b92c42d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1beffd640 1 --2- 172.21.15.81:0/2967401054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c42d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1beffd640 1 -- 172.21.15.81:0/2967401054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3d91d0 msgr2=0x55b92c4035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1beffd640 1 --2- 172.21.15.81:0/2967401054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3d91d0 0x55b92c4035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1beffd640 1 -- 172.21.15.81:0/2967401054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b92c3fa080 con 0x55b92c3da2c0 2024-09-16T01:24:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1bffff640 1 --2- 172.21.15.81:0/2967401054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c42d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1beffd640 1 --2- 172.21.15.81:0/2967401054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3da2c0 0x55b92c420210 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009e90 tx=0x7ff1b4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bece8a38daa492 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1a4ff9640 1 -- 172.21.15.81:0/2967401054 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4023020 con 0x55b92c3da2c0 2024-09-16T01:24:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1a4ff9640 1 -- 172.21.15.81:0/2967401054 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b4015cf0 con 0x55b92c3da2c0 2024-09-16T01:24:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.592+0000 7ff1a4ff9640 1 -- 172.21.15.81:0/2967401054 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b401f600 con 0x55b92c3da2c0 2024-09-16T01:24:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.593+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2967401054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3da2c0 msgr2=0x55b92c420210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.593+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2967401054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3da2c0 0x55b92c420210 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009e90 tx=0x7ff1b4009190 comp rx=0 tx=0).stop 2024-09-16T01:24:05.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.593+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2967401054 shutdown_connections 2024-09-16T01:24:05.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.593+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2967401054 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c42d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.593+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2967401054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3da2c0 0x55b92c420210 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.593+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/2967401054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3d91d0 0x55b92c4035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.593+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2967401054 >> 172.21.15.81:0/2967401054 conn(0x55b92c3d7a80 msgr2=0x55b92c3cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.593+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2967401054 shutdown_connections 2024-09-16T01:24:05.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.593+0000 7ff1c8eae740 1 -- 172.21.15.81:0/2967401054 wait complete. 2024-09-16T01:24:05.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.594+0000 7ff1c8eae740 1 -- start start 2024-09-16T01:24:05.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.594+0000 7ff1c8eae740 1 Processor -- start 2024-09-16T01:24:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.594+0000 7ff1c8eae740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 0x55b92c3d37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.594+0000 7ff1c8eae740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3da2c0 0x55b92c41de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.594+0000 7ff1c8eae740 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c49be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.594+0000 7ff1c8eae740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55b92c2e43e0 con 0x55b92c3d91d0 2024-09-16T01:24:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.594+0000 7ff1c8eae740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b92c2c5450 con 0x55b92c3da2c0 2024-09-16T01:24:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.594+0000 7ff1c8eae740 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55b92c3f8940 con 0x55b92c3dba50 2024-09-16T01:24:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1c8eae740 10 client.0 _ll_register_callbacks cb 0x7ff1b8090070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-16T01:24:05.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 0x55b92c3d37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 0x55b92c3d37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51360/0 (socket says 172.21.15.81:51360) 2024-09-16T01:24:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1bf7fe640 1 -- 172.21.15.81:0/478320260 learned_addr learned my addr 172.21.15.81:0/478320260 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1beffd640 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3da2c0 0x55b92c41de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1bffff640 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c49be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1bf7fe640 1 -- 172.21.15.81:0/478320260 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 msgr2=0x55b92c49be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1bf7fe640 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c49be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1bf7fe640 1 -- 172.21.15.81:0/478320260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3da2c0 msgr2=0x55b92c41de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1bf7fe640 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3da2c0 0x55b92c41de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1bf7fe640 1 -- 172.21.15.81:0/478320260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b92c41e390 con 0x55b92c3d91d0 2024-09-16T01:24:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1bffff640 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c49be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:05.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1bf7fe640 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 0x55b92c3d37d0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0001650 tx=0x7ff1b0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3e093626a8b0ad server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff19e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-16T01:24:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff19e7fc640 1 -- 172.21.15.81:0/478320260 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0007530 con 0x55b92c3d91d0 2024-09-16T01:24:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff19e7fc640 1 -- 172.21.15.81:0/478320260 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7ff1b00067d0 con 0x55b92c3d91d0 2024-09-16T01:24:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1c8eae740 1 -- 172.21.15.81:0/478320260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1b4015cf0 con 0x55b92c3d91d0 2024-09-16T01:24:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff19e7fc640 1 -- 172.21.15.81:0/478320260 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ff1b0039050 con 0x55b92c3d91d0 2024-09-16T01:24:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1c8eae740 10 client.8685 fetch_fsmap learned FSMap version 83 2024-09-16T01:24:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff1c8eae740 1 -- 172.21.15.81:0/478320260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55b92c49c3c0 con 0x55b92c3d91d0 2024-09-16T01:24:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.595+0000 7ff19e7fc640 1 -- 172.21.15.81:0/478320260 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b4015cf0 con 0x55b92c3d91d0 2024-09-16T01:24:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff19e7fc640 1 -- 172.21.15.81:0/478320260 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 83) ==== 3502+0+0 (secure 0 0 0) 0x7ff1b003c020 con 0x55b92c3d91d0 2024-09-16T01:24:05.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 10 client.8685 fetch_fsmap finished waiting for FSMap version 83 2024-09-16T01:24:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 10 client.8685 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-16T01:24:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 20 client.8685 populate_metadata read hostname 'smithi081' 2024-09-16T01:24:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.81:6835/3797465908,v1:172.21.15.81:6837/3797465908] conn(0x55b92c41d6f0 0x55b92c422160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 4 client.8685 mds_command: new command op to 8547 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-16T01:24:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 -- 172.21.15.81:0/478320260 --> [v2:172.21.15.81:6835/3797465908,v1:172.21.15.81:6837/3797465908] -- command(tid 0: {"prefix": "status"}) -- 0x55b92c343fa0 con 0x55b92c41d6f0 2024-09-16T01:24:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1beffd640 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.81:6835/3797465908,v1:172.21.15.81:6837/3797465908] conn(0x55b92c41d6f0 0x55b92c422160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff19e7fc640 10 client.8685 ms_handle_connect on v2:172.21.15.81:6835/3797465908 2024-09-16T01:24:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1beffd640 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.81:6835/3797465908,v1:172.21.15.81:6837/3797465908] conn(0x55b92c41d6f0 0x55b92c422160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d71fa8d4e28f39b9 server_cookie=64754a5e8ef78a1b in_seq=0 out_seq=0 2024-09-16T01:24:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff19e7fc640 1 -- 172.21.15.81:0/478320260 <== mds.0 v2:172.21.15.81:6835/3797465908 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55b92c343fa0 con 0x55b92c41d6f0 2024-09-16T01:24:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff19e7fc640 10 client.8685 handle_command_reply: tid=0 2024-09-16T01:24:05.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 client.8685 shutdown 2024-09-16T01:24:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 -- 172.21.15.81:0/478320260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 msgr2=0x55b92c3d37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 0x55b92c3d37d0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0001650 tx=0x7ff1b0001120 comp rx=0 tx=0).stop 2024-09-16T01:24:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 -- 172.21.15.81:0/478320260 shutdown_connections 2024-09-16T01:24:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55b92c3dba50 0x55b92c49be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b92c3da2c0 0x55b92c41de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.81:6835/3797465908,v1:172.21.15.81:6837/3797465908] conn(0x55b92c41d6f0 0x55b92c422160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 --2- 172.21.15.81:0/478320260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b92c3d91d0 0x55b92c3d37d0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff19e7fc640 0 client.8685 ms_handle_reset on v2:172.21.15.81:6835/3797465908 2024-09-16T01:24:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 -- 172.21.15.81:0/478320260 >> 172.21.15.81:0/478320260 conn(0x55b92c3d7a80 msgr2=0x55b92c404410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 -- 172.21.15.81:0/478320260 shutdown_connections 2024-09-16T01:24:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 1 -- 172.21.15.81:0/478320260 wait complete. 2024-09-16T01:24:05.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.596+0000 7ff1c8eae740 20 client.8685 trim_cache size 0 max 16384 2024-09-16T01:24:05.608 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:24:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973", 2024-09-16T01:24:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-16T01:24:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8547, 2024-09-16T01:24:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-16T01:24:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-16T01:24:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-16T01:24:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.539652824, 2024-09-16T01:24:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 83, 2024-09-16T01:24:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 149, 2024-09-16T01:24:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 149, 2024-09-16T01:24:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 8.6216627859999999 2024-09-16T01:24:05.609 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:24:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.597+0000 7ff1c611a640 1 -- 172.21.15.81:0/481619210 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1ac06c2e0 msgr2=0x7ff1ac06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.597+0000 7ff1c611a640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1ac06c2e0 0x7ff1ac06e7a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0000c00 tx=0x7ff1b0009040 comp rx=0 tx=0).stop 2024-09-16T01:24:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.597+0000 7ff1c611a640 1 -- 172.21.15.81:0/481619210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c01f76c0 msgr2=0x7ff1c01f7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.597+0000 7ff1c611a640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c01f76c0 0x7ff1c01f7b40 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8000f80 tx=0x7ff1b802d070 comp rx=0 tx=0).stop 2024-09-16T01:24:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.597+0000 7ff1c611a640 1 -- 172.21.15.81:0/481619210 shutdown_connections 2024-09-16T01:24:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.597+0000 7ff1c611a640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff1ac06c2e0 0x7ff1ac06e7a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.597+0000 7ff1c611a640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1c01f76c0 0x7ff1c01f7b40 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.597+0000 7ff1c611a640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff1c00ae7c0 0x7ff1c014cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.597+0000 7ff1c611a640 1 --2- 172.21.15.81:0/481619210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff1a80051c0 0x7ff1c0150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.597+0000 7ff1c611a640 1 -- 172.21.15.81:0/481619210 >> 172.21.15.81:0/481619210 conn(0x7ff1c0073490 msgr2=0x7ff1c015cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.597+0000 7ff1c611a640 1 -- 172.21.15.81:0/481619210 shutdown_connections 2024-09-16T01:24:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.597+0000 7ff1c611a640 1 -- 172.21.15.81:0/481619210 wait complete. 2024-09-16T01:24:05.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:24:05.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.708+0000 7fd4d004c640 1 Processor -- start 2024-09-16T01:24:05.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.708+0000 7fd4d004c640 1 -- start start 2024-09-16T01:24:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.709+0000 7fd4d004c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c8162060 0x7fd4c80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.709+0000 7fd4d004c640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c806d9f0 con 0x7fd4c80b64b0 2024-09-16T01:24:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.709+0000 7fd4d004c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c806dcd0 con 0x7fd4c8161c80 2024-09-16T01:24:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.709+0000 7fd4d004c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c806dfb0 con 0x7fd4c8162060 2024-09-16T01:24:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.709+0000 7fd4ce5e9640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd4c80b64b0 0x7fd4c80cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54178/0 (socket says 172.21.15.81:54178) 2024-09-16T01:24:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.709+0000 7fd4ce5e9640 1 -- 172.21.15.81:0/1365430886 learned_addr learned my addr 172.21.15.81:0/1365430886 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.709+0000 7fd4cd5e7640 1 --2- 172.21.15.81:0/1365430886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c8162060 0x7fd4c80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.710+0000 7fd4ccde6640 1 -- 172.21.15.81:0/1365430886 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2922665222 0 0) 0x7fd4c806d9f0 con 0x7fd4c80b64b0 2024-09-16T01:24:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.710+0000 7fd4ccde6640 1 -- 172.21.15.81:0/1365430886 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4b4003520 con 0x7fd4c80b64b0 2024-09-16T01:24:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.710+0000 7fd4ccde6640 1 -- 172.21.15.81:0/1365430886 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2862268263 0 0) 0x7fd4c806dcd0 con 0x7fd4c8161c80 2024-09-16T01:24:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.710+0000 7fd4ccde6640 1 -- 172.21.15.81:0/1365430886 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c806d9f0 con 0x7fd4c8161c80 2024-09-16T01:24:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.710+0000 7fd4cd5e7640 1 -- 172.21.15.81:0/1365430886 >> v1:172.21.15.102:6789/0 conn(0x7fd4c8161c80 legacy=0x7fd4c806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.710+0000 7fd4cd5e7640 1 -- 172.21.15.81:0/1365430886 >> v1:172.21.15.81:6789/0 conn(0x7fd4c80b64b0 legacy=0x7fd4c80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.710+0000 7fd4cd5e7640 1 -- 172.21.15.81:0/1365430886 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c80d2890 con 0x7fd4c8162060 2024-09-16T01:24:05.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.710+0000 7fd4cd5e7640 1 --2- 172.21.15.81:0/1365430886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c8162060 0x7fd4c80b5f70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80097d0 tx=0x7fd4b802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f57644527929c55 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.711+0000 7fd4ccde6640 1 -- 172.21.15.81:0/1365430886 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8037070 con 0x7fd4c8162060 2024-09-16T01:24:05.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.711+0000 7fd4ccde6640 1 -- 172.21.15.81:0/1365430886 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b8032440 con 0x7fd4c8162060 2024-09-16T01:24:05.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.711+0000 7fd4ccde6640 1 -- 172.21.15.81:0/1365430886 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b80327f0 con 0x7fd4c8162060 2024-09-16T01:24:05.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.711+0000 7fd4d004c640 1 -- 172.21.15.81:0/1365430886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c8162060 msgr2=0x7fd4c80b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.711+0000 7fd4d004c640 1 --2- 172.21.15.81:0/1365430886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c8162060 0x7fd4c80b5f70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd4b80097d0 tx=0x7fd4b802a210 comp rx=0 tx=0).stop 2024-09-16T01:24:05.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.711+0000 7fd4d004c640 1 -- 172.21.15.81:0/1365430886 shutdown_connections 2024-09-16T01:24:05.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.711+0000 7fd4d004c640 1 --2- 172.21.15.81:0/1365430886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c8162060 0x7fd4c80b5f70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.711+0000 7fd4d004c640 1 -- 172.21.15.81:0/1365430886 >> 172.21.15.81:0/1365430886 conn(0x7fd4c80d44f0 msgr2=0x7fd4c80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.711+0000 7fd4d004c640 1 -- 172.21.15.81:0/1365430886 shutdown_connections 2024-09-16T01:24:05.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.711+0000 7fd4d004c640 1 -- 172.21.15.81:0/1365430886 wait complete. 2024-09-16T01:24:05.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.712+0000 7fd4d004c640 1 Processor -- start 2024-09-16T01:24:05.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.713+0000 7fd4d004c640 1 -- start start 2024-09-16T01:24:05.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.713+0000 7fd4d004c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c80b64b0 0x7fd4c80c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.713+0000 7fd4d004c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c8161c80 0x7fd4c80b9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.713+0000 7fd4d004c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c8162060 0x7fd4c80b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.713+0000 7fd4d004c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c80b6cf0 con 0x7fd4c8162060 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.713+0000 7fd4d004c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c80b6b70 con 0x7fd4c8161c80 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.713+0000 7fd4d004c640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c80cf8f0 con 0x7fd4c80b64b0 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.713+0000 7fd4ce5e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c8162060 0x7fd4c80b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.713+0000 7fd4ce5e9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c8162060 0x7fd4c80b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51372/0 (socket says 172.21.15.81:51372) 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.713+0000 7fd4ce5e9640 1 -- 172.21.15.81:0/514152992 learned_addr learned my addr 172.21.15.81:0/514152992 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.713+0000 7fd4cd5e7640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c8161c80 0x7fd4c80b9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.714+0000 7fd4cdde8640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c80b64b0 0x7fd4c80c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.714+0000 7fd4ce5e9640 1 -- 172.21.15.81:0/514152992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c80b64b0 msgr2=0x7fd4c80c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.714+0000 7fd4ce5e9640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c80b64b0 0x7fd4c80c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.714+0000 7fd4ce5e9640 1 -- 172.21.15.81:0/514152992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c8161c80 msgr2=0x7fd4c80b9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.714+0000 7fd4ce5e9640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c8161c80 0x7fd4c80b9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.714+0000 7fd4ce5e9640 1 -- 172.21.15.81:0/514152992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c80c82a0 con 0x7fd4c8162060 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.714+0000 7fd4ce5e9640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c8162060 0x7fd4c80b2130 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000cbd0 tx=0x7fd4c000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.714+0000 7fd4be7fc640 1 -- 172.21.15.81:0/514152992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0017070 con 0x7fd4c8162060 2024-09-16T01:24:05.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.714+0000 7fd4be7fc640 1 -- 172.21.15.81:0/514152992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4c000ace0 con 0x7fd4c8162060 2024-09-16T01:24:05.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.714+0000 7fd4be7fc640 1 -- 172.21.15.81:0/514152992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c0012620 con 0x7fd4c8162060 2024-09-16T01:24:05.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.714+0000 7fd4d004c640 1 -- 172.21.15.81:0/514152992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c80c8580 con 0x7fd4c8162060 2024-09-16T01:24:05.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.714+0000 7fd4d004c640 1 -- 172.21.15.81:0/514152992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c80c8b40 con 0x7fd4c8162060 2024-09-16T01:24:05.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.715+0000 7fd4d004c640 1 -- 172.21.15.81:0/514152992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c806dcd0 con 0x7fd4c8162060 2024-09-16T01:24:05.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.716+0000 7fd4be7fc640 1 -- 172.21.15.81:0/514152992 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd4c001a070 con 0x7fd4c8162060 2024-09-16T01:24:05.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.716+0000 7fd4be7fc640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4ac06c2b0 0x7fd4ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:05.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.716+0000 7fd4be7fc640 1 -- 172.21.15.81:0/514152992 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7fd4c008b570 con 0x7fd4c8162060 2024-09-16T01:24:05.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.716+0000 7fd4cdde8640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4ac06c2b0 0x7fd4ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:05.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.717+0000 7fd4cdde8640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4ac06c2b0 0x7fd4ac06e770 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4007fd0 tx=0x7fd4c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:05.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.720+0000 7fd4be7fc640 1 -- 172.21.15.81:0/514152992 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4c0059500 con 0x7fd4c8162060 2024-09-16T01:24:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.920+0000 7fd4d004c640 1 -- 172.21.15.81:0/514152992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd4c80ce5e0 con 0x7fd4c8162060 2024-09-16T01:24:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.921+0000 7fd4be7fc640 1 -- 172.21.15.81:0/514152992 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7fd4c005d800 con 0x7fd4c8162060 2024-09-16T01:24:05.922 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:24:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.922+0000 7fd4d004c640 1 -- 172.21.15.81:0/514152992 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4ac06c2b0 msgr2=0x7fd4ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.922+0000 7fd4d004c640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4ac06c2b0 0x7fd4ac06e770 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4007fd0 tx=0x7fd4c4009040 comp rx=0 tx=0).stop 2024-09-16T01:24:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.922+0000 7fd4d004c640 1 -- 172.21.15.81:0/514152992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c8162060 msgr2=0x7fd4c80b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.922+0000 7fd4d004c640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c8162060 0x7fd4c80b2130 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fd4c000cbd0 tx=0x7fd4c000a430 comp rx=0 tx=0).stop 2024-09-16T01:24:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.923+0000 7fd4d004c640 1 -- 172.21.15.81:0/514152992 shutdown_connections 2024-09-16T01:24:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.923+0000 7fd4d004c640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd4ac06c2b0 0x7fd4ac06e770 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.923+0000 7fd4d004c640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4c8162060 0x7fd4c80b2130 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.923+0000 7fd4d004c640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4c8161c80 0x7fd4c80b9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.923+0000 7fd4d004c640 1 --2- 172.21.15.81:0/514152992 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd4c80b64b0 0x7fd4c80c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.923+0000 7fd4d004c640 1 -- 172.21.15.81:0/514152992 >> 172.21.15.81:0/514152992 conn(0x7fd4c80d44f0 msgr2=0x7fd4c8160490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.923+0000 7fd4d004c640 1 -- 172.21.15.81:0/514152992 shutdown_connections 2024-09-16T01:24:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:05.923+0000 7fd4d004c640 1 -- 172.21.15.81:0/514152992 wait complete. 2024-09-16T01:24:05.935 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:24:05.935 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:24:05.935 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-16T01:24:05.935 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T01:24:05.935 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T01:24:05.935 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:24:05.936 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:24:05.936 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:24:05.936 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:24:05.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:05.936 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-16T01:24:05.952 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:24:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:24:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:24:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-16T01:24:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:05.952 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:24:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:24:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-16T01:24:05.952 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:24:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42292sec preferred_lft 42292sec 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:24:05.953 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::bc22:19ff:fe0c:8fb1/64 scope link 2024-09-16T01:24:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:05.954 INFO:teuthology.orchestra.run.smithi081.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:24:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 86:bb:d8:38:80:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:24:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::84bb:d8ff:fe38:80af/64 scope link 2024-09-16T01:24:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:05.954 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:24:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0a:28:0d:bd:ee:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:24:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::828:dff:febd:ee39/64 scope link 2024-09-16T01:24:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:05.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:05.955 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:24:06.015 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-16T01:24:06.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:06.016 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-16T01:24:06.072 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-16T01:24:06.073 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:24:06.073 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:24:06.073 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:24:06.073 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:24:06.073 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:24:06.073 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-16T01:24:06.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:24:06.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:24:06.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:24:06.074 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-16T01:24:06.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:24:06.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:24:06.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:06.200 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:24:06.217 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:24:06.217 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:24:06.218 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:24:06.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:06.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-16T01:24:06.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:24:06.283 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T01:24:06.339 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T01:24:06.339 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:24:06.339 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:24:06.394 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:24:06.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:06.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:24:06.476 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:24:06.477 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:24:06.477 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:24:06.485 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:24:06.485 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:24:06.485 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:24:06.485 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:24:06.485 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:24:06.489 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T01:24:06.489 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T01:24:06.489 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-09-16T01:24:06.490 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:24:06.490 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:24:06.490 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:24:06.490 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:24:06.490 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:24:06.493 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T01:24:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:24:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:24:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:24:06.493 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:24:06.493 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:24:06.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:06.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T01:24:06.560 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:24:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:24:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:24:06.659 INFO:teuthology.orchestra.run.smithi081.stdout:client8694 2024-09-16T01:24:06.659 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:24:06.660 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:24:06.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-16T01:24:06.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.813+0000 7fe39c4ae640 1 Processor -- start 2024-09-16T01:24:06.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.813+0000 7fe39c4ae640 1 -- start start 2024-09-16T01:24:06.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe39c4ae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe394147360 0x7fe394070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:06.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe39c4ae640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe394070dd0 0x7fe3940d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:06.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe39c4ae640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe39406cb30 con 0x7fe3940d09e0 2024-09-16T01:24:06.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe39c4ae640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe39406bfb0 con 0x7fe394147360 2024-09-16T01:24:06.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe39c4ae640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe39406c290 con 0x7fe394070dd0 2024-09-16T01:24:06.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe39a24a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe394147360 0x7fe394070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:06.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe39aa4b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe3940d09e0 0x7fe39406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54180/0 (socket says 172.21.15.81:54180) 2024-09-16T01:24:06.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe39aa4b640 1 -- 172.21.15.81:0/338513877 learned_addr learned my addr 172.21.15.81:0/338513877 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:06.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe399a49640 1 --2- 172.21.15.81:0/338513877 >> v2:172.21.15.102:3300/0 conn(0x7fe394070dd0 0x7fe3940d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:06.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe39a24a640 1 -- 172.21.15.81:0/338513877 >> v2:172.21.15.102:3300/0 conn(0x7fe394070dd0 msgr2=0x7fe3940d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:06.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe39a24a640 1 --2- 172.21.15.81:0/338513877 >> v2:172.21.15.102:3300/0 conn(0x7fe394070dd0 0x7fe3940d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:06.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe39a24a640 1 -- 172.21.15.81:0/338513877 >> v1:172.21.15.81:6789/0 conn(0x7fe3940d09e0 legacy=0x7fe39406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:06.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe39a24a640 1 -- 172.21.15.81:0/338513877 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39406c570 con 0x7fe394147360 2024-09-16T01:24:06.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.814+0000 7fe399248640 1 -- 172.21.15.81:0/338513877 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1272654237 0 0) 0x7fe39406cb30 con 0x7fe3940d09e0 2024-09-16T01:24:06.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.815+0000 7fe39a24a640 1 --2- 172.21.15.81:0/338513877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe394147360 0x7fe394070890 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fe3940cec70 tx=0x7fe39002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cf4b745989d81a server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:06.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.815+0000 7fe399248640 1 -- 172.21.15.81:0/338513877 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390037070 con 0x7fe394147360 2024-09-16T01:24:06.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.815+0000 7fe399248640 1 -- 172.21.15.81:0/338513877 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe390032440 con 0x7fe394147360 2024-09-16T01:24:06.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.815+0000 7fe399248640 1 -- 172.21.15.81:0/338513877 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39002ae60 con 0x7fe394147360 2024-09-16T01:24:06.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.816+0000 7fe39c4ae640 1 -- 172.21.15.81:0/338513877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe394147360 msgr2=0x7fe394070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:06.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.816+0000 7fe39c4ae640 1 --2- 172.21.15.81:0/338513877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe394147360 0x7fe394070890 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fe3940cec70 tx=0x7fe39002a110 comp rx=0 tx=0).stop 2024-09-16T01:24:06.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.816+0000 7fe39c4ae640 1 -- 172.21.15.81:0/338513877 shutdown_connections 2024-09-16T01:24:06.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.816+0000 7fe39c4ae640 1 --2- 172.21.15.81:0/338513877 >> v2:172.21.15.102:3300/0 conn(0x7fe394070dd0 0x7fe3940d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.816+0000 7fe39c4ae640 1 --2- 172.21.15.81:0/338513877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe394147360 0x7fe394070890 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.816+0000 7fe39c4ae640 1 -- 172.21.15.81:0/338513877 >> 172.21.15.81:0/338513877 conn(0x7fe3940b2f40 msgr2=0x7fe3940b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.816+0000 7fe39c4ae640 1 -- 172.21.15.81:0/338513877 shutdown_connections 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.816+0000 7fe39c4ae640 1 -- 172.21.15.81:0/338513877 wait complete. 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.817+0000 7fe39c4ae640 1 Processor -- start 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.817+0000 7fe39c4ae640 1 -- start start 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39c4ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe394070dd0 0x7fe39413dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39c4ae640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3940d09e0 0x7fe3940b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39c4ae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe394147360 0x7fe3941614a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39c4ae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe39406bc10 con 0x7fe394070dd0 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39c4ae640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe3940d0e00 con 0x7fe394147360 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39c4ae640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe39406bd90 con 0x7fe3940d09e0 2024-09-16T01:24:06.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39a24a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe394070dd0 0x7fe39413dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:06.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39a24a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe394070dd0 0x7fe39413dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51400/0 (socket says 172.21.15.81:51400) 2024-09-16T01:24:06.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39a24a640 1 -- 172.21.15.81:0/601440843 learned_addr learned my addr 172.21.15.81:0/601440843 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:06.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe399a49640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3940d09e0 0x7fe3940b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:06.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39aa4b640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe394147360 0x7fe3941614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:06.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39a24a640 1 -- 172.21.15.81:0/601440843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3940d09e0 msgr2=0x7fe3940b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:06.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39a24a640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3940d09e0 0x7fe3940b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:06.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39a24a640 1 -- 172.21.15.81:0/601440843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe394147360 msgr2=0x7fe3941614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:06.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39a24a640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe394147360 0x7fe3941614a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:06.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39a24a640 1 -- 172.21.15.81:0/601440843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3941400c0 con 0x7fe394070dd0 2024-09-16T01:24:06.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe399a49640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3940d09e0 0x7fe3940b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:06.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39aa4b640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe394147360 0x7fe3941614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:06.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe39a24a640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe394070dd0 0x7fe39413dce0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fe390000c00 tx=0x7fe3900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:06.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.818+0000 7fe38affd640 1 -- 172.21.15.81:0/601440843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390037040 con 0x7fe394070dd0 2024-09-16T01:24:06.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.819+0000 7fe38affd640 1 -- 172.21.15.81:0/601440843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe390042070 con 0x7fe394070dd0 2024-09-16T01:24:06.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.819+0000 7fe39c4ae640 1 -- 172.21.15.81:0/601440843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3940b5d70 con 0x7fe394070dd0 2024-09-16T01:24:06.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.819+0000 7fe38affd640 1 -- 172.21.15.81:0/601440843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe390030960 con 0x7fe394070dd0 2024-09-16T01:24:06.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.819+0000 7fe39c4ae640 1 -- 172.21.15.81:0/601440843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3940b6330 con 0x7fe394070dd0 2024-09-16T01:24:06.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.819+0000 7fe39c4ae640 1 -- 172.21.15.81:0/601440843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3940701d0 con 0x7fe394070dd0 2024-09-16T01:24:06.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.820+0000 7fe38affd640 1 -- 172.21.15.81:0/601440843 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe390030b00 con 0x7fe394070dd0 2024-09-16T01:24:06.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.820+0000 7fe38affd640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe37806c2e0 0x7fe37806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:06.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.820+0000 7fe38affd640 1 -- 172.21.15.81:0/601440843 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7fe3900abe90 con 0x7fe394070dd0 2024-09-16T01:24:06.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.821+0000 7fe399a49640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe37806c2e0 0x7fe37806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:06.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.821+0000 7fe399a49640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe37806c2e0 0x7fe37806e7a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe3941f83e0 tx=0x7fe384008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:06.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:06.825+0000 7fe38affd640 1 -- 172.21.15.81:0/601440843 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe39007a590 con 0x7fe394070dd0 2024-09-16T01:24:07.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.025+0000 7fe39c4ae640 1 -- 172.21.15.81:0/601440843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe3940d04a0 con 0x7fe394070dd0 2024-09-16T01:24:07.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.025+0000 7fe38affd640 1 -- 172.21.15.81:0/601440843 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) ==== 53+0+73 (secure 0 0 0) 0x7fe390079e90 con 0x7fe394070dd0 2024-09-16T01:24:07.027 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-16T01:24:07.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.027+0000 7fe39c4ae640 1 -- 172.21.15.81:0/601440843 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe37806c2e0 msgr2=0x7fe37806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:07.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.027+0000 7fe39c4ae640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe37806c2e0 0x7fe37806e7a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe3941f83e0 tx=0x7fe384008040 comp rx=0 tx=0).stop 2024-09-16T01:24:07.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.027+0000 7fe39c4ae640 1 -- 172.21.15.81:0/601440843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe394070dd0 msgr2=0x7fe39413dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:07.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.027+0000 7fe39c4ae640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe394070dd0 0x7fe39413dce0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fe390000c00 tx=0x7fe3900046c0 comp rx=0 tx=0).stop 2024-09-16T01:24:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.027+0000 7fe39c4ae640 1 -- 172.21.15.81:0/601440843 shutdown_connections 2024-09-16T01:24:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.027+0000 7fe39c4ae640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fe37806c2e0 0x7fe37806e7a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.027+0000 7fe39c4ae640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe394147360 0x7fe3941614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.027+0000 7fe39c4ae640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe3940d09e0 0x7fe3940b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.027+0000 7fe39c4ae640 1 --2- 172.21.15.81:0/601440843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe394070dd0 0x7fe39413dce0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.027+0000 7fe39c4ae640 1 -- 172.21.15.81:0/601440843 >> 172.21.15.81:0/601440843 conn(0x7fe3940b2f40 msgr2=0x7fe394145870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.027+0000 7fe39c4ae640 1 -- 172.21.15.81:0/601440843 shutdown_connections 2024-09-16T01:24:07.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:07.027+0000 7fe39c4ae640 1 -- 172.21.15.81:0/601440843 wait complete. 2024-09-16T01:24:07.039 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-16T01:24:07.039 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T01:24:07.040 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-16T01:24:07.040 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T01:24:07.040 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T01:24:07.040 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-16T01:24:07.040 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-16T01:24:07.040 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T01:24:07.040 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:24:07.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:07.040 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-16T01:24:07.059 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T01:24:07.059 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T01:24:07.060 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T01:24:07.060 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:07.060 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-16T01:24:07.060 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:07.060 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:24:07.060 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-16T01:24:07.060 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-16T01:24:07.060 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:24:07.060 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-16T01:24:07.061 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-16T01:24:07.061 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T01:24:07.061 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:24:07.061 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T01:24:07.061 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:24:07.062 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T01:24:07.062 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42293sec preferred_lft 42293sec 2024-09-16T01:24:07.062 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-16T01:24:07.062 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:07.062 INFO:teuthology.orchestra.run.smithi102.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-16T01:24:07.062 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff 2024-09-16T01:24:07.062 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-16T01:24:07.062 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:07.062 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::fc48:18ff:fedc:b80f/64 scope link 2024-09-16T01:24:07.062 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:07.062 INFO:teuthology.orchestra.run.smithi102.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:24:07.062 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 2e:4a:65:c9:20:4f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:24:07.063 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::2c4a:65ff:fec9:204f/64 scope link 2024-09-16T01:24:07.063 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:07.063 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-16T01:24:07.063 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 12:72:70:fd:f9:f1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:24:07.063 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::1072:70ff:fefd:f9f1/64 scope link 2024-09-16T01:24:07.063 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-16T01:24:07.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:07.063 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T01:24:07.126 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-16T01:24:07.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:07.128 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-16T01:24:07.186 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-16T01:24:07.186 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T01:24:07.186 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T01:24:07.186 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T01:24:07.186 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T01:24:07.187 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T01:24:07.187 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-16T01:24:07.187 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T01:24:07.187 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T01:24:07.187 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T01:24:07.187 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-16T01:24:07.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:24:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T01:24:07.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:24:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:24:07.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:07.321 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:24:07.337 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T01:24:07.337 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:24:07.337 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:24:07.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:07.337 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-16T01:24:07.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:24:07.402 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T01:24:07.459 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T01:24:07.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T01:24:07.460 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:24:07.515 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T01:24:07.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:07.515 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:24:07.598 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:24:07.598 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:24:07.598 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:24:07.607 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:24:07.607 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:24:07.607 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:24:07.607 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:24:07.607 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:24:07.611 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T01:24:07.612 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T01:24:07.612 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-16T01:24:07.612 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-16T01:24:07.612 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T01:24:07.612 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-16T01:24:07.612 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-16T01:24:07.612 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973" will pass to kernel 2024-09-16T01:24:07.613 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T01:24:07.613 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-16T01:24:07.613 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T01:24:07.613 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T01:24:07.613 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T01:24:07.614 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T01:24:07.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:07.614 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T01:24:07.679 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T01:24:07.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:24:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T01:24:07.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-16T01:24:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T01:24:07.774 INFO:teuthology.orchestra.run.smithi102.stdout:client7483 2024-09-16T01:24:07.775 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:24:07.775 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:24:07.790 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-16T01:24:07.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:24:07.835 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-16T01:24:07.887 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-16T01:24:07.887 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:24:07.887 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:24:07.887 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:24:07.904 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:24:07.905 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:24:07.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:24:08.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.108+0000 7fc68efd6640 1 Processor -- start 2024-09-16T01:24:08.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.108+0000 7fc68efd6640 1 -- start start 2024-09-16T01:24:08.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc68efd6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6880d0be0 0x7fc6880cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc68efd6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc68815d460 0x7fc6880afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc68efd6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6880af720 con 0x7fc688145e00 2024-09-16T01:24:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc68efd6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc6881461e0 con 0x7fc6880d0be0 2024-09-16T01:24:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc68efd6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc6880cdf90 con 0x7fc68815d460 2024-09-16T01:24:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc687fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6880d0be0 0x7fc6880cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc68cd72640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc688145e00 0x7fc6880d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54192/0 (socket says 172.21.15.81:54192) 2024-09-16T01:24:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc68cd72640 1 -- 172.21.15.81:0/1510966642 learned_addr learned my addr 172.21.15.81:0/1510966642 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc68d573640 1 --2- 172.21.15.81:0/1510966642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc68815d460 0x7fc6880afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc687fff640 1 -- 172.21.15.81:0/1510966642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc68815d460 msgr2=0x7fc6880afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc687fff640 1 --2- 172.21.15.81:0/1510966642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc68815d460 0x7fc6880afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc687fff640 1 -- 172.21.15.81:0/1510966642 >> v1:172.21.15.81:6789/0 conn(0x7fc688145e00 legacy=0x7fc6880d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc687fff640 1 -- 172.21.15.81:0/1510966642 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6880ce270 con 0x7fc6880d0be0 2024-09-16T01:24:08.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.109+0000 7fc6877fe640 1 -- 172.21.15.81:0/1510966642 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 914462869 0 0) 0x7fc6880af720 con 0x7fc688145e00 2024-09-16T01:24:08.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.110+0000 7fc687fff640 1 --2- 172.21.15.81:0/1510966642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6880d0be0 0x7fc6880cd8a0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fc6740097a0 tx=0x7fc67402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b62aa0a87bd036 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:08.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.110+0000 7fc6877fe640 1 -- 172.21.15.81:0/1510966642 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674037070 con 0x7fc6880d0be0 2024-09-16T01:24:08.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.110+0000 7fc6877fe640 1 -- 172.21.15.81:0/1510966642 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc674032440 con 0x7fc6880d0be0 2024-09-16T01:24:08.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.110+0000 7fc6877fe640 1 -- 172.21.15.81:0/1510966642 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674032810 con 0x7fc6880d0be0 2024-09-16T01:24:08.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.111+0000 7fc68efd6640 1 -- 172.21.15.81:0/1510966642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6880d0be0 msgr2=0x7fc6880cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.111+0000 7fc68efd6640 1 --2- 172.21.15.81:0/1510966642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6880d0be0 0x7fc6880cd8a0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fc6740097a0 tx=0x7fc67402a180 comp rx=0 tx=0).stop 2024-09-16T01:24:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.111+0000 7fc68efd6640 1 -- 172.21.15.81:0/1510966642 shutdown_connections 2024-09-16T01:24:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.111+0000 7fc68efd6640 1 --2- 172.21.15.81:0/1510966642 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc68815d460 0x7fc6880afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.111+0000 7fc68efd6640 1 --2- 172.21.15.81:0/1510966642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6880d0be0 0x7fc6880cd8a0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.111+0000 7fc68efd6640 1 -- 172.21.15.81:0/1510966642 >> 172.21.15.81:0/1510966642 conn(0x7fc6880b2f40 msgr2=0x7fc6880b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.111+0000 7fc68efd6640 1 -- 172.21.15.81:0/1510966642 shutdown_connections 2024-09-16T01:24:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.111+0000 7fc68efd6640 1 -- 172.21.15.81:0/1510966642 wait complete. 2024-09-16T01:24:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.112+0000 7fc68efd6640 1 Processor -- start 2024-09-16T01:24:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.112+0000 7fc68efd6640 1 -- start start 2024-09-16T01:24:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc68efd6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6880d0be0 0x7fc68814ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc68efd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc688145e00 0x7fc688157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc68efd6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc68815d460 0x7fc6881f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc68efd6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc68815d8b0 con 0x7fc688145e00 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc68efd6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc6880ce830 con 0x7fc68815d460 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc68efd6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc6880cede0 con 0x7fc6880d0be0 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc687fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc688145e00 0x7fc688157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc687fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc688145e00 0x7fc688157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51420/0 (socket says 172.21.15.81:51420) 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc687fff640 1 -- 172.21.15.81:0/1762494581 learned_addr learned my addr 172.21.15.81:0/1762494581 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc68cd72640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6880d0be0 0x7fc68814ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc68d573640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc68815d460 0x7fc6881f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc687fff640 1 -- 172.21.15.81:0/1762494581 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6880d0be0 msgr2=0x7fc68814ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc687fff640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6880d0be0 0x7fc68814ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc687fff640 1 -- 172.21.15.81:0/1762494581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc68815d460 msgr2=0x7fc6881f1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc687fff640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc68815d460 0x7fc6881f1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.113+0000 7fc687fff640 1 -- 172.21.15.81:0/1762494581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68815a270 con 0x7fc688145e00 2024-09-16T01:24:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.114+0000 7fc687fff640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc688145e00 0x7fc688157130 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fc674035040 tx=0x7fc6740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.114+0000 7fc6857fa640 1 -- 172.21.15.81:0/1762494581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674037040 con 0x7fc688145e00 2024-09-16T01:24:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.114+0000 7fc6857fa640 1 -- 172.21.15.81:0/1762494581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc674030770 con 0x7fc688145e00 2024-09-16T01:24:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.114+0000 7fc6857fa640 1 -- 172.21.15.81:0/1762494581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc674030b80 con 0x7fc688145e00 2024-09-16T01:24:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.114+0000 7fc68efd6640 1 -- 172.21.15.81:0/1762494581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc688159cb0 con 0x7fc688145e00 2024-09-16T01:24:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.114+0000 7fc68efd6640 1 -- 172.21.15.81:0/1762494581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc68813fef0 con 0x7fc688145e00 2024-09-16T01:24:08.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.115+0000 7fc68efd6640 1 -- 172.21.15.81:0/1762494581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc688068fc0 con 0x7fc688145e00 2024-09-16T01:24:08.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.115+0000 7fc6857fa640 1 -- 172.21.15.81:0/1762494581 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc674044020 con 0x7fc688145e00 2024-09-16T01:24:08.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.116+0000 7fc6857fa640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc66c06c2b0 0x7fc66c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.116+0000 7fc6857fa640 1 -- 172.21.15.81:0/1762494581 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7fc6740ab980 con 0x7fc688145e00 2024-09-16T01:24:08.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.116+0000 7fc68cd72640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc66c06c2b0 0x7fc66c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.116+0000 7fc68cd72640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc66c06c2b0 0x7fc66c06e770 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc67c000f60 tx=0x7fc67c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:08.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.120+0000 7fc6857fa640 1 -- 172.21.15.81:0/1762494581 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc688068fc0 con 0x7fc688145e00 2024-09-16T01:24:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.300+0000 7fc68efd6640 1 -- 172.21.15.81:0/1762494581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc6880cd8a0 con 0x7fc688145e00 2024-09-16T01:24:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.300+0000 7fc6857fa640 1 -- 172.21.15.81:0/1762494581 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v149) ==== 80+0+0 (secure 0 0 0) 0x7fc674032e20 con 0x7fc688145e00 2024-09-16T01:24:08.302 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:24:08.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.302+0000 7fc68efd6640 1 -- 172.21.15.81:0/1762494581 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc66c06c2b0 msgr2=0x7fc66c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.302+0000 7fc68efd6640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc66c06c2b0 0x7fc66c06e770 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc67c000f60 tx=0x7fc67c009040 comp rx=0 tx=0).stop 2024-09-16T01:24:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.302+0000 7fc68efd6640 1 -- 172.21.15.81:0/1762494581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc688145e00 msgr2=0x7fc688157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.302+0000 7fc68efd6640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc688145e00 0x7fc688157130 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fc674035040 tx=0x7fc6740046c0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.303+0000 7fc68efd6640 1 -- 172.21.15.81:0/1762494581 shutdown_connections 2024-09-16T01:24:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.303+0000 7fc68efd6640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc66c06c2b0 0x7fc66c06e770 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.303+0000 7fc68efd6640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc68815d460 0x7fc6881f1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.303+0000 7fc68efd6640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc688145e00 0x7fc688157130 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.303+0000 7fc68efd6640 1 --2- 172.21.15.81:0/1762494581 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6880d0be0 0x7fc68814ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.303+0000 7fc68efd6640 1 -- 172.21.15.81:0/1762494581 >> 172.21.15.81:0/1762494581 conn(0x7fc6880b2f40 msgr2=0x7fc688144800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.303+0000 7fc68efd6640 1 -- 172.21.15.81:0/1762494581 shutdown_connections 2024-09-16T01:24:08.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.303+0000 7fc68efd6640 1 -- 172.21.15.81:0/1762494581 wait complete. 2024-09-16T01:24:08.315 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T01:24:08.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:08.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T01:24:08.344 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:24:08.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:08.344 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T01:24:08.399 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:24:08.400 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:24:08.400 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:24:08.416 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:24:08.416 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:24:08.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.569+0000 7f1d95513640 1 Processor -- start 2024-09-16T01:24:08.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.569+0000 7f1d95513640 1 -- start start 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.570+0000 7f1d95513640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1d9015e5b0 0x7f1d900b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.570+0000 7f1d95513640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d9015e990 0x7f1d900b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.570+0000 7f1d95513640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d900b6520 con 0x7f1d900ae140 2024-09-16T01:24:08.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.570+0000 7f1d95513640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1d900b17f0 con 0x7f1d9015e5b0 2024-09-16T01:24:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.570+0000 7f1d95513640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1d900b1a40 con 0x7f1d9015e990 2024-09-16T01:24:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.570+0000 7f1d8effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1d9015e5b0 0x7f1d900b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.570+0000 7f1d8effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1d9015e5b0 0x7f1d900b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51426/0 (socket says 172.21.15.81:51426) 2024-09-16T01:24:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.570+0000 7f1d8effd640 1 -- 172.21.15.81:0/2016074682 learned_addr learned my addr 172.21.15.81:0/2016074682 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.571+0000 7f1d8e7fc640 1 --2- 172.21.15.81:0/2016074682 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d9015e990 0x7f1d900b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.571+0000 7f1d8effd640 1 -- 172.21.15.81:0/2016074682 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d9015e990 msgr2=0x7f1d900b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.571+0000 7f1d8effd640 1 --2- 172.21.15.81:0/2016074682 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d9015e990 0x7f1d900b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.571+0000 7f1d8effd640 1 -- 172.21.15.81:0/2016074682 >> v1:172.21.15.102:6789/0 conn(0x7f1d900ae140 legacy=0x7f1d9006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.571+0000 7f1d8effd640 1 -- 172.21.15.81:0/2016074682 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d900b1d20 con 0x7f1d9015e5b0 2024-09-16T01:24:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.571+0000 7f1d8effd640 1 --2- 172.21.15.81:0/2016074682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9015e5b0 0x7f1d900b5f40 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009e50 tx=0x7f1d8002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39672b1c631b764 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.572+0000 7f1d8dffb640 1 -- 172.21.15.81:0/2016074682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d80036070 con 0x7f1d9015e5b0 2024-09-16T01:24:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.572+0000 7f1d8dffb640 1 -- 172.21.15.81:0/2016074682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d80031600 con 0x7f1d9015e5b0 2024-09-16T01:24:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.572+0000 7f1d8dffb640 1 -- 172.21.15.81:0/2016074682 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d800319d0 con 0x7f1d9015e5b0 2024-09-16T01:24:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.572+0000 7f1d95513640 1 -- 172.21.15.81:0/2016074682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9015e5b0 msgr2=0x7f1d900b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.572+0000 7f1d95513640 1 --2- 172.21.15.81:0/2016074682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9015e5b0 0x7f1d900b5f40 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f1d80009e50 tx=0x7f1d8002a710 comp rx=0 tx=0).stop 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.572+0000 7f1d95513640 1 -- 172.21.15.81:0/2016074682 shutdown_connections 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.572+0000 7f1d95513640 1 --2- 172.21.15.81:0/2016074682 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d9015e990 0x7f1d900b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.572+0000 7f1d95513640 1 --2- 172.21.15.81:0/2016074682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9015e5b0 0x7f1d900b5f40 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.572+0000 7f1d95513640 1 -- 172.21.15.81:0/2016074682 >> 172.21.15.81:0/2016074682 conn(0x7f1d90073490 msgr2=0x7f1d900b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.572+0000 7f1d95513640 1 -- 172.21.15.81:0/2016074682 shutdown_connections 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.572+0000 7f1d95513640 1 -- 172.21.15.81:0/2016074682 wait complete. 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.573+0000 7f1d95513640 1 Processor -- start 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.573+0000 7f1d95513640 1 -- start start 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.574+0000 7f1d95513640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d900ae140 0x7f1d900cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.574+0000 7f1d95513640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9015e5b0 0x7f1d90154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.574+0000 7f1d95513640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9015e990 0x7f1d900ce400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.574+0000 7f1d95513640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d900b2a60 con 0x7f1d9015e990 2024-09-16T01:24:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.574+0000 7f1d95513640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1d900b0490 con 0x7f1d9015e5b0 2024-09-16T01:24:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.574+0000 7f1d95513640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1d900b2be0 con 0x7f1d900ae140 2024-09-16T01:24:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.574+0000 7f1d8f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9015e990 0x7f1d900ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.574+0000 7f1d8f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9015e990 0x7f1d900ce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51436/0 (socket says 172.21.15.81:51436) 2024-09-16T01:24:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.574+0000 7f1d8f7fe640 1 -- 172.21.15.81:0/2947683098 learned_addr learned my addr 172.21.15.81:0/2947683098 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.574+0000 7f1d8effd640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d900ae140 0x7f1d900cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.574+0000 7f1d8e7fc640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9015e5b0 0x7f1d90154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.575+0000 7f1d8f7fe640 1 -- 172.21.15.81:0/2947683098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d900ae140 msgr2=0x7f1d900cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.575+0000 7f1d8f7fe640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d900ae140 0x7f1d900cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.575+0000 7f1d8f7fe640 1 -- 172.21.15.81:0/2947683098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9015e5b0 msgr2=0x7f1d90154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.575+0000 7f1d8f7fe640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9015e5b0 0x7f1d90154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.575+0000 7f1d8f7fe640 1 -- 172.21.15.81:0/2947683098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d900cee50 con 0x7f1d9015e990 2024-09-16T01:24:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.575+0000 7f1d8f7fe640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9015e990 0x7f1d900ce400 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800c400 tx=0x7f1d8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.575+0000 7f1d777fe640 1 -- 172.21.15.81:0/2947683098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88017070 con 0x7f1d9015e990 2024-09-16T01:24:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.575+0000 7f1d777fe640 1 -- 172.21.15.81:0/2947683098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d880052d0 con 0x7f1d9015e990 2024-09-16T01:24:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.575+0000 7f1d95513640 1 -- 172.21.15.81:0/2947683098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d9015efa0 con 0x7f1d9015e990 2024-09-16T01:24:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.575+0000 7f1d777fe640 1 -- 172.21.15.81:0/2947683098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d88003810 con 0x7f1d9015e990 2024-09-16T01:24:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.575+0000 7f1d95513640 1 -- 172.21.15.81:0/2947683098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d90155280 con 0x7f1d9015e990 2024-09-16T01:24:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.576+0000 7f1d95513640 1 -- 172.21.15.81:0/2947683098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d900b5f40 con 0x7f1d9015e990 2024-09-16T01:24:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.576+0000 7f1d777fe640 1 -- 172.21.15.81:0/2947683098 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1d8801a070 con 0x7f1d9015e990 2024-09-16T01:24:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.577+0000 7f1d777fe640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1d7c06c2b0 0x7f1d7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.577+0000 7f1d777fe640 1 -- 172.21.15.81:0/2947683098 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7f1d8808a8e0 con 0x7f1d9015e990 2024-09-16T01:24:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.577+0000 7f1d8effd640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1d7c06c2b0 0x7f1d7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.577+0000 7f1d8effd640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1d7c06c2b0 0x7f1d7c06e770 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1d80033000 tx=0x7f1d80009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.581+0000 7f1d777fe640 1 -- 172.21.15.81:0/2947683098 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d88058870 con 0x7f1d9015e990 2024-09-16T01:24:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.757+0000 7f1d95513640 1 -- 172.21.15.81:0/2947683098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1d900701c0 con 0x7f1d9015e990 2024-09-16T01:24:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.758+0000 7f1d777fe640 1 -- 172.21.15.81:0/2947683098 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v149) ==== 80+0+0 (secure 0 0 0) 0x7f1d8805cb70 con 0x7f1d9015e990 2024-09-16T01:24:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-16T01:24:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.759+0000 7f1d95513640 1 -- 172.21.15.81:0/2947683098 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1d7c06c2b0 msgr2=0x7f1d7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.759+0000 7f1d95513640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1d7c06c2b0 0x7f1d7c06e770 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f1d80033000 tx=0x7f1d80009000 comp rx=0 tx=0).stop 2024-09-16T01:24:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.759+0000 7f1d95513640 1 -- 172.21.15.81:0/2947683098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9015e990 msgr2=0x7f1d900ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.759+0000 7f1d95513640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9015e990 0x7f1d900ce400 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f1d8800c400 tx=0x7f1d8800c8c0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.759+0000 7f1d95513640 1 -- 172.21.15.81:0/2947683098 shutdown_connections 2024-09-16T01:24:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.759+0000 7f1d95513640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f1d7c06c2b0 0x7f1d7c06e770 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.759+0000 7f1d95513640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d9015e990 0x7f1d900ce400 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.759+0000 7f1d95513640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d9015e5b0 0x7f1d90154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.759+0000 7f1d95513640 1 --2- 172.21.15.81:0/2947683098 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d900ae140 0x7f1d900cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.760+0000 7f1d95513640 1 -- 172.21.15.81:0/2947683098 >> 172.21.15.81:0/2947683098 conn(0x7f1d90073490 msgr2=0x7f1d900af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.760+0000 7f1d95513640 1 -- 172.21.15.81:0/2947683098 shutdown_connections 2024-09-16T01:24:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:08.760+0000 7f1d95513640 1 -- 172.21.15.81:0/2947683098 wait complete. 2024-09-16T01:24:08.772 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T01:24:08.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:08.773 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T01:24:08.801 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:24:08.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:08.801 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T01:24:08.857 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:24:08.857 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:24:08.857 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:24:08.873 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:24:08.873 INFO:tasks.cephfs.mount:Terminating background process 2024-09-16T01:24:08.873 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:24:08.873 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:24:08.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:24:08.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:24:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.010+0000 7f7e58566640 1 Processor -- start 2024-09-16T01:24:09.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.010+0000 7f7e58566640 1 -- start start 2024-09-16T01:24:09.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.011+0000 7f7e58566640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e500b6680 0x7f7e50169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.011+0000 7f7e58566640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5006d9f0 con 0x7f7e50161c80 2024-09-16T01:24:09.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.011+0000 7f7e58566640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5006dcd0 con 0x7f7e50162060 2024-09-16T01:24:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.011+0000 7f7e58566640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7e5006dfb0 con 0x7f7e500b6680 2024-09-16T01:24:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.011+0000 7f7e56b03640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e500b6680 0x7f7e50169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.011+0000 7f7e56302640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7e50161c80 0x7f7e5006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54208/0 (socket says 172.21.15.81:54208) 2024-09-16T01:24:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.011+0000 7f7e56302640 1 -- 172.21.15.81:0/3694959822 learned_addr learned my addr 172.21.15.81:0/3694959822 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.012+0000 7f7e56b03640 1 -- 172.21.15.81:0/3694959822 >> v1:172.21.15.102:6789/0 conn(0x7f7e50162060 legacy=0x7f7e500b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.012+0000 7f7e56b03640 1 -- 172.21.15.81:0/3694959822 >> v1:172.21.15.81:6789/0 conn(0x7f7e50161c80 legacy=0x7f7e5006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.012+0000 7f7e56b03640 1 -- 172.21.15.81:0/3694959822 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e500d01f0 con 0x7f7e500b6680 2024-09-16T01:24:09.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.012+0000 7f7e55300640 1 -- 172.21.15.81:0/3694959822 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3904839294 0 0) 0x7f7e5006d9f0 con 0x7f7e50161c80 2024-09-16T01:24:09.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.012+0000 7f7e56b03640 1 --2- 172.21.15.81:0/3694959822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500b6680 0x7f7e50169830 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f7e400097a0 tx=0x7f7e4002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa55754af7bc87f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:09.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.012+0000 7f7e55300640 1 -- 172.21.15.81:0/3694959822 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40037070 con 0x7f7e500b6680 2024-09-16T01:24:09.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.013+0000 7f7e55300640 1 -- 172.21.15.81:0/3694959822 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e40032440 con 0x7f7e500b6680 2024-09-16T01:24:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.013+0000 7f7e55300640 1 -- 172.21.15.81:0/3694959822 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e40032810 con 0x7f7e500b6680 2024-09-16T01:24:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.013+0000 7f7e58566640 1 -- 172.21.15.81:0/3694959822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500b6680 msgr2=0x7f7e50169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.013+0000 7f7e58566640 1 --2- 172.21.15.81:0/3694959822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500b6680 0x7f7e50169830 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f7e400097a0 tx=0x7f7e4002a230 comp rx=0 tx=0).stop 2024-09-16T01:24:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.013+0000 7f7e58566640 1 -- 172.21.15.81:0/3694959822 shutdown_connections 2024-09-16T01:24:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.013+0000 7f7e58566640 1 --2- 172.21.15.81:0/3694959822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500b6680 0x7f7e50169830 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.013+0000 7f7e58566640 1 -- 172.21.15.81:0/3694959822 >> 172.21.15.81:0/3694959822 conn(0x7f7e500d44f0 msgr2=0x7f7e500d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.013+0000 7f7e58566640 1 -- 172.21.15.81:0/3694959822 shutdown_connections 2024-09-16T01:24:09.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.013+0000 7f7e58566640 1 -- 172.21.15.81:0/3694959822 wait complete. 2024-09-16T01:24:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.014+0000 7f7e58566640 1 Processor -- start 2024-09-16T01:24:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.014+0000 7f7e58566640 1 -- start start 2024-09-16T01:24:09.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e58566640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500b6680 0x7f7e500ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e58566640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e50161c80 0x7f7e500b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e58566640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e50162060 0x7f7e5014f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e58566640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e500b6cb0 con 0x7f7e500b6680 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e58566640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7e500b6b30 con 0x7f7e50161c80 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e58566640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7e50169d70 con 0x7f7e50162060 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e56302640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500b6680 0x7f7e500ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e56302640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500b6680 0x7f7e500ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51454/0 (socket says 172.21.15.81:51454) 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e56302640 1 -- 172.21.15.81:0/1669864679 learned_addr learned my addr 172.21.15.81:0/1669864679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e55b01640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e50161c80 0x7f7e500b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e56b03640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e50162060 0x7f7e5014f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e56302640 1 -- 172.21.15.81:0/1669864679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e50162060 msgr2=0x7f7e5014f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e56302640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e50162060 0x7f7e5014f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e56302640 1 -- 172.21.15.81:0/1669864679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e50161c80 msgr2=0x7f7e500b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e56302640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e50161c80 0x7f7e500b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.015+0000 7f7e56302640 1 -- 172.21.15.81:0/1669864679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e500b2cb0 con 0x7f7e500b6680 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.016+0000 7f7e56302640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500b6680 0x7f7e500ca7b0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800c420 tx=0x7f7e4800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.016+0000 7f7e4effd640 1 -- 172.21.15.81:0/1669864679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e480074e0 con 0x7f7e500b6680 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.016+0000 7f7e4effd640 1 -- 172.21.15.81:0/1669864679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e480047e0 con 0x7f7e500b6680 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.016+0000 7f7e58566640 1 -- 172.21.15.81:0/1669864679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e500b2f90 con 0x7f7e500b6680 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.016+0000 7f7e4effd640 1 -- 172.21.15.81:0/1669864679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e48004c10 con 0x7f7e500b6680 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.016+0000 7f7e58566640 1 -- 172.21.15.81:0/1669864679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e500c84f0 con 0x7f7e500b6680 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.017+0000 7f7e58566640 1 -- 172.21.15.81:0/1669864679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e500d42f0 con 0x7f7e500b6680 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.017+0000 7f7e4effd640 1 -- 172.21.15.81:0/1669864679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7e48011070 con 0x7f7e500b6680 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.018+0000 7f7e4effd640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e3c06c2b0 0x7f7e3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.018+0000 7f7e4effd640 1 -- 172.21.15.81:0/1669864679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7f7e4808b140 con 0x7f7e500b6680 2024-09-16T01:24:09.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.018+0000 7f7e55b01640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e3c06c2b0 0x7f7e3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.018+0000 7f7e55b01640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e3c06c2b0 0x7f7e3c06e770 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7e500b5ef0 tx=0x7f7e44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:09.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.022+0000 7f7e4effd640 1 -- 172.21.15.81:0/1669864679 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e500d42f0 con 0x7f7e500b6680 2024-09-16T01:24:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.226+0000 7f7e58566640 1 -- 172.21.15.81:0/1669864679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e500ba470 con 0x7f7e500b6680 2024-09-16T01:24:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.227+0000 7f7e4effd640 1 -- 172.21.15.81:0/1669864679 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5233 (secure 0 0 0) 0x7f7e48059040 con 0x7f7e500b6680 2024-09-16T01:24:09.229 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:09.229 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"btime":"2024-09-16T01:24:03:062667+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1526547768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1526547768},{"type":"v1","addr":"172.21.15.102:6834","nonce":1526547768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1390834502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1390834502},{"type":"v1","addr":"172.21.15.102:6835","nonce":1390834502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1449155906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1449155906},{"type":"v1","addr":"172.21.15.81:6836","nonce":1449155906}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:24:00.383912+0000","modified":"2024-09-16T01:24:02.389045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8547":{"gid":8547,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3797465908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3797465908},{"type":"v1","addr":"172.21.15.81:6837","nonce":3797465908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8547,"qdb_cluster":[8547]},"id":11}]} 2024-09-16T01:24:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2024-09-16T01:24:09.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.229+0000 7f7e58566640 1 -- 172.21.15.81:0/1669864679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e3c06c2b0 msgr2=0x7f7e3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.229+0000 7f7e58566640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e3c06c2b0 0x7f7e3c06e770 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7e500b5ef0 tx=0x7f7e44009040 comp rx=0 tx=0).stop 2024-09-16T01:24:09.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.229+0000 7f7e58566640 1 -- 172.21.15.81:0/1669864679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500b6680 msgr2=0x7f7e500ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.229+0000 7f7e58566640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500b6680 0x7f7e500ca7b0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800c420 tx=0x7f7e4800c8e0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.229+0000 7f7e58566640 1 -- 172.21.15.81:0/1669864679 shutdown_connections 2024-09-16T01:24:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.229+0000 7f7e58566640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f7e3c06c2b0 0x7f7e3c06e770 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.229+0000 7f7e58566640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e50162060 0x7f7e5014f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.229+0000 7f7e58566640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e50161c80 0x7f7e500b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.229+0000 7f7e58566640 1 --2- 172.21.15.81:0/1669864679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e500b6680 0x7f7e500ca7b0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.229+0000 7f7e58566640 1 -- 172.21.15.81:0/1669864679 >> 172.21.15.81:0/1669864679 conn(0x7f7e500d44f0 msgr2=0x7f7e500b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.229+0000 7f7e58566640 1 -- 172.21.15.81:0/1669864679 shutdown_connections 2024-09-16T01:24:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.229+0000 7f7e58566640 1 -- 172.21.15.81:0/1669864679 wait complete. 2024-09-16T01:24:09.242 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:24:09.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.339+0000 7f08fd513640 1 Processor -- start 2024-09-16T01:24:09.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.339+0000 7f08fd513640 1 -- start start 2024-09-16T01:24:09.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08fd513640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f08f8161c80 0x7f08f806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08fd513640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08f80b6680 0x7f08f80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08fd513640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f806e870 con 0x7f08f8162060 2024-09-16T01:24:09.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08fd513640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f08f806d9f0 con 0x7f08f80b6680 2024-09-16T01:24:09.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08fd513640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f08f806dcd0 con 0x7f08f8161c80 2024-09-16T01:24:09.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08f77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08f80b6680 0x7f08f80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08f77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08f80b6680 0x7f08f80cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51460/0 (socket says 172.21.15.81:51460) 2024-09-16T01:24:09.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08f77fe640 1 -- 172.21.15.81:0/2855313901 learned_addr learned my addr 172.21.15.81:0/2855313901 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:09.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08f6ffd640 1 --2- 172.21.15.81:0/2855313901 >> v2:172.21.15.102:3300/0 conn(0x7f08f8161c80 0x7f08f806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08f77fe640 1 -- 172.21.15.81:0/2855313901 >> v2:172.21.15.102:3300/0 conn(0x7f08f8161c80 msgr2=0x7f08f806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:09.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08f77fe640 1 --2- 172.21.15.81:0/2855313901 >> v2:172.21.15.102:3300/0 conn(0x7f08f8161c80 0x7f08f806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08f77fe640 1 -- 172.21.15.81:0/2855313901 >> v1:172.21.15.102:6789/0 conn(0x7f08f8162060 legacy=0x7f08f80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:09.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.340+0000 7f08f77fe640 1 -- 172.21.15.81:0/2855313901 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f806dfb0 con 0x7f08f80b6680 2024-09-16T01:24:09.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.341+0000 7f08f77fe640 1 --2- 172.21.15.81:0/2855313901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f80b6680 0x7f08f80cf1e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f08f808d7a0 tx=0x7f08f002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93772eb69d5d470f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:09.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.341+0000 7f08f67fc640 1 -- 172.21.15.81:0/2855313901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f0036070 con 0x7f08f80b6680 2024-09-16T01:24:09.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.341+0000 7f08f67fc640 1 -- 172.21.15.81:0/2855313901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08f0031600 con 0x7f08f80b6680 2024-09-16T01:24:09.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.341+0000 7f08f67fc640 1 -- 172.21.15.81:0/2855313901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f00319d0 con 0x7f08f80b6680 2024-09-16T01:24:09.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.341+0000 7f08fd513640 1 -- 172.21.15.81:0/2855313901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f80b6680 msgr2=0x7f08f80cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.341+0000 7f08fd513640 1 --2- 172.21.15.81:0/2855313901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f80b6680 0x7f08f80cf1e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f08f808d7a0 tx=0x7f08f002a730 comp rx=0 tx=0).stop 2024-09-16T01:24:09.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.341+0000 7f08fd513640 1 -- 172.21.15.81:0/2855313901 shutdown_connections 2024-09-16T01:24:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.341+0000 7f08fd513640 1 --2- 172.21.15.81:0/2855313901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f80b6680 0x7f08f80cf1e0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.341+0000 7f08fd513640 1 --2- 172.21.15.81:0/2855313901 >> v2:172.21.15.102:3300/0 conn(0x7f08f8161c80 0x7f08f806e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.341+0000 7f08fd513640 1 -- 172.21.15.81:0/2855313901 >> 172.21.15.81:0/2855313901 conn(0x7f08f80d44f0 msgr2=0x7f08f80d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.342+0000 7f08fd513640 1 -- 172.21.15.81:0/2855313901 shutdown_connections 2024-09-16T01:24:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.342+0000 7f08fd513640 1 -- 172.21.15.81:0/2855313901 wait complete. 2024-09-16T01:24:09.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.343+0000 7f08fd513640 1 Processor -- start 2024-09-16T01:24:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.343+0000 7f08fd513640 1 -- start start 2024-09-16T01:24:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.343+0000 7f08fd513640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08f80b6680 0x7f08f8159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.343+0000 7f08fd513640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f8161c80 0x7f08f80b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08fd513640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f8162060 0x7f08f81f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08fd513640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f08f80b6b30 con 0x7f08f8161c80 2024-09-16T01:24:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08fd513640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f08f80d2aa0 con 0x7f08f8162060 2024-09-16T01:24:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08fd513640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f08f80b6cb0 con 0x7f08f80b6680 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08ee7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f8161c80 0x7f08f80b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08ee7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f8161c80 0x7f08f80b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51468/0 (socket says 172.21.15.81:51468) 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08ee7fc640 1 -- 172.21.15.81:0/3863285245 learned_addr learned my addr 172.21.15.81:0/3863285245 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08f77fe640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f8162060 0x7f08f81f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08f6ffd640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08f80b6680 0x7f08f8159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08ee7fc640 1 -- 172.21.15.81:0/3863285245 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08f80b6680 msgr2=0x7f08f8159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08ee7fc640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08f80b6680 0x7f08f8159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08ee7fc640 1 -- 172.21.15.81:0/3863285245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f8162060 msgr2=0x7f08f81f3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08ee7fc640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f8162060 0x7f08f81f3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08ee7fc640 1 -- 172.21.15.81:0/3863285245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f80b9ae0 con 0x7f08f8161c80 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08ee7fc640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f8161c80 0x7f08f80b3460 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c470 tx=0x7f08e0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08effff640 1 -- 172.21.15.81:0/3863285245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e00052d0 con 0x7f08f8161c80 2024-09-16T01:24:09.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08effff640 1 -- 172.21.15.81:0/3863285245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e0005470 con 0x7f08f8161c80 2024-09-16T01:24:09.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08fd513640 1 -- 172.21.15.81:0/3863285245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f80b39a0 con 0x7f08f8161c80 2024-09-16T01:24:09.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08effff640 1 -- 172.21.15.81:0/3863285245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0007260 con 0x7f08f8161c80 2024-09-16T01:24:09.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.344+0000 7f08fd513640 1 -- 172.21.15.81:0/3863285245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f80ba040 con 0x7f08f8161c80 2024-09-16T01:24:09.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.345+0000 7f08fd513640 1 -- 172.21.15.81:0/3863285245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f806e330 con 0x7f08f8161c80 2024-09-16T01:24:09.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.346+0000 7f08effff640 1 -- 172.21.15.81:0/3863285245 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f08e0007400 con 0x7f08f8161c80 2024-09-16T01:24:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.346+0000 7f08effff640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08d806c2b0 0x7f08d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.346+0000 7f08effff640 1 -- 172.21.15.81:0/3863285245 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7f08e008aa40 con 0x7f08f8161c80 2024-09-16T01:24:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.346+0000 7f08f6ffd640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08d806c2b0 0x7f08d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.347+0000 7f08f6ffd640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08d806c2b0 0x7f08d806e770 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f08e8006fd0 tx=0x7f08e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:09.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.350+0000 7f08effff640 1 -- 172.21.15.81:0/3863285245 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f08f80b9ae0 con 0x7f08f8161c80 2024-09-16T01:24:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.548+0000 7f08fd513640 1 -- 172.21.15.81:0/3863285245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08f81604c0 con 0x7f08f8161c80 2024-09-16T01:24:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.549+0000 7f08effff640 1 -- 172.21.15.81:0/3863285245 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5233 (secure 0 0 0) 0x7f08e008ae20 con 0x7f08f8161c80 2024-09-16T01:24:09.551 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:09.552 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"btime":"2024-09-16T01:24:03:062667+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1526547768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1526547768},{"type":"v1","addr":"172.21.15.102:6834","nonce":1526547768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1390834502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1390834502},{"type":"v1","addr":"172.21.15.102:6835","nonce":1390834502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1449155906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1449155906},{"type":"v1","addr":"172.21.15.81:6836","nonce":1449155906}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:24:00.383912+0000","modified":"2024-09-16T01:24:02.389045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8547":{"gid":8547,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3797465908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3797465908},{"type":"v1","addr":"172.21.15.81:6837","nonce":3797465908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8547,"qdb_cluster":[8547]},"id":11}]} 2024-09-16T01:24:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2024-09-16T01:24:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.551+0000 7f08fd513640 1 -- 172.21.15.81:0/3863285245 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08d806c2b0 msgr2=0x7f08d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.551+0000 7f08fd513640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08d806c2b0 0x7f08d806e770 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f08e8006fd0 tx=0x7f08e8008040 comp rx=0 tx=0).stop 2024-09-16T01:24:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.551+0000 7f08fd513640 1 -- 172.21.15.81:0/3863285245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f8161c80 msgr2=0x7f08f80b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.551+0000 7f08fd513640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f8161c80 0x7f08f80b3460 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f08e000c470 tx=0x7f08e0001e70 comp rx=0 tx=0).stop 2024-09-16T01:24:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.551+0000 7f08fd513640 1 -- 172.21.15.81:0/3863285245 shutdown_connections 2024-09-16T01:24:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.551+0000 7f08fd513640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f08d806c2b0 0x7f08d806e770 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.551+0000 7f08fd513640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08f8162060 0x7f08f81f3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.551+0000 7f08fd513640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f8161c80 0x7f08f80b3460 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.551+0000 7f08fd513640 1 --2- 172.21.15.81:0/3863285245 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08f80b6680 0x7f08f8159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.551+0000 7f08fd513640 1 -- 172.21.15.81:0/3863285245 >> 172.21.15.81:0/3863285245 conn(0x7f08f80d44f0 msgr2=0x7f08f80b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.551+0000 7f08fd513640 1 -- 172.21.15.81:0/3863285245 shutdown_connections 2024-09-16T01:24:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.551+0000 7f08fd513640 1 -- 172.21.15.81:0/3863285245 wait complete. 2024-09-16T01:24:09.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:24:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.660+0000 7f47d8103640 1 Processor -- start 2024-09-16T01:24:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.661+0000 7f47d8103640 1 -- start start 2024-09-16T01:24:09.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.661+0000 7f47d8103640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47d0161c80 0x7f47d006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.661+0000 7f47d8103640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f47d0162060 0x7f47d00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.661+0000 7f47d8103640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d006e870 con 0x7f47d00b64b0 2024-09-16T01:24:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.661+0000 7f47d8103640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f47d006d9f0 con 0x7f47d0162060 2024-09-16T01:24:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.661+0000 7f47d8103640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f47d006dcd0 con 0x7f47d0161c80 2024-09-16T01:24:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.662+0000 7f47d5e9f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47d0161c80 0x7f47d006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.662+0000 7f47d569e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f47d0162060 0x7f47d00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.662+0000 7f47d66a0640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f47d00b64b0 0x7f47d0162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:54922/0 (socket says 172.21.15.81:54922) 2024-09-16T01:24:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.662+0000 7f47d66a0640 1 -- 172.21.15.81:0/276128465 learned_addr learned my addr 172.21.15.81:0/276128465 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.662+0000 7f47d5e9f640 1 -- 172.21.15.81:0/276128465 >> v2:172.21.15.102:3300/0 conn(0x7f47d0162060 msgr2=0x7f47d00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.662+0000 7f47d5e9f640 1 --2- 172.21.15.81:0/276128465 >> v2:172.21.15.102:3300/0 conn(0x7f47d0162060 0x7f47d00b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.662+0000 7f47d5e9f640 1 -- 172.21.15.81:0/276128465 >> v1:172.21.15.102:6789/0 conn(0x7f47d00b64b0 legacy=0x7f47d0162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.662+0000 7f47d5e9f640 1 -- 172.21.15.81:0/276128465 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d006dfb0 con 0x7f47d0161c80 2024-09-16T01:24:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.663+0000 7f47d5e9f640 1 --2- 172.21.15.81:0/276128465 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47d0161c80 0x7f47d006e330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0097a0 tx=0x7f47cc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73caacda2f0b4408 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.663+0000 7f47d4e9d640 1 -- 172.21.15.81:0/276128465 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc037070 con 0x7f47d0161c80 2024-09-16T01:24:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.663+0000 7f47d4e9d640 1 -- 172.21.15.81:0/276128465 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47cc032440 con 0x7f47d0161c80 2024-09-16T01:24:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.663+0000 7f47d4e9d640 1 -- 172.21.15.81:0/276128465 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc032810 con 0x7f47d0161c80 2024-09-16T01:24:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.663+0000 7f47d8103640 1 -- 172.21.15.81:0/276128465 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47d0161c80 msgr2=0x7f47d006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.663+0000 7f47d8103640 1 --2- 172.21.15.81:0/276128465 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47d0161c80 0x7f47d006e330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47cc0097a0 tx=0x7f47cc02a180 comp rx=0 tx=0).stop 2024-09-16T01:24:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.663+0000 7f47d8103640 1 -- 172.21.15.81:0/276128465 shutdown_connections 2024-09-16T01:24:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.663+0000 7f47d8103640 1 --2- 172.21.15.81:0/276128465 >> v2:172.21.15.102:3300/0 conn(0x7f47d0162060 0x7f47d00b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.663+0000 7f47d8103640 1 --2- 172.21.15.81:0/276128465 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47d0161c80 0x7f47d006e330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.663+0000 7f47d8103640 1 -- 172.21.15.81:0/276128465 >> 172.21.15.81:0/276128465 conn(0x7f47d00d44f0 msgr2=0x7f47d00d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.664+0000 7f47d8103640 1 -- 172.21.15.81:0/276128465 shutdown_connections 2024-09-16T01:24:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.664+0000 7f47d8103640 1 -- 172.21.15.81:0/276128465 wait complete. 2024-09-16T01:24:09.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.665+0000 7f47d8103640 1 Processor -- start 2024-09-16T01:24:09.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.665+0000 7f47d8103640 1 -- start start 2024-09-16T01:24:09.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.665+0000 7f47d8103640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47d00b64b0 0x7f47d0155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.665+0000 7f47d8103640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0161c80 0x7f47d00b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.665+0000 7f47d8103640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47d0162060 0x7f47d015e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.665+0000 7f47d8103640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f47d00d2a10 con 0x7f47d0161c80 2024-09-16T01:24:09.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.665+0000 7f47d8103640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f47d00d2890 con 0x7f47d0162060 2024-09-16T01:24:09.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.665+0000 7f47d8103640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f47d00b6960 con 0x7f47d00b64b0 2024-09-16T01:24:09.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d569e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0161c80 0x7f47d00b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d569e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0161c80 0x7f47d00b8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51470/0 (socket says 172.21.15.81:51470) 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d569e640 1 -- 172.21.15.81:0/2116384543 learned_addr learned my addr 172.21.15.81:0/2116384543 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d66a0640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47d0162060 0x7f47d015e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d5e9f640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47d00b64b0 0x7f47d0155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d569e640 1 -- 172.21.15.81:0/2116384543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47d00b64b0 msgr2=0x7f47d0155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d569e640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47d00b64b0 0x7f47d0155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d569e640 1 -- 172.21.15.81:0/2116384543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47d0162060 msgr2=0x7f47d015e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d569e640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47d0162060 0x7f47d015e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d569e640 1 -- 172.21.15.81:0/2116384543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d00c87e0 con 0x7f47d0161c80 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d569e640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0161c80 0x7f47d00b8e00 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f47c000e870 tx=0x7f47c000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47c67fc640 1 -- 172.21.15.81:0/2116384543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0017070 con 0x7f47d0161c80 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47c67fc640 1 -- 172.21.15.81:0/2116384543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c000ee60 con 0x7f47d0161c80 2024-09-16T01:24:09.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d8103640 1 -- 172.21.15.81:0/2116384543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d00c8a80 con 0x7f47d0161c80 2024-09-16T01:24:09.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47c67fc640 1 -- 172.21.15.81:0/2116384543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c000cb40 con 0x7f47d0161c80 2024-09-16T01:24:09.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.666+0000 7f47d8103640 1 -- 172.21.15.81:0/2116384543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d00c9040 con 0x7f47d0161c80 2024-09-16T01:24:09.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.667+0000 7f47d8103640 1 -- 172.21.15.81:0/2116384543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d006e330 con 0x7f47d0161c80 2024-09-16T01:24:09.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.668+0000 7f47c67fc640 1 -- 172.21.15.81:0/2116384543 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f47c001a070 con 0x7f47d0161c80 2024-09-16T01:24:09.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.668+0000 7f47c67fc640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f47b406c2b0 0x7f47b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.668+0000 7f47c67fc640 1 -- 172.21.15.81:0/2116384543 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7f47c008b5e0 con 0x7f47d0161c80 2024-09-16T01:24:09.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.668+0000 7f47d5e9f640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f47b406c2b0 0x7f47b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.669+0000 7f47d5e9f640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f47b406c2b0 0x7f47b406e770 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f47cc034000 tx=0x7f47cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:09.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.672+0000 7f47c67fc640 1 -- 172.21.15.81:0/2116384543 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47c0059600 con 0x7f47d0161c80 2024-09-16T01:24:09.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.838+0000 7f47d8103640 1 -- 172.21.15.81:0/2116384543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47d00ba470 con 0x7f47d0161c80 2024-09-16T01:24:09.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.839+0000 7f47c67fc640 1 -- 172.21.15.81:0/2116384543 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) ==== 74+0+16944 (secure 0 0 0) 0x7f47c005d900 con 0x7f47d0161c80 2024-09-16T01:24:09.841 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:09.842 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":149,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:24:01.892632+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:23:59.008759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-16T01:23:59.360280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:24:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.841+0000 7f47d8103640 1 -- 172.21.15.81:0/2116384543 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f47b406c2b0 msgr2=0x7f47b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.841+0000 7f47d8103640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f47b406c2b0 0x7f47b406e770 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f47cc034000 tx=0x7f47cc02e000 comp rx=0 tx=0).stop 2024-09-16T01:24:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.842+0000 7f47d8103640 1 -- 172.21.15.81:0/2116384543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0161c80 msgr2=0x7f47d00b8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.842+0000 7f47d8103640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0161c80 0x7f47d00b8e00 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f47c000e870 tx=0x7f47c000ed30 comp rx=0 tx=0).stop 2024-09-16T01:24:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.842+0000 7f47d8103640 1 -- 172.21.15.81:0/2116384543 shutdown_connections 2024-09-16T01:24:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.842+0000 7f47d8103640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f47b406c2b0 0x7f47b406e770 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.842+0000 7f47d8103640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f47d0162060 0x7f47d015e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.842+0000 7f47d8103640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47d0161c80 0x7f47d00b8e00 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.842+0000 7f47d8103640 1 --2- 172.21.15.81:0/2116384543 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f47d00b64b0 0x7f47d0155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.842+0000 7f47d8103640 1 -- 172.21.15.81:0/2116384543 >> 172.21.15.81:0/2116384543 conn(0x7f47d00d44f0 msgr2=0x7f47d006ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:09.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.842+0000 7f47d8103640 1 -- 172.21.15.81:0/2116384543 shutdown_connections 2024-09-16T01:24:09.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.842+0000 7f47d8103640 1 -- 172.21.15.81:0/2116384543 wait complete. 2024-09-16T01:24:09.855 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:24:09.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:24:09.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:24:09.901 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:24:09.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.954+0000 7fdd74496640 1 Processor -- start 2024-09-16T01:24:09.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.954+0000 7fdd74496640 1 -- start start 2024-09-16T01:24:09.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.954+0000 7fdd74496640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd6c0d0be0 0x7fdd6c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.954+0000 7fdd74496640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd6c15d460 0x7fdd6c0afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.955+0000 7fdd74496640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6c0af720 con 0x7fdd6c145e00 2024-09-16T01:24:09.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.955+0000 7fdd74496640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fdd6c1461e0 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.955+0000 7fdd74496640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdd6c0cdf90 con 0x7fdd6c15d460 2024-09-16T01:24:09.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.955+0000 7fdd71a31640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd6c0d0be0 0x7fdd6c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.955+0000 7fdd71a31640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd6c0d0be0 0x7fdd6c0cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51482/0 (socket says 172.21.15.81:51482) 2024-09-16T01:24:09.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.955+0000 7fdd71a31640 1 -- 172.21.15.81:0/3435908852 learned_addr learned my addr 172.21.15.81:0/3435908852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:09.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.955+0000 7fdd72a33640 1 --2- 172.21.15.81:0/3435908852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd6c15d460 0x7fdd6c0afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.955+0000 7fdd71a31640 1 -- 172.21.15.81:0/3435908852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd6c15d460 msgr2=0x7fdd6c0afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:09.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.955+0000 7fdd71a31640 1 --2- 172.21.15.81:0/3435908852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd6c15d460 0x7fdd6c0afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.955+0000 7fdd71a31640 1 -- 172.21.15.81:0/3435908852 >> v1:172.21.15.102:6789/0 conn(0x7fdd6c145e00 legacy=0x7fdd6c0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.955+0000 7fdd71a31640 1 -- 172.21.15.81:0/3435908852 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c0ce270 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.956+0000 7fdd71a31640 1 --2- 172.21.15.81:0/3435908852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0d0be0 0x7fdd6c0cd8a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009e50 tx=0x7fdd6002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2efc081c0d015f96 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:09.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.956+0000 7fdd71230640 1 -- 172.21.15.81:0/3435908852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd60036070 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.956+0000 7fdd71230640 1 -- 172.21.15.81:0/3435908852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd60031600 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.956+0000 7fdd71230640 1 -- 172.21.15.81:0/3435908852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd600319d0 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.956+0000 7fdd74496640 1 -- 172.21.15.81:0/3435908852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0d0be0 msgr2=0x7fdd6c0cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.956+0000 7fdd74496640 1 --2- 172.21.15.81:0/3435908852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0d0be0 0x7fdd6c0cd8a0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009e50 tx=0x7fdd6002a710 comp rx=0 tx=0).stop 2024-09-16T01:24:09.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.957+0000 7fdd74496640 1 -- 172.21.15.81:0/3435908852 shutdown_connections 2024-09-16T01:24:09.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.957+0000 7fdd74496640 1 --2- 172.21.15.81:0/3435908852 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd6c15d460 0x7fdd6c0afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.957+0000 7fdd74496640 1 --2- 172.21.15.81:0/3435908852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0d0be0 0x7fdd6c0cd8a0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.957+0000 7fdd74496640 1 -- 172.21.15.81:0/3435908852 >> 172.21.15.81:0/3435908852 conn(0x7fdd6c0b2f40 msgr2=0x7fdd6c0b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:09.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.957+0000 7fdd74496640 1 -- 172.21.15.81:0/3435908852 shutdown_connections 2024-09-16T01:24:09.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.957+0000 7fdd74496640 1 -- 172.21.15.81:0/3435908852 wait complete. 2024-09-16T01:24:09.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.958+0000 7fdd74496640 1 Processor -- start 2024-09-16T01:24:09.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.958+0000 7fdd74496640 1 -- start start 2024-09-16T01:24:09.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.958+0000 7fdd74496640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0d0be0 0x7fdd6c1e8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.958+0000 7fdd74496640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd6c145e00 0x7fdd6c0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.958+0000 7fdd74496640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd6c15d460 0x7fdd6c155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.958+0000 7fdd74496640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c15d8b0 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.958+0000 7fdd74496640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c0ce830 con 0x7fdd6c145e00 2024-09-16T01:24:09.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.958+0000 7fdd74496640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdd6c0cede0 con 0x7fdd6c15d460 2024-09-16T01:24:09.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd72232640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0d0be0 0x7fdd6c1e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd72232640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0d0be0 0x7fdd6c1e8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51494/0 (socket says 172.21.15.81:51494) 2024-09-16T01:24:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd72232640 1 -- 172.21.15.81:0/270165149 learned_addr learned my addr 172.21.15.81:0/270165149 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd71a31640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd6c145e00 0x7fdd6c0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd72a33640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd6c15d460 0x7fdd6c155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd72232640 1 -- 172.21.15.81:0/270165149 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd6c15d460 msgr2=0x7fdd6c155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd72232640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd6c15d460 0x7fdd6c155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd72232640 1 -- 172.21.15.81:0/270165149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd6c145e00 msgr2=0x7fdd6c0ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd72232640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd6c145e00 0x7fdd6c0ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd72232640 1 -- 172.21.15.81:0/270165149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c15b020 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd72232640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0d0be0 0x7fdd6c1e8140 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400c430 tx=0x7fdd6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd6affd640 1 -- 172.21.15.81:0/270165149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64017070 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd6affd640 1 -- 172.21.15.81:0/270165149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd640052d0 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd74496640 1 -- 172.21.15.81:0/270165149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6c1e8680 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd6affd640 1 -- 172.21.15.81:0/270165149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64003850 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.959+0000 7fdd74496640 1 -- 172.21.15.81:0/270165149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6c15b2c0 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.960+0000 7fdd74496640 1 -- 172.21.15.81:0/270165149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd6c144400 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.961+0000 7fdd6affd640 1 -- 172.21.15.81:0/270165149 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdd6401a070 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.961+0000 7fdd6affd640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd5806c2b0 0x7fdd5806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.961+0000 7fdd6affd640 1 -- 172.21.15.81:0/270165149 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7fdd6408a810 con 0x7fdd6c0d0be0 2024-09-16T01:24:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.961+0000 7fdd71a31640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd5806c2b0 0x7fdd5806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.962+0000 7fdd71a31640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd5806c2b0 0x7fdd5806e770 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdd60033000 tx=0x7fdd60009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:09.965+0000 7fdd6affd640 1 -- 172.21.15.81:0/270165149 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd6c144400 con 0x7fdd6c0d0be0 2024-09-16T01:24:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.168+0000 7fdd74496640 1 -- 172.21.15.81:0/270165149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd6c0cd8a0 con 0x7fdd6c0d0be0 2024-09-16T01:24:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.168+0000 7fdd6affd640 1 -- 172.21.15.81:0/270165149 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5233 (secure 0 0 0) 0x7fdd64058830 con 0x7fdd6c0d0be0 2024-09-16T01:24:10.170 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:10.171 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"btime":"2024-09-16T01:24:03:062667+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1526547768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1526547768},{"type":"v1","addr":"172.21.15.102:6834","nonce":1526547768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1390834502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1390834502},{"type":"v1","addr":"172.21.15.102:6835","nonce":1390834502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1449155906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1449155906},{"type":"v1","addr":"172.21.15.81:6836","nonce":1449155906}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:24:00.383912+0000","modified":"2024-09-16T01:24:02.389045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8547":{"gid":8547,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3797465908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3797465908},{"type":"v1","addr":"172.21.15.81:6837","nonce":3797465908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8547,"qdb_cluster":[8547]},"id":11}]} 2024-09-16T01:24:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2024-09-16T01:24:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.170+0000 7fdd74496640 1 -- 172.21.15.81:0/270165149 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd5806c2b0 msgr2=0x7fdd5806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.170+0000 7fdd74496640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd5806c2b0 0x7fdd5806e770 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fdd60033000 tx=0x7fdd60009000 comp rx=0 tx=0).stop 2024-09-16T01:24:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.170+0000 7fdd74496640 1 -- 172.21.15.81:0/270165149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0d0be0 msgr2=0x7fdd6c1e8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.171+0000 7fdd74496640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0d0be0 0x7fdd6c1e8140 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400c430 tx=0x7fdd6400c8f0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.171+0000 7fdd74496640 1 -- 172.21.15.81:0/270165149 shutdown_connections 2024-09-16T01:24:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.171+0000 7fdd74496640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fdd5806c2b0 0x7fdd5806e770 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.171+0000 7fdd74496640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdd6c15d460 0x7fdd6c155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.171+0000 7fdd74496640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd6c145e00 0x7fdd6c0ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.171+0000 7fdd74496640 1 --2- 172.21.15.81:0/270165149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd6c0d0be0 0x7fdd6c1e8140 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.171+0000 7fdd74496640 1 -- 172.21.15.81:0/270165149 >> 172.21.15.81:0/270165149 conn(0x7fdd6c0b2f40 msgr2=0x7fdd6c1437b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.171+0000 7fdd74496640 1 -- 172.21.15.81:0/270165149 shutdown_connections 2024-09-16T01:24:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.171+0000 7fdd74496640 1 -- 172.21.15.81:0/270165149 wait complete. 2024-09-16T01:24:10.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:24:10.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.321+0000 7f3865f91640 1 Processor -- start 2024-09-16T01:24:10.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.321+0000 7f3865f91640 1 -- start start 2024-09-16T01:24:10.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f3865f91640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3860072320 0x7f38600cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f3865f91640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3860072de0 0x7f386006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f3865f91640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3860146140 con 0x7f3860072700 2024-09-16T01:24:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f3865f91640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f38600cd740 con 0x7f3860072320 2024-09-16T01:24:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f3865f91640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f38600cda20 con 0x7f3860072de0 2024-09-16T01:24:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f385f7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3860072320 0x7f38600cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f3857fff640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3860072de0 0x7f386006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f385ffff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3860072700 0x7f386006e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:54934/0 (socket says 172.21.15.81:54934) 2024-09-16T01:24:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f385ffff640 1 -- 172.21.15.81:0/3911006532 learned_addr learned my addr 172.21.15.81:0/3911006532 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f385f7fe640 1 -- 172.21.15.81:0/3911006532 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3860072de0 msgr2=0x7f386006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f385f7fe640 1 --2- 172.21.15.81:0/3911006532 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3860072de0 0x7f386006e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f385f7fe640 1 -- 172.21.15.81:0/3911006532 >> v1:172.21.15.102:6789/0 conn(0x7f3860072700 legacy=0x7f386006e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f385effd640 1 -- 172.21.15.81:0/3911006532 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224851584 0 0) 0x7f3860146140 con 0x7f3860072700 2024-09-16T01:24:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f385f7fe640 1 -- 172.21.15.81:0/3911006532 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38600cdd00 con 0x7f3860072320 2024-09-16T01:24:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.322+0000 7f3857fff640 1 --2- 172.21.15.81:0/3911006532 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3860072de0 0x7f386006e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.323+0000 7f385f7fe640 1 --2- 172.21.15.81:0/3911006532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3860072320 0x7f38600cce60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f38500097a0 tx=0x7f385002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=796d19b76db41a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.323+0000 7f385effd640 1 -- 172.21.15.81:0/3911006532 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850037070 con 0x7f3860072320 2024-09-16T01:24:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.323+0000 7f385effd640 1 -- 172.21.15.81:0/3911006532 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385002ae50 con 0x7f3860072320 2024-09-16T01:24:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.323+0000 7f385effd640 1 -- 172.21.15.81:0/3911006532 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850032660 con 0x7f3860072320 2024-09-16T01:24:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.324+0000 7f3865f91640 1 -- 172.21.15.81:0/3911006532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3860072320 msgr2=0x7f38600cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.324+0000 7f3865f91640 1 --2- 172.21.15.81:0/3911006532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3860072320 0x7f38600cce60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f38500097a0 tx=0x7f385002a100 comp rx=0 tx=0).stop 2024-09-16T01:24:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.324+0000 7f3865f91640 1 -- 172.21.15.81:0/3911006532 shutdown_connections 2024-09-16T01:24:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.324+0000 7f3865f91640 1 --2- 172.21.15.81:0/3911006532 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3860072de0 0x7f386006e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.324+0000 7f3865f91640 1 --2- 172.21.15.81:0/3911006532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3860072320 0x7f38600cce60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.324+0000 7f3865f91640 1 -- 172.21.15.81:0/3911006532 >> 172.21.15.81:0/3911006532 conn(0x7f3860067d70 msgr2=0x7f386006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.324+0000 7f3865f91640 1 -- 172.21.15.81:0/3911006532 shutdown_connections 2024-09-16T01:24:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.324+0000 7f3865f91640 1 -- 172.21.15.81:0/3911006532 wait complete. 2024-09-16T01:24:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.325+0000 7f3865f91640 1 Processor -- start 2024-09-16T01:24:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.325+0000 7f3865f91640 1 -- start start 2024-09-16T01:24:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f3865f91640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3860072320 0x7f386015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f3865f91640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3860072700 0x7f38600abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f3865f91640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3860072de0 0x7f38600ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f3865f91640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38600cd520 con 0x7f3860072320 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f3865f91640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f38600cd3a0 con 0x7f3860072de0 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f3865f91640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f386006ed00 con 0x7f3860072700 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f385f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3860072320 0x7f386015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f385f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3860072320 0x7f386015bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51506/0 (socket says 172.21.15.81:51506) 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f385f7fe640 1 -- 172.21.15.81:0/874199761 learned_addr learned my addr 172.21.15.81:0/874199761 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f3857fff640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3860072700 0x7f38600abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f385ffff640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3860072de0 0x7f38600ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f385f7fe640 1 -- 172.21.15.81:0/874199761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3860072700 msgr2=0x7f38600abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f385f7fe640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3860072700 0x7f38600abf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f385f7fe640 1 -- 172.21.15.81:0/874199761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3860072de0 msgr2=0x7f38600ac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f385f7fe640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3860072de0 0x7f38600ac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f385f7fe640 1 -- 172.21.15.81:0/874199761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3860137cf0 con 0x7f3860072320 2024-09-16T01:24:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.326+0000 7f3857fff640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3860072700 0x7f38600abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.327+0000 7f385f7fe640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3860072320 0x7f386015bec0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f38500097a0 tx=0x7f38500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.327+0000 7f385cff9640 1 -- 172.21.15.81:0/874199761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850037040 con 0x7f3860072320 2024-09-16T01:24:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.327+0000 7f385cff9640 1 -- 172.21.15.81:0/874199761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3850004030 con 0x7f3860072320 2024-09-16T01:24:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.327+0000 7f385cff9640 1 -- 172.21.15.81:0/874199761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3850004420 con 0x7f3860072320 2024-09-16T01:24:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.327+0000 7f3865f91640 1 -- 172.21.15.81:0/874199761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38600acaf0 con 0x7f3860072320 2024-09-16T01:24:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.327+0000 7f3865f91640 1 -- 172.21.15.81:0/874199761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38600ad0b0 con 0x7f3860072320 2024-09-16T01:24:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.328+0000 7f3865f91640 1 -- 172.21.15.81:0/874199761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38600cce60 con 0x7f3860072320 2024-09-16T01:24:10.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.328+0000 7f385cff9640 1 -- 172.21.15.81:0/874199761 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3850003610 con 0x7f3860072320 2024-09-16T01:24:10.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.329+0000 7f385cff9640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f384006c2b0 0x7f384006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.329+0000 7f385cff9640 1 -- 172.21.15.81:0/874199761 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7f38500ac240 con 0x7f3860072320 2024-09-16T01:24:10.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.329+0000 7f3857fff640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f384006c2b0 0x7f384006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.329+0000 7f3857fff640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f384006c2b0 0x7f384006e770 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f38601f69a0 tx=0x7f3848009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.333+0000 7f385cff9640 1 -- 172.21.15.81:0/874199761 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f385007a380 con 0x7f3860072320 2024-09-16T01:24:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.531+0000 7f3865f91640 1 -- 172.21.15.81:0/874199761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f38600c8bd0 con 0x7f3860072320 2024-09-16T01:24:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.532+0000 7f385cff9640 1 -- 172.21.15.81:0/874199761 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5233 (secure 0 0 0) 0x7f385007e680 con 0x7f3860072320 2024-09-16T01:24:10.534 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:10.534 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"btime":"2024-09-16T01:24:03:062667+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1526547768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1526547768},{"type":"v1","addr":"172.21.15.102:6834","nonce":1526547768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1390834502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1390834502},{"type":"v1","addr":"172.21.15.102:6835","nonce":1390834502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1449155906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1449155906},{"type":"v1","addr":"172.21.15.81:6836","nonce":1449155906}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T01:24:00.383912+0000","modified":"2024-09-16T01:24:02.389045+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8547":{"gid":8547,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3797465908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3797465908},{"type":"v1","addr":"172.21.15.81:6837","nonce":3797465908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8547,"qdb_cluster":[8547]},"id":11}]} 2024-09-16T01:24:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 83 2024-09-16T01:24:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.534+0000 7f3865f91640 1 -- 172.21.15.81:0/874199761 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f384006c2b0 msgr2=0x7f384006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.534+0000 7f3865f91640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f384006c2b0 0x7f384006e770 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f38601f69a0 tx=0x7f3848009190 comp rx=0 tx=0).stop 2024-09-16T01:24:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.534+0000 7f3865f91640 1 -- 172.21.15.81:0/874199761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3860072320 msgr2=0x7f386015bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.534+0000 7f3865f91640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3860072320 0x7f386015bec0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f38500097a0 tx=0x7f38500046c0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.534+0000 7f3865f91640 1 -- 172.21.15.81:0/874199761 shutdown_connections 2024-09-16T01:24:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.534+0000 7f3865f91640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f384006c2b0 0x7f384006e770 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.534+0000 7f3865f91640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3860072de0 0x7f38600ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.534+0000 7f3865f91640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3860072700 0x7f38600abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.534+0000 7f3865f91640 1 --2- 172.21.15.81:0/874199761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3860072320 0x7f386015bec0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.534+0000 7f3865f91640 1 -- 172.21.15.81:0/874199761 >> 172.21.15.81:0/874199761 conn(0x7f3860067d70 msgr2=0x7f386006e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.534+0000 7f3865f91640 1 -- 172.21.15.81:0/874199761 shutdown_connections 2024-09-16T01:24:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.534+0000 7f3865f91640 1 -- 172.21.15.81:0/874199761 wait complete. 2024-09-16T01:24:10.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:24:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.643+0000 7f8168d11640 1 Processor -- start 2024-09-16T01:24:10.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.643+0000 7f8168d11640 1 -- start start 2024-09-16T01:24:10.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f8168d11640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f816415c490 0x7f816409b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f8168d11640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f816409b980 0x7f816415c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f8168d11640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81640d01c0 con 0x7f816415cdb0 2024-09-16T01:24:10.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f8168d11640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f81640cff70 con 0x7f816415c490 2024-09-16T01:24:10.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f8168d11640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f81640d0dd0 con 0x7f816409b980 2024-09-16T01:24:10.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f816259c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f816415c490 0x7f816409b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f8162d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f816415cdb0 0x7f816415ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54224/0 (socket says 172.21.15.81:54224) 2024-09-16T01:24:10.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f8162d9d640 1 -- 172.21.15.81:0/3401881952 learned_addr learned my addr 172.21.15.81:0/3401881952 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f8161d9b640 1 --2- 172.21.15.81:0/3401881952 >> v2:172.21.15.102:3300/0 conn(0x7f816409b980 0x7f816415c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f816259c640 1 -- 172.21.15.81:0/3401881952 >> v2:172.21.15.102:3300/0 conn(0x7f816409b980 msgr2=0x7f816415c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f816259c640 1 --2- 172.21.15.81:0/3401881952 >> v2:172.21.15.102:3300/0 conn(0x7f816409b980 0x7f816415c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f816259c640 1 -- 172.21.15.81:0/3401881952 >> v1:172.21.15.81:6789/0 conn(0x7f816415cdb0 legacy=0x7f816415ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f816159a640 1 -- 172.21.15.81:0/3401881952 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3971348591 0 0) 0x7f81640d01c0 con 0x7f816415cdb0 2024-09-16T01:24:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.644+0000 7f816259c640 1 -- 172.21.15.81:0/3401881952 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81640d04a0 con 0x7f816415c490 2024-09-16T01:24:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.645+0000 7f816259c640 1 --2- 172.21.15.81:0/3401881952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816415c490 0x7f816409b440 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f8164074070 tx=0x7f815402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd5b488d12b0914 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.645+0000 7f816159a640 1 -- 172.21.15.81:0/3401881952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154037070 con 0x7f816415c490 2024-09-16T01:24:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.645+0000 7f816159a640 1 -- 172.21.15.81:0/3401881952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8154032440 con 0x7f816415c490 2024-09-16T01:24:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.645+0000 7f816159a640 1 -- 172.21.15.81:0/3401881952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154032810 con 0x7f816415c490 2024-09-16T01:24:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.645+0000 7f8168d11640 1 -- 172.21.15.81:0/3401881952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816415c490 msgr2=0x7f816409b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.645+0000 7f8168d11640 1 --2- 172.21.15.81:0/3401881952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816415c490 0x7f816409b440 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f8164074070 tx=0x7f815402a230 comp rx=0 tx=0).stop 2024-09-16T01:24:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.646+0000 7f8168d11640 1 -- 172.21.15.81:0/3401881952 shutdown_connections 2024-09-16T01:24:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.646+0000 7f8168d11640 1 --2- 172.21.15.81:0/3401881952 >> v2:172.21.15.102:3300/0 conn(0x7f816409b980 0x7f816415c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.646+0000 7f8168d11640 1 --2- 172.21.15.81:0/3401881952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816415c490 0x7f816409b440 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.646+0000 7f8168d11640 1 -- 172.21.15.81:0/3401881952 >> 172.21.15.81:0/3401881952 conn(0x7f81640d23a0 msgr2=0x7f81640d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.646+0000 7f8168d11640 1 -- 172.21.15.81:0/3401881952 shutdown_connections 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.646+0000 7f8168d11640 1 -- 172.21.15.81:0/3401881952 wait complete. 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.647+0000 7f8168d11640 1 Processor -- start 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.647+0000 7f8168d11640 1 -- start start 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8168d11640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f816409b980 0x7f816406d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8168d11640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f816415c490 0x7f8164157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8168d11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816415cdb0 0x7f81640b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8168d11640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f81640cdfa0 con 0x7f816415cdb0 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8168d11640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81640d0a60 con 0x7f816409b980 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8168d11640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f81640d1260 con 0x7f816415c490 2024-09-16T01:24:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8162d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816415cdb0 0x7f81640b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8162d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816415cdb0 0x7f81640b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51518/0 (socket says 172.21.15.81:51518) 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8162d9d640 1 -- 172.21.15.81:0/785089933 learned_addr learned my addr 172.21.15.81:0/785089933 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f816259c640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f816409b980 0x7f816406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8161d9b640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f816415c490 0x7f8164157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8162d9d640 1 -- 172.21.15.81:0/785089933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f816415c490 msgr2=0x7f8164157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8162d9d640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f816415c490 0x7f8164157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8162d9d640 1 -- 172.21.15.81:0/785089933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f816409b980 msgr2=0x7f816406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8162d9d640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f816409b980 0x7f816406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8162d9d640 1 -- 172.21.15.81:0/785089933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81640ca850 con 0x7f816415cdb0 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8162d9d640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816415cdb0 0x7f81640b00c0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f815c00c700 tx=0x7f815c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8152ffd640 1 -- 172.21.15.81:0/785089933 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c018070 con 0x7f816415cdb0 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8152ffd640 1 -- 172.21.15.81:0/785089933 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815c00ce10 con 0x7f816415cdb0 2024-09-16T01:24:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8168d11640 1 -- 172.21.15.81:0/785089933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81641581f0 con 0x7f816415cdb0 2024-09-16T01:24:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8152ffd640 1 -- 172.21.15.81:0/785089933 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c00a860 con 0x7f816415cdb0 2024-09-16T01:24:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.648+0000 7f8168d11640 1 -- 172.21.15.81:0/785089933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f816406ce50 con 0x7f816415cdb0 2024-09-16T01:24:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.649+0000 7f8168d11640 1 -- 172.21.15.81:0/785089933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81640d01c0 con 0x7f816415cdb0 2024-09-16T01:24:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.650+0000 7f8152ffd640 1 -- 172.21.15.81:0/785089933 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f815c01b070 con 0x7f816415cdb0 2024-09-16T01:24:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.650+0000 7f8152ffd640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f814406c2b0 0x7f814406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.650+0000 7f8152ffd640 1 -- 172.21.15.81:0/785089933 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7f815c08aa00 con 0x7f816415cdb0 2024-09-16T01:24:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.650+0000 7f816259c640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f814406c2b0 0x7f814406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.651+0000 7f816259c640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f814406c2b0 0x7f814406e770 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8154034000 tx=0x7f815402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.655+0000 7f8152ffd640 1 -- 172.21.15.81:0/785089933 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f815c058a20 con 0x7f816415cdb0 2024-09-16T01:24:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.821+0000 7f8168d11640 1 -- 172.21.15.81:0/785089933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81640d3190 con 0x7f816415cdb0 2024-09-16T01:24:10.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.822+0000 7f8152ffd640 1 -- 172.21.15.81:0/785089933 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) ==== 74+0+16944 (secure 0 0 0) 0x7f815c05cd20 con 0x7f816415cdb0 2024-09-16T01:24:10.824 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:10.824 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":149,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:24:01.892632+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2024-09-16T01:23:59.008759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2024-09-16T01:23:59.360280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:24:10.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.824+0000 7f8168d11640 1 -- 172.21.15.81:0/785089933 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f814406c2b0 msgr2=0x7f814406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.824+0000 7f8168d11640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f814406c2b0 0x7f814406e770 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8154034000 tx=0x7f815402e000 comp rx=0 tx=0).stop 2024-09-16T01:24:10.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.824+0000 7f8168d11640 1 -- 172.21.15.81:0/785089933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816415cdb0 msgr2=0x7f81640b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.824+0000 7f8168d11640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816415cdb0 0x7f81640b00c0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f815c00c700 tx=0x7f815c00cbc0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.824+0000 7f8168d11640 1 -- 172.21.15.81:0/785089933 shutdown_connections 2024-09-16T01:24:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.824+0000 7f8168d11640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f814406c2b0 0x7f814406e770 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.824+0000 7f8168d11640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f816415cdb0 0x7f81640b00c0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.824+0000 7f8168d11640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f816415c490 0x7f8164157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.824+0000 7f8168d11640 1 --2- 172.21.15.81:0/785089933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f816409b980 0x7f816406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.824+0000 7f8168d11640 1 -- 172.21.15.81:0/785089933 >> 172.21.15.81:0/785089933 conn(0x7f81640d23a0 msgr2=0x7f8164070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.824+0000 7f8168d11640 1 -- 172.21.15.81:0/785089933 shutdown_connections 2024-09-16T01:24:10.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.824+0000 7f8168d11640 1 -- 172.21.15.81:0/785089933 wait complete. 2024-09-16T01:24:10.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-16T01:24:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.934+0000 7f3da8465640 1 Processor -- start 2024-09-16T01:24:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.934+0000 7f3da8465640 1 -- start start 2024-09-16T01:24:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.935+0000 7f3da8465640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da00b69d0 0x7f3da0162a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.935+0000 7f3da8465640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3da00af280 0x7f3da00afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.935+0000 7f3da8465640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da015eb60 con 0x7f3da00affb0 2024-09-16T01:24:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.935+0000 7f3da8465640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3da00b6db0 con 0x7f3da00af280 2024-09-16T01:24:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.935+0000 7f3da8465640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3da015ee40 con 0x7f3da00b69d0 2024-09-16T01:24:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.936+0000 7f3da5a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3da00af280 0x7f3da00afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.936+0000 7f3da6a02640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3da00affb0 0x7f3da0154d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54228/0 (socket says 172.21.15.81:54228) 2024-09-16T01:24:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.936+0000 7f3da6a02640 1 -- 172.21.15.81:0/647164765 learned_addr learned my addr 172.21.15.81:0/647164765 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.936+0000 7f3da6201640 1 --2- 172.21.15.81:0/647164765 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da00b69d0 0x7f3da0162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.936+0000 7f3da51ff640 1 -- 172.21.15.81:0/647164765 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321760037 0 0) 0x7f3da015eb60 con 0x7f3da00affb0 2024-09-16T01:24:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.936+0000 7f3da51ff640 1 -- 172.21.15.81:0/647164765 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d8c003520 con 0x7f3da00affb0 2024-09-16T01:24:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.936+0000 7f3da5a00640 1 -- 172.21.15.81:0/647164765 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da00b69d0 msgr2=0x7f3da0162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.936+0000 7f3da5a00640 1 --2- 172.21.15.81:0/647164765 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da00b69d0 0x7f3da0162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.936+0000 7f3da5a00640 1 -- 172.21.15.81:0/647164765 >> v1:172.21.15.81:6789/0 conn(0x7f3da00affb0 legacy=0x7f3da0154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.936+0000 7f3da5a00640 1 -- 172.21.15.81:0/647164765 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da015f120 con 0x7f3da00af280 2024-09-16T01:24:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.936+0000 7f3da6201640 1 --2- 172.21.15.81:0/647164765 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da00b69d0 0x7f3da0162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.937+0000 7f3da5a00640 1 --2- 172.21.15.81:0/647164765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da00af280 0x7f3da00afa70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3d900097d0 tx=0x7f3d9002a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c16f2f98cf82227c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.937+0000 7f3da51ff640 1 -- 172.21.15.81:0/647164765 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90037070 con 0x7f3da00af280 2024-09-16T01:24:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.937+0000 7f3da51ff640 1 -- 172.21.15.81:0/647164765 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9002adb0 con 0x7f3da00af280 2024-09-16T01:24:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.937+0000 7f3da51ff640 1 -- 172.21.15.81:0/647164765 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90032640 con 0x7f3da00af280 2024-09-16T01:24:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.938+0000 7f3da8465640 1 -- 172.21.15.81:0/647164765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da00af280 msgr2=0x7f3da00afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.938+0000 7f3da8465640 1 --2- 172.21.15.81:0/647164765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da00af280 0x7f3da00afa70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3d900097d0 tx=0x7f3d9002a0a0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.938+0000 7f3da8465640 1 -- 172.21.15.81:0/647164765 shutdown_connections 2024-09-16T01:24:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.938+0000 7f3da8465640 1 --2- 172.21.15.81:0/647164765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da00af280 0x7f3da00afa70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.938+0000 7f3da8465640 1 --2- 172.21.15.81:0/647164765 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da00b69d0 0x7f3da0162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.938+0000 7f3da8465640 1 -- 172.21.15.81:0/647164765 >> 172.21.15.81:0/647164765 conn(0x7f3da006bc10 msgr2=0x7f3da006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.938+0000 7f3da8465640 1 -- 172.21.15.81:0/647164765 shutdown_connections 2024-09-16T01:24:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.938+0000 7f3da8465640 1 -- 172.21.15.81:0/647164765 wait complete. 2024-09-16T01:24:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.939+0000 7f3da8465640 1 Processor -- start 2024-09-16T01:24:10.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.939+0000 7f3da8465640 1 -- start start 2024-09-16T01:24:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da8465640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da00af280 0x7f3da0159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da8465640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da00affb0 0x7f3da01539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da8465640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da00b69d0 0x7f3da015b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da8465640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3da0155410 con 0x7f3da00af280 2024-09-16T01:24:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da8465640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3da00af6e0 con 0x7f3da00affb0 2024-09-16T01:24:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da8465640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3da0155590 con 0x7f3da00b69d0 2024-09-16T01:24:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da6201640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da00af280 0x7f3da0159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da6201640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da00af280 0x7f3da0159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51530/0 (socket says 172.21.15.81:51530) 2024-09-16T01:24:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da6201640 1 -- 172.21.15.81:0/726576352 learned_addr learned my addr 172.21.15.81:0/726576352 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da5a00640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da00affb0 0x7f3da01539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da6a02640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da00b69d0 0x7f3da015b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da6201640 1 -- 172.21.15.81:0/726576352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da00b69d0 msgr2=0x7f3da015b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da6201640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da00b69d0 0x7f3da015b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da6201640 1 -- 172.21.15.81:0/726576352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da00affb0 msgr2=0x7f3da01539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da6201640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da00affb0 0x7f3da01539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da6201640 1 -- 172.21.15.81:0/726576352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da01595c0 con 0x7f3da00af280 2024-09-16T01:24:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da5a00640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da00affb0 0x7f3da01539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:10.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da6201640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da00af280 0x7f3da0159080 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00d800 tx=0x7f3d9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3d96ffd640 1 -- 172.21.15.81:0/726576352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c004030 con 0x7f3da00af280 2024-09-16T01:24:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3d96ffd640 1 -- 172.21.15.81:0/726576352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9c0041d0 con 0x7f3da00af280 2024-09-16T01:24:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3d96ffd640 1 -- 172.21.15.81:0/726576352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c009640 con 0x7f3da00af280 2024-09-16T01:24:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.940+0000 7f3da8465640 1 -- 172.21.15.81:0/726576352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da0159860 con 0x7f3da00af280 2024-09-16T01:24:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.941+0000 7f3da8465640 1 -- 172.21.15.81:0/726576352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da015a100 con 0x7f3da00af280 2024-09-16T01:24:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.941+0000 7f3da8465640 1 -- 172.21.15.81:0/726576352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da0159c50 con 0x7f3da00af280 2024-09-16T01:24:10.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.942+0000 7f3d96ffd640 1 -- 172.21.15.81:0/726576352 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3d9c0097e0 con 0x7f3da00af280 2024-09-16T01:24:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.942+0000 7f3d96ffd640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3d8406c2b0 0x7f3d8406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.942+0000 7f3d96ffd640 1 -- 172.21.15.81:0/726576352 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 6101+0+0 (secure 0 0 0) 0x7f3d9c08b810 con 0x7f3da00af280 2024-09-16T01:24:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.942+0000 7f3da5a00640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3d8406c2b0 0x7f3d8406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.943+0000 7f3da5a00640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3d8406c2b0 0x7f3d8406e770 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3d90034000 tx=0x7f3d9002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:10.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:10.947+0000 7f3d96ffd640 1 -- 172.21.15.81:0/726576352 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d9c059df0 con 0x7f3da00af280 2024-09-16T01:24:11.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.150+0000 7f3da8465640 1 -- 172.21.15.81:0/726576352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3da00aeeb0 con 0x7f3da00af280 2024-09-16T01:24:11.152 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-16T01:24:11.151+0000 7f4e951a0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T01:24:11.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.152+0000 7f3d96ffd640 1 -- 172.21.15.81:0/726576352 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) ==== 161+0+0 (secure 0 0 0) 0x7f3d9c0596f0 con 0x7f3da00af280 2024-09-16T01:24:11.154 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-16T01:24:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.155+0000 7f3da8465640 1 -- 172.21.15.81:0/726576352 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3d8406c2b0 msgr2=0x7f3d8406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.155+0000 7f3da8465640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3d8406c2b0 0x7f3d8406e770 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3d90034000 tx=0x7f3d9002e000 comp rx=0 tx=0).stop 2024-09-16T01:24:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.155+0000 7f3da8465640 1 -- 172.21.15.81:0/726576352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da00af280 msgr2=0x7f3da0159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.155+0000 7f3da8465640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da00af280 0x7f3da0159080 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c00d800 tx=0x7f3d9c00dcc0 comp rx=0 tx=0).stop 2024-09-16T01:24:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.155+0000 7f3da8465640 1 -- 172.21.15.81:0/726576352 shutdown_connections 2024-09-16T01:24:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.155+0000 7f3da8465640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3d8406c2b0 0x7f3d8406e770 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.155+0000 7f3da8465640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3da00b69d0 0x7f3da015b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.155+0000 7f3da8465640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3da00affb0 0x7f3da01539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.155+0000 7f3da8465640 1 --2- 172.21.15.81:0/726576352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3da00af280 0x7f3da0159080 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.155+0000 7f3da8465640 1 -- 172.21.15.81:0/726576352 >> 172.21.15.81:0/726576352 conn(0x7f3da006bc10 msgr2=0x7f3da006f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.155+0000 7f3da8465640 1 -- 172.21.15.81:0/726576352 shutdown_connections 2024-09-16T01:24:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.155+0000 7f3da8465640 1 -- 172.21.15.81:0/726576352 wait complete. 2024-09-16T01:24:11.158 INFO:tasks.ceph.mds.a.smithi081.stderr: -2006> 2024-09-16T01:24:02.307+0000 7f6358ce3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-16T01:24:11.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-16T01:24:11.187 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-16T01:24:11.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.270+0000 7f9fd29f1640 1 Processor -- start 2024-09-16T01:24:11.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.270+0000 7f9fd29f1640 1 -- start start 2024-09-16T01:24:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.271+0000 7f9fd29f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fcc15e760 0x7f9fcc0b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.271+0000 7f9fd29f1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9fcc070110 0x7f9fcc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.271+0000 7f9fd29f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fcc0b4a50 con 0x7f9fcc0705c0 2024-09-16T01:24:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.271+0000 7f9fd29f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9fcc0b5ea0 con 0x7f9fcc15e760 2024-09-16T01:24:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.271+0000 7f9fd29f1640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9fcc0710d0 con 0x7f9fcc070110 2024-09-16T01:24:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.271+0000 7f9fcbfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fcc15e760 0x7f9fcc0b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.271+0000 7f9fcb7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9fcc0705c0 0x7f9fcc06fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37420/0 (socket says 172.21.15.81:37420) 2024-09-16T01:24:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.271+0000 7f9fcb7fe640 1 -- 172.21.15.81:0/924095227 learned_addr learned my addr 172.21.15.81:0/924095227 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.272+0000 7f9fd0f8e640 1 --2- 172.21.15.81:0/924095227 >> v2:172.21.15.102:3300/0 conn(0x7f9fcc070110 0x7f9fcc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.272+0000 7f9fcbfff640 1 -- 172.21.15.81:0/924095227 >> v2:172.21.15.102:3300/0 conn(0x7f9fcc070110 msgr2=0x7f9fcc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.272+0000 7f9fcbfff640 1 --2- 172.21.15.81:0/924095227 >> v2:172.21.15.102:3300/0 conn(0x7f9fcc070110 0x7f9fcc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.272+0000 7f9fcbfff640 1 -- 172.21.15.81:0/924095227 >> v1:172.21.15.81:6789/0 conn(0x7f9fcc0705c0 legacy=0x7f9fcc06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.272+0000 7f9fcaffd640 1 -- 172.21.15.81:0/924095227 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2205212931 0 0) 0x7f9fcc0b4a50 con 0x7f9fcc0705c0 2024-09-16T01:24:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.272+0000 7f9fcbfff640 1 -- 172.21.15.81:0/924095227 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc070b10 con 0x7f9fcc15e760 2024-09-16T01:24:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.272+0000 7f9fcbfff640 1 --2- 172.21.15.81:0/924095227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc15e760 0x7f9fcc0b6310 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0d0c90 tx=0x7f9fbc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45c1f8f46cb5ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.273+0000 7f9fcaffd640 1 -- 172.21.15.81:0/924095227 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc037070 con 0x7f9fcc15e760 2024-09-16T01:24:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.273+0000 7f9fcaffd640 1 -- 172.21.15.81:0/924095227 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fbc032440 con 0x7f9fcc15e760 2024-09-16T01:24:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.273+0000 7f9fcaffd640 1 -- 172.21.15.81:0/924095227 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc032810 con 0x7f9fcc15e760 2024-09-16T01:24:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.273+0000 7f9fd29f1640 1 -- 172.21.15.81:0/924095227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc15e760 msgr2=0x7f9fcc0b6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.273+0000 7f9fd29f1640 1 --2- 172.21.15.81:0/924095227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc15e760 0x7f9fcc0b6310 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0d0c90 tx=0x7f9fbc02a1e0 comp rx=0 tx=0).stop 2024-09-16T01:24:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.273+0000 7f9fd29f1640 1 -- 172.21.15.81:0/924095227 shutdown_connections 2024-09-16T01:24:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.273+0000 7f9fd29f1640 1 --2- 172.21.15.81:0/924095227 >> v2:172.21.15.102:3300/0 conn(0x7f9fcc070110 0x7f9fcc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.273+0000 7f9fd29f1640 1 --2- 172.21.15.81:0/924095227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc15e760 0x7f9fcc0b6310 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.273+0000 7f9fd29f1640 1 -- 172.21.15.81:0/924095227 >> 172.21.15.81:0/924095227 conn(0x7f9fcc073490 msgr2=0x7f9fcc0b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.273+0000 7f9fd29f1640 1 -- 172.21.15.81:0/924095227 shutdown_connections 2024-09-16T01:24:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.273+0000 7f9fd29f1640 1 -- 172.21.15.81:0/924095227 wait complete. 2024-09-16T01:24:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.274+0000 7f9fd29f1640 1 Processor -- start 2024-09-16T01:24:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.275+0000 7f9fd29f1640 1 -- start start 2024-09-16T01:24:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.275+0000 7f9fd29f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc070110 0x7f9fcc161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.275+0000 7f9fd29f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fcc0705c0 0x7f9fcc1f3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.275+0000 7f9fd29f1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fcc15e760 0x7f9fcc15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.275+0000 7f9fd29f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc0b46e0 con 0x7f9fcc070110 2024-09-16T01:24:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.275+0000 7f9fd29f1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9fcc0b4400 con 0x7f9fcc0705c0 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.275+0000 7f9fd29f1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9fcc0ae240 con 0x7f9fcc15e760 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.275+0000 7f9fcbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc070110 0x7f9fcc161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.275+0000 7f9fcbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc070110 0x7f9fcc161a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33318/0 (socket says 172.21.15.81:33318) 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.275+0000 7f9fcbfff640 1 -- 172.21.15.81:0/2105869814 learned_addr learned my addr 172.21.15.81:0/2105869814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fcb7fe640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fcc0705c0 0x7f9fcc1f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fd0f8e640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fcc15e760 0x7f9fcc15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fcbfff640 1 -- 172.21.15.81:0/2105869814 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fcc15e760 msgr2=0x7f9fcc15fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fcbfff640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fcc15e760 0x7f9fcc15fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fcbfff640 1 -- 172.21.15.81:0/2105869814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fcc0705c0 msgr2=0x7f9fcc1f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fcbfff640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fcc0705c0 0x7f9fcc1f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fcbfff640 1 -- 172.21.15.81:0/2105869814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fcc09f120 con 0x7f9fcc070110 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fcb7fe640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fcc0705c0 0x7f9fcc1f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fcbfff640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc070110 0x7f9fcc161a50 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009720 tx=0x7f9fbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fc8ff9640 1 -- 172.21.15.81:0/2105869814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc037040 con 0x7f9fcc070110 2024-09-16T01:24:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fc8ff9640 1 -- 172.21.15.81:0/2105869814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fbc004030 con 0x7f9fcc070110 2024-09-16T01:24:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fd29f1640 1 -- 172.21.15.81:0/2105869814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fcc162450 con 0x7f9fcc070110 2024-09-16T01:24:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fc8ff9640 1 -- 172.21.15.81:0/2105869814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc006e10 con 0x7f9fcc070110 2024-09-16T01:24:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.276+0000 7f9fd29f1640 1 -- 172.21.15.81:0/2105869814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fcc162a10 con 0x7f9fcc070110 2024-09-16T01:24:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.277+0000 7f9fd29f1640 1 -- 172.21.15.81:0/2105869814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fcc0b6310 con 0x7f9fcc070110 2024-09-16T01:24:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.277+0000 7f9fc8ff9640 1 -- 172.21.15.81:0/2105869814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9fbc030770 con 0x7f9fcc070110 2024-09-16T01:24:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.278+0000 7f9fc8ff9640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9fb806c2b0 0x7f9fb806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.278+0000 7f9fc8ff9640 1 -- 172.21.15.81:0/2105869814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 6187+0+0 (secure 0 0 0) 0x7f9fbc0ac7d0 con 0x7f9fcc070110 2024-09-16T01:24:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.278+0000 7f9fcb7fe640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9fb806c2b0 0x7f9fb806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.278+0000 7f9fcb7fe640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9fb806c2b0 0x7f9fb806e770 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc1f8590 tx=0x7f9fc0007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.282+0000 7f9fc8ff9640 1 -- 172.21.15.81:0/2105869814 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9fbc07ae80 con 0x7f9fcc070110 2024-09-16T01:24:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:11.483+0000 7f9fd29f1640 1 -- 172.21.15.81:0/2105869814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9fcc09da90 con 0x7f9fcc070110 2024-09-16T01:24:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.153+0000 7f9fc8ff9640 1 -- 172.21.15.81:0/2105869814 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) ==== 104+0+0 (secure 0 0 0) 0x7f9fbc07a780 con 0x7f9fcc070110 2024-09-16T01:24:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.156+0000 7f9fd29f1640 1 -- 172.21.15.81:0/2105869814 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9fb806c2b0 msgr2=0x7f9fb806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.156+0000 7f9fd29f1640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9fb806c2b0 0x7f9fb806e770 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc1f8590 tx=0x7f9fc0007ca0 comp rx=0 tx=0).stop 2024-09-16T01:24:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.156+0000 7f9fd29f1640 1 -- 172.21.15.81:0/2105869814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc070110 msgr2=0x7f9fcc161a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.156+0000 7f9fd29f1640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc070110 0x7f9fcc161a50 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc009720 tx=0x7f9fbc0046c0 comp rx=0 tx=0).stop 2024-09-16T01:24:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.156+0000 7f9fd29f1640 1 -- 172.21.15.81:0/2105869814 shutdown_connections 2024-09-16T01:24:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.156+0000 7f9fd29f1640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f9fb806c2b0 0x7f9fb806e770 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.156+0000 7f9fd29f1640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fcc15e760 0x7f9fcc15fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.156+0000 7f9fd29f1640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fcc0705c0 0x7f9fcc1f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.156+0000 7f9fd29f1640 1 --2- 172.21.15.81:0/2105869814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc070110 0x7f9fcc161a50 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.156+0000 7f9fd29f1640 1 -- 172.21.15.81:0/2105869814 >> 172.21.15.81:0/2105869814 conn(0x7f9fcc073490 msgr2=0x7f9fcc15abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.157+0000 7f9fd29f1640 1 -- 172.21.15.81:0/2105869814 shutdown_connections 2024-09-16T01:24:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.157+0000 7f9fd29f1640 1 -- 172.21.15.81:0/2105869814 wait complete. 2024-09-16T01:24:12.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-16T01:24:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.320+0000 7f0376bdf640 1 Processor -- start 2024-09-16T01:24:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.320+0000 7f0376bdf640 1 -- start start 2024-09-16T01:24:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f0376bdf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f037015e7f0 0x7f03700b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f0376bdf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037006cdc0 con 0x7f03700af210 2024-09-16T01:24:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f0376bdf640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037006d0a0 con 0x7f0370071180 2024-09-16T01:24:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f0376bdf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f037006d380 con 0x7f037015e7f0 2024-09-16T01:24:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f0367fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f03700af210 0x7f0370070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37428/0 (socket says 172.21.15.81:37428) 2024-09-16T01:24:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f0367fff640 1 -- 172.21.15.81:0/4089952914 learned_addr learned my addr 172.21.15.81:0/4089952914 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f037497b640 1 --2- 172.21.15.81:0/4089952914 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f037015e7f0 0x7f03700b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2897142298 0 0) 0x7f037006cdc0 con 0x7f03700af210 2024-09-16T01:24:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0358003520 con 0x7f03700af210 2024-09-16T01:24:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3415171153 0 0) 0x7f0358003520 con 0x7f03700af210 2024-09-16T01:24:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f037015e7f0 msgr2=0x7f03700b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f03677fe640 1 --2- 172.21.15.81:0/4089952914 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f037015e7f0 0x7f03700b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.321+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 >> v1:172.21.15.102:6789/0 conn(0x7f0370071180 legacy=0x7f037006de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037006d660 con 0x7f03700af210 2024-09-16T01:24:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f0360001670 con 0x7f03700af210 2024-09-16T01:24:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 >> v1:172.21.15.81:6789/0 conn(0x7f03700af210 legacy=0x7f0370070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f03677fe640 1 --2- 172.21.15.81:0/4089952914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03580039e0 0x7f0358003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f03677fe640 1 --2- 172.21.15.81:0/4089952914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0358004390 0x7f0358004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f03677fe640 1 --2- 172.21.15.81:0/4089952914 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f037015e7f0 0x7f03580050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f037006d380 con 0x7f03580039e0 2024-09-16T01:24:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f035800b9c0 con 0x7f0358004390 2024-09-16T01:24:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f035800bbc0 con 0x7f037015e7f0 2024-09-16T01:24:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f037497b640 1 --2- 172.21.15.81:0/4089952914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03580039e0 0x7f0358003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f0367fff640 1 --2- 172.21.15.81:0/4089952914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0358004390 0x7f0358004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f037517c640 1 --2- 172.21.15.81:0/4089952914 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f037015e7f0 0x7f03580050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f037497b640 1 -- 172.21.15.81:0/4089952914 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f037015e7f0 msgr2=0x7f03580050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f037497b640 1 --2- 172.21.15.81:0/4089952914 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f037015e7f0 0x7f03580050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f037497b640 1 -- 172.21.15.81:0/4089952914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0358004390 msgr2=0x7f0358004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f037497b640 1 --2- 172.21.15.81:0/4089952914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0358004390 0x7f0358004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.322+0000 7f037497b640 1 -- 172.21.15.81:0/4089952914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0358003520 con 0x7f03580039e0 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.323+0000 7f037497b640 1 --2- 172.21.15.81:0/4089952914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03580039e0 0x7f0358003dc0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f036c009fc0 tx=0x7f0358005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57a1d7fd2677c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.323+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c009c10 con 0x7f03580039e0 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.323+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c036070 con 0x7f03580039e0 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.323+0000 7f03677fe640 1 -- 172.21.15.81:0/4089952914 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c031880 con 0x7f03580039e0 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.323+0000 7f0376bdf640 1 -- 172.21.15.81:0/4089952914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03580039e0 msgr2=0x7f0358003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.323+0000 7f0376bdf640 1 --2- 172.21.15.81:0/4089952914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03580039e0 0x7f0358003dc0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f036c009fc0 tx=0x7f0358005830 comp rx=0 tx=0).stop 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.323+0000 7f037517c640 1 -- 172.21.15.81:0/4089952914 reap_dead start 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.323+0000 7f0376bdf640 1 -- 172.21.15.81:0/4089952914 shutdown_connections 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.323+0000 7f0376bdf640 1 -- 172.21.15.81:0/4089952914 >> 172.21.15.81:0/4089952914 conn(0x7f03700b3f30 msgr2=0x7f03700b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.323+0000 7f0376bdf640 1 -- 172.21.15.81:0/4089952914 shutdown_connections 2024-09-16T01:24:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.323+0000 7f0376bdf640 1 -- 172.21.15.81:0/4089952914 wait complete. 2024-09-16T01:24:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.325+0000 7f0376bdf640 1 Processor -- start 2024-09-16T01:24:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.325+0000 7f0376bdf640 1 -- start start 2024-09-16T01:24:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.325+0000 7f0376bdf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03580039e0 0x7f0370149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.325+0000 7f0376bdf640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0370156420 0x7f0370161510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.325+0000 7f0376bdf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701570e0 0x7f0370157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.325+0000 7f0376bdf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f037006e570 con 0x7f03701570e0 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.325+0000 7f0376bdf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03700b6150 con 0x7f03580039e0 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.325+0000 7f0376bdf640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f037006e6f0 con 0x7f0370156420 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f037517c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701570e0 0x7f0370157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f037517c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701570e0 0x7f0370157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33346/0 (socket says 172.21.15.81:33346) 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f037517c640 1 -- 172.21.15.81:0/2744959048 learned_addr learned my addr 172.21.15.81:0/2744959048 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f037497b640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03580039e0 0x7f0370149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f0367fff640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0370156420 0x7f0370161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f037517c640 1 -- 172.21.15.81:0/2744959048 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0370156420 msgr2=0x7f0370161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f037517c640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0370156420 0x7f0370161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f037517c640 1 -- 172.21.15.81:0/2744959048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03580039e0 msgr2=0x7f0370149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f037517c640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03580039e0 0x7f0370149f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f037517c640 1 -- 172.21.15.81:0/2744959048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0370155380 con 0x7f03701570e0 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f037497b640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03580039e0 0x7f0370149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f0367fff640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0370156420 0x7f0370161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f037517c640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701570e0 0x7f0370157560 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f0370073e30 tx=0x7f036800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f03657fa640 1 -- 172.21.15.81:0/2744959048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368019070 con 0x7f03701570e0 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f03657fa640 1 -- 172.21.15.81:0/2744959048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03680050d0 con 0x7f03701570e0 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f0376bdf640 1 -- 172.21.15.81:0/2744959048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0370155660 con 0x7f03701570e0 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f03657fa640 1 -- 172.21.15.81:0/2744959048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03680067d0 con 0x7f03701570e0 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.326+0000 7f0376bdf640 1 -- 172.21.15.81:0/2744959048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0370155c20 con 0x7f03701570e0 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.327+0000 7f0376bdf640 1 -- 172.21.15.81:0/2744959048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f037006eb20 con 0x7f03701570e0 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.328+0000 7f03657fa640 1 -- 172.21.15.81:0/2744959048 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f036801c070 con 0x7f03701570e0 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.328+0000 7f03657fa640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f035c06c2b0 0x7f035c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.328+0000 7f037497b640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f035c06c2b0 0x7f035c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.328+0000 7f03657fa640 1 -- 172.21.15.81:0/2744959048 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 6187+0+0 (secure 0 0 0) 0x7f036808a680 con 0x7f03701570e0 2024-09-16T01:24:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.329+0000 7f037497b640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f035c06c2b0 0x7f035c06e770 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f036c033040 tx=0x7f036c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.332+0000 7f03657fa640 1 -- 172.21.15.81:0/2744959048 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0368058ca0 con 0x7f03701570e0 2024-09-16T01:24:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:12.497+0000 7f0376bdf640 1 -- 172.21.15.81:0/2744959048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0370158230 con 0x7f03701570e0 2024-09-16T01:24:13.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.160+0000 7f03657fa640 1 -- 172.21.15.81:0/2744959048 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v151) ==== 181+0+0 (secure 0 0 0) 0x7f03680585a0 con 0x7f03701570e0 2024-09-16T01:24:13.162 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-16T01:24:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.162+0000 7f0376bdf640 1 -- 172.21.15.81:0/2744959048 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f035c06c2b0 msgr2=0x7f035c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.162+0000 7f0376bdf640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f035c06c2b0 0x7f035c06e770 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f036c033040 tx=0x7f036c02f000 comp rx=0 tx=0).stop 2024-09-16T01:24:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.162+0000 7f0376bdf640 1 -- 172.21.15.81:0/2744959048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701570e0 msgr2=0x7f0370157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.162+0000 7f0376bdf640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701570e0 0x7f0370157560 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f0370073e30 tx=0x7f036800fc00 comp rx=0 tx=0).stop 2024-09-16T01:24:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.162+0000 7f0376bdf640 1 -- 172.21.15.81:0/2744959048 shutdown_connections 2024-09-16T01:24:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.162+0000 7f0376bdf640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f035c06c2b0 0x7f035c06e770 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.162+0000 7f0376bdf640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03701570e0 0x7f0370157560 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.162+0000 7f0376bdf640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0370156420 0x7f0370161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.162+0000 7f0376bdf640 1 --2- 172.21.15.81:0/2744959048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03580039e0 0x7f0370149f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.162+0000 7f0376bdf640 1 -- 172.21.15.81:0/2744959048 >> 172.21.15.81:0/2744959048 conn(0x7f03700b3f30 msgr2=0x7f03700b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.162+0000 7f0376bdf640 1 -- 172.21.15.81:0/2744959048 shutdown_connections 2024-09-16T01:24:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.162+0000 7f0376bdf640 1 -- 172.21.15.81:0/2744959048 wait complete. 2024-09-16T01:24:13.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-16T01:24:13.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.278+0000 7f6a5b542640 1 Processor -- start 2024-09-16T01:24:13.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.279+0000 7f6a5b542640 1 -- start start 2024-09-16T01:24:13.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.279+0000 7f6a5b542640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a54162340 0x7f6a5406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:13.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.279+0000 7f6a5b542640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a54162e30 0x7f6a540d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:13.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.279+0000 7f6a5b542640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a5415ff70 con 0x7f6a540cf280 2024-09-16T01:24:13.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.279+0000 7f6a5b542640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6a5406de90 con 0x7f6a54162e30 2024-09-16T01:24:13.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.279+0000 7f6a5b542640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6a540d4d10 con 0x7f6a54162340 2024-09-16T01:24:13.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.280+0000 7f6a59adf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a54162e30 0x7f6a540d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:13.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.280+0000 7f6a59adf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6a54162e30 0x7f6a540d2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33360/0 (socket says 172.21.15.81:33360) 2024-09-16T01:24:13.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.280+0000 7f6a59adf640 1 -- 172.21.15.81:0/2341637315 learned_addr learned my addr 172.21.15.81:0/2341637315 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:13.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.280+0000 7f6a592de640 1 --2- 172.21.15.81:0/2341637315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a54162340 0x7f6a5406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:13.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.280+0000 7f6a59adf640 1 -- 172.21.15.81:0/2341637315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a54162340 msgr2=0x7f6a5406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:13.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.280+0000 7f6a59adf640 1 --2- 172.21.15.81:0/2341637315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a54162340 0x7f6a5406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:13.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.280+0000 7f6a59adf640 1 -- 172.21.15.81:0/2341637315 >> v1:172.21.15.102:6789/0 conn(0x7f6a540cf280 legacy=0x7f6a54162720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:13.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.280+0000 7f6a59adf640 1 -- 172.21.15.81:0/2341637315 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a540d4ff0 con 0x7f6a54162e30 2024-09-16T01:24:13.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.280+0000 7f6a592de640 1 --2- 172.21.15.81:0/2341637315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a54162340 0x7f6a5406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:13.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.281+0000 7f6a59adf640 1 --2- 172.21.15.81:0/2341637315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a54162e30 0x7f6a540d2990 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009e50 tx=0x7f6a4c02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c1a9332d936e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:13.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.281+0000 7f6a4bfff640 1 -- 172.21.15.81:0/2341637315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c036070 con 0x7f6a54162e30 2024-09-16T01:24:13.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.281+0000 7f6a4bfff640 1 -- 172.21.15.81:0/2341637315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a4c031600 con 0x7f6a54162e30 2024-09-16T01:24:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.281+0000 7f6a4bfff640 1 -- 172.21.15.81:0/2341637315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0319d0 con 0x7f6a54162e30 2024-09-16T01:24:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.281+0000 7f6a5b542640 1 -- 172.21.15.81:0/2341637315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a54162e30 msgr2=0x7f6a540d2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.281+0000 7f6a5b542640 1 --2- 172.21.15.81:0/2341637315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a54162e30 0x7f6a540d2990 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009e50 tx=0x7f6a4c02a630 comp rx=0 tx=0).stop 2024-09-16T01:24:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.281+0000 7f6a5b542640 1 -- 172.21.15.81:0/2341637315 shutdown_connections 2024-09-16T01:24:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.281+0000 7f6a5b542640 1 --2- 172.21.15.81:0/2341637315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a54162e30 0x7f6a540d2990 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.281+0000 7f6a5b542640 1 --2- 172.21.15.81:0/2341637315 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a54162340 0x7f6a5406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.281+0000 7f6a5b542640 1 -- 172.21.15.81:0/2341637315 >> 172.21.15.81:0/2341637315 conn(0x7f6a5408bfc0 msgr2=0x7f6a540d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.282+0000 7f6a5b542640 1 -- 172.21.15.81:0/2341637315 shutdown_connections 2024-09-16T01:24:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.282+0000 7f6a5b542640 1 -- 172.21.15.81:0/2341637315 wait complete. 2024-09-16T01:24:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.283+0000 7f6a5b542640 1 Processor -- start 2024-09-16T01:24:13.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.283+0000 7f6a5b542640 1 -- start start 2024-09-16T01:24:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.283+0000 7f6a5b542640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a540cf280 0x7f6a540ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.283+0000 7f6a5b542640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a54162340 0x7f6a540cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:13.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.283+0000 7f6a5b542640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a54162e30 0x7f6a540b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:13.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.283+0000 7f6a5b542640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a540cf6c0 con 0x7f6a54162e30 2024-09-16T01:24:13.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.283+0000 7f6a5b542640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6a540d52d0 con 0x7f6a540cf280 2024-09-16T01:24:13.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.283+0000 7f6a5b542640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6a540d2ed0 con 0x7f6a54162340 2024-09-16T01:24:13.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.283+0000 7f6a59adf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a54162e30 0x7f6a540b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:13.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.283+0000 7f6a59adf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a54162e30 0x7f6a540b92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33368/0 (socket says 172.21.15.81:33368) 2024-09-16T01:24:13.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.283+0000 7f6a59adf640 1 -- 172.21.15.81:0/3164016239 learned_addr learned my addr 172.21.15.81:0/3164016239 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:13.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a592de640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a540cf280 0x7f6a540ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:13.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a58add640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a54162340 0x7f6a540cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:13.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a59adf640 1 -- 172.21.15.81:0/3164016239 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a54162340 msgr2=0x7f6a540cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a59adf640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a54162340 0x7f6a540cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a59adf640 1 -- 172.21.15.81:0/3164016239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a540cf280 msgr2=0x7f6a540ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a59adf640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a540cf280 0x7f6a540ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a59adf640 1 -- 172.21.15.81:0/3164016239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a540b9d50 con 0x7f6a54162e30 2024-09-16T01:24:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a592de640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a540cf280 0x7f6a540ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a59adf640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a54162e30 0x7f6a540b92f0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009e50 tx=0x7f6a4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a49ffb640 1 -- 172.21.15.81:0/3164016239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c041070 con 0x7f6a54162e30 2024-09-16T01:24:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a49ffb640 1 -- 172.21.15.81:0/3164016239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a4c03c650 con 0x7f6a54162e30 2024-09-16T01:24:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a5b542640 1 -- 172.21.15.81:0/3164016239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a540cc050 con 0x7f6a54162e30 2024-09-16T01:24:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a49ffb640 1 -- 172.21.15.81:0/3164016239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c036040 con 0x7f6a54162e30 2024-09-16T01:24:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.284+0000 7f6a5b542640 1 -- 172.21.15.81:0/3164016239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a540cc610 con 0x7f6a54162e30 2024-09-16T01:24:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.285+0000 7f6a5b542640 1 -- 172.21.15.81:0/3164016239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a540d2990 con 0x7f6a54162e30 2024-09-16T01:24:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.286+0000 7f6a49ffb640 1 -- 172.21.15.81:0/3164016239 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6a4c044070 con 0x7f6a54162e30 2024-09-16T01:24:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.286+0000 7f6a49ffb640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6a3806c2b0 0x7f6a3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.286+0000 7f6a592de640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6a3806c2b0 0x7f6a3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:13.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.286+0000 7f6a49ffb640 1 -- 172.21.15.81:0/3164016239 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5749+0+0 (secure 0 0 0) 0x7f6a4c0ac020 con 0x7f6a54162e30 2024-09-16T01:24:13.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.287+0000 7f6a592de640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6a3806c2b0 0x7f6a3806e770 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6a540a23d0 tx=0x7f6a50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:13.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.291+0000 7f6a49ffb640 1 -- 172.21.15.81:0/3164016239 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a4c07a760 con 0x7f6a54162e30 2024-09-16T01:24:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:13.457+0000 7f6a5b542640 1 -- 172.21.15.81:0/3164016239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6a5408e640 con 0x7f6a54162e30 2024-09-16T01:24:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.162+0000 7f6a49ffb640 1 -- 172.21.15.81:0/3164016239 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v152) ==== 169+0+0 (secure 0 0 0) 0x7f6a4c07a060 con 0x7f6a54162e30 2024-09-16T01:24:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-16T01:24:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.165+0000 7f6a5b542640 1 -- 172.21.15.81:0/3164016239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6a3806c2b0 msgr2=0x7f6a3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.165+0000 7f6a5b542640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6a3806c2b0 0x7f6a3806e770 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6a540a23d0 tx=0x7f6a50008040 comp rx=0 tx=0).stop 2024-09-16T01:24:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.165+0000 7f6a5b542640 1 -- 172.21.15.81:0/3164016239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a54162e30 msgr2=0x7f6a540b92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.165+0000 7f6a5b542640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a54162e30 0x7f6a540b92f0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009e50 tx=0x7f6a4c004a40 comp rx=0 tx=0).stop 2024-09-16T01:24:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.165+0000 7f6a5b542640 1 -- 172.21.15.81:0/3164016239 shutdown_connections 2024-09-16T01:24:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.165+0000 7f6a5b542640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f6a3806c2b0 0x7f6a3806e770 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.165+0000 7f6a5b542640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a54162e30 0x7f6a540b92f0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.165+0000 7f6a5b542640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6a54162340 0x7f6a540cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.165+0000 7f6a5b542640 1 --2- 172.21.15.81:0/3164016239 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a540cf280 0x7f6a540ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.165+0000 7f6a5b542640 1 -- 172.21.15.81:0/3164016239 >> 172.21.15.81:0/3164016239 conn(0x7f6a5408bfc0 msgr2=0x7f6a541ea360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.165+0000 7f6a5b542640 1 -- 172.21.15.81:0/3164016239 shutdown_connections 2024-09-16T01:24:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.165+0000 7f6a5b542640 1 -- 172.21.15.81:0/3164016239 wait complete. 2024-09-16T01:24:14.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-16T01:24:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.282+0000 7f03c212a640 1 Processor -- start 2024-09-16T01:24:14.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.282+0000 7f03c212a640 1 -- start start 2024-09-16T01:24:14.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03c212a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03bc1519f0 0x7f03bc0726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03c212a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f03bc0b41a0 0x7f03bc06e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03c212a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc0b4800 con 0x7f03bc072be0 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03c212a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f03bc0b45d0 con 0x7f03bc1519f0 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03c212a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f03bc073020 con 0x7f03bc0b41a0 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03bb7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03bc1519f0 0x7f03bc0726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03bb7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03bc1519f0 0x7f03bc0726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33372/0 (socket says 172.21.15.81:33372) 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03bb7fe640 1 -- 172.21.15.81:0/1765232147 learned_addr learned my addr 172.21.15.81:0/1765232147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03baffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f03bc072be0 0x7f03bc0b3a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37436/0 (socket says 172.21.15.81:37436) 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03bb7fe640 1 -- 172.21.15.81:0/1765232147 >> v2:172.21.15.102:3300/0 conn(0x7f03bc0b41a0 msgr2=0x7f03bc06e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03bbfff640 1 --2- 172.21.15.81:0/1765232147 >> v2:172.21.15.102:3300/0 conn(0x7f03bc0b41a0 0x7f03bc06e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03bb7fe640 1 --2- 172.21.15.81:0/1765232147 >> v2:172.21.15.102:3300/0 conn(0x7f03bc0b41a0 0x7f03bc06e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03bb7fe640 1 -- 172.21.15.81:0/1765232147 >> v1:172.21.15.81:6789/0 conn(0x7f03bc072be0 legacy=0x7f03bc0b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03ba7fc640 1 -- 172.21.15.81:0/1765232147 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2555618199 0 0) 0x7f03bc0b4800 con 0x7f03bc072be0 2024-09-16T01:24:14.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03bb7fe640 1 -- 172.21.15.81:0/1765232147 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03bc0b4ae0 con 0x7f03bc1519f0 2024-09-16T01:24:14.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.283+0000 7f03bbfff640 1 --2- 172.21.15.81:0/1765232147 >> v2:172.21.15.102:3300/0 conn(0x7f03bc0b41a0 0x7f03bc06e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:14.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.284+0000 7f03bb7fe640 1 --2- 172.21.15.81:0/1765232147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc1519f0 0x7f03bc0726a0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f03bc155570 tx=0x7f03ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d0f54d33edf53e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:14.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.284+0000 7f03ba7fc640 1 -- 172.21.15.81:0/1765232147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac037070 con 0x7f03bc1519f0 2024-09-16T01:24:14.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.284+0000 7f03ba7fc640 1 -- 172.21.15.81:0/1765232147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ac032440 con 0x7f03bc1519f0 2024-09-16T01:24:14.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.284+0000 7f03ba7fc640 1 -- 172.21.15.81:0/1765232147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac032810 con 0x7f03bc1519f0 2024-09-16T01:24:14.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.284+0000 7f03c212a640 1 -- 172.21.15.81:0/1765232147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc1519f0 msgr2=0x7f03bc0726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.284+0000 7f03c212a640 1 --2- 172.21.15.81:0/1765232147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc1519f0 0x7f03bc0726a0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f03bc155570 tx=0x7f03ac02a1e0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.284+0000 7f03c212a640 1 -- 172.21.15.81:0/1765232147 shutdown_connections 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.284+0000 7f03c212a640 1 --2- 172.21.15.81:0/1765232147 >> v2:172.21.15.102:3300/0 conn(0x7f03bc0b41a0 0x7f03bc06e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.284+0000 7f03c212a640 1 --2- 172.21.15.81:0/1765232147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc1519f0 0x7f03bc0726a0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.285+0000 7f03c212a640 1 -- 172.21.15.81:0/1765232147 >> 172.21.15.81:0/1765232147 conn(0x7f03bc06bdf0 msgr2=0x7f03bc06c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.285+0000 7f03c212a640 1 -- 172.21.15.81:0/1765232147 shutdown_connections 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.285+0000 7f03c212a640 1 -- 172.21.15.81:0/1765232147 wait complete. 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.286+0000 7f03c212a640 1 Processor -- start 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.286+0000 7f03c212a640 1 -- start start 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03c212a640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03bc072be0 0x7f03bc14b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03c212a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0b41a0 0x7f03bc0ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03c212a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03bc1519f0 0x7f03bc156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03c212a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc151dd0 con 0x7f03bc0b41a0 2024-09-16T01:24:14.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03c212a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc0b50a0 con 0x7f03bc1519f0 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03c212a640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f03bc0d0370 con 0x7f03bc072be0 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03baffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0b41a0 0x7f03bc0ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03baffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0b41a0 0x7f03bc0ad4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33380/0 (socket says 172.21.15.81:33380) 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03baffd640 1 -- 172.21.15.81:0/3970451220 learned_addr learned my addr 172.21.15.81:0/3970451220 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03bbfff640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03bc1519f0 0x7f03bc156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03bb7fe640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03bc072be0 0x7f03bc14b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03baffd640 1 -- 172.21.15.81:0/3970451220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03bc072be0 msgr2=0x7f03bc14b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03baffd640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03bc072be0 0x7f03bc14b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03baffd640 1 -- 172.21.15.81:0/3970451220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03bc1519f0 msgr2=0x7f03bc156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03baffd640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03bc1519f0 0x7f03bc156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03baffd640 1 -- 172.21.15.81:0/3970451220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03bc1557a0 con 0x7f03bc0b41a0 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03bbfff640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03bc1519f0 0x7f03bc156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03bb7fe640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03bc072be0 0x7f03bc14b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:14.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03baffd640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0b41a0 0x7f03bc0ad4f0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f03b000c4d0 tx=0x7f03b000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:14.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03a3fff640 1 -- 172.21.15.81:0/3970451220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0018070 con 0x7f03bc0b41a0 2024-09-16T01:24:14.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03a3fff640 1 -- 172.21.15.81:0/3970451220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03b0007500 con 0x7f03bc0b41a0 2024-09-16T01:24:14.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03c212a640 1 -- 172.21.15.81:0/3970451220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03bc155a80 con 0x7f03bc0b41a0 2024-09-16T01:24:14.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03a3fff640 1 -- 172.21.15.81:0/3970451220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b0004a20 con 0x7f03bc0b41a0 2024-09-16T01:24:14.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.287+0000 7f03c212a640 1 -- 172.21.15.81:0/3970451220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03bc156040 con 0x7f03bc0b41a0 2024-09-16T01:24:14.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.288+0000 7f03c212a640 1 -- 172.21.15.81:0/3970451220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03bc156240 con 0x7f03bc0b41a0 2024-09-16T01:24:14.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.289+0000 7f03a3fff640 1 -- 172.21.15.81:0/3970451220 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f03b001b070 con 0x7f03bc0b41a0 2024-09-16T01:24:14.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.289+0000 7f03a3fff640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f03a806c2e0 0x7f03a806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.289+0000 7f03a3fff640 1 -- 172.21.15.81:0/3970451220 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f03b008a5f0 con 0x7f03bc0b41a0 2024-09-16T01:24:14.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.289+0000 7f03bb7fe640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f03a806c2e0 0x7f03a806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.290+0000 7f03bb7fe640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f03a806c2e0 0x7f03a806e7a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f03ac034000 tx=0x7f03ac02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:14.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.294+0000 7f03a3fff640 1 -- 172.21.15.81:0/3970451220 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03bc156240 con 0x7f03bc0b41a0 2024-09-16T01:24:14.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.459+0000 7f03c212a640 1 -- 172.21.15.81:0/3970451220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f03bc0d0730 con 0x7f03bc0b41a0 2024-09-16T01:24:14.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.463+0000 7f03a3fff640 1 -- 172.21.15.81:0/3970451220 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v67) ==== 104+0+0 (secure 0 0 0) 0x7f03b0058ed0 con 0x7f03bc0b41a0 2024-09-16T01:24:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.465+0000 7f03c212a640 1 -- 172.21.15.81:0/3970451220 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f03a806c2e0 msgr2=0x7f03a806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.465+0000 7f03c212a640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f03a806c2e0 0x7f03a806e7a0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f03ac034000 tx=0x7f03ac02e000 comp rx=0 tx=0).stop 2024-09-16T01:24:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.465+0000 7f03c212a640 1 -- 172.21.15.81:0/3970451220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0b41a0 msgr2=0x7f03bc0ad4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.465+0000 7f03c212a640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0b41a0 0x7f03bc0ad4f0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f03b000c4d0 tx=0x7f03b000c990 comp rx=0 tx=0).stop 2024-09-16T01:24:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.465+0000 7f03c212a640 1 -- 172.21.15.81:0/3970451220 shutdown_connections 2024-09-16T01:24:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.465+0000 7f03c212a640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f03a806c2e0 0x7f03a806e7a0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.465+0000 7f03c212a640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03bc1519f0 0x7f03bc156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.465+0000 7f03c212a640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0b41a0 0x7f03bc0ad4f0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.465+0000 7f03c212a640 1 --2- 172.21.15.81:0/3970451220 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03bc072be0 0x7f03bc14b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.465+0000 7f03c212a640 1 -- 172.21.15.81:0/3970451220 >> 172.21.15.81:0/3970451220 conn(0x7f03bc06bdf0 msgr2=0x7f03bc15c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.465+0000 7f03c212a640 1 -- 172.21.15.81:0/3970451220 shutdown_connections 2024-09-16T01:24:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.465+0000 7f03c212a640 1 -- 172.21.15.81:0/3970451220 wait complete. 2024-09-16T01:24:14.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug' 2024-09-16T01:24:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.573+0000 7fd28a0b7640 1 Processor -- start 2024-09-16T01:24:14.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.573+0000 7fd28a0b7640 1 -- start start 2024-09-16T01:24:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.574+0000 7fd28a0b7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd28409b140 0x7fd284169570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.574+0000 7fd28a0b7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28406cec0 con 0x7fd28406df60 2024-09-16T01:24:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.574+0000 7fd28a0b7640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28406d1a0 con 0x7fd28415e5d0 2024-09-16T01:24:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.574+0000 7fd28a0b7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd28406dad0 con 0x7fd28409b140 2024-09-16T01:24:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.574+0000 7fd282ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd28406df60 0x7fd28409aa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37438/0 (socket says 172.21.15.81:37438) 2024-09-16T01:24:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.574+0000 7fd282ffd640 1 -- 172.21.15.81:0/2243340553 learned_addr learned my addr 172.21.15.81:0/2243340553 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd283fff640 1 --2- 172.21.15.81:0/2243340553 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd28409b140 0x7fd284169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3804452412 0 0) 0x7fd28406cec0 con 0x7fd28406df60 2024-09-16T01:24:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd270003520 con 0x7fd28406df60 2024-09-16T01:24:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 310319385 0 0) 0x7fd28406d1a0 con 0x7fd28415e5d0 2024-09-16T01:24:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd28406cec0 con 0x7fd28415e5d0 2024-09-16T01:24:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 939071797 0 0) 0x7fd270003520 con 0x7fd28406df60 2024-09-16T01:24:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd28409b140 msgr2=0x7fd284169570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 --2- 172.21.15.81:0/2243340553 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd28409b140 0x7fd284169570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 >> v1:172.21.15.102:6789/0 conn(0x7fd28415e5d0 legacy=0x7fd2840d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28406d480 con 0x7fd28406df60 2024-09-16T01:24:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fd26c001670 con 0x7fd28406df60 2024-09-16T01:24:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 >> v1:172.21.15.81:6789/0 conn(0x7fd28406df60 legacy=0x7fd28409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 --2- 172.21.15.81:0/2243340553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd270003b70 0x7fd270003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 --2- 172.21.15.81:0/2243340553 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd28409b140 0x7fd270004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 --2- 172.21.15.81:0/2243340553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd270004d40 0x7fd2700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd28406dad0 con 0x7fd270003b70 2024-09-16T01:24:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd27000baa0 con 0x7fd270004d40 2024-09-16T01:24:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd27000bca0 con 0x7fd28409b140 2024-09-16T01:24:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2837fe640 1 --2- 172.21.15.81:0/2243340553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd270003b70 0x7fd270003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd282ffd640 1 --2- 172.21.15.81:0/2243340553 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd28409b140 0x7fd270004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd283fff640 1 --2- 172.21.15.81:0/2243340553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd270004d40 0x7fd2700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2837fe640 1 -- 172.21.15.81:0/2243340553 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd28409b140 msgr2=0x7fd270004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2837fe640 1 --2- 172.21.15.81:0/2243340553 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd28409b140 0x7fd270004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2837fe640 1 -- 172.21.15.81:0/2243340553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd270004d40 msgr2=0x7fd2700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2837fe640 1 --2- 172.21.15.81:0/2243340553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd270004d40 0x7fd2700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.575+0000 7fd2837fe640 1 -- 172.21.15.81:0/2243340553 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd270003520 con 0x7fd270003b70 2024-09-16T01:24:14.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.576+0000 7fd2837fe640 1 --2- 172.21.15.81:0/2243340553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd270003b70 0x7fd270003f70 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fd274001fd0 tx=0x7fd270005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8236504f6ecdf4f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.576+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd274001bf0 con 0x7fd270003b70 2024-09-16T01:24:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.576+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd274003b70 con 0x7fd270003b70 2024-09-16T01:24:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.576+0000 7fd2827fc640 1 -- 172.21.15.81:0/2243340553 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2740050d0 con 0x7fd270003b70 2024-09-16T01:24:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.577+0000 7fd28a0b7640 1 -- 172.21.15.81:0/2243340553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd270003b70 msgr2=0x7fd270003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.577+0000 7fd28a0b7640 1 --2- 172.21.15.81:0/2243340553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd270003b70 0x7fd270003f70 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fd274001fd0 tx=0x7fd270005830 comp rx=0 tx=0).stop 2024-09-16T01:24:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.577+0000 7fd283fff640 1 -- 172.21.15.81:0/2243340553 reap_dead start 2024-09-16T01:24:14.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.577+0000 7fd28a0b7640 1 -- 172.21.15.81:0/2243340553 shutdown_connections 2024-09-16T01:24:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.577+0000 7fd28a0b7640 1 -- 172.21.15.81:0/2243340553 >> 172.21.15.81:0/2243340553 conn(0x7fd2840d23a0 msgr2=0x7fd2840d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.577+0000 7fd28a0b7640 1 -- 172.21.15.81:0/2243340553 shutdown_connections 2024-09-16T01:24:14.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.577+0000 7fd28a0b7640 1 -- 172.21.15.81:0/2243340553 wait complete. 2024-09-16T01:24:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.578+0000 7fd28a0b7640 1 Processor -- start 2024-09-16T01:24:14.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.578+0000 7fd28a0b7640 1 -- start start 2024-09-16T01:24:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd28a0b7640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd270003b70 0x7fd284152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd28a0b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2840c7180 0x7fd2840c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd28a0b7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2840c8390 0x7fd2840b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd28a0b7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2840d1980 con 0x7fd2840c8390 2024-09-16T01:24:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd28a0b7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd2840d1800 con 0x7fd2840c7180 2024-09-16T01:24:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd28a0b7640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd28415e9b0 con 0x7fd270003b70 2024-09-16T01:24:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd283fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2840c8390 0x7fd2840b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd283fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2840c8390 0x7fd2840b6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33412/0 (socket says 172.21.15.81:33412) 2024-09-16T01:24:14.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd283fff640 1 -- 172.21.15.81:0/3933198700 learned_addr learned my addr 172.21.15.81:0/3933198700 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd282ffd640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2840c7180 0x7fd2840c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd2837fe640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd270003b70 0x7fd284152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd283fff640 1 -- 172.21.15.81:0/3933198700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd270003b70 msgr2=0x7fd284152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd283fff640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd270003b70 0x7fd284152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd283fff640 1 -- 172.21.15.81:0/3933198700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2840c7180 msgr2=0x7fd2840c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd283fff640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2840c7180 0x7fd2840c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd283fff640 1 -- 172.21.15.81:0/3933198700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2840c5e00 con 0x7fd2840c8390 2024-09-16T01:24:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd2837fe640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd270003b70 0x7fd284152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.579+0000 7fd283fff640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2840c8390 0x7fd2840b6c10 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fd28406cbf0 tx=0x7fd27c011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.580+0000 7fd27bfff640 1 -- 172.21.15.81:0/3933198700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c004240 con 0x7fd2840c8390 2024-09-16T01:24:14.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.580+0000 7fd27bfff640 1 -- 172.21.15.81:0/3933198700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd27c01b070 con 0x7fd2840c8390 2024-09-16T01:24:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.580+0000 7fd27bfff640 1 -- 172.21.15.81:0/3933198700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00f710 con 0x7fd2840c8390 2024-09-16T01:24:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.580+0000 7fd28a0b7640 1 -- 172.21.15.81:0/3933198700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2840c60e0 con 0x7fd2840c8390 2024-09-16T01:24:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.580+0000 7fd28a0b7640 1 -- 172.21.15.81:0/3933198700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2840c66a0 con 0x7fd2840c8390 2024-09-16T01:24:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.581+0000 7fd28a0b7640 1 -- 172.21.15.81:0/3933198700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28406d1a0 con 0x7fd2840c8390 2024-09-16T01:24:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.581+0000 7fd27bfff640 1 -- 172.21.15.81:0/3933198700 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd27c012040 con 0x7fd2840c8390 2024-09-16T01:24:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.582+0000 7fd27bfff640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd26406c2e0 0x7fd26406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.582+0000 7fd27bfff640 1 -- 172.21.15.81:0/3933198700 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7fd27c08afb0 con 0x7fd2840c8390 2024-09-16T01:24:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.582+0000 7fd2837fe640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd26406c2e0 0x7fd26406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.582+0000 7fd2837fe640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd26406c2e0 0x7fd26406e7a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd274032000 tx=0x7fd27402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:14.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.586+0000 7fd27bfff640 1 -- 172.21.15.81:0/3933198700 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd27c059890 con 0x7fd2840c8390 2024-09-16T01:24:14.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:14.821+0000 7fd28a0b7640 1 -- 172.21.15.81:0/3933198700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]} v 0) -- 0x7fd2840b8320 con 0x7fd2840c8390 2024-09-16T01:24:15.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.167+0000 7fd27bfff640 1 -- 172.21.15.81:0/3933198700 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]}]=0 v439) ==== 151+0+0 (secure 0 0 0) 0x7fd27c059190 con 0x7fd2840c8390 2024-09-16T01:24:15.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.169+0000 7fd28a0b7640 1 -- 172.21.15.81:0/3933198700 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd26406c2e0 msgr2=0x7fd26406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.169+0000 7fd28a0b7640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd26406c2e0 0x7fd26406e7a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd274032000 tx=0x7fd27402f000 comp rx=0 tx=0).stop 2024-09-16T01:24:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.169+0000 7fd28a0b7640 1 -- 172.21.15.81:0/3933198700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2840c8390 msgr2=0x7fd2840b6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.169+0000 7fd28a0b7640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2840c8390 0x7fd2840b6c10 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fd28406cbf0 tx=0x7fd27c011cf0 comp rx=0 tx=0).stop 2024-09-16T01:24:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.169+0000 7fd28a0b7640 1 -- 172.21.15.81:0/3933198700 shutdown_connections 2024-09-16T01:24:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.169+0000 7fd28a0b7640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fd26406c2e0 0x7fd26406e7a0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.169+0000 7fd28a0b7640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2840c8390 0x7fd2840b6c10 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.169+0000 7fd28a0b7640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2840c7180 0x7fd2840c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.169+0000 7fd28a0b7640 1 --2- 172.21.15.81:0/3933198700 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd270003b70 0x7fd284152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.169+0000 7fd28a0b7640 1 -- 172.21.15.81:0/3933198700 >> 172.21.15.81:0/3933198700 conn(0x7fd2840d23a0 msgr2=0x7fd28409aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.169+0000 7fd28a0b7640 1 -- 172.21.15.81:0/3933198700 shutdown_connections 2024-09-16T01:24:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:15.170+0000 7fd28a0b7640 1 -- 172.21.15.81:0/3933198700 wait complete. 2024-09-16T01:24:15.182 INFO:tasks.cephfs_test_runner:When a client has a bug (which we will simulate) preventing it from releasing caps, ... skipped 'Require FUSE client to inject client release failure' 2024-09-16T01:24:15.182 INFO:tasks.cephfs_test_runner: 2024-09-16T01:24:15.183 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-16T01:24:15.183 INFO:tasks.cephfs_test_runner:Ran 10 tests in 480.717s 2024-09-16T01:24:15.183 INFO:tasks.cephfs_test_runner: 2024-09-16T01:24:15.183 INFO:tasks.cephfs_test_runner:OK (skipped=4) 2024-09-16T01:24:15.183 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-16T01:24:15.195 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-16T01:24:15.231 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-16T01:24:15.231 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:24:15.231 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:24:15.248 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:24:15.248 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-16T01:24:15.248 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:24:15.305 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-16T01:24:15.305 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:24:15.305 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:24:15.324 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:24:15.324 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-16T01:24:15.324 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T01:24:15.382 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19841 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-16T01:24:15.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:15.382 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:24:15.398 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-16T01:24:15.398 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T01:24:15.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:15.398 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-16T01:24:15.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:15.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T01:24:15.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:15.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-16T01:24:15.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:15.626 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-16T01:24:15.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:15.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-16T01:24:15.709 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-09-16T01:24:15.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:24:15.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:15.711 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:24:15.729 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-16T01:24:15.729 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T01:24:15.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:15.730 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-16T01:24:15.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:15.800 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T01:24:15.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:15.870 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-09-16T01:24:15.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:15.972 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-16T01:24:15.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T01:24:15.988 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-09-16T01:24:16.057 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2024-09-16T01:24:16.058 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:24:16.059 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-16T01:24:16.070 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-16T01:24:16.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:24:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.171+0000 7f574eaa5640 1 Processor -- start 2024-09-16T01:24:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.171+0000 7f574eaa5640 1 -- start start 2024-09-16T01:24:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.172+0000 7f574eaa5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f574815b0b0 0x7f57480cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.172+0000 7f574eaa5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57480cd950 con 0x7f5748072d30 2024-09-16T01:24:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.172+0000 7f574eaa5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5748072250 con 0x7f574806f8d0 2024-09-16T01:24:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.172+0000 7f574eaa5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5748072530 con 0x7f574815b0b0 2024-09-16T01:24:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.172+0000 7f574c841640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f574815b0b0 0x7f57480cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.172+0000 7f574c841640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f574815b0b0 0x7f57480cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33414/0 (socket says 172.21.15.81:33414) 2024-09-16T01:24:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.172+0000 7f574c841640 1 -- 172.21.15.81:0/1090883411 learned_addr learned my addr 172.21.15.81:0/1090883411 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.173+0000 7f574c841640 1 -- 172.21.15.81:0/1090883411 >> v1:172.21.15.102:6789/0 conn(0x7f574806f8d0 legacy=0x7f57480cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.173+0000 7f574c841640 1 -- 172.21.15.81:0/1090883411 >> v1:172.21.15.81:6789/0 conn(0x7f5748072d30 legacy=0x7f574806f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.173+0000 7f574c841640 1 -- 172.21.15.81:0/1090883411 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5748072810 con 0x7f574815b0b0 2024-09-16T01:24:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.173+0000 7f574c841640 1 --2- 172.21.15.81:0/1090883411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574815b0b0 0x7f57480cceb0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f573c009870 tx=0x7f573c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1686063817ecccf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.173+0000 7f57477fe640 1 -- 172.21.15.81:0/1090883411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c037070 con 0x7f574815b0b0 2024-09-16T01:24:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.173+0000 7f57477fe640 1 -- 172.21.15.81:0/1090883411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f573c032440 con 0x7f574815b0b0 2024-09-16T01:24:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.173+0000 7f57477fe640 1 -- 172.21.15.81:0/1090883411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c032810 con 0x7f574815b0b0 2024-09-16T01:24:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.174+0000 7f574eaa5640 1 -- 172.21.15.81:0/1090883411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574815b0b0 msgr2=0x7f57480cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.174+0000 7f574eaa5640 1 --2- 172.21.15.81:0/1090883411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574815b0b0 0x7f57480cceb0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f573c009870 tx=0x7f573c02a270 comp rx=0 tx=0).stop 2024-09-16T01:24:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.174+0000 7f574eaa5640 1 -- 172.21.15.81:0/1090883411 shutdown_connections 2024-09-16T01:24:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.174+0000 7f574eaa5640 1 --2- 172.21.15.81:0/1090883411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574815b0b0 0x7f57480cceb0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.174+0000 7f574eaa5640 1 -- 172.21.15.81:0/1090883411 >> 172.21.15.81:0/1090883411 conn(0x7f5748067d70 msgr2=0x7f574806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.174+0000 7f574eaa5640 1 -- 172.21.15.81:0/1090883411 shutdown_connections 2024-09-16T01:24:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.174+0000 7f574eaa5640 1 -- 172.21.15.81:0/1090883411 wait complete. 2024-09-16T01:24:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.175+0000 7f574eaa5640 1 Processor -- start 2024-09-16T01:24:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.175+0000 7f574eaa5640 1 -- start start 2024-09-16T01:24:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.176+0000 7f574eaa5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f574806f8d0 0x7f5748146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.176+0000 7f574eaa5640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5748072d30 0x7f574815bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.176+0000 7f574eaa5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574815b0b0 0x7f574806e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.176+0000 7f574eaa5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f574815b610 con 0x7f574815b0b0 2024-09-16T01:24:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.176+0000 7f574eaa5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f574815b490 con 0x7f574806f8d0 2024-09-16T01:24:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.176+0000 7f574eaa5640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f57480cd3f0 con 0x7f5748072d30 2024-09-16T01:24:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.176+0000 7f574d042640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574815b0b0 0x7f574806e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.176+0000 7f574d042640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574815b0b0 0x7f574806e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33426/0 (socket says 172.21.15.81:33426) 2024-09-16T01:24:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.176+0000 7f574d042640 1 -- 172.21.15.81:0/3055874960 learned_addr learned my addr 172.21.15.81:0/3055874960 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.176+0000 7f574c841640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f574806f8d0 0x7f5748146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.176+0000 7f5747fff640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5748072d30 0x7f574815bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.177+0000 7f574d042640 1 -- 172.21.15.81:0/3055874960 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5748072d30 msgr2=0x7f574815bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.177+0000 7f574d042640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5748072d30 0x7f574815bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.177+0000 7f574d042640 1 -- 172.21.15.81:0/3055874960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f574806f8d0 msgr2=0x7f5748146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.177+0000 7f574d042640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f574806f8d0 0x7f5748146ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.177+0000 7f574d042640 1 -- 172.21.15.81:0/3055874960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5748147430 con 0x7f574815b0b0 2024-09-16T01:24:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.177+0000 7f574d042640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574815b0b0 0x7f574806e0b0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f574000c710 tx=0x7f574000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.177+0000 7f57457fa640 1 -- 172.21.15.81:0/3055874960 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740016020 con 0x7f574815b0b0 2024-09-16T01:24:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.177+0000 7f57457fa640 1 -- 172.21.15.81:0/3055874960 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5740006d50 con 0x7f574815b0b0 2024-09-16T01:24:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.177+0000 7f574eaa5640 1 -- 172.21.15.81:0/3055874960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5748147710 con 0x7f574815b0b0 2024-09-16T01:24:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.177+0000 7f57457fa640 1 -- 172.21.15.81:0/3055874960 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740003bb0 con 0x7f574815b0b0 2024-09-16T01:24:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.177+0000 7f574eaa5640 1 -- 172.21.15.81:0/3055874960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5748147cd0 con 0x7f574815b0b0 2024-09-16T01:24:16.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.178+0000 7f574eaa5640 1 -- 172.21.15.81:0/3055874960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57480cfd40 con 0x7f574815b0b0 2024-09-16T01:24:16.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.178+0000 7f57457fa640 1 -- 172.21.15.81:0/3055874960 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f574000a850 con 0x7f574815b0b0 2024-09-16T01:24:16.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.179+0000 7f57457fa640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f572c06c2b0 0x7f572c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.179+0000 7f57457fa640 1 -- 172.21.15.81:0/3055874960 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f574008ade0 con 0x7f574815b0b0 2024-09-16T01:24:16.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.179+0000 7f574c841640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f572c06c2b0 0x7f572c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.179+0000 7f574c841640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f572c06c2b0 0x7f572c06e770 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f573c034000 tx=0x7f573c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:16.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.183+0000 7f57457fa640 1 -- 172.21.15.81:0/3055874960 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57480cfd40 con 0x7f574815b0b0 2024-09-16T01:24:16.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.345+0000 7f574eaa5640 1 -- 172.21.15.81:0/3055874960 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57481471e0 con 0x7f572c06c2b0 2024-09-16T01:24:16.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.346+0000 7f57457fa640 1 -- 172.21.15.81:0/3055874960 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13443 (secure 0 0 0) 0x7f57481471e0 con 0x7f572c06c2b0 2024-09-16T01:24:16.348 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:16.348 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:24:16.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.348+0000 7f574eaa5640 1 -- 172.21.15.81:0/3055874960 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f572c06c2b0 msgr2=0x7f572c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.348+0000 7f574eaa5640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f572c06c2b0 0x7f572c06e770 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f573c034000 tx=0x7f573c02e000 comp rx=0 tx=0).stop 2024-09-16T01:24:16.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.348+0000 7f574eaa5640 1 -- 172.21.15.81:0/3055874960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574815b0b0 msgr2=0x7f574806e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.348+0000 7f574eaa5640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574815b0b0 0x7f574806e0b0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f574000c710 tx=0x7f574000cbd0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.348+0000 7f574eaa5640 1 -- 172.21.15.81:0/3055874960 shutdown_connections 2024-09-16T01:24:16.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.348+0000 7f574eaa5640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f572c06c2b0 0x7f572c06e770 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.348+0000 7f574eaa5640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574815b0b0 0x7f574806e0b0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.348+0000 7f574eaa5640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5748072d30 0x7f574815bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.348+0000 7f574eaa5640 1 --2- 172.21.15.81:0/3055874960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f574806f8d0 0x7f5748146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.348+0000 7f574eaa5640 1 -- 172.21.15.81:0/3055874960 >> 172.21.15.81:0/3055874960 conn(0x7f5748067d70 msgr2=0x7f57480cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:16.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.348+0000 7f574eaa5640 1 -- 172.21.15.81:0/3055874960 shutdown_connections 2024-09-16T01:24:16.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.348+0000 7f574eaa5640 1 -- 172.21.15.81:0/3055874960 wait complete. 2024-09-16T01:24:16.361 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-09-16T01:24:16.170895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":273800,"kb_used_data":15976,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754700920,"statfs":{"total":773094113280,"available":772813742080,"internally_reserved":0,"allocated":16359424,"data_stored":8186590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3909,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000968"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":407,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-16T01:24:11.214344+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:24:11.214344+0000","last_peered":"2024-09-16T01:24:11.214344+0000","last_clean":"2024-09-16T01:24:11.214344+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:24:11.214344+0000","last_undegraded":"2024-09-16T01:24:11.214344+0000","last_fullsized":"2024-09-16T01:24:11.214344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33612,"kb_used_data":2424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338228,"statfs":{"total":96636764160,"available":96602345472,"internally_reserved":0,"allocated":2482176,"data_stored":1465052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574957,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37192,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334648,"statfs":{"total":96636764160,"available":96598679552,"internally_reserved":0,"allocated":1888256,"data_stored":874684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574956,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33040,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338800,"statfs":{"total":96636764160,"available":96602931200,"internally_reserved":0,"allocated":1896448,"data_stored":874808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37208,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334632,"statfs":{"total":96636764160,"available":96598663168,"internally_reserved":0,"allocated":1904640,"data_stored":875448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33052,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338788,"statfs":{"total":96636764160,"available":96602918912,"internally_reserved":0,"allocated":1908736,"data_stored":878681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574957,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1888256,"data_stored":874684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1900544,"data_stored":878077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33620,"kb_used_data":2432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338220,"statfs":{"total":96636764160,"available":96602337280,"internally_reserved":0,"allocated":2490368,"data_stored":1465156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:24:16.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:24:16.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.458+0000 7fa7436e6640 1 Processor -- start 2024-09-16T01:24:16.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.458+0000 7fa7436e6640 1 -- start start 2024-09-16T01:24:16.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa7436e6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa73c162060 0x7fa73c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa7436e6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa73c0b64b0 0x7fa73c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa7436e6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa73c06d9f0 con 0x7fa73c161c80 2024-09-16T01:24:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa7436e6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa73c06dcd0 con 0x7fa73c162060 2024-09-16T01:24:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa7436e6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa73c06dfb0 con 0x7fa73c0b64b0 2024-09-16T01:24:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa740c81640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa73c162060 0x7fa73c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa741482640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa73c161c80 0x7fa73c06e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37444/0 (socket says 172.21.15.81:37444) 2024-09-16T01:24:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa741482640 1 -- 172.21.15.81:0/2047630493 learned_addr learned my addr 172.21.15.81:0/2047630493 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa741c83640 1 --2- 172.21.15.81:0/2047630493 >> v2:172.21.15.102:3300/0 conn(0x7fa73c0b64b0 0x7fa73c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa740c81640 1 -- 172.21.15.81:0/2047630493 >> v2:172.21.15.102:3300/0 conn(0x7fa73c0b64b0 msgr2=0x7fa73c0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:16.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa740c81640 1 --2- 172.21.15.81:0/2047630493 >> v2:172.21.15.102:3300/0 conn(0x7fa73c0b64b0 0x7fa73c0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa740c81640 1 -- 172.21.15.81:0/2047630493 >> v1:172.21.15.81:6789/0 conn(0x7fa73c161c80 legacy=0x7fa73c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa740c81640 1 -- 172.21.15.81:0/2047630493 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c0d01f0 con 0x7fa73c162060 2024-09-16T01:24:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.459+0000 7fa741c83640 1 --2- 172.21.15.81:0/2047630493 >> v2:172.21.15.102:3300/0 conn(0x7fa73c0b64b0 0x7fa73c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.460+0000 7fa740c81640 1 --2- 172.21.15.81:0/2047630493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c162060 0x7fa73c0b5f70 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fa73c08d750 tx=0x7fa72c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee8ea809f563ad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.460+0000 7fa733fff640 1 -- 172.21.15.81:0/2047630493 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c037070 con 0x7fa73c162060 2024-09-16T01:24:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.460+0000 7fa733fff640 1 -- 172.21.15.81:0/2047630493 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72c032440 con 0x7fa73c162060 2024-09-16T01:24:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.460+0000 7fa733fff640 1 -- 172.21.15.81:0/2047630493 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c032810 con 0x7fa73c162060 2024-09-16T01:24:16.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.460+0000 7fa7436e6640 1 -- 172.21.15.81:0/2047630493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c162060 msgr2=0x7fa73c0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.461+0000 7fa7436e6640 1 --2- 172.21.15.81:0/2047630493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c162060 0x7fa73c0b5f70 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fa73c08d750 tx=0x7fa72c02a1a0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.461+0000 7fa7436e6640 1 -- 172.21.15.81:0/2047630493 shutdown_connections 2024-09-16T01:24:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.461+0000 7fa7436e6640 1 --2- 172.21.15.81:0/2047630493 >> v2:172.21.15.102:3300/0 conn(0x7fa73c0b64b0 0x7fa73c0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.461+0000 7fa7436e6640 1 --2- 172.21.15.81:0/2047630493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c162060 0x7fa73c0b5f70 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.461+0000 7fa7436e6640 1 -- 172.21.15.81:0/2047630493 >> 172.21.15.81:0/2047630493 conn(0x7fa73c0d44f0 msgr2=0x7fa73c0d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.461+0000 7fa7436e6640 1 -- 172.21.15.81:0/2047630493 shutdown_connections 2024-09-16T01:24:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.461+0000 7fa7436e6640 1 -- 172.21.15.81:0/2047630493 wait complete. 2024-09-16T01:24:16.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.462+0000 7fa7436e6640 1 Processor -- start 2024-09-16T01:24:16.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.462+0000 7fa7436e6640 1 -- start start 2024-09-16T01:24:16.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.462+0000 7fa7436e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa73c0b64b0 0x7fa73c0b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa7436e6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa73c161c80 0x7fa73c1591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa7436e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c162060 0x7fa73c0b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa7436e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c0cf1e0 con 0x7fa73c162060 2024-09-16T01:24:16.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa7436e6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa73c0d2aa0 con 0x7fa73c0b64b0 2024-09-16T01:24:16.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa7436e6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa73c0cf360 con 0x7fa73c161c80 2024-09-16T01:24:16.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa741c83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c162060 0x7fa73c0b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa741c83640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c162060 0x7fa73c0b7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33444/0 (socket says 172.21.15.81:33444) 2024-09-16T01:24:16.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa741c83640 1 -- 172.21.15.81:0/1907886945 learned_addr learned my addr 172.21.15.81:0/1907886945 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:16.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa741482640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa73c0b64b0 0x7fa73c0b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa741c83640 1 -- 172.21.15.81:0/1907886945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa73c161c80 msgr2=0x7fa73c1591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa741c83640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa73c161c80 0x7fa73c1591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa741c83640 1 -- 172.21.15.81:0/1907886945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa73c0b64b0 msgr2=0x7fa73c0b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa741c83640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa73c0b64b0 0x7fa73c0b8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa741c83640 1 -- 172.21.15.81:0/1907886945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa73c0b7cb0 con 0x7fa73c162060 2024-09-16T01:24:16.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa741c83640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c162060 0x7fa73c0b7340 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fa73400cef0 tx=0x7fa73400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:16.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa731ffb640 1 -- 172.21.15.81:0/1907886945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73401a070 con 0x7fa73c162060 2024-09-16T01:24:16.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa731ffb640 1 -- 172.21.15.81:0/1907886945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73400d860 con 0x7fa73c162060 2024-09-16T01:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa7436e6640 1 -- 172.21.15.81:0/1907886945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa73c0b7f90 con 0x7fa73c162060 2024-09-16T01:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa731ffb640 1 -- 172.21.15.81:0/1907886945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73400dc50 con 0x7fa73c162060 2024-09-16T01:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.463+0000 7fa7436e6640 1 -- 172.21.15.81:0/1907886945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73c0b8550 con 0x7fa73c162060 2024-09-16T01:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.464+0000 7fa7436e6640 1 -- 172.21.15.81:0/1907886945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa73c0b5f70 con 0x7fa73c162060 2024-09-16T01:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.465+0000 7fa731ffb640 1 -- 172.21.15.81:0/1907886945 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa73401d070 con 0x7fa73c162060 2024-09-16T01:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.465+0000 7fa731ffb640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa72006c2b0 0x7fa72006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.465+0000 7fa731ffb640 1 -- 172.21.15.81:0/1907886945 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7fa73408bba0 con 0x7fa73c162060 2024-09-16T01:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.465+0000 7fa741482640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa72006c2b0 0x7fa72006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.466+0000 7fa741482640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa72006c2b0 0x7fa72006e770 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa73c1f7cd0 tx=0x7fa738009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:16.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.470+0000 7fa731ffb640 1 -- 172.21.15.81:0/1907886945 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa73405a540 con 0x7fa73c162060 2024-09-16T01:24:16.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.634+0000 7fa7436e6640 1 -- 172.21.15.81:0/1907886945 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa73c0ba470 con 0x7fa72006c2b0 2024-09-16T01:24:16.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.635+0000 7fa731ffb640 1 -- 172.21.15.81:0/1907886945 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13443 (secure 0 0 0) 0x7fa73c0ba470 con 0x7fa72006c2b0 2024-09-16T01:24:16.637 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:16.637 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:24:16.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.637+0000 7fa7436e6640 1 -- 172.21.15.81:0/1907886945 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa72006c2b0 msgr2=0x7fa72006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.637+0000 7fa7436e6640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa72006c2b0 0x7fa72006e770 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fa73c1f7cd0 tx=0x7fa738009040 comp rx=0 tx=0).stop 2024-09-16T01:24:16.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.637+0000 7fa7436e6640 1 -- 172.21.15.81:0/1907886945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c162060 msgr2=0x7fa73c0b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.637+0000 7fa7436e6640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c162060 0x7fa73c0b7340 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fa73400cef0 tx=0x7fa73400a710 comp rx=0 tx=0).stop 2024-09-16T01:24:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.637+0000 7fa7436e6640 1 -- 172.21.15.81:0/1907886945 shutdown_connections 2024-09-16T01:24:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.637+0000 7fa7436e6640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa72006c2b0 0x7fa72006e770 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.637+0000 7fa7436e6640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c162060 0x7fa73c0b7340 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.637+0000 7fa7436e6640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa73c161c80 0x7fa73c1591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.637+0000 7fa7436e6640 1 --2- 172.21.15.81:0/1907886945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa73c0b64b0 0x7fa73c0b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.637+0000 7fa7436e6640 1 -- 172.21.15.81:0/1907886945 >> 172.21.15.81:0/1907886945 conn(0x7fa73c0d44f0 msgr2=0x7fa73c0d3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.638+0000 7fa7436e6640 1 -- 172.21.15.81:0/1907886945 shutdown_connections 2024-09-16T01:24:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.638+0000 7fa7436e6640 1 -- 172.21.15.81:0/1907886945 wait complete. 2024-09-16T01:24:16.650 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-09-16T01:24:16.170895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":273800,"kb_used_data":15976,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754700920,"statfs":{"total":773094113280,"available":772813742080,"internally_reserved":0,"allocated":16359424,"data_stored":8186590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3909,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000968"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":407,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-16T01:24:11.214344+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:24:11.214344+0000","last_peered":"2024-09-16T01:24:11.214344+0000","last_clean":"2024-09-16T01:24:11.214344+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:24:11.214344+0000","last_undegraded":"2024-09-16T01:24:11.214344+0000","last_fullsized":"2024-09-16T01:24:11.214344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33612,"kb_used_data":2424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338228,"statfs":{"total":96636764160,"available":96602345472,"internally_reserved":0,"allocated":2482176,"data_stored":1465052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574957,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37192,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334648,"statfs":{"total":96636764160,"available":96598679552,"internally_reserved":0,"allocated":1888256,"data_stored":874684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574956,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33040,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338800,"statfs":{"total":96636764160,"available":96602931200,"internally_reserved":0,"allocated":1896448,"data_stored":874808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37208,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334632,"statfs":{"total":96636764160,"available":96598663168,"internally_reserved":0,"allocated":1904640,"data_stored":875448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33052,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338788,"statfs":{"total":96636764160,"available":96602918912,"internally_reserved":0,"allocated":1908736,"data_stored":878681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574957,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1888256,"data_stored":874684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1900544,"data_stored":878077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33620,"kb_used_data":2432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338220,"statfs":{"total":96636764160,"available":96602337280,"internally_reserved":0,"allocated":2490368,"data_stored":1465156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:24:16.651 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-16T01:24:16.651 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:24:16.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.747+0000 7f653f978640 1 Processor -- start 2024-09-16T01:24:16.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.747+0000 7f653f978640 1 -- start start 2024-09-16T01:24:16.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653f978640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6538147360 0x7f6538070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653f978640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6538070dd0 0x7f65380d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653f978640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f653806cb30 con 0x7f65380d09e0 2024-09-16T01:24:16.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653f978640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f65380d0e30 con 0x7f6538070dd0 2024-09-16T01:24:16.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653f978640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f653806bfb0 con 0x7f6538147360 2024-09-16T01:24:16.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653df15640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f65380d09e0 0x7f653806f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37460/0 (socket says 172.21.15.81:37460) 2024-09-16T01:24:16.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653df15640 1 -- 172.21.15.81:0/3880845647 learned_addr learned my addr 172.21.15.81:0/3880845647 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:16.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653d714640 1 --2- 172.21.15.81:0/3880845647 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6538147360 0x7f6538070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653cf13640 1 --2- 172.21.15.81:0/3880845647 >> v2:172.21.15.102:3300/0 conn(0x7f6538070dd0 0x7f65380d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f652bfff640 1 -- 172.21.15.81:0/3880845647 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2900081474 0 0) 0x7f653806cb30 con 0x7f65380d09e0 2024-09-16T01:24:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f652bfff640 1 -- 172.21.15.81:0/3880845647 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6524003520 con 0x7f65380d09e0 2024-09-16T01:24:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653d714640 1 -- 172.21.15.81:0/3880845647 >> v2:172.21.15.102:3300/0 conn(0x7f6538070dd0 msgr2=0x7f65380d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653d714640 1 --2- 172.21.15.81:0/3880845647 >> v2:172.21.15.102:3300/0 conn(0x7f6538070dd0 0x7f65380d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653d714640 1 -- 172.21.15.81:0/3880845647 >> v1:172.21.15.81:6789/0 conn(0x7f65380d09e0 legacy=0x7f653806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653d714640 1 -- 172.21.15.81:0/3880845647 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653806c290 con 0x7f6538147360 2024-09-16T01:24:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.748+0000 7f653cf13640 1 --2- 172.21.15.81:0/3880845647 >> v2:172.21.15.102:3300/0 conn(0x7f6538070dd0 0x7f65380d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.749+0000 7f653d714640 1 --2- 172.21.15.81:0/3880845647 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6538147360 0x7f6538070890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f65340097a0 tx=0x7f653402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae6cbd4b104ed8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.749+0000 7f652bfff640 1 -- 172.21.15.81:0/3880845647 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534037070 con 0x7f6538147360 2024-09-16T01:24:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.749+0000 7f652bfff640 1 -- 172.21.15.81:0/3880845647 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653402ae50 con 0x7f6538147360 2024-09-16T01:24:16.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.749+0000 7f652bfff640 1 -- 172.21.15.81:0/3880845647 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534032660 con 0x7f6538147360 2024-09-16T01:24:16.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.750+0000 7f653f978640 1 -- 172.21.15.81:0/3880845647 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6538147360 msgr2=0x7f6538070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.750+0000 7f653f978640 1 --2- 172.21.15.81:0/3880845647 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6538147360 0x7f6538070890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f65340097a0 tx=0x7f653402a100 comp rx=0 tx=0).stop 2024-09-16T01:24:16.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.750+0000 7f653f978640 1 -- 172.21.15.81:0/3880845647 shutdown_connections 2024-09-16T01:24:16.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.750+0000 7f653f978640 1 --2- 172.21.15.81:0/3880845647 >> v2:172.21.15.102:3300/0 conn(0x7f6538070dd0 0x7f65380d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.750+0000 7f653f978640 1 --2- 172.21.15.81:0/3880845647 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6538147360 0x7f6538070890 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.750+0000 7f653f978640 1 -- 172.21.15.81:0/3880845647 >> 172.21.15.81:0/3880845647 conn(0x7f65380b2f40 msgr2=0x7f65380b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.750+0000 7f653f978640 1 -- 172.21.15.81:0/3880845647 shutdown_connections 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.750+0000 7f653f978640 1 -- 172.21.15.81:0/3880845647 wait complete. 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.751+0000 7f653f978640 1 Processor -- start 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.751+0000 7f653f978640 1 -- start start 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653f978640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6538070dd0 0x7f65380cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653f978640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65380d09e0 0x7f65380cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653f978640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6538147360 0x7f6538143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653f978640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f653806bc10 con 0x7f65380d09e0 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653f978640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f653806c850 con 0x7f6538147360 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653f978640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f653806bd90 con 0x7f6538070dd0 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653cf13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65380d09e0 0x7f65380cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653cf13640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65380d09e0 0x7f65380cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33456/0 (socket says 172.21.15.81:33456) 2024-09-16T01:24:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653cf13640 1 -- 172.21.15.81:0/3152948155 learned_addr learned my addr 172.21.15.81:0/3152948155 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653d714640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6538070dd0 0x7f65380cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653df15640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6538147360 0x7f6538143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653cf13640 1 -- 172.21.15.81:0/3152948155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6538070dd0 msgr2=0x7f65380cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653cf13640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6538070dd0 0x7f65380cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653cf13640 1 -- 172.21.15.81:0/3152948155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6538147360 msgr2=0x7f6538143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653cf13640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6538147360 0x7f6538143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653cf13640 1 -- 172.21.15.81:0/3152948155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65380cddb0 con 0x7f65380d09e0 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f653cf13640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65380d09e0 0x7f65380cd870 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f652c00ebb0 tx=0x7f652c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f6529ffb640 1 -- 172.21.15.81:0/3152948155 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c017070 con 0x7f65380d09e0 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.752+0000 7f6529ffb640 1 -- 172.21.15.81:0/3152948155 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f652c00cc30 con 0x7f65380d09e0 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.753+0000 7f653f978640 1 -- 172.21.15.81:0/3152948155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65380ce030 con 0x7f65380d09e0 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.753+0000 7f6529ffb640 1 -- 172.21.15.81:0/3152948155 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c013470 con 0x7f65380d09e0 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.753+0000 7f653f978640 1 -- 172.21.15.81:0/3152948155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65380ce5f0 con 0x7f65380d09e0 2024-09-16T01:24:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.754+0000 7f653f978640 1 -- 172.21.15.81:0/3152948155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65380d04a0 con 0x7f65380d09e0 2024-09-16T01:24:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.754+0000 7f6529ffb640 1 -- 172.21.15.81:0/3152948155 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f652c01a070 con 0x7f65380d09e0 2024-09-16T01:24:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.755+0000 7f6529ffb640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f651c06c2b0 0x7f651c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.755+0000 7f653d714640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f651c06c2b0 0x7f651c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.755+0000 7f6529ffb640 1 -- 172.21.15.81:0/3152948155 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f652c08b190 con 0x7f65380d09e0 2024-09-16T01:24:16.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.755+0000 7f653d714640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f651c06c2b0 0x7f651c06e770 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6534034000 tx=0x7f653402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:16.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.759+0000 7f6529ffb640 1 -- 172.21.15.81:0/3152948155 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65380cddb0 con 0x7f65380d09e0 2024-09-16T01:24:16.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.924+0000 7f653f978640 1 -- 172.21.15.81:0/3152948155 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65380b6220 con 0x7f651c06c2b0 2024-09-16T01:24:16.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.925+0000 7f6529ffb640 1 -- 172.21.15.81:0/3152948155 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13443 (secure 0 0 0) 0x7f65380b6220 con 0x7f651c06c2b0 2024-09-16T01:24:16.927 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:16.927 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:24:16.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.927+0000 7f653f978640 1 -- 172.21.15.81:0/3152948155 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f651c06c2b0 msgr2=0x7f651c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.927+0000 7f653f978640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f651c06c2b0 0x7f651c06e770 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6534034000 tx=0x7f653402e000 comp rx=0 tx=0).stop 2024-09-16T01:24:16.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.927+0000 7f653f978640 1 -- 172.21.15.81:0/3152948155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65380d09e0 msgr2=0x7f65380cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:16.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.927+0000 7f653f978640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65380d09e0 0x7f65380cd870 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f652c00ebb0 tx=0x7f652c00c520 comp rx=0 tx=0).stop 2024-09-16T01:24:16.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.928+0000 7f653f978640 1 -- 172.21.15.81:0/3152948155 shutdown_connections 2024-09-16T01:24:16.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.928+0000 7f653f978640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f651c06c2b0 0x7f651c06e770 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.928+0000 7f653f978640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6538147360 0x7f6538143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.928+0000 7f653f978640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65380d09e0 0x7f65380cd870 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.928+0000 7f653f978640 1 --2- 172.21.15.81:0/3152948155 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6538070dd0 0x7f65380cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:16.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.928+0000 7f653f978640 1 -- 172.21.15.81:0/3152948155 >> 172.21.15.81:0/3152948155 conn(0x7f65380b2f40 msgr2=0x7f65380b6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:16.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.928+0000 7f653f978640 1 -- 172.21.15.81:0/3152948155 shutdown_connections 2024-09-16T01:24:16.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:16.928+0000 7f653f978640 1 -- 172.21.15.81:0/3152948155 wait complete. 2024-09-16T01:24:16.940 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":409,"stamp":"2024-09-16T01:24:16.170895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":273800,"kb_used_data":15976,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754700920,"statfs":{"total":773094113280,"available":772813742080,"internally_reserved":0,"allocated":16359424,"data_stored":8186590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3909,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000968"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":407,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-09-16T01:24:11.214344+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:24:11.214344+0000","last_peered":"2024-09-16T01:24:11.214344+0000","last_clean":"2024-09-16T01:24:11.214344+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:24:11.214344+0000","last_undegraded":"2024-09-16T01:24:11.214344+0000","last_fullsized":"2024-09-16T01:24:11.214344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33612,"kb_used_data":2424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338228,"statfs":{"total":96636764160,"available":96602345472,"internally_reserved":0,"allocated":2482176,"data_stored":1465052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574957,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37192,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334648,"statfs":{"total":96636764160,"available":96598679552,"internally_reserved":0,"allocated":1888256,"data_stored":874684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574956,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33040,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338800,"statfs":{"total":96636764160,"available":96602931200,"internally_reserved":0,"allocated":1896448,"data_stored":874808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37208,"kb_used_data":1860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334632,"statfs":{"total":96636764160,"available":96598663168,"internally_reserved":0,"allocated":1904640,"data_stored":875448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33052,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338788,"statfs":{"total":96636764160,"available":96602918912,"internally_reserved":0,"allocated":1908736,"data_stored":878681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574957,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33032,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338808,"statfs":{"total":96636764160,"available":96602939392,"internally_reserved":0,"allocated":1888256,"data_stored":874684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1900544,"data_stored":878077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33620,"kb_used_data":2432,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338220,"statfs":{"total":96636764160,"available":96602337280,"internally_reserved":0,"allocated":2490368,"data_stored":1465156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:24:16.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-16T01:24:17.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.038+0000 7fab87713640 1 Processor -- start 2024-09-16T01:24:17.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.038+0000 7fab87713640 1 -- start start 2024-09-16T01:24:17.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab87713640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fab8015b300 0x7fab800cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:17.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab87713640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab800cd3f0 0x7fab8006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:17.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab87713640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab800cdbe0 con 0x7fab80072d30 2024-09-16T01:24:17.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab87713640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fab800728a0 con 0x7fab800cd3f0 2024-09-16T01:24:17.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab87713640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fab800cd900 con 0x7fab8015b300 2024-09-16T01:24:17.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab84cae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab800cd3f0 0x7fab8006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:17.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab84cae640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab800cd3f0 0x7fab8006f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33468/0 (socket says 172.21.15.81:33468) 2024-09-16T01:24:17.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab84cae640 1 -- 172.21.15.81:0/3583093702 learned_addr learned my addr 172.21.15.81:0/3583093702 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:17.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab854af640 1 --2- 172.21.15.81:0/3583093702 >> v2:172.21.15.102:3300/0 conn(0x7fab8015b300 0x7fab800cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:17.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab84cae640 1 -- 172.21.15.81:0/3583093702 >> v2:172.21.15.102:3300/0 conn(0x7fab8015b300 msgr2=0x7fab800cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab84cae640 1 --2- 172.21.15.81:0/3583093702 >> v2:172.21.15.102:3300/0 conn(0x7fab8015b300 0x7fab800cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab84cae640 1 -- 172.21.15.81:0/3583093702 >> v1:172.21.15.102:6789/0 conn(0x7fab80072d30 legacy=0x7fab800b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.039+0000 7fab84cae640 1 -- 172.21.15.81:0/3583093702 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab80072250 con 0x7fab800cd3f0 2024-09-16T01:24:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.040+0000 7fab84cae640 1 --2- 172.21.15.81:0/3583093702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab800cd3f0 0x7fab8006f1c0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fab80070250 tx=0x7fab7002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9e5a76221293e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.040+0000 7fab77fff640 1 -- 172.21.15.81:0/3583093702 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70037070 con 0x7fab800cd3f0 2024-09-16T01:24:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.040+0000 7fab77fff640 1 -- 172.21.15.81:0/3583093702 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab70032440 con 0x7fab800cd3f0 2024-09-16T01:24:17.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.040+0000 7fab77fff640 1 -- 172.21.15.81:0/3583093702 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab70032810 con 0x7fab800cd3f0 2024-09-16T01:24:17.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.041+0000 7fab87713640 1 -- 172.21.15.81:0/3583093702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab800cd3f0 msgr2=0x7fab8006f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:17.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.041+0000 7fab87713640 1 --2- 172.21.15.81:0/3583093702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab800cd3f0 0x7fab8006f1c0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fab80070250 tx=0x7fab7002a230 comp rx=0 tx=0).stop 2024-09-16T01:24:17.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.041+0000 7fab87713640 1 -- 172.21.15.81:0/3583093702 shutdown_connections 2024-09-16T01:24:17.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.041+0000 7fab87713640 1 --2- 172.21.15.81:0/3583093702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab800cd3f0 0x7fab8006f1c0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:17.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.041+0000 7fab87713640 1 --2- 172.21.15.81:0/3583093702 >> v2:172.21.15.102:3300/0 conn(0x7fab8015b300 0x7fab800cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:17.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.041+0000 7fab87713640 1 -- 172.21.15.81:0/3583093702 >> 172.21.15.81:0/3583093702 conn(0x7fab80067d70 msgr2=0x7fab8006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:17.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.041+0000 7fab87713640 1 -- 172.21.15.81:0/3583093702 shutdown_connections 2024-09-16T01:24:17.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.041+0000 7fab87713640 1 -- 172.21.15.81:0/3583093702 wait complete. 2024-09-16T01:24:17.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.042+0000 7fab87713640 1 Processor -- start 2024-09-16T01:24:17.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.042+0000 7fab87713640 1 -- start start 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab87713640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab80072d30 0x7fab80151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab87713640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab800cd3f0 0x7fab80150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab87713640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab8015b300 0x7fab8006dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab87713640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab800d0160 con 0x7fab80072d30 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab87713640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fab800cffe0 con 0x7fab800cd3f0 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab87713640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fab8006f700 con 0x7fab8015b300 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab854af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab80072d30 0x7fab80151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab854af640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab80072d30 0x7fab80151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33480/0 (socket says 172.21.15.81:33480) 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab854af640 1 -- 172.21.15.81:0/1381892263 learned_addr learned my addr 172.21.15.81:0/1381892263 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab854af640 1 -- 172.21.15.81:0/1381892263 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab8015b300 msgr2=0x7fab8006dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab854af640 1 --2- 172.21.15.81:0/1381892263 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab8015b300 0x7fab8006dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab854af640 1 -- 172.21.15.81:0/1381892263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab800cd3f0 msgr2=0x7fab80150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:17.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab854af640 1 --2- 172.21.15.81:0/1381892263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab800cd3f0 0x7fab80150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:17.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab854af640 1 -- 172.21.15.81:0/1381892263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab800c6a80 con 0x7fab80072d30 2024-09-16T01:24:17.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab854af640 1 --2- 172.21.15.81:0/1381892263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab80072d30 0x7fab80151000 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00d5f0 tx=0x7fab7c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:17.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab75ffb640 1 -- 172.21.15.81:0/1381892263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0125f0 con 0x7fab80072d30 2024-09-16T01:24:17.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab75ffb640 1 -- 172.21.15.81:0/1381892263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7c019070 con 0x7fab80072d30 2024-09-16T01:24:17.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab87713640 1 -- 172.21.15.81:0/1381892263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab80155de0 con 0x7fab80072d30 2024-09-16T01:24:17.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab75ffb640 1 -- 172.21.15.81:0/1381892263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0129d0 con 0x7fab80072d30 2024-09-16T01:24:17.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.043+0000 7fab87713640 1 -- 172.21.15.81:0/1381892263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab801563a0 con 0x7fab80072d30 2024-09-16T01:24:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.045+0000 7fab87713640 1 -- 172.21.15.81:0/1381892263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8006fac0 con 0x7fab80072d30 2024-09-16T01:24:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.045+0000 7fab75ffb640 1 -- 172.21.15.81:0/1381892263 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fab7c012b70 con 0x7fab80072d30 2024-09-16T01:24:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.045+0000 7fab75ffb640 1 --2- 172.21.15.81:0/1381892263 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fab6406c2b0 0x7fab6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.045+0000 7fab75ffb640 1 -- 172.21.15.81:0/1381892263 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7fab7c08b620 con 0x7fab80072d30 2024-09-16T01:24:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.045+0000 7fab84cae640 1 --2- 172.21.15.81:0/1381892263 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fab6406c2b0 0x7fab6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.046+0000 7fab84cae640 1 --2- 172.21.15.81:0/1381892263 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fab6406c2b0 0x7fab6406e770 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fab70034000 tx=0x7fab7002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:17.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.049+0000 7fab75ffb640 1 -- 172.21.15.81:0/1381892263 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab7c059f90 con 0x7fab80072d30 2024-09-16T01:24:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.218+0000 7fab87713640 1 -- 172.21.15.81:0/1381892263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab8015c020 con 0x7fab80072d30 2024-09-16T01:24:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.219+0000 7fab75ffb640 1 -- 172.21.15.81:0/1381892263 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) ==== 74+0+13315 (secure 0 0 0) 0x7fab7c059890 con 0x7fab80072d30 2024-09-16T01:24:17.221 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:17.221 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":152,"fsid":"a7c8d4b4-fcf0-4a07-b75a-4e0b298d7973","created":"2024-09-16T01:15:16.025172+0000","modified":"2024-09-16T01:24:14.161755+0000","last_up_change":"2024-09-16T01:15:28.017621+0000","last_in_change":"2024-09-16T01:15:18.141792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T01:15:28.088452+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79091d3d-fd64-4212-82b8-8a55acc7aa49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6817","nonce":2041738643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6819","nonce":2041738643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6823","nonce":2041738643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2041738643},{"type":"v1","addr":"172.21.15.81:6821","nonce":2041738643}]},"public_addr":"172.21.15.81:6817/2041738643","cluster_addr":"172.21.15.81:6819/2041738643","heartbeat_back_addr":"172.21.15.81:6823/2041738643","heartbeat_front_addr":"172.21.15.81:6821/2041738643","state":["exists","up"]},{"osd":1,"uuid":"75c9bff1-ab46-4ce0-b3c2-75302021affc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6801","nonce":1559362497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6803","nonce":1559362497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6807","nonce":1559362497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1559362497},{"type":"v1","addr":"172.21.15.81:6805","nonce":1559362497}]},"public_addr":"172.21.15.81:6801/1559362497","cluster_addr":"172.21.15.81:6803/1559362497","heartbeat_back_addr":"172.21.15.81:6807/1559362497","heartbeat_front_addr":"172.21.15.81:6805/1559362497","state":["exists","up"]},{"osd":2,"uuid":"292f046c-3cd5-4df5-976c-1e6d40d4ca60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6827","nonce":3728781080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6829","nonce":3728781080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6833","nonce":3728781080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":3728781080},{"type":"v1","addr":"172.21.15.81:6831","nonce":3728781080}]},"public_addr":"172.21.15.81:6827/3728781080","cluster_addr":"172.21.15.81:6829/3728781080","heartbeat_back_addr":"172.21.15.81:6833/3728781080","heartbeat_front_addr":"172.21.15.81:6831/3728781080","state":["exists","up"]},{"osd":3,"uuid":"d8bf03f0-5d58-45cf-a445-f4d5f465544e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6809","nonce":3410907338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6811","nonce":3410907338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6815","nonce":3410907338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":3410907338},{"type":"v1","addr":"172.21.15.81:6813","nonce":3410907338}]},"public_addr":"172.21.15.81:6809/3410907338","cluster_addr":"172.21.15.81:6811/3410907338","heartbeat_back_addr":"172.21.15.81:6815/3410907338","heartbeat_front_addr":"172.21.15.81:6813/3410907338","state":["exists","up"]},{"osd":4,"uuid":"974c34ea-d019-439a-8625-9f4036107649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6811","nonce":1702667483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6813","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6815","nonce":1702667483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6821","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6823","nonce":1702667483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6817","nonce":1702667483},{"type":"v1","addr":"172.21.15.102:6819","nonce":1702667483}]},"public_addr":"172.21.15.102:6811/1702667483","cluster_addr":"172.21.15.102:6815/1702667483","heartbeat_back_addr":"172.21.15.102:6823/1702667483","heartbeat_front_addr":"172.21.15.102:6819/1702667483","state":["exists","up"]},{"osd":5,"uuid":"1942eaca-07bb-490a-b314-9804f2c3932f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6810","nonce":366563181}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6814","nonce":366563181}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6822","nonce":366563181}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":366563181},{"type":"v1","addr":"172.21.15.102:6818","nonce":366563181}]},"public_addr":"172.21.15.102:6810/366563181","cluster_addr":"172.21.15.102:6814/366563181","heartbeat_back_addr":"172.21.15.102:6822/366563181","heartbeat_front_addr":"172.21.15.102:6818/366563181","state":["exists","up"]},{"osd":6,"uuid":"a6b65b9d-4b55-407e-9736-9f88c76f2325","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6825","nonce":136250174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6827","nonce":136250174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6831","nonce":136250174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":136250174},{"type":"v1","addr":"172.21.15.102:6829","nonce":136250174}]},"public_addr":"172.21.15.102:6825/136250174","cluster_addr":"172.21.15.102:6827/136250174","heartbeat_back_addr":"172.21.15.102:6831/136250174","heartbeat_front_addr":"172.21.15.102:6829/136250174","state":["exists","up"]},{"osd":7,"uuid":"83bb35ce-e93a-444c-a66b-9d414122d8af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6801","nonce":1527646643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6803","nonce":1527646643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6807","nonce":1527646643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":1527646643},{"type":"v1","addr":"172.21.15.102:6805","nonce":1527646643}]},"public_addr":"172.21.15.102:6801/1527646643","cluster_addr":"172.21.15.102:6803/1527646643","heartbeat_back_addr":"172.21.15.102:6807/1527646643","heartbeat_front_addr":"172.21.15.102:6805/1527646643","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.468849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.717565+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.917220+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.713111+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.706169+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.726749+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.773853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T01:15:24.429446+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/3797465908":"2024-09-17T01:24:11.152401+0000","172.21.15.81:6835/3797465908":"2024-09-17T01:24:11.152401+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T01:24:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.221+0000 7fab87713640 1 -- 172.21.15.81:0/1381892263 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fab6406c2b0 msgr2=0x7fab6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.221+0000 7fab87713640 1 --2- 172.21.15.81:0/1381892263 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fab6406c2b0 0x7fab6406e770 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fab70034000 tx=0x7fab7002c000 comp rx=0 tx=0).stop 2024-09-16T01:24:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.221+0000 7fab87713640 1 -- 172.21.15.81:0/1381892263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab80072d30 msgr2=0x7fab80151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.221+0000 7fab87713640 1 --2- 172.21.15.81:0/1381892263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab80072d30 0x7fab80151000 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00d5f0 tx=0x7fab7c00dab0 comp rx=0 tx=0).stop 2024-09-16T01:24:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.221+0000 7fab87713640 1 -- 172.21.15.81:0/1381892263 shutdown_connections 2024-09-16T01:24:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.221+0000 7fab87713640 1 --2- 172.21.15.81:0/1381892263 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fab6406c2b0 0x7fab6406e770 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.221+0000 7fab87713640 1 --2- 172.21.15.81:0/1381892263 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab8015b300 0x7fab8006dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.221+0000 7fab87713640 1 --2- 172.21.15.81:0/1381892263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab800cd3f0 0x7fab80150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:17.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.221+0000 7fab87713640 1 --2- 172.21.15.81:0/1381892263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab80072d30 0x7fab80151000 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:17.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.221+0000 7fab87713640 1 -- 172.21.15.81:0/1381892263 >> 172.21.15.81:0/1381892263 conn(0x7fab80067d70 msgr2=0x7fab8015a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:17.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.221+0000 7fab87713640 1 -- 172.21.15.81:0/1381892263 shutdown_connections 2024-09-16T01:24:17.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:17.221+0000 7fab87713640 1 -- 172.21.15.81:0/1381892263 wait complete. 2024-09-16T01:24:18.235 INFO:tasks.ceph:Scrubbing osd.0 2024-09-16T01:24:18.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:24:18.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.349+0000 7f3a7ab78640 1 Processor -- start 2024-09-16T01:24:18.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.349+0000 7f3a7ab78640 1 -- start start 2024-09-16T01:24:18.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.350+0000 7f3a7ab78640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3a7415e410 0x7f3a740b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.350+0000 7f3a7ab78640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3a7406bc10 0x7f3a7406c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.350+0000 7f3a7ab78640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a740ae240 con 0x7f3a740b40c0 2024-09-16T01:24:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.350+0000 7f3a7ab78640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3a7406c5c0 con 0x7f3a7415e410 2024-09-16T01:24:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.350+0000 7f3a7ab78640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3a740ae520 con 0x7f3a7406bc10 2024-09-16T01:24:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.350+0000 7f3a78914640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3a7415e410 0x7f3a740b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.350+0000 7f3a78914640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3a7415e410 0x7f3a740b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33492/0 (socket says 172.21.15.81:33492) 2024-09-16T01:24:18.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.350+0000 7f3a78914640 1 -- 172.21.15.81:0/741756425 learned_addr learned my addr 172.21.15.81:0/741756425 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:18.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.351+0000 7f3a78914640 1 -- 172.21.15.81:0/741756425 >> v2:172.21.15.102:3300/0 conn(0x7f3a7406bc10 msgr2=0x7f3a7406c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:18.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.351+0000 7f3a78914640 1 --2- 172.21.15.81:0/741756425 >> v2:172.21.15.102:3300/0 conn(0x7f3a7406bc10 0x7f3a7406c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.351+0000 7f3a78914640 1 -- 172.21.15.81:0/741756425 >> v1:172.21.15.102:6789/0 conn(0x7f3a740b40c0 legacy=0x7f3a740aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:18.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.351+0000 7f3a78914640 1 -- 172.21.15.81:0/741756425 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a740ae800 con 0x7f3a7415e410 2024-09-16T01:24:18.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.351+0000 7f3a78914640 1 --2- 172.21.15.81:0/741756425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a7415e410 0x7f3a740b5fe0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f3a740b5510 tx=0x7f3a6402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9271bf868beb94 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.351+0000 7f3a737fe640 1 -- 172.21.15.81:0/741756425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64037070 con 0x7f3a7415e410 2024-09-16T01:24:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.352+0000 7f3a737fe640 1 -- 172.21.15.81:0/741756425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a64032440 con 0x7f3a7415e410 2024-09-16T01:24:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.352+0000 7f3a737fe640 1 -- 172.21.15.81:0/741756425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a64032810 con 0x7f3a7415e410 2024-09-16T01:24:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.352+0000 7f3a7ab78640 1 -- 172.21.15.81:0/741756425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a7415e410 msgr2=0x7f3a740b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.352+0000 7f3a7ab78640 1 --2- 172.21.15.81:0/741756425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a7415e410 0x7f3a740b5fe0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f3a740b5510 tx=0x7f3a6402a1a0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.352+0000 7f3a7ab78640 1 -- 172.21.15.81:0/741756425 shutdown_connections 2024-09-16T01:24:18.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.352+0000 7f3a7ab78640 1 --2- 172.21.15.81:0/741756425 >> v2:172.21.15.102:3300/0 conn(0x7f3a7406bc10 0x7f3a7406c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.352+0000 7f3a7ab78640 1 --2- 172.21.15.81:0/741756425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a7415e410 0x7f3a740b5fe0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.352+0000 7f3a7ab78640 1 -- 172.21.15.81:0/741756425 >> 172.21.15.81:0/741756425 conn(0x7f3a7409aa30 msgr2=0x7f3a740b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.352+0000 7f3a7ab78640 1 -- 172.21.15.81:0/741756425 shutdown_connections 2024-09-16T01:24:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.352+0000 7f3a7ab78640 1 -- 172.21.15.81:0/741756425 wait complete. 2024-09-16T01:24:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.353+0000 7f3a7ab78640 1 Processor -- start 2024-09-16T01:24:18.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.353+0000 7f3a7ab78640 1 -- start start 2024-09-16T01:24:18.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.354+0000 7f3a7ab78640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a7406bc10 0x7f3a741f48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.354+0000 7f3a7ab78640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a740b40c0 0x7f3a74160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.354+0000 7f3a7ab78640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a7415e410 0x7f3a741e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.354+0000 7f3a7ab78640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7415e7f0 con 0x7f3a740b40c0 2024-09-16T01:24:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.354+0000 7f3a7ab78640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3a740b4510 con 0x7f3a7406bc10 2024-09-16T01:24:18.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.354+0000 7f3a7ab78640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7415e970 con 0x7f3a7415e410 2024-09-16T01:24:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.354+0000 7f3a73fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a740b40c0 0x7f3a74160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.354+0000 7f3a73fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a740b40c0 0x7f3a74160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33504/0 (socket says 172.21.15.81:33504) 2024-09-16T01:24:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.354+0000 7f3a73fff640 1 -- 172.21.15.81:0/4179664140 learned_addr learned my addr 172.21.15.81:0/4179664140 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a78914640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a7406bc10 0x7f3a741f48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a79115640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a7415e410 0x7f3a741e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a73fff640 1 -- 172.21.15.81:0/4179664140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a7415e410 msgr2=0x7f3a741e7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a73fff640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a7415e410 0x7f3a741e7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a73fff640 1 -- 172.21.15.81:0/4179664140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a7406bc10 msgr2=0x7f3a741f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a73fff640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a7406bc10 0x7f3a741f48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a73fff640 1 -- 172.21.15.81:0/4179664140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a741f5170 con 0x7f3a740b40c0 2024-09-16T01:24:18.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a78914640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a7406bc10 0x7f3a741f48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:18.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a73fff640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a740b40c0 0x7f3a74160340 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c440 tx=0x7f3a6800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a717fa640 1 -- 172.21.15.81:0/4179664140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a68017070 con 0x7f3a740b40c0 2024-09-16T01:24:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a717fa640 1 -- 172.21.15.81:0/4179664140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a680035f0 con 0x7f3a740b40c0 2024-09-16T01:24:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a717fa640 1 -- 172.21.15.81:0/4179664140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a680039e0 con 0x7f3a740b40c0 2024-09-16T01:24:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a7ab78640 1 -- 172.21.15.81:0/4179664140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a741f5450 con 0x7f3a740b40c0 2024-09-16T01:24:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.355+0000 7f3a7ab78640 1 -- 172.21.15.81:0/4179664140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a741f5a10 con 0x7f3a740b40c0 2024-09-16T01:24:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.356+0000 7f3a7ab78640 1 -- 172.21.15.81:0/4179664140 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3a741f4ef0 con 0x7f3a740b40c0 2024-09-16T01:24:18.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.357+0000 7f3a717fa640 1 -- 172.21.15.81:0/4179664140 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3a6801a070 con 0x7f3a740b40c0 2024-09-16T01:24:18.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.357+0000 7f3a717fa640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a6006c2b0 0x7f3a6006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.357+0000 7f3a717fa640 1 -- 172.21.15.81:0/4179664140 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f3a6808a660 con 0x7f3a740b40c0 2024-09-16T01:24:18.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.357+0000 7f3a78914640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a6006c2b0 0x7f3a6006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.357+0000 7f3a717fa640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] conn(0x7f3a60072750 0x7f3a60074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.357+0000 7f3a717fa640 1 -- 172.21.15.81:0/4179664140 --> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a60075260 con 0x7f3a60072750 2024-09-16T01:24:18.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.357+0000 7f3a717fa640 1 -- 172.21.15.81:0/4179664140 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7f3a68091050 con 0x7f3a740b40c0 2024-09-16T01:24:18.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.357+0000 7f3a79115640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] conn(0x7f3a60072750 0x7f3a60074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.358+0000 7f3a78914640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a6006c2b0 0x7f3a6006e770 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3a64034000 tx=0x7f3a6402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.358+0000 7f3a79115640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] conn(0x7f3a60072750 0x7f3a60074b90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.358+0000 7f3a717fa640 1 -- 172.21.15.81:0/4179664140 <== osd.0 v2:172.21.15.81:6816/2041738643 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3a60075260 con 0x7f3a60072750 2024-09-16T01:24:18.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.371+0000 7f3a7ab78640 1 -- 172.21.15.81:0/4179664140 --> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3a740b6f00 con 0x7f3a60072750 2024-09-16T01:24:18.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.371+0000 7f3a717fa640 1 -- 172.21.15.81:0/4179664140 <== osd.0 v2:172.21.15.81:6816/2041738643 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3a740b6f00 con 0x7f3a60072750 2024-09-16T01:24:18.372 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:24:18.372 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:24:18.372 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:24:18.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.371+0000 7f3a7ab78640 1 -- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] conn(0x7f3a60072750 msgr2=0x7f3a60074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.371+0000 7f3a7ab78640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:6816/2041738643,v1:172.21.15.81:6817/2041738643] conn(0x7f3a60072750 0x7f3a60074b90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.372+0000 7f3a7ab78640 1 -- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a6006c2b0 msgr2=0x7f3a6006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.372+0000 7f3a7ab78640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3a6006c2b0 0x7f3a6006e770 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3a64034000 tx=0x7f3a6402e000 comp rx=0 tx=0).stop 2024-09-16T01:24:18.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.372+0000 7f3a7ab78640 1 -- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a740b40c0 msgr2=0x7f3a74160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.372+0000 7f3a7ab78640 1 --2- 172.21.15.81:0/4179664140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a740b40c0 0x7f3a74160340 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f3a6800c440 tx=0x7f3a6800c900 comp rx=0 tx=0).stop 2024-09-16T01:24:18.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.372+0000 7f3a79115640 1 -- 172.21.15.81:0/4179664140 reap_dead start 2024-09-16T01:24:18.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.372+0000 7f3a7ab78640 1 -- 172.21.15.81:0/4179664140 shutdown_connections 2024-09-16T01:24:18.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.372+0000 7f3a7ab78640 1 -- 172.21.15.81:0/4179664140 >> 172.21.15.81:0/4179664140 conn(0x7f3a7409aa30 msgr2=0x7f3a740b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:18.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.372+0000 7f3a7ab78640 1 -- 172.21.15.81:0/4179664140 shutdown_connections 2024-09-16T01:24:18.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.372+0000 7f3a7ab78640 1 -- 172.21.15.81:0/4179664140 wait complete. 2024-09-16T01:24:18.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-16T01:24:18.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.482+0000 7f89aa7a6640 1 Processor -- start 2024-09-16T01:24:18.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.482+0000 7f89aa7a6640 1 -- start start 2024-09-16T01:24:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.483+0000 7f89aa7a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f89a415e740 0x7f89a40d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.483+0000 7f89aa7a6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a40d0780 con 0x7f89a409b690 2024-09-16T01:24:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.483+0000 7f89aa7a6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a40d0a60 con 0x7f89a406dbd0 2024-09-16T01:24:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.483+0000 7f89aa7a6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f89a415eb20 con 0x7f89a415e740 2024-09-16T01:24:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.483+0000 7f89a37fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f89a409b690 0x7f89a406d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37466/0 (socket says 172.21.15.81:37466) 2024-09-16T01:24:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.483+0000 7f89a37fe640 1 -- 172.21.15.81:0/3050240028 learned_addr learned my addr 172.21.15.81:0/3050240028 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.483+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2284935715 0 0) 0x7f89a40d0780 con 0x7f89a409b690 2024-09-16T01:24:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.483+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f898c003520 con 0x7f89a409b690 2024-09-16T01:24:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.483+0000 7f89a3fff640 1 --2- 172.21.15.81:0/3050240028 >> v2:172.21.15.102:3300/0 conn(0x7f89a415e740 0x7f89a40d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3492036631 0 0) 0x7f898c003520 con 0x7f89a409b690 2024-09-16T01:24:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 >> v2:172.21.15.102:3300/0 conn(0x7f89a415e740 msgr2=0x7f89a40d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 --2- 172.21.15.81:0/3050240028 >> v2:172.21.15.102:3300/0 conn(0x7f89a415e740 0x7f89a40d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 >> v1:172.21.15.102:6789/0 conn(0x7f89a406dbd0 legacy=0x7f89a4070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a40d0d40 con 0x7f89a409b690 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f8998001670 con 0x7f89a409b690 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 >> v1:172.21.15.81:6789/0 conn(0x7f89a409b690 legacy=0x7f89a406d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 --2- 172.21.15.81:0/3050240028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f898c0039b0 0x7f898c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 --2- 172.21.15.81:0/3050240028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f898c004800 0x7f898c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 --2- 172.21.15.81:0/3050240028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f898c0051c0 0x7f898c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89a415eb20 con 0x7f898c004800 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f898c00c070 con 0x7f898c0051c0 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f898c00c270 con 0x7f898c0039b0 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a37fe640 1 --2- 172.21.15.81:0/3050240028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f898c004800 0x7f898c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a3fff640 1 --2- 172.21.15.81:0/3050240028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f898c0039b0 0x7f898c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a8d43640 1 --2- 172.21.15.81:0/3050240028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f898c0051c0 0x7f898c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a37fe640 1 -- 172.21.15.81:0/3050240028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f898c0039b0 msgr2=0x7f898c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a37fe640 1 --2- 172.21.15.81:0/3050240028 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f898c0039b0 0x7f898c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a37fe640 1 -- 172.21.15.81:0/3050240028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f898c0051c0 msgr2=0x7f898c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a37fe640 1 --2- 172.21.15.81:0/3050240028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f898c0051c0 0x7f898c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a37fe640 1 -- 172.21.15.81:0/3050240028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c003520 con 0x7f898c004800 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a8d43640 1 --2- 172.21.15.81:0/3050240028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f898c0051c0 0x7f898c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.484+0000 7f89a8d43640 1 -- 172.21.15.81:0/3050240028 reap_dead start 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.485+0000 7f89a37fe640 1 --2- 172.21.15.81:0/3050240028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f898c004800 0x7f898c004c80 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f899800c210 tx=0x7f898c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464f74877b9a5463 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.485+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998007d30 con 0x7f898c004800 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.485+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8998005ad0 con 0x7f898c004800 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.485+0000 7f89a2ffd640 1 -- 172.21.15.81:0/3050240028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998007070 con 0x7f898c004800 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.485+0000 7f89aa7a6640 1 -- 172.21.15.81:0/3050240028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f898c004800 msgr2=0x7f898c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.485+0000 7f89aa7a6640 1 --2- 172.21.15.81:0/3050240028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f898c004800 0x7f898c004c80 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f899800c210 tx=0x7f898c005830 comp rx=0 tx=0).stop 2024-09-16T01:24:18.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.485+0000 7f89aa7a6640 1 -- 172.21.15.81:0/3050240028 shutdown_connections 2024-09-16T01:24:18.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.485+0000 7f89aa7a6640 1 --2- 172.21.15.81:0/3050240028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f898c004800 0x7f898c004c80 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.485+0000 7f89aa7a6640 1 -- 172.21.15.81:0/3050240028 >> 172.21.15.81:0/3050240028 conn(0x7f89a40d23a0 msgr2=0x7f89a40d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:18.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.485+0000 7f89aa7a6640 1 -- 172.21.15.81:0/3050240028 shutdown_connections 2024-09-16T01:24:18.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.485+0000 7f89aa7a6640 1 -- 172.21.15.81:0/3050240028 wait complete. 2024-09-16T01:24:18.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.487+0000 7f89aa7a6640 1 Processor -- start 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.487+0000 7f89aa7a6640 1 -- start start 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.487+0000 7f89aa7a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f898c004800 0x7f89a40cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89aa7a6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89a40c96a0 0x7f89a40b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89aa7a6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89a40b7400 0x7f89a415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89aa7a6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89a406dfe0 con 0x7f89a40b7400 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89aa7a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f89a409bac0 con 0x7f898c004800 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89aa7a6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f89a40d1540 con 0x7f89a40c96a0 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a8d43640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89a40b7400 0x7f89a415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a8d43640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89a40b7400 0x7f89a415b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33532/0 (socket says 172.21.15.81:33532) 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a8d43640 1 -- 172.21.15.81:0/1278816298 learned_addr learned my addr 172.21.15.81:0/1278816298 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a3fff640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f898c004800 0x7f89a40cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a37fe640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89a40c96a0 0x7f89a40b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a8d43640 1 -- 172.21.15.81:0/1278816298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89a40c96a0 msgr2=0x7f89a40b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a8d43640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89a40c96a0 0x7f89a40b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a8d43640 1 -- 172.21.15.81:0/1278816298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f898c004800 msgr2=0x7f89a40cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a8d43640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f898c004800 0x7f89a40cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a8d43640 1 -- 172.21.15.81:0/1278816298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a40b7d90 con 0x7f89a40b7400 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a8d43640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89a40b7400 0x7f89a415b7c0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f89a40b1dd0 tx=0x7f899c00e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a0ff9640 1 -- 172.21.15.81:0/1278816298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c019070 con 0x7f89a40b7400 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a0ff9640 1 -- 172.21.15.81:0/1278816298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899c003b80 con 0x7f89a40b7400 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89aa7a6640 1 -- 172.21.15.81:0/1278816298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a40ca090 con 0x7f89a40b7400 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89a0ff9640 1 -- 172.21.15.81:0/1278816298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c0050d0 con 0x7f89a40b7400 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.488+0000 7f89aa7a6640 1 -- 172.21.15.81:0/1278816298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a40ca650 con 0x7f89a40b7400 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.489+0000 7f89aa7a6640 1 -- 172.21.15.81:0/1278816298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a40d0780 con 0x7f89a40b7400 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.490+0000 7f89a0ff9640 1 -- 172.21.15.81:0/1278816298 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f899c01c070 con 0x7f89a40b7400 2024-09-16T01:24:18.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.490+0000 7f89a0ff9640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f899006c2b0 0x7f899006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.490+0000 7f89a0ff9640 1 -- 172.21.15.81:0/1278816298 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f899c08a8c0 con 0x7f89a40b7400 2024-09-16T01:24:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.490+0000 7f89a3fff640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f899006c2b0 0x7f899006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.491+0000 7f89a3fff640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f899006c2b0 0x7f899006e770 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8994009a90 tx=0x7f8994008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.495+0000 7f89a0ff9640 1 -- 172.21.15.81:0/1278816298 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f899c0591a0 con 0x7f89a40b7400 2024-09-16T01:24:18.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.660+0000 7f89aa7a6640 1 -- 172.21.15.81:0/1278816298 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f89a40d1cb0 con 0x7f899006c2b0 2024-09-16T01:24:18.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.661+0000 7f89a0ff9640 1 -- 172.21.15.81:0/1278816298 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f89a40d1cb0 con 0x7f899006c2b0 2024-09-16T01:24:18.662 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2024-09-16T01:24:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.662+0000 7f89aa7a6640 1 -- 172.21.15.81:0/1278816298 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f899006c2b0 msgr2=0x7f899006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.663+0000 7f89aa7a6640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f899006c2b0 0x7f899006e770 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8994009a90 tx=0x7f8994008040 comp rx=0 tx=0).stop 2024-09-16T01:24:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.663+0000 7f89aa7a6640 1 -- 172.21.15.81:0/1278816298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89a40b7400 msgr2=0x7f89a415b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.663+0000 7f89aa7a6640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89a40b7400 0x7f89a415b7c0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f89a40b1dd0 tx=0x7f899c00e980 comp rx=0 tx=0).stop 2024-09-16T01:24:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.663+0000 7f89aa7a6640 1 -- 172.21.15.81:0/1278816298 shutdown_connections 2024-09-16T01:24:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.663+0000 7f89aa7a6640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f899006c2b0 0x7f899006e770 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.663+0000 7f89aa7a6640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89a40b7400 0x7f89a415b7c0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.663+0000 7f89aa7a6640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89a40c96a0 0x7f89a40b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.663+0000 7f89aa7a6640 1 --2- 172.21.15.81:0/1278816298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f898c004800 0x7f89a40cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.663+0000 7f89aa7a6640 1 -- 172.21.15.81:0/1278816298 >> 172.21.15.81:0/1278816298 conn(0x7f89a40d23a0 msgr2=0x7f89a40b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:18.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.663+0000 7f89aa7a6640 1 -- 172.21.15.81:0/1278816298 shutdown_connections 2024-09-16T01:24:18.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.663+0000 7f89aa7a6640 1 -- 172.21.15.81:0/1278816298 wait complete. 2024-09-16T01:24:18.674 INFO:tasks.ceph:Scrubbing osd.1 2024-09-16T01:24:18.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:24:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.775+0000 7f4286ae6640 1 Processor -- start 2024-09-16T01:24:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.775+0000 7f4286ae6640 1 -- start start 2024-09-16T01:24:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.776+0000 7f4286ae6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4280145e50 0x7f42800b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.776+0000 7f4286ae6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f428015d350 0x7f428006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.776+0000 7f4286ae6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f428006c150 0x7f428015e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.776+0000 7f4286ae6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f42800b7230 con 0x7f428015d350 2024-09-16T01:24:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.776+0000 7f4286ae6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f42800ae420 con 0x7f428006c150 2024-09-16T01:24:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.776+0000 7f4286ae6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f428015e4d0 con 0x7f4280145e50 2024-09-16T01:24:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.776+0000 7f427ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f428015d350 0x7f428006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.776+0000 7f427ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f428015d350 0x7f428006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33542/0 (socket says 172.21.15.81:33542) 2024-09-16T01:24:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.776+0000 7f427ffff640 1 -- 172.21.15.81:0/3863890197 learned_addr learned my addr 172.21.15.81:0/3863890197 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.776+0000 7f4284882640 1 --2- 172.21.15.81:0/3863890197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4280145e50 0x7f42800b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.776+0000 7f4285083640 1 --2- 172.21.15.81:0/3863890197 >> v2:172.21.15.102:3300/0 conn(0x7f428006c150 0x7f428015e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.777+0000 7f427ffff640 1 -- 172.21.15.81:0/3863890197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4280145e50 msgr2=0x7f42800b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.777+0000 7f427ffff640 1 --2- 172.21.15.81:0/3863890197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4280145e50 0x7f42800b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.777+0000 7f427ffff640 1 -- 172.21.15.81:0/3863890197 >> v2:172.21.15.102:3300/0 conn(0x7f428006c150 msgr2=0x7f428015e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.777+0000 7f427ffff640 1 --2- 172.21.15.81:0/3863890197 >> v2:172.21.15.102:3300/0 conn(0x7f428006c150 0x7f428015e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.777+0000 7f427ffff640 1 -- 172.21.15.81:0/3863890197 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428015d8a0 con 0x7f428015d350 2024-09-16T01:24:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.777+0000 7f427ffff640 1 --2- 172.21.15.81:0/3863890197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f428015d350 0x7f428006bc10 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f42800b4170 tx=0x7f426802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185fb45084efab6c server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.777+0000 7f427f7fe640 1 -- 172.21.15.81:0/3863890197 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268037070 con 0x7f428015d350 2024-09-16T01:24:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.777+0000 7f427f7fe640 1 -- 172.21.15.81:0/3863890197 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4268032440 con 0x7f428015d350 2024-09-16T01:24:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.777+0000 7f427f7fe640 1 -- 172.21.15.81:0/3863890197 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268032810 con 0x7f428015d350 2024-09-16T01:24:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.778+0000 7f4286ae6640 1 -- 172.21.15.81:0/3863890197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f428015d350 msgr2=0x7f428006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.778+0000 7f4286ae6640 1 --2- 172.21.15.81:0/3863890197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f428015d350 0x7f428006bc10 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f42800b4170 tx=0x7f426802a210 comp rx=0 tx=0).stop 2024-09-16T01:24:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.778+0000 7f4286ae6640 1 -- 172.21.15.81:0/3863890197 shutdown_connections 2024-09-16T01:24:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.778+0000 7f4286ae6640 1 --2- 172.21.15.81:0/3863890197 >> v2:172.21.15.102:3300/0 conn(0x7f428006c150 0x7f428015e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.778+0000 7f4286ae6640 1 --2- 172.21.15.81:0/3863890197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f428015d350 0x7f428006bc10 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.778+0000 7f4286ae6640 1 --2- 172.21.15.81:0/3863890197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4280145e50 0x7f42800b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.778+0000 7f4286ae6640 1 -- 172.21.15.81:0/3863890197 >> 172.21.15.81:0/3863890197 conn(0x7f428009aa30 msgr2=0x7f42800b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:18.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.778+0000 7f4286ae6640 1 -- 172.21.15.81:0/3863890197 shutdown_connections 2024-09-16T01:24:18.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.778+0000 7f4286ae6640 1 -- 172.21.15.81:0/3863890197 wait complete. 2024-09-16T01:24:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.779+0000 7f4286ae6640 1 Processor -- start 2024-09-16T01:24:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.779+0000 7f4286ae6640 1 -- start start 2024-09-16T01:24:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4286ae6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f428006c150 0x7f4280156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4286ae6640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4280145e50 0x7f42800cf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4286ae6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f428015d350 0x7f42800cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4286ae6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f428015e160 con 0x7f428015d350 2024-09-16T01:24:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4286ae6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f428015de80 con 0x7f428006c150 2024-09-16T01:24:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4286ae6640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f428015eea0 con 0x7f4280145e50 2024-09-16T01:24:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4285083640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f428015d350 0x7f42800cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4285083640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f428015d350 0x7f42800cfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33556/0 (socket says 172.21.15.81:33556) 2024-09-16T01:24:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4285083640 1 -- 172.21.15.81:0/2449699576 learned_addr learned my addr 172.21.15.81:0/2449699576 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4284882640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f428006c150 0x7f4280156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f427ffff640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4280145e50 0x7f42800cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4285083640 1 -- 172.21.15.81:0/2449699576 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4280145e50 msgr2=0x7f42800cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4285083640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4280145e50 0x7f42800cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4285083640 1 -- 172.21.15.81:0/2449699576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f428006c150 msgr2=0x7f4280156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.780+0000 7f4285083640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f428006c150 0x7f4280156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.781+0000 7f4285083640 1 -- 172.21.15.81:0/2449699576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42800ce7c0 con 0x7f428015d350 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.781+0000 7f427ffff640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4280145e50 0x7f42800cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.781+0000 7f4285083640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f428015d350 0x7f42800cfac0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f427800e860 tx=0x7f427800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.781+0000 7f427d7fa640 1 -- 172.21.15.81:0/2449699576 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278017070 con 0x7f428015d350 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.781+0000 7f427d7fa640 1 -- 172.21.15.81:0/2449699576 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f427800c8e0 con 0x7f428015d350 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.781+0000 7f4286ae6640 1 -- 172.21.15.81:0/2449699576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42800ceaa0 con 0x7f428015d350 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.781+0000 7f427d7fa640 1 -- 172.21.15.81:0/2449699576 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427800ccd0 con 0x7f428015d350 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.781+0000 7f4286ae6640 1 -- 172.21.15.81:0/2449699576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42800cf060 con 0x7f428015d350 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.782+0000 7f4286ae6640 1 -- 172.21.15.81:0/2449699576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f42800b6cf0 con 0x7f428015d350 2024-09-16T01:24:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.782+0000 7f427d7fa640 1 -- 172.21.15.81:0/2449699576 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f427801a070 con 0x7f428015d350 2024-09-16T01:24:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.783+0000 7f427d7fa640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f426006c2b0 0x7f426006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.783+0000 7f427d7fa640 1 -- 172.21.15.81:0/2449699576 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f427808b8d0 con 0x7f428015d350 2024-09-16T01:24:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.783+0000 7f4284882640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f426006c2b0 0x7f426006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.783+0000 7f427d7fa640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] conn(0x7f4260072750 0x7f4260074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.783+0000 7f427d7fa640 1 -- 172.21.15.81:0/2449699576 --> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4278026e50 con 0x7f4260072750 2024-09-16T01:24:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.783+0000 7f427d7fa640 1 -- 172.21.15.81:0/2449699576 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7f427808bd60 con 0x7f428015d350 2024-09-16T01:24:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.783+0000 7f427ffff640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] conn(0x7f4260072750 0x7f4260074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.783+0000 7f4284882640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f426006c2b0 0x7f426006e770 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f428009dff0 tx=0x7f427000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.783+0000 7f427ffff640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] conn(0x7f4260072750 0x7f4260074b90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.784+0000 7f427d7fa640 1 -- 172.21.15.81:0/2449699576 <== osd.1 v2:172.21.15.81:6800/1559362497 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4278026e50 con 0x7f4260072750 2024-09-16T01:24:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.796+0000 7f4286ae6640 1 -- 172.21.15.81:0/2449699576 --> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f42800cd2d0 con 0x7f4260072750 2024-09-16T01:24:18.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.797+0000 7f427d7fa640 1 -- 172.21.15.81:0/2449699576 <== osd.1 v2:172.21.15.81:6800/1559362497 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f42800cd2d0 con 0x7f4260072750 2024-09-16T01:24:18.798 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:24:18.798 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:24:18.798 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:24:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.797+0000 7f4286ae6640 1 -- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] conn(0x7f4260072750 msgr2=0x7f4260074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.797+0000 7f4286ae6640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:6800/1559362497,v1:172.21.15.81:6801/1559362497] conn(0x7f4260072750 0x7f4260074b90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.797+0000 7f4286ae6640 1 -- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f426006c2b0 msgr2=0x7f426006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.797+0000 7f4286ae6640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f426006c2b0 0x7f426006e770 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f428009dff0 tx=0x7f427000b040 comp rx=0 tx=0).stop 2024-09-16T01:24:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.797+0000 7f4286ae6640 1 -- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f428015d350 msgr2=0x7f42800cfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.797+0000 7f4286ae6640 1 --2- 172.21.15.81:0/2449699576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f428015d350 0x7f42800cfac0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f427800e860 tx=0x7f427800ed20 comp rx=0 tx=0).stop 2024-09-16T01:24:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.797+0000 7f4285083640 1 -- 172.21.15.81:0/2449699576 reap_dead start 2024-09-16T01:24:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.797+0000 7f4286ae6640 1 -- 172.21.15.81:0/2449699576 shutdown_connections 2024-09-16T01:24:18.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.797+0000 7f4286ae6640 1 -- 172.21.15.81:0/2449699576 >> 172.21.15.81:0/2449699576 conn(0x7f428009aa30 msgr2=0x7f428006ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:18.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.797+0000 7f4286ae6640 1 -- 172.21.15.81:0/2449699576 shutdown_connections 2024-09-16T01:24:18.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.797+0000 7f4286ae6640 1 -- 172.21.15.81:0/2449699576 wait complete. 2024-09-16T01:24:18.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-16T01:24:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.906+0000 7ff2279c0640 1 Processor -- start 2024-09-16T01:24:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.907+0000 7ff2279c0640 1 -- start start 2024-09-16T01:24:18.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.907+0000 7ff2279c0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff22015ba30 0x7ff22006f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff2279c0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff22006fd50 0x7ff220072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff2279c0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff220072e80 0x7ff22006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff2279c0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff2200b4180 con 0x7ff22015ba30 2024-09-16T01:24:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff2279c0640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff2200b3570 con 0x7ff220072e80 2024-09-16T01:24:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff2279c0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff2200b3850 con 0x7ff22006fd50 2024-09-16T01:24:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff22575c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff22015ba30 0x7ff22006f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff22575c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff22015ba30 0x7ff22006f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33562/0 (socket says 172.21.15.81:33562) 2024-09-16T01:24:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff22575c640 1 -- 172.21.15.81:0/1703191275 learned_addr learned my addr 172.21.15.81:0/1703191275 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff225f5d640 1 --2- 172.21.15.81:0/1703191275 >> v2:172.21.15.102:3300/0 conn(0x7ff220072e80 0x7ff22006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff22575c640 1 -- 172.21.15.81:0/1703191275 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff22006fd50 msgr2=0x7ff220072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff22575c640 1 --2- 172.21.15.81:0/1703191275 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff22006fd50 0x7ff220072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff22575c640 1 -- 172.21.15.81:0/1703191275 >> v2:172.21.15.102:3300/0 conn(0x7ff220072e80 msgr2=0x7ff22006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff22575c640 1 --2- 172.21.15.81:0/1703191275 >> v2:172.21.15.102:3300/0 conn(0x7ff220072e80 0x7ff22006e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.908+0000 7ff22575c640 1 -- 172.21.15.81:0/1703191275 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2200b3b30 con 0x7ff22015ba30 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff22575c640 1 --2- 172.21.15.81:0/1703191275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22015ba30 0x7ff22006f810 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7ff2200b4610 tx=0x7ff21802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372998b1bb29f556 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff21ffff640 1 -- 172.21.15.81:0/1703191275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218037070 con 0x7ff22015ba30 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff21ffff640 1 -- 172.21.15.81:0/1703191275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff218032440 con 0x7ff22015ba30 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff21ffff640 1 -- 172.21.15.81:0/1703191275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218032810 con 0x7ff22015ba30 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff2279c0640 1 -- 172.21.15.81:0/1703191275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22015ba30 msgr2=0x7ff22006f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff2279c0640 1 --2- 172.21.15.81:0/1703191275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22015ba30 0x7ff22006f810 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7ff2200b4610 tx=0x7ff21802a200 comp rx=0 tx=0).stop 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff2279c0640 1 -- 172.21.15.81:0/1703191275 shutdown_connections 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff2279c0640 1 --2- 172.21.15.81:0/1703191275 >> v2:172.21.15.102:3300/0 conn(0x7ff220072e80 0x7ff22006e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff2279c0640 1 --2- 172.21.15.81:0/1703191275 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff22006fd50 0x7ff220072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff2279c0640 1 --2- 172.21.15.81:0/1703191275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22015ba30 0x7ff22006f810 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff2279c0640 1 -- 172.21.15.81:0/1703191275 >> 172.21.15.81:0/1703191275 conn(0x7ff220067d70 msgr2=0x7ff22006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff2279c0640 1 -- 172.21.15.81:0/1703191275 shutdown_connections 2024-09-16T01:24:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.909+0000 7ff2279c0640 1 -- 172.21.15.81:0/1703191275 wait complete. 2024-09-16T01:24:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.911+0000 7ff2279c0640 1 Processor -- start 2024-09-16T01:24:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.911+0000 7ff2279c0640 1 -- start start 2024-09-16T01:24:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.911+0000 7ff2279c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22006fd50 0x7ff2201501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.911+0000 7ff2279c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff220072e80 0x7ff2200b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.911+0000 7ff2279c0640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff22015ba30 0x7ff2200b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.911+0000 7ff2279c0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2200ce810 con 0x7ff22006fd50 2024-09-16T01:24:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.911+0000 7ff2279c0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff2200b5990 con 0x7ff220072e80 2024-09-16T01:24:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.911+0000 7ff2279c0640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff2200ccfe0 con 0x7ff22015ba30 2024-09-16T01:24:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.911+0000 7ff22575c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22006fd50 0x7ff2201501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.911+0000 7ff22575c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22006fd50 0x7ff2201501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33564/0 (socket says 172.21.15.81:33564) 2024-09-16T01:24:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.911+0000 7ff22575c640 1 -- 172.21.15.81:0/1133162555 learned_addr learned my addr 172.21.15.81:0/1133162555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.912+0000 7ff22575c640 1 -- 172.21.15.81:0/1133162555 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff22015ba30 msgr2=0x7ff2200b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.912+0000 7ff22575c640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff22015ba30 0x7ff2200b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.912+0000 7ff22575c640 1 -- 172.21.15.81:0/1133162555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff220072e80 msgr2=0x7ff2200b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.912+0000 7ff224f5b640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff220072e80 0x7ff2200b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.912+0000 7ff22575c640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff220072e80 0x7ff2200b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.912+0000 7ff22575c640 1 -- 172.21.15.81:0/1133162555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff220150b90 con 0x7ff22006fd50 2024-09-16T01:24:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.912+0000 7ff22575c640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22006fd50 0x7ff2201501d0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7ff21802a240 tx=0x7ff2180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.912+0000 7ff21dffb640 1 -- 172.21.15.81:0/1133162555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218041070 con 0x7ff22006fd50 2024-09-16T01:24:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.912+0000 7ff21dffb640 1 -- 172.21.15.81:0/1133162555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21803c870 con 0x7ff22006fd50 2024-09-16T01:24:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.912+0000 7ff2279c0640 1 -- 172.21.15.81:0/1133162555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff220150e70 con 0x7ff22006fd50 2024-09-16T01:24:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.912+0000 7ff21dffb640 1 -- 172.21.15.81:0/1133162555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218037040 con 0x7ff22006fd50 2024-09-16T01:24:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.912+0000 7ff2279c0640 1 -- 172.21.15.81:0/1133162555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff220151430 con 0x7ff22006fd50 2024-09-16T01:24:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.913+0000 7ff2279c0640 1 -- 172.21.15.81:0/1133162555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff22006f810 con 0x7ff22006fd50 2024-09-16T01:24:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.914+0000 7ff21dffb640 1 -- 172.21.15.81:0/1133162555 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff218044070 con 0x7ff22006fd50 2024-09-16T01:24:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.914+0000 7ff21dffb640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff20c06c2b0 0x7ff20c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.914+0000 7ff21dffb640 1 -- 172.21.15.81:0/1133162555 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7ff2180abdf0 con 0x7ff22006fd50 2024-09-16T01:24:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.914+0000 7ff224f5b640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff20c06c2b0 0x7ff20c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.915+0000 7ff224f5b640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff20c06c2b0 0x7ff20c06e770 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff2200b5440 tx=0x7ff214008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:18.918+0000 7ff21dffb640 1 -- 172.21.15.81:0/1133162555 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff21807a880 con 0x7ff22006fd50 2024-09-16T01:24:19.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.084+0000 7ff2279c0640 1 -- 172.21.15.81:0/1133162555 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7ff2200cf720 con 0x7ff20c06c2b0 2024-09-16T01:24:19.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.084+0000 7ff21dffb640 1 -- 172.21.15.81:0/1133162555 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff2200cf720 con 0x7ff20c06c2b0 2024-09-16T01:24:19.085 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2024-09-16T01:24:19.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.086+0000 7ff2279c0640 1 -- 172.21.15.81:0/1133162555 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff20c06c2b0 msgr2=0x7ff20c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.086+0000 7ff2279c0640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff20c06c2b0 0x7ff20c06e770 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ff2200b5440 tx=0x7ff214008040 comp rx=0 tx=0).stop 2024-09-16T01:24:19.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.086+0000 7ff2279c0640 1 -- 172.21.15.81:0/1133162555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22006fd50 msgr2=0x7ff2201501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.086+0000 7ff2279c0640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22006fd50 0x7ff2201501d0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7ff21802a240 tx=0x7ff2180046c0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.086+0000 7ff2279c0640 1 -- 172.21.15.81:0/1133162555 shutdown_connections 2024-09-16T01:24:19.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.086+0000 7ff2279c0640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff20c06c2b0 0x7ff20c06e770 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.086+0000 7ff2279c0640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff22015ba30 0x7ff2200b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.086+0000 7ff2279c0640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff220072e80 0x7ff2200b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.086+0000 7ff2279c0640 1 --2- 172.21.15.81:0/1133162555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22006fd50 0x7ff2201501d0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.086+0000 7ff2279c0640 1 -- 172.21.15.81:0/1133162555 >> 172.21.15.81:0/1133162555 conn(0x7ff220067d70 msgr2=0x7ff22015be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:19.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.086+0000 7ff2279c0640 1 -- 172.21.15.81:0/1133162555 shutdown_connections 2024-09-16T01:24:19.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.086+0000 7ff2279c0640 1 -- 172.21.15.81:0/1133162555 wait complete. 2024-09-16T01:24:19.097 INFO:tasks.ceph:Scrubbing osd.2 2024-09-16T01:24:19.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:24:19.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.200+0000 7f70ed9e8640 1 Processor -- start 2024-09-16T01:24:19.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.200+0000 7f70ed9e8640 1 -- start start 2024-09-16T01:24:19.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.201+0000 7f70ed9e8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70e80b4270 0x7f70e8166110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.201+0000 7f70ed9e8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e80cec90 con 0x7f70e8072760 2024-09-16T01:24:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.201+0000 7f70ed9e8640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70e80cef70 con 0x7f70e815b410 2024-09-16T01:24:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.201+0000 7f70ed9e8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f70e80cf250 con 0x7f70e80b4270 2024-09-16T01:24:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.201+0000 7f70e67fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f70e8072760 0x7f70e80cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37470/0 (socket says 172.21.15.81:37470) 2024-09-16T01:24:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.201+0000 7f70e67fc640 1 -- 172.21.15.81:0/1723828410 learned_addr learned my addr 172.21.15.81:0/1723828410 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.201+0000 7f70e77fe640 1 --2- 172.21.15.81:0/1723828410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70e80b4270 0x7f70e8166110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.201+0000 7f70e5ffb640 1 -- 172.21.15.81:0/1723828410 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2965062487 0 0) 0x7f70e80cec90 con 0x7f70e8072760 2024-09-16T01:24:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.201+0000 7f70e5ffb640 1 -- 172.21.15.81:0/1723828410 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70d0003520 con 0x7f70e8072760 2024-09-16T01:24:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.201+0000 7f70e5ffb640 1 -- 172.21.15.81:0/1723828410 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800229339 0 0) 0x7f70e80cef70 con 0x7f70e815b410 2024-09-16T01:24:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.202+0000 7f70e5ffb640 1 -- 172.21.15.81:0/1723828410 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70e80cec90 con 0x7f70e815b410 2024-09-16T01:24:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.202+0000 7f70e77fe640 1 -- 172.21.15.81:0/1723828410 >> v1:172.21.15.102:6789/0 conn(0x7f70e815b410 legacy=0x7f70e8072050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.202+0000 7f70e77fe640 1 -- 172.21.15.81:0/1723828410 >> v1:172.21.15.81:6789/0 conn(0x7f70e8072760 legacy=0x7f70e80cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.202+0000 7f70e77fe640 1 -- 172.21.15.81:0/1723828410 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e80cf530 con 0x7f70e80b4270 2024-09-16T01:24:19.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.202+0000 7f70e77fe640 1 --2- 172.21.15.81:0/1723828410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70e80b4270 0x7f70e8166110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009df0 tx=0x7f70e002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39db9e131b606ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.203+0000 7f70e5ffb640 1 -- 172.21.15.81:0/1723828410 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e002ae60 con 0x7f70e80b4270 2024-09-16T01:24:19.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.203+0000 7f70e5ffb640 1 -- 172.21.15.81:0/1723828410 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e0007740 con 0x7f70e80b4270 2024-09-16T01:24:19.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.203+0000 7f70e5ffb640 1 -- 172.21.15.81:0/1723828410 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0007af0 con 0x7f70e80b4270 2024-09-16T01:24:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.203+0000 7f70ed9e8640 1 -- 172.21.15.81:0/1723828410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70e80b4270 msgr2=0x7f70e8166110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.203+0000 7f70ed9e8640 1 --2- 172.21.15.81:0/1723828410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70e80b4270 0x7f70e8166110 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009df0 tx=0x7f70e002a680 comp rx=0 tx=0).stop 2024-09-16T01:24:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.203+0000 7f70ed9e8640 1 -- 172.21.15.81:0/1723828410 shutdown_connections 2024-09-16T01:24:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.203+0000 7f70ed9e8640 1 --2- 172.21.15.81:0/1723828410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70e80b4270 0x7f70e8166110 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.203+0000 7f70ed9e8640 1 -- 172.21.15.81:0/1723828410 >> 172.21.15.81:0/1723828410 conn(0x7f70e806bdf0 msgr2=0x7f70e806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.203+0000 7f70ed9e8640 1 -- 172.21.15.81:0/1723828410 shutdown_connections 2024-09-16T01:24:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.203+0000 7f70ed9e8640 1 -- 172.21.15.81:0/1723828410 wait complete. 2024-09-16T01:24:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.204+0000 7f70ed9e8640 1 Processor -- start 2024-09-16T01:24:19.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.205+0000 7f70ed9e8640 1 -- start start 2024-09-16T01:24:19.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.205+0000 7f70ed9e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e8072760 0x7f70e809a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.205+0000 7f70ed9e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70e80b4270 0x7f70e814c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.205+0000 7f70ed9e8640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70e815b410 0x7f70e8159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.205+0000 7f70ed9e8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70e815b970 con 0x7f70e8072760 2024-09-16T01:24:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.205+0000 7f70ed9e8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f70e815b7f0 con 0x7f70e80b4270 2024-09-16T01:24:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.205+0000 7f70ed9e8640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f70e815baf0 con 0x7f70e815b410 2024-09-16T01:24:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.205+0000 7f70e6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e8072760 0x7f70e809a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.205+0000 7f70e6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e8072760 0x7f70e809a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33568/0 (socket says 172.21.15.81:33568) 2024-09-16T01:24:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.205+0000 7f70e6ffd640 1 -- 172.21.15.81:0/3941369725 learned_addr learned my addr 172.21.15.81:0/3941369725 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.205+0000 7f70e67fc640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70e80b4270 0x7f70e814c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.205+0000 7f70e77fe640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70e815b410 0x7f70e8159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70e6ffd640 1 -- 172.21.15.81:0/3941369725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70e815b410 msgr2=0x7f70e8159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70e6ffd640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70e815b410 0x7f70e8159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70e6ffd640 1 -- 172.21.15.81:0/3941369725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70e80b4270 msgr2=0x7f70e814c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70e6ffd640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70e80b4270 0x7f70e814c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70e6ffd640 1 -- 172.21.15.81:0/3941369725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e814c940 con 0x7f70e8072760 2024-09-16T01:24:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70e77fe640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70e815b410 0x7f70e8159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70e67fc640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70e80b4270 0x7f70e814c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70e6ffd640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e8072760 0x7f70e809a1a0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c530 tx=0x7f70d800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70cffff640 1 -- 172.21.15.81:0/3941369725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d80052d0 con 0x7f70e8072760 2024-09-16T01:24:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70cffff640 1 -- 172.21.15.81:0/3941369725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70d8005490 con 0x7f70e8072760 2024-09-16T01:24:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70ed9e8640 1 -- 172.21.15.81:0/3941369725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70e809acd0 con 0x7f70e8072760 2024-09-16T01:24:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70cffff640 1 -- 172.21.15.81:0/3941369725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8012870 con 0x7f70e8072760 2024-09-16T01:24:19.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.206+0000 7f70ed9e8640 1 -- 172.21.15.81:0/3941369725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70e809b290 con 0x7f70e8072760 2024-09-16T01:24:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.207+0000 7f70ed9e8640 1 -- 172.21.15.81:0/3941369725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f70e80b0c50 con 0x7f70e8072760 2024-09-16T01:24:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.207+0000 7f70cffff640 1 -- 172.21.15.81:0/3941369725 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f70d8012a10 con 0x7f70e8072760 2024-09-16T01:24:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.208+0000 7f70cffff640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f70d406c2e0 0x7f70d406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.208+0000 7f70cffff640 1 -- 172.21.15.81:0/3941369725 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f70d808aee0 con 0x7f70e8072760 2024-09-16T01:24:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.208+0000 7f70e67fc640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f70d406c2e0 0x7f70d406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.208+0000 7f70cffff640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] conn(0x7f70d4072780 0x7f70d4074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.208+0000 7f70cffff640 1 -- 172.21.15.81:0/3941369725 --> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70d4075290 con 0x7f70d4072780 2024-09-16T01:24:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.208+0000 7f70cffff640 1 -- 172.21.15.81:0/3941369725 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7f70d808d5e0 con 0x7f70e8072760 2024-09-16T01:24:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.208+0000 7f70e77fe640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] conn(0x7f70d4072780 0x7f70d4074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.208+0000 7f70e67fc640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f70d406c2e0 0x7f70d406e7a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f70e809a6e0 tx=0x7f70dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.208+0000 7f70e77fe640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] conn(0x7f70d4072780 0x7f70d4074bc0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.209+0000 7f70cffff640 1 -- 172.21.15.81:0/3941369725 <== osd.2 v2:172.21.15.81:6826/3728781080 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70d4075290 con 0x7f70d4072780 2024-09-16T01:24:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.221+0000 7f70ed9e8640 1 -- 172.21.15.81:0/3941369725 --> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f70e81588e0 con 0x7f70d4072780 2024-09-16T01:24:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.222+0000 7f70cffff640 1 -- 172.21.15.81:0/3941369725 <== osd.2 v2:172.21.15.81:6826/3728781080 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f70e81588e0 con 0x7f70d4072780 2024-09-16T01:24:19.223 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:24:19.223 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:24:19.223 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:24:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.222+0000 7f70ed9e8640 1 -- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] conn(0x7f70d4072780 msgr2=0x7f70d4074bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.222+0000 7f70ed9e8640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:6826/3728781080,v1:172.21.15.81:6827/3728781080] conn(0x7f70d4072780 0x7f70d4074bc0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.222+0000 7f70ed9e8640 1 -- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f70d406c2e0 msgr2=0x7f70d406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.222+0000 7f70ed9e8640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f70d406c2e0 0x7f70d406e7a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f70e809a6e0 tx=0x7f70dc009040 comp rx=0 tx=0).stop 2024-09-16T01:24:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.222+0000 7f70ed9e8640 1 -- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e8072760 msgr2=0x7f70e809a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.222+0000 7f70ed9e8640 1 --2- 172.21.15.81:0/3941369725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70e8072760 0x7f70e809a1a0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f70d800c530 tx=0x7f70d800c9f0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.222+0000 7f70e77fe640 1 -- 172.21.15.81:0/3941369725 reap_dead start 2024-09-16T01:24:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.222+0000 7f70ed9e8640 1 -- 172.21.15.81:0/3941369725 shutdown_connections 2024-09-16T01:24:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.222+0000 7f70ed9e8640 1 -- 172.21.15.81:0/3941369725 >> 172.21.15.81:0/3941369725 conn(0x7f70e806bdf0 msgr2=0x7f70e815e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.222+0000 7f70ed9e8640 1 -- 172.21.15.81:0/3941369725 shutdown_connections 2024-09-16T01:24:19.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.222+0000 7f70ed9e8640 1 -- 172.21.15.81:0/3941369725 wait complete. 2024-09-16T01:24:19.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-16T01:24:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.331+0000 7f2401b4b640 1 Processor -- start 2024-09-16T01:24:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.331+0000 7f2401b4b640 1 -- start start 2024-09-16T01:24:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.332+0000 7f2401b4b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23fc15e5d0 0x7f23fc0d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.332+0000 7f2401b4b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f23fc06df60 0x7f23fc09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.332+0000 7f2401b4b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23fc06cec0 con 0x7f23fc0d1630 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.332+0000 7f2401b4b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f23fc06dad0 con 0x7f23fc15e5d0 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.332+0000 7f2401b4b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f23fc06d1a0 con 0x7f23fc06df60 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.332+0000 7f23fb7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23fc15e5d0 0x7f23fc0d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.332+0000 7f23fbfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f23fc0d1630 0x7f23fc162230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37476/0 (socket says 172.21.15.81:37476) 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.332+0000 7f23fbfff640 1 -- 172.21.15.81:0/4226886845 learned_addr learned my addr 172.21.15.81:0/4226886845 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.332+0000 7f23faffd640 1 --2- 172.21.15.81:0/4226886845 >> v2:172.21.15.102:3300/0 conn(0x7f23fc06df60 0x7f23fc09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.333+0000 7f23fb7fe640 1 -- 172.21.15.81:0/4226886845 >> v2:172.21.15.102:3300/0 conn(0x7f23fc06df60 msgr2=0x7f23fc09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.333+0000 7f23fb7fe640 1 --2- 172.21.15.81:0/4226886845 >> v2:172.21.15.102:3300/0 conn(0x7f23fc06df60 0x7f23fc09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.333+0000 7f23fb7fe640 1 -- 172.21.15.81:0/4226886845 >> v1:172.21.15.81:6789/0 conn(0x7f23fc0d1630 legacy=0x7f23fc162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.333+0000 7f23fa7fc640 1 -- 172.21.15.81:0/4226886845 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899301551 0 0) 0x7f23fc06cec0 con 0x7f23fc0d1630 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.333+0000 7f23fb7fe640 1 -- 172.21.15.81:0/4226886845 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc06d480 con 0x7f23fc15e5d0 2024-09-16T01:24:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.333+0000 7f23faffd640 1 --2- 172.21.15.81:0/4226886845 >> v2:172.21.15.102:3300/0 conn(0x7f23fc06df60 0x7f23fc09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.333+0000 7f23fb7fe640 1 --2- 172.21.15.81:0/4226886845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc15e5d0 0x7f23fc0d10f0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0a0490 tx=0x7f23ec02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02bc1b8b0ca1a51 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.333+0000 7f23fa7fc640 1 -- 172.21.15.81:0/4226886845 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec037070 con 0x7f23fc15e5d0 2024-09-16T01:24:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.333+0000 7f23fa7fc640 1 -- 172.21.15.81:0/4226886845 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23ec032440 con 0x7f23fc15e5d0 2024-09-16T01:24:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.333+0000 7f23fa7fc640 1 -- 172.21.15.81:0/4226886845 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec032810 con 0x7f23fc15e5d0 2024-09-16T01:24:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.334+0000 7f2401b4b640 1 -- 172.21.15.81:0/4226886845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc15e5d0 msgr2=0x7f23fc0d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.334+0000 7f2401b4b640 1 --2- 172.21.15.81:0/4226886845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc15e5d0 0x7f23fc0d10f0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0a0490 tx=0x7f23ec02a230 comp rx=0 tx=0).stop 2024-09-16T01:24:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.334+0000 7f2401b4b640 1 -- 172.21.15.81:0/4226886845 shutdown_connections 2024-09-16T01:24:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.334+0000 7f2401b4b640 1 --2- 172.21.15.81:0/4226886845 >> v2:172.21.15.102:3300/0 conn(0x7f23fc06df60 0x7f23fc09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.334+0000 7f2401b4b640 1 --2- 172.21.15.81:0/4226886845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc15e5d0 0x7f23fc0d10f0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.334+0000 7f2401b4b640 1 -- 172.21.15.81:0/4226886845 >> 172.21.15.81:0/4226886845 conn(0x7f23fc0d23a0 msgr2=0x7f23fc0d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.334+0000 7f2401b4b640 1 -- 172.21.15.81:0/4226886845 shutdown_connections 2024-09-16T01:24:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.334+0000 7f2401b4b640 1 -- 172.21.15.81:0/4226886845 wait complete. 2024-09-16T01:24:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.335+0000 7f2401b4b640 1 Processor -- start 2024-09-16T01:24:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.335+0000 7f2401b4b640 1 -- start start 2024-09-16T01:24:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.336+0000 7f2401b4b640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23fc06df60 0x7f23fc0af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.336+0000 7f2401b4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc0d1630 0x7f23fc0af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.336+0000 7f2401b4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23fc15e5d0 0x7f23fc0afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.336+0000 7f2401b4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc15eb30 con 0x7f23fc0d1630 2024-09-16T01:24:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.336+0000 7f2401b4b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc15e9b0 con 0x7f23fc15e5d0 2024-09-16T01:24:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.336+0000 7f2401b4b640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f23fc09af70 con 0x7f23fc06df60 2024-09-16T01:24:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.336+0000 7f23faffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc0d1630 0x7f23fc0af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.336+0000 7f23faffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc0d1630 0x7f23fc0af680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33594/0 (socket says 172.21.15.81:33594) 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.336+0000 7f23faffd640 1 -- 172.21.15.81:0/282085961 learned_addr learned my addr 172.21.15.81:0/282085961 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.336+0000 7f23fb7fe640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23fc06df60 0x7f23fc0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.336+0000 7f23fbfff640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23fc15e5d0 0x7f23fc0afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.337+0000 7f23faffd640 1 -- 172.21.15.81:0/282085961 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23fc06df60 msgr2=0x7f23fc0af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.337+0000 7f23faffd640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23fc06df60 0x7f23fc0af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.337+0000 7f23faffd640 1 -- 172.21.15.81:0/282085961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23fc15e5d0 msgr2=0x7f23fc0afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.337+0000 7f23faffd640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23fc15e5d0 0x7f23fc0afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.337+0000 7f23faffd640 1 -- 172.21.15.81:0/282085961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc1f44a0 con 0x7f23fc0d1630 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.337+0000 7f23fbfff640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23fc15e5d0 0x7f23fc0afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.337+0000 7f23faffd640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc0d1630 0x7f23fc0af680 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f23f000c7f0 tx=0x7f23f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.337+0000 7f23e3fff640 1 -- 172.21.15.81:0/282085961 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0015070 con 0x7f23fc0d1630 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.337+0000 7f23e3fff640 1 -- 172.21.15.81:0/282085961 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f0007a30 con 0x7f23fc0d1630 2024-09-16T01:24:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.337+0000 7f23e3fff640 1 -- 172.21.15.81:0/282085961 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0007e00 con 0x7f23fc0d1630 2024-09-16T01:24:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.337+0000 7f2401b4b640 1 -- 172.21.15.81:0/282085961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23fc0c85d0 con 0x7f23fc0d1630 2024-09-16T01:24:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.337+0000 7f2401b4b640 1 -- 172.21.15.81:0/282085961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23fc1e8280 con 0x7f23fc0d1630 2024-09-16T01:24:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.338+0000 7f2401b4b640 1 -- 172.21.15.81:0/282085961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23fc0d3310 con 0x7f23fc0d1630 2024-09-16T01:24:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.339+0000 7f23e3fff640 1 -- 172.21.15.81:0/282085961 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f23f0018070 con 0x7f23fc0d1630 2024-09-16T01:24:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.339+0000 7f23e3fff640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f23e806c2b0 0x7f23e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.339+0000 7f23e3fff640 1 -- 172.21.15.81:0/282085961 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f23f008b170 con 0x7f23fc0d1630 2024-09-16T01:24:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.339+0000 7f23fb7fe640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f23e806c2b0 0x7f23e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.340+0000 7f23fb7fe640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f23e806c2b0 0x7f23e806e770 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f23ec034000 tx=0x7f23ec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.343+0000 7f23e3fff640 1 -- 172.21.15.81:0/282085961 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23fc0d3310 con 0x7f23fc0d1630 2024-09-16T01:24:19.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.509+0000 7f2401b4b640 1 -- 172.21.15.81:0/282085961 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f23fc0b8320 con 0x7f23e806c2b0 2024-09-16T01:24:19.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.510+0000 7f23e3fff640 1 -- 172.21.15.81:0/282085961 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f23fc0b8320 con 0x7f23e806c2b0 2024-09-16T01:24:19.511 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2024-09-16T01:24:19.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.512+0000 7f2401b4b640 1 -- 172.21.15.81:0/282085961 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f23e806c2b0 msgr2=0x7f23e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.512+0000 7f2401b4b640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f23e806c2b0 0x7f23e806e770 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f23ec034000 tx=0x7f23ec02e000 comp rx=0 tx=0).stop 2024-09-16T01:24:19.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.512+0000 7f2401b4b640 1 -- 172.21.15.81:0/282085961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc0d1630 msgr2=0x7f23fc0af680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.512+0000 7f2401b4b640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc0d1630 0x7f23fc0af680 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f23f000c7f0 tx=0x7f23f000cbf0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.512+0000 7f2401b4b640 1 -- 172.21.15.81:0/282085961 shutdown_connections 2024-09-16T01:24:19.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.512+0000 7f2401b4b640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f23e806c2b0 0x7f23e806e770 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.512+0000 7f2401b4b640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23fc15e5d0 0x7f23fc0afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.512+0000 7f2401b4b640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23fc0d1630 0x7f23fc0af680 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.512+0000 7f2401b4b640 1 --2- 172.21.15.81:0/282085961 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23fc06df60 0x7f23fc0af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.512+0000 7f2401b4b640 1 -- 172.21.15.81:0/282085961 >> 172.21.15.81:0/282085961 conn(0x7f23fc0d23a0 msgr2=0x7f23fc0d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.512+0000 7f2401b4b640 1 -- 172.21.15.81:0/282085961 shutdown_connections 2024-09-16T01:24:19.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.512+0000 7f2401b4b640 1 -- 172.21.15.81:0/282085961 wait complete. 2024-09-16T01:24:19.524 INFO:tasks.ceph:Scrubbing osd.3 2024-09-16T01:24:19.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:24:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.624+0000 7f32b061e640 1 Processor -- start 2024-09-16T01:24:19.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.624+0000 7f32b061e640 1 -- start start 2024-09-16T01:24:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.625+0000 7f32b061e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f32a815b570 0x7f32a8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.625+0000 7f32b061e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a815b950 0x7f32a80cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.625+0000 7f32b061e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a8073b20 con 0x7f32a80ccf50 2024-09-16T01:24:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.625+0000 7f32b061e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f32a80740e0 con 0x7f32a815b570 2024-09-16T01:24:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.625+0000 7f32b061e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f32a8073e00 con 0x7f32a815b950 2024-09-16T01:24:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32aebbb640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f32a80ccf50 0x7f32a80cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37492/0 (socket says 172.21.15.81:37492) 2024-09-16T01:24:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32aebbb640 1 -- 172.21.15.81:0/1703185099 learned_addr learned my addr 172.21.15.81:0/1703185099 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ae3ba640 1 --2- 172.21.15.81:0/1703185099 >> v2:172.21.15.102:3300/0 conn(0x7f32a815b570 0x7f32a8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32adbb9640 1 --2- 172.21.15.81:0/1703185099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a815b950 0x7f32a80cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107181897 0 0) 0x7f32a8073b20 con 0x7f32a80ccf50 2024-09-16T01:24:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3294004630 con 0x7f32a80ccf50 2024-09-16T01:24:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 118577235 0 0) 0x7f3294004630 con 0x7f32a80ccf50 2024-09-16T01:24:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a815b950 msgr2=0x7f32a80cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 --2- 172.21.15.81:0/1703185099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a815b950 0x7f32a80cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 >> v2:172.21.15.102:3300/0 conn(0x7f32a815b570 msgr2=0x7f32a8071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 --2- 172.21.15.81:0/1703185099 >> v2:172.21.15.102:3300/0 conn(0x7f32a815b570 0x7f32a8071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a80cf320 con 0x7f32a80ccf50 2024-09-16T01:24:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7f32a00019f0 con 0x7f32a80ccf50 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 >> v1:172.21.15.81:6789/0 conn(0x7f32a80ccf50 legacy=0x7f32a80cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 --2- 172.21.15.81:0/1703185099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294004ac0 0x7f3294004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 --2- 172.21.15.81:0/1703185099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a815b950 0x7f3294005910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 --2- 172.21.15.81:0/1703185099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3294005e50 0x7f32940062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32a80740e0 con 0x7f3294004ac0 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f32a8073e00 con 0x7f3294005e50 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f329400cad0 con 0x7f32a815b950 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32ae3ba640 1 --2- 172.21.15.81:0/1703185099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294004ac0 0x7f3294004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32adbb9640 1 --2- 172.21.15.81:0/1703185099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a815b950 0x7f3294005910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.626+0000 7f32aebbb640 1 --2- 172.21.15.81:0/1703185099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3294005e50 0x7f32940062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.627+0000 7f32ae3ba640 1 -- 172.21.15.81:0/1703185099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a815b950 msgr2=0x7f3294005910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.627+0000 7f32ae3ba640 1 --2- 172.21.15.81:0/1703185099 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a815b950 0x7f3294005910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.627+0000 7f32ae3ba640 1 -- 172.21.15.81:0/1703185099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3294005e50 msgr2=0x7f32940062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.627+0000 7f32ae3ba640 1 --2- 172.21.15.81:0/1703185099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3294005e50 0x7f32940062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.627+0000 7f32ae3ba640 1 -- 172.21.15.81:0/1703185099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3294004630 con 0x7f3294004ac0 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.627+0000 7f32ae3ba640 1 --2- 172.21.15.81:0/1703185099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294004ac0 0x7f3294004ee0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f329c009ac0 tx=0x7f3294006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d195dc4dc5110005 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.627+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c036070 con 0x7f3294004ac0 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.627+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c031400 con 0x7f3294004ac0 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.627+0000 7f32ad3b8640 1 -- 172.21.15.81:0/1703185099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c009690 con 0x7f3294004ac0 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.628+0000 7f32b061e640 1 -- 172.21.15.81:0/1703185099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294004ac0 msgr2=0x7f3294004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.628+0000 7f32b061e640 1 --2- 172.21.15.81:0/1703185099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294004ac0 0x7f3294004ee0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f329c009ac0 tx=0x7f3294006940 comp rx=0 tx=0).stop 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.628+0000 7f32aebbb640 1 -- 172.21.15.81:0/1703185099 reap_dead start 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.628+0000 7f32b061e640 1 -- 172.21.15.81:0/1703185099 shutdown_connections 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.628+0000 7f32b061e640 1 -- 172.21.15.81:0/1703185099 >> 172.21.15.81:0/1703185099 conn(0x7f32a806bdf0 msgr2=0x7f32a806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.628+0000 7f32b061e640 1 -- 172.21.15.81:0/1703185099 shutdown_connections 2024-09-16T01:24:19.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.628+0000 7f32b061e640 1 -- 172.21.15.81:0/1703185099 wait complete. 2024-09-16T01:24:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.629+0000 7f32b061e640 1 Processor -- start 2024-09-16T01:24:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.629+0000 7f32b061e640 1 -- start start 2024-09-16T01:24:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32b061e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294004ac0 0x7f32a81511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32b061e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a81f4e80 0x7f32a814f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32b061e640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a8154890 0x7f32a80ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32b061e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32a80cf840 con 0x7f3294004ac0 2024-09-16T01:24:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32b061e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f32a8072450 con 0x7f32a81f4e80 2024-09-16T01:24:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32b061e640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f32a80cf9c0 con 0x7f32a8154890 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32ae3ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294004ac0 0x7f32a81511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32ae3ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294004ac0 0x7f32a81511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33622/0 (socket says 172.21.15.81:33622) 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32ae3ba640 1 -- 172.21.15.81:0/4196274603 learned_addr learned my addr 172.21.15.81:0/4196274603 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32aebbb640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a8154890 0x7f32a80ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32adbb9640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a81f4e80 0x7f32a814f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32ae3ba640 1 -- 172.21.15.81:0/4196274603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a8154890 msgr2=0x7f32a80ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32ae3ba640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f32a8154890 0x7f32a80ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32ae3ba640 1 -- 172.21.15.81:0/4196274603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a81f4e80 msgr2=0x7f32a814f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32ae3ba640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f32a81f4e80 0x7f32a814f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32ae3ba640 1 -- 172.21.15.81:0/4196274603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a81537f0 con 0x7f3294004ac0 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.630+0000 7f32ae3ba640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294004ac0 0x7f32a81511a0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f329c034040 tx=0x7f329c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.631+0000 7f329affd640 1 -- 172.21.15.81:0/4196274603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c040020 con 0x7f3294004ac0 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.631+0000 7f329affd640 1 -- 172.21.15.81:0/4196274603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329c003c40 con 0x7f3294004ac0 2024-09-16T01:24:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.631+0000 7f32b061e640 1 -- 172.21.15.81:0/4196274603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a8153ad0 con 0x7f3294004ac0 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.631+0000 7f329affd640 1 -- 172.21.15.81:0/4196274603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c036040 con 0x7f3294004ac0 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.631+0000 7f32b061e640 1 -- 172.21.15.81:0/4196274603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a8154090 con 0x7f3294004ac0 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.631+0000 7f32b061e640 1 -- 172.21.15.81:0/4196274603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32a8071e40 con 0x7f3294004ac0 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.632+0000 7f329affd640 1 -- 172.21.15.81:0/4196274603 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f329c043020 con 0x7f3294004ac0 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.632+0000 7f329affd640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f328c06c2b0 0x7f328c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.633+0000 7f32adbb9640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f328c06c2b0 0x7f328c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.633+0000 7f329affd640 1 -- 172.21.15.81:0/4196274603 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f329c0abb80 con 0x7f3294004ac0 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.633+0000 7f329affd640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] conn(0x7f328c072750 0x7f328c074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.633+0000 7f329affd640 1 -- 172.21.15.81:0/4196274603 --> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f329c007e50 con 0x7f328c072750 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.633+0000 7f329affd640 1 -- 172.21.15.81:0/4196274603 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7f329c0ac010 con 0x7f3294004ac0 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.633+0000 7f32aebbb640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] conn(0x7f328c072750 0x7f328c074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.633+0000 7f32adbb9640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f328c06c2b0 0x7f328c06e770 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f32a8155540 tx=0x7f32a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.633+0000 7f32aebbb640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] conn(0x7f328c072750 0x7f328c074b90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.634+0000 7f329affd640 1 -- 172.21.15.81:0/4196274603 <== osd.3 v2:172.21.15.81:6808/3410907338 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f329c007e50 con 0x7f328c072750 2024-09-16T01:24:19.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.646+0000 7f32b061e640 1 -- 172.21.15.81:0/4196274603 --> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f32a80b0d80 con 0x7f328c072750 2024-09-16T01:24:19.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.646+0000 7f329affd640 1 -- 172.21.15.81:0/4196274603 <== osd.3 v2:172.21.15.81:6808/3410907338 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f32a80b0d80 con 0x7f328c072750 2024-09-16T01:24:19.647 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:24:19.647 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:24:19.647 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:24:19.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.647+0000 7f32b061e640 1 -- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] conn(0x7f328c072750 msgr2=0x7f328c074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.647+0000 7f32b061e640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:6808/3410907338,v1:172.21.15.81:6809/3410907338] conn(0x7f328c072750 0x7f328c074b90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.647+0000 7f32b061e640 1 -- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f328c06c2b0 msgr2=0x7f328c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.647+0000 7f32b061e640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f328c06c2b0 0x7f328c06e770 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f32a8155540 tx=0x7f32a4008040 comp rx=0 tx=0).stop 2024-09-16T01:24:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.647+0000 7f32b061e640 1 -- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294004ac0 msgr2=0x7f32a81511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.647+0000 7f32b061e640 1 --2- 172.21.15.81:0/4196274603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3294004ac0 0x7f32a81511a0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f329c034040 tx=0x7f329c004730 comp rx=0 tx=0).stop 2024-09-16T01:24:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.647+0000 7f32aebbb640 1 -- 172.21.15.81:0/4196274603 reap_dead start 2024-09-16T01:24:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.647+0000 7f32b061e640 1 -- 172.21.15.81:0/4196274603 shutdown_connections 2024-09-16T01:24:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.647+0000 7f32b061e640 1 -- 172.21.15.81:0/4196274603 >> 172.21.15.81:0/4196274603 conn(0x7f32a806bdf0 msgr2=0x7f32a815d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.647+0000 7f32b061e640 1 -- 172.21.15.81:0/4196274603 shutdown_connections 2024-09-16T01:24:19.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.647+0000 7f32b061e640 1 -- 172.21.15.81:0/4196274603 wait complete. 2024-09-16T01:24:19.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-16T01:24:19.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.756+0000 7f95661c4640 1 Processor -- start 2024-09-16T01:24:19.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.756+0000 7f95661c4640 1 -- start start 2024-09-16T01:24:19.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f95661c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95600d0be0 0x7f95600cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f95661c4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f956015d460 0x7f95600afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f95661c4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95600af720 con 0x7f9560145e00 2024-09-16T01:24:19.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f95661c4640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f95601461e0 con 0x7f956015d460 2024-09-16T01:24:19.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f95661c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f95600cdf90 con 0x7f95600d0be0 2024-09-16T01:24:19.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f955f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9560145e00 0x7f95600d04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37502/0 (socket says 172.21.15.81:37502) 2024-09-16T01:24:19.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f955f7fe640 1 -- 172.21.15.81:0/4197195831 learned_addr learned my addr 172.21.15.81:0/4197195831 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:19.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f955effd640 1 --2- 172.21.15.81:0/4197195831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95600d0be0 0x7f95600cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f955ffff640 1 --2- 172.21.15.81:0/4197195831 >> v2:172.21.15.102:3300/0 conn(0x7f956015d460 0x7f95600afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f955e7fc640 1 -- 172.21.15.81:0/4197195831 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1921780436 0 0) 0x7f95600af720 con 0x7f9560145e00 2024-09-16T01:24:19.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f955e7fc640 1 -- 172.21.15.81:0/4197195831 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9548003520 con 0x7f9560145e00 2024-09-16T01:24:19.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f955effd640 1 -- 172.21.15.81:0/4197195831 >> v2:172.21.15.102:3300/0 conn(0x7f956015d460 msgr2=0x7f95600afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:19.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f955effd640 1 --2- 172.21.15.81:0/4197195831 >> v2:172.21.15.102:3300/0 conn(0x7f956015d460 0x7f95600afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f955effd640 1 -- 172.21.15.81:0/4197195831 >> v1:172.21.15.81:6789/0 conn(0x7f9560145e00 legacy=0x7f95600d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.757+0000 7f955effd640 1 -- 172.21.15.81:0/4197195831 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95600ce270 con 0x7f95600d0be0 2024-09-16T01:24:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.758+0000 7f955effd640 1 --2- 172.21.15.81:0/4197195831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95600d0be0 0x7f95600cd8a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f95540097a0 tx=0x7f955402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70834e8eb7295c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.759+0000 7f955e7fc640 1 -- 172.21.15.81:0/4197195831 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554037070 con 0x7f95600d0be0 2024-09-16T01:24:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.759+0000 7f955e7fc640 1 -- 172.21.15.81:0/4197195831 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9554032440 con 0x7f95600d0be0 2024-09-16T01:24:19.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.759+0000 7f955e7fc640 1 -- 172.21.15.81:0/4197195831 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554032810 con 0x7f95600d0be0 2024-09-16T01:24:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.759+0000 7f95661c4640 1 -- 172.21.15.81:0/4197195831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95600d0be0 msgr2=0x7f95600cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.759+0000 7f95661c4640 1 --2- 172.21.15.81:0/4197195831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95600d0be0 0x7f95600cd8a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f95540097a0 tx=0x7f955402a180 comp rx=0 tx=0).stop 2024-09-16T01:24:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.759+0000 7f95661c4640 1 -- 172.21.15.81:0/4197195831 shutdown_connections 2024-09-16T01:24:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.759+0000 7f95661c4640 1 --2- 172.21.15.81:0/4197195831 >> v2:172.21.15.102:3300/0 conn(0x7f956015d460 0x7f95600afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.759+0000 7f95661c4640 1 --2- 172.21.15.81:0/4197195831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f95600d0be0 0x7f95600cd8a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.759+0000 7f95661c4640 1 -- 172.21.15.81:0/4197195831 >> 172.21.15.81:0/4197195831 conn(0x7f95600b2f40 msgr2=0x7f95600b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.759+0000 7f95661c4640 1 -- 172.21.15.81:0/4197195831 shutdown_connections 2024-09-16T01:24:19.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.759+0000 7f95661c4640 1 -- 172.21.15.81:0/4197195831 wait complete. 2024-09-16T01:24:19.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.760+0000 7f95661c4640 1 Processor -- start 2024-09-16T01:24:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.760+0000 7f95661c4640 1 -- start start 2024-09-16T01:24:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.761+0000 7f95661c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95600d0be0 0x7f9560142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.761+0000 7f95661c4640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9560145e00 0x7f956015b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.761+0000 7f95661c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f956015d460 0x7f9560141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.761+0000 7f95661c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f956015d8b0 con 0x7f95600d0be0 2024-09-16T01:24:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.761+0000 7f95661c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f95600ce830 con 0x7f956015d460 2024-09-16T01:24:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.761+0000 7f95661c4640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f95600cede0 con 0x7f9560145e00 2024-09-16T01:24:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.761+0000 7f955f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95600d0be0 0x7f9560142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.761+0000 7f955f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95600d0be0 0x7f9560142570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33626/0 (socket says 172.21.15.81:33626) 2024-09-16T01:24:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.761+0000 7f955f7fe640 1 -- 172.21.15.81:0/4148056368 learned_addr learned my addr 172.21.15.81:0/4148056368 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:19.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.761+0000 7f955effd640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9560145e00 0x7f956015b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.761+0000 7f955ffff640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f956015d460 0x7f9560141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f955f7fe640 1 -- 172.21.15.81:0/4148056368 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9560145e00 msgr2=0x7f956015b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f955f7fe640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9560145e00 0x7f956015b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f955f7fe640 1 -- 172.21.15.81:0/4148056368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f956015d460 msgr2=0x7f9560141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f955f7fe640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f956015d460 0x7f9560141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f955f7fe640 1 -- 172.21.15.81:0/4148056368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9560141c70 con 0x7f95600d0be0 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f955effd640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9560145e00 0x7f956015b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f955ffff640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f956015d460 0x7f9560141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f955f7fe640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95600d0be0 0x7f9560142570 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f9550001460 tx=0x7f955000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f9547fff640 1 -- 172.21.15.81:0/4148056368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550017070 con 0x7f95600d0be0 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f9547fff640 1 -- 172.21.15.81:0/4148056368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955000ad00 con 0x7f95600d0be0 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f95661c4640 1 -- 172.21.15.81:0/4148056368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9560142b70 con 0x7f95600d0be0 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f9547fff640 1 -- 172.21.15.81:0/4148056368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550012640 con 0x7f95600d0be0 2024-09-16T01:24:19.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.762+0000 7f95661c4640 1 -- 172.21.15.81:0/4148056368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9560143130 con 0x7f95600d0be0 2024-09-16T01:24:19.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.763+0000 7f95661c4640 1 -- 172.21.15.81:0/4148056368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9560145940 con 0x7f95600d0be0 2024-09-16T01:24:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.763+0000 7f9547fff640 1 -- 172.21.15.81:0/4148056368 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f955001a070 con 0x7f95600d0be0 2024-09-16T01:24:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.764+0000 7f9547fff640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f954c06c2b0 0x7f954c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.764+0000 7f9547fff640 1 -- 172.21.15.81:0/4148056368 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f955008b0d0 con 0x7f95600d0be0 2024-09-16T01:24:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.764+0000 7f955effd640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f954c06c2b0 0x7f954c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:19.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.764+0000 7f955effd640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f954c06c2b0 0x7f954c06e770 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9554034000 tx=0x7f955402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:19.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.768+0000 7f9547fff640 1 -- 172.21.15.81:0/4148056368 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9550059a40 con 0x7f95600d0be0 2024-09-16T01:24:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.935+0000 7f95661c4640 1 -- 172.21.15.81:0/4148056368 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f95600cd8a0 con 0x7f954c06c2b0 2024-09-16T01:24:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.935+0000 7f9547fff640 1 -- 172.21.15.81:0/4148056368 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f95600cd8a0 con 0x7f954c06c2b0 2024-09-16T01:24:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2024-09-16T01:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.937+0000 7f95661c4640 1 -- 172.21.15.81:0/4148056368 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f954c06c2b0 msgr2=0x7f954c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.937+0000 7f95661c4640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f954c06c2b0 0x7f954c06e770 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9554034000 tx=0x7f955402e000 comp rx=0 tx=0).stop 2024-09-16T01:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.937+0000 7f95661c4640 1 -- 172.21.15.81:0/4148056368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95600d0be0 msgr2=0x7f9560142570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.937+0000 7f95661c4640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95600d0be0 0x7f9560142570 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f9550001460 tx=0x7f955000a430 comp rx=0 tx=0).stop 2024-09-16T01:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.937+0000 7f95661c4640 1 -- 172.21.15.81:0/4148056368 shutdown_connections 2024-09-16T01:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.937+0000 7f95661c4640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f954c06c2b0 0x7f954c06e770 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.937+0000 7f95661c4640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f956015d460 0x7f9560141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.937+0000 7f95661c4640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9560145e00 0x7f956015b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.937+0000 7f95661c4640 1 --2- 172.21.15.81:0/4148056368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95600d0be0 0x7f9560142570 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.937+0000 7f95661c4640 1 -- 172.21.15.81:0/4148056368 >> 172.21.15.81:0/4148056368 conn(0x7f95600b2f40 msgr2=0x7f95600cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.937+0000 7f95661c4640 1 -- 172.21.15.81:0/4148056368 shutdown_connections 2024-09-16T01:24:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:19.937+0000 7f95661c4640 1 -- 172.21.15.81:0/4148056368 wait complete. 2024-09-16T01:24:19.949 INFO:tasks.ceph:Scrubbing osd.4 2024-09-16T01:24:19.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:24:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.051+0000 7fc79b552640 1 Processor -- start 2024-09-16T01:24:20.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.051+0000 7fc79b552640 1 -- start start 2024-09-16T01:24:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.052+0000 7fc79b552640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc794164fc0 0x7fc7941673b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.052+0000 7fc79b552640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7940b3d10 con 0x7fc79415fe50 2024-09-16T01:24:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.052+0000 7fc79b552640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7940b3ff0 con 0x7fc794159f90 2024-09-16T01:24:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.052+0000 7fc79b552640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc7940b4db0 con 0x7fc794164fc0 2024-09-16T01:24:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.052+0000 7fc798aed640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc79415fe50 0x7fc794160270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37518/0 (socket says 172.21.15.81:37518) 2024-09-16T01:24:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.052+0000 7fc798aed640 1 -- 172.21.15.81:0/2239947859 learned_addr learned my addr 172.21.15.81:0/2239947859 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.052+0000 7fc799aef640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc794164fc0 0x7fc7941673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.052+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518393877 0 0) 0x7fc7940b3d10 con 0x7fc79415fe50 2024-09-16T01:24:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc77c003520 con 0x7fc79415fe50 2024-09-16T01:24:20.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2125530018 0 0) 0x7fc77c003520 con 0x7fc79415fe50 2024-09-16T01:24:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc794164fc0 msgr2=0x7fc7941673b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc794164fc0 0x7fc7941673b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 >> v1:172.21.15.102:6789/0 conn(0x7fc794159f90 legacy=0x7fc79406f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7940b42d0 con 0x7fc79415fe50 2024-09-16T01:24:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fc788001670 con 0x7fc79415fe50 2024-09-16T01:24:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 >> v1:172.21.15.81:6789/0 conn(0x7fc79415fe50 legacy=0x7fc794160270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc77c0039e0 0x7fc77c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc77c004800 0x7fc77c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc794164fc0 0x7fc77c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7940b4db0 con 0x7fc77c0039e0 2024-09-16T01:24:20.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc77c00baf0 con 0x7fc77c004800 2024-09-16T01:24:20.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc77c00bcf0 con 0x7fc794164fc0 2024-09-16T01:24:20.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc7992ee640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc77c0039e0 0x7fc77c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc799aef640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc794164fc0 0x7fc77c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc798aed640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc77c004800 0x7fc77c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc7992ee640 1 -- 172.21.15.81:0/2239947859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc794164fc0 msgr2=0x7fc77c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:20.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc7992ee640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc794164fc0 0x7fc77c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc7992ee640 1 -- 172.21.15.81:0/2239947859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc77c004800 msgr2=0x7fc77c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:20.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc7992ee640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc77c004800 0x7fc77c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc7992ee640 1 -- 172.21.15.81:0/2239947859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77c003520 con 0x7fc77c0039e0 2024-09-16T01:24:20.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.053+0000 7fc799aef640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc794164fc0 0x7fc77c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.054+0000 7fc7992ee640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc77c0039e0 0x7fc77c003e00 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fc784001e50 tx=0x7fc77c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a772e49db23566fa server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.054+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc784001a70 con 0x7fc77c0039e0 2024-09-16T01:24:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.054+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc784003970 con 0x7fc77c0039e0 2024-09-16T01:24:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.054+0000 7fc793fff640 1 -- 172.21.15.81:0/2239947859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc784003d60 con 0x7fc77c0039e0 2024-09-16T01:24:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.054+0000 7fc79b552640 1 -- 172.21.15.81:0/2239947859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc77c0039e0 msgr2=0x7fc77c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.054+0000 7fc79b552640 1 --2- 172.21.15.81:0/2239947859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc77c0039e0 0x7fc77c003e00 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fc784001e50 tx=0x7fc77c005830 comp rx=0 tx=0).stop 2024-09-16T01:24:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.054+0000 7fc799aef640 1 -- 172.21.15.81:0/2239947859 reap_dead start 2024-09-16T01:24:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.055+0000 7fc79b552640 1 -- 172.21.15.81:0/2239947859 shutdown_connections 2024-09-16T01:24:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.055+0000 7fc79b552640 1 -- 172.21.15.81:0/2239947859 >> 172.21.15.81:0/2239947859 conn(0x7fc79406bdf0 msgr2=0x7fc79406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.055+0000 7fc79b552640 1 -- 172.21.15.81:0/2239947859 shutdown_connections 2024-09-16T01:24:20.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.055+0000 7fc79b552640 1 -- 172.21.15.81:0/2239947859 wait complete. 2024-09-16T01:24:20.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.056+0000 7fc79b552640 1 Processor -- start 2024-09-16T01:24:20.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.056+0000 7fc79b552640 1 -- start start 2024-09-16T01:24:20.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.056+0000 7fc79b552640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc77c0039e0 0x7fc794150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.056+0000 7fc79b552640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc794153aa0 0x7fc794153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc79b552640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7940cdfd0 0x7fc7940ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc79b552640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7940b3930 con 0x7fc7940cdfd0 2024-09-16T01:24:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc79b552640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc7940700e0 con 0x7fc794153aa0 2024-09-16T01:24:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc79b552640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc7940b3ab0 con 0x7fc77c0039e0 2024-09-16T01:24:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc799aef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7940cdfd0 0x7fc7940ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc799aef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7940cdfd0 0x7fc7940ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33634/0 (socket says 172.21.15.81:33634) 2024-09-16T01:24:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc799aef640 1 -- 172.21.15.81:0/2407963436 learned_addr learned my addr 172.21.15.81:0/2407963436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc798aed640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc794153aa0 0x7fc794153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc7992ee640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc77c0039e0 0x7fc794150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc799aef640 1 -- 172.21.15.81:0/2407963436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc77c0039e0 msgr2=0x7fc794150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc799aef640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc77c0039e0 0x7fc794150650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc799aef640 1 -- 172.21.15.81:0/2407963436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc794153aa0 msgr2=0x7fc794153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc799aef640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc794153aa0 0x7fc794153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc799aef640 1 -- 172.21.15.81:0/2407963436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7940adf20 con 0x7fc7940cdfd0 2024-09-16T01:24:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc799aef640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7940cdfd0 0x7fc7940ce450 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fc77c004780 tx=0x7fc78c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc791ffb640 1 -- 172.21.15.81:0/2407963436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c004440 con 0x7fc7940cdfd0 2024-09-16T01:24:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc791ffb640 1 -- 172.21.15.81:0/2407963436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc78c01b070 con 0x7fc7940cdfd0 2024-09-16T01:24:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc791ffb640 1 -- 172.21.15.81:0/2407963436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c003850 con 0x7fc7940cdfd0 2024-09-16T01:24:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc79b552640 1 -- 172.21.15.81:0/2407963436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7940ae200 con 0x7fc7940cdfd0 2024-09-16T01:24:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.057+0000 7fc79b552640 1 -- 172.21.15.81:0/2407963436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7940ae7c0 con 0x7fc7940cdfd0 2024-09-16T01:24:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.058+0000 7fc79b552640 1 -- 172.21.15.81:0/2407963436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc79406f9d0 con 0x7fc7940cdfd0 2024-09-16T01:24:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.059+0000 7fc791ffb640 1 -- 172.21.15.81:0/2407963436 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc78c0039f0 con 0x7fc7940cdfd0 2024-09-16T01:24:20.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.059+0000 7fc791ffb640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc78006c2e0 0x7fc78006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.059+0000 7fc791ffb640 1 -- 172.21.15.81:0/2407963436 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7fc78c08b290 con 0x7fc7940cdfd0 2024-09-16T01:24:20.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.059+0000 7fc7992ee640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc78006c2e0 0x7fc78006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.060+0000 7fc791ffb640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] conn(0x7fc780072780 0x7fc780074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.060+0000 7fc791ffb640 1 -- 172.21.15.81:0/2407963436 --> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc78c0110b0 con 0x7fc780072780 2024-09-16T01:24:20.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.060+0000 7fc791ffb640 1 -- 172.21.15.81:0/2407963436 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7fc78c092050 con 0x7fc7940cdfd0 2024-09-16T01:24:20.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.060+0000 7fc798aed640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] conn(0x7fc780072780 0x7fc780074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.060+0000 7fc7992ee640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc78006c2e0 0x7fc78006e7a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc784032000 tx=0x7fc78402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.060+0000 7fc798aed640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] conn(0x7fc780072780 0x7fc780074bc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.061+0000 7fc791ffb640 1 -- 172.21.15.81:0/2407963436 <== osd.4 v2:172.21.15.102:6809/1702667483 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc78c0110b0 con 0x7fc780072780 2024-09-16T01:24:20.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.073+0000 7fc79b552640 1 -- 172.21.15.81:0/2407963436 --> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc7940b0220 con 0x7fc780072780 2024-09-16T01:24:20.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.074+0000 7fc791ffb640 1 -- 172.21.15.81:0/2407963436 <== osd.4 v2:172.21.15.102:6809/1702667483 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc7940b0220 con 0x7fc780072780 2024-09-16T01:24:20.075 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:24:20.075 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:24:20.075 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:24:20.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.074+0000 7fc79b552640 1 -- 172.21.15.81:0/2407963436 >> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] conn(0x7fc780072780 msgr2=0x7fc780074bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.074+0000 7fc79b552640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.102:6809/1702667483,v1:172.21.15.102:6811/1702667483] conn(0x7fc780072780 0x7fc780074bc0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.074+0000 7fc79b552640 1 -- 172.21.15.81:0/2407963436 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc78006c2e0 msgr2=0x7fc78006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.074+0000 7fc79b552640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc78006c2e0 0x7fc78006e7a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc784032000 tx=0x7fc78402e000 comp rx=0 tx=0).stop 2024-09-16T01:24:20.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.074+0000 7fc79b552640 1 -- 172.21.15.81:0/2407963436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7940cdfd0 msgr2=0x7fc7940ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.074+0000 7fc79b552640 1 --2- 172.21.15.81:0/2407963436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7940cdfd0 0x7fc7940ce450 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fc77c004780 tx=0x7fc78c011920 comp rx=0 tx=0).stop 2024-09-16T01:24:20.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.074+0000 7fc799aef640 1 -- 172.21.15.81:0/2407963436 reap_dead start 2024-09-16T01:24:20.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.074+0000 7fc79b552640 1 -- 172.21.15.81:0/2407963436 shutdown_connections 2024-09-16T01:24:20.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.074+0000 7fc79b552640 1 -- 172.21.15.81:0/2407963436 >> 172.21.15.81:0/2407963436 conn(0x7fc79406bdf0 msgr2=0x7fc79415ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:20.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.074+0000 7fc79b552640 1 -- 172.21.15.81:0/2407963436 shutdown_connections 2024-09-16T01:24:20.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.074+0000 7fc79b552640 1 -- 172.21.15.81:0/2407963436 wait complete. 2024-09-16T01:24:20.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-16T01:24:20.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.187+0000 7fc6af56f640 1 Processor -- start 2024-09-16T01:24:20.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.187+0000 7fc6af56f640 1 -- start start 2024-09-16T01:24:20.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.188+0000 7fc6af56f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6a806ff00 0x7fc6a8165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.188+0000 7fc6af56f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6a815b860 con 0x7fc6a8155850 2024-09-16T01:24:20.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.188+0000 7fc6af56f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6a815bb20 con 0x7fc6a8070bf0 2024-09-16T01:24:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.188+0000 7fc6af56f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc6a815be00 con 0x7fc6a806ff00 2024-09-16T01:24:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.188+0000 7fc6adb0c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6a806ff00 0x7fc6a8165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.188+0000 7fc6ad30b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc6a8155850 0x7fc6a80b00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37522/0 (socket says 172.21.15.81:37522) 2024-09-16T01:24:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.188+0000 7fc6ad30b640 1 -- 172.21.15.81:0/1970712842 learned_addr learned my addr 172.21.15.81:0/1970712842 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.188+0000 7fc6adb0c640 1 -- 172.21.15.81:0/1970712842 >> v1:172.21.15.102:6789/0 conn(0x7fc6a8070bf0 legacy=0x7fc6a806f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.188+0000 7fc6adb0c640 1 -- 172.21.15.81:0/1970712842 >> v1:172.21.15.81:6789/0 conn(0x7fc6a8155850 legacy=0x7fc6a80b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.188+0000 7fc6adb0c640 1 -- 172.21.15.81:0/1970712842 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a815c0e0 con 0x7fc6a806ff00 2024-09-16T01:24:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.188+0000 7fc69ffff640 1 -- 172.21.15.81:0/1970712842 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482722979 0 0) 0x7fc6a815b860 con 0x7fc6a8155850 2024-09-16T01:24:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.189+0000 7fc6adb0c640 1 --2- 172.21.15.81:0/1970712842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a806ff00 0x7fc6a8165e90 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009d90 tx=0x7fc6a002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0aee2ccb09f8abf server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.189+0000 7fc69ffff640 1 -- 172.21.15.81:0/1970712842 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0007740 con 0x7fc6a806ff00 2024-09-16T01:24:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.189+0000 7fc69ffff640 1 -- 172.21.15.81:0/1970712842 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a00078e0 con 0x7fc6a806ff00 2024-09-16T01:24:20.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.189+0000 7fc69ffff640 1 -- 172.21.15.81:0/1970712842 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0007cb0 con 0x7fc6a806ff00 2024-09-16T01:24:20.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.190+0000 7fc6af56f640 1 -- 172.21.15.81:0/1970712842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a806ff00 msgr2=0x7fc6a8165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.190+0000 7fc6af56f640 1 --2- 172.21.15.81:0/1970712842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a806ff00 0x7fc6a8165e90 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009d90 tx=0x7fc6a002a6f0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.190+0000 7fc6af56f640 1 -- 172.21.15.81:0/1970712842 shutdown_connections 2024-09-16T01:24:20.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.190+0000 7fc6af56f640 1 --2- 172.21.15.81:0/1970712842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a806ff00 0x7fc6a8165e90 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.190+0000 7fc6af56f640 1 -- 172.21.15.81:0/1970712842 >> 172.21.15.81:0/1970712842 conn(0x7fc6a806bc10 msgr2=0x7fc6a806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:20.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.190+0000 7fc6af56f640 1 -- 172.21.15.81:0/1970712842 shutdown_connections 2024-09-16T01:24:20.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.190+0000 7fc6af56f640 1 -- 172.21.15.81:0/1970712842 wait complete. 2024-09-16T01:24:20.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.191+0000 7fc6af56f640 1 Processor -- start 2024-09-16T01:24:20.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.191+0000 7fc6af56f640 1 -- start start 2024-09-16T01:24:20.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6af56f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6a806ff00 0x7fc6a814c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6af56f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6a8070bf0 0x7fc6a814f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6af56f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a8155850 0x7fc6a81e55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6af56f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a80b63b0 con 0x7fc6a8155850 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6af56f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a8155c30 con 0x7fc6a8070bf0 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6af56f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a80b6530 con 0x7fc6a806ff00 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6adb0c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a8155850 0x7fc6a81e55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6adb0c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a8155850 0x7fc6a81e55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33650/0 (socket says 172.21.15.81:33650) 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6adb0c640 1 -- 172.21.15.81:0/3434298321 learned_addr learned my addr 172.21.15.81:0/3434298321 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6acb0a640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6a8070bf0 0x7fc6a814f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6ad30b640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6a806ff00 0x7fc6a814c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6adb0c640 1 -- 172.21.15.81:0/3434298321 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6a806ff00 msgr2=0x7fc6a814c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6adb0c640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6a806ff00 0x7fc6a814c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6adb0c640 1 -- 172.21.15.81:0/3434298321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6a8070bf0 msgr2=0x7fc6a814f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6adb0c640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6a8070bf0 0x7fc6a814f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.192+0000 7fc6adb0c640 1 -- 172.21.15.81:0/3434298321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a814e610 con 0x7fc6a8155850 2024-09-16T01:24:20.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.193+0000 7fc6adb0c640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a8155850 0x7fc6a81e55d0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009d90 tx=0x7fc6a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.193+0000 7fc69dffb640 1 -- 172.21.15.81:0/3434298321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a003a8d0 con 0x7fc6a8155850 2024-09-16T01:24:20.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.193+0000 7fc69dffb640 1 -- 172.21.15.81:0/3434298321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a003aa70 con 0x7fc6a8155850 2024-09-16T01:24:20.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.193+0000 7fc6af56f640 1 -- 172.21.15.81:0/3434298321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a814da90 con 0x7fc6a8155850 2024-09-16T01:24:20.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.193+0000 7fc69dffb640 1 -- 172.21.15.81:0/3434298321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a003ae60 con 0x7fc6a8155850 2024-09-16T01:24:20.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.193+0000 7fc6af56f640 1 -- 172.21.15.81:0/3434298321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a814e050 con 0x7fc6a8155850 2024-09-16T01:24:20.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.194+0000 7fc6af56f640 1 -- 172.21.15.81:0/3434298321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6a81f1130 con 0x7fc6a8155850 2024-09-16T01:24:20.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.194+0000 7fc69dffb640 1 -- 172.21.15.81:0/3434298321 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc6a0045420 con 0x7fc6a8155850 2024-09-16T01:24:20.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.195+0000 7fc69dffb640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc68c06c2b0 0x7fc68c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.195+0000 7fc6ad30b640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc68c06c2b0 0x7fc68c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.195+0000 7fc69dffb640 1 -- 172.21.15.81:0/3434298321 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7fc6a00ae060 con 0x7fc6a8155850 2024-09-16T01:24:20.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.195+0000 7fc6ad30b640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc68c06c2b0 0x7fc68c06e770 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4000f60 tx=0x7fc6a4007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.199+0000 7fc69dffb640 1 -- 172.21.15.81:0/3434298321 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6a81f1130 con 0x7fc6a8155850 2024-09-16T01:24:20.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.365+0000 7fc6af56f640 1 -- 172.21.15.81:0/3434298321 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fc6a80b1660 con 0x7fc68c06c2b0 2024-09-16T01:24:20.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.365+0000 7fc69dffb640 1 -- 172.21.15.81:0/3434298321 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc6a80b1660 con 0x7fc68c06c2b0 2024-09-16T01:24:20.366 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2024-09-16T01:24:20.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.367+0000 7fc6af56f640 1 -- 172.21.15.81:0/3434298321 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc68c06c2b0 msgr2=0x7fc68c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.367+0000 7fc6af56f640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc68c06c2b0 0x7fc68c06e770 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4000f60 tx=0x7fc6a4007e40 comp rx=0 tx=0).stop 2024-09-16T01:24:20.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.367+0000 7fc6af56f640 1 -- 172.21.15.81:0/3434298321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a8155850 msgr2=0x7fc6a81e55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.367+0000 7fc6af56f640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a8155850 0x7fc6a81e55d0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009d90 tx=0x7fc6a0004a40 comp rx=0 tx=0).stop 2024-09-16T01:24:20.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.367+0000 7fc6af56f640 1 -- 172.21.15.81:0/3434298321 shutdown_connections 2024-09-16T01:24:20.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.367+0000 7fc6af56f640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fc68c06c2b0 0x7fc68c06e770 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.367+0000 7fc6af56f640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6a8155850 0x7fc6a81e55d0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.367+0000 7fc6af56f640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6a8070bf0 0x7fc6a814f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.367+0000 7fc6af56f640 1 --2- 172.21.15.81:0/3434298321 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc6a806ff00 0x7fc6a814c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.367+0000 7fc6af56f640 1 -- 172.21.15.81:0/3434298321 >> 172.21.15.81:0/3434298321 conn(0x7fc6a806bc10 msgr2=0x7fc6a815cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:20.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.367+0000 7fc6af56f640 1 -- 172.21.15.81:0/3434298321 shutdown_connections 2024-09-16T01:24:20.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.368+0000 7fc6af56f640 1 -- 172.21.15.81:0/3434298321 wait complete. 2024-09-16T01:24:20.379 INFO:tasks.ceph:Scrubbing osd.5 2024-09-16T01:24:20.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:24:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.481+0000 7ff7c48dd640 1 Processor -- start 2024-09-16T01:24:20.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.481+0000 7ff7c48dd640 1 -- start start 2024-09-16T01:24:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7c48dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c00b14d0 0x7ff7c0166fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7c48dd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c0072180 con 0x7ff7c009b140 2024-09-16T01:24:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7c48dd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c015c870 con 0x7ff7c015c490 2024-09-16T01:24:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7c48dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c0071bc0 con 0x7ff7c00b14d0 2024-09-16T01:24:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7b5d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff7c009b140 0x7ff7c00700f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37530/0 (socket says 172.21.15.81:37530) 2024-09-16T01:24:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7b5d9b640 1 -- 172.21.15.81:0/2785478935 learned_addr learned my addr 172.21.15.81:0/2785478935 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4082838396 0 0) 0x7ff7c0072180 con 0x7ff7c009b140 2024-09-16T01:24:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7ac003520 con 0x7ff7c009b140 2024-09-16T01:24:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bed9d640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c00b14d0 0x7ff7c0166fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3360378419 0 0) 0x7ff7ac003520 con 0x7ff7c009b140 2024-09-16T01:24:20.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c00b14d0 msgr2=0x7ff7c0166fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c00b14d0 0x7ff7c0166fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 >> v1:172.21.15.102:6789/0 conn(0x7ff7c015c490 legacy=0x7ff7c009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c0071ea0 con 0x7ff7c009b140 2024-09-16T01:24:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7ff7a8001670 con 0x7ff7c009b140 2024-09-16T01:24:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 >> v1:172.21.15.81:6789/0 conn(0x7ff7c009b140 legacy=0x7ff7c00700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c00b14d0 0x7ff7ac0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac004010 0x7ff7ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7ac004d40 0x7ff7ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c0071bc0 con 0x7ff7ac004010 2024-09-16T01:24:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac00bb80 con 0x7ff7ac004d40 2024-09-16T01:24:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ac00bd80 con 0x7ff7c00b14d0 2024-09-16T01:24:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7b5d9b640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac004010 0x7ff7ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.482+0000 7ff7bed9d640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7ac004d40 0x7ff7ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.483+0000 7ff7be59c640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c00b14d0 0x7ff7ac0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.483+0000 7ff7b5d9b640 1 -- 172.21.15.81:0/2785478935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c00b14d0 msgr2=0x7ff7ac0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.483+0000 7ff7b5d9b640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c00b14d0 0x7ff7ac0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.483+0000 7ff7b5d9b640 1 -- 172.21.15.81:0/2785478935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7ac004d40 msgr2=0x7ff7ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.483+0000 7ff7b5d9b640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7ac004d40 0x7ff7ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.483+0000 7ff7b5d9b640 1 -- 172.21.15.81:0/2785478935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac003520 con 0x7ff7ac004010 2024-09-16T01:24:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.483+0000 7ff7be59c640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c00b14d0 0x7ff7ac0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.483+0000 7ff7b5d9b640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac004010 0x7ff7ac004800 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800c290 tx=0x7ff7ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ab6a6f0507603e server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.483+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8007d30 con 0x7ff7ac004010 2024-09-16T01:24:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.483+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a80058d0 con 0x7ff7ac004010 2024-09-16T01:24:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.483+0000 7ff7bdd9b640 1 -- 172.21.15.81:0/2785478935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8005ce0 con 0x7ff7ac004010 2024-09-16T01:24:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.484+0000 7ff7c48dd640 1 -- 172.21.15.81:0/2785478935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac004010 msgr2=0x7ff7ac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.484+0000 7ff7c48dd640 1 --2- 172.21.15.81:0/2785478935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac004010 0x7ff7ac004800 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800c290 tx=0x7ff7ac005830 comp rx=0 tx=0).stop 2024-09-16T01:24:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.484+0000 7ff7bed9d640 1 -- 172.21.15.81:0/2785478935 reap_dead start 2024-09-16T01:24:20.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.484+0000 7ff7c48dd640 1 -- 172.21.15.81:0/2785478935 shutdown_connections 2024-09-16T01:24:20.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.484+0000 7ff7c48dd640 1 -- 172.21.15.81:0/2785478935 >> 172.21.15.81:0/2785478935 conn(0x7ff7c00b3f30 msgr2=0x7ff7c00b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:20.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.484+0000 7ff7c48dd640 1 -- 172.21.15.81:0/2785478935 shutdown_connections 2024-09-16T01:24:20.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.484+0000 7ff7c48dd640 1 -- 172.21.15.81:0/2785478935 wait complete. 2024-09-16T01:24:20.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.485+0000 7ff7c48dd640 1 Processor -- start 2024-09-16T01:24:20.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.486+0000 7ff7c48dd640 1 -- start start 2024-09-16T01:24:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.486+0000 7ff7c48dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac004010 0x7ff7c01f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.486+0000 7ff7c48dd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7c01e75a0 0x7ff7c015dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.486+0000 7ff7c48dd640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c01e4be0 0x7ff7c015eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.486+0000 7ff7c48dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c009b8f0 con 0x7ff7ac004010 2024-09-16T01:24:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.486+0000 7ff7c48dd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c00affa0 con 0x7ff7c01e75a0 2024-09-16T01:24:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.486+0000 7ff7c48dd640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c0071810 con 0x7ff7c01e4be0 2024-09-16T01:24:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.486+0000 7ff7be59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac004010 0x7ff7c01f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.486+0000 7ff7be59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac004010 0x7ff7c01f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33668/0 (socket says 172.21.15.81:33668) 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.486+0000 7ff7be59c640 1 -- 172.21.15.81:0/1223375281 learned_addr learned my addr 172.21.15.81:0/1223375281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7b5d9b640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7c01e75a0 0x7ff7c015dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7bed9d640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c01e4be0 0x7ff7c015eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7be59c640 1 -- 172.21.15.81:0/1223375281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c01e4be0 msgr2=0x7ff7c015eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7be59c640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff7c01e4be0 0x7ff7c015eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7be59c640 1 -- 172.21.15.81:0/1223375281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7c01e75a0 msgr2=0x7ff7c015dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7be59c640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7c01e75a0 0x7ff7c015dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7be59c640 1 -- 172.21.15.81:0/1223375281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c01e67e0 con 0x7ff7ac004010 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7b5d9b640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff7c01e75a0 0x7ff7c015dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7be59c640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac004010 0x7ff7c01f5810 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000e660 tx=0x7ff7b000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7b77fe640 1 -- 172.21.15.81:0/1223375281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00050d0 con 0x7ff7ac004010 2024-09-16T01:24:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7b77fe640 1 -- 172.21.15.81:0/1223375281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b0018070 con 0x7ff7ac004010 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7c48dd640 1 -- 172.21.15.81:0/1223375281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c01e6ac0 con 0x7ff7ac004010 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7b77fe640 1 -- 172.21.15.81:0/1223375281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000c6c0 con 0x7ff7ac004010 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.487+0000 7ff7c48dd640 1 -- 172.21.15.81:0/1223375281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c01e7080 con 0x7ff7ac004010 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.488+0000 7ff7c48dd640 1 -- 172.21.15.81:0/1223375281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7c009aa30 con 0x7ff7ac004010 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.488+0000 7ff7b77fe640 1 -- 172.21.15.81:0/1223375281 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff7b000c860 con 0x7ff7ac004010 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.489+0000 7ff7b77fe640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff7a006c2b0 0x7ff7a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.489+0000 7ff7b77fe640 1 -- 172.21.15.81:0/1223375281 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7ff7b008b000 con 0x7ff7ac004010 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.489+0000 7ff7b5d9b640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff7a006c2b0 0x7ff7a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.489+0000 7ff7b77fe640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] conn(0x7ff7a0072750 0x7ff7a0074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.489+0000 7ff7b77fe640 1 -- 172.21.15.81:0/1223375281 --> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7b001de50 con 0x7ff7a0072750 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.489+0000 7ff7b77fe640 1 -- 172.21.15.81:0/1223375281 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7ff7b0092050 con 0x7ff7ac004010 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.489+0000 7ff7bed9d640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] conn(0x7ff7a0072750 0x7ff7a0074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.489+0000 7ff7b5d9b640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff7a006c2b0 0x7ff7a006e770 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8033000 tx=0x7ff7a8009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.490+0000 7ff7bed9d640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] conn(0x7ff7a0072750 0x7ff7a0074b90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.490+0000 7ff7b77fe640 1 -- 172.21.15.81:0/1223375281 <== osd.5 v2:172.21.15.102:6808/366563181 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7b001de50 con 0x7ff7a0072750 2024-09-16T01:24:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.503+0000 7ff7c48dd640 1 -- 172.21.15.81:0/1223375281 --> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff7c015bc40 con 0x7ff7a0072750 2024-09-16T01:24:20.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.503+0000 7ff7b77fe640 1 -- 172.21.15.81:0/1223375281 <== osd.5 v2:172.21.15.102:6808/366563181 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff7c015bc40 con 0x7ff7a0072750 2024-09-16T01:24:20.504 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:24:20.504 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:24:20.504 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:24:20.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.504+0000 7ff7c48dd640 1 -- 172.21.15.81:0/1223375281 >> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] conn(0x7ff7a0072750 msgr2=0x7ff7a0074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.504+0000 7ff7c48dd640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.102:6808/366563181,v1:172.21.15.102:6810/366563181] conn(0x7ff7a0072750 0x7ff7a0074b90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.504+0000 7ff7c48dd640 1 -- 172.21.15.81:0/1223375281 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff7a006c2b0 msgr2=0x7ff7a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.504+0000 7ff7c48dd640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7ff7a006c2b0 0x7ff7a006e770 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8033000 tx=0x7ff7a8009030 comp rx=0 tx=0).stop 2024-09-16T01:24:20.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.504+0000 7ff7c48dd640 1 -- 172.21.15.81:0/1223375281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac004010 msgr2=0x7ff7c01f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.504+0000 7ff7c48dd640 1 --2- 172.21.15.81:0/1223375281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7ac004010 0x7ff7c01f5810 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000e660 tx=0x7ff7b000eb20 comp rx=0 tx=0).stop 2024-09-16T01:24:20.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.504+0000 7ff7bed9d640 1 -- 172.21.15.81:0/1223375281 reap_dead start 2024-09-16T01:24:20.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.504+0000 7ff7c48dd640 1 -- 172.21.15.81:0/1223375281 shutdown_connections 2024-09-16T01:24:20.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.504+0000 7ff7c48dd640 1 -- 172.21.15.81:0/1223375281 >> 172.21.15.81:0/1223375281 conn(0x7ff7c00b3f30 msgr2=0x7ff7c00700f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:20.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.504+0000 7ff7c48dd640 1 -- 172.21.15.81:0/1223375281 shutdown_connections 2024-09-16T01:24:20.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.504+0000 7ff7c48dd640 1 -- 172.21.15.81:0/1223375281 wait complete. 2024-09-16T01:24:20.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-16T01:24:20.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.613+0000 7f22b7766640 1 Processor -- start 2024-09-16T01:24:20.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.614+0000 7f22b7766640 1 -- start start 2024-09-16T01:24:20.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.614+0000 7f22b7766640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f22b009aca0 0x7f22b009b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.614+0000 7f22b7766640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22b0071750 0x7f22b01680c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.614+0000 7f22b7766640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22b00d12c0 con 0x7f22b009b5c0 2024-09-16T01:24:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.614+0000 7f22b7766640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f22b006d040 con 0x7f22b0071750 2024-09-16T01:24:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.614+0000 7f22b7766640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f22b00d15a0 con 0x7f22b009aca0 2024-09-16T01:24:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.614+0000 7f22b5d03640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22b0071750 0x7f22b01680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.614+0000 7f22b4d01640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f22b009b5c0 0x7f22b00d05e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37544/0 (socket says 172.21.15.81:37544) 2024-09-16T01:24:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.614+0000 7f22b4d01640 1 -- 172.21.15.81:0/427091448 learned_addr learned my addr 172.21.15.81:0/427091448 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.615+0000 7f22b5502640 1 --2- 172.21.15.81:0/427091448 >> v2:172.21.15.102:3300/0 conn(0x7f22b009aca0 0x7f22b009b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.615+0000 7f22b5d03640 1 -- 172.21.15.81:0/427091448 >> v2:172.21.15.102:3300/0 conn(0x7f22b009aca0 msgr2=0x7f22b009b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.615+0000 7f22b5d03640 1 --2- 172.21.15.81:0/427091448 >> v2:172.21.15.102:3300/0 conn(0x7f22b009aca0 0x7f22b009b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.615+0000 7f22b5d03640 1 -- 172.21.15.81:0/427091448 >> v1:172.21.15.81:6789/0 conn(0x7f22b009b5c0 legacy=0x7f22b00d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.615+0000 7f22b5d03640 1 -- 172.21.15.81:0/427091448 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b00d1880 con 0x7f22b0071750 2024-09-16T01:24:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.615+0000 7f22b5d03640 1 --2- 172.21.15.81:0/427091448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b0071750 0x7f22b01680c0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f22b00733d0 tx=0x7f22a802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f9cc2be5af8ac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.616+0000 7f22affff640 1 -- 172.21.15.81:0/427091448 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8037070 con 0x7f22b0071750 2024-09-16T01:24:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.616+0000 7f22affff640 1 -- 172.21.15.81:0/427091448 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a8032440 con 0x7f22b0071750 2024-09-16T01:24:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.616+0000 7f22affff640 1 -- 172.21.15.81:0/427091448 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a8032810 con 0x7f22b0071750 2024-09-16T01:24:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.616+0000 7f22b7766640 1 -- 172.21.15.81:0/427091448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b0071750 msgr2=0x7f22b01680c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.616+0000 7f22b7766640 1 --2- 172.21.15.81:0/427091448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b0071750 0x7f22b01680c0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f22b00733d0 tx=0x7f22a802a1a0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.616+0000 7f22b7766640 1 -- 172.21.15.81:0/427091448 shutdown_connections 2024-09-16T01:24:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.616+0000 7f22b7766640 1 --2- 172.21.15.81:0/427091448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b0071750 0x7f22b01680c0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.616+0000 7f22b7766640 1 --2- 172.21.15.81:0/427091448 >> v2:172.21.15.102:3300/0 conn(0x7f22b009aca0 0x7f22b009b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.616+0000 7f22b7766640 1 -- 172.21.15.81:0/427091448 >> 172.21.15.81:0/427091448 conn(0x7f22b00d23a0 msgr2=0x7f22b00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.616+0000 7f22b7766640 1 -- 172.21.15.81:0/427091448 shutdown_connections 2024-09-16T01:24:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.616+0000 7f22b7766640 1 -- 172.21.15.81:0/427091448 wait complete. 2024-09-16T01:24:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.617+0000 7f22b7766640 1 Processor -- start 2024-09-16T01:24:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.617+0000 7f22b7766640 1 -- start start 2024-09-16T01:24:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.618+0000 7f22b7766640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b0071750 0x7f22b00b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.618+0000 7f22b7766640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f22b009aca0 0x7f22b015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.618+0000 7f22b7766640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b009b5c0 0x7f22b0149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.618+0000 7f22b7766640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22b00d0cf0 con 0x7f22b0071750 2024-09-16T01:24:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.618+0000 7f22b7766640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f22b0070220 con 0x7f22b009b5c0 2024-09-16T01:24:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.618+0000 7f22b7766640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f22b00d0e70 con 0x7f22b009aca0 2024-09-16T01:24:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.618+0000 7f22b5502640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b0071750 0x7f22b00b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.618+0000 7f22b5502640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b0071750 0x7f22b00b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33688/0 (socket says 172.21.15.81:33688) 2024-09-16T01:24:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.618+0000 7f22b5502640 1 -- 172.21.15.81:0/1276268377 learned_addr learned my addr 172.21.15.81:0/1276268377 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22b5502640 1 -- 172.21.15.81:0/1276268377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f22b009aca0 msgr2=0x7f22b015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22b4d01640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f22b009aca0 0x7f22b015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22b5d03640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b009b5c0 0x7f22b0149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22b5502640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f22b009aca0 0x7f22b015a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22b5502640 1 -- 172.21.15.81:0/1276268377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b009b5c0 msgr2=0x7f22b0149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22b5502640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b009b5c0 0x7f22b0149590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22b5502640 1 -- 172.21.15.81:0/1276268377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b00cd5f0 con 0x7f22b0071750 2024-09-16T01:24:20.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22b5502640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b0071750 0x7f22b00b51d0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f22a0007f20 tx=0x7f22a000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22adffb640 1 -- 172.21.15.81:0/1276268377 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0014620 con 0x7f22b0071750 2024-09-16T01:24:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22adffb640 1 -- 172.21.15.81:0/1276268377 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a0019070 con 0x7f22b0071750 2024-09-16T01:24:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22b7766640 1 -- 172.21.15.81:0/1276268377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b00cd8d0 con 0x7f22b0071750 2024-09-16T01:24:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22adffb640 1 -- 172.21.15.81:0/1276268377 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0014a00 con 0x7f22b0071750 2024-09-16T01:24:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.619+0000 7f22b7766640 1 -- 172.21.15.81:0/1276268377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b00cde90 con 0x7f22b0071750 2024-09-16T01:24:20.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.620+0000 7f22b7766640 1 -- 172.21.15.81:0/1276268377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b009b080 con 0x7f22b0071750 2024-09-16T01:24:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.620+0000 7f22adffb640 1 -- 172.21.15.81:0/1276268377 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f22a0014ba0 con 0x7f22b0071750 2024-09-16T01:24:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.621+0000 7f22adffb640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f229c06c2b0 0x7f229c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.621+0000 7f22adffb640 1 -- 172.21.15.81:0/1276268377 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f22a008bcc0 con 0x7f22b0071750 2024-09-16T01:24:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.621+0000 7f22b4d01640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f229c06c2b0 0x7f229c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.621+0000 7f22b4d01640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f229c06c2b0 0x7f229c06e770 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f22b0161a10 tx=0x7f22a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.625+0000 7f22adffb640 1 -- 172.21.15.81:0/1276268377 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22a0092080 con 0x7f22b0071750 2024-09-16T01:24:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.790+0000 7f22b7766640 1 -- 172.21.15.81:0/1276268377 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f22b009bab0 con 0x7f229c06c2b0 2024-09-16T01:24:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.790+0000 7f22adffb640 1 -- 172.21.15.81:0/1276268377 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f22b009bab0 con 0x7f229c06c2b0 2024-09-16T01:24:20.791 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2024-09-16T01:24:20.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.792+0000 7f22b7766640 1 -- 172.21.15.81:0/1276268377 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f229c06c2b0 msgr2=0x7f229c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.792+0000 7f22b7766640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f229c06c2b0 0x7f229c06e770 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f22b0161a10 tx=0x7f22a4009040 comp rx=0 tx=0).stop 2024-09-16T01:24:20.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.792+0000 7f22b7766640 1 -- 172.21.15.81:0/1276268377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b0071750 msgr2=0x7f22b00b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.792+0000 7f22b7766640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b0071750 0x7f22b00b51d0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f22a0007f20 tx=0x7f22a000e570 comp rx=0 tx=0).stop 2024-09-16T01:24:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.792+0000 7f22b7766640 1 -- 172.21.15.81:0/1276268377 shutdown_connections 2024-09-16T01:24:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.792+0000 7f22b7766640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f229c06c2b0 0x7f229c06e770 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.792+0000 7f22b7766640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22b009b5c0 0x7f22b0149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.792+0000 7f22b7766640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f22b009aca0 0x7f22b015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.792+0000 7f22b7766640 1 --2- 172.21.15.81:0/1276268377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22b0071750 0x7f22b00b51d0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.792+0000 7f22b7766640 1 -- 172.21.15.81:0/1276268377 >> 172.21.15.81:0/1276268377 conn(0x7f22b00d23a0 msgr2=0x7f22b00b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.792+0000 7f22b7766640 1 -- 172.21.15.81:0/1276268377 shutdown_connections 2024-09-16T01:24:20.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.792+0000 7f22b7766640 1 -- 172.21.15.81:0/1276268377 wait complete. 2024-09-16T01:24:20.804 INFO:tasks.ceph:Scrubbing osd.6 2024-09-16T01:24:20.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:24:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.905+0000 7f25a4b52640 1 Processor -- start 2024-09-16T01:24:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.905+0000 7f25a4b52640 1 -- start start 2024-09-16T01:24:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.906+0000 7f25a4b52640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25a00b1920 0x7f25a009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.906+0000 7f25a4b52640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f25a009af70 0x7f25a00cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.906+0000 7f25a4b52640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a00ce720 con 0x7f25a0071160 2024-09-16T01:24:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.906+0000 7f25a4b52640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f25a00cea00 con 0x7f25a009af70 2024-09-16T01:24:20.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.906+0000 7f25a4b52640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f25a00ccfe0 con 0x7f25a00b1920 2024-09-16T01:24:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.907+0000 7f259e59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25a00b1920 0x7f25a009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.907+0000 7f259dd9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f25a009af70 0x7f25a00cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.907+0000 7f259e59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25a00b1920 0x7f25a009aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.81:56160/0 (socket says 172.21.15.81:56160) 2024-09-16T01:24:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.907+0000 7f259e59c640 1 -- 172.21.15.81:0/3787427396 learned_addr learned my addr 172.21.15.81:0/3787427396 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.907+0000 7f259ed9d640 1 --1- 172.21.15.81:0/3787427396 >> v1:172.21.15.102:6789/0 conn(0x7f25a0071160 0x7f25a00700c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.81:56726/0 (socket says 172.21.15.81:56726) 2024-09-16T01:24:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.907+0000 7f259e59c640 1 -- 172.21.15.81:0/3787427396 >> v2:172.21.15.102:3300/0 conn(0x7f25a009af70 msgr2=0x7f25a00cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:20.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.907+0000 7f259e59c640 1 --2- 172.21.15.81:0/3787427396 >> v2:172.21.15.102:3300/0 conn(0x7f25a009af70 0x7f25a00cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.907+0000 7f259e59c640 1 -- 172.21.15.81:0/3787427396 >> v1:172.21.15.102:6789/0 conn(0x7f25a0071160 legacy=0x7f25a00700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.907+0000 7f259e59c640 1 -- 172.21.15.81:0/3787427396 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a00cd2c0 con 0x7f25a00b1920 2024-09-16T01:24:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.907+0000 7f259dd9b640 1 --2- 172.21.15.81:0/3787427396 >> v2:172.21.15.102:3300/0 conn(0x7f25a009af70 0x7f25a00cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:20.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.908+0000 7f259e59c640 1 --2- 172.21.15.81:0/3787427396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25a00b1920 0x7f25a009aa30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2590009870 tx=0x7f259002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce991a1b90a102db server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.908+0000 7f259d59a640 1 -- 172.21.15.81:0/3787427396 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590037070 con 0x7f25a00b1920 2024-09-16T01:24:20.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.908+0000 7f259d59a640 1 -- 172.21.15.81:0/3787427396 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2590032440 con 0x7f25a00b1920 2024-09-16T01:24:20.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.908+0000 7f259d59a640 1 -- 172.21.15.81:0/3787427396 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590032810 con 0x7f25a00b1920 2024-09-16T01:24:20.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.909+0000 7f25a4b52640 1 -- 172.21.15.81:0/3787427396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25a00b1920 msgr2=0x7f25a009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.909+0000 7f25a4b52640 1 --2- 172.21.15.81:0/3787427396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25a00b1920 0x7f25a009aa30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2590009870 tx=0x7f259002a1c0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.909+0000 7f25a4b52640 1 -- 172.21.15.81:0/3787427396 shutdown_connections 2024-09-16T01:24:20.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.909+0000 7f25a4b52640 1 --2- 172.21.15.81:0/3787427396 >> v2:172.21.15.102:3300/0 conn(0x7f25a009af70 0x7f25a00cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.909+0000 7f25a4b52640 1 --2- 172.21.15.81:0/3787427396 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25a00b1920 0x7f25a009aa30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.909+0000 7f25a4b52640 1 -- 172.21.15.81:0/3787427396 >> 172.21.15.81:0/3787427396 conn(0x7f25a00b3de0 msgr2=0x7f25a00b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:20.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.909+0000 7f25a4b52640 1 -- 172.21.15.81:0/3787427396 shutdown_connections 2024-09-16T01:24:20.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.909+0000 7f25a4b52640 1 -- 172.21.15.81:0/3787427396 wait complete. 2024-09-16T01:24:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.910+0000 7f25a4b52640 1 Processor -- start 2024-09-16T01:24:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.910+0000 7f25a4b52640 1 -- start start 2024-09-16T01:24:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f25a4b52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a0071160 0x7f25a015bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f25a4b52640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25a009af70 0x7f25a00b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f25a4b52640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25a00b1920 0x7f25a00b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f25a4b52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00d01f0 con 0x7f25a0071160 2024-09-16T01:24:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f25a4b52640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f25a00d0070 con 0x7f25a00b1920 2024-09-16T01:24:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f25a4b52640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f25a00cdd20 con 0x7f25a009af70 2024-09-16T01:24:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f259e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a0071160 0x7f25a015bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f259e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a0071160 0x7f25a015bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33692/0 (socket says 172.21.15.81:33692) 2024-09-16T01:24:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f259e59c640 1 -- 172.21.15.81:0/1718058057 learned_addr learned my addr 172.21.15.81:0/1718058057 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:20.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f259dd9b640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25a009af70 0x7f25a00b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f259ed9d640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25a00b1920 0x7f25a00b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f259e59c640 1 -- 172.21.15.81:0/1718058057 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25a009af70 msgr2=0x7f25a00b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f259e59c640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25a009af70 0x7f25a00b5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f259e59c640 1 -- 172.21.15.81:0/1718058057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25a00b1920 msgr2=0x7f25a00b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f259e59c640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25a00b1920 0x7f25a00b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f259e59c640 1 -- 172.21.15.81:0/1718058057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a00cb580 con 0x7f25a0071160 2024-09-16T01:24:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.911+0000 7f259e59c640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a0071160 0x7f25a015bd00 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f259002a200 tx=0x7f25900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.912+0000 7f258effd640 1 -- 172.21.15.81:0/1718058057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590041030 con 0x7f25a0071160 2024-09-16T01:24:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.912+0000 7f258effd640 1 -- 172.21.15.81:0/1718058057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2590030440 con 0x7f25a0071160 2024-09-16T01:24:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.912+0000 7f25a4b52640 1 -- 172.21.15.81:0/1718058057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a00cb860 con 0x7f25a0071160 2024-09-16T01:24:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.912+0000 7f258effd640 1 -- 172.21.15.81:0/1718058057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590037040 con 0x7f25a0071160 2024-09-16T01:24:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.912+0000 7f25a4b52640 1 -- 172.21.15.81:0/1718058057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a00cbe20 con 0x7f25a0071160 2024-09-16T01:24:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.913+0000 7f25a4b52640 1 -- 172.21.15.81:0/1718058057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25a00cc060 con 0x7f25a0071160 2024-09-16T01:24:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.913+0000 7f258effd640 1 -- 172.21.15.81:0/1718058057 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2590044070 con 0x7f25a0071160 2024-09-16T01:24:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.913+0000 7f258effd640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f258006c2b0 0x7f258006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.914+0000 7f258effd640 1 -- 172.21.15.81:0/1718058057 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f25900ab630 con 0x7f25a0071160 2024-09-16T01:24:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.914+0000 7f259dd9b640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f258006c2b0 0x7f258006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.914+0000 7f258effd640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] conn(0x7f2580072750 0x7f2580074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.914+0000 7f258effd640 1 -- 172.21.15.81:0/1718058057 --> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2590032440 con 0x7f2580072750 2024-09-16T01:24:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.914+0000 7f258effd640 1 -- 172.21.15.81:0/1718058057 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7f25900b2050 con 0x7f25a0071160 2024-09-16T01:24:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.914+0000 7f259dd9b640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f258006c2b0 0x7f258006e770 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f25a00cad30 tx=0x7f2594008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.914+0000 7f259ed9d640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] conn(0x7f2580072750 0x7f2580074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.914+0000 7f259ed9d640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] conn(0x7f2580072750 0x7f2580074b90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:20.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.915+0000 7f258effd640 1 -- 172.21.15.81:0/1718058057 <== osd.6 v2:172.21.15.102:6824/136250174 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2590032440 con 0x7f2580072750 2024-09-16T01:24:20.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.928+0000 7f25a4b52640 1 -- 172.21.15.81:0/1718058057 --> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f25a01f2ef0 con 0x7f2580072750 2024-09-16T01:24:20.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.928+0000 7f258effd640 1 -- 172.21.15.81:0/1718058057 <== osd.6 v2:172.21.15.102:6824/136250174 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f25a01f2ef0 con 0x7f2580072750 2024-09-16T01:24:20.929 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:24:20.930 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:24:20.930 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:24:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.929+0000 7f25a4b52640 1 -- 172.21.15.81:0/1718058057 >> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] conn(0x7f2580072750 msgr2=0x7f2580074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.929+0000 7f25a4b52640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.102:6824/136250174,v1:172.21.15.102:6825/136250174] conn(0x7f2580072750 0x7f2580074b90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.929+0000 7f25a4b52640 1 -- 172.21.15.81:0/1718058057 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f258006c2b0 msgr2=0x7f258006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.929+0000 7f25a4b52640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f258006c2b0 0x7f258006e770 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f25a00cad30 tx=0x7f2594008040 comp rx=0 tx=0).stop 2024-09-16T01:24:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.929+0000 7f25a4b52640 1 -- 172.21.15.81:0/1718058057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a0071160 msgr2=0x7f25a015bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.929+0000 7f25a4b52640 1 --2- 172.21.15.81:0/1718058057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25a0071160 0x7f25a015bd00 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f259002a200 tx=0x7f25900046c0 comp rx=0 tx=0).stop 2024-09-16T01:24:20.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.929+0000 7f259ed9d640 1 -- 172.21.15.81:0/1718058057 reap_dead start 2024-09-16T01:24:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.929+0000 7f25a4b52640 1 -- 172.21.15.81:0/1718058057 shutdown_connections 2024-09-16T01:24:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.929+0000 7f25a4b52640 1 -- 172.21.15.81:0/1718058057 >> 172.21.15.81:0/1718058057 conn(0x7f25a00b3de0 msgr2=0x7f25a009b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.929+0000 7f25a4b52640 1 -- 172.21.15.81:0/1718058057 shutdown_connections 2024-09-16T01:24:20.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:20.929+0000 7f25a4b52640 1 -- 172.21.15.81:0/1718058057 wait complete. 2024-09-16T01:24:20.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-16T01:24:21.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.039+0000 7f2294131640 1 Processor -- start 2024-09-16T01:24:21.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.039+0000 7f2294131640 1 -- start start 2024-09-16T01:24:21.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.040+0000 7f2294131640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f228c0d30f0 0x7f228c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.040+0000 7f2294131640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228c0b64c0 0x7f228c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.040+0000 7f2294131640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c0d3690 con 0x7f228c15e5f0 2024-09-16T01:24:21.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.040+0000 7f2294131640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f228c06d530 con 0x7f228c0d30f0 2024-09-16T01:24:21.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.040+0000 7f2294131640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f228c0d3970 con 0x7f228c0b64c0 2024-09-16T01:24:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.040+0000 7f22916cc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f228c0d30f0 0x7f228c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.040+0000 7f22926ce640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228c0b64c0 0x7f228c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.040+0000 7f22916cc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f228c0d30f0 0x7f228c0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:50114/0 (socket says 172.21.15.81:50114) 2024-09-16T01:24:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.040+0000 7f22916cc640 1 -- 172.21.15.81:0/191597005 learned_addr learned my addr 172.21.15.81:0/191597005 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.041+0000 7f22916cc640 1 -- 172.21.15.81:0/191597005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228c0b64c0 msgr2=0x7f228c06d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.041+0000 7f22916cc640 1 --2- 172.21.15.81:0/191597005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228c0b64c0 0x7f228c06d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.041+0000 7f22916cc640 1 -- 172.21.15.81:0/191597005 >> v1:172.21.15.102:6789/0 conn(0x7f228c15e5f0 legacy=0x7f228c0d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.041+0000 7f2290ecb640 1 -- 172.21.15.81:0/191597005 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428610513 0 0) 0x7f228c0d3690 con 0x7f228c15e5f0 2024-09-16T01:24:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.041+0000 7f22916cc640 1 -- 172.21.15.81:0/191597005 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c06cee0 con 0x7f228c0d30f0 2024-09-16T01:24:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.041+0000 7f22916cc640 1 --2- 172.21.15.81:0/191597005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0d30f0 0x7f228c0b5f80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f227c009870 tx=0x7f227c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a489f63828ebc58 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.042+0000 7f2290ecb640 1 -- 172.21.15.81:0/191597005 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c037070 con 0x7f228c0d30f0 2024-09-16T01:24:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.042+0000 7f2290ecb640 1 -- 172.21.15.81:0/191597005 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c032440 con 0x7f228c0d30f0 2024-09-16T01:24:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.042+0000 7f2290ecb640 1 -- 172.21.15.81:0/191597005 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c032810 con 0x7f228c0d30f0 2024-09-16T01:24:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.042+0000 7f2294131640 1 -- 172.21.15.81:0/191597005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0d30f0 msgr2=0x7f228c0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.042+0000 7f2294131640 1 --2- 172.21.15.81:0/191597005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0d30f0 0x7f228c0b5f80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f227c009870 tx=0x7f227c02a270 comp rx=0 tx=0).stop 2024-09-16T01:24:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.042+0000 7f2294131640 1 -- 172.21.15.81:0/191597005 shutdown_connections 2024-09-16T01:24:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.042+0000 7f2294131640 1 --2- 172.21.15.81:0/191597005 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228c0b64c0 0x7f228c06d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.042+0000 7f2294131640 1 --2- 172.21.15.81:0/191597005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0d30f0 0x7f228c0b5f80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.042+0000 7f2294131640 1 -- 172.21.15.81:0/191597005 >> 172.21.15.81:0/191597005 conn(0x7f228c08bfc0 msgr2=0x7f228c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.042+0000 7f2294131640 1 -- 172.21.15.81:0/191597005 shutdown_connections 2024-09-16T01:24:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.042+0000 7f2294131640 1 -- 172.21.15.81:0/191597005 wait complete. 2024-09-16T01:24:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.043+0000 7f2294131640 1 Processor -- start 2024-09-16T01:24:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.043+0000 7f2294131640 1 -- start start 2024-09-16T01:24:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f2294131640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0b64c0 0x7f228c156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f2294131640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0d30f0 0x7f228c0caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f2294131640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228c15e5f0 0x7f228c0b4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f2294131640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f228c06df00 con 0x7f228c0b64c0 2024-09-16T01:24:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f2294131640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f228c15e9d0 con 0x7f228c0d30f0 2024-09-16T01:24:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f2294131640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f228c06e080 con 0x7f228c15e5f0 2024-09-16T01:24:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f2291ecd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0b64c0 0x7f228c156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f2291ecd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0b64c0 0x7f228c156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55474/0 (socket says 172.21.15.81:55474) 2024-09-16T01:24:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f2291ecd640 1 -- 172.21.15.81:0/2695930439 learned_addr learned my addr 172.21.15.81:0/2695930439 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f22916cc640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0d30f0 0x7f228c0caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f22926ce640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228c15e5f0 0x7f228c0b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f2291ecd640 1 -- 172.21.15.81:0/2695930439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228c15e5f0 msgr2=0x7f228c0b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.044+0000 7f2291ecd640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228c15e5f0 0x7f228c0b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.045+0000 7f2291ecd640 1 -- 172.21.15.81:0/2695930439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0d30f0 msgr2=0x7f228c0caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.045+0000 7f2291ecd640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0d30f0 0x7f228c0caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.045+0000 7f2291ecd640 1 -- 172.21.15.81:0/2695930439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c15b250 con 0x7f228c0b64c0 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.045+0000 7f2291ecd640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0b64c0 0x7f228c156570 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f228800c410 tx=0x7f228800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.045+0000 7f22827fc640 1 -- 172.21.15.81:0/2695930439 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288017070 con 0x7f228c0b64c0 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.045+0000 7f22827fc640 1 -- 172.21.15.81:0/2695930439 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22880035f0 con 0x7f228c0b64c0 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.045+0000 7f2294131640 1 -- 172.21.15.81:0/2695930439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c15b530 con 0x7f228c0b64c0 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.045+0000 7f22827fc640 1 -- 172.21.15.81:0/2695930439 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22880039e0 con 0x7f228c0b64c0 2024-09-16T01:24:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.045+0000 7f2294131640 1 -- 172.21.15.81:0/2695930439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c156cf0 con 0x7f228c0b64c0 2024-09-16T01:24:21.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.046+0000 7f2294131640 1 -- 172.21.15.81:0/2695930439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c06d9c0 con 0x7f228c0b64c0 2024-09-16T01:24:21.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.046+0000 7f22827fc640 1 -- 172.21.15.81:0/2695930439 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f228801a070 con 0x7f228c0b64c0 2024-09-16T01:24:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.047+0000 7f22827fc640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f227006c2b0 0x7f227006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.047+0000 7f22827fc640 1 -- 172.21.15.81:0/2695930439 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f228808a6b0 con 0x7f228c0b64c0 2024-09-16T01:24:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.047+0000 7f22916cc640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f227006c2b0 0x7f227006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.047+0000 7f22916cc640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f227006c2b0 0x7f227006e770 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f227c034000 tx=0x7f227c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.051+0000 7f22827fc640 1 -- 172.21.15.81:0/2695930439 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2288059020 con 0x7f228c0b64c0 2024-09-16T01:24:21.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.220+0000 7f2294131640 1 -- 172.21.15.81:0/2695930439 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f228c0b5e20 con 0x7f227006c2b0 2024-09-16T01:24:21.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.220+0000 7f22827fc640 1 -- 172.21.15.81:0/2695930439 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f228c0b5e20 con 0x7f227006c2b0 2024-09-16T01:24:21.221 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2024-09-16T01:24:21.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.222+0000 7f2294131640 1 -- 172.21.15.81:0/2695930439 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f227006c2b0 msgr2=0x7f227006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.222+0000 7f2294131640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f227006c2b0 0x7f227006e770 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f227c034000 tx=0x7f227c02e000 comp rx=0 tx=0).stop 2024-09-16T01:24:21.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.222+0000 7f2294131640 1 -- 172.21.15.81:0/2695930439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0b64c0 msgr2=0x7f228c156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.222+0000 7f2294131640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0b64c0 0x7f228c156570 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f228800c410 tx=0x7f228800c8d0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.222+0000 7f2294131640 1 -- 172.21.15.81:0/2695930439 shutdown_connections 2024-09-16T01:24:21.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.222+0000 7f2294131640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f227006c2b0 0x7f227006e770 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.222+0000 7f2294131640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f228c15e5f0 0x7f228c0b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.222+0000 7f2294131640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f228c0d30f0 0x7f228c0caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.222+0000 7f2294131640 1 --2- 172.21.15.81:0/2695930439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0b64c0 0x7f228c156570 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.222+0000 7f2294131640 1 -- 172.21.15.81:0/2695930439 >> 172.21.15.81:0/2695930439 conn(0x7f228c08bfc0 msgr2=0x7f228c0d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.222+0000 7f2294131640 1 -- 172.21.15.81:0/2695930439 shutdown_connections 2024-09-16T01:24:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.222+0000 7f2294131640 1 -- 172.21.15.81:0/2695930439 wait complete. 2024-09-16T01:24:21.234 INFO:tasks.ceph:Scrubbing osd.7 2024-09-16T01:24:21.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-16T01:24:21.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.336+0000 7f3fd1d18640 1 Processor -- start 2024-09-16T01:24:21.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.336+0000 7f3fd1d18640 1 -- start start 2024-09-16T01:24:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.336+0000 7f3fd1d18640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3fcc0b1920 0x7f3fcc09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.336+0000 7f3fd1d18640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fcc09af70 0x7f3fcc0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.336+0000 7f3fd1d18640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fcc0ce720 con 0x7f3fcc071160 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.336+0000 7f3fd1d18640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3fcc0cea00 con 0x7f3fcc0b1920 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.336+0000 7f3fd1d18640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3fcc0ccfe0 con 0x7f3fcc09af70 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.337+0000 7f3fcb7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3fcc0b1920 0x7f3fcc09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.337+0000 7f3fcb7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3fcc0b1920 0x7f3fcc09aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55478/0 (socket says 172.21.15.81:55478) 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.337+0000 7f3fcb7fe640 1 -- 172.21.15.81:0/1849164577 learned_addr learned my addr 172.21.15.81:0/1849164577 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.337+0000 7f3fcb7fe640 1 -- 172.21.15.81:0/1849164577 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fcc09af70 msgr2=0x7f3fcc0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.337+0000 7f3fc3fff640 1 --2- 172.21.15.81:0/1849164577 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fcc09af70 0x7f3fcc0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.337+0000 7f3fcb7fe640 1 --2- 172.21.15.81:0/1849164577 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fcc09af70 0x7f3fcc0cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.337+0000 7f3fcb7fe640 1 -- 172.21.15.81:0/1849164577 >> v1:172.21.15.102:6789/0 conn(0x7f3fcc071160 legacy=0x7f3fcc0700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.337+0000 7f3fcb7fe640 1 -- 172.21.15.81:0/1849164577 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fcc0cd2c0 con 0x7f3fcc0b1920 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.338+0000 7f3fcb7fe640 1 --2- 172.21.15.81:0/1849164577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fcc0b1920 0x7f3fcc09aa30 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009870 tx=0x7f3fbc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8228cc4480cd75 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.338+0000 7f3fcaffd640 1 -- 172.21.15.81:0/1849164577 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc037070 con 0x7f3fcc0b1920 2024-09-16T01:24:21.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.338+0000 7f3fcaffd640 1 -- 172.21.15.81:0/1849164577 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fbc032440 con 0x7f3fcc0b1920 2024-09-16T01:24:21.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.338+0000 7f3fcaffd640 1 -- 172.21.15.81:0/1849164577 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc032810 con 0x7f3fcc0b1920 2024-09-16T01:24:21.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.338+0000 7f3fd1d18640 1 -- 172.21.15.81:0/1849164577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fcc0b1920 msgr2=0x7f3fcc09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.338+0000 7f3fd1d18640 1 --2- 172.21.15.81:0/1849164577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fcc0b1920 0x7f3fcc09aa30 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc009870 tx=0x7f3fbc02a180 comp rx=0 tx=0).stop 2024-09-16T01:24:21.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.338+0000 7f3fd1d18640 1 -- 172.21.15.81:0/1849164577 shutdown_connections 2024-09-16T01:24:21.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.338+0000 7f3fd1d18640 1 --2- 172.21.15.81:0/1849164577 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fcc09af70 0x7f3fcc0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.338+0000 7f3fd1d18640 1 --2- 172.21.15.81:0/1849164577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fcc0b1920 0x7f3fcc09aa30 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.338+0000 7f3fd1d18640 1 -- 172.21.15.81:0/1849164577 >> 172.21.15.81:0/1849164577 conn(0x7f3fcc0b3de0 msgr2=0x7f3fcc0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:21.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.338+0000 7f3fd1d18640 1 -- 172.21.15.81:0/1849164577 shutdown_connections 2024-09-16T01:24:21.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.338+0000 7f3fd1d18640 1 -- 172.21.15.81:0/1849164577 wait complete. 2024-09-16T01:24:21.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.340+0000 7f3fd1d18640 1 Processor -- start 2024-09-16T01:24:21.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.340+0000 7f3fd1d18640 1 -- start start 2024-09-16T01:24:21.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.340+0000 7f3fd1d18640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fcc071160 0x7f3fcc14a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.340+0000 7f3fd1d18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fcc09af70 0x7f3fcc06df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.340+0000 7f3fd1d18640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fcc0b1920 0x7f3fcc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.340+0000 7f3fd1d18640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc0d01f0 con 0x7f3fcc09af70 2024-09-16T01:24:21.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.340+0000 7f3fd1d18640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3fcc0d0070 con 0x7f3fcc071160 2024-09-16T01:24:21.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.340+0000 7f3fd1d18640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3fcc0cdd20 con 0x7f3fcc0b1920 2024-09-16T01:24:21.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.340+0000 7f3fc3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fcc09af70 0x7f3fcc06df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.340+0000 7f3fc3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fcc09af70 0x7f3fcc06df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55484/0 (socket says 172.21.15.81:55484) 2024-09-16T01:24:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.340+0000 7f3fc3fff640 1 -- 172.21.15.81:0/2663141732 learned_addr learned my addr 172.21.15.81:0/2663141732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.340+0000 7f3fcb7fe640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fcc071160 0x7f3fcc14a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.341+0000 7f3fcbfff640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fcc0b1920 0x7f3fcc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.341+0000 7f3fc3fff640 1 -- 172.21.15.81:0/2663141732 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fcc0b1920 msgr2=0x7f3fcc06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.341+0000 7f3fc3fff640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3fcc0b1920 0x7f3fcc06e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.341+0000 7f3fc3fff640 1 -- 172.21.15.81:0/2663141732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fcc071160 msgr2=0x7f3fcc14a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.341+0000 7f3fc3fff640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3fcc071160 0x7f3fcc14a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.341+0000 7f3fc3fff640 1 -- 172.21.15.81:0/2663141732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fcc06cec0 con 0x7f3fcc09af70 2024-09-16T01:24:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.341+0000 7f3fc3fff640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fcc09af70 0x7f3fcc06df60 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400c7f0 tx=0x7f3fb400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.341+0000 7f3fc8ff9640 1 -- 172.21.15.81:0/2663141732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4015070 con 0x7f3fcc09af70 2024-09-16T01:24:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.341+0000 7f3fc8ff9640 1 -- 172.21.15.81:0/2663141732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fb4004240 con 0x7f3fcc09af70 2024-09-16T01:24:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.341+0000 7f3fd1d18640 1 -- 172.21.15.81:0/2663141732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fcc06d1a0 con 0x7f3fcc09af70 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.341+0000 7f3fc8ff9640 1 -- 172.21.15.81:0/2663141732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4007620 con 0x7f3fcc09af70 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.341+0000 7f3fd1d18640 1 -- 172.21.15.81:0/2663141732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fcc06d760 con 0x7f3fcc09af70 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.342+0000 7f3fd1d18640 1 -- 172.21.15.81:0/2663141732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3fcc14a040 con 0x7f3fcc09af70 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.342+0000 7f3fc8ff9640 1 -- 172.21.15.81:0/2663141732 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3fb40079d0 con 0x7f3fcc09af70 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.343+0000 7f3fc8ff9640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3fac06c2b0 0x7f3fac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.343+0000 7f3fc8ff9640 1 -- 172.21.15.81:0/2663141732 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f3fb408b6b0 con 0x7f3fcc09af70 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.343+0000 7f3fcb7fe640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3fac06c2b0 0x7f3fac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.343+0000 7f3fc8ff9640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] conn(0x7f3fac072750 0x7f3fac074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.343+0000 7f3fc8ff9640 1 -- 172.21.15.81:0/2663141732 --> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fac075260 con 0x7f3fac072750 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.343+0000 7f3fc8ff9640 1 -- 172.21.15.81:0/2663141732 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=152) ==== 24+0+0 (secure 0 0 0) 0x7f3fb4092050 con 0x7f3fcc09af70 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.343+0000 7f3fcbfff640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] conn(0x7f3fac072750 0x7f3fac074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.343+0000 7f3fcb7fe640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3fac06c2b0 0x7f3fac06e770 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc034000 tx=0x7f3fbc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.344+0000 7f3fcbfff640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] conn(0x7f3fac072750 0x7f3fac074b90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.344+0000 7f3fc8ff9640 1 -- 172.21.15.81:0/2663141732 <== osd.7 v2:172.21.15.102:6800/1527646643 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3fac075260 con 0x7f3fac072750 2024-09-16T01:24:21.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.357+0000 7f3fd1d18640 1 -- 172.21.15.81:0/2663141732 --> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3fcc0cd7e0 con 0x7f3fac072750 2024-09-16T01:24:21.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.357+0000 7f3fc8ff9640 1 -- 172.21.15.81:0/2663141732 <== osd.7 v2:172.21.15.102:6800/1527646643 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3fcc0cd7e0 con 0x7f3fac072750 2024-09-16T01:24:21.358 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-16T01:24:21.358 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-16T01:24:21.358 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-16T01:24:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.358+0000 7f3fd1d18640 1 -- 172.21.15.81:0/2663141732 >> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] conn(0x7f3fac072750 msgr2=0x7f3fac074b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.358+0000 7f3fd1d18640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.102:6800/1527646643,v1:172.21.15.102:6801/1527646643] conn(0x7f3fac072750 0x7f3fac074b90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.358+0000 7f3fd1d18640 1 -- 172.21.15.81:0/2663141732 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3fac06c2b0 msgr2=0x7f3fac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.358+0000 7f3fd1d18640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f3fac06c2b0 0x7f3fac06e770 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc034000 tx=0x7f3fbc02e000 comp rx=0 tx=0).stop 2024-09-16T01:24:21.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.358+0000 7f3fd1d18640 1 -- 172.21.15.81:0/2663141732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fcc09af70 msgr2=0x7f3fcc06df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.358+0000 7f3fd1d18640 1 --2- 172.21.15.81:0/2663141732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fcc09af70 0x7f3fcc06df60 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400c7f0 tx=0x7f3fb400ccb0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.358+0000 7f3fcbfff640 1 -- 172.21.15.81:0/2663141732 reap_dead start 2024-09-16T01:24:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.358+0000 7f3fd1d18640 1 -- 172.21.15.81:0/2663141732 shutdown_connections 2024-09-16T01:24:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.358+0000 7f3fd1d18640 1 -- 172.21.15.81:0/2663141732 >> 172.21.15.81:0/2663141732 conn(0x7f3fcc0b3de0 msgr2=0x7f3fcc0b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.358+0000 7f3fd1d18640 1 -- 172.21.15.81:0/2663141732 shutdown_connections 2024-09-16T01:24:21.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.358+0000 7f3fd1d18640 1 -- 172.21.15.81:0/2663141732 wait complete. 2024-09-16T01:24:21.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-16T01:24:21.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.467+0000 7fb22ae65640 1 Processor -- start 2024-09-16T01:24:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.467+0000 7fb22ae65640 1 -- start start 2024-09-16T01:24:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.468+0000 7fb22ae65640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb224072d30 0x7fb22406f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.468+0000 7fb22ae65640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb22406f700 0x7fb22415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.468+0000 7fb22ae65640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22406fae0 con 0x7fb22415b300 2024-09-16T01:24:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.468+0000 7fb22ae65640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb2240728a0 con 0x7fb224072d30 2024-09-16T01:24:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.468+0000 7fb22ae65640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb2240cdbe0 con 0x7fb22406f700 2024-09-16T01:24:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.468+0000 7fb223fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb224072d30 0x7fb22406f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.468+0000 7fb223fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb224072d30 0x7fb22406f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55494/0 (socket says 172.21.15.81:55494) 2024-09-16T01:24:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.468+0000 7fb223fff640 1 -- 172.21.15.81:0/2803183133 learned_addr learned my addr 172.21.15.81:0/2803183133 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.469+0000 7fb229402640 1 --2- 172.21.15.81:0/2803183133 >> v2:172.21.15.102:3300/0 conn(0x7fb22406f700 0x7fb22415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.469+0000 7fb223fff640 1 -- 172.21.15.81:0/2803183133 >> v2:172.21.15.102:3300/0 conn(0x7fb22406f700 msgr2=0x7fb22415b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.469+0000 7fb223fff640 1 --2- 172.21.15.81:0/2803183133 >> v2:172.21.15.102:3300/0 conn(0x7fb22406f700 0x7fb22415b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.469+0000 7fb223fff640 1 -- 172.21.15.81:0/2803183133 >> v1:172.21.15.81:6789/0 conn(0x7fb22415b300 legacy=0x7fb2240cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.469+0000 7fb223fff640 1 -- 172.21.15.81:0/2803183133 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2240cd900 con 0x7fb224072d30 2024-09-16T01:24:21.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.469+0000 7fb229402640 1 --2- 172.21.15.81:0/2803183133 >> v2:172.21.15.102:3300/0 conn(0x7fb22406f700 0x7fb22415b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:21.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.469+0000 7fb223fff640 1 --2- 172.21.15.81:0/2803183133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224072d30 0x7fb22406f1c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fb2240b38f0 tx=0x7fb21802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2f9f836465bb42 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.470+0000 7fb2237fe640 1 -- 172.21.15.81:0/2803183133 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb218036070 con 0x7fb224072d30 2024-09-16T01:24:21.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.470+0000 7fb2237fe640 1 -- 172.21.15.81:0/2803183133 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb218031600 con 0x7fb224072d30 2024-09-16T01:24:21.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.470+0000 7fb2237fe640 1 -- 172.21.15.81:0/2803183133 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2180319d0 con 0x7fb224072d30 2024-09-16T01:24:21.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.470+0000 7fb22ae65640 1 -- 172.21.15.81:0/2803183133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224072d30 msgr2=0x7fb22406f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.470+0000 7fb22ae65640 1 --2- 172.21.15.81:0/2803183133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224072d30 0x7fb22406f1c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fb2240b38f0 tx=0x7fb21802a6a0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.470+0000 7fb22ae65640 1 -- 172.21.15.81:0/2803183133 shutdown_connections 2024-09-16T01:24:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.470+0000 7fb22ae65640 1 --2- 172.21.15.81:0/2803183133 >> v2:172.21.15.102:3300/0 conn(0x7fb22406f700 0x7fb22415b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.470+0000 7fb22ae65640 1 --2- 172.21.15.81:0/2803183133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb224072d30 0x7fb22406f1c0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.470+0000 7fb22ae65640 1 -- 172.21.15.81:0/2803183133 >> 172.21.15.81:0/2803183133 conn(0x7fb224067d70 msgr2=0x7fb22406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.470+0000 7fb22ae65640 1 -- 172.21.15.81:0/2803183133 shutdown_connections 2024-09-16T01:24:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.470+0000 7fb22ae65640 1 -- 172.21.15.81:0/2803183133 wait complete. 2024-09-16T01:24:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.471+0000 7fb22ae65640 1 Processor -- start 2024-09-16T01:24:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.471+0000 7fb22ae65640 1 -- start start 2024-09-16T01:24:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.472+0000 7fb22ae65640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb22406f700 0x7fb2240b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.472+0000 7fb22ae65640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb224072d30 0x7fb2241e77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.472+0000 7fb22ae65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22415b300 0x7fb2241e7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.472+0000 7fb22ae65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2240cd5c0 con 0x7fb22415b300 2024-09-16T01:24:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.472+0000 7fb22ae65640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb224072530 con 0x7fb22406f700 2024-09-16T01:24:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.472+0000 7fb22ae65640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb2240cffe0 con 0x7fb224072d30 2024-09-16T01:24:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.472+0000 7fb229402640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22415b300 0x7fb2241e7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.472+0000 7fb229402640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22415b300 0x7fb2241e7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55508/0 (socket says 172.21.15.81:55508) 2024-09-16T01:24:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.472+0000 7fb229402640 1 -- 172.21.15.81:0/3921507998 learned_addr learned my addr 172.21.15.81:0/3921507998 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:21.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.473+0000 7fb228c01640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb22406f700 0x7fb2240b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.473+0000 7fb229402640 1 -- 172.21.15.81:0/3921507998 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb224072d30 msgr2=0x7fb2241e77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.473+0000 7fb229402640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb224072d30 0x7fb2241e77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.473+0000 7fb229402640 1 -- 172.21.15.81:0/3921507998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb22406f700 msgr2=0x7fb2240b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.473+0000 7fb229402640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb22406f700 0x7fb2240b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.473+0000 7fb229402640 1 -- 172.21.15.81:0/3921507998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb224147c40 con 0x7fb22415b300 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.473+0000 7fb229402640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22415b300 0x7fb2241e7d10 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00c7f0 tx=0x7fb21c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.473+0000 7fb2217fa640 1 -- 172.21.15.81:0/3921507998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c015020 con 0x7fb22415b300 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.473+0000 7fb2217fa640 1 -- 172.21.15.81:0/3921507998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb21c004230 con 0x7fb22415b300 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.473+0000 7fb22ae65640 1 -- 172.21.15.81:0/3921507998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb224147960 con 0x7fb22415b300 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.473+0000 7fb2217fa640 1 -- 172.21.15.81:0/3921507998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c007620 con 0x7fb22415b300 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.473+0000 7fb22ae65640 1 -- 172.21.15.81:0/3921507998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb224145040 con 0x7fb22415b300 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.474+0000 7fb22ae65640 1 -- 172.21.15.81:0/3921507998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22406f1c0 con 0x7fb22415b300 2024-09-16T01:24:21.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.475+0000 7fb2217fa640 1 -- 172.21.15.81:0/3921507998 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb21c018020 con 0x7fb22415b300 2024-09-16T01:24:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.475+0000 7fb2217fa640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb21006c2e0 0x7fb21006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.475+0000 7fb228c01640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb21006c2e0 0x7fb21006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.475+0000 7fb2217fa640 1 -- 172.21.15.81:0/3921507998 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7fb21c08b310 con 0x7fb22415b300 2024-09-16T01:24:21.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.476+0000 7fb228c01640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb21006c2e0 0x7fb21006e7a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb224144b20 tx=0x7fb214009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.480+0000 7fb2217fa640 1 -- 172.21.15.81:0/3921507998 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb21c01f020 con 0x7fb22415b300 2024-09-16T01:24:21.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.644+0000 7fb22ae65640 1 -- 172.21.15.81:0/3921507998 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fb2240b2df0 con 0x7fb21006c2e0 2024-09-16T01:24:21.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.645+0000 7fb2217fa640 1 -- 172.21.15.81:0/3921507998 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb2240b2df0 con 0x7fb21006c2e0 2024-09-16T01:24:21.646 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2024-09-16T01:24:21.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.647+0000 7fb22ae65640 1 -- 172.21.15.81:0/3921507998 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb21006c2e0 msgr2=0x7fb21006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.647+0000 7fb22ae65640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb21006c2e0 0x7fb21006e7a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb224144b20 tx=0x7fb214009040 comp rx=0 tx=0).stop 2024-09-16T01:24:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.647+0000 7fb22ae65640 1 -- 172.21.15.81:0/3921507998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22415b300 msgr2=0x7fb2241e7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.647+0000 7fb22ae65640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22415b300 0x7fb2241e7d10 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00c7f0 tx=0x7fb21c00ccb0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.647+0000 7fb22ae65640 1 -- 172.21.15.81:0/3921507998 shutdown_connections 2024-09-16T01:24:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.647+0000 7fb22ae65640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fb21006c2e0 0x7fb21006e7a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.647+0000 7fb22ae65640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22415b300 0x7fb2241e7d10 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.647+0000 7fb22ae65640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb224072d30 0x7fb2241e77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.647+0000 7fb22ae65640 1 --2- 172.21.15.81:0/3921507998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb22406f700 0x7fb2240b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.647+0000 7fb22ae65640 1 -- 172.21.15.81:0/3921507998 >> 172.21.15.81:0/3921507998 conn(0x7fb224067d70 msgr2=0x7fb2240cceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.647+0000 7fb22ae65640 1 -- 172.21.15.81:0/3921507998 shutdown_connections 2024-09-16T01:24:21.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.647+0000 7fb22ae65640 1 -- 172.21.15.81:0/3921507998 wait complete. 2024-09-16T01:24:21.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:24:21.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.756+0000 7efdacef1640 1 Processor -- start 2024-09-16T01:24:21.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.756+0000 7efdacef1640 1 -- start start 2024-09-16T01:24:21.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efdacef1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efda80d0be0 0x7efda80cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efdacef1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda815d460 0x7efda80afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efdacef1640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda80af720 con 0x7efda8145e00 2024-09-16T01:24:21.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efdacef1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7efda81461e0 con 0x7efda80d0be0 2024-09-16T01:24:21.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efdacef1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efda80cdf90 con 0x7efda815d460 2024-09-16T01:24:21.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efd9dd9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efda80d0be0 0x7efda80cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efd9dd9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efda80d0be0 0x7efda80cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55522/0 (socket says 172.21.15.81:55522) 2024-09-16T01:24:21.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efd9dd9b640 1 -- 172.21.15.81:0/2865061289 learned_addr learned my addr 172.21.15.81:0/2865061289 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:21.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efda6d9d640 1 --2- 172.21.15.81:0/2865061289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda815d460 0x7efda80afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efd9dd9b640 1 -- 172.21.15.81:0/2865061289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda815d460 msgr2=0x7efda80afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:21.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efd9dd9b640 1 --2- 172.21.15.81:0/2865061289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda815d460 0x7efda80afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efd9dd9b640 1 -- 172.21.15.81:0/2865061289 >> v1:172.21.15.102:6789/0 conn(0x7efda8145e00 legacy=0x7efda80d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:21.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efd9dd9b640 1 -- 172.21.15.81:0/2865061289 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda80ce270 con 0x7efda80d0be0 2024-09-16T01:24:21.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.757+0000 7efda6d9d640 1 --2- 172.21.15.81:0/2865061289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda815d460 0x7efda80afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T01:24:21.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.758+0000 7efd9dd9b640 1 --2- 172.21.15.81:0/2865061289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80d0be0 0x7efda80cd8a0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7efda8156fe0 tx=0x7efd9002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc9fb93ae1fd3f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.758+0000 7efda5d9b640 1 -- 172.21.15.81:0/2865061289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90037070 con 0x7efda80d0be0 2024-09-16T01:24:21.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.758+0000 7efda5d9b640 1 -- 172.21.15.81:0/2865061289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd90032440 con 0x7efda80d0be0 2024-09-16T01:24:21.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.758+0000 7efda5d9b640 1 -- 172.21.15.81:0/2865061289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90032810 con 0x7efda80d0be0 2024-09-16T01:24:21.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.758+0000 7efdacef1640 1 -- 172.21.15.81:0/2865061289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80d0be0 msgr2=0x7efda80cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.758+0000 7efdacef1640 1 --2- 172.21.15.81:0/2865061289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80d0be0 0x7efda80cd8a0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7efda8156fe0 tx=0x7efd9002a1e0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.758+0000 7efdacef1640 1 -- 172.21.15.81:0/2865061289 shutdown_connections 2024-09-16T01:24:21.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.758+0000 7efdacef1640 1 --2- 172.21.15.81:0/2865061289 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda815d460 0x7efda80afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.758+0000 7efdacef1640 1 --2- 172.21.15.81:0/2865061289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80d0be0 0x7efda80cd8a0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.758+0000 7efdacef1640 1 -- 172.21.15.81:0/2865061289 >> 172.21.15.81:0/2865061289 conn(0x7efda80b2f40 msgr2=0x7efda80b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:21.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.758+0000 7efdacef1640 1 -- 172.21.15.81:0/2865061289 shutdown_connections 2024-09-16T01:24:21.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.758+0000 7efdacef1640 1 -- 172.21.15.81:0/2865061289 wait complete. 2024-09-16T01:24:21.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.760+0000 7efdacef1640 1 Processor -- start 2024-09-16T01:24:21.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.760+0000 7efdacef1640 1 -- start start 2024-09-16T01:24:21.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efdacef1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80d0be0 0x7efda8156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efdacef1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efda8145e00 0x7efda8157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efdacef1640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda815d460 0x7efda81e3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efdacef1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efda815d8b0 con 0x7efda80d0be0 2024-09-16T01:24:21.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efdacef1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efda80ce830 con 0x7efda8145e00 2024-09-16T01:24:21.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efdacef1640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efda80cede0 con 0x7efda815d460 2024-09-16T01:24:21.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efda659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80d0be0 0x7efda8156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efda659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80d0be0 0x7efda8156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55536/0 (socket says 172.21.15.81:55536) 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efda659c640 1 -- 172.21.15.81:0/1824781875 learned_addr learned my addr 172.21.15.81:0/1824781875 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efd9dd9b640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efda8145e00 0x7efda8157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efda659c640 1 -- 172.21.15.81:0/1824781875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda815d460 msgr2=0x7efda81e3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efda659c640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda815d460 0x7efda81e3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efda659c640 1 -- 172.21.15.81:0/1824781875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efda8145e00 msgr2=0x7efda8157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efda659c640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efda8145e00 0x7efda8157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efda659c640 1 -- 172.21.15.81:0/1824781875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda80b49a0 con 0x7efda80d0be0 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efda659c640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80d0be0 0x7efda8156fe0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c430 tx=0x7efd9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efd9f7fe640 1 -- 172.21.15.81:0/1824781875 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98011790 con 0x7efda80d0be0 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efd9f7fe640 1 -- 172.21.15.81:0/1824781875 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98017070 con 0x7efda80d0be0 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efdacef1640 1 -- 172.21.15.81:0/1824781875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda80b4c80 con 0x7efda80d0be0 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efd9f7fe640 1 -- 172.21.15.81:0/1824781875 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98011b70 con 0x7efda80d0be0 2024-09-16T01:24:21.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.761+0000 7efdacef1640 1 -- 172.21.15.81:0/1824781875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda80b5240 con 0x7efda80d0be0 2024-09-16T01:24:21.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.763+0000 7efdacef1640 1 -- 172.21.15.81:0/1824781875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda8068c60 con 0x7efda80d0be0 2024-09-16T01:24:21.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.763+0000 7efd9f7fe640 1 -- 172.21.15.81:0/1824781875 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efd98011d10 con 0x7efda80d0be0 2024-09-16T01:24:21.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.763+0000 7efd9f7fe640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8806c2b0 0x7efd8806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:21.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.763+0000 7efd9f7fe640 1 -- 172.21.15.81:0/1824781875 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7efd9808b130 con 0x7efda80d0be0 2024-09-16T01:24:21.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.763+0000 7efd9dd9b640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8806c2b0 0x7efd8806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:21.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.764+0000 7efd9dd9b640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8806c2b0 0x7efd8806e770 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7efd90034000 tx=0x7efd9002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:21.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.767+0000 7efd9f7fe640 1 -- 172.21.15.81:0/1824781875 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efda8068c60 con 0x7efda80d0be0 2024-09-16T01:24:21.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.929+0000 7efdacef1640 1 -- 172.21.15.81:0/1824781875 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efda80cd8a0 con 0x7efd8806c2b0 2024-09-16T01:24:21.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.929+0000 7efd9f7fe640 1 -- 172.21.15.81:0/1824781875 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13496 (secure 0 0 0) 0x7efda80cd8a0 con 0x7efd8806c2b0 2024-09-16T01:24:21.930 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:21.931 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:24:21.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.932+0000 7efdacef1640 1 -- 172.21.15.81:0/1824781875 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8806c2b0 msgr2=0x7efd8806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.932+0000 7efdacef1640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8806c2b0 0x7efd8806e770 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7efd90034000 tx=0x7efd9002e000 comp rx=0 tx=0).stop 2024-09-16T01:24:21.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.932+0000 7efdacef1640 1 -- 172.21.15.81:0/1824781875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80d0be0 msgr2=0x7efda8156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:21.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.932+0000 7efdacef1640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80d0be0 0x7efda8156fe0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c430 tx=0x7efd9800c8f0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.932+0000 7efdacef1640 1 -- 172.21.15.81:0/1824781875 shutdown_connections 2024-09-16T01:24:21.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.932+0000 7efdacef1640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7efd8806c2b0 0x7efd8806e770 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.932+0000 7efdacef1640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efda815d460 0x7efda81e3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.932+0000 7efdacef1640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efda8145e00 0x7efda8157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.932+0000 7efdacef1640 1 --2- 172.21.15.81:0/1824781875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80d0be0 0x7efda8156fe0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:21.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.932+0000 7efdacef1640 1 -- 172.21.15.81:0/1824781875 >> 172.21.15.81:0/1824781875 conn(0x7efda80b2f40 msgr2=0x7efda813ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:21.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.932+0000 7efdacef1640 1 -- 172.21.15.81:0/1824781875 shutdown_connections 2024-09-16T01:24:21.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:21.932+0000 7efdacef1640 1 -- 172.21.15.81:0/1824781875 wait complete. 2024-09-16T01:24:21.943 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-09-16T01:24:20.171541+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":274020,"kb_used_data":16168,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754700700,"statfs":{"total":773094113280,"available":772813516800,"internally_reserved":0,"allocated":16556032,"data_stored":8277024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3909,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-48,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001249"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":411,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T01:24:14.716453+0000","last_change":"2024-09-16T01:15:30.035972+0000","last_active":"2024-09-16T01:24:14.716453+0000","last_peered":"2024-09-16T01:24:14.716453+0000","last_clean":"2024-09-16T01:24:14.716453+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:24:14.716453+0000","last_undegraded":"2024-09-16T01:24:14.716453+0000","last_fullsized":"2024-09-16T01:24:14.716453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T01:15:29.019883+0000","last_clean_scrub_stamp":"2024-09-16T01:15:29.019883+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:28.690948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33648,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338192,"statfs":{"total":96636764160,"available":96602308608,"internally_reserved":0,"allocated":2514944,"data_stored":1477404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37228,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334612,"statfs":{"total":96636764160,"available":96598642688,"internally_reserved":0,"allocated":1921024,"data_stored":887036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33068,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1921024,"data_stored":887036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37224,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334616,"statfs":{"total":96636764160,"available":96598646784,"internally_reserved":0,"allocated":1921024,"data_stored":887036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33068,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1921024,"data_stored":887036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33068,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1921024,"data_stored":887036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33068,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1921024,"data_stored":887036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33648,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338192,"statfs":{"total":96636764160,"available":96602308608,"internally_reserved":0,"allocated":2514944,"data_stored":1477404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:24:21.945 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-16T01:15:29.019883+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=1, tm_min=15, tm_sec=29, tm_wday=0, tm_yday=260, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=16, tm_hour=1, tm_min=24, tm_sec=17, tm_wday=0, tm_yday=260, tm_isdst=0) 2024-09-16T01:24:21.946 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-16T01:24:40.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:24:40.192 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:24:41.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-16T01:24:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.047+0000 7fad81152640 1 Processor -- start 2024-09-16T01:24:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.047+0000 7fad81152640 1 -- start start 2024-09-16T01:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad81152640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad7c15b300 0x7fad7c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad81152640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fad7c0cd3f0 0x7fad7c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad81152640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad7c072d30 0x7fad7c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad81152640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fad7c0728a0 con 0x7fad7c15b300 2024-09-16T01:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad81152640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fad7c0cdbe0 con 0x7fad7c0cd3f0 2024-09-16T01:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad81152640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fad7c0cd900 con 0x7fad7c072d30 2024-09-16T01:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad7ad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad7c15b300 0x7fad7c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad7ad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad7c15b300 0x7fad7c0cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57272/0 (socket says 172.21.15.81:57272) 2024-09-16T01:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad7ad9d640 1 -- 172.21.15.81:0/2782207445 learned_addr learned my addr 172.21.15.81:0/2782207445 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad7a59c640 1 --2- 172.21.15.81:0/2782207445 >> v2:172.21.15.102:3300/0 conn(0x7fad7c0cd3f0 0x7fad7c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad7b59e640 1 --2- 172.21.15.81:0/2782207445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad7c072d30 0x7fad7c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad7ad9d640 1 -- 172.21.15.81:0/2782207445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad7c072d30 msgr2=0x7fad7c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad7ad9d640 1 --2- 172.21.15.81:0/2782207445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad7c072d30 0x7fad7c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad7ad9d640 1 -- 172.21.15.81:0/2782207445 >> v2:172.21.15.102:3300/0 conn(0x7fad7c0cd3f0 msgr2=0x7fad7c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad7ad9d640 1 --2- 172.21.15.81:0/2782207445 >> v2:172.21.15.102:3300/0 conn(0x7fad7c0cd3f0 0x7fad7c06f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.048+0000 7fad7ad9d640 1 -- 172.21.15.81:0/2782207445 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c072250 con 0x7fad7c15b300 2024-09-16T01:24:42.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.049+0000 7fad7ad9d640 1 --2- 172.21.15.81:0/2782207445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad7c15b300 0x7fad7c0cceb0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0b57c0 tx=0x7fad6c02c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12903a912bf07f server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:42.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.049+0000 7fad79d9b640 1 -- 172.21.15.81:0/2782207445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00b2e0 con 0x7fad7c15b300 2024-09-16T01:24:42.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.049+0000 7fad79d9b640 1 -- 172.21.15.81:0/2782207445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad6c009600 con 0x7fad7c15b300 2024-09-16T01:24:42.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.049+0000 7fad79d9b640 1 -- 172.21.15.81:0/2782207445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00b480 con 0x7fad7c15b300 2024-09-16T01:24:42.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.050+0000 7fad81152640 1 -- 172.21.15.81:0/2782207445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad7c15b300 msgr2=0x7fad7c0cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.050+0000 7fad81152640 1 --2- 172.21.15.81:0/2782207445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad7c15b300 0x7fad7c0cceb0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fad7c0b57c0 tx=0x7fad6c02c8a0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.050+0000 7fad81152640 1 -- 172.21.15.81:0/2782207445 shutdown_connections 2024-09-16T01:24:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.050+0000 7fad81152640 1 --2- 172.21.15.81:0/2782207445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad7c072d30 0x7fad7c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.050+0000 7fad81152640 1 --2- 172.21.15.81:0/2782207445 >> v2:172.21.15.102:3300/0 conn(0x7fad7c0cd3f0 0x7fad7c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.050+0000 7fad81152640 1 --2- 172.21.15.81:0/2782207445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad7c15b300 0x7fad7c0cceb0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.050+0000 7fad81152640 1 -- 172.21.15.81:0/2782207445 >> 172.21.15.81:0/2782207445 conn(0x7fad7c067d70 msgr2=0x7fad7c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.050+0000 7fad81152640 1 -- 172.21.15.81:0/2782207445 shutdown_connections 2024-09-16T01:24:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.050+0000 7fad81152640 1 -- 172.21.15.81:0/2782207445 wait complete. 2024-09-16T01:24:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.051+0000 7fad81152640 1 Processor -- start 2024-09-16T01:24:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.051+0000 7fad81152640 1 -- start start 2024-09-16T01:24:42.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad81152640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad7c072d30 0x7fad7c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad81152640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad7c0cd3f0 0x7fad7c150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad81152640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad7c15b300 0x7fad7c1512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad81152640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c0d0160 con 0x7fad7c15b300 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad81152640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fad7c0cffe0 con 0x7fad7c072d30 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad81152640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fad7c0b3c40 con 0x7fad7c0cd3f0 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad7ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad7c072d30 0x7fad7c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad7b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad7c15b300 0x7fad7c1512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad7ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad7c072d30 0x7fad7c0cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.81:36478/0 (socket says 172.21.15.81:36478) 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad7a59c640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad7c0cd3f0 0x7fad7c150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad7ad9d640 1 -- 172.21.15.81:0/2982234556 learned_addr learned my addr 172.21.15.81:0/2982234556 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad7b59e640 1 -- 172.21.15.81:0/2982234556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad7c0cd3f0 msgr2=0x7fad7c150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad7b59e640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad7c0cd3f0 0x7fad7c150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad7b59e640 1 -- 172.21.15.81:0/2982234556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad7c072d30 msgr2=0x7fad7c0cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.052+0000 7fad7b59e640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad7c072d30 0x7fad7c0cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.053+0000 7fad7b59e640 1 -- 172.21.15.81:0/2982234556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7c156ff0 con 0x7fad7c15b300 2024-09-16T01:24:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.053+0000 7fad7ad9d640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad7c072d30 0x7fad7c0cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T01:24:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.053+0000 7fad7b59e640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad7c15b300 0x7fad7c1512d0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fad74009870 tx=0x7fad74009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.053+0000 7fad637fe640 1 -- 172.21.15.81:0/2982234556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74011630 con 0x7fad7c15b300 2024-09-16T01:24:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.053+0000 7fad637fe640 1 -- 172.21.15.81:0/2982234556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad740117d0 con 0x7fad7c15b300 2024-09-16T01:24:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.053+0000 7fad81152640 1 -- 172.21.15.81:0/2982234556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad7c154630 con 0x7fad7c15b300 2024-09-16T01:24:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.053+0000 7fad637fe640 1 -- 172.21.15.81:0/2982234556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad74011bc0 con 0x7fad7c15b300 2024-09-16T01:24:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.053+0000 7fad81152640 1 -- 172.21.15.81:0/2982234556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7c154bf0 con 0x7fad7c15b300 2024-09-16T01:24:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.054+0000 7fad81152640 1 -- 172.21.15.81:0/2982234556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad7c155080 con 0x7fad7c15b300 2024-09-16T01:24:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.054+0000 7fad637fe640 1 -- 172.21.15.81:0/2982234556 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fad74023400 con 0x7fad7c15b300 2024-09-16T01:24:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.055+0000 7fad637fe640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fad6806c2b0 0x7fad6806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.055+0000 7fad7ad9d640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fad6806c2b0 0x7fad6806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.055+0000 7fad637fe640 1 -- 172.21.15.81:0/2982234556 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7fad7408f240 con 0x7fad7c15b300 2024-09-16T01:24:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.055+0000 7fad7ad9d640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fad6806c2b0 0x7fad6806e770 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fad6c02c8e0 tx=0x7fad6c00b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.059+0000 7fad637fe640 1 -- 172.21.15.81:0/2982234556 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad7405d4d0 con 0x7fad7c15b300 2024-09-16T01:24:42.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.223+0000 7fad81152640 1 -- 172.21.15.81:0/2982234556 --> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad7c15d760 con 0x7fad6806c2b0 2024-09-16T01:24:42.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.224+0000 7fad637fe640 1 -- 172.21.15.81:0/2982234556 <== mgr.4107 v2:172.21.15.81:6824/3436185483 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7fad7c15d760 con 0x7fad6806c2b0 2024-09-16T01:24:42.226 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:42.226 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-16T01:24:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.226+0000 7fad81152640 1 -- 172.21.15.81:0/2982234556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fad6806c2b0 msgr2=0x7fad6806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.226+0000 7fad81152640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fad6806c2b0 0x7fad6806e770 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fad6c02c8e0 tx=0x7fad6c00b000 comp rx=0 tx=0).stop 2024-09-16T01:24:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.226+0000 7fad81152640 1 -- 172.21.15.81:0/2982234556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad7c15b300 msgr2=0x7fad7c1512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.226+0000 7fad81152640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad7c15b300 0x7fad7c1512d0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fad74009870 tx=0x7fad74009d30 comp rx=0 tx=0).stop 2024-09-16T01:24:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.226+0000 7fad81152640 1 -- 172.21.15.81:0/2982234556 shutdown_connections 2024-09-16T01:24:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.226+0000 7fad81152640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fad6806c2b0 0x7fad6806e770 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.226+0000 7fad81152640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad7c15b300 0x7fad7c1512d0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.226+0000 7fad81152640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fad7c0cd3f0 0x7fad7c150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.226+0000 7fad81152640 1 --2- 172.21.15.81:0/2982234556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fad7c072d30 0x7fad7c0cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.226+0000 7fad81152640 1 -- 172.21.15.81:0/2982234556 >> 172.21.15.81:0/2982234556 conn(0x7fad7c067d70 msgr2=0x7fad7c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.226+0000 7fad81152640 1 -- 172.21.15.81:0/2982234556 shutdown_connections 2024-09-16T01:24:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.226+0000 7fad81152640 1 -- 172.21.15.81:0/2982234556 wait complete. 2024-09-16T01:24:42.239 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":422,"stamp":"2024-09-16T01:24:42.175943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":274004,"kb_used_data":16168,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754700716,"statfs":{"total":773094113280,"available":772813533184,"internally_reserved":0,"allocated":16556032,"data_stored":8277024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":263835185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002442"},"pg_stats":[{"pgid":"1.0","version":"152'119","reported_seq":422,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-16T01:24:21.963661+0000","last_change":"2024-09-16T01:24:21.963697+0000","last_active":"2024-09-16T01:24:21.963661+0000","last_peered":"2024-09-16T01:24:21.963661+0000","last_clean":"2024-09-16T01:24:21.963661+0000","last_became_active":"2024-09-16T01:15:30.035621+0000","last_became_peered":"2024-09-16T01:15:30.035621+0000","last_unstale":"2024-09-16T01:24:21.963661+0000","last_undegraded":"2024-09-16T01:24:21.963661+0000","last_fullsized":"2024-09-16T01:24:21.963661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'119","last_scrub_stamp":"2024-09-16T01:24:21.963578+0000","last_deep_scrub":"152'119","last_deep_scrub_stamp":"2024-09-16T01:24:21.963578+0000","last_clean_scrub_stamp":"2024-09-16T01:24:21.963578+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:52.837150+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574961,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33640,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338200,"statfs":{"total":96636764160,"available":96602316800,"internally_reserved":0,"allocated":2514944,"data_stored":1477404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37228,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334612,"statfs":{"total":96636764160,"available":96598642688,"internally_reserved":0,"allocated":1921024,"data_stored":887036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33068,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1921024,"data_stored":887036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37224,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334616,"statfs":{"total":96636764160,"available":96598646784,"internally_reserved":0,"allocated":1921024,"data_stored":887036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33068,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1921024,"data_stored":887036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33068,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1921024,"data_stored":887036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33068,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1921024,"data_stored":887036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574961,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33640,"kb_used_data":2456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338200,"statfs":{"total":96636764160,"available":96602316800,"internally_reserved":0,"allocated":2514944,"data_stored":1477404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T01:24:42.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-16T01:24:42.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.335+0000 7fa435b1f640 1 Processor -- start 2024-09-16T01:24:42.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.335+0000 7fa435b1f640 1 -- start start 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.336+0000 7fa435b1f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4300d0510 0x7fa43015f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.336+0000 7fa435b1f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4300d0950 con 0x7fa43009aa30 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.336+0000 7fa435b1f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4300d0bd0 con 0x7fa43015f850 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.336+0000 7fa435b1f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa4300d17e0 con 0x7fa4300d0510 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.336+0000 7fa42f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa43009aa30 0x7fa43009ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47774/0 (socket says 172.21.15.81:47774) 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.336+0000 7fa42f7fe640 1 -- 172.21.15.81:0/1228736350 learned_addr learned my addr 172.21.15.81:0/1228736350 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.336+0000 7fa427fff640 1 --2- 172.21.15.81:0/1228736350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4300d0510 0x7fa43015f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.336+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 405974451 0 0) 0x7fa420001110 con 0x7fa43009aa30 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.336+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa41c003520 con 0x7fa43009aa30 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2677920745 0 0) 0x7fa4300d0bd0 con 0x7fa43015f850 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa420001110 con 0x7fa43015f850 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1462420407 0 0) 0x7fa41c003520 con 0x7fa43009aa30 2024-09-16T01:24:42.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4300d0510 msgr2=0x7fa43015f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 --2- 172.21.15.81:0/1228736350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4300d0510 0x7fa43015f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 >> v1:172.21.15.102:6789/0 conn(0x7fa43015f850 legacy=0x7fa43006cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4300d0eb0 con 0x7fa43009aa30 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2507747092 0 0) 0x7fa420001840 con 0x7fa43009aa30 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 >> v1:172.21.15.81:6789/0 conn(0x7fa43009aa30 legacy=0x7fa43009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 --2- 172.21.15.81:0/1228736350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003b70 0x7fa41c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 --2- 172.21.15.81:0/1228736350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa41c004800 0x7fa41c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 --2- 172.21.15.81:0/1228736350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4300d0510 0x7fa41c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300d17e0 con 0x7fa41c003b70 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa41c00baa0 con 0x7fa41c004800 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa41c00bca0 con 0x7fa4300d0510 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42f7fe640 1 --2- 172.21.15.81:0/1228736350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003b70 0x7fa41c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa427fff640 1 --2- 172.21.15.81:0/1228736350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa41c004800 0x7fa41c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42ffff640 1 --2- 172.21.15.81:0/1228736350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4300d0510 0x7fa41c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42f7fe640 1 -- 172.21.15.81:0/1228736350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4300d0510 msgr2=0x7fa41c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42f7fe640 1 --2- 172.21.15.81:0/1228736350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4300d0510 0x7fa41c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42f7fe640 1 -- 172.21.15.81:0/1228736350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa41c004800 msgr2=0x7fa41c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42f7fe640 1 --2- 172.21.15.81:0/1228736350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa41c004800 0x7fa41c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.337+0000 7fa42f7fe640 1 -- 172.21.15.81:0/1228736350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa41c003520 con 0x7fa41c003b70 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.338+0000 7fa42f7fe640 1 --2- 172.21.15.81:0/1228736350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003b70 0x7fa41c003f70 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fa42000c2a0 tx=0x7fa41c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e80b86d4fa113 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.338+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420036070 con 0x7fa41c003b70 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.338+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa420005ad0 con 0x7fa41c003b70 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.338+0000 7fa42effd640 1 -- 172.21.15.81:0/1228736350 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420007de0 con 0x7fa41c003b70 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.339+0000 7fa435b1f640 1 -- 172.21.15.81:0/1228736350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003b70 msgr2=0x7fa41c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.339+0000 7fa435b1f640 1 --2- 172.21.15.81:0/1228736350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003b70 0x7fa41c003f70 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fa42000c2a0 tx=0x7fa41c005830 comp rx=0 tx=0).stop 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.339+0000 7fa42ffff640 1 -- 172.21.15.81:0/1228736350 reap_dead start 2024-09-16T01:24:42.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.339+0000 7fa435b1f640 1 -- 172.21.15.81:0/1228736350 shutdown_connections 2024-09-16T01:24:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.339+0000 7fa435b1f640 1 -- 172.21.15.81:0/1228736350 >> 172.21.15.81:0/1228736350 conn(0x7fa4300d2380 msgr2=0x7fa4300d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.339+0000 7fa435b1f640 1 -- 172.21.15.81:0/1228736350 shutdown_connections 2024-09-16T01:24:42.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.339+0000 7fa435b1f640 1 -- 172.21.15.81:0/1228736350 wait complete. 2024-09-16T01:24:42.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.340+0000 7fa435b1f640 1 Processor -- start 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.340+0000 7fa435b1f640 1 -- start start 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.340+0000 7fa435b1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003b70 0x7fa4300b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.340+0000 7fa435b1f640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa430153d50 0x7fa4301541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.340+0000 7fa435b1f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa43015fd70 0x7fa4301601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.340+0000 7fa435b1f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa43015f310 con 0x7fa41c003b70 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.340+0000 7fa435b1f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300d1470 con 0x7fa43015fd70 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.340+0000 7fa435b1f640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa43015f490 con 0x7fa430153d50 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003b70 0x7fa4300b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003b70 0x7fa4300b7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57298/0 (socket says 172.21.15.81:57298) 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42f7fe640 1 -- 172.21.15.81:0/1742961997 learned_addr learned my addr 172.21.15.81:0/1742961997 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42ffff640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa43015fd70 0x7fa4301601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa427fff640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa430153d50 0x7fa4301541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42f7fe640 1 -- 172.21.15.81:0/1742961997 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa430153d50 msgr2=0x7fa4301541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42f7fe640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa430153d50 0x7fa4301541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42f7fe640 1 -- 172.21.15.81:0/1742961997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa43015fd70 msgr2=0x7fa4301601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42f7fe640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa43015fd70 0x7fa4301601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42f7fe640 1 -- 172.21.15.81:0/1742961997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa430152cb0 con 0x7fa41c003b70 2024-09-16T01:24:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42f7fe640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003b70 0x7fa4300b7970 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fa42000c3c0 tx=0x7fa420001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42cff9640 1 -- 172.21.15.81:0/1742961997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420041020 con 0x7fa41c003b70 2024-09-16T01:24:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42cff9640 1 -- 172.21.15.81:0/1742961997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa420001640 con 0x7fa41c003b70 2024-09-16T01:24:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa435b1f640 1 -- 172.21.15.81:0/1742961997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa430152f90 con 0x7fa41c003b70 2024-09-16T01:24:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa42cff9640 1 -- 172.21.15.81:0/1742961997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420036040 con 0x7fa41c003b70 2024-09-16T01:24:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.341+0000 7fa435b1f640 1 -- 172.21.15.81:0/1742961997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa430153550 con 0x7fa41c003b70 2024-09-16T01:24:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.342+0000 7fa435b1f640 1 -- 172.21.15.81:0/1742961997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4300d0bd0 con 0x7fa41c003b70 2024-09-16T01:24:42.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.343+0000 7fa42cff9640 1 -- 172.21.15.81:0/1742961997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa420044020 con 0x7fa41c003b70 2024-09-16T01:24:42.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.343+0000 7fa42cff9640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa41006c2b0 0x7fa41006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.343+0000 7fa42cff9640 1 -- 172.21.15.81:0/1742961997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7fa4200aacb0 con 0x7fa41c003b70 2024-09-16T01:24:42.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.343+0000 7fa427fff640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa41006c2b0 0x7fa41006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.343+0000 7fa427fff640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa41006c2b0 0x7fa41006e770 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa4300b1160 tx=0x7fa418009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:42.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.347+0000 7fa42cff9640 1 -- 172.21.15.81:0/1742961997 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4300d0950 con 0x7fa41c003b70 2024-09-16T01:24:42.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.515+0000 7fa435b1f640 1 -- 172.21.15.81:0/1742961997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa4300d3290 con 0x7fa41c003b70 2024-09-16T01:24:42.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.519+0000 7fa42cff9640 1 -- 172.21.15.81:0/1742961997 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v68)=0 v68) ==== 123+0+0 (secure 0 0 0) 0x7fa420078fd0 con 0x7fa41c003b70 2024-09-16T01:24:42.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.520+0000 7fa42cff9640 1 -- 172.21.15.81:0/1742961997 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa42007d2d0 con 0x7fa41c003b70 2024-09-16T01:24:42.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.521+0000 7fa435b1f640 1 -- 172.21.15.81:0/1742961997 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa41006c2b0 msgr2=0x7fa41006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.521+0000 7fa435b1f640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa41006c2b0 0x7fa41006e770 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa4300b1160 tx=0x7fa418009190 comp rx=0 tx=0).stop 2024-09-16T01:24:42.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.521+0000 7fa435b1f640 1 -- 172.21.15.81:0/1742961997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003b70 msgr2=0x7fa4300b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.521+0000 7fa435b1f640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003b70 0x7fa4300b7970 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fa42000c3c0 tx=0x7fa420001b40 comp rx=0 tx=0).stop 2024-09-16T01:24:42.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.521+0000 7fa435b1f640 1 -- 172.21.15.81:0/1742961997 shutdown_connections 2024-09-16T01:24:42.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.521+0000 7fa435b1f640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7fa41006c2b0 0x7fa41006e770 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.521+0000 7fa435b1f640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa43015fd70 0x7fa4301601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.521+0000 7fa435b1f640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa430153d50 0x7fa4301541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.521+0000 7fa435b1f640 1 --2- 172.21.15.81:0/1742961997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003b70 0x7fa4300b7970 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.521+0000 7fa435b1f640 1 -- 172.21.15.81:0/1742961997 >> 172.21.15.81:0/1742961997 conn(0x7fa4300d2380 msgr2=0x7fa4300b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:42.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.521+0000 7fa435b1f640 1 -- 172.21.15.81:0/1742961997 shutdown_connections 2024-09-16T01:24:42.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.521+0000 7fa435b1f640 1 -- 172.21.15.81:0/1742961997 wait complete. 2024-09-16T01:24:42.534 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-16T01:24:42.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-16T01:24:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.630+0000 7f2796718640 1 Processor -- start 2024-09-16T01:24:42.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.631+0000 7f2796718640 1 -- start start 2024-09-16T01:24:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.631+0000 7f2796718640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f27900b6680 0x7f2790169830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.631+0000 7f2796718640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f279006d9f0 con 0x7f2790161c80 2024-09-16T01:24:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.631+0000 7f2796718640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f279006dcd0 con 0x7f2790162060 2024-09-16T01:24:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.631+0000 7f2796718640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f279006dfb0 con 0x7f27900b6680 2024-09-16T01:24:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.631+0000 7f278ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2790161c80 0x7f279006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47782/0 (socket says 172.21.15.81:47782) 2024-09-16T01:24:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.631+0000 7f278ffff640 1 -- 172.21.15.81:0/2068987284 learned_addr learned my addr 172.21.15.81:0/2068987284 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-16T01:24:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.632+0000 7f2794cb5640 1 --2- 172.21.15.81:0/2068987284 >> v2:172.21.15.102:3300/0 conn(0x7f27900b6680 0x7f2790169830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.632+0000 7f278effd640 1 -- 172.21.15.81:0/2068987284 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 548510196 0 0) 0x7f279006d9f0 con 0x7f2790161c80 2024-09-16T01:24:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.632+0000 7f278effd640 1 -- 172.21.15.81:0/2068987284 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2778003520 con 0x7f2790161c80 2024-09-16T01:24:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.632+0000 7f2794cb5640 1 -- 172.21.15.81:0/2068987284 >> v1:172.21.15.102:6789/0 conn(0x7f2790162060 legacy=0x7f27900b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.632+0000 7f2794cb5640 1 -- 172.21.15.81:0/2068987284 >> v1:172.21.15.81:6789/0 conn(0x7f2790161c80 legacy=0x7f279006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.632+0000 7f2794cb5640 1 -- 172.21.15.81:0/2068987284 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27900d01f0 con 0x7f27900b6680 2024-09-16T01:24:42.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.633+0000 7f2794cb5640 1 --2- 172.21.15.81:0/2068987284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27900b6680 0x7f2790169830 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2788009d90 tx=0x7f278802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973ba979befad1f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.633+0000 7f278effd640 1 -- 172.21.15.81:0/2068987284 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788007740 con 0x7f27900b6680 2024-09-16T01:24:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.633+0000 7f278effd640 1 -- 172.21.15.81:0/2068987284 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f27880078e0 con 0x7f27900b6680 2024-09-16T01:24:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.633+0000 7f278effd640 1 -- 172.21.15.81:0/2068987284 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788007c90 con 0x7f27900b6680 2024-09-16T01:24:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.633+0000 7f2796718640 1 -- 172.21.15.81:0/2068987284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27900b6680 msgr2=0x7f2790169830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.633+0000 7f2796718640 1 --2- 172.21.15.81:0/2068987284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27900b6680 0x7f2790169830 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2788009d90 tx=0x7f278802a6f0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.633+0000 7f2796718640 1 -- 172.21.15.81:0/2068987284 shutdown_connections 2024-09-16T01:24:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.633+0000 7f2796718640 1 --2- 172.21.15.81:0/2068987284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27900b6680 0x7f2790169830 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.633+0000 7f2796718640 1 -- 172.21.15.81:0/2068987284 >> 172.21.15.81:0/2068987284 conn(0x7f27900d44f0 msgr2=0x7f27900d4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.633+0000 7f2796718640 1 -- 172.21.15.81:0/2068987284 shutdown_connections 2024-09-16T01:24:42.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.633+0000 7f2796718640 1 -- 172.21.15.81:0/2068987284 wait complete. 2024-09-16T01:24:42.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.635+0000 7f2796718640 1 Processor -- start 2024-09-16T01:24:42.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.635+0000 7f2796718640 1 -- start start 2024-09-16T01:24:42.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.635+0000 7f2796718640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27900b6680 0x7f27901599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.635+0000 7f2796718640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2790161c80 0x7f27900b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.635+0000 7f2796718640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2790162060 0x7f279014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2796718640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27900b6b30 con 0x7f2790162060 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2796718640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f27900d2aa0 con 0x7f2790161c80 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2796718640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f27900b6cb0 con 0x7f27900b6680 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2794cb5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2790162060 0x7f279014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2794cb5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2790162060 0x7f279014f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57310/0 (socket says 172.21.15.81:57310) 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2794cb5640 1 -- 172.21.15.81:0/2169316866 learned_addr learned my addr 172.21.15.81:0/2169316866 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f278f7fe640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2790161c80 0x7f27900b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f278ffff640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27900b6680 0x7f27901599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2794cb5640 1 -- 172.21.15.81:0/2169316866 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27900b6680 msgr2=0x7f27901599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2794cb5640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27900b6680 0x7f27901599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2794cb5640 1 -- 172.21.15.81:0/2169316866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2790161c80 msgr2=0x7f27900b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2794cb5640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2790161c80 0x7f27900b87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2794cb5640 1 -- 172.21.15.81:0/2169316866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27900c9440 con 0x7f2790162060 2024-09-16T01:24:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f278ffff640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27900b6680 0x7f27901599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T01:24:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2794cb5640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2790162060 0x7f279014f810 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f278802a730 tx=0x7f2788004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f278cff9640 1 -- 172.21.15.81:0/2169316866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278803f070 con 0x7f2790162060 2024-09-16T01:24:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f278cff9640 1 -- 172.21.15.81:0/2169316866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2788031c40 con 0x7f2790162060 2024-09-16T01:24:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2796718640 1 -- 172.21.15.81:0/2169316866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27900c96b0 con 0x7f2790162060 2024-09-16T01:24:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f278cff9640 1 -- 172.21.15.81:0/2169316866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788009450 con 0x7f2790162060 2024-09-16T01:24:42.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.636+0000 7f2796718640 1 -- 172.21.15.81:0/2169316866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27900c9c70 con 0x7f2790162060 2024-09-16T01:24:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.637+0000 7f2796718640 1 -- 172.21.15.81:0/2169316866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27900ba470 con 0x7f2790162060 2024-09-16T01:24:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.638+0000 7f278cff9640 1 -- 172.21.15.81:0/2169316866 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2788003990 con 0x7f2790162060 2024-09-16T01:24:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.638+0000 7f278cff9640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f277c06c2b0 0x7f277c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T01:24:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.638+0000 7f278cff9640 1 -- 172.21.15.81:0/2169316866 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5335+0+0 (secure 0 0 0) 0x7f27880ac450 con 0x7f2790162060 2024-09-16T01:24:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.638+0000 7f278ffff640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f277c06c2b0 0x7f277c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T01:24:42.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.639+0000 7f278ffff640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f277c06c2b0 0x7f277c06e770 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f2780007fd0 tx=0x7f2780009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T01:24:42.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.642+0000 7f278cff9640 1 -- 172.21.15.81:0/2169316866 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f278807a6e0 con 0x7f2790162060 2024-09-16T01:24:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.838+0000 7f2796718640 1 -- 172.21.15.81:0/2169316866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27900b5a50 con 0x7f2790162060 2024-09-16T01:24:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.839+0000 7f278cff9640 1 -- 172.21.15.81:0/2169316866 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+3917 (secure 0 0 0) 0x7f278807e9e0 con 0x7f2790162060 2024-09-16T01:24:42.841 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-16T01:24:42.841 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":85,"btime":"2024-09-16T01:24:12:153842+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6834/1526547768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":1526547768},{"type":"v1","addr":"172.21.15.102:6834","nonce":1526547768}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":7375,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1390834502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6833","nonce":1390834502},{"type":"v1","addr":"172.21.15.102:6835","nonce":1390834502}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/1449155906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1449155906},{"type":"v1","addr":"172.21.15.81:6836","nonce":1449155906}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8766,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2044326192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2044326192},{"type":"v1","addr":"172.21.15.81:6837","nonce":2044326192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85}],"filesystems":[]} 2024-09-16T01:24:42.841 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 85 2024-09-16T01:24:42.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.840+0000 7f2796718640 1 -- 172.21.15.81:0/2169316866 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f277c06c2b0 msgr2=0x7f277c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.840+0000 7f2796718640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f277c06c2b0 0x7f277c06e770 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f2780007fd0 tx=0x7f2780009040 comp rx=0 tx=0).stop 2024-09-16T01:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.840+0000 7f2796718640 1 -- 172.21.15.81:0/2169316866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2790162060 msgr2=0x7f279014f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T01:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.840+0000 7f2796718640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2790162060 0x7f279014f810 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f278802a730 tx=0x7f2788004a40 comp rx=0 tx=0).stop 2024-09-16T01:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.841+0000 7f2796718640 1 -- 172.21.15.81:0/2169316866 shutdown_connections 2024-09-16T01:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.841+0000 7f2796718640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.81:6824/3436185483,v1:172.21.15.81:6825/3436185483] conn(0x7f277c06c2b0 0x7f277c06e770 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.841+0000 7f2796718640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2790162060 0x7f279014f810 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.841+0000 7f2796718640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2790161c80 0x7f27900b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.841+0000 7f2796718640 1 --2- 172.21.15.81:0/2169316866 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f27900b6680 0x7f27901599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T01:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.841+0000 7f2796718640 1 -- 172.21.15.81:0/2169316866 >> 172.21.15.81:0/2169316866 conn(0x7f27900d44f0 msgr2=0x7f27900d3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T01:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.841+0000 7f2796718640 1 -- 172.21.15.81:0/2169316866 shutdown_connections 2024-09-16T01:24:42.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-16T01:24:42.841+0000 7f2796718640 1 -- 172.21.15.81:0/2169316866 wait complete. 2024-09-16T01:24:42.853 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-16T01:24:42.853 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-16T01:24:42.853 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-16T01:24:42.853 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:42.862 INFO:tasks.ceph.mds.a:Stopped 2024-09-16T01:24:42.862 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-16T01:24:42.862 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:42.912 INFO:tasks.ceph.mds.c:Stopped 2024-09-16T01:24:42.912 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-16T01:24:42.912 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:42.924 INFO:tasks.ceph.mds.b:Stopped 2024-09-16T01:24:42.924 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-16T01:24:42.924 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:42.975 INFO:tasks.ceph.mds.d:Stopped 2024-09-16T01:24:42.975 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-16T01:24:42.975 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-16T01:24:42.975 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.009 INFO:tasks.ceph.osd.0:Stopped 2024-09-16T01:24:43.010 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-16T01:24:43.010 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.091 INFO:tasks.ceph.osd.1:Stopped 2024-09-16T01:24:43.091 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-16T01:24:43.091 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.123 INFO:tasks.ceph.osd.2:Stopped 2024-09-16T01:24:43.123 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-16T01:24:43.123 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.190 INFO:tasks.ceph.osd.3:Stopped 2024-09-16T01:24:43.190 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-16T01:24:43.191 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.235 INFO:tasks.ceph.osd.4:Stopped 2024-09-16T01:24:43.235 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-16T01:24:43.235 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.273 INFO:tasks.ceph.osd.5:Stopped 2024-09-16T01:24:43.273 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-16T01:24:43.274 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.343 INFO:tasks.ceph.osd.6:Stopped 2024-09-16T01:24:43.343 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-16T01:24:43.343 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.413 INFO:tasks.ceph.osd.7:Stopped 2024-09-16T01:24:43.413 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-16T01:24:43.413 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-16T01:24:43.413 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.441 INFO:tasks.ceph.mgr.y:Stopped 2024-09-16T01:24:43.442 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-16T01:24:43.442 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.479 INFO:tasks.ceph.mgr.x:Stopped 2024-09-16T01:24:43.479 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-16T01:24:43.479 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-16T01:24:43.479 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.493 INFO:tasks.ceph.mon.a:Stopped 2024-09-16T01:24:43.494 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-16T01:24:43.494 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.531 INFO:tasks.ceph.mon.b:Stopped 2024-09-16T01:24:43.531 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-16T01:24:43.531 INFO:teuthology.orchestra.run:waiting for 300 2024-09-16T01:24:43.584 INFO:tasks.ceph.mon.c:Stopped 2024-09-16T01:24:43.584 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-16T01:24:43.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'responding to mclientcaps\(revoke\)' | egrep -v 'not advance its oldest_client_tid' | egrep -v 'failing to advance its oldest client/flush tid' | egrep -v 'Too many inodes in cache' | egrep -v 'failing to respond to cache pressure' | egrep -v 'slow requests are blocked' | egrep -v 'failing to respond to capability release' | egrep -v 'MDS cache is too large' | egrep -v '\(MDS_CLIENT_OLDEST_TID\)' | egrep -v '\(MDS_CACHE_OVERSIZED\)' | head -n 1 2024-09-16T01:24:43.625 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:24:43.625 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-16T01:24:43.810 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:24:43.811 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-16T01:24:43.907 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:24:43.908 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-16T01:24:43.980 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:24:43.980 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-16T01:24:44.040 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:24:44.040 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-16T01:24:44.233 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:24:44.233 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-16T01:24:44.301 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:24:44.301 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-16T01:24:44.358 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:24:44.358 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-16T01:24:44.417 INFO:tasks.ceph:Archiving mon data... 2024-09-16T01:24:44.418 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453/data/mon.a.tgz 2024-09-16T01:24:44.418 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-16T01:24:44.435 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.4YQwAW71ku 2024-09-16T01:24:44.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4YQwAW71ku 2024-09-16T01:24:44.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.4YQwAW71ku 2024-09-16T01:24:44.685 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.4YQwAW71ku is 464KB 2024-09-16T01:24:44.787 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.4YQwAW71ku 2024-09-16T01:24:44.802 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453/data/mon.b.tgz 2024-09-16T01:24:44.802 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-16T01:24:44.820 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.OozEy326L7 2024-09-16T01:24:44.820 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.OozEy326L7 2024-09-16T01:24:44.989 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.OozEy326L7 2024-09-16T01:24:45.073 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.OozEy326L7 is 468KB 2024-09-16T01:24:45.172 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.OozEy326L7 2024-09-16T01:24:45.188 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453/data/mon.c.tgz 2024-09-16T01:24:45.188 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-16T01:24:45.242 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.PytNA8uqcn 2024-09-16T01:24:45.242 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.PytNA8uqcn 2024-09-16T01:24:45.393 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.PytNA8uqcn 2024-09-16T01:24:45.476 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.PytNA8uqcn is 468KB 2024-09-16T01:24:45.578 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.PytNA8uqcn 2024-09-16T01:24:45.593 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-16T01:24:45.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T01:24:45.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-16T01:24:45.677 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T01:24:45.714 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-16T01:24:45.715 INFO:tasks.ceph:Archiving crash dumps... 2024-09-16T01:24:45.717 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453/remote/smithi081/crash 2024-09-16T01:24:45.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T01:24:45.744 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453/remote/smithi102/crash 2024-09-16T01:24:45.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-16T01:24:45.778 INFO:tasks.ceph:Shutting down logrotate 2024-09-16T01:24:45.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:24:45.789 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-16T01:24:45.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-16T01:24:45.905 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-16T01:24:45.930 INFO:tasks.ceph:Compressing logs... 2024-09-16T01:24:45.930 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:24:45.948 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T01:24:45.970 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-16T01:24:45.970 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71282.log 2024-09-16T01:24:45.971 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52688.log 2024-09-16T01:24:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36794.log 2024-09-16T01:24:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46042.log 2024-09-16T01:24:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36794.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-16T01:24:46.039 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.46042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45501.log 2024-09-16T01:24:46.039 INFO:teuthology.orchestra.run.smithi102.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36794.log.gz 2024-09-16T01:24:46.040 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46042.log.gz 2024-09-16T01:24:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44015.log 2024-09-16T01:24:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.45501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45029.log 2024-09-16T01:24:46.040 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45501.log.gz 2024-09-16T01:24:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.44015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47112.log 2024-09-16T01:24:46.040 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44015.log.gz 2024-09-16T01:24:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.45029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43033.log 2024-09-16T01:24:46.040 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45029.log.gz 2024-09-16T01:24:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.47112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48172.log 2024-09-16T01:24:46.040 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47112.log.gz 2024-09-16T01:24:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.43033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43033.log.gz 2024-09-16T01:24:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44525.log 2024-09-16T01:24:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.48172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36966.log 2024-09-16T01:24:46.041 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.48172.log.gz 2024-09-16T01:24:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.44525.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-16T01:24:46.041 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44525.log.gz 2024-09-16T01:24:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45505.log 2024-09-16T01:24:46.041 INFO:teuthology.orchestra.run.smithi102.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36966.log.gz 2024-09-16T01:24:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-16T01:24:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.45505.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T01:24:46.041 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45505.log.gz 2024-09-16T01:24:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37046.log 2024-09-16T01:24:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36874.log 2024-09-16T01:24:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37046.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-16T01:24:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36874.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37046.log.gz 2024-09-16T01:24:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48661.log 2024-09-16T01:24:46.042 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36874.log.gz 2024-09-16T01:24:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43437.log 2024-09-16T01:24:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.48661.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.1.48661.log.gz 2024-09-16T01:24:46.042 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37006.log 2024-09-16T01:24:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.3.43437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43437.log.gz 2024-09-16T01:24:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47690.log 2024-09-16T01:24:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.37006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48657.log 2024-09-16T01:24:46.042 INFO:teuthology.orchestra.run.smithi102.stderr: 88.0%/var/log/ceph/ceph-client.1.47690.log: -- replaced with /var/log/ceph/ceph-client.admin.37006.log.gz 2024-09-16T01:24:46.043 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47690.log.gz 2024-09-16T01:24:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46634.log 2024-09-16T01:24:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5/var/log/ceph/ceph-client.1.48657.log: --verbose -- /var/log/ceph/ceph-client.admin.36754.log 2024-09-16T01:24:46.043 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.48657.log.gz 2024-09-16T01:24:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.46634.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47108.log 2024-09-16T01:24:46.043 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.1.46634.log.gz 2024-09-16T01:24:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5/var/log/ceph/ceph-client.admin.36754.log: --verbose -- /var/log/ceph/ceph-client.1.45025.log 2024-09-16T01:24:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.47108.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36754.log.gz 2024-09-16T01:24:46.043 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47108.log.gz 2024-09-16T01:24:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-16T01:24:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.1.45025.log: -- /var/log/ceph/ceph-client.1.44529.log 2024-09-16T01:24:46.044 INFO:teuthology.orchestra.run.smithi102.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T01:24:46.044 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45025.log.gz 2024-09-16T01:24:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-16T01:24:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.44529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44529.log.gz 2024-09-16T01:24:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T01:24:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-16T01:24:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-16T01:24:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.d.log: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T01:24:46.044 INFO:teuthology.orchestra.run.smithi102.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-16T01:24:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47694.log 2024-09-16T01:24:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36834.log 2024-09-16T01:24:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.47694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47694.log.gz 2024-09-16T01:24:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-16T01:24:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36834.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36834.log.gz 2024-09-16T01:24:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48176.log 2024-09-16T01:24:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.b.log: 94.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-16T01:24:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44011.log 2024-09-16T01:24:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.48176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.48176.log.gz 2024-09-16T01:24:46.054 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43038.log 2024-09-16T01:24:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.44011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44011.log.gz 2024-09-16T01:24:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36914.log 2024-09-16T01:24:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.43038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43038.log.gz 2024-09-16T01:24:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43433.log 2024-09-16T01:24:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.36914.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36914.log.gz 2024-09-16T01:24:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46046.log 2024-09-16T01:24:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.3.43433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43433.log.gz 2024-09-16T01:24:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46630.log 2024-09-16T01:24:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.46046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46046.log.gz 2024-09-16T01:24:46.055 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.46630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46630.log.gz 2024-09-16T01:24:46.305 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-16T01:24:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74557.log 2024-09-16T01:24:46.305 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71282.log.gz 2024-09-16T01:24:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75459.log 2024-09-16T01:24:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74557.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52688.log.gz 2024-09-16T01:24:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55926.log 2024-09-16T01:24:46.305 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74557.log.gz 2024-09-16T01:24:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69537.log 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75459.log: /var/log/ceph/ceph-client.admin.55926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69885.log 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75459.log.gz 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55926.log.gz 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55800.log 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52604.log 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69537.log.gz 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55800.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69885.log.gz 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43623.log 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55800.log.gz 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75375.log 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4%/var/log/ceph/ceph-client.admin.43623.log: -- replaced with /var/log/ceph/ceph-client.admin.52604.log.gz 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44177.log 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43623.log.gz 2024-09-16T01:24:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70131.log 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1%/var/log/ceph/ceph-client.admin.44177.log: -- replaced with /var/log/ceph/ceph-client.admin.75375.log.gz 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73483.log 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60078.log 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44177.log.gz 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70131.log.gz 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47329.log 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73483.log.gz 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60874.log 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60078.log: /var/log/ceph/ceph-client.admin.47329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75585.log 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60078.log.gz 88.2% 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47329.log.gz 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70568.log 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46553.log 89.6% 2024-09-16T01:24:46.307 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60874.log.gz 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70568.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75585.log.gz 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68494.log 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70568.log.gz 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70219.log 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68494.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46553.log.gz 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75164.log 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70219.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68494.log.gz 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68662.log 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70219.log.gz 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59309.log 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7%/var/log/ceph/ceph-client.admin.68662.log: -- replaced with /var/log/ceph/ceph-client.admin.75164.log.gz 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63587.log 2024-09-16T01:24:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59309.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.68662.log.gz -5 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.69165.log 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59309.log.gz 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65929.log 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63587.log.gz 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64479.log 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73931.log 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.69165.log.gz 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65929.log.gz 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57586.log 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73931.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64479.log.gz 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52100.log 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57586.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73931.log.gz 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52352.log 2024-09-16T01:24:46.309 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57586.log.gz 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42556.log 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53424.log 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52100.log.gz 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42556.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52352.log.gz 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48493.log 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53424.log: gzip -5 --verbose 89.1% -- -- replaced with /var/log/ceph/ceph-client.admin.42556.log.gz /var/log/ceph/ceph-client.admin.58015.log 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53424.log.gz 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50928.log 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47680.log 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48493.log.gz 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58015.log.gz 2024-09-16T01:24:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53256.log 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47680.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50928.log.gz 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57334.log 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47680.log.gz 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58490.log 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53256.log.gz 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57166.log 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58490.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57334.log.gz 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66987.log 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73571.log 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57166.log.gz 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66987.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.58490.log.gz 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67314.log 2024-09-16T01:24:46.311 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66987.log.gz 2024-09-16T01:24:46.312 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55758.log 2024-09-16T01:24:46.312 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72355.log 2024-09-16T01:24:46.312 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73571.log.gz 2024-09-16T01:24:46.312 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61779.log 2024-09-16T01:24:46.312 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67314.log.gz 2024-09-16T01:24:46.312 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72355.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55758.log.gz 2024-09-16T01:24:46.312 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68029.log 2024-09-16T01:24:46.312 INFO:teuthology.orchestra.run.smithi081.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.72355.log.gz 2024-09-16T01:24:46.312 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63928.log 2024-09-16T01:24:46.312 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68029.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.46469.log 2024-09-16T01:24:46.312 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61779.log.gz 2024-09-16T01:24:46.312 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68029.log.gz 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61017.log 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63928.log.gz 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59579.log 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61017.log: gzip 88.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.46469.log.gz -- 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.47042.log 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61017.log.gz 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50415.log 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5%/var/log/ceph/ceph-client.admin.47042.log: -- replaced with /var/log/ceph/ceph-client.admin.59579.log.gz 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65109.log 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50415.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47042.log.gz 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55130.log 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50415.log.gz 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46511.log 2024-09-16T01:24:46.313 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65109.log.gz 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53508.log 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46511.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55130.log.gz 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59519.log 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46511.log.gz 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58952.log 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53508.log.gz 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48321.log 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58952.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59519.log.gzgzip 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43504.log 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58952.log.gz 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66390.log 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43504.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.64629.log -- replaced with /var/log/ceph/ceph-client.admin.48321.log.gz 2024-09-16T01:24:46.314 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66390.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43504.log.gz 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53778.log 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.66390.log.gz 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71198.log 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64629.log.gz 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62710.log 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.71198.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.68536.log 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53778.log.gz 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.62710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62710.log.gz 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71198.log.gz 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68578.log 2024-09-16T01:24:46.315 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42832.log 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68536.log.gz 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63629.log 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68578.log.gz 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70778.log 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42832.log.gz 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50373.log 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63629.log: /var/log/ceph/ceph-client.admin.70778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75921.log 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63629.log.gz 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70778.log.gz 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63106.log 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50373.log.gz 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63766.log 2024-09-16T01:24:46.316 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69789.log 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63106.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75921.log.gz 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63766.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.63106.log.gz 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60391.log 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63766.log.gz 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43791.log 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69789.log: /var/log/ceph/ceph-client.admin.60391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74515.log 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69789.log.gz 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60391.log.gz 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65625.log 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43791.log.gz 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75795.log 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74515.log: /var/log/ceph/ceph-client.admin.65625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64226.log 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74515.log.gz 2024-09-16T01:24:46.317 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65625.log.gz 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49850.log 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68323.log 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64226.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.75795.log.gz 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49850.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64226.log.gz 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59705.log 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49850.log.gz 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73056.log 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68323.log: /var/log/ceph/ceph-client.admin.59705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75333.log 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68323.log.gz 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59705.log.gz 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61821.log 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.73056.log.gz 2024-09-16T01:24:46.318 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55210.log 2024-09-16T01:24:46.319 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.75333.log.gz 2024-09-16T01:24:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59096.log 2024-09-16T01:24:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61821.log: /var/log/ceph/ceph-client.admin.55210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73260.log 2024-09-16T01:24:46.319 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61821.log.gz 2024-09-16T01:24:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59096.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55210.log.gz 2024-09-16T01:24:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68239.log 2024-09-16T01:24:46.319 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59096.log.gz 2024-09-16T01:24:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46763.log 2024-09-16T01:24:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73260.log: /var/log/ceph/ceph-client.admin.68239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48279.log 2024-09-16T01:24:46.319 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.73260.log.gz 2024-09-16T01:24:46.319 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4%/var/log/ceph/ceph-client.admin.46763.log: -- replaced with /var/log/ceph/ceph-client.admin.68239.log.gz 2024-09-16T01:24:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73739.log 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46763.log.gz 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75122.log 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48279.log: /var/log/ceph/ceph-client.admin.73739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64100.log 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73739.log.gz 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75122.log: -- replaced with /var/log/ceph/ceph-client.admin.48279.log.gz 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71967.log 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.75122.log.gz 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66138.log 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64100.log: /var/log/ceph/ceph-client.admin.71967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70694.log 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64100.log.gz 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66138.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71967.log.gz 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55968.log 2024-09-16T01:24:46.320 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66138.log.gz 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72229.log 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70694.log.gz 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60433.log 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55968.log: /var/log/ceph/ceph-client.admin.72229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68620.log 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55968.log.gz 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60433.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72229.log.gz 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52825.log 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60433.log.gz 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66432.log 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68620.log: /var/log/ceph/ceph-client.admin.52825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65151.log 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68620.log.gz 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52825.log.gz 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57502.log 2024-09-16T01:24:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66222.log 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6%/var/log/ceph/ceph-client.admin.65151.log: -- replaced with /var/log/ceph/ceph-client.admin.66432.log.gz 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57502.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65151.log.gz 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54328.log 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57502.log.gz 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71706.log 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66222.log: /var/log/ceph/ceph-client.admin.54328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52987.log 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66222.log.gz 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71706.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54328.log.gz 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53886.log 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74888.log 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71706.log.gz 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52987.log: /var/log/ceph/ceph-client.admin.53886.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.52987.log.gz 2024-09-16T01:24:46.322 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60606.log 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53886.log.gz 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62204.log 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74888.log: /var/log/ceph/ceph-client.admin.60606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68281.log 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74888.log.gz 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60606.log.gz 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66943.log 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62204.log.gz 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58910.log 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68281.log: /var/log/ceph/ceph-client.admin.66943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71492.log 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68281.log.gz 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66943.log.gz 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69705.log 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58910.log.gz 2024-09-16T01:24:46.323 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53382.log 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71492.log: /var/log/ceph/ceph-client.admin.69705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46290.log 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71492.log.gz 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53382.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69705.log.gz 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71116.log 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53382.log.gz 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72583.log 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.2.46290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46290.log.gz 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.71116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43446.log 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71116.log.gz 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56010.log 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43446.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72583.log.gz 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65488.log 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43446.log.gz 2024-09-16T01:24:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44517.log 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56010.log.gz 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58280.log 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65488.log: /var/log/ceph/ceph-client.admin.44517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47413.log 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65488.log.gz 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44517.log.gz 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73697.log 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53718.log 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58280.log.gz 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47413.log: /var/log/ceph/ceph-client.admin.73697.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47413.log.gz 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71366.log 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73697.log.gz 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53820.log 2024-09-16T01:24:46.325 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53718.log: /var/log/ceph/ceph-client.admin.71366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36962.log 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53718.log.gz 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71366.log.gz 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69495.log 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67650.log 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36962.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53820.log.gz 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69495.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.62372.log 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36962.log.gz 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69495.log.gz 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72313.log 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67650.log: /var/log/ceph/ceph-client.admin.62372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75669.log 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67650.log.gz 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72313.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62372.log.gz 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72271.log 2024-09-16T01:24:46.326 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72313.log.gz 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44774.log 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75669.log: /var/log/ceph/ceph-client.admin.72271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75291.log 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75669.log.gz 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44774.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72271.log.gz 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70175.log 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44774.log.gz 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64437.log 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75291.log: /var/log/ceph/ceph-client.admin.70175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54638.log 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75291.log.gz 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64437.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70175.log.gz 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57124.log 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64437.log.gz 2024-09-16T01:24:46.327 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47287.log 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54638.log: /var/log/ceph/ceph-client.admin.57124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52730.log 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54638.log.gz/var/log/ceph/ceph-client.admin.47287.log: 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57124.log.gz 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62032.log 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47287.log.gz 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75627.log 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52730.log: /var/log/ceph/ceph-client.admin.62032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73136.log 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52730.log.gz 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75627.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62032.log.gz 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43833.log 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75627.log.gz 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71240.log 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73136.log: /var/log/ceph/ceph-client.admin.43833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57040.log 2024-09-16T01:24:46.328 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73136.log.gz 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71240.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43833.log.gz 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61270.log 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.71240.log.gz 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64983.log 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57040.log: /var/log/ceph/ceph-client.admin.61270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70862.log 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57040.log.gz 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64983.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61270.log.gz 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52310.log 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64983.log.gz 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47600.log 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70862.log: /var/log/ceph/ceph-client.admin.52310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58556.log 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52310.log.gz 2024-09-16T01:24:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47930.log 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.70862.log.gz 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50632.log 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47600.log.gz 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47930.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58556.log.gz 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55506.log 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47930.log.gz 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71663.log 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50632.log: /var/log/ceph/ceph-client.admin.55506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56348.log 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50632.log.gz 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71663.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55506.log.gz 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71324.log 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71663.log.gz 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73781.log 2024-09-16T01:24:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.56348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56348.log.gz 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68855.log 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73781.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71324.log.gz 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57681.log 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73781.log.gz 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62246.log 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68855.log.gz 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52520.log 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57681.log: /var/log/ceph/ceph-client.admin.62246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50121.log 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57681.log.gz 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62246.log.gz 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51534.log 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63461.log 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50121.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52520.log.gz 2024-09-16T01:24:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51534.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50121.log.gz 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62887.log 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63970.log 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63461.log: /var/log/ceph/ceph-client.admin.62887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70736.log 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63461.log.gz 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51534.log.gz 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62887.log.gz 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54867.log 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70736.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63970.log.gz 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44851.log 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70736.log.gz 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52436.log 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.44851.log: --verbose -- /var/log/ceph/ceph-client.admin.48142.log 2024-09-16T01:24:46.332 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54867.log.gz 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52436.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44851.log.gz 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65887.log 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52436.log.gz 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44513.log 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48142.log: /var/log/ceph/ceph-client.admin.65887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57208.log 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48142.log.gz 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44513.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65887.log.gz 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53159.log 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44513.log.gz 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49766.log 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57208.log.gz 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51408.log 2024-09-16T01:24:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53159.log: /var/log/ceph/ceph-client.admin.49766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54554.log 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53159.log.gz 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50163.log 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49766.log.gz 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51408.log.gz 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74373.log 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54554.log.gz 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61354.log 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50163.log: /var/log/ceph/ceph-client.admin.74373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44171.log 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50163.log.gz 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74373.log.gz/var/log/ceph/ceph-client.admin.61354.log: 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62522.log 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61354.log.gz 2024-09-16T01:24:46.334 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65845.log 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44171.log: /var/log/ceph/ceph-client.admin.62522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67946.log 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44171.log.gz 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65845.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62522.log.gz 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63334.log 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.67946.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65845.log.gz 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.67946.log.gz 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73823.log 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55842.log 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73655.log 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73823.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63334.log.gz 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55035.log 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73823.log.gz 2024-09-16T01:24:46.335 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55842.log.gz 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44510.log 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73655.log.gz 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44857.log 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55035.log: /var/log/ceph/ceph-client.admin.44510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58994.log 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55035.log.gz 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44857.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44510.log.gz 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71810.log 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44857.log.gz 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48933.log 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58994.log: /var/log/ceph/ceph-client.admin.71810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74473.log 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58994.log.gz 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71810.log.gz 2024-09-16T01:24:46.336 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.48933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75248.log 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48933.log.gz 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48014.log 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74473.log: /var/log/ceph/ceph-client.admin.75248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65319.log 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74473.log.gz 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75248.log.gz 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68071.log 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48014.log.gz 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47558.log 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75711.log 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68071.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65319.log.gz 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46874.log 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68071.log.gz 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47558.log.gz 2024-09-16T01:24:46.337 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54596.log 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75711.log.gz 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50798.log 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46874.log: /var/log/ceph/ceph-client.admin.54596.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46874.log.gz 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50798.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54596.log.gz 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46952.log 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59850.log 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50798.log.gz 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.46952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53029.log 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46952.log.gz 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76035.log 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74701.log 2024-09-16T01:24:46.338 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59850.log.gz 2024-09-16T01:24:46.339 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60957.log 2024-09-16T01:24:46.339 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.76035.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53029.log.gz 2024-09-16T01:24:46.339 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74701.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.76035.log.gz 2024-09-16T01:24:46.339 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66306.log 2024-09-16T01:24:46.339 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74701.log.gz 2024-09-16T01:24:46.339 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70047.log 2024-09-16T01:24:46.339 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66306.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60957.log.gz 2024-09-16T01:24:46.339 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53592.log 2024-09-16T01:24:46.339 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66306.log.gz 2024-09-16T01:24:46.339 INFO:teuthology.orchestra.run.smithi081.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-16T01:24:46.339 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67082.log 2024-09-16T01:24:46.339 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53592.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70047.log.gz 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43875.log 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53592.log.gz 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61980.log 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67082.log.gz 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49099.log 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44182.log 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61980.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43875.log.gz 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55334.log 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61980.log.gz 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57544.log 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3%/var/log/ceph/ceph-client.admin.44182.log: -- replaced with /var/log/ceph/ceph-client.admin.49099.log.gz 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64056.log 2024-09-16T01:24:46.340 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44182.log.gz 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67031.log 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55334.log.gz 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57544.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57544.log.gz 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.64056.log: -- /var/log/ceph/ceph-client.admin.73613.log 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49057.log 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67031.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64056.log.gz 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73613.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67031.log.gz 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62964.log 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.73613.log.gz 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65803.log 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49057.log: /var/log/ceph/ceph-client.admin.62964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47245.log 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49057.log.gz 2024-09-16T01:24:46.341 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62964.log.gz 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64821.log 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55674.log 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47245.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65803.log.gz 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.64821.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47245.log.gz 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.0.64821.log.gz /var/log/ceph/ceph-client.admin.57460.log 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43581.log 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55674.log: /var/log/ceph/ceph-client.admin.57460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42598.log 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55674.log.gz 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43581.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57460.log.gz 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63671.log 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43581.log.gz 2024-09-16T01:24:46.342 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66348.log 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42598.log.gz 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66013.log 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66348.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63671.log.gz 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44514.log 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66348.log.gz 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75837.log 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.66013.log.gz 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69965.log 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67608.log 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75837.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44514.log.gz 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69965.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.75837.log.gz 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55420.log 2024-09-16T01:24:46.343 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64563.log 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67608.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69965.log.gz 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55420.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67608.log.gz 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58066.log 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56778.log 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55420.log.gz 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64563.log: /var/log/ceph/ceph-client.admin.58066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61907.log 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.64563.log.gz 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56778.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58066.log.gzgzip 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64352.log 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56778.log.gz 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62288.log 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61907.log: /var/log/ceph/ceph-client.admin.64352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70354.log 2024-09-16T01:24:46.344 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61907.log.gz 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62288.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64352.log.gz 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72145.log 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70354.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62288.log.gz 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41963.log 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72145.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70354.log.gz 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72667.log 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72145.log.gz 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50205.log 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41963.log.gz 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52184.log 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72667.log.gz 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44170.log 2024-09-16T01:24:46.345 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50205.log: /var/log/ceph/ceph-client.admin.52184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49469.log 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50205.log.gz 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52184.log.gz 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61186.log 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58322.log 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44170.log.gz 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69621.log 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61186.log.gz 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51450.log 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.49469.log.gz 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69621.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58322.log.gz 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67272.log 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69621.log.gz 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56914.log 2024-09-16T01:24:46.346 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51450.log: /var/log/ceph/ceph-client.admin.67272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57376.log 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51450.log.gz 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67272.log.gz 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53071.log 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59808.log 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57376.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56914.log.gz 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56052.log 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57376.log.gz 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62330.log 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53071.log.gz 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59808.log: /var/log/ceph/ceph-client.admin.56052.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59808.log.gz 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60790.log 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56052.log.gz 2024-09-16T01:24:46.347 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66776.log 2024-09-16T01:24:46.348 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62330.log: /var/log/ceph/ceph-client.admin.60790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69309.log 2024-09-16T01:24:46.348 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62330.log.gz 2024-09-16T01:24:46.348 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60790.log.gz 2024-09-16T01:24:46.348 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69081.log 2024-09-16T01:24:46.348 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46721.log/var/log/ceph/ceph-client.admin.69309.log: 2024-09-16T01:24:46.348 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66776.log.gz 2024-09-16T01:24:46.348 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69081.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69309.log.gz 2024-09-16T01:24:46.348 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50552.log 2024-09-16T01:24:46.348 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.69081.log.gz 2024-09-16T01:24:46.348 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62116.log 2024-09-16T01:24:46.348 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46721.log: /var/log/ceph/ceph-client.admin.50552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53676.log 2024-09-16T01:24:46.348 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46721.log.gz 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62116.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50552.log.gz 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47161.log 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68155.log 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62116.log.gz 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53676.log: /var/log/ceph/ceph-client.admin.47161.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53676.log.gz 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46595.log 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47161.log.gz 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42059.log 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68155.log: /var/log/ceph/ceph-client.admin.46595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64268.log 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68155.log.gz 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42059.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46595.log.gz 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68913.log 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42059.log.gz 2024-09-16T01:24:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47888.log 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64941.log 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64268.log.gz 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68913.log: /var/log/ceph/ceph-client.admin.47888.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68913.log.gz 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44178.log 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47888.log.gz 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60916.log 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52268.log 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44178.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64941.log.gz 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60916.log: gzip 87.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.44178.log.gz -- 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.71852.log 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.60916.log.gz 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54251.log 2024-09-16T01:24:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 87.6%/var/log/ceph/ceph-client.admin.71852.log: -- replaced with /var/log/ceph/ceph-client.admin.52268.log.gz -5 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55716.log 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57971.log 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71852.log.gz 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54251.log.gz 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45853.log 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55716.log.gz 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45848.log 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57971.log.gz 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.45853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45853.log.gz 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60528.log 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.45848.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45848.log.gz 2024-09-16T01:24:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47972.log 2024-09-16T01:24:46.352 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60528.log.gz 2024-09-16T01:24:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73441.log 2024-09-16T01:24:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48727.log 2024-09-16T01:24:46.352 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47972.log.gz 2024-09-16T01:24:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58196.log 2024-09-16T01:24:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48727.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.73441.log.gz 2024-09-16T01:24:46.352 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51012.log 2024-09-16T01:24:46.352 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48727.log.gz 2024-09-16T01:24:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55376.log 2024-09-16T01:24:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60289.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51012.log.gz 2024-09-16T01:24:46.352 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58196.log.gz 2024-09-16T01:24:46.352 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73346.log 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55376.log.gz 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44180.log 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59351.log 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60289.log.gz 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44180.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.73346.log.gz 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69453.log 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62074.log 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59351.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44180.log.gz 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60832.log 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59351.log.gz 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69453.log.gz 2024-09-16T01:24:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59267.log 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62074.log.gz 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72045.log 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60832.log: /var/log/ceph/ceph-client.admin.59267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63274.log 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60832.log.gz 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59267.log.gz 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72499.log 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.63274.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44775.log 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72045.log.gz 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59477.log 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63274.log.gz 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72499.log.gz 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66901.log 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68113.log 2024-09-16T01:24:46.354 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44775.log.gz 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59477.log: /var/log/ceph/ceph-client.admin.66901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76117.log 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59477.log.gz 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68113.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66901.log.gz 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54386.log 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68113.log.gz 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42682.log 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.76117.log: /var/log/ceph/ceph-client.admin.54386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72835.log 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54386.log.gz 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76117.log.gz 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74659.log 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.72835.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54909.log 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42682.log.gz 2024-09-16T01:24:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74659.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72835.log.gz 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.72961.log 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74659.log.gz 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54909.log: gzip -5 --verbose 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54909.log.gz 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.42225.log 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50714.log 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42225.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72961.log.gz 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73865.log 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42225.log.gz 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57292.log 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50714.log.gz 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51054.log 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47803.log 2024-09-16T01:24:46.356 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57292.log.gz 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.73865.log.gz 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64184.log 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51054.log.gz 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45093.log 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47803.log: /var/log/ceph/ceph-client.admin.64184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69747.log 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47803.log.gz 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64184.log.gz 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72541.log 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45093.log.gz 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70820.log 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72541.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69747.log.gz 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59748.log 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72541.log.gz 2024-09-16T01:24:46.357 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68997.log 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70820.log: /var/log/ceph/ceph-client.admin.59748.log: gzip 88.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.51324.log 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70820.log.gz 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68997.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59748.log.gz 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51240.log 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68997.log.gz 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72877.log 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69206.log 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51240.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51324.log.gz 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56514.log 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51240.log.gz 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69206.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72877.log.gz 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54470.log 2024-09-16T01:24:46.358 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69206.log.gz 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45051.log 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56514.log.gz 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59663.log 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54470.log.gz 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57082.log 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45051.log.gz 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43707.log 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57082.log: 89.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.59663.log.gz 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51114.log 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43707.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57082.log.gz 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53466.log 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51114.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30568.log 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43707.log.gz 2024-09-16T01:24:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53466.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.51114.log.gz -5 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73218.log 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.tmp-client.admin.30568.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.30568.log.gz 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53466.log.gz 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69411.log 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.a.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.73218.log.gz 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51156.log 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49892.log 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51156.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69411.log.gz 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54078.log 87.6% 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51156.log.gz 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61617.log 2024-09-16T01:24:46.360 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49892.log.gz 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.54078.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.48237.log 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.0.54078.log.gz 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70442.log 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61617.log.gz 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68197.log 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70442.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48237.log.gz 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50842.log 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70442.log.gz 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67166.log 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68197.log.gz 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51492.log 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50842.log.gz 2024-09-16T01:24:46.361 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59393.log 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67166.log.gz 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64394.log 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51492.log.gz 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59204.log 88.3% 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59393.log.gz 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56856.log 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64394.log.gz 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49407.log 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59204.log.gz 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42382.log 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56856.log.gz 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71600.log 2024-09-16T01:24:46.362 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49407.log.gz/var/log/ceph/ceph-client.admin.42382.log: 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68431.log 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42382.log.gz 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55464.log 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71600.log.gz 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64012.log 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55464.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68431.log.gz 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52142.log 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55464.log.gz 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65067.log 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64012.log.gz 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60121.log 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52142.log.gz 2024-09-16T01:24:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70270.log 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55590.log 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4%/var/log/ceph/ceph-client.admin.60121.log: -- replaced with /var/log/ceph/ceph-client.admin.65067.log.gz 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66558.log 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55590.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60121.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50247.log 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70270.log.gz 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66558.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55590.log.gz 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 88.1% 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66558.log.gz 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63190.log 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50247.log.gz 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48577.log 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59054.log 2024-09-16T01:24:46.364 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63190.log.gz 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66180.log 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8%/var/log/ceph/ceph-client.admin.59054.log: -- replaced with /var/log/ceph/ceph-client.admin.48577.log.gz 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72751.log 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59054.log.gz 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44504.log 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57885.log 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3%/var/log/ceph/ceph-client.admin.72751.log: -- replaced with /var/log/ceph/ceph-client.admin.66180.log.gz 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65404.log 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72751.log.gz 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44504.log.gz 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49976.log 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57885.log.gz 2024-09-16T01:24:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60205.log 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65404.log.gz 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66264.log 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49976.log.gz 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57250.log 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60205.log: /var/log/ceph/ceph-client.admin.66264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63377.log 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57250.log: 89.1% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60205.log.gz 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66264.log.gz 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57250.log.gz 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53298.log 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65446.log 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63377.log.gz/var/log/ceph/ceph-client.admin.53298.log: 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60163.log 2024-09-16T01:24:46.366 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53298.log.gz 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48535.log 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61144.log 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60163.log: 88.9%/var/log/ceph/ceph-client.admin.48535.log: -- replaced with /var/log/ceph/ceph-client.admin.65446.log.gz 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60163.log.gz 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48535.log.gz 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67566.log 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44773.log 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8%/var/log/ceph/ceph-client.admin.67566.log: -- replaced with /var/log/ceph/ceph-client.admin.61144.log.gz 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70089.log 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67566.log.gz 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62456.log 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44773.log: /var/log/ceph/ceph-client.admin.70089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47516.log 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62456.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44773.log.gz 2024-09-16T01:24:46.367 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70089.log.gz 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66054.log 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr: 91.2%/var/log/ceph/ceph-client.admin.47516.log: -- replaced with /var/log/ceph/ceph-client.admin.62456.log.gz 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43749.log 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47516.log.gz 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48619.log 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66054.log: /var/log/ceph/ceph-client.admin.43749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60247.log 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48619.log: 88.8% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66054.log.gz 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43749.log.gz 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48619.log.gz 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51366.log 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56956.log 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8%/var/log/ceph/ceph-client.admin.51366.log: -- replaced with /var/log/ceph/ceph-client.admin.60247.log.gz 2024-09-16T01:24:46.368 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61438.log 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51366.log.gz 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76075.log 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56956.log: /var/log/ceph/ceph-client.admin.61438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60664.log 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.76075.log: 88.2% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61438.log.gz 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56956.log.gz 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.76075.log.gz 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54428.log 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57418.log 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60664.log.gz 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41850.log 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54428.log.gz 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61228.log 2024-09-16T01:24:46.369 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73302.log 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41850.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57418.log.gz/var/log/ceph/ceph-client.admin.61228.log: 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41850.log.gz 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61228.log.gz 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69663.log 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62792.log 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47203.log 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.73302.log.gz 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69663.log.gz/var/log/ceph/ceph-client.admin.62792.log: 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53210.log 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49666.log 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62792.log.gz 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53210.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47203.log.gz 2024-09-16T01:24:46.370 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54156.log 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53210.log.gz 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52042.log 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49666.log: /var/log/ceph/ceph-client.admin.54156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50886.log 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52042.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49666.log.gz 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54156.log.gz 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51792.log 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52042.log.gz 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.50886.log: -- /var/log/ceph/ceph-mgr.y.log 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.51792.log: 88.6% 0.0% -- replaced with /var/log/ceph/ceph-client.0.51792.log.gz 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50886.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74431.log 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45177.log 2024-09-16T01:24:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.74431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52646.log 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45177.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74431.log.gz 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45177.log.gz 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75206.log 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70400.log 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75206.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52646.log.gz 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.75206.log.gz 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46637.log 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70400.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70400.log.gz 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52226.log 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65703.log 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52226.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46637.log.gz 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52226.log.gz 2024-09-16T01:24:46.372 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49724.log 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65703.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65703.log.gz 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51198.log 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64899.log 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51198.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49724.log.gz 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49934.log 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51198.log.gz 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64899.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64899.log.gz 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69039.log 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42287.log 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69039.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49934.log.gz 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69039.log.gz 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56472.log 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42287.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42287.log.gz 2024-09-16T01:24:46.373 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43959.log 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56472.log: /var/log/ceph/ceph-client.admin.43959.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56472.log.gz 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45303.log 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43959.log.gz 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.log: 86.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43272.log 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66600.log 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43272.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45303.log.gz 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52562.log 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66600.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66600.log.gz 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47119.log 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.43272.log.gz 2024-09-16T01:24:46.374 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52562.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52562.log.gz 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62714.log 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53634.log 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47119.log.gz 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.62714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62714.log.gz 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44183.log 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54825.log 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53634.log: /var/log/ceph/ceph-client.admin.44183.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53634.log.gz 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48098.log 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44183.log.gz 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54825.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54825.log.gz 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51965.log 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61697.log 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48098.log.gz 2024-09-16T01:24:46.375 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54951.log 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61697.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51965.log.gz 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61697.log.gz 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67212.log 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68955.log 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54951.log.gz 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51282.log 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68955.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67212.log.gz 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68955.log.gz 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75963.log 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57761.log 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51282.log.gz 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60706.log 2024-09-16T01:24:46.376 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57761.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.75963.log.gz 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57761.log.gz 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70928.log 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74296.log 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60706.log.gz 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61060.log 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1%/var/log/ceph/ceph-client.admin.74296.log: -- replaced with /var/log/ceph/ceph-client.admin.70928.log.gz 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74296.log.gz 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69579.log 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58868.log 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61060.log.gz 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51870.log 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69579.log.gz 2024-09-16T01:24:46.377 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58868.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58868.log.gz 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44001.log 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66096.log 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51870.log.gz 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72793.log 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66096.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44001.log.gz 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66096.log.gz 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55292.log 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50970.log 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72793.log.gz 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61480.log 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50970.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55292.log.gz 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50970.log.gz 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68777.log 2024-09-16T01:24:46.378 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63846.log 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61480.log.gz 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71408.log 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63846.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68777.log.gz 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63846.log.gz 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57843.log 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61102.log 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71408.log.gz 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69263.log 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61102.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57843.log.gz 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61102.log.gz 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75753.log 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67482.log 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69263.log.gz 2024-09-16T01:24:46.379 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48367.log 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67482.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.75753.log.gz 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67482.log.gz 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75543.log 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49015.log 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48367.log.gz 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63064.log 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.75543.log.gz 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49015.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49015.log.gz 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65761.log 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44516.log 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63064.log.gz 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45986.log 2024-09-16T01:24:46.380 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44516.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65761.log.gz 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44516.log.gz 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42766.log 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65211.log 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45986.log.gz 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56641.log 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65211.log: 89.4% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42766.log.gz 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65211.log.gz 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65971.log 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55548.log 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56641.log.gz 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48451.log 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55548.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65971.log.gz 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.55548.log.gz 2024-09-16T01:24:46.381 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54741.log 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52905.log 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48451.log.gz 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67950.log 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52905.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54741.log.gz 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52905.log.gz 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75417.log 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.67950.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47473.log 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.0.67950.log.gz 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44501.log 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75417.log: /var/log/ceph/ceph-client.admin.47473.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47473.log.gz 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.75417.log.gz 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48186.log 2024-09-16T01:24:46.382 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63419.log 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44501.log.gz 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74930.log 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63419.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48186.log.gz 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63419.log.gz 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49345.log 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63545.log 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74930.log: /var/log/ceph/ceph-client.admin.49345.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74930.log.gz 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67356.log 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49345.log.gz 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74119.log 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67356.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63545.log.gz 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67356.log.gz 2024-09-16T01:24:46.383 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56160.log 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60748.log 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.74119.log: /var/log/ceph/ceph-client.admin.56160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74119.log.gz 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44715.log 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56160.log.gz 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42514.log 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44715.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60748.log.gz 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44715.log.gzgzip 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.74761.log 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.42514.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64521.log 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42514.log.gz 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72396.log 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64521.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74761.log.gz 2024-09-16T01:24:46.384 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64521.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57927.log 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59934.log 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72396.log: /var/log/ceph/ceph-client.admin.57927.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72396.log.gz 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54783.log 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57927.log.gz 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58406.log 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54783.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59934.log.gz 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54783.log.gz 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66516.log 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55632.log 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58406.log: /var/log/ceph/ceph-client.admin.66516.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58406.log.gz 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66516.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.74123.log 2024-09-16T01:24:46.385 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54993.log 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55632.log: /var/log/ceph/ceph-client.0.74123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.74123.log.gz 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55632.log.gz 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70610.log 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70526.log 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54993.log.gz 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43917.log 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70526.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70610.log.gz 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70526.log.gz 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50289.log 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67524.log 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50289.log: /var/log/ceph/ceph-client.admin.43917.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43917.log.gz 2024-09-16T01:24:46.386 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50289.log.gz 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42183.log 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44519.log 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67524.log.gz 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69123.log 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44519.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42183.log.gz 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44519.log.gz 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42428.log 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67440.log 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69123.log: /var/log/ceph/ceph-client.admin.42428.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69123.log.gz 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58364.log 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42428.log.gz 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45135.log 2024-09-16T01:24:46.387 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67440.log: /var/log/ceph/ceph-client.admin.58364.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67440.log.gz 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58364.log.gz 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62414.log 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59435.log 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45135.log: /var/log/ceph/ceph-client.admin.62414.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45135.log.gz 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62414.log.gz 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46427.log 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52478.log 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59435.log.gz 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49808.log 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52478.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46427.log.gz 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52478.log.gz 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63503.log 2024-09-16T01:24:46.388 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44179.log 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49808.log: /var/log/ceph/ceph-client.admin.63503.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49808.log.gz 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58748.log 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63503.log.gz 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75501.log 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.58748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58748.log.gz 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44179.log.gz 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72103.log 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47371.log 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.75501.log.gz 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50331.log 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47371.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72103.log.gz 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47371.log.gz 2024-09-16T01:24:46.389 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67124.log 2024-09-16T01:24:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51788.log 2024-09-16T01:24:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67124.log: /var/log/ceph/ceph-client.admin.50331.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50331.log.gz 2024-09-16T01:24:46.390 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67124.log.gz 2024-09-16T01:24:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59621.log 2024-09-16T01:24:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45345.log 2024-09-16T01:24:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.51788.log: /var/log/ceph/ceph-client.admin.59621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51788.log.gz 2024-09-16T01:24:46.390 INFO:teuthology.orchestra.run.smithi081.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.59621.log.gz 2024-09-16T01:24:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53115.log 2024-09-16T01:24:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74201.log 2024-09-16T01:24:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45345.log: /var/log/ceph/ceph-client.admin.53115.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53115.log.gz 2024-09-16T01:24:46.390 INFO:teuthology.orchestra.run.smithi081.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45345.log.gz 2024-09-16T01:24:46.390 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58238.log 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58150.log 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74201.log.gz 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61312.log 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58150.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.58238.log.gz 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58150.log.gz 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61396.log 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56352.log 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61396.log: /var/log/ceph/ceph-client.admin.61312.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61312.log.gz 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61396.log.gz 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48937.log 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36876.log 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.56352.log: /var/log/ceph/ceph-client.0.48937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56352.log.gz 2024-09-16T01:24:46.391 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48937.log.gz 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56683.log 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51600.log 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36876.log.gz 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60349.log 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51600.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56683.log.gz 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51600.log.gz 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53550.log 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55884.log 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60349.log.gz 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71768.log 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6%/var/log/ceph/ceph-client.admin.55884.log: -- replaced with /var/log/ceph/ceph-client.admin.53550.log.gz 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55884.log.gz 2024-09-16T01:24:46.392 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54074.log 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70652.log 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71768.log.gz 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.54074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54074.log.gz 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67758.log 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56094.log 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70652.log.gz 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59976.log 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.67758.log.gz 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66474.log 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59976.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59976.log.gz 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56094.log.gz 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70484.log 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69369.log 2024-09-16T01:24:46.393 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.66474.log.gz 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59892.log 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69369.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70484.log.gz 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69369.log.gz 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74804.log 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45261.log 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59892.log: /var/log/ceph/ceph-client.admin.74804.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59892.log.gz 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45510.log 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74804.log.gz 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61863.log 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45261.log: /var/log/ceph/ceph-client.admin.45510.log: 88.5% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45261.log.gz 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45510.log.gz 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46679.log 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47845.log 2024-09-16T01:24:46.394 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61863.log.gz 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45219.log 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47845.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46679.log.gz 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47845.log.gz 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72448.log 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45219.log: -- /var/log/ceph/ceph-client.admin.65025.log 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45219.log.gz 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58826.log 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65025.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.72448.log.gz 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65025.log.gz 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72187.log 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67692.log 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58826.log.gz 2024-09-16T01:24:46.395 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44852.log 2024-09-16T01:24:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67692.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72187.log.gz 2024-09-16T01:24:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50457.log 2024-09-16T01:24:46.396 INFO:teuthology.orchestra.run.smithi081.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.67692.log.gz 2024-09-16T01:24:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48661.log 2024-09-16T01:24:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50457.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44852.log.gz 2024-09-16T01:24:46.396 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50457.log.gz 2024-09-16T01:24:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74846.log 2024-09-16T01:24:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.48661.log: -- /var/log/ceph/ceph-client.admin.62162.log 2024-09-16T01:24:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74846.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48661.log.gz 2024-09-16T01:24:46.396 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.74846.log.gz 2024-09-16T01:24:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71450.log 2024-09-16T01:24:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75879.log 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62162.log.gz 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73525.log 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75879.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71450.log.gz 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.75879.log.gz 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63148.log 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36611.log 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63148.log: /var/log/ceph/ceph-client.admin.73525.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63148.log.gz 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73525.log.gz 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48409.log 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47761.log 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36611.log.gz 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72919.log 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48409.log.gz/var/log/ceph/ceph-client.admin.47761.log: 2024-09-16T01:24:46.397 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72625.log 2024-09-16T01:24:46.398 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47761.log.gz 2024-09-16T01:24:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72709.log 2024-09-16T01:24:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72919.log: /var/log/ceph/ceph-client.admin.72625.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72919.log.gz 2024-09-16T01:24:46.398 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72625.log.gz 2024-09-16T01:24:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49588.log 2024-09-16T01:24:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64142.log 2024-09-16T01:24:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72709.log: /var/log/ceph/ceph-client.admin.49588.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72709.log.gz 2024-09-16T01:24:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53340.log 2024-09-16T01:24:46.398 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49588.log.gz/var/log/ceph/ceph-client.admin.64142.log: 2024-09-16T01:24:46.398 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64310.log 2024-09-16T01:24:46.398 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64142.log.gz 2024-09-16T01:24:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63022.log 2024-09-16T01:24:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64310.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53340.log.gz 2024-09-16T01:24:46.399 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64310.log.gz 2024-09-16T01:24:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42472.log 2024-09-16T01:24:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61522.log 2024-09-16T01:24:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63022.log: /var/log/ceph/ceph-client.admin.42472.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63022.log.gz 2024-09-16T01:24:46.399 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42472.log.gz 2024-09-16T01:24:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54698.log 2024-09-16T01:24:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65530.log 2024-09-16T01:24:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61522.log: /var/log/ceph/ceph-client.admin.54698.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61522.log.gz 2024-09-16T01:24:46.399 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54698.log.gzgzip 2024-09-16T01:24:46.399 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42724.log 2024-09-16T01:24:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43665.log 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42724.log: /var/log/ceph/ceph-client.admin.65530.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42724.log.gz 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65530.log.gz 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54512.log 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65362.log 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43665.log: /var/log/ceph/ceph-client.admin.54512.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43665.log.gz 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54512.log.gz 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60018.log 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65362.log: /var/log/ceph/ceph-osd.3.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.65362.log.gz 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56430.log 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60018.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60018.log.gz 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58108.log 2024-09-16T01:24:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56430.log: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56430.log.gz 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70312.log 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58108.log.gz 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74617.log 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70312.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70312.log.gz 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56998.log 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74617.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74617.log.gz 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48056.log 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56998.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56998.log.gz 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42331.log 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48056.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48056.log.gz 2024-09-16T01:24:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46294.log 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42331.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42331.log.gz 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67398.log 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.2.46294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46294.log.gz 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67398.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67398.log.gz 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71120.log 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50079.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66859.log 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.71120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71120.log.gz 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50028.log 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66859.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66859.log.gz 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52394.log 2024-09-16T01:24:46.402 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50028.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50028.log.gz 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64817.log 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52394.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52394.log.gz 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44854.log 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.64817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64817.log.gz 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42141.log 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44854.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44854.log.gz 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42640.log 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42141.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42141.log.gz 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58744.log 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42640.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42640.log.gz 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66696.log 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.58744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58744.log.gz 2024-09-16T01:24:46.403 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58448.log 2024-09-16T01:24:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66696.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66696.log.gz 2024-09-16T01:24:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63232.log 2024-09-16T01:24:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58448.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58448.log.gz 2024-09-16T01:24:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50756.log 2024-09-16T01:24:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63232.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63232.log.gz 2024-09-16T01:24:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73390.log 2024-09-16T01:24:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50756.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50756.log.gz 2024-09-16T01:24:46.404 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73390.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73390.log.gz 2024-09-16T01:24:46.405 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-16T01:24:46.819 INFO:teuthology.orchestra.run.smithi081.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-16T01:24:46.950 INFO:teuthology.orchestra.run.smithi081.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-16T01:24:47.156 INFO:teuthology.orchestra.run.smithi081.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-16T01:24:47.320 INFO:teuthology.orchestra.run.smithi081.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-16T01:24:47.413 INFO:teuthology.orchestra.run.smithi102.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-16T01:24:47.434 INFO:teuthology.orchestra.run.smithi102.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-16T01:24:47.496 INFO:teuthology.orchestra.run.smithi081.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-16T01:24:47.529 INFO:teuthology.orchestra.run.smithi102.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-16T01:24:47.633 INFO:teuthology.orchestra.run.smithi081.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-16T01:24:47.719 INFO:teuthology.orchestra.run.smithi102.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-16T01:24:47.804 INFO:teuthology.orchestra.run.smithi081.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-16T01:24:47.806 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-16T01:24:47.806 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m1.846s 2024-09-16T01:24:47.806 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m8.586s 2024-09-16T01:24:47.806 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.695s 2024-09-16T01:24:47.976 INFO:teuthology.orchestra.run.smithi102.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-16T01:24:47.979 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-16T01:24:47.979 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m1.988s 2024-09-16T01:24:47.979 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m8.400s 2024-09-16T01:24:47.979 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m0.306s 2024-09-16T01:24:47.980 INFO:tasks.ceph:Archiving logs... 2024-09-16T01:24:47.980 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453/remote/smithi081/log 2024-09-16T01:24:47.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:24:49.584 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453/remote/smithi102/log 2024-09-16T01:24:49.585 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T01:24:50.705 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T01:24:50.714 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T01:24:50.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:24:50.717 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T01:24:50.804 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T01:24:50.813 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T01:24:50.813 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:24:50.816 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T01:24:50.831 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:24:50.831 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-16T01:24:50.835 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:24:50.835 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-16T01:24:50.835 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 -405us[ -399us] +/- 51ms 2024-09-16T01:24:50.835 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 0 -101us[ -101us] +/- 48ms 2024-09-16T01:24:50.835 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +810us[ +810us] +/- 80ms 2024-09-16T01:24:50.835 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:24:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T01:24:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-16T01:24:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv01.front.sepia.ceph.com 3 6 377 0 -395us[ -371us] +/- 51ms 2024-09-16T01:24:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -117us[ -103us] +/- 47ms 2024-09-16T01:24:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +818us[ +842us] +/- 80ms 2024-09-16T01:24:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T01:24:50.837 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T01:24:50.846 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T01:24:50.847 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T01:24:50.856 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:24:50.962 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T01:24:51.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:24:51.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:24:51.063 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-16T01:24:51.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:24:51.092 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T01:24:51.102 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T01:24:51.111 INFO:teuthology.task.internal:Duration was 945.708955 seconds 2024-09-16T01:24:51.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T01:24:51.120 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T01:24:51.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:24:51.122 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T01:24:51.159 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:24:51.171 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T01:24:51.476 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T01:24:51.476 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-16T01:24:51.476 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:24:51.538 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-16T01:24:51.538 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T01:24:51.572 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T01:24:51.572 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:24:51.581 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T01:24:51.638 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T01:24:51.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:24:51.648 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T01:24:51.787 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T01:24:51.799 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T01:24:51.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:24:51.824 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T01:24:51.850 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T01:24:51.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:24:51.867 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:24:51.888 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-16T01:24:51.913 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-16T01:24:51.927 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:24:51.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:24:51.956 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T01:24:51.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T01:24:51.982 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T01:24:51.994 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T01:24:51.995 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453/remote/smithi081 2024-09-16T01:24:51.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:24:52.033 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906453/remote/smithi102 2024-09-16T01:24:52.033 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T01:24:52.066 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T01:24:52.067 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:24:52.070 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T01:24:52.117 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T01:24:52.129 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T01:24:52.129 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T01:24:52.139 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T01:24:52.139 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:24:52.142 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T01:24:52.154 INFO:teuthology.orchestra.run.smithi081.stdout: 265861 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:24 /home/ubuntu/cephtest 2024-09-16T01:24:52.171 INFO:teuthology.orchestra.run.smithi102.stdout: 265836 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 01:24 /home/ubuntu/cephtest 2024-09-16T01:24:52.172 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T01:24:52.182 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T01:24:52.207 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/client-limits} duration: 945.7089552879333 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-16T01:24:52.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T01:24:52.285 INFO:teuthology.run:pass